2021-03-10T13:37:59.050 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T13:37:59.053 DEBUG:teuthology.run:Teuthology command: teuthology --name sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba --owner scheduled_sage@teuthology --verbose --description rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} --archive /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953061 -- /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953061/orig.config.yaml 2021-03-10T13:37:59.087 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-10T13:37:59.138 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953061 branch: wip-sage-testing-2021-03-09-1434 description: rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} email: null first_in_suite: false job_id: '5953061' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-sage-testing-2021-03-09-1434 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b26fc080937a021ce826cdc94d1adb52c064381a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b26fc080937a021ce826cdc94d1adb52c064381a workunit: branch: cephadm-rgw-simplification sha1: fd39f244c71b258f156a77730a6203886f27efb2 owner: scheduled_sage@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: b26fc080937a021ce826cdc94d1adb52c064381a sleep_before_teardown: 0 suite: rados:cephadm:upgrade suite_branch: cephadm-rgw-simplification suite_path: /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: fd39f244c71b258f156a77730a6203886f27efb2 targets: gibba003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDP/aMO86+3V1wwrOMFaDiifRWs6dlVuymOdNYl2jZfBxZEwmV24Y657krxpfgCN8DM5i3fDmIrO0dSSxGbJGP8809y6FVBeYgLuCttLATozMDE7lU3pUsiZA5Dsskz/kuAbPhC3Z97vGzlkiDpnCC44yLObplOLwJ0SvcX55e9M2Rj2YjpXtnFRcc06G8CHn+CKeKaaDf8H9O+jQ/XhGDo7akk657lOQxFiM3jRUr/H1QByLEhuOJbGvn0FNWHU/i0tY3mtJdGMaEu/RGTfTbYRPJrqsXW+pGF0dAPcno+KSCpSChD7Ivog6h5D2qoWrwS8QAtwPbECJ+cmHlREtIhU3GQE5As+t0Y4Gomc2u9GiR4MgTpxbFKRGaOrp9ih3tg+cdGH7qeQXQ+eA+CskZFDjsSQ7iAEJntbJ2IycsMJONME425jbq6a+vtQ6CmUUi7cJppG7+sAGqIWQ8sojVC4qlkWXqtqCfwlJenijSJjLeMa4RmKOrl9EV++nef2Vs= gibba043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqTsW5pYSOX3d3LFx2HA4rtpQCDZD7JLFn8Ui68z6QTUsNRkfcyJQ6aWAUanLuHFHxuEgDW4l5unFuf5GtsosnUj0dTLSYUbvhZ8G4bCE/9wRxNMLrV2uEGf7ZIiWMsM9f8gLR6l02NRBbNC5C2pLkkUDo4hikgwNFT4bhnzctCQ7CkW58L2LEClzuX2mHEfx2ITW9gRr9oXyh+DCs+HvCHZgPQY0FjRUVjW3YCk24UxgrIBE096neUPWtBIy2uFkxIMz37i9zTzU+KBESsBN0Lejxwv72e15VNLc616avzPXq3RUIC7jZIwezxCJ+7B7EayOnNla2ct46yPia86HloSOAqHsDlfwtqszZmrcUh4ZytSIURzpNF9O0ls4Ag9b5eDtP/u7OJapAuMQkcSAOZML/MNGyycVv2rbq9hw2TF3oZdqGZnrGnGIyjYp2QKGoNMTodgunqn3Ng9WYGg8byHVBDj1Sk+6PGpbIwbP3pB8EdnQQw52SVJBXH9T/VTU= tasks: - cephadm: allow_ptrace: false cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=1 - sleep 120 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 teuthology_branch: master teuthology_sha1: b6eecfe89a4363750d696160843a096384b357a8 timestamp: 2021-03-10_13:21:20 tube: gibba user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.26181 2021-03-10T13:37:59.138 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa; will attempt to use it 2021-03-10T13:37:59.150 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa/tasks 2021-03-10T13:37:59.150 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-10T13:37:59.152 INFO:teuthology.task.internal:Checking packages... 2021-03-10T13:37:59.215 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b26fc080937a021ce826cdc94d1adb52c064381a' 2021-03-10T13:37:59.216 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-10T13:37:59.216 INFO:teuthology.packaging:ref: None 2021-03-10T13:37:59.217 INFO:teuthology.packaging:tag: None 2021-03-10T13:37:59.217 INFO:teuthology.packaging:branch: wip-sage-testing-2021-03-09-1434 2021-03-10T13:37:59.217 INFO:teuthology.packaging:sha1: b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:37:59.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-sage-testing-2021-03-09-1434 2021-03-10T13:37:59.356 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1749-gb26fc080-1focal 2021-03-10T13:37:59.356 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-10T13:37:59.367 INFO:teuthology.task.internal:no buildpackages task found 2021-03-10T13:37:59.368 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-10T13:37:59.445 INFO:teuthology.task.internal:Saving configuration 2021-03-10T13:37:59.458 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-10T13:37:59.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-10T13:37:59.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 13:32:51.666963', 'description': '/home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953061', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILy7He19j3frgK13wLegiOCrZzsZYe2tXQokuDMug1GZ', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba003.front.sepia.ceph.com'} 2021-03-10T13:37:59.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 13:32:51.666942', 'description': '/home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953061', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBY0G4fdHn/+BjHEbSnR/UDwW7DObjeh5XX4Y+Jy3LTe', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba043.front.sepia.ceph.com'} 2021-03-10T13:37:59.543 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-10T13:37:59.555 INFO:teuthology.task.internal:roles: ubuntu@gibba003.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-03-10T13:37:59.555 INFO:teuthology.task.internal:roles: ubuntu@gibba043.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-03-10T13:37:59.556 INFO:teuthology.run_tasks:Running task console_log... 2021-03-10T13:37:59.648 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f34d5f00598>, signals=[15]) 2021-03-10T13:37:59.649 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-10T13:37:59.660 INFO:teuthology.task.internal:Opening connections... 2021-03-10T13:37:59.661 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba003.front.sepia.ceph.com 2021-03-10T13:37:59.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:37:59.698 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba043.front.sepia.ceph.com 2021-03-10T13:37:59.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:37:59.731 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-10T13:37:59.741 DEBUG:teuthology.orchestra.run.gibba003:> uname -m 2021-03-10T13:37:59.746 INFO:teuthology.orchestra.run.gibba003.stdout:x86_64 2021-03-10T13:37:59.746 DEBUG:teuthology.orchestra.run.gibba003:> cat /etc/os-release 2021-03-10T13:37:59.795 INFO:teuthology.orchestra.run.gibba003.stdout:NAME="Ubuntu" 2021-03-10T13:37:59.795 INFO:teuthology.orchestra.run.gibba003.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T13:37:59.795 INFO:teuthology.orchestra.run.gibba003.stdout:ID=ubuntu 2021-03-10T13:37:59.796 INFO:teuthology.orchestra.run.gibba003.stdout:ID_LIKE=debian 2021-03-10T13:37:59.796 INFO:teuthology.orchestra.run.gibba003.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T13:37:59.796 INFO:teuthology.orchestra.run.gibba003.stdout:VERSION_ID="20.04" 2021-03-10T13:37:59.796 INFO:teuthology.orchestra.run.gibba003.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T13:37:59.796 INFO:teuthology.orchestra.run.gibba003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T13:37:59.797 INFO:teuthology.orchestra.run.gibba003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T13:37:59.797 INFO:teuthology.orchestra.run.gibba003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T13:37:59.797 INFO:teuthology.orchestra.run.gibba003.stdout:VERSION_CODENAME=focal 2021-03-10T13:37:59.797 INFO:teuthology.orchestra.run.gibba003.stdout:UBUNTU_CODENAME=focal 2021-03-10T13:37:59.798 INFO:teuthology.lock.ops:Updating gibba003.front.sepia.ceph.com on lock server 2021-03-10T13:37:59.813 DEBUG:teuthology.orchestra.run.gibba043:> uname -m 2021-03-10T13:37:59.818 INFO:teuthology.orchestra.run.gibba043.stdout:x86_64 2021-03-10T13:37:59.818 DEBUG:teuthology.orchestra.run.gibba043:> cat /etc/os-release 2021-03-10T13:37:59.869 INFO:teuthology.orchestra.run.gibba043.stdout:NAME="Ubuntu" 2021-03-10T13:37:59.870 INFO:teuthology.orchestra.run.gibba043.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T13:37:59.870 INFO:teuthology.orchestra.run.gibba043.stdout:ID=ubuntu 2021-03-10T13:37:59.870 INFO:teuthology.orchestra.run.gibba043.stdout:ID_LIKE=debian 2021-03-10T13:37:59.870 INFO:teuthology.orchestra.run.gibba043.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T13:37:59.871 INFO:teuthology.orchestra.run.gibba043.stdout:VERSION_ID="20.04" 2021-03-10T13:37:59.871 INFO:teuthology.orchestra.run.gibba043.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T13:37:59.871 INFO:teuthology.orchestra.run.gibba043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T13:37:59.871 INFO:teuthology.orchestra.run.gibba043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T13:37:59.871 INFO:teuthology.orchestra.run.gibba043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T13:37:59.872 INFO:teuthology.orchestra.run.gibba043.stdout:VERSION_CODENAME=focal 2021-03-10T13:37:59.872 INFO:teuthology.orchestra.run.gibba043.stdout:UBUNTU_CODENAME=focal 2021-03-10T13:37:59.872 INFO:teuthology.lock.ops:Updating gibba043.front.sepia.ceph.com on lock server 2021-03-10T13:37:59.885 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-10T13:37:59.898 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-10T13:37:59.957 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-10T13:37:59.958 DEBUG:teuthology.orchestra.run.gibba003:> test '!' -e /home/ubuntu/cephtest 2021-03-10T13:37:59.960 DEBUG:teuthology.orchestra.run.gibba043:> test '!' -e /home/ubuntu/cephtest 2021-03-10T13:37:59.967 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-10T13:38:00.018 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-10T13:38:00.018 DEBUG:teuthology.orchestra.run.gibba003:> test -z $(ls -A /var/lib/ceph) 2021-03-10T13:38:00.021 DEBUG:teuthology.orchestra.run.gibba043:> test -z $(ls -A /var/lib/ceph) 2021-03-10T13:38:00.032 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-10T13:38:00.113 INFO:teuthology.run_tasks:Running task kernel... 2021-03-10T13:38:00.180 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-10T13:38:00.181 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-10T13:38:00.182 DEBUG:teuthology.orchestra.run.gibba003:> uname -r 2021-03-10T13:38:00.190 INFO:teuthology.orchestra.run.gibba003.stdout:5.4.0-66-generic 2021-03-10T13:38:00.190 INFO:teuthology.task.kernel:Running kernel on gibba003: 5.4.0-66-generic 2021-03-10T13:38:00.191 DEBUG:teuthology.orchestra.run.gibba003:> sudo apt-get clean 2021-03-10T13:38:00.351 DEBUG:teuthology.orchestra.run.gibba003:> sudo apt-get update 2021-03-10T13:38:00.619 INFO:teuthology.orchestra.run.gibba003.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T13:38:00.630 INFO:teuthology.orchestra.run.gibba003.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T13:38:00.683 INFO:teuthology.orchestra.run.gibba003.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T13:38:01.008 INFO:teuthology.orchestra.run.gibba003.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [527 kB] 2021-03-10T13:38:01.009 INFO:teuthology.orchestra.run.gibba003.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T13:38:01.117 INFO:teuthology.orchestra.run.gibba003.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T13:38:01.312 INFO:teuthology.orchestra.run.gibba003.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T13:38:01.315 INFO:teuthology.orchestra.run.gibba003.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [199 kB] 2021-03-10T13:38:01.331 INFO:teuthology.orchestra.run.gibba003.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [113 kB] 2021-03-10T13:38:01.341 INFO:teuthology.orchestra.run.gibba003.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,208 B] 2021-03-10T13:38:01.341 INFO:teuthology.orchestra.run.gibba003.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T13:38:01.352 INFO:teuthology.orchestra.run.gibba003.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T13:38:01.353 INFO:teuthology.orchestra.run.gibba003.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T13:38:01.357 INFO:teuthology.orchestra.run.gibba003.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T13:38:01.372 INFO:teuthology.orchestra.run.gibba003.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T13:38:01.373 INFO:teuthology.orchestra.run.gibba003.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T13:38:01.382 INFO:teuthology.orchestra.run.gibba003.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T13:38:01.383 INFO:teuthology.orchestra.run.gibba003.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T13:38:01.414 INFO:teuthology.orchestra.run.gibba003.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T13:38:01.415 INFO:teuthology.orchestra.run.gibba003.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [545 kB] 2021-03-10T13:38:01.447 INFO:teuthology.orchestra.run.gibba003.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T13:38:01.452 INFO:teuthology.orchestra.run.gibba003.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T13:38:01.457 INFO:teuthology.orchestra.run.gibba003.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.6 kB] 2021-03-10T13:38:01.462 INFO:teuthology.orchestra.run.gibba003.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T13:38:03.415 INFO:teuthology.orchestra.run.gibba003.stdout:Fetched 5,542 kB in 1s (4,255 kB/s) 2021-03-10T13:38:04.334 INFO:teuthology.orchestra.run.gibba003.stdout:Reading package lists... 2021-03-10T13:38:04.345 DEBUG:teuthology.orchestra.run.gibba003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T13:38:04.380 INFO:teuthology.orchestra.run.gibba003.stdout:Reading package lists... 2021-03-10T13:38:04.471 INFO:teuthology.orchestra.run.gibba003.stdout:Building dependency tree... 2021-03-10T13:38:04.472 INFO:teuthology.orchestra.run.gibba003.stdout:Reading state information... 2021-03-10T13:38:04.514 INFO:teuthology.orchestra.run.gibba003.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T13:38:04.515 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T13:38:04.516 DEBUG:teuthology.orchestra.run.gibba003:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T13:38:04.601 INFO:teuthology.orchestra.run.gibba003.stdout:Reading package lists... 2021-03-10T13:38:04.695 INFO:teuthology.orchestra.run.gibba003.stdout:Building dependency tree... 2021-03-10T13:38:04.696 INFO:teuthology.orchestra.run.gibba003.stdout:Reading state information... 2021-03-10T13:38:04.781 INFO:teuthology.orchestra.run.gibba003.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T13:38:04.781 INFO:teuthology.orchestra.run.gibba003.stdout:linux-image-generic set to manually installed. 2021-03-10T13:38:04.781 INFO:teuthology.orchestra.run.gibba003.stdout:0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded. 2021-03-10T13:38:04.783 DEBUG:teuthology.orchestra.run.gibba003:> dpkg -s linux-image-generic 2021-03-10T13:38:04.793 INFO:teuthology.orchestra.run.gibba003.stdout:Package: linux-image-generic 2021-03-10T13:38:04.793 INFO:teuthology.orchestra.run.gibba003.stdout:Status: install ok installed 2021-03-10T13:38:04.793 INFO:teuthology.orchestra.run.gibba003.stdout:Priority: optional 2021-03-10T13:38:04.794 INFO:teuthology.orchestra.run.gibba003.stdout:Section: kernel 2021-03-10T13:38:04.794 INFO:teuthology.orchestra.run.gibba003.stdout:Installed-Size: 18 2021-03-10T13:38:04.794 INFO:teuthology.orchestra.run.gibba003.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T13:38:04.794 INFO:teuthology.orchestra.run.gibba003.stdout:Architecture: amd64 2021-03-10T13:38:04.795 INFO:teuthology.orchestra.run.gibba003.stdout:Source: linux-meta 2021-03-10T13:38:04.795 INFO:teuthology.orchestra.run.gibba003.stdout:Version: 5.4.0.66.69 2021-03-10T13:38:04.795 INFO:teuthology.orchestra.run.gibba003.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T13:38:04.795 INFO:teuthology.orchestra.run.gibba003.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T13:38:04.796 INFO:teuthology.orchestra.run.gibba003.stdout:Recommends: thermald 2021-03-10T13:38:04.796 INFO:teuthology.orchestra.run.gibba003.stdout:Description: Generic Linux kernel image 2021-03-10T13:38:04.796 INFO:teuthology.orchestra.run.gibba003.stdout: This package will always depend on the latest generic kernel image 2021-03-10T13:38:04.796 INFO:teuthology.orchestra.run.gibba003.stdout: available. 2021-03-10T13:38:04.797 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T13:38:04.797 DEBUG:teuthology.orchestra.run.gibba043:> uname -r 2021-03-10T13:38:04.806 INFO:teuthology.orchestra.run.gibba043.stdout:5.4.0-66-generic 2021-03-10T13:38:04.806 INFO:teuthology.task.kernel:Running kernel on gibba043: 5.4.0-66-generic 2021-03-10T13:38:04.807 DEBUG:teuthology.orchestra.run.gibba043:> sudo apt-get clean 2021-03-10T13:38:04.931 DEBUG:teuthology.orchestra.run.gibba043:> sudo apt-get update 2021-03-10T13:38:05.184 INFO:teuthology.orchestra.run.gibba043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T13:38:05.185 INFO:teuthology.orchestra.run.gibba043.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T13:38:05.239 INFO:teuthology.orchestra.run.gibba043.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T13:38:05.568 INFO:teuthology.orchestra.run.gibba043.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [527 kB] 2021-03-10T13:38:05.574 INFO:teuthology.orchestra.run.gibba043.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T13:38:05.674 INFO:teuthology.orchestra.run.gibba043.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T13:38:05.871 INFO:teuthology.orchestra.run.gibba043.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T13:38:05.886 INFO:teuthology.orchestra.run.gibba043.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [199 kB] 2021-03-10T13:38:05.901 INFO:teuthology.orchestra.run.gibba043.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [113 kB] 2021-03-10T13:38:05.910 INFO:teuthology.orchestra.run.gibba043.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,208 B] 2021-03-10T13:38:05.911 INFO:teuthology.orchestra.run.gibba043.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T13:38:05.918 INFO:teuthology.orchestra.run.gibba043.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T13:38:05.922 INFO:teuthology.orchestra.run.gibba043.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T13:38:05.924 INFO:teuthology.orchestra.run.gibba043.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [545 kB] 2021-03-10T13:38:05.933 INFO:teuthology.orchestra.run.gibba043.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T13:38:05.934 INFO:teuthology.orchestra.run.gibba043.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T13:38:05.941 INFO:teuthology.orchestra.run.gibba043.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T13:38:05.942 INFO:teuthology.orchestra.run.gibba043.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T13:38:05.990 INFO:teuthology.orchestra.run.gibba043.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T13:38:05.998 INFO:teuthology.orchestra.run.gibba043.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T13:38:06.012 INFO:teuthology.orchestra.run.gibba043.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T13:38:06.015 INFO:teuthology.orchestra.run.gibba043.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T13:38:06.029 INFO:teuthology.orchestra.run.gibba043.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.6 kB] 2021-03-10T13:38:06.035 INFO:teuthology.orchestra.run.gibba043.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T13:38:08.054 INFO:teuthology.orchestra.run.gibba043.stdout:Fetched 5,542 kB in 1s (4,334 kB/s) 2021-03-10T13:38:09.096 INFO:teuthology.orchestra.run.gibba043.stdout:Reading package lists... 2021-03-10T13:38:09.107 DEBUG:teuthology.orchestra.run.gibba043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T13:38:09.141 INFO:teuthology.orchestra.run.gibba043.stdout:Reading package lists... 2021-03-10T13:38:09.236 INFO:teuthology.orchestra.run.gibba043.stdout:Building dependency tree... 2021-03-10T13:38:09.237 INFO:teuthology.orchestra.run.gibba043.stdout:Reading state information... 2021-03-10T13:38:09.279 INFO:teuthology.orchestra.run.gibba043.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T13:38:09.280 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T13:38:09.281 DEBUG:teuthology.orchestra.run.gibba043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T13:38:09.316 INFO:teuthology.orchestra.run.gibba043.stdout:Reading package lists... 2021-03-10T13:38:09.408 INFO:teuthology.orchestra.run.gibba043.stdout:Building dependency tree... 2021-03-10T13:38:09.408 INFO:teuthology.orchestra.run.gibba043.stdout:Reading state information... 2021-03-10T13:38:09.492 INFO:teuthology.orchestra.run.gibba043.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T13:38:09.492 INFO:teuthology.orchestra.run.gibba043.stdout:linux-image-generic set to manually installed. 2021-03-10T13:38:09.493 INFO:teuthology.orchestra.run.gibba043.stdout:0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded. 2021-03-10T13:38:09.494 DEBUG:teuthology.orchestra.run.gibba043:> dpkg -s linux-image-generic 2021-03-10T13:38:09.547 INFO:teuthology.orchestra.run.gibba043.stdout:Package: linux-image-generic 2021-03-10T13:38:09.548 INFO:teuthology.orchestra.run.gibba043.stdout:Status: install ok installed 2021-03-10T13:38:09.548 INFO:teuthology.orchestra.run.gibba043.stdout:Priority: optional 2021-03-10T13:38:09.548 INFO:teuthology.orchestra.run.gibba043.stdout:Section: kernel 2021-03-10T13:38:09.548 INFO:teuthology.orchestra.run.gibba043.stdout:Installed-Size: 18 2021-03-10T13:38:09.549 INFO:teuthology.orchestra.run.gibba043.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T13:38:09.549 INFO:teuthology.orchestra.run.gibba043.stdout:Architecture: amd64 2021-03-10T13:38:09.549 INFO:teuthology.orchestra.run.gibba043.stdout:Source: linux-meta 2021-03-10T13:38:09.549 INFO:teuthology.orchestra.run.gibba043.stdout:Version: 5.4.0.66.69 2021-03-10T13:38:09.550 INFO:teuthology.orchestra.run.gibba043.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T13:38:09.550 INFO:teuthology.orchestra.run.gibba043.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T13:38:09.550 INFO:teuthology.orchestra.run.gibba043.stdout:Recommends: thermald 2021-03-10T13:38:09.550 INFO:teuthology.orchestra.run.gibba043.stdout:Description: Generic Linux kernel image 2021-03-10T13:38:09.551 INFO:teuthology.orchestra.run.gibba043.stdout: This package will always depend on the latest generic kernel image 2021-03-10T13:38:09.551 INFO:teuthology.orchestra.run.gibba043.stdout: available. 2021-03-10T13:38:09.551 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T13:38:09.552 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-10T13:38:09.552 DEBUG:teuthology.orchestra.run.gibba003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T13:38:09.572 INFO:teuthology.orchestra.run.gibba003.stdout:ttyS1 2021-03-10T13:38:09.616 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-10T13:38:09.616 DEBUG:teuthology.orchestra.run.gibba043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T13:38:09.635 INFO:teuthology.orchestra.run.gibba043.stdout:ttyS1 2021-03-10T13:38:09.659 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-10T13:38:09.667 INFO:teuthology.task.internal:Creating test directory... 2021-03-10T13:38:09.667 DEBUG:teuthology.orchestra.run.gibba003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T13:38:09.670 DEBUG:teuthology.orchestra.run.gibba043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T13:38:09.676 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-10T13:38:09.713 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-10T13:38:09.796 INFO:teuthology.task.internal:Creating archive directory... 2021-03-10T13:38:09.797 DEBUG:teuthology.orchestra.run.gibba003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T13:38:09.800 DEBUG:teuthology.orchestra.run.gibba043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T13:38:09.814 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-10T13:38:09.861 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-10T13:38:09.862 DEBUG:teuthology.orchestra.run.gibba003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T13:38:09.865 DEBUG:teuthology.orchestra.run.gibba043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T13:38:09.890 INFO:teuthology.orchestra.run.gibba003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:38:09.892 INFO:teuthology.orchestra.run.gibba043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:38:09.899 INFO:teuthology.orchestra.run.gibba003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:38:09.906 INFO:teuthology.orchestra.run.gibba043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:38:09.908 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-10T13:38:09.915 INFO:teuthology.task.internal:Configuring sudo... 2021-03-10T13:38:09.915 DEBUG:teuthology.orchestra.run.gibba003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T13:38:09.917 DEBUG:teuthology.orchestra.run.gibba043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T13:38:09.970 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-10T13:38:09.983 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-10T13:38:09.984 DEBUG:teuthology.orchestra.run.gibba003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T13:38:09.987 DEBUG:teuthology.orchestra.run.gibba043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T13:38:09.996 DEBUG:teuthology.orchestra.run.gibba003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T13:38:10.043 DEBUG:teuthology.orchestra.run.gibba003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T13:38:10.053 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:38:10.053 DEBUG:teuthology.orchestra.run.gibba003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T13:38:10.067 DEBUG:teuthology.orchestra.run.gibba043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T13:38:10.073 DEBUG:teuthology.orchestra.run.gibba043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T13:38:10.122 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:38:10.123 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T13:38:10.142 DEBUG:teuthology.orchestra.run.gibba003:> sudo service rsyslog restart 2021-03-10T13:38:10.145 DEBUG:teuthology.orchestra.run.gibba043:> sudo service rsyslog restart 2021-03-10T13:38:10.187 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-10T13:38:10.205 INFO:teuthology.task.internal:Starting timer... 2021-03-10T13:38:10.206 INFO:teuthology.run_tasks:Running task pcp... 2021-03-10T13:38:10.347 INFO:teuthology.run_tasks:Running task selinux... 2021-03-10T13:38:10.395 DEBUG:teuthology.task.selinux:Excluding gibba003: OS 'ubuntu' does not support SELinux 2021-03-10T13:38:10.396 DEBUG:teuthology.task.selinux:Excluding gibba043: OS 'ubuntu' does not support SELinux 2021-03-10T13:38:10.396 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-10T13:38:10.396 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-10T13:38:10.396 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-10T13:38:10.397 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-10T13:38:10.435 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-03-10T13:38:10.451 INFO:teuthology.repo_utils:Fetching master from origin 2021-03-10T13:38:10.659 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-10T13:38:10.878 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-10T13:38:10.881 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba003.front.sepia.ceph.com,gibba043.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-10T13:38:11.350 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-10T13:38:12.702 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-10T13:38:14.709 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-10T13:38:14.748 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:14 +0000 (0:00:00.065) 0:00:00.065 ******* 2021-03-10T13:38:14.761 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:14 +0000 (0:00:00.012) 0:00:00.078 ******* 2021-03-10T13:38:16.554 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T13:38:16.556 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba003.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba003.front.sepia.ceph.com] 2021-03-10T13:38:16.603 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:16 +0000 (0:00:01.842) 0:00:01.920 ******* 2021-03-10T13:38:16.623 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba043.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba043.front.sepia.ceph.com] 2021-03-10T13:38:16.671 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:16 +0000 (0:00:00.067) 0:00:01.988 ******* 2021-03-10T13:38:16.831 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-10T13:38:16.833 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:38:16.853 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:16 +0000 (0:00:00.181) 0:00:02.170 ******* 2021-03-10T13:38:16.870 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:16 +0000 (0:00:00.017) 0:00:02.187 ******* 2021-03-10T13:38:17.431 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-10T13:38:17.433 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} changed: [gibba043.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T13:38:17.455 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:17 +0000 (0:00:00.584) 0:00:02.772 ******* 2021-03-10T13:38:17.472 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:17 +0000 (0:00:00.016) 0:00:02.789 ******* 2021-03-10T13:38:17.755 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-10T13:38:17.756 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.053631", "end": "2021-03-10 13:38:18.190361", "rc": 0, "start": "2021-03-10 13:38:18.136730", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T13:38:17.776 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:17 +0000 (0:00:00.304) 0:00:03.093 ******* 2021-03-10T13:38:17.781 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.050379", "end": "2021-03-10 13:38:17.808694", "rc": 0, "start": "2021-03-10 13:38:17.758315", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T13:38:17.805 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:17 +0000 (0:00:00.029) 0:00:03.122 ******* 2021-03-10T13:38:17.985 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-10T13:38:17.987 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:38:18.008 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:18 +0000 (0:00:00.203) 0:00:03.326 ******* 2021-03-10T13:38:18.025 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:18 +0000 (0:00:00.016) 0:00:03.342 ******* 2021-03-10T13:38:18.679 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-10T13:38:18.681 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383498.0351603-643-255791764843261/source", "state": "file", "uid": 0} 2021-03-10T13:38:18.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:18 +0000 (0:00:00.675) 0:00:04.017 ******* 2021-03-10T13:38:18.706 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383498.0522323-645-55408193285428/source", "state": "file", "uid": 0} 2021-03-10T13:38:18.729 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:18 +0000 (0:00:00.028) 0:00:04.046 ******* 2021-03-10T13:38:19.105 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-10T13:38:19.107 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T13:38:19.109 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T13:38:19.127 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T13:38:19.129 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T13:38:19.198 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-10T13:38:19.201 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-10T13:38:19.343 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:19 +0000 (0:00:00.614) 0:00:04.660 ******* 2021-03-10T13:38:19.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:19 +0000 (0:00:00.019) 0:00:04.679 ******* 2021-03-10T13:38:20.033 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba003.front.sepia.ceph.com] 2021-03-10T13:38:20.065 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-03-10T13:38:20.097 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-10T13:38:20.101 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.734) 0:00:05.414 ******* 2021-03-10T13:38:20.143 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.046) 0:00:05.460 ******* 2021-03-10T13:38:20.757 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-10T13:38:20.759 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.386464", "end": "2021-03-10 13:38:20.735813", "rc": 0, "start": "2021-03-10 13:38:20.349349", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.431778", "end": "2021-03-10 13:38:20.738442", "rc": 0, "start": "2021-03-10 13:38:20.306664", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T13:38:20.781 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.637) 0:00:06.098 ******* 2021-03-10T13:38:20.801 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.019) 0:00:06.118 ******* 2021-03-10T13:38:20.879 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-10T13:38:20.881 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006528", "end": "2021-03-10 13:38:20.939739", "failed_when_result": false, "rc": 0, "start": "2021-03-10 13:38:20.933211", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T13:38:20.908 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.107) 0:00:06.225 ******* 2021-03-10T13:38:20.915 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012407", "end": "2021-03-10 13:38:21.340046", "failed_when_result": false, "rc": 0, "start": "2021-03-10 13:38:21.327639", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T13:38:20.940 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.031) 0:00:06.257 ******* 2021-03-10T13:38:20.967 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-10T13:38:20.968 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:20.991 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:20 +0000 (0:00:00.051) 0:00:06.308 ******* 2021-03-10T13:38:21.007 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.031 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.040) 0:00:06.348 ******* 2021-03-10T13:38:21.058 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T13:38:21.059 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.082 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.050) 0:00:06.399 ******* 2021-03-10T13:38:21.098 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.122 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.040) 0:00:06.439 ******* 2021-03-10T13:38:21.148 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T13:38:21.150 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.173 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.050) 0:00:06.490 ******* 2021-03-10T13:38:21.189 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.039) 0:00:06.530 ******* 2021-03-10T13:38:21.239 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-10T13:38:21.241 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.262 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.049) 0:00:06.579 ******* 2021-03-10T13:38:21.278 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.040) 0:00:06.619 ******* 2021-03-10T13:38:21.328 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-10T13:38:21.330 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.352 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.049) 0:00:06.669 ******* 2021-03-10T13:38:21.367 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:21.391 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.038) 0:00:06.708 ******* 2021-03-10T13:38:21.499 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-10T13:38:21.501 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:38:21.527 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.135) 0:00:06.844 ******* 2021-03-10T13:38:21.533 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:38:21.559 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:21 +0000 (0:00:00.032) 0:00:06.876 ******* 2021-03-10T13:38:21.699 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:38:21.701 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T13:38:21.742 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T13:38:21.795 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T13:38:21.827 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T13:38:21.881 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T13:38:21.923 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T13:38:21.976 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T13:38:22.008 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T13:38:22.073 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T13:38:22.105 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T13:38:22.160 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T13:38:22.192 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T13:38:22.255 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T13:38:22.277 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T13:38:22.341 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T13:38:22.373 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T13:38:22.425 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T13:38:22.457 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T13:38:22.551 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T13:38:22.552 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T13:38:22.636 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T13:38:22.648 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T13:38:22.732 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T13:38:22.733 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T13:38:22.817 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T13:38:22.829 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T13:38:22.902 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T13:38:22.914 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T13:38:22.997 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T13:38:22.998 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T13:38:23.093 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T13:38:23.135 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T13:38:23.177 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T13:38:23.219 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T13:38:23.272 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T13:38:23.314 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T13:38:23.367 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T13:38:23.399 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T13:38:23.462 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T13:38:23.494 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T13:38:23.546 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T13:38:23.578 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T13:38:23.631 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T13:38:23.663 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T13:38:23.727 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T13:38:23.759 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T13:38:23.811 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T13:38:23.843 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T13:38:23.906 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T13:38:23.938 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T13:38:23.991 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T13:38:24.023 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T13:38:24.075 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T13:38:24.118 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T13:38:24.160 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T13:38:24.203 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T13:38:24.256 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T13:38:24.288 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T13:38:24.340 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T13:38:24.413 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T13:38:24.435 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T13:38:24.498 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T13:38:24.520 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T13:38:24.593 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T13:38:24.615 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T13:38:24.679 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T13:38:24.711 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T13:38:24.774 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T13:38:24.795 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T13:38:24.869 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T13:38:24.880 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T13:38:24.953 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T13:38:24.975 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T13:38:25.058 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T13:38:25.090 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T13:38:25.153 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:38:25.186 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T13:38:25.238 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T13:38:25.312 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:38:25.334 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T13:38:25.397 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T13:38:25.419 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T13:38:25.482 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T13:38:25.504 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T13:38:25.577 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T13:38:25.599 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T13:38:25.662 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T13:38:25.684 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T13:38:25.760 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T13:38:25.782 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T13:38:25.855 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T13:38:25.877 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:38:25.950 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T13:38:25.962 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T13:38:26.045 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:38:26.057 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T13:38:26.130 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T13:38:26.142 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T13:38:26.227 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T13:38:26.239 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T13:38:26.322 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T13:38:26.323 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T13:38:26.407 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T13:38:26.418 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T13:38:26.501 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T13:38:26.502 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T13:38:26.596 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T13:38:26.597 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T13:38:26.681 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T13:38:26.693 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T13:38:26.776 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T13:38:26.777 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T13:38:26.882 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T13:38:26.883 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T13:38:26.966 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T13:38:26.967 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T13:38:27.061 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T13:38:27.062 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T13:38:27.146 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T13:38:27.157 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T13:38:27.241 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T13:38:27.242 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T13:38:27.325 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T13:38:27.368 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T13:38:27.420 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:38:27.463 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T13:38:27.506 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T13:38:27.548 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T13:38:27.601 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T13:38:27.634 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:38:27.686 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T13:38:27.760 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T13:38:27.772 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T13:38:27.845 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T13:38:27.856 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T13:38:27.929 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T13:38:27.951 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T13:38:28.025 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T13:38:28.046 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T13:38:28.109 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T13:38:28.131 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T13:38:28.204 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T13:38:28.226 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T13:38:28.290 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T13:38:28.321 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T13:38:28.373 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T13:38:28.406 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T13:38:28.468 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T13:38:28.490 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T13:38:28.553 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T13:38:28.575 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T13:38:28.649 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T13:38:28.660 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T13:38:28.734 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T13:38:28.746 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T13:38:28.829 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T13:38:28.841 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T13:38:28.915 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T13:38:28.926 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T13:38:29.021 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T13:38:29.023 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T13:38:29.107 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T13:38:29.108 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T13:38:29.191 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T13:38:29.203 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T13:38:29.287 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T13:38:29.289 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T13:38:29.372 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T13:38:29.373 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T13:38:29.467 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T13:38:29.468 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T13:38:29.562 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T13:38:29.563 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T13:38:29.647 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T13:38:29.658 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T13:38:29.743 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T13:38:29.744 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T13:38:29.838 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T13:38:29.870 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T13:38:29.933 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T13:38:29.955 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T13:38:30.028 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T13:38:30.050 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T13:38:30.113 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T13:38:30.135 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T13:38:30.208 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T13:38:30.240 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T13:38:30.303 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T13:38:30.324 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T13:38:30.387 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T13:38:30.409 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T13:38:30.473 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T13:38:30.494 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T13:38:30.557 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T13:38:30.630 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T13:38:30.652 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T13:38:30.725 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T13:38:30.737 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T13:38:30.821 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T13:38:30.833 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:38:30.906 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T13:38:30.917 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T13:38:31.000 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T13:38:31.001 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T13:38:31.095 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T13:38:31.096 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T13:38:31.180 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T13:38:31.181 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:38:31.264 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T13:38:31.276 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T13:38:31.359 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T13:38:31.360 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T13:38:31.443 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T13:38:31.455 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T13:38:31.528 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T13:38:31.550 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T13:38:31.623 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T13:38:31.634 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T13:38:31.718 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T13:38:31.740 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T13:38:31.803 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T13:38:31.824 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T13:38:31.887 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T13:38:31.909 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T13:38:31.972 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T13:38:31.994 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T13:38:32.067 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T13:38:32.089 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T13:38:32.152 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T13:38:32.173 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T13:38:32.236 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T13:38:32.310 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T13:38:32.332 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T13:38:32.396 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T13:38:32.418 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T13:38:32.480 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T13:38:32.502 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T13:38:32.575 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T13:38:32.597 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T13:38:32.681 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T13:38:32.682 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T13:38:32.766 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T13:38:32.768 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T13:38:32.861 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T13:38:32.862 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T13:38:32.946 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T13:38:32.957 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T13:38:33.041 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T13:38:33.042 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T13:38:33.136 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T13:38:33.137 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T13:38:33.221 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T13:38:33.222 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T13:38:33.315 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T13:38:33.358 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T13:38:33.453 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T13:38:33.536 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T13:38:33.547 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T13:38:33.631 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T13:38:33.643 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T13:38:33.716 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T13:38:33.738 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T13:38:33.811 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T13:38:33.822 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T13:38:33.906 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T13:38:33.907 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T13:38:33.991 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T13:38:34.003 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T13:38:34.087 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T13:38:34.088 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T13:38:34.172 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T13:38:34.174 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T13:38:34.258 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T13:38:34.269 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T13:38:34.384 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:34 +0000 (0:00:12.824) 0:00:19.701 ******* 2021-03-10T13:38:34.441 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T13:38:34.464 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:34 +0000 (0:00:00.080) 0:00:19.781 ******* 2021-03-10T13:38:34.480 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:38:34.482 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T13:38:34.545 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T13:38:34.547 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T13:38:34.549 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T13:38:34.550 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T13:38:34.552 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T13:38:34.554 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw 2021-03-10T13:38:34.554 INFO:teuthology.task.ansible.out: fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T13:38:34.556 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T13:38:34.558 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T13:38:34.559 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T13:38:34.561 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T13:38:34.562 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArN 2021-03-10T13:38:34.563 INFO:teuthology.task.ansible.out:hsAMXq/nkSC9tKDig 131b8214b 2021-03-10T13:38:34.564 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T13:38:34.566 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T13:38:34.568 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T13:38:34.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:34 +0000 (0:00:00.127) 0:00:19.909 ******* 2021-03-10T13:38:34.599 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:38:34.599 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T13:38:34.694 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T13:38:34.799 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T13:38:35.005 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:35 +0000 (0:00:00.412) 0:00:20.322 ******* 2021-03-10T13:38:35.065 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T13:38:35.089 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:35 +0000 (0:00:00.084) 0:00:20.406 ******* 2021-03-10T13:38:35.170 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T13:38:35.172 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T13:38:35.174 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T13:38:35.176 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T13:38:35.177 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\n 2021-03-10T13:38:35.178 INFO:teuthology.task.ansible.out:yehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T13:38:35.179 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T13:38:35.181 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T13:38:35.183 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T13:38:35.184 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T13:38:35.186 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T13:38:35.188 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T13:38:35.189 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ov 2021-03-10T13:38:35.190 INFO:teuthology.task.ansible.out:pn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T13:38:35.191 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T13:38:35.193 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T13:38:35.217 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:35 +0000 (0:00:00.127) 0:00:20.534 ******* 2021-03-10T13:38:35.566 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-10T13:38:35.568 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T13:38:35.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:35 +0000 (0:00:00.374) 0:00:20.909 ******* 2021-03-10T13:38:35.785 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T13:38:35.786 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:38:35.786 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T13:38:35.811 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:35 +0000 (0:00:00.219) 0:00:21.128 ******* 2021-03-10T13:38:35.890 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T13:38:35.995 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T13:38:35.997 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T13:38:36.091 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T13:38:36.102 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T13:38:36.104 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T13:38:36.196 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T13:38:36.207 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T13:38:36.325 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T13:38:36.327 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+B 2021-03-10T13:38:36.328 INFO:teuthology.task.ansible.out:KRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T13:38:36.420 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T13:38:36.432 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T13:38:36.536 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T13:38:36.558 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T13:38:36.559 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T13:38:36.641 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T13:38:36.652 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:36.767 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T13:38:36.769 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T13:38:36.872 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T13:38:36.874 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:36.883 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:36.987 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T13:38:37.020 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T13:38:37.094 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T13:38:37.096 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T13:38:37.167 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T13:38:37.179 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:37.200 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T13:38:37.284 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T13:38:37.286 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T13:38:37.305 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T13:38:37.307 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T13:38:37.378 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T13:38:37.380 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:37.390 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:37.401 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T13:38:37.484 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T13:38:37.505 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T13:38:37.588 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T13:38:37.590 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T13:38:37.610 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T13:38:37.683 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T13:38:37.715 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T13:38:37.717 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T13:38:37.778 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T13:38:37.780 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T13:38:37.810 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T13:38:37.811 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T13:38:37.872 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T13:38:37.904 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T13:38:37.956 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T13:38:38.019 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T13:38:38.040 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T13:38:38.124 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T13:38:38.125 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T13:38:38.187 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T13:38:38.189 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T13:38:38.219 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T13:38:38.282 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T13:38:38.284 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T13:38:38.313 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T13:38:38.365 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T13:38:38.397 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T13:38:38.449 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T13:38:38.491 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T13:38:38.544 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T13:38:38.545 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T13:38:38.575 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T13:38:38.628 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T13:38:38.691 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T13:38:38.692 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T13:38:38.723 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T13:38:38.796 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T13:38:38.827 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T13:38:38.900 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T13:38:38.911 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T13:38:39.005 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T13:38:39.016 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T13:38:39.110 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T13:38:39.112 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T13:38:39.205 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T13:38:39.206 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T13:38:39.290 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T13:38:39.301 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T13:38:39.385 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T13:38:39.417 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:38:39.479 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T13:38:39.542 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T13:38:39.574 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T13:38:39.626 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T13:38:39.668 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T13:38:39.711 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T13:38:39.713 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T13:38:39.764 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:38:39.816 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T13:38:39.818 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T13:38:39.889 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T13:38:39.921 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T13:38:39.994 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T13:38:40.006 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T13:38:40.100 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T13:38:40.102 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T13:38:40.184 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T13:38:40.186 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T13:38:40.195 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T13:38:40.197 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:38:40.281 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T13:38:40.292 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T13:38:40.294 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T13:38:40.295 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T13:38:40.365 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T13:38:40.386 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T13:38:40.459 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T13:38:40.471 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T13:38:40.554 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T13:38:40.556 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T13:38:40.648 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T13:38:40.649 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T13:38:40.651 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T13:38:40.652 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T13:38:40.743 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T13:38:40.745 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T13:38:40.837 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T13:38:40.849 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T13:38:40.850 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T13:38:40.932 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T13:38:40.943 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T13:38:41.036 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T13:38:41.038 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T13:38:41.121 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T13:38:41.132 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T13:38:41.134 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T13:38:41.216 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T13:38:41.217 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T13:38:41.227 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T13:38:41.300 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T13:38:41.321 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T13:38:41.384 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T13:38:41.415 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T13:38:41.417 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T13:38:41.478 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T13:38:41.480 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T13:38:41.510 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T13:38:41.562 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T13:38:41.604 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T13:38:41.656 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T13:38:41.688 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T13:38:41.741 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T13:38:41.742 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T13:38:41.782 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:38:41.835 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T13:38:41.877 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T13:38:41.919 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T13:38:41.962 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T13:38:42.014 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T13:38:42.056 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T13:38:42.098 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:38:42.140 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T13:38:42.182 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T13:38:42.224 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T13:38:42.266 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T13:38:42.320 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T13:38:42.362 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T13:38:42.404 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T13:38:42.446 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T13:38:42.488 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T13:38:42.530 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T13:38:42.582 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T13:38:42.624 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T13:38:42.666 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T13:38:42.718 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T13:38:42.771 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T13:38:42.802 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T13:38:42.876 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T13:38:42.887 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T13:38:42.970 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T13:38:42.971 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T13:38:43.064 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T13:38:43.065 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T13:38:43.149 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T13:38:43.180 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T13:38:43.243 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T13:38:43.295 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T13:38:43.337 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T13:38:43.339 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T13:38:43.380 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T13:38:43.432 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T13:38:43.484 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T13:38:43.516 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T13:38:43.558 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T13:38:43.600 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T13:38:43.652 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T13:38:43.654 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T13:38:43.694 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T13:38:43.746 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T13:38:43.788 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T13:38:43.790 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T13:38:43.840 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T13:38:43.872 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T13:38:43.874 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T13:38:43.966 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T13:38:43.967 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T13:38:44.050 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T13:38:44.061 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T13:38:44.145 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T13:38:44.146 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T13:38:44.239 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T13:38:44.241 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T13:38:44.271 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T13:38:44.367 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T13:38:44.378 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T13:38:44.451 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T13:38:44.462 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T13:38:44.546 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T13:38:44.548 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T13:38:44.632 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T13:38:44.634 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T13:38:44.643 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T13:38:44.727 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T13:38:44.738 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T13:38:44.810 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T13:38:44.821 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T13:38:44.905 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T13:38:44.906 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T13:38:44.989 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T13:38:44.990 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T13:38:44.991 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T13:38:45.073 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T13:38:45.580 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} ok: [ 2021-03-10T13:38:45.581 INFO:teuthology.task.ansible.out:gibba003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX 2021-03-10T13:38:45.583 INFO:teuthology.task.ansible.out:2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYX 2021-03-10T13:38:45.585 INFO:teuthology.task.ansible.out:jnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9 2021-03-10T13:38:45.586 INFO:teuthology.task.ansible.out:mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) 2021-03-10T13:38:45.588 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T13:38:45.611 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T13:38:45.632 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T13:38:45.695 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T13:38:45.697 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:38:45.727 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T13:38:45.779 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T13:38:45.811 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T13:38:45.874 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T13:38:45.906 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T13:38:46.000 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T13:38:46.000 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T13:38:46.094 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T13:38:46.095 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T13:38:46.179 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T13:38:46.181 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T13:38:46.274 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T13:38:46.275 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T13:38:46.359 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T13:38:46.401 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T13:38:46.453 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T13:38:46.485 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T13:38:46.548 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T13:38:46.570 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T13:38:46.633 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T13:38:46.665 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T13:38:46.728 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T13:38:46.749 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T13:38:46.824 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T13:38:46.845 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T13:38:46.918 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T13:38:46.950 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T13:38:47.012 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T13:38:47.075 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T13:38:47.076 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T13:38:47.106 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T13:38:47.189 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T13:38:47.211 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T13:38:47.273 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T13:38:47.305 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T13:38:47.367 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T13:38:47.398 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T13:38:47.461 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T13:38:47.513 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T13:38:47.515 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T13:38:47.555 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T13:38:47.639 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T13:38:47.650 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T13:38:47.723 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T13:38:47.744 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T13:38:47.817 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T13:38:47.838 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T13:38:47.911 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T13:38:47.922 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T13:38:47.995 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T13:38:48.017 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T13:38:48.079 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T13:38:48.101 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T13:38:48.174 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T13:38:48.185 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T13:38:48.268 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T13:38:48.279 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T13:38:48.352 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T13:38:48.374 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T13:38:48.447 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T13:38:48.458 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T13:38:48.531 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T13:38:48.553 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T13:38:48.616 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T13:38:48.648 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": 2021-03-10T13:38:48.650 INFO:teuthology.task.ansible.out: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T13:38:48.710 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T13:38:48.732 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T13:38:48.817 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:48 +0000 (0:00:13.006) 0:00:34.134 ******* 2021-03-10T13:38:48.823 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T13:38:48.899 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T13:38:48.901 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.911 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.912 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.922 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.924 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.933 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.935 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.945 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.946 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:48.997 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:38:49.000 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T13:38:49.039 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:38:49.041 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T13:38:49.051 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.062 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.093 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:38:49.095 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": 2021-03-10T13:38:49.097 INFO:teuthology.task.ansible.out: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T13:38:49.145 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:38:49.147 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T13:38:49.198 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:38:49.200 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T13:38:49.253 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:38:49.255 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada2 2021-03-10T13:38:49.257 INFO:teuthology.task.ansible.out:8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-a 2021-03-10T13:38:49.259 INFO:teuthology.task.ansible.out:ngeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.278 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:49 +0000 (0:00:00.460) 0:00:34.595 ******* 2021-03-10T13:38:49.285 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.287 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.300 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.302 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.312 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.323 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.324 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.334 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.335 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.345 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.356 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.357 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.367 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.369 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.380 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.381 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.391 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.393 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.403 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.405 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.405 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.416 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.426 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.428 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.438 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.439 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.449 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.460 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.462 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.471 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.473 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.482 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.484 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.494 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.495 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.505 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.506 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T13:38:49.517 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.518 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.528 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.530 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.540 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.542 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.551 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.562 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.564 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.573 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.575 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.585 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.585 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.596 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.607 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.609 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.618 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.620 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1 2021-03-10T13:38:49.622 INFO:teuthology.task.ansible.out:PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T13:38:49.631 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.632 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.642 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.643 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.653 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.664 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.665 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.675 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.677 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.687 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.689 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.698 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.709 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.710 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T13:38:49.710 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33 2021-03-10T13:38:49.712 INFO:teuthology.task.ansible.out:e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.721 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.723 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05e 2021-03-10T13:38:49.725 INFO:teuthology.task.ansible.out:f8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.733 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.735 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488f 2021-03-10T13:38:49.737 INFO:teuthology.task.ansible.out:f621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.746 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.747 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.758 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.759 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.760 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.771 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.772 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.783 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.784 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.795 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.797 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.807 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.809 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.819 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.821 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.831 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.833 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.843 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.845 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.855 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.856 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.857 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.858 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.869 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.870 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.881 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.882 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.893 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.894 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.905 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.906 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.917 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.917 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.918 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.919 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.929 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.931 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.941 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.942 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.943 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.944 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.954 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.956 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.966 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.967 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.967 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.968 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.978 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.980 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.991 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.991 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.992 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:49.993 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.003 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.005 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.014 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.016 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.026 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.028 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.039 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.040 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.051 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.052 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.069 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.071 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.093 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:50 +0000 (0:00:00.815) 0:00:35.410 ******* 2021-03-10T13:38:50.100 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.100 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.102 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.102 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.114 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.115 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.126 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.127 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.137 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.148 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.149 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.160 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.161 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.183 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:50 +0000 (0:00:00.090) 0:00:35.500 ******* 2021-03-10T13:38:50.189 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.191 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.193 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.204 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.205 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.216 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.227 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.229 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.239 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.241 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.250 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.267 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.268 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.279 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.281 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.291 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.292 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.302 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.304 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.313 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.315 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.325 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.326 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.336 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.336 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.347 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.358 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.360 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba043.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T13:38:50.371 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:38:50.372 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.382 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.384 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.393 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.395 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.404 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.405 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.416 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.427 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.428 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.438 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.440 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.449 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.451 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.460 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.461 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.472 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.483 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.484 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba043.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.495 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.496 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.506 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.508 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.518 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.555 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:50 +0000 (0:00:00.371) 0:00:35.872 ******* 2021-03-10T13:38:50.593 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:38:50.595 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T13:38:50.625 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-03-10T13:38:50.627 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:50.647 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:50 +0000 (0:00:00.092) 0:00:35.965 ******* 2021-03-10T13:38:50.685 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:38:50.686 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T13:38:50.779 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T13:38:50.811 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T13:38:50.863 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T13:38:50.916 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T13:38:50.948 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T13:38:51.000 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T13:38:51.032 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T13:38:51.084 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T13:38:51.126 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T13:38:51.168 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T13:38:51.211 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T13:38:51.253 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T13:38:51.295 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T13:38:51.347 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T13:38:51.379 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T13:38:51.431 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T13:38:51.463 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T13:38:51.506 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T13:38:51.547 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T13:38:51.590 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T13:38:51.632 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T13:38:51.674 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T13:38:51.717 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T13:38:51.759 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T13:38:51.801 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T13:38:51.843 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T13:38:51.885 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T13:38:51.969 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T13:38:51.970 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T13:38:52.053 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T13:38:52.085 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T13:38:52.138 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T13:38:52.170 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T13:38:52.222 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T13:38:52.254 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T13:38:52.317 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T13:38:52.338 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T13:38:52.422 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T13:38:52.433 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T13:38:52.516 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T13:38:52.538 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T13:38:52.601 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T13:38:52.653 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T13:38:52.685 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T13:38:52.738 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T13:38:52.770 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T13:38:52.853 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T13:38:52.854 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T13:38:52.948 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T13:38:52.949 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T13:38:53.042 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T13:38:53.043 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T13:38:53.126 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T13:38:53.127 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T13:38:53.211 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T13:38:53.211 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T13:38:53.295 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T13:38:53.306 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T13:38:53.379 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T13:38:53.391 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T13:38:53.464 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T13:38:53.475 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T13:38:53.548 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T13:38:53.559 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T13:38:53.642 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T13:38:53.654 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T13:38:53.727 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T13:38:53.738 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T13:38:53.813 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T13:38:53.824 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T13:38:53.897 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T13:38:53.908 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T13:38:53.983 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T13:38:53.994 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T13:38:54.067 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T13:38:54.078 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T13:38:54.152 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T13:38:54.164 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T13:38:54.237 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T13:38:54.249 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T13:38:54.323 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T13:38:54.345 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T13:38:54.449 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T13:38:54.460 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T13:38:54.534 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T13:38:54.545 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T13:38:54.630 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T13:38:54.642 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T13:38:54.683 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:54 +0000 (0:00:04.035) 0:00:40.000 ******* 2021-03-10T13:38:54.710 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T13:38:54.804 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T13:38:54.920 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T13:38:54.962 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T13:38:54.964 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383534.7651443-2082-19246867739714/source", "state": "file", "uid": 0} 2021-03-10T13:38:54.985 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:54 +0000 (0:00:00.302) 0:00:40.302 ******* 2021-03-10T13:38:55.012 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:38:55.014 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T13:38:55.054 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T13:38:55.056 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => { "msg": "Host gibba043.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T13:38:55.077 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.092) 0:00:40.394 ******* 2021-03-10T13:38:55.093 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:38:55.095 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T13:38:55.146 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T13:38:55.148 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T13:38:55.169 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.091) 0:00:40.486 ******* 2021-03-10T13:38:55.185 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:38:55.186 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T13:38:55.237 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.067) 0:00:40.554 ******* 2021-03-10T13:38:55.242 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T13:38:55.244 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.035) 0:00:40.589 ******* 2021-03-10T13:38:55.343 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-10T13:38:55.345 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.099) 0:00:40.688 ******* 2021-03-10T13:38:55.439 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-10T13:38:55.441 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.465 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.093) 0:00:40.782 ******* 2021-03-10T13:38:55.533 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T13:38:55.535 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.556 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.090) 0:00:40.873 ******* 2021-03-10T13:38:55.561 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T13:38:55.563 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383535.3237221-2119-24413914804518/source", "state": "file", "uid": 0} 2021-03-10T13:38:55.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.030) 0:00:40.904 ******* 2021-03-10T13:38:55.614 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T13:38:55.616 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.638 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.050) 0:00:40.955 ******* 2021-03-10T13:38:55.655 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T13:38:55.657 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => { "msg": "Host gibba003.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T13:38:55.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.052) 0:00:41.007 ******* 2021-03-10T13:38:55.720 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T13:38:55.721 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.744 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.053) 0:00:41.061 ******* 2021-03-10T13:38:55.771 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T13:38:55.773 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T13:38:55.799 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.055) 0:00:41.116 ******* 2021-03-10T13:38:55.816 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T13:38:55.818 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.842 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.042) 0:00:41.159 ******* 2021-03-10T13:38:55.859 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T13:38:55.860 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.883 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.041) 0:00:41.200 ******* 2021-03-10T13:38:55.910 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T13:38:55.911 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.934 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.051) 0:00:41.251 ******* 2021-03-10T13:38:55.951 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-10T13:38:55.953 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:55.977 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:55 +0000 (0:00:00.042) 0:00:41.294 ******* 2021-03-10T13:38:56.004 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T13:38:56.005 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:56.029 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.051) 0:00:41.346 ******* 2021-03-10T13:38:56.045 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-10T13:38:56.046 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.041) 0:00:41.387 ******* 2021-03-10T13:38:56.100 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T13:38:56.101 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.136 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.066) 0:00:41.453 ******* 2021-03-10T13:38:56.156 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T13:38:56.157 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.180 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.043) 0:00:41.497 ******* 2021-03-10T13:38:56.207 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T13:38:56.208 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.231 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.050) 0:00:41.548 ******* 2021-03-10T13:38:56.247 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T13:38:56.249 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.041) 0:00:41.589 ******* 2021-03-10T13:38:56.299 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T13:38:56.301 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:56.324 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.051) 0:00:41.641 ******* 2021-03-10T13:38:56.340 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T13:38:56.342 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.367 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.043) 0:00:41.684 ******* 2021-03-10T13:38:56.397 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T13:38:56.399 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.433 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.065) 0:00:41.750 ******* 2021-03-10T13:38:56.452 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T13:38:56.454 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.476 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.043) 0:00:41.793 ******* 2021-03-10T13:38:56.505 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T13:38:56.506 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:56.541 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.064) 0:00:41.858 ******* 2021-03-10T13:38:56.560 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T13:38:56.561 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.584 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.042) 0:00:41.901 ******* 2021-03-10T13:38:56.601 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T13:38:56.603 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.625 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.041) 0:00:41.942 ******* 2021-03-10T13:38:56.652 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T13:38:56.654 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:56.677 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.051) 0:00:41.994 ******* 2021-03-10T13:38:56.693 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T13:38:56.695 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.717 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.040) 0:00:42.034 ******* 2021-03-10T13:38:56.744 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T13:38:56.746 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.768 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.050) 0:00:42.085 ******* 2021-03-10T13:38:56.784 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T13:38:56.786 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.809 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.040) 0:00:42.126 ******* 2021-03-10T13:38:56.835 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T13:38:56.837 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.859 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.050) 0:00:42.176 ******* 2021-03-10T13:38:56.875 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T13:38:56.877 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:56.900 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.040) 0:00:42.217 ******* 2021-03-10T13:38:56.926 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T13:38:56.928 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:56.953 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.053) 0:00:42.270 ******* 2021-03-10T13:38:56.970 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T13:38:56.972 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:56.994 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:56 +0000 (0:00:00.041) 0:00:42.312 ******* 2021-03-10T13:38:57.021 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T13:38:57.023 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.050) 0:00:42.362 ******* 2021-03-10T13:38:57.061 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T13:38:57.062 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.085 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.040) 0:00:42.402 ******* 2021-03-10T13:38:57.112 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T13:38:57.114 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:57.136 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.050) 0:00:42.453 ******* 2021-03-10T13:38:57.153 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T13:38:57.155 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.177 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.040) 0:00:42.494 ******* 2021-03-10T13:38:57.204 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T13:38:57.206 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.228 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.050) 0:00:42.545 ******* 2021-03-10T13:38:57.244 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T13:38:57.245 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.270 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.041) 0:00:42.587 ******* 2021-03-10T13:38:57.296 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T13:38:57.298 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.319 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.049) 0:00:42.636 ******* 2021-03-10T13:38:57.335 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T13:38:57.337 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.359 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.039) 0:00:42.676 ******* 2021-03-10T13:38:57.386 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T13:38:57.387 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.409 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.050) 0:00:42.727 ******* 2021-03-10T13:38:57.425 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T13:38:57.427 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.449 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.039) 0:00:42.766 ******* 2021-03-10T13:38:57.475 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T13:38:57.477 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.502 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.053) 0:00:42.819 ******* 2021-03-10T13:38:57.518 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T13:38:57.520 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.040) 0:00:42.860 ******* 2021-03-10T13:38:57.559 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T13:38:57.561 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:57.584 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.040) 0:00:42.901 ******* 2021-03-10T13:38:57.612 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T13:38:57.614 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:57.647 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.063) 0:00:42.965 ******* 2021-03-10T13:38:57.667 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.042) 0:00:43.007 ******* 2021-03-10T13:38:57.716 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T13:38:57.718 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.742 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.051) 0:00:43.059 ******* 2021-03-10T13:38:57.759 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T13:38:57.761 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.041) 0:00:43.101 ******* 2021-03-10T13:38:57.811 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T13:38:57.813 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.835 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.051) 0:00:43.153 ******* 2021-03-10T13:38:57.852 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T13:38:57.853 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.876 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.040) 0:00:43.193 ******* 2021-03-10T13:38:57.903 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T13:38:57.904 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.926 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.050) 0:00:43.243 ******* 2021-03-10T13:38:57.943 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T13:38:57.944 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:57.967 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:57 +0000 (0:00:00.040) 0:00:43.284 ******* 2021-03-10T13:38:58.004 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T13:38:58.005 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.029 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.062) 0:00:43.346 ******* 2021-03-10T13:38:58.045 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T13:38:58.047 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.072 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.042) 0:00:43.389 ******* 2021-03-10T13:38:58.099 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-10T13:38:58.101 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.123 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.051) 0:00:43.441 ******* 2021-03-10T13:38:58.139 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T13:38:58.141 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.167 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.043) 0:00:43.484 ******* 2021-03-10T13:38:58.183 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T13:38:58.185 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.208 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.041) 0:00:43.525 ******* 2021-03-10T13:38:58.234 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T13:38:58.236 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:38:58.258 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.049) 0:00:43.575 ******* 2021-03-10T13:38:58.327 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T13:38:58.328 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.349 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.090) 0:00:43.666 ******* 2021-03-10T13:38:58.355 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:38:58.357 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013540", "end": "2021-03-10 13:38:58.785838", "rc": 0, "start": "2021-03-10 13:38:58.772298", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T13:38:58.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.032) 0:00:43.698 ******* 2021-03-10T13:38:58.422 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T13:38:58.424 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.450 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.068) 0:00:43.767 ******* 2021-03-10T13:38:58.456 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T13:38:58.458 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.036) 0:00:43.804 ******* 2021-03-10T13:38:58.515 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T13:38:58.517 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.056) 0:00:43.860 ******* 2021-03-10T13:38:58.562 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T13:38:58.564 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.591 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.047) 0:00:43.908 ******* 2021-03-10T13:38:58.619 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T13:38:58.621 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.647 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.055) 0:00:43.964 ******* 2021-03-10T13:38:58.726 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-10T13:38:58.728 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.757 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.109) 0:00:44.074 ******* 2021-03-10T13:38:58.825 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T13:38:58.827 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:58.848 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:58 +0000 (0:00:00.091) 0:00:44.165 ******* 2021-03-10T13:38:59.000 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:38:59.001 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.008909", "end": "2021-03-10 13:38:59.060070", "rc": 0, "start": "2021-03-10 13:38:59.051161", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T13:38:59.023 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.174) 0:00:44.340 ******* 2021-03-10T13:38:59.090 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T13:38:59.092 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.112 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.089) 0:00:44.430 ******* 2021-03-10T13:38:59.180 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:38:59.181 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.204 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.091) 0:00:44.521 ******* 2021-03-10T13:38:59.295 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:38:59.297 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.411 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.443 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.527 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.549 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.575 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.370) 0:00:44.892 ******* 2021-03-10T13:38:59.633 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.644 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:38:59.646 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.668 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.092) 0:00:44.985 ******* 2021-03-10T13:38:59.735 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T13:38:59.736 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.757 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.089) 0:00:45.074 ******* 2021-03-10T13:38:59.764 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:38:59.765 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:38:59.792 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.035) 0:00:45.110 ******* 2021-03-10T13:38:59.819 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T13:38:59.821 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.845 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.052) 0:00:45.162 ******* 2021-03-10T13:38:59.872 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:38:59.874 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.896 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.050) 0:00:45.213 ******* 2021-03-10T13:38:59.911 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T13:38:59.913 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.935 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.039) 0:00:45.252 ******* 2021-03-10T13:38:59.972 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T13:38:59.973 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:59.995 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:59 +0000 (0:00:00.060) 0:00:45.312 ******* 2021-03-10T13:39:00.002 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T13:39:00.003 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:00.027 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.031) 0:00:45.344 ******* 2021-03-10T13:39:00.085 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T13:39:00.086 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:00.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.082) 0:00:45.426 ******* 2021-03-10T13:39:00.187 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T13:39:00.189 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:00.210 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.100) 0:00:45.527 ******* 2021-03-10T13:39:00.288 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T13:39:00.290 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:00.310 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.100) 0:00:45.627 ******* 2021-03-10T13:39:00.439 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T13:39:00.441 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.038872", "end": "2021-03-10 13:39:00.500984", "rc": 0, "start": "2021-03-10 13:39:00.462112", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:00.463 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.152) 0:00:45.780 ******* 2021-03-10T13:39:00.531 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T13:39:00.532 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:00.553 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.090) 0:00:45.870 ******* 2021-03-10T13:39:00.702 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T13:39:00.704 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007627", "end": "2021-03-10 13:39:00.764711", "rc": 0, "start": "2021-03-10 13:39:00.757084", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:00.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:00 +0000 (0:00:00.172) 0:00:46.043 ******* 2021-03-10T13:39:01.074 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T13:39:01.076 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.952513", "end": "2021-03-10 13:39:01.500883", "rc": 0, "start": "2021-03-10 13:39:00.548370", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:01.100 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:01 +0000 (0:00:00.373) 0:00:46.417 ******* 2021-03-10T13:39:01.167 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T13:39:01.169 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:01.189 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:01 +0000 (0:00:00.089) 0:00:46.506 ******* 2021-03-10T13:39:01.339 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T13:39:01.341 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007756", "end": "2021-03-10 13:39:01.773769", "rc": 0, "start": "2021-03-10 13:39:01.766013", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:01.362 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:01 +0000 (0:00:00.173) 0:00:46.679 ******* 2021-03-10T13:39:02.716 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T13:39:02.718 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:02.739 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:02 +0000 (0:00:01.377) 0:00:48.057 ******* 2021-03-10T13:39:03.209 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T13:39:03.211 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:03.231 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:03 +0000 (0:00:00.491) 0:00:48.548 ******* 2021-03-10T13:39:03.249 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T13:39:03.250 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:03.284 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:03 +0000 (0:00:00.053) 0:00:48.602 ******* 2021-03-10T13:39:03.313 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T13:39:03.314 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:03.336 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:03 +0000 (0:00:00.051) 0:00:48.653 ******* 2021-03-10T13:39:03.778 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T13:39:03.779 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:03.800 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:03 +0000 (0:00:00.464) 0:00:49.118 ******* 2021-03-10T13:39:03.869 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:03.891 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:03 +0000 (0:00:00.090) 0:00:49.208 ******* 2021-03-10T13:39:03.896 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T13:39:03.898 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T13:39:03.922 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:03 +0000 (0:00:00.030) 0:00:49.239 ******* 2021-03-10T13:39:04.144 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T13:39:04.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:04 +0000 (0:00:00.245) 0:00:49.485 ******* 2021-03-10T13:39:04.368 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T13:39:04.370 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:04.391 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:04 +0000 (0:00:00.223) 0:00:49.708 ******* 2021-03-10T13:39:04.604 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:04.628 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:04 +0000 (0:00:00.236) 0:00:49.945 ******* 2021-03-10T13:39:04.697 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:39:04.698 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T13:39:04.936 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T13:39:04.947 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T13:39:05.123 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T13:39:05.147 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:05 +0000 (0:00:00.518) 0:00:50.464 ******* 2021-03-10T13:39:05.196 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T13:39:05.258 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T13:39:05.260 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:39:05.286 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:05 +0000 (0:00:00.138) 0:00:50.603 ******* 2021-03-10T13:39:05.395 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:39:05.397 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T13:39:05.422 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:05 +0000 (0:00:00.136) 0:00:50.739 ******* 2021-03-10T13:39:05.541 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T13:39:05.543 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba003.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T13:39:05.565 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:05 +0000 (0:00:00.143) 0:00:50.882 ******* 2021-03-10T13:39:05.717 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T13:39:05.831 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T13:39:05.915 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T13:39:05.940 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:05 +0000 (0:00:00.374) 0:00:51.257 ******* 2021-03-10T13:39:06.018 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T13:39:06.019 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba043.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T13:39:06.041 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.100) 0:00:51.358 ******* 2021-03-10T13:39:06.107 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-10T13:39:06.109 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.129 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.088) 0:00:51.446 ******* 2021-03-10T13:39:06.196 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T13:39:06.198 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:39:06.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.088) 0:00:51.535 ******* 2021-03-10T13:39:06.224 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:39:06.224 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T13:39:06.251 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.032) 0:00:51.568 ******* 2021-03-10T13:39:06.289 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T13:39:06.291 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.301 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.302 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.313 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.337 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.086) 0:00:51.654 ******* 2021-03-10T13:39:06.343 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T13:39:06.344 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:39:06.367 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.030) 0:00:51.684 ******* 2021-03-10T13:39:06.404 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T13:39:06.406 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.426 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.059) 0:00:51.743 ******* 2021-03-10T13:39:06.432 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-10T13:39:06.433 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.455 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.028) 0:00:51.772 ******* 2021-03-10T13:39:06.533 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T13:39:06.535 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:39:06.558 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.102) 0:00:51.875 ******* 2021-03-10T13:39:06.625 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T13:39:06.627 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.636 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.638 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.659 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.100) 0:00:51.976 ******* 2021-03-10T13:39:06.714 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T13:39:06.716 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:06.736 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.077) 0:00:52.053 ******* 2021-03-10T13:39:06.875 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T13:39:06.877 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:06.898 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:06 +0000 (0:00:00.161) 0:00:52.215 ******* 2021-03-10T13:39:07.152 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T13:39:07.154 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T13:39:07.174 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.276) 0:00:52.491 ******* 2021-03-10T13:39:07.190 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T13:39:07.191 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:07.214 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.039) 0:00:52.531 ******* 2021-03-10T13:39:07.458 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-10T13:39:07.460 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T13:39:07.480 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.266) 0:00:52.797 ******* 2021-03-10T13:39:07.485 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T13:39:07.487 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T13:39:07.510 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.030) 0:00:52.827 ******* 2021-03-10T13:39:07.632 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:39:07.634 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T13:39:07.697 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T13:39:07.743 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.232) 0:00:53.060 ******* 2021-03-10T13:39:07.812 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T13:39:07.814 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:07.845 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.102) 0:00:53.162 ******* 2021-03-10T13:39:07.853 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-10T13:39:07.854 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T13:39:07.892 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.046) 0:00:53.209 ******* 2021-03-10T13:39:07.908 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T13:39:07.910 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:39:07.932 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:07 +0000 (0:00:00.040) 0:00:53.249 ******* 2021-03-10T13:39:07.999 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T13:39:08.001 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:08.021 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.088) 0:00:53.338 ******* 2021-03-10T13:39:08.047 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:39:08.049 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T13:39:08.121 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T13:39:08.145 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.124) 0:00:53.462 ******* 2021-03-10T13:39:08.212 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T13:39:08.213 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:08.234 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.088) 0:00:53.551 ******* 2021-03-10T13:39:08.301 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T13:39:08.302 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T13:39:08.324 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.090) 0:00:53.641 ******* 2021-03-10T13:39:08.344 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.019) 0:00:53.661 ******* 2021-03-10T13:39:08.546 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:08.568 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.223) 0:00:53.885 ******* 2021-03-10T13:39:08.636 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T13:39:08.637 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:37:27 UTC", "ActiveEnterTimestampMonotonic": "13422991", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target nss-lookup.target system.slice var-run.mount -.mount sysinit.target systemd-journald.socket systemd-tmpfiles-setup.service local-fs.target basic.target time-sync.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:37:27 UTC", "AssertTimestampMonotonic": "13410934", "Before": "xdm.service getty@tty1.service multi-user.target shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:37:27 UTC", "Con 2021-03-10T13:39:08.639 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13410933", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1219", "ExecMainStartTimestamp": "Wed 2021-03-10 13:37:27 UTC", "ExecMainStartTimestampMonotonic": "13422883", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T13:39:08.641 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:37:27 UTC", "InactiveExitTimestampMonotonic": "13422991", "InvocationID": "dc7630d747de4a17a1f886f26901f7e1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1219", "MemoryAccounting": "yes", "MemoryCurrent": "1335296", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T13:39:08.643 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:27 UTC", "StateChangeTimestampMonotonic": "13422991", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T13:39:08.645 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:39:08.661 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.093) 0:00:53.978 ******* 2021-03-10T13:39:08.844 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T13:39:08.845 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:08.865 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.203) 0:00:54.182 ******* 2021-03-10T13:39:08.933 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T13:39:08.935 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:08.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.090) 0:00:54.273 ******* 2021-03-10T13:39:08.962 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-10T13:39:08.964 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T13:39:08.989 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:08 +0000 (0:00:00.033) 0:00:54.306 ******* 2021-03-10T13:39:09.016 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T13:39:09.018 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.040 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.051) 0:00:54.357 ******* 2021-03-10T13:39:09.108 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T13:39:09.109 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.129 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.088) 0:00:54.446 ******* 2021-03-10T13:39:09.186 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T13:39:09.187 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.208 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.078) 0:00:54.525 ******* 2021-03-10T13:39:09.215 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T13:39:09.216 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:37:32 UTC", "ActiveEnterTimestampMonotonic": "14011092", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount time-sync.target remote-fs.target sysinit.target -.mount nss-lookup.target local-fs.target network.target systemd-tmpfiles-setup.service basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:37:32 UTC", "AssertTimestampMonotonic": "13990996", "Before": "shutdown.target xdm.service multi-user.target getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:37:32 UTC", "Con 2021-03-10T13:39:09.218 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13990996", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1347", "ExecMainStartTimestamp": "Wed 2021-03-10 13:37:32 UTC", "ExecMainStartTimestampMonotonic": "14010990", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T13:39:09.220 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:37:32 UTC", "InactiveExitTimestampMonotonic": "14011092", "InvocationID": "c9cb8a76aed640fba6c45f55493b1e7c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1347", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T13:39:09.221 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:32 UTC", "StateChangeTimestampMonotonic": "14011092", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T13:39:09.223 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:39:09.242 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.033) 0:00:54.559 ******* 2021-03-10T13:39:09.268 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T13:39:09.270 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.292 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.050) 0:00:54.609 ******* 2021-03-10T13:39:09.307 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T13:39:09.309 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.331 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.039) 0:00:54.648 ******* 2021-03-10T13:39:09.451 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T13:39:09.453 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.474 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.142) 0:00:54.791 ******* 2021-03-10T13:39:09.510 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T13:39:09.512 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.533 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.059) 0:00:54.850 ******* 2021-03-10T13:39:09.643 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T13:39:09.644 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.666 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.132) 0:00:54.983 ******* 2021-03-10T13:39:09.703 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T13:39:09.705 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.060) 0:00:55.043 ******* 2021-03-10T13:39:09.845 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T13:39:09.847 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:09.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:09 +0000 (0:00:00.145) 0:00:55.188 ******* 2021-03-10T13:39:09.898 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T13:39:09.899 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.004 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.132) 0:00:55.321 ******* 2021-03-10T13:39:10.041 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T13:39:10.043 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.064 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.060) 0:00:55.381 ******* 2021-03-10T13:39:10.069 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T13:39:10.071 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.093 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.029) 0:00:55.410 ******* 2021-03-10T13:39:10.120 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T13:39:10.122 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:39:10.144 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.050) 0:00:55.461 ******* 2021-03-10T13:39:10.159 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T13:39:10.161 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.183 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.039) 0:00:55.500 ******* 2021-03-10T13:39:10.219 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T13:39:10.221 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T13:39:10.244 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.060) 0:00:55.561 ******* 2021-03-10T13:39:10.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T13:39:10.251 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.273 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.029) 0:00:55.591 ******* 2021-03-10T13:39:10.321 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T13:39:10.323 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T13:39:10.345 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.071) 0:00:55.662 ******* 2021-03-10T13:39:10.350 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T13:39:10.352 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.374 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.029) 0:00:55.691 ******* 2021-03-10T13:39:10.412 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T13:39:10.413 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T13:39:10.436 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.061) 0:00:55.753 ******* 2021-03-10T13:39:10.451 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T13:39:10.453 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.476 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.040) 0:00:55.793 ******* 2021-03-10T13:39:10.524 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T13:39:10.526 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:39:10.547 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.071) 0:00:55.864 ******* 2021-03-10T13:39:10.552 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T13:39:10.554 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.581 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.033) 0:00:55.898 ******* 2021-03-10T13:39:10.648 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T13:39:10.649 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:39:10.670 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.089) 0:00:55.987 ******* 2021-03-10T13:39:10.686 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T13:39:10.687 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T13:39:10.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.039) 0:00:56.027 ******* 2021-03-10T13:39:10.737 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T13:39:10.739 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T13:39:10.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.053) 0:00:56.081 ******* 2021-03-10T13:39:10.780 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T13:39:10.782 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.807 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.043) 0:00:56.124 ******* 2021-03-10T13:39:10.835 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T13:39:10.837 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T13:39:10.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.063) 0:00:56.188 ******* 2021-03-10T13:39:10.887 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T13:39:10.889 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:10.912 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.041) 0:00:56.229 ******* 2021-03-10T13:39:10.939 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T13:39:10.941 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T13:39:10.964 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:10 +0000 (0:00:00.051) 0:00:56.281 ******* 2021-03-10T13:39:11.062 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T13:39:11.064 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:39:11.084 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.120) 0:00:56.401 ******* 2021-03-10T13:39:11.090 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T13:39:11.092 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T13:39:11.115 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.030) 0:00:56.432 ******* 2021-03-10T13:39:11.225 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T13:39:11.227 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T13:39:11.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.134) 0:00:56.566 ******* 2021-03-10T13:39:11.316 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T13:39:11.318 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:11.340 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.090) 0:00:56.657 ******* 2021-03-10T13:39:11.418 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T13:39:11.420 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:11.446 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.106) 0:00:56.763 ******* 2021-03-10T13:39:11.504 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T13:39:11.506 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T13:39:11.529 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.083) 0:00:56.846 ******* 2021-03-10T13:39:11.607 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T13:39:11.609 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba003"}, "changed": false} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [gibba043.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T13:39:11.631 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.102) 0:00:56.948 ******* 2021-03-10T13:39:11.652 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:11 +0000 (0:00:00.021) 0:00:56.969 ******* 2021-03-10T13:39:12.019 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T13:39:12.021 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T13:39:12.042 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.390) 0:00:57.360 ******* 2021-03-10T13:39:12.120 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T13:39:12.122 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba043"}, "changed": false} 2021-03-10T13:39:12.143 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.100) 0:00:57.460 ******* 2021-03-10T13:39:12.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-10T13:39:12.316 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba003", "ansible_hostname": "gibba003", "ansible_nodename": "gibba003"}, "changed": false, "name": "gibba003"} 2021-03-10T13:39:12.338 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.195) 0:00:57.656 ******* 2021-03-10T13:39:12.438 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba043", "ansible_hostname": "gibba043", "ansible_nodename": "gibba043"}, "changed": false, "name": "gibba043"} 2021-03-10T13:39:12.463 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.124) 0:00:57.780 ******* 2021-03-10T13:39:12.633 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-10T13:39:12.635 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T13:39:12.658 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.195) 0:00:57.975 ******* 2021-03-10T13:39:12.758 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T13:39:12.782 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.123) 0:00:58.099 ******* 2021-03-10T13:39:12.948 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-10T13:39:12.950 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T13:39:12.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:12 +0000 (0:00:00.197) 0:00:58.297 ******* 2021-03-10T13:39:13.059 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T13:39:13.084 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.103) 0:00:58.401 ******* 2021-03-10T13:39:13.493 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T13:39:13.495 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T13:39:13.517 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.432) 0:00:58.834 ******* 2021-03-10T13:39:13.584 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T13:39:13.586 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.606 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.089) 0:00:58.924 ******* 2021-03-10T13:39:13.674 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:39:13.675 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.696 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.089) 0:00:59.013 ******* 2021-03-10T13:39:13.702 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T13:39:13.704 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T13:39:13.733 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.036) 0:00:59.050 ******* 2021-03-10T13:39:13.760 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:39:13.762 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.051) 0:00:59.101 ******* 2021-03-10T13:39:13.801 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T13:39:13.803 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.827 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.043) 0:00:59.144 ******* 2021-03-10T13:39:13.854 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:39:13.856 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.879 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.052) 0:00:59.196 ******* 2021-03-10T13:39:13.896 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:39:13.898 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.921 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.041) 0:00:59.238 ******* 2021-03-10T13:39:13.948 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:39:13.950 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:13.972 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:13 +0000 (0:00:00.050) 0:00:59.289 ******* 2021-03-10T13:39:13.990 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:39:13.992 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.029 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.057) 0:00:59.346 ******* 2021-03-10T13:39:14.059 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:39:14.061 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.083 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.053) 0:00:59.400 ******* 2021-03-10T13:39:14.099 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:39:14.101 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.124 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.041) 0:00:59.441 ******* 2021-03-10T13:39:14.151 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:39:14.153 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.176 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.051) 0:00:59.493 ******* 2021-03-10T13:39:14.193 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:39:14.194 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.041) 0:00:59.535 ******* 2021-03-10T13:39:14.255 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T13:39:14.257 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.280 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.062) 0:00:59.597 ******* 2021-03-10T13:39:14.299 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:39:14.300 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.336 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.056) 0:00:59.653 ******* 2021-03-10T13:39:14.367 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T13:39:14.391 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.054) 0:00:59.708 ******* 2021-03-10T13:39:14.408 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:39:14.410 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.433 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.042) 0:00:59.750 ******* 2021-03-10T13:39:14.471 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T13:39:14.495 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.061) 0:00:59.812 ******* 2021-03-10T13:39:14.514 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T13:39:14.516 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.556 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.060) 0:00:59.873 ******* 2021-03-10T13:39:14.585 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T13:39:14.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.053) 0:00:59.926 ******* 2021-03-10T13:39:14.626 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T13:39:14.654 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.044) 0:00:59.971 ******* 2021-03-10T13:39:14.682 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-10T13:39:14.684 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.053) 0:01:00.024 ******* 2021-03-10T13:39:14.724 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T13:39:14.749 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.042) 0:01:00.066 ******* 2021-03-10T13:39:14.786 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-10T13:39:14.788 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.812 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.062) 0:01:00.129 ******* 2021-03-10T13:39:14.818 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T13:39:14.843 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.031) 0:01:00.160 ******* 2021-03-10T13:39:14.880 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T13:39:14.882 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.904 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.061) 0:01:00.221 ******* 2021-03-10T13:39:14.920 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-10T13:39:14.922 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.945 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.040) 0:01:00.262 ******* 2021-03-10T13:39:14.972 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:39:14.973 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:14.996 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:14 +0000 (0:00:00.051) 0:01:00.313 ******* 2021-03-10T13:39:15.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-10T13:39:15.025 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.048 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.051) 0:01:00.365 ******* 2021-03-10T13:39:15.064 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-10T13:39:15.066 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.088 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.040) 0:01:00.405 ******* 2021-03-10T13:39:15.115 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T13:39:15.116 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.138 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.049) 0:01:00.455 ******* 2021-03-10T13:39:15.154 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T13:39:15.156 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.178 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.039) 0:01:00.495 ******* 2021-03-10T13:39:15.215 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:39:15.217 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.242 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.064) 0:01:00.559 ******* 2021-03-10T13:39:15.259 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T13:39:15.260 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.286 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.043) 0:01:00.603 ******* 2021-03-10T13:39:15.304 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-10T13:39:15.305 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.328 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.041) 0:01:00.645 ******* 2021-03-10T13:39:15.354 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T13:39:15.356 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.378 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.050) 0:01:00.695 ******* 2021-03-10T13:39:15.395 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T13:39:15.397 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.040) 0:01:00.737 ******* 2021-03-10T13:39:15.446 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:39:15.448 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.470 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.050) 0:01:00.787 ******* 2021-03-10T13:39:15.487 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T13:39:15.489 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.511 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.040) 0:01:00.828 ******* 2021-03-10T13:39:15.538 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:39:15.540 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.562 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.051) 0:01:00.879 ******* 2021-03-10T13:39:15.589 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T13:39:15.591 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.613 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.050) 0:01:00.930 ******* 2021-03-10T13:39:15.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:39:15.632 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.656 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.042) 0:01:00.973 ******* 2021-03-10T13:39:15.703 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:39:15.705 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.727 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.071) 0:01:01.044 ******* 2021-03-10T13:39:15.732 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T13:39:15.734 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.757 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.030) 0:01:01.074 ******* 2021-03-10T13:39:15.796 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:39:15.798 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.823 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.065) 0:01:01.140 ******* 2021-03-10T13:39:15.946 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.042) 0:01:01.182 ******* TASK [testnode : Install packages] ********************************************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.053) 0:01:01.236 ******* TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:15.961 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:15 +0000 (0:00:00.042) 0:01:01.278 ******* 2021-03-10T13:39:15.989 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T13:39:15.991 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.015 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.053) 0:01:01.332 ******* 2021-03-10T13:39:16.032 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T13:39:16.033 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.056 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.041) 0:01:01.373 ******* 2021-03-10T13:39:16.084 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:39:16.086 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.110 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.053) 0:01:01.427 ******* 2021-03-10T13:39:16.126 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-10T13:39:16.128 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.151 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.041) 0:01:01.468 ******* 2021-03-10T13:39:16.179 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:39:16.180 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.202 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.051) 0:01:01.520 ******* 2021-03-10T13:39:16.218 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-10T13:39:16.220 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.243 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.040) 0:01:01.560 ******* 2021-03-10T13:39:16.270 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T13:39:16.272 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.295 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.052) 0:01:01.612 ******* 2021-03-10T13:39:16.312 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T13:39:16.314 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.336 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.041) 0:01:01.653 ******* 2021-03-10T13:39:16.364 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-10T13:39:16.366 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.391 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.054) 0:01:01.708 ******* 2021-03-10T13:39:16.407 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T13:39:16.409 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.431 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.040) 0:01:01.748 ******* 2021-03-10T13:39:16.447 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-10T13:39:16.448 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.471 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.040) 0:01:01.788 ******* 2021-03-10T13:39:16.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T13:39:16.499 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.520 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.049) 0:01:01.837 ******* 2021-03-10T13:39:16.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T13:39:16.539 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.043) 0:01:01.881 ******* 2021-03-10T13:39:16.591 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T13:39:16.593 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.615 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.050) 0:01:01.932 ******* 2021-03-10T13:39:16.642 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T13:39:16.643 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.668 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.052) 0:01:01.985 ******* 2021-03-10T13:39:16.684 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T13:39:16.686 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.042) 0:01:02.027 ******* 2021-03-10T13:39:16.738 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T13:39:16.740 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.762 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.052) 0:01:02.079 ******* 2021-03-10T13:39:16.831 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T13:39:16.832 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.855 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.091) 0:01:02.171 ******* 2021-03-10T13:39:16.860 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-10T13:39:16.861 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001363", "end": "2021-03-10 13:39:16.909057", "rc": 0, "start": "2021-03-10 13:39:16.907694", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:16.887 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.032) 0:01:02.204 ******* 2021-03-10T13:39:16.915 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T13:39:16.916 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:16.940 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.052) 0:01:02.257 ******* 2021-03-10T13:39:16.957 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T13:39:16.986 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:16 +0000 (0:00:00.046) 0:01:02.303 ******* 2021-03-10T13:39:17.086 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-10T13:39:17.088 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001356", "end": "2021-03-10 13:39:17.514340", "rc": 0, "start": "2021-03-10 13:39:17.512984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:17.111 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:17 +0000 (0:00:00.125) 0:01:02.429 ******* 2021-03-10T13:39:17.169 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T13:39:17.192 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:17 +0000 (0:00:00.080) 0:01:02.509 ******* 2021-03-10T13:39:17.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T13:39:17.241 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T13:39:17.266 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:17 +0000 (0:00:00.073) 0:01:02.583 ******* 2021-03-10T13:39:17.334 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-10T13:39:17.336 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:17.358 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:17 +0000 (0:00:00.091) 0:01:02.675 ******* 2021-03-10T13:39:17.468 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T13:39:17.470 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T13:39:17.494 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:17 +0000 (0:00:00.135) 0:01:02.811 ******* 2021-03-10T13:39:17.564 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-10T13:39:17.566 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:17.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:17 +0000 (0:00:00.093) 0:01:02.904 ******* 2021-03-10T13:39:18.471 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-10T13:39:18.473 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T13:39:18.576 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T13:39:19.199 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T13:39:19.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:19 +0000 (0:00:01.648) 0:01:04.553 ******* 2021-03-10T13:39:19.244 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T13:39:19.271 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:19 +0000 (0:00:00.035) 0:01:04.588 ******* 2021-03-10T13:39:19.726 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T13:39:19.728 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:19.750 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:19 +0000 (0:00:00.478) 0:01:05.067 ******* 2021-03-10T13:39:19.756 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:19.782 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:19 +0000 (0:00:00.031) 0:01:05.099 ******* 2021-03-10T13:39:19.809 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T13:39:19.833 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:19 +0000 (0:00:00.051) 0:01:05.150 ******* 2021-03-10T13:39:19.875 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:19 +0000 (0:00:00.041) 0:01:05.192 ******* 2021-03-10T13:39:19.994 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-10T13:39:19.996 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010992", "end": "2021-03-10 13:39:20.050441", "rc": 0, "start": "2021-03-10 13:39:20.039449", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:20.019 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:20 +0000 (0:00:00.144) 0:01:05.336 ******* 2021-03-10T13:39:20.036 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010190", "end": "2021-03-10 13:39:20.459860", "rc": 0, "start": "2021-03-10 13:39:20.449670", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:20.060 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:20 +0000 (0:00:00.041) 0:01:05.377 ******* 2021-03-10T13:39:21.486 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-10T13:39:21.488 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:21.512 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:21 +0000 (0:00:01.451) 0:01:06.829 ******* 2021-03-10T13:39:21.529 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:21.555 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:21 +0000 (0:00:00.042) 0:01:06.871 ******* 2021-03-10T13:39:30.404 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T13:39:30.406 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\nR 2021-03-10T13:39:30.407 INFO:teuthology.task.ansible.out:emoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading 2021-03-10T13:39:30.409 INFO:teuthology.task.ansible.out: database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:39:30.427 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:30 +0000 (0:00:08.872) 0:01:15.744 ******* 2021-03-10T13:39:30.870 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:39:30.872 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:30.894 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:30 +0000 (0:00:00.466) 0:01:16.211 ******* 2021-03-10T13:39:30.902 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T13:39:30.903 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\nR 2021-03-10T13:39:30.904 INFO:teuthology.task.ansible.out:emoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading 2021-03-10T13:39:30.906 INFO:teuthology.task.ansible.out: database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:39:30.928 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:30 +0000 (0:00:00.034) 0:01:16.246 ******* 2021-03-10T13:39:30.956 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T13:39:30.958 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:30.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:30 +0000 (0:00:00.051) 0:01:16.297 ******* 2021-03-10T13:39:31.379 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:39:31.381 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:31.402 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:31 +0000 (0:00:00.422) 0:01:16.719 ******* 2021-03-10T13:39:31.469 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:31.491 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:31 +0000 (0:00:00.088) 0:01:16.808 ******* 2021-03-10T13:39:40.435 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:39:40.437 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databas 2021-03-10T13:39:40.438 INFO:teuthology.task.ansible.out:e ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T13:39:40.440 INFO:teuthology.task.ansible.out:...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", " 2021-03-10T13:39:40.442 INFO:teuthology.task.ansible.out:(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Sett 2021-03-10T13:39:40.443 INFO:teuthology.task.ansible.out:ing up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:39:40.458 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:40 +0000 (0:00:08.967) 0:01:25.775 ******* 2021-03-10T13:39:40.860 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databas 2021-03-10T13:39:40.862 INFO:teuthology.task.ansible.out:e ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T13:39:40.864 INFO:teuthology.task.ansible.out:...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", " 2021-03-10T13:39:40.865 INFO:teuthology.task.ansible.out:(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Sett 2021-03-10T13:39:40.867 INFO:teuthology.task.ansible.out:ing up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1 2021-03-10T13:39:40.867 INFO:teuthology.task.ansible.out::4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:39:40.892 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:40 +0000 (0:00:00.433) 0:01:26.209 ******* 2021-03-10T13:39:40.930 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-10T13:39:40.932 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:40.955 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:40 +0000 (0:00:00.062) 0:01:26.272 ******* 2021-03-10T13:39:41.344 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:41.368 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:41 +0000 (0:00:00.412) 0:01:26.685 ******* 2021-03-10T13:39:41.394 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T13:39:41.396 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:41.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:41 +0000 (0:00:00.050) 0:01:26.736 ******* 2021-03-10T13:39:41.559 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T13:39:41.561 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T13:39:41.582 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:41 +0000 (0:00:00.163) 0:01:26.899 ******* 2021-03-10T13:39:41.650 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T13:39:41.651 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:41.672 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:41 +0000 (0:00:00.089) 0:01:26.989 ******* 2021-03-10T13:39:41.811 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T13:39:41.813 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T13:39:41.834 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:41 +0000 (0:00:00.161) 0:01:27.151 ******* 2021-03-10T13:39:41.858 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:41 +0000 (0:00:00.024) 0:01:27.175 ******* 2021-03-10T13:39:41.998 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T13:39:42.000 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T13:39:42.021 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.163) 0:01:27.339 ******* 2021-03-10T13:39:42.088 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T13:39:42.090 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:42.111 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.089) 0:01:27.428 ******* 2021-03-10T13:39:42.128 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T13:39:42.129 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T13:39:42.152 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.041) 0:01:27.470 ******* 2021-03-10T13:39:42.262 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T13:39:42.264 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T13:39:42.285 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.132) 0:01:27.602 ******* 2021-03-10T13:39:42.363 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T13:39:42.364 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T13:39:42.387 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.101) 0:01:27.704 ******* 2021-03-10T13:39:42.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T13:39:42.538 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:39:42.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.173) 0:01:27.877 ******* 2021-03-10T13:39:42.586 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T13:39:42.588 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T13:39:42.611 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.050) 0:01:27.928 ******* 2021-03-10T13:39:42.782 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T13:39:42.784 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T13:39:42.807 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.196) 0:01:28.124 ******* 2021-03-10T13:39:42.814 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T13:39:42.816 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:37:28 UTC", "ActiveEnterTimestampMonotonic": "13925411", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket -.mount network.target remote-fs.target nss-lookup.target system.slice basic.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:37:27 UTC", "AssertTimestampMonotonic": "13322938", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:37:27 UTC", "ConditionTimestampMonotonic": "13322938", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T13:39:42.817 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1467", "ExecMainStartTimestamp": "Wed 2021-03-10 13:37:28 UTC", "ExecMainStartTimestampMonotonic": "13925401", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T13:39:42.819 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:37:27 UTC", "InactiveExitTimestampMonotonic": "13323577", "InvocationID": "9421cf1c18ff43fa88d047c4c3205445", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1467", "MemoryAccounting": "yes", "MemoryCurrent": "10604544", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T13:39:42.821 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:28 UTC", "StateChangeTimestampMonotonic": "13925411", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T13:39:42.822 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:39:42.842 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.034) 0:01:28.159 ******* 2021-03-10T13:39:42.910 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:39:42.912 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:42.932 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.090) 0:01:28.250 ******* 2021-03-10T13:39:42.959 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T13:39:42.961 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:39:42.986 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:42 +0000 (0:00:00.053) 0:01:28.303 ******* 2021-03-10T13:39:43.002 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:39:43.004 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.027 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.041) 0:01:28.344 ******* 2021-03-10T13:39:43.095 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:39:43.096 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.118 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.090) 0:01:28.435 ******* 2021-03-10T13:39:43.175 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.197 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.079) 0:01:28.514 ******* 2021-03-10T13:39:43.214 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T13:39:43.216 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:37:33 UTC", "ActiveEnterTimestampMonotonic": "15410966", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket system.slice -.mount network.target basic.target remote-fs.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:37:32 UTC", "AssertTimestampMonotonic": "13894855", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:37:32 UTC", "ConditionTimestampMonotonic": "13894855", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T13:39:43.217 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1518", "ExecMainStartTimestamp": "Wed 2021-03-10 13:37:33 UTC", "ExecMainStartTimestampMonotonic": "15410955", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T13:39:43.219 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:37:32 UTC", "InactiveExitTimestampMonotonic": "13895447", "InvocationID": "c3d6324ab4cf43319c11119abb14b49c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1518", "MemoryAccounting": "yes", "MemoryCurrent": "10555392", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T13:39:43.220 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:33 UTC", "StateChangeTimestampMonotonic": "15410966", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T13:39:43.222 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:39:43.241 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.043) 0:01:28.558 ******* 2021-03-10T13:39:43.257 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:39:43.258 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.282 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.040) 0:01:28.599 ******* 2021-03-10T13:39:43.308 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:39:43.310 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.333 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.051) 0:01:28.650 ******* 2021-03-10T13:39:43.349 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:39:43.350 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.374 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.040) 0:01:28.691 ******* 2021-03-10T13:39:43.400 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:39:43.402 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.424 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.050) 0:01:28.741 ******* 2021-03-10T13:39:43.440 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:39:43.441 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.464 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.039) 0:01:28.781 ******* 2021-03-10T13:39:43.490 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:39:43.492 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.514 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.050) 0:01:28.831 ******* 2021-03-10T13:39:43.530 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:39:43.531 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.554 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.039) 0:01:28.871 ******* 2021-03-10T13:39:43.580 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:39:43.582 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.608 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.054) 0:01:28.925 ******* 2021-03-10T13:39:43.624 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:39:43.626 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.649 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.041) 0:01:28.966 ******* 2021-03-10T13:39:43.676 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:39:43.677 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.051) 0:01:29.017 ******* 2021-03-10T13:39:43.716 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:39:43.717 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.744 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.043) 0:01:29.061 ******* 2021-03-10T13:39:43.761 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:39:43.763 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.786 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.041) 0:01:29.103 ******* 2021-03-10T13:39:43.801 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:39:43.803 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.826 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.040) 0:01:29.143 ******* 2021-03-10T13:39:43.852 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:39:43.854 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.877 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.051) 0:01:29.194 ******* 2021-03-10T13:39:43.893 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:39:43.895 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.918 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.041) 0:01:29.235 ******* 2021-03-10T13:39:43.945 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:39:43.947 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:43.968 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:43 +0000 (0:00:00.050) 0:01:29.285 ******* 2021-03-10T13:39:43.984 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:39:43.985 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.007 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.038) 0:01:29.324 ******* 2021-03-10T13:39:44.034 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:39:44.036 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.057 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.049) 0:01:29.374 ******* 2021-03-10T13:39:44.072 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:39:44.074 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.095 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.038) 0:01:29.413 ******* 2021-03-10T13:39:44.122 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:39:44.124 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.150 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.054) 0:01:29.467 ******* 2021-03-10T13:39:44.166 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:39:44.167 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.190 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.040) 0:01:29.507 ******* 2021-03-10T13:39:44.217 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:39:44.219 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.241 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.051) 0:01:29.558 ******* 2021-03-10T13:39:44.257 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:39:44.259 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.282 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.041) 0:01:29.599 ******* 2021-03-10T13:39:44.308 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:39:44.310 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.332 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.050) 0:01:29.650 ******* 2021-03-10T13:39:44.348 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:39:44.350 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.373 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.039) 0:01:29.690 ******* 2021-03-10T13:39:44.399 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:39:44.401 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.424 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.051) 0:01:29.741 ******* 2021-03-10T13:39:44.440 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:39:44.442 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.466 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.042) 0:01:29.783 ******* 2021-03-10T13:39:44.493 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:39:44.494 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.517 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.050) 0:01:29.834 ******* 2021-03-10T13:39:44.533 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:39:44.535 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.557 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.040) 0:01:29.874 ******* 2021-03-10T13:39:44.584 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:39:44.585 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.607 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.049) 0:01:29.924 ******* 2021-03-10T13:39:44.622 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:39:44.624 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.646 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.039) 0:01:29.963 ******* 2021-03-10T13:39:44.673 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:39:44.675 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.701 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.054) 0:01:30.018 ******* 2021-03-10T13:39:44.717 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:39:44.719 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.742 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.040) 0:01:30.059 ******* 2021-03-10T13:39:44.759 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:39:44.760 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.787 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.044) 0:01:30.104 ******* 2021-03-10T13:39:44.803 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:39:44.805 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.828 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.041) 0:01:30.145 ******* 2021-03-10T13:39:44.854 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:39:44.856 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.878 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.049) 0:01:30.195 ******* 2021-03-10T13:39:44.894 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:39:44.895 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.918 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.040) 0:01:30.235 ******* 2021-03-10T13:39:44.945 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:39:44.946 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:44.969 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:44 +0000 (0:00:00.050) 0:01:30.286 ******* 2021-03-10T13:39:44.985 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:39:44.987 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.010 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.040) 0:01:30.327 ******* 2021-03-10T13:39:45.037 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:39:45.039 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.060 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.050) 0:01:30.377 ******* 2021-03-10T13:39:45.077 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:39:45.078 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.100 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.039) 0:01:30.417 ******* 2021-03-10T13:39:45.127 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:39:45.128 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.151 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.050) 0:01:30.468 ******* 2021-03-10T13:39:45.167 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T13:39:45.169 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.190 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.039) 0:01:30.507 ******* 2021-03-10T13:39:45.216 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:39:45.218 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.243 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.052) 0:01:30.560 ******* 2021-03-10T13:39:45.311 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:39:45.313 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.334 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.090) 0:01:30.651 ******* 2021-03-10T13:39:45.340 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T13:39:45.341 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T13:39:45.365 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.031) 0:01:30.682 ******* 2021-03-10T13:39:45.392 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.416 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.050) 0:01:30.733 ******* 2021-03-10T13:39:45.473 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:39:45.475 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.496 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.080) 0:01:30.813 ******* 2021-03-10T13:39:45.564 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T13:39:45.566 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.091) 0:01:30.904 ******* 2021-03-10T13:39:45.635 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:39:45.636 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T13:39:45.659 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.071) 0:01:30.976 ******* 2021-03-10T13:39:45.727 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T13:39:45.728 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:45.749 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.090) 0:01:31.066 ******* 2021-03-10T13:39:45.770 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:45 +0000 (0:00:00.020) 0:01:31.087 ******* 2021-03-10T13:39:46.046 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:39:46.047 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T13:39:46.048 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T13:39:46.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.300) 0:01:31.387 ******* 2021-03-10T13:39:46.089 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.019) 0:01:31.406 ******* 2021-03-10T13:39:46.158 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:39:46.160 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:46.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.095) 0:01:31.502 ******* 2021-03-10T13:39:46.345 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T13:39:46.346 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T13:39:46.369 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.183) 0:01:31.686 ******* 2021-03-10T13:39:46.509 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T13:39:46.511 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T13:39:46.534 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.165) 0:01:31.851 ******* 2021-03-10T13:39:46.684 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T13:39:46.686 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T13:39:46.708 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.174) 0:01:32.026 ******* 2021-03-10T13:39:46.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T13:39:46.935 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.153) 0:01:32.179 ******* TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.031) 0:01:32.211 ******* 2021-03-10T13:39:46.962 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T13:39:46.963 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:46.985 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:46 +0000 (0:00:00.091) 0:01:32.302 ******* 2021-03-10T13:39:47.051 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T13:39:47.053 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.074 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.089) 0:01:32.391 ******* 2021-03-10T13:39:47.131 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T13:39:47.133 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T13:39:47.154 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.080) 0:01:32.471 ******* 2021-03-10T13:39:47.160 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T13:39:47.161 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.030) 0:01:32.502 ******* 2021-03-10T13:39:47.253 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T13:39:47.255 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.275 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.089) 0:01:32.592 ******* 2021-03-10T13:39:47.302 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T13:39:47.303 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:39:47.326 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.051) 0:01:32.643 ******* 2021-03-10T13:39:47.342 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T13:39:47.344 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.370 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.043) 0:01:32.687 ******* 2021-03-10T13:39:47.397 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T13:39:47.399 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.421 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.051) 0:01:32.738 ******* 2021-03-10T13:39:47.437 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:39:47.439 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T13:39:47.462 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.040) 0:01:32.779 ******* 2021-03-10T13:39:47.489 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T13:39:47.490 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.051) 0:01:32.830 ******* 2021-03-10T13:39:47.540 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba003.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.551 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.552 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.562 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.564 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.573 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.575 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** ok: [gibba003.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T13:39:47.596 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.083) 0:01:32.914 ******* 2021-03-10T13:39:47.602 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.603 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.603 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.604 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.615 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.616 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.626 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.654 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.057) 0:01:32.971 ******* 2021-03-10T13:39:47.660 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T13:39:47.662 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.685 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.031) 0:01:33.002 ******* 2021-03-10T13:39:47.753 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T13:39:47.755 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.776 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.090) 0:01:33.093 ******* 2021-03-10T13:39:47.854 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:39:47.856 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T13:39:47.878 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.101) 0:01:33.195 ******* 2021-03-10T13:39:47.884 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T13:39:47.885 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003093", "end": "2021-03-10 13:39:47.858514", "rc": 0, "start": "2021-03-10 13:39:47.855421", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T13:39:47.912 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:47 +0000 (0:00:00.034) 0:01:33.230 ******* 2021-03-10T13:39:47.952 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T13:39:47.954 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.964 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.965 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.975 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.976 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.986 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:47.988 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** ok: [gibba043.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T13:39:48.013 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.100) 0:01:33.330 ******* 2021-03-10T13:39:48.020 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.022 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.033 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.035 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.061 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.048) 0:01:33.378 ******* 2021-03-10T13:39:48.087 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T13:39:48.089 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.115 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.053) 0:01:33.432 ******* 2021-03-10T13:39:48.184 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T13:39:48.185 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.207 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.091) 0:01:33.524 ******* 2021-03-10T13:39:48.285 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T13:39:48.287 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002944", "end": "2021-03-10 13:39:48.266818", "rc": 0, "start": "2021-03-10 13:39:48.263874", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T13:39:48.313 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.105) 0:01:33.630 ******* 2021-03-10T13:39:48.380 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T13:39:48.382 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.406 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.092) 0:01:33.723 ******* 2021-03-10T13:39:48.472 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T13:39:48.474 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.495 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.089) 0:01:33.812 ******* 2021-03-10T13:39:48.562 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T13:39:48.564 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.585 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.089) 0:01:33.902 ******* 2021-03-10T13:39:48.641 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T13:39:48.643 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:39:48.665 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.080) 0:01:33.982 ******* 2021-03-10T13:39:48.733 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T13:39:48.734 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:48.756 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.090) 0:01:34.073 ******* 2021-03-10T13:39:48.835 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:39:48.836 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T13:39:48.869 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:48 +0000 (0:00:00.113) 0:01:34.187 ******* 2021-03-10T13:39:49.021 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T13:39:49.023 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002383", "end": "2021-03-10 13:39:49.076892", "rc": 0, "start": "2021-03-10 13:39:49.074509", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:39:49.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.175) 0:01:34.362 ******* 2021-03-10T13:39:49.066 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.021) 0:01:34.383 ******* 2021-03-10T13:39:49.125 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T13:39:49.127 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:49.148 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.081) 0:01:34.465 ******* 2021-03-10T13:39:49.154 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T13:39:49.156 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:49.183 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.034) 0:01:34.500 ******* 2021-03-10T13:39:49.211 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T13:39:49.235 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.052) 0:01:34.552 ******* 2021-03-10T13:39:49.263 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:39:49.264 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T13:39:49.288 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.052) 0:01:34.605 ******* 2021-03-10T13:39:49.315 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:39:49.317 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:49.430 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T13:39:49.432 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002519", "end": "2021-03-10 13:39:49.857828", "rc": 0, "start": "2021-03-10 13:39:49.855309", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:49.453 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.165) 0:01:34.770 ******* 2021-03-10T13:39:49.532 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T13:39:49.534 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:49.556 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.102) 0:01:34.873 ******* 2021-03-10T13:39:49.623 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T13:39:49.645 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:49 +0000 (0:00:00.089) 0:01:34.962 ******* 2021-03-10T13:39:49.733 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:39:49.734 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:51.071 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3bvw9kB0xUs8vcz2FEkcIia4c23vzhSgO'], 'uuids': ['0589f4da-d314-4679-922f-57b12b02bfe3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.662028", "end": "2021-03-10 13:39:51.119283", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3bvw9kB0xUs8vcz2FEkcIia4c23vzhSgO"], "labels": [], "masters": [], "uuids": ["0589f4da-d314-4679-922f-57b12b02bfe3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:49.457255", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:51.082 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:51.083 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:51.549 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWl6ue5JctvVYMeckYi96HmcYY9XkgTnk9'], 'uuids': ['5858fe25-a9b6-49f6-8855-cc70945ce968']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.725146", "end": "2021-03-10 13:39:51.974814", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWl6ue5JctvVYMeckYi96HmcYY9XkgTnk9"], "labels": [], "masters": [], "uuids": ["5858fe25-a9b6-49f6-8855-cc70945ce968"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:50.249668", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:51.561 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:51.572 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:52.273 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi32YCsJMrgd3zujIZa37uivDUKQkYEemgQ'], 'uuids': ['83d6481b-35e6-4dee-bef7-3dabb6dc87af']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.106813", "end": "2021-03-10 13:39:52.322804", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi32YCsJMrgd3zujIZa37uivDUKQkYEemgQ"], "labels": [], "masters": [], "uuids": ["83d6481b-35e6-4dee-bef7-3dabb6dc87af"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:51.215991", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:52.285 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF', 'wwn-0x50000399ac6019dc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF-part1', 'wwn-0x50000399ac6019dc-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ac6019dc', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9IVK2O6F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF", "wwn-0x50000399ac6019dc"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF-part1", "wwn-0x50000399ac6019dc-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9IVK2O6F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ac6019dc"}}, "skip_reason": "Cond 2021-03-10T13:39:52.286 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:39:52.751 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWFAPYder8r1NfE6efV75ybfDUlgfJ6GPD'], 'uuids': ['3ad091ef-0c51-46a9-a0b6-6f7eaea3c186']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.100135", "end": "2021-03-10 13:39:53.174072", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWFAPYder8r1NfE6efV75ybfDUlgfJ6GPD"], "labels": [], "masters": [], "uuids": ["3ad091ef-0c51-46a9-a0b6-6f7eaea3c186"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:52.073937", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:52.762 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF', 'wwn-0x50000399aba81666'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1', 'wwn-0x50000399aba81666-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba81666', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38GF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF", "wwn-0x50000399aba81666"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1", "wwn-0x50000399aba81666-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38GF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81666"}}, "skip_reason": "Cond 2021-03-10T13:39:52.764 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:39:53.528 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-QcVot6-4yw2-mZhR-pZdi-OFkc-vlDE-eNDyRT', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200008A375A', 'nvme-nvme.8086-50484b4d393230303030384133373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.135698", "end": "2021-03-10 13:39:53.581976", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-QcVot6-4yw2-mZhR-pZdi-OFkc-vlDE-eNDyRT", "nvme-INTEL_SSDPEL1K375GA_PHKM9200008A375A", "nvme-nvme.8086-50484b4d393230303030384133373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:52.446278", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T13:39:53.530 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:53.540 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:53.551 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:53.996 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-tFs0BT-hfHS-465u-A9sT-ispk-BD5Y-YG15q8', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A', 'nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.116383", "end": "2021-03-10 13:39:54.417474", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-tFs0BT-hfHS-465u-A9sT-ispk-BD5Y-YG15q8", "nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A", "nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:53.301091", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T13:39:53.998 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:54.008 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:54.009 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:54.751 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3OIQDevzcjJaRP2eG9krpuvN37oVokQ1g'], 'uuids': ['7c109f7b-0267-4e3d-92a4-8f2afc14614e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.115896", "end": "2021-03-10 13:39:54.799880", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3OIQDevzcjJaRP2eG9krpuvN37oVokQ1g"], "labels": [], "masters": [], "uuids": ["7c109f7b-0267-4e3d-92a4-8f2afc14614e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:53.683984", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:54.762 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:54.763 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:55.207 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWzPIea1SX29rb0il6bY9UvgSceEmaaqre'], 'uuids': ['794eefba-f0ef-48ee-98bf-058c378f2282']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.111537", "end": "2021-03-10 13:39:55.633613", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWzPIea1SX29rb0il6bY9UvgSceEmaaqre"], "labels": [], "masters": [], "uuids": ["794eefba-f0ef-48ee-98bf-058c378f2282"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:54.522076", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:55.219 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:55.230 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:55.953 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3Q356e3GEUB1F420eqYU91TwXXUmnCOME'], 'uuids': ['f41903b9-55b3-4ecc-ac5e-df55e85c64f9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.101980", "end": "2021-03-10 13:39:55.999493", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3Q356e3GEUB1F420eqYU91TwXXUmnCOME"], "labels": [], "masters": [], "uuids": ["f41903b9-55b3-4ecc-ac5e-df55e85c64f9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:54.897513", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:55.964 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:56.420 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWqlXr8GQiBOPWmU2G8vAFOBoKorFIo8oF'], 'uuids': ['7f483627-0fd5-4421-b739-8b61c90c9bf0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.107242", "end": "2021-03-10 13:39:56.841678", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWqlXr8GQiBOPWmU2G8vAFOBoKorFIo8oF"], "labels": [], "masters": [], "uuids": ["7f483627-0fd5-4421-b739-8b61c90c9bf0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:55.734436", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:56.432 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.146 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3EYqShqezBbSL10ae3qkC9XYuvdAKPVBb'], 'uuids': ['3035bc44-eb38-4101-ae05-9b363272b257']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.104287", "end": "2021-03-10 13:39:57.200798", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3EYqShqezBbSL10ae3qkC9XYuvdAKPVBb"], "labels": [], "masters": [], "uuids": ["3035bc44-eb38-4101-ae05-9b363272b257"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:56.096511", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:57.188 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:57 +0000 (0:00:07.543) 0:01:42.505 ******* 2021-03-10T13:39:57.267 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:39:57.269 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.444 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3bvw9kB0xUs8vcz2FEkcIia4c23vzhSgO'], 'uuids': ['0589f4da-d314-4679-922f-57b12b02bfe3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078023", "end": "2021-03-10 13:39:57.491736", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3bvw9kB0xUs8vcz2FEkcIia4c23vzhSgO"], "labels": [], "masters": [], "uuids": ["0589f4da-d314-4679-922f-57b12b02bfe3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:57.413713", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767283 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767283 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:57.445 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.456 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.624 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi32YCsJMrgd3zujIZa37uivDUKQkYEemgQ'], 'uuids': ['83d6481b-35e6-4dee-bef7-3dabb6dc87af']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077668", "end": "2021-03-10 13:39:57.676544", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi32YCsJMrgd3zujIZa37uivDUKQkYEemgQ"], "labels": [], "masters": [], "uuids": ["83d6481b-35e6-4dee-bef7-3dabb6dc87af"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:57.598876", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764986 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764986 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:57.625 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF', 'wwn-0x50000399ac6019dc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF-part1', 'wwn-0x50000399ac6019dc-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ac6019dc', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9IVK2O6F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF", "wwn-0x50000399ac6019dc"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF-part1", "wwn-0x50000399ac6019dc-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9IVK2O6F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ac6019dc"}}, "skip_reason": "Cond 2021-03-10T13:39:57.627 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:39:57.637 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:39:57.639 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWIPe9ZAExj3nlIlAAWeFAcKIQopXRfnrt'], 'uuids': ['dac27ebb-3ba8-4ac7-b1d0-f5c8da2e363d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.117945", "end": "2021-03-10 13:39:58.053389", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWIPe9ZAExj3nlIlAAWeFAcKIQopXRfnrt"], "labels": [], "masters": [], "uuids": ["dac27ebb-3ba8-4ac7-b1d0-f5c8da2e363d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:56.935444", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:39:57.670 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:57 +0000 (0:00:00.481) 0:01:42.987 ******* 2021-03-10T13:39:57.729 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:39:57.731 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-QcVot6-4yw2-mZhR-pZdi-OFkc-vlDE-eNDyRT', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200008A375A', 'nvme-nvme.8086-50484b4d393230303030384133373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.024751", "end": "2021-03-10 13:39:57.783590", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-QcVot6-4yw2-mZhR-pZdi-OFkc-vlDE-eNDyRT", "nvme-INTEL_SSDPEL1K375GA_PHKM9200008A375A", "nvme-nvme.8086-50484b4d393230303030384133373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:57.758839", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0235563 s, 4.9 GB/s", "stderr_lines": ["1 2021-03-10T13:39:57.733 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0235563 s, 4.9 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:57.742 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.743 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.754 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.911 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWl6ue5JctvVYMeckYi96HmcYY9XkgTnk9'], 'uuids': ['5858fe25-a9b6-49f6-8855-cc70945ce968']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.076521", "end": "2021-03-10 13:39:58.334432", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWl6ue5JctvVYMeckYi96HmcYY9XkgTnk9"], "labels": [], "masters": [], "uuids": ["5858fe25-a9b6-49f6-8855-cc70945ce968"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:58.257911", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0752713 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0752713 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:57.912 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.923 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.945 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3OIQDevzcjJaRP2eG9krpuvN37oVokQ1g'], 'uuids': ['7c109f7b-0267-4e3d-92a4-8f2afc14614e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077911", "end": "2021-03-10 13:39:57.998328", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3OIQDevzcjJaRP2eG9krpuvN37oVokQ1g"], "labels": [], "masters": [], "uuids": ["7c109f7b-0267-4e3d-92a4-8f2afc14614e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:57.920417", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766753 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766753 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:57.947 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:57.958 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.073 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWFAPYder8r1NfE6efV75ybfDUlgfJ6GPD'], 'uuids': ['3ad091ef-0c51-46a9-a0b6-6f7eaea3c186']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078374", "end": "2021-03-10 13:39:58.500369", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWFAPYder8r1NfE6efV75ybfDUlgfJ6GPD"], "labels": [], "masters": [], "uuids": ["3ad091ef-0c51-46a9-a0b6-6f7eaea3c186"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:58.421995", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771739 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771739 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.084 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF', 'wwn-0x50000399aba81666'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1', 'wwn-0x50000399aba81666-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba81666', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38GF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF", "wwn-0x50000399aba81666"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1", "wwn-0x50000399aba81666-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38GF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81666"}}, "skip_reason": "Cond 2021-03-10T13:39:58.086 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:39:58.127 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3Q356e3GEUB1F420eqYU91TwXXUmnCOME'], 'uuids': ['f41903b9-55b3-4ecc-ac5e-df55e85c64f9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078019", "end": "2021-03-10 13:39:58.179071", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3Q356e3GEUB1F420eqYU91TwXXUmnCOME"], "labels": [], "masters": [], "uuids": ["f41903b9-55b3-4ecc-ac5e-df55e85c64f9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:58.101052", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767582 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767582 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.138 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.191 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-tFs0BT-hfHS-465u-A9sT-ispk-BD5Y-YG15q8', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A', 'nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025579", "end": "2021-03-10 13:39:58.621238", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-tFs0BT-hfHS-465u-A9sT-ispk-BD5Y-YG15q8", "nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A", "nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:58.595659", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.024284 s, 4.7 GB/s", "stderr_lines": ["11 2021-03-10T13:39:58.193 INFO:teuthology.task.ansible.out:0+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.024284 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.203 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.204 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.319 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3EYqShqezBbSL10ae3qkC9XYuvdAKPVBb'], 'uuids': ['3035bc44-eb38-4101-ae05-9b363272b257']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.077835", "end": "2021-03-10 13:39:58.372308", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-GOtd5snKgAMHucLwwK3r7KMTtK7xtXi3EYqShqezBbSL10ae3qkC9XYuvdAKPVBb"], "labels": [], "masters": [], "uuids": ["3035bc44-eb38-4101-ae05-9b363272b257"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:58.294473", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766283 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766283 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.351 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:58 +0000 (0:00:00.681) 0:01:43.668 ******* 2021-03-10T13:39:58.504 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWzPIea1SX29rb0il6bY9UvgSceEmaaqre'], 'uuids': ['794eefba-f0ef-48ee-98bf-058c378f2282']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078020", "end": "2021-03-10 13:39:58.933131", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWzPIea1SX29rb0il6bY9UvgSceEmaaqre"], "labels": [], "masters": [], "uuids": ["794eefba-f0ef-48ee-98bf-058c378f2282"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:58.855111", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767023 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767023 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.515 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.517 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.684 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWqlXr8GQiBOPWmU2G8vAFOBoKorFIo8oF'], 'uuids': ['7f483627-0fd5-4421-b739-8b61c90c9bf0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078731", "end": "2021-03-10 13:39:59.114398", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWqlXr8GQiBOPWmU2G8vAFOBoKorFIo8oF"], "labels": [], "masters": [], "uuids": ["7f483627-0fd5-4421-b739-8b61c90c9bf0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:59.035667", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0775055 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0775055 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.695 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:58.696 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T13:39:58.696 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.183942", "end": "2021-03-10 13:39:58.694472", "rc": 0, "start": "2021-03-10 13:39:58.510530", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.718 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:58 +0000 (0:00:00.366) 0:01:44.035 ******* 2021-03-10T13:39:58.878 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T13:39:58.880 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.068524", "end": "2021-03-10 13:39:58.933512", "rc": 0, "start": "2021-03-10 13:39:58.864988", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.901 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:58 +0000 (0:00:00.182) 0:01:44.218 ******* 2021-03-10T13:39:58.909 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:39:58.909 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWIPe9ZAExj3nlIlAAWeFAcKIQopXRfnrt'], 'uuids': ['dac27ebb-3ba8-4ac7-b1d0-f5c8da2e363d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078323", "end": "2021-03-10 13:39:59.330148", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-AhLwDS9gRKMEfR24iDxwYXkP7DeoUyIWIPe9ZAExj3nlIlAAWeFAcKIQopXRfnrt"], "labels": [], "masters": [], "uuids": ["dac27ebb-3ba8-4ac7-b1d0-f5c8da2e363d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:39:59.251825", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.077102 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.077102 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:58.945 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:58 +0000 (0:00:00.044) 0:01:44.262 ******* 2021-03-10T13:39:58.961 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T13:39:59.027 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.082) 0:01:44.344 ******* 2021-03-10T13:39:59.055 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T13:39:59.056 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.079 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.051) 0:01:44.396 ******* 2021-03-10T13:39:59.105 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T13:39:59.106 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.126 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.047) 0:01:44.443 ******* 2021-03-10T13:39:59.152 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:39:59.153 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.175 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.048) 0:01:44.492 ******* 2021-03-10T13:39:59.200 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T13:39:59.202 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.222 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.046) 0:01:44.539 ******* 2021-03-10T13:39:59.320 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T13:39:59.322 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:39:59.343 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.120) 0:01:44.660 ******* 2021-03-10T13:39:59.369 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T13:39:59.371 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.197838", "end": "2021-03-10 13:39:59.717665", "rc": 0, "start": "2021-03-10 13:39:59.519827", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:59.394 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.051) 0:01:44.711 ******* 2021-03-10T13:39:59.401 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:39:59.402 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.428 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.033) 0:01:44.745 ******* 2021-03-10T13:39:59.454 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.476 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.048) 0:01:44.793 ******* 2021-03-10T13:39:59.502 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.525 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.049) 0:01:44.843 ******* 2021-03-10T13:39:59.552 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.574 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.048) 0:01:44.891 ******* 2021-03-10T13:39:59.580 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T13:39:59.581 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.082809", "end": "2021-03-10 13:40:00.000870", "rc": 0, "start": "2021-03-10 13:39:59.918061", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:39:59.603 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.029) 0:01:44.920 ******* 2021-03-10T13:39:59.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T13:39:59.610 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.631 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.027) 0:01:44.948 ******* 2021-03-10T13:39:59.637 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T13:39:59.661 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.030) 0:01:44.978 ******* 2021-03-10T13:39:59.667 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T13:39:59.668 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.029) 0:01:45.008 ******* 2021-03-10T13:39:59.696 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T13:39:59.698 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.721 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.030) 0:01:45.038 ******* 2021-03-10T13:39:59.727 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T13:39:59.728 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.750 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.028) 0:01:45.067 ******* 2021-03-10T13:39:59.755 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T13:39:59.757 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.779 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.029) 0:01:45.096 ******* 2021-03-10T13:39:59.804 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:39:59.806 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.831 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.051) 0:01:45.148 ******* 2021-03-10T13:39:59.857 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T13:39:59.858 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:39:59.971 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:39:59 +0000 (0:00:00.139) 0:01:45.288 ******* 2021-03-10T13:40:00.070 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T13:40:00.072 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:40:00.093 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.122) 0:01:45.410 ******* 2021-03-10T13:40:00.130 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:40:00.132 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.153 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.059) 0:01:45.470 ******* 2021-03-10T13:40:00.178 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T13:40:00.180 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.201 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.048) 0:01:45.518 ******* 2021-03-10T13:40:00.227 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:00.229 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.047) 0:01:45.566 ******* 2021-03-10T13:40:00.275 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:00.277 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.298 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.048) 0:01:45.615 ******* 2021-03-10T13:40:00.324 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T13:40:00.326 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.346 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.048) 0:01:45.663 ******* 2021-03-10T13:40:00.372 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T13:40:00.373 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.393 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.047) 0:01:45.711 ******* 2021-03-10T13:40:00.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T13:40:00.421 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:00.441 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.047) 0:01:45.758 ******* 2021-03-10T13:40:00.477 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T13:40:00.479 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T13:40:00.502 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.061) 0:01:45.819 ******* 2021-03-10T13:40:00.945 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T13:40:00.967 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:00 +0000 (0:00:00.465) 0:01:46.284 ******* 2021-03-10T13:40:01.025 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T13:40:01.026 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:01.332 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:01.374 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:01.685 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:01.810 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:02.028 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:02.247 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:02.454 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:02.632 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:02.668 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:02 +0000 (0:00:01.700) 0:01:47.985 ******* 2021-03-10T13:40:02.782 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:40:02.784 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T13:40:02.806 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:02 +0000 (0:00:00.138) 0:01:48.123 ******* 2021-03-10T13:40:02.843 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T13:40:02.845 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:40:02.870 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:02 +0000 (0:00:00.064) 0:01:48.187 ******* 2021-03-10T13:40:02.939 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:40:02.941 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:02.993 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:40:02.995 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T13:40:03.017 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.146) 0:01:48.334 ******* 2021-03-10T13:40:03.034 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:40:03.036 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.109 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.131 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.184 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.195 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:03.222 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.204) 0:01:48.539 ******* 2021-03-10T13:40:03.230 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.242 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T13:40:03.244 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:03.264 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.042) 0:01:48.582 ******* 2021-03-10T13:40:03.291 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T13:40:03.293 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.318 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.053) 0:01:48.635 ******* 2021-03-10T13:40:03.366 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:40:03.378 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:03.405 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.086) 0:01:48.722 ******* 2021-03-10T13:40:03.422 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T13:40:03.424 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:03.445 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.040) 0:01:48.762 ******* 2021-03-10T13:40:03.451 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T13:40:03.453 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:03.477 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.031) 0:01:48.794 ******* 2021-03-10T13:40:03.483 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T13:40:03.485 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T13:40:03.509 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.032) 0:01:48.826 ******* 2021-03-10T13:40:03.516 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T13:40:03.517 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:03.542 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.032) 0:01:48.859 ******* 2021-03-10T13:40:03.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T13:40:03.653 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:03.674 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.132) 0:01:48.991 ******* 2021-03-10T13:40:03.711 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T13:40:03.712 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T13:40:03.733 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.059) 0:01:49.050 ******* 2021-03-10T13:40:03.812 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-10T13:40:03.813 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true} 2021-03-10T13:40:03.839 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.105) 0:01:49.156 ******* 2021-03-10T13:40:03.866 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true} 2021-03-10T13:40:03.889 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:03 +0000 (0:00:00.049) 0:01:49.206 ******* 2021-03-10T13:40:04.144 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T13:40:04.146 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T13:40:04.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.278) 0:01:49.485 ******* 2021-03-10T13:40:04.185 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T13:40:04.210 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.042) 0:01:49.527 ******* 2021-03-10T13:40:04.216 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-10T13:40:04.218 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.240 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.029) 0:01:49.557 ******* 2021-03-10T13:40:04.246 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.268 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.027) 0:01:49.585 ******* 2021-03-10T13:40:04.273 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T13:40:04.274 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.297 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.028) 0:01:49.614 ******* 2021-03-10T13:40:04.303 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.326 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.029) 0:01:49.643 ******* 2021-03-10T13:40:04.331 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:40:04.332 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.355 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.028) 0:01:49.672 ******* 2021-03-10T13:40:04.361 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.386 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.030) 0:01:49.703 ******* 2021-03-10T13:40:04.391 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:40:04.393 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.415 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.029) 0:01:49.732 ******* 2021-03-10T13:40:04.421 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:04.445 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.030) 0:01:49.762 ******* 2021-03-10T13:40:04.534 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-10T13:40:04.536 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:40:04.559 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.113) 0:01:49.876 ******* 2021-03-10T13:40:04.586 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:40:04.611 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.052) 0:01:49.928 ******* 2021-03-10T13:40:04.669 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-10T13:40:04.671 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:04.693 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.081) 0:01:50.010 ******* 2021-03-10T13:40:04.720 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:04.751 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.058) 0:01:50.068 ******* 2021-03-10T13:40:04.943 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-10T13:40:04.945 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T13:40:04.969 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:04 +0000 (0:00:00.217) 0:01:50.286 ******* 2021-03-10T13:40:05.080 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T13:40:05.105 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:05 +0000 (0:00:00.135) 0:01:50.422 ******* 2021-03-10T13:40:05.193 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-10T13:40:05.195 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T13:40:05.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:05 +0000 (0:00:00.111) 0:01:50.534 ******* 2021-03-10T13:40:05.336 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T13:40:05.361 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:05 +0000 (0:00:00.144) 0:01:50.678 ******* 2021-03-10T13:40:05.645 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-10T13:40:05.646 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:40:05.668 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:05 +0000 (0:00:00.307) 0:01:50.985 ******* 2021-03-10T13:40:05.787 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:40:05.811 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:05 +0000 (0:00:00.142) 0:01:51.128 ******* 2021-03-10T13:40:05.951 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T13:40:05.953 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.176518", "end": "2021-03-10 13:40:06.006287", "rc": 0, "start": "2021-03-10 13:40:05.829769", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T13:40:05.975 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:05 +0000 (0:00:00.164) 0:01:51.292 ******* 2021-03-10T13:40:06.002 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-10T13:40:06.003 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.025 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.049) 0:01:51.342 ******* 2021-03-10T13:40:06.051 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T13:40:06.053 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.074 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.049) 0:01:51.391 ******* 2021-03-10T13:40:06.080 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T13:40:06.081 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.141547", "end": "2021-03-10 13:40:06.492465", "rc": 0, "start": "2021-03-10 13:40:06.350918", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T13:40:06.104 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.029) 0:01:51.421 ******* 2021-03-10T13:40:06.130 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-10T13:40:06.131 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.159 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.055) 0:01:51.476 ******* 2021-03-10T13:40:06.186 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T13:40:06.188 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.209 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.049) 0:01:51.526 ******* 2021-03-10T13:40:06.473 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T13:40:06.475 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:40:06.498 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.289) 0:01:51.815 ******* 2021-03-10T13:40:06.526 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T13:40:06.528 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.550 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.051) 0:01:51.867 ******* 2021-03-10T13:40:06.618 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T13:40:06.620 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:40:06.643 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.093) 0:01:51.960 ******* 2021-03-10T13:40:06.669 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T13:40:06.671 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.693 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.049) 0:01:52.010 ******* 2021-03-10T13:40:06.792 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T13:40:06.793 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T13:40:06.820 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.126) 0:01:52.137 ******* 2021-03-10T13:40:06.847 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T13:40:06.848 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:06.870 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.050) 0:01:52.187 ******* 2021-03-10T13:40:06.939 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T13:40:06.941 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T13:40:06.964 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:06 +0000 (0:00:00.094) 0:01:52.282 ******* 2021-03-10T13:40:06.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T13:40:06.993 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:07.014 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.049) 0:01:52.331 ******* 2021-03-10T13:40:07.062 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T13:40:07.063 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:37:26 UTC", "ActiveEnterTimestampMonotonic": "12391316", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service network.target basic.target systemd-journald.socket sysinit.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:37:26 UTC", "AssertTimestampMonotonic": "12250862", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:37:26 UTC", "ConditionTimestampMonotonic": "12250861", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-03-10T13:40:07.065 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "965", "ExecMainStartTimestamp": "Wed 2021-03-10 13:37:26 UTC", "ExecMainStartTimestampMonotonic": "12391307", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:37:26 UTC", "InactiveExitTimestampMonotonic": "12251504", "InvocationID": "3dee65b5fff24a87afe95082704de428", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T13:40:07.067 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "965", "MemoryAccounting": "yes", "MemoryCurrent": "4050944", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-03-10T13:40:07.068 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:26 UTC", "StateChangeTimestampMonotonic": "12391316", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:40:07.094 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.079) 0:01:52.411 ******* 2021-03-10T13:40:07.122 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:07.123 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T13:40:07.144 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.049) 0:01:52.461 ******* 2021-03-10T13:40:07.181 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:07.182 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T13:40:07.203 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.058) 0:01:52.520 ******* 2021-03-10T13:40:07.209 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T13:40:07.211 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:37:31 UTC", "ActiveEnterTimestampMonotonic": "13039332", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice -.mount basic.target sysinit.target systemd-journald.socket network.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:37:31 UTC", "AssertTimestampMonotonic": "12794672", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:37:31 UTC", "ConditionTimestampMonotonic": "12794672", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-03-10T13:40:07.212 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1089", "ExecMainStartTimestamp": "Wed 2021-03-10 13:37:31 UTC", "ExecMainStartTimestampMonotonic": "13039323", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:37:31 UTC", "InactiveExitTimestampMonotonic": "12795265", "InvocationID": "0c254e9496ba4750aa0384c592c27747", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-03-10T13:40:07.214 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1089", "MemoryAccounting": "yes", "MemoryCurrent": "3629056", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requ 2021-03-10T13:40:07.216 INFO:teuthology.task.ansible.out:iresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:31 UTC", "StateChangeTimestampMonotonic": "13039332", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:40:07.235 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.031) 0:01:52.552 ******* 2021-03-10T13:40:07.240 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T13:40:07.241 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:07.264 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.029) 0:01:52.581 ******* 2021-03-10T13:40:07.270 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:07.272 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T13:40:07.295 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.031) 0:01:52.613 ******* 2021-03-10T13:40:07.321 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:07.323 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T13:40:07.343 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.048) 0:01:52.661 ******* 2021-03-10T13:40:07.369 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T13:40:07.370 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:07.393 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:07 +0000 (0:00:00.049) 0:01:52.710 ******* 2021-03-10T13:40:08.049 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T13:40:08.051 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:40:08.073 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.679) 0:01:53.390 ******* 2021-03-10T13:40:08.099 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T13:40:08.101 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:08.127 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.053) 0:01:53.444 ******* 2021-03-10T13:40:08.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T13:40:08.258 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:40:08.279 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.152) 0:01:53.596 ******* 2021-03-10T13:40:08.285 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T13:40:08.287 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:40:08.312 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.032) 0:01:53.629 ******* 2021-03-10T13:40:08.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T13:40:08.339 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:08.361 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.049) 0:01:53.678 ******* 2021-03-10T13:40:08.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T13:40:08.492 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:40:08.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.152) 0:01:53.830 ******* 2021-03-10T13:40:08.560 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-10T13:40:08.562 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T13:40:08.585 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.071) 0:01:53.902 ******* 2021-03-10T13:40:08.819 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T13:40:08.843 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:08 +0000 (0:00:00.258) 0:01:54.160 ******* 2021-03-10T13:40:10.423 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-10T13:40:10.424 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T13:40:10.460 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:10 +0000 (0:00:01.616) 0:01:55.777 ******* 2021-03-10T13:40:10.519 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T13:40:10.552 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:10 +0000 (0:00:00.092) 0:01:55.869 ******* 2021-03-10T13:40:10.797 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T13:40:10.798 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false} 2021-03-10T13:40:10.821 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:10 +0000 (0:00:00.269) 0:01:56.138 ******* 2021-03-10T13:40:10.848 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T13:40:10.850 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T13:40:10.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:10 +0000 (0:00:00.050) 0:01:56.189 ******* 2021-03-10T13:40:10.919 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T13:40:10.921 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false} 2021-03-10T13:40:10.944 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:10 +0000 (0:00:00.072) 0:01:56.261 ******* 2021-03-10T13:40:10.971 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T13:40:10.973 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T13:40:10.994 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:10 +0000 (0:00:00.049) 0:01:56.311 ******* 2021-03-10T13:40:11.002 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T13:40:11.002 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615383463.106491, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615383463.098491, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615383463.098491, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T13:40:11.028 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.033) 0:01:56.345 ******* 2021-03-10T13:40:11.128 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615383467.8244023, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615383467.8204021, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615383467.8204021, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T13:40:11.152 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.123) 0:01:56.469 ******* 2021-03-10T13:40:11.292 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-10T13:40:11.294 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T13:40:11.320 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.167) 0:01:56.637 ******* 2021-03-10T13:40:11.327 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T13:40:11.352 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.032) 0:01:56.670 ******* 2021-03-10T13:40:11.359 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-10T13:40:11.360 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T13:40:11.391 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.038) 0:01:56.708 ******* 2021-03-10T13:40:11.397 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T13:40:11.423 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.032) 0:01:56.740 ******* 2021-03-10T13:40:11.429 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-10T13:40:11.431 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.456 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.033) 0:01:56.773 ******* 2021-03-10T13:40:11.462 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.488 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.031) 0:01:56.805 ******* 2021-03-10T13:40:11.587 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-10T13:40:11.589 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T13:40:11.612 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.124) 0:01:56.929 ******* 2021-03-10T13:40:11.619 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T13:40:11.644 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.031) 0:01:56.961 ******* 2021-03-10T13:40:11.743 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T13:40:11.745 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T13:40:11.767 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.123) 0:01:57.085 ******* 2021-03-10T13:40:11.774 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T13:40:11.798 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.031) 0:01:57.116 ******* 2021-03-10T13:40:11.804 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-10T13:40:11.806 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.828 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.029) 0:01:57.145 ******* 2021-03-10T13:40:11.834 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.859 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.031) 0:01:57.176 ******* 2021-03-10T13:40:11.866 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-10T13:40:11.868 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.878 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.880 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.904 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.045) 0:01:57.221 ******* 2021-03-10T13:40:11.910 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.911 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.913 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.938 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.033) 0:01:57.255 ******* 2021-03-10T13:40:11.945 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T13:40:11.947 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.957 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.958 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.984 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.045) 0:01:57.301 ******* 2021-03-10T13:40:11.992 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.993 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:11.994 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.004 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.006 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.006 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.030 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.046) 0:01:57.347 ******* 2021-03-10T13:40:12.055 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.024) 0:01:57.372 ******* 2021-03-10T13:40:12.061 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T13:40:12.063 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.085 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.029) 0:01:57.402 ******* 2021-03-10T13:40:12.090 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:40:12.092 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.116 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:01:57.433 ******* 2021-03-10T13:40:12.122 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T13:40:12.124 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.150 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.033) 0:01:57.467 ******* 2021-03-10T13:40:12.157 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T13:40:12.158 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.181 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:01:57.498 ******* 2021-03-10T13:40:12.186 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T13:40:12.188 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.209 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.028) 0:01:57.526 ******* 2021-03-10T13:40:12.215 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T13:40:12.216 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.240 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:01:57.557 ******* 2021-03-10T13:40:12.246 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T13:40:12.248 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:01:57.589 ******* 2021-03-10T13:40:12.278 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T13:40:12.280 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.301 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.028) 0:01:57.618 ******* 2021-03-10T13:40:12.306 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:40:12.308 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.332 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:01:57.649 ******* 2021-03-10T13:40:12.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T13:40:12.340 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.030) 0:01:57.680 ******* 2021-03-10T13:40:12.368 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T13:40:12.369 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.391 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.028) 0:01:57.708 ******* 2021-03-10T13:40:12.396 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:40:12.398 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.425 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.033) 0:01:57.742 ******* 2021-03-10T13:40:12.431 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:40:12.432 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.454 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.028) 0:01:57.771 ******* 2021-03-10T13:40:12.459 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T13:40:12.460 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.485 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:01:57.802 ******* 2021-03-10T13:40:12.511 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:40:12.512 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:12.535 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.049) 0:01:57.852 ******* 2021-03-10T13:40:12.582 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T13:40:12.584 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002515", "end": "2021-03-10 13:40:12.629533", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 13:40:12.627018", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.666 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002506", "end": "2021-03-10 13:40:13.089985", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 13:40:13.087479", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.688 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001827", "end": "2021-03-10 13:40:12.732371", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 13:40:12.730544", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.771 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001717", "end": "2021-03-10 13:40:13.190967", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 13:40:13.189250", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.782 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001692", "end": "2021-03-10 13:40:12.832780", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 13:40:12.831088", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.867 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001655", "end": "2021-03-10 13:40:13.287545", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 13:40:13.285890", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.919 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025399", "end": "2021-03-10 13:40:12.958571", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 13:40:12.933172", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:12.945 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.410) 0:01:58.262 ******* 2021-03-10T13:40:12.972 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T13:40:12.999 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.048) 0:01:58.311 ******* 2021-03-10T13:40:13.026 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T13:40:13.027 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.053055", "end": "2021-03-10 13:40:13.446039", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 13:40:13.392984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:13.053 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.054) 0:01:58.370 ******* 2021-03-10T13:40:13.080 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T13:40:13.103 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.049) 0:01:58.420 ******* 2021-03-10T13:40:13.120 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T13:40:13.121 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T13:40:13.234 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T13:40:13.303 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-10T13:40:13.321 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.218) 0:01:58.638 ******* 2021-03-10T13:40:13.342 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.020) 0:01:58.659 ******* 2021-03-10T13:40:14.107 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba003.front.sepia.ceph.com] 2021-03-10T13:40:14.158 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.816) 0:01:59.475 ******* 2021-03-10T13:40:14.184 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:14.186 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T13:40:14.208 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.050) 0:01:59.526 ******* 2021-03-10T13:40:14.235 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:14.236 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:14.256 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.047) 0:01:59.573 ******* 2021-03-10T13:40:14.266 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T13:40:14.268 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-03-10T13:40:14.297 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T13:40:14.299 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T13:40:14.318 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.062) 0:01:59.635 ******* 2021-03-10T13:40:14.338 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.020) 0:01:59.655 ******* 2021-03-10T13:40:14.365 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:14.367 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T13:40:14.388 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.050) 0:01:59.705 ******* 2021-03-10T13:40:14.415 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:14.416 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:14.437 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.049) 0:01:59.755 ******* 2021-03-10T13:40:14.474 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T13:40:14.476 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T13:40:14.497 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.059) 0:01:59.814 ******* 2021-03-10T13:40:14.781 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T13:40:14.783 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"cache_update_time": 1615383481, "cache_updated": false, "changed": false} 2021-03-10T13:40:14.806 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.308) 0:02:00.123 ******* 2021-03-10T13:40:14.832 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:14.834 INFO:teuthology.task.ansible.out:skipping: [gibba003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:14.861 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.055) 0:02:00.178 ******* 2021-03-10T13:40:14.888 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:14.889 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T13:40:14.911 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.050) 0:02:00.228 ******* 2021-03-10T13:40:14.948 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T13:40:14.950 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"cache_update_time": 1615383486, "cache_updated": false, "changed": false} 2021-03-10T13:40:14.971 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.060) 0:02:00.289 ******* 2021-03-10T13:40:14.998 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:15.000 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:15.026 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.054) 0:02:00.343 ******* 2021-03-10T13:40:15.064 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:40:15.066 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [gibba003.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:15.088 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.061) 0:02:00.405 ******* 2021-03-10T13:40:15.187 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:15.215 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.127) 0:02:00.532 ******* 2021-03-10T13:40:15.253 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:15.352 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:15.378 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.163) 0:02:00.695 ******* 2021-03-10T13:40:15.550 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-10T13:40:15.551 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383615.2657838-5838-1007816072334/source", "state": "file", "uid": 0} 2021-03-10T13:40:15.685 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383615.4268556-5851-2431568984691/source", "state": "file", "uid": 0} 2021-03-10T13:40:15.882 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383615.5675159-5838-81708560849597/source", "state": "file", "uid": 0} 2021-03-10T13:40:15.907 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.528) 0:02:01.224 ******* 2021-03-10T13:40:15.997 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383615.7071614-5851-69652661080267/source", "state": "file", "uid": 0} 2021-03-10T13:40:16.023 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.115) 0:02:01.340 ******* 2021-03-10T13:40:19.063 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T13:40:19.065 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-oimvdf7s\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-oimvdf7s"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-oimvdf7s\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=5f5a94cdeda9b3753c4626cb828dfc7a7e7c95ad6fa4b89ff79c922beedebda7\n Stored in directory: /tmp/pip-ephem-wheel-cache-930y1i_5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=09e6405bca0541ba7a18fefcd4be6560f894530f9e898f20c4b0d6ca323fef20\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T13:40:19.067 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-oimvdf7s", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=5f5a94cdeda9b3753c4626cb828dfc7a7e7c95ad6fa4b89ff79c922beedebda7", " Stored in directory: /tmp/pip-ephem-wheel-cache-930y1i_5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=09e6405bca0541ba7a18fefcd4be6560f894530f9e898f20c4b0d6ca323fef20", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T13:40:19.086 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:19 +0000 (0:00:03.063) 0:02:04.403 ******* 2021-03-10T13:40:19.238 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T13:40:19.239 INFO:teuthology.task.ansible.out:ok: [gibba003.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T13:40:19.262 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:19 +0000 (0:00:00.175) 0:02:04.579 ******* 2021-03-10T13:40:19.526 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T13:40:19.528 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-1_pe02e6\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-1_pe02e6"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-1_pe02e6\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=0ce18222c01eb4f7a623b1275129d04a1855f2340e6b366773741bbee0c78d30\n Stored in directory: /tmp/pip-ephem-wheel-cache-n6qzy6fu/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=09e6405bca0541ba7a18fefcd4be6560f894530f9e898f20c4b0d6ca323fef20\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T13:40:19.529 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-1_pe02e6", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=0ce18222c01eb4f7a623b1275129d04a1855f2340e6b366773741bbee0c78d30", " Stored in directory: /tmp/pip-ephem-wheel-cache-n6qzy6fu/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=09e6405bca0541ba7a18fefcd4be6560f894530f9e898f20c4b0d6ca323fef20", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T13:40:19.551 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:19 +0000 (0:00:00.288) 0:02:04.868 ******* 2021-03-10T13:40:19.567 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T13:40:19.568 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383619.3076453-6168-12896862368733/source", "state": "file", "uid": 0} 2021-03-10T13:40:19.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:19 +0000 (0:00:00.041) 0:02:04.909 ******* 2021-03-10T13:40:19.692 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T13:40:19.693 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T13:40:19.719 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:19 +0000 (0:00:00.126) 0:02:05.036 ******* 2021-03-10T13:40:19.756 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T13:40:19.758 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.018587", "end": "2021-03-10 13:40:19.812338", "rc": 0, "start": "2021-03-10 13:40:19.793751", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:19.781 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:19 +0000 (0:00:00.062) 0:02:05.099 ******* 2021-03-10T13:40:20.026 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T13:40:20.028 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383619.76742-6203-240388934096868/source", "state": "file", "uid": 0} 2021-03-10T13:40:20.051 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:20 +0000 (0:00:00.269) 0:02:05.368 ******* 2021-03-10T13:40:20.223 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T13:40:20.224 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.018823", "end": "2021-03-10 13:40:20.655372", "rc": 0, "start": "2021-03-10 13:40:20.636549", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:20.246 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:20 +0000 (0:00:00.195) 0:02:05.563 ******* 2021-03-10T13:40:23.740 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-10T13:40:23.742 INFO:teuthology.task.ansible.out:changed: [gibba003.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "network-online.target containerd.service firewalld.service basic.target docker.socket sysinit.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T13:40:23.743 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T13:40:23.745 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T13:40:23.746 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:50 UTC", "StateChangeTimestampMonotonic": "36344564", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:40:24.191 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket sysinit.target containerd.service systemd-journald.socket firewalld.service basic.target network-online.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T13:40:24.193 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T13:40:24.194 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T13:40:24.196 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:37:55 UTC", "StateChangeTimestampMonotonic": "36937299", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:40:24.257 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-10T13:40:24.258 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-10T13:40:24.260 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* gibba003.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 gibba043.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 Wednesday 10 March 2021 13:40:24 +0000 (0:00:04.013) 0:02:09.577 ******* =============================================================================== 2021-03-10T13:40:24.260 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 13.01s Create all admin users with sudo access. ------------------------------- 12.82s testnode : Install packages --------------------------------------------- 8.97s testnode : Ensure packages are not present. ----------------------------- 8.87s testnode : Zap all non-root disks --------------------------------------- 7.54s Remove revoked users ---------------------------------------------------- 4.04s container-host : Restart docker service --------------------------------- 4.01s container-host : Install registries-conf-ctl ---------------------------- 3.06s Gathering Facts --------------------------------------------------------- 1.84s testnode : Create logical volume(s) ------------------------------------- 1.70s testnode : Install apt keys --------------------------------------------- 1.65s testnode : Install packages via pip ------------------------------------- 1.62s testnode : Update apt cache. -------------------------------------------- 1.45s common : Update apt cache ----------------------------------------------- 1.38s Gathering Facts --------------------------------------------------------- 0.82s users : Update authorized_keys for each user with literal keys ---------- 0.82s Gathering Facts --------------------------------------------------------- 0.73s testnode : Blow a 2021-03-10T13:40:24.262 INFO:teuthology.task.ansible.out:way lingering OSD data and FSIDs ----------------------- 0.68s testnode : Install python-pip on apt based systems. --------------------- 0.68s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.68s 2021-03-10T13:40:24.560 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba003.front.sepia.ceph.com'), Remote(name='ubuntu@gibba043.front.sepia.ceph.com')] 2021-03-10T13:40:24.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T13:40:24.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:40:24.599 DEBUG:teuthology.orchestra.run.gibba003:> true 2021-03-10T13:40:24.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T13:40:24.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:40:24.709 DEBUG:teuthology.orchestra.run.gibba043:> true 2021-03-10T13:40:24.794 INFO:teuthology.run_tasks:Running task clock... 2021-03-10T13:40:24.818 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-10T13:40:24.818 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T13:40:24.820 DEBUG:teuthology.orchestra.run.gibba003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T13:40:24.840 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T13:40:24.840 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Command line: ntpd -gq 2021-03-10T13:40:24.841 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: proto: precision = 0.032 usec (-25) 2021-03-10T13:40:24.841 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:40:24.842 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:40:24.842 INFO:teuthology.orchestra.run.gibba003.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:40:24.842 INFO:teuthology.orchestra.run.gibba003.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:40:24.844 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T13:40:24.844 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T13:40:24.844 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T13:40:24.844 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listen normally on 3 enp1s0f0 172.21.2.103:123 2021-03-10T13:40:24.845 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listen normally on 4 lo [::1]:123 2021-03-10T13:40:24.845 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8c54%4]:123 2021-03-10T13:40:24.845 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:24 ntpd[8652]: Listening on routing socket on fd #22 for interface updates 2021-03-10T13:40:25.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:25.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:25.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:25.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:25.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:25.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:25.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:25.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:25.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:25.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:25.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:25.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:25 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:27.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:27.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:27.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:27.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:27.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:27.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:27.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:27.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:27.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:27.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:27.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:27.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:27 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:28.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:28 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:28.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:28 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:28.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:28 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:28.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:28 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:28.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:28 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:28.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:28 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:29.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:29.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:29.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:29.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:29.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:29.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:29.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:29.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:29.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:29.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:29.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:29.846 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:29.846 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:29.846 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:29.846 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:29.846 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:29.847 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:29.847 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:29 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:30.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:30 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:30.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:30 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:30.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:30 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:30.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:30 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:30.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:30 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:30.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:30 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:31.842 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:31.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:31.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:31.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:31.843 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:31.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:31.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:31.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:31.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:31.844 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:31.845 INFO:teuthology.orchestra.run.gibba003.stdout:10 Mar 13:40:31 ntpd[8652]: ntpd: time set -0.069186 s 2021-03-10T13:40:31.845 INFO:teuthology.orchestra.run.gibba003.stdout:ntpd: time set -0.069186s 2021-03-10T13:40:31.845 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T13:40:31.846 INFO:teuthology.orchestra.run.gibba003.stderr:10 Mar 13:40:31 ntpd[8652]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T13:40:31.907 INFO:teuthology.orchestra.run.gibba003.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T13:40:31.907 INFO:teuthology.orchestra.run.gibba003.stdout:============================================================================== 2021-03-10T13:40:31.908 INFO:teuthology.orchestra.run.gibba003.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:31.908 INFO:teuthology.orchestra.run.gibba003.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:31.908 INFO:teuthology.orchestra.run.gibba003.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:31.908 INFO:teuthology.orchestra.run.gibba003.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:31.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T13:40:31.910 DEBUG:teuthology.orchestra.run.gibba043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T13:40:31.929 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T13:40:31.930 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Command line: ntpd -gq 2021-03-10T13:40:31.931 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: proto: precision = 0.036 usec (-25) 2021-03-10T13:40:31.931 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:40:31.931 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:40:31.931 INFO:teuthology.orchestra.run.gibba043.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:40:31.932 INFO:teuthology.orchestra.run.gibba043.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:40:31.933 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T13:40:31.933 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T13:40:31.933 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T13:40:31.933 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listen normally on 3 enp1s0f0 172.21.2.143:123 2021-03-10T13:40:31.934 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listen normally on 4 lo [::1]:123 2021-03-10T13:40:31.934 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9238%4]:123 2021-03-10T13:40:31.934 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:32 ntpd[8698]: Listening on routing socket on fd #22 for interface updates 2021-03-10T13:40:32.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:33 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:32.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:33 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:32.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:33 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:32.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:33 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:32.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:33 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:32.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:33 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:33.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:33.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:33.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:33.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:33.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:33.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:33.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:33.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:33.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:33.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:33.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:33.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:34 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:34.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:35 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:34.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:35 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:34.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:35 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:34.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:35 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:34.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:35 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:34.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:35 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:35.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:35.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:35.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:35.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:35.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:35.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:35.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:35.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:35.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:35.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:35.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:35.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:35.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:35.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:35.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:35.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:35.937 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:35.937 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:36 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:36.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:37 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:36.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:37 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:36.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:37 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:36.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:37 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:36.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:37 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:36.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:37 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:37.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:37.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:37.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:37.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:37.933 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:37.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:37.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:37.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:37.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:37.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:37.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:37.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:37.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:37.935 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:37.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:37.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:37.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:37.936 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:38.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:39 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:38.931 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:39 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:38.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:39 ntpd[8698]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:40:38.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:39 ntpd[8698]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:40:38.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:39 ntpd[8698]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:40:38.932 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:39 ntpd[8698]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:40:38.933 INFO:teuthology.orchestra.run.gibba043.stdout:10 Mar 13:40:38 ntpd[8698]: ntpd: time set -0.443829 s 2021-03-10T13:40:38.933 INFO:teuthology.orchestra.run.gibba043.stdout:ntpd: time set -0.443829s 2021-03-10T13:40:38.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T13:40:38.934 INFO:teuthology.orchestra.run.gibba043.stderr:10 Mar 13:40:38 ntpd[8698]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T13:40:39.017 INFO:teuthology.orchestra.run.gibba043.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T13:40:39.017 INFO:teuthology.orchestra.run.gibba043.stdout:============================================================================== 2021-03-10T13:40:39.018 INFO:teuthology.orchestra.run.gibba043.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:39.018 INFO:teuthology.orchestra.run.gibba043.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:39.018 INFO:teuthology.orchestra.run.gibba043.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:39.018 INFO:teuthology.orchestra.run.gibba043.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:40:39.020 INFO:teuthology.run_tasks:Running task cephadm... 2021-03-10T13:40:39.082 INFO:tasks.cephadm:Config: {'allow_ptrace': False, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b26fc080937a021ce826cdc94d1adb52c064381a'} 2021-03-10T13:40:39.082 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2021-03-10T13:40:39.083 INFO:tasks.cephadm:Cluster fsid is 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:40:39.084 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-03-10T13:40:39.084 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.2.103', 'mon.c': '[v2:172.21.2.103:3301,v1:172.21.2.103:6790]', 'mon.b': '172.21.2.143'} 2021-03-10T13:40:39.085 INFO:tasks.cephadm:First mon is mon.a on gibba003 2021-03-10T13:40:39.085 INFO:tasks.cephadm:First mgr is y 2021-03-10T13:40:39.085 INFO:tasks.cephadm:Normalizing hostnames... 2021-03-10T13:40:39.086 DEBUG:teuthology.orchestra.run.gibba003:> sudo hostname $(hostname -s) 2021-03-10T13:40:39.103 DEBUG:teuthology.orchestra.run.gibba043:> sudo hostname $(hostname -s) 2021-03-10T13:40:39.125 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2021-03-10T13:40:39.126 DEBUG:teuthology.orchestra.run.gibba003:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T13:40:39.212 INFO:teuthology.orchestra.run.gibba003.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 13:40 /home/ubuntu/cephtest/cephadm 2021-03-10T13:40:39.212 DEBUG:teuthology.orchestra.run.gibba043:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T13:40:39.410 INFO:teuthology.orchestra.run.gibba043.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 13:40 /home/ubuntu/cephtest/cephadm 2021-03-10T13:40:39.410 DEBUG:teuthology.orchestra.run.gibba003:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T13:40:39.423 DEBUG:teuthology.orchestra.run.gibba043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T13:40:39.445 DEBUG:teuthology.orchestra.run.gibba003:> sudo mkdir -p /etc/ceph 2021-03-10T13:40:39.467 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /etc/ceph 2021-03-10T13:40:39.488 DEBUG:teuthology.orchestra.run.gibba003:> sudo chmod 777 /etc/ceph 2021-03-10T13:40:39.530 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 777 /etc/ceph 2021-03-10T13:40:39.541 INFO:tasks.cephadm:Writing seed config... 2021-03-10T13:40:39.542 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-03-10T13:40:39.543 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-03-10T13:40:39.543 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-03-10T13:40:39.543 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-03-10T13:40:39.544 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-03-10T13:40:39.544 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-03-10T13:40:39.544 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-03-10T13:40:39.545 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-03-10T13:40:39.545 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-03-10T13:40:39.545 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-03-10T13:40:39.546 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-03-10T13:40:39.546 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:40:39.547 DEBUG:teuthology.orchestra.run.gibba003:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-03-10T13:40:39.556 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 33572ad6-81a6-11eb-9080-001a4aab830c mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 1 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-03-10T13:40:39.557 DEBUG:teuthology.orchestra.run.gibba003:mon.a> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a.service 2021-03-10T13:40:39.601 DEBUG:teuthology.orchestra.run.gibba003:mgr.y> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y.service 2021-03-10T13:40:39.604 INFO:tasks.cephadm:Bootstrapping... 2021-03-10T13:40:39.604 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid 33572ad6-81a6-11eb-9080-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.103 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:40:39.640 INFO:journalctl@ceph.mgr.y.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:40:39.665 INFO:journalctl@ceph.mon.a.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:40:39.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Could not locate podman: podman not found 2021-03-10T13:40:39.692 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Verifying podman|docker is present... 2021-03-10T13:40:39.692 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Verifying lvm2 is present... 2021-03-10T13:40:39.692 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Verifying time synchronization is in place... 2021-03-10T13:40:39.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T13:40:39.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T13:40:39.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T13:40:39.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T13:40:39.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T13:40:39.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T13:40:39.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T13:40:39.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T13:40:39.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T13:40:39.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T13:40:39.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T13:40:39.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T13:40:39.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T13:40:39.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T13:40:39.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T13:40:39.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T13:40:39.711 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T13:40:39.711 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Repeating the final host check... 2021-03-10T13:40:39.712 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:podman|docker (/usr/bin/docker) is present 2021-03-10T13:40:39.712 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:systemctl is present 2021-03-10T13:40:39.712 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:lvcreate is present 2021-03-10T13:40:39.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T13:40:39.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T13:40:39.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T13:40:39.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T13:40:39.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T13:40:39.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T13:40:39.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T13:40:39.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T13:40:39.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T13:40:39.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T13:40:39.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T13:40:39.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T13:40:39.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:40:39.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T13:40:39.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T13:40:39.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T13:40:39.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T13:40:39.730 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T13:40:39.731 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Host looks OK 2021-03-10T13:40:39.731 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:root:Cluster fsid: 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:40:39.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Acquiring lock 140421141918048 on /run/cephadm/33572ad6-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:40:39.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Lock 140421141918048 acquired on /run/cephadm/33572ad6-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:40:39.732 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Verifying IP 172.21.2.103 port 3300 ... 2021-03-10T13:40:39.732 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Verifying IP 172.21.2.103 port 6789 ... 2021-03-10T13:40:39.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Base mon IP is 172.21.2.103, final addrv is [v2:172.21.2.103:3300,v1:172.21.2.103:6789] 2021-03-10T13:40:39.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/sbin/ip route ls 2021-03-10T13:40:39.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 2021-03-10T13:40:39.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 proto dhcp src 172.21.2.103 metric 100 2021-03-10T13:40:39.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-03-10T13:40:39.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.0.0/20 dev enp1s0f0 proto kernel scope link src 172.21.2.103 2021-03-10T13:40:39.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.15.254 dev enp1s0f0 proto dhcp scope link src 172.21.2.103 metric 100 2021-03-10T13:40:39.735 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Mon IP 172.21.2.103 is in CIDR network 172.21.0.0/20 2021-03-10T13:40:39.735 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2021-03-10T13:40:39.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.0 2021-03-10T13:40:40.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout v15.2.0: Pulling from ceph/ceph 2021-03-10T13:40:40.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pulling fs layer 2021-03-10T13:40:40.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pulling fs layer 2021-03-10T13:40:41.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Verifying Checksum 2021-03-10T13:40:41.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Download complete 2021-03-10T13:40:41.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Verifying Checksum 2021-03-10T13:40:41.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Download complete 2021-03-10T13:40:42.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pull complete 2021-03-10T13:40:46.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pull complete 2021-03-10T13:40:46.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Digest: sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60 2021-03-10T13:40:46.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Status: Downloaded newer image for ceph/ceph:v15.2.0 2021-03-10T13:40:46.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/docker:stdout docker.io/ceph/ceph:v15.2.0 2021-03-10T13:40:46.658 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2021-03-10T13:40:46.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2021-03-10T13:40:46.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2021-03-10T13:40:55.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:stat:stdout 167 167 2021-03-10T13:40:55.685 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Creating initial keys... 2021-03-10T13:40:55.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:40:55.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:40:56.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBozEhgBryjGxAAulYejLtXtJGwQLPN8dRfrA== 2021-03-10T13:40:56.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:40:56.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:40:57.744 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBpzEhg6SZOLBAA/KhDJ/pSU/qW/ZQlzAjKQg== 2021-03-10T13:40:58.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:40:58.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:40:59.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBrzEhguuNxARAAD//B2TRnic5bRmhNyxceoQ== 2021-03-10T13:40:59.457 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Creating initial monmap... 2021-03-10T13:40:59.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/tmp/ceph-tmpbrm22ole:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', '33572ad6-81a6-11eb-9080-001a4aab830c', '--addv', 'a', '[v2:172.21.2.103:3300,v1:172.21.2.103:6789]', '/tmp/monmap'] 2021-03-10T13:40:59.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /tmp/ceph-tmpbrm22ole:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid 33572ad6-81a6-11eb-9080-001a4aab830c --addv a [v2:172.21.2.103:3300,v1:172.21.2.103:6789] /tmp/monmap 2021-03-10T13:41:00.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2021-03-10T13:41:00.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:00.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-03-10T13:41:00.701 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Creating mon... 2021-03-10T13:41:00.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpqix6dmze:/tmp/keyring:z', '-v', '/tmp/ceph-tmpbrm22ole:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', '33572ad6-81a6-11eb-9080-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2021-03-10T13:41:00.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpqix6dmze:/tmp/keyring:z -v /tmp/ceph-tmpbrm22ole:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-03-10T13:41:01.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:41:01.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 1 imported monmap: 2021-03-10T13:41:01.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2021-03-10T13:41:01.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:01.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2021-03-10T13:41:00.210403+0000 2021-03-10T13:41:01.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2021-03-10T13:41:00.210403+0000 2021-03-10T13:41:01.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2021-03-10T13:41:01.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0] mon.a 2021-03-10T13:41:01.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 /usr/bin/ceph-mon: set fsid to 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:01.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:41:01.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:41:01.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:41:01.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:41:01.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:41:01.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:41:01.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:41:01.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:41:01.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:41:01.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: DB SUMMARY 2021-03-10T13:41:01.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-03-10T13:41:01.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-03-10T13:41:01.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:41:01.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.create_if_missing: 1 2021-03-10T13:41:01.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:41:01.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.env: 0x55e03ba051a0 2021-03-10T13:41:01.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.info_log: 0x55e03e24ba80 2021-03-10T13:41:01.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:41:01.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:41:01.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:41:01.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:41:01.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:41:01.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:41:01.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:41:01.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:41:01.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:41:01.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:41:01.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:41:01.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:41:01.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:41:01.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:41:01.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:41:01.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:41:01.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:41:01.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:41:01.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:41:01.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:41:01.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:41:01.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:41:01.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:41:01.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:41:01.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:41:01.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.write_buffer_manager: 0x55e03edec120 2021-03-10T13:41:01.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:41:01.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:41:01.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:41:01.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:41:01.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:41:01.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:41:01.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:41:01.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:41:01.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:41:01.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:41:01.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:41:01.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:41:01.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:41:01.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:41:01.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:41:01.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:41:01.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:41:01.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:41:01.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:41:01.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:41:01.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:41:01.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:41:01.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:41:01.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:41:01.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:41:01.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:41:01.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:41:01.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:41:01.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:41:01.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:41:01.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:41:01.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:41:01.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:41:01.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:41:01.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:41:01.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:41:01.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:41:01.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:41:01.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:41:01.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:41:01.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:41:01.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:41:01.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:41:01.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:41:01.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:41:01.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:41:01.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.506+0000 7f20a69096c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2021-03-10T13:41:01.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-03-10T13:41:01.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:41:01.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:41:01.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:41:01.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:41:01.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:41:01.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:41:01.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:41:01.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e03e174130) 2021-03-10T13:41:01.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2021-03-10T13:41:01.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:41:01.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:41:01.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2021-03-10T13:41:01.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2021-03-10T13:41:01.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2021-03-10T13:41:01.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:41:01.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2021-03-10T13:41:01.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2021-03-10T13:41:01.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2021-03-10T13:41:01.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55e03e1aa510 2021-03-10T13:41:01.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2021-03-10T13:41:01.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2021-03-10T13:41:01.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2021-03-10T13:41:01.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2021-03-10T13:41:01.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2021-03-10T13:41:01.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2021-03-10T13:41:01.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2021-03-10T13:41:01.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2021-03-10T13:41:01.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2021-03-10T13:41:01.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2021-03-10T13:41:01.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2021-03-10T13:41:01.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2021-03-10T13:41:01.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2021-03-10T13:41:01.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2021-03-10T13:41:01.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2021-03-10T13:41:01.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:41:01.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2021-03-10T13:41:01.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2021-03-10T13:41:01.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2021-03-10T13:41:01.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2021-03-10T13:41:01.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2021-03-10T13:41:01.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2021-03-10T13:41:01.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:41:01.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:41:01.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:41:01.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:41:01.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:41:01.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:41:01.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:41:01.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:41:01.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:41:01.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:41:01.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:41:01.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:41:01.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:41:01.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:41:01.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:41:01.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:41:01.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:41:01.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:41:01.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:41:01.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:41:01.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:41:01.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:41:01.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:41:01.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:41:01.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:41:01.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:41:01.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:41:01.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:41:01.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:41:01.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:41:01.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:41:01.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:41:01.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:41:01.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:41:01.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:41:01.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:41:01.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:41:01.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:41:01.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:41:01.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:41:01.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:41:01.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:41:01.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:41:01.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:41:01.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:41:01.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:41:01.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:41:01.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:41:01.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:41:01.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:41:01.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:41:01.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:41:01.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:41:01.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:41:01.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:41:01.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:41:01.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:41:01.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:41:01.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:41:01.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:41:01.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:41:01.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:41:01.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:41:01.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:41:01.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:41:01.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:41:01.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:41:01.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T13:41:01.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: DB pointer 0x55e03e246400 2021-03-10T13:41:01.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f208faca700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:41:01.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f208faca700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:41:01.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2021-03-10T13:41:01.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:41:01.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:41:01.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:41:01.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:41:01.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:41:01.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:41:01.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:41:01.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:41:01.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:01.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:01.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:41:01.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:41:01.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:41:01.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:01.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:01.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:41:01.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:01.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:01.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:41:01.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:41:01.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:41:01.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:01.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:01.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:41:01.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:41:01.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:41:01.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:01.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:01.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:41:01.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:41:01.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:41:01.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:01.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:01.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:41:01.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:01.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:01.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:41:01.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:41:01.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:41:01.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:01.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:01.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:41:01.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:41:01.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:41:01.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2021-03-10T13:41:01.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2021-03-10T13:41:01.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:41:01.510+0000 7f20a69096c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-03-10T13:41:02.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:02.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2021-03-10T13:41:02.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2021-03-10T13:41:02.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-03-10T13:41:02.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2021-03-10T13:41:02.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target 2021-03-10T13:41:02.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target. 2021-03-10T13:41:02.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target. 2021-03-10T13:41:02.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl start ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target 2021-03-10T13:41:02.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T13:41:02.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:41:02.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:41:02.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a.service: Unit ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a.service not loaded. 2021-03-10T13:41:02.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:41:02.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target.wants/ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-33572ad6-81a6-11eb-9080-001a4aab830c@.service. 2021-03-10T13:41:02.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl start ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:41:02.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T13:41:02.659 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for mon to start... 2021-03-10T13:41:02.659 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for mon... 2021-03-10T13:41:02.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2021-03-10T13:41:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:02 gibba003 docker[9349]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:41:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:02 gibba003 systemd[1]: Started Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:41:03.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2021-03-10T13:41:03.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:03.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2021-03-10T13:41:03.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:03.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2021-03-10T13:41:03.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.111805s) 2021-03-10T13:41:03.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2021-03-10T13:41:03.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2021-03-10T13:41:03.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:03.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2021-03-10T13:41:03.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2021-03-10T13:41:03.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2021-03-10T13:41:03.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2021-03-10T13:41:03.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2021-03-10T13:41:03.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:03.877 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:03 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.716350+0000 mon.a (mon.0) 0 : [INF] mkfs 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:03.878 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:03 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.712717+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:41:04.358 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2021-03-10T13:41:04.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T13:41:04.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z -v /var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-03-10T13:41:05.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:04 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.715558+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:41:05.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:04 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.715879+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0]} 2021-03-10T13:41:05.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:04 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.717531+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:41:05.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:04 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.719487+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T13:41:05.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:04 gibba003 bash[9365]: cluster 2021-03-10T13:41:03.719924+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T13:41:05.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:04 gibba003 bash[9365]: audit 2021-03-10T13:41:03.827344+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.103:0/2684457625' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-03-10T13:41:05.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:05.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2021-03-10T13:41:05.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:05.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 3 2021-03-10T13:41:05.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.2.103:3300,v1:172.21.2.103:6789] 2021-03-10T13:41:05.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2021-03-10T13:41:05.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2021-03-10T13:41:05.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2021-03-10T13:41:05.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2021-03-10T13:41:05.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:05.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2021-03-10T13:41:05.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2021-03-10T13:41:05.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:05.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2021-03-10T13:41:05.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2021-03-10T13:41:05.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2021-03-10T13:41:05.814 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2021-03-10T13:41:05.814 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T13:41:05.815 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z -v /var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-03-10T13:41:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:05 gibba003 bash[9365]: audit 2021-03-10T13:41:05.249275+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.2.103:0/2718722821' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-03-10T13:41:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:05 gibba003 bash[9365]: audit 2021-03-10T13:41:05.251588+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.2.103:0/2718722821' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-03-10T13:41:06.759 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:06 gibba003 bash[9365]: audit 2021-03-10T13:41:06.710957+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.103:0/3574855779' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:07.205 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Restarting the monitor... 2021-03-10T13:41:07.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:41:07.511 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 systemd[1]: Stopping Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:41:07.511 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 bash[9365]: debug 2021-03-10T13:41:07.286+0000 7fc01ea5b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:41:07.511 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 bash[9365]: debug 2021-03-10T13:41:07.286+0000 7fc01ea5b700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-03-10T13:41:07.838 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Setting mon public_network... 2021-03-10T13:41:07.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2021-03-10T13:41:07.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2021-03-10T13:41:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 docker[9718]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:41:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T13:41:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 systemd[1]: Stopped Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:41:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 systemd[1]: Starting Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:41:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 docker[9751]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:41:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:07 gibba003 systemd[1]: Started Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:41:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.786+0000 7fdad0a236c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:41:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.786+0000 7fdad0a236c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T13:41:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.786+0000 7fdad0a236c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:41:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 load: jerasure load: lrc load: isa 2021-03-10T13:41:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:41:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:41:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:41:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:41:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:41:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:41:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 1 rocksdb: do_open column families: [default] 2021-03-10T13:41:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:41:08.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:41:08.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:41:08.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: DB SUMMARY 2021-03-10T13:41:08.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:41:08.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:41:08.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2021-03-10T13:41:08.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-03-10T13:41:08.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69025 ; 2021-03-10T13:41:08.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:41:08.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:41:08.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:41:08.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.env: 0x55884cd521a0 2021-03-10T13:41:08.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.info_log: 0x55884dc129a0 2021-03-10T13:41:08.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:41:08.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:41:08.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:41:08.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:41:08.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:41:08.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:41:08.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:41:08.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:41:08.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:41:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:41:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:41:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:41:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:41:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:41:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:41:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:41:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:41:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:41:08.955 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:41:08.955 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:41:08.955 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:41:08.955 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:41:08.955 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:41:08.956 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:41:08.956 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:41:08.956 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.write_buffer_manager: 0x55884e7acae0 2021-03-10T13:41:08.956 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:41:08.957 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:41:08.957 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:41:08.957 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:41:08.957 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:41:08.958 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:41:08.958 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:41:08.958 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:41:08.958 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:41:08.958 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:41:08.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:41:08.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:41:08.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:41:08.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:41:08.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:41:08.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:41:08.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:41:08.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:41:08.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:41:08.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:41:08.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:41:08.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:41:08.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:41:08.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:41:08.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:41:08.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:41:08.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:41:08.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:41:08.963 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:41:08.963 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:41:08.963 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:41:08.963 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:41:08.964 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:41:08.964 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:41:08.964 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:41:08.964 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:41:08.964 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:41:08.965 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:41:08.965 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:41:08.965 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:41:08.965 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:41:08.966 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:41:08.966 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:41:08.966 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:41:08.966 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:41:08.966 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:41:08.967 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-03-10T13:41:08.967 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:41:08.967 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:41:08.967 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:41:08.967 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:41:08.968 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:41:08.968 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:41:08.968 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:41:08.968 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55884db32138) 2021-03-10T13:41:08.969 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cache_index_and_filter_blocks: 1 2021-03-10T13:41:08.969 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:41:08.969 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:41:08.969 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: pin_top_level_index_and_filter: 1 2021-03-10T13:41:08.969 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: index_type: 0 2021-03-10T13:41:08.970 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: data_block_index_type: 0 2021-03-10T13:41:08.970 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:41:08.970 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: hash_index_allow_collision: 1 2021-03-10T13:41:08.970 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: checksum: 1 2021-03-10T13:41:08.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: no_block_cache: 0 2021-03-10T13:41:08.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_cache: 0x55884db68610 2021-03-10T13:41:08.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_cache_name: BinnedLRUCache 2021-03-10T13:41:08.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_cache_options: 2021-03-10T13:41:08.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: capacity : 536870912 2021-03-10T13:41:08.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: num_shard_bits : 4 2021-03-10T13:41:08.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: strict_capacity_limit : 0 2021-03-10T13:41:08.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: high_pri_pool_ratio: 0.000 2021-03-10T13:41:08.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_cache_compressed: (nil) 2021-03-10T13:41:08.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: persistent_cache: (nil) 2021-03-10T13:41:08.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_size: 4096 2021-03-10T13:41:08.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_size_deviation: 10 2021-03-10T13:41:08.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_restart_interval: 16 2021-03-10T13:41:08.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: index_block_restart_interval: 1 2021-03-10T13:41:08.974 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: metadata_block_size: 4096 2021-03-10T13:41:08.974 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: partition_filters: 0 2021-03-10T13:41:08.974 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: use_delta_encoding: 1 2021-03-10T13:41:08.974 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:41:08.975 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: whole_key_filtering: 1 2021-03-10T13:41:08.975 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: verify_compression: 0 2021-03-10T13:41:08.975 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: read_amp_bytes_per_bit: 0 2021-03-10T13:41:08.975 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: format_version: 2 2021-03-10T13:41:08.975 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: enable_index_compression: 1 2021-03-10T13:41:08.976 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: block_align: 0 2021-03-10T13:41:08.976 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:41:08.976 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:41:08.976 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:41:08.977 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:41:08.977 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:41:08.977 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:41:08.977 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:41:08.977 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:41:08.978 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:41:08.978 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:41:08.978 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:41:08.978 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:41:08.979 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:41:08.979 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:41:08.979 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:41:08.979 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:41:08.980 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:41:08.980 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:41:08.980 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:41:08.980 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:41:08.980 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:41:08.981 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:41:08.981 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:41:08.981 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:41:08.981 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:41:08.981 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:41:08.982 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:41:08.982 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:41:08.982 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:41:08.982 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:41:08.983 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:41:08.983 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:41:08.983 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:41:08.983 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:41:08.983 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:41:08.984 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:41:08.984 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:41:08.984 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:41:08.984 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:41:08.985 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:41:08.985 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:41:08.985 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:41:08.985 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:41:08.985 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:41:08.986 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:41:08.986 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:41:08.986 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:41:08.986 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:41:08.987 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:41:08.987 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:41:08.987 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:41:08.987 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:41:08.987 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:41:08.988 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:41:08.988 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:41:08.988 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:41:08.988 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:41:08.989 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:41:08.989 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:41:08.989 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:41:08.989 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:41:08.989 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:41:08.990 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:41:08.990 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:41:08.990 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:41:08.990 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.790+0000 7fdad0a236c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:41:08.991 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:41:08.991 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2021-03-10T13:41:08.991 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383668795172, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-03-10T13:41:08.991 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2021-03-10T13:41:08.991 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383668795847, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66120, "table_properties": {"data_size": 64415, "index_size": 310, "filter_size": 581, "raw_key_size": 8602, "raw_average_key_size": 46, "raw_value_size": 59469, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T13:41:08.992 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2021-03-10T13:41:08.992 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383668796359, "job": 1, "event": "recovery_finished"} 2021-03-10T13:41:08.992 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 4 rocksdb: DB pointer 0x55884dc04400 2021-03-10T13:41:08.992 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdab7b70700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:41:08.993 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdab7b70700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:41:08.993 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** DB Stats ** 2021-03-10T13:41:08.993 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:41:08.993 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:41:08.993 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:41:08.994 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:41:08.994 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:41:08.994 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:41:08.994 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:41:08.995 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** Compaction Stats [default] ** 2021-03-10T13:41:08.995 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:08.995 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:08.995 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:08.995 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:08.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:08.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** Compaction Stats [default] ** 2021-03-10T13:41:08.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:08.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:08.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:08.997 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:41:08.997 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:08.997 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:08.997 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:41:08.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:41:08.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:41:08.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Cumulative compaction: 0.00 GB write, 22.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:08.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Interval compaction: 0.00 GB write, 22.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:08.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:41:08.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:41:08.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** Compaction Stats [default] ** 2021-03-10T13:41:08.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:08.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:09.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:09.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:09.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:41:09.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** Compaction Stats [default] ** 2021-03-10T13:41:09.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:41:09.001 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:41:09.001 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 119.9 0.00 0.00 1 0.001 0 0 2021-03-10T13:41:09.001 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:41:09.001 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:09.002 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:41:09.002 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:41:09.002 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:41:09.002 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:41:09.002 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Cumulative compaction: 0.00 GB write, 21.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:09.003 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:41:09.003 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:41:09.003 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:41:09.003 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 starting mon.a rank 0 at public addrs [v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0] at bind addrs [v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:09.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 1 mon.a@-1(???) e1 preinit fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:09.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 mon.a@-1(???).mds e1 new map 2021-03-10T13:41:09.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 mon.a@-1(???).mds e1 print_map 2021-03-10T13:41:09.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: e1 2021-03-10T13:41:09.004 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:41:09.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:41:09.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: legacy client fscid: -1 2021-03-10T13:41:09.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: 2021-03-10T13:41:09.005 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: No filesystems configured 2021-03-10T13:41:09.006 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:41:09.006 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:41:09.006 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-03-10T13:41:09.006 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:41:09.007 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: audit 2021-03-10T13:41:06.710957+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.103:0/3574855779' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:09.007 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.794+0000 7fdad0a236c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-03-10T13:41:09.007 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:41:09.007 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:41:09.007 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:41:09.008 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:41:09.008 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:41:09.008 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:41:09.008 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:41:09.008 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:41:09.009 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:41:09.009 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:41:09.009 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:41:09.009 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: debug 2021-03-10T13:41:08.798+0000 7fdad0a236c0 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:41:09.010 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cluster 2021-03-10T13:41:08.801039+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:41:09.010 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cluster 2021-03-10T13:41:08.801079+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0]} 2021-03-10T13:41:09.010 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cluster 2021-03-10T13:41:08.801112+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-03-10T13:41:09.010 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cluster 2021-03-10T13:41:08.801129+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T13:41:09.011 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:08 gibba003 bash[9769]: cluster 2021-03-10T13:41:08.801424+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T13:41:09.578 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Creating mgr... 2021-03-10T13:41:09.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T13:41:09.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:41:09.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:41:09.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y.service: Unit ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y.service not loaded. 2021-03-10T13:41:09.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:41:09.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-33572ad6-81a6-11eb-9080-001a4aab830c.target.wants/ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-33572ad6-81a6-11eb-9080-001a4aab830c@.service. 2021-03-10T13:41:09.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: systemctl start ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:41:09.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T13:41:09.857 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:41:09.857 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2021-03-10T13:41:09.857 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for mgr to start... 2021-03-10T13:41:09.858 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for mgr... 2021-03-10T13:41:09.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:41:09.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:41:10.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:09 gibba003 bash[9769]: audit 2021-03-10T13:41:08.938646+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.2.103:0/2065638636' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2021-03-10T13:41:10.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:09 gibba003 bash[9769]: audit 2021-03-10T13:41:08.940537+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.2.103:0/2065638636' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2021-03-10T13:41:10.193 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:09 gibba003 docker[9983]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mgr.y 2021-03-10T13:41:10.193 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:09 gibba003 systemd[1]: Started Ceph mgr.y for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:41:11.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:11.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:11.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "33572ad6-81a6-11eb-9080-001a4aab830c", 2021-03-10T13:41:11.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:41:11.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:41:11.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:41:11.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:41:11.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:41:11.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:41:11.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:41:11.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:11.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:41:11.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:41:11.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:11.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2021-03-10T13:41:11.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:41:11.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:11.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:41:11.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:41:11.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:41:11.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:11.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:41:11.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:41:11.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:41:11.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:41:11.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:41:11.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:41:11.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:41:11.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:41:11.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:41:11.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:41:11.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:41:11.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:41:11.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:41:11.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:41:11.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:41:11.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:41:11.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:11.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:41:11.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:41:11.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:41:11.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T13:41:11.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:41:11.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:41:11.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:41:11.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:41:11.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:11.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:41:11.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:41:11.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:11.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:41:03.716587+0000", 2021-03-10T13:41:11.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:41:11.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:11.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:41:11.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:11.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:11 gibba003 bash[9769]: audit 2021-03-10T13:41:11.181469+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.2.103:0/571226372' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:41:11.725 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2021-03-10T13:41:12.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:41:12.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:41:13.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:13.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:13.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "33572ad6-81a6-11eb-9080-001a4aab830c", 2021-03-10T13:41:13.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:41:13.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:41:13.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:41:13.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:41:13.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:41:13.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:41:13.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:41:13.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:13.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:41:13.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:41:13.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:13.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2021-03-10T13:41:13.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:41:13.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:13.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:41:13.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:41:13.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:41:13.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:13.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:41:13.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:41:13.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:41:13.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:41:13.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:41:13.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:41:13.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:41:13.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:41:13.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:41:13.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:41:13.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:41:13.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:41:13.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:41:13.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:41:13.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:41:13.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:41:13.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:13.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:41:13.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:41:13.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:41:13.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T13:41:13.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:41:13.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:41:13.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:41:13.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:41:13.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:13.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:41:13.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:41:13.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:13.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:41:03.716587+0000", 2021-03-10T13:41:13.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:41:13.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:13.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:41:13.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:13 gibba003 bash[9769]: audit 2021-03-10T13:41:13.620552+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.2.103:0/3171584328' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:41:14.123 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2021-03-10T13:41:15.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:41:15.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:41:15.158 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: cluster 2021-03-10T13:41:13.809804+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2021-03-10T13:41:15.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: cluster 2021-03-10T13:41:13.811693+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00195108s) 2021-03-10T13:41:15.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.812381+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:41:15.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.812451+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:41:15.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.812561+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:41:15.160 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.812601+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:41:15.160 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.812678+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:41:15.160 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.812939+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:41:15.160 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.813159+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:41:15.161 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: cluster 2021-03-10T13:41:13.814478+0000 mon.a (mon.0) 19 : cluster [INF] Manager daemon y is now available 2021-03-10T13:41:15.161 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.822562+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:41:15.161 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.893662+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-03-10T13:41:15.161 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: cluster 2021-03-10T13:41:13.893680+0000 mon.a (mon.0) 22 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-03-10T13:41:15.161 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.894335+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:41:15.162 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.897661+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"647de80f-a89f-41dd-9bf9-4fc1795f6433"}]: dispatch 2021-03-10T13:41:15.162 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.898979+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"647de80f-a89f-41dd-9bf9-4fc1795f6433"}]': finished 2021-03-10T13:41:15.162 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.899367+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"152f2fbb-df20-4c44-8c16-02ad8545b3f2"}]: dispatch 2021-03-10T13:41:15.162 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:14 gibba003 bash[9769]: audit 2021-03-10T13:41:13.900817+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"152f2fbb-df20-4c44-8c16-02ad8545b3f2"}]': finished 2021-03-10T13:41:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:15 gibba003 bash[9769]: cluster 2021-03-10T13:41:14.813476+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: y(active, since 1.00373s) 2021-03-10T13:41:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:15 gibba003 bash[9769]: audit 2021-03-10T13:41:14.899041+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.14100 172.21.2.103:0/2880840755' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:41:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:15 gibba003 bash[9769]: cluster 2021-03-10T13:41:14.899171+0000 mon.a (mon.0) 30 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-03-10T13:41:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:15 gibba003 bash[9769]: audit 2021-03-10T13:41:14.906517+0000 mon.a (mon.0) 31 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:41:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:15 gibba003 bash[9769]: audit 2021-03-10T13:41:15.061324+0000 mon.a (mon.0) 32 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:41:16.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:41:16.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:16.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "33572ad6-81a6-11eb-9080-001a4aab830c", 2021-03-10T13:41:16.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:41:16.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:41:16.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:41:16.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:41:16.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:41:16.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:41:16.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:41:16.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:16.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:41:16.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:41:16.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:16.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2021-03-10T13:41:16.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:41:16.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:16.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:41:16.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:41:16.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:41:16.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2021-03-10T13:41:16.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:41:16.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:41:16.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:41:16.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:41:16.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:41:16.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:41:16.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:41:16.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:41:16.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:41:16.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:41:16.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:41:16.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:41:16.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:41:16.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:41:16.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:41:16.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:41:16.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:16.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:41:16.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:41:16.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:41:16.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:41:16.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:41:16.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:41:16.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:41:16.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:41:16.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:16.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:41:16.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:41:16.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:41:16.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:41:03.716587+0000", 2021-03-10T13:41:16.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:41:16.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:16.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:41:16.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:16.725 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Enabling cephadm module... 2021-03-10T13:41:16.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2021-03-10T13:41:16.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2021-03-10T13:41:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:16 gibba003 bash[9769]: audit 2021-03-10T13:41:16.211730+0000 mon.a (mon.0) 33 : audit [DBG] from='client.? 172.21.2.103:0/3190114066' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:41:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:17 gibba003 bash[9769]: cluster 2021-03-10T13:41:16.819798+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e4: y(active, since 3s) 2021-03-10T13:41:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:17 gibba003 bash[9769]: audit 2021-03-10T13:41:17.731110+0000 mon.a (mon.0) 35 : audit [INF] from='client.? 172.21.2.103:0/2620446835' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-03-10T13:41:18.192 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:17 gibba003 bash[10000]: ignoring --setuser ceph since I am not root 2021-03-10T13:41:18.193 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:17 gibba003 bash[10000]: ignoring --setgroup ceph since I am not root 2021-03-10T13:41:18.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T13:41:18.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T13:41:19.080 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:18 gibba003 bash[9769]: audit 2021-03-10T13:41:17.823960+0000 mon.a (mon.0) 36 : audit [INF] from='client.? 172.21.2.103:0/2620446835' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-03-10T13:41:19.081 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:18 gibba003 bash[9769]: cluster 2021-03-10T13:41:17.823989+0000 mon.a (mon.0) 37 : cluster [DBG] mgrmap e5: y(active, since 4s) 2021-03-10T13:41:19.821 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2021-03-10T13:41:19.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2021-03-10T13:41:19.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T13:41:19.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T13:41:19.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:19.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:19.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:6800", 2021-03-10T13:41:19.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3738610366 2021-03-10T13:41:19.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T13:41:19.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:6801", 2021-03-10T13:41:19.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3738610366 2021-03-10T13:41:19.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:19.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.103:6801/3738610366", 2021-03-10T13:41:19.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T13:41:13.809735+0000", 2021-03-10T13:41:19.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T13:41:19.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:41:19.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T13:41:19.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:41:19.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:41:19.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:41:19.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:41:19.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T13:41:19.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T13:41:19.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:19.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:19.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:19.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:19.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:19.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:19.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T13:41:19.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:19.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:19.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:19.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:19.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:19.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:19.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:19.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:19.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:19.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T13:41:19.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T13:41:19.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T13:41:19.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T13:41:19.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T13:41:19.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T13:41:19.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T13:41:19.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T13:41:19.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T13:41:19.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T13:41:19.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T13:41:19.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T13:41:19.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T13:41:19.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T13:41:19.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T13:41:19.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:19.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T13:41:19.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T13:41:19.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T13:41:19.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T13:41:19.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T13:41:19.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T13:41:19.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T13:41:19.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:19.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T13:41:19.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T13:41:19.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T13:41:19.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T13:41:19.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T13:41:19.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:19.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:19.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:19.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T13:41:19.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T13:41:19.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T13:41:19.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T13:41:19.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T13:41:19.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T13:41:19.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T13:41:19.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:41:19.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T13:41:19.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T13:41:19.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:19.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:41:19.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:41:19.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:41:19.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T13:41:19.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:41:19.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T13:41:19.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T13:41:19.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:19.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T13:41:19.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:41:19.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T13:41:19.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T13:41:19.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T13:41:19.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T13:41:19.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T13:41:19.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T13:41:19.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T13:41:19.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T13:41:19.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T13:41:19.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:41:19.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T13:41:19.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T13:41:19.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T13:41:19.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T13:41:19.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T13:41:19.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T13:41:19.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T13:41:19.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T13:41:19.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T13:41:19.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:41:19.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T13:41:19.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T13:41:19.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:19.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:41:19.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:41:19.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:41:19.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T13:41:19.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:41:19.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:19.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:19.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:19.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:19.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:19.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:19.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:19.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:19.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:19.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T13:41:19.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T13:41:19.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:41:19.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:41:19.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T13:41:19.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:41:19.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:41:19.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T13:41:19.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T13:41:19.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T13:41:19.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T13:41:19.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T13:41:19.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T13:41:19.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T13:41:19.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T13:41:19.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:19.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:19.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:19.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T13:41:19.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T13:41:19.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T13:41:19.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:19.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:19.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:41:19.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T13:41:19.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T13:41:19.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T13:41:19.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T13:41:19.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:19.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:19.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T13:41:19.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T13:41:19.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:19.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:19.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:19.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T13:41:19.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T13:41:19.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T13:41:19.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T13:41:19.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T13:41:19.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T13:41:19.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T13:41:19.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T13:41:19.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T13:41:19.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T13:41:19.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:19.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T13:41:19.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T13:41:19.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T13:41:19.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T13:41:19.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T13:41:19.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T13:41:19.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T13:41:19.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:19.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T13:41:19.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:19.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:19.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:19.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:19.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:19.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T13:41:19.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:19.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:19.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:19.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:19.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:19.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:41:19.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:41:19.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T13:41:19.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T13:41:19.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T13:41:19.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T13:41:19.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T13:41:19.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T13:41:19.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:19.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T13:41:19.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T13:41:19.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T13:41:19.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:19.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T13:41:19.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T13:41:19.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T13:41:19.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:19.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T13:41:19.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T13:41:19.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T13:41:19.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:19.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T13:41:19.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T13:41:19.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:19.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:19.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:19.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:19.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:19.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:19.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:19.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:19.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:19.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:19.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:19.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:19.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:19.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:19.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:19.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:19.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:19.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:19.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:19.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:19.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T13:41:19.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T13:41:19.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T13:41:19.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T13:41:19.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T13:41:19.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T13:41:19.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:19.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:19.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T13:41:19.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T13:41:19.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:19.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:19.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T13:41:19.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:19.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:19.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:19.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T13:41:19.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T13:41:19.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:19.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:19.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T13:41:19.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T13:41:19.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:19.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:19.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:19.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T13:41:19.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T13:41:19.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:19.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:19.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:19.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:19.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:19.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:19.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:19.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:19.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:19.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:19.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T13:41:20.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T13:41:20.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T13:41:20.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T13:41:20.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T13:41:20.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T13:41:20.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T13:41:20.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T13:41:20.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T13:41:20.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T13:41:20.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T13:41:20.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T13:41:20.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T13:41:20.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T13:41:20.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T13:41:20.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T13:41:20.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T13:41:20.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T13:41:20.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:41:20.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T13:41:20.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T13:41:20.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T13:41:20.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T13:41:20.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T13:41:20.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T13:41:20.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:41:20.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T13:41:20.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T13:41:20.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T13:41:20.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T13:41:20.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T13:41:20.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T13:41:20.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T13:41:20.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T13:41:20.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T13:41:20.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T13:41:20.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T13:41:20.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T13:41:20.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T13:41:20.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T13:41:20.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T13:41:20.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T13:41:20.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T13:41:20.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T13:41:20.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T13:41:20.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T13:41:20.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T13:41:20.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T13:41:20.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T13:41:20.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T13:41:20.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T13:41:20.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T13:41:20.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T13:41:20.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:20.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T13:41:20.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T13:41:20.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T13:41:20.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T13:41:20.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T13:41:20.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T13:41:20.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T13:41:20.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T13:41:20.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T13:41:20.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T13:41:20.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:41:20.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T13:41:20.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T13:41:20.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T13:41:20.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T13:41:20.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T13:41:20.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T13:41:20.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T13:41:20.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T13:41:20.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T13:41:20.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T13:41:20.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T13:41:20.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T13:41:20.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T13:41:20.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T13:41:20.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T13:41:20.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T13:41:20.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:41:20.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T13:41:20.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T13:41:20.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:20.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T13:41:20.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T13:41:20.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:20.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T13:41:20.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T13:41:20.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T13:41:20.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T13:41:20.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T13:41:20.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T13:41:20.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T13:41:20.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T13:41:20.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:41:20.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:41:20.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:41:20.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:41:20.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:41:20.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:41:20.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T13:41:20.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:41:20.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:41:20.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T13:41:20.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:41:20.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:41:20.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T13:41:20.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T13:41:20.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T13:41:20.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T13:41:20.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T13:41:20.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T13:41:20.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T13:41:20.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T13:41:20.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T13:41:20.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T13:41:20.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T13:41:20.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T13:41:20.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T13:41:20.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T13:41:20.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:41:20.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:41:20.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T13:41:20.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T13:41:20.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T13:41:20.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T13:41:20.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T13:41:20.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T13:41:20.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T13:41:20.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T13:41:20.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T13:41:20.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T13:41:20.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T13:41:20.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T13:41:20.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T13:41:20.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T13:41:20.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T13:41:20.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T13:41:20.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T13:41:20.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T13:41:20.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:41:20.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T13:41:20.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T13:41:20.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T13:41:20.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T13:41:20.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:20.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:20.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:20.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T13:41:20.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T13:41:20.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T13:41:20.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T13:41:20.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T13:41:20.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T13:41:20.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T13:41:20.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T13:41:20.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:41:20.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T13:41:20.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T13:41:20.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T13:41:20.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:20.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:20.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:20.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T13:41:20.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T13:41:20.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T13:41:20.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T13:41:20.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T13:41:20.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T13:41:20.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T13:41:20.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T13:41:20.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T13:41:20.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T13:41:20.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T13:41:20.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:20.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:20.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T13:41:20.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:41:20.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:41:20.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T13:41:20.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T13:41:20.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T13:41:20.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:41:20.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:41:20.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T13:41:20.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T13:41:20.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T13:41:20.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:20.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:41:20.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:41:20.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T13:41:20.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T13:41:20.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T13:41:20.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T13:41:20.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T13:41:20.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T13:41:20.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T13:41:20.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T13:41:20.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:41:20.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T13:41:20.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T13:41:20.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T13:41:20.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:20.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T13:41:20.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T13:41:20.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T13:41:20.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T13:41:20.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T13:41:20.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T13:41:20.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T13:41:20.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T13:41:20.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T13:41:20.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T13:41:20.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T13:41:20.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T13:41:20.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T13:41:20.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T13:41:20.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T13:41:20.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T13:41:20.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T13:41:20.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T13:41:20.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T13:41:20.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T13:41:20.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T13:41:20.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T13:41:20.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T13:41:20.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T13:41:20.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T13:41:20.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:41:20.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T13:41:20.361 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:41:20.361 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.361 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.361 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.361 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.362 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.362 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.362 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.362 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:41:20.362 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T13:41:20.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T13:41:20.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T13:41:20.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T13:41:20.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T13:41:20.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.382 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.382 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.382 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.382 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.382 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.384 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.384 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.384 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.384 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.384 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.385 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.385 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.385 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.385 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.385 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.386 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.386 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.386 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.386 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.386 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.387 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.387 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.387 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.387 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.387 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.388 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.388 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.388 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.388 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.388 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.389 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.389 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.389 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.389 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.389 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.390 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.390 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.390 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.390 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.390 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.391 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.391 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.391 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.391 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.391 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.392 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.392 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.392 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.392 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.392 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.392 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.393 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.393 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.393 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.393 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.393 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.394 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.394 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.394 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.394 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.394 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:20.395 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:20.395 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.395 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.395 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.396 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:20.396 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.396 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.396 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.396 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.396 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.397 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.397 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.397 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.397 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.397 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.398 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.398 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T13:41:20.398 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.398 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.398 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.399 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.399 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.399 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.399 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.399 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.400 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.400 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.400 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.400 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.400 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.401 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.401 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.401 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.401 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.401 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.402 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.402 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.402 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.402 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.402 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.403 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.403 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.403 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.403 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.403 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.404 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.404 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.404 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.404 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.404 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.404 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.405 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.405 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.405 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.405 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.405 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.406 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.406 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.406 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.406 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.406 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.407 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.407 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.407 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.407 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.407 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.408 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.408 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.408 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.408 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.408 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.409 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.409 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.409 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.409 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.409 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.410 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.410 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.410 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.410 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.410 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.410 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.411 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.411 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.411 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.411 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.412 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.412 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.412 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.412 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.412 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T13:41:20.412 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T13:41:20.413 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.413 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.413 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.413 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T13:41:20.413 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.414 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.414 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.414 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T13:41:20.414 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.414 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.415 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.415 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.415 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T13:41:20.415 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T13:41:20.415 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.416 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.416 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.416 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:20.416 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.416 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.417 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.417 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T13:41:20.417 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.417 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.417 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.418 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.418 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.418 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.418 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.418 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T13:41:20.419 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.419 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.419 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.419 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.419 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.419 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.420 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.420 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.420 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.420 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.420 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.421 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.421 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.421 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.421 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.421 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.422 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.422 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.422 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.422 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.422 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.423 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.423 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.423 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.423 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.423 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.424 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.424 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.424 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.424 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.424 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.425 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.425 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.425 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.425 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.425 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.426 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.426 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.426 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.426 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.426 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.427 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.427 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.427 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.427 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.427 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.428 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.428 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.428 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.428 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.428 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.429 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.429 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.429 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.429 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.429 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.430 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.430 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.430 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.430 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.430 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.431 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.431 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.431 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.431 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.431 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.432 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.432 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.432 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.432 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.432 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.432 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.433 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.433 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T13:41:20.433 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T13:41:20.433 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.433 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.434 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.434 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.434 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.434 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.435 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.435 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.435 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.436 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.436 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.436 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.436 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T13:41:20.437 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T13:41:20.437 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.437 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.437 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.438 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.438 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.438 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.438 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.438 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.439 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.439 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.439 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.439 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.440 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T13:41:20.440 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T13:41:20.440 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.440 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.441 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.441 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.441 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.441 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.441 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.442 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.442 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.442 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.442 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.442 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.443 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:41:20.443 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:41:20.443 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.443 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.444 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.444 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.444 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.444 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.444 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.445 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.445 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.445 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.445 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.445 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.446 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:41:20.446 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:41:20.446 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.446 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.447 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.447 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.447 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.447 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.447 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.448 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.448 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.448 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.448 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.448 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.449 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.449 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.449 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.449 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T13:41:20.449 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.450 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.450 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.450 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.450 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.451 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.451 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.451 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.451 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.451 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.452 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.452 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.452 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.452 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.452 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.453 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.453 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.453 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.453 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.453 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.454 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.454 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.454 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.454 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.455 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.455 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.455 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.455 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.455 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.456 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.456 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.456 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.456 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.456 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.457 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.457 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.457 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.457 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T13:41:20.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T13:41:20.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T13:41:20.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T13:41:20.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T13:41:20.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:41:20.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:41:20.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:41:20.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:41:20.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:41:20.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:41:20.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T13:41:20.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T13:41:20.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T13:41:20.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T13:41:20.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T13:41:20.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T13:41:20.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T13:41:20.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T13:41:20.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T13:41:20.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T13:41:20.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T13:41:20.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T13:41:20.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T13:41:20.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:41:20.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T13:41:20.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T13:41:20.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T13:41:20.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T13:41:20.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T13:41:20.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T13:41:20.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T13:41:20.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T13:41:20.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T13:41:20.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T13:41:20.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T13:41:20.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T13:41:20.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T13:41:20.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T13:41:20.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T13:41:20.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T13:41:20.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T13:41:20.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:20.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:20.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T13:41:20.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T13:41:20.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T13:41:20.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T13:41:20.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T13:41:20.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T13:41:20.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T13:41:20.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T13:41:20.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T13:41:20.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:20.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T13:41:20.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T13:41:20.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T13:41:20.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T13:41:20.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T13:41:20.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T13:41:20.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T13:41:20.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T13:41:20.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T13:41:20.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T13:41:20.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T13:41:20.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:20.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:20.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T13:41:20.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T13:41:20.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T13:41:20.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T13:41:20.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T13:41:20.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T13:41:20.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T13:41:20.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T13:41:20.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T13:41:20.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T13:41:20.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T13:41:20.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T13:41:20.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T13:41:20.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T13:41:20.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T13:41:20.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T13:41:20.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T13:41:20.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:20.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:20.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:20.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T13:41:20.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T13:41:20.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T13:41:20.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T13:41:20.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T13:41:20.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:20.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:20.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:20.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:20.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:20.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:20.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:20.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:20.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:20.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:20.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:20.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:20.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:20.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:20.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:20.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:20.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:20.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:20.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:20.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:20.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:20.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:20.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:20.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:20.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T13:41:20.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T13:41:20.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:20.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T13:41:20.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T13:41:20.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:20.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T13:41:20.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T13:41:20.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T13:41:20.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:20.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:20.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:20.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T13:41:20.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:20.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:20.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:20.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:20.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:20.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:20.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:20.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T13:41:20.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T13:41:20.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T13:41:20.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:41:20.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:41:20.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:41:20.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T13:41:20.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:41:20.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:41:20.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:41:20.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:41:20.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T13:41:20.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:41:20.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:41:20.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:41:20.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T13:41:20.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T13:41:20.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T13:41:20.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:41:20.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:41:20.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:41:20.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T13:41:20.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:41:20.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:20.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2021-03-10T13:41:20.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T13:41:20.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:20.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:20.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:0", 2021-03-10T13:41:20.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3079389261 2021-03-10T13:41:20.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:20.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:20.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:20.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:0", 2021-03-10T13:41:20.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2319811689 2021-03-10T13:41:20.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:20.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:20.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:20.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:20.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:20.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:0", 2021-03-10T13:41:20.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 184559695 2021-03-10T13:41:20.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:20.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:20.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.742 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:20.743 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T13:41:20.743 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2021-03-10T13:41:20.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T13:41:20.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T13:41:20.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:19 gibba003 bash[9769]: audit 2021-03-10T13:41:19.339428+0000 mon.a (mon.0) 38 : audit [DBG] from='client.? 172.21.2.103:0/2305963985' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T13:41:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:20 gibba003 bash[9769]: cluster 2021-03-10T13:41:20.588344+0000 mon.a (mon.0) 39 : cluster [INF] Active manager daemon y restarted 2021-03-10T13:41:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:20 gibba003 bash[9769]: cluster 2021-03-10T13:41:20.588901+0000 mon.a (mon.0) 40 : cluster [INF] Activating manager daemon y 2021-03-10T13:41:21.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:20 gibba003 bash[9769]: cluster 2021-03-10T13:41:20.590409+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-03-10T13:41:21.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:21.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2021-03-10T13:41:21.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T13:41:21.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:22.102 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: cluster 2021-03-10T13:41:20.839596+0000 mon.a (mon.0) 42 : cluster [DBG] mgrmap e6: y(active, starting, since 0.250722s) 2021-03-10T13:41:22.103 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.843807+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:41:22.103 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.846150+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:41:22.103 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.846727+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:41:22.103 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.847295+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:41:22.104 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.848775+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:41:22.104 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.851102+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:41:22.104 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.852400+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:41:22.104 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: cluster 2021-03-10T13:41:20.857916+0000 mon.a (mon.0) 50 : cluster [INF] Manager daemon y is now available 2021-03-10T13:41:22.105 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:20.875312+0000 mon.a (mon.0) 51 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:41:22.105 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:21 gibba003 bash[9769]: audit 2021-03-10T13:41:21.030039+0000 mon.a (mon.0) 52 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:41:22.466 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2021-03-10T13:41:22.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2021-03-10T13:41:22.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2021-03-10T13:41:23.129 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:22 gibba003 bash[9769]: cluster 2021-03-10T13:41:21.844697+0000 mon.a (mon.0) 53 : cluster [DBG] mgrmap e7: y(active, since 1.25586s) 2021-03-10T13:41:23.939 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Generating ssh key... 2021-03-10T13:41:23.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2021-03-10T13:41:23.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2021-03-10T13:41:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:23 gibba003 bash[9769]: cluster 2021-03-10T13:41:22.854144+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-03-10T13:41:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:23 gibba003 bash[9769]: audit 2021-03-10T13:41:23.458697+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:23 gibba003 bash[9769]: audit 2021-03-10T13:41:23.459702+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2021-03-10T13:41:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:23 gibba003 bash[9769]: audit 2021-03-10T13:41:23.461917+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2021-03-10T13:41:25.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[9769]: audit 2021-03-10T13:41:25.479421+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA5ARw6WJOwBXBFGG+ZAzOhcYmWtTgo8Ad+KvUqThzdAoQ+JAIVrYt\nFzZPVXIyX5+rRCEGQ3eyl9R+2677fI62qGOlyKU9giKFrcJ8NELesDLdTw//uCQyGuZU1H\nhMB9bo+RYDEaO68OyoB7VPdJjZjMWbHyqC/8CVPfgVGpd1P1IKmdc4q7WsOLN2NnmsROkW\nG8ycUD8U1XvFK8UT7dBTSwoAqIu4iPQUUZBT+Mf7cvmcwUJilo6YdcJc47IWZ4wBEqeeoG\nrdmsl66CLgoa3QolQnWa1RQBM1YDXKAV6iebq3X/NFoSnxueozOnj/WZz/+CWy+RRd7tJq\nm8VGYbQ5vAUkcU9173s2O//YQCtMYHyMABFZUxwyM7uHNJgyC60PD7eJwmetbS07B7ohne\nWnxgZ45UHnt1MmfDHhuixyhY7wOLLi80gpa2sUOMZ0VRr56Tt7IGdg1oQQpdDOmsWIhY+Y\n7LNUqhESKgD13h3fxXGYA0Dk58rOK+VslYO2/v43AAAFoL+X/P6/l/z+AAAAB3NzaC1yc2\nEAAAGBAOQEcOliTsAVwRRhvmQMzoXGJlrU4KPAHfir1Kk4c3QKEPiQCFa2LRc2T1VyMl+f\nq0QhBkN3spfUftuu+3yOtqhjpcilPYIiha3CfDRC3rAy3U8P/7gkMhrmVNR4TAfW6PkWAx\nGjuvDsqAe1T3SY2YzFmx8qgv/AlT34FRqXdT9SCpnXOKu1rDizdjZ5rETpFhvMnFA/FNV7\nxSvFE+3QU0sKAKiLuIj0FFGQU/jH+3L5nMFCYpaOmHXCXOOyFmeMARKnnqBq3ZrJeugi4K\nGt0KJUJ1mtUUATNWA1ygFeonm6t1/zRaEp8bnqMzp4/1mc//glsvkUXe7SapvFRmG0ObwF\nJHFPde97Njv/2EArTGB8jAARWVMcMjO7hzSYMgutDw+3icJnrW0tOwe6IZ3lp8YGeOVB57\ndTJnwx4boscoWO8Diy4vNIKWtrFDjGdFUa+ek7eyBnYNaEEKXQzprFiIWPmOyzVKoREioA\n9d4d38VxmANA5OfKzivlbJWDtv7+NwAAAAMBAAEAAAGBAIDXoZW+3xDbOgbyVErkka41kW\nax812UKVtifQBBzbs8FOrfOFcHCeOb5Kg7pwsxhe0xXACzmk8A2832ylRPsBbmd78w39iw\n+Sh+RQCi6IJXu4X5XF4I1ectT7HfZ9bmMS7OqV1GT1Pj5e61HPidhhBteIHb27n4cFxb2l\nD0VGQ7T5Iucu9T8MT5Y0rU5erqanu62njdrEAVeAyLh/9RQD+en1Cd4uBAS1rrWwewuPz2\n3wS1JlA8sxmXgjWHY/GOwdsM5X80ugeEY5eFee1CBpIHBgy7UhqJbI86SeQYYEG7MFqM0y\nQ0BmpTtZXPxJ/7HnHwgOHS5AA7WagPmACNYC/3WFkKoA11AVkCoXGtwv0JomdwqY8SUBW6\nRLKdyLZI67OtKWMQsm1SVWAYR5VKbFQXmC4IH3VM/TR8+gqcg+892jE9ocUfAM4M7r9Clm\nsjH7hFEItPHOVx3ZRqS3nz4XiCYHhC1C1hDp2pV4JjE1mgnS2Oz93w8cloRPAk0vTuAQAA\nAMEA0QFqNrthzVLpogdNt36+2j2esWmC64bQbp1i6rAFGHA77Vl75t9xcCkxqVmtcyJadC\nBm5JLRfK4Mfbp/CI64Rh9TJccKxZAVI8tnIRXDggF0HUIYItNI4bblKuh2nERAA69GTH2e\nn44uZNBO1OeT1gXGQe7SHU3p55M7X5fA7QjKaluOj8BVORk2t9ZEJc6qKpTuNz+xvPsUNj\n5tHBm4hhFml9qmIVYACAwP9Cf+v/ki+zRe+LdFbtY943q2rDIQAAAAwQD+FudIcugGKc5Z\nVLZ+cSVpRiTdVvgaKyN8s8vAfhF0naY6Ocdo1ap6drIYrXjOJLpzVckAuXUKt7ktQ/2MIe\nv0jhJeGo9Ea9YMMBWKAYNDm8Csliur9DSWWypEG6Y3Hl+msQMw5rmQg+q+PUrh6naiDrML\nTJpzwqA5n8J28UvbGu88hdR8mLK8nSav03nv+u6ri8b+F9lke+1rgX0egts0+fnt7RLD2v\nEyA4yXjDWDwGPVy5xMGUYO691hWM9QFVcAAADBAOW7WfaCJ32Ejcgz9+c0kWxknU9BZXC1\nMmcVNBMuSwvkXdBM1mwLNEpGp2Q7m+TJaab/O/gbmiwrU47ZU8iJugbKd1VGF8b0EGXCov\n4shL0BUQrm2O4HT+f28BF8TU8na3c7htfkBL5ET40j25AARMiUTr54Y3VcvjeM4OISn6Ta\n6e4E/vWoLYlhKwDkq6iVtcYIINuwwFI9poe8UoG9bVqDMr98AmjNWzZRNzNADX5xgJ6jCZ\nWo5/5EZYCHkoDyIQAAACljZXBoLTMzNTcyYWQ2LTgxYTYtMTFlYi05MDgwLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:41:25.943 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: Generating public/private rsa key pair. 2021-03-10T13:41:25.944 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: Your identification has been saved in /tmp/tmph_r0a1gx/key. 2021-03-10T13:41:25.944 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: Your public key has been saved in /tmp/tmph_r0a1gx/key.pub. 2021-03-10T13:41:25.944 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: The key fingerprint is: 2021-03-10T13:41:25.944 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: SHA256:m443DEp5pDiDoq0Y2EDONFesQlgSY2iJhOK1iVV9NAU ceph-33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:25.945 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: The key's randomart image is: 2021-03-10T13:41:25.945 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: +---[RSA 3072]----+ 2021-03-10T13:41:25.945 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |X=o oo. .Eo. | 2021-03-10T13:41:25.945 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |B* o.. . .. | 2021-03-10T13:41:25.945 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |=++.+ . | 2021-03-10T13:41:25.946 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |=+o+ . | 2021-03-10T13:41:25.946 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |.+.. + S | 2021-03-10T13:41:25.946 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |+o+ + o o | 2021-03-10T13:41:25.946 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |=..+ o oo | 2021-03-10T13:41:25.946 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |o.. . o+ | 2021-03-10T13:41:25.947 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: |o. .... | 2021-03-10T13:41:25.947 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[10000]: +----[SHA256]-----+ 2021-03-10T13:41:25.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[9769]: audit 2021-03-10T13:41:25.481139+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA5ARw6WJOwBXBFGG+ZAzOhcYmWtTgo8Ad+KvUqThzdAoQ+JAIVrYt\nFzZPVXIyX5+rRCEGQ3eyl9R+2677fI62qGOlyKU9giKFrcJ8NELesDLdTw//uCQyGuZU1H\nhMB9bo+RYDEaO68OyoB7VPdJjZjMWbHyqC/8CVPfgVGpd1P1IKmdc4q7WsOLN2NnmsROkW\nG8ycUD8U1XvFK8UT7dBTSwoAqIu4iPQUUZBT+Mf7cvmcwUJilo6YdcJc47IWZ4wBEqeeoG\nrdmsl66CLgoa3QolQnWa1RQBM1YDXKAV6iebq3X/NFoSnxueozOnj/WZz/+CWy+RRd7tJq\nm8VGYbQ5vAUkcU9173s2O//YQCtMYHyMABFZUxwyM7uHNJgyC60PD7eJwmetbS07B7ohne\nWnxgZ45UHnt1MmfDHhuixyhY7wOLLi80gpa2sUOMZ0VRr56Tt7IGdg1oQQpdDOmsWIhY+Y\n7LNUqhESKgD13h3fxXGYA0Dk58rOK+VslYO2/v43AAAFoL+X/P6/l/z+AAAAB3NzaC1yc2\nEAAAGBAOQEcOliTsAVwRRhvmQMzoXGJlrU4KPAHfir1Kk4c3QKEPiQCFa2LRc2T1VyMl+f\nq0QhBkN3spfUftuu+3yOtqhjpcilPYIiha3CfDRC3rAy3U8P/7gkMhrmVNR4TAfW6PkWAx\nGjuvDsqAe1T3SY2YzFmx8qgv/AlT34FRqXdT9SCpnXOKu1rDizdjZ5rETpFhvMnFA/FNV7\nxSvFE+3QU0sKAKiLuIj0FFGQU/jH+3L5nMFCYpaOmHXCXOOyFmeMARKnnqBq3ZrJeugi4K\nGt0KJUJ1mtUUATNWA1ygFeonm6t1/zRaEp8bnqMzp4/1mc//glsvkUXe7SapvFRmG0ObwF\nJHFPde97Njv/2EArTGB8jAARWVMcMjO7hzSYMgutDw+3icJnrW0tOwe6IZ3lp8YGeOVB57\ndTJnwx4boscoWO8Diy4vNIKWtrFDjGdFUa+ek7eyBnYNaEEKXQzprFiIWPmOyzVKoREioA\n9d4d38VxmANA5OfKzivlbJWDtv7+NwAAAAMBAAEAAAGBAIDXoZW+3xDbOgbyVErkka41kW\nax812UKVtifQBBzbs8FOrfOFcHCeOb5Kg7pwsxhe0xXACzmk8A2832ylRPsBbmd78w39iw\n+Sh+RQCi6IJXu4X5XF4I1ectT7HfZ9bmMS7OqV1GT1Pj5e61HPidhhBteIHb27n4cFxb2l\nD0VGQ7T5Iucu9T8MT5Y0rU5erqanu62njdrEAVeAyLh/9RQD+en1Cd4uBAS1rrWwewuPz2\n3wS1JlA8sxmXgjWHY/GOwdsM5X80ugeEY5eFee1CBpIHBgy7UhqJbI86SeQYYEG7MFqM0y\nQ0BmpTtZXPxJ/7HnHwgOHS5AA7WagPmACNYC/3WFkKoA11AVkCoXGtwv0JomdwqY8SUBW6\nRLKdyLZI67OtKWMQsm1SVWAYR5VKbFQXmC4IH3VM/TR8+gqcg+892jE9ocUfAM4M7r9Clm\nsjH7hFEItPHOVx3ZRqS3nz4XiCYHhC1C1hDp2pV4JjE1mgnS2Oz93w8cloRPAk0vTuAQAA\nAMEA0QFqNrthzVLpogdNt36+2j2esWmC64bQbp1i6rAFGHA77Vl75t9xcCkxqVmtcyJadC\nBm5JLRfK4Mfbp/CI64Rh9TJccKxZAVI8tnIRXDggF0HUIYItNI4bblKuh2nERAA69GTH2e\nn44uZNBO1OeT1gXGQe7SHU3p55M7X5fA7QjKaluOj8BVORk2t9ZEJc6qKpTuNz+xvPsUNj\n5tHBm4hhFml9qmIVYACAwP9Cf+v/ki+zRe+LdFbtY943q2rDIQAAAAwQD+FudIcugGKc5Z\nVLZ+cSVpRiTdVvgaKyN8s8vAfhF0naY6Ocdo1ap6drIYrXjOJLpzVckAuXUKt7ktQ/2MIe\nv0jhJeGo9Ea9YMMBWKAYNDm8Csliur9DSWWypEG6Y3Hl+msQMw5rmQg+q+PUrh6naiDrML\nTJpzwqA5n8J28UvbGu88hdR8mLK8nSav03nv+u6ri8b+F9lke+1rgX0egts0+fnt7RLD2v\nEyA4yXjDWDwGPVy5xMGUYO691hWM9QFVcAAADBAOW7WfaCJ32Ejcgz9+c0kWxknU9BZXC1\nMmcVNBMuSwvkXdBM1mwLNEpGp2Q7m+TJaab/O/gbmiwrU47ZU8iJugbKd1VGF8b0EGXCov\n4shL0BUQrm2O4HT+f28BF8TU8na3c7htfkBL5ET40j25AARMiUTr54Y3VcvjeM4OISn6Ta\n6e4E/vWoLYlhKwDkq6iVtcYIINuwwFI9poe8UoG9bVqDMr98AmjNWzZRNzNADX5xgJ6jCZ\nWo5/5EZYCHkoDyIQAAACljZXBoLTMzNTcyYWQ2LTgxYTYtMTFlYi05MDgwLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2021-03-10T13:41:25.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[9769]: audit 2021-03-10T13:41:25.481639+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c\n"}]: dispatch 2021-03-10T13:41:25.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:25 gibba003 bash[9769]: audit 2021-03-10T13:41:25.482973+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c\n"}]': finished 2021-03-10T13:41:26.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2021-03-10T13:41:26.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2021-03-10T13:41:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:26 gibba003 bash[9769]: audit 2021-03-10T13:41:24.960493+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:26 gibba003 bash[9769]: cephadm 2021-03-10T13:41:24.960720+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2021-03-10T13:41:26.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:27.537 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-03-10T13:41:27.537 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2021-03-10T13:41:27.537 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Adding host gibba003... 2021-03-10T13:41:27.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'gibba003'] 2021-03-10T13:41:27.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add gibba003 2021-03-10T13:41:28.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:27 gibba003 bash[9769]: audit 2021-03-10T13:41:26.986901+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:28.942 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:28 gibba003 bash[10000]: Warning: Permanently added 'gibba003,172.21.2.103' (ECDSA) to the list of known hosts. 2021-03-10T13:41:29.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'gibba003' 2021-03-10T13:41:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:28.534127+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba003", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:28.852379+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba003\": {\"hostname\": \"gibba003\", \"addr\": \"gibba003\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T13:41:30.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:28.853908+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba003\": {\"hostname\": \"gibba003\", \"addr\": \"gibba003\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T13:41:30.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:28.966883+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:41:30.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:28.968591+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:41:30.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:28.969205+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:30.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:29.303794+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:29.302346\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:29.303349\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:41:29.303412\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:41:30.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:29.305629+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:29.302346\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:29.303349\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:41:29.303412\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:41:30.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:29 gibba003 bash[9769]: audit 2021-03-10T13:41:29.306160+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.14117 172.21.2.103:0/1976319532' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:30.285 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Enabling the dashboard module... 2021-03-10T13:41:30.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2021-03-10T13:41:30.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2021-03-10T13:41:30.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:30 gibba003 bash[9769]: cephadm 2021-03-10T13:41:28.854241+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host gibba003 2021-03-10T13:41:32.403 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:31 gibba003 bash[9769]: audit 2021-03-10T13:41:31.937035+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.2.103:0/3115824430' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-03-10T13:41:32.403 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:32 gibba003 bash[10000]: ignoring --setuser ceph since I am not root 2021-03-10T13:41:32.403 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:32 gibba003 bash[10000]: ignoring --setgroup ceph since I am not root 2021-03-10T13:41:32.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T13:41:32.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T13:41:33.041 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:32 gibba003 bash[9769]: audit 2021-03-10T13:41:31.989914+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.2.103:0/3115824430' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-03-10T13:41:33.042 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:32 gibba003 bash[9769]: cluster 2021-03-10T13:41:31.989946+0000 mon.a (mon.0) 71 : cluster [DBG] mgrmap e9: y(active, since 11s) 2021-03-10T13:41:34.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2021-03-10T13:41:34.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2021-03-10T13:41:34.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T13:41:34.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T13:41:34.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:34.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:34.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:6800", 2021-03-10T13:41:34.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2012233970 2021-03-10T13:41:34.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T13:41:34.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:6801", 2021-03-10T13:41:34.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2012233970 2021-03-10T13:41:34.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:34.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.103:6801/2012233970", 2021-03-10T13:41:34.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T13:41:20.588833+0000", 2021-03-10T13:41:34.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T13:41:34.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:41:34.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T13:41:34.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:41:34.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:41:34.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2021-03-10T13:41:34.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:41:34.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:41:34.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T13:41:34.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T13:41:34.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:34.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:34.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:34.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T13:41:34.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.457 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.458 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.459 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.460 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.461 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.462 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T13:41:34.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T13:41:34.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.463 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.464 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T13:41:34.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.465 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T13:41:34.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T13:41:34.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.466 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T13:41:34.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.467 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T13:41:34.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.468 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T13:41:34.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T13:41:34.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.469 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.470 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T13:41:34.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.471 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T13:41:34.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T13:41:34.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.472 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T13:41:34.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T13:41:34.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T13:41:34.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.475 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T13:41:34.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.476 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T13:41:34.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.477 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T13:41:34.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T13:41:34.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.478 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.479 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T13:41:34.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.480 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T13:41:34.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T13:41:34.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.481 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.482 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T13:41:34.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.483 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T13:41:34.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T13:41:34.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.484 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.485 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T13:41:34.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.486 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T13:41:34.487 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T13:41:34.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T13:41:34.488 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.489 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T13:41:34.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.490 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T13:41:34.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T13:41:34.491 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T13:41:34.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.492 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T13:41:34.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:41:34.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.493 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T13:41:34.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T13:41:34.494 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:34.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:41:34.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:41:34.495 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:41:34.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T13:41:34.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:41:34.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.496 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T13:41:34.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T13:41:34.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:34.497 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T13:41:34.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:41:34.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T13:41:34.498 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T13:41:34.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.499 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T13:41:34.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T13:41:34.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.500 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T13:41:34.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.501 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T13:41:34.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T13:41:34.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.502 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T13:41:34.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T13:41:34.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:41:34.503 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T13:41:34.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T13:41:34.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T13:41:34.504 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T13:41:34.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T13:41:34.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.505 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T13:41:34.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T13:41:34.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.506 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T13:41:34.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.507 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T13:41:34.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:41:34.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.508 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T13:41:34.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T13:41:34.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:34.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.509 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:41:34.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:41:34.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:41:34.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.510 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T13:41:34.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:41:34.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.511 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.512 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.513 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.514 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.515 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.516 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.517 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.518 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.519 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.520 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.521 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.522 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.523 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.524 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.525 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T13:41:34.526 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T13:41:34.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:41:34.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:41:34.527 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T13:41:34.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.528 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:41:34.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:41:34.529 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T13:41:34.530 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T13:41:34.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T13:41:34.531 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T13:41:34.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T13:41:34.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.532 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T13:41:34.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T13:41:34.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.533 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.534 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T13:41:34.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.535 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:34.536 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:34.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:34.537 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T13:41:34.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.538 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T13:41:34.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T13:41:34.539 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:34.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:41:34.540 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T13:41:34.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T13:41:34.541 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T13:41:34.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T13:41:34.542 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:41:34.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:34.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.543 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T13:41:34.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.544 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.545 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T13:41:34.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.546 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T13:41:34.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T13:41:34.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.547 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T13:41:34.548 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T13:41:34.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.549 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T13:41:34.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T13:41:34.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.550 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T13:41:34.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T13:41:34.551 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T13:41:34.552 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T13:41:34.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.553 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:34.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T13:41:34.554 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T13:41:34.555 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T13:41:34.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T13:41:34.556 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T13:41:34.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.557 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T13:41:34.558 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T13:41:34.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:34.559 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T13:41:34.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.560 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.561 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.562 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.563 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.564 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.565 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.566 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T13:41:34.567 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.568 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.569 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.570 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.571 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.572 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.573 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.574 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.575 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.576 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:41:34.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:41:34.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.577 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T13:41:34.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.578 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T13:41:34.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T13:41:34.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T13:41:34.579 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T13:41:34.580 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T13:41:34.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.581 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:34.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T13:41:34.582 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T13:41:34.583 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T13:41:34.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T13:41:34.585 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T13:41:34.586 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T13:41:34.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.587 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T13:41:34.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.588 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T13:41:34.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T13:41:34.589 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.590 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T13:41:34.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.591 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.592 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T13:41:34.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.593 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.594 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.595 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.596 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.597 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.598 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.599 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.600 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.601 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.602 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.603 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.604 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.605 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.606 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.607 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T13:41:34.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T13:41:34.608 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T13:41:34.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.609 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T13:41:34.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.610 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T13:41:34.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T13:41:34.611 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T13:41:34.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.612 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T13:41:34.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.613 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.614 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T13:41:34.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.615 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T13:41:34.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T13:41:34.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.616 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.617 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T13:41:34.618 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T13:41:34.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.619 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.620 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T13:41:34.621 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T13:41:34.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.622 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.623 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T13:41:34.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T13:41:34.624 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.625 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.626 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T13:41:34.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T13:41:34.627 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.628 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.629 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T13:41:34.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T13:41:34.630 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.631 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.632 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T13:41:34.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T13:41:34.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.633 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.634 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.635 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T13:41:34.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T13:41:34.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.636 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.637 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.638 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T13:41:34.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T13:41:34.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.639 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.640 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.641 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T13:41:34.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T13:41:34.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.642 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.643 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.644 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T13:41:34.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T13:41:34.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.645 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.646 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.647 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T13:41:34.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T13:41:34.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.648 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:41:34.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.649 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.650 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T13:41:34.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T13:41:34.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.651 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.652 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.653 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T13:41:34.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T13:41:34.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.654 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.655 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T13:41:34.656 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T13:41:34.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:41:34.657 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.658 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T13:41:34.659 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T13:41:34.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.660 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.661 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T13:41:34.662 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T13:41:34.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.663 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.664 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T13:41:34.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T13:41:34.665 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.666 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.667 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T13:41:34.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T13:41:34.668 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.669 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.670 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T13:41:34.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T13:41:34.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.671 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.672 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.673 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T13:41:34.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T13:41:34.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.674 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.675 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.676 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T13:41:34.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T13:41:34.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.677 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.678 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.679 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T13:41:34.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T13:41:34.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.680 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.681 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.682 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T13:41:34.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T13:41:34.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.683 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.684 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.685 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T13:41:34.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T13:41:34.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.686 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.687 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.688 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T13:41:34.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T13:41:34.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.689 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.690 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.691 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T13:41:34.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T13:41:34.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.692 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T13:41:34.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.693 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T13:41:34.694 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T13:41:34.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.695 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:34.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.696 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T13:41:34.697 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T13:41:34.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T13:41:34.698 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.699 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T13:41:34.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T13:41:34.700 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T13:41:34.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.701 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.702 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T13:41:34.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T13:41:34.703 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.704 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.705 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T13:41:34.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T13:41:34.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.706 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:41:34.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.707 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.708 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T13:41:34.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T13:41:34.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.709 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.710 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.711 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T13:41:34.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T13:41:34.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.712 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T13:41:34.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.713 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.714 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T13:41:34.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T13:41:34.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.715 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T13:41:34.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.716 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.717 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T13:41:34.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T13:41:34.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.718 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.719 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.720 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T13:41:34.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T13:41:34.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.721 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.722 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T13:41:34.723 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T13:41:34.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.724 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.725 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T13:41:34.726 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T13:41:34.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.727 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:41:34.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.728 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T13:41:34.729 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T13:41:34.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:34.730 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.731 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T13:41:34.732 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T13:41:34.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:34.733 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.734 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T13:41:34.735 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T13:41:34.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.736 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.737 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T13:41:34.738 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T13:41:34.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.739 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T13:41:34.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.740 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T13:41:34.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T13:41:34.741 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.742 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.742 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.742 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T13:41:34.742 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.742 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.743 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.744 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.744 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:41:34.744 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:41:34.744 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.745 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.745 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.745 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.745 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.745 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.746 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.746 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.746 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.746 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.746 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.747 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.747 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.747 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.747 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.747 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.748 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.748 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.748 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.748 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.748 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.749 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.749 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.749 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.749 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.750 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.750 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.750 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.750 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.750 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.751 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.751 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.751 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.751 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.751 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.752 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.752 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.752 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.752 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.752 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.753 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.753 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.753 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.753 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.754 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.754 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.754 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.754 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.754 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.755 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.755 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.755 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.755 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.755 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.756 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.756 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.756 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.756 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.756 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.757 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.757 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.757 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.757 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.757 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.758 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.758 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.758 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.758 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.759 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.759 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.759 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.759 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.759 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.760 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.760 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.760 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.760 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.760 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.761 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.761 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.761 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.761 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.761 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:41:34.762 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:41:34.762 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.762 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.762 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.763 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.763 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.763 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.763 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.763 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.764 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.764 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.764 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.764 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.764 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:41:34.765 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:41:34.765 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.765 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.765 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.765 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T13:41:34.766 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.766 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.766 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.766 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.766 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.767 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.767 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.767 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.767 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:41:34.767 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:41:34.768 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.768 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.768 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.768 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T13:41:34.768 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.769 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.769 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.769 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.769 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.770 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.770 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.770 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.770 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:41:34.770 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:41:34.771 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.771 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.771 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.771 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.771 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.772 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.772 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.772 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.772 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.772 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.773 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.773 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.773 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T13:41:34.773 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T13:41:34.774 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.774 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.774 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.774 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T13:41:34.774 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.775 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.775 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.775 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.775 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.775 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.776 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.776 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.776 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T13:41:34.776 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T13:41:34.776 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.777 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.777 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.777 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T13:41:34.777 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.778 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.778 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.778 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.778 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T13:41:34.778 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.779 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.779 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.779 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.779 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.779 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.780 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T13:41:34.780 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T13:41:34.780 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.780 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.780 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.781 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T13:41:34.781 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T13:41:34.781 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T13:41:34.781 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.782 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.782 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.782 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.782 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.782 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.783 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T13:41:34.783 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T13:41:34.783 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.783 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.783 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.784 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.784 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.784 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.784 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.784 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.785 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.785 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.785 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.785 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.785 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:41:34.786 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:41:34.786 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.786 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.786 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.787 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.787 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.787 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.787 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.787 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.788 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.788 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.788 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.788 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.788 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.789 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.789 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.789 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T13:41:34.789 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.789 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.790 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.790 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T13:41:34.790 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T13:41:34.790 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.791 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.791 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.791 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.791 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.791 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.792 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.792 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T13:41:34.792 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.792 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.792 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.793 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.793 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.793 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.793 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.793 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.794 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.794 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.794 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.794 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.794 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.795 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.795 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.795 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.795 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.795 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.796 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.796 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.796 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.796 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.796 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.797 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.797 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.797 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.797 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.797 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.798 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.798 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.798 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.798 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.798 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.799 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.799 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.799 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.799 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.799 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.800 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.800 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.800 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.800 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.801 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.801 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.801 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.801 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.801 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.802 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.802 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.802 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.802 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.802 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.803 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.803 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.803 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.803 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.803 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.804 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.804 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.804 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.804 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.804 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.806 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.806 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.806 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.806 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.806 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.807 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.807 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.807 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T13:41:34.807 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T13:41:34.807 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.808 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.808 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.808 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T13:41:34.808 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.809 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.809 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.809 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T13:41:34.809 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.809 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.810 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.810 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.810 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T13:41:34.810 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T13:41:34.810 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.811 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.811 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.811 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T13:41:34.811 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.812 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.812 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.812 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T13:41:34.812 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.812 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.813 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.813 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.813 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T13:41:34.813 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T13:41:34.813 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.814 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.814 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.814 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T13:41:34.814 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.815 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.815 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.815 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T13:41:34.815 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.815 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.816 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.816 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.816 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T13:41:34.816 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T13:41:34.816 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.817 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.817 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.817 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:41:34.817 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.817 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.818 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.818 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T13:41:34.818 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.818 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.819 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.819 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.819 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T13:41:34.819 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T13:41:34.819 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.820 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.820 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.820 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:34.820 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.820 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.821 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.821 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T13:41:34.821 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.821 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.821 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:34.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:34.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.822 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:34.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.823 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T13:41:34.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.824 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T13:41:34.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T13:41:34.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:34.825 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T13:41:34.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.826 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T13:41:34.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.827 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T13:41:34.828 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.829 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.830 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.831 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.832 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.833 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.834 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.835 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.836 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.837 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.840 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.841 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.842 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.843 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T13:41:34.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T13:41:34.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.844 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:41:34.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.845 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.846 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T13:41:34.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T13:41:34.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.847 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T13:41:34.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.848 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.849 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:34.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:34.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.850 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:41:34.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.851 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.852 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T13:41:34.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T13:41:34.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T13:41:34.853 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T13:41:34.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T13:41:34.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.854 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T13:41:34.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.855 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.856 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T13:41:34.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T13:41:34.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.857 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T13:41:34.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.858 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.859 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T13:41:34.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T13:41:34.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.860 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:34.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.861 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.862 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:34.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:34.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.863 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T13:41:34.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.864 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.865 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.866 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.867 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.868 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.869 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.870 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.871 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.872 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.873 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.874 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.875 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.876 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.877 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.878 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.879 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:41:34.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:41:34.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.880 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:34.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.881 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.882 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T13:41:34.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T13:41:34.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.883 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T13:41:34.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.884 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.885 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:41:34.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:41:34.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.886 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T13:41:34.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.887 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.888 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T13:41:34.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T13:41:34.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.889 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:34.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.890 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.891 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:41:34.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:41:34.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.892 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:34.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.893 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.894 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T13:41:34.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T13:41:34.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.895 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T13:41:34.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.896 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.897 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T13:41:34.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.898 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.899 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.900 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.901 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.902 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.903 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.904 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.905 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.906 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.907 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.908 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.909 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.910 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.911 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.912 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.913 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T13:41:34.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.914 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.915 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.916 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.917 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.918 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.919 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.920 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.921 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.923 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.924 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.925 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.926 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.927 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.928 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.929 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T13:41:34.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.930 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T13:41:34.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T13:41:34.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.931 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:41:34.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.932 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T13:41:34.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.933 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T13:41:34.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T13:41:34.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.934 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:34.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:41:34.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T13:41:34.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.935 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T13:41:34.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.936 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.937 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.938 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.939 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.940 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.941 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.942 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.943 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.944 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.945 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.946 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.947 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.948 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.949 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.950 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.951 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T13:41:34.952 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T13:41:34.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T13:41:34.953 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T13:41:34.954 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T13:41:34.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.955 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.957 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.958 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.959 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.960 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.961 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.962 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.963 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.964 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.965 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.966 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.967 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.968 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.969 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.970 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T13:41:34.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T13:41:34.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.971 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.972 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T13:41:34.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.973 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T13:41:34.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T13:41:34.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.974 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T13:41:34.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.975 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T13:41:34.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.976 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T13:41:34.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T13:41:34.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:34.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.977 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T13:41:34.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.978 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T13:41:34.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.979 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T13:41:34.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T13:41:34.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.980 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T13:41:34.981 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.982 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T13:41:34.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T13:41:34.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.983 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T13:41:34.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T13:41:34.984 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:34.985 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:34.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:41:34.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:34.986 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:34.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:34.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:34.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:34.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.987 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:34.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.988 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.989 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.990 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:34.991 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:34.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:34.992 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:34.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.993 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:34.994 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:34.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:34.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:34.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:34.995 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:34.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:34.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:34.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:34.996 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:34.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:34.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:34.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:34.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:34.997 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:34.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:34.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:34.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:34.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:34.998 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:34.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:34.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:34.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:34.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:34.999 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.000 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.001 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T13:41:35.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:41:35.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.002 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:35.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.003 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:41:35.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T13:41:35.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T13:41:35.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.004 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T13:41:35.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.005 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T13:41:35.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.006 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.007 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.008 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.009 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.010 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.011 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.012 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.013 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.014 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.015 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.016 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.017 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.018 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.019 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.020 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.021 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T13:41:35.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.022 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.023 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.024 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.025 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.026 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.027 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.028 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.029 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.030 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.031 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.032 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.033 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.034 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.035 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.036 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:41:35.037 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:41:35.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:35.038 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.039 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.040 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T13:41:35.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.041 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.042 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.043 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.044 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.045 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.046 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.047 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.048 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.049 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.050 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.051 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.052 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.053 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.054 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.055 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T13:41:35.056 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T13:41:35.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:35.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T13:41:35.057 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T13:41:35.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.058 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T13:41:35.059 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T13:41:35.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:35.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:41:35.060 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T13:41:35.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.061 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.062 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T13:41:35.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.063 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.064 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.065 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.066 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.067 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.068 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.069 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.070 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.071 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.072 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.073 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.074 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.075 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.076 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.077 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T13:41:35.078 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T13:41:35.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.079 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.080 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T13:41:35.081 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T13:41:35.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.082 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.083 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T13:41:35.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T13:41:35.084 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.085 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.086 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:41:35.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:41:35.087 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.088 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.089 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:41:35.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:41:35.090 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.091 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.092 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.093 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T13:41:35.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.094 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.095 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.096 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.097 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.098 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.099 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.100 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.101 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.102 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.103 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.104 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.105 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.106 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.107 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.108 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T13:41:35.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T13:41:35.109 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.110 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.111 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T13:41:35.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T13:41:35.112 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.113 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.114 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.115 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T13:41:35.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.116 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:41:35.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:41:35.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.117 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.118 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.119 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.120 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.121 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.122 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.123 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.124 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.125 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.126 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.127 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.128 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.129 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.130 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.131 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.132 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.133 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:41:35.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:41:35.134 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.135 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.136 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:41:35.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:41:35.137 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.138 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.139 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.140 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T13:41:35.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.141 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.142 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.143 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.144 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.145 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.146 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.147 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.148 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.149 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.150 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.151 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.152 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.153 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.154 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.155 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.156 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T13:41:35.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.157 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.158 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.159 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.160 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.161 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.162 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.163 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.164 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.165 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.166 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.167 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.168 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.169 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.170 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.171 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.172 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T13:41:35.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T13:41:35.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.173 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.174 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.175 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T13:41:35.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T13:41:35.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.176 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T13:41:35.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.177 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.178 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T13:41:35.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T13:41:35.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.179 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.180 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.181 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T13:41:35.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T13:41:35.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:35.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.182 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.183 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.184 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T13:41:35.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T13:41:35.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:41:35.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.185 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.186 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.187 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T13:41:35.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T13:41:35.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.188 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.189 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.190 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T13:41:35.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T13:41:35.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.191 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.192 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.193 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T13:41:35.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T13:41:35.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.194 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:35.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.195 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T13:41:35.196 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T13:41:35.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.197 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.198 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.199 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T13:41:35.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T13:41:35.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.200 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.201 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T13:41:35.202 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T13:41:35.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.203 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.204 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.205 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T13:41:35.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.206 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.207 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.208 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.209 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.210 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.212 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.213 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.214 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.215 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.216 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.217 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.218 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.219 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.220 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.221 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T13:41:35.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.222 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T13:41:35.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T13:41:35.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.223 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T13:41:35.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.224 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.225 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:35.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:35.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:35.226 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T13:41:35.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.227 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.228 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.229 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.230 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.231 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.232 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.233 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.234 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.235 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.236 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.237 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.238 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.239 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.240 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.241 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.242 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.243 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T13:41:35.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.244 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T13:41:35.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T13:41:35.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.245 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:35.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.246 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T13:41:35.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.247 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T13:41:35.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T13:41:35.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.248 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:35.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.249 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.250 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T13:41:35.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T13:41:35.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.251 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:41:35.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.252 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.253 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T13:41:35.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T13:41:35.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.254 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.255 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.256 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T13:41:35.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T13:41:35.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.257 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:35.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.258 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.259 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T13:41:35.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T13:41:35.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.260 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:35.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.261 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.262 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T13:41:35.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T13:41:35.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.263 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T13:41:35.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.264 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T13:41:35.265 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T13:41:35.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.266 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.267 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:35.268 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:35.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:35.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T13:41:35.269 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T13:41:35.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.270 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T13:41:35.271 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T13:41:35.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:35.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T13:41:35.272 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.273 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T13:41:35.274 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T13:41:35.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.275 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.276 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.277 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.278 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.279 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.280 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.281 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.282 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.283 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.284 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.285 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.286 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.287 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.288 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.289 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.290 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.291 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T13:41:35.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T13:41:35.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.292 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:35.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.293 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.294 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T13:41:35.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T13:41:35.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.295 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:35.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.296 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.297 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T13:41:35.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T13:41:35.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.298 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T13:41:35.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.299 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.300 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T13:41:35.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.301 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.302 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.303 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.304 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.305 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.306 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.307 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.308 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.309 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.310 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.311 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.312 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.313 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.314 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.315 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.316 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.317 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T13:41:35.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.318 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.319 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.320 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.321 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.322 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.323 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.324 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.325 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.326 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.327 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.328 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.329 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.330 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.331 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.332 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.333 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T13:41:35.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:41:35.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:41:35.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:41:35.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T13:41:35.334 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T13:41:35.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T13:41:35.335 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.336 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T13:41:35.337 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T13:41:35.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.338 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.339 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:41:35.340 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:41:35.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:41:35.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:41:35.341 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.342 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:41:35.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:41:35.343 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:41:35.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.344 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.345 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.346 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.347 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:41:35.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:41:35.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.348 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.349 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:41:35.350 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:41:35.351 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.351 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.351 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.351 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:41:35.351 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.352 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.352 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:41:35.352 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:41:35.352 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:41:35.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:41:35.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:41:35.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:41:35.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:41:35.353 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.354 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:41:35.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:41:35.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:41:35.355 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:41:35.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:41:35.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.356 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.357 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T13:41:35.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T13:41:35.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.358 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:41:35.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.359 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.360 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.362 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T13:41:35.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T13:41:35.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:41:35.363 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T13:41:35.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.364 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.365 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T13:41:35.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T13:41:35.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:41:35.366 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:41:35.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:41:35.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T13:41:35.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:41:35.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:41:35.367 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:41:35.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:41:35.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:41:35.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:41:35.368 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:41:35.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.369 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T13:41:35.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T13:41:35.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T13:41:35.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:41:35.370 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:41:35.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:41:35.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T13:41:35.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:41:35.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:41:35.371 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:41:35.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:41:35.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T13:41:35.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:41:35.372 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:41:35.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:41:35.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T13:41:35.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T13:41:35.373 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T13:41:35.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:41:35.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:41:35.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:41:35.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T13:41:35.374 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:41:35.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:41:35.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2021-03-10T13:41:35.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T13:41:35.375 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:35.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:35.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:0", 2021-03-10T13:41:35.376 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2525947923 2021-03-10T13:41:35.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:35.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.377 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:35.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:35.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:0", 2021-03-10T13:41:35.378 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1049164244 2021-03-10T13:41:35.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:35.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:41:35.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.379 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:41:35.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:35.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:41:35.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.103:0", 2021-03-10T13:41:35.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3560639010 2021-03-10T13:41:35.380 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:35.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:41:35.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.381 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:35.383 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T13:41:35.383 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2021-03-10T13:41:35.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T13:41:35.383 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T13:41:35.384 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:34 gibba003 bash[9769]: audit 2021-03-10T13:41:33.848587+0000 mon.a (mon.0) 72 : audit [DBG] from='client.? 172.21.2.103:0/2069809842' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T13:41:36.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:35 gibba003 bash[9769]: cluster 2021-03-10T13:41:34.844316+0000 mon.a (mon.0) 73 : cluster [INF] Active manager daemon y restarted 2021-03-10T13:41:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:35 gibba003 bash[9769]: cluster 2021-03-10T13:41:34.844869+0000 mon.a (mon.0) 74 : cluster [INF] Activating manager daemon y 2021-03-10T13:41:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:35 gibba003 bash[9769]: cluster 2021-03-10T13:41:34.846593+0000 mon.a (mon.0) 75 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-03-10T13:41:36.193 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:41:35 gibba003 bash[10000]: Warning: Permanently added 'gibba003,172.21.2.103' (ECDSA) to the list of known hosts. 2021-03-10T13:41:36.838 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:41:36.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2021-03-10T13:41:36.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T13:41:36.839 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:41:37.145 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: cluster 2021-03-10T13:41:35.818210+0000 mon.a (mon.0) 76 : cluster [DBG] mgrmap e10: y(active, starting, since 0.973429s) 2021-03-10T13:41:37.145 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.823442+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:41:37.146 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.825996+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:41:37.146 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.826470+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:41:37.146 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.826916+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:41:37.146 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.828432+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:41:37.147 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.830801+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:41:37.147 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.832027+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:41:37.147 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.833364+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:41:37.147 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.834651+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:41:37.147 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.836036+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:41:37.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.837534+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:41:37.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: cluster 2021-03-10T13:41:35.842987+0000 mon.a (mon.0) 88 : cluster [INF] Manager daemon y is now available 2021-03-10T13:41:37.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:35.861711+0000 mon.a (mon.0) 89 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:41:37.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:36.021290+0000 mon.a (mon.0) 90 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:41:37.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:36.021498+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:37.149 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:36.303572+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303010\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303123\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:41:36.303190\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:41:37.149 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:36.305506+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303010\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303123\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:41:36.303190\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:41:37.149 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:36 gibba003 bash[9769]: audit 2021-03-10T13:41:36.306069+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:37.583 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2021-03-10T13:41:37.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2021-03-10T13:41:37.584 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2021-03-10T13:41:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:37 gibba003 bash[9769]: cluster 2021-03-10T13:41:36.826140+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e11: y(active, since 1.98136s) 2021-03-10T13:41:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:38 gibba003 bash[9769]: cluster 2021-03-10T13:41:37.828919+0000 mon.a (mon.0) 96 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-03-10T13:41:39.211 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2021-03-10T13:41:39.804 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Creating initial admin user... 2021-03-10T13:41:39.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'g71s183dxj', 'administrator', '--force-password', '--pwd-update-required'] 2021-03-10T13:41:39.805 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin g71s183dxj administrator --force-password --pwd-update-required 2021-03-10T13:41:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:39 gibba003 bash[9769]: audit 2021-03-10T13:41:39.205496+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDQQho6o8lFrJVXQiUU4+ZLMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAxMzQx\nMzlaFw0zMTAzMDgxMzQxMzlaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAK8iRV+t\n6RWHQFbz59la5riukPMOKAInMBKA7t0e5kOK+zo8oPMQkoIw9iTMHM/a746mLM3k\nie1Wslq+zFyo/lEPFdM7yKAu4fJ+u45abIAwBg5ZevyHyIjK01+d3CL0WXQ9TZoO\nven3ZihuJOxX1UPYrSwqq6PYvEFUWjXZPo0HfaggL4gwuK8RjgzIWS4fdFA25uS4\nJisb/ZVT28QOiJG2L0pb7tYDF/+8uWTxU5gcjl7o2Se8xtq8eK1TfLtiUe0HVKFW\nZZNYh6W1oNJiTMUj+Nj4Zh+jF1GSm8QE86u316R8TQh0Mv619xsPnnBz/0H7F7ev\npkMbMHP6zj75HFkCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAM/IY778M7sfe8TAo\n6RW7C5xCOoeSIR4SQyGQXT5X71oisq0TvheAYtwg/PyrAW8ncZ/sd4GTfqJAmsfP\nY9ACM1bwI3vr5doyOM8EOAnmcg2SuE0qmKBxubNLcj2Hl8VqlFcbDR8lIxDlQSXi\nx/6wMfELJ1wnbxaC2eTwSFhKMS5Rh8dSF/cXHR/ghsNLQ3P0Qftx2UzqsuXOIZIT\n+7Z6H9ESo/aPTDTs/caNX5YWrBzeMxxDSSWCXNeTfioEo7HMKv56h84nH2uHsDVu\nART4Vdye8kPKuQXSKBOApVydYpU7QiISHd8wgqB3w12nEZLtbTTJ4iEpWMPLxUcO\ni/NPLQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:41:40.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:39 gibba003 bash[9769]: audit 2021-03-10T13:41:39.207229+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDQQho6o8lFrJVXQiUU4+ZLMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAxMzQx\nMzlaFw0zMTAzMDgxMzQxMzlaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAK8iRV+t\n6RWHQFbz59la5riukPMOKAInMBKA7t0e5kOK+zo8oPMQkoIw9iTMHM/a746mLM3k\nie1Wslq+zFyo/lEPFdM7yKAu4fJ+u45abIAwBg5ZevyHyIjK01+d3CL0WXQ9TZoO\nven3ZihuJOxX1UPYrSwqq6PYvEFUWjXZPo0HfaggL4gwuK8RjgzIWS4fdFA25uS4\nJisb/ZVT28QOiJG2L0pb7tYDF/+8uWTxU5gcjl7o2Se8xtq8eK1TfLtiUe0HVKFW\nZZNYh6W1oNJiTMUj+Nj4Zh+jF1GSm8QE86u316R8TQh0Mv619xsPnnBz/0H7F7ev\npkMbMHP6zj75HFkCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAM/IY778M7sfe8TAo\n6RW7C5xCOoeSIR4SQyGQXT5X71oisq0TvheAYtwg/PyrAW8ncZ/sd4GTfqJAmsfP\nY9ACM1bwI3vr5doyOM8EOAnmcg2SuE0qmKBxubNLcj2Hl8VqlFcbDR8lIxDlQSXi\nx/6wMfELJ1wnbxaC2eTwSFhKMS5Rh8dSF/cXHR/ghsNLQ3P0Qftx2UzqsuXOIZIT\n+7Z6H9ESo/aPTDTs/caNX5YWrBzeMxxDSSWCXNeTfioEo7HMKv56h84nH2uHsDVu\nART4Vdye8kPKuQXSKBOApVydYpU7QiISHd8wgqB3w12nEZLtbTTJ4iEpWMPLxUcO\ni/NPLQ==\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:41:40.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:39 gibba003 bash[9769]: audit 2021-03-10T13:41:39.207721+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCvIkVfrekVh0BW\n8+fZWua4rpDzDigCJzASgO7dHuZDivs6PKDzEJKCMPYkzBzP2u+OpizN5IntVrJa\nvsxcqP5RDxXTO8igLuHyfruOWmyAMAYOWXr8h8iIytNfndwi9Fl0PU2aDr3p92Yo\nbiTsV9VD2K0sKquj2LxBVFo12T6NB32oIC+IMLivEY4MyFkuH3RQNubkuCYrG/2V\nU9vEDoiRti9KW+7WAxf/vLlk8VOYHI5e6NknvMbavHitU3y7YlHtB1ShVmWTWIel\ntaDSYkzFI/jY+GYfoxdRkpvEBPOrt9ekfE0IdDL+tfcbD55wc/9B+xe3r6ZDGzBz\n+s4++RxZAgMBAAECggEAa96h+DK38+igem40ia3xmiL7aJl5jwnwFBWSCmQz07pQ\nzyf0woGcm8/oa/XEcUoabzRvOEnhomvZ4wbN/Oyh5+9ws/CIvBDkXmYsw5tyZOov\ncLswg0Zm/8pdsvEaW/VA+9WebJtT4j3dkF13JJNc6jMVRrTpjzu5iEuaXLx4SIgl\nvqSvAosYw+KWOl6yCClVe8GHBzTZJTH6zbnmZSEdKPQJw4afCgai5oKnwLwo3Bqy\nvUPIumweCa9zNx3Eo4PRLboxFtWt/JEYyeZn1pDBUxEJ6yQLsoEKBhzXhVhKRt23\nNVm32FwWP2sLyEiWfVXn+mv56vfglz7NfJyXGB4e+QKBgQDXeYDWgctFJx7tii98\nnINie1JLPT9Z/VtgIBqFhi/nLaMYWQdPfjqX5EJhM7EBqzNwzdHFXTI1ikhvzVA9\nkaLrrlW2XgVATo9d8avIpzQ6Kx5Nlgp2zWBqLLbLHXY5dLKridEvLwxqUiKCtwFs\nSYQJbSdvAMULxmzL2X4Qm5UW0wKBgQDQEnlcjleUVpLC06rBjyppPg/Udf4ag7RP\nyIcTdEYxZ2pgPvduD8qMob2BGhqGQfjQF+4IONxgSsYrj+HJvVxIXUqektPmLV1H\nAnFpE5jFS02k5JlkHJCNagTJV+5UI9EXb23os/m78U1UiHS9nM6EXxUBKpUkUPno\nlWaIdnGcowKBgQDV8UcyNPdN9zTnJ9BUitaM/uNL30k6oauLevS6ZOzFPfP1Jdhz\nXmLxE2uxNXDntkPCGinRK+LBdEbN825bY3H/Tj6+bwYJvrbs0Rr+hL3/j3ZsFLDZ\nGrxDT5hDfkI3dB4+4fz4O1+5ZUnsvaZFDY1zCpUfywTa1y6JDK718HSMjwKBgQCD\njEqCQ9QHCrz6xAvfF/5+Tyh+8KJYbRAgqO0NVaPTNEjC1MxmH0G1q8Q9zR0b6LXA\nCoEJXbmmf1/Oxsa/XyLq9WBp5PZnPiMM8/RztFoP0k4ihAyeiJizb2XbTeZ197cI\nFADu8GphcmurmCIGhw7iDaMf+6YTMcbuTxZmDExD9QKBgQCsJ4CTjMAJLI+XAJrV\nUPgS/QP/M1L7a55ENvRmnviDEw4z8UZS4Xe92lknN0hz81wuoS6UIKU6yTZyIue+\nbo4FPTV4RjZcHcq66QzcKa5Er8q1r+VtMazwM+vwLBlDYxlNblCjaLS4nQ1kKkrL\n47g+Rj8gazuNkJtqViE9Kkaf/Q==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:41:40.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:39 gibba003 bash[9769]: audit 2021-03-10T13:41:39.208984+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCvIkVfrekVh0BW\n8+fZWua4rpDzDigCJzASgO7dHuZDivs6PKDzEJKCMPYkzBzP2u+OpizN5IntVrJa\nvsxcqP5RDxXTO8igLuHyfruOWmyAMAYOWXr8h8iIytNfndwi9Fl0PU2aDr3p92Yo\nbiTsV9VD2K0sKquj2LxBVFo12T6NB32oIC+IMLivEY4MyFkuH3RQNubkuCYrG/2V\nU9vEDoiRti9KW+7WAxf/vLlk8VOYHI5e6NknvMbavHitU3y7YlHtB1ShVmWTWIel\ntaDSYkzFI/jY+GYfoxdRkpvEBPOrt9ekfE0IdDL+tfcbD55wc/9B+xe3r6ZDGzBz\n+s4++RxZAgMBAAECggEAa96h+DK38+igem40ia3xmiL7aJl5jwnwFBWSCmQz07pQ\nzyf0woGcm8/oa/XEcUoabzRvOEnhomvZ4wbN/Oyh5+9ws/CIvBDkXmYsw5tyZOov\ncLswg0Zm/8pdsvEaW/VA+9WebJtT4j3dkF13JJNc6jMVRrTpjzu5iEuaXLx4SIgl\nvqSvAosYw+KWOl6yCClVe8GHBzTZJTH6zbnmZSEdKPQJw4afCgai5oKnwLwo3Bqy\nvUPIumweCa9zNx3Eo4PRLboxFtWt/JEYyeZn1pDBUxEJ6yQLsoEKBhzXhVhKRt23\nNVm32FwWP2sLyEiWfVXn+mv56vfglz7NfJyXGB4e+QKBgQDXeYDWgctFJx7tii98\nnINie1JLPT9Z/VtgIBqFhi/nLaMYWQdPfjqX5EJhM7EBqzNwzdHFXTI1ikhvzVA9\nkaLrrlW2XgVATo9d8avIpzQ6Kx5Nlgp2zWBqLLbLHXY5dLKridEvLwxqUiKCtwFs\nSYQJbSdvAMULxmzL2X4Qm5UW0wKBgQDQEnlcjleUVpLC06rBjyppPg/Udf4ag7RP\nyIcTdEYxZ2pgPvduD8qMob2BGhqGQfjQF+4IONxgSsYrj+HJvVxIXUqektPmLV1H\nAnFpE5jFS02k5JlkHJCNagTJV+5UI9EXb23os/m78U1UiHS9nM6EXxUBKpUkUPno\nlWaIdnGcowKBgQDV8UcyNPdN9zTnJ9BUitaM/uNL30k6oauLevS6ZOzFPfP1Jdhz\nXmLxE2uxNXDntkPCGinRK+LBdEbN825bY3H/Tj6+bwYJvrbs0Rr+hL3/j3ZsFLDZ\nGrxDT5hDfkI3dB4+4fz4O1+5ZUnsvaZFDY1zCpUfywTa1y6JDK718HSMjwKBgQCD\njEqCQ9QHCrz6xAvfF/5+Tyh+8KJYbRAgqO0NVaPTNEjC1MxmH0G1q8Q9zR0b6LXA\nCoEJXbmmf1/Oxsa/XyLq9WBp5PZnPiMM8/RztFoP0k4ihAyeiJizb2XbTeZ197cI\nFADu8GphcmurmCIGhw7iDaMf+6YTMcbuTxZmDExD9QKBgQCsJ4CTjMAJLI+XAJrV\nUPgS/QP/M1L7a55ENvRmnviDEw4z8UZS4Xe92lknN0hz81wuoS6UIKU6yTZyIue+\nbo4FPTV4RjZcHcq66QzcKa5Er8q1r+VtMazwM+vwLBlDYxlNblCjaLS4nQ1kKkrL\n47g+Rj8gazuNkJtqViE9Kkaf/Q==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:41:40.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:40 gibba003 bash[9769]: audit 2021-03-10T13:41:39.170767+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:40.956 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$8KaGuH6L3.V78eKzyd.aq.GB9wO6eZVO4.nz3BMYFr7ZKAQsqXmA.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1615383700, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-03-10T13:41:41.473 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Fetching dashboard port number... 2021-03-10T13:41:41.473 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba003', '-v', '/var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2021-03-10T13:41:41.474 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba003 -v /var/log/ceph/33572ad6-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjeqk2hei:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpkrmqtv04:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2021-03-10T13:41:42.113 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:41 gibba003 bash[9769]: audit 2021-03-10T13:41:40.777068+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "g71s183dxj", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:42.114 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:41 gibba003 bash[9769]: audit 2021-03-10T13:41:40.948300+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$8KaGuH6L3.V78eKzyd.aq.GB9wO6eZVO4.nz3BMYFr7ZKAQsqXmA.\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615383700, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2021-03-10T13:41:42.114 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:41 gibba003 bash[9769]: audit 2021-03-10T13:41:40.949983+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$8KaGuH6L3.V78eKzyd.aq.GB9wO6eZVO4.nz3BMYFr7ZKAQsqXmA.\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615383700, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2021-03-10T13:41:42.114 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:41 gibba003 bash[9769]: audit 2021-03-10T13:41:40.998505+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:42.115 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:41 gibba003 bash[9769]: audit 2021-03-10T13:41:41.099467+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303010\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303123\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:41:36.303190\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:41:42.115 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:41 gibba003 bash[9769]: audit 2021-03-10T13:41:41.101145+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303010\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303123\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:41:36.303190\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:41:42.400 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2021-03-10T13:41:42.918 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2021-03-10T13:41:42.918 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.918 INFO:teuthology.orchestra.run.gibba003.stderr: URL: https://gibba003:8443/ 2021-03-10T13:41:42.919 INFO:teuthology.orchestra.run.gibba003.stderr: User: admin 2021-03-10T13:41:42.919 INFO:teuthology.orchestra.run.gibba003.stderr: Password: g71s183dxj 2021-03-10T13:41:42.919 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.919 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:You can access the Ceph CLI with: 2021-03-10T13:41:42.919 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.920 INFO:teuthology.orchestra.run.gibba003.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:41:42.920 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.920 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2021-03-10T13:41:42.920 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.921 INFO:teuthology.orchestra.run.gibba003.stderr: ceph telemetry on 2021-03-10T13:41:42.921 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.921 INFO:teuthology.orchestra.run.gibba003.stderr:For more information see: 2021-03-10T13:41:42.921 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.921 INFO:teuthology.orchestra.run.gibba003.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-03-10T13:41:42.922 INFO:teuthology.orchestra.run.gibba003.stderr: 2021-03-10T13:41:42.922 INFO:teuthology.orchestra.run.gibba003.stderr:INFO:cephadm:Bootstrap complete. 2021-03-10T13:41:42.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Releasing lock 140421141918048 on /run/cephadm/33572ad6-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:41:42.922 INFO:teuthology.orchestra.run.gibba003.stderr:DEBUG:cephadm:Lock 140421141918048 released on /run/cephadm/33572ad6-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:41:42.926 INFO:tasks.cephadm:Fetching config... 2021-03-10T13:41:42.927 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:41:42.927 DEBUG:teuthology.orchestra.run.gibba003:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-03-10T13:41:42.976 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-03-10T13:41:42.976 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:41:42.977 DEBUG:teuthology.orchestra.run.gibba003:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-03-10T13:41:42.981 INFO:tasks.cephadm:Fetching mon keyring... 2021-03-10T13:41:42.981 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:41:42.982 DEBUG:teuthology.orchestra.run.gibba003:> sudo dd if=/var/lib/ceph/33572ad6-81a6-11eb-9080-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-03-10T13:41:43.032 INFO:tasks.cephadm:Fetching pub ssh key... 2021-03-10T13:41:43.032 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:41:43.032 DEBUG:teuthology.orchestra.run.gibba003:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-03-10T13:41:43.038 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-03-10T13:41:43.038 DEBUG:teuthology.orchestra.run.gibba003:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T13:41:43.056 INFO:teuthology.orchestra.run.gibba003.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:43.059 DEBUG:teuthology.orchestra.run.gibba043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T13:41:43.076 INFO:teuthology.orchestra.run.gibba043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkBHDpYk7AFcEUYb5kDM6FxiZa1OCjwB34q9SpOHN0ChD4kAhWti0XNk9VcjJfn6tEIQZDd7KX1H7brvt8jraoY6XIpT2CIoWtwnw0Qt6wMt1PD/+4JDIa5lTUeEwH1uj5FgMRo7rw7KgHtU90mNmMxZsfKoL/wJU9+BUal3U/UgqZ1zirtaw4s3Y2eaxE6RYbzJxQPxTVe8UrxRPt0FNLCgCoi7iI9BRRkFP4x/ty+ZzBQmKWjph1wlzjshZnjAESp56gat2ayXroIuChrdCiVCdZrVFAEzVgNcoBXqJ5urdf80WhKfG56jM6eP9ZnP/4JbL5FF3u0mqbxUZhtDm8BSRxT3XvezY7/9hAK0xgfIwAEVlTHDIzu4c0mDILrQ8Pt4nCZ61tLTsHuiGd5afGBnjlQee3UyZ8MeG6LHKFjvA4suLzSClraxQ4xnRVGvnpO3sgZ2DWhBCl0M6axYiFj5jss1SqERIqAPXeHd/FcZgDQOTnys4r5WyVg7b+/jc= ceph-33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:41:43.079 INFO:tasks.cephadm:Writing (initial) conf and keyring to gibba043 2021-03-10T13:41:43.080 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:41:43.080 DEBUG:teuthology.orchestra.run.gibba043:> dd of=/etc/ceph/ceph.conf 2021-03-10T13:41:43.084 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:41:43.084 DEBUG:teuthology.orchestra.run.gibba043:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:41:43.131 INFO:tasks.cephadm:Adding host gibba043 to orchestrator... 2021-03-10T13:41:43.132 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch host add gibba043 2021-03-10T13:41:43.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:42 gibba003 bash[9769]: audit 2021-03-10T13:41:42.398520+0000 mon.a (mon.0) 106 : audit [DBG] from='client.? 172.21.2.103:0/3973714103' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-03-10T13:41:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:44 gibba003 bash[9769]: cluster 2021-03-10T13:41:43.846703+0000 mon.a (mon.0) 107 : cluster [DBG] mgrmap e13: y(active, since 9s) 2021-03-10T13:41:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:56 gibba003 bash[9769]: cluster 2021-03-10T13:41:55.829324+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:41:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:41:58 gibba003 bash[9769]: cluster 2021-03-10T13:41:57.830236+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:00 gibba003 bash[9769]: cluster 2021-03-10T13:41:59.831172+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:02 gibba003 bash[9769]: cluster 2021-03-10T13:42:01.831760+0000 mgr.y (mgr.14140) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:03.193 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:42:02 gibba003 bash[10000]: Warning: Permanently added 'gibba043,172.21.2.143' (ECDSA) to the list of known hosts. 2021-03-10T13:42:03.973 INFO:teuthology.orchestra.run.gibba043.stdout:Added host 'gibba043' 2021-03-10T13:42:04.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:02.965662+0000 mgr.y (mgr.14140) 7 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba043", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:04.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.344129+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba003\": {\"hostname\": \"gibba003\", \"addr\": \"gibba003\", \"labels\": [], \"status\": \"\"}, \"gibba043\": {\"hostname\": \"gibba043\", \"addr\": \"gibba043\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T13:42:04.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.350018+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba003\": {\"hostname\": \"gibba003\", \"addr\": \"gibba003\", \"labels\": [], \"status\": \"\"}, \"gibba043\": {\"hostname\": \"gibba043\", \"addr\": \"gibba043\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T13:42:04.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.498179+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:04.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.504049+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:04.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.506046+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:04.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.661066+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:42:03.660085\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:04.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.666807+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:42:03.660085\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:04.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:03 gibba003 bash[9769]: audit 2021-03-10T13:42:03.668636+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:04.725 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch host ls --format=json 2021-03-10T13:42:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:04 gibba003 bash[9769]: cephadm 2021-03-10T13:42:03.351180+0000 mgr.y (mgr.14140) 8 : cephadm [INF] Added host gibba043 2021-03-10T13:42:05.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:04 gibba003 bash[9769]: cluster 2021-03-10T13:42:03.832404+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:06 gibba003 bash[9769]: cluster 2021-03-10T13:42:05.833316+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:08.427 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-03-10T13:42:08.428 INFO:teuthology.orchestra.run.gibba043.stdout:[{"addr": "gibba003", "hostname": "gibba003", "labels": [], "status": ""}, {"addr": "gibba043", "hostname": "gibba043", "labels": [], "status": ""}] 2021-03-10T13:42:09.064 INFO:tasks.cephadm:Setting crush tunables to default 2021-03-10T13:42:09.065 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd crush tunables default 2021-03-10T13:42:09.151 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:08 gibba003 bash[9769]: cluster 2021-03-10T13:42:07.834207+0000 mgr.y (mgr.14140) 11 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:10.062 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:09 gibba003 bash[9769]: audit 2021-03-10T13:42:08.423498+0000 mgr.y (mgr.14140) 12 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:42:10.062 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:09 gibba003 bash[9769]: audit 2021-03-10T13:42:09.336377+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:10.062 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:09 gibba003 bash[9769]: audit 2021-03-10T13:42:09.489875+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:42:03.660085\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:10.062 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:09 gibba003 bash[9769]: audit 2021-03-10T13:42:09.495788+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:42:03.660085\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:11.124 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:10 gibba003 bash[9769]: cluster 2021-03-10T13:42:09.834630+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:11.875 INFO:teuthology.orchestra.run.gibba003.stderr:adjusted tunables profile to default 2021-03-10T13:42:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:11 gibba003 bash[9769]: audit 2021-03-10T13:42:11.311041+0000 mon.a (mon.0) 119 : audit [INF] from='client.? 172.21.2.103:0/1060620367' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-03-10T13:42:12.348 INFO:tasks.cephadm:Adding mon.c on gibba003 2021-03-10T13:42:12.349 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add mon 'gibba003:[v2:172.21.2.103:3301,v1:172.21.2.103:6790]=c' 2021-03-10T13:42:13.153 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:12 gibba003 bash[9769]: cluster 2021-03-10T13:42:11.835141+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:13.154 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:12 gibba003 bash[9769]: audit 2021-03-10T13:42:11.871145+0000 mon.a (mon.0) 120 : audit [INF] from='client.? 172.21.2.103:0/1060620367' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-03-10T13:42:13.154 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:12 gibba003 bash[9769]: cluster 2021-03-10T13:42:11.871168+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:42:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:14 gibba003 bash[9769]: cluster 2021-03-10T13:42:13.835705+0000 mgr.y (mgr.14140) 15 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:14 gibba003 bash[9769]: audit 2021-03-10T13:42:14.577221+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:42:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:14 gibba003 bash[9769]: audit 2021-03-10T13:42:14.578219+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:14 gibba003 bash[9769]: audit 2021-03-10T13:42:14.579262+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-03-10T13:42:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:15 gibba003 bash[9769]: audit 2021-03-10T13:42:14.575983+0000 mgr.y (mgr.14140) 16 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba003:[v2:172.21.2.103:3301,v1:172.21.2.103:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:15 gibba003 bash[9769]: cephadm 2021-03-10T13:42:14.578988+0000 mgr.y (mgr.14140) 17 : cephadm [INF] Deploying daemon mon.c on gibba003 2021-03-10T13:42:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:16 gibba003 bash[9769]: cluster 2021-03-10T13:42:15.836086+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:17 gibba003 bash[9769]: audit 2021-03-10T13:42:17.629257+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303010\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303123\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:17 gibba003 bash[9769]: audit 2021-03-10T13:42:17.629717+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:17 gibba003 bash[9769]: audit 2021-03-10T13:42:17.630825+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303010\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:36.303123\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:18.586 INFO:teuthology.orchestra.run.gibba003.stdout:Deployed mon.c on host 'gibba003' 2021-03-10T13:42:19.227 DEBUG:teuthology.orchestra.run.gibba003:mon.c> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.c.service 2021-03-10T13:42:19.230 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-03-10T13:42:19.231 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T13:42:19.256 INFO:journalctl@ceph.mon.c.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:18.505787+0000 mon.a (mon.0) 130 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:23.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:19.836836+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:23.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:20.508768+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:42:23.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:21.837489+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:23.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.512144+0000 mon.a (mon.0) 131 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:42:23.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.520489+0000 mon.a (mon.0) 132 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:42:23.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.520621+0000 mon.a (mon.0) 133 : cluster [DBG] fsmap 2021-03-10T13:42:23.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.520687+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:42:23.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.521155+0000 mon.a (mon.0) 135 : cluster [DBG] mgrmap e13: y(active, since 48s) 2021-03-10T13:42:23.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.523460+0000 mon.a (mon.0) 136 : cluster [INF] overall HEALTH_OK 2021-03-10T13:42:23.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:18.505787+0000 mon.a (mon.0) 130 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:23.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:19.836836+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:23.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:20.508768+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:42:23.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:21.837489+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:23.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.512144+0000 mon.a (mon.0) 131 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:42:23.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.520489+0000 mon.a (mon.0) 132 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:42:23.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.520621+0000 mon.a (mon.0) 133 : cluster [DBG] fsmap 2021-03-10T13:42:23.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.520687+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:42:23.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.521155+0000 mon.a (mon.0) 135 : cluster [DBG] mgrmap e13: y(active, since 48s) 2021-03-10T13:42:23.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:23 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.523460+0000 mon.a (mon.0) 136 : cluster [INF] overall HEALTH_OK 2021-03-10T13:42:23.973 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:42:23.973 INFO:teuthology.orchestra.run.gibba003.stdout:{"epoch":2,"fsid":"33572ad6-81a6-11eb-9080-001a4aab830c","modified":"2021-03-10T13:42:18.504160Z","created":"2021-03-10T13:41:00.210403Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:3300","nonce":0},{"type":"v1","addr":"172.21.2.103:6789","nonce":0}]},"addr":"172.21.2.103:6789/0","public_addr":"172.21.2.103:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:3301","nonce":0},{"type":"v1","addr":"172.21.2.103:6790","nonce":0}]},"addr":"172.21.2.103:6790/0","public_addr":"172.21.2.103:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2021-03-10T13:42:23.975 INFO:teuthology.orchestra.run.gibba003.stderr:dumped monmap epoch 2 2021-03-10T13:42:24.505 INFO:tasks.cephadm:Adding mon.b on gibba043 2021-03-10T13:42:24.505 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add mon gibba043:172.21.2.143=b 2021-03-10T13:42:25.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:24 gibba003 bash[9769]: cluster 2021-03-10T13:42:23.837795+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:25.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:24 gibba003 bash[9769]: audit 2021-03-10T13:42:23.970737+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.2.103:0/3725760116' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:42:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:24 gibba003 bash[12956]: cluster 2021-03-10T13:42:23.837795+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:24 gibba003 bash[12956]: audit 2021-03-10T13:42:23.970737+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.2.103:0/3725760116' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:42:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:26 gibba003 bash[9769]: cluster 2021-03-10T13:42:25.838440+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:27.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:26 gibba003 bash[12956]: cluster 2021-03-10T13:42:25.838440+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:27 gibba003 bash[9769]: audit 2021-03-10T13:42:27.191123+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:42:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:27 gibba003 bash[9769]: audit 2021-03-10T13:42:27.194089+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:27 gibba003 bash[9769]: audit 2021-03-10T13:42:27.197538+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T13:42:28.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:27 gibba003 bash[12956]: audit 2021-03-10T13:42:27.191123+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:42:28.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:27 gibba003 bash[12956]: audit 2021-03-10T13:42:27.194089+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:28.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:27 gibba003 bash[12956]: audit 2021-03-10T13:42:27.197538+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T13:42:29.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:28 gibba003 bash[9769]: audit 2021-03-10T13:42:27.187560+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba043:172.21.2.143=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:29.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:28 gibba003 bash[9769]: cephadm 2021-03-10T13:42:27.196569+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on gibba043 2021-03-10T13:42:29.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:28 gibba003 bash[9769]: cluster 2021-03-10T13:42:27.839208+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:29.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:28 gibba003 bash[12956]: audit 2021-03-10T13:42:27.187560+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba043:172.21.2.143=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:29.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:28 gibba003 bash[12956]: cephadm 2021-03-10T13:42:27.196569+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on gibba043 2021-03-10T13:42:29.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:28 gibba003 bash[12956]: cluster 2021-03-10T13:42:27.839208+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:31.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[9769]: cluster 2021-03-10T13:42:29.839886+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:31.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[9769]: audit 2021-03-10T13:42:30.862840+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:31.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[9769]: audit 2021-03-10T13:42:30.864257+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:31.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[9769]: audit 2021-03-10T13:42:30.870943+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:31.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[12956]: cluster 2021-03-10T13:42:29.839886+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:31.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[12956]: audit 2021-03-10T13:42:30.862840+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:31.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[12956]: audit 2021-03-10T13:42:30.864257+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:31.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:30 gibba003 bash[12956]: audit 2021-03-10T13:42:30.870943+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:31.201 INFO:teuthology.orchestra.run.gibba043.stdout:Deployed mon.b on host 'gibba043' 2021-03-10T13:42:32.028 DEBUG:teuthology.orchestra.run.gibba043:mon.b> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.b.service 2021-03-10T13:42:32.030 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-03-10T13:42:32.030 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T13:42:32.106 INFO:journalctl@ceph.mon.b.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:32.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:31 gibba003 bash[9769]: audit 2021-03-10T13:42:31.015980+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_daemon_update\": \"2021-03-10T13:42:31.014284\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:32.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:31 gibba003 bash[9769]: audit 2021-03-10T13:42:31.023565+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_daemon_update\": \"2021-03-10T13:42:31.014284\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:32.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:31 gibba003 bash[12956]: audit 2021-03-10T13:42:31.015980+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_daemon_update\": \"2021-03-10T13:42:31.014284\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:32.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:31 gibba003 bash[12956]: audit 2021-03-10T13:42:31.023565+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_daemon_update\": \"2021-03-10T13:42:31.014284\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.191+0000 7efc75d856c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:42:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.191+0000 7efc75d856c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T13:42:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.191+0000 7efc75d856c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:42:32.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 load: jerasure load: lrc load: isa 2021-03-10T13:42:32.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:42:32.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:42:32.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:42:32.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:42:32.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:42:32.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:42:32.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 1 rocksdb: do_open column families: [default] 2021-03-10T13:42:32.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:42:32.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:42:32.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:42:32.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: DB SUMMARY 2021-03-10T13:42:32.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:42:32.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:42:32.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-03-10T13:42:32.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-03-10T13:42:32.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 610 ; 2021-03-10T13:42:32.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:42:32.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:42:32.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:42:32.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.env: 0x5616e2ecd1a0 2021-03-10T13:42:32.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.info_log: 0x5616e4f249a0 2021-03-10T13:42:32.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:42:32.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:42:32.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:42:32.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:42:32.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:42:32.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:42:32.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:42:32.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:42:32.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:42:32.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:42:32.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:42:32.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:42:32.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:42:32.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:42:32.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:42:32.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T13:42:32.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:42:32.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:42:32.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:42:32.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:42:32.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:42:32.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:42:32.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:42:32.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:42:32.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:42:32.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.write_buffer_manager: 0x5616e5abea80 2021-03-10T13:42:32.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:42:32.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:42:32.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:42:32.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:42:32.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:42:32.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:42:32.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:42:32.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:42:32.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:42:32.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:42:32.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:42:32.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:42:32.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:42:32.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:42:32.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:42:32.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:42:32.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:42:32.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:42:32.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:42:32.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:42:32.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:42:32.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:42:32.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:42:32.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:42:32.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:42:32.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:42:32.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:42:32.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:42:32.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:42:32.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:42:32.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:42:32.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:42:32.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:42:32.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:42:32.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:42:32.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:42:32.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:42:32.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:42:32.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:42:32.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:42:32.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:42:32.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:42:32.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:42:32.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:42:32.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:42:32.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:42:32.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-03-10T13:42:32.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:42:32.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:42:32.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:42:32.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:42:32.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:42:32.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:42:32.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:42:32.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5616e4e44138) 2021-03-10T13:42:32.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: cache_index_and_filter_blocks: 1 2021-03-10T13:42:32.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:42:32.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:42:32.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: pin_top_level_index_and_filter: 1 2021-03-10T13:42:32.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: index_type: 0 2021-03-10T13:42:32.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: data_block_index_type: 0 2021-03-10T13:42:32.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:42:32.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: hash_index_allow_collision: 1 2021-03-10T13:42:32.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: checksum: 1 2021-03-10T13:42:32.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: no_block_cache: 0 2021-03-10T13:42:32.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_cache: 0x5616e4e7a610 2021-03-10T13:42:32.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_cache_name: BinnedLRUCache 2021-03-10T13:42:32.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_cache_options: 2021-03-10T13:42:32.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: capacity : 536870912 2021-03-10T13:42:32.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: num_shard_bits : 4 2021-03-10T13:42:32.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: strict_capacity_limit : 0 2021-03-10T13:42:32.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: high_pri_pool_ratio: 0.000 2021-03-10T13:42:32.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_cache_compressed: (nil) 2021-03-10T13:42:32.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: persistent_cache: (nil) 2021-03-10T13:42:32.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_size: 4096 2021-03-10T13:42:32.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_size_deviation: 10 2021-03-10T13:42:32.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_restart_interval: 16 2021-03-10T13:42:32.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: index_block_restart_interval: 1 2021-03-10T13:42:32.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: metadata_block_size: 4096 2021-03-10T13:42:32.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: partition_filters: 0 2021-03-10T13:42:32.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: use_delta_encoding: 1 2021-03-10T13:42:32.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:42:32.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: whole_key_filtering: 1 2021-03-10T13:42:32.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: verify_compression: 0 2021-03-10T13:42:32.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: read_amp_bytes_per_bit: 0 2021-03-10T13:42:32.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: format_version: 2 2021-03-10T13:42:32.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: enable_index_compression: 1 2021-03-10T13:42:32.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: block_align: 0 2021-03-10T13:42:32.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:42:32.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:42:32.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:42:32.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:42:32.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:42:32.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:42:32.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:42:32.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:42:32.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:42:32.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:42:32.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:42:32.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:42:32.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:42:32.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:42:32.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:42:32.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:42:32.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:42:32.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:42:32.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:42:32.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:42:32.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:42:32.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:42:32.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:42:32.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:42:32.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:42:32.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:42:32.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:42:32.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:42:32.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:42:32.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:42:32.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:42:32.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:42:32.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:42:32.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:42:32.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:42:32.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:42:32.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:42:32.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:42:32.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:42:32.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:42:32.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:42:32.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:42:32.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:42:32.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:42:32.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:42:32.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:42:32.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:42:32.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:42:32.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:42:32.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:42:32.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:42:32.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:42:32.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:42:32.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:42:32.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:42:32.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:42:32.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:42:32.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:42:32.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:42:32.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:42:32.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:42:32.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:42:32.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:42:32.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:42:32.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:42:32.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:42:32.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:42:32.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T13:42:32.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383752196942, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-03-10T13:42:32.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2021-03-10T13:42:32.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383752197400, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1524, "table_properties": {"data_size": 622, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T13:42:32.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2021-03-10T13:42:32.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383752197821, "job": 1, "event": "recovery_finished"} 2021-03-10T13:42:32.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 4 rocksdb: DB pointer 0x5616e4f15200 2021-03-10T13:42:32.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc5ced2700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:42:32.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc5ced2700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:42:32.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** DB Stats ** 2021-03-10T13:42:32.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:42:32.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:42:32.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:42:32.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:42:32.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:42:32.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:42:32.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:42:32.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** Compaction Stats [default] ** 2021-03-10T13:42:32.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:32.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:32.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** Compaction Stats [default] ** 2021-03-10T13:42:32.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:32.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:32.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:42:32.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:32.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:32.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:42:32.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:42:32.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:42:32.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:32.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:32.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:42:32.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:42:32.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** Compaction Stats [default] ** 2021-03-10T13:42:32.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:32.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:32.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:42:32.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** Compaction Stats [default] ** 2021-03-10T13:42:32.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:32.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:32.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.4 0.00 0.00 1 0.000 0 0 2021-03-10T13:42:32.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:42:32.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:32.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:32.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:42:32.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:42:32.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:42:32.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:32.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:32.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:42:32.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:42:32.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-03-10T13:42:32.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 using public_addr v2:172.21.2.143:0/0 -> [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] 2021-03-10T13:42:32.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.195+0000 7efc75d856c0 0 starting mon.b rank -1 at public addrs [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] at bind addrs [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:32.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.199+0000 7efc75d856c0 1 mon.b@-1(???) e0 preinit fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:32.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 0 mon.b@-1(synchronizing).mds e1 new map 2021-03-10T13:42:32.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-03-10T13:42:32.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: e1 2021-03-10T13:42:32.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:42:32.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:42:32.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: legacy client fscid: -1 2021-03-10T13:42:32.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: 2021-03-10T13:42:32.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: No filesystems configured 2021-03-10T13:42:32.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-03-10T13:42:32.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-03-10T13:42:32.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-03-10T13:42:32.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-03-10T13:42:32.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-03-10T13:42:32.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-03-10T13:42:32.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-03-10T13:42:32.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-03-10T13:42:32.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:42:32.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:42:32.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:42:32.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:42:32.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: audit 2021-03-10T13:42:31.015980+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_daemon_update\": \"2021-03-10T13:42:31.014284\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:32.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: audit 2021-03-10T13:42:31.023565+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}}, \"last_daemon_update\": \"2021-03-10T13:42:31.014284\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:32.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.223+0000 7efc5f6d7700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-03-10T13:42:32.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-03-10T13:42:32.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:42:32.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:42:32.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:42:32.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:42:32.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:42:32.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:42:32.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:42:32.583 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:42:32.583 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:42:32.583 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:42:32.583 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:42:32.583 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:32 gibba043 bash[9839]: debug 2021-03-10T13:42:32.227+0000 7efc5f6d7700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:42:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:32.237775+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:32.238746+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:42:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:33.841474+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:34.235085+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:42:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:35.842571+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.242030+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.267469+0000 mon.a (mon.0) 148 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:42:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.277391+0000 mon.a (mon.0) 149 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:42:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.277540+0000 mon.a (mon.0) 150 : cluster [DBG] fsmap 2021-03-10T13:42:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.277571+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:42:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.277692+0000 mon.a (mon.0) 152 : cluster [DBG] mgrmap e13: y(active, since 62s) 2021-03-10T13:42:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.281194+0000 mon.a (mon.0) 153 : cluster [INF] overall HEALTH_OK 2021-03-10T13:42:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:32.237775+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:32.238746+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:42:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:33.841474+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:34.235085+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:42:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:35.842571+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.242030+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.267469+0000 mon.a (mon.0) 148 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:42:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.277391+0000 mon.a (mon.0) 149 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:42:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.277540+0000 mon.a (mon.0) 150 : cluster [DBG] fsmap 2021-03-10T13:42:37.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.277571+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:42:37.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.277692+0000 mon.a (mon.0) 152 : cluster [DBG] mgrmap e13: y(active, since 62s) 2021-03-10T13:42:37.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:37 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.281194+0000 mon.a (mon.0) 153 : cluster [INF] overall HEALTH_OK 2021-03-10T13:42:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:32.237775+0000 mon.a (mon.0) 146 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:32.238746+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:42:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:33.841474+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:34.235085+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:42:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:35.842571+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.242030+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2021-03-10T13:42:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.267469+0000 mon.a (mon.0) 148 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:42:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.277391+0000 mon.a (mon.0) 149 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:42:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.277540+0000 mon.a (mon.0) 150 : cluster [DBG] fsmap 2021-03-10T13:42:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.277571+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:42:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.277692+0000 mon.a (mon.0) 152 : cluster [DBG] mgrmap e13: y(active, since 62s) 2021-03-10T13:42:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:37 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.281194+0000 mon.a (mon.0) 153 : cluster [INF] overall HEALTH_OK 2021-03-10T13:42:38.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:38 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.329078+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:42:38.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:38 gibba003 bash[9769]: cluster 2021-03-10T13:42:37.843557+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:38 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.329078+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:42:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:38 gibba003 bash[12956]: cluster 2021-03-10T13:42:37.843557+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:38 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.329078+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:42:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:38 gibba043 bash[9839]: cluster 2021-03-10T13:42:37.843557+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:38.902 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-03-10T13:42:38.902 INFO:teuthology.orchestra.run.gibba043.stdout:{"epoch":3,"fsid":"33572ad6-81a6-11eb-9080-001a4aab830c","modified":"2021-03-10T13:42:32.229344Z","created":"2021-03-10T13:41:00.210403Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:3300","nonce":0},{"type":"v1","addr":"172.21.2.103:6789","nonce":0}]},"addr":"172.21.2.103:6789/0","public_addr":"172.21.2.103:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:3301","nonce":0},{"type":"v1","addr":"172.21.2.103:6790","nonce":0}]},"addr":"172.21.2.103:6790/0","public_addr":"172.21.2.103:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:3300","nonce":0},{"type":"v1","addr":"172.21.2.143:6789","nonce":0}]},"addr":"172.21.2.143:6789/0","public_addr":"172.21.2.143:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2021-03-10T13:42:38.904 INFO:teuthology.orchestra.run.gibba043.stderr:dumped monmap epoch 3 2021-03-10T13:42:39.553 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-03-10T13:42:39.553 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph config generate-minimal-conf 2021-03-10T13:42:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:39 gibba003 bash[9769]: audit 2021-03-10T13:42:38.898900+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.2.143:0/3038387488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:42:39.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:39 gibba003 bash[12956]: audit 2021-03-10T13:42:38.898900+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.2.143:0/3038387488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:42:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:39 gibba043 bash[9839]: audit 2021-03-10T13:42:38.898900+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.2.143:0/3038387488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:42:40.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:40 gibba003 bash[9769]: cluster 2021-03-10T13:42:39.844206+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:40.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:40 gibba003 bash[12956]: cluster 2021-03-10T13:42:39.844206+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:40 gibba043 bash[9839]: cluster 2021-03-10T13:42:39.844206+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:41.918 INFO:teuthology.orchestra.run.gibba003.stdout:# minimal ceph.conf for 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:41.918 INFO:teuthology.orchestra.run.gibba003.stdout:[global] 2021-03-10T13:42:41.919 INFO:teuthology.orchestra.run.gibba003.stdout: fsid = 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:41.919 INFO:teuthology.orchestra.run.gibba003.stdout: mon_host = [v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0] [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] [v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0] 2021-03-10T13:42:42.452 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-03-10T13:42:42.453 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:42:42.453 DEBUG:teuthology.orchestra.run.gibba003:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T13:42:42.459 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:42:42.460 DEBUG:teuthology.orchestra.run.gibba003:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:42:42.507 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:42:42.508 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T13:42:42.519 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:42:42.520 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:42:42.567 INFO:tasks.cephadm:Adding mgr.y on gibba003 2021-03-10T13:42:42.567 INFO:tasks.cephadm:Adding mgr.x on gibba043 2021-03-10T13:42:42.568 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch apply mgr '3;gibba003=y;gibba043=x' 2021-03-10T13:42:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:42 gibba043 bash[9839]: cluster 2021-03-10T13:42:41.844487+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:42 gibba043 bash[9839]: audit 2021-03-10T13:42:41.914927+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.2.103:0/2395853745' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:43.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:42 gibba003 bash[9769]: cluster 2021-03-10T13:42:41.844487+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:43.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:42 gibba003 bash[9769]: audit 2021-03-10T13:42:41.914927+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.2.103:0/2395853745' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:43.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:42 gibba003 bash[12956]: cluster 2021-03-10T13:42:41.844487+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:43.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:42 gibba003 bash[12956]: audit 2021-03-10T13:42:41.914927+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.2.103:0/2395853745' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:45.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:44 gibba003 bash[9769]: cluster 2021-03-10T13:42:43.845155+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:45.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:44 gibba003 bash[12956]: cluster 2021-03-10T13:42:43.845155+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:45.218 INFO:teuthology.orchestra.run.gibba043.stdout:Scheduled mgr update... 2021-03-10T13:42:45.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:44 gibba043 bash[9839]: cluster 2021-03-10T13:42:43.845155+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:46.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[12956]: audit 2021-03-10T13:42:45.206489+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:42:45.205504\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:42:46.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[12956]: audit 2021-03-10T13:42:45.214018+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:42:45.205504\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:42:46.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[12956]: audit 2021-03-10T13:42:45.215541+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:42:46.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[12956]: audit 2021-03-10T13:42:45.217885+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:42:46.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[12956]: audit 2021-03-10T13:42:45.218915+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:46.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[12956]: audit 2021-03-10T13:42:45.219958+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:42:46.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[9769]: audit 2021-03-10T13:42:45.206489+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:42:45.205504\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:42:46.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[9769]: audit 2021-03-10T13:42:45.214018+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:42:45.205504\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:42:46.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[9769]: audit 2021-03-10T13:42:45.215541+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:42:46.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[9769]: audit 2021-03-10T13:42:45.217885+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:42:46.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[9769]: audit 2021-03-10T13:42:45.218915+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:46.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:45 gibba003 bash[9769]: audit 2021-03-10T13:42:45.219958+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:42:46.247 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:45 gibba043 bash[9839]: audit 2021-03-10T13:42:45.206489+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:42:45.205504\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:42:46.247 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:45 gibba043 bash[9839]: audit 2021-03-10T13:42:45.214018+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:42:45.205504\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:42:46.248 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:45 gibba043 bash[9839]: audit 2021-03-10T13:42:45.215541+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:42:46.248 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:45 gibba043 bash[9839]: audit 2021-03-10T13:42:45.217885+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:42:46.248 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:45 gibba043 bash[9839]: audit 2021-03-10T13:42:45.218915+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:46.248 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:45 gibba043 bash[9839]: audit 2021-03-10T13:42:45.219958+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:42:46.249 DEBUG:teuthology.orchestra.run.gibba043:mgr.x> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.x.service 2021-03-10T13:42:46.251 INFO:tasks.cephadm:Deploying OSDs... 2021-03-10T13:42:46.252 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:42:46.252 DEBUG:teuthology.orchestra.run.gibba003:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T13:42:46.256 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T13:42:46.257 DEBUG:teuthology.orchestra.run.gibba003:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T13:42:46.261 INFO:teuthology.orchestra.run.gibba003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T13:42:46.261 INFO:teuthology.orchestra.run.gibba003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.261 INFO:teuthology.orchestra.run.gibba003.stdout:Device: 6h/6d Inode: 370 Links: 1 2021-03-10T13:42:46.262 INFO:teuthology.orchestra.run.gibba003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.262 INFO:teuthology.orchestra.run.gibba003.stdout:Access: 2021-03-10 13:40:01.206494454 +0000 2021-03-10T13:42:46.262 INFO:teuthology.orchestra.run.gibba003.stdout:Modify: 2021-03-10 13:40:01.018494450 +0000 2021-03-10T13:42:46.262 INFO:teuthology.orchestra.run.gibba003.stdout:Change: 2021-03-10 13:40:01.018494450 +0000 2021-03-10T13:42:46.263 INFO:teuthology.orchestra.run.gibba003.stdout: Birth: - 2021-03-10T13:42:46.265 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records in 2021-03-10T13:42:46.265 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records out 2021-03-10T13:42:46.265 INFO:teuthology.orchestra.run.gibba003.stderr:512 bytes copied, 0.000207702 s, 2.5 MB/s 2021-03-10T13:42:46.267 DEBUG:teuthology.orchestra.run.gibba003:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T13:42:46.307 INFO:journalctl@ceph.mgr.x.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:46.318 INFO:teuthology.orchestra.run.gibba003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T13:42:46.318 INFO:teuthology.orchestra.run.gibba003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.319 INFO:teuthology.orchestra.run.gibba003.stdout:Device: 6h/6d Inode: 377 Links: 1 2021-03-10T13:42:46.319 INFO:teuthology.orchestra.run.gibba003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.319 INFO:teuthology.orchestra.run.gibba003.stdout:Access: 2021-03-10 13:40:01.538494463 +0000 2021-03-10T13:42:46.319 INFO:teuthology.orchestra.run.gibba003.stdout:Modify: 2021-03-10 13:40:01.418494460 +0000 2021-03-10T13:42:46.319 INFO:teuthology.orchestra.run.gibba003.stdout:Change: 2021-03-10 13:40:01.418494460 +0000 2021-03-10T13:42:46.320 INFO:teuthology.orchestra.run.gibba003.stdout: Birth: - 2021-03-10T13:42:46.326 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records in 2021-03-10T13:42:46.326 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records out 2021-03-10T13:42:46.326 INFO:teuthology.orchestra.run.gibba003.stderr:512 bytes copied, 0.000210751 s, 2.4 MB/s 2021-03-10T13:42:46.328 DEBUG:teuthology.orchestra.run.gibba003:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T13:42:46.331 INFO:teuthology.orchestra.run.gibba003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T13:42:46.332 INFO:teuthology.orchestra.run.gibba003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.332 INFO:teuthology.orchestra.run.gibba003.stdout:Device: 6h/6d Inode: 381 Links: 1 2021-03-10T13:42:46.332 INFO:teuthology.orchestra.run.gibba003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.332 INFO:teuthology.orchestra.run.gibba003.stdout:Access: 2021-03-10 13:40:01.954494473 +0000 2021-03-10T13:42:46.332 INFO:teuthology.orchestra.run.gibba003.stdout:Modify: 2021-03-10 13:40:01.794494469 +0000 2021-03-10T13:42:46.333 INFO:teuthology.orchestra.run.gibba003.stdout:Change: 2021-03-10 13:40:01.794494469 +0000 2021-03-10T13:42:46.333 INFO:teuthology.orchestra.run.gibba003.stdout: Birth: - 2021-03-10T13:42:46.334 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records in 2021-03-10T13:42:46.334 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records out 2021-03-10T13:42:46.334 INFO:teuthology.orchestra.run.gibba003.stderr:512 bytes copied, 0.000218705 s, 2.3 MB/s 2021-03-10T13:42:46.336 DEBUG:teuthology.orchestra.run.gibba003:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T13:42:46.339 INFO:teuthology.orchestra.run.gibba003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T13:42:46.339 INFO:teuthology.orchestra.run.gibba003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.340 INFO:teuthology.orchestra.run.gibba003.stdout:Device: 6h/6d Inode: 388 Links: 1 2021-03-10T13:42:46.340 INFO:teuthology.orchestra.run.gibba003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.340 INFO:teuthology.orchestra.run.gibba003.stdout:Access: 2021-03-10 13:40:02.386494484 +0000 2021-03-10T13:42:46.340 INFO:teuthology.orchestra.run.gibba003.stdout:Modify: 2021-03-10 13:40:02.222494480 +0000 2021-03-10T13:42:46.340 INFO:teuthology.orchestra.run.gibba003.stdout:Change: 2021-03-10 13:40:02.222494480 +0000 2021-03-10T13:42:46.341 INFO:teuthology.orchestra.run.gibba003.stdout: Birth: - 2021-03-10T13:42:46.342 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records in 2021-03-10T13:42:46.342 INFO:teuthology.orchestra.run.gibba003.stderr:1+0 records out 2021-03-10T13:42:46.343 INFO:teuthology.orchestra.run.gibba003.stderr:512 bytes copied, 0.000251029 s, 2.0 MB/s 2021-03-10T13:42:46.344 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:42:46.344 DEBUG:teuthology.orchestra.run.gibba043:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T13:42:46.353 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T13:42:46.353 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T13:42:46.362 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T13:42:46.362 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.362 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 345 Links: 1 2021-03-10T13:42:46.363 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.363 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-03-10 13:40:01.844398784 +0000 2021-03-10T13:42:46.363 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-03-10 13:40:01.788398785 +0000 2021-03-10T13:42:46.363 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-03-10 13:40:01.788398785 +0000 2021-03-10T13:42:46.364 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-03-10T13:42:46.369 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-03-10T13:42:46.370 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-03-10T13:42:46.370 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000243052 s, 2.1 MB/s 2021-03-10T13:42:46.371 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T13:42:46.380 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T13:42:46.380 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.381 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 351 Links: 1 2021-03-10T13:42:46.381 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.381 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-03-10 13:40:02.200398774 +0000 2021-03-10T13:42:46.381 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-03-10 13:40:02.152398776 +0000 2021-03-10T13:42:46.382 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-03-10 13:40:02.152398776 +0000 2021-03-10T13:42:46.382 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-03-10T13:42:46.393 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-03-10T13:42:46.393 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-03-10T13:42:46.394 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.00049164 s, 1.0 MB/s 2021-03-10T13:42:46.400 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T13:42:46.452 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T13:42:46.453 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.453 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-03-10T13:42:46.453 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.453 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-03-10 13:40:02.596398764 +0000 2021-03-10T13:42:46.453 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-03-10 13:40:02.412398769 +0000 2021-03-10T13:42:46.454 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-03-10 13:40:02.412398769 +0000 2021-03-10T13:42:46.454 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-03-10T13:42:46.466 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-03-10T13:42:46.466 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-03-10T13:42:46.466 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000456522 s, 1.1 MB/s 2021-03-10T13:42:46.472 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T13:42:46.482 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T13:42:46.482 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:42:46.482 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-03-10T13:42:46.482 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:42:46.482 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-03-10 13:40:02.964398755 +0000 2021-03-10T13:42:46.483 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-03-10 13:40:02.880398757 +0000 2021-03-10T13:42:46.483 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-03-10 13:40:02.880398757 +0000 2021-03-10T13:42:46.483 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-03-10T13:42:46.494 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-03-10T13:42:46.495 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-03-10T13:42:46.495 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000398904 s, 1.3 MB/s 2021-03-10T13:42:46.501 INFO:tasks.cephadm:Deploying osd.0 on gibba003 with /dev/vg_nvme/lv_4... 2021-03-10T13:42:46.501 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T13:42:47.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[9769]: audit 2021-03-10T13:42:45.204000+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba003=y;gibba043=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:47.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[9769]: cephadm 2021-03-10T13:42:45.205469+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba003=y,gibba043=x 2021-03-10T13:42:47.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[9769]: cephadm 2021-03-10T13:42:45.219721+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba043 2021-03-10T13:42:47.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[9769]: cluster 2021-03-10T13:42:45.845801+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:47.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[12956]: audit 2021-03-10T13:42:45.204000+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba003=y;gibba043=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:47.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[12956]: cephadm 2021-03-10T13:42:45.205469+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba003=y,gibba043=x 2021-03-10T13:42:47.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[12956]: cephadm 2021-03-10T13:42:45.219721+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba043 2021-03-10T13:42:47.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:46 gibba003 bash[12956]: cluster 2021-03-10T13:42:45.845801+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:46 gibba043 bash[9839]: audit 2021-03-10T13:42:45.204000+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba003=y;gibba043=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:46 gibba043 bash[9839]: cephadm 2021-03-10T13:42:45.205469+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba003=y,gibba043=x 2021-03-10T13:42:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:46 gibba043 bash[9839]: cephadm 2021-03-10T13:42:45.219721+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba043 2021-03-10T13:42:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:46 gibba043 bash[9839]: cluster 2021-03-10T13:42:45.845801+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:47.864 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:42:47 gibba043 docker[10438]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:42:47.864 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:42:47 gibba043 systemd[1]: Started Ceph mgr.x for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:42:47.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[9769]: audit 2021-03-10T13:42:47.624472+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[12956]: audit 2021-03-10T13:42:47.624472+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:47.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[9769]: audit 2021-03-10T13:42:47.632692+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:47.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[9769]: audit 2021-03-10T13:42:47.634647+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:42:47.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[9769]: audit 2021-03-10T13:42:47.643545+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:42:47.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[9769]: audit 2021-03-10T13:42:47.646316+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:47.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[9769]: audit 2021-03-10T13:42:47.650709+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba043.dnkmem", "key": "container_image"}]: dispatch 2021-03-10T13:42:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[12956]: audit 2021-03-10T13:42:47.632692+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[12956]: audit 2021-03-10T13:42:47.634647+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:42:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[12956]: audit 2021-03-10T13:42:47.643545+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:42:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[12956]: audit 2021-03-10T13:42:47.646316+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:47 gibba003 bash[12956]: audit 2021-03-10T13:42:47.650709+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba043.dnkmem", "key": "container_image"}]: dispatch 2021-03-10T13:42:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:47 gibba043 bash[9839]: audit 2021-03-10T13:42:47.624472+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:47 gibba043 bash[9839]: audit 2021-03-10T13:42:47.632692+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:47 gibba043 bash[9839]: audit 2021-03-10T13:42:47.634647+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:42:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:47 gibba043 bash[9839]: audit 2021-03-10T13:42:47.643545+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:42:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:47 gibba043 bash[9839]: audit 2021-03-10T13:42:47.646316+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:47 gibba043 bash[9839]: audit 2021-03-10T13:42:47.650709+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba043.dnkmem", "key": "container_image"}]: dispatch 2021-03-10T13:42:49.119 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:48 gibba043 bash[9839]: cephadm 2021-03-10T13:42:47.648652+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:42:49.119 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:48 gibba043 bash[9839]: cluster 2021-03-10T13:42:47.846650+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:49.169 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T13:42:49.169 INFO:teuthology.orchestra.run.gibba003.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T13:42:49.170 INFO:teuthology.orchestra.run.gibba003.stderr: stderr: 10+0 records in 2021-03-10T13:42:49.170 INFO:teuthology.orchestra.run.gibba003.stderr:10+0 records out 2021-03-10T13:42:49.170 INFO:teuthology.orchestra.run.gibba003.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00920156 s, 1.1 GB/s 2021-03-10T13:42:49.170 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping successful for: 2021-03-10T13:42:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:48 gibba003 bash[9769]: cephadm 2021-03-10T13:42:47.648652+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:42:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:48 gibba003 bash[9769]: cluster 2021-03-10T13:42:47.846650+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:48 gibba003 bash[12956]: cephadm 2021-03-10T13:42:47.648652+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:42:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:48 gibba003 bash[12956]: cluster 2021-03-10T13:42:47.846650+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:49.387 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:42:49 gibba043 bash[10457]: debug 2021-03-10T13:42:49.159+0000 7f1dc795a040 1 -- 172.21.2.143:0/601497966 >> [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] conn(0x564e5346ac00 msgr2=0x564e540e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:42:49.388 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:42:49 gibba043 bash[10457]: debug 2021-03-10T13:42:49.159+0000 7f1dc795a040 1 --2- 172.21.2.143:0/601497966 >> [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] conn(0x564e5346ac00 0x564e540e0000 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x564e5345d140 tx=0x564e5345f7c0).stop 2021-03-10T13:42:49.675 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba003:vg_nvme/lv_4 2021-03-10T13:42:50.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: cluster 2021-03-10T13:42:49.847546+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:50.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.140176+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:50.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: cluster 2021-03-10T13:42:49.847546+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:50.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.140176+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:50.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.143343+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:50.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.144063+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:50.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.143343+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:50.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.144063+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:50.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.549247+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548496\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548569\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548607\", \"created\": \"2021-03-10T13:42:50.131453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:50.548668\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:50.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.551924+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548496\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548569\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548607\", \"created\": \"2021-03-10T13:42:50.131453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:50.548668\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:50.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.552929+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:42:50.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.553727+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:50.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[9769]: audit 2021-03-10T13:42:50.554791+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:42:50.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.549247+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548496\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548569\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548607\", \"created\": \"2021-03-10T13:42:50.131453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:50.548668\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:50.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.551924+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548496\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548569\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548607\", \"created\": \"2021-03-10T13:42:50.131453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:50.548668\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:50.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.552929+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:42:50.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.553727+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:50.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:50 gibba003 bash[12956]: audit 2021-03-10T13:42:50.554791+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:42:51.129 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: cluster 2021-03-10T13:42:49.847546+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:51.130 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.140176+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:51.130 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.143343+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:31.013925\", \"created\": \"2021-03-10T13:42:30.851453\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:51.130 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.144063+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:51.131 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.549247+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548496\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548569\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548607\", \"created\": \"2021-03-10T13:42:50.131453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:50.548668\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:51.131 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.551924+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548496\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548569\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:50.548607\", \"created\": \"2021-03-10T13:42:50.131453\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:50.548668\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:51.131 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.552929+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:42:51.131 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.553727+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:51.131 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:50 gibba043 bash[9839]: audit 2021-03-10T13:42:50.554791+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:42:52.182 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:51 gibba003 bash[9769]: cephadm 2021-03-10T13:42:50.552691+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:42:52.182 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:51 gibba003 bash[9769]: cephadm 2021-03-10T13:42:50.554492+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba003 2021-03-10T13:42:52.183 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:51 gibba003 bash[12956]: cephadm 2021-03-10T13:42:50.552691+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:42:52.183 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:51 gibba003 bash[12956]: cephadm 2021-03-10T13:42:50.554492+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba003 2021-03-10T13:42:52.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:51 gibba043 bash[9839]: cephadm 2021-03-10T13:42:50.552691+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:42:52.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:51 gibba043 bash[9839]: cephadm 2021-03-10T13:42:50.554492+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba003 2021-03-10T13:42:53.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: cluster 2021-03-10T13:42:51.848288+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:53.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: cluster 2021-03-10T13:42:52.014565+0000 mon.a (mon.0) 177 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:42:53.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.016375+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.143:0/2850111350' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:42:53.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.017226+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.143:0/2850111350' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:42:53.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: cluster 2021-03-10T13:42:51.848288+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:53.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: cluster 2021-03-10T13:42:52.014565+0000 mon.a (mon.0) 177 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:42:53.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.016375+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.143:0/2850111350' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:42:53.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.017226+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.143:0/2850111350' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:42:53.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.575374+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950094\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950183\", \"created\": \"2021-03-10T13:42:17.618426\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:53.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.577980+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950094\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950183\", \"created\": \"2021-03-10T13:42:17.618426\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:53.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.578729+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:53.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.593139+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:53.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.594007+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:53.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[9769]: audit 2021-03-10T13:42:52.594711+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:53.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.575374+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950094\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950183\", \"created\": \"2021-03-10T13:42:17.618426\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:53.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.577980+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950094\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950183\", \"created\": \"2021-03-10T13:42:17.618426\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:53.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.578729+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:53.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.593139+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:53.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.594007+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:53.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:52 gibba003 bash[12956]: audit 2021-03-10T13:42:52.594711+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:53.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: cluster 2021-03-10T13:42:51.848288+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:53.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: cluster 2021-03-10T13:42:52.014565+0000 mon.a (mon.0) 177 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:42:53.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.016375+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.143:0/2850111350' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:42:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.017226+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.143:0/2850111350' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:42:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.575374+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950094\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950183\", \"created\": \"2021-03-10T13:42:17.618426\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.577980+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950094\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.950183\", \"created\": \"2021-03-10T13:42:17.618426\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.578729+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.593139+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.594007+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:52 gibba043 bash[9839]: audit 2021-03-10T13:42:52.594711+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:54.176 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:52.592353+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:54.176 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: cephadm 2021-03-10T13:42:52.592907+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:42:54.176 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: cluster 2021-03-10T13:42:52.889154+0000 mon.a (mon.0) 184 : cluster [DBG] mgrmap e14: y(active, since 78s), standbys: x 2021-03-10T13:42:54.176 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:52.889236+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:42:54.177 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:52.592353+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:54.177 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: cephadm 2021-03-10T13:42:52.592907+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:42:54.177 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: cluster 2021-03-10T13:42:52.889154+0000 mon.a (mon.0) 184 : cluster [DBG] mgrmap e14: y(active, since 78s), standbys: x 2021-03-10T13:42:54.178 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:52.889236+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:42:54.178 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:53.091171+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.090704\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:54.178 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:53.091171+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.090704\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:54.179 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:53.094177+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.090704\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:54.179 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:53.094615+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:54.180 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:53.446754+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.444987\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:54.180 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[9769]: audit 2021-03-10T13:42:53.454872+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.444987\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:54.180 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:53.094177+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.090704\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:54.181 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:53.094615+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:54.181 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:53.446754+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.444987\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:54.181 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:53 gibba003 bash[12956]: audit 2021-03-10T13:42:53.454872+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.444987\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:52.592353+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: cephadm 2021-03-10T13:42:52.592907+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:42:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: cluster 2021-03-10T13:42:52.889154+0000 mon.a (mon.0) 184 : cluster [DBG] mgrmap e14: y(active, since 78s), standbys: x 2021-03-10T13:42:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:52.889236+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:42:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:53.091171+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.090704\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:42:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:53.094177+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.090704\", \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:42:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:53.094615+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:54.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:53.446754+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.444987\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:42:54.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:53 gibba043 bash[9839]: audit 2021-03-10T13:42:53.454872+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}}, \"last_daemon_update\": \"2021-03-10T13:42:53.444987\", \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:42:55.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[9769]: cluster 2021-03-10T13:42:53.849058+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:55.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[9769]: cluster 2021-03-10T13:42:53.891208+0000 mon.a (mon.0) 191 : cluster [DBG] Standby manager daemon gibba043.dnkmem started 2021-03-10T13:42:55.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[9769]: audit 2021-03-10T13:42:53.893020+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.143:0/3151663325' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:42:55.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[9769]: audit 2021-03-10T13:42:53.893880+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.143:0/3151663325' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:42:55.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[9769]: cluster 2021-03-10T13:42:54.848958+0000 mon.a (mon.0) 192 : cluster [DBG] mgrmap e15: y(active, since 80s), standbys: x, gibba043.dnkmem 2021-03-10T13:42:55.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[9769]: audit 2021-03-10T13:42:54.849070+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:42:55.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[12956]: cluster 2021-03-10T13:42:53.849058+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:55.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[12956]: cluster 2021-03-10T13:42:53.891208+0000 mon.a (mon.0) 191 : cluster [DBG] Standby manager daemon gibba043.dnkmem started 2021-03-10T13:42:55.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[12956]: audit 2021-03-10T13:42:53.893020+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.143:0/3151663325' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:42:55.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[12956]: audit 2021-03-10T13:42:53.893880+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.143:0/3151663325' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:42:55.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[12956]: cluster 2021-03-10T13:42:54.848958+0000 mon.a (mon.0) 192 : cluster [DBG] mgrmap e15: y(active, since 80s), standbys: x, gibba043.dnkmem 2021-03-10T13:42:55.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:54 gibba003 bash[12956]: audit 2021-03-10T13:42:54.849070+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:42:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:54 gibba043 bash[9839]: cluster 2021-03-10T13:42:53.849058+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:54 gibba043 bash[9839]: cluster 2021-03-10T13:42:53.891208+0000 mon.a (mon.0) 191 : cluster [DBG] Standby manager daemon gibba043.dnkmem started 2021-03-10T13:42:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:54 gibba043 bash[9839]: audit 2021-03-10T13:42:53.893020+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.143:0/3151663325' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:42:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:54 gibba043 bash[9839]: audit 2021-03-10T13:42:53.893880+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.143:0/3151663325' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:42:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:54 gibba043 bash[9839]: cluster 2021-03-10T13:42:54.848958+0000 mon.a (mon.0) 192 : cluster [DBG] mgrmap e15: y(active, since 80s), standbys: x, gibba043.dnkmem 2021-03-10T13:42:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:54 gibba043 bash[9839]: audit 2021-03-10T13:42:54.849070+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:42:56.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[9769]: cluster 2021-03-10T13:42:54.921826+0000 mgr.gibba043.dnkmem (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:42:56.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[9769]: audit 2021-03-10T13:42:55.558497+0000 mon.a (mon.0) 194 : audit [INF] from='client.? 172.21.2.103:0/635889460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d26860c-9743-487b-8483-5d559e1f056b"}]: dispatch 2021-03-10T13:42:56.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[9769]: audit 2021-03-10T13:42:55.563893+0000 mon.a (mon.0) 195 : audit [INF] from='client.? 172.21.2.103:0/635889460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d26860c-9743-487b-8483-5d559e1f056b"}]': finished 2021-03-10T13:42:56.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[9769]: cluster 2021-03-10T13:42:55.563918+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:42:56.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[9769]: audit 2021-03-10T13:42:55.564092+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:42:56.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[12956]: cluster 2021-03-10T13:42:54.921826+0000 mgr.gibba043.dnkmem (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:42:56.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[12956]: audit 2021-03-10T13:42:55.558497+0000 mon.a (mon.0) 194 : audit [INF] from='client.? 172.21.2.103:0/635889460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d26860c-9743-487b-8483-5d559e1f056b"}]: dispatch 2021-03-10T13:42:56.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[12956]: audit 2021-03-10T13:42:55.563893+0000 mon.a (mon.0) 195 : audit [INF] from='client.? 172.21.2.103:0/635889460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d26860c-9743-487b-8483-5d559e1f056b"}]': finished 2021-03-10T13:42:56.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[12956]: cluster 2021-03-10T13:42:55.563918+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:42:56.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:55 gibba003 bash[12956]: audit 2021-03-10T13:42:55.564092+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:42:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:55 gibba043 bash[9839]: cluster 2021-03-10T13:42:54.921826+0000 mgr.gibba043.dnkmem (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:42:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:55 gibba043 bash[9839]: audit 2021-03-10T13:42:55.558497+0000 mon.a (mon.0) 194 : audit [INF] from='client.? 172.21.2.103:0/635889460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d26860c-9743-487b-8483-5d559e1f056b"}]: dispatch 2021-03-10T13:42:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:55 gibba043 bash[9839]: audit 2021-03-10T13:42:55.563893+0000 mon.a (mon.0) 195 : audit [INF] from='client.? 172.21.2.103:0/635889460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d26860c-9743-487b-8483-5d559e1f056b"}]': finished 2021-03-10T13:42:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:55 gibba043 bash[9839]: cluster 2021-03-10T13:42:55.563918+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:42:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:55 gibba043 bash[9839]: audit 2021-03-10T13:42:55.564092+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:42:57.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:56 gibba003 bash[9769]: cluster 2021-03-10T13:42:55.849663+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:57.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:56 gibba003 bash[12956]: cluster 2021-03-10T13:42:55.849663+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:56 gibba043 bash[9839]: cluster 2021-03-10T13:42:55.849663+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:57 gibba003 bash[9769]: audit 2021-03-10T13:42:57.507142+0000 mon.a (mon.0) 198 : audit [DBG] from='client.? 172.21.2.103:0/3061806057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:57 gibba003 bash[12956]: audit 2021-03-10T13:42:57.507142+0000 mon.a (mon.0) 198 : audit [DBG] from='client.? 172.21.2.103:0/3061806057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:57 gibba043 bash[9839]: audit 2021-03-10T13:42:57.507142+0000 mon.a (mon.0) 198 : audit [DBG] from='client.? 172.21.2.103:0/3061806057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:42:58 gibba003 bash[9769]: cluster 2021-03-10T13:42:57.850370+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:59.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:42:58 gibba003 bash[12956]: cluster 2021-03-10T13:42:57.850370+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:42:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:42:58 gibba043 bash[9839]: cluster 2021-03-10T13:42:57.850370+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:01.020 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:00 gibba003 bash[9769]: cluster 2021-03-10T13:42:59.851263+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:01.020 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:00 gibba003 bash[9769]: audit 2021-03-10T13:42:59.990738+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.021 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:00 gibba003 bash[12956]: cluster 2021-03-10T13:42:59.851263+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:01.021 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:00 gibba003 bash[12956]: audit 2021-03-10T13:42:59.990738+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:00 gibba043 bash[9839]: cluster 2021-03-10T13:42:59.851263+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:00 gibba043 bash[9839]: audit 2021-03-10T13:42:59.990738+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:02 gibba043 bash[9839]: cluster 2021-03-10T13:43:01.852072+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:02 gibba043 bash[9839]: audit 2021-03-10T13:43:02.893457+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:43:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:02 gibba043 bash[9839]: audit 2021-03-10T13:43:02.894517+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:02 gibba043 bash[9839]: audit 2021-03-10T13:43:02.895170+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:43:03.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[9769]: cluster 2021-03-10T13:43:01.852072+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[9769]: audit 2021-03-10T13:43:02.893457+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:43:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[9769]: audit 2021-03-10T13:43:02.894517+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[9769]: audit 2021-03-10T13:43:02.895170+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:43:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[12956]: cluster 2021-03-10T13:43:01.852072+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:03.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[12956]: audit 2021-03-10T13:43:02.893457+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:43:03.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[12956]: audit 2021-03-10T13:43:02.894517+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:03.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:02 gibba003 bash[12956]: audit 2021-03-10T13:43:02.895170+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:43:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:03 gibba043 bash[9839]: cephadm 2021-03-10T13:43:02.894954+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Deploying daemon osd.0 on gibba003 2021-03-10T13:43:04.274 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:03 gibba003 bash[12956]: cephadm 2021-03-10T13:43:02.894954+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Deploying daemon osd.0 on gibba003 2021-03-10T13:43:04.274 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:03 gibba003 bash[9769]: cephadm 2021-03-10T13:43:02.894954+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Deploying daemon osd.0 on gibba003 2021-03-10T13:43:04.577 INFO:teuthology.orchestra.run.gibba003.stdout:Created osd(s) 0 on host 'gibba003' 2021-03-10T13:43:05.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[9769]: cluster 2021-03-10T13:43:03.852668+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:05.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[12956]: cluster 2021-03-10T13:43:03.852668+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:05.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[9769]: audit 2021-03-10T13:43:04.570214+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:05.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[9769]: audit 2021-03-10T13:43:04.570679+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:05.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[9769]: audit 2021-03-10T13:43:04.573747+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:05.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[12956]: audit 2021-03-10T13:43:04.570214+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:05.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[12956]: audit 2021-03-10T13:43:04.570679+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:05.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:04 gibba003 bash[12956]: audit 2021-03-10T13:43:04.573747+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:04 gibba043 bash[9839]: cluster 2021-03-10T13:43:03.852668+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:04 gibba043 bash[9839]: audit 2021-03-10T13:43:04.570214+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:04 gibba043 bash[9839]: audit 2021-03-10T13:43:04.570679+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:04 gibba043 bash[9839]: audit 2021-03-10T13:43:04.573747+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090553\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090614\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.090644\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_device_update\": \"2021-03-10T13:41:41.098985\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:05.601 DEBUG:teuthology.orchestra.run.gibba003:osd.0> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.0.service 2021-03-10T13:43:05.604 INFO:tasks.cephadm:Deploying osd.1 on gibba003 with /dev/vg_nvme/lv_3... 2021-03-10T13:43:05.604 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T13:43:05.688 INFO:journalctl@ceph.osd.0.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:06.266 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:05 gibba003 bash[9769]: audit 2021-03-10T13:43:04.961077+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:06.267 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:05 gibba003 bash[12956]: audit 2021-03-10T13:43:04.961077+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:06.268 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:05 gibba003 bash[9769]: audit 2021-03-10T13:43:04.964019+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:06.268 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:05 gibba003 bash[9769]: audit 2021-03-10T13:43:04.964502+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:06.268 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:05 gibba003 bash[12956]: audit 2021-03-10T13:43:04.964019+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:06.268 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:05 gibba003 bash[12956]: audit 2021-03-10T13:43:04.964502+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:05 gibba043 bash[9839]: audit 2021-03-10T13:43:04.961077+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:05 gibba043 bash[9839]: audit 2021-03-10T13:43:04.964019+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:05 gibba043 bash[9839]: audit 2021-03-10T13:43:04.964502+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:06.816 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:43:06.817 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T13:43:06.817 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:43:06.817 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:43:06.817 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:43:06.818 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:43:06.818 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[14561]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T13:43:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[9769]: cluster 2021-03-10T13:43:05.853436+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:06 gibba003 bash[12956]: cluster 2021-03-10T13:43:05.853436+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:06 gibba043 bash[9839]: cluster 2021-03-10T13:43:05.853436+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:09.042 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:08 gibba003 bash[12956]: cluster 2021-03-10T13:43:07.854031+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:09.042 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:08 gibba003 bash[9769]: cluster 2021-03-10T13:43:07.854031+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:08 gibba043 bash[9839]: cluster 2021-03-10T13:43:07.854031+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:10.041 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:09 gibba003 bash[14861]: debug 2021-03-10T13:43:09.722+0000 7f3a33a47ec0 -1 Falling back to public interface 2021-03-10T13:43:10.569 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T13:43:10.570 INFO:teuthology.orchestra.run.gibba003.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T13:43:10.570 INFO:teuthology.orchestra.run.gibba003.stderr: stderr: 10+0 records in 2021-03-10T13:43:10.570 INFO:teuthology.orchestra.run.gibba003.stderr:10+0 records out 2021-03-10T13:43:10.570 INFO:teuthology.orchestra.run.gibba003.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00742169 s, 1.4 GB/s 2021-03-10T13:43:10.570 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping successful for: 2021-03-10T13:43:10.625 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:10 gibba003 bash[14861]: debug 2021-03-10T13:43:10.350+0000 7f3a33a47ec0 -1 osd.0 0 log_to_monitors {default=true} 2021-03-10T13:43:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:11 gibba043 bash[9839]: cluster 2021-03-10T13:43:09.854340+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:11 gibba043 bash[9839]: audit 2021-03-10T13:43:10.355992+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:43:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:11 gibba043 bash[9839]: audit 2021-03-10T13:43:10.356305+0000 mon.a (mon.0) 209 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:43:11.295 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:11 gibba003 bash[9769]: cluster 2021-03-10T13:43:09.854340+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:11.296 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:11 gibba003 bash[9769]: audit 2021-03-10T13:43:10.355992+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:43:11.296 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:11 gibba003 bash[9769]: audit 2021-03-10T13:43:10.356305+0000 mon.a (mon.0) 209 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:43:11.296 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:11 gibba003 bash[12956]: cluster 2021-03-10T13:43:09.854340+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:11.297 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:11 gibba003 bash[12956]: audit 2021-03-10T13:43:10.355992+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:43:11.297 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:11 gibba003 bash[12956]: audit 2021-03-10T13:43:10.356305+0000 mon.a (mon.0) 209 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:43:11.298 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba003:vg_nvme/lv_3 2021-03-10T13:43:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:10.997622+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:43:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: cluster 2021-03-10T13:43:10.997664+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:43:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:10.998398+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:10.998533+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:10.998809+0000 mon.a (mon.0) 213 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: cluster 2021-03-10T13:43:11.324654+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: cluster 2021-03-10T13:43:11.324693+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:11.765106+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:11.860995+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:11.865048+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:12.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: audit 2021-03-10T13:43:12.002370+0000 mon.a (mon.0) 217 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:43:12.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:12 gibba043 bash[9839]: cluster 2021-03-10T13:43:12.002396+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:43:12.290 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[14861]: debug 2021-03-10T13:43:12.002+0000 7f3a1c7fc700 -1 osd.0 0 waiting for initial osdmap 2021-03-10T13:43:12.291 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[14861]: debug 2021-03-10T13:43:12.006+0000 7f3a27a18700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:43:12.291 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:10.997622+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:43:12.292 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: cluster 2021-03-10T13:43:10.997664+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:43:12.292 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:10.998398+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:12.292 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:10.998533+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:12.292 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:10.998809+0000 mon.a (mon.0) 213 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:12.293 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: cluster 2021-03-10T13:43:11.324654+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:12.293 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: cluster 2021-03-10T13:43:11.324693+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:12.293 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:11.765106+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:12.293 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:10.997622+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:43:12.294 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: cluster 2021-03-10T13:43:10.997664+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:43:12.294 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:10.998398+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:12.294 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:10.998533+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:12.294 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:10.998809+0000 mon.a (mon.0) 213 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:12.295 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: cluster 2021-03-10T13:43:11.324654+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:12.295 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: cluster 2021-03-10T13:43:11.324693+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:12.295 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:11.765106+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:12.295 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:11.860995+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:12.296 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:11.860995+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:12.297 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:11.865048+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:12.297 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: audit 2021-03-10T13:43:12.002370+0000 mon.a (mon.0) 217 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:43:12.297 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[9769]: cluster 2021-03-10T13:43:12.002396+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:43:12.297 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:11.865048+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}}, \"last_daemon_update\": \"2021-03-10T13:43:04.960573\", \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:12.298 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: audit 2021-03-10T13:43:12.002370+0000 mon.a (mon.0) 217 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:43:12.298 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:12 gibba003 bash[12956]: cluster 2021-03-10T13:43:12.002396+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:43:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:13 gibba003 bash[9769]: cluster 2021-03-10T13:43:11.854563+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:13 gibba003 bash[9769]: audit 2021-03-10T13:43:12.002508+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:13 gibba003 bash[12956]: cluster 2021-03-10T13:43:11.854563+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:13 gibba003 bash[12956]: audit 2021-03-10T13:43:12.002508+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:13 gibba043 bash[9839]: cluster 2021-03-10T13:43:11.854563+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:13 gibba043 bash[9839]: audit 2021-03-10T13:43:12.002508+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[9769]: cluster 2021-03-10T13:43:13.019678+0000 mon.a (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524] boot 2021-03-10T13:43:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[9769]: cluster 2021-03-10T13:43:13.019739+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:43:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[9769]: audit 2021-03-10T13:43:13.020294+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[9769]: audit 2021-03-10T13:43:13.824841+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[9769]: audit 2021-03-10T13:43:13.825700+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[9769]: audit 2021-03-10T13:43:13.826659+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[12956]: cluster 2021-03-10T13:43:13.019678+0000 mon.a (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524] boot 2021-03-10T13:43:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[12956]: cluster 2021-03-10T13:43:13.019739+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:43:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[12956]: audit 2021-03-10T13:43:13.020294+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[12956]: audit 2021-03-10T13:43:13.824841+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[12956]: audit 2021-03-10T13:43:13.825700+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:14 gibba003 bash[12956]: audit 2021-03-10T13:43:13.826659+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:14 gibba043 bash[9839]: cluster 2021-03-10T13:43:13.019678+0000 mon.a (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.2.103:6802/278332524,v1:172.21.2.103:6803/278332524] boot 2021-03-10T13:43:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:14 gibba043 bash[9839]: cluster 2021-03-10T13:43:13.019739+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:43:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:14 gibba043 bash[9839]: audit 2021-03-10T13:43:13.020294+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:43:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:14 gibba043 bash[9839]: audit 2021-03-10T13:43:13.824841+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:14 gibba043 bash[9839]: audit 2021-03-10T13:43:13.825700+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:14 gibba043 bash[9839]: audit 2021-03-10T13:43:13.826659+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:15.331 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[9769]: audit 2021-03-10T13:43:13.824152+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:15.331 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[9769]: cephadm 2021-03-10T13:43:13.824603+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:43:15.331 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[9769]: cluster 2021-03-10T13:43:13.854766+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:15.332 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[9769]: cluster 2021-03-10T13:43:14.024551+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:43:15.332 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[9769]: cluster 2021-03-10T13:43:15.024249+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:43:15.332 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[12956]: audit 2021-03-10T13:43:13.824152+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:15.332 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[12956]: cephadm 2021-03-10T13:43:13.824603+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:43:15.333 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[12956]: cluster 2021-03-10T13:43:13.854766+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:15.333 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[12956]: cluster 2021-03-10T13:43:14.024551+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:43:15.333 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:15 gibba003 bash[12956]: cluster 2021-03-10T13:43:15.024249+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:43:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:15 gibba043 bash[9839]: audit 2021-03-10T13:43:13.824152+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:15 gibba043 bash[9839]: cephadm 2021-03-10T13:43:13.824603+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:43:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:15 gibba043 bash[9839]: cluster 2021-03-10T13:43:13.854766+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:15 gibba043 bash[9839]: cluster 2021-03-10T13:43:14.024551+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:43:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:15 gibba043 bash[9839]: cluster 2021-03-10T13:43:15.024249+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:43:16.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:16 gibba003 bash[9769]: cluster 2021-03-10T13:43:15.855438+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:16 gibba003 bash[9769]: cluster 2021-03-10T13:43:16.032847+0000 mon.a (mon.0) 228 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:43:16.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:16 gibba003 bash[12956]: cluster 2021-03-10T13:43:15.855438+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:16.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:16 gibba003 bash[12956]: cluster 2021-03-10T13:43:16.032847+0000 mon.a (mon.0) 228 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:43:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:16 gibba043 bash[9839]: cluster 2021-03-10T13:43:15.855438+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:16 gibba043 bash[9839]: cluster 2021-03-10T13:43:16.032847+0000 mon.a (mon.0) 228 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:43:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[9769]: audit 2021-03-10T13:43:16.579937+0000 mon.a (mon.0) 229 : audit [INF] from='client.? 172.21.2.103:0/2499832194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1969538-9fbe-4d1c-a6a2-564d7b3d7b92"}]: dispatch 2021-03-10T13:43:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[9769]: audit 2021-03-10T13:43:16.584509+0000 mon.a (mon.0) 230 : audit [INF] from='client.? 172.21.2.103:0/2499832194' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1969538-9fbe-4d1c-a6a2-564d7b3d7b92"}]': finished 2021-03-10T13:43:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[9769]: cluster 2021-03-10T13:43:16.584554+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:43:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[9769]: audit 2021-03-10T13:43:16.584677+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[12956]: audit 2021-03-10T13:43:16.579937+0000 mon.a (mon.0) 229 : audit [INF] from='client.? 172.21.2.103:0/2499832194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1969538-9fbe-4d1c-a6a2-564d7b3d7b92"}]: dispatch 2021-03-10T13:43:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[12956]: audit 2021-03-10T13:43:16.584509+0000 mon.a (mon.0) 230 : audit [INF] from='client.? 172.21.2.103:0/2499832194' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1969538-9fbe-4d1c-a6a2-564d7b3d7b92"}]': finished 2021-03-10T13:43:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[12956]: cluster 2021-03-10T13:43:16.584554+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:43:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:17 gibba003 bash[12956]: audit 2021-03-10T13:43:16.584677+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:17.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:17 gibba043 bash[9839]: audit 2021-03-10T13:43:16.579937+0000 mon.a (mon.0) 229 : audit [INF] from='client.? 172.21.2.103:0/2499832194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1969538-9fbe-4d1c-a6a2-564d7b3d7b92"}]: dispatch 2021-03-10T13:43:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:17 gibba043 bash[9839]: audit 2021-03-10T13:43:16.584509+0000 mon.a (mon.0) 230 : audit [INF] from='client.? 172.21.2.103:0/2499832194' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1969538-9fbe-4d1c-a6a2-564d7b3d7b92"}]': finished 2021-03-10T13:43:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:17 gibba043 bash[9839]: cluster 2021-03-10T13:43:16.584554+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:43:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:17 gibba043 bash[9839]: audit 2021-03-10T13:43:16.584677+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:18 gibba003 bash[9769]: cluster 2021-03-10T13:43:17.856244+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:18 gibba003 bash[12956]: cluster 2021-03-10T13:43:17.856244+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:18 gibba043 bash[9839]: cluster 2021-03-10T13:43:17.856244+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:19.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:19 gibba003 bash[9769]: audit 2021-03-10T13:43:18.554742+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.2.103:0/1737160503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:19 gibba003 bash[12956]: audit 2021-03-10T13:43:18.554742+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.2.103:0/1737160503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:19 gibba043 bash[9839]: audit 2021-03-10T13:43:18.554742+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.2.103:0/1737160503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:20 gibba003 bash[9769]: cluster 2021-03-10T13:43:19.857280+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:20.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:20 gibba003 bash[12956]: cluster 2021-03-10T13:43:19.857280+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:20.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:20 gibba043 bash[9839]: cluster 2021-03-10T13:43:19.857280+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:21.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:21 gibba003 bash[9769]: audit 2021-03-10T13:43:21.100440+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:21.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:21 gibba003 bash[12956]: audit 2021-03-10T13:43:21.100440+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:21 gibba043 bash[9839]: audit 2021-03-10T13:43:21.100440+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:22.168 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:22 gibba003 bash[9769]: cluster 2021-03-10T13:43:21.857948+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:22.168 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:22 gibba003 bash[12956]: cluster 2021-03-10T13:43:21.857948+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:22 gibba043 bash[9839]: cluster 2021-03-10T13:43:21.857948+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:24.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:23 gibba003 bash[9769]: cluster 2021-03-10T13:43:23.842852+0000 mon.a (mon.0) 234 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:43:24.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:23 gibba003 bash[12956]: cluster 2021-03-10T13:43:23.842852+0000 mon.a (mon.0) 234 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:43:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:23 gibba043 bash[9839]: cluster 2021-03-10T13:43:23.842852+0000 mon.a (mon.0) 234 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:43:25.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[9769]: cluster 2021-03-10T13:43:23.858674+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:25.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[9769]: audit 2021-03-10T13:43:24.085811+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:43:25.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[9769]: audit 2021-03-10T13:43:24.086701+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:25.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[9769]: audit 2021-03-10T13:43:24.087350+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:43:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[12956]: cluster 2021-03-10T13:43:23.858674+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[12956]: audit 2021-03-10T13:43:24.085811+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:43:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[12956]: audit 2021-03-10T13:43:24.086701+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:24 gibba003 bash[12956]: audit 2021-03-10T13:43:24.087350+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:43:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:24 gibba043 bash[9839]: cluster 2021-03-10T13:43:23.858674+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:24 gibba043 bash[9839]: audit 2021-03-10T13:43:24.085811+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:43:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:24 gibba043 bash[9839]: audit 2021-03-10T13:43:24.086701+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:24 gibba043 bash[9839]: audit 2021-03-10T13:43:24.087350+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba003.stdout:Created osd(s) 1 on host 'gibba003' 2021-03-10T13:43:26.043 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[12956]: cephadm 2021-03-10T13:43:24.087104+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:43:26.043 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[9769]: cephadm 2021-03-10T13:43:24.087104+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:43:26.044 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[12956]: audit 2021-03-10T13:43:25.681979+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:26.044 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[12956]: audit 2021-03-10T13:43:25.682531+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:26.044 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[12956]: audit 2021-03-10T13:43:25.686131+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:26.045 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[9769]: audit 2021-03-10T13:43:25.681979+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:26.045 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[9769]: audit 2021-03-10T13:43:25.682531+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:26.045 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:25 gibba003 bash[9769]: audit 2021-03-10T13:43:25.686131+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:25 gibba043 bash[9839]: cephadm 2021-03-10T13:43:24.087104+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:43:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:25 gibba043 bash[9839]: audit 2021-03-10T13:43:25.681979+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:25 gibba043 bash[9839]: audit 2021-03-10T13:43:25.682531+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:25 gibba043 bash[9839]: audit 2021-03-10T13:43:25.686131+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960407\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960468\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960498\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:04.960525\", \"created\": \"2021-03-10T13:43:04.558427\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_device_update\": \"2021-03-10T13:43:11.860506\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:26.679 DEBUG:teuthology.orchestra.run.gibba003:osd.1> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.1.service 2021-03-10T13:43:26.681 INFO:tasks.cephadm:Deploying osd.2 on gibba003 with /dev/vg_nvme/lv_2... 2021-03-10T13:43:26.682 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T13:43:26.762 INFO:journalctl@ceph.osd.1.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[9769]: cluster 2021-03-10T13:43:25.859390+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:26.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[12956]: cluster 2021-03-10T13:43:25.859390+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[9769]: audit 2021-03-10T13:43:26.158380+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:26.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[9769]: audit 2021-03-10T13:43:26.162535+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:26.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[9769]: audit 2021-03-10T13:43:26.163179+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[12956]: audit 2021-03-10T13:43:26.158380+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[12956]: audit 2021-03-10T13:43:26.162535+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:26 gibba003 bash[12956]: audit 2021-03-10T13:43:26.163179+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:26 gibba043 bash[9839]: cluster 2021-03-10T13:43:25.859390+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:26 gibba043 bash[9839]: audit 2021-03-10T13:43:26.158380+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:26 gibba043 bash[9839]: audit 2021-03-10T13:43:26.162535+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:26 gibba043 bash[9839]: audit 2021-03-10T13:43:26.163179+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:28.325 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:43:28.325 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:43:28.325 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:43:28.326 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:43:28.326 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:43:28.326 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:43:28.326 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[15989]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:43:29.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[9769]: cluster 2021-03-10T13:43:27.859713+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:29.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:28 gibba003 bash[12956]: cluster 2021-03-10T13:43:27.859713+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:28 gibba043 bash[9839]: cluster 2021-03-10T13:43:27.859713+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:31.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:30 gibba003 bash[9769]: cluster 2021-03-10T13:43:29.860419+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:31.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:30 gibba003 bash[12956]: cluster 2021-03-10T13:43:29.860419+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:30 gibba043 bash[9839]: cluster 2021-03-10T13:43:29.860419+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:31.418 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T13:43:31.419 INFO:teuthology.orchestra.run.gibba003.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T13:43:31.419 INFO:teuthology.orchestra.run.gibba003.stderr: stderr: 10+0 records in 2021-03-10T13:43:31.419 INFO:teuthology.orchestra.run.gibba003.stderr:10+0 records out 2021-03-10T13:43:31.419 INFO:teuthology.orchestra.run.gibba003.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0282791 s, 371 MB/s 2021-03-10T13:43:31.419 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping successful for: 2021-03-10T13:43:31.945 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:31 gibba003 bash[16359]: debug 2021-03-10T13:43:31.490+0000 7faa9f4e1ec0 -1 Falling back to public interface 2021-03-10T13:43:32.022 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba003:vg_nvme/lv_2 2021-03-10T13:43:32.445 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[16359]: debug 2021-03-10T13:43:32.138+0000 7faa9f4e1ec0 -1 osd.1 0 log_to_monitors {default=true} 2021-03-10T13:43:33.208 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[9769]: cluster 2021-03-10T13:43:31.861026+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:33.209 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[9769]: audit 2021-03-10T13:43:32.144583+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:33.209 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[9769]: audit 2021-03-10T13:43:32.144904+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:33.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[12956]: cluster 2021-03-10T13:43:31.861026+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:33.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[12956]: audit 2021-03-10T13:43:32.144583+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:33.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:32 gibba003 bash[12956]: audit 2021-03-10T13:43:32.144904+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:32 gibba043 bash[9839]: cluster 2021-03-10T13:43:31.861026+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:32 gibba043 bash[9839]: audit 2021-03-10T13:43:32.144583+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:32 gibba043 bash[9839]: audit 2021-03-10T13:43:32.144904+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:34.195 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[16359]: debug 2021-03-10T13:43:33.958+0000 7faa8428e700 -1 osd.1 0 waiting for initial osdmap 2021-03-10T13:43:34.196 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[16359]: debug 2021-03-10T13:43:33.962+0000 7faa8f4aa700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:43:34.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:32.944421+0000 mon.a (mon.0) 245 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:43:34.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: cluster 2021-03-10T13:43:32.944552+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:43:34.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:32.945726+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:34.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:32.946262+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:34.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:32.949236+0000 mon.a (mon.0) 248 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:34.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:33.020229+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:34.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: cluster 2021-03-10T13:43:33.118540+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:34.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: cluster 2021-03-10T13:43:33.118570+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:34.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:32.944421+0000 mon.a (mon.0) 245 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:43:34.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: cluster 2021-03-10T13:43:32.944552+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:43:34.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:32.945726+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:34.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:32.946262+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:34.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:32.949236+0000 mon.a (mon.0) 248 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:34.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:33.020229+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:34.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: cluster 2021-03-10T13:43:33.118540+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:34.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: cluster 2021-03-10T13:43:33.118570+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:34.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:33.127038+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:34.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[9769]: audit 2021-03-10T13:43:33.131566+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:34.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:33.127038+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:34.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:33 gibba003 bash[12956]: audit 2021-03-10T13:43:33.131566+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:32.944421+0000 mon.a (mon.0) 245 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:43:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: cluster 2021-03-10T13:43:32.944552+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:43:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:32.945726+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:32.946262+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:32.949236+0000 mon.a (mon.0) 248 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:33.020229+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:34.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: cluster 2021-03-10T13:43:33.118540+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:34.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: cluster 2021-03-10T13:43:33.118570+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:34.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:33.127038+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:34.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:33 gibba043 bash[9839]: audit 2021-03-10T13:43:33.131566+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157621\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:24.085571\"}}, \"last_daemon_update\": \"2021-03-10T13:43:26.157691\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:35.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: cluster 2021-03-10T13:43:33.861400+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:35.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: audit 2021-03-10T13:43:33.957609+0000 mon.a (mon.0) 252 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:43:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: cluster 2021-03-10T13:43:33.957637+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:43:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: audit 2021-03-10T13:43:33.958534+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: audit 2021-03-10T13:43:34.761568+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: audit 2021-03-10T13:43:34.762495+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:35.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[9769]: audit 2021-03-10T13:43:34.763412+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:35.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: cluster 2021-03-10T13:43:33.861400+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:35.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: audit 2021-03-10T13:43:33.957609+0000 mon.a (mon.0) 252 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:43:35.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: cluster 2021-03-10T13:43:33.957637+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:43:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: audit 2021-03-10T13:43:33.958534+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: audit 2021-03-10T13:43:34.761568+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: audit 2021-03-10T13:43:34.762495+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:34 gibba003 bash[12956]: audit 2021-03-10T13:43:34.763412+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: cluster 2021-03-10T13:43:33.861400+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: audit 2021-03-10T13:43:33.957609+0000 mon.a (mon.0) 252 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:43:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: cluster 2021-03-10T13:43:33.957637+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:43:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: audit 2021-03-10T13:43:33.958534+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: audit 2021-03-10T13:43:34.761568+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: audit 2021-03-10T13:43:34.762495+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:34 gibba043 bash[9839]: audit 2021-03-10T13:43:34.763412+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[9769]: audit 2021-03-10T13:43:34.760752+0000 mgr.y (mgr.14140) 72 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[9769]: cephadm 2021-03-10T13:43:34.761310+0000 mgr.y (mgr.14140) 73 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:43:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[9769]: cluster 2021-03-10T13:43:34.970991+0000 mon.a (mon.0) 258 : cluster [INF] osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108] boot 2021-03-10T13:43:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[9769]: cluster 2021-03-10T13:43:34.971038+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:43:36.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[9769]: audit 2021-03-10T13:43:34.971525+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[12956]: audit 2021-03-10T13:43:34.760752+0000 mgr.y (mgr.14140) 72 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[12956]: cephadm 2021-03-10T13:43:34.761310+0000 mgr.y (mgr.14140) 73 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:43:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[12956]: cluster 2021-03-10T13:43:34.970991+0000 mon.a (mon.0) 258 : cluster [INF] osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108] boot 2021-03-10T13:43:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[12956]: cluster 2021-03-10T13:43:34.971038+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:43:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:35 gibba003 bash[12956]: audit 2021-03-10T13:43:34.971525+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:35 gibba043 bash[9839]: audit 2021-03-10T13:43:34.760752+0000 mgr.y (mgr.14140) 72 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:35 gibba043 bash[9839]: cephadm 2021-03-10T13:43:34.761310+0000 mgr.y (mgr.14140) 73 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:43:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:35 gibba043 bash[9839]: cluster 2021-03-10T13:43:34.970991+0000 mon.a (mon.0) 258 : cluster [INF] osd.1 [v2:172.21.2.103:6810/1693323108,v1:172.21.2.103:6811/1693323108] boot 2021-03-10T13:43:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:35 gibba043 bash[9839]: cluster 2021-03-10T13:43:34.971038+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:43:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:35 gibba043 bash[9839]: audit 2021-03-10T13:43:34.971525+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:36 gibba043 bash[9839]: cluster 2021-03-10T13:43:35.862150+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:36 gibba043 bash[9839]: cluster 2021-03-10T13:43:35.984213+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:43:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:36 gibba043 bash[9839]: audit 2021-03-10T13:43:36.298454+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134135"}]: dispatch 2021-03-10T13:43:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:36 gibba043 bash[9839]: audit 2021-03-10T13:43:36.307528+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134135"}]': finished 2021-03-10T13:43:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[9769]: cluster 2021-03-10T13:43:35.862150+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[9769]: cluster 2021-03-10T13:43:35.984213+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:43:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[9769]: audit 2021-03-10T13:43:36.298454+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134135"}]: dispatch 2021-03-10T13:43:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[9769]: audit 2021-03-10T13:43:36.307528+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134135"}]': finished 2021-03-10T13:43:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[12956]: cluster 2021-03-10T13:43:35.862150+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:43:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[12956]: cluster 2021-03-10T13:43:35.984213+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:43:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[12956]: audit 2021-03-10T13:43:36.298454+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134135"}]: dispatch 2021-03-10T13:43:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:36 gibba003 bash[12956]: audit 2021-03-10T13:43:36.307528+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134135"}]': finished 2021-03-10T13:43:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:38 gibba043 bash[9839]: audit 2021-03-10T13:43:37.712953+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.2.103:0/2540458819' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bee355c-eb6f-4174-a4ad-c1927a01db68"}]: dispatch 2021-03-10T13:43:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:38 gibba043 bash[9839]: audit 2021-03-10T13:43:37.717855+0000 mon.a (mon.0) 265 : audit [INF] from='client.? 172.21.2.103:0/2540458819' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bee355c-eb6f-4174-a4ad-c1927a01db68"}]': finished 2021-03-10T13:43:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:38 gibba043 bash[9839]: cluster 2021-03-10T13:43:37.717897+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:43:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:38 gibba043 bash[9839]: audit 2021-03-10T13:43:37.718053+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:37 gibba003 bash[9769]: audit 2021-03-10T13:43:37.712953+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.2.103:0/2540458819' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bee355c-eb6f-4174-a4ad-c1927a01db68"}]: dispatch 2021-03-10T13:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:37 gibba003 bash[9769]: audit 2021-03-10T13:43:37.717855+0000 mon.a (mon.0) 265 : audit [INF] from='client.? 172.21.2.103:0/2540458819' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bee355c-eb6f-4174-a4ad-c1927a01db68"}]': finished 2021-03-10T13:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:37 gibba003 bash[9769]: cluster 2021-03-10T13:43:37.717897+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:43:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:38 gibba003 bash[9769]: audit 2021-03-10T13:43:37.718053+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:38 gibba003 bash[12956]: audit 2021-03-10T13:43:37.712953+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.2.103:0/2540458819' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bee355c-eb6f-4174-a4ad-c1927a01db68"}]: dispatch 2021-03-10T13:43:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:38 gibba003 bash[12956]: audit 2021-03-10T13:43:37.717855+0000 mon.a (mon.0) 265 : audit [INF] from='client.? 172.21.2.103:0/2540458819' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bee355c-eb6f-4174-a4ad-c1927a01db68"}]': finished 2021-03-10T13:43:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:38 gibba003 bash[12956]: cluster 2021-03-10T13:43:37.717897+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:43:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:38 gibba003 bash[12956]: audit 2021-03-10T13:43:37.718053+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:39 gibba043 bash[9839]: cluster 2021-03-10T13:43:37.863027+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:43:39.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:39 gibba003 bash[9769]: cluster 2021-03-10T13:43:37.863027+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:43:39.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:39 gibba003 bash[12956]: cluster 2021-03-10T13:43:37.863027+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:43:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:40 gibba043 bash[9839]: audit 2021-03-10T13:43:39.718159+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.103:0/156353332' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:40.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:40 gibba003 bash[9769]: audit 2021-03-10T13:43:39.718159+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.103:0/156353332' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:40.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:40 gibba003 bash[12956]: audit 2021-03-10T13:43:39.718159+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.103:0/156353332' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:41.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:41 gibba003 bash[9769]: cluster 2021-03-10T13:43:39.863859+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:43:41.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:41 gibba003 bash[12956]: cluster 2021-03-10T13:43:39.863859+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:43:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:41 gibba043 bash[9839]: cluster 2021-03-10T13:43:39.863859+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:43:42.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:42 gibba003 bash[9769]: cluster 2021-03-10T13:43:41.864321+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:42.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:42 gibba003 bash[9769]: cluster 2021-03-10T13:43:42.017290+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:43:42.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:42 gibba003 bash[9769]: cluster 2021-03-10T13:43:42.017388+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:43:42.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:42 gibba003 bash[12956]: cluster 2021-03-10T13:43:41.864321+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:42.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:42 gibba003 bash[12956]: cluster 2021-03-10T13:43:42.017290+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:43:42.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:42 gibba003 bash[12956]: cluster 2021-03-10T13:43:42.017388+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:43:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:42 gibba043 bash[9839]: cluster 2021-03-10T13:43:41.864321+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:42 gibba043 bash[9839]: cluster 2021-03-10T13:43:42.017290+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:43:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:42 gibba043 bash[9839]: cluster 2021-03-10T13:43:42.017388+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:43:43.379 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:43 gibba003 bash[9769]: audit 2021-03-10T13:43:42.236967+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:43.380 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:43 gibba003 bash[12956]: audit 2021-03-10T13:43:42.236967+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:43 gibba043 bash[9839]: audit 2021-03-10T13:43:42.236967+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:45.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:44 gibba003 bash[9769]: cluster 2021-03-10T13:43:43.864684+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:45.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:44 gibba003 bash[12956]: cluster 2021-03-10T13:43:43.864684+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:44 gibba043 bash[9839]: cluster 2021-03-10T13:43:43.864684+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:46.163 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:45 gibba003 bash[9769]: audit 2021-03-10T13:43:45.373498+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:43:46.163 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:45 gibba003 bash[9769]: audit 2021-03-10T13:43:45.374631+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:46.164 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:45 gibba003 bash[9769]: audit 2021-03-10T13:43:45.375415+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:43:46.164 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:45 gibba003 bash[12956]: audit 2021-03-10T13:43:45.373498+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:43:46.164 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:45 gibba003 bash[12956]: audit 2021-03-10T13:43:45.374631+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:46.164 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:45 gibba003 bash[12956]: audit 2021-03-10T13:43:45.375415+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:43:46.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:45 gibba043 bash[9839]: audit 2021-03-10T13:43:45.373498+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:43:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:45 gibba043 bash[9839]: audit 2021-03-10T13:43:45.374631+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:45 gibba043 bash[9839]: audit 2021-03-10T13:43:45.375415+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:43:47.184 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:46 gibba003 bash[9769]: cephadm 2021-03-10T13:43:45.375153+0000 mgr.y (mgr.14140) 79 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:43:47.184 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:46 gibba003 bash[9769]: cluster 2021-03-10T13:43:45.865518+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:47.185 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:46 gibba003 bash[12956]: cephadm 2021-03-10T13:43:45.375153+0000 mgr.y (mgr.14140) 79 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:43:47.185 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:46 gibba003 bash[12956]: cluster 2021-03-10T13:43:45.865518+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:47.185 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:46 gibba003 systemd[1]: Stopping Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:43:47.186 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[16359]: debug 2021-03-10T13:43:47.014+0000 7faa96d29700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:43:47.186 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[16359]: debug 2021-03-10T13:43:47.014+0000 7faa96d29700 -1 osd.1 18 *** Got signal Terminated *** 2021-03-10T13:43:47.186 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[16359]: debug 2021-03-10T13:43:47.014+0000 7faa96d29700 -1 osd.1 18 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:43:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:46 gibba043 bash[9839]: cephadm 2021-03-10T13:43:45.375153+0000 mgr.y (mgr.14140) 79 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:43:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:46 gibba043 bash[9839]: cluster 2021-03-10T13:43:45.865518+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:48.195 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:47 gibba003 docker[17409]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.1 2021-03-10T13:43:48.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.122393+0000 mon.a (mon.0) 274 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.122535+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 failed (root=default,host=gibba003) (connection refused reported by osd.0) 2021-03-10T13:43:48.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.123661+0000 mon.a (mon.0) 276 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.322054+0000 mon.a (mon.0) 277 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.322152+0000 mon.a (mon.0) 278 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.722277+0000 mon.a (mon.0) 279 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.722373+0000 mon.a (mon.0) 280 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.122393+0000 mon.a (mon.0) 274 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.122535+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 failed (root=default,host=gibba003) (connection refused reported by osd.0) 2021-03-10T13:43:48.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.123661+0000 mon.a (mon.0) 276 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.322054+0000 mon.a (mon.0) 277 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.322152+0000 mon.a (mon.0) 278 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.722277+0000 mon.a (mon.0) 279 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:47 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.722373+0000 mon.a (mon.0) 280 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.122393+0000 mon.a (mon.0) 274 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.122535+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 failed (root=default,host=gibba003) (connection refused reported by osd.0) 2021-03-10T13:43:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.123661+0000 mon.a (mon.0) 276 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.322054+0000 mon.a (mon.0) 277 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.322152+0000 mon.a (mon.0) 278 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.722277+0000 mon.a (mon.0) 279 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:47 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.722373+0000 mon.a (mon.0) 280 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:43:49.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.866487+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:49.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.886917+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:43:49.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[9769]: cluster 2021-03-10T13:43:47.899082+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e19: 3 total, 1 up, 2 in 2021-03-10T13:43:49.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[9769]: audit 2021-03-10T13:43:47.899145+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:49.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.866487+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:49.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.886917+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:43:49.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[12956]: cluster 2021-03-10T13:43:47.899082+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e19: 3 total, 1 up, 2 in 2021-03-10T13:43:49.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:48 gibba003 bash[12956]: audit 2021-03-10T13:43:47.899145+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:48 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.866487+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:43:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:48 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.886917+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:43:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:48 gibba043 bash[9839]: cluster 2021-03-10T13:43:47.899082+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e19: 3 total, 1 up, 2 in 2021-03-10T13:43:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:48 gibba043 bash[9839]: audit 2021-03-10T13:43:47.899145+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:49.627 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:49 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.1.service: Succeeded. 2021-03-10T13:43:49.627 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:49 gibba003 systemd[1]: Stopped Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:43:49.627 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:49 gibba003 systemd[1]: Starting Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:43:49.627 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:49 gibba003 docker[17543]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.1 2021-03-10T13:43:49.628 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:49 gibba003 systemd[1]: Started Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:43:50.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: cluster 2021-03-10T13:43:48.908134+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 1 up, 2 in 2021-03-10T13:43:50.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:48.909782+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: cluster 2021-03-10T13:43:48.908134+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 1 up, 2 in 2021-03-10T13:43:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:48.909782+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:49.501033+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:50.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:49.501577+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:50.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:49.501033+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:50.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:49.501577+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:49.505299+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:49.505745+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:43:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:49.506371+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:50.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[12956]: audit 2021-03-10T13:43:49.507037+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:43:50.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:49.505299+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:50.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:49.505745+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:43:50.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:49.506371+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:50.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:49 gibba003 bash[9769]: audit 2021-03-10T13:43:49.507037+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:43:50.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: cluster 2021-03-10T13:43:48.908134+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 1 up, 2 in 2021-03-10T13:43:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:48.909782+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:49.501033+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:49.501577+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:49.505299+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157421\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157502\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157545\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.157583\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:49.505745+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:43:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:49.506371+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:49 gibba043 bash[9839]: audit 2021-03-10T13:43:49.507037+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:43:50.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[9769]: cephadm 2021-03-10T13:43:49.506880+0000 mgr.y (mgr.14140) 82 : cephadm [INF] Deploying daemon osd.2 on gibba003 2021-03-10T13:43:50.996 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[9769]: cluster 2021-03-10T13:43:49.866828+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:50.997 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[12956]: cephadm 2021-03-10T13:43:49.506880+0000 mgr.y (mgr.14140) 82 : cephadm [INF] Deploying daemon osd.2 on gibba003 2021-03-10T13:43:50.997 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[12956]: cluster 2021-03-10T13:43:49.866828+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:50.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[9769]: audit 2021-03-10T13:43:49.969277+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_daemon_update\": \"2021-03-10T13:43:49.968721\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:50.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[9769]: audit 2021-03-10T13:43:49.973073+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_daemon_update\": \"2021-03-10T13:43:49.968721\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:50.998 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[9769]: cluster 2021-03-10T13:43:50.503927+0000 mon.a (mon.0) 294 : cluster [WRN] Health check update: Degraded data redundancy: 2/3 objects degraded (66.667%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:43:50.999 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[12956]: audit 2021-03-10T13:43:49.969277+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_daemon_update\": \"2021-03-10T13:43:49.968721\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:50.999 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[12956]: audit 2021-03-10T13:43:49.973073+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_daemon_update\": \"2021-03-10T13:43:49.968721\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:50.999 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:50 gibba003 bash[12956]: cluster 2021-03-10T13:43:50.503927+0000 mon.a (mon.0) 294 : cluster [WRN] Health check update: Degraded data redundancy: 2/3 objects degraded (66.667%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:43:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:50 gibba043 bash[9839]: cephadm 2021-03-10T13:43:49.506880+0000 mgr.y (mgr.14140) 82 : cephadm [INF] Deploying daemon osd.2 on gibba003 2021-03-10T13:43:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:50 gibba043 bash[9839]: cluster 2021-03-10T13:43:49.866828+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:50 gibba043 bash[9839]: audit 2021-03-10T13:43:49.969277+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_daemon_update\": \"2021-03-10T13:43:49.968721\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:50 gibba043 bash[9839]: audit 2021-03-10T13:43:49.973073+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}}, \"last_daemon_update\": \"2021-03-10T13:43:49.968721\", \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:50 gibba043 bash[9839]: cluster 2021-03-10T13:43:50.503927+0000 mon.a (mon.0) 294 : cluster [WRN] Health check update: Degraded data redundancy: 2/3 objects degraded (66.667%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:43:51.275 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:43:51.275 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:43:51.276 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:43:51.276 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:43:51.276 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:43:51.276 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:43:51.276 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[17560]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:43:51.789 INFO:teuthology.orchestra.run.gibba003.stdout:Created osd(s) 1,2 on host 'gibba003' 2021-03-10T13:43:52.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[9769]: audit 2021-03-10T13:43:51.783565+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:52.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[9769]: audit 2021-03-10T13:43:51.784014+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:52.159 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[9769]: audit 2021-03-10T13:43:51.787315+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:52.160 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[12956]: audit 2021-03-10T13:43:51.783565+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:52.160 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[12956]: audit 2021-03-10T13:43:51.784014+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:52.160 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:51 gibba003 bash[12956]: audit 2021-03-10T13:43:51.787315+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:51 gibba043 bash[9839]: audit 2021-03-10T13:43:51.783565+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:51 gibba043 bash[9839]: audit 2021-03-10T13:43:51.784014+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:51 gibba043 bash[9839]: audit 2021-03-10T13:43:51.787315+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968528\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968590\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968619\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968646\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:49.968673\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_device_update\": \"2021-03-10T13:43:33.126473\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:53.157 DEBUG:teuthology.orchestra.run.gibba003:osd.2> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.2.service 2021-03-10T13:43:53.160 INFO:tasks.cephadm:Deploying osd.3 on gibba003 with /dev/vg_nvme/lv_1... 2021-03-10T13:43:53.160 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T13:43:53.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[9769]: cluster 2021-03-10T13:43:51.867093+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:53.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[12956]: cluster 2021-03-10T13:43:51.867093+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:53.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[9769]: audit 2021-03-10T13:43:52.503890+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:53.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[9769]: audit 2021-03-10T13:43:52.507537+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:53.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[9769]: audit 2021-03-10T13:43:52.508036+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:53.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[12956]: audit 2021-03-10T13:43:52.503890+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:53.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[12956]: audit 2021-03-10T13:43:52.507537+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:53.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:52 gibba003 bash[12956]: audit 2021-03-10T13:43:52.508036+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:53.257 INFO:journalctl@ceph.osd.2.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:52 gibba043 bash[9839]: cluster 2021-03-10T13:43:51.867093+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:52 gibba043 bash[9839]: audit 2021-03-10T13:43:52.503890+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:43:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:52 gibba043 bash[9839]: audit 2021-03-10T13:43:52.507537+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:43:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:52 gibba043 bash[9839]: audit 2021-03-10T13:43:52.508036+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:54.557 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:43:54.557 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T13:43:54.558 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:43:54.558 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:43:54.558 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:43:54.559 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:43:54.559 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[17907]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T13:43:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[9769]: cluster 2021-03-10T13:43:53.867318+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:54 gibba003 bash[12956]: cluster 2021-03-10T13:43:53.867318+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:54 gibba043 bash[9839]: cluster 2021-03-10T13:43:53.867318+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+degraded+peered; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:55.442 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:55 gibba003 bash[17982]: debug 2021-03-10T13:43:55.208+0000 7f8db5e0cec0 -1 Falling back to public interface 2021-03-10T13:43:56.223 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:55 gibba003 bash[17982]: debug 2021-03-10T13:43:55.868+0000 7f8db5e0cec0 -1 osd.1 18 log_to_monitors {default=true} 2021-03-10T13:43:56.223 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:43:55 gibba003 bash[17982]: debug 2021-03-10T13:43:55.876+0000 7f8da5dd5700 -1 osd.1 18 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:43:57.218 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:56 gibba003 bash[9769]: cluster 2021-03-10T13:43:55.867742+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+degraded+peered; 0 B data, 336 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:57.218 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:56 gibba003 bash[9769]: audit 2021-03-10T13:43:55.877765+0000 mon.a (mon.0) 301 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:57.219 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:56 gibba003 bash[9769]: audit 2021-03-10T13:43:55.878096+0000 mon.a (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:57.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:56 gibba003 bash[12956]: cluster 2021-03-10T13:43:55.867742+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+degraded+peered; 0 B data, 336 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:57.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:56 gibba003 bash[12956]: audit 2021-03-10T13:43:55.877765+0000 mon.a (mon.0) 301 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:57.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:56 gibba003 bash[12956]: audit 2021-03-10T13:43:55.878096+0000 mon.a (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:56 gibba043 bash[9839]: cluster 2021-03-10T13:43:55.867742+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+degraded+peered; 0 B data, 336 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:56 gibba043 bash[9839]: audit 2021-03-10T13:43:55.877765+0000 mon.a (mon.0) 301 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:43:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:56 gibba043 bash[9839]: audit 2021-03-10T13:43:55.878096+0000 mon.a (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:43:58.147 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[18319]: debug 2021-03-10T13:43:58.000+0000 7f5ee9f69ec0 -1 Falling back to public interface 2021-03-10T13:43:58.147 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: cluster 2021-03-10T13:43:56.875423+0000 mon.a (mon.0) 303 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:43:58.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: cluster 2021-03-10T13:43:56.886297+0000 mon.a (mon.0) 304 : cluster [INF] osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322] boot 2021-03-10T13:43:58.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: cluster 2021-03-10T13:43:56.886358+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2021-03-10T13:43:58.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: audit 2021-03-10T13:43:56.886808+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:58.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: audit 2021-03-10T13:43:56.886992+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:58.148 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: cluster 2021-03-10T13:43:57.884551+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2021-03-10T13:43:58.149 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[9769]: audit 2021-03-10T13:43:57.884671+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:58.149 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: cluster 2021-03-10T13:43:56.875423+0000 mon.a (mon.0) 303 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:43:58.149 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: cluster 2021-03-10T13:43:56.886297+0000 mon.a (mon.0) 304 : cluster [INF] osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322] boot 2021-03-10T13:43:58.149 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: cluster 2021-03-10T13:43:56.886358+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2021-03-10T13:43:58.150 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: audit 2021-03-10T13:43:56.886808+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:58.150 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: audit 2021-03-10T13:43:56.886992+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:58.150 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: cluster 2021-03-10T13:43:57.884551+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2021-03-10T13:43:58.150 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:57 gibba003 bash[12956]: audit 2021-03-10T13:43:57.884671+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: cluster 2021-03-10T13:43:56.875423+0000 mon.a (mon.0) 303 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:43:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: cluster 2021-03-10T13:43:56.886297+0000 mon.a (mon.0) 304 : cluster [INF] osd.1 [v2:172.21.2.103:6810/1275055322,v1:172.21.2.103:6811/1275055322] boot 2021-03-10T13:43:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: cluster 2021-03-10T13:43:56.886358+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2021-03-10T13:43:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: audit 2021-03-10T13:43:56.886808+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:43:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: audit 2021-03-10T13:43:56.886992+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: cluster 2021-03-10T13:43:57.884551+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2021-03-10T13:43:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:57 gibba043 bash[9839]: audit 2021-03-10T13:43:57.884671+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:43:58.649 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T13:43:58.649 INFO:teuthology.orchestra.run.gibba003.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T13:43:58.649 INFO:teuthology.orchestra.run.gibba003.stderr: stderr: 10+0 records in 2021-03-10T13:43:58.650 INFO:teuthology.orchestra.run.gibba003.stderr:10+0 records out 2021-03-10T13:43:58.650 INFO:teuthology.orchestra.run.gibba003.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00787054 s, 1.3 GB/s 2021-03-10T13:43:58.650 INFO:teuthology.orchestra.run.gibba003.stderr:--> Zapping successful for: 2021-03-10T13:43:58.910 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[18319]: debug 2021-03-10T13:43:58.648+0000 7f5ee9f69ec0 -1 osd.2 0 log_to_monitors {default=true} 2021-03-10T13:43:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[9769]: cluster 2021-03-10T13:43:57.868148+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+degraded+peered; 0 B data, 336 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[9769]: audit 2021-03-10T13:43:58.657183+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:43:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[9769]: audit 2021-03-10T13:43:58.657430+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[12956]: cluster 2021-03-10T13:43:57.868148+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+degraded+peered; 0 B data, 336 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[12956]: audit 2021-03-10T13:43:58.657183+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:58 gibba003 bash[12956]: audit 2021-03-10T13:43:58.657430+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:43:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:58 gibba043 bash[9839]: cluster 2021-03-10T13:43:57.868148+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+degraded+peered; 0 B data, 336 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:43:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:58 gibba043 bash[9839]: audit 2021-03-10T13:43:58.657183+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:43:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:58 gibba043 bash[9839]: audit 2021-03-10T13:43:58.657430+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:43:59.284 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba003:vg_nvme/lv_1 2021-03-10T13:44:00.193 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[18319]: debug 2021-03-10T13:43:59.920+0000 7f5ed2d1e700 -1 osd.2 0 waiting for initial osdmap 2021-03-10T13:44:00.194 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[18319]: debug 2021-03-10T13:43:59.920+0000 7f5eddf3a700 -1 osd.2 24 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:44:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: audit 2021-03-10T13:43:58.905201+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:44:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: cluster 2021-03-10T13:43:58.905283+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e23: 3 total, 2 up, 2 in 2021-03-10T13:44:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: audit 2021-03-10T13:43:58.906229+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: audit 2021-03-10T13:43:58.907647+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: audit 2021-03-10T13:43:58.910966+0000 mon.a (mon.0) 314 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: cluster 2021-03-10T13:43:59.644324+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[9769]: cluster 2021-03-10T13:43:59.644424+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: audit 2021-03-10T13:43:58.905201+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:44:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: cluster 2021-03-10T13:43:58.905283+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e23: 3 total, 2 up, 2 in 2021-03-10T13:44:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: audit 2021-03-10T13:43:58.906229+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: audit 2021-03-10T13:43:58.907647+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: audit 2021-03-10T13:43:58.910966+0000 mon.a (mon.0) 314 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: cluster 2021-03-10T13:43:59.644324+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:43:59 gibba003 bash[12956]: cluster 2021-03-10T13:43:59.644424+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: audit 2021-03-10T13:43:58.905201+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:44:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: cluster 2021-03-10T13:43:58.905283+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e23: 3 total, 2 up, 2 in 2021-03-10T13:44:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: audit 2021-03-10T13:43:58.906229+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: audit 2021-03-10T13:43:58.907647+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: audit 2021-03-10T13:43:58.910966+0000 mon.a (mon.0) 314 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: cluster 2021-03-10T13:43:59.644324+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:43:59 gibba043 bash[9839]: cluster 2021-03-10T13:43:59.644424+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:00.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: cluster 2021-03-10T13:43:59.868775+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+degraded+peered; 0 B data, 352 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:44:00.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: audit 2021-03-10T13:43:59.915669+0000 mon.a (mon.0) 315 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:44:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: cluster 2021-03-10T13:43:59.915702+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e24: 3 total, 2 up, 2 in 2021-03-10T13:44:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: audit 2021-03-10T13:43:59.916289+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: audit 2021-03-10T13:43:59.921002+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: cluster 2021-03-10T13:43:59.868775+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+degraded+peered; 0 B data, 352 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:44:01.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: audit 2021-03-10T13:43:59.915669+0000 mon.a (mon.0) 315 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:44:01.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: cluster 2021-03-10T13:43:59.915702+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e24: 3 total, 2 up, 2 in 2021-03-10T13:44:01.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: audit 2021-03-10T13:43:59.916289+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:01.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: audit 2021-03-10T13:43:59.921002+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:01.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: audit 2021-03-10T13:44:00.019329+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:01.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[9769]: audit 2021-03-10T13:44:00.023412+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:01.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: audit 2021-03-10T13:44:00.019329+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:01.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:00 gibba003 bash[12956]: audit 2021-03-10T13:44:00.023412+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: cluster 2021-03-10T13:43:59.868775+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+degraded+peered; 0 B data, 352 KiB used, 166 GiB / 168 GiB avail; 2/3 objects degraded (66.667%) 2021-03-10T13:44:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: audit 2021-03-10T13:43:59.915669+0000 mon.a (mon.0) 315 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:44:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: cluster 2021-03-10T13:43:59.915702+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e24: 3 total, 2 up, 2 in 2021-03-10T13:44:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: audit 2021-03-10T13:43:59.916289+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: audit 2021-03-10T13:43:59.921002+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: audit 2021-03-10T13:44:00.019329+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:01.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:00 gibba043 bash[9839]: audit 2021-03-10T13:44:00.023412+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}}, \"last_daemon_update\": \"2021-03-10T13:43:52.503351\", \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[9769]: cluster 2021-03-10T13:44:00.932801+0000 mon.a (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710] boot 2021-03-10T13:44:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[9769]: cluster 2021-03-10T13:44:00.932846+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2021-03-10T13:44:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[9769]: audit 2021-03-10T13:44:00.933374+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:02.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[9769]: cluster 2021-03-10T13:44:01.931639+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2021-03-10T13:44:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[12956]: cluster 2021-03-10T13:44:00.932801+0000 mon.a (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710] boot 2021-03-10T13:44:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[12956]: cluster 2021-03-10T13:44:00.932846+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2021-03-10T13:44:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[12956]: audit 2021-03-10T13:44:00.933374+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:02.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:01 gibba003 bash[12956]: cluster 2021-03-10T13:44:01.931639+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2021-03-10T13:44:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:01 gibba043 bash[9839]: cluster 2021-03-10T13:44:00.932801+0000 mon.a (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.2.103:6818/3060648710,v1:172.21.2.103:6819/3060648710] boot 2021-03-10T13:44:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:01 gibba043 bash[9839]: cluster 2021-03-10T13:44:00.932846+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2021-03-10T13:44:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:01 gibba043 bash[9839]: audit 2021-03-10T13:44:00.933374+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:44:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:01 gibba043 bash[9839]: cluster 2021-03-10T13:44:01.931639+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2021-03-10T13:44:03.271 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[9769]: cluster 2021-03-10T13:44:01.869517+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized+degraded; 0 B data, 400 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:03.271 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[9769]: cluster 2021-03-10T13:44:01.936331+0000 mon.a (mon.0) 325 : cluster [WRN] Health check update: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:44:03.271 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[9769]: audit 2021-03-10T13:44:02.101500+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:03.272 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[9769]: audit 2021-03-10T13:44:02.102327+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:03.272 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[9769]: audit 2021-03-10T13:44:02.103333+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:03.272 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[12956]: cluster 2021-03-10T13:44:01.869517+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized+degraded; 0 B data, 400 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:03.272 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[12956]: cluster 2021-03-10T13:44:01.936331+0000 mon.a (mon.0) 325 : cluster [WRN] Health check update: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:44:03.273 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[12956]: audit 2021-03-10T13:44:02.101500+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:03.273 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[12956]: audit 2021-03-10T13:44:02.102327+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:03.273 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:02 gibba003 bash[12956]: audit 2021-03-10T13:44:02.103333+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:02 gibba043 bash[9839]: cluster 2021-03-10T13:44:01.869517+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized+degraded; 0 B data, 400 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:02 gibba043 bash[9839]: cluster 2021-03-10T13:44:01.936331+0000 mon.a (mon.0) 325 : cluster [WRN] Health check update: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:44:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:02 gibba043 bash[9839]: audit 2021-03-10T13:44:02.101500+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:02 gibba043 bash[9839]: audit 2021-03-10T13:44:02.102327+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:03.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:02 gibba043 bash[9839]: audit 2021-03-10T13:44:02.103333+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:03 gibba043 bash[9839]: audit 2021-03-10T13:44:02.100877+0000 mgr.y (mgr.14140) 90 : audit [DBG] from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:03 gibba043 bash[9839]: cephadm 2021-03-10T13:44:02.101328+0000 mgr.y (mgr.14140) 91 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:44:04.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:03 gibba003 bash[9769]: audit 2021-03-10T13:44:02.100877+0000 mgr.y (mgr.14140) 90 : audit [DBG] from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:04.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:03 gibba003 bash[9769]: cephadm 2021-03-10T13:44:02.101328+0000 mgr.y (mgr.14140) 91 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:44:04.397 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:03 gibba003 bash[12956]: audit 2021-03-10T13:44:02.100877+0000 mgr.y (mgr.14140) 90 : audit [DBG] from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:04.397 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:03 gibba003 bash[12956]: cephadm 2021-03-10T13:44:02.101328+0000 mgr.y (mgr.14140) 91 : cephadm [INF] Applying osd on host gibba003... 2021-03-10T13:44:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:04 gibba043 bash[9839]: cluster 2021-03-10T13:44:03.869848+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized+degraded; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:04 gibba003 bash[9769]: cluster 2021-03-10T13:44:03.869848+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized+degraded; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:04 gibba003 bash[12956]: cluster 2021-03-10T13:44:03.869848+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized+degraded; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:05 gibba043 bash[9839]: audit 2021-03-10T13:44:05.064729+0000 mon.a (mon.0) 329 : audit [INF] from='client.? 172.21.2.103:0/972852894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd6542e9-2018-4531-8712-34829d2fa049"}]: dispatch 2021-03-10T13:44:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:05 gibba043 bash[9839]: audit 2021-03-10T13:44:05.069887+0000 mon.a (mon.0) 330 : audit [INF] from='client.? 172.21.2.103:0/972852894' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd6542e9-2018-4531-8712-34829d2fa049"}]': finished 2021-03-10T13:44:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:05 gibba043 bash[9839]: cluster 2021-03-10T13:44:05.069909+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2021-03-10T13:44:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:05 gibba043 bash[9839]: audit 2021-03-10T13:44:05.070061+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:06.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[9769]: audit 2021-03-10T13:44:05.064729+0000 mon.a (mon.0) 329 : audit [INF] from='client.? 172.21.2.103:0/972852894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd6542e9-2018-4531-8712-34829d2fa049"}]: dispatch 2021-03-10T13:44:06.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[9769]: audit 2021-03-10T13:44:05.069887+0000 mon.a (mon.0) 330 : audit [INF] from='client.? 172.21.2.103:0/972852894' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd6542e9-2018-4531-8712-34829d2fa049"}]': finished 2021-03-10T13:44:06.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[9769]: cluster 2021-03-10T13:44:05.069909+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2021-03-10T13:44:06.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[9769]: audit 2021-03-10T13:44:05.070061+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[12956]: audit 2021-03-10T13:44:05.064729+0000 mon.a (mon.0) 329 : audit [INF] from='client.? 172.21.2.103:0/972852894' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd6542e9-2018-4531-8712-34829d2fa049"}]: dispatch 2021-03-10T13:44:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[12956]: audit 2021-03-10T13:44:05.069887+0000 mon.a (mon.0) 330 : audit [INF] from='client.? 172.21.2.103:0/972852894' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd6542e9-2018-4531-8712-34829d2fa049"}]': finished 2021-03-10T13:44:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[12956]: cluster 2021-03-10T13:44:05.069909+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2021-03-10T13:44:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:05 gibba003 bash[12956]: audit 2021-03-10T13:44:05.070061+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:06 gibba043 bash[9839]: cluster 2021-03-10T13:44:05.870586+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized+degraded; 0 B data, 648 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:06 gibba003 bash[9769]: cluster 2021-03-10T13:44:05.870586+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized+degraded; 0 B data, 648 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:06 gibba003 bash[12956]: cluster 2021-03-10T13:44:05.870586+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized+degraded; 0 B data, 648 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:44:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:07 gibba043 bash[9839]: audit 2021-03-10T13:44:07.162219+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.103:0/2727126459' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:07 gibba003 bash[9769]: audit 2021-03-10T13:44:07.162219+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.103:0/2727126459' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:07 gibba003 bash[12956]: audit 2021-03-10T13:44:07.162219+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.103:0/2727126459' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:08 gibba043 bash[9839]: cluster 2021-03-10T13:44:07.871193+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 688 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:08 gibba043 bash[9839]: cluster 2021-03-10T13:44:07.957875+0000 mon.a (mon.0) 333 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:44:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:08 gibba043 bash[9839]: cluster 2021-03-10T13:44:07.958011+0000 mon.a (mon.0) 334 : cluster [INF] Cluster is now healthy 2021-03-10T13:44:09.328 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:08 gibba003 bash[9769]: cluster 2021-03-10T13:44:07.871193+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 688 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:09.329 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:08 gibba003 bash[9769]: cluster 2021-03-10T13:44:07.957875+0000 mon.a (mon.0) 333 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:44:09.329 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:08 gibba003 bash[9769]: cluster 2021-03-10T13:44:07.958011+0000 mon.a (mon.0) 334 : cluster [INF] Cluster is now healthy 2021-03-10T13:44:09.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:08 gibba003 bash[12956]: cluster 2021-03-10T13:44:07.871193+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 688 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:09.330 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:08 gibba003 bash[12956]: cluster 2021-03-10T13:44:07.957875+0000 mon.a (mon.0) 333 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:44:09.330 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:08 gibba003 bash[12956]: cluster 2021-03-10T13:44:07.958011+0000 mon.a (mon.0) 334 : cluster [INF] Cluster is now healthy 2021-03-10T13:44:10.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:09 gibba003 bash[9769]: audit 2021-03-10T13:44:09.739081+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:10.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:09 gibba003 bash[12956]: audit 2021-03-10T13:44:09.739081+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:09 gibba043 bash[9839]: audit 2021-03-10T13:44:09.739081+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:11.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:10 gibba003 bash[9769]: cluster 2021-03-10T13:44:09.871748+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:11.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:11 gibba003 bash[12956]: cluster 2021-03-10T13:44:09.871748+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:11 gibba043 bash[9839]: cluster 2021-03-10T13:44:09.871748+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:13 gibba003 bash[9769]: cluster 2021-03-10T13:44:11.872468+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:13.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:13 gibba003 bash[12956]: cluster 2021-03-10T13:44:11.872468+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:13 gibba043 bash[9839]: cluster 2021-03-10T13:44:11.872468+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:14 gibba043 bash[9839]: audit 2021-03-10T13:44:13.195842+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:44:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:14 gibba043 bash[9839]: audit 2021-03-10T13:44:13.196745+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:14 gibba043 bash[9839]: audit 2021-03-10T13:44:13.197551+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:44:14.337 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:14 gibba003 bash[9769]: audit 2021-03-10T13:44:13.195842+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:44:14.337 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:14 gibba003 bash[9769]: audit 2021-03-10T13:44:13.196745+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:14.337 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:14 gibba003 bash[9769]: audit 2021-03-10T13:44:13.197551+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:44:14.338 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:14 gibba003 bash[12956]: audit 2021-03-10T13:44:13.195842+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:44:14.338 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:14 gibba003 bash[12956]: audit 2021-03-10T13:44:13.196745+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:14.338 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:14 gibba003 bash[12956]: audit 2021-03-10T13:44:13.197551+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:44:15.066 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:15 gibba003 bash[12956]: cephadm 2021-03-10T13:44:13.197359+0000 mgr.y (mgr.14140) 97 : cephadm [INF] Deploying daemon osd.3 on gibba003 2021-03-10T13:44:15.066 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:15 gibba003 bash[12956]: cluster 2021-03-10T13:44:13.872878+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:15.067 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:15 gibba003 bash[9769]: cephadm 2021-03-10T13:44:13.197359+0000 mgr.y (mgr.14140) 97 : cephadm [INF] Deploying daemon osd.3 on gibba003 2021-03-10T13:44:15.067 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:15 gibba003 bash[9769]: cluster 2021-03-10T13:44:13.872878+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:15.101 INFO:teuthology.orchestra.run.gibba003.stdout:Created osd(s) 3 on host 'gibba003' 2021-03-10T13:44:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:15 gibba043 bash[9839]: cephadm 2021-03-10T13:44:13.197359+0000 mgr.y (mgr.14140) 97 : cephadm [INF] Deploying daemon osd.3 on gibba003 2021-03-10T13:44:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:15 gibba043 bash[9839]: cluster 2021-03-10T13:44:13.872878+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:16.245 DEBUG:teuthology.orchestra.run.gibba003:osd.3> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.3.service 2021-03-10T13:44:16.248 INFO:tasks.cephadm:Deploying osd.4 on gibba043 with /dev/vg_nvme/lv_4... 2021-03-10T13:44:16.248 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T13:44:16.334 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:16 gibba043 bash[9839]: audit 2021-03-10T13:44:15.093749+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:16.335 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:16 gibba043 bash[9839]: audit 2021-03-10T13:44:15.094284+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:16.335 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:16 gibba043 bash[9839]: audit 2021-03-10T13:44:15.097494+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:16.335 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:16 gibba043 bash[9839]: audit 2021-03-10T13:44:15.635336+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:16.336 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:16 gibba043 bash[9839]: audit 2021-03-10T13:44:15.639077+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:16.336 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:16 gibba043 bash[9839]: audit 2021-03-10T13:44:15.639587+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:16.362 INFO:journalctl@ceph.osd.3.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[9769]: audit 2021-03-10T13:44:15.093749+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[9769]: audit 2021-03-10T13:44:15.094284+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:16.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[12956]: audit 2021-03-10T13:44:15.093749+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:16.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[12956]: audit 2021-03-10T13:44:15.094284+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:16.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[12956]: audit 2021-03-10T13:44:15.097494+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[9769]: audit 2021-03-10T13:44:15.097494+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503146\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503204\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503233\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503260\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503286\", \"created\": \"2021-03-10T13:43:25.670427\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:52.503301\", \"created\": \"2021-03-10T13:43:51.772801\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_device_update\": \"2021-03-10T13:44:00.018719\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:16.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[12956]: audit 2021-03-10T13:44:15.635336+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:16.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[9769]: audit 2021-03-10T13:44:15.635336+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:16.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[9769]: audit 2021-03-10T13:44:15.639077+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:16.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[9769]: audit 2021-03-10T13:44:15.639587+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:16.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[12956]: audit 2021-03-10T13:44:15.639077+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:16.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:16 gibba003 bash[12956]: audit 2021-03-10T13:44:15.639587+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:17.350 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:17 gibba043 bash[9839]: cluster 2021-03-10T13:44:15.873586+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[9769]: cluster 2021-03-10T13:44:15.873586+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[12956]: cluster 2021-03-10T13:44:15.873586+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:17.444 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:44:17.445 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T13:44:17.445 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:44:17.445 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:44:17.445 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:44:17.446 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:44:17.446 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:17 gibba003 bash[19549]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T13:44:19.094 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T13:44:19.094 INFO:teuthology.orchestra.run.gibba043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T13:44:19.094 INFO:teuthology.orchestra.run.gibba043.stderr: stderr: 10+0 records in 2021-03-10T13:44:19.095 INFO:teuthology.orchestra.run.gibba043.stderr:10+0 records out 2021-03-10T13:44:19.095 INFO:teuthology.orchestra.run.gibba043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0253584 s, 414 MB/s 2021-03-10T13:44:19.095 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping successful for: 2021-03-10T13:44:19.294 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:19 gibba003 bash[9769]: cluster 2021-03-10T13:44:17.873989+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:19.295 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:19 gibba003 bash[12956]: cluster 2021-03-10T13:44:17.873989+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:19.355 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:19 gibba043 bash[9839]: cluster 2021-03-10T13:44:17.873989+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:19.728 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba043:vg_nvme/lv_4 2021-03-10T13:44:20.193 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:19 gibba003 bash[19890]: debug 2021-03-10T13:44:19.844+0000 7f8d04dbfec0 -1 Falling back to public interface 2021-03-10T13:44:20.944 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:20 gibba003 bash[19890]: debug 2021-03-10T13:44:20.480+0000 7f8d04dbfec0 -1 osd.3 0 log_to_monitors {default=true} 2021-03-10T13:44:21.233 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:21 gibba043 bash[9839]: cluster 2021-03-10T13:44:19.874658+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:21.234 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:21 gibba043 bash[9839]: audit 2021-03-10T13:44:20.488571+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:44:21.234 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:21 gibba043 bash[9839]: audit 2021-03-10T13:44:20.488885+0000 mon.a (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:44:21.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:21 gibba003 bash[9769]: cluster 2021-03-10T13:44:19.874658+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:21.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:21 gibba003 bash[9769]: audit 2021-03-10T13:44:20.488571+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:44:21.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:21 gibba003 bash[9769]: audit 2021-03-10T13:44:20.488885+0000 mon.a (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:44:21.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:21 gibba003 bash[12956]: cluster 2021-03-10T13:44:19.874658+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:21.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:21 gibba003 bash[12956]: audit 2021-03-10T13:44:20.488571+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:44:21.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:21 gibba003 bash[12956]: audit 2021-03-10T13:44:20.488885+0000 mon.a (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:44:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.049552+0000 mon.a (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:44:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: cluster 2021-03-10T13:44:21.049590+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e28: 4 total, 3 up, 3 in 2021-03-10T13:44:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.050383+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.050562+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.050978+0000 mon.a (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.106411+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.207222+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:22 gibba043 bash[9839]: audit 2021-03-10T13:44:21.210563+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:22.444 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[19890]: debug 2021-03-10T13:44:22.052+0000 7f8cedb74700 -1 osd.3 0 waiting for initial osdmap 2021-03-10T13:44:22.444 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[19890]: debug 2021-03-10T13:44:22.056+0000 7f8cf8d90700 -1 osd.3 29 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:44:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.049552+0000 mon.a (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:44:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: cluster 2021-03-10T13:44:21.049590+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e28: 4 total, 3 up, 3 in 2021-03-10T13:44:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.050383+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.050562+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.050978+0000 mon.a (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.106411+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.049552+0000 mon.a (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:44:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: cluster 2021-03-10T13:44:21.049590+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e28: 4 total, 3 up, 3 in 2021-03-10T13:44:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.050383+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.050562+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.050978+0000 mon.a (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:44:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.106411+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.207222+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:22.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[9769]: audit 2021-03-10T13:44:21.210563+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.207222+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:44:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:22 gibba003 bash[12956]: audit 2021-03-10T13:44:21.210563+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}}, \"last_daemon_update\": \"2021-03-10T13:44:15.634697\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:44:23.329 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: cluster 2021-03-10T13:44:21.534627+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:23.389 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: cluster 2021-03-10T13:44:21.534752+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:23.389 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: cluster 2021-03-10T13:44:21.875468+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:23.389 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: audit 2021-03-10T13:44:22.053293+0000 mon.a (mon.0) 353 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:44:23.390 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: cluster 2021-03-10T13:44:22.053319+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e29: 4 total, 3 up, 3 in 2021-03-10T13:44:23.390 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: audit 2021-03-10T13:44:22.053479+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:23.390 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: audit 2021-03-10T13:44:22.238309+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:23.390 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: audit 2021-03-10T13:44:22.239327+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:23.390 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:23 gibba043 bash[9839]: audit 2021-03-10T13:44:22.240527+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: cluster 2021-03-10T13:44:21.534627+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: cluster 2021-03-10T13:44:21.534752+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:23.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: cluster 2021-03-10T13:44:21.875468+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:23.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: audit 2021-03-10T13:44:22.053293+0000 mon.a (mon.0) 353 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:44:23.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: cluster 2021-03-10T13:44:22.053319+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e29: 4 total, 3 up, 3 in 2021-03-10T13:44:23.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: audit 2021-03-10T13:44:22.053479+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:23.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: audit 2021-03-10T13:44:22.238309+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:23.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: audit 2021-03-10T13:44:22.239327+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:23.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[9769]: audit 2021-03-10T13:44:22.240527+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: cluster 2021-03-10T13:44:21.534627+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: cluster 2021-03-10T13:44:21.534752+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: cluster 2021-03-10T13:44:21.875468+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 696 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: audit 2021-03-10T13:44:22.053293+0000 mon.a (mon.0) 353 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]': finished 2021-03-10T13:44:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: cluster 2021-03-10T13:44:22.053319+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e29: 4 total, 3 up, 3 in 2021-03-10T13:44:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: audit 2021-03-10T13:44:22.053479+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: audit 2021-03-10T13:44:22.238309+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: audit 2021-03-10T13:44:22.239327+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:23 gibba003 bash[12956]: audit 2021-03-10T13:44:22.240527+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:24 gibba043 bash[9839]: audit 2021-03-10T13:44:22.237249+0000 mgr.y (mgr.14140) 103 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:24 gibba043 bash[9839]: cephadm 2021-03-10T13:44:22.237999+0000 mgr.y (mgr.14140) 104 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:44:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:24 gibba043 bash[9839]: cluster 2021-03-10T13:44:23.067165+0000 mon.a (mon.0) 359 : cluster [INF] osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074] boot 2021-03-10T13:44:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:24 gibba043 bash[9839]: cluster 2021-03-10T13:44:23.067238+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e30: 4 total, 4 up, 4 in 2021-03-10T13:44:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:24 gibba043 bash[9839]: audit 2021-03-10T13:44:23.067832+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[9769]: audit 2021-03-10T13:44:22.237249+0000 mgr.y (mgr.14140) 103 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[9769]: cephadm 2021-03-10T13:44:22.237999+0000 mgr.y (mgr.14140) 104 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:44:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[9769]: cluster 2021-03-10T13:44:23.067165+0000 mon.a (mon.0) 359 : cluster [INF] osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074] boot 2021-03-10T13:44:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[9769]: cluster 2021-03-10T13:44:23.067238+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e30: 4 total, 4 up, 4 in 2021-03-10T13:44:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[9769]: audit 2021-03-10T13:44:23.067832+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:24.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[12956]: audit 2021-03-10T13:44:22.237249+0000 mgr.y (mgr.14140) 103 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:24.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[12956]: cephadm 2021-03-10T13:44:22.237999+0000 mgr.y (mgr.14140) 104 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:44:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[12956]: cluster 2021-03-10T13:44:23.067165+0000 mon.a (mon.0) 359 : cluster [INF] osd.3 [v2:172.21.2.103:6826/1193170074,v1:172.21.2.103:6827/1193170074] boot 2021-03-10T13:44:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[12956]: cluster 2021-03-10T13:44:23.067238+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e30: 4 total, 4 up, 4 in 2021-03-10T13:44:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:24 gibba003 bash[12956]: audit 2021-03-10T13:44:23.067832+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:44:25.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:25 gibba003 bash[9769]: cluster 2021-03-10T13:44:23.875862+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 704 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:25.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:25 gibba003 bash[9769]: cluster 2021-03-10T13:44:24.085861+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e31: 4 total, 4 up, 4 in 2021-03-10T13:44:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:25 gibba003 bash[12956]: cluster 2021-03-10T13:44:23.875862+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 704 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:25 gibba003 bash[12956]: cluster 2021-03-10T13:44:24.085861+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e31: 4 total, 4 up, 4 in 2021-03-10T13:44:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:25 gibba043 bash[9839]: cluster 2021-03-10T13:44:23.875862+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 704 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:44:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:25 gibba043 bash[9839]: cluster 2021-03-10T13:44:24.085861+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e31: 4 total, 4 up, 4 in 2021-03-10T13:44:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[9769]: audit 2021-03-10T13:44:25.196343+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.143:0/3786408044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]: dispatch 2021-03-10T13:44:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[9769]: audit 2021-03-10T13:44:25.196977+0000 mon.a (mon.0) 363 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]: dispatch 2021-03-10T13:44:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[9769]: audit 2021-03-10T13:44:25.208059+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]': finished 2021-03-10T13:44:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[9769]: cluster 2021-03-10T13:44:25.208200+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2021-03-10T13:44:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[9769]: audit 2021-03-10T13:44:25.208498+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[9769]: cluster 2021-03-10T13:44:25.876517+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[12956]: audit 2021-03-10T13:44:25.196343+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.143:0/3786408044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]: dispatch 2021-03-10T13:44:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[12956]: audit 2021-03-10T13:44:25.196977+0000 mon.a (mon.0) 363 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]: dispatch 2021-03-10T13:44:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[12956]: audit 2021-03-10T13:44:25.208059+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]': finished 2021-03-10T13:44:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[12956]: cluster 2021-03-10T13:44:25.208200+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2021-03-10T13:44:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[12956]: audit 2021-03-10T13:44:25.208498+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:26 gibba003 bash[12956]: cluster 2021-03-10T13:44:25.876517+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:26 gibba043 bash[9839]: audit 2021-03-10T13:44:25.196343+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.143:0/3786408044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]: dispatch 2021-03-10T13:44:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:26 gibba043 bash[9839]: audit 2021-03-10T13:44:25.196977+0000 mon.a (mon.0) 363 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]: dispatch 2021-03-10T13:44:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:26 gibba043 bash[9839]: audit 2021-03-10T13:44:25.208059+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e34f549d-6455-4902-8e28-b62de18179cf"}]': finished 2021-03-10T13:44:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:26 gibba043 bash[9839]: cluster 2021-03-10T13:44:25.208200+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2021-03-10T13:44:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:26 gibba043 bash[9839]: audit 2021-03-10T13:44:25.208498+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:26.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:26 gibba043 bash[9839]: cluster 2021-03-10T13:44:25.876517+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:27 gibba003 bash[9769]: audit 2021-03-10T13:44:27.291001+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.143:0/2347376591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:27.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:27 gibba003 bash[12956]: audit 2021-03-10T13:44:27.291001+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.143:0/2347376591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:27 gibba043 bash[9839]: audit 2021-03-10T13:44:27.291001+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.143:0/2347376591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:28.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:28 gibba003 bash[9769]: cluster 2021-03-10T13:44:27.877361+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:28.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:28 gibba003 bash[12956]: cluster 2021-03-10T13:44:27.877361+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:28.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:28 gibba043 bash[9839]: cluster 2021-03-10T13:44:27.877361+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.0 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:29 gibba043 bash[9839]: audit 2021-03-10T13:44:29.891604+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:30.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:29 gibba003 bash[9769]: audit 2021-03-10T13:44:29.891604+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:30.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:29 gibba003 bash[12956]: audit 2021-03-10T13:44:29.891604+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:30 gibba043 bash[9839]: cluster 2021-03-10T13:44:29.878166+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:31.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:30 gibba003 bash[9769]: cluster 2021-03-10T13:44:29.878166+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:30 gibba003 bash[12956]: cluster 2021-03-10T13:44:29.878166+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:32 gibba043 bash[9839]: cluster 2021-03-10T13:44:31.879197+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:33.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:32 gibba003 bash[9769]: cluster 2021-03-10T13:44:31.879197+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:32 gibba003 bash[12956]: cluster 2021-03-10T13:44:31.879197+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:34.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:33 gibba043 bash[9839]: audit 2021-03-10T13:44:33.151697+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:44:34.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:33 gibba043 bash[9839]: audit 2021-03-10T13:44:33.154565+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:34.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:33 gibba043 bash[9839]: audit 2021-03-10T13:44:33.157970+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:44:34.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:33 gibba003 bash[9769]: audit 2021-03-10T13:44:33.151697+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:44:34.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:33 gibba003 bash[9769]: audit 2021-03-10T13:44:33.154565+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:34.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:33 gibba003 bash[9769]: audit 2021-03-10T13:44:33.157970+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:44:34.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:33 gibba003 bash[12956]: audit 2021-03-10T13:44:33.151697+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:44:34.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:33 gibba003 bash[12956]: audit 2021-03-10T13:44:33.154565+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:34.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:33 gibba003 bash[12956]: audit 2021-03-10T13:44:33.157970+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:44:35.010 INFO:teuthology.orchestra.run.gibba043.stdout:Created osd(s) 4 on host 'gibba043' 2021-03-10T13:44:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:34 gibba043 bash[9839]: cephadm 2021-03-10T13:44:33.157014+0000 mgr.y (mgr.14140) 110 : cephadm [INF] Deploying daemon osd.4 on gibba043 2021-03-10T13:44:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:34 gibba043 bash[9839]: cluster 2021-03-10T13:44:33.879852+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:35.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:34 gibba003 bash[9769]: cephadm 2021-03-10T13:44:33.157014+0000 mgr.y (mgr.14140) 110 : cephadm [INF] Deploying daemon osd.4 on gibba043 2021-03-10T13:44:35.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:34 gibba003 bash[9769]: cluster 2021-03-10T13:44:33.879852+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:34 gibba003 bash[12956]: cephadm 2021-03-10T13:44:33.157014+0000 mgr.y (mgr.14140) 110 : cephadm [INF] Deploying daemon osd.4 on gibba043 2021-03-10T13:44:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:34 gibba003 bash[12956]: cluster 2021-03-10T13:44:33.879852+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:36.128 DEBUG:teuthology.orchestra.run.gibba043:osd.4> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.4.service 2021-03-10T13:44:36.131 INFO:tasks.cephadm:Deploying osd.5 on gibba043 with /dev/vg_nvme/lv_3... 2021-03-10T13:44:36.132 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T13:44:36.243 INFO:journalctl@ceph.osd.4.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:36.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:35 gibba043 bash[9839]: audit 2021-03-10T13:44:35.002988+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:36.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:35 gibba043 bash[9839]: audit 2021-03-10T13:44:35.003582+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:35 gibba043 bash[9839]: audit 2021-03-10T13:44:35.005913+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:35 gibba043 bash[9839]: audit 2021-03-10T13:44:35.419376+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:35 gibba043 bash[9839]: audit 2021-03-10T13:44:35.428126+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:35 gibba043 bash[9839]: audit 2021-03-10T13:44:35.429047+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[9769]: audit 2021-03-10T13:44:35.002988+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:36.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[9769]: audit 2021-03-10T13:44:35.003582+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[12956]: audit 2021-03-10T13:44:35.002988+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[12956]: audit 2021-03-10T13:44:35.003582+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:36.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[9769]: audit 2021-03-10T13:44:35.005913+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[12956]: audit 2021-03-10T13:44:35.005913+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444237\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444504\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:53.444670\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_device_update\": \"2021-03-10T13:42:09.488334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:36.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[9769]: audit 2021-03-10T13:44:35.419376+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:36.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[9769]: audit 2021-03-10T13:44:35.428126+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:36.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[9769]: audit 2021-03-10T13:44:35.429047+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[12956]: audit 2021-03-10T13:44:35.419376+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[12956]: audit 2021-03-10T13:44:35.428126+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:35 gibba003 bash[12956]: audit 2021-03-10T13:44:35.429047+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:37.111 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:36 gibba043 bash[9839]: cluster 2021-03-10T13:44:35.880224+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:37.375 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:44:37.375 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T13:44:37.375 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:44:37.375 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:44:37.376 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:44:37.376 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:44:37.376 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:37 gibba043 bash[11906]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T13:44:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:36 gibba003 bash[9769]: cluster 2021-03-10T13:44:35.880224+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:36 gibba003 bash[12956]: cluster 2021-03-10T13:44:35.880224+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:39.249 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:38 gibba043 bash[9839]: cluster 2021-03-10T13:44:37.880933+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:38 gibba003 bash[9769]: cluster 2021-03-10T13:44:37.880933+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:39.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:38 gibba003 bash[12956]: cluster 2021-03-10T13:44:37.880933+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:41.006 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:40 gibba043 bash[12217]: debug 2021-03-10T13:44:40.734+0000 7f95fbe48ec0 -1 Falling back to public interface 2021-03-10T13:44:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:41 gibba043 bash[9839]: cluster 2021-03-10T13:44:39.881866+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:41.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:41 gibba003 bash[9769]: cluster 2021-03-10T13:44:39.881866+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:41.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:41 gibba003 bash[12956]: cluster 2021-03-10T13:44:39.881866+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:41.727 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T13:44:41.727 INFO:teuthology.orchestra.run.gibba043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T13:44:41.728 INFO:teuthology.orchestra.run.gibba043.stderr: stderr: 10+0 records in 2021-03-10T13:44:41.728 INFO:teuthology.orchestra.run.gibba043.stderr:10+0 records out 2021-03-10T13:44:41.728 INFO:teuthology.orchestra.run.gibba043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00728975 s, 1.4 GB/s 2021-03-10T13:44:41.728 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping successful for: 2021-03-10T13:44:41.771 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:41 gibba043 bash[12217]: debug 2021-03-10T13:44:41.386+0000 7f95fbe48ec0 -1 osd.4 0 log_to_monitors {default=true} 2021-03-10T13:44:42.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:42 gibba043 bash[9839]: audit 2021-03-10T13:44:41.392492+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:44:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:42 gibba043 bash[9839]: audit 2021-03-10T13:44:41.392707+0000 mon.a (mon.0) 377 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:44:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:42 gibba003 bash[9769]: audit 2021-03-10T13:44:41.392492+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:44:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:42 gibba003 bash[9769]: audit 2021-03-10T13:44:41.392707+0000 mon.a (mon.0) 377 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:44:42.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:42 gibba003 bash[12956]: audit 2021-03-10T13:44:41.392492+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:44:42.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:42 gibba003 bash[12956]: audit 2021-03-10T13:44:41.392707+0000 mon.a (mon.0) 377 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:44:42.613 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba043:vg_nvme/lv_3 2021-03-10T13:44:43.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: cluster 2021-03-10T13:44:41.882694+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.015872+0000 mon.a (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:44:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: cluster 2021-03-10T13:44:42.015898+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e33: 5 total, 4 up, 4 in 2021-03-10T13:44:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.015987+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.024478+0000 mon.a (mon.0) 381 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:44:43.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.024488+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:44:43.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: cluster 2021-03-10T13:44:42.374711+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:43.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: cluster 2021-03-10T13:44:42.374814+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:43.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.608075+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: cluster 2021-03-10T13:44:41.882694+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.015872+0000 mon.a (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:44:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: cluster 2021-03-10T13:44:42.015898+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e33: 5 total, 4 up, 4 in 2021-03-10T13:44:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.015987+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.024478+0000 mon.a (mon.0) 381 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:44:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.024488+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:44:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: cluster 2021-03-10T13:44:42.374711+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: cluster 2021-03-10T13:44:42.374814+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.608075+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.717886+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:43.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[9769]: audit 2021-03-10T13:44:42.725612+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:43.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.717886+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:43.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:43 gibba003 bash[12956]: audit 2021-03-10T13:44:42.725612+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:43.460 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[12217]: debug 2021-03-10T13:44:43.026+0000 7f95e4bfd700 -1 osd.4 0 waiting for initial osdmap 2021-03-10T13:44:43.460 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[12217]: debug 2021-03-10T13:44:43.030+0000 7f95efe19700 -1 osd.4 34 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:44:43.461 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: cluster 2021-03-10T13:44:41.882694+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:43.461 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.015872+0000 mon.a (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:44:43.461 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: cluster 2021-03-10T13:44:42.015898+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e33: 5 total, 4 up, 4 in 2021-03-10T13:44:43.461 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.015987+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:43.461 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.024478+0000 mon.a (mon.0) 381 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:44:43.462 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.024488+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:44:43.462 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: cluster 2021-03-10T13:44:42.374711+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:44:43.462 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: cluster 2021-03-10T13:44:42.374814+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:44:43.462 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.608075+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.463 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.717886+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:43.463 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:43 gibba043 bash[9839]: audit 2021-03-10T13:44:42.725612+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}}, \"last_daemon_update\": \"2021-03-10T13:44:35.417364\", \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:44.173 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:44 gibba043 bash[9839]: audit 2021-03-10T13:44:43.025730+0000 mon.a (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:44:44.174 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:44 gibba043 bash[9839]: cluster 2021-03-10T13:44:43.025786+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e34: 5 total, 4 up, 4 in 2021-03-10T13:44:44.174 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:44 gibba043 bash[9839]: audit 2021-03-10T13:44:43.026400+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:44.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:44 gibba003 bash[9769]: audit 2021-03-10T13:44:43.025730+0000 mon.a (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:44:44.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:44 gibba003 bash[9769]: cluster 2021-03-10T13:44:43.025786+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e34: 5 total, 4 up, 4 in 2021-03-10T13:44:44.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:44 gibba003 bash[9769]: audit 2021-03-10T13:44:43.026400+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:44.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:44 gibba003 bash[12956]: audit 2021-03-10T13:44:43.025730+0000 mon.a (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:44:44.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:44 gibba003 bash[12956]: cluster 2021-03-10T13:44:43.025786+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e34: 5 total, 4 up, 4 in 2021-03-10T13:44:44.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:44 gibba003 bash[12956]: audit 2021-03-10T13:44:43.026400+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:45 gibba043 bash[9839]: cluster 2021-03-10T13:44:43.883339+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:45 gibba043 bash[9839]: cluster 2021-03-10T13:44:44.030245+0000 mon.a (mon.0) 388 : cluster [INF] osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690] boot 2021-03-10T13:44:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:45 gibba043 bash[9839]: cluster 2021-03-10T13:44:44.030281+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2021-03-10T13:44:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:45 gibba043 bash[9839]: audit 2021-03-10T13:44:44.030362+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:45.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[9769]: cluster 2021-03-10T13:44:43.883339+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:45.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[9769]: cluster 2021-03-10T13:44:44.030245+0000 mon.a (mon.0) 388 : cluster [INF] osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690] boot 2021-03-10T13:44:45.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[9769]: cluster 2021-03-10T13:44:44.030281+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2021-03-10T13:44:45.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[9769]: audit 2021-03-10T13:44:44.030362+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:45.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[12956]: cluster 2021-03-10T13:44:43.883339+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 MiB used, 332 GiB / 336 GiB avail 2021-03-10T13:44:45.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[12956]: cluster 2021-03-10T13:44:44.030245+0000 mon.a (mon.0) 388 : cluster [INF] osd.4 [v2:172.21.2.143:6800/3764758690,v1:172.21.2.143:6801/3764758690] boot 2021-03-10T13:44:45.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[12956]: cluster 2021-03-10T13:44:44.030281+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2021-03-10T13:44:45.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:45 gibba003 bash[12956]: audit 2021-03-10T13:44:44.030362+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:44:46.398 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:46 gibba043 bash[9839]: cluster 2021-03-10T13:44:45.034001+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e36: 5 total, 5 up, 5 in 2021-03-10T13:44:46.399 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:46 gibba043 bash[9839]: audit 2021-03-10T13:44:45.164243+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:46.399 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:46 gibba043 bash[9839]: audit 2021-03-10T13:44:45.167349+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:46.399 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:46 gibba043 bash[9839]: audit 2021-03-10T13:44:45.171587+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[9769]: cluster 2021-03-10T13:44:45.034001+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e36: 5 total, 5 up, 5 in 2021-03-10T13:44:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[9769]: audit 2021-03-10T13:44:45.164243+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[9769]: audit 2021-03-10T13:44:45.167349+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[9769]: audit 2021-03-10T13:44:45.171587+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:46.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[12956]: cluster 2021-03-10T13:44:45.034001+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e36: 5 total, 5 up, 5 in 2021-03-10T13:44:46.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[12956]: audit 2021-03-10T13:44:45.164243+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:46.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[12956]: audit 2021-03-10T13:44:45.167349+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:46.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:46 gibba003 bash[12956]: audit 2021-03-10T13:44:45.171587+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:47.351 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:47 gibba003 bash[9769]: audit 2021-03-10T13:44:45.161068+0000 mgr.y (mgr.14140) 117 : audit [DBG] from='client.34151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:47.351 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:47 gibba003 bash[9769]: cephadm 2021-03-10T13:44:45.163369+0000 mgr.y (mgr.14140) 118 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:44:47.351 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:47 gibba003 bash[9769]: cluster 2021-03-10T13:44:45.884017+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:44:47.352 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:47 gibba003 bash[12956]: audit 2021-03-10T13:44:45.161068+0000 mgr.y (mgr.14140) 117 : audit [DBG] from='client.34151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:47.352 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:47 gibba003 bash[12956]: cephadm 2021-03-10T13:44:45.163369+0000 mgr.y (mgr.14140) 118 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:44:47.352 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:47 gibba003 bash[12956]: cluster 2021-03-10T13:44:45.884017+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:44:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:47 gibba043 bash[9839]: audit 2021-03-10T13:44:45.161068+0000 mgr.y (mgr.14140) 117 : audit [DBG] from='client.34151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:47 gibba043 bash[9839]: cephadm 2021-03-10T13:44:45.163369+0000 mgr.y (mgr.14140) 118 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:44:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:47 gibba043 bash[9839]: cluster 2021-03-10T13:44:45.884017+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:44:49.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[9769]: cluster 2021-03-10T13:44:47.884851+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:49.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[9769]: audit 2021-03-10T13:44:48.174696+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.143:0/675763338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]: dispatch 2021-03-10T13:44:49.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[9769]: audit 2021-03-10T13:44:48.175112+0000 mon.a (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]: dispatch 2021-03-10T13:44:49.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[9769]: audit 2021-03-10T13:44:48.186305+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]': finished 2021-03-10T13:44:49.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[9769]: cluster 2021-03-10T13:44:48.186327+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2021-03-10T13:44:49.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[9769]: audit 2021-03-10T13:44:48.186485+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:44:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[12956]: cluster 2021-03-10T13:44:47.884851+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[12956]: audit 2021-03-10T13:44:48.174696+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.143:0/675763338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]: dispatch 2021-03-10T13:44:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[12956]: audit 2021-03-10T13:44:48.175112+0000 mon.a (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]: dispatch 2021-03-10T13:44:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[12956]: audit 2021-03-10T13:44:48.186305+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]': finished 2021-03-10T13:44:49.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[12956]: cluster 2021-03-10T13:44:48.186327+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2021-03-10T13:44:49.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:49 gibba003 bash[12956]: audit 2021-03-10T13:44:48.186485+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:44:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:49 gibba043 bash[9839]: cluster 2021-03-10T13:44:47.884851+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:49 gibba043 bash[9839]: audit 2021-03-10T13:44:48.174696+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.143:0/675763338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]: dispatch 2021-03-10T13:44:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:49 gibba043 bash[9839]: audit 2021-03-10T13:44:48.175112+0000 mon.a (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]: dispatch 2021-03-10T13:44:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:49 gibba043 bash[9839]: audit 2021-03-10T13:44:48.186305+0000 mon.a (mon.0) 396 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e87ccff-6aca-42b9-977e-eacf5afbde08"}]': finished 2021-03-10T13:44:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:49 gibba043 bash[9839]: cluster 2021-03-10T13:44:48.186327+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2021-03-10T13:44:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:49 gibba043 bash[9839]: audit 2021-03-10T13:44:48.186485+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:44:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:51 gibba003 bash[9769]: cluster 2021-03-10T13:44:49.885712+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:51 gibba003 bash[9769]: audit 2021-03-10T13:44:50.155550+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.143:0/3508414122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:51.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:51 gibba003 bash[12956]: cluster 2021-03-10T13:44:49.885712+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:51.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:51 gibba003 bash[12956]: audit 2021-03-10T13:44:50.155550+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.143:0/3508414122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:51 gibba043 bash[9839]: cluster 2021-03-10T13:44:49.885712+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:51 gibba043 bash[9839]: audit 2021-03-10T13:44:50.155550+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.143:0/3508414122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:53 gibba043 bash[9839]: cluster 2021-03-10T13:44:51.886573+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:53 gibba043 bash[9839]: audit 2021-03-10T13:44:52.738898+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:53.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:53 gibba003 bash[9769]: cluster 2021-03-10T13:44:51.886573+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:53.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:53 gibba003 bash[9769]: audit 2021-03-10T13:44:52.738898+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:53.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:53 gibba003 bash[12956]: cluster 2021-03-10T13:44:51.886573+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:53.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:53 gibba003 bash[12956]: audit 2021-03-10T13:44:52.738898+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:55.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:54 gibba003 bash[9769]: cluster 2021-03-10T13:44:53.887278+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:55.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:54 gibba003 bash[12956]: cluster 2021-03-10T13:44:53.887278+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:54 gibba043 bash[9839]: cluster 2021-03-10T13:44:53.887278+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:57.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[9769]: cluster 2021-03-10T13:44:55.888069+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:57.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[9769]: audit 2021-03-10T13:44:56.069199+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:44:57.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[9769]: audit 2021-03-10T13:44:56.072163+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[9769]: cephadm 2021-03-10T13:44:56.074667+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Deploying daemon osd.5 on gibba043 2021-03-10T13:44:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[9769]: audit 2021-03-10T13:44:56.075687+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:44:57.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[12956]: cluster 2021-03-10T13:44:55.888069+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:57.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[12956]: audit 2021-03-10T13:44:56.069199+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:44:57.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[12956]: audit 2021-03-10T13:44:56.072163+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:57.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[12956]: cephadm 2021-03-10T13:44:56.074667+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Deploying daemon osd.5 on gibba043 2021-03-10T13:44:57.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:56 gibba003 bash[12956]: audit 2021-03-10T13:44:56.075687+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:44:57.224 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:56 gibba043 bash[9839]: cluster 2021-03-10T13:44:55.888069+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:44:57.224 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:56 gibba043 bash[9839]: audit 2021-03-10T13:44:56.069199+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:44:57.224 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:56 gibba043 bash[9839]: audit 2021-03-10T13:44:56.072163+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:57.224 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:56 gibba043 bash[9839]: cephadm 2021-03-10T13:44:56.074667+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Deploying daemon osd.5 on gibba043 2021-03-10T13:44:57.225 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:56 gibba043 bash[9839]: audit 2021-03-10T13:44:56.075687+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:44:57.900 INFO:teuthology.orchestra.run.gibba043.stdout:Created osd(s) 5 on host 'gibba043' 2021-03-10T13:44:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:57 gibba003 bash[9769]: audit 2021-03-10T13:44:57.885908+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:57 gibba003 bash[9769]: audit 2021-03-10T13:44:57.887564+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:57 gibba003 bash[9769]: audit 2021-03-10T13:44:57.895733+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:57 gibba003 bash[12956]: audit 2021-03-10T13:44:57.885908+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:57 gibba003 bash[12956]: audit 2021-03-10T13:44:57.887564+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:57 gibba003 bash[12956]: audit 2021-03-10T13:44:57.895733+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:57 gibba043 bash[9839]: audit 2021-03-10T13:44:57.885908+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:57 gibba043 bash[9839]: audit 2021-03-10T13:44:57.887564+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:57 gibba043 bash[9839]: audit 2021-03-10T13:44:57.895733+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416526\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416789\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.416955\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:35.417108\", \"created\": \"2021-03-10T13:44:34.990842\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_device_update\": \"2021-03-10T13:44:42.716518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:58.987 DEBUG:teuthology.orchestra.run.gibba043:osd.5> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.5.service 2021-03-10T13:44:58.991 INFO:tasks.cephadm:Deploying osd.6 on gibba043 with /dev/vg_nvme/lv_2... 2021-03-10T13:44:58.991 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T13:44:59.146 INFO:journalctl@ceph.osd.5.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[9769]: cluster 2021-03-10T13:44:57.888687+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:44:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[12956]: cluster 2021-03-10T13:44:57.888687+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:44:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[9769]: audit 2021-03-10T13:44:58.313096+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[9769]: audit 2021-03-10T13:44:58.321546+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[9769]: audit 2021-03-10T13:44:58.322276+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[12956]: audit 2021-03-10T13:44:58.313096+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[12956]: audit 2021-03-10T13:44:58.321546+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:44:58 gibba003 bash[12956]: audit 2021-03-10T13:44:58.322276+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:58 gibba043 bash[9839]: cluster 2021-03-10T13:44:57.888687+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:44:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:58 gibba043 bash[9839]: audit 2021-03-10T13:44:58.313096+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:44:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:58 gibba043 bash[9839]: audit 2021-03-10T13:44:58.321546+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:44:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:44:58 gibba043 bash[9839]: audit 2021-03-10T13:44:58.322276+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:00.523 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:45:00.523 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T13:45:00.524 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:45:00.524 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:45:00.524 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:45:00.524 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:45:00.524 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[13358]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T13:45:01.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:00 gibba003 bash[9769]: cluster 2021-03-10T13:44:59.889510+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:01.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:00 gibba003 bash[9769]: audit 2021-03-10T13:45:00.883290+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:01.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:00 gibba003 bash[9769]: audit 2021-03-10T13:45:00.892319+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:01.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:00 gibba003 bash[12956]: cluster 2021-03-10T13:44:59.889510+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:01.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:00 gibba003 bash[12956]: audit 2021-03-10T13:45:00.883290+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:01.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:00 gibba003 bash[12956]: audit 2021-03-10T13:45:00.892319+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[9839]: cluster 2021-03-10T13:44:59.889510+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[9839]: audit 2021-03-10T13:45:00.883290+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:00 gibba043 bash[9839]: audit 2021-03-10T13:45:00.892319+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:03.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:02 gibba003 bash[9769]: cluster 2021-03-10T13:45:01.890280+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:03.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:02 gibba003 bash[12956]: cluster 2021-03-10T13:45:01.890280+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:02 gibba043 bash[9839]: cluster 2021-03-10T13:45:01.890280+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:03.910 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:03 gibba043 bash[13719]: debug 2021-03-10T13:45:03.766+0000 7f884b8d8ec0 1 -- 172.21.2.143:0/1247558338 >> [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] conn(0x558bf72df400 msgr2=0x558bf72dbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:45:03.911 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:03 gibba043 bash[13719]: debug 2021-03-10T13:45:03.766+0000 7f884b8d8ec0 1 --2- 172.21.2.143:0/1247558338 >> [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] conn(0x558bf72df400 0x558bf72dbf80 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x558bf7275ef0 tx=0x558bf7f4aaa0).stop 2021-03-10T13:45:04.306 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T13:45:04.306 INFO:teuthology.orchestra.run.gibba043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T13:45:04.306 INFO:teuthology.orchestra.run.gibba043.stderr: stderr: 10+0 records in 2021-03-10T13:45:04.306 INFO:teuthology.orchestra.run.gibba043.stderr:10+0 records out 2021-03-10T13:45:04.307 INFO:teuthology.orchestra.run.gibba043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0245489 s, 427 MB/s 2021-03-10T13:45:04.307 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping successful for: 2021-03-10T13:45:04.773 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:04 gibba043 bash[13719]: debug 2021-03-10T13:45:04.330+0000 7f884b8d8ec0 -1 Falling back to public interface 2021-03-10T13:45:04.940 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba043:vg_nvme/lv_2 2021-03-10T13:45:05.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:04 gibba003 bash[9769]: cluster 2021-03-10T13:45:03.890928+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:05.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:04 gibba003 bash[12956]: cluster 2021-03-10T13:45:03.890928+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:05.318 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:04 gibba043 bash[13719]: debug 2021-03-10T13:45:04.962+0000 7f884b8d8ec0 -1 osd.5 0 log_to_monitors {default=true} 2021-03-10T13:45:05.318 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:04 gibba043 bash[9839]: cluster 2021-03-10T13:45:03.890928+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:06.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:05 gibba003 bash[9769]: audit 2021-03-10T13:45:04.968425+0000 mon.a (mon.0) 411 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:45:06.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:05 gibba003 bash[9769]: audit 2021-03-10T13:45:04.968814+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:45:06.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:05 gibba003 bash[12956]: audit 2021-03-10T13:45:04.968425+0000 mon.a (mon.0) 411 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:45:06.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:05 gibba003 bash[12956]: audit 2021-03-10T13:45:04.968814+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:45:06.220 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:05 gibba043 bash[9839]: audit 2021-03-10T13:45:04.968425+0000 mon.a (mon.0) 411 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:45:06.220 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:05 gibba043 bash[9839]: audit 2021-03-10T13:45:04.968814+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:45:07.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: cluster 2021-03-10T13:45:05.891752+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:07.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:05.915505+0000 mon.a (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:45:07.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: cluster 2021-03-10T13:45:05.915528+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e38: 6 total, 5 up, 5 in 2021-03-10T13:45:07.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:05.915606+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:07.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:05.917184+0000 mon.a (mon.0) 415 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:07.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:05.918186+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:07.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: cluster 2021-03-10T13:45:05.947211+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:07.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: cluster 2021-03-10T13:45:05.947255+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:07.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:05.968096+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: cluster 2021-03-10T13:45:05.891752+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:05.915505+0000 mon.a (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:45:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: cluster 2021-03-10T13:45:05.915528+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e38: 6 total, 5 up, 5 in 2021-03-10T13:45:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:05.915606+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:05.917184+0000 mon.a (mon.0) 415 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:05.918186+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: cluster 2021-03-10T13:45:05.947211+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: cluster 2021-03-10T13:45:05.947255+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:05.968096+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:07.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:06.075206+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:07.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[9769]: audit 2021-03-10T13:45:06.084152+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:07.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:06.075206+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:07.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:06 gibba003 bash[12956]: audit 2021-03-10T13:45:06.084152+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:07.273 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[13719]: debug 2021-03-10T13:45:06.926+0000 7f883468d700 -1 osd.5 0 waiting for initial osdmap 2021-03-10T13:45:07.273 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[13719]: debug 2021-03-10T13:45:06.934+0000 7f883f8a9700 -1 osd.5 39 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:45:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: cluster 2021-03-10T13:45:05.891752+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:05.915505+0000 mon.a (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:45:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: cluster 2021-03-10T13:45:05.915528+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e38: 6 total, 5 up, 5 in 2021-03-10T13:45:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:05.915606+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:05.917184+0000 mon.a (mon.0) 415 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:05.918186+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: cluster 2021-03-10T13:45:05.947211+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: cluster 2021-03-10T13:45:05.947255+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:05.968096+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:06.075206+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:06 gibba043 bash[9839]: audit 2021-03-10T13:45:06.084152+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}}, \"last_daemon_update\": \"2021-03-10T13:44:58.310849\", \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:08.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:07 gibba003 bash[9769]: audit 2021-03-10T13:45:06.924597+0000 mon.a (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:08.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:07 gibba003 bash[9769]: cluster 2021-03-10T13:45:06.924632+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e39: 6 total, 5 up, 5 in 2021-03-10T13:45:08.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:07 gibba003 bash[9769]: audit 2021-03-10T13:45:06.925167+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:07 gibba003 bash[12956]: audit 2021-03-10T13:45:06.924597+0000 mon.a (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:07 gibba003 bash[12956]: cluster 2021-03-10T13:45:06.924632+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e39: 6 total, 5 up, 5 in 2021-03-10T13:45:08.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:07 gibba003 bash[12956]: audit 2021-03-10T13:45:06.925167+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:07 gibba043 bash[9839]: audit 2021-03-10T13:45:06.924597+0000 mon.a (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:07 gibba043 bash[9839]: cluster 2021-03-10T13:45:06.924632+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e39: 6 total, 5 up, 5 in 2021-03-10T13:45:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:07 gibba043 bash[9839]: audit 2021-03-10T13:45:06.925167+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:09.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: cluster 2021-03-10T13:45:07.892683+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.6 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:09.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: cluster 2021-03-10T13:45:07.929165+0000 mon.a (mon.0) 422 : cluster [INF] osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294] boot 2021-03-10T13:45:09.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: cluster 2021-03-10T13:45:07.929191+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2021-03-10T13:45:09.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: audit 2021-03-10T13:45:07.929272+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:09.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: audit 2021-03-10T13:45:07.929276+0000 mgr.y (mgr.14140) 132 : audit [DBG] from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:09.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: cephadm 2021-03-10T13:45:07.930171+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:45:09.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: audit 2021-03-10T13:45:07.930450+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:09.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: audit 2021-03-10T13:45:07.931256+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:09.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[9769]: audit 2021-03-10T13:45:07.934516+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:09.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: cluster 2021-03-10T13:45:07.892683+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.6 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:09.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: cluster 2021-03-10T13:45:07.929165+0000 mon.a (mon.0) 422 : cluster [INF] osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294] boot 2021-03-10T13:45:09.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: cluster 2021-03-10T13:45:07.929191+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2021-03-10T13:45:09.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: audit 2021-03-10T13:45:07.929272+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: audit 2021-03-10T13:45:07.929276+0000 mgr.y (mgr.14140) 132 : audit [DBG] from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: cephadm 2021-03-10T13:45:07.930171+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:45:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: audit 2021-03-10T13:45:07.930450+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: audit 2021-03-10T13:45:07.931256+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:09.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:08 gibba003 bash[12956]: audit 2021-03-10T13:45:07.934516+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:09.215 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: cluster 2021-03-10T13:45:07.892683+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.6 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:45:09.215 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: cluster 2021-03-10T13:45:07.929165+0000 mon.a (mon.0) 422 : cluster [INF] osd.5 [v2:172.21.2.143:6808/3023567294,v1:172.21.2.143:6809/3023567294] boot 2021-03-10T13:45:09.216 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: cluster 2021-03-10T13:45:07.929191+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2021-03-10T13:45:09.216 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: audit 2021-03-10T13:45:07.929272+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:45:09.216 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: audit 2021-03-10T13:45:07.929276+0000 mgr.y (mgr.14140) 132 : audit [DBG] from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:09.216 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: cephadm 2021-03-10T13:45:07.930171+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:45:09.217 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: audit 2021-03-10T13:45:07.930450+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:09.217 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: audit 2021-03-10T13:45:07.931256+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:09.217 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:08 gibba043 bash[9839]: audit 2021-03-10T13:45:07.934516+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:09 gibba043 bash[9839]: cluster 2021-03-10T13:45:08.940824+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2021-03-10T13:45:10.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:09 gibba003 bash[9769]: cluster 2021-03-10T13:45:08.940824+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2021-03-10T13:45:10.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:09 gibba003 bash[12956]: cluster 2021-03-10T13:45:08.940824+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2021-03-10T13:45:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:10 gibba043 bash[9839]: cluster 2021-03-10T13:45:09.893731+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:11.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:10 gibba003 bash[9769]: cluster 2021-03-10T13:45:09.893731+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:11.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:10 gibba003 bash[12956]: cluster 2021-03-10T13:45:09.893731+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:11 gibba043 bash[9839]: audit 2021-03-10T13:45:10.996555+0000 mon.a (mon.0) 429 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]: dispatch 2021-03-10T13:45:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:11 gibba043 bash[9839]: audit 2021-03-10T13:45:10.997209+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.143:0/1729383055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]: dispatch 2021-03-10T13:45:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:11 gibba043 bash[9839]: audit 2021-03-10T13:45:11.001317+0000 mon.a (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]': finished 2021-03-10T13:45:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:11 gibba043 bash[9839]: cluster 2021-03-10T13:45:11.001382+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2021-03-10T13:45:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:11 gibba043 bash[9839]: audit 2021-03-10T13:45:11.001497+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:12.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[9769]: audit 2021-03-10T13:45:10.996555+0000 mon.a (mon.0) 429 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]: dispatch 2021-03-10T13:45:12.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[9769]: audit 2021-03-10T13:45:10.997209+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.143:0/1729383055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]: dispatch 2021-03-10T13:45:12.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[9769]: audit 2021-03-10T13:45:11.001317+0000 mon.a (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]': finished 2021-03-10T13:45:12.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[9769]: cluster 2021-03-10T13:45:11.001382+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2021-03-10T13:45:12.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[9769]: audit 2021-03-10T13:45:11.001497+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:12.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[12956]: audit 2021-03-10T13:45:10.996555+0000 mon.a (mon.0) 429 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]: dispatch 2021-03-10T13:45:12.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[12956]: audit 2021-03-10T13:45:10.997209+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.143:0/1729383055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]: dispatch 2021-03-10T13:45:12.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[12956]: audit 2021-03-10T13:45:11.001317+0000 mon.a (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ad182fc-ab4c-4b6c-82b1-631487e2292a"}]': finished 2021-03-10T13:45:12.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[12956]: cluster 2021-03-10T13:45:11.001382+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2021-03-10T13:45:12.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:11 gibba003 bash[12956]: audit 2021-03-10T13:45:11.001497+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:13 gibba043 bash[9839]: cluster 2021-03-10T13:45:11.894665+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:13.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:13 gibba003 bash[9769]: cluster 2021-03-10T13:45:11.894665+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:13 gibba003 bash[12956]: cluster 2021-03-10T13:45:11.894665+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:14 gibba043 bash[9839]: audit 2021-03-10T13:45:13.015783+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.143:0/4158440678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:14 gibba003 bash[9769]: audit 2021-03-10T13:45:13.015783+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.143:0/4158440678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:14 gibba003 bash[12956]: audit 2021-03-10T13:45:13.015783+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.143:0/4158440678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:15 gibba003 bash[9769]: cluster 2021-03-10T13:45:13.895334+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:15 gibba003 bash[12956]: cluster 2021-03-10T13:45:13.895334+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:15 gibba043 bash[9839]: cluster 2021-03-10T13:45:13.895334+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:16 gibba003 bash[9769]: audit 2021-03-10T13:45:15.619882+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:16.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:16 gibba003 bash[12956]: audit 2021-03-10T13:45:15.619882+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:16.457 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:16 gibba043 bash[9839]: audit 2021-03-10T13:45:15.619882+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:17.194 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:17 gibba043 bash[9839]: cluster 2021-03-10T13:45:15.895994+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:17 gibba003 bash[9769]: cluster 2021-03-10T13:45:15.895994+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:17 gibba003 bash[12956]: cluster 2021-03-10T13:45:15.895994+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:19.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[9769]: cluster 2021-03-10T13:45:17.896639+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:19.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[9769]: audit 2021-03-10T13:45:19.017435+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:45:19.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[9769]: audit 2021-03-10T13:45:19.020382+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:19.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[9769]: audit 2021-03-10T13:45:19.023771+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:45:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[12956]: cluster 2021-03-10T13:45:17.896639+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[12956]: audit 2021-03-10T13:45:19.017435+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:45:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[12956]: audit 2021-03-10T13:45:19.020382+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:19.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:19 gibba003 bash[12956]: audit 2021-03-10T13:45:19.023771+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:19 gibba043 bash[9839]: cluster 2021-03-10T13:45:17.896639+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:19 gibba043 bash[9839]: audit 2021-03-10T13:45:19.017435+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:19 gibba043 bash[9839]: audit 2021-03-10T13:45:19.020382+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:19 gibba043 bash[9839]: audit 2021-03-10T13:45:19.023771+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:45:20.207 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:20 gibba043 bash[9839]: cephadm 2021-03-10T13:45:19.022805+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.6 on gibba043 2021-03-10T13:45:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:20 gibba003 bash[9769]: cephadm 2021-03-10T13:45:19.022805+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.6 on gibba043 2021-03-10T13:45:20.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:20 gibba003 bash[12956]: cephadm 2021-03-10T13:45:19.022805+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.6 on gibba043 2021-03-10T13:45:20.905 INFO:teuthology.orchestra.run.gibba043.stdout:Created osd(s) 6 on host 'gibba043' 2021-03-10T13:45:21.246 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:21 gibba043 bash[9839]: cluster 2021-03-10T13:45:19.897370+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:21.246 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:21 gibba043 bash[9839]: audit 2021-03-10T13:45:20.890793+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:21.247 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:21 gibba043 bash[9839]: audit 2021-03-10T13:45:20.892348+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:21.247 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:21 gibba043 bash[9839]: audit 2021-03-10T13:45:20.899560+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:21.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[12956]: cluster 2021-03-10T13:45:19.897370+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:21.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[9769]: cluster 2021-03-10T13:45:19.897370+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:21.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[12956]: audit 2021-03-10T13:45:20.890793+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:21.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[12956]: audit 2021-03-10T13:45:20.892348+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:21.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[12956]: audit 2021-03-10T13:45:20.899560+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:21.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[9769]: audit 2021-03-10T13:45:20.890793+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:21.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[9769]: audit 2021-03-10T13:45:20.892348+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:21.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:21 gibba003 bash[9769]: audit 2021-03-10T13:45:20.899560+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.309836\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310108\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310276\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310432\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:58.310583\", \"created\": \"2021-03-10T13:44:57.874841\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_device_update\": \"2021-03-10T13:45:06.072893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:21.939 DEBUG:teuthology.orchestra.run.gibba043:osd.6> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.6.service 2021-03-10T13:45:21.941 INFO:tasks.cephadm:Deploying osd.7 on gibba043 with /dev/vg_nvme/lv_1... 2021-03-10T13:45:21.942 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T13:45:22.054 INFO:journalctl@ceph.osd.6.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[9839]: audit 2021-03-10T13:45:21.341932+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[9839]: audit 2021-03-10T13:45:21.350718+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[9839]: audit 2021-03-10T13:45:21.351339+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:22 gibba003 bash[9769]: audit 2021-03-10T13:45:21.341932+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:22 gibba003 bash[12956]: audit 2021-03-10T13:45:21.341932+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:22 gibba003 bash[12956]: audit 2021-03-10T13:45:21.350718+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:22 gibba003 bash[12956]: audit 2021-03-10T13:45:21.351339+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:22 gibba003 bash[9769]: audit 2021-03-10T13:45:21.350718+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:22 gibba003 bash[9769]: audit 2021-03-10T13:45:21.351339+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:23 gibba043 bash[9839]: cluster 2021-03-10T13:45:21.898057+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:23.274 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:45:23.274 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T13:45:23.274 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:45:23.274 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:45:23.275 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:45:23.275 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:45:23.275 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:22 gibba043 bash[14800]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T13:45:23.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:23 gibba003 bash[9769]: cluster 2021-03-10T13:45:21.898057+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:23 gibba003 bash[12956]: cluster 2021-03-10T13:45:21.898057+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:25.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:24 gibba003 bash[9769]: cluster 2021-03-10T13:45:23.898857+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:24 gibba003 bash[12956]: cluster 2021-03-10T13:45:23.898857+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:24 gibba043 bash[9839]: cluster 2021-03-10T13:45:23.898857+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:26.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:25 gibba003 bash[9769]: audit 2021-03-10T13:45:25.899080+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:26.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:25 gibba003 bash[9769]: audit 2021-03-10T13:45:25.907854+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:25 gibba003 bash[12956]: audit 2021-03-10T13:45:25.899080+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:25 gibba003 bash[12956]: audit 2021-03-10T13:45:25.907854+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:25 gibba043 bash[9839]: audit 2021-03-10T13:45:25.899080+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:26.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:25 gibba043 bash[9839]: audit 2021-03-10T13:45:25.907854+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:26.934 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:26 gibba043 bash[15153]: debug 2021-03-10T13:45:26.682+0000 7f92e4ec0ec0 -1 Falling back to public interface 2021-03-10T13:45:27.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:26 gibba003 bash[9769]: cluster 2021-03-10T13:45:25.899655+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:27.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:26 gibba003 bash[12956]: cluster 2021-03-10T13:45:25.899655+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:26 gibba043 bash[9839]: cluster 2021-03-10T13:45:25.899655+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:27.400 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T13:45:27.400 INFO:teuthology.orchestra.run.gibba043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T13:45:27.400 INFO:teuthology.orchestra.run.gibba043.stderr: stderr: 10+0 records in 2021-03-10T13:45:27.400 INFO:teuthology.orchestra.run.gibba043.stderr:10+0 records out 2021-03-10T13:45:27.401 INFO:teuthology.orchestra.run.gibba043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00907836 s, 1.2 GB/s 2021-03-10T13:45:27.401 INFO:teuthology.orchestra.run.gibba043.stderr:--> Zapping successful for: 2021-03-10T13:45:27.631 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:27 gibba043 bash[15153]: debug 2021-03-10T13:45:27.294+0000 7f92e4ec0ec0 -1 osd.6 0 log_to_monitors {default=true} 2021-03-10T13:45:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:27 gibba003 bash[9769]: audit 2021-03-10T13:45:27.299928+0000 mon.a (mon.0) 445 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:45:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:27 gibba003 bash[9769]: audit 2021-03-10T13:45:27.300846+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:45:28.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:27 gibba003 bash[12956]: audit 2021-03-10T13:45:27.299928+0000 mon.a (mon.0) 445 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:45:28.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:27 gibba003 bash[12956]: audit 2021-03-10T13:45:27.300846+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:45:28.219 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:27 gibba043 bash[9839]: audit 2021-03-10T13:45:27.299928+0000 mon.a (mon.0) 445 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:45:28.219 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:27 gibba043 bash[9839]: audit 2021-03-10T13:45:27.300846+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:45:28.220 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba043:vg_nvme/lv_1 2021-03-10T13:45:29.273 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[15153]: debug 2021-03-10T13:45:28.950+0000 7f92cdc75700 -1 osd.6 0 waiting for initial osdmap 2021-03-10T13:45:29.274 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[15153]: debug 2021-03-10T13:45:28.954+0000 7f92d8e91700 -1 osd.6 44 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:45:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: cluster 2021-03-10T13:45:27.900655+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: audit 2021-03-10T13:45:27.943966+0000 mon.a (mon.0) 446 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:45:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: cluster 2021-03-10T13:45:27.943991+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2021-03-10T13:45:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: audit 2021-03-10T13:45:27.944050+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: audit 2021-03-10T13:45:27.951023+0000 mon.a (mon.0) 449 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: audit 2021-03-10T13:45:27.951949+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: cluster 2021-03-10T13:45:28.287822+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: cluster 2021-03-10T13:45:28.287853+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:28 gibba043 bash[9839]: audit 2021-03-10T13:45:28.911745+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: cluster 2021-03-10T13:45:27.900655+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: audit 2021-03-10T13:45:27.943966+0000 mon.a (mon.0) 446 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:45:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: cluster 2021-03-10T13:45:27.943991+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2021-03-10T13:45:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: audit 2021-03-10T13:45:27.944050+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: audit 2021-03-10T13:45:27.951023+0000 mon.a (mon.0) 449 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: audit 2021-03-10T13:45:27.951949+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: cluster 2021-03-10T13:45:28.287822+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: cluster 2021-03-10T13:45:28.287853+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:29.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[9769]: audit 2021-03-10T13:45:28.911745+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: cluster 2021-03-10T13:45:27.900655+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: audit 2021-03-10T13:45:27.943966+0000 mon.a (mon.0) 446 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:45:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: cluster 2021-03-10T13:45:27.943991+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2021-03-10T13:45:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: audit 2021-03-10T13:45:27.944050+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: audit 2021-03-10T13:45:27.951023+0000 mon.a (mon.0) 449 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: audit 2021-03-10T13:45:27.951949+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: cluster 2021-03-10T13:45:28.287822+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: cluster 2021-03-10T13:45:28.287853+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:28 gibba003 bash[12956]: audit 2021-03-10T13:45:28.911745+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:29 gibba043 bash[9839]: audit 2021-03-10T13:45:28.946191+0000 mon.a (mon.0) 451 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:30.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:29 gibba043 bash[9839]: cluster 2021-03-10T13:45:28.946217+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2021-03-10T13:45:30.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:29 gibba043 bash[9839]: audit 2021-03-10T13:45:28.946577+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:30.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:29 gibba043 bash[9839]: audit 2021-03-10T13:45:29.027046+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:30.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:29 gibba043 bash[9839]: audit 2021-03-10T13:45:29.035540+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:30.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[9769]: audit 2021-03-10T13:45:28.946191+0000 mon.a (mon.0) 451 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:30.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[9769]: cluster 2021-03-10T13:45:28.946217+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2021-03-10T13:45:30.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[9769]: audit 2021-03-10T13:45:28.946577+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:30.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[12956]: audit 2021-03-10T13:45:28.946191+0000 mon.a (mon.0) 451 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:30.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[12956]: cluster 2021-03-10T13:45:28.946217+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2021-03-10T13:45:30.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[12956]: audit 2021-03-10T13:45:28.946577+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:30.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[12956]: audit 2021-03-10T13:45:29.027046+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:30.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[12956]: audit 2021-03-10T13:45:29.035540+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:30.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[9769]: audit 2021-03-10T13:45:29.027046+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:30.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:29 gibba003 bash[9769]: audit 2021-03-10T13:45:29.035540+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}}, \"last_daemon_update\": \"2021-03-10T13:45:21.339559\", \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:31.224 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:30 gibba043 bash[9839]: cluster 2021-03-10T13:45:29.901694+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:31.224 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:30 gibba043 bash[9839]: cluster 2021-03-10T13:45:29.965481+0000 mon.a (mon.0) 456 : cluster [INF] osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849] boot 2021-03-10T13:45:31.225 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:30 gibba043 bash[9839]: cluster 2021-03-10T13:45:29.965518+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2021-03-10T13:45:31.225 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:30 gibba043 bash[9839]: audit 2021-03-10T13:45:29.965620+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:31.225 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:30 gibba043 bash[9839]: cluster 2021-03-10T13:45:30.030954+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:31.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[9769]: cluster 2021-03-10T13:45:29.901694+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:31.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[9769]: cluster 2021-03-10T13:45:29.965481+0000 mon.a (mon.0) 456 : cluster [INF] osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849] boot 2021-03-10T13:45:31.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[9769]: cluster 2021-03-10T13:45:29.965518+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2021-03-10T13:45:31.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[9769]: audit 2021-03-10T13:45:29.965620+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:31.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[9769]: cluster 2021-03-10T13:45:30.030954+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:31.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[12956]: cluster 2021-03-10T13:45:29.901694+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.2 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:45:31.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[12956]: cluster 2021-03-10T13:45:29.965481+0000 mon.a (mon.0) 456 : cluster [INF] osd.6 [v2:172.21.2.143:6816/500274849,v1:172.21.2.143:6817/500274849] boot 2021-03-10T13:45:31.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[12956]: cluster 2021-03-10T13:45:29.965518+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2021-03-10T13:45:31.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[12956]: audit 2021-03-10T13:45:29.965620+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:45:31.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:30 gibba003 bash[12956]: cluster 2021-03-10T13:45:30.030954+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:31 gibba043 bash[9839]: cluster 2021-03-10T13:45:30.978011+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2021-03-10T13:45:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:31 gibba043 bash[9839]: audit 2021-03-10T13:45:31.086746+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:31 gibba043 bash[9839]: cephadm 2021-03-10T13:45:31.088787+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:45:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:31 gibba043 bash[9839]: audit 2021-03-10T13:45:31.089659+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:31 gibba043 bash[9839]: audit 2021-03-10T13:45:31.092652+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:31 gibba043 bash[9839]: audit 2021-03-10T13:45:31.097052+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:32.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[9769]: cluster 2021-03-10T13:45:30.978011+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2021-03-10T13:45:32.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[9769]: audit 2021-03-10T13:45:31.086746+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:32.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[9769]: cephadm 2021-03-10T13:45:31.088787+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:45:32.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[9769]: audit 2021-03-10T13:45:31.089659+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:32.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[9769]: audit 2021-03-10T13:45:31.092652+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:32.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[9769]: audit 2021-03-10T13:45:31.097052+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[12956]: cluster 2021-03-10T13:45:30.978011+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2021-03-10T13:45:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[12956]: audit 2021-03-10T13:45:31.086746+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[12956]: cephadm 2021-03-10T13:45:31.088787+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Applying osd on host gibba043... 2021-03-10T13:45:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[12956]: audit 2021-03-10T13:45:31.089659+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:32.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[12956]: audit 2021-03-10T13:45:31.092652+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:32.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:31 gibba003 bash[12956]: audit 2021-03-10T13:45:31.097052+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:33 gibba043 bash[9839]: cluster 2021-03-10T13:45:31.902677+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:33.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:32 gibba003 bash[9769]: cluster 2021-03-10T13:45:31.902677+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:33.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:32 gibba003 bash[12956]: cluster 2021-03-10T13:45:31.902677+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[9769]: cluster 2021-03-10T13:45:33.903599+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[9769]: audit 2021-03-10T13:45:34.382418+0000 mon.a (mon.0) 464 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]: dispatch 2021-03-10T13:45:35.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[9769]: audit 2021-03-10T13:45:34.383069+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.143:0/529504875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]: dispatch 2021-03-10T13:45:35.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[9769]: audit 2021-03-10T13:45:34.394446+0000 mon.a (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]': finished 2021-03-10T13:45:35.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[9769]: cluster 2021-03-10T13:45:34.394579+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-03-10T13:45:35.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[9769]: audit 2021-03-10T13:45:34.394780+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:35.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[12956]: cluster 2021-03-10T13:45:33.903599+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:35.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[12956]: audit 2021-03-10T13:45:34.382418+0000 mon.a (mon.0) 464 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]: dispatch 2021-03-10T13:45:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[12956]: audit 2021-03-10T13:45:34.383069+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.143:0/529504875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]: dispatch 2021-03-10T13:45:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[12956]: audit 2021-03-10T13:45:34.394446+0000 mon.a (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]': finished 2021-03-10T13:45:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[12956]: cluster 2021-03-10T13:45:34.394579+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-03-10T13:45:35.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:34 gibba003 bash[12956]: audit 2021-03-10T13:45:34.394780+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:34 gibba043 bash[9839]: cluster 2021-03-10T13:45:33.903599+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:34 gibba043 bash[9839]: audit 2021-03-10T13:45:34.382418+0000 mon.a (mon.0) 464 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]: dispatch 2021-03-10T13:45:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:34 gibba043 bash[9839]: audit 2021-03-10T13:45:34.383069+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.143:0/529504875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]: dispatch 2021-03-10T13:45:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:34 gibba043 bash[9839]: audit 2021-03-10T13:45:34.394446+0000 mon.a (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7f28b82-26f4-4986-b100-8fd72cbd424e"}]': finished 2021-03-10T13:45:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:34 gibba043 bash[9839]: cluster 2021-03-10T13:45:34.394579+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-03-10T13:45:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:34 gibba043 bash[9839]: audit 2021-03-10T13:45:34.394780+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:36 gibba003 bash[9769]: cluster 2021-03-10T13:45:35.904368+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v155: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:36 gibba003 bash[9769]: audit 2021-03-10T13:45:36.700456+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.143:0/1966598902' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:36 gibba003 bash[12956]: cluster 2021-03-10T13:45:35.904368+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v155: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:36 gibba003 bash[12956]: audit 2021-03-10T13:45:36.700456+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.143:0/1966598902' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:36 gibba043 bash[9839]: cluster 2021-03-10T13:45:35.904368+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v155: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:36 gibba043 bash[9839]: audit 2021-03-10T13:45:36.700456+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.143:0/1966598902' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:37 gibba043 bash[9839]: cluster 2021-03-10T13:45:37.922295+0000 mon.a (mon.0) 468 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:45:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:37 gibba043 bash[9839]: cluster 2021-03-10T13:45:37.922405+0000 mon.a (mon.0) 469 : cluster [INF] Cluster is now healthy 2021-03-10T13:45:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:37 gibba003 bash[9769]: cluster 2021-03-10T13:45:37.922295+0000 mon.a (mon.0) 468 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:45:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:37 gibba003 bash[9769]: cluster 2021-03-10T13:45:37.922405+0000 mon.a (mon.0) 469 : cluster [INF] Cluster is now healthy 2021-03-10T13:45:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:37 gibba003 bash[12956]: cluster 2021-03-10T13:45:37.922295+0000 mon.a (mon.0) 468 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:45:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:37 gibba003 bash[12956]: cluster 2021-03-10T13:45:37.922405+0000 mon.a (mon.0) 469 : cluster [INF] Cluster is now healthy 2021-03-10T13:45:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:38 gibba043 bash[9839]: cluster 2021-03-10T13:45:37.905024+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:39.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:38 gibba003 bash[9769]: cluster 2021-03-10T13:45:37.905024+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:39.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:38 gibba003 bash[12956]: cluster 2021-03-10T13:45:37.905024+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:40.257 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:39 gibba043 bash[9839]: audit 2021-03-10T13:45:39.333882+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:40.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:39 gibba003 bash[9769]: audit 2021-03-10T13:45:39.333882+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:40.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:39 gibba003 bash[12956]: audit 2021-03-10T13:45:39.333882+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:41 gibba043 bash[9839]: cluster 2021-03-10T13:45:39.905942+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:41.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:40 gibba003 bash[9769]: cluster 2021-03-10T13:45:39.905942+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:41.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:41 gibba003 bash[12956]: cluster 2021-03-10T13:45:39.905942+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:43 gibba043 bash[9839]: cluster 2021-03-10T13:45:41.906936+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:43 gibba003 bash[9769]: cluster 2021-03-10T13:45:41.906936+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:43.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:43 gibba003 bash[12956]: cluster 2021-03-10T13:45:41.906936+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:44 gibba043 bash[9839]: audit 2021-03-10T13:45:43.012781+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:45:44.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:44 gibba043 bash[9839]: audit 2021-03-10T13:45:43.013668+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:44.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:44 gibba043 bash[9839]: cephadm 2021-03-10T13:45:43.014238+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon osd.7 on gibba043 2021-03-10T13:45:44.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:44 gibba043 bash[9839]: audit 2021-03-10T13:45:43.014439+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:45:44.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[9769]: audit 2021-03-10T13:45:43.012781+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:45:44.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[9769]: audit 2021-03-10T13:45:43.013668+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:44.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[9769]: cephadm 2021-03-10T13:45:43.014238+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon osd.7 on gibba043 2021-03-10T13:45:44.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[9769]: audit 2021-03-10T13:45:43.014439+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:45:44.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[12956]: audit 2021-03-10T13:45:43.012781+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:45:44.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[12956]: audit 2021-03-10T13:45:43.013668+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:44.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[12956]: cephadm 2021-03-10T13:45:43.014238+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon osd.7 on gibba043 2021-03-10T13:45:44.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:44 gibba003 bash[12956]: audit 2021-03-10T13:45:43.014439+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:45:45.032 INFO:teuthology.orchestra.run.gibba043.stdout:Created osd(s) 7 on host 'gibba043' 2021-03-10T13:45:45.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:45 gibba043 bash[9839]: cluster 2021-03-10T13:45:43.907603+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:45.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:45 gibba003 bash[9769]: cluster 2021-03-10T13:45:43.907603+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:45.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:45 gibba003 bash[12956]: cluster 2021-03-10T13:45:43.907603+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:46.352 DEBUG:teuthology.orchestra.run.gibba043:osd.7> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.7.service 2021-03-10T13:45:46.353 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.022381+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:46.354 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.023024+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.354 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.025056+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:46.354 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.577300+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:46.355 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.585960+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:46.355 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.586720+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.355 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.910161+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:46.355 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:46 gibba043 bash[9839]: audit 2021-03-10T13:45:45.914131+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:46.357 INFO:tasks.cephadm:Adding prometheus.a on gibba043 2021-03-10T13:45:46.358 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch apply prometheus '1;gibba043=a' 2021-03-10T13:45:46.436 INFO:journalctl@ceph.osd.7.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:46.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.022381+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:46.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.023024+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.022381+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:46.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.023024+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.025056+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:46.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.577300+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:46.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.025056+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338328\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338594\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338759\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.338913\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339131\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:21.339287\", \"created\": \"2021-03-10T13:45:20.878841\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_device_update\": \"2021-03-10T13:45:29.024540\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:46.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.585960+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:46.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.586720+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.910161+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:46.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[9769]: audit 2021-03-10T13:45:45.914131+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.577300+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.585960+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.586720+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.910161+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:45:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:46 gibba003 bash[12956]: audit 2021-03-10T13:45:45.914131+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:45:47.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[9839]: cluster 2021-03-10T13:45:45.908071+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:47.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:47 gibba003 bash[9769]: cluster 2021-03-10T13:45:45.908071+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:47.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:47 gibba003 bash[12956]: cluster 2021-03-10T13:45:45.908071+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:47.773 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:45:47.774 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T13:45:47.774 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:45:47.774 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:45:47.774 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:45:47.775 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:45:47.775 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:47 gibba043 bash[16267]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T13:45:49.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:49 gibba003 bash[9769]: cluster 2021-03-10T13:45:47.908709+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:49 gibba003 bash[12956]: cluster 2021-03-10T13:45:47.908709+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:49 gibba043 bash[9839]: cluster 2021-03-10T13:45:47.908709+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:51.216 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:51 gibba043 bash[9839]: cluster 2021-03-10T13:45:49.909465+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:51.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:51 gibba003 bash[9769]: cluster 2021-03-10T13:45:49.909465+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:51.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:51 gibba003 bash[12956]: cluster 2021-03-10T13:45:49.909465+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:51.507 INFO:teuthology.orchestra.run.gibba043.stdout:Scheduled prometheus update... 2021-03-10T13:45:52.059 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:51 gibba043 bash[16691]: debug 2021-03-10T13:45:51.862+0000 7ff92e4f7ec0 -1 Falling back to public interface 2021-03-10T13:45:52.165 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:52 gibba043 bash[9839]: audit 2021-03-10T13:45:51.493336+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:45:51.492372\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:45:52.165 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:52 gibba043 bash[9839]: audit 2021-03-10T13:45:51.501584+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:45:51.492372\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:45:52.166 DEBUG:teuthology.orchestra.run.gibba043:prometheus.a> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@prometheus.a.service 2021-03-10T13:45:52.168 INFO:tasks.cephadm:Adding node-exporter.a on gibba003 2021-03-10T13:45:52.169 INFO:tasks.cephadm:Adding node-exporter.b on gibba043 2021-03-10T13:45:52.169 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch apply node-exporter '2;gibba003=a;gibba043=b' 2021-03-10T13:45:52.174 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:52.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:52 gibba003 bash[9769]: audit 2021-03-10T13:45:51.493336+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:45:51.492372\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:45:52.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:52 gibba003 bash[9769]: audit 2021-03-10T13:45:51.501584+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:45:51.492372\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:45:52.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:52 gibba003 bash[12956]: audit 2021-03-10T13:45:51.493336+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:45:51.492372\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:45:52.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:52 gibba003 bash[12956]: audit 2021-03-10T13:45:51.501584+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:45:51.492372\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:45:52.607 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:52 gibba043 bash[16691]: debug 2021-03-10T13:45:52.474+0000 7ff92e4f7ec0 -1 osd.7 0 log_to_monitors {default=true} 2021-03-10T13:45:53.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[9769]: audit 2021-03-10T13:45:51.490900+0000 mgr.y (mgr.14140) 159 : audit [DBG] from='client.34229 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba043=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:53.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[9769]: cephadm 2021-03-10T13:45:51.492266+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba043=a 2021-03-10T13:45:53.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[9769]: cluster 2021-03-10T13:45:51.910431+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:53.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[9769]: audit 2021-03-10T13:45:52.479208+0000 mon.a (mon.0) 484 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:45:53.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[9769]: audit 2021-03-10T13:45:52.479698+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:45:53.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[12956]: audit 2021-03-10T13:45:51.490900+0000 mgr.y (mgr.14140) 159 : audit [DBG] from='client.34229 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba043=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:53.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[12956]: cephadm 2021-03-10T13:45:51.492266+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba043=a 2021-03-10T13:45:53.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[12956]: cluster 2021-03-10T13:45:51.910431+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:53.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[12956]: audit 2021-03-10T13:45:52.479208+0000 mon.a (mon.0) 484 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:45:53.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:53 gibba003 bash[12956]: audit 2021-03-10T13:45:52.479698+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:45:53.474 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:53 gibba043 bash[9839]: audit 2021-03-10T13:45:51.490900+0000 mgr.y (mgr.14140) 159 : audit [DBG] from='client.34229 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba043=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:53.475 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:53 gibba043 bash[9839]: cephadm 2021-03-10T13:45:51.492266+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba043=a 2021-03-10T13:45:53.475 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:53 gibba043 bash[9839]: cluster 2021-03-10T13:45:51.910431+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:53.475 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:53 gibba043 bash[9839]: audit 2021-03-10T13:45:52.479208+0000 mon.a (mon.0) 484 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:45:53.475 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:53 gibba043 bash[9839]: audit 2021-03-10T13:45:52.479698+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:45:54.426 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[16691]: debug 2021-03-10T13:45:54.078+0000 7ff9132a4700 -1 osd.7 0 waiting for initial osdmap 2021-03-10T13:45:54.426 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[16691]: debug 2021-03-10T13:45:54.086+0000 7ff91e4c0700 -1 osd.7 49 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:45:54.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.067244+0000 mon.a (mon.0) 485 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:45:54.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: cluster 2021-03-10T13:45:53.067268+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-03-10T13:45:54.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.067333+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:54.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.068024+0000 mon.a (mon.0) 488 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:54.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.069792+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:54.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.208260+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:54.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.317867+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:54.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: audit 2021-03-10T13:45:53.326582+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:54.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: cluster 2021-03-10T13:45:53.438526+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:54.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:54 gibba043 bash[9839]: cluster 2021-03-10T13:45:53.438561+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:54.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.067244+0000 mon.a (mon.0) 485 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:45:54.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: cluster 2021-03-10T13:45:53.067268+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-03-10T13:45:54.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.067333+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:54.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.068024+0000 mon.a (mon.0) 488 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:54.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.069792+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:54.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.208260+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:54.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.067244+0000 mon.a (mon.0) 485 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:45:54.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: cluster 2021-03-10T13:45:53.067268+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-03-10T13:45:54.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.067333+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:54.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.068024+0000 mon.a (mon.0) 488 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:54.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.069792+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:45:54.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.208260+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:54.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.317867+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:54.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: audit 2021-03-10T13:45:53.326582+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:54.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: cluster 2021-03-10T13:45:53.438526+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:54.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[9769]: cluster 2021-03-10T13:45:53.438561+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:54.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.317867+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:45:54.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: audit 2021-03-10T13:45:53.326582+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}}, \"last_daemon_update\": \"2021-03-10T13:45:45.574654\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:45:54.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: cluster 2021-03-10T13:45:53.438526+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:54.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:54 gibba003 bash[12956]: cluster 2021-03-10T13:45:53.438561+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:55.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[9769]: cephadm 2021-03-10T13:45:53.329395+0000 mgr.y (mgr.14140) 162 : cephadm [INF] Deploying daemon prometheus.a on gibba043 2021-03-10T13:45:55.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[9769]: cluster 2021-03-10T13:45:53.911072+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:55.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[9769]: audit 2021-03-10T13:45:54.076662+0000 mon.a (mon.0) 492 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:55.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[9769]: cluster 2021-03-10T13:45:54.076711+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2021-03-10T13:45:55.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[9769]: audit 2021-03-10T13:45:54.077321+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:55.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[12956]: cephadm 2021-03-10T13:45:53.329395+0000 mgr.y (mgr.14140) 162 : cephadm [INF] Deploying daemon prometheus.a on gibba043 2021-03-10T13:45:55.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[12956]: cluster 2021-03-10T13:45:53.911072+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:55.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[12956]: audit 2021-03-10T13:45:54.076662+0000 mon.a (mon.0) 492 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:55.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[12956]: cluster 2021-03-10T13:45:54.076711+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2021-03-10T13:45:55.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:55 gibba003 bash[12956]: audit 2021-03-10T13:45:54.077321+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:55 gibba043 bash[9839]: cephadm 2021-03-10T13:45:53.329395+0000 mgr.y (mgr.14140) 162 : cephadm [INF] Deploying daemon prometheus.a on gibba043 2021-03-10T13:45:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:55 gibba043 bash[9839]: cluster 2021-03-10T13:45:53.911072+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:55 gibba043 bash[9839]: audit 2021-03-10T13:45:54.076662+0000 mon.a (mon.0) 492 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]': finished 2021-03-10T13:45:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:55 gibba043 bash[9839]: cluster 2021-03-10T13:45:54.076711+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2021-03-10T13:45:55.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:55 gibba043 bash[9839]: audit 2021-03-10T13:45:54.077321+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:56.359 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:45:56 gibba043 bash[15153]: debug 2021-03-10T13:45:56.110+0000 7f92bee5d700 -1 osd.6 51 build_incremental_map_msg missing incremental map 51 2021-03-10T13:45:56.360 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:56 gibba043 bash[9839]: cluster 2021-03-10T13:45:55.095584+0000 mon.a (mon.0) 495 : cluster [INF] osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677] boot 2021-03-10T13:45:56.360 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:56 gibba043 bash[9839]: cluster 2021-03-10T13:45:55.095604+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:45:56.360 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:56 gibba043 bash[9839]: audit 2021-03-10T13:45:55.095696+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:56.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:56 gibba003 bash[12956]: cluster 2021-03-10T13:45:55.095584+0000 mon.a (mon.0) 495 : cluster [INF] osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677] boot 2021-03-10T13:45:56.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:56 gibba003 bash[12956]: cluster 2021-03-10T13:45:55.095604+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:45:56.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:56 gibba003 bash[12956]: audit 2021-03-10T13:45:55.095696+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:56.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:56 gibba003 bash[9769]: cluster 2021-03-10T13:45:55.095584+0000 mon.a (mon.0) 495 : cluster [INF] osd.7 [v2:172.21.2.143:6824/3056964677,v1:172.21.2.143:6825/3056964677] boot 2021-03-10T13:45:56.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:56 gibba003 bash[9769]: cluster 2021-03-10T13:45:55.095604+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:45:56.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:56 gibba003 bash[9769]: audit 2021-03-10T13:45:55.095696+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:45:56.638 INFO:teuthology.orchestra.run.gibba043.stdout:Scheduled node-exporter update... 2021-03-10T13:45:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:57 gibba043 bash[9839]: cluster 2021-03-10T13:45:55.911923+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:57 gibba043 bash[9839]: cluster 2021-03-10T13:45:56.109982+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:45:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:57 gibba043 bash[9839]: audit 2021-03-10T13:45:56.623491+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:45:56.622522\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:45:57.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:57 gibba043 bash[9839]: audit 2021-03-10T13:45:56.632132+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:45:56.622522\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:45:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[9769]: cluster 2021-03-10T13:45:55.911923+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[9769]: cluster 2021-03-10T13:45:56.109982+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:45:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[9769]: audit 2021-03-10T13:45:56.623491+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:45:56.622522\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:45:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[9769]: audit 2021-03-10T13:45:56.632132+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:45:56.622522\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:45:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[12956]: cluster 2021-03-10T13:45:55.911923+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:45:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[12956]: cluster 2021-03-10T13:45:56.109982+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:45:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[12956]: audit 2021-03-10T13:45:56.623491+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:45:56.622522\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:45:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:57 gibba003 bash[12956]: audit 2021-03-10T13:45:56.632132+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:45:56.622522\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba043\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:45:58.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:58 gibba003 bash[9769]: audit 2021-03-10T13:45:56.621128+0000 mgr.y (mgr.14140) 165 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba003=a;gibba043=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:58.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:58 gibba003 bash[9769]: cephadm 2021-03-10T13:45:56.622489+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba003=a,gibba043=b 2021-03-10T13:45:58.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:58 gibba003 bash[9769]: cluster 2021-03-10T13:45:57.912921+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v170: 1 pgs: 1 peering; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:58.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:58 gibba003 bash[12956]: audit 2021-03-10T13:45:56.621128+0000 mgr.y (mgr.14140) 165 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba003=a;gibba043=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:58.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:58 gibba003 bash[12956]: cephadm 2021-03-10T13:45:56.622489+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba003=a,gibba043=b 2021-03-10T13:45:58.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:58 gibba003 bash[12956]: cluster 2021-03-10T13:45:57.912921+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v170: 1 pgs: 1 peering; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:58.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:58 gibba043 bash[9839]: audit 2021-03-10T13:45:56.621128+0000 mgr.y (mgr.14140) 165 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba003=a;gibba043=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:58 gibba043 bash[9839]: cephadm 2021-03-10T13:45:56.622489+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba003=a,gibba043=b 2021-03-10T13:45:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:58 gibba043 bash[9839]: cluster 2021-03-10T13:45:57.912921+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v170: 1 pgs: 1 peering; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:58.728 DEBUG:teuthology.orchestra.run.gibba003:node-exporter.a> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@node-exporter.a.service 2021-03-10T13:45:58.732 DEBUG:teuthology.orchestra.run.gibba043:node-exporter.b> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@node-exporter.b.service 2021-03-10T13:45:58.734 INFO:tasks.cephadm:Adding alertmanager.a on gibba003 2021-03-10T13:45:58.735 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch apply alertmanager '1;gibba003=a' 2021-03-10T13:45:58.745 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:58.762 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:59.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:45:59 gibba003 bash[9769]: cluster 2021-03-10T13:45:58.106697+0000 mon.a (mon.0) 501 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:59.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:45:59 gibba003 bash[12956]: cluster 2021-03-10T13:45:58.106697+0000 mon.a (mon.0) 501 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:45:59 gibba043 bash[9839]: cluster 2021-03-10T13:45:58.106697+0000 mon.a (mon.0) 501 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:46:00.418 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:00 gibba043 bash[9839]: cluster 2021-03-10T13:45:59.913687+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v171: 1 pgs: 1 peering; 0 B data, 3.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:00.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:00 gibba003 bash[9769]: cluster 2021-03-10T13:45:59.913687+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v171: 1 pgs: 1 peering; 0 B data, 3.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:00.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:00 gibba003 bash[12956]: cluster 2021-03-10T13:45:59.913687+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v171: 1 pgs: 1 peering; 0 B data, 3.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:02.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:02 gibba003 bash[9769]: cluster 2021-03-10T13:46:01.966856+0000 mon.a (mon.0) 502 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:46:02.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:02 gibba003 bash[9769]: cluster 2021-03-10T13:46:01.967044+0000 mon.a (mon.0) 503 : cluster [INF] Cluster is now healthy 2021-03-10T13:46:02.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:02 gibba003 bash[12956]: cluster 2021-03-10T13:46:01.966856+0000 mon.a (mon.0) 502 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:46:02.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:02 gibba003 bash[12956]: cluster 2021-03-10T13:46:01.967044+0000 mon.a (mon.0) 503 : cluster [INF] Cluster is now healthy 2021-03-10T13:46:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:02 gibba043 bash[9839]: cluster 2021-03-10T13:46:01.966856+0000 mon.a (mon.0) 502 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:46:02.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:02 gibba043 bash[9839]: cluster 2021-03-10T13:46:01.967044+0000 mon.a (mon.0) 503 : cluster [INF] Cluster is now healthy 2021-03-10T13:46:03.126 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:03 gibba043 bash[9839]: cluster 2021-03-10T13:46:01.914689+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:03.154 INFO:teuthology.orchestra.run.gibba043.stdout:Scheduled alertmanager update... 2021-03-10T13:46:03.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:03 gibba003 bash[9769]: cluster 2021-03-10T13:46:01.914689+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:03.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:03 gibba003 bash[12956]: cluster 2021-03-10T13:46:01.914689+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:04.247 DEBUG:teuthology.orchestra.run.gibba003:alertmanager.a> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@alertmanager.a.service 2021-03-10T13:46:04.251 INFO:tasks.cephadm:Adding grafana.a on gibba043 2021-03-10T13:46:04.251 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph orch apply grafana '1;gibba043=a' 2021-03-10T13:46:04.277 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:46:04.336 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:04 gibba043 bash[9839]: audit 2021-03-10T13:46:03.140369+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:46:03.139408\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:46:04.336 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:04 gibba043 bash[9839]: audit 2021-03-10T13:46:03.148597+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:46:03.139408\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:46:04.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:04 gibba003 bash[9769]: audit 2021-03-10T13:46:03.140369+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:46:03.139408\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:46:04.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:04 gibba003 bash[9769]: audit 2021-03-10T13:46:03.148597+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:46:03.139408\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:46:04.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:04 gibba003 bash[12956]: audit 2021-03-10T13:46:03.140369+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:46:03.139408\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:46:04.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:04 gibba003 bash[12956]: audit 2021-03-10T13:46:03.148597+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:46:03.139408\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba003\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:46:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:05 gibba003 bash[9769]: audit 2021-03-10T13:46:03.138045+0000 mgr.y (mgr.14140) 170 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba003=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:05 gibba003 bash[9769]: cephadm 2021-03-10T13:46:03.139372+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba003=a 2021-03-10T13:46:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:05 gibba003 bash[9769]: cluster 2021-03-10T13:46:03.915416+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:05.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:05 gibba003 bash[12956]: audit 2021-03-10T13:46:03.138045+0000 mgr.y (mgr.14140) 170 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba003=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:05.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:05 gibba003 bash[12956]: cephadm 2021-03-10T13:46:03.139372+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba003=a 2021-03-10T13:46:05.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:05 gibba003 bash[12956]: cluster 2021-03-10T13:46:03.915416+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:05.586 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:05 gibba043 bash[9839]: audit 2021-03-10T13:46:03.138045+0000 mgr.y (mgr.14140) 170 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba003=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:05.586 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:05 gibba043 bash[9839]: cephadm 2021-03-10T13:46:03.139372+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba003=a 2021-03-10T13:46:05.586 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:05 gibba043 bash[9839]: cluster 2021-03-10T13:46:03.915416+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:06.410 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:06 gibba043 bash[9839]: audit 2021-03-10T13:46:05.918022+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}, {\"id\": \"05491234-0d99-41e8-b581-85f516252a97\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383955.09553, \"finished_at\": 1615383961.9774408}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:46:06.410 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:06 gibba043 bash[9839]: audit 2021-03-10T13:46:05.927206+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}, {\"id\": \"05491234-0d99-41e8-b581-85f516252a97\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383955.09553, \"finished_at\": 1615383961.9774408}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:46:06.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:06 gibba003 bash[9769]: audit 2021-03-10T13:46:05.918022+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}, {\"id\": \"05491234-0d99-41e8-b581-85f516252a97\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383955.09553, \"finished_at\": 1615383961.9774408}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:46:06.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:06 gibba003 bash[9769]: audit 2021-03-10T13:46:05.927206+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}, {\"id\": \"05491234-0d99-41e8-b581-85f516252a97\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383955.09553, \"finished_at\": 1615383961.9774408}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:46:06.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:06 gibba003 bash[12956]: audit 2021-03-10T13:46:05.918022+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}, {\"id\": \"05491234-0d99-41e8-b581-85f516252a97\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383955.09553, \"finished_at\": 1615383961.9774408}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:46:06.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:06 gibba003 bash[12956]: audit 2021-03-10T13:46:05.927206+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"b7a4d6bd-4b13-4fe1-9cf2-abe1025a42b2\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383884.0299335, \"finished_at\": 1615383897.898723}, {\"id\": \"bef96342-c6c6-4b04-be96-b293d1778241\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383907.9286802, \"finished_at\": 1615383920.902812}, {\"id\": \"96c9b643-ad2b-476f-a9f4-dc8fef63400e\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383929.9655726, \"finished_at\": 1615383945.0285406}, {\"id\": \"05491234-0d99-41e8-b581-85f516252a97\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383955.09553, \"finished_at\": 1615383961.9774408}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:46:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:07 gibba043 bash[9839]: cluster 2021-03-10T13:46:05.916241+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:07.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:07 gibba003 bash[9769]: cluster 2021-03-10T13:46:05.916241+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:07 gibba003 bash[12956]: cluster 2021-03-10T13:46:05.916241+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:08.023 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:07 gibba043 docker[17879]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:46:08.024 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:07 gibba043 systemd[1]: Started Ceph prometheus.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:08 gibba003 bash[12956]: audit 2021-03-10T13:46:07.746183+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:08.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:08 gibba003 bash[9769]: audit 2021-03-10T13:46:07.746183+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:08.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:08 gibba003 bash[9769]: audit 2021-03-10T13:46:07.754930+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:08.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:08 gibba003 bash[9769]: audit 2021-03-10T13:46:07.755660+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:08 gibba003 bash[12956]: audit 2021-03-10T13:46:07.754930+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:08 gibba003 bash[12956]: audit 2021-03-10T13:46:07.755660+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:08 gibba043 bash[9839]: audit 2021-03-10T13:46:07.746183+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:08 gibba043 bash[9839]: audit 2021-03-10T13:46:07.754930+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573334\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573605\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573774\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.573931\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574082\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574231\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:45.574381\", \"created\": \"2021-03-10T13:45:45.010840\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:08 gibba043 bash[9839]: audit 2021-03-10T13:46:07.755660+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:08.977 INFO:teuthology.orchestra.run.gibba043.stdout:Scheduled grafana update... 2021-03-10T13:46:09.072 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:08 gibba043 systemd[1]: Started Ceph node-exporter.b for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:09.072 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:08 gibba043 bash[18255]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T13:46:09.324 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: cluster 2021-03-10T13:46:07.917227+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:09.325 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: cluster 2021-03-10T13:46:07.917227+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:09.326 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.419572+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_daemon_update\": \"2021-03-10T13:46:08.416460\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:09.326 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.428431+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_daemon_update\": \"2021-03-10T13:46:08.416460\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:09.327 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.429989+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:46:09.327 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.430906+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:09.327 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.968054+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:46:08.967677\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:46:09.327 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.419572+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_daemon_update\": \"2021-03-10T13:46:08.416460\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:09.328 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.971404+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:46:08.967677\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:46:09.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.428431+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_daemon_update\": \"2021-03-10T13:46:08.416460\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:09.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.429989+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:46:09.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.430906+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:09.330 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.979162+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:09.330 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.983030+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:09.330 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.983875+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:46:09.331 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[9769]: audit 2021-03-10T13:46:08.985353+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:09.331 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.968054+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:46:08.967677\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:46:09.332 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.971404+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:46:08.967677\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:46:09.332 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.979162+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:09.332 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.983030+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:09.333 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.983875+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:46:09.333 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[12956]: audit 2021-03-10T13:46:08.985353+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:09.439 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: cluster 2021-03-10T13:46:07.917227+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:09.440 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.072Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T13:46:09.440 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.072Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T13:46:09.440 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.072Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T13:46:09.440 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.072Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba043 (none))" 2021-03-10T13:46:09.441 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.072Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T13:46:09.441 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.072Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T13:46:09.441 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.073Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T13:46:09.441 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.074Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T13:46:09.442 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.074Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T13:46:09.442 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.076Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T13:46:09.442 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.076Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.768µs 2021-03-10T13:46:09.442 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.076Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T13:46:09.443 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.076Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-03-10T13:46:09.443 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.076Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=14.574µs wal_replay_duration=163.671µs total_replay_duration=189.388µs 2021-03-10T13:46:09.443 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.077Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T13:46:09.443 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.077Z caller=main.go:802 msg="TSDB started" 2021-03-10T13:46:09.443 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.077Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T13:46:09.444 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.077Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=337.854µs remote_storage=818ns web_handler=160ns query_engine=399ns scrape=178.781µs scrape_sd=13.974µs notify=445ns notify_sd=1.156µs rules=14.221µs 2021-03-10T13:46:09.444 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:09.077Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T13:46:09.445 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.419572+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_daemon_update\": \"2021-03-10T13:46:08.416460\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:09.445 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.428431+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}}, \"last_daemon_update\": \"2021-03-10T13:46:08.416460\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:09.446 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.429989+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:46:09.446 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.430906+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:09.446 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.968054+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:46:08.967677\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:46:09.446 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.971404+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:46:08.967677\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba043\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:46:09.447 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.979162+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:09.447 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.983030+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.414957\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415272\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415441\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415598\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415749\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.415896\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416041\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:08.416188\", \"created\": \"2021-03-10T13:46:07.734839\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:09.447 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.983875+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:46:09.447 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[9839]: audit 2021-03-10T13:46:08.985353+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:09.465 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: latest: Pulling from prom/node-exporter 2021-03-10T13:46:09.696 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 systemd[1]: Started Ceph node-exporter.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:09.697 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T13:46:09.773 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: dc6dd4561653: Pulling fs layer 2021-03-10T13:46:09.774 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: 613f88646930: Pulling fs layer 2021-03-10T13:46:09.774 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: edad907fb257: Pulling fs layer 2021-03-10T13:46:09.774 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: 613f88646930: Download complete 2021-03-10T13:46:09.774 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: dc6dd4561653: Verifying Checksum 2021-03-10T13:46:09.775 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: dc6dd4561653: Download complete 2021-03-10T13:46:09.775 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: edad907fb257: Verifying Checksum 2021-03-10T13:46:09.775 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: edad907fb257: Download complete 2021-03-10T13:46:09.809 DEBUG:teuthology.orchestra.run.gibba043:grafana.a> sudo journalctl -f -n 0 -u ceph-33572ad6-81a6-11eb-9080-001a4aab830c@grafana.a.service 2021-03-10T13:46:09.811 INFO:tasks.cephadm:Setting up client nodes... 2021-03-10T13:46:09.812 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T13:46:09.883 INFO:journalctl@ceph.grafana.a.gibba043.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:46:10.078 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: latest: Pulling from prom/node-exporter 2021-03-10T13:46:10.078 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: dc6dd4561653: Pulling fs layer 2021-03-10T13:46:10.078 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: 613f88646930: Pulling fs layer 2021-03-10T13:46:10.079 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: edad907fb257: Pulling fs layer 2021-03-10T13:46:10.079 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: 613f88646930: Download complete 2021-03-10T13:46:10.079 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: dc6dd4561653: Verifying Checksum 2021-03-10T13:46:10.079 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: dc6dd4561653: Download complete 2021-03-10T13:46:10.080 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: edad907fb257: Verifying Checksum 2021-03-10T13:46:10.080 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:09 gibba003 bash[20265]: edad907fb257: Download complete 2021-03-10T13:46:10.080 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:09 gibba043 bash[18255]: dc6dd4561653: Pull complete 2021-03-10T13:46:10.440 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[18255]: 613f88646930: Pull complete 2021-03-10T13:46:10.441 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[9839]: cephadm 2021-03-10T13:46:08.431568+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon node-exporter.b on gibba043 2021-03-10T13:46:10.441 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[9839]: audit 2021-03-10T13:46:08.967195+0000 mgr.y (mgr.14140) 176 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba043=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:10.442 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[9839]: cephadm 2021-03-10T13:46:08.967666+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Saving service grafana spec with placement count:1 gibba043=a 2021-03-10T13:46:10.442 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[9839]: cephadm 2021-03-10T13:46:08.986504+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Deploying daemon node-exporter.a on gibba003 2021-03-10T13:46:10.442 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[9839]: audit 2021-03-10T13:46:09.402831+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:10.443 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[9839]: audit 2021-03-10T13:46:09.406454+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:10.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[9769]: cephadm 2021-03-10T13:46:08.431568+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon node-exporter.b on gibba043 2021-03-10T13:46:10.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[9769]: audit 2021-03-10T13:46:08.967195+0000 mgr.y (mgr.14140) 176 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba043=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:10.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[9769]: cephadm 2021-03-10T13:46:08.967666+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Saving service grafana spec with placement count:1 gibba043=a 2021-03-10T13:46:10.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[9769]: cephadm 2021-03-10T13:46:08.986504+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Deploying daemon node-exporter.a on gibba003 2021-03-10T13:46:10.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[12956]: cephadm 2021-03-10T13:46:08.431568+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon node-exporter.b on gibba043 2021-03-10T13:46:10.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[12956]: audit 2021-03-10T13:46:08.967195+0000 mgr.y (mgr.14140) 176 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba043=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:10.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[12956]: cephadm 2021-03-10T13:46:08.967666+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Saving service grafana spec with placement count:1 gibba043=a 2021-03-10T13:46:10.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[12956]: cephadm 2021-03-10T13:46:08.986504+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Deploying daemon node-exporter.a on gibba003 2021-03-10T13:46:10.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[9769]: audit 2021-03-10T13:46:09.402831+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:10.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[9769]: audit 2021-03-10T13:46:09.406454+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:10.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[12956]: audit 2021-03-10T13:46:09.402831+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:10.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[12956]: audit 2021-03-10T13:46:09.406454+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:10.773 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[18255]: edad907fb257: Pull complete 2021-03-10T13:46:11.008 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[18255]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T13:46:11.009 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:10 gibba043 bash[18255]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T13:46:11.009 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:10 gibba003 bash[20265]: dc6dd4561653: Pull complete 2021-03-10T13:46:11.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:11 gibba003 bash[9769]: cephadm 2021-03-10T13:46:09.409045+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Deploying daemon alertmanager.a on gibba003 2021-03-10T13:46:11.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:11 gibba003 bash[9769]: cluster 2021-03-10T13:46:09.917590+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:11.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:11 gibba003 bash[12956]: cephadm 2021-03-10T13:46:09.409045+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Deploying daemon alertmanager.a on gibba003 2021-03-10T13:46:11.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:11 gibba003 bash[12956]: cluster 2021-03-10T13:46:09.917590+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[9839]: cephadm 2021-03-10T13:46:09.409045+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Deploying daemon alertmanager.a on gibba003 2021-03-10T13:46:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[9839]: cluster 2021-03-10T13:46:09.917590+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:11.946 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:11 gibba003 bash[20265]: 613f88646930: Pull complete 2021-03-10T13:46:12.024 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T13:46:12.024 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T13:46:12.025 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T13:46:12.025 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T13:46:12.025 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T13:46:12.025 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=node_exporter.go:113 collector=arp 2021-03-10T13:46:12.026 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.778Z caller=node_exporter.go:113 collector=bcache 2021-03-10T13:46:12.026 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=bonding 2021-03-10T13:46:12.026 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T13:46:12.026 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T13:46:12.027 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=cpu 2021-03-10T13:46:12.027 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T13:46:12.027 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T13:46:12.028 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=edac 2021-03-10T13:46:12.028 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=entropy 2021-03-10T13:46:12.028 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T13:46:12.029 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=filefd 2021-03-10T13:46:12.029 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T13:46:12.029 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T13:46:12.029 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T13:46:12.030 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T13:46:12.030 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T13:46:12.030 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T13:46:12.030 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T13:46:12.031 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=netclass 2021-03-10T13:46:12.031 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=netdev 2021-03-10T13:46:12.031 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=netstat 2021-03-10T13:46:12.031 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=nfs 2021-03-10T13:46:12.032 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T13:46:12.032 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T13:46:12.032 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=pressure 2021-03-10T13:46:12.033 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=rapl 2021-03-10T13:46:12.033 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T13:46:12.033 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T13:46:12.033 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=softnet 2021-03-10T13:46:12.034 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=stat 2021-03-10T13:46:12.034 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=textfile 2021-03-10T13:46:12.034 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T13:46:12.034 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=time 2021-03-10T13:46:12.035 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T13:46:12.035 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=uname 2021-03-10T13:46:12.035 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T13:46:12.035 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=xfs 2021-03-10T13:46:12.035 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:113 collector=zfs 2021-03-10T13:46:12.036 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T13:46:12.036 INFO:journalctl@ceph.node-exporter.b.gibba043.stdout:Mar 10 13:46:11 gibba043 bash[18255]: level=info ts=2021-03-10T13:46:11.779Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T13:46:12.380 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:12 gibba003 bash[20265]: edad907fb257: Pull complete 2021-03-10T13:46:12.380 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:12 gibba003 bash[20265]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T13:46:12.381 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:12 gibba003 bash[20265]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T13:46:13.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:13 gibba003 bash[9769]: cluster 2021-03-10T13:46:11.918383+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:13 gibba003 bash[12956]: cluster 2021-03-10T13:46:11.918383+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:13 gibba043 bash[9839]: cluster 2021-03-10T13:46:11.918383+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:15.141 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:15 gibba003 bash[9769]: cluster 2021-03-10T13:46:13.919320+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:15.141 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:15 gibba003 bash[12956]: cluster 2021-03-10T13:46:13.919320+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:15.142 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.959Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T13:46:15.142 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.959Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T13:46:15.142 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.959Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T13:46:15.143 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.959Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T13:46:15.143 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T13:46:15.143 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=arp 2021-03-10T13:46:15.143 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=bcache 2021-03-10T13:46:15.144 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=bonding 2021-03-10T13:46:15.144 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T13:46:15.144 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T13:46:15.144 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=cpu 2021-03-10T13:46:15.144 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T13:46:15.145 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T13:46:15.145 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=edac 2021-03-10T13:46:15.145 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=entropy 2021-03-10T13:46:15.145 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T13:46:15.146 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=filefd 2021-03-10T13:46:15.146 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T13:46:15.146 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T13:46:15.146 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T13:46:15.147 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T13:46:15.147 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T13:46:15.147 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T13:46:15.147 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T13:46:15.147 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=netclass 2021-03-10T13:46:15.148 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=netdev 2021-03-10T13:46:15.148 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=netstat 2021-03-10T13:46:15.148 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=nfs 2021-03-10T13:46:15.148 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T13:46:15.149 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T13:46:15.149 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=pressure 2021-03-10T13:46:15.149 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=rapl 2021-03-10T13:46:15.149 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T13:46:15.149 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T13:46:15.150 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=softnet 2021-03-10T13:46:15.150 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=stat 2021-03-10T13:46:15.150 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=textfile 2021-03-10T13:46:15.150 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T13:46:15.150 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=time 2021-03-10T13:46:15.151 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T13:46:15.151 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=uname 2021-03-10T13:46:15.151 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T13:46:15.151 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=xfs 2021-03-10T13:46:15.152 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:113 collector=zfs 2021-03-10T13:46:15.152 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T13:46:15.152 INFO:journalctl@ceph.node-exporter.a.gibba003.stdout:Mar 10 13:46:14 gibba003 bash[20265]: level=info ts=2021-03-10T13:46:14.960Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T13:46:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:15 gibba043 bash[9839]: cluster 2021-03-10T13:46:13.919320+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:15.986 INFO:teuthology.orchestra.run.gibba003.stdout:[client.0] 2021-03-10T13:46:15.987 INFO:teuthology.orchestra.run.gibba003.stdout: key = AQCnzUhg04INOhAAJ9rzyDKKOV2P3IEY6dzt9Q== 2021-03-10T13:46:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:16 gibba003 bash[9769]: audit 2021-03-10T13:46:15.973531+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.2.103:0/234016222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:16 gibba003 bash[9769]: audit 2021-03-10T13:46:15.973860+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:16.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:16 gibba003 bash[9769]: audit 2021-03-10T13:46:15.978235+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:46:16.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:16 gibba003 bash[12956]: audit 2021-03-10T13:46:15.973531+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.2.103:0/234016222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:16.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:16 gibba003 bash[12956]: audit 2021-03-10T13:46:15.973860+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:16.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:16 gibba003 bash[12956]: audit 2021-03-10T13:46:15.978235+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:46:16.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:16 gibba043 bash[9839]: audit 2021-03-10T13:46:15.973531+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.2.103:0/234016222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:16.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:16 gibba043 bash[9839]: audit 2021-03-10T13:46:15.973860+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:16.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:16 gibba043 bash[9839]: audit 2021-03-10T13:46:15.978235+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:46:16.810 DEBUG:teuthology.orchestra.run.gibba003:> set -ex 2021-03-10T13:46:16.811 DEBUG:teuthology.orchestra.run.gibba003:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-03-10T13:46:16.811 DEBUG:teuthology.orchestra.run.gibba003:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-10T13:46:16.819 DEBUG:teuthology.orchestra.run.gibba043:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T13:46:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:17 gibba043 bash[9839]: cluster 2021-03-10T13:46:15.919646+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:17 gibba003 bash[9769]: cluster 2021-03-10T13:46:15.919646+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:17 gibba003 bash[12956]: cluster 2021-03-10T13:46:15.919646+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:18.389 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:18 gibba003 bash[9769]: cluster 2021-03-10T13:46:17.920280+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:18.389 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:18 gibba003 bash[12956]: cluster 2021-03-10T13:46:17.920280+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:18 gibba043 bash[9839]: cluster 2021-03-10T13:46:17.920280+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:19.693 INFO:teuthology.orchestra.run.gibba043.stdout:[client.1] 2021-03-10T13:46:19.693 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQCrzUhgLdm8KBAAL8hBFtrmlgVbyYkQ/L8yVw== 2021-03-10T13:46:19.696 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:19 gibba003 docker[20873]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:46:19.696 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:19 gibba003 systemd[1]: Started Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:19 gibba043 bash[9839]: audit 2021-03-10T13:46:19.398591+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:19 gibba043 bash[9839]: audit 2021-03-10T13:46:19.402403+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:19 gibba043 bash[9839]: audit 2021-03-10T13:46:19.403183+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:19 gibba043 bash[9839]: audit 2021-03-10T13:46:19.683377+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:19 gibba043 bash[9839]: audit 2021-03-10T13:46:19.685431+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.143:0/2355781178' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:19 gibba043 bash[9839]: audit 2021-03-10T13:46:19.686999+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:46:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[12956]: audit 2021-03-10T13:46:19.398591+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:20.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[9769]: audit 2021-03-10T13:46:19.398591+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[12956]: audit 2021-03-10T13:46:19.402403+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[12956]: audit 2021-03-10T13:46:19.403183+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:20.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[12956]: audit 2021-03-10T13:46:19.683377+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:20.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[12956]: audit 2021-03-10T13:46:19.685431+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.143:0/2355781178' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:20.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[12956]: audit 2021-03-10T13:46:19.686999+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:46:20.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[9769]: audit 2021-03-10T13:46:19.402403+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634453\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634514\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634543\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634570\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634596\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634621\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:15.634647\", \"created\": \"2021-03-10T13:44:15.080913\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:20.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[9769]: audit 2021-03-10T13:46:19.403183+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:20.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[9769]: audit 2021-03-10T13:46:19.683377+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:20.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[9769]: audit 2021-03-10T13:46:19.685431+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.143:0/2355781178' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:46:20.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:19 gibba003 bash[9769]: audit 2021-03-10T13:46:19.686999+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:46:20.230 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-03-10T13:46:20.231 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-03-10T13:46:20.231 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-10T13:46:20.240 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:46:20.697 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.345Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:46:20.697 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.345Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:46:20.697 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.346Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.103 port=9094 2021-03-10T13:46:20.698 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.346Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:46:20.698 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.360Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:46:20.698 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.361Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:46:20.698 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:20.363Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:46:21.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[9769]: cluster 2021-03-10T13:46:19.920634+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:21.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[12956]: cluster 2021-03-10T13:46:19.920634+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:21.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[9769]: audit 2021-03-10T13:46:20.807915+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.806944\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807003\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807071\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807098\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807123\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807148\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807173\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807199\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807224\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:20.807281\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:21.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[9769]: audit 2021-03-10T13:46:20.811915+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.806944\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807003\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807071\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807098\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807123\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807148\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807173\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807199\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807224\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:20.807281\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:21.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[9769]: audit 2021-03-10T13:46:20.812509+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:21.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[12956]: audit 2021-03-10T13:46:20.807915+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.806944\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807003\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807071\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807098\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807123\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807148\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807173\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807199\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807224\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:20.807281\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:21.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[12956]: audit 2021-03-10T13:46:20.811915+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.806944\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807003\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807071\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807098\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807123\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807148\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807173\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807199\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807224\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:20.807281\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:21.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:20 gibba003 bash[12956]: audit 2021-03-10T13:46:20.812509+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:20 gibba043 bash[9839]: cluster 2021-03-10T13:46:19.920634+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:20 gibba043 bash[9839]: audit 2021-03-10T13:46:20.807915+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.806944\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807003\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807071\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807098\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807123\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807148\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807173\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807199\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807224\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:20.807281\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:20 gibba043 bash[9839]: audit 2021-03-10T13:46:20.811915+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.806944\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807003\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807071\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807098\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807123\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807148\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807173\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807199\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:20.807224\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:20.807281\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:20 gibba043 bash[9839]: audit 2021-03-10T13:46:20.812509+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:21 gibba043 bash[9839]: audit 2021-03-10T13:46:21.555340+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_daemon_update\": \"2021-03-10T13:46:21.552280\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:21 gibba043 bash[9839]: audit 2021-03-10T13:46:21.564666+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_daemon_update\": \"2021-03-10T13:46:21.552280\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:21 gibba043 bash[9839]: audit 2021-03-10T13:46:21.650750+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAmIwYbN40FSi1MepvZABa0wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAxMzQ2MjFaFw0z\nMTAzMDgxMzQ2MjFaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDKTPnB3Gb4KNIveMhmYqFY\nyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5QmhH76HTIov\nv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc8EpLzNWo\nkOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8EKmNifBu\nNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZnSHpV2T1D\nud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJWOPBSoVT\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAL0+VnlOBxoyrEaPfqc32tsloasAU5cK\nohp31BdUiKvWgZgVb2U2b50Lu9iLOvwh+I+GVut9SHdjrSNcec9B7YysU9ifuhgK\nUm4etDleA41vdHMRBM3C20F8O0+V5nGcMnDmYfqj3vj4kzXdfAdLP4dn/cAEVzni\nodCAClGX4byl3uOdj5aC0ORlpP+4kNhoM7eEZ4FTkAlROwkUkXmBibNWgk0lVTeC\nbnOkozltmcfABizQblyJQ3/NSrqsEdArpokS/Xr4Q6D3RSC2fKIJUyrwfK1t5gw/\nmOzQ95OE9B5VYSHJMMf7VzVQANNjmmqjFqtAqTvqReL30lWn3Psrq78=\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:46:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:21 gibba043 bash[9839]: audit 2021-03-10T13:46:21.654436+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAmIwYbN40FSi1MepvZABa0wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAxMzQ2MjFaFw0z\nMTAzMDgxMzQ2MjFaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDKTPnB3Gb4KNIveMhmYqFY\nyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5QmhH76HTIov\nv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc8EpLzNWo\nkOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8EKmNifBu\nNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZnSHpV2T1D\nud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJWOPBSoVT\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAL0+VnlOBxoyrEaPfqc32tsloasAU5cK\nohp31BdUiKvWgZgVb2U2b50Lu9iLOvwh+I+GVut9SHdjrSNcec9B7YysU9ifuhgK\nUm4etDleA41vdHMRBM3C20F8O0+V5nGcMnDmYfqj3vj4kzXdfAdLP4dn/cAEVzni\nodCAClGX4byl3uOdj5aC0ORlpP+4kNhoM7eEZ4FTkAlROwkUkXmBibNWgk0lVTeC\nbnOkozltmcfABizQblyJQ3/NSrqsEdArpokS/Xr4Q6D3RSC2fKIJUyrwfK1t5gw/\nmOzQ95OE9B5VYSHJMMf7VzVQANNjmmqjFqtAqTvqReL30lWn3Psrq78=\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:46:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:21 gibba043 bash[9839]: audit 2021-03-10T13:46:21.654880+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDKTPnB3Gb4KNIv\neMhmYqFYyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5Qmh\nH76HTIovv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc\n8EpLzNWokOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8\nEKmNifBuNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZn\nSHpV2T1Dud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJ\nWOPBSoVTAgMBAAECggEAH/xPuQEaHr6FjQ/xz45kqF9e5Xseod6/HsuGxp8OlyRZ\nBSfi87px6nNNOEO9xLlrF86fw4rSmB9EiH82ZroJV0dTr4vFotwHDzkYMb90xw8L\nQgi/1kArK0u2557vW7fB89dyjse9dG+UDHLJrHZ0ibRvFqQh/2ivPpCf6iq+UttS\nHnKO3nqMFZ568HuG7RYemTPEeUlllWMqdcR9Qyufrsy8VkkKYe8Ih3eDIRULU35J\nEelboSEBcYjDLSsbdhYD4/oB6cUkRMXcM2qfGVQBS82UW4EPdFY38aavevQqlMsb\njG3QgXqtEtQZJSkBh5LVBuN7a45GqE+eBn9DuDRW0QKBgQDyl6ASxY8vT7/CUdK7\nHXSE2TjPy3siTL3I6Y1fd2A/OWZfoyorR8Ugc+CsB1fTPXSLC3NcrNXtQ3l5ja49\nt78PpgiiFAgFkWUn5XNtb449IWU0nFrScw3Cqw6LY17ylYVR8OvCDgdGoTdXQmzP\nHOEtF+66cl3m1pEPTQZz5dXzbwKBgQDVe0ZoVibZdeg86feuBg4uPAEyWFfT94p4\nzAEQrdVswtnH+CfVEoPNY03JAPo+IrnxtkqccdSL5UochuYviAVoFWDuyNBfcC2b\ne69WOiqFmUqiaaeh0Va4YAiaJ9kshcy7t52Q8azTjbNU+Rpi9J/rk+kgsrqjQ9eW\n+s7Mw31KXQKBgQDL1S8A1tJ6dE2xXsLrydIPld0wa86ogUatu9+3qTxLo1UrYpOa\nDhHKNNNAeGMI8QgtlI93/Rk65Ij641rWLL/yzBVQ6ffbhdEy9o5IE4W2Q4sf64g8\nb8POH6B26iXrOkrtELtnMBZY+DjhrsRyOdfR5dwG+PWBciQscRHM6/8bLQKBgEXa\nJFuXdPbKwcbMt6JVkOZH9AxJI9PTt5d3CRIwDxmbWC86X640dLQLvjP7Aea67iTN\nBPTTujxcNjfHXCJJW5uHA0SeqK/RwNqTSffo6Gj2k5k5AQTNvpZtteLbDxCmZys1\nFXWL3oUKZJd1OtEOQhWPPETatn8df7mDL4+Il8JxAoGBANZMxsI6BH6cn8FMkNtt\ndNozYhvDr/jOX+wyLTc9cCXC1F6T6cutMnXC6HJyX6VMSt2PtbrN26zgoMW7DMS8\nCVtb7Hd6lgBTrVvovWte2pbtUdli306RTa4KPi8BxyPi90WxM5Lyw+UVp9DImmfX\n+fYzQrSkWWRSkVyRYZNiBcLq\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:46:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:21 gibba043 bash[9839]: audit 2021-03-10T13:46:21.664415+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDKTPnB3Gb4KNIv\neMhmYqFYyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5Qmh\nH76HTIovv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc\n8EpLzNWokOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8\nEKmNifBuNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZn\nSHpV2T1Dud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJ\nWOPBSoVTAgMBAAECggEAH/xPuQEaHr6FjQ/xz45kqF9e5Xseod6/HsuGxp8OlyRZ\nBSfi87px6nNNOEO9xLlrF86fw4rSmB9EiH82ZroJV0dTr4vFotwHDzkYMb90xw8L\nQgi/1kArK0u2557vW7fB89dyjse9dG+UDHLJrHZ0ibRvFqQh/2ivPpCf6iq+UttS\nHnKO3nqMFZ568HuG7RYemTPEeUlllWMqdcR9Qyufrsy8VkkKYe8Ih3eDIRULU35J\nEelboSEBcYjDLSsbdhYD4/oB6cUkRMXcM2qfGVQBS82UW4EPdFY38aavevQqlMsb\njG3QgXqtEtQZJSkBh5LVBuN7a45GqE+eBn9DuDRW0QKBgQDyl6ASxY8vT7/CUdK7\nHXSE2TjPy3siTL3I6Y1fd2A/OWZfoyorR8Ugc+CsB1fTPXSLC3NcrNXtQ3l5ja49\nt78PpgiiFAgFkWUn5XNtb449IWU0nFrScw3Cqw6LY17ylYVR8OvCDgdGoTdXQmzP\nHOEtF+66cl3m1pEPTQZz5dXzbwKBgQDVe0ZoVibZdeg86feuBg4uPAEyWFfT94p4\nzAEQrdVswtnH+CfVEoPNY03JAPo+IrnxtkqccdSL5UochuYviAVoFWDuyNBfcC2b\ne69WOiqFmUqiaaeh0Va4YAiaJ9kshcy7t52Q8azTjbNU+Rpi9J/rk+kgsrqjQ9eW\n+s7Mw31KXQKBgQDL1S8A1tJ6dE2xXsLrydIPld0wa86ogUatu9+3qTxLo1UrYpOa\nDhHKNNNAeGMI8QgtlI93/Rk65Ij641rWLL/yzBVQ6ffbhdEy9o5IE4W2Q4sf64g8\nb8POH6B26iXrOkrtELtnMBZY+DjhrsRyOdfR5dwG+PWBciQscRHM6/8bLQKBgEXa\nJFuXdPbKwcbMt6JVkOZH9AxJI9PTt5d3CRIwDxmbWC86X640dLQLvjP7Aea67iTN\nBPTTujxcNjfHXCJJW5uHA0SeqK/RwNqTSffo6Gj2k5k5AQTNvpZtteLbDxCmZys1\nFXWL3oUKZJd1OtEOQhWPPETatn8df7mDL4+Il8JxAoGBANZMxsI6BH6cn8FMkNtt\ndNozYhvDr/jOX+wyLTc9cCXC1F6T6cutMnXC6HJyX6VMSt2PtbrN26zgoMW7DMS8\nCVtb7Hd6lgBTrVvovWte2pbtUdli306RTa4KPi8BxyPi90WxM5Lyw+UVp9DImmfX\n+fYzQrSkWWRSkVyRYZNiBcLq\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:46:22.355 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[9769]: audit 2021-03-10T13:46:21.555340+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_daemon_update\": \"2021-03-10T13:46:21.552280\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:22.355 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[12956]: audit 2021-03-10T13:46:21.555340+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_daemon_update\": \"2021-03-10T13:46:21.552280\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:22.356 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[9769]: audit 2021-03-10T13:46:21.564666+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_daemon_update\": \"2021-03-10T13:46:21.552280\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:22.356 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[9769]: audit 2021-03-10T13:46:21.650750+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAmIwYbN40FSi1MepvZABa0wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAxMzQ2MjFaFw0z\nMTAzMDgxMzQ2MjFaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDKTPnB3Gb4KNIveMhmYqFY\nyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5QmhH76HTIov\nv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc8EpLzNWo\nkOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8EKmNifBu\nNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZnSHpV2T1D\nud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJWOPBSoVT\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAL0+VnlOBxoyrEaPfqc32tsloasAU5cK\nohp31BdUiKvWgZgVb2U2b50Lu9iLOvwh+I+GVut9SHdjrSNcec9B7YysU9ifuhgK\nUm4etDleA41vdHMRBM3C20F8O0+V5nGcMnDmYfqj3vj4kzXdfAdLP4dn/cAEVzni\nodCAClGX4byl3uOdj5aC0ORlpP+4kNhoM7eEZ4FTkAlROwkUkXmBibNWgk0lVTeC\nbnOkozltmcfABizQblyJQ3/NSrqsEdArpokS/Xr4Q6D3RSC2fKIJUyrwfK1t5gw/\nmOzQ95OE9B5VYSHJMMf7VzVQANNjmmqjFqtAqTvqReL30lWn3Psrq78=\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:46:22.356 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[9769]: audit 2021-03-10T13:46:21.654436+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAmIwYbN40FSi1MepvZABa0wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAxMzQ2MjFaFw0z\nMTAzMDgxMzQ2MjFaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDKTPnB3Gb4KNIveMhmYqFY\nyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5QmhH76HTIov\nv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc8EpLzNWo\nkOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8EKmNifBu\nNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZnSHpV2T1D\nud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJWOPBSoVT\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAL0+VnlOBxoyrEaPfqc32tsloasAU5cK\nohp31BdUiKvWgZgVb2U2b50Lu9iLOvwh+I+GVut9SHdjrSNcec9B7YysU9ifuhgK\nUm4etDleA41vdHMRBM3C20F8O0+V5nGcMnDmYfqj3vj4kzXdfAdLP4dn/cAEVzni\nodCAClGX4byl3uOdj5aC0ORlpP+4kNhoM7eEZ4FTkAlROwkUkXmBibNWgk0lVTeC\nbnOkozltmcfABizQblyJQ3/NSrqsEdArpokS/Xr4Q6D3RSC2fKIJUyrwfK1t5gw/\nmOzQ95OE9B5VYSHJMMf7VzVQANNjmmqjFqtAqTvqReL30lWn3Psrq78=\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:46:22.357 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[12956]: audit 2021-03-10T13:46:21.564666+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}}, \"last_daemon_update\": \"2021-03-10T13:46:21.552280\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:22.357 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[12956]: audit 2021-03-10T13:46:21.650750+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAmIwYbN40FSi1MepvZABa0wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAxMzQ2MjFaFw0z\nMTAzMDgxMzQ2MjFaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDKTPnB3Gb4KNIveMhmYqFY\nyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5QmhH76HTIov\nv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc8EpLzNWo\nkOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8EKmNifBu\nNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZnSHpV2T1D\nud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJWOPBSoVT\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAL0+VnlOBxoyrEaPfqc32tsloasAU5cK\nohp31BdUiKvWgZgVb2U2b50Lu9iLOvwh+I+GVut9SHdjrSNcec9B7YysU9ifuhgK\nUm4etDleA41vdHMRBM3C20F8O0+V5nGcMnDmYfqj3vj4kzXdfAdLP4dn/cAEVzni\nodCAClGX4byl3uOdj5aC0ORlpP+4kNhoM7eEZ4FTkAlROwkUkXmBibNWgk0lVTeC\nbnOkozltmcfABizQblyJQ3/NSrqsEdArpokS/Xr4Q6D3RSC2fKIJUyrwfK1t5gw/\nmOzQ95OE9B5VYSHJMMf7VzVQANNjmmqjFqtAqTvqReL30lWn3Psrq78=\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:46:22.357 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[12956]: audit 2021-03-10T13:46:21.654436+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAmIwYbN40FSi1MepvZABa0wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAxMzQ2MjFaFw0z\nMTAzMDgxMzQ2MjFaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDKTPnB3Gb4KNIveMhmYqFY\nyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5QmhH76HTIov\nv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc8EpLzNWo\nkOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8EKmNifBu\nNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZnSHpV2T1D\nud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJWOPBSoVT\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAL0+VnlOBxoyrEaPfqc32tsloasAU5cK\nohp31BdUiKvWgZgVb2U2b50Lu9iLOvwh+I+GVut9SHdjrSNcec9B7YysU9ifuhgK\nUm4etDleA41vdHMRBM3C20F8O0+V5nGcMnDmYfqj3vj4kzXdfAdLP4dn/cAEVzni\nodCAClGX4byl3uOdj5aC0ORlpP+4kNhoM7eEZ4FTkAlROwkUkXmBibNWgk0lVTeC\nbnOkozltmcfABizQblyJQ3/NSrqsEdArpokS/Xr4Q6D3RSC2fKIJUyrwfK1t5gw/\nmOzQ95OE9B5VYSHJMMf7VzVQANNjmmqjFqtAqTvqReL30lWn3Psrq78=\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:46:22.358 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[9769]: audit 2021-03-10T13:46:21.654880+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDKTPnB3Gb4KNIv\neMhmYqFYyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5Qmh\nH76HTIovv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc\n8EpLzNWokOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8\nEKmNifBuNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZn\nSHpV2T1Dud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJ\nWOPBSoVTAgMBAAECggEAH/xPuQEaHr6FjQ/xz45kqF9e5Xseod6/HsuGxp8OlyRZ\nBSfi87px6nNNOEO9xLlrF86fw4rSmB9EiH82ZroJV0dTr4vFotwHDzkYMb90xw8L\nQgi/1kArK0u2557vW7fB89dyjse9dG+UDHLJrHZ0ibRvFqQh/2ivPpCf6iq+UttS\nHnKO3nqMFZ568HuG7RYemTPEeUlllWMqdcR9Qyufrsy8VkkKYe8Ih3eDIRULU35J\nEelboSEBcYjDLSsbdhYD4/oB6cUkRMXcM2qfGVQBS82UW4EPdFY38aavevQqlMsb\njG3QgXqtEtQZJSkBh5LVBuN7a45GqE+eBn9DuDRW0QKBgQDyl6ASxY8vT7/CUdK7\nHXSE2TjPy3siTL3I6Y1fd2A/OWZfoyorR8Ugc+CsB1fTPXSLC3NcrNXtQ3l5ja49\nt78PpgiiFAgFkWUn5XNtb449IWU0nFrScw3Cqw6LY17ylYVR8OvCDgdGoTdXQmzP\nHOEtF+66cl3m1pEPTQZz5dXzbwKBgQDVe0ZoVibZdeg86feuBg4uPAEyWFfT94p4\nzAEQrdVswtnH+CfVEoPNY03JAPo+IrnxtkqccdSL5UochuYviAVoFWDuyNBfcC2b\ne69WOiqFmUqiaaeh0Va4YAiaJ9kshcy7t52Q8azTjbNU+Rpi9J/rk+kgsrqjQ9eW\n+s7Mw31KXQKBgQDL1S8A1tJ6dE2xXsLrydIPld0wa86ogUatu9+3qTxLo1UrYpOa\nDhHKNNNAeGMI8QgtlI93/Rk65Ij641rWLL/yzBVQ6ffbhdEy9o5IE4W2Q4sf64g8\nb8POH6B26iXrOkrtELtnMBZY+DjhrsRyOdfR5dwG+PWBciQscRHM6/8bLQKBgEXa\nJFuXdPbKwcbMt6JVkOZH9AxJI9PTt5d3CRIwDxmbWC86X640dLQLvjP7Aea67iTN\nBPTTujxcNjfHXCJJW5uHA0SeqK/RwNqTSffo6Gj2k5k5AQTNvpZtteLbDxCmZys1\nFXWL3oUKZJd1OtEOQhWPPETatn8df7mDL4+Il8JxAoGBANZMxsI6BH6cn8FMkNtt\ndNozYhvDr/jOX+wyLTc9cCXC1F6T6cutMnXC6HJyX6VMSt2PtbrN26zgoMW7DMS8\nCVtb7Hd6lgBTrVvovWte2pbtUdli306RTa4KPi8BxyPi90WxM5Lyw+UVp9DImmfX\n+fYzQrSkWWRSkVyRYZNiBcLq\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:46:22.358 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[9769]: audit 2021-03-10T13:46:21.664415+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDKTPnB3Gb4KNIv\neMhmYqFYyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5Qmh\nH76HTIovv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc\n8EpLzNWokOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8\nEKmNifBuNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZn\nSHpV2T1Dud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJ\nWOPBSoVTAgMBAAECggEAH/xPuQEaHr6FjQ/xz45kqF9e5Xseod6/HsuGxp8OlyRZ\nBSfi87px6nNNOEO9xLlrF86fw4rSmB9EiH82ZroJV0dTr4vFotwHDzkYMb90xw8L\nQgi/1kArK0u2557vW7fB89dyjse9dG+UDHLJrHZ0ibRvFqQh/2ivPpCf6iq+UttS\nHnKO3nqMFZ568HuG7RYemTPEeUlllWMqdcR9Qyufrsy8VkkKYe8Ih3eDIRULU35J\nEelboSEBcYjDLSsbdhYD4/oB6cUkRMXcM2qfGVQBS82UW4EPdFY38aavevQqlMsb\njG3QgXqtEtQZJSkBh5LVBuN7a45GqE+eBn9DuDRW0QKBgQDyl6ASxY8vT7/CUdK7\nHXSE2TjPy3siTL3I6Y1fd2A/OWZfoyorR8Ugc+CsB1fTPXSLC3NcrNXtQ3l5ja49\nt78PpgiiFAgFkWUn5XNtb449IWU0nFrScw3Cqw6LY17ylYVR8OvCDgdGoTdXQmzP\nHOEtF+66cl3m1pEPTQZz5dXzbwKBgQDVe0ZoVibZdeg86feuBg4uPAEyWFfT94p4\nzAEQrdVswtnH+CfVEoPNY03JAPo+IrnxtkqccdSL5UochuYviAVoFWDuyNBfcC2b\ne69WOiqFmUqiaaeh0Va4YAiaJ9kshcy7t52Q8azTjbNU+Rpi9J/rk+kgsrqjQ9eW\n+s7Mw31KXQKBgQDL1S8A1tJ6dE2xXsLrydIPld0wa86ogUatu9+3qTxLo1UrYpOa\nDhHKNNNAeGMI8QgtlI93/Rk65Ij641rWLL/yzBVQ6ffbhdEy9o5IE4W2Q4sf64g8\nb8POH6B26iXrOkrtELtnMBZY+DjhrsRyOdfR5dwG+PWBciQscRHM6/8bLQKBgEXa\nJFuXdPbKwcbMt6JVkOZH9AxJI9PTt5d3CRIwDxmbWC86X640dLQLvjP7Aea67iTN\nBPTTujxcNjfHXCJJW5uHA0SeqK/RwNqTSffo6Gj2k5k5AQTNvpZtteLbDxCmZys1\nFXWL3oUKZJd1OtEOQhWPPETatn8df7mDL4+Il8JxAoGBANZMxsI6BH6cn8FMkNtt\ndNozYhvDr/jOX+wyLTc9cCXC1F6T6cutMnXC6HJyX6VMSt2PtbrN26zgoMW7DMS8\nCVtb7Hd6lgBTrVvovWte2pbtUdli306RTa4KPi8BxyPi90WxM5Lyw+UVp9DImmfX\n+fYzQrSkWWRSkVyRYZNiBcLq\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:46:22.359 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[12956]: audit 2021-03-10T13:46:21.654880+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDKTPnB3Gb4KNIv\neMhmYqFYyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5Qmh\nH76HTIovv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc\n8EpLzNWokOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8\nEKmNifBuNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZn\nSHpV2T1Dud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJ\nWOPBSoVTAgMBAAECggEAH/xPuQEaHr6FjQ/xz45kqF9e5Xseod6/HsuGxp8OlyRZ\nBSfi87px6nNNOEO9xLlrF86fw4rSmB9EiH82ZroJV0dTr4vFotwHDzkYMb90xw8L\nQgi/1kArK0u2557vW7fB89dyjse9dG+UDHLJrHZ0ibRvFqQh/2ivPpCf6iq+UttS\nHnKO3nqMFZ568HuG7RYemTPEeUlllWMqdcR9Qyufrsy8VkkKYe8Ih3eDIRULU35J\nEelboSEBcYjDLSsbdhYD4/oB6cUkRMXcM2qfGVQBS82UW4EPdFY38aavevQqlMsb\njG3QgXqtEtQZJSkBh5LVBuN7a45GqE+eBn9DuDRW0QKBgQDyl6ASxY8vT7/CUdK7\nHXSE2TjPy3siTL3I6Y1fd2A/OWZfoyorR8Ugc+CsB1fTPXSLC3NcrNXtQ3l5ja49\nt78PpgiiFAgFkWUn5XNtb449IWU0nFrScw3Cqw6LY17ylYVR8OvCDgdGoTdXQmzP\nHOEtF+66cl3m1pEPTQZz5dXzbwKBgQDVe0ZoVibZdeg86feuBg4uPAEyWFfT94p4\nzAEQrdVswtnH+CfVEoPNY03JAPo+IrnxtkqccdSL5UochuYviAVoFWDuyNBfcC2b\ne69WOiqFmUqiaaeh0Va4YAiaJ9kshcy7t52Q8azTjbNU+Rpi9J/rk+kgsrqjQ9eW\n+s7Mw31KXQKBgQDL1S8A1tJ6dE2xXsLrydIPld0wa86ogUatu9+3qTxLo1UrYpOa\nDhHKNNNAeGMI8QgtlI93/Rk65Ij641rWLL/yzBVQ6ffbhdEy9o5IE4W2Q4sf64g8\nb8POH6B26iXrOkrtELtnMBZY+DjhrsRyOdfR5dwG+PWBciQscRHM6/8bLQKBgEXa\nJFuXdPbKwcbMt6JVkOZH9AxJI9PTt5d3CRIwDxmbWC86X640dLQLvjP7Aea67iTN\nBPTTujxcNjfHXCJJW5uHA0SeqK/RwNqTSffo6Gj2k5k5AQTNvpZtteLbDxCmZys1\nFXWL3oUKZJd1OtEOQhWPPETatn8df7mDL4+Il8JxAoGBANZMxsI6BH6cn8FMkNtt\ndNozYhvDr/jOX+wyLTc9cCXC1F6T6cutMnXC6HJyX6VMSt2PtbrN26zgoMW7DMS8\nCVtb7Hd6lgBTrVvovWte2pbtUdli306RTa4KPi8BxyPi90WxM5Lyw+UVp9DImmfX\n+fYzQrSkWWRSkVyRYZNiBcLq\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:46:22.359 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:21 gibba003 bash[12956]: audit 2021-03-10T13:46:21.664415+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQDKTPnB3Gb4KNIv\neMhmYqFYyvauq1x5F36t5PYfE1mJyCtSSs+3M8Y1/LsPfU7Skid1423+YkhP5Qmh\nH76HTIovv3F4TZre4thnLLPtaaeEXlWCGaQrSNFkU6iGiwSpKZifI5YEs5EGy3zc\n8EpLzNWokOTAY25sRuve/XFFMS0m7y11ygDKnNkxb66RlImqoHydacf1nw1cdoB8\nEKmNifBuNBO4HJqwMlwKRhcqay3M7SFNJFeOjH6oQBImhepWrm3/cwAuTRrjFvZn\nSHpV2T1Dud/YcB8d1/Y49ax6KeErLIJbPcwjTxHes6DAM4KGOQUlmvCEJ9y7vlZJ\nWOPBSoVTAgMBAAECggEAH/xPuQEaHr6FjQ/xz45kqF9e5Xseod6/HsuGxp8OlyRZ\nBSfi87px6nNNOEO9xLlrF86fw4rSmB9EiH82ZroJV0dTr4vFotwHDzkYMb90xw8L\nQgi/1kArK0u2557vW7fB89dyjse9dG+UDHLJrHZ0ibRvFqQh/2ivPpCf6iq+UttS\nHnKO3nqMFZ568HuG7RYemTPEeUlllWMqdcR9Qyufrsy8VkkKYe8Ih3eDIRULU35J\nEelboSEBcYjDLSsbdhYD4/oB6cUkRMXcM2qfGVQBS82UW4EPdFY38aavevQqlMsb\njG3QgXqtEtQZJSkBh5LVBuN7a45GqE+eBn9DuDRW0QKBgQDyl6ASxY8vT7/CUdK7\nHXSE2TjPy3siTL3I6Y1fd2A/OWZfoyorR8Ugc+CsB1fTPXSLC3NcrNXtQ3l5ja49\nt78PpgiiFAgFkWUn5XNtb449IWU0nFrScw3Cqw6LY17ylYVR8OvCDgdGoTdXQmzP\nHOEtF+66cl3m1pEPTQZz5dXzbwKBgQDVe0ZoVibZdeg86feuBg4uPAEyWFfT94p4\nzAEQrdVswtnH+CfVEoPNY03JAPo+IrnxtkqccdSL5UochuYviAVoFWDuyNBfcC2b\ne69WOiqFmUqiaaeh0Va4YAiaJ9kshcy7t52Q8azTjbNU+Rpi9J/rk+kgsrqjQ9eW\n+s7Mw31KXQKBgQDL1S8A1tJ6dE2xXsLrydIPld0wa86ogUatu9+3qTxLo1UrYpOa\nDhHKNNNAeGMI8QgtlI93/Rk65Ij641rWLL/yzBVQ6ffbhdEy9o5IE4W2Q4sf64g8\nb8POH6B26iXrOkrtELtnMBZY+DjhrsRyOdfR5dwG+PWBciQscRHM6/8bLQKBgEXa\nJFuXdPbKwcbMt6JVkOZH9AxJI9PTt5d3CRIwDxmbWC86X640dLQLvjP7Aea67iTN\nBPTTujxcNjfHXCJJW5uHA0SeqK/RwNqTSffo6Gj2k5k5AQTNvpZtteLbDxCmZys1\nFXWL3oUKZJd1OtEOQhWPPETatn8df7mDL4+Il8JxAoGBANZMxsI6BH6cn8FMkNtt\ndNozYhvDr/jOX+wyLTc9cCXC1F6T6cutMnXC6HJyX6VMSt2PtbrN26zgoMW7DMS8\nCVtb7Hd6lgBTrVvovWte2pbtUdli306RTa4KPi8BxyPi90WxM5Lyw+UVp9DImmfX\n+fYzQrSkWWRSkVyRYZNiBcLq\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:46:22.696 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:22 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:22.347Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000177803s 2021-03-10T13:46:23.153 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:46:23.154 INFO:teuthology.orchestra.run.gibba003.stdout:{"epoch":51,"fsid":"33572ad6-81a6-11eb-9080-001a4aab830c","created":"2021-03-10T13:41:03.716275+0000","modified":"2021-03-10T13:45:56.095279+0000","last_up_change":"2021-03-10T13:45:55.080469+0000","last_in_change":"2021-03-10T13:45:55.080469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:41:13.891422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"0d26860c-9743-487b-8483-5d559e1f056b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6802","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6803","nonce":278332524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6804","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6805","nonce":278332524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6808","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6809","nonce":278332524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6806","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6807","nonce":278332524}]},"public_addr":"172.21.2.103:6803/278332524","cluster_addr":"172.21.2.103:6805/278332524","heartbeat_back_addr":"172.21.2.103:6809/278332524","heartbeat_front_addr":"172.21.2.103:6807/278332524","state":["exists","up"]},{"osd":1,"uuid":"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":18,"up_from":21,"up_thru":35,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6810","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6811","nonce":1275055322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6812","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6813","nonce":1275055322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6816","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6817","nonce":1275055322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6814","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6815","nonce":1275055322}]},"public_addr":"172.21.2.103:6811/1275055322","cluster_addr":"172.21.2.103:6813/1275055322","heartbeat_back_addr":"172.21.2.103:6817/1275055322","heartbeat_front_addr":"172.21.2.103:6815/1275055322","state":["exists","up"]},{"osd":2,"uuid":"2bee355c-eb6f-4174-a4ad-c1927a01db68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6818","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6819","nonce":3060648710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6820","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6821","nonce":3060648710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6824","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6825","nonce":3060648710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6822","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6823","nonce":3060648710}]},"public_addr":"172.21.2.103:6819/3060648710","cluster_addr":"172.21.2.103:6821/3060648710","heartbeat_back_addr":"172.21.2.103:6825/3060648710","heartbeat_front_addr":"172.21.2.103:6823/3060648710","state":["exists","up"]},{"osd":3,"uuid":"cd6542e9-2018-4531-8712-34829d2fa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6826","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6827","nonce":1193170074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6828","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6829","nonce":1193170074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6832","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6833","nonce":1193170074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6830","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6831","nonce":1193170074}]},"public_addr":"172.21.2.103:6827/1193170074","cluster_addr":"172.21.2.103:6829/1193170074","heartbeat_back_addr":"172.21.2.103:6833/1193170074","heartbeat_front_addr":"172.21.2.103:6831/1193170074","state":["exists","up"]},{"osd":4,"uuid":"e34f549d-6455-4902-8e28-b62de18179cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6801","nonce":3764758690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6803","nonce":3764758690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6807","nonce":3764758690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6805","nonce":3764758690}]},"public_addr":"172.21.2.143:6801/3764758690","cluster_addr":"172.21.2.143:6803/3764758690","heartbeat_back_addr":"172.21.2.143:6807/3764758690","heartbeat_front_addr":"172.21.2.143:6805/3764758690","state":["exists","up"]},{"osd":5,"uuid":"2e87ccff-6aca-42b9-977e-eacf5afbde08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6809","nonce":3023567294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6810","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6811","nonce":3023567294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6814","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6815","nonce":3023567294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6813","nonce":3023567294}]},"public_addr":"172.21.2.143:6809/3023567294","cluster_addr":"172.21.2.143:6811/3023567294","heartbeat_back_addr":"172.21.2.143:6815/3023567294","heartbeat_front_addr":"172.21.2.143:6813/3023567294","state":["exists","up"]},{"osd":6,"uuid":"2ad182fc-ab4c-4b6c-82b1-631487e2292a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6817","nonce":500274849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6818","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6819","nonce":500274849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6822","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6823","nonce":500274849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6821","nonce":500274849}]},"public_addr":"172.21.2.143:6817/500274849","cluster_addr":"172.21.2.143:6819/500274849","heartbeat_back_addr":"172.21.2.143:6823/500274849","heartbeat_front_addr":"172.21.2.143:6821/500274849","state":["exists","up"]},{"osd":7,"uuid":"b7f28b82-26f4-4986-b100-8fd72cbd424e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6824","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6825","nonce":3056964677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6826","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6827","nonce":3056964677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6830","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6831","nonce":3056964677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6828","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6829","nonce":3056964677}]},"public_addr":"172.21.2.143:6825/3056964677","cluster_addr":"172.21.2.143:6827/3056964677","heartbeat_back_addr":"172.21.2.143:6831/3056964677","heartbeat_front_addr":"172.21.2.143:6829/3056964677","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:11.324695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:33.118571+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:59.644431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:44:21.534759+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:44:42.374821+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:05.947257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:28.287855+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:53.438563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.103:6800/2012233970":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/1049164244":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/2525947923":"2021-03-11T13:41:34.844327+0000","172.21.2.103:6801/2012233970":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/184559695":"2021-03-11T13:41:20.588356+0000","172.21.2.103:0/3560639010":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/3079389261":"2021-03-11T13:41:20.588356+0000","172.21.2.103:6801/3738610366":"2021-03-11T13:41:20.588356+0000","172.21.2.103:0/2319811689":"2021-03-11T13:41:20.588356+0000","172.21.2.103:6800/3738610366":"2021-03-11T13:41:20.588356+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:46:23.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:22 gibba003 bash[9769]: cephadm 2021-03-10T13:46:21.665407+0000 mgr.y (mgr.14140) 186 : cephadm [INF] Deploying daemon grafana.a on gibba043 2021-03-10T13:46:23.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:22 gibba003 bash[9769]: cluster 2021-03-10T13:46:21.921639+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:22 gibba003 bash[12956]: cephadm 2021-03-10T13:46:21.665407+0000 mgr.y (mgr.14140) 186 : cephadm [INF] Deploying daemon grafana.a on gibba043 2021-03-10T13:46:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:22 gibba003 bash[12956]: cluster 2021-03-10T13:46:21.921639+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:22 gibba043 bash[9839]: cephadm 2021-03-10T13:46:21.665407+0000 mgr.y (mgr.14140) 186 : cephadm [INF] Deploying daemon grafana.a on gibba043 2021-03-10T13:46:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:22 gibba043 bash[9839]: cluster 2021-03-10T13:46:21.921639+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:23.741 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-10T13:41:13.891422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2021-03-10T13:46:23.741 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-03-10T13:46:24.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:23 gibba003 bash[9769]: audit 2021-03-10T13:46:23.147180+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.103:0/3854336467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:24.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:23 gibba003 bash[12956]: audit 2021-03-10T13:46:23.147180+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.103:0/3854336467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:23 gibba043 bash[9839]: audit 2021-03-10T13:46:23.147180+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.103:0/3854336467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:25.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:24 gibba003 bash[9769]: cluster 2021-03-10T13:46:23.922608+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:25 gibba003 bash[12956]: cluster 2021-03-10T13:46:23.922608+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:24 gibba043 bash[9839]: cluster 2021-03-10T13:46:23.922608+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:26.383 INFO:teuthology.orchestra.run.gibba003.stdout:pg_num: 1 2021-03-10T13:46:26.956 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-03-10T13:46:26.957 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-03-10T13:46:26.958 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph mgr dump --format=json 2021-03-10T13:46:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:26 gibba043 bash[9839]: cluster 2021-03-10T13:46:25.923548+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:26 gibba043 bash[9839]: audit 2021-03-10T13:46:26.377791+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.103:0/3723444231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:46:27.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:26 gibba003 bash[9769]: cluster 2021-03-10T13:46:25.923548+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:27.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:26 gibba003 bash[9769]: audit 2021-03-10T13:46:26.377791+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.103:0/3723444231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:46:27.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:26 gibba003 bash[12956]: cluster 2021-03-10T13:46:25.923548+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:27.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:26 gibba003 bash[12956]: audit 2021-03-10T13:46:26.377791+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.103:0/3723444231' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:46:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:28 gibba043 bash[9839]: cluster 2021-03-10T13:46:27.923915+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:29.431 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:46:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:28 gibba003 bash[9769]: cluster 2021-03-10T13:46:27.923915+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:29.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:28 gibba003 bash[12956]: cluster 2021-03-10T13:46:27.923915+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:30.008 INFO:teuthology.orchestra.run.gibba003.stdout:{"epoch":15,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6800","nonce":4285261622},{"type":"v1","addr":"172.21.2.103:6801","nonce":4285261622}]},"active_addr":"172.21.2.103:6801/4285261622","active_change":"2021-03-10T13:41:34.844751+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34115,"name":"gibba043.dnkmem","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://gibba003:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.103:0","nonce":481027333}]},{"addrvec":[{"type":"v2","addr":"172.21.2.103:0","nonce":1442518189}]},{"addrvec":[{"type":"v2","addr":"172.21.2.103:0","nonce":4115203706}]}]}} 2021-03-10T13:46:30.014 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-03-10T13:46:30.014 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-03-10T13:46:30.015 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:46:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:29 gibba043 bash[9839]: audit 2021-03-10T13:46:29.420385+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.103:0/287014059' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:46:30.354 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:29 gibba003 bash[9769]: audit 2021-03-10T13:46:29.420385+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.103:0/287014059' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:46:30.355 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:29 gibba003 bash[12956]: audit 2021-03-10T13:46:29.420385+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.103:0/287014059' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:46:30.696 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:30 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:30.348Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001100713s 2021-03-10T13:46:31.163 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:31 gibba003 bash[9769]: cluster 2021-03-10T13:46:29.924684+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:31.164 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:31 gibba003 bash[12956]: cluster 2021-03-10T13:46:29.924684+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:31 gibba043 bash[9839]: cluster 2021-03-10T13:46:29.924684+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:32.555 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:46:32.556 INFO:teuthology.orchestra.run.gibba003.stdout:{"epoch":51,"fsid":"33572ad6-81a6-11eb-9080-001a4aab830c","created":"2021-03-10T13:41:03.716275+0000","modified":"2021-03-10T13:45:56.095279+0000","last_up_change":"2021-03-10T13:45:55.080469+0000","last_in_change":"2021-03-10T13:45:55.080469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:41:13.891422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"0d26860c-9743-487b-8483-5d559e1f056b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6802","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6803","nonce":278332524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6804","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6805","nonce":278332524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6808","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6809","nonce":278332524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6806","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6807","nonce":278332524}]},"public_addr":"172.21.2.103:6803/278332524","cluster_addr":"172.21.2.103:6805/278332524","heartbeat_back_addr":"172.21.2.103:6809/278332524","heartbeat_front_addr":"172.21.2.103:6807/278332524","state":["exists","up"]},{"osd":1,"uuid":"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":18,"up_from":21,"up_thru":35,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6810","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6811","nonce":1275055322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6812","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6813","nonce":1275055322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6816","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6817","nonce":1275055322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6814","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6815","nonce":1275055322}]},"public_addr":"172.21.2.103:6811/1275055322","cluster_addr":"172.21.2.103:6813/1275055322","heartbeat_back_addr":"172.21.2.103:6817/1275055322","heartbeat_front_addr":"172.21.2.103:6815/1275055322","state":["exists","up"]},{"osd":2,"uuid":"2bee355c-eb6f-4174-a4ad-c1927a01db68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6818","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6819","nonce":3060648710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6820","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6821","nonce":3060648710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6824","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6825","nonce":3060648710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6822","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6823","nonce":3060648710}]},"public_addr":"172.21.2.103:6819/3060648710","cluster_addr":"172.21.2.103:6821/3060648710","heartbeat_back_addr":"172.21.2.103:6825/3060648710","heartbeat_front_addr":"172.21.2.103:6823/3060648710","state":["exists","up"]},{"osd":3,"uuid":"cd6542e9-2018-4531-8712-34829d2fa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6826","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6827","nonce":1193170074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6828","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6829","nonce":1193170074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6832","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6833","nonce":1193170074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6830","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6831","nonce":1193170074}]},"public_addr":"172.21.2.103:6827/1193170074","cluster_addr":"172.21.2.103:6829/1193170074","heartbeat_back_addr":"172.21.2.103:6833/1193170074","heartbeat_front_addr":"172.21.2.103:6831/1193170074","state":["exists","up"]},{"osd":4,"uuid":"e34f549d-6455-4902-8e28-b62de18179cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6801","nonce":3764758690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6803","nonce":3764758690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6807","nonce":3764758690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6805","nonce":3764758690}]},"public_addr":"172.21.2.143:6801/3764758690","cluster_addr":"172.21.2.143:6803/3764758690","heartbeat_back_addr":"172.21.2.143:6807/3764758690","heartbeat_front_addr":"172.21.2.143:6805/3764758690","state":["exists","up"]},{"osd":5,"uuid":"2e87ccff-6aca-42b9-977e-eacf5afbde08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6809","nonce":3023567294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6810","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6811","nonce":3023567294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6814","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6815","nonce":3023567294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6813","nonce":3023567294}]},"public_addr":"172.21.2.143:6809/3023567294","cluster_addr":"172.21.2.143:6811/3023567294","heartbeat_back_addr":"172.21.2.143:6815/3023567294","heartbeat_front_addr":"172.21.2.143:6813/3023567294","state":["exists","up"]},{"osd":6,"uuid":"2ad182fc-ab4c-4b6c-82b1-631487e2292a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6817","nonce":500274849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6818","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6819","nonce":500274849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6822","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6823","nonce":500274849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6821","nonce":500274849}]},"public_addr":"172.21.2.143:6817/500274849","cluster_addr":"172.21.2.143:6819/500274849","heartbeat_back_addr":"172.21.2.143:6823/500274849","heartbeat_front_addr":"172.21.2.143:6821/500274849","state":["exists","up"]},{"osd":7,"uuid":"b7f28b82-26f4-4986-b100-8fd72cbd424e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6824","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6825","nonce":3056964677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6826","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6827","nonce":3056964677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6830","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6831","nonce":3056964677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6828","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6829","nonce":3056964677}]},"public_addr":"172.21.2.143:6825/3056964677","cluster_addr":"172.21.2.143:6827/3056964677","heartbeat_back_addr":"172.21.2.143:6831/3056964677","heartbeat_front_addr":"172.21.2.143:6829/3056964677","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:11.324695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:33.118571+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:59.644431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:44:21.534759+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:44:42.374821+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:05.947257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:28.287855+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:53.438563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.103:6800/2012233970":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/1049164244":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/2525947923":"2021-03-11T13:41:34.844327+0000","172.21.2.103:6801/2012233970":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/184559695":"2021-03-11T13:41:20.588356+0000","172.21.2.103:0/3560639010":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/3079389261":"2021-03-11T13:41:20.588356+0000","172.21.2.103:6801/3738610366":"2021-03-11T13:41:20.588356+0000","172.21.2.103:0/2319811689":"2021-03-11T13:41:20.588356+0000","172.21.2.103:6800/3738610366":"2021-03-11T13:41:20.588356+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:46:32.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:32 gibba043 docker[19165]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-grafana.a 2021-03-10T13:46:32.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:32 gibba043 systemd[1]: Started Ceph grafana.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:33.134 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-03-10T13:46:33.135 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:46:33.273 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[9769]: cluster 2021-03-10T13:46:31.925679+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:33.274 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[12956]: cluster 2021-03-10T13:46:31.925679+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:33.275 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[9769]: audit 2021-03-10T13:46:32.315355+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:33.275 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[9769]: audit 2021-03-10T13:46:32.323976+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:33.275 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[9769]: audit 2021-03-10T13:46:32.324804+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:33.276 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[9769]: audit 2021-03-10T13:46:32.548909+0000 mon.a (mon.0) 542 : audit [DBG] from='client.? 172.21.2.103:0/3692902289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:33.276 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[12956]: audit 2021-03-10T13:46:32.315355+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:33.276 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[12956]: audit 2021-03-10T13:46:32.323976+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:33.277 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[12956]: audit 2021-03-10T13:46:32.324804+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:33.277 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:33 gibba003 bash[12956]: audit 2021-03-10T13:46:32.548909+0000 mon.a (mon.0) 542 : audit [DBG] from='client.? 172.21.2.103:0/3692902289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:33.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[9839]: cluster 2021-03-10T13:46:31.925679+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:33.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[9839]: audit 2021-03-10T13:46:32.315355+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:33.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[9839]: audit 2021-03-10T13:46:32.323976+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550599\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.550865\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551061\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551228\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551378\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551523\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551668\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551811\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:21.551954\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:33.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[9839]: audit 2021-03-10T13:46:32.324804+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:33.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[9839]: audit 2021-03-10T13:46:32.548909+0000 mon.a (mon.0) 542 : audit [DBG] from='client.? 172.21.2.103:0/3692902289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:33.623 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2021-03-10T13:46:33.624 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-03-10T13:46:33.624 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-03-10T13:46:33.624 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-03-10T13:46:33.625 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-03-10T13:46:33.625 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-03-10T13:46:33.625 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-03-10T13:46:33.625 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-03-10T13:46:33.626 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-03-10T13:46:33.626 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-03-10T13:46:33.626 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-03-10T13:46:33.626 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-03-10T13:46:33.626 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="App mode production" logger=settings 2021-03-10T13:46:33.627 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-03-10T13:46:33.627 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-03-10T13:46:33.627 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-03-10T13:46:33.627 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-03-10T13:46:33.627 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-03-10T13:46:33.628 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-03-10T13:46:33.628 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-03-10T13:46:33.628 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-03-10T13:46:33.900 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-03-10T13:46:33.900 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-03-10T13:46:33.900 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-03-10T13:46:34.171 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-03-10T13:46:34.171 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:33 gibba043 bash[19184]: t=2021-03-10T13:46:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-03-10T13:46:34.171 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T13:46:34.171 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-03-10T13:46:34.172 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[9839]: audit 2021-03-10T13:46:33.234229+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233236\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:33.233346\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:34.173 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[9839]: audit 2021-03-10T13:46:33.237808+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233236\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:33.233346\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:34.173 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[9839]: audit 2021-03-10T13:46:33.238406+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:34.299 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:34 gibba003 bash[9769]: audit 2021-03-10T13:46:33.234229+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233236\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:33.233346\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:34.299 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:34 gibba003 bash[9769]: audit 2021-03-10T13:46:33.237808+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233236\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:33.233346\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:34.300 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:34 gibba003 bash[9769]: audit 2021-03-10T13:46:33.238406+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:34.300 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:34 gibba003 bash[12956]: audit 2021-03-10T13:46:33.234229+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233236\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:33.233346\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:34.301 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:34 gibba003 bash[12956]: audit 2021-03-10T13:46:33.237808+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"338480344b7b\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233236\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:19.413159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:09.407067\"}}, \"last_daemon_update\": \"2021-03-10T13:46:33.233346\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:34.301 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:34 gibba003 bash[12956]: audit 2021-03-10T13:46:33.238406+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:34.338 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-03-10T13:46:34.338 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-03-10T13:46:34.459 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-03-10T13:46:34.459 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-03-10T13:46:34.750 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-03-10T13:46:34.750 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-03-10T13:46:34.751 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-03-10T13:46:34.751 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-03-10T13:46:34.751 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-03-10T13:46:35.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-03-10T13:46:35.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-03-10T13:46:35.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:34 gibba043 bash[19184]: t=2021-03-10T13:46:34+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-03-10T13:46:35.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[9769]: cluster 2021-03-10T13:46:33.926388+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:35.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[12956]: cluster 2021-03-10T13:46:33.926388+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:35.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[12956]: audit 2021-03-10T13:46:34.105248+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104440\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:34.104552\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:35.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[12956]: audit 2021-03-10T13:46:34.108175+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104440\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:34.104552\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:35.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[12956]: cephadm 2021-03-10T13:46:34.109601+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:46:35.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[12956]: cephadm 2021-03-10T13:46:34.111489+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba003 2021-03-10T13:46:35.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[9769]: audit 2021-03-10T13:46:34.105248+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104440\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:34.104552\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:35.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[9769]: audit 2021-03-10T13:46:34.108175+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104440\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:34.104552\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:35.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[9769]: cephadm 2021-03-10T13:46:34.109601+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:46:35.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:35 gibba003 bash[9769]: cephadm 2021-03-10T13:46:34.111489+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba003 2021-03-10T13:46:35.286 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-03-10T13:46:35.286 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-03-10T13:46:35.287 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-03-10T13:46:35.287 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-03-10T13:46:35.288 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[9839]: cluster 2021-03-10T13:46:33.926388+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:35.288 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[9839]: audit 2021-03-10T13:46:34.105248+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104440\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:34.104552\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:35.288 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[9839]: audit 2021-03-10T13:46:34.108175+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"b46117029763\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104440\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:07.756940\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:45:53.327468\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:34.104552\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:35.289 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[9839]: cephadm 2021-03-10T13:46:34.109601+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:46:35.289 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[9839]: cephadm 2021-03-10T13:46:34.111489+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba003 2021-03-10T13:46:35.592 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-03-10T13:46:35.593 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-03-10T13:46:35.593 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-03-10T13:46:35.593 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-03-10T13:46:35.894 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-03-10T13:46:35.895 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-03-10T13:46:35.895 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-03-10T13:46:35.895 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-03-10T13:46:35.896 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-03-10T13:46:36.182 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:35 gibba043 bash[19184]: t=2021-03-10T13:46:35+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-03-10T13:46:36.183 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-03-10T13:46:36.183 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-03-10T13:46:36.183 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-03-10T13:46:36.492 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-03-10T13:46:36.492 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-03-10T13:46:36.493 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-03-10T13:46:36.493 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-03-10T13:46:36.581 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:46:36.581 INFO:teuthology.orchestra.run.gibba003.stdout:{"epoch":51,"fsid":"33572ad6-81a6-11eb-9080-001a4aab830c","created":"2021-03-10T13:41:03.716275+0000","modified":"2021-03-10T13:45:56.095279+0000","last_up_change":"2021-03-10T13:45:55.080469+0000","last_in_change":"2021-03-10T13:45:55.080469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:41:13.891422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"0d26860c-9743-487b-8483-5d559e1f056b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6802","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6803","nonce":278332524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6804","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6805","nonce":278332524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6808","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6809","nonce":278332524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6806","nonce":278332524},{"type":"v1","addr":"172.21.2.103:6807","nonce":278332524}]},"public_addr":"172.21.2.103:6803/278332524","cluster_addr":"172.21.2.103:6805/278332524","heartbeat_back_addr":"172.21.2.103:6809/278332524","heartbeat_front_addr":"172.21.2.103:6807/278332524","state":["exists","up"]},{"osd":1,"uuid":"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":18,"up_from":21,"up_thru":35,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6810","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6811","nonce":1275055322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6812","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6813","nonce":1275055322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6816","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6817","nonce":1275055322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6814","nonce":1275055322},{"type":"v1","addr":"172.21.2.103:6815","nonce":1275055322}]},"public_addr":"172.21.2.103:6811/1275055322","cluster_addr":"172.21.2.103:6813/1275055322","heartbeat_back_addr":"172.21.2.103:6817/1275055322","heartbeat_front_addr":"172.21.2.103:6815/1275055322","state":["exists","up"]},{"osd":2,"uuid":"2bee355c-eb6f-4174-a4ad-c1927a01db68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6818","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6819","nonce":3060648710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6820","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6821","nonce":3060648710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6824","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6825","nonce":3060648710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6822","nonce":3060648710},{"type":"v1","addr":"172.21.2.103:6823","nonce":3060648710}]},"public_addr":"172.21.2.103:6819/3060648710","cluster_addr":"172.21.2.103:6821/3060648710","heartbeat_back_addr":"172.21.2.103:6825/3060648710","heartbeat_front_addr":"172.21.2.103:6823/3060648710","state":["exists","up"]},{"osd":3,"uuid":"cd6542e9-2018-4531-8712-34829d2fa049","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6826","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6827","nonce":1193170074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6828","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6829","nonce":1193170074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6832","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6833","nonce":1193170074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.103:6830","nonce":1193170074},{"type":"v1","addr":"172.21.2.103:6831","nonce":1193170074}]},"public_addr":"172.21.2.103:6827/1193170074","cluster_addr":"172.21.2.103:6829/1193170074","heartbeat_back_addr":"172.21.2.103:6833/1193170074","heartbeat_front_addr":"172.21.2.103:6831/1193170074","state":["exists","up"]},{"osd":4,"uuid":"e34f549d-6455-4902-8e28-b62de18179cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6801","nonce":3764758690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6803","nonce":3764758690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6807","nonce":3764758690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":3764758690},{"type":"v1","addr":"172.21.2.143:6805","nonce":3764758690}]},"public_addr":"172.21.2.143:6801/3764758690","cluster_addr":"172.21.2.143:6803/3764758690","heartbeat_back_addr":"172.21.2.143:6807/3764758690","heartbeat_front_addr":"172.21.2.143:6805/3764758690","state":["exists","up"]},{"osd":5,"uuid":"2e87ccff-6aca-42b9-977e-eacf5afbde08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6809","nonce":3023567294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6810","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6811","nonce":3023567294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6814","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6815","nonce":3023567294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":3023567294},{"type":"v1","addr":"172.21.2.143:6813","nonce":3023567294}]},"public_addr":"172.21.2.143:6809/3023567294","cluster_addr":"172.21.2.143:6811/3023567294","heartbeat_back_addr":"172.21.2.143:6815/3023567294","heartbeat_front_addr":"172.21.2.143:6813/3023567294","state":["exists","up"]},{"osd":6,"uuid":"2ad182fc-ab4c-4b6c-82b1-631487e2292a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6817","nonce":500274849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6818","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6819","nonce":500274849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6822","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6823","nonce":500274849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":500274849},{"type":"v1","addr":"172.21.2.143:6821","nonce":500274849}]},"public_addr":"172.21.2.143:6817/500274849","cluster_addr":"172.21.2.143:6819/500274849","heartbeat_back_addr":"172.21.2.143:6823/500274849","heartbeat_front_addr":"172.21.2.143:6821/500274849","state":["exists","up"]},{"osd":7,"uuid":"b7f28b82-26f4-4986-b100-8fd72cbd424e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6824","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6825","nonce":3056964677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6826","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6827","nonce":3056964677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6830","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6831","nonce":3056964677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6828","nonce":3056964677},{"type":"v1","addr":"172.21.2.143:6829","nonce":3056964677}]},"public_addr":"172.21.2.143:6825/3056964677","cluster_addr":"172.21.2.143:6827/3056964677","heartbeat_back_addr":"172.21.2.143:6831/3056964677","heartbeat_front_addr":"172.21.2.143:6829/3056964677","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:11.324695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:33.118571+0000","dead_epoch":19},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:59.644431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:44:21.534759+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:44:42.374821+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:05.947257+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:28.287855+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:53.438563+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.103:6800/2012233970":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/1049164244":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/2525947923":"2021-03-11T13:41:34.844327+0000","172.21.2.103:6801/2012233970":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/184559695":"2021-03-11T13:41:20.588356+0000","172.21.2.103:0/3560639010":"2021-03-11T13:41:34.844327+0000","172.21.2.103:0/3079389261":"2021-03-11T13:41:20.588356+0000","172.21.2.103:6801/3738610366":"2021-03-11T13:41:20.588356+0000","172.21.2.103:0/2319811689":"2021-03-11T13:41:20.588356+0000","172.21.2.103:6800/3738610366":"2021-03-11T13:41:20.588356+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:46:36.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-03-10T13:46:36.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-03-10T13:46:36.775 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-03-10T13:46:37.029 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-03-10T13:46:37.029 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-03-10T13:46:37.029 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-03-10T13:46:37.030 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:36 gibba043 bash[19184]: t=2021-03-10T13:46:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-03-10T13:46:37.297 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[9839]: cluster 2021-03-10T13:46:35.927096+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:37.297 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[9839]: audit 2021-03-10T13:46:36.574568+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.2.103:0/2418544770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:37.297 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-03-10T13:46:37.298 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-03-10T13:46:37.298 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-03-10T13:46:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:37 gibba003 bash[9769]: cluster 2021-03-10T13:46:35.927096+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:37 gibba003 bash[9769]: audit 2021-03-10T13:46:36.574568+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.2.103:0/2418544770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:37 gibba003 bash[12956]: cluster 2021-03-10T13:46:35.927096+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:37 gibba003 bash[12956]: audit 2021-03-10T13:46:36.574568+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.2.103:0/2418544770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:46:37.548 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-03-10T13:46:37.548 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-03-10T13:46:37.548 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-03-10T13:46:37.683 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-03-10T13:46:37.799 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-03-10T13:46:37.799 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-03-10T13:46:37.799 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-03-10T13:46:38.050 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-03-10T13:46:38.050 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-03-10T13:46:38.050 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:37 gibba043 bash[19184]: t=2021-03-10T13:46:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-03-10T13:46:38.319 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-03-10T13:46:38.319 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-03-10T13:46:38.319 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-03-10T13:46:38.319 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-03-10T13:46:38.320 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-03-10T13:46:38.648 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-03-10T13:46:38.648 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-03-10T13:46:38.648 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-03-10T13:46:38.988 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-03-10T13:46:38.988 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-03-10T13:46:38.988 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-03-10T13:46:38.988 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-03-10T13:46:39.248 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[9839]: cluster 2021-03-10T13:46:37.927882+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:39.249 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:38 gibba043 bash[19184]: t=2021-03-10T13:46:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-03-10T13:46:39.249 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-03-10T13:46:39.249 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-03-10T13:46:39.249 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-03-10T13:46:39.306 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:39 gibba003 bash[9769]: cluster 2021-03-10T13:46:37.927882+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:39.306 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:39 gibba003 bash[12956]: cluster 2021-03-10T13:46:37.927882+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:39.499 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-03-10T13:46:39.499 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T13:46:39.697 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:39 gibba003 systemd[1]: Stopping Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:46:39.697 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:39 gibba003 bash[20890]: level=info ts=2021-03-10T13:46:39.411Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:46:39.750 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-03-10T13:46:39.751 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-03-10T13:46:39.751 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-03-10T13:46:39.751 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-03-10T13:46:40.002 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-03-10T13:46:40.016 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-03-10T13:46:40.016 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-03-10T13:46:40.017 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:39 gibba043 bash[19184]: t=2021-03-10T13:46:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-03-10T13:46:40.270 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-03-10T13:46:40.271 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-03-10T13:46:40.271 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-03-10T13:46:40.271 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-03-10T13:46:40.522 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-03-10T13:46:40.522 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-03-10T13:46:40.773 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-03-10T13:46:40.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-03-10T13:46:40.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-03-10T13:46:40.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-03-10T13:46:40.947 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:40 gibba003 docker[22459]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:46:40.948 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:40 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T13:46:40.948 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:40 gibba003 systemd[1]: Stopped Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:40.948 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:40 gibba003 systemd[1]: Starting Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:46:40.948 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:40 gibba003 docker[22516]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:46:40.949 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:40 gibba003 systemd[1]: Started Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:41.072 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:40 gibba043 bash[19184]: t=2021-03-10T13:46:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-03-10T13:46:41.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[9839]: cluster 2021-03-10T13:46:39.928600+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:41.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[9839]: audit 2021-03-10T13:46:40.632685+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:41.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[9839]: audit 2021-03-10T13:46:40.636874+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:41.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:41 gibba003 bash[9769]: cluster 2021-03-10T13:46:39.928600+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:41.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:41 gibba003 bash[12956]: cluster 2021-03-10T13:46:39.928600+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:41.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:41 gibba003 bash[9769]: audit 2021-03-10T13:46:40.632685+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:41.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:41 gibba003 bash[9769]: audit 2021-03-10T13:46:40.636874+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:41.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:41 gibba003 bash[12956]: audit 2021-03-10T13:46:40.632685+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:41.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:41 gibba003 bash[12956]: audit 2021-03-10T13:46:40.636874+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232781\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232883\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232938\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.232988\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233039\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233087\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233137\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:33.233187\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:41.673 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[19184]: t=2021-03-10T13:46:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-03-10T13:46:41.673 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[19184]: t=2021-03-10T13:46:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-03-10T13:46:41.773 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[19184]: t=2021-03-10T13:46:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-03-10T13:46:42.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[9769]: cephadm 2021-03-10T13:46:40.637424+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:46:42.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[9769]: cephadm 2021-03-10T13:46:40.639733+0000 mgr.y (mgr.14140) 200 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba043 2021-03-10T13:46:42.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[12956]: cephadm 2021-03-10T13:46:40.637424+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:46:42.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[12956]: cephadm 2021-03-10T13:46:40.639733+0000 mgr.y (mgr.14140) 200 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba043 2021-03-10T13:46:42.199 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.004Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:46:42.199 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.004Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:46:42.200 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.005Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.103 port=9094 2021-03-10T13:46:42.200 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.006Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:46:42.200 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.020Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:46:42.200 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.020Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:46:42.201 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:42 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:42.022Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:46:42.254 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[9839]: cephadm 2021-03-10T13:46:40.637424+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:46:42.254 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[9839]: cephadm 2021-03-10T13:46:40.639733+0000 mgr.y (mgr.14140) 200 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba043 2021-03-10T13:46:42.255 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:41 gibba043 bash[19184]: t=2021-03-10T13:46:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-03-10T13:46:42.255 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-03-10T13:46:42.507 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-03-10T13:46:42.508 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-03-10T13:46:42.508 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-03-10T13:46:42.580 INFO:teuthology.orchestra.run.gibba003.stdout:42949673003 2021-03-10T13:46:42.581 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-03-10T13:46:42.773 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-03-10T13:46:42.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-03-10T13:46:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:43 gibba043 bash[9839]: cluster 2021-03-10T13:46:41.929018+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:43.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-03-10T13:46:43.275 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:42 gibba043 bash[19184]: t=2021-03-10T13:46:42+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-03-10T13:46:43.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:43 gibba003 bash[9769]: cluster 2021-03-10T13:46:41.929018+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:43 gibba003 bash[12956]: cluster 2021-03-10T13:46:41.929018+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:43.801 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:43 gibba043 bash[19184]: t=2021-03-10T13:46:43+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-03-10T13:46:43.801 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:43 gibba043 bash[19184]: t=2021-03-10T13:46:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-03-10T13:46:43.802 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:43 gibba043 bash[19184]: t=2021-03-10T13:46:43+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-03-10T13:46:44.174 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:43 gibba043 bash[19184]: t=2021-03-10T13:46:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-03-10T13:46:44.175 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:44 gibba043 bash[19184]: t=2021-03-10T13:46:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-03-10T13:46:44.197 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:44 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:44.006Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000063056s 2021-03-10T13:46:44.505 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:44 gibba043 bash[19184]: t=2021-03-10T13:46:44+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-03-10T13:46:44.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:44 gibba043 bash[19184]: t=2021-03-10T13:46:44+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-03-10T13:46:44.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:44 gibba043 bash[19184]: t=2021-03-10T13:46:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-03-10T13:46:45.102 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:44 gibba043 bash[19184]: t=2021-03-10T13:46:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-03-10T13:46:45.103 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:44 gibba043 bash[19184]: t=2021-03-10T13:46:44+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-03-10T13:46:45.330 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:45 gibba003 bash[9769]: cluster 2021-03-10T13:46:43.929792+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:45.330 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:45 gibba003 bash[12956]: cluster 2021-03-10T13:46:43.929792+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:45.360 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[9839]: cluster 2021-03-10T13:46:43.929792+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:45.360 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[19184]: t=2021-03-10T13:46:45+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-03-10T13:46:45.360 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[19184]: t=2021-03-10T13:46:45+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-03-10T13:46:45.360 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[19184]: t=2021-03-10T13:46:45+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-03-10T13:46:45.633 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[19184]: t=2021-03-10T13:46:45+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-03-10T13:46:45.744 INFO:teuthology.orchestra.run.gibba003.stdout:90194313251 2021-03-10T13:46:45.744 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-03-10T13:46:45.945 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[19184]: t=2021-03-10T13:46:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-03-10T13:46:46.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:45 gibba043 bash[19184]: t=2021-03-10T13:46:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-03-10T13:46:46.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-03-10T13:46:46.544 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 systemd[1]: Stopping Ceph prometheus.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:46:46.544 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-03-10T13:46:46.545 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-03-10T13:46:46.545 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-03-10T13:46:46.857 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-03-10T13:46:46.858 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-03-10T13:46:46.858 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=warn ts=2021-03-10T13:46:46.540Z caller=main.go:629 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:46:46.859 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:652 msg="Stopping scrape discovery manager..." 2021-03-10T13:46:46.859 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:666 msg="Stopping notify discovery manager..." 2021-03-10T13:46:46.859 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:688 msg="Stopping scrape manager..." 2021-03-10T13:46:46.859 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=manager.go:924 component="rule manager" msg="Stopping rule manager..." 2021-03-10T13:46:46.859 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=manager.go:934 component="rule manager" msg="Rule manager stopped" 2021-03-10T13:46:46.860 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:662 msg="Notify discovery manager stopped" 2021-03-10T13:46:46.860 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:648 msg="Scrape discovery manager stopped" 2021-03-10T13:46:46.860 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:682 msg="Scrape manager stopped" 2021-03-10T13:46:46.860 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-03-10T13:46:46.861 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:856 msg="Notifier manager stopped" 2021-03-10T13:46:46.861 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[17895]: level=info ts=2021-03-10T13:46:46.540Z caller=main.go:868 msg="See you next time!" 2021-03-10T13:46:47.115 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:46 gibba043 bash[19184]: t=2021-03-10T13:46:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-03-10T13:46:47.369 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:47 gibba043 bash[9839]: cluster 2021-03-10T13:46:45.930694+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:47.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:47 gibba003 bash[9769]: cluster 2021-03-10T13:46:45.930694+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:47.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:47 gibba003 bash[12956]: cluster 2021-03-10T13:46:45.930694+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:47.622 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:47 gibba043 docker[19754]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:46:47.623 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:47 gibba043 bash[19184]: t=2021-03-10T13:46:47+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-03-10T13:46:47.623 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:47 gibba043 bash[19184]: t=2021-03-10T13:46:47+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-03-10T13:46:48.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:47 gibba043 bash[19184]: t=2021-03-10T13:46:47+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-03-10T13:46:48.024 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:47 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@prometheus.a.service: Succeeded. 2021-03-10T13:46:48.025 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:47 gibba043 systemd[1]: Stopped Ceph prometheus.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:48.025 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:47 gibba043 systemd[1]: Starting Ceph prometheus.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:46:48.025 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:47 gibba043 docker[19791]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:46:48.026 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:47 gibba043 systemd[1]: Started Ceph prometheus.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:46:48.303 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[12956]: audit 2021-03-10T13:46:47.654053+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:48.303 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[12956]: audit 2021-03-10T13:46:47.662581+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:48.304 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[12956]: audit 2021-03-10T13:46:47.663318+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba043:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:46:48.304 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[12956]: audit 2021-03-10T13:46:47.666324+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba043:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:46:48.304 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[12956]: audit 2021-03-10T13:46:47.668548+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:48.305 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[9769]: audit 2021-03-10T13:46:47.654053+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:48.305 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[9769]: audit 2021-03-10T13:46:47.662581+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:48.305 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[9769]: audit 2021-03-10T13:46:47.663318+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba043:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:46:48.306 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[9769]: audit 2021-03-10T13:46:47.666324+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba043:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:46:48.306 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:48 gibba003 bash[9769]: audit 2021-03-10T13:46:47.668548+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:48.503 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[19184]: t=2021-03-10T13:46:48+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-03-10T13:46:48.504 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[19184]: t=2021-03-10T13:46:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-03-10T13:46:48.505 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[9839]: audit 2021-03-10T13:46:47.654053+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:48.505 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[9839]: audit 2021-03-10T13:46:47.662581+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104225\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104285\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104313\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104339\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104365\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104390\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104415\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104465\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:34.104490\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:48.505 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[9839]: audit 2021-03-10T13:46:47.663318+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba043:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:46:48.505 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[9839]: audit 2021-03-10T13:46:47.666324+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba043:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:46:48.506 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[9839]: audit 2021-03-10T13:46:47.668548+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:48.764 INFO:teuthology.orchestra.run.gibba003.stdout:107374182435 2021-03-10T13:46:48.764 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-03-10T13:46:48.773 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[19184]: t=2021-03-10T13:46:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-03-10T13:46:48.773 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[19184]: t=2021-03-10T13:46:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-03-10T13:46:49.086 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[19184]: t=2021-03-10T13:46:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-03-10T13:46:49.087 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:48 gibba043 bash[19184]: t=2021-03-10T13:46:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-03-10T13:46:49.393 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-03-10T13:46:49.394 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-03-10T13:46:49.394 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-03-10T13:46:49.395 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.283Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T13:46:49.395 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.283Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T13:46:49.395 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.283Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T13:46:49.395 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.283Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba043 (none))" 2021-03-10T13:46:49.396 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.283Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T13:46:49.396 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.283Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T13:46:49.396 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.284Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T13:46:49.396 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.285Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T13:46:49.396 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.285Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T13:46:49.397 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.287Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T13:46:49.397 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.287Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.479µs 2021-03-10T13:46:49.397 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.287Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T13:46:49.397 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.287Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-03-10T13:46:49.398 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.287Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-03-10T13:46:49.398 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.287Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=14.621µs wal_replay_duration=608.226µs total_replay_duration=635.384µs 2021-03-10T13:46:49.398 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.288Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T13:46:49.398 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.288Z caller=main.go:802 msg="TSDB started" 2021-03-10T13:46:49.399 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.288Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T13:46:49.399 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.289Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=473.494µs remote_storage=850ns web_handler=151ns query_engine=414ns scrape=219.67µs scrape_sd=20.598µs notify=11.909µs notify_sd=5.711µs rules=19.479µs 2021-03-10T13:46:49.399 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19809]: level=info ts=2021-03-10T13:46:49.289Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T13:46:49.400 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[9839]: cephadm 2021-03-10T13:46:47.663148+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Setting dashboard grafana config to https://gibba043:3000 2021-03-10T13:46:49.400 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[9839]: cluster 2021-03-10T13:46:47.931024+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:49.400 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[9839]: audit 2021-03-10T13:46:48.307099+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_daemon_update\": \"2021-03-10T13:46:48.306480\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:49.401 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[9839]: audit 2021-03-10T13:46:48.310735+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_daemon_update\": \"2021-03-10T13:46:48.306480\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:49.401 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[9839]: audit 2021-03-10T13:46:48.311209+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:49.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[9769]: cephadm 2021-03-10T13:46:47.663148+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Setting dashboard grafana config to https://gibba043:3000 2021-03-10T13:46:49.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[9769]: cluster 2021-03-10T13:46:47.931024+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:49.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[12956]: cephadm 2021-03-10T13:46:47.663148+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Setting dashboard grafana config to https://gibba043:3000 2021-03-10T13:46:49.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[12956]: cluster 2021-03-10T13:46:47.931024+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:49.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[9769]: audit 2021-03-10T13:46:48.307099+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_daemon_update\": \"2021-03-10T13:46:48.306480\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:49.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[9769]: audit 2021-03-10T13:46:48.310735+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_daemon_update\": \"2021-03-10T13:46:48.306480\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:49.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[9769]: audit 2021-03-10T13:46:48.311209+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:49.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[12956]: audit 2021-03-10T13:46:48.307099+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_daemon_update\": \"2021-03-10T13:46:48.306480\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:46:49.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[12956]: audit 2021-03-10T13:46:48.310735+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}}, \"last_daemon_update\": \"2021-03-10T13:46:48.306480\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:46:49.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:49 gibba003 bash[12956]: audit 2021-03-10T13:46:48.311209+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:49.662 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-03-10T13:46:49.662 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-03-10T13:46:49.662 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-03-10T13:46:49.663 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-03-10T13:46:49.930 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-03-10T13:46:49.931 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-03-10T13:46:50.181 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:49 gibba043 bash[19184]: t=2021-03-10T13:46:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-03-10T13:46:50.181 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-03-10T13:46:50.181 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-03-10T13:46:50.182 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[9839]: audit 2021-03-10T13:46:49.763587+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762547\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:49.762842\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:50.182 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[9839]: audit 2021-03-10T13:46:49.766386+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762547\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:49.762842\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:50.183 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[9839]: cluster 2021-03-10T13:46:49.931579+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:50.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:50 gibba003 bash[9769]: audit 2021-03-10T13:46:49.763587+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762547\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:49.762842\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:50.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:50 gibba003 bash[9769]: audit 2021-03-10T13:46:49.766386+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762547\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:49.762842\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:50.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:50 gibba003 bash[9769]: cluster 2021-03-10T13:46:49.931579+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:50.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:50 gibba003 bash[12956]: audit 2021-03-10T13:46:49.763587+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762547\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:49.762842\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:46:50.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:50 gibba003 bash[12956]: audit 2021-03-10T13:46:49.766386+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"7a78b79a1a0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762547\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:42:47.638077\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:45.218677\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:46:49.762842\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:46:50.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:50 gibba003 bash[12956]: cluster 2021-03-10T13:46:49.931579+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:50.484 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-03-10T13:46:50.484 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-03-10T13:46:50.485 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-03-10T13:46:50.485 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-03-10T13:46:50.485 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-03-10T13:46:50.735 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-03-10T13:46:50.736 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-03-10T13:46:50.736 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-03-10T13:46:50.736 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-03-10T13:46:51.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-03-10T13:46:51.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-03-10T13:46:51.024 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:50 gibba043 bash[19184]: t=2021-03-10T13:46:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-03-10T13:46:51.355 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-03-10T13:46:51.355 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-03-10T13:46:51.356 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-03-10T13:46:51.665 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-03-10T13:46:51.665 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-03-10T13:46:51.665 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-03-10T13:46:51.666 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-03-10T13:46:51.666 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-03-10T13:46:51.809 INFO:teuthology.orchestra.run.gibba003.stdout:128849018912 2021-03-10T13:46:51.810 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-03-10T13:46:51.966 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-03-10T13:46:51.967 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-03-10T13:46:51.967 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-03-10T13:46:52.197 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:46:52 gibba003 bash[22533]: level=info ts=2021-03-10T13:46:52.007Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000844104s 2021-03-10T13:46:52.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:51 gibba043 bash[19184]: t=2021-03-10T13:46:51+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-03-10T13:46:52.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-03-10T13:46:52.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-03-10T13:46:52.275 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-03-10T13:46:52.605 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-03-10T13:46:52.605 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-03-10T13:46:52.605 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-03-10T13:46:52.606 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-03-10T13:46:52.606 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-03-10T13:46:52.865 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-03-10T13:46:52.866 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-03-10T13:46:53.126 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[9839]: cluster 2021-03-10T13:46:51.932410+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:53.127 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-03-10T13:46:53.127 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:52 gibba043 bash[19184]: t=2021-03-10T13:46:52+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-03-10T13:46:53.127 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-03-10T13:46:53.127 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-03-10T13:46:53.402 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:52 gibba003 bash[9769]: cluster 2021-03-10T13:46:51.932410+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:53.403 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:52 gibba003 bash[12956]: cluster 2021-03-10T13:46:51.932410+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:53.466 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-03-10T13:46:53.466 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-03-10T13:46:53.466 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-03-10T13:46:53.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-03-10T13:46:53.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-03-10T13:46:53.774 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-03-10T13:46:53.775 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-03-10T13:46:54.070 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-03-10T13:46:54.070 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-03-10T13:46:54.070 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:53 gibba043 bash[19184]: t=2021-03-10T13:46:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-03-10T13:46:54.071 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-03-10T13:46:54.414 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-03-10T13:46:54.415 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-03-10T13:46:54.415 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-03-10T13:46:54.415 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-03-10T13:46:54.739 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-03-10T13:46:54.740 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-03-10T13:46:54.740 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-03-10T13:46:54.740 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-03-10T13:46:54.908 INFO:teuthology.orchestra.run.gibba003.stdout:150323855389 2021-03-10T13:46:54.909 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-03-10T13:46:55.007 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-03-10T13:46:55.008 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-03-10T13:46:55.008 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:54 gibba043 bash[19184]: t=2021-03-10T13:46:54+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-03-10T13:46:55.008 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-03-10T13:46:55.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:55 gibba003 bash[9769]: cluster 2021-03-10T13:46:53.933077+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:55.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:55 gibba003 bash[12956]: cluster 2021-03-10T13:46:53.933077+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[9839]: cluster 2021-03-10T13:46:53.933077+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:55.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-03-10T13:46:55.274 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-03-10T13:46:55.275 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-03-10T13:46:55.578 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-03-10T13:46:55.578 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-03-10T13:46:55.578 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-03-10T13:46:55.579 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-03-10T13:46:55.579 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-03-10T13:46:55.854 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-03-10T13:46:55.855 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-03-10T13:46:55.855 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-03-10T13:46:55.855 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-03-10T13:46:56.272 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:55 gibba043 bash[19184]: t=2021-03-10T13:46:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-03-10T13:46:56.272 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-03-10T13:46:56.273 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-03-10T13:46:56.273 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-03-10T13:46:56.524 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-03-10T13:46:56.524 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-03-10T13:46:56.525 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-03-10T13:46:56.525 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-03-10T13:46:56.525 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-03-10T13:46:56.525 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-03-10T13:46:56.525 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing HooksService" logger=server 2021-03-10T13:46:56.526 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-03-10T13:46:56.526 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-03-10T13:46:56.526 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-03-10T13:46:56.526 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-03-10T13:46:56.527 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-03-10T13:46:56.527 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-03-10T13:46:56.527 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-03-10T13:46:56.527 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-03-10T13:46:56.527 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-03-10T13:46:56.528 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing LoginService" logger=server 2021-03-10T13:46:56.528 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing SearchService" logger=server 2021-03-10T13:46:56.528 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing TracingService" logger=server 2021-03-10T13:46:56.528 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-03-10T13:46:56.529 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-03-10T13:46:56.529 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-03-10T13:46:56.529 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-03-10T13:46:56.529 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-03-10T13:46:56.529 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2021-03-10T13:46:56.530 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-03-10T13:46:56.530 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2021-03-10T13:46:56.530 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="Initializing Stream Manager" 2021-03-10T13:46:56.530 INFO:journalctl@ceph.grafana.a.gibba043.stdout:Mar 10 13:46:56 gibba043 bash[19184]: t=2021-03-10T13:46:56+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2021-03-10T13:46:57.318 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:57 gibba003 bash[9769]: cluster 2021-03-10T13:46:55.933641+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:57.319 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:57 gibba003 bash[12956]: cluster 2021-03-10T13:46:55.933641+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:57 gibba043 bash[9839]: cluster 2021-03-10T13:46:55.933641+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:58.041 INFO:teuthology.orchestra.run.gibba003.stdout:171798691864 2021-03-10T13:46:58.112 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-03-10T13:46:59.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:46:59 gibba003 bash[9769]: cluster 2021-03-10T13:46:57.934436+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:59.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:46:59 gibba003 bash[12956]: cluster 2021-03-10T13:46:57.934436+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:46:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:46:59 gibba043 bash[9839]: cluster 2021-03-10T13:46:57.934436+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:01.048 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:01 gibba003 bash[9769]: cluster 2021-03-10T13:46:59.935355+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:01.212 INFO:teuthology.orchestra.run.gibba003.stdout:193273528340 2021-03-10T13:47:01.213 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-03-10T13:47:01.296 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:01 gibba003 bash[12956]: cluster 2021-03-10T13:46:59.935355+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:01 gibba043 bash[9839]: cluster 2021-03-10T13:46:59.935355+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:03.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:03 gibba003 bash[9769]: cluster 2021-03-10T13:47:01.936073+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:03.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:03 gibba003 bash[12956]: cluster 2021-03-10T13:47:01.936073+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:03 gibba043 bash[9839]: cluster 2021-03-10T13:47:01.936073+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:04.387 INFO:teuthology.orchestra.run.gibba003.stdout:214748364817 2021-03-10T13:47:04.388 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-03-10T13:47:05.393 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:05 gibba003 bash[9769]: cluster 2021-03-10T13:47:03.936827+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:05.393 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:05 gibba003 bash[12956]: cluster 2021-03-10T13:47:03.936827+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:05 gibba043 bash[9839]: cluster 2021-03-10T13:47:03.936827+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:06.922 INFO:teuthology.orchestra.run.gibba003.stdout:42949673008 2021-03-10T13:47:07.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:07 gibba003 bash[12956]: cluster 2021-03-10T13:47:05.937200+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:07.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:07 gibba003 bash[12956]: audit 2021-03-10T13:47:06.915841+0000 mon.a (mon.0) 561 : audit [DBG] from='client.? 172.21.2.103:0/2899832896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:47:07.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:07 gibba003 bash[9769]: cluster 2021-03-10T13:47:05.937200+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:07.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:07 gibba003 bash[9769]: audit 2021-03-10T13:47:06.915841+0000 mon.a (mon.0) 561 : audit [DBG] from='client.? 172.21.2.103:0/2899832896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:47:07.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673003 got 42949673008 for osd.0 2021-03-10T13:47:07.503 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-03-10T13:47:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:07 gibba043 bash[9839]: cluster 2021-03-10T13:47:05.937200+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:07 gibba043 bash[9839]: audit 2021-03-10T13:47:06.915841+0000 mon.a (mon.0) 561 : audit [DBG] from='client.? 172.21.2.103:0/2899832896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:47:09.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:09 gibba003 bash[9769]: cluster 2021-03-10T13:47:07.937985+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:09 gibba003 bash[12956]: cluster 2021-03-10T13:47:07.937985+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:09 gibba043 bash[9839]: cluster 2021-03-10T13:47:07.937985+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:10.192 INFO:teuthology.orchestra.run.gibba003.stdout:90194313256 2021-03-10T13:47:10.783 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313251 got 90194313256 for osd.1 2021-03-10T13:47:10.784 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-03-10T13:47:11.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:11 gibba003 bash[9769]: cluster 2021-03-10T13:47:09.938785+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:11.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:11 gibba003 bash[9769]: audit 2021-03-10T13:47:10.185802+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.2.103:0/2805965924' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:47:11.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:11 gibba003 bash[12956]: cluster 2021-03-10T13:47:09.938785+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:11.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:11 gibba003 bash[12956]: audit 2021-03-10T13:47:10.185802+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.2.103:0/2805965924' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:47:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:11 gibba043 bash[9839]: cluster 2021-03-10T13:47:09.938785+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:11 gibba043 bash[9839]: audit 2021-03-10T13:47:10.185802+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.2.103:0/2805965924' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:47:13.360 INFO:teuthology.orchestra.run.gibba003.stdout:107374182439 2021-03-10T13:47:13.404 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:13 gibba003 bash[9769]: cluster 2021-03-10T13:47:11.939617+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:13.405 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:13 gibba003 bash[12956]: cluster 2021-03-10T13:47:11.939617+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:13 gibba043 bash[9839]: cluster 2021-03-10T13:47:11.939617+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:13.965 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182435 got 107374182439 for osd.2 2021-03-10T13:47:13.966 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-03-10T13:47:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:14 gibba003 bash[9769]: audit 2021-03-10T13:47:13.353318+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.103:0/1688625248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:47:14.469 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:14 gibba003 bash[12956]: audit 2021-03-10T13:47:13.353318+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.103:0/1688625248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:47:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:14 gibba043 bash[9839]: audit 2021-03-10T13:47:13.353318+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.103:0/1688625248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:47:15.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:15 gibba003 bash[9769]: cluster 2021-03-10T13:47:13.940318+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:15 gibba003 bash[12956]: cluster 2021-03-10T13:47:13.940318+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:15 gibba043 bash[9839]: cluster 2021-03-10T13:47:13.940318+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:16.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:16 gibba003 bash[12956]: cluster 2021-03-10T13:47:15.941307+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:16.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:16 gibba003 bash[9769]: cluster 2021-03-10T13:47:15.941307+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:16.494 INFO:teuthology.orchestra.run.gibba003.stdout:128849018917 2021-03-10T13:47:16.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:16 gibba043 bash[9839]: cluster 2021-03-10T13:47:15.941307+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:17.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018912 got 128849018917 for osd.3 2021-03-10T13:47:17.241 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-03-10T13:47:17.329 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:17 gibba003 bash[9769]: audit 2021-03-10T13:47:16.487051+0000 mon.a (mon.0) 563 : audit [DBG] from='client.? 172.21.2.103:0/2679711762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:47:17.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:17 gibba003 bash[12956]: audit 2021-03-10T13:47:16.487051+0000 mon.a (mon.0) 563 : audit [DBG] from='client.? 172.21.2.103:0/2679711762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:47:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:17 gibba043 bash[9839]: audit 2021-03-10T13:47:16.487051+0000 mon.a (mon.0) 563 : audit [DBG] from='client.? 172.21.2.103:0/2679711762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:47:18.373 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:18 gibba003 bash[9769]: cluster 2021-03-10T13:47:17.942204+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:18.374 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:18 gibba003 bash[12956]: cluster 2021-03-10T13:47:17.942204+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:18 gibba043 bash[9839]: cluster 2021-03-10T13:47:17.942204+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:19.781 INFO:teuthology.orchestra.run.gibba003.stdout:150323855393 2021-03-10T13:47:20.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:19 gibba003 bash[9769]: audit 2021-03-10T13:47:19.774367+0000 mon.a (mon.0) 564 : audit [DBG] from='client.? 172.21.2.103:0/1185670573' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:47:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:19 gibba003 bash[12956]: audit 2021-03-10T13:47:19.774367+0000 mon.a (mon.0) 564 : audit [DBG] from='client.? 172.21.2.103:0/1185670573' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:47:20.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:19 gibba043 bash[9839]: audit 2021-03-10T13:47:19.774367+0000 mon.a (mon.0) 564 : audit [DBG] from='client.? 172.21.2.103:0/1185670573' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:47:20.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855389 got 150323855393 for osd.4 2021-03-10T13:47:20.383 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-03-10T13:47:21.271 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:20 gibba003 bash[9769]: cluster 2021-03-10T13:47:19.942894+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:21.272 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:20 gibba003 bash[12956]: cluster 2021-03-10T13:47:19.942894+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:20 gibba043 bash[9839]: cluster 2021-03-10T13:47:19.942894+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:22.883 INFO:teuthology.orchestra.run.gibba003.stdout:171798691869 2021-03-10T13:47:23.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:22 gibba003 bash[9769]: cluster 2021-03-10T13:47:21.943623+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:23.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:22 gibba003 bash[9769]: audit 2021-03-10T13:47:22.876497+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.103:0/2533008248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:47:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:23 gibba003 bash[12956]: cluster 2021-03-10T13:47:21.943623+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:23 gibba003 bash[12956]: audit 2021-03-10T13:47:22.876497+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.103:0/2533008248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:47:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:22 gibba043 bash[9839]: cluster 2021-03-10T13:47:21.943623+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:22 gibba043 bash[9839]: audit 2021-03-10T13:47:22.876497+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.103:0/2533008248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:47:23.461 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691864 got 171798691869 for osd.5 2021-03-10T13:47:23.462 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-03-10T13:47:25.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:25 gibba003 bash[9769]: cluster 2021-03-10T13:47:23.944442+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:25 gibba003 bash[12956]: cluster 2021-03-10T13:47:23.944442+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:25 gibba043 bash[9839]: cluster 2021-03-10T13:47:23.944442+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:26.256 INFO:teuthology.orchestra.run.gibba003.stdout:193273528345 2021-03-10T13:47:26.813 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528340 got 193273528345 for osd.6 2021-03-10T13:47:26.814 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-03-10T13:47:27.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:27 gibba003 bash[12956]: cluster 2021-03-10T13:47:25.945268+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:27.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:27 gibba003 bash[12956]: audit 2021-03-10T13:47:26.249589+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.2.103:0/1427395803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:47:27.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:27 gibba003 bash[9769]: cluster 2021-03-10T13:47:25.945268+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:27.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:27 gibba003 bash[9769]: audit 2021-03-10T13:47:26.249589+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.2.103:0/1427395803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:47:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:27 gibba043 bash[9839]: cluster 2021-03-10T13:47:25.945268+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:27 gibba043 bash[9839]: audit 2021-03-10T13:47:26.249589+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.2.103:0/1427395803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:47:29.388 INFO:teuthology.orchestra.run.gibba003.stdout:214748364822 2021-03-10T13:47:29.433 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:29 gibba003 bash[9769]: cluster 2021-03-10T13:47:27.946173+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:29.433 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:29 gibba003 bash[12956]: cluster 2021-03-10T13:47:27.946173+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:29 gibba043 bash[9839]: cluster 2021-03-10T13:47:27.946173+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:29.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364817 got 214748364822 for osd.7 2021-03-10T13:47:29.942 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-03-10T13:47:29.942 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T13:47:30.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:30 gibba003 bash[9769]: audit 2021-03-10T13:47:29.381242+0000 mon.a (mon.0) 566 : audit [DBG] from='client.? 172.21.2.103:0/616274597' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:47:30.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:30 gibba003 bash[12956]: audit 2021-03-10T13:47:29.381242+0000 mon.a (mon.0) 566 : audit [DBG] from='client.? 172.21.2.103:0/616274597' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:47:30.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:30 gibba043 bash[9839]: audit 2021-03-10T13:47:29.381242+0000 mon.a (mon.0) 566 : audit [DBG] from='client.? 172.21.2.103:0/616274597' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:47:31.180 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:31 gibba003 bash[9769]: cluster 2021-03-10T13:47:29.946593+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:31.180 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:31 gibba003 bash[12956]: cluster 2021-03-10T13:47:29.946593+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:31.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:31 gibba043 bash[9839]: cluster 2021-03-10T13:47:29.946593+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:32.693 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:47:32.693 INFO:teuthology.orchestra.run.gibba003.stderr:dumped all 2021-03-10T13:47:33.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:33 gibba003 bash[9769]: cluster 2021-03-10T13:47:31.947413+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:33.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:33 gibba003 bash[12956]: cluster 2021-03-10T13:47:31.947413+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:33.286 INFO:teuthology.orchestra.run.gibba003.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2021-03-10T13:47:31.947040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392476,"kb_used_data":3804,"kb_used_omap":8,"kb_used_meta":8388599,"kb_avail":696250596,"statfs":{"total":721554505728,"available":712960610304,"internally_reserved":8589934592,"allocated":3895296,"data_stored":1540018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8271,"internal_metadata":8589926321},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004486"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"51","state":"active+clean","last_fresh":"2021-03-10T13:45:56.116687+0000","last_change":"2021-03-10T13:45:56.116687+0000","last_active":"2021-03-10T13:45:56.116687+0000","last_peered":"2021-03-10T13:45:56.116687+0000","last_clean":"2021-03-10T13:45:56.116687+0000","last_became_active":"2021-03-10T13:45:56.114483+0000","last_became_peered":"2021-03-10T13:45:56.114483+0000","last_unstale":"2021-03-10T13:45:56.116687+0000","last_undegraded":"2021-03-10T13:45:56.116687+0000","last_fullsized":"2021-03-10T13:45:56.116687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T13:41:13.891438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T13:41:13.891438+0000","last_clean_scrub_stamp":"2021-03-10T13:41:13.891438+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8271,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364823,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.778},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.359}]},{"osd":1,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":1.696},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.921}]},{"osd":2,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":2.0750000000000002}]},{"osd":3,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":1.466},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":2.2440000000000002}]},{"osd":4,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.042}]},{"osd":5,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.6379999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.218}]},{"osd":6,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.575},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.94099999999999995}]}]},{"osd":6,"up_from":45,"seq":193273528347,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049056,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031328,"statfs":{"total":90194313216,"available":89120079872,"internally_reserved":1073741824,"allocated":483328,"data_stored":192245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.3089999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.0609999999999999}]},{"osd":3,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.548}]},{"osd":4,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.7230000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.956}]},{"osd":5,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.456},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":2.278}]},{"osd":7,"last update":"Wed Mar 10 13:46:55 2021","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.851},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":2.0840000000000001}]}]},{"osd":1,"up_from":21,"seq":90194313261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8271,"internal_metadata":1073733553},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:00 2021","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.91200000000000003,"15min":0.872},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.079,"5min":0.96399999999999997,"15min":0.88700000000000001},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6799999999999999,"5min":2.48,"15min":2.48},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:47:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.099,"15min":1.0349999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.8979999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.556},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97399999999999998,"15min":0.91100000000000003},"min":{"1min":0.35699999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4910000000000001,"5min":1.806,"15min":1.806},"last":1.042}]},{"osd":3,"last update":"Wed Mar 10 13:47:29 2021","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.891,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4770000000000001,"15min":1.5109999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.0259999999999998,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:46:50 2021","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.609,"15min":1.5920000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":2.056},{"interface":"front","average":{"1min":1.613,"5min":1.448,"15min":1.4199999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":1.879}]},{"osd":5,"last update":"Wed Mar 10 13:47:11 2021","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.6859999999999999,"15min":1.6659999999999999},"min":{"1min":0.73099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2040000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.3879999999999999,"15min":1.3440000000000001},"min":{"1min":0.79200000000000004,"5min":0.501,"15min":0.501},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.425}]},{"osd":6,"last update":"Wed Mar 10 13:47:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.546,"15min":1.528},"min":{"1min":0.79800000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.25,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.7290000000000001},{"interface":"front","average":{"1min":2.056,"5min":1.913,"15min":1.889},"min":{"1min":0.94699999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.944}]},{"osd":7,"last update":"Wed Mar 10 13:46:58 2021","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.649},{"interface":"front","average":{"1min":1.946,"5min":1.946,"15min":1.946},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.4730000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.83899999999999997,"15min":0.77300000000000002},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":2.1429999999999998,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.81499999999999995},"min":{"1min":0.27500000000000002,"5min":0.185,"15min":0.185},"max":{"1min":1.357,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Mar 10 13:47:08 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.89600000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.3370000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.046,"15min":1.032},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.7729999999999999,"5min":1.974,"15min":1.974},"last":0.73199999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.274,"5min":1.212,"15min":1.202},"min":{"1min":0.437,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Mar 10 13:46:54 2021","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.484,"15min":1.4830000000000001},"min":{"1min":0.51500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.63,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.222}]},{"osd":5,"last update":"Wed Mar 10 13:47:08 2021","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.409,"15min":1.4079999999999999},"min":{"1min":0.49199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.2370000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4790000000000001,"15min":1.474},"min":{"1min":0.58699999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.323,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.2589999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.774,"5min":1.774,"15min":1.774},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.6910000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:46:57 2021","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":1.5389999999999999}]}]},{"osd":2,"up_from":25,"seq":107374182443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78800000000000003,"15min":0.71399999999999997},"min":{"1min":0.27200000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.754},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.90400000000000003,"15min":0.86099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.70499999999999996}]},{"osd":1,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89100000000000001,"15min":0.86499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.0069999999999999,"15min":0.93899999999999995},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.94899999999999995}]},{"osd":3,"last update":"Wed Mar 10 13:47:25 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1060000000000001,"15min":1.1299999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.105},{"interface":"front","average":{"1min":1.204,"5min":1.214,"15min":1.222},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.9590000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:46:49 2021","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.306,"15min":1.327},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.0459999999999998},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":2.165}]},{"osd":5,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.383,"15min":1.403},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.923,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":2.3069999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4219999999999999,"15min":1.4450000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0310000000000001,"5min":2.077,"15min":2.077},"last":1.359}]},{"osd":6,"last update":"Wed Mar 10 13:46:30 2021","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":2.4470000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.639}]},{"osd":7,"last update":"Wed Mar 10 13:46:55 2021","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.8879999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":2.6179999999999999}]}]},{"osd":3,"up_from":30,"seq":128849018920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:28 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.97799999999999998,"15min":0.96899999999999997},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.982,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0880000000000001,"15min":1.052},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":2.4239999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.0369999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:47:28 2021","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.96399999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.4690000000000001,"5min":1.996,"15min":1.996},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":1.681,"5min":1.762,"15min":1.762},"last":0.96199999999999997}]},{"osd":2,"last update":"Wed Mar 10 13:47:28 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.085,"15min":1.0589999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.111},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93300000000000005,"15min":0.90400000000000003},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.218},"max":{"1min":1.6339999999999999,"5min":1.871,"15min":1.871},"last":0.90600000000000003}]},{"osd":4,"last update":"Wed Mar 10 13:46:50 2021","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.5429999999999999,"15min":1.5189999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":2.109},{"interface":"front","average":{"1min":1.488,"5min":1.4239999999999999,"15min":1.4139999999999999},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.597}]},{"osd":5,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5840000000000001,"15min":1.6040000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.4199999999999999,"5min":2.589,"15min":2.589},"last":1.861},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4370000000000001,"15min":1.452},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.431}]},{"osd":6,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":2.222}]},{"osd":7,"last update":"Wed Mar 10 13:46:58 2021","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.613,"15min":1.613},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.7170000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855396,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3180000000000001},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3500000000000001,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.337,"15min":1.343},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.91100000000000003}]},{"osd":1,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3080000000000001,"15min":1.3360000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.369,"15min":1.379},"min":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.383}]},{"osd":2,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.0680000000000001,"5min":2.367,"15min":2.367},"last":1.288}]},{"osd":3,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.341,"15min":1.3520000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.617},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.329,"15min":1.343},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.151}]},{"osd":5,"last update":"Wed Mar 10 13:47:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.89500000000000002,"15min":0.84399999999999997},"min":{"1min":0.22700000000000001,"5min":0.185,"15min":0.185},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":1.528},{"interface":"front","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.85599999999999998},"min":{"1min":0.309,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":2.1269999999999998,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.861},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.2430000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.97},{"interface":"front","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.7509999999999999,"5min":2.7509999999999999,"15min":2.7509999999999999},"last":2.0529999999999999}]}]},{"osd":5,"up_from":40,"seq":171798691871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4279999999999999,"15min":1.4119999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.7610000000000001,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3280000000000001,"15min":1.3160000000000001},"min":{"1min":0.51800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.4630000000000001,"15min":1.4370000000000001},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":0.497},{"interface":"front","average":{"1min":1.462,"5min":1.264,"15min":1.2310000000000001},"min":{"1min":0.55600000000000005,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.4099999999999999,"15min":1.4119999999999999},"min":{"1min":0.61799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.726,"5min":1.4179999999999999,"15min":1.3660000000000001},"min":{"1min":0.751,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.753}]},{"osd":3,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.29,"15min":1.2549999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.784,"5min":1.5409999999999999,"15min":1.5009999999999999},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.78500000000000003,"15min":0.751},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.2410000000000001,"5min":0.871,"15min":0.80900000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.36899999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.30199999999999999}]},{"osd":7,"last update":"Wed Mar 10 13:46:57 2021","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.42399999999999999}]}]}]}} 2021-03-10T13:47:33.288 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T13:47:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:33 gibba043 bash[9839]: cluster 2021-03-10T13:47:31.947413+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:34.349 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:34 gibba003 bash[9769]: audit 2021-03-10T13:47:32.682897+0000 mgr.y (mgr.14140) 228 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:47:34.350 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:34 gibba003 bash[12956]: audit 2021-03-10T13:47:32.682897+0000 mgr.y (mgr.14140) 228 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:47:34.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:34 gibba043 bash[9839]: audit 2021-03-10T13:47:32.682897+0000 mgr.y (mgr.14140) 228 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:47:35.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:35 gibba003 bash[9769]: cluster 2021-03-10T13:47:33.948076+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:35.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:35 gibba003 bash[12956]: cluster 2021-03-10T13:47:33.948076+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:35 gibba043 bash[9839]: cluster 2021-03-10T13:47:33.948076+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:35.891 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:47:35.891 INFO:teuthology.orchestra.run.gibba003.stderr:dumped all 2021-03-10T13:47:36.491 INFO:teuthology.orchestra.run.gibba003.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2021-03-10T13:47:33.947738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392476,"kb_used_data":3804,"kb_used_omap":8,"kb_used_meta":8388599,"kb_avail":696250596,"statfs":{"total":721554505728,"available":712960610304,"internally_reserved":8589934592,"allocated":3895296,"data_stored":1540018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8271,"internal_metadata":8589926321},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004492"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"51","state":"active+clean","last_fresh":"2021-03-10T13:45:56.116687+0000","last_change":"2021-03-10T13:45:56.116687+0000","last_active":"2021-03-10T13:45:56.116687+0000","last_peered":"2021-03-10T13:45:56.116687+0000","last_clean":"2021-03-10T13:45:56.116687+0000","last_became_active":"2021-03-10T13:45:56.114483+0000","last_became_peered":"2021-03-10T13:45:56.114483+0000","last_unstale":"2021-03-10T13:45:56.116687+0000","last_undegraded":"2021-03-10T13:45:56.116687+0000","last_fullsized":"2021-03-10T13:45:56.116687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T13:41:13.891438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T13:41:13.891438+0000","last_clean_scrub_stamp":"2021-03-10T13:41:13.891438+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8271,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364823,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.778},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.359}]},{"osd":1,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":1.696},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.921}]},{"osd":2,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":2.0750000000000002}]},{"osd":3,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":1.466},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":2.2440000000000002}]},{"osd":4,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.042}]},{"osd":5,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.6379999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.218}]},{"osd":6,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.575},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.94099999999999995}]}]},{"osd":6,"up_from":45,"seq":193273528347,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049056,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031328,"statfs":{"total":90194313216,"available":89120079872,"internally_reserved":1073741824,"allocated":483328,"data_stored":192245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.3089999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.0609999999999999}]},{"osd":3,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.548}]},{"osd":4,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.7230000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":1.956}]},{"osd":5,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.456},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":2.278}]},{"osd":7,"last update":"Wed Mar 10 13:46:55 2021","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.851},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":2.0840000000000001}]}]},{"osd":1,"up_from":21,"seq":90194313261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8271,"internal_metadata":1073733553},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:00 2021","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.91200000000000003,"15min":0.872},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.079,"5min":0.96399999999999997,"15min":0.88700000000000001},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6799999999999999,"5min":2.48,"15min":2.48},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:47:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.099,"15min":1.0349999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.8979999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.556},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97399999999999998,"15min":0.91100000000000003},"min":{"1min":0.35699999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4910000000000001,"5min":1.806,"15min":1.806},"last":1.042}]},{"osd":3,"last update":"Wed Mar 10 13:47:29 2021","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.891,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4770000000000001,"15min":1.5109999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.0259999999999998,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:46:50 2021","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.609,"15min":1.5920000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":2.056},{"interface":"front","average":{"1min":1.613,"5min":1.448,"15min":1.4199999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":1.879}]},{"osd":5,"last update":"Wed Mar 10 13:47:11 2021","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.6859999999999999,"15min":1.6659999999999999},"min":{"1min":0.73099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2040000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.3879999999999999,"15min":1.3440000000000001},"min":{"1min":0.79200000000000004,"5min":0.501,"15min":0.501},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.425}]},{"osd":6,"last update":"Wed Mar 10 13:47:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.546,"15min":1.528},"min":{"1min":0.79800000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.25,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.7290000000000001},{"interface":"front","average":{"1min":2.056,"5min":1.913,"15min":1.889},"min":{"1min":0.94699999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.944}]},{"osd":7,"last update":"Wed Mar 10 13:46:58 2021","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.649},{"interface":"front","average":{"1min":1.946,"5min":1.946,"15min":1.946},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.4730000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.83899999999999997,"15min":0.77300000000000002},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":2.1429999999999998,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.81499999999999995},"min":{"1min":0.27500000000000002,"5min":0.185,"15min":0.185},"max":{"1min":1.357,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Mar 10 13:47:08 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92500000000000004,"15min":0.89600000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.3370000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.046,"15min":1.032},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.7729999999999999,"5min":1.974,"15min":1.974},"last":0.73199999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.208,"15min":1.1739999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.274,"5min":1.212,"15min":1.202},"min":{"1min":0.437,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Mar 10 13:46:54 2021","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.484,"15min":1.4830000000000001},"min":{"1min":0.51500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.63,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.222}]},{"osd":5,"last update":"Wed Mar 10 13:47:08 2021","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.409,"15min":1.4079999999999999},"min":{"1min":0.49199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.2370000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4790000000000001,"15min":1.474},"min":{"1min":0.58699999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.323,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.2589999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.774,"5min":1.774,"15min":1.774},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.6910000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:46:57 2021","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":1.5389999999999999}]}]},{"osd":2,"up_from":25,"seq":107374182444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.78800000000000003,"15min":0.71399999999999997},"min":{"1min":0.27200000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.90400000000000003,"15min":0.86099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89100000000000001,"15min":0.86499999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.0069999999999999,"15min":0.93899999999999995},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:47:25 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1060000000000001,"15min":1.1299999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.159},{"interface":"front","average":{"1min":1.204,"5min":1.214,"15min":1.222},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.3109999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:46:49 2021","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.306,"15min":1.327},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.502},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5920000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.383,"15min":1.403},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.923,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4219999999999999,"15min":1.4450000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0310000000000001,"5min":2.077,"15min":2.077},"last":1.407}]},{"osd":6,"last update":"Wed Mar 10 13:47:31 2021","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.708,"15min":1.704},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.887},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.5169999999999999,"15min":1.504},"min":{"1min":0.46600000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.708}]},{"osd":7,"last update":"Wed Mar 10 13:46:55 2021","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.546},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.7909999999999999}]}]},{"osd":3,"up_from":30,"seq":128849018920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:28 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.97799999999999998,"15min":0.96899999999999997},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.982,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0880000000000001,"15min":1.052},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":2.4239999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.0369999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:47:28 2021","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.96399999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.4690000000000001,"5min":1.996,"15min":1.996},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":1.681,"5min":1.762,"15min":1.762},"last":0.96199999999999997}]},{"osd":2,"last update":"Wed Mar 10 13:47:28 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.085,"15min":1.0589999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.111},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93300000000000005,"15min":0.90400000000000003},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.218},"max":{"1min":1.6339999999999999,"5min":1.871,"15min":1.871},"last":0.90600000000000003}]},{"osd":4,"last update":"Wed Mar 10 13:46:50 2021","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.5429999999999999,"15min":1.5189999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":2.109},{"interface":"front","average":{"1min":1.488,"5min":1.4239999999999999,"15min":1.4139999999999999},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.597}]},{"osd":5,"last update":"Wed Mar 10 13:47:12 2021","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.5840000000000001,"15min":1.6040000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.4199999999999999,"5min":2.589,"15min":2.589},"last":1.861},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4370000000000001,"15min":1.452},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.431}]},{"osd":6,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":2.222}]},{"osd":7,"last update":"Wed Mar 10 13:46:58 2021","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.613,"15min":1.613},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.7170000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855396,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.304,"15min":1.3180000000000001},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3500000000000001,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.337,"15min":1.343},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.91100000000000003}]},{"osd":1,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.3080000000000001,"15min":1.3360000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.369,"15min":1.379},"min":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.383}]},{"osd":2,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.266,"15min":1.2689999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.0680000000000001,"5min":2.367,"15min":2.367},"last":1.288}]},{"osd":3,"last update":"Wed Mar 10 13:46:51 2021","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.341,"15min":1.3520000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.617},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.329,"15min":1.343},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.151}]},{"osd":5,"last update":"Wed Mar 10 13:47:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.89500000000000002,"15min":0.84399999999999997},"min":{"1min":0.22700000000000001,"5min":0.185,"15min":0.185},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":1.528},{"interface":"front","average":{"1min":1.159,"5min":0.89900000000000002,"15min":0.85599999999999998},"min":{"1min":0.309,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":2.1269999999999998,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:46:33 2021","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.861},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.2430000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:46:59 2021","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.97},{"interface":"front","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.7509999999999999,"5min":2.7509999999999999,"15min":2.7509999999999999},"last":2.0529999999999999}]}]},{"osd":5,"up_from":40,"seq":171798691872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049060,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031324,"statfs":{"total":90194313216,"available":89120075776,"internally_reserved":1073741824,"allocated":487424,"data_stored":192539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.4279999999999999,"15min":1.4119999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.7610000000000001,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":1.9910000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3280000000000001,"15min":1.3160000000000001},"min":{"1min":0.51800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":2.1280000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.4630000000000001,"15min":1.4370000000000001},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":2.4129999999999998},{"interface":"front","average":{"1min":1.462,"5min":1.264,"15min":1.2310000000000001},"min":{"1min":0.55600000000000005,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":1.7350000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.4099999999999999,"15min":1.4119999999999999},"min":{"1min":0.61799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.8660000000000001},{"interface":"front","average":{"1min":1.726,"5min":1.4179999999999999,"15min":1.3660000000000001},"min":{"1min":0.751,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":2.5800000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.29,"15min":1.2549999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":2.2629999999999999},{"interface":"front","average":{"1min":1.784,"5min":1.5409999999999999,"15min":1.5009999999999999},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.605}]},{"osd":4,"last update":"Wed Mar 10 13:47:13 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.78500000000000003,"15min":0.751},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.2410000000000001,"5min":0.871,"15min":0.80900000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.4530000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:46:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.046},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.86499999999999999}]},{"osd":7,"last update":"Wed Mar 10 13:46:57 2021","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.3029999999999999}]}]}]}} 2021-03-10T13:47:36.493 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-03-10T13:47:36.493 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-03-10T13:47:36.493 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-03-10T13:47:36.494 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- ceph health --format=json 2021-03-10T13:47:37.371 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:37 gibba003 bash[9769]: audit 2021-03-10T13:47:35.881541+0000 mgr.y (mgr.14140) 230 : audit [DBG] from='client.24364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:47:37.371 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:37 gibba003 bash[9769]: cluster 2021-03-10T13:47:35.948519+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:37.372 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:37 gibba003 bash[12956]: audit 2021-03-10T13:47:35.881541+0000 mgr.y (mgr.14140) 230 : audit [DBG] from='client.24364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:47:37.372 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:37 gibba003 bash[12956]: cluster 2021-03-10T13:47:35.948519+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:37 gibba043 bash[9839]: audit 2021-03-10T13:47:35.881541+0000 mgr.y (mgr.14140) 230 : audit [DBG] from='client.24364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:47:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:37 gibba043 bash[9839]: cluster 2021-03-10T13:47:35.948519+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:39.164 INFO:teuthology.orchestra.run.gibba003.stdout: 2021-03-10T13:47:39.363 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:39 gibba003 bash[9769]: cluster 2021-03-10T13:47:37.949190+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:39.364 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:39 gibba003 bash[12956]: cluster 2021-03-10T13:47:37.949190+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:39 gibba043 bash[9839]: cluster 2021-03-10T13:47:37.949190+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:39.796 INFO:teuthology.orchestra.run.gibba003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-10T13:47:39.796 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-03-10T13:47:39.797 INFO:tasks.cephadm:Setup complete, yielding 2021-03-10T13:47:39.797 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:47:39.809 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba003.front.sepia.ceph.com 2021-03-10T13:47:39.809 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2021-03-10T13:47:40.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:40 gibba003 bash[9769]: audit 2021-03-10T13:47:39.156799+0000 mon.a (mon.0) 567 : audit [DBG] from='client.? 172.21.2.103:0/71190837' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:47:40.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:40 gibba003 bash[12956]: audit 2021-03-10T13:47:39.156799+0000 mon.a (mon.0) 567 : audit [DBG] from='client.? 172.21.2.103:0/71190837' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:47:40.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:40 gibba043 bash[9839]: audit 2021-03-10T13:47:39.156799+0000 mon.a (mon.0) 567 : audit [DBG] from='client.? 172.21.2.103:0/71190837' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:47:41.343 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:41 gibba003 bash[9769]: cluster 2021-03-10T13:47:39.949808+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:41.343 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:41 gibba003 bash[12956]: cluster 2021-03-10T13:47:39.949808+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:41.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:41 gibba043 bash[9839]: cluster 2021-03-10T13:47:39.949808+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:43.059 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:47:43.081 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba003.front.sepia.ceph.com 2021-03-10T13:47:43.082 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2021-03-10T13:47:43.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:43 gibba003 bash[9769]: cluster 2021-03-10T13:47:41.950452+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:43.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:43 gibba003 bash[9769]: audit 2021-03-10T13:47:42.414937+0000 mon.a (mon.0) 568 : audit [INF] from='client.? 172.21.2.103:0/1201685437' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2021-03-10T13:47:43.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:43 gibba003 bash[9769]: audit 2021-03-10T13:47:42.420067+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.2.103:0/1201685437' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2021-03-10T13:47:43.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:43 gibba003 bash[12956]: cluster 2021-03-10T13:47:41.950452+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:43.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:43 gibba003 bash[12956]: audit 2021-03-10T13:47:42.414937+0000 mon.a (mon.0) 568 : audit [INF] from='client.? 172.21.2.103:0/1201685437' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2021-03-10T13:47:43.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:43 gibba003 bash[12956]: audit 2021-03-10T13:47:42.420067+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.2.103:0/1201685437' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2021-03-10T13:47:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:43 gibba043 bash[9839]: cluster 2021-03-10T13:47:41.950452+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:43 gibba043 bash[9839]: audit 2021-03-10T13:47:42.414937+0000 mon.a (mon.0) 568 : audit [INF] from='client.? 172.21.2.103:0/1201685437' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2021-03-10T13:47:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:43 gibba043 bash[9839]: audit 2021-03-10T13:47:42.420067+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.2.103:0/1201685437' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2021-03-10T13:47:45.400 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:45 gibba003 bash[9769]: cluster 2021-03-10T13:47:43.951236+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:45.401 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:45 gibba003 bash[12956]: cluster 2021-03-10T13:47:43.951236+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:45 gibba043 bash[9839]: cluster 2021-03-10T13:47:43.951236+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[9769]: cluster 2021-03-10T13:47:45.951979+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[9769]: cluster 2021-03-10T13:47:46.139513+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:47:46.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[9769]: audit 2021-03-10T13:47:46.140200+0000 mon.c (mon.1) 20 : audit [INF] from='client.? 172.21.2.103:0/943123950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:47:46.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[9769]: audit 2021-03-10T13:47:46.143707+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:47:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[12956]: cluster 2021-03-10T13:47:45.951979+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[12956]: cluster 2021-03-10T13:47:46.139513+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:47:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[12956]: audit 2021-03-10T13:47:46.140200+0000 mon.c (mon.1) 20 : audit [INF] from='client.? 172.21.2.103:0/943123950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:47:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:46 gibba003 bash[12956]: audit 2021-03-10T13:47:46.143707+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:47:46.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:46 gibba043 bash[9839]: cluster 2021-03-10T13:47:45.951979+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:46 gibba043 bash[9839]: cluster 2021-03-10T13:47:46.139513+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:47:46.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:46 gibba043 bash[9839]: audit 2021-03-10T13:47:46.140200+0000 mon.c (mon.1) 20 : audit [INF] from='client.? 172.21.2.103:0/943123950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:47:46.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:46 gibba043 bash[9839]: audit 2021-03-10T13:47:46.143707+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:47:47.173 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:47:47.174 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "df2a027c-7705-4aef-8908-743d822992a2", 2021-03-10T13:47:47.174 INFO:teuthology.orchestra.run.gibba003.stdout: "name": "r", 2021-03-10T13:47:47.174 INFO:teuthology.orchestra.run.gibba003.stdout: "current_period": "5a00e842-530a-48ac-ab49-3db42098df9f", 2021-03-10T13:47:47.175 INFO:teuthology.orchestra.run.gibba003.stdout: "epoch": 1 2021-03-10T13:47:47.175 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:47:47.802 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2021-03-10T13:47:48.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:48 gibba003 bash[9769]: audit 2021-03-10T13:47:47.143396+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:47:48.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:48 gibba003 bash[9769]: cluster 2021-03-10T13:47:47.143429+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:47:48.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:48 gibba003 bash[9769]: cluster 2021-03-10T13:47:47.952767+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v227: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:48.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:48 gibba003 bash[12956]: audit 2021-03-10T13:47:47.143396+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:47:48.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:48 gibba003 bash[12956]: cluster 2021-03-10T13:47:47.143429+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:47:48.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:48 gibba003 bash[12956]: cluster 2021-03-10T13:47:47.952767+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v227: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:48.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:48 gibba043 bash[9839]: audit 2021-03-10T13:47:47.143396+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:47:48.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:48 gibba043 bash[9839]: cluster 2021-03-10T13:47:47.143429+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:47:48.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:48 gibba043 bash[9839]: cluster 2021-03-10T13:47:47.952767+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v227: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:49.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:49 gibba003 bash[9769]: cluster 2021-03-10T13:47:48.157154+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:47:49.465 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:49 gibba003 bash[12956]: cluster 2021-03-10T13:47:48.157154+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:47:49.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:49 gibba043 bash[9839]: cluster 2021-03-10T13:47:48.157154+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:47:50.381 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:47:50.382 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "3fe9bc5c-ca47-47a5-95ff-5f9a050d3b99", 2021-03-10T13:47:50.382 INFO:teuthology.orchestra.run.gibba003.stdout: "name": "default", 2021-03-10T13:47:50.382 INFO:teuthology.orchestra.run.gibba003.stdout: "api_name": "default", 2021-03-10T13:47:50.382 INFO:teuthology.orchestra.run.gibba003.stdout: "is_master": "true", 2021-03-10T13:47:50.383 INFO:teuthology.orchestra.run.gibba003.stdout: "endpoints": [], 2021-03-10T13:47:50.383 INFO:teuthology.orchestra.run.gibba003.stdout: "hostnames": [], 2021-03-10T13:47:50.383 INFO:teuthology.orchestra.run.gibba003.stdout: "hostnames_s3website": [], 2021-03-10T13:47:50.383 INFO:teuthology.orchestra.run.gibba003.stdout: "master_zone": "", 2021-03-10T13:47:50.384 INFO:teuthology.orchestra.run.gibba003.stdout: "zones": [], 2021-03-10T13:47:50.384 INFO:teuthology.orchestra.run.gibba003.stdout: "placement_targets": [], 2021-03-10T13:47:50.384 INFO:teuthology.orchestra.run.gibba003.stdout: "default_placement": "", 2021-03-10T13:47:50.384 INFO:teuthology.orchestra.run.gibba003.stdout: "realm_id": "df2a027c-7705-4aef-8908-743d822992a2", 2021-03-10T13:47:50.384 INFO:teuthology.orchestra.run.gibba003.stdout: "sync_policy": { 2021-03-10T13:47:50.385 INFO:teuthology.orchestra.run.gibba003.stdout: "groups": [] 2021-03-10T13:47:50.385 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:47:50.385 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:47:50.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:50 gibba003 bash[9769]: cluster 2021-03-10T13:47:49.953622+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v229: 33 pgs: 4 creating+peering, 12 active+clean, 17 unknown; 126 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 682 B/s wr, 0 op/s 2021-03-10T13:47:50.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:50 gibba003 bash[12956]: cluster 2021-03-10T13:47:49.953622+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v229: 33 pgs: 4 creating+peering, 12 active+clean, 17 unknown; 126 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 682 B/s wr, 0 op/s 2021-03-10T13:47:50.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:50 gibba043 bash[9839]: cluster 2021-03-10T13:47:49.953622+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v229: 33 pgs: 4 creating+peering, 12 active+clean, 17 unknown; 126 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 682 B/s wr, 0 op/s 2021-03-10T13:47:51.001 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2021-03-10T13:47:53.340 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:53 gibba003 bash[9769]: cluster 2021-03-10T13:47:51.954479+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v230: 33 pgs: 33 active+clean; 562 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T13:47:53.341 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:53 gibba003 bash[12956]: cluster 2021-03-10T13:47:51.954479+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v230: 33 pgs: 33 active+clean; 562 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T13:47:53.491 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:47:53.492 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "31b41157-1437-4db5-bd89-88fb936019fd", 2021-03-10T13:47:53.492 INFO:teuthology.orchestra.run.gibba003.stdout: "name": "z", 2021-03-10T13:47:53.492 INFO:teuthology.orchestra.run.gibba003.stdout: "domain_root": "z.rgw.meta:root", 2021-03-10T13:47:53.493 INFO:teuthology.orchestra.run.gibba003.stdout: "control_pool": "z.rgw.control", 2021-03-10T13:47:53.493 INFO:teuthology.orchestra.run.gibba003.stdout: "gc_pool": "z.rgw.log:gc", 2021-03-10T13:47:53.493 INFO:teuthology.orchestra.run.gibba003.stdout: "lc_pool": "z.rgw.log:lc", 2021-03-10T13:47:53.493 INFO:teuthology.orchestra.run.gibba003.stdout: "log_pool": "z.rgw.log", 2021-03-10T13:47:53.493 INFO:teuthology.orchestra.run.gibba003.stdout: "intent_log_pool": "z.rgw.log:intent", 2021-03-10T13:47:53.494 INFO:teuthology.orchestra.run.gibba003.stdout: "usage_log_pool": "z.rgw.log:usage", 2021-03-10T13:47:53.494 INFO:teuthology.orchestra.run.gibba003.stdout: "roles_pool": "z.rgw.meta:roles", 2021-03-10T13:47:53.494 INFO:teuthology.orchestra.run.gibba003.stdout: "reshard_pool": "z.rgw.log:reshard", 2021-03-10T13:47:53.494 INFO:teuthology.orchestra.run.gibba003.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2021-03-10T13:47:53.495 INFO:teuthology.orchestra.run.gibba003.stdout: "user_email_pool": "z.rgw.meta:users.email", 2021-03-10T13:47:53.495 INFO:teuthology.orchestra.run.gibba003.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2021-03-10T13:47:53.495 INFO:teuthology.orchestra.run.gibba003.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2021-03-10T13:47:53.495 INFO:teuthology.orchestra.run.gibba003.stdout: "otp_pool": "z.rgw.otp", 2021-03-10T13:47:53.495 INFO:teuthology.orchestra.run.gibba003.stdout: "system_key": { 2021-03-10T13:47:53.496 INFO:teuthology.orchestra.run.gibba003.stdout: "access_key": "", 2021-03-10T13:47:53.496 INFO:teuthology.orchestra.run.gibba003.stdout: "secret_key": "" 2021-03-10T13:47:53.496 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:47:53.496 INFO:teuthology.orchestra.run.gibba003.stdout: "placement_pools": [ 2021-03-10T13:47:53.497 INFO:teuthology.orchestra.run.gibba003.stdout: { 2021-03-10T13:47:53.497 INFO:teuthology.orchestra.run.gibba003.stdout: "key": "default-placement", 2021-03-10T13:47:53.497 INFO:teuthology.orchestra.run.gibba003.stdout: "val": { 2021-03-10T13:47:53.497 INFO:teuthology.orchestra.run.gibba003.stdout: "index_pool": "z.rgw.buckets.index", 2021-03-10T13:47:53.497 INFO:teuthology.orchestra.run.gibba003.stdout: "storage_classes": { 2021-03-10T13:47:53.498 INFO:teuthology.orchestra.run.gibba003.stdout: "STANDARD": { 2021-03-10T13:47:53.498 INFO:teuthology.orchestra.run.gibba003.stdout: "data_pool": "z.rgw.buckets.data" 2021-03-10T13:47:53.498 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:47:53.498 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:47:53.498 INFO:teuthology.orchestra.run.gibba003.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2021-03-10T13:47:53.499 INFO:teuthology.orchestra.run.gibba003.stdout: "index_type": 0 2021-03-10T13:47:53.499 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:47:53.499 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:47:53.499 INFO:teuthology.orchestra.run.gibba003.stdout: ], 2021-03-10T13:47:53.500 INFO:teuthology.orchestra.run.gibba003.stdout: "realm_id": "df2a027c-7705-4aef-8908-743d822992a2" 2021-03-10T13:47:53.500 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:47:53.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:53 gibba043 bash[9839]: cluster 2021-03-10T13:47:51.954479+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v230: 33 pgs: 33 active+clean; 562 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T13:47:54.111 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2021-03-10T13:47:55.238 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:55 gibba003 bash[9769]: cluster 2021-03-10T13:47:53.955325+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v231: 33 pgs: 33 active+clean; 562 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 261 B/s rd, 1.2 KiB/s wr, 1 op/s 2021-03-10T13:47:55.239 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:55 gibba003 bash[12956]: cluster 2021-03-10T13:47:53.955325+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v231: 33 pgs: 33 active+clean; 562 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 261 B/s rd, 1.2 KiB/s wr, 1 op/s 2021-03-10T13:47:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:55 gibba043 bash[9839]: cluster 2021-03-10T13:47:53.955325+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v231: 33 pgs: 33 active+clean; 562 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 261 B/s rd, 1.2 KiB/s wr, 1 op/s 2021-03-10T13:47:57.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:57 gibba003 bash[9769]: cluster 2021-03-10T13:47:55.956151+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 1.0 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 464 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T13:47:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:57 gibba003 bash[12956]: cluster 2021-03-10T13:47:55.956151+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 1.0 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 464 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T13:47:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:57 gibba043 bash[9839]: cluster 2021-03-10T13:47:55.956151+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 1.0 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 464 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T13:47:58.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[9769]: cluster 2021-03-10T13:47:57.034722+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:47:58.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[9769]: audit 2021-03-10T13:47:57.035310+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.2.103:0/1534412226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:47:58.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[9769]: audit 2021-03-10T13:47:57.035859+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:47:58.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[9769]: audit 2021-03-10T13:47:58.044292+0000 mon.a (mon.0) 577 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:47:58.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[12956]: cluster 2021-03-10T13:47:57.034722+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:47:58.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[12956]: audit 2021-03-10T13:47:57.035310+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.2.103:0/1534412226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:47:58.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[12956]: audit 2021-03-10T13:47:57.035859+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:47:58.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:58 gibba003 bash[12956]: audit 2021-03-10T13:47:58.044292+0000 mon.a (mon.0) 577 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:47:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:58 gibba043 bash[9839]: cluster 2021-03-10T13:47:57.034722+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:47:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:58 gibba043 bash[9839]: audit 2021-03-10T13:47:57.035310+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.2.103:0/1534412226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:47:58.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:58 gibba043 bash[9839]: audit 2021-03-10T13:47:57.035859+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:47:58.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:58 gibba043 bash[9839]: audit 2021-03-10T13:47:58.044292+0000 mon.a (mon.0) 577 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:47:59.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:59 gibba003 bash[9769]: cluster 2021-03-10T13:47:57.957239+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v234: 65 pgs: 32 unknown, 33 active+clean; 1.7 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 522 B/s rd, 1.1 KiB/s wr, 1 op/s 2021-03-10T13:47:59.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:47:59 gibba003 bash[9769]: cluster 2021-03-10T13:47:58.044375+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:47:59.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:59 gibba003 bash[12956]: cluster 2021-03-10T13:47:57.957239+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v234: 65 pgs: 32 unknown, 33 active+clean; 1.7 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 522 B/s rd, 1.1 KiB/s wr, 1 op/s 2021-03-10T13:47:59.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:47:59 gibba003 bash[12956]: cluster 2021-03-10T13:47:58.044375+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:47:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:59 gibba043 bash[9839]: cluster 2021-03-10T13:47:57.957239+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v234: 65 pgs: 32 unknown, 33 active+clean; 1.7 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 522 B/s rd, 1.1 KiB/s wr, 1 op/s 2021-03-10T13:47:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:47:59 gibba043 bash[9839]: cluster 2021-03-10T13:47:58.044375+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:48:00.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[9769]: cluster 2021-03-10T13:47:59.056546+0000 mon.a (mon.0) 579 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:48:00.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[9769]: audit 2021-03-10T13:47:59.058160+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.2.103:0/1534412226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:48:00.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[9769]: audit 2021-03-10T13:47:59.062363+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:48:00.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[9769]: audit 2021-03-10T13:48:00.057042+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:48:00.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[9769]: cluster 2021-03-10T13:48:00.057122+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:48:00.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[12956]: cluster 2021-03-10T13:47:59.056546+0000 mon.a (mon.0) 579 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:48:00.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[12956]: audit 2021-03-10T13:47:59.058160+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.2.103:0/1534412226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:48:00.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[12956]: audit 2021-03-10T13:47:59.062363+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:48:00.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[12956]: audit 2021-03-10T13:48:00.057042+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:48:00.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:00 gibba003 bash[12956]: cluster 2021-03-10T13:48:00.057122+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:48:00.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:00 gibba043 bash[9839]: cluster 2021-03-10T13:47:59.056546+0000 mon.a (mon.0) 579 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:48:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:00 gibba043 bash[9839]: audit 2021-03-10T13:47:59.058160+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.2.103:0/1534412226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:48:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:00 gibba043 bash[9839]: audit 2021-03-10T13:47:59.062363+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:48:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:00 gibba043 bash[9839]: audit 2021-03-10T13:48:00.057042+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:48:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:00 gibba043 bash[9839]: cluster 2021-03-10T13:48:00.057122+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:48:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:01 gibba003 bash[9769]: cluster 2021-03-10T13:47:59.958490+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v237: 97 pgs: 21 creating+peering, 27 unknown, 49 active+clean; 1.8 KiB data, 4.3 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:48:01.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:01 gibba003 bash[12956]: cluster 2021-03-10T13:47:59.958490+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v237: 97 pgs: 21 creating+peering, 27 unknown, 49 active+clean; 1.8 KiB data, 4.3 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:48:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:01 gibba043 bash[9839]: cluster 2021-03-10T13:47:59.958490+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v237: 97 pgs: 21 creating+peering, 27 unknown, 49 active+clean; 1.8 KiB data, 4.3 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:48:02.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: cluster 2021-03-10T13:48:01.067429+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:48:02.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: audit 2021-03-10T13:48:01.068528+0000 mon.c (mon.1) 23 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:48:02.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: audit 2021-03-10T13:48:01.069823+0000 mon.a (mon.0) 584 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:48:02.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: audit 2021-03-10T13:48:02.068523+0000 mon.a (mon.0) 585 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:48:02.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: cluster 2021-03-10T13:48:02.068665+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:48:02.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: audit 2021-03-10T13:48:02.070107+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:48:02.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[9769]: audit 2021-03-10T13:48:02.070279+0000 mon.a (mon.0) 587 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:48:02.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: cluster 2021-03-10T13:48:01.067429+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:48:02.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: audit 2021-03-10T13:48:01.068528+0000 mon.c (mon.1) 23 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:48:02.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: audit 2021-03-10T13:48:01.069823+0000 mon.a (mon.0) 584 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:48:02.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: audit 2021-03-10T13:48:02.068523+0000 mon.a (mon.0) 585 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:48:02.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: cluster 2021-03-10T13:48:02.068665+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:48:02.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: audit 2021-03-10T13:48:02.070107+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:48:02.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:02 gibba003 bash[12956]: audit 2021-03-10T13:48:02.070279+0000 mon.a (mon.0) 587 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:48:02.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: cluster 2021-03-10T13:48:01.067429+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:48:02.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: audit 2021-03-10T13:48:01.068528+0000 mon.c (mon.1) 23 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:48:02.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: audit 2021-03-10T13:48:01.069823+0000 mon.a (mon.0) 584 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:48:02.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: audit 2021-03-10T13:48:02.068523+0000 mon.a (mon.0) 585 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:48:02.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: cluster 2021-03-10T13:48:02.068665+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:48:02.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: audit 2021-03-10T13:48:02.070107+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:48:02.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:02 gibba043 bash[9839]: audit 2021-03-10T13:48:02.070279+0000 mon.a (mon.0) 587 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:48:03.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[9769]: cluster 2021-03-10T13:48:01.959512+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v240: 129 pgs: 30 creating+peering, 30 unknown, 69 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 511 B/s wr, 4 op/s 2021-03-10T13:48:03.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[9769]: audit 2021-03-10T13:48:03.074768+0000 mon.a (mon.0) 588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:48:03.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[9769]: cluster 2021-03-10T13:48:03.074815+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:48:03.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[9769]: audit 2021-03-10T13:48:03.075507+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:48:03.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[9769]: audit 2021-03-10T13:48:03.075807+0000 mon.a (mon.0) 590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:48:03.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[12956]: cluster 2021-03-10T13:48:01.959512+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v240: 129 pgs: 30 creating+peering, 30 unknown, 69 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 511 B/s wr, 4 op/s 2021-03-10T13:48:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[12956]: audit 2021-03-10T13:48:03.074768+0000 mon.a (mon.0) 588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:48:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[12956]: cluster 2021-03-10T13:48:03.074815+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:48:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[12956]: audit 2021-03-10T13:48:03.075507+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:48:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:03 gibba003 bash[12956]: audit 2021-03-10T13:48:03.075807+0000 mon.a (mon.0) 590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:48:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:03 gibba043 bash[9839]: cluster 2021-03-10T13:48:01.959512+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v240: 129 pgs: 30 creating+peering, 30 unknown, 69 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 511 B/s wr, 4 op/s 2021-03-10T13:48:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:03 gibba043 bash[9839]: audit 2021-03-10T13:48:03.074768+0000 mon.a (mon.0) 588 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:48:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:03 gibba043 bash[9839]: cluster 2021-03-10T13:48:03.074815+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:48:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:03 gibba043 bash[9839]: audit 2021-03-10T13:48:03.075507+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.2.103:0/1130008476' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:48:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:03 gibba043 bash[9839]: audit 2021-03-10T13:48:03.075807+0000 mon.a (mon.0) 590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:48:04.264 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:48:04.265 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "183dd6a0-a9aa-413d-ac2a-d6cc856fdcbc", 2021-03-10T13:48:04.265 INFO:teuthology.orchestra.run.gibba003.stdout: "epoch": 1, 2021-03-10T13:48:04.265 INFO:teuthology.orchestra.run.gibba003.stdout: "predecessor_uuid": "5a00e842-530a-48ac-ab49-3db42098df9f", 2021-03-10T13:48:04.266 INFO:teuthology.orchestra.run.gibba003.stdout: "sync_status": [], 2021-03-10T13:48:04.266 INFO:teuthology.orchestra.run.gibba003.stdout: "period_map": { 2021-03-10T13:48:04.266 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "183dd6a0-a9aa-413d-ac2a-d6cc856fdcbc", 2021-03-10T13:48:04.266 INFO:teuthology.orchestra.run.gibba003.stdout: "zonegroups": [ 2021-03-10T13:48:04.267 INFO:teuthology.orchestra.run.gibba003.stdout: { 2021-03-10T13:48:04.267 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "3fe9bc5c-ca47-47a5-95ff-5f9a050d3b99", 2021-03-10T13:48:04.267 INFO:teuthology.orchestra.run.gibba003.stdout: "name": "default", 2021-03-10T13:48:04.267 INFO:teuthology.orchestra.run.gibba003.stdout: "api_name": "default", 2021-03-10T13:48:04.267 INFO:teuthology.orchestra.run.gibba003.stdout: "is_master": "true", 2021-03-10T13:48:04.268 INFO:teuthology.orchestra.run.gibba003.stdout: "endpoints": [], 2021-03-10T13:48:04.268 INFO:teuthology.orchestra.run.gibba003.stdout: "hostnames": [], 2021-03-10T13:48:04.268 INFO:teuthology.orchestra.run.gibba003.stdout: "hostnames_s3website": [], 2021-03-10T13:48:04.268 INFO:teuthology.orchestra.run.gibba003.stdout: "master_zone": "31b41157-1437-4db5-bd89-88fb936019fd", 2021-03-10T13:48:04.269 INFO:teuthology.orchestra.run.gibba003.stdout: "zones": [ 2021-03-10T13:48:04.269 INFO:teuthology.orchestra.run.gibba003.stdout: { 2021-03-10T13:48:04.269 INFO:teuthology.orchestra.run.gibba003.stdout: "id": "31b41157-1437-4db5-bd89-88fb936019fd", 2021-03-10T13:48:04.269 INFO:teuthology.orchestra.run.gibba003.stdout: "name": "z", 2021-03-10T13:48:04.269 INFO:teuthology.orchestra.run.gibba003.stdout: "endpoints": [], 2021-03-10T13:48:04.270 INFO:teuthology.orchestra.run.gibba003.stdout: "log_meta": "false", 2021-03-10T13:48:04.270 INFO:teuthology.orchestra.run.gibba003.stdout: "log_data": "false", 2021-03-10T13:48:04.270 INFO:teuthology.orchestra.run.gibba003.stdout: "bucket_index_max_shards": 11, 2021-03-10T13:48:04.270 INFO:teuthology.orchestra.run.gibba003.stdout: "read_only": "false", 2021-03-10T13:48:04.270 INFO:teuthology.orchestra.run.gibba003.stdout: "tier_type": "", 2021-03-10T13:48:04.271 INFO:teuthology.orchestra.run.gibba003.stdout: "sync_from_all": "true", 2021-03-10T13:48:04.271 INFO:teuthology.orchestra.run.gibba003.stdout: "sync_from": [], 2021-03-10T13:48:04.271 INFO:teuthology.orchestra.run.gibba003.stdout: "redirect_zone": "" 2021-03-10T13:48:04.271 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:48:04.271 INFO:teuthology.orchestra.run.gibba003.stdout: ], 2021-03-10T13:48:04.272 INFO:teuthology.orchestra.run.gibba003.stdout: "placement_targets": [ 2021-03-10T13:48:04.272 INFO:teuthology.orchestra.run.gibba003.stdout: { 2021-03-10T13:48:04.272 INFO:teuthology.orchestra.run.gibba003.stdout: "name": "default-placement", 2021-03-10T13:48:04.272 INFO:teuthology.orchestra.run.gibba003.stdout: "tags": [], 2021-03-10T13:48:04.272 INFO:teuthology.orchestra.run.gibba003.stdout: "storage_classes": [ 2021-03-10T13:48:04.273 INFO:teuthology.orchestra.run.gibba003.stdout: "STANDARD" 2021-03-10T13:48:04.273 INFO:teuthology.orchestra.run.gibba003.stdout: ] 2021-03-10T13:48:04.273 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:48:04.273 INFO:teuthology.orchestra.run.gibba003.stdout: ], 2021-03-10T13:48:04.273 INFO:teuthology.orchestra.run.gibba003.stdout: "default_placement": "default-placement", 2021-03-10T13:48:04.274 INFO:teuthology.orchestra.run.gibba003.stdout: "realm_id": "df2a027c-7705-4aef-8908-743d822992a2", 2021-03-10T13:48:04.274 INFO:teuthology.orchestra.run.gibba003.stdout: "sync_policy": { 2021-03-10T13:48:04.274 INFO:teuthology.orchestra.run.gibba003.stdout: "groups": [] 2021-03-10T13:48:04.274 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:48:04.274 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:48:04.275 INFO:teuthology.orchestra.run.gibba003.stdout: ], 2021-03-10T13:48:04.275 INFO:teuthology.orchestra.run.gibba003.stdout: "short_zone_ids": [ 2021-03-10T13:48:04.275 INFO:teuthology.orchestra.run.gibba003.stdout: { 2021-03-10T13:48:04.275 INFO:teuthology.orchestra.run.gibba003.stdout: "key": "31b41157-1437-4db5-bd89-88fb936019fd", 2021-03-10T13:48:04.276 INFO:teuthology.orchestra.run.gibba003.stdout: "val": 3680941193 2021-03-10T13:48:04.276 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:48:04.276 INFO:teuthology.orchestra.run.gibba003.stdout: ] 2021-03-10T13:48:04.276 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:48:04.276 INFO:teuthology.orchestra.run.gibba003.stdout: "master_zonegroup": "3fe9bc5c-ca47-47a5-95ff-5f9a050d3b99", 2021-03-10T13:48:04.277 INFO:teuthology.orchestra.run.gibba003.stdout: "master_zone": "31b41157-1437-4db5-bd89-88fb936019fd", 2021-03-10T13:48:04.277 INFO:teuthology.orchestra.run.gibba003.stdout: "period_config": { 2021-03-10T13:48:04.277 INFO:teuthology.orchestra.run.gibba003.stdout: "bucket_quota": { 2021-03-10T13:48:04.277 INFO:teuthology.orchestra.run.gibba003.stdout: "enabled": false, 2021-03-10T13:48:04.277 INFO:teuthology.orchestra.run.gibba003.stdout: "check_on_raw": false, 2021-03-10T13:48:04.278 INFO:teuthology.orchestra.run.gibba003.stdout: "max_size": -1, 2021-03-10T13:48:04.278 INFO:teuthology.orchestra.run.gibba003.stdout: "max_size_kb": 0, 2021-03-10T13:48:04.278 INFO:teuthology.orchestra.run.gibba003.stdout: "max_objects": -1 2021-03-10T13:48:04.278 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:48:04.279 INFO:teuthology.orchestra.run.gibba003.stdout: "user_quota": { 2021-03-10T13:48:04.279 INFO:teuthology.orchestra.run.gibba003.stdout: "enabled": false, 2021-03-10T13:48:04.279 INFO:teuthology.orchestra.run.gibba003.stdout: "check_on_raw": false, 2021-03-10T13:48:04.279 INFO:teuthology.orchestra.run.gibba003.stdout: "max_size": -1, 2021-03-10T13:48:04.279 INFO:teuthology.orchestra.run.gibba003.stdout: "max_size_kb": 0, 2021-03-10T13:48:04.280 INFO:teuthology.orchestra.run.gibba003.stdout: "max_objects": -1 2021-03-10T13:48:04.280 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:48:04.280 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:48:04.280 INFO:teuthology.orchestra.run.gibba003.stdout: "realm_id": "df2a027c-7705-4aef-8908-743d822992a2", 2021-03-10T13:48:04.280 INFO:teuthology.orchestra.run.gibba003.stdout: "realm_name": "r", 2021-03-10T13:48:04.281 INFO:teuthology.orchestra.run.gibba003.stdout: "realm_epoch": 2 2021-03-10T13:48:04.281 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:48:05.013 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch apply rgw r z --placement=1' 2021-03-10T13:48:05.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:05 gibba003 bash[9769]: cluster 2021-03-10T13:48:03.960353+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v243: 129 pgs: 25 creating+peering, 23 unknown, 81 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 2 op/s 2021-03-10T13:48:05.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:05 gibba003 bash[9769]: audit 2021-03-10T13:48:04.078992+0000 mon.a (mon.0) 591 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:48:05.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:05 gibba003 bash[9769]: cluster 2021-03-10T13:48:04.079045+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:48:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:05 gibba003 bash[12956]: cluster 2021-03-10T13:48:03.960353+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v243: 129 pgs: 25 creating+peering, 23 unknown, 81 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 2 op/s 2021-03-10T13:48:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:05 gibba003 bash[12956]: audit 2021-03-10T13:48:04.078992+0000 mon.a (mon.0) 591 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:48:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:05 gibba003 bash[12956]: cluster 2021-03-10T13:48:04.079045+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:48:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:05 gibba043 bash[9839]: cluster 2021-03-10T13:48:03.960353+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v243: 129 pgs: 25 creating+peering, 23 unknown, 81 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 2 op/s 2021-03-10T13:48:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:05 gibba043 bash[9839]: audit 2021-03-10T13:48:04.078992+0000 mon.a (mon.0) 591 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:48:05.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:05 gibba043 bash[9839]: cluster 2021-03-10T13:48:04.079045+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:48:07.366 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:07 gibba003 bash[9769]: cluster 2021-03-10T13:48:05.960831+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v245: 129 pgs: 9 creating+peering, 3 unknown, 117 active+clean; 2.4 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2021-03-10T13:48:07.367 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:07 gibba003 bash[12956]: cluster 2021-03-10T13:48:05.960831+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v245: 129 pgs: 9 creating+peering, 3 unknown, 117 active+clean; 2.4 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2021-03-10T13:48:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:07 gibba043 bash[9839]: cluster 2021-03-10T13:48:05.960831+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v245: 129 pgs: 9 creating+peering, 3 unknown, 117 active+clean; 2.4 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2021-03-10T13:48:07.591 INFO:teuthology.orchestra.run.gibba003.stdout:Scheduled rgw update... 2021-03-10T13:48:08.394 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.577016+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:48:07.576771\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:48:08.394 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.581077+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:48:07.576771\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:48:08.394 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.582847+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:48:08.395 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.589014+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:48:08.395 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.589996+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:48:08.395 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.593040+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:48:08.395 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.594026+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:48:08.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.596863+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:48:08.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.597863+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:48:08.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.600543+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:48:08.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.601282+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:08.396 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[9769]: audit 2021-03-10T13:48:07.602155+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba003.uvtpth", "key": "container_image"}]: dispatch 2021-03-10T13:48:08.397 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.577016+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:48:07.576771\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:48:08.397 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.581077+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:48:07.576771\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:48:08.397 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.582847+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:48:08.398 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.589014+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:48:08.398 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.589996+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:48:08.398 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.593040+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:48:08.398 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.594026+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:48:08.399 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.596863+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:48:08.399 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.597863+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:48:08.399 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.600543+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:48:08.399 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.601282+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:08.399 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:08 gibba003 bash[12956]: audit 2021-03-10T13:48:07.602155+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba003.uvtpth", "key": "container_image"}]: dispatch 2021-03-10T13:48:08.400 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'sleep 120' 2021-03-10T13:48:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.577016+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:48:07.576771\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:48:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.581077+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:48:07.576771\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:48:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.582847+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:48:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.589014+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:48:08.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.589996+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:48:08.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.593040+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:48:08.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.594026+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:48:08.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.596863+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:48:08.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.597863+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:48:08.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.600543+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:48:08.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.601282+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:08.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:08 gibba043 bash[9839]: audit 2021-03-10T13:48:07.602155+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba003.uvtpth", "key": "container_image"}]: dispatch 2021-03-10T13:48:09.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[9769]: audit 2021-03-10T13:48:07.576406+0000 mgr.y (mgr.14140) 247 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:09.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[9769]: cephadm 2021-03-10T13:48:07.576761+0000 mgr.y (mgr.14140) 248 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:48:09.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[9769]: cephadm 2021-03-10T13:48:07.601878+0000 mgr.y (mgr.14140) 249 : cephadm [INF] Deploying daemon rgw.r.z.gibba003.uvtpth on gibba003 2021-03-10T13:48:09.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[9769]: cluster 2021-03-10T13:48:07.962069+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 4.9 KiB data, 5.1 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 2.8 KiB/s wr, 9 op/s 2021-03-10T13:48:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[12956]: audit 2021-03-10T13:48:07.576406+0000 mgr.y (mgr.14140) 247 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[12956]: cephadm 2021-03-10T13:48:07.576761+0000 mgr.y (mgr.14140) 248 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:48:09.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[12956]: cephadm 2021-03-10T13:48:07.601878+0000 mgr.y (mgr.14140) 249 : cephadm [INF] Deploying daemon rgw.r.z.gibba003.uvtpth on gibba003 2021-03-10T13:48:09.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:09 gibba003 bash[12956]: cluster 2021-03-10T13:48:07.962069+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 4.9 KiB data, 5.1 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 2.8 KiB/s wr, 9 op/s 2021-03-10T13:48:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:09 gibba043 bash[9839]: audit 2021-03-10T13:48:07.576406+0000 mgr.y (mgr.14140) 247 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:09 gibba043 bash[9839]: cephadm 2021-03-10T13:48:07.576761+0000 mgr.y (mgr.14140) 248 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:48:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:09 gibba043 bash[9839]: cephadm 2021-03-10T13:48:07.601878+0000 mgr.y (mgr.14140) 249 : cephadm [INF] Deploying daemon rgw.r.z.gibba003.uvtpth on gibba003 2021-03-10T13:48:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:09 gibba043 bash[9839]: cluster 2021-03-10T13:48:07.962069+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 4.9 KiB data, 5.1 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 2.8 KiB/s wr, 9 op/s 2021-03-10T13:48:11.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[12956]: cluster 2021-03-10T13:48:09.963617+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 907 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:48:11.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[9769]: cluster 2021-03-10T13:48:09.963617+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 907 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:48:11.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[9769]: audit 2021-03-10T13:48:10.533734+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:48:11.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[9769]: audit 2021-03-10T13:48:10.537698+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:48:11.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[9769]: audit 2021-03-10T13:48:10.538321+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:11.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[12956]: audit 2021-03-10T13:48:10.533734+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:48:11.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[12956]: audit 2021-03-10T13:48:10.537698+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:48:11.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:11 gibba003 bash[12956]: audit 2021-03-10T13:48:10.538321+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:11.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:11 gibba043 bash[9839]: cluster 2021-03-10T13:48:09.963617+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 907 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:48:11.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:11 gibba043 bash[9839]: audit 2021-03-10T13:48:10.533734+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:48:11.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:11 gibba043 bash[9839]: audit 2021-03-10T13:48:10.537698+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306173\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306233\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306263\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306289\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306316\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306341\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306367\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306393\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:48.306419\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:48:11.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:11 gibba043 bash[9839]: audit 2021-03-10T13:48:10.538321+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:13.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:13 gibba003 bash[9769]: cluster 2021-03-10T13:48:11.964923+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 805 B/s rd, 4.4 KiB/s wr, 16 op/s 2021-03-10T13:48:13.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:13 gibba003 bash[12956]: cluster 2021-03-10T13:48:11.964923+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 805 B/s rd, 4.4 KiB/s wr, 16 op/s 2021-03-10T13:48:13.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:13 gibba003 bash[9769]: audit 2021-03-10T13:48:12.214542+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212033\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212169\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212248\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212350\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212459\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212566\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212669\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212755\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212880\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"container_id\": \"e766fb56aa27\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212962\", \"created\": \"2021-03-10T13:48:10.520919\", \"started\": \"2021-03-10T13:48:10.546702\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_daemon_update\": \"2021-03-10T13:48:12.213150\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:48:13.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:13 gibba003 bash[9769]: audit 2021-03-10T13:48:12.219893+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212033\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212169\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212248\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212350\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212459\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212566\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212669\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212755\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212880\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"container_id\": \"e766fb56aa27\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212962\", \"created\": \"2021-03-10T13:48:10.520919\", \"started\": \"2021-03-10T13:48:10.546702\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_daemon_update\": \"2021-03-10T13:48:12.213150\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:48:13.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:13 gibba003 bash[12956]: audit 2021-03-10T13:48:12.214542+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212033\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212169\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212248\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212350\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212459\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212566\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212669\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212755\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212880\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"container_id\": \"e766fb56aa27\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212962\", \"created\": \"2021-03-10T13:48:10.520919\", \"started\": \"2021-03-10T13:48:10.546702\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_daemon_update\": \"2021-03-10T13:48:12.213150\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:48:13.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:13 gibba003 bash[12956]: audit 2021-03-10T13:48:12.219893+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212033\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212169\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212248\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212350\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212459\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212566\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212669\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212755\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212880\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"container_id\": \"e766fb56aa27\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212962\", \"created\": \"2021-03-10T13:48:10.520919\", \"started\": \"2021-03-10T13:48:10.546702\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_daemon_update\": \"2021-03-10T13:48:12.213150\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:48:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:13 gibba043 bash[9839]: cluster 2021-03-10T13:48:11.964923+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 805 B/s rd, 4.4 KiB/s wr, 16 op/s 2021-03-10T13:48:13.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:13 gibba043 bash[9839]: audit 2021-03-10T13:48:12.214542+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212033\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212169\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212248\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212350\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212459\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212566\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212669\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212755\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212880\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"container_id\": \"e766fb56aa27\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212962\", \"created\": \"2021-03-10T13:48:10.520919\", \"started\": \"2021-03-10T13:48:10.546702\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_daemon_update\": \"2021-03-10T13:48:12.213150\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]: dispatch 2021-03-10T13:48:13.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:13 gibba043 bash[9839]: audit 2021-03-10T13:48:12.219893+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212033\", \"created\": \"2021-03-10T13:41:02.654424\", \"started\": \"2021-03-10T13:41:07.860120\"}, \"mgr.y\": {\"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212169\", \"created\": \"2021-03-10T13:41:09.854424\", \"started\": \"2021-03-10T13:41:09.877098\"}, \"mon.c\": {\"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212248\", \"created\": \"2021-03-10T13:42:17.618426\", \"started\": \"2021-03-10T13:42:17.642532\"}, \"osd.0\": {\"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212350\", \"created\": \"2021-03-10T13:43:04.558427\", \"started\": \"2021-03-10T13:43:07.346285\"}, \"osd.1\": {\"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212459\", \"created\": \"2021-03-10T13:43:25.670427\", \"started\": \"2021-03-10T13:43:52.130582\"}, \"osd.2\": {\"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212566\", \"created\": \"2021-03-10T13:43:51.772801\", \"started\": \"2021-03-10T13:43:55.442950\"}, \"osd.3\": {\"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212669\", \"created\": \"2021-03-10T13:44:15.080913\", \"started\": \"2021-03-10T13:44:18.055588\"}, \"node-exporter.a\": {\"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212755\", \"created\": \"2021-03-10T13:46:09.388916\", \"started\": \"2021-03-10T13:46:12.160337\"}, \"alertmanager.a\": {\"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212880\", \"created\": \"2021-03-10T13:46:19.384917\", \"started\": \"2021-03-10T13:46:40.646299\"}, \"rgw.r.z.gibba003.uvtpth\": {\"hostname\": \"gibba003\", \"container_id\": \"e766fb56aa27\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:12.212962\", \"created\": \"2021-03-10T13:48:10.520919\", \"started\": \"2021-03-10T13:48:10.546702\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089\"}}, \"last_daemon_update\": \"2021-03-10T13:48:12.213150\", \"last_device_update\": \"2021-03-10T13:44:21.206613\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567\"}"}]': finished 2021-03-10T13:48:15.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:15 gibba003 bash[9769]: cluster 2021-03-10T13:48:13.966161+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 716 B/s rd, 3.9 KiB/s wr, 14 op/s 2021-03-10T13:48:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:15 gibba003 bash[12956]: cluster 2021-03-10T13:48:13.966161+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 716 B/s rd, 3.9 KiB/s wr, 14 op/s 2021-03-10T13:48:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:15 gibba043 bash[9839]: cluster 2021-03-10T13:48:13.966161+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 6.9 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 716 B/s rd, 3.9 KiB/s wr, 14 op/s 2021-03-10T13:48:17.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:17 gibba003 bash[9769]: cluster 2021-03-10T13:48:15.967890+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 3.4 KiB/s wr, 14 op/s 2021-03-10T13:48:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:17 gibba003 bash[12956]: cluster 2021-03-10T13:48:15.967890+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 3.4 KiB/s wr, 14 op/s 2021-03-10T13:48:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:17 gibba043 bash[9839]: cluster 2021-03-10T13:48:15.967890+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 3.4 KiB/s wr, 14 op/s 2021-03-10T13:48:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:18 gibba043 bash[9839]: cluster 2021-03-10T13:48:17.969229+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 2.8 KiB/s wr, 14 op/s 2021-03-10T13:48:18.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:18 gibba003 bash[9769]: cluster 2021-03-10T13:48:17.969229+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 2.8 KiB/s wr, 14 op/s 2021-03-10T13:48:18.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:18 gibba003 bash[12956]: cluster 2021-03-10T13:48:17.969229+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 2.8 KiB/s wr, 14 op/s 2021-03-10T13:48:21.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:21 gibba043 bash[9839]: cluster 2021-03-10T13:48:19.970791+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2021-03-10T13:48:21.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:20 gibba003 bash[9769]: cluster 2021-03-10T13:48:19.970791+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2021-03-10T13:48:21.739 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:20 gibba003 bash[12956]: cluster 2021-03-10T13:48:19.970791+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2021-03-10T13:48:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:23 gibba043 bash[9839]: cluster 2021-03-10T13:48:21.972159+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:23.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:23 gibba003 bash[9769]: cluster 2021-03-10T13:48:21.972159+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:23.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:23 gibba003 bash[12956]: cluster 2021-03-10T13:48:21.972159+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:25.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:25 gibba003 bash[9769]: cluster 2021-03-10T13:48:23.973248+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:25.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:25 gibba003 bash[12956]: cluster 2021-03-10T13:48:23.973248+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:25.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:25 gibba043 bash[9839]: cluster 2021-03-10T13:48:23.973248+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:27.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:27 gibba003 bash[9769]: cluster 2021-03-10T13:48:25.974854+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T13:48:27.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:27 gibba003 bash[12956]: cluster 2021-03-10T13:48:25.974854+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T13:48:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:27 gibba043 bash[9839]: cluster 2021-03-10T13:48:25.974854+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T13:48:29.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:29 gibba003 bash[9769]: cluster 2021-03-10T13:48:27.976271+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:29 gibba003 bash[12956]: cluster 2021-03-10T13:48:27.976271+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:29 gibba043 bash[9839]: cluster 2021-03-10T13:48:27.976271+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:48:31.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:31 gibba003 bash[9769]: cluster 2021-03-10T13:48:29.977679+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:31.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:31 gibba003 bash[12956]: cluster 2021-03-10T13:48:29.977679+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:31.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:31 gibba043 bash[9839]: cluster 2021-03-10T13:48:29.977679+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:33.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:33 gibba003 bash[9769]: cluster 2021-03-10T13:48:31.979156+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:33.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:33 gibba003 bash[12956]: cluster 2021-03-10T13:48:31.979156+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:33 gibba043 bash[9839]: cluster 2021-03-10T13:48:31.979156+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:35.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:35 gibba003 bash[9769]: cluster 2021-03-10T13:48:33.980171+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:35.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:35 gibba003 bash[12956]: cluster 2021-03-10T13:48:33.980171+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:35 gibba043 bash[9839]: cluster 2021-03-10T13:48:33.980171+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:37.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:37 gibba003 bash[9769]: cluster 2021-03-10T13:48:35.981865+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:37 gibba003 bash[12956]: cluster 2021-03-10T13:48:35.981865+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:37 gibba043 bash[9839]: cluster 2021-03-10T13:48:35.981865+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:39.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:39 gibba003 bash[9769]: cluster 2021-03-10T13:48:37.983382+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:39.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:39 gibba003 bash[12956]: cluster 2021-03-10T13:48:37.983382+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:39 gibba043 bash[9839]: cluster 2021-03-10T13:48:37.983382+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:41.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:41 gibba003 bash[9769]: cluster 2021-03-10T13:48:39.984693+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:48:41.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:41 gibba003 bash[12956]: cluster 2021-03-10T13:48:39.984693+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:48:41.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:41 gibba043 bash[9839]: cluster 2021-03-10T13:48:39.984693+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:48:43.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:43 gibba003 bash[9769]: cluster 2021-03-10T13:48:41.986023+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:43.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:43 gibba003 bash[12956]: cluster 2021-03-10T13:48:41.986023+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:43 gibba043 bash[9839]: cluster 2021-03-10T13:48:41.986023+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:45.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:45 gibba003 bash[9769]: cluster 2021-03-10T13:48:43.987361+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:45.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:45 gibba003 bash[12956]: cluster 2021-03-10T13:48:43.987361+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:45 gibba043 bash[9839]: cluster 2021-03-10T13:48:43.987361+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:47.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:47 gibba003 bash[9769]: cluster 2021-03-10T13:48:45.989004+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:47.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:47 gibba003 bash[12956]: cluster 2021-03-10T13:48:45.989004+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:47 gibba043 bash[9839]: cluster 2021-03-10T13:48:45.989004+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:49.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:49 gibba003 bash[9769]: cluster 2021-03-10T13:48:47.990425+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:49.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:49 gibba003 bash[12956]: cluster 2021-03-10T13:48:47.990425+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:49.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:49 gibba043 bash[9839]: cluster 2021-03-10T13:48:47.990425+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:51.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:51 gibba003 bash[9769]: cluster 2021-03-10T13:48:49.991995+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:51.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:51 gibba003 bash[12956]: cluster 2021-03-10T13:48:49.991995+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:51.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:51 gibba043 bash[9839]: cluster 2021-03-10T13:48:49.991995+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:48:53.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:53 gibba003 bash[9769]: cluster 2021-03-10T13:48:51.993310+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:53.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:53 gibba003 bash[12956]: cluster 2021-03-10T13:48:51.993310+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:53.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:53 gibba043 bash[9839]: cluster 2021-03-10T13:48:51.993310+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:55.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:55 gibba003 bash[9769]: cluster 2021-03-10T13:48:53.994432+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:55.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:55 gibba003 bash[12956]: cluster 2021-03-10T13:48:53.994432+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:55 gibba043 bash[9839]: cluster 2021-03-10T13:48:53.994432+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:57.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:57 gibba003 bash[9769]: cluster 2021-03-10T13:48:55.996287+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:57 gibba003 bash[12956]: cluster 2021-03-10T13:48:55.996287+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:57 gibba043 bash[9839]: cluster 2021-03-10T13:48:55.996287+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:58.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:48:58 gibba003 bash[9769]: cluster 2021-03-10T13:48:57.997936+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:58.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:48:58 gibba003 bash[12956]: cluster 2021-03-10T13:48:57.997936+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:48:58.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:48:58 gibba043 bash[9839]: cluster 2021-03-10T13:48:57.997936+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:01.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:01 gibba003 bash[9769]: cluster 2021-03-10T13:48:59.999490+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:49:01.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:01 gibba003 bash[12956]: cluster 2021-03-10T13:48:59.999490+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:49:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:01 gibba043 bash[9839]: cluster 2021-03-10T13:48:59.999490+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:49:03.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:03 gibba003 bash[9769]: cluster 2021-03-10T13:49:02.000803+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:49:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:03 gibba003 bash[12956]: cluster 2021-03-10T13:49:02.000803+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:49:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:03 gibba043 bash[9839]: cluster 2021-03-10T13:49:02.000803+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:49:05.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:05 gibba003 bash[9769]: cluster 2021-03-10T13:49:04.002126+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:05.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:05 gibba003 bash[12956]: cluster 2021-03-10T13:49:04.002126+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:05.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:05 gibba043 bash[9839]: cluster 2021-03-10T13:49:04.002126+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:07.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:07 gibba003 bash[9769]: cluster 2021-03-10T13:49:06.004125+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:07.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:07 gibba003 bash[12956]: cluster 2021-03-10T13:49:06.004125+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:07 gibba043 bash[9839]: cluster 2021-03-10T13:49:06.004125+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:09.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:09 gibba003 bash[9769]: cluster 2021-03-10T13:49:08.005487+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:09.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:09 gibba003 bash[12956]: cluster 2021-03-10T13:49:08.005487+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:09 gibba043 bash[9839]: cluster 2021-03-10T13:49:08.005487+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:11.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:11 gibba003 bash[9769]: cluster 2021-03-10T13:49:10.006776+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:11.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:11 gibba003 bash[12956]: cluster 2021-03-10T13:49:10.006776+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:11.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:11 gibba043 bash[9839]: cluster 2021-03-10T13:49:10.006776+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:49:13.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:13 gibba003 bash[9769]: cluster 2021-03-10T13:49:12.011417+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:13.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:13 gibba003 bash[12956]: cluster 2021-03-10T13:49:12.011417+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:13 gibba043 bash[9839]: cluster 2021-03-10T13:49:12.011417+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:15.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:15 gibba003 bash[9769]: cluster 2021-03-10T13:49:14.012360+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:15 gibba003 bash[12956]: cluster 2021-03-10T13:49:14.012360+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:15 gibba043 bash[9839]: cluster 2021-03-10T13:49:14.012360+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:17.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:17 gibba003 bash[9769]: cluster 2021-03-10T13:49:16.014242+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:17 gibba003 bash[12956]: cluster 2021-03-10T13:49:16.014242+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:17 gibba043 bash[9839]: cluster 2021-03-10T13:49:16.014242+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:19.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:19 gibba003 bash[9769]: cluster 2021-03-10T13:49:18.015807+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:19.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:19 gibba003 bash[12956]: cluster 2021-03-10T13:49:18.015807+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:19 gibba043 bash[9839]: cluster 2021-03-10T13:49:18.015807+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:21.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:21 gibba003 bash[9769]: cluster 2021-03-10T13:49:20.016611+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:49:21.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:21 gibba003 bash[12956]: cluster 2021-03-10T13:49:20.016611+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:49:21.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:21 gibba043 bash[9839]: cluster 2021-03-10T13:49:20.016611+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:49:23.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:23 gibba003 bash[9769]: cluster 2021-03-10T13:49:22.017257+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:49:23.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:23 gibba003 bash[12956]: cluster 2021-03-10T13:49:22.017257+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:49:23.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:23 gibba043 bash[9839]: cluster 2021-03-10T13:49:22.017257+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:49:25.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:25 gibba003 bash[9769]: cluster 2021-03-10T13:49:24.018145+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:25.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:25 gibba003 bash[12956]: cluster 2021-03-10T13:49:24.018145+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:25.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:25 gibba043 bash[9839]: cluster 2021-03-10T13:49:24.018145+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:27.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:27 gibba003 bash[9769]: cluster 2021-03-10T13:49:26.018910+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:27.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:27 gibba003 bash[12956]: cluster 2021-03-10T13:49:26.018910+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:27 gibba043 bash[9839]: cluster 2021-03-10T13:49:26.018910+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:29.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:29 gibba003 bash[9769]: cluster 2021-03-10T13:49:28.020169+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:29 gibba003 bash[12956]: cluster 2021-03-10T13:49:28.020169+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:29 gibba043 bash[9839]: cluster 2021-03-10T13:49:28.020169+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:31.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:31 gibba003 bash[9769]: cluster 2021-03-10T13:49:30.020772+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:31.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:31 gibba003 bash[12956]: cluster 2021-03-10T13:49:30.020772+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:31.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:31 gibba043 bash[9839]: cluster 2021-03-10T13:49:30.020772+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:33.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:33 gibba003 bash[9769]: cluster 2021-03-10T13:49:32.021121+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:33.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:33 gibba003 bash[12956]: cluster 2021-03-10T13:49:32.021121+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:33.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:33 gibba043 bash[9839]: cluster 2021-03-10T13:49:32.021121+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:35.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:35 gibba003 bash[9769]: cluster 2021-03-10T13:49:34.021979+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:35.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:35 gibba003 bash[12956]: cluster 2021-03-10T13:49:34.021979+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:35 gibba043 bash[9839]: cluster 2021-03-10T13:49:34.021979+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:37.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:37 gibba003 bash[9769]: cluster 2021-03-10T13:49:36.023713+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:37 gibba003 bash[12956]: cluster 2021-03-10T13:49:36.023713+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:37 gibba043 bash[9839]: cluster 2021-03-10T13:49:36.023713+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:39.056 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:39 gibba003 bash[9769]: cluster 2021-03-10T13:49:38.025071+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:39.056 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:39 gibba003 bash[12956]: cluster 2021-03-10T13:49:38.025071+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:39 gibba043 bash[9839]: cluster 2021-03-10T13:49:38.025071+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:41.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:41 gibba003 bash[9769]: cluster 2021-03-10T13:49:40.025794+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:41.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:41 gibba003 bash[12956]: cluster 2021-03-10T13:49:40.025794+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:41 gibba043 bash[9839]: cluster 2021-03-10T13:49:40.025794+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:43.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:43 gibba003 bash[9769]: cluster 2021-03-10T13:49:42.026107+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:43.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:43 gibba003 bash[12956]: cluster 2021-03-10T13:49:42.026107+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:43 gibba043 bash[9839]: cluster 2021-03-10T13:49:42.026107+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:49:45.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:45 gibba003 bash[9769]: cluster 2021-03-10T13:49:44.026957+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T13:49:45.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:45 gibba003 bash[12956]: cluster 2021-03-10T13:49:44.026957+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T13:49:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:45 gibba043 bash[9839]: cluster 2021-03-10T13:49:44.026957+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T13:49:47.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:47 gibba003 bash[9769]: cluster 2021-03-10T13:49:46.028776+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:47.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:47 gibba003 bash[12956]: cluster 2021-03-10T13:49:46.028776+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:47 gibba043 bash[9839]: cluster 2021-03-10T13:49:46.028776+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:49.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:49 gibba003 bash[9769]: cluster 2021-03-10T13:49:48.030257+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:49.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:49 gibba003 bash[12956]: cluster 2021-03-10T13:49:48.030257+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:49 gibba043 bash[9839]: cluster 2021-03-10T13:49:48.030257+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:51 gibba003 bash[9769]: cluster 2021-03-10T13:49:50.030851+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:51.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:51 gibba003 bash[12956]: cluster 2021-03-10T13:49:50.030851+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:51 gibba043 bash[9839]: cluster 2021-03-10T13:49:50.030851+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:53.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:53 gibba003 bash[9769]: cluster 2021-03-10T13:49:52.031212+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:53.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:53 gibba003 bash[12956]: cluster 2021-03-10T13:49:52.031212+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:53 gibba043 bash[9839]: cluster 2021-03-10T13:49:52.031212+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:55.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:55 gibba003 bash[9769]: cluster 2021-03-10T13:49:54.032276+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:55.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:55 gibba003 bash[12956]: cluster 2021-03-10T13:49:54.032276+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:55 gibba043 bash[9839]: cluster 2021-03-10T13:49:54.032276+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:57 gibba003 bash[9769]: cluster 2021-03-10T13:49:56.033397+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:57.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:57 gibba003 bash[12956]: cluster 2021-03-10T13:49:56.033397+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:57 gibba043 bash[9839]: cluster 2021-03-10T13:49:56.033397+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:49:59.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:49:59 gibba003 bash[9769]: cluster 2021-03-10T13:49:58.034764+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:49:59 gibba003 bash[12956]: cluster 2021-03-10T13:49:58.034764+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:49:59 gibba043 bash[9839]: cluster 2021-03-10T13:49:58.034764+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:01.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:01 gibba003 bash[9769]: cluster 2021-03-10T13:50:00.035639+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:01.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:01 gibba003 bash[12956]: cluster 2021-03-10T13:50:00.035639+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:01 gibba043 bash[9839]: cluster 2021-03-10T13:50:00.035639+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:03.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:03 gibba003 bash[9769]: cluster 2021-03-10T13:50:02.036017+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:03 gibba003 bash[12956]: cluster 2021-03-10T13:50:02.036017+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:03 gibba043 bash[9839]: cluster 2021-03-10T13:50:02.036017+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:05 gibba003 bash[9769]: cluster 2021-03-10T13:50:04.037057+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:05 gibba003 bash[12956]: cluster 2021-03-10T13:50:04.037057+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:05 gibba043 bash[9839]: cluster 2021-03-10T13:50:04.037057+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:07 gibba003 bash[9769]: cluster 2021-03-10T13:50:06.038922+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:07 gibba003 bash[12956]: cluster 2021-03-10T13:50:06.038922+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:07 gibba043 bash[9839]: cluster 2021-03-10T13:50:06.038922+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:09 gibba003 bash[9769]: cluster 2021-03-10T13:50:08.040437+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:09 gibba003 bash[12956]: cluster 2021-03-10T13:50:08.040437+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:09 gibba043 bash[9839]: cluster 2021-03-10T13:50:08.040437+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:11.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:11 gibba003 bash[9769]: cluster 2021-03-10T13:50:10.041364+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:11 gibba003 bash[12956]: cluster 2021-03-10T13:50:10.041364+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:11 gibba043 bash[9839]: cluster 2021-03-10T13:50:10.041364+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:12.645 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-03-10T13:50:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:13 gibba003 bash[9769]: cluster 2021-03-10T13:50:12.042593+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:13 gibba003 bash[12956]: cluster 2021-03-10T13:50:12.042593+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:13 gibba043 bash[9839]: cluster 2021-03-10T13:50:12.042593+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:15.273 INFO:teuthology.orchestra.run.gibba003.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:50:15.336 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:15 gibba003 bash[9769]: cluster 2021-03-10T13:50:14.043665+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:15.337 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:15 gibba003 bash[12956]: cluster 2021-03-10T13:50:14.043665+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:15 gibba043 bash[9839]: cluster 2021-03-10T13:50:14.043665+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:16 gibba003 bash[9769]: audit 2021-03-10T13:50:15.265574+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\"}"}]: dispatch 2021-03-10T13:50:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:16 gibba003 bash[9769]: audit 2021-03-10T13:50:15.269782+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\"}"}]': finished 2021-03-10T13:50:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:16 gibba003 bash[12956]: audit 2021-03-10T13:50:15.265574+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\"}"}]: dispatch 2021-03-10T13:50:16.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:16 gibba003 bash[12956]: audit 2021-03-10T13:50:15.269782+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\"}"}]': finished 2021-03-10T13:50:16.445 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:50:16.455 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba003.front.sepia.ceph.com 2021-03-10T13:50:16.456 DEBUG:teuthology.orchestra.run.gibba003:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 33572ad6-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2021-03-10T13:50:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:16 gibba043 bash[9839]: audit 2021-03-10T13:50:15.265574+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\"}"}]: dispatch 2021-03-10T13:50:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:16 gibba043 bash[9839]: audit 2021-03-10T13:50:15.269782+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\"}"}]': finished 2021-03-10T13:50:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:17 gibba003 bash[9769]: audit 2021-03-10T13:50:15.264939+0000 mgr.y (mgr.14140) 314 : audit [DBG] from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:17 gibba003 bash[9769]: cephadm 2021-03-10T13:50:15.272261+0000 mgr.y (mgr.14140) 315 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:50:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:17 gibba003 bash[9769]: cluster 2021-03-10T13:50:16.044213+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:17 gibba003 bash[12956]: audit 2021-03-10T13:50:15.264939+0000 mgr.y (mgr.14140) 314 : audit [DBG] from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:17 gibba003 bash[12956]: cephadm 2021-03-10T13:50:15.272261+0000 mgr.y (mgr.14140) 315 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:50:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:17 gibba003 bash[12956]: cluster 2021-03-10T13:50:16.044213+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:17 gibba043 bash[9839]: audit 2021-03-10T13:50:15.264939+0000 mgr.y (mgr.14140) 314 : audit [DBG] from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:17 gibba043 bash[9839]: cephadm 2021-03-10T13:50:15.272261+0000 mgr.y (mgr.14140) 315 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:50:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:17 gibba043 bash[9839]: cluster 2021-03-10T13:50:16.044213+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:19 gibba003 bash[9769]: cluster 2021-03-10T13:50:18.045254+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:19 gibba003 bash[12956]: cluster 2021-03-10T13:50:18.045254+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:19 gibba043 bash[9839]: cluster 2021-03-10T13:50:18.045254+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:21 gibba003 bash[9769]: cluster 2021-03-10T13:50:20.045747+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:21 gibba003 bash[12956]: cluster 2021-03-10T13:50:20.045747+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:21 gibba043 bash[9839]: cluster 2021-03-10T13:50:20.045747+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:23 gibba003 bash[9769]: cluster 2021-03-10T13:50:22.046095+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:23 gibba003 bash[12956]: cluster 2021-03-10T13:50:22.046095+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:23 gibba043 bash[9839]: cluster 2021-03-10T13:50:22.046095+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:25.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:25 gibba003 bash[12956]: cluster 2021-03-10T13:50:24.046957+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:25 gibba003 bash[9769]: cluster 2021-03-10T13:50:24.046957+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:25 gibba043 bash[9839]: cluster 2021-03-10T13:50:24.046957+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:27.480 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:27 gibba003 bash[9769]: cluster 2021-03-10T13:50:26.048829+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:27.480 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:27 gibba003 bash[12956]: cluster 2021-03-10T13:50:26.048829+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:27 gibba043 bash[9839]: cluster 2021-03-10T13:50:26.048829+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:29 gibba003 bash[9769]: cluster 2021-03-10T13:50:28.049504+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:29 gibba003 bash[12956]: cluster 2021-03-10T13:50:28.049504+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:29.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:29 gibba043 bash[9839]: cluster 2021-03-10T13:50:28.049504+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:30.328 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:30 gibba003 bash[9769]: audit 2021-03-10T13:50:29.442465+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:50:30.328 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:30 gibba003 bash[9769]: audit 2021-03-10T13:50:29.446218+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:50:30.328 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:30 gibba003 bash[9769]: audit 2021-03-10T13:50:29.446769+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:30.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:30 gibba003 bash[12956]: audit 2021-03-10T13:50:29.442465+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:50:30.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:30 gibba003 bash[12956]: audit 2021-03-10T13:50:29.446218+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:50:30.329 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:30 gibba003 bash[12956]: audit 2021-03-10T13:50:29.446769+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:30.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:30 gibba043 bash[9839]: audit 2021-03-10T13:50:29.442465+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:50:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:30 gibba043 bash[9839]: audit 2021-03-10T13:50:29.446218+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:50:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:30 gibba043 bash[9839]: audit 2021-03-10T13:50:29.446769+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:30.550 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:50:30.741 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:50:30.741 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3m) 2m ago 4m 0.21.0 prom/alertmanager c876f5897d7b ef09171c6190 2021-03-10T13:50:30.741 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3m) 3m ago 3m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:50:30.741 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4d22dd216835 2021-03-10T13:50:30.742 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7a78b79a1a0b 2021-03-10T13:50:30.742 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b8fc1368daa1 2021-03-10T13:50:30.742 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8bc1091ccae9 2021-03-10T13:50:30.742 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0560a63542e 2021-03-10T13:50:30.742 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 be39d003f3cf 2021-03-10T13:50:30.743 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:50:30.743 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (4m) 3m ago 4m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:50:30.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8f0b52d3cade 2021-03-10T13:50:30.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (6m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:50:30.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:50:30.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:50:30.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:50:30.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:50:30.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:50:30.745 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (4m) 3m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:50:30.745 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3m) 3m ago 4m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:50:30.745 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e766fb56aa27 2021-03-10T13:50:30.951 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:50:30.952 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:50:30.952 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:50:30.952 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:50:30.952 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:50:30.952 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:50:30.953 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:50:30.953 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:50:30.953 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:50:30.953 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:50:30.953 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:50:30.954 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:50:30.954 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T13:50:30.954 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:50:30.954 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:50:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[9769]: cephadm 2021-03-10T13:50:29.446588+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:50:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[9769]: cephadm 2021-03-10T13:50:29.447525+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:50:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[9769]: cephadm 2021-03-10T13:50:29.447597+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:50:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[9769]: cephadm 2021-03-10T13:50:29.589968+0000 mgr.y (mgr.14140) 326 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba043 2021-03-10T13:50:31.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[9769]: cluster 2021-03-10T13:50:30.050655+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:31.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[9769]: audit 2021-03-10T13:50:30.949615+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.103:0/442438995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[12956]: cephadm 2021-03-10T13:50:29.446588+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:50:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[12956]: cephadm 2021-03-10T13:50:29.447525+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:50:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[12956]: cephadm 2021-03-10T13:50:29.447597+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:50:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[12956]: cephadm 2021-03-10T13:50:29.589968+0000 mgr.y (mgr.14140) 326 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba043 2021-03-10T13:50:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[12956]: cluster 2021-03-10T13:50:30.050655+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:31 gibba003 bash[12956]: audit 2021-03-10T13:50:30.949615+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.103:0/442438995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:31 gibba043 bash[9839]: cephadm 2021-03-10T13:50:29.446588+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:50:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:31 gibba043 bash[9839]: cephadm 2021-03-10T13:50:29.447525+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:50:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:31 gibba043 bash[9839]: cephadm 2021-03-10T13:50:29.447597+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:50:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:31 gibba043 bash[9839]: cephadm 2021-03-10T13:50:29.589968+0000 mgr.y (mgr.14140) 326 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba043 2021-03-10T13:50:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:31 gibba043 bash[9839]: cluster 2021-03-10T13:50:30.050655+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:31 gibba043 bash[9839]: audit 2021-03-10T13:50:30.949615+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.103:0/442438995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:32 gibba003 bash[9769]: audit 2021-03-10T13:50:30.541126+0000 mgr.y (mgr.14140) 328 : audit [DBG] from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:32 gibba003 bash[9769]: audit 2021-03-10T13:50:30.736230+0000 mgr.y (mgr.14140) 329 : audit [DBG] from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:32 gibba003 bash[12956]: audit 2021-03-10T13:50:30.541126+0000 mgr.y (mgr.14140) 328 : audit [DBG] from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:32 gibba003 bash[12956]: audit 2021-03-10T13:50:30.736230+0000 mgr.y (mgr.14140) 329 : audit [DBG] from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:32 gibba043 bash[9839]: audit 2021-03-10T13:50:30.541126+0000 mgr.y (mgr.14140) 328 : audit [DBG] from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:32 gibba043 bash[9839]: audit 2021-03-10T13:50:30.736230+0000 mgr.y (mgr.14140) 329 : audit [DBG] from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:33 gibba003 bash[9769]: cluster 2021-03-10T13:50:32.052167+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:33 gibba003 bash[12956]: cluster 2021-03-10T13:50:32.052167+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:33 gibba043 bash[9839]: cluster 2021-03-10T13:50:32.052167+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:35 gibba003 bash[9769]: cluster 2021-03-10T13:50:34.052599+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:35 gibba003 bash[12956]: cluster 2021-03-10T13:50:34.052599+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:35 gibba043 bash[9839]: cluster 2021-03-10T13:50:34.052599+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:37 gibba003 bash[9769]: cluster 2021-03-10T13:50:36.054015+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:37 gibba003 bash[12956]: cluster 2021-03-10T13:50:36.054015+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:37 gibba043 bash[9839]: cluster 2021-03-10T13:50:36.054015+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:39 gibba003 bash[9769]: cluster 2021-03-10T13:50:38.055564+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:39 gibba003 bash[12956]: cluster 2021-03-10T13:50:38.055564+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:39 gibba043 bash[9839]: cluster 2021-03-10T13:50:38.055564+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:41 gibba003 bash[12956]: cluster 2021-03-10T13:50:40.056559+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:41 gibba003 bash[9769]: cluster 2021-03-10T13:50:40.056559+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:41 gibba043 bash[9839]: cluster 2021-03-10T13:50:40.056559+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:43 gibba003 bash[9769]: cluster 2021-03-10T13:50:42.057242+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:43 gibba003 bash[12956]: cluster 2021-03-10T13:50:42.057242+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:43.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:43 gibba043 bash[9839]: cluster 2021-03-10T13:50:42.057242+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:45.325 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:45 gibba043 bash[9839]: cluster 2021-03-10T13:50:44.058071+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:45 gibba003 bash[9769]: cluster 2021-03-10T13:50:44.058071+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:45 gibba003 bash[12956]: cluster 2021-03-10T13:50:44.058071+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.412 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:47 gibba043 bash[9839]: cluster 2021-03-10T13:50:46.059780+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.412 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:47 gibba043 bash[9839]: audit 2021-03-10T13:50:46.191976+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:50:47.412 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:47 gibba043 bash[9839]: audit 2021-03-10T13:50:46.201273+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:50:47.412 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:47 gibba043 bash[9839]: audit 2021-03-10T13:50:46.202155+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:50:47.413 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:47 gibba043 bash[9839]: audit 2021-03-10T13:50:46.202886+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:47.413 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:47 gibba043 bash[9839]: audit 2021-03-10T13:50:46.203725+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:50:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[9769]: cluster 2021-03-10T13:50:46.059780+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[9769]: audit 2021-03-10T13:50:46.191976+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:50:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[9769]: audit 2021-03-10T13:50:46.201273+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:50:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[9769]: audit 2021-03-10T13:50:46.202155+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:50:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[9769]: audit 2021-03-10T13:50:46.202886+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[9769]: audit 2021-03-10T13:50:46.203725+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:50:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[12956]: cluster 2021-03-10T13:50:46.059780+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[12956]: audit 2021-03-10T13:50:46.191976+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:50:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[12956]: audit 2021-03-10T13:50:46.201273+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:50:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[12956]: audit 2021-03-10T13:50:46.202155+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:50:47.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[12956]: audit 2021-03-10T13:50:46.202886+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:47.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:47 gibba003 bash[12956]: audit 2021-03-10T13:50:46.203725+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:50:48.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:48 gibba003 bash[9769]: cephadm 2021-03-10T13:50:46.190738+0000 mgr.y (mgr.14140) 338 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:50:48.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:48 gibba003 bash[9769]: cephadm 2021-03-10T13:50:46.190964+0000 mgr.y (mgr.14140) 339 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:50:48.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:48 gibba003 bash[9769]: cephadm 2021-03-10T13:50:46.203533+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Deploying daemon mgr.x on gibba043 2021-03-10T13:50:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:48 gibba003 bash[12956]: cephadm 2021-03-10T13:50:46.190738+0000 mgr.y (mgr.14140) 338 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:50:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:48 gibba003 bash[12956]: cephadm 2021-03-10T13:50:46.190964+0000 mgr.y (mgr.14140) 339 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:50:48.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:48 gibba003 bash[12956]: cephadm 2021-03-10T13:50:46.203533+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Deploying daemon mgr.x on gibba043 2021-03-10T13:50:48.521 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:48 gibba043 systemd[1]: Stopping Ceph mgr.x for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:50:48.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:48 gibba043 bash[9839]: cephadm 2021-03-10T13:50:46.190738+0000 mgr.y (mgr.14140) 338 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:50:48.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:48 gibba043 bash[9839]: cephadm 2021-03-10T13:50:46.190964+0000 mgr.y (mgr.14140) 339 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:50:48.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:48 gibba043 bash[9839]: cephadm 2021-03-10T13:50:46.203533+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Deploying daemon mgr.x on gibba043 2021-03-10T13:50:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:49 gibba003 bash[9769]: cluster 2021-03-10T13:50:48.061020+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:49 gibba003 bash[12956]: cluster 2021-03-10T13:50:48.061020+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:49.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:49 gibba043 bash[9839]: cluster 2021-03-10T13:50:48.061020+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:51.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:51 gibba003 bash[12956]: cluster 2021-03-10T13:50:50.061481+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:51 gibba003 bash[9769]: cluster 2021-03-10T13:50:50.061481+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:51 gibba043 bash[9839]: cluster 2021-03-10T13:50:50.061481+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:53 gibba003 bash[9769]: cluster 2021-03-10T13:50:52.062189+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:53 gibba003 bash[12956]: cluster 2021-03-10T13:50:52.062189+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:53.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:53 gibba043 bash[9839]: cluster 2021-03-10T13:50:52.062189+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:55 gibba003 bash[9769]: cluster 2021-03-10T13:50:54.063476+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:55 gibba003 bash[12956]: cluster 2021-03-10T13:50:54.063476+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:55.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:55 gibba043 bash[9839]: cluster 2021-03-10T13:50:54.063476+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:57 gibba003 bash[9769]: cluster 2021-03-10T13:50:56.064742+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:57 gibba003 bash[12956]: cluster 2021-03-10T13:50:56.064742+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:57.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:57 gibba043 bash[9839]: cluster 2021-03-10T13:50:56.064742+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:50:59 gibba003 bash[9769]: cluster 2021-03-10T13:50:58.066149+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:50:59 gibba003 bash[12956]: cluster 2021-03-10T13:50:58.066149+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:50:59 gibba043 bash[9839]: cluster 2021-03-10T13:50:58.066149+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:59.520 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 docker[20616]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:50:59.521 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2021-03-10T13:50:59.521 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-03-10T13:50:59.521 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 systemd[1]: Stopped Ceph mgr.x for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:50:59.521 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 systemd[1]: Starting Ceph mgr.x for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:50:59.522 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 docker[20689]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:50:59.522 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:50:59 gibba043 systemd[1]: Started Ceph mgr.x for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:51:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:00 gibba043 bash[9839]: audit 2021-03-10T13:50:59.323124+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:00 gibba043 bash[9839]: audit 2021-03-10T13:50:59.332131+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:00 gibba043 bash[9839]: audit 2021-03-10T13:50:59.333054+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:51:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:00 gibba003 bash[9769]: audit 2021-03-10T13:50:59.323124+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:00 gibba003 bash[9769]: audit 2021-03-10T13:50:59.332131+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:00 gibba003 bash[9769]: audit 2021-03-10T13:50:59.333054+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:51:00.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:00 gibba003 bash[12956]: audit 2021-03-10T13:50:59.323124+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:00.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:00 gibba003 bash[12956]: audit 2021-03-10T13:50:59.332131+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762483\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762579\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762609\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762637\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762665\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762693\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762721\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762749\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:49.762777\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:00.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:00 gibba003 bash[12956]: audit 2021-03-10T13:50:59.333054+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:51:00.770 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:51:00 gibba043 bash[20706]: debug 2021-03-10T13:51:00.411+0000 7f4aaa6b6700 1 -- 172.21.2.143:0/2463464202 <== mon.2 v2:172.21.2.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5609d1fae4e0 con 0x5609d209d000 2021-03-10T13:51:01.162 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:51:01.351 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:51:01.351 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (4m) 2m ago 4m 0.21.0 prom/alertmanager c876f5897d7b ef09171c6190 2021-03-10T13:51:01.352 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (4m) 0s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:51:01.352 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (8m) 0s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4d22dd216835 2021-03-10T13:51:01.352 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running 0s ago 8m quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:51:01.352 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b8fc1368daa1 2021-03-10T13:51:01.353 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8bc1091ccae9 2021-03-10T13:51:01.353 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (8m) 0s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0560a63542e 2021-03-10T13:51:01.353 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 be39d003f3cf 2021-03-10T13:51:01.353 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:51:01.353 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (4m) 0s ago 4m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:51:01.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8f0b52d3cade 2021-03-10T13:51:01.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:51:01.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:51:01.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:51:01.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:51:01.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (5m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:51:01.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (5m) 0s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:51:01.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (5m) 0s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:51:01.355 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (4m) 0s ago 4m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:51:01.356 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e766fb56aa27 2021-03-10T13:51:01.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:01 gibba043 bash[9839]: cluster 2021-03-10T13:51:00.067000+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:01.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:01 gibba043 bash[9839]: audit 2021-03-10T13:51:00.397263+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392758\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:00.394109\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:01.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:01 gibba043 bash[9839]: audit 2021-03-10T13:51:00.406211+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392758\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:00.394109\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:01.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:01 gibba043 bash[9839]: audit 2021-03-10T13:51:00.408467+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[9769]: cluster 2021-03-10T13:51:00.067000+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[12956]: cluster 2021-03-10T13:51:00.067000+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[9769]: audit 2021-03-10T13:51:00.397263+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392758\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:00.394109\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[9769]: audit 2021-03-10T13:51:00.406211+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392758\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:00.394109\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[9769]: audit 2021-03-10T13:51:00.408467+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[12956]: audit 2021-03-10T13:51:00.397263+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392758\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:00.394109\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[12956]: audit 2021-03-10T13:51:00.406211+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"4d22dd216835\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392758\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:42:50.155536\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:47.645534\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:00.394109\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:01 gibba003 bash[12956]: audit 2021-03-10T13:51:00.408467+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:01.576 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:51:01.576 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:51:01.576 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:51:01.576 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:51:01.577 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:51:01.577 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:51:01.577 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:51:01.577 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:51:01.577 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:51:01.578 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:51:01.578 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:51:01.578 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:51:01.578 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T13:51:01.578 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:51:01.579 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:51:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[9769]: cephadm 2021-03-10T13:51:00.408278+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:51:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[9769]: cephadm 2021-03-10T13:51:00.409482+0000 mgr.y (mgr.14140) 349 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:51:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[9769]: cephadm 2021-03-10T13:51:00.409546+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:51:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[9769]: audit 2021-03-10T13:51:01.153293+0000 mgr.y (mgr.14140) 351 : audit [DBG] from='client.14643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[9769]: audit 2021-03-10T13:51:01.575225+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.103:0/2257528166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[12956]: cephadm 2021-03-10T13:51:00.408278+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:51:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[12956]: cephadm 2021-03-10T13:51:00.409482+0000 mgr.y (mgr.14140) 349 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:51:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[12956]: cephadm 2021-03-10T13:51:00.409546+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:51:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[12956]: audit 2021-03-10T13:51:01.153293+0000 mgr.y (mgr.14140) 351 : audit [DBG] from='client.14643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:02 gibba003 bash[12956]: audit 2021-03-10T13:51:01.575225+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.103:0/2257528166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:02 gibba043 bash[9839]: cephadm 2021-03-10T13:51:00.408278+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:51:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:02 gibba043 bash[9839]: cephadm 2021-03-10T13:51:00.409482+0000 mgr.y (mgr.14140) 349 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:51:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:02 gibba043 bash[9839]: cephadm 2021-03-10T13:51:00.409546+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:51:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:02 gibba043 bash[9839]: audit 2021-03-10T13:51:01.153293+0000 mgr.y (mgr.14140) 351 : audit [DBG] from='client.14643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:02 gibba043 bash[9839]: audit 2021-03-10T13:51:01.575225+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.103:0/2257528166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:03 gibba003 bash[9769]: audit 2021-03-10T13:51:01.347300+0000 mgr.y (mgr.14140) 352 : audit [DBG] from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:03 gibba003 bash[9769]: cluster 2021-03-10T13:51:02.067450+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:03 gibba003 bash[12956]: audit 2021-03-10T13:51:01.347300+0000 mgr.y (mgr.14140) 352 : audit [DBG] from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:03 gibba003 bash[12956]: cluster 2021-03-10T13:51:02.067450+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:03.458 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:03 gibba043 bash[9839]: audit 2021-03-10T13:51:01.347300+0000 mgr.y (mgr.14140) 352 : audit [DBG] from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:03.459 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:03 gibba043 bash[9839]: cluster 2021-03-10T13:51:02.067450+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[9769]: audit 2021-03-10T13:51:04.054530+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[9769]: audit 2021-03-10T13:51:04.064018+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba043.dnkmem"}]': finished 2021-03-10T13:51:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[9769]: audit 2021-03-10T13:51:04.065477+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[9769]: audit 2021-03-10T13:51:04.067642+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[9769]: audit 2021-03-10T13:51:04.068631+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba043.dnkmem", "key": "container_image"}]: dispatch 2021-03-10T13:51:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[12956]: audit 2021-03-10T13:51:04.054530+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[12956]: audit 2021-03-10T13:51:04.064018+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba043.dnkmem"}]': finished 2021-03-10T13:51:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[12956]: audit 2021-03-10T13:51:04.065477+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[12956]: audit 2021-03-10T13:51:04.067642+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:04 gibba003 bash[12956]: audit 2021-03-10T13:51:04.068631+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba043.dnkmem", "key": "container_image"}]: dispatch 2021-03-10T13:51:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:04 gibba043 bash[9839]: audit 2021-03-10T13:51:04.054530+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:04.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:04 gibba043 bash[9839]: audit 2021-03-10T13:51:04.064018+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba043.dnkmem"}]': finished 2021-03-10T13:51:04.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:04 gibba043 bash[9839]: audit 2021-03-10T13:51:04.065477+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:04.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:04 gibba043 bash[9839]: audit 2021-03-10T13:51:04.067642+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:04.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:04 gibba043 bash[9839]: audit 2021-03-10T13:51:04.068631+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba043.dnkmem", "key": "container_image"}]: dispatch 2021-03-10T13:51:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: cephadm 2021-03-10T13:51:04.053406+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba043.dnkmem 2021-03-10T13:51:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: cephadm 2021-03-10T13:51:04.053626+0000 mgr.y (mgr.14140) 355 : cephadm [INF] Upgrade: Redeploying mgr.gibba043.dnkmem 2021-03-10T13:51:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: cluster 2021-03-10T13:51:04.067907+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: cephadm 2021-03-10T13:51:04.068386+0000 mgr.y (mgr.14140) 357 : cephadm [INF] Deploying daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:51:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: audit 2021-03-10T13:51:04.221829+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.2.143:0/1882381' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: cluster 2021-03-10T13:51:04.222424+0000 mon.a (mon.0) 631 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:51:05.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: cluster 2021-03-10T13:51:04.222682+0000 mon.a (mon.0) 632 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:51:05.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[9769]: audit 2021-03-10T13:51:04.222701+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.143:0/1882381' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: cephadm 2021-03-10T13:51:04.053406+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba043.dnkmem 2021-03-10T13:51:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: cephadm 2021-03-10T13:51:04.053626+0000 mgr.y (mgr.14140) 355 : cephadm [INF] Upgrade: Redeploying mgr.gibba043.dnkmem 2021-03-10T13:51:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: cluster 2021-03-10T13:51:04.067907+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: cephadm 2021-03-10T13:51:04.068386+0000 mgr.y (mgr.14140) 357 : cephadm [INF] Deploying daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:51:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: audit 2021-03-10T13:51:04.221829+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.2.143:0/1882381' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: cluster 2021-03-10T13:51:04.222424+0000 mon.a (mon.0) 631 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:51:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: cluster 2021-03-10T13:51:04.222682+0000 mon.a (mon.0) 632 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:51:05.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:05 gibba003 bash[12956]: audit 2021-03-10T13:51:04.222701+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.143:0/1882381' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:05.508 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: cephadm 2021-03-10T13:51:04.053406+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba043.dnkmem 2021-03-10T13:51:05.508 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: cephadm 2021-03-10T13:51:04.053626+0000 mgr.y (mgr.14140) 355 : cephadm [INF] Upgrade: Redeploying mgr.gibba043.dnkmem 2021-03-10T13:51:05.508 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: cluster 2021-03-10T13:51:04.067907+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:05.508 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: cephadm 2021-03-10T13:51:04.068386+0000 mgr.y (mgr.14140) 357 : cephadm [INF] Deploying daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:51:05.508 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: audit 2021-03-10T13:51:04.221829+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.2.143:0/1882381' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:05.509 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: cluster 2021-03-10T13:51:04.222424+0000 mon.a (mon.0) 631 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:51:05.509 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: cluster 2021-03-10T13:51:04.222682+0000 mon.a (mon.0) 632 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:51:05.509 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:05 gibba043 bash[9839]: audit 2021-03-10T13:51:04.222701+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.143:0/1882381' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:06 gibba043 bash[9839]: cluster 2021-03-10T13:51:05.126176+0000 mon.a (mon.0) 633 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba043.dnkmem, x 2021-03-10T13:51:06.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:06 gibba003 bash[9769]: cluster 2021-03-10T13:51:05.126176+0000 mon.a (mon.0) 633 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba043.dnkmem, x 2021-03-10T13:51:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:06 gibba003 bash[12956]: cluster 2021-03-10T13:51:05.126176+0000 mon.a (mon.0) 633 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba043.dnkmem, x 2021-03-10T13:51:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:07 gibba003 bash[9769]: cluster 2021-03-10T13:51:06.069211+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:07 gibba003 bash[12956]: cluster 2021-03-10T13:51:06.069211+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:07.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:07 gibba043 bash[9839]: cluster 2021-03-10T13:51:06.069211+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:09 gibba003 bash[9769]: cluster 2021-03-10T13:51:08.070745+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:09 gibba003 bash[12956]: cluster 2021-03-10T13:51:08.070745+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:09 gibba043 bash[9839]: cluster 2021-03-10T13:51:08.070745+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:11 gibba003 bash[9769]: cluster 2021-03-10T13:51:10.072042+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:11 gibba003 bash[12956]: cluster 2021-03-10T13:51:10.072042+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:11.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:11 gibba043 bash[9839]: cluster 2021-03-10T13:51:10.072042+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:13 gibba003 bash[9769]: cluster 2021-03-10T13:51:12.072918+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:13 gibba003 bash[12956]: cluster 2021-03-10T13:51:12.072918+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:13 gibba043 bash[9839]: cluster 2021-03-10T13:51:12.072918+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:15 gibba003 bash[9769]: cluster 2021-03-10T13:51:14.073952+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:15 gibba003 bash[12956]: cluster 2021-03-10T13:51:14.073952+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:15 gibba043 bash[9839]: cluster 2021-03-10T13:51:14.073952+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:17 gibba043 bash[9839]: cluster 2021-03-10T13:51:16.075509+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:17 gibba003 bash[9769]: cluster 2021-03-10T13:51:16.075509+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:17 gibba003 bash[12956]: cluster 2021-03-10T13:51:16.075509+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:18 gibba003 bash[9769]: audit 2021-03-10T13:51:17.115106+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:18 gibba003 bash[12956]: audit 2021-03-10T13:51:17.115106+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:18.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:18 gibba003 bash[12956]: audit 2021-03-10T13:51:17.124490+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:18.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:18 gibba003 bash[12956]: audit 2021-03-10T13:51:17.126196+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:51:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:18 gibba003 bash[9769]: audit 2021-03-10T13:51:17.124490+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:18.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:18 gibba003 bash[9769]: audit 2021-03-10T13:51:17.126196+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:51:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:18 gibba043 bash[9839]: audit 2021-03-10T13:51:17.115106+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:18 gibba043 bash[9839]: audit 2021-03-10T13:51:17.124490+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392385\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392654\", \"created\": \"2021-03-10T13:42:47.615453\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.392917\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393067\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393214\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393361\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393505\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393649\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:00.393793\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:18 gibba043 bash[9839]: audit 2021-03-10T13:51:17.126196+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:51:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[9769]: cluster 2021-03-10T13:51:18.076729+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[12956]: cluster 2021-03-10T13:51:18.076729+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[9769]: audit 2021-03-10T13:51:18.732173+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727218\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727487\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:50:59.332208\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727653\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:51:17.124371\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727807\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727955\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728101\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728247\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728392\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728538\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728684\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:18.729008\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[12956]: audit 2021-03-10T13:51:18.732173+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727218\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727487\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:50:59.332208\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727653\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:51:17.124371\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727807\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727955\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728101\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728247\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728392\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728538\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728684\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:18.729008\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:19.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[9769]: audit 2021-03-10T13:51:18.740875+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727218\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727487\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:50:59.332208\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727653\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:51:17.124371\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727807\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727955\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728101\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728247\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728392\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728538\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728684\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:18.729008\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:19.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[9769]: audit 2021-03-10T13:51:18.742503+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:19.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[9769]: audit 2021-03-10T13:51:18.745444+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:51:19.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[9769]: cluster 2021-03-10T13:51:18.748308+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-03-10T13:51:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[12956]: audit 2021-03-10T13:51:18.740875+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727218\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727487\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:50:59.332208\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727653\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:51:17.124371\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727807\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727955\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728101\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728247\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728392\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728538\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728684\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:18.729008\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[12956]: audit 2021-03-10T13:51:18.742503+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[12956]: audit 2021-03-10T13:51:18.745444+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:51:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[12956]: cluster 2021-03-10T13:51:18.748308+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-03-10T13:51:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:19 gibba043 bash[9839]: cluster 2021-03-10T13:51:18.076729+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:19 gibba043 bash[9839]: audit 2021-03-10T13:51:18.732173+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727218\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727487\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:50:59.332208\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727653\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:51:17.124371\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727807\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727955\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728101\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728247\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728392\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728538\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728684\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:18.729008\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]: dispatch 2021-03-10T13:51:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:19 gibba043 bash[9839]: audit 2021-03-10T13:51:18.740875+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727218\", \"created\": \"2021-03-10T13:42:30.851453\", \"started\": \"2021-03-10T13:42:30.874714\"}, \"mgr.x\": {\"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727487\", \"created\": \"2021-03-10T13:42:47.615453\", \"started\": \"2021-03-10T13:50:59.332208\"}, \"mgr.gibba043.dnkmem\": {\"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba043.dnkmem\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727653\", \"created\": \"2021-03-10T13:42:50.131453\", \"started\": \"2021-03-10T13:51:17.124371\"}, \"osd.4\": {\"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727807\", \"created\": \"2021-03-10T13:44:34.990842\", \"started\": \"2021-03-10T13:44:38.140721\"}, \"osd.5\": {\"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.727955\", \"created\": \"2021-03-10T13:44:57.874841\", \"started\": \"2021-03-10T13:45:01.533976\"}, \"osd.6\": {\"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728101\", \"created\": \"2021-03-10T13:45:20.878841\", \"started\": \"2021-03-10T13:45:24.157626\"}, \"osd.7\": {\"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728247\", \"created\": \"2021-03-10T13:45:45.010840\", \"started\": \"2021-03-10T13:45:49.095912\"}, \"prometheus.a\": {\"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728392\", \"created\": \"2021-03-10T13:46:07.734839\", \"started\": \"2021-03-10T13:46:47.666765\"}, \"node-exporter.b\": {\"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728538\", \"created\": \"2021-03-10T13:46:08.970839\", \"started\": \"2021-03-10T13:46:10.554442\"}, \"grafana.a\": {\"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:51:18.728684\", \"created\": \"2021-03-10T13:46:32.302839\", \"started\": \"2021-03-10T13:46:32.326196\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215\"}}, \"last_daemon_update\": \"2021-03-10T13:51:18.729008\", \"last_device_update\": \"2021-03-10T13:45:53.315291\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157\"}"}]': finished 2021-03-10T13:51:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:19 gibba043 bash[9839]: audit 2021-03-10T13:51:18.742503+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:19 gibba043 bash[9839]: audit 2021-03-10T13:51:18.745444+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:51:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:19 gibba043 bash[9839]: cluster 2021-03-10T13:51:18.748308+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-03-10T13:51:20.130 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[10000]: debug 2021-03-10T13:51:19.741+0000 7fe9d91ee700 -1 mgr handle_mgr_map I was active but no longer am 2021-03-10T13:51:20.131 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[10000]: ignoring --setuser ceph since I am not root 2021-03-10T13:51:20.131 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:19 gibba003 bash[10000]: ignoring --setgroup ceph since I am not root 2021-03-10T13:51:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[9769]: cephadm 2021-03-10T13:51:18.742349+0000 mgr.y (mgr.14140) 365 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:51:20.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[9769]: cephadm 2021-03-10T13:51:18.743284+0000 mgr.y (mgr.14140) 366 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:51:20.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[9769]: cephadm 2021-03-10T13:51:18.743485+0000 mgr.y (mgr.14140) 367 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:51:20.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[9769]: cephadm 2021-03-10T13:51:18.745040+0000 mgr.y (mgr.14140) 368 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:51:20.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[9769]: audit 2021-03-10T13:51:19.748045+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:51:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[9769]: cluster 2021-03-10T13:51:19.748094+0000 mon.a (mon.0) 643 : cluster [DBG] mgrmap e17: gibba043.dnkmem(active, starting, since 1.00222s), standbys: x 2021-03-10T13:51:20.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[12956]: cephadm 2021-03-10T13:51:18.742349+0000 mgr.y (mgr.14140) 365 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:51:20.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[12956]: cephadm 2021-03-10T13:51:18.743284+0000 mgr.y (mgr.14140) 366 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:51:20.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[12956]: cephadm 2021-03-10T13:51:18.743485+0000 mgr.y (mgr.14140) 367 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:51:20.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[12956]: cephadm 2021-03-10T13:51:18.745040+0000 mgr.y (mgr.14140) 368 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:51:20.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[12956]: audit 2021-03-10T13:51:19.748045+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:51:20.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:20 gibba003 bash[12956]: cluster 2021-03-10T13:51:19.748094+0000 mon.a (mon.0) 643 : cluster [DBG] mgrmap e17: gibba043.dnkmem(active, starting, since 1.00222s), standbys: x 2021-03-10T13:51:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:20 gibba043 bash[9839]: cephadm 2021-03-10T13:51:18.742349+0000 mgr.y (mgr.14140) 365 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:51:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:20 gibba043 bash[9839]: cephadm 2021-03-10T13:51:18.743284+0000 mgr.y (mgr.14140) 366 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:51:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:20 gibba043 bash[9839]: cephadm 2021-03-10T13:51:18.743485+0000 mgr.y (mgr.14140) 367 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:51:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:20 gibba043 bash[9839]: cephadm 2021-03-10T13:51:18.745040+0000 mgr.y (mgr.14140) 368 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:51:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:20 gibba043 bash[9839]: audit 2021-03-10T13:51:19.748045+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14140 172.21.2.103:0/1517741003' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:51:20.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:20 gibba043 bash[9839]: cluster 2021-03-10T13:51:19.748094+0000 mon.a (mon.0) 643 : cluster [DBG] mgrmap e17: gibba043.dnkmem(active, starting, since 1.00222s), standbys: x 2021-03-10T13:51:22.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[9769]: cluster 2021-03-10T13:51:22.012843+0000 mon.a (mon.0) 644 : cluster [INF] Active manager daemon gibba043.dnkmem restarted 2021-03-10T13:51:22.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[9769]: cluster 2021-03-10T13:51:22.013650+0000 mon.a (mon.0) 645 : cluster [INF] Activating manager daemon gibba043.dnkmem 2021-03-10T13:51:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[9769]: audit 2021-03-10T13:51:22.014069+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[9769]: audit 2021-03-10T13:51:22.015097+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[9769]: cluster 2021-03-10T13:51:22.016819+0000 mon.a (mon.0) 646 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T13:51:22.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[12956]: cluster 2021-03-10T13:51:22.012843+0000 mon.a (mon.0) 644 : cluster [INF] Active manager daemon gibba043.dnkmem restarted 2021-03-10T13:51:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[12956]: cluster 2021-03-10T13:51:22.013650+0000 mon.a (mon.0) 645 : cluster [INF] Activating manager daemon gibba043.dnkmem 2021-03-10T13:51:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[12956]: audit 2021-03-10T13:51:22.014069+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[12956]: audit 2021-03-10T13:51:22.015097+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:22 gibba003 bash[12956]: cluster 2021-03-10T13:51:22.016819+0000 mon.a (mon.0) 646 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T13:51:22.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:22 gibba043 bash[9839]: cluster 2021-03-10T13:51:22.012843+0000 mon.a (mon.0) 644 : cluster [INF] Active manager daemon gibba043.dnkmem restarted 2021-03-10T13:51:22.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:22 gibba043 bash[9839]: cluster 2021-03-10T13:51:22.013650+0000 mon.a (mon.0) 645 : cluster [INF] Activating manager daemon gibba043.dnkmem 2021-03-10T13:51:22.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:22 gibba043 bash[9839]: audit 2021-03-10T13:51:22.014069+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:22 gibba043 bash[9839]: audit 2021-03-10T13:51:22.015097+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:22 gibba043 bash[9839]: cluster 2021-03-10T13:51:22.016819+0000 mon.a (mon.0) 646 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T13:51:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: cluster 2021-03-10T13:51:22.069521+0000 mon.a (mon.0) 647 : cluster [DBG] mgrmap e18: gibba043.dnkmem(active, starting, since 0.0560436s), standbys: x 2021-03-10T13:51:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.075214+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.075420+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:51:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.075614+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:51:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.075818+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:51:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.076006+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:51:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.076231+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:51:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.076440+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:51:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.076654+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:51:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.076860+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:51:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.077073+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:51:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.077305+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:51:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.077469+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:51:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.077906+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:51:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.078586+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:51:23.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.079387+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:51:23.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.079736+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:51:23.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: cluster 2021-03-10T13:51:22.069521+0000 mon.a (mon.0) 647 : cluster [DBG] mgrmap e18: gibba043.dnkmem(active, starting, since 0.0560436s), standbys: x 2021-03-10T13:51:23.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.075214+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.075420+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:51:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.075614+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:51:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.075818+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:51:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.076006+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:51:23.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.076231+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:51:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.076440+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:51:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.076654+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:51:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.076860+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:51:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.077073+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:51:23.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.077305+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:51:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.077469+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:51:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.077906+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:51:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.078586+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:51:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.079387+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:51:23.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.079736+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:51:23.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.080156+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:51:23.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.080583+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba043"}]: dispatch 2021-03-10T13:51:23.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.080963+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:51:23.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.081320+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:51:23.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.081664+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:51:23.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.081997+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:51:23.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.082304+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:51:23.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.082585+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:51:23.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.082908+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:51:23.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.083236+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:51:23.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.083544+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:51:23.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.083908+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:51:23.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.084319+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:51:23.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.084648+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:23.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.084895+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:23.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.085138+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:51:23.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.085361+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:51:23.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.085573+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:51:23.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.085790+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:51:23.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: cluster 2021-03-10T13:51:22.564093+0000 mon.a (mon.0) 648 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:51:23.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.564881+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.? 172.21.2.103:0/605698513' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:23.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:22.565737+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.? 172.21.2.103:0/605698513' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:23.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: cluster 2021-03-10T13:51:23.052312+0000 mon.a (mon.0) 651 : cluster [INF] Manager daemon gibba043.dnkmem is now available 2021-03-10T13:51:23.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:23.059319+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:23.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:23.059797+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:23.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[9769]: audit 2021-03-10T13:51:23.069237+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:23.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.080156+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:51:23.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.080583+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba043"}]: dispatch 2021-03-10T13:51:23.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.080963+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:51:23.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.081320+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:51:23.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.081664+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:51:23.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.081997+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:51:23.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.082304+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:51:23.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.082585+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:51:23.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.082908+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:51:23.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.083236+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:51:23.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.083544+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:51:23.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.083908+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:51:23.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.084319+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:51:23.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.084648+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:23.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.084895+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:23.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.085138+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:51:23.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.085361+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:51:23.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.085573+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:51:23.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.085790+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:51:23.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: cluster 2021-03-10T13:51:22.564093+0000 mon.a (mon.0) 648 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:51:23.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.564881+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.? 172.21.2.103:0/605698513' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:23.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:22.565737+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.? 172.21.2.103:0/605698513' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:23.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: cluster 2021-03-10T13:51:23.052312+0000 mon.a (mon.0) 651 : cluster [INF] Manager daemon gibba043.dnkmem is now available 2021-03-10T13:51:23.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:23.059319+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:23.460 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:23.059797+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:23.460 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:23 gibba003 bash[12956]: audit 2021-03-10T13:51:23.069237+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:23.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: cluster 2021-03-10T13:51:22.069521+0000 mon.a (mon.0) 647 : cluster [DBG] mgrmap e18: gibba043.dnkmem(active, starting, since 0.0560436s), standbys: x 2021-03-10T13:51:23.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.075214+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:51:23.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.075420+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:51:23.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.075614+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:51:23.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.075818+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:51:23.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.076006+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:51:23.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.076231+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:51:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.076440+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:51:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.076654+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:51:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.076860+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:51:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.077073+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:51:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.077305+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:51:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.077469+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:51:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.077906+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:51:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.078586+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:51:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.079387+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:51:23.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.079736+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:51:23.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.080156+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:51:23.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.080583+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba043"}]: dispatch 2021-03-10T13:51:23.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.080963+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:51:23.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.081320+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:51:23.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.081664+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:51:23.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.081997+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:51:23.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.082304+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:51:23.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.082585+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:51:23.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.082908+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:51:23.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.083236+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:51:23.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.083544+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:51:23.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.083908+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:51:23.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.084319+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:51:23.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.084648+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:23.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.084895+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:23.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.085138+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:51:23.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.085361+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:51:23.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.085573+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:51:23.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.085790+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:51:23.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: cluster 2021-03-10T13:51:22.564093+0000 mon.a (mon.0) 648 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:51:23.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.564881+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.? 172.21.2.103:0/605698513' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:51:23.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:22.565737+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.? 172.21.2.103:0/605698513' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:51:23.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: cluster 2021-03-10T13:51:23.052312+0000 mon.a (mon.0) 651 : cluster [INF] Manager daemon gibba043.dnkmem is now available 2021-03-10T13:51:23.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:23.059319+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:23.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:23.059797+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:23.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:23 gibba043 bash[9839]: audit 2021-03-10T13:51:23.069237+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: cephadm 2021-03-10T13:51:23.071598+0000 mgr.gibba043.dnkmem (mgr.34337) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:51:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.071902+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:51:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.072620+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:51:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.081711+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:51:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: cluster 2021-03-10T13:51:23.082035+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e19: gibba043.dnkmem(active, since 1.06856s), standbys: y, x 2021-03-10T13:51:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.085198+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:51:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.085817+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.086178+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: cluster 2021-03-10T13:51:23.087094+0000 mgr.gibba043.dnkmem (mgr.34337) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.088819+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.091590+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.091912+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.094618+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.188602+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: cephadm 2021-03-10T13:51:23.071598+0000 mgr.gibba043.dnkmem (mgr.34337) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:51:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.071902+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:51:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.072620+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:51:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.081711+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:51:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: cluster 2021-03-10T13:51:23.082035+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e19: gibba043.dnkmem(active, since 1.06856s), standbys: y, x 2021-03-10T13:51:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.085198+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:51:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.085817+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.086178+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: cluster 2021-03-10T13:51:23.087094+0000 mgr.gibba043.dnkmem (mgr.34337) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.088819+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.091590+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.091912+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.094618+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.188602+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:24.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.189186+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:24.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.197047+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:24.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.197443+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.324146+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: audit 2021-03-10T13:51:23.396825+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[9769]: debug 2021-03-10T13:51:24.085+0000 7fdabcb7a700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:51:24.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.189186+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.197047+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.197443+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.324146+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:24 gibba003 bash[12956]: audit 2021-03-10T13:51:23.396825+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: cephadm 2021-03-10T13:51:23.071598+0000 mgr.gibba043.dnkmem (mgr.34337) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:51:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.071902+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:51:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.072620+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:51:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.081711+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:51:23.071607Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba003=y\", \"gibba043=x\", \"gibba043=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:51:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: cluster 2021-03-10T13:51:23.082035+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e19: gibba043.dnkmem(active, since 1.06856s), standbys: y, x 2021-03-10T13:51:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.085198+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:51:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.085817+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.086178+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: cluster 2021-03-10T13:51:23.087094+0000 mgr.gibba043.dnkmem (mgr.34337) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.088819+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.091590+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.091912+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:51:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.094618+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:51:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.188602+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.189186+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.197047+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.197443+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.324146+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:24 gibba043 bash[9839]: audit 2021-03-10T13:51:23.396825+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:25 gibba003 bash[9769]: cluster 2021-03-10T13:51:24.075971+0000 mgr.gibba043.dnkmem (mgr.34337) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:25 gibba003 bash[9769]: cluster 2021-03-10T13:51:24.087642+0000 mon.a (mon.0) 663 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:51:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:25 gibba003 bash[9769]: cluster 2021-03-10T13:51:24.097047+0000 mon.a (mon.0) 664 : cluster [DBG] mgrmap e20: gibba043.dnkmem(active, since 2s), standbys: y, x 2021-03-10T13:51:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:25 gibba003 bash[12956]: cluster 2021-03-10T13:51:24.075971+0000 mgr.gibba043.dnkmem (mgr.34337) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:25 gibba003 bash[12956]: cluster 2021-03-10T13:51:24.087642+0000 mon.a (mon.0) 663 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:51:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:25 gibba003 bash[12956]: cluster 2021-03-10T13:51:24.097047+0000 mon.a (mon.0) 664 : cluster [DBG] mgrmap e20: gibba043.dnkmem(active, since 2s), standbys: y, x 2021-03-10T13:51:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:25 gibba043 bash[9839]: cluster 2021-03-10T13:51:24.075971+0000 mgr.gibba043.dnkmem (mgr.34337) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:25.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:25 gibba043 bash[9839]: cluster 2021-03-10T13:51:24.087642+0000 mon.a (mon.0) 663 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:51:25.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:25 gibba043 bash[9839]: cluster 2021-03-10T13:51:24.097047+0000 mon.a (mon.0) 664 : cluster [DBG] mgrmap e20: gibba043.dnkmem(active, since 2s), standbys: y, x 2021-03-10T13:51:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:26 gibba003 bash[9769]: cluster 2021-03-10T13:51:24.331160+0000 mgr.gibba043.dnkmem (mgr.34337) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:51:26.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:26 gibba003 bash[12956]: cluster 2021-03-10T13:51:24.331160+0000 mgr.gibba043.dnkmem (mgr.34337) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:51:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:26 gibba043 bash[9839]: cluster 2021-03-10T13:51:24.331160+0000 mgr.gibba043.dnkmem (mgr.34337) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:51:27.410 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:27 gibba003 bash[9769]: cluster 2021-03-10T13:51:26.076973+0000 mgr.gibba043.dnkmem (mgr.34337) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:27.410 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:27 gibba003 bash[12956]: cluster 2021-03-10T13:51:26.076973+0000 mgr.gibba043.dnkmem (mgr.34337) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:27 gibba043 bash[9839]: cluster 2021-03-10T13:51:26.076973+0000 mgr.gibba043.dnkmem (mgr.34337) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:28.117 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.194279+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.118 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.194279+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.118 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.194550+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.119 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.194550+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.120 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.198346+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:28.120 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.198346+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:28.121 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.431079+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.121 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.431079+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.122 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.431148+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.123 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.434616+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:28.123 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.675970+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:51:28.123 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.678458+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:51:28.123 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.687512+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:51:28.124 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.691293+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:28.124 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.692275+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:28.124 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.693258+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:28.124 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[12956]: audit 2021-03-10T13:51:27.694339+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:51:28.125 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.431148+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.125 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.434616+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:28.125 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.675970+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:51:28.126 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.678458+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:51:28.126 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.687512+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:51:28.126 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.691293+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:28.127 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.692275+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:28.127 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.693258+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:28.127 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:28 gibba003 bash[9769]: audit 2021-03-10T13:51:27.694339+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:51:28.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.194279+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.194550+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.198346+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.431079+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.431148+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.434616+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:27.193342Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.675970+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:51:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.678458+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:51:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.687512+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:51:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.691293+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.692275+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.693258+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:28 gibba043 bash[9839]: audit 2021-03-10T13:51:27.694339+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:51:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[9769]: cephadm 2021-03-10T13:51:27.200186+0000 mgr.gibba043.dnkmem (mgr.34337) 7 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:51:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[9769]: cephadm 2021-03-10T13:51:27.436352+0000 mgr.gibba043.dnkmem (mgr.34337) 8 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:51:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[9769]: cluster 2021-03-10T13:51:27.675552+0000 mgr.gibba043.dnkmem (mgr.34337) 9 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[9769]: cephadm 2021-03-10T13:51:27.691014+0000 mgr.gibba043.dnkmem (mgr.34337) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:51:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[9769]: cephadm 2021-03-10T13:51:27.693990+0000 mgr.gibba043.dnkmem (mgr.34337) 11 : cephadm [INF] Reconfiguring daemon mon.a on gibba003 2021-03-10T13:51:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[9769]: cluster 2021-03-10T13:51:28.433421+0000 mon.a (mon.0) 671 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:51:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[12956]: cephadm 2021-03-10T13:51:27.200186+0000 mgr.gibba043.dnkmem (mgr.34337) 7 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:51:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[12956]: cephadm 2021-03-10T13:51:27.436352+0000 mgr.gibba043.dnkmem (mgr.34337) 8 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:51:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[12956]: cluster 2021-03-10T13:51:27.675552+0000 mgr.gibba043.dnkmem (mgr.34337) 9 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[12956]: cephadm 2021-03-10T13:51:27.691014+0000 mgr.gibba043.dnkmem (mgr.34337) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:51:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[12956]: cephadm 2021-03-10T13:51:27.693990+0000 mgr.gibba043.dnkmem (mgr.34337) 11 : cephadm [INF] Reconfiguring daemon mon.a on gibba003 2021-03-10T13:51:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:29 gibba003 bash[12956]: cluster 2021-03-10T13:51:28.433421+0000 mon.a (mon.0) 671 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:51:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:29 gibba043 bash[9839]: cephadm 2021-03-10T13:51:27.200186+0000 mgr.gibba043.dnkmem (mgr.34337) 7 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:51:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:29 gibba043 bash[9839]: cephadm 2021-03-10T13:51:27.436352+0000 mgr.gibba043.dnkmem (mgr.34337) 8 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:51:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:29 gibba043 bash[9839]: cluster 2021-03-10T13:51:27.675552+0000 mgr.gibba043.dnkmem (mgr.34337) 9 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:29 gibba043 bash[9839]: cephadm 2021-03-10T13:51:27.691014+0000 mgr.gibba043.dnkmem (mgr.34337) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:51:29.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:29 gibba043 bash[9839]: cephadm 2021-03-10T13:51:27.693990+0000 mgr.gibba043.dnkmem (mgr.34337) 11 : cephadm [INF] Reconfiguring daemon mon.a on gibba003 2021-03-10T13:51:29.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:29 gibba043 bash[9839]: cluster 2021-03-10T13:51:28.433421+0000 mon.a (mon.0) 671 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:51:30.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.445351+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:30.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.445351+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:30.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.446126+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:30.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.446126+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:30.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.451606+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:30.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.460834+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:30.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.463732+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:30.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.466639+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:30.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[9769]: audit 2021-03-10T13:51:29.470513+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:51:30.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.451606+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:30.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.460834+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:30.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.463732+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:30.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.466639+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:30.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:30 gibba003 bash[12956]: audit 2021-03-10T13:51:29.470513+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:51:30.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.445351+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:30.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.446126+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.451606+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:14.577958Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.460834+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.463732+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.466639+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:30.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:30 gibba043 bash[9839]: audit 2021-03-10T13:51:29.470513+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:51:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:31 gibba003 bash[9769]: cephadm 2021-03-10T13:51:29.459942+0000 mgr.gibba043.dnkmem (mgr.34337) 12 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:51:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:31 gibba003 bash[9769]: cephadm 2021-03-10T13:51:29.469151+0000 mgr.gibba043.dnkmem (mgr.34337) 13 : cephadm [INF] Reconfiguring daemon mon.c on gibba003 2021-03-10T13:51:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:31 gibba003 bash[9769]: cluster 2021-03-10T13:51:29.677272+0000 mgr.gibba043.dnkmem (mgr.34337) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:31 gibba003 bash[12956]: cephadm 2021-03-10T13:51:29.459942+0000 mgr.gibba043.dnkmem (mgr.34337) 12 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:51:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:31 gibba003 bash[12956]: cephadm 2021-03-10T13:51:29.469151+0000 mgr.gibba043.dnkmem (mgr.34337) 13 : cephadm [INF] Reconfiguring daemon mon.c on gibba003 2021-03-10T13:51:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:31 gibba003 bash[12956]: cluster 2021-03-10T13:51:29.677272+0000 mgr.gibba043.dnkmem (mgr.34337) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:31 gibba043 bash[9839]: cephadm 2021-03-10T13:51:29.459942+0000 mgr.gibba043.dnkmem (mgr.34337) 12 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:51:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:31 gibba043 bash[9839]: cephadm 2021-03-10T13:51:29.469151+0000 mgr.gibba043.dnkmem (mgr.34337) 13 : cephadm [INF] Reconfiguring daemon mon.c on gibba003 2021-03-10T13:51:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:31 gibba043 bash[9839]: cluster 2021-03-10T13:51:29.677272+0000 mgr.gibba043.dnkmem (mgr.34337) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:31.859 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:51:32.086 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:51:32.087 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (4m) 4s ago 5m 0.21.0 prom/alertmanager c876f5897d7b ef09171c6190 2021-03-10T13:51:32.087 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (4m) 4s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:51:32.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (14s) 4s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:51:32.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (32s) 4s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:51:32.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (10m) 4s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b8fc1368daa1 2021-03-10T13:51:32.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (10m) 4s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8bc1091ccae9 2021-03-10T13:51:32.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (9m) 4s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0560a63542e 2021-03-10T13:51:32.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (9m) 4s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 be39d003f3cf 2021-03-10T13:51:32.088 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (5m) 4s ago 5m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:51:32.088 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (5m) 4s ago 5m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:51:32.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (8m) 4s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8f0b52d3cade 2021-03-10T13:51:32.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (7m) 4s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:51:32.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (7m) 4s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:51:32.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (7m) 4s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:51:32.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (6m) 4s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:51:32.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (6m) 4s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:51:32.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (6m) 4s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:51:32.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (5m) 4s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:51:32.090 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (4m) 4s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:51:32.090 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:51:32.364 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:51:32.364 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:51:32.364 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:51:32.364 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:51:32.365 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:51:32.365 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:51:32.365 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:51:32.365 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:51:32.365 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:51:32.366 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:51:32.366 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:51:32.366 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:51:32.366 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:51:32.366 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T13:51:32.367 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:51:32.367 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:51:32.367 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:51:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:32 gibba003 bash[9769]: audit 2021-03-10T13:51:31.255468+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:32 gibba003 bash[12956]: audit 2021-03-10T13:51:31.255468+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:32 gibba003 bash[9769]: audit 2021-03-10T13:51:31.256108+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:32.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:32 gibba003 bash[9769]: audit 2021-03-10T13:51:31.260193+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:32.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:32 gibba003 bash[12956]: audit 2021-03-10T13:51:31.256108+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:32.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:32 gibba003 bash[12956]: audit 2021-03-10T13:51:31.260193+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:32 gibba043 bash[9839]: audit 2021-03-10T13:51:31.255468+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:32 gibba043 bash[9839]: audit 2021-03-10T13:51:31.256108+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:32 gibba043 bash[9839]: audit 2021-03-10T13:51:31.260193+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"ef09171c6190\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12970885, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192876Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:46:40.646299Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:46:34.109607Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.193062Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[9769]: cephadm 2021-03-10T13:51:31.266932+0000 mgr.gibba043.dnkmem (mgr.34337) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:51:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[9769]: cephadm 2021-03-10T13:51:31.273291+0000 mgr.gibba043.dnkmem (mgr.34337) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba003 2021-03-10T13:51:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[9769]: cluster 2021-03-10T13:51:31.678458+0000 mgr.gibba043.dnkmem (mgr.34337) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[9769]: audit 2021-03-10T13:51:31.849525+0000 mgr.gibba043.dnkmem (mgr.34337) 18 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[9769]: audit 2021-03-10T13:51:32.075087+0000 mgr.gibba043.dnkmem (mgr.34337) 19 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[9769]: audit 2021-03-10T13:51:32.363730+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.103:0/2613729378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[12956]: cephadm 2021-03-10T13:51:31.266932+0000 mgr.gibba043.dnkmem (mgr.34337) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:51:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[12956]: cephadm 2021-03-10T13:51:31.273291+0000 mgr.gibba043.dnkmem (mgr.34337) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba003 2021-03-10T13:51:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[12956]: cluster 2021-03-10T13:51:31.678458+0000 mgr.gibba043.dnkmem (mgr.34337) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[12956]: audit 2021-03-10T13:51:31.849525+0000 mgr.gibba043.dnkmem (mgr.34337) 18 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[12956]: audit 2021-03-10T13:51:32.075087+0000 mgr.gibba043.dnkmem (mgr.34337) 19 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:33.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:33 gibba003 bash[12956]: audit 2021-03-10T13:51:32.363730+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.103:0/2613729378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:33.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:33 gibba043 bash[9839]: cephadm 2021-03-10T13:51:31.266932+0000 mgr.gibba043.dnkmem (mgr.34337) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:51:33.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:33 gibba043 bash[9839]: cephadm 2021-03-10T13:51:31.273291+0000 mgr.gibba043.dnkmem (mgr.34337) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba003 2021-03-10T13:51:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:33 gibba043 bash[9839]: cluster 2021-03-10T13:51:31.678458+0000 mgr.gibba043.dnkmem (mgr.34337) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:33 gibba043 bash[9839]: audit 2021-03-10T13:51:31.849525+0000 mgr.gibba043.dnkmem (mgr.34337) 18 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:33 gibba043 bash[9839]: audit 2021-03-10T13:51:32.075087+0000 mgr.gibba043.dnkmem (mgr.34337) 19 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:33 gibba043 bash[9839]: audit 2021-03-10T13:51:32.363730+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.103:0/2613729378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:35 gibba003 bash[9769]: cluster 2021-03-10T13:51:33.679536+0000 mgr.gibba043.dnkmem (mgr.34337) 20 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:35.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:35 gibba003 bash[12956]: cluster 2021-03-10T13:51:33.679536+0000 mgr.gibba043.dnkmem (mgr.34337) 20 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:35 gibba043 bash[9839]: cluster 2021-03-10T13:51:33.679536+0000 mgr.gibba043.dnkmem (mgr.34337) 20 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:37.160 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:36 gibba003 systemd[1]: Stopping Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:51:37.161 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:36 gibba003 bash[22533]: level=info ts=2021-03-10T13:51:36.921Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:51:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:37 gibba003 bash[9769]: cluster 2021-03-10T13:51:35.680551+0000 mgr.gibba043.dnkmem (mgr.34337) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:37 gibba003 bash[12956]: cluster 2021-03-10T13:51:35.680551+0000 mgr.gibba043.dnkmem (mgr.34337) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:37 gibba043 bash[9839]: cluster 2021-03-10T13:51:35.680551+0000 mgr.gibba043.dnkmem (mgr.34337) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:37.941 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:37 gibba003 docker[29899]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:51:37.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:37 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T13:51:37.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:37 gibba003 systemd[1]: Stopped Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:51:37.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:37 gibba003 systemd[1]: Starting Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:51:37.943 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:37 gibba003 docker[29931]: Error: No such container: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:51:37.943 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:37 gibba003 systemd[1]: Started Ceph alertmanager.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:51:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.615242+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:38.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.615242+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.615757+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.620149+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.627037+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:38.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.628021+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:38.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.628827+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:38.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[9769]: audit 2021-03-10T13:51:37.629768+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:51:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.615757+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.620149+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.627037+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.628021+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.628827+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[12956]: audit 2021-03-10T13:51:37.629768+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:51:38.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.615242+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.615757+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.620149+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"b8fc1368daa1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 308700774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191907Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:41:09.877098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:50.552698Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.627037+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:51:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.628021+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:51:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.628827+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:38 gibba043 bash[9839]: audit 2021-03-10T13:51:37.629768+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:51:38.941 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.554Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:51:38.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.554Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:51:38.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.555Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.103 port=9094 2021-03-10T13:51:38.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.555Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:51:38.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.569Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:51:38.942 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.569Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:51:38.943 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:38 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:38.572Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:51:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:39 gibba003 bash[9769]: cephadm 2021-03-10T13:51:37.626763+0000 mgr.gibba043.dnkmem (mgr.34337) 22 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:51:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:39 gibba003 bash[9769]: cephadm 2021-03-10T13:51:37.629522+0000 mgr.gibba043.dnkmem (mgr.34337) 23 : cephadm [INF] Reconfiguring daemon mon.b on gibba043 2021-03-10T13:51:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:39 gibba003 bash[9769]: cluster 2021-03-10T13:51:37.680952+0000 mgr.gibba043.dnkmem (mgr.34337) 24 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:39 gibba003 bash[12956]: cephadm 2021-03-10T13:51:37.626763+0000 mgr.gibba043.dnkmem (mgr.34337) 22 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:51:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:39 gibba003 bash[12956]: cephadm 2021-03-10T13:51:37.629522+0000 mgr.gibba043.dnkmem (mgr.34337) 23 : cephadm [INF] Reconfiguring daemon mon.b on gibba043 2021-03-10T13:51:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:39 gibba003 bash[12956]: cluster 2021-03-10T13:51:37.680952+0000 mgr.gibba043.dnkmem (mgr.34337) 24 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:39 gibba043 bash[9839]: cephadm 2021-03-10T13:51:37.626763+0000 mgr.gibba043.dnkmem (mgr.34337) 22 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:51:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:39 gibba043 bash[9839]: cephadm 2021-03-10T13:51:37.629522+0000 mgr.gibba043.dnkmem (mgr.34337) 23 : cephadm [INF] Reconfiguring daemon mon.b on gibba043 2021-03-10T13:51:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:39 gibba043 bash[9839]: cluster 2021-03-10T13:51:37.680952+0000 mgr.gibba043.dnkmem (mgr.34337) 24 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[9769]: audit 2021-03-10T13:51:39.614737+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:40.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[12956]: audit 2021-03-10T13:51:39.614737+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:40.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[9769]: audit 2021-03-10T13:51:39.615716+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:40.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[9769]: audit 2021-03-10T13:51:39.624918+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:40.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[9769]: audit 2021-03-10T13:51:39.629527+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:51:40.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[12956]: audit 2021-03-10T13:51:39.615716+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:40.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[12956]: audit 2021-03-10T13:51:39.624918+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:40.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[12956]: audit 2021-03-10T13:51:39.629527+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:51:40.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:40 gibba043 bash[9839]: audit 2021-03-10T13:51:39.614737+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:40 gibba043 bash[9839]: audit 2021-03-10T13:51:39.615716+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:51:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:40 gibba043 bash[9839]: audit 2021-03-10T13:51:39.624918+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:51:27.429950Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:42:03.497157Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:51:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:40 gibba043 bash[9839]: audit 2021-03-10T13:51:39.629527+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:51:40.941 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:40 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:40.555Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000051986s 2021-03-10T13:51:41.415 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[9769]: audit 2021-03-10T13:51:39.629835+0000 mgr.gibba043.dnkmem (mgr.34337) 25 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:51:41.415 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[9769]: cephadm 2021-03-10T13:51:39.630808+0000 mgr.gibba043.dnkmem (mgr.34337) 26 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:51:41.416 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[9769]: cephadm 2021-03-10T13:51:39.630879+0000 mgr.gibba043.dnkmem (mgr.34337) 27 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:51:41.416 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[9769]: cluster 2021-03-10T13:51:39.682552+0000 mgr.gibba043.dnkmem (mgr.34337) 28 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:41.416 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[12956]: audit 2021-03-10T13:51:39.629835+0000 mgr.gibba043.dnkmem (mgr.34337) 25 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:51:41.416 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[12956]: cephadm 2021-03-10T13:51:39.630808+0000 mgr.gibba043.dnkmem (mgr.34337) 26 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:51:41.417 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[12956]: cephadm 2021-03-10T13:51:39.630879+0000 mgr.gibba043.dnkmem (mgr.34337) 27 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:51:41.417 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:41 gibba003 bash[12956]: cluster 2021-03-10T13:51:39.682552+0000 mgr.gibba043.dnkmem (mgr.34337) 28 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:41 gibba043 bash[9839]: audit 2021-03-10T13:51:39.629835+0000 mgr.gibba043.dnkmem (mgr.34337) 25 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:51:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:41 gibba043 bash[9839]: cephadm 2021-03-10T13:51:39.630808+0000 mgr.gibba043.dnkmem (mgr.34337) 26 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:51:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:41 gibba043 bash[9839]: cephadm 2021-03-10T13:51:39.630879+0000 mgr.gibba043.dnkmem (mgr.34337) 27 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:51:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:41 gibba043 bash[9839]: cluster 2021-03-10T13:51:39.682552+0000 mgr.gibba043.dnkmem (mgr.34337) 28 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[9769]: audit 2021-03-10T13:51:41.883626+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:51:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[9769]: audit 2021-03-10T13:51:41.883702+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:51:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[9769]: audit 2021-03-10T13:51:41.887116+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:51:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[9769]: audit 2021-03-10T13:51:41.894226+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[12956]: audit 2021-03-10T13:51:41.883626+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:51:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[12956]: audit 2021-03-10T13:51:41.883702+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:51:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[12956]: audit 2021-03-10T13:51:41.887116+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:51:42.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:42 gibba003 bash[12956]: audit 2021-03-10T13:51:41.894226+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:42.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:42 gibba043 bash[9839]: audit 2021-03-10T13:51:41.883626+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:51:42.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:42 gibba043 bash[9839]: audit 2021-03-10T13:51:41.883702+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:51:42.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:42 gibba043 bash[9839]: audit 2021-03-10T13:51:41.887116+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4a09634f-c223-4ac4-a118-59d9aadd31bb\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:51:42.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:42 gibba043 bash[9839]: audit 2021-03-10T13:51:41.894226+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[9769]: cluster 2021-03-10T13:51:41.683769+0000 mgr.gibba043.dnkmem (mgr.34337) 29 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[9769]: cephadm 2021-03-10T13:51:41.893534+0000 mgr.gibba043.dnkmem (mgr.34337) 30 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[9769]: cephadm 2021-03-10T13:51:41.895230+0000 mgr.gibba043.dnkmem (mgr.34337) 31 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[9769]: cephadm 2021-03-10T13:51:41.895480+0000 mgr.gibba043.dnkmem (mgr.34337) 32 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:51:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[12956]: cluster 2021-03-10T13:51:41.683769+0000 mgr.gibba043.dnkmem (mgr.34337) 29 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[12956]: cephadm 2021-03-10T13:51:41.893534+0000 mgr.gibba043.dnkmem (mgr.34337) 30 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[12956]: cephadm 2021-03-10T13:51:41.895230+0000 mgr.gibba043.dnkmem (mgr.34337) 31 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:43.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:43 gibba003 bash[12956]: cephadm 2021-03-10T13:51:41.895480+0000 mgr.gibba043.dnkmem (mgr.34337) 32 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:51:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:43 gibba043 bash[9839]: cluster 2021-03-10T13:51:41.683769+0000 mgr.gibba043.dnkmem (mgr.34337) 29 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:43 gibba043 bash[9839]: cephadm 2021-03-10T13:51:41.893534+0000 mgr.gibba043.dnkmem (mgr.34337) 30 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:43 gibba043 bash[9839]: cephadm 2021-03-10T13:51:41.895230+0000 mgr.gibba043.dnkmem (mgr.34337) 31 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:43 gibba043 bash[9839]: cephadm 2021-03-10T13:51:41.895480+0000 mgr.gibba043.dnkmem (mgr.34337) 32 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:51:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: cephadm 2021-03-10T13:51:43.655645+0000 mgr.gibba043.dnkmem (mgr.34337) 33 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:51:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.656786+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T13:51:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.657073+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T13:51:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.661849+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]': finished 2021-03-10T13:51:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.668925+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:51:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.669270+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:51:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.670774+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:51:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.671485+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: cephadm 2021-03-10T13:51:43.672180+0000 mgr.gibba043.dnkmem (mgr.34337) 34 : cephadm [INF] Deploying daemon mgr.y on gibba003 2021-03-10T13:51:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: audit 2021-03-10T13:51:43.672414+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:51:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:44 gibba043 bash[9839]: cluster 2021-03-10T13:51:43.684463+0000 mgr.gibba043.dnkmem (mgr.34337) 35 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: cephadm 2021-03-10T13:51:43.655645+0000 mgr.gibba043.dnkmem (mgr.34337) 33 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:51:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.656786+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T13:51:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.657073+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T13:51:44.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.661849+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]': finished 2021-03-10T13:51:44.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.668925+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:51:44.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.669270+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:51:44.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.670774+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:51:44.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.671485+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:44.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: cephadm 2021-03-10T13:51:43.672180+0000 mgr.gibba043.dnkmem (mgr.34337) 34 : cephadm [INF] Deploying daemon mgr.y on gibba003 2021-03-10T13:51:44.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: audit 2021-03-10T13:51:43.672414+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:51:44.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[9769]: cluster 2021-03-10T13:51:43.684463+0000 mgr.gibba043.dnkmem (mgr.34337) 35 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:44.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: cephadm 2021-03-10T13:51:43.655645+0000 mgr.gibba043.dnkmem (mgr.34337) 33 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:51:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.656786+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T13:51:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.657073+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T13:51:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.661849+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]': finished 2021-03-10T13:51:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.668925+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:51:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.669270+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:51:44.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.670774+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:51:44.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.671485+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:51:44.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: cephadm 2021-03-10T13:51:43.672180+0000 mgr.gibba043.dnkmem (mgr.34337) 34 : cephadm [INF] Deploying daemon mgr.y on gibba003 2021-03-10T13:51:44.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: audit 2021-03-10T13:51:43.672414+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:51:44.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:44 gibba003 bash[12956]: cluster 2021-03-10T13:51:43.684463+0000 mgr.gibba043.dnkmem (mgr.34337) 35 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:45.941 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:45 gibba003 systemd[1]: Stopping Ceph mgr.y for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:51:47.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:46 gibba043 bash[9839]: cluster 2021-03-10T13:51:45.685047+0000 mgr.gibba043.dnkmem (mgr.34337) 36 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:46 gibba003 bash[9769]: cluster 2021-03-10T13:51:45.685047+0000 mgr.gibba043.dnkmem (mgr.34337) 36 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:46 gibba003 bash[12956]: cluster 2021-03-10T13:51:45.685047+0000 mgr.gibba043.dnkmem (mgr.34337) 36 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:48 gibba003 bash[9769]: cluster 2021-03-10T13:51:47.686136+0000 mgr.gibba043.dnkmem (mgr.34337) 37 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:48 gibba003 bash[12956]: cluster 2021-03-10T13:51:47.686136+0000 mgr.gibba043.dnkmem (mgr.34337) 37 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:48.945 INFO:journalctl@ceph.alertmanager.a.gibba003.stdout:Mar 10 13:51:48 gibba003 bash[29950]: level=info ts=2021-03-10T13:51:48.556Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001033618s 2021-03-10T13:51:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:48 gibba043 bash[9839]: cluster 2021-03-10T13:51:47.686136+0000 mgr.gibba043.dnkmem (mgr.34337) 37 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:51 gibba003 bash[9769]: cluster 2021-03-10T13:51:49.688208+0000 mgr.gibba043.dnkmem (mgr.34337) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:51 gibba003 bash[12956]: cluster 2021-03-10T13:51:49.688208+0000 mgr.gibba043.dnkmem (mgr.34337) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:51 gibba043 bash[9839]: cluster 2021-03-10T13:51:49.688208+0000 mgr.gibba043.dnkmem (mgr.34337) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:53 gibba003 bash[9769]: cluster 2021-03-10T13:51:51.689045+0000 mgr.gibba043.dnkmem (mgr.34337) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:53.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:53 gibba003 bash[12956]: cluster 2021-03-10T13:51:51.689045+0000 mgr.gibba043.dnkmem (mgr.34337) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:53 gibba043 bash[9839]: cluster 2021-03-10T13:51:51.689045+0000 mgr.gibba043.dnkmem (mgr.34337) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:55 gibba003 bash[9769]: cluster 2021-03-10T13:51:53.690815+0000 mgr.gibba043.dnkmem (mgr.34337) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:55 gibba003 bash[12956]: cluster 2021-03-10T13:51:53.690815+0000 mgr.gibba043.dnkmem (mgr.34337) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:55 gibba043 bash[9839]: cluster 2021-03-10T13:51:53.690815+0000 mgr.gibba043.dnkmem (mgr.34337) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:56.691 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:56 gibba003 docker[30292]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mgr.y 2021-03-10T13:51:56.691 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:56 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2021-03-10T13:51:56.691 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:56 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2021-03-10T13:51:56.691 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:56 gibba003 systemd[1]: Stopped Ceph mgr.y for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:51:56.692 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:56 gibba003 systemd[1]: Started Ceph mgr.y for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:51:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: cluster 2021-03-10T13:51:55.691825+0000 mgr.gibba043.dnkmem (mgr.34337) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: cluster 2021-03-10T13:51:55.691825+0000 mgr.gibba043.dnkmem (mgr.34337) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.634338+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.634338+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:57.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.634605+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.634605+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:57.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.638237+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.638237+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.830043+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:51:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.830043+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:51:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.830563+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:51:57.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.830563+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:51:57.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.834465+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]': finished 2021-03-10T13:51:57.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[9769]: audit 2021-03-10T13:51:56.841615+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.834465+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]': finished 2021-03-10T13:51:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[12956]: audit 2021-03-10T13:51:56.841615+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:57.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: cluster 2021-03-10T13:51:55.691825+0000 mgr.gibba043.dnkmem (mgr.34337) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:57.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.634338+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.634605+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]: dispatch 2021-03-10T13:51:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.638237+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:41:28.966567Z\"}"}]': finished 2021-03-10T13:51:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.830043+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.830563+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.834465+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 92327116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191731Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95525273, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.191993Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48674897, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192071Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192284Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192456Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48632954, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192624Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22533898, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192789Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.192953Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]': finished 2021-03-10T13:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:57 gibba043 bash[9839]: audit 2021-03-10T13:51:56.841615+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:57.941 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:51:57 gibba003 bash[30384]: debug 2021-03-10T13:51:57.574+0000 7fa1cfb15700 1 -- 172.21.2.103:0/1812272338 <== mon.0 v2:172.21.2.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ba96864e0 con 0x558ba9776800 2021-03-10T13:51:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:51:59 gibba003 bash[9769]: cluster 2021-03-10T13:51:57.692738+0000 mgr.gibba043.dnkmem (mgr.34337) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:51:59 gibba003 bash[12956]: cluster 2021-03-10T13:51:57.692738+0000 mgr.gibba043.dnkmem (mgr.34337) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:51:59 gibba043 bash[9839]: cluster 2021-03-10T13:51:57.692738+0000 mgr.gibba043.dnkmem (mgr.34337) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: cluster 2021-03-10T13:51:59.694464+0000 mgr.gibba043.dnkmem (mgr.34337) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: cluster 2021-03-10T13:51:59.694464+0000 mgr.gibba043.dnkmem (mgr.34337) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.451130+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.451130+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:01.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.451249+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:01.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.454357+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]': finished 2021-03-10T13:52:01.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.456215+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:01.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.451249+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:01.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.454357+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]': finished 2021-03-10T13:52:01.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.456215+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.456619+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.458582+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:52:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.463940+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.465318+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.465729+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T13:52:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.466159+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T13:52:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.468576+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]': finished 2021-03-10T13:52:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.470095+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.470459+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.472771+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]': finished 2021-03-10T13:52:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.474107+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.474486+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.476799+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:52:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.478222+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:52:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.478665+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:52:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.480995+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:52:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[9769]: audit 2021-03-10T13:52:00.483409+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:52:01.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.456619+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:01.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.458582+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:52:01.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.463940+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:01.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.465318+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.465729+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T13:52:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.466159+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T13:52:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.468576+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]': finished 2021-03-10T13:52:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.470095+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.470459+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.472771+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]': finished 2021-03-10T13:52:01.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.474107+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:01.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.474486+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:01.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.476799+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:52:01.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.478222+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:52:01.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.478665+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:52:01.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.480995+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:52:01.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:01 gibba003 bash[12956]: audit 2021-03-10T13:52:00.483409+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:52:01.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: cluster 2021-03-10T13:51:59.694464+0000 mgr.gibba043.dnkmem (mgr.34337) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.451130+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.451249+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.454357+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"8bc1091ccae9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103473479, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.445633Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:41:07.860120Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:27.693933Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:00.450327Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]': finished 2021-03-10T13:52:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.456215+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.456619+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.458582+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:52:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.463940+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.465318+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.465729+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T13:52:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.466159+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T13:52:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.468576+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]': finished 2021-03-10T13:52:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.470095+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.470459+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.472771+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba043.dnkmem"}]': finished 2021-03-10T13:52:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.474107+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.474486+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.476799+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:52:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.478222+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:52:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.478665+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:52:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.480995+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:52:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:01 gibba043 bash[9839]: audit 2021-03-10T13:52:00.483409+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:52:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.463317+0000 mgr.gibba043.dnkmem (mgr.34337) 44 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.464995+0000 mgr.gibba043.dnkmem (mgr.34337) 45 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.465959+0000 mgr.gibba043.dnkmem (mgr.34337) 46 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:52:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.466011+0000 mgr.gibba043.dnkmem (mgr.34337) 47 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:52:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.482991+0000 mgr.gibba043.dnkmem (mgr.34337) 48 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.483053+0000 mgr.gibba043.dnkmem (mgr.34337) 49 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.483984+0000 mgr.gibba043.dnkmem (mgr.34337) 50 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:52:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cephadm 2021-03-10T13:52:00.484048+0000 mgr.gibba043.dnkmem (mgr.34337) 51 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:52:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cluster 2021-03-10T13:52:01.439857+0000 mon.a (mon.0) 701 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:52:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: cluster 2021-03-10T13:52:01.439945+0000 mon.a (mon.0) 702 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:52:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: audit 2021-03-10T13:52:01.440995+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.2.103:0/748238099' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[9769]: audit 2021-03-10T13:52:01.441896+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.2.103:0/748238099' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.463317+0000 mgr.gibba043.dnkmem (mgr.34337) 44 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.464995+0000 mgr.gibba043.dnkmem (mgr.34337) 45 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.465959+0000 mgr.gibba043.dnkmem (mgr.34337) 46 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:52:02.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.466011+0000 mgr.gibba043.dnkmem (mgr.34337) 47 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:52:02.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.482991+0000 mgr.gibba043.dnkmem (mgr.34337) 48 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:02.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.483053+0000 mgr.gibba043.dnkmem (mgr.34337) 49 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:02.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.483984+0000 mgr.gibba043.dnkmem (mgr.34337) 50 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:52:02.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cephadm 2021-03-10T13:52:00.484048+0000 mgr.gibba043.dnkmem (mgr.34337) 51 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:52:02.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cluster 2021-03-10T13:52:01.439857+0000 mon.a (mon.0) 701 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:52:02.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: cluster 2021-03-10T13:52:01.439945+0000 mon.a (mon.0) 702 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:52:02.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: audit 2021-03-10T13:52:01.440995+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.2.103:0/748238099' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:02.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:02 gibba003 bash[12956]: audit 2021-03-10T13:52:01.441896+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.2.103:0/748238099' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.463317+0000 mgr.gibba043.dnkmem (mgr.34337) 44 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.464995+0000 mgr.gibba043.dnkmem (mgr.34337) 45 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.465959+0000 mgr.gibba043.dnkmem (mgr.34337) 46 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:52:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.466011+0000 mgr.gibba043.dnkmem (mgr.34337) 47 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:52:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.482991+0000 mgr.gibba043.dnkmem (mgr.34337) 48 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.483053+0000 mgr.gibba043.dnkmem (mgr.34337) 49 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.483984+0000 mgr.gibba043.dnkmem (mgr.34337) 50 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:52:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cephadm 2021-03-10T13:52:00.484048+0000 mgr.gibba043.dnkmem (mgr.34337) 51 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:52:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cluster 2021-03-10T13:52:01.439857+0000 mon.a (mon.0) 701 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:52:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: cluster 2021-03-10T13:52:01.439945+0000 mon.a (mon.0) 702 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:52:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: audit 2021-03-10T13:52:01.440995+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.2.103:0/748238099' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:02 gibba043 bash[9839]: audit 2021-03-10T13:52:01.441896+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.2.103:0/748238099' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:02.607 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:52:02.840 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:52:02.840 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (25s) 2s ago 5m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:52:02.841 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (5m) 35s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:52:02.841 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (45s) 35s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:52:02.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (63s) 35s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:52:02.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (6s) 2s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:52:02.842 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (10m) 2s ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8bc1091ccae9 2021-03-10T13:52:02.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (9m) 35s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0560a63542e 2021-03-10T13:52:02.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (9m) 2s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 be39d003f3cf 2021-03-10T13:52:02.843 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (5m) 2s ago 5m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:52:02.843 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (5m) 35s ago 5m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:52:02.843 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (8m) 2s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8f0b52d3cade 2021-03-10T13:52:02.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (8m) 2s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:52:02.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (8m) 2s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:52:02.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (7m) 2s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:52:02.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (7m) 35s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:52:02.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (7m) 35s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:52:02.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (6m) 35s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:52:02.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (6m) 35s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:52:02.845 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (5m) 35s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:52:02.845 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:52:03.085 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:52:03.085 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:52:03.085 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:52:03.086 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:52:03.086 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:52:03.086 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:03.086 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:52:03.087 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:52:03.087 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:52:03.087 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:52:03.087 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:52:03.087 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:52:03.088 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 11, 2021-03-10T13:52:03.088 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:03.088 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:52:03.088 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:52:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: cluster 2021-03-10T13:52:01.695719+0000 mgr.gibba043.dnkmem (mgr.34337) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: cluster 2021-03-10T13:52:02.179230+0000 mon.a (mon.0) 703 : cluster [DBG] mgrmap e21: gibba043.dnkmem(active, since 40s), standbys: y, x 2021-03-10T13:52:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.478762+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T13:52:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.478807+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T13:52:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.483150+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]': finished 2021-03-10T13:52:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.494644+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.497273+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.500192+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:02.504447+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:52:03.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[9769]: audit 2021-03-10T13:52:03.084791+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.103:0/2801029661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: cluster 2021-03-10T13:52:01.695719+0000 mgr.gibba043.dnkmem (mgr.34337) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: cluster 2021-03-10T13:52:02.179230+0000 mon.a (mon.0) 703 : cluster [DBG] mgrmap e21: gibba043.dnkmem(active, since 40s), standbys: y, x 2021-03-10T13:52:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.478762+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T13:52:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.478807+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T13:52:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.483150+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]': finished 2021-03-10T13:52:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.494644+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:03.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.497273+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:03.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.500192+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:03.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:02.504447+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:52:03.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:03 gibba003 bash[12956]: audit 2021-03-10T13:52:03.084791+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.103:0/2801029661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: cluster 2021-03-10T13:52:01.695719+0000 mgr.gibba043.dnkmem (mgr.34337) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: cluster 2021-03-10T13:52:02.179230+0000 mon.a (mon.0) 703 : cluster [DBG] mgrmap e21: gibba043.dnkmem(active, since 40s), standbys: y, x 2021-03-10T13:52:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.478762+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T13:52:03.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.478807+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T13:52:03.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.483150+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34337 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]': finished 2021-03-10T13:52:03.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.494644+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:03.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.497273+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:03.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.500192+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:02.504447+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:52:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:03 gibba043 bash[9839]: audit 2021-03-10T13:52:03.084791+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.103:0/2801029661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[9769]: cephadm 2021-03-10T13:52:02.477668+0000 mgr.gibba043.dnkmem (mgr.34337) 53 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:52:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[9769]: cephadm 2021-03-10T13:52:02.502734+0000 mgr.gibba043.dnkmem (mgr.34337) 54 : cephadm [INF] Deploying daemon mon.a on gibba003 2021-03-10T13:52:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[9769]: audit 2021-03-10T13:52:02.599205+0000 mgr.gibba043.dnkmem (mgr.34337) 55 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[9769]: audit 2021-03-10T13:52:02.829287+0000 mgr.gibba043.dnkmem (mgr.34337) 56 : audit [DBG] from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[12956]: cephadm 2021-03-10T13:52:02.477668+0000 mgr.gibba043.dnkmem (mgr.34337) 53 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:52:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[12956]: cephadm 2021-03-10T13:52:02.502734+0000 mgr.gibba043.dnkmem (mgr.34337) 54 : cephadm [INF] Deploying daemon mon.a on gibba003 2021-03-10T13:52:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[12956]: audit 2021-03-10T13:52:02.599205+0000 mgr.gibba043.dnkmem (mgr.34337) 55 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[12956]: audit 2021-03-10T13:52:02.829287+0000 mgr.gibba043.dnkmem (mgr.34337) 56 : audit [DBG] from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:04 gibba043 bash[9839]: cephadm 2021-03-10T13:52:02.477668+0000 mgr.gibba043.dnkmem (mgr.34337) 53 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:52:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:04 gibba043 bash[9839]: cephadm 2021-03-10T13:52:02.502734+0000 mgr.gibba043.dnkmem (mgr.34337) 54 : cephadm [INF] Deploying daemon mon.a on gibba003 2021-03-10T13:52:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:04 gibba043 bash[9839]: audit 2021-03-10T13:52:02.599205+0000 mgr.gibba043.dnkmem (mgr.34337) 55 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:04.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:04 gibba043 bash[9839]: audit 2021-03-10T13:52:02.829287+0000 mgr.gibba043.dnkmem (mgr.34337) 56 : audit [DBG] from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:04.782 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 systemd[1]: Stopping Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:52:04.782 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[9769]: debug 2021-03-10T13:52:04.598+0000 7fdac0b82700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:52:04.783 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:04 gibba003 bash[9769]: debug 2021-03-10T13:52:04.598+0000 7fdac0b82700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-03-10T13:52:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:05 gibba003 docker[31299]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:52:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:05 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T13:52:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:05 gibba003 systemd[1]: Stopped Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:05 gibba003 systemd[1]: Started Ceph mon.a for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:06.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.506+0000 7fe49d45d700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:52:06.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.506+0000 7fe49d45d700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:52:06.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.506+0000 7fe49d45d700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:52:06.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 0 load: jerasure load: lrc load: isa 2021-03-10T13:52:06.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:52:06.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:52:06.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:52:06.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: DB SUMMARY 2021-03-10T13:52:06.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:52:06.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:52:06.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 843 Bytes 2021-03-10T13:52:06.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000026.sst 2021-03-10T13:52:06.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000024.log size: 12114341 ; 2021-03-10T13:52:06.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:52:06.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:52:06.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:52:06.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.env: 0x55ffb96b51c0 2021-03-10T13:52:06.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:52:06.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.info_log: 0x55ffbbdf71e0 2021-03-10T13:52:06.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:52:06.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:52:06.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:52:06.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:52:06.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:52:06.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:52:06.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:52:06.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:52:06.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:52:06.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:52:06.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:52:06.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:52:06.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:52:06.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:52:06.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:52:06.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:52:06.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:52:06.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:52:06.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:52:06.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:52:06.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:52:06.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:52:06.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:52:06.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:52:06.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:52:06.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:52:06.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.write_buffer_manager: 0x55ffbbe4bc50 2021-03-10T13:52:06.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:52:06.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:52:06.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:52:06.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:52:06.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:52:06.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:52:06.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:52:06.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:52:06.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:52:06.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:52:06.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:52:06.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:52:06.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:52:06.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:52:06.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.row_cache: None 2021-03-10T13:52:06.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:52:06.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:52:06.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:52:06.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:52:06.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:52:06.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:52:06.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:52:06.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:52:06.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:52:06.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:52:06.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:52:06.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:52:06.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:52:06.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:52:06.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:52:06.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:52:06.711 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:52:06.711 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:52:06.711 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:52:06.711 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:52:06.712 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:52:06.712 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:52:06.712 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:52:06.712 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:52:06.712 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:52:06.713 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:52:06.713 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:52:06.713 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:52:06.713 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:52:06.713 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:52:06.714 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:52:06.714 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:52:06.714 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:52:06.714 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:52:06.715 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:52:06.715 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:52:06.715 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:52:06.715 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2021-03-10T13:52:06.715 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:52:06.716 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:52:06.716 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.merge_operator: 2021-03-10T13:52:06.716 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:52:06.716 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:52:06.716 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:52:06.717 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:52:06.717 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ffbbd9a230) 2021-03-10T13:52:06.717 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: cache_index_and_filter_blocks: 1 2021-03-10T13:52:06.717 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:52:06.717 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:52:06.718 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: pin_top_level_index_and_filter: 1 2021-03-10T13:52:06.718 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: index_type: 0 2021-03-10T13:52:06.718 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: data_block_index_type: 0 2021-03-10T13:52:06.718 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: index_shortening: 1 2021-03-10T13:52:06.718 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:52:06.719 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: hash_index_allow_collision: 1 2021-03-10T13:52:06.719 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: checksum: 1 2021-03-10T13:52:06.719 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: no_block_cache: 0 2021-03-10T13:52:06.719 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_cache: 0x55ffbbdd2510 2021-03-10T13:52:06.719 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_cache_name: BinnedLRUCache 2021-03-10T13:52:06.720 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_cache_options: 2021-03-10T13:52:06.720 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: capacity : 536870912 2021-03-10T13:52:06.720 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: num_shard_bits : 4 2021-03-10T13:52:06.720 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: strict_capacity_limit : 0 2021-03-10T13:52:06.720 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: high_pri_pool_ratio: 0.000 2021-03-10T13:52:06.721 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_cache_compressed: (nil) 2021-03-10T13:52:06.721 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: persistent_cache: (nil) 2021-03-10T13:52:06.721 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_size: 4096 2021-03-10T13:52:06.721 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_size_deviation: 10 2021-03-10T13:52:06.722 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_restart_interval: 16 2021-03-10T13:52:06.722 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: index_block_restart_interval: 1 2021-03-10T13:52:06.722 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: metadata_block_size: 4096 2021-03-10T13:52:06.722 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: partition_filters: 0 2021-03-10T13:52:06.722 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: use_delta_encoding: 1 2021-03-10T13:52:06.723 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:52:06.723 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: whole_key_filtering: 1 2021-03-10T13:52:06.723 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: verify_compression: 0 2021-03-10T13:52:06.723 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: read_amp_bytes_per_bit: 0 2021-03-10T13:52:06.723 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: format_version: 2 2021-03-10T13:52:06.724 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: enable_index_compression: 1 2021-03-10T13:52:06.724 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: block_align: 0 2021-03-10T13:52:06.724 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:52:06.724 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:52:06.725 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:52:06.725 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:52:06.725 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:52:06.725 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:52:06.725 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:52:06.726 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:52:06.726 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:52:06.726 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:52:06.726 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:52:06.726 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:52:06.727 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:52:06.727 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:52:06.727 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:52:06.727 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:52:06.728 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:52:06.728 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:52:06.728 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:52:06.728 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:52:06.729 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:52:06.729 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:52:06.729 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:52:06.729 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:52:06.729 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:52:06.730 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:52:06.730 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:52:06.730 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:52:06.730 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:52:06.730 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:52:06.731 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:52:06.731 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:52:06.731 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:52:06.731 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:52:06.732 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:52:06.732 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:52:06.732 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:52:06.732 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:52:06.732 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:52:06.733 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:52:06.733 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:52:06.733 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:52:06.733 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:52:06.733 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:52:06.734 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:52:06.734 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:52:06.734 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:52:06.734 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:52:06.735 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:52:06.735 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:52:06.735 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:52:06.735 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:52:06.735 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:52:06.736 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:52:06.736 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:52:06.736 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:52:06.736 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:52:06.736 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:52:06.737 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:52:06.737 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:52:06.737 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:52:06.737 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:52:06.738 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:52:06.738 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:52:06.738 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:52:06.738 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:52:06.738 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:52:06.739 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:52:06.739 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 28, last_sequence is 8734, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:52:06.739 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2021-03-10T13:52:06.739 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384326512270, "job": 1, "event": "recovery_started", "log_files": [24]} 2021-03-10T13:52:06.740 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.510+0000 7fe49d45d700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2021-03-10T13:52:06.740 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.514+0000 7fe49d45d700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:52:06.740 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.526+0000 7fe49d45d700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384326528695, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 28, "file_size": 12034249, "table_properties": {"data_size": 12028222, "index_size": 4499, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 5532, "raw_average_key_size": 23, "raw_value_size": 12021142, "raw_average_value_size": 51815, "num_data_blocks": 140, "num_entries": 232, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384326, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:52:06.740 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.526+0000 7fe49d45d700 4 rocksdb: [version_set.cc:3826] Creating manifest 29 2021-03-10T13:52:06.740 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.526+0000 7fe49d45d700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384326529437, "job": 1, "event": "recovery_finished"} 2021-03-10T13:52:06.741 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.526+0000 7fe49d45d700 4 rocksdb: DB pointer 0x55ffbbe97800 2021-03-10T13:52:06.741 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.526+0000 7fe484270700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:52:06.741 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.526+0000 7fe484270700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:52:06.741 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** DB Stats ** 2021-03-10T13:52:06.742 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:06.742 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:52:06.742 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:52:06.742 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:52:06.742 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:52:06.743 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:52:06.743 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:52:06.743 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** Compaction Stats [default] ** 2021-03-10T13:52:06.743 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:06.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:06.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: L0 1/0 11.48 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: L6 1/0 62.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:06.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Sum 2/0 74.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** Compaction Stats [default] ** 2021-03-10T13:52:06.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:06.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:06.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:06.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Flush(GB): cumulative 0.011, interval 0.011 2021-03-10T13:52:06.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:52:06.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:52:06.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:52:06.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:52:06.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Cumulative compaction: 0.01 GB write, 605.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:06.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Interval compaction: 0.01 GB write, 605.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:06.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:52:06.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:52:06.748 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** Compaction Stats [default] ** 2021-03-10T13:52:06.748 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:06.748 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:06.748 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: L0 1/0 11.48 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.749 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: L6 1/0 62.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:06.749 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Sum 2/0 74.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.749 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:06.749 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** Compaction Stats [default] ** 2021-03-10T13:52:06.750 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:06.750 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:06.750 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1113.4 0.01 0.00 1 0.010 0 0 2021-03-10T13:52:06.750 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:06.750 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Flush(GB): cumulative 0.011, interval 0.000 2021-03-10T13:52:06.751 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:52:06.751 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:52:06.751 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:52:06.751 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:52:06.752 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Cumulative compaction: 0.01 GB write, 604.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:06.752 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:06.752 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:52:06.752 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:52:06.753 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 starting mon.a rank 0 at public addrs [v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0] at bind addrs [v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:52:06.753 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 1 mon.a@-1(???) e3 preinit fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:52:06.753 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 mon.a@-1(???).mds e1 new map 2021-03-10T13:52:06.753 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 mon.a@-1(???).mds e1 print_map 2021-03-10T13:52:06.754 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: e1 2021-03-10T13:52:06.754 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:52:06.754 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:52:06.754 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: legacy client fscid: -1 2021-03-10T13:52:06.754 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: 2021-03-10T13:52:06.755 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: No filesystems configured 2021-03-10T13:52:06.755 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 mon.a@-1(???).osd e64 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:52:06.755 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 mon.a@-1(???).osd e64 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:06.755 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 mon.a@-1(???).osd e64 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:06.756 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 0 mon.a@-1(???).osd e64 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:06.756 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: cephadm 2021-03-10T13:52:02.477668+0000 mgr.gibba043.dnkmem (mgr.34337) 53 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:52:06.756 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: cephadm 2021-03-10T13:52:02.502734+0000 mgr.gibba043.dnkmem (mgr.34337) 54 : cephadm [INF] Deploying daemon mon.a on gibba003 2021-03-10T13:52:06.756 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: audit 2021-03-10T13:52:02.599205+0000 mgr.gibba043.dnkmem (mgr.34337) 55 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:06.756 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: audit 2021-03-10T13:52:02.829287+0000 mgr.gibba043.dnkmem (mgr.34337) 56 : audit [DBG] from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:06.757 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:06 gibba003 bash[31385]: debug 2021-03-10T13:52:06.530+0000 7fe49d45d700 1 mon.a@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2021-03-10T13:52:08.270 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:52:07 gibba043 bash[20706]: ignoring --setuser ceph since I am not root 2021-03-10T13:52:08.270 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:52:07 gibba043 bash[20706]: ignoring --setgroup ceph since I am not root 2021-03-10T13:52:08.270 INFO:journalctl@ceph.mgr.x.gibba043.stdout:Mar 10 13:52:07 gibba043 bash[20706]: debug 2021-03-10T13:52:07.993+0000 7f25564b6700 1 -- 172.21.2.143:0/4120985692 <== mon.2 v2:172.21.2.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5633888304e0 con 0x563388921000 2021-03-10T13:52:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: audit 2021-03-10T13:52:05.554945+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:05.698713+0000 mgr.gibba043.dnkmem (mgr.34337) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.146875+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.948231+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.957160+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.957185+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:52:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.957202+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T13:52:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.958095+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba043.dnkmem(active, since 45s), standbys: y, x 2021-03-10T13:52:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.970291+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba043.dnkmem(active, since 45s), standbys: y, x 2021-03-10T13:52:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.970927+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.970941+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.970950+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.970959+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: cluster 2021-03-10T13:52:07.970969+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:08 gibba043 bash[9839]: audit 2021-03-10T13:52:07.975393+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34337 ' entity='' 2021-03-10T13:52:08.441 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[30384]: ignoring --setuser ceph since I am not root 2021-03-10T13:52:08.441 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[30384]: ignoring --setgroup ceph since I am not root 2021-03-10T13:52:08.441 INFO:journalctl@ceph.mgr.y.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[30384]: debug 2021-03-10T13:52:07.994+0000 7f513ab66700 1 -- 172.21.2.103:0/461383809 <== mon.1 v2:172.21.2.103:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aef43744e0 con 0x55aef4464800 2021-03-10T13:52:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[31385]: debug 2021-03-10T13:52:07.966+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[31385]: debug 2021-03-10T13:52:07.966+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[31385]: debug 2021-03-10T13:52:07.966+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[31385]: debug 2021-03-10T13:52:07.966+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:07 gibba003 bash[31385]: debug 2021-03-10T13:52:07.966+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: audit 2021-03-10T13:52:05.554945+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:05.698713+0000 mgr.gibba043.dnkmem (mgr.34337) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.146875+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.948231+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.957160+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.957185+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:52:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.957202+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T13:52:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: audit 2021-03-10T13:52:05.554945+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34337 172.21.2.143:0/1683169908' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 166409011, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446125Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95546245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446455Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48758784, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.446761Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48874127, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.447474Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46001029, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448176Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.448823Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22638755, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.449457Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12111052, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:52:00.449786Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:00.450086Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\"}"}]: dispatch 2021-03-10T13:52:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:05.698713+0000 mgr.gibba043.dnkmem (mgr.34337) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.146875+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.948231+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.957160+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.957185+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:52:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.957202+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T13:52:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.958095+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba043.dnkmem(active, since 45s), standbys: y, x 2021-03-10T13:52:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.970291+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba043.dnkmem(active, since 45s), standbys: y, x 2021-03-10T13:52:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.970927+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.970941+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.970950+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.970959+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: cluster 2021-03-10T13:52:07.970969+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[12956]: audit 2021-03-10T13:52:07.975393+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34337 ' entity='' 2021-03-10T13:52:08.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.958095+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba043.dnkmem(active, since 45s), standbys: y, x 2021-03-10T13:52:08.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.970291+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba043.dnkmem(active, since 45s), standbys: y, x 2021-03-10T13:52:08.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.970927+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.970941+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:08.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.970950+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:08.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.970959+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: cluster 2021-03-10T13:52:07.970969+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:08.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:08 gibba003 bash[31385]: audit 2021-03-10T13:52:07.975393+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34337 ' entity='' 2021-03-10T13:52:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.702105+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:52:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.702162+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:52:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: audit 2021-03-10T13:52:11.703525+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.? 172.21.2.103:0/3970466665' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: audit 2021-03-10T13:52:11.704459+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.? 172.21.2.103:0/3970466665' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.845900+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:52:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.846034+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:52:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: audit 2021-03-10T13:52:11.846282+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.? 172.21.2.143:0/639877117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: audit 2021-03-10T13:52:11.847106+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.? 172.21.2.143:0/639877117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.861254+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba043.dnkmem restarted 2021-03-10T13:52:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.862589+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba043.dnkmem 2021-03-10T13:52:12.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[31385]: cluster 2021-03-10T13:52:11.870832+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:12.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.702105+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:52:12.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.702162+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:52:12.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: audit 2021-03-10T13:52:11.703525+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.? 172.21.2.103:0/3970466665' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:12.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: audit 2021-03-10T13:52:11.704459+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.? 172.21.2.103:0/3970466665' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:12.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.845900+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:52:12.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.846034+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:52:12.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: audit 2021-03-10T13:52:11.846282+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.? 172.21.2.143:0/639877117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: audit 2021-03-10T13:52:11.847106+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.? 172.21.2.143:0/639877117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.861254+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba043.dnkmem restarted 2021-03-10T13:52:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.862589+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba043.dnkmem 2021-03-10T13:52:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:12 gibba003 bash[12956]: cluster 2021-03-10T13:52:11.870832+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:13.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.702105+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:52:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.702162+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:52:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: audit 2021-03-10T13:52:11.703525+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.? 172.21.2.103:0/3970466665' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: audit 2021-03-10T13:52:11.704459+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.? 172.21.2.103:0/3970466665' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.845900+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:52:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.846034+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:52:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: audit 2021-03-10T13:52:11.846282+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.? 172.21.2.143:0/639877117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: audit 2021-03-10T13:52:11.847106+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.? 172.21.2.143:0/639877117' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.861254+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba043.dnkmem restarted 2021-03-10T13:52:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.862589+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba043.dnkmem 2021-03-10T13:52:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:12 gibba043 bash[9839]: cluster 2021-03-10T13:52:11.870832+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:13.847 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: cluster 2021-03-10T13:52:12.558994+0000 mon.a (mon.0) 21 : cluster [DBG] mgrmap e23: gibba043.dnkmem(active, starting, since 0.696608s), standbys: y, x 2021-03-10T13:52:13.848 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564117+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:13.848 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564248+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:52:13.848 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564360+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:52:13.848 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564467+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:52:13.849 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564612+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:52:13.849 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564747+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:52:13.849 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.564882+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:52:13.849 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.565008+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:52:13.850 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.565135+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:52:13.850 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.565261+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:52:13.850 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.565388+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:52:13.850 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.565750+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:52:13.850 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.565847+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:52:13.851 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.566143+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:52:13.851 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.566642+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:52:13.851 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.567200+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:52:13.851 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.567483+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:52:13.852 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.567765+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:52:13.852 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.568131+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba043"}]: dispatch 2021-03-10T13:52:13.852 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.568432+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:52:13.852 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.568677+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:52:13.852 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.568947+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:52:13.853 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.569190+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:52:13.853 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.569475+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:52:13.853 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.569689+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:52:13.853 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.569912+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:52:13.854 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.570157+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:52:13.854 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.570393+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:52:13.854 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.570653+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:52:13.854 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.570989+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:52:13.854 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.571291+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:52:13.855 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.571575+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:13.855 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.571806+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:13.855 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.572043+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:52:13.855 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.572273+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:52:13.856 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.572495+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:52:13.856 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.572765+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:52:13.856 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: cluster 2021-03-10T13:52:12.574614+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon gibba043.dnkmem is now available 2021-03-10T13:52:13.856 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.688494+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:13.856 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.688817+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:13.857 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.692647+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:13.857 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.693038+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:13.857 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:12.836878+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:13.857 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:13.010883+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:52:13.009930Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:13.858 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:13.014225+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:13.858 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:13 gibba043 bash[9839]: audit 2021-03-10T13:52:13.016564+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: cluster 2021-03-10T13:52:12.558994+0000 mon.a (mon.0) 21 : cluster [DBG] mgrmap e23: gibba043.dnkmem(active, starting, since 0.696608s), standbys: y, x 2021-03-10T13:52:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564117+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564248+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:52:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564360+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:52:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564467+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:52:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564612+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:52:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564747+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:52:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.564882+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:52:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.565008+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:52:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.565135+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:52:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.565261+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:52:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.565388+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:52:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.565750+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:52:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.565847+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:52:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.566143+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:52:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.566642+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:52:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.567200+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:52:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: cluster 2021-03-10T13:52:12.558994+0000 mon.a (mon.0) 21 : cluster [DBG] mgrmap e23: gibba043.dnkmem(active, starting, since 0.696608s), standbys: y, x 2021-03-10T13:52:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564117+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "gibba043.dnkmem", "id": "gibba043.dnkmem"}]: dispatch 2021-03-10T13:52:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564248+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:52:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564360+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:52:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564467+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:52:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564612+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:52:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564747+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:52:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.564882+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:52:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.565008+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:52:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.565135+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:52:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.565261+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:52:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.565388+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:52:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.565750+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:52:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.565847+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:52:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.566143+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:52:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.566642+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:52:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.567200+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:52:13.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.567483+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:52:13.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.567765+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:52:13.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.568131+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba043"}]: dispatch 2021-03-10T13:52:13.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.568432+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:52:13.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.568677+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:52:13.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.568947+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:52:13.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.569190+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:52:13.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.569475+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:52:13.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.569689+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:52:13.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.569912+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:52:13.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.570157+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:52:13.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.570393+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:52:13.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.570653+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:52:13.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.570989+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:52:13.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.571291+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:52:13.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.571575+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:13.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.567483+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:52:13.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.567765+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba003"}]: dispatch 2021-03-10T13:52:13.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.568131+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba043"}]: dispatch 2021-03-10T13:52:13.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.568432+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:52:13.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.568677+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:52:13.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.568947+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:52:13.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.569190+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:52:13.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.569475+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:52:13.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.569689+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:52:13.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.569912+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:52:13.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.570157+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:52:13.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.570393+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:52:13.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.570653+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:52:13.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.570989+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:52:13.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.571291+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:52:13.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.571575+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:13.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.571806+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:13.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.572043+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:52:13.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.572273+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:52:13.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.572495+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:52:13.959 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.572765+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:52:13.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: cluster 2021-03-10T13:52:12.574614+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon gibba043.dnkmem is now available 2021-03-10T13:52:13.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.688494+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:13.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.688817+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:13.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.692647+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:13.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.693038+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:13.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:12.836878+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:13.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:13.010883+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:52:13.009930Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:13.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:13.014225+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:13.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[31385]: audit 2021-03-10T13:52:13.016564+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:13.962 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.571806+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:13.962 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.572043+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:52:13.962 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.572273+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:52:13.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.572495+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:52:13.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.572765+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:52:13.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: cluster 2021-03-10T13:52:12.574614+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon gibba043.dnkmem is now available 2021-03-10T13:52:13.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.688494+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:13.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.688817+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:13.964 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.692647+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:13.964 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.693038+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:13.964 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:12.836878+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:13.964 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:13.010883+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100139008, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428606Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372454195, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428754Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400346316, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428841Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48129638, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.428921Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46305116, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429134Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46441431, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429309Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48454696, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429481Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33271316, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429649Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429737Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29381099, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:51:27.429817Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:52:13.009930Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:13.965 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:13.014225+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:13.965 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:13 gibba003 bash[12956]: audit 2021-03-10T13:52:13.016564+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:14 gibba003 bash[31385]: cluster 2021-03-10T13:52:13.572318+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e24: gibba043.dnkmem(active, since 1.70993s), standbys: y, x 2021-03-10T13:52:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:14 gibba003 bash[31385]: cluster 2021-03-10T13:52:13.578864+0000 mgr.gibba043.dnkmem (mgr.34373) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:14 gibba003 bash[31385]: cluster 2021-03-10T13:52:13.847313+0000 mgr.gibba043.dnkmem (mgr.34373) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:14 gibba003 bash[12956]: cluster 2021-03-10T13:52:13.572318+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e24: gibba043.dnkmem(active, since 1.70993s), standbys: y, x 2021-03-10T13:52:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:14 gibba003 bash[12956]: cluster 2021-03-10T13:52:13.578864+0000 mgr.gibba043.dnkmem (mgr.34373) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:14 gibba003 bash[12956]: cluster 2021-03-10T13:52:13.847313+0000 mgr.gibba043.dnkmem (mgr.34373) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:14 gibba043 bash[9839]: cluster 2021-03-10T13:52:13.572318+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e24: gibba043.dnkmem(active, since 1.70993s), standbys: y, x 2021-03-10T13:52:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:14 gibba043 bash[9839]: cluster 2021-03-10T13:52:13.578864+0000 mgr.gibba043.dnkmem (mgr.34373) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:14 gibba043 bash[9839]: cluster 2021-03-10T13:52:13.847313+0000 mgr.gibba043.dnkmem (mgr.34373) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba043.dnkmem: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:15 gibba003 bash[31385]: cluster 2021-03-10T13:52:14.566758+0000 mgr.gibba043.dnkmem (mgr.34373) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:15 gibba003 bash[31385]: cluster 2021-03-10T13:52:14.578730+0000 mon.a (mon.0) 27 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:52:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:15 gibba003 bash[31385]: cluster 2021-03-10T13:52:14.592483+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 2s), standbys: y, x 2021-03-10T13:52:15.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:15 gibba003 bash[12956]: cluster 2021-03-10T13:52:14.566758+0000 mgr.gibba043.dnkmem (mgr.34373) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:15.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:15 gibba003 bash[12956]: cluster 2021-03-10T13:52:14.578730+0000 mon.a (mon.0) 27 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:52:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:15 gibba003 bash[12956]: cluster 2021-03-10T13:52:14.592483+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 2s), standbys: y, x 2021-03-10T13:52:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:15 gibba043 bash[9839]: cluster 2021-03-10T13:52:14.566758+0000 mgr.gibba043.dnkmem (mgr.34373) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:15 gibba043 bash[9839]: cluster 2021-03-10T13:52:14.578730+0000 mon.a (mon.0) 27 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:52:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:15 gibba043 bash[9839]: cluster 2021-03-10T13:52:14.592483+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 2s), standbys: y, x 2021-03-10T13:52:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:16.576266+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37822136, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574468Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373607628, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574587Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96164904, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574645Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49524244, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574698Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49251614, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574853Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46630174, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574976Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49157242, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575092Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22858956, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575205Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12373196, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575263Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575316Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:16.575389Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:16.579056+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: cephadm 2021-03-10T13:52:16.580738+0000 mgr.gibba043.dnkmem (mgr.34373) 5 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:52:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:16.576266+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37822136, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574468Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373607628, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574587Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96164904, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574645Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49524244, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574698Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49251614, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574853Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46630174, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574976Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49157242, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575092Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22858956, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575205Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12373196, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575263Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575316Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:16.575389Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:16.579056+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: cephadm 2021-03-10T13:52:16.580738+0000 mgr.gibba043.dnkmem (mgr.34373) 5 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:52:17.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:16.903773+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102781419, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901135Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374656204, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901284Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 405484339, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901372Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901455Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47469035, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901676Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47206891, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901859Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48800727, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902037Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33816576, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902212Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23341301, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902302Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902386Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:16.902524Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:52:13.009930Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:17.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:16.916250+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:17.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: cephadm 2021-03-10T13:52:16.918830+0000 mgr.gibba043.dnkmem (mgr.34373) 6 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:52:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:17.123790+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:17.134571+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:17.140126+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:17.141417+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[31385]: audit 2021-03-10T13:52:17.142565+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:52:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:16.903773+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102781419, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901135Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374656204, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901284Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 405484339, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901372Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901455Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47469035, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901676Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47206891, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901859Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48800727, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902037Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33816576, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902212Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23341301, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902302Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902386Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:16.902524Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:52:13.009930Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:16.916250+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: cephadm 2021-03-10T13:52:16.918830+0000 mgr.gibba043.dnkmem (mgr.34373) 6 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:52:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:17.123790+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:17.134571+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:17.140126+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:17.141417+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:17 gibba003 bash[12956]: audit 2021-03-10T13:52:17.142565+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:52:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:16.576266+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37822136, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574468Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373607628, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574587Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"be39d003f3cf\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96164904, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574645Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:42:17.642532Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49524244, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574698Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49251614, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574853Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46630174, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574976Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49157242, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575092Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22858956, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575205Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12373196, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575263Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575316Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:29.468849Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:16.575389Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:16.579056+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: cephadm 2021-03-10T13:52:16.580738+0000 mgr.gibba043.dnkmem (mgr.34373) 5 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:52:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:16.903773+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba043","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"d0560a63542e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102781419, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901135Z\", \"created\": \"2021-03-10T13:42:30.851453Z\", \"started\": \"2021-03-10T13:42:30.874714Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba043\", \"container_id\": \"9cc1d7c3b4bd\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374656204, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901284Z\", \"created\": \"2021-03-10T13:42:47.615453Z\", \"started\": \"2021-03-10T13:50:59.332208Z\"}, \"mgr.gibba043.dnkmem\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba043.dnkmem\", \"hostname\": \"gibba043\", \"container_id\": \"154bd117b0e2\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 405484339, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901372Z\", \"created\": \"2021-03-10T13:42:50.131453Z\", \"started\": \"2021-03-10T13:51:17.124371Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba043\", \"container_id\": \"865d9dcbf7c8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48549068, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901455Z\", \"created\": \"2021-03-10T13:44:34.990842Z\", \"started\": \"2021-03-10T13:44:38.140721Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba043\", \"container_id\": \"4fa1e6ee0db0\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47469035, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901676Z\", \"created\": \"2021-03-10T13:44:57.874841Z\", \"started\": \"2021-03-10T13:45:01.533976Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba043\", \"container_id\": \"cb28a4d085dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47206891, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.901859Z\", \"created\": \"2021-03-10T13:45:20.878841Z\", \"started\": \"2021-03-10T13:45:24.157626Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba043\", \"container_id\": \"3c249f64edab\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48800727, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902037Z\", \"created\": \"2021-03-10T13:45:45.010840Z\", \"started\": \"2021-03-10T13:45:49.095912Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"3030f53c03bc\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33816576, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902212Z\", \"created\": \"2021-03-10T13:46:07.734839Z\", \"started\": \"2021-03-10T13:46:47.666765Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba043\", \"container_id\": \"e41dc542ba77\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23341301, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902302Z\", \"created\": \"2021-03-10T13:46:08.970839Z\", \"started\": \"2021-03-10T13:46:10.554442Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba043\", \"container_id\": \"bc4083225ccd\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.902386Z\", \"created\": \"2021-03-10T13:46:32.302839Z\", \"started\": \"2021-03-10T13:46:32.326196Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b7f28b82-26f4-4986-b100-8fd72cbd424e\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Sk1zjI-wQLd-eZF3-tUpd-Jpdk-Me9l-Nff2e1\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2ad182fc-ab4c-4b6c-82b1-631487e2292a\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"WSfqak-I5y1-Fw9Z-OAtl-lU9n-bhU3-PbAgEQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2e87ccff-6aca-42b9-977e-eacf5afbde08\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"rZtlGw-QWuY-3Ku4-eR7Y-4AcW-mEH6-QICjJ8\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e34f549d-6455-4902-8e28-b62de18179cf\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ag5ReA-NLlj-DVlC-i9UV-JcvN-34V4-vSOIzZ\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400LD375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38GF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:37.629464Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:50:46.201975Z\"}, \"mgr.gibba043.dnkmem\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:04.065213Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:33.150874Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:56.068309Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:19.016582Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:43.012457Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:46:40.637435Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.429800Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:46:21.570215Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:16.902524Z\", \"last_device_update\": \"2021-03-10T13:45:53.315291Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.143\"], \"172.21.15.254\": [\"172.21.2.143\"]}, \"last_host_check\": \"2021-03-10T13:52:13.009930Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:16.916250+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: cephadm 2021-03-10T13:52:16.918830+0000 mgr.gibba043.dnkmem (mgr.34373) 6 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:52:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:17.123790+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:17.134571+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:17.140126+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:17.141417+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:17 gibba043 bash[9839]: audit 2021-03-10T13:52:17.142565+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:52:18.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cluster 2021-03-10T13:52:17.123393+0000 mgr.gibba043.dnkmem (mgr.34373) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:18.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cephadm 2021-03-10T13:52:17.139405+0000 mgr.gibba043.dnkmem (mgr.34373) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:18.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cephadm 2021-03-10T13:52:17.141053+0000 mgr.gibba043.dnkmem (mgr.34373) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:18.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cephadm 2021-03-10T13:52:17.142090+0000 mgr.gibba043.dnkmem (mgr.34373) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:18.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cephadm 2021-03-10T13:52:17.142128+0000 mgr.gibba043.dnkmem (mgr.34373) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:18.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cephadm 2021-03-10T13:52:17.143158+0000 mgr.gibba043.dnkmem (mgr.34373) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:52:18.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cephadm 2021-03-10T13:52:17.143241+0000 mgr.gibba043.dnkmem (mgr.34373) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:52:18.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[31385]: cluster 2021-03-10T13:52:17.538124+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:52:18.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cluster 2021-03-10T13:52:17.123393+0000 mgr.gibba043.dnkmem (mgr.34373) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:18.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cephadm 2021-03-10T13:52:17.139405+0000 mgr.gibba043.dnkmem (mgr.34373) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:18.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cephadm 2021-03-10T13:52:17.141053+0000 mgr.gibba043.dnkmem (mgr.34373) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:18.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cephadm 2021-03-10T13:52:17.142090+0000 mgr.gibba043.dnkmem (mgr.34373) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:18.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cephadm 2021-03-10T13:52:17.142128+0000 mgr.gibba043.dnkmem (mgr.34373) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:18.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cephadm 2021-03-10T13:52:17.143158+0000 mgr.gibba043.dnkmem (mgr.34373) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:52:18.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cephadm 2021-03-10T13:52:17.143241+0000 mgr.gibba043.dnkmem (mgr.34373) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:52:18.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:18 gibba003 bash[12956]: cluster 2021-03-10T13:52:17.538124+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:52:19.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cluster 2021-03-10T13:52:17.123393+0000 mgr.gibba043.dnkmem (mgr.34373) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:19.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cephadm 2021-03-10T13:52:17.139405+0000 mgr.gibba043.dnkmem (mgr.34373) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cephadm 2021-03-10T13:52:17.141053+0000 mgr.gibba043.dnkmem (mgr.34373) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cephadm 2021-03-10T13:52:17.142090+0000 mgr.gibba043.dnkmem (mgr.34373) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cephadm 2021-03-10T13:52:17.142128+0000 mgr.gibba043.dnkmem (mgr.34373) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cephadm 2021-03-10T13:52:17.143158+0000 mgr.gibba043.dnkmem (mgr.34373) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:52:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cephadm 2021-03-10T13:52:17.143241+0000 mgr.gibba043.dnkmem (mgr.34373) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:52:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:18 gibba043 bash[9839]: cluster 2021-03-10T13:52:17.538124+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:52:19.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[31385]: audit 2021-03-10T13:52:19.057561+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.c"}]: dispatch 2021-03-10T13:52:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[31385]: audit 2021-03-10T13:52:19.061825+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[31385]: audit 2021-03-10T13:52:19.069569+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[31385]: audit 2021-03-10T13:52:19.070428+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[31385]: audit 2021-03-10T13:52:19.071257+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[31385]: audit 2021-03-10T13:52:19.072159+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:52:19.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[12956]: audit 2021-03-10T13:52:19.057561+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.c"}]: dispatch 2021-03-10T13:52:19.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[12956]: audit 2021-03-10T13:52:19.061825+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:19.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[12956]: audit 2021-03-10T13:52:19.069569+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[12956]: audit 2021-03-10T13:52:19.070428+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[12956]: audit 2021-03-10T13:52:19.071257+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:19 gibba003 bash[12956]: audit 2021-03-10T13:52:19.072159+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:52:20.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:19 gibba043 bash[9839]: audit 2021-03-10T13:52:19.057561+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.c"}]: dispatch 2021-03-10T13:52:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:19 gibba043 bash[9839]: audit 2021-03-10T13:52:19.061825+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:19 gibba043 bash[9839]: audit 2021-03-10T13:52:19.069569+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:19 gibba043 bash[9839]: audit 2021-03-10T13:52:19.070428+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:19 gibba043 bash[9839]: audit 2021-03-10T13:52:19.071257+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:19 gibba043 bash[9839]: audit 2021-03-10T13:52:19.072159+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:52:20.893 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[31385]: cephadm 2021-03-10T13:52:19.056459+0000 mgr.gibba043.dnkmem (mgr.34373) 14 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:52:20.893 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[31385]: cephadm 2021-03-10T13:52:19.071890+0000 mgr.gibba043.dnkmem (mgr.34373) 15 : cephadm [INF] Deploying daemon mon.c on gibba003 2021-03-10T13:52:20.893 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[31385]: cluster 2021-03-10T13:52:19.124431+0000 mgr.gibba043.dnkmem (mgr.34373) 16 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:20.894 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[12956]: cephadm 2021-03-10T13:52:19.056459+0000 mgr.gibba043.dnkmem (mgr.34373) 14 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:52:20.894 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[12956]: cephadm 2021-03-10T13:52:19.071890+0000 mgr.gibba043.dnkmem (mgr.34373) 15 : cephadm [INF] Deploying daemon mon.c on gibba003 2021-03-10T13:52:20.894 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[12956]: cluster 2021-03-10T13:52:19.124431+0000 mgr.gibba043.dnkmem (mgr.34373) 16 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:21.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:20 gibba043 bash[9839]: cephadm 2021-03-10T13:52:19.056459+0000 mgr.gibba043.dnkmem (mgr.34373) 14 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:52:21.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:20 gibba043 bash[9839]: cephadm 2021-03-10T13:52:19.071890+0000 mgr.gibba043.dnkmem (mgr.34373) 15 : cephadm [INF] Deploying daemon mon.c on gibba003 2021-03-10T13:52:21.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:20 gibba043 bash[9839]: cluster 2021-03-10T13:52:19.124431+0000 mgr.gibba043.dnkmem (mgr.34373) 16 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:21.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:20 gibba003 systemd[1]: Stopping Ceph mon.c for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:52:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[12956]: debug 2021-03-10T13:52:20.946+0000 7f4bb1e32700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:52:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:20 gibba003 bash[12956]: debug 2021-03-10T13:52:20.946+0000 7f4bb1e32700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-03-10T13:52:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:21 gibba003 docker[32268]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mon.c 2021-03-10T13:52:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:21 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.c.service: Succeeded. 2021-03-10T13:52:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:21 gibba003 systemd[1]: Stopped Ceph mon.c for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:21 gibba003 systemd[1]: Started Ceph mon.c for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[31385]: debug 2021-03-10T13:52:22.978+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[31385]: debug 2021-03-10T13:52:22.978+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[31385]: debug 2021-03-10T13:52:22.978+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[31385]: debug 2021-03-10T13:52:22.978+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[31385]: debug 2021-03-10T13:52:22.978+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:23.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.890+0000 7f0b9e3ef700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:52:23.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.890+0000 7f0b9e3ef700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:52:23.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.890+0000 7f0b9e3ef700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:52:23.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 0 load: jerasure load: lrc load: isa 2021-03-10T13:52:23.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:52:23.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:52:23.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:52:23.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: DB SUMMARY 2021-03-10T13:52:23.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:52:23.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:52:23.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 719 Bytes 2021-03-10T13:52:23.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000022.sst 2021-03-10T13:52:23.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000020.log size: 22379528 ; 2021-03-10T13:52:23.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:52:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:52:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:52:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.env: 0x558ca66771c0 2021-03-10T13:52:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:52:23.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.info_log: 0x558ca851b1e0 2021-03-10T13:52:23.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:52:23.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:52:23.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:52:23.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:52:23.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:52:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:52:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:52:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:52:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:52:23.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:52:23.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:52:23.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:52:23.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:52:23.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:52:23.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:52:23.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T13:52:23.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:52:23.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:52:23.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:52:23.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:52:23.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:52:23.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:52:23.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:52:23.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:52:23.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:52:23.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:52:23.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.write_buffer_manager: 0x558ca856fc50 2021-03-10T13:52:23.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:52:23.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:52:23.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:52:23.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:52:23.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:52:23.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:52:23.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:52:23.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:52:23.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:52:23.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:52:23.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:52:23.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:52:23.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:52:23.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:52:23.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.row_cache: None 2021-03-10T13:52:23.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:52:23.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:52:23.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:52:23.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:52:23.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:52:23.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:52:23.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:52:23.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:52:23.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:52:23.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:52:23.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:52:23.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:52:23.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:52:23.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:52:23.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:52:23.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:52:23.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:52:23.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:52:23.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:52:23.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:52:23.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:52:23.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:52:23.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:52:23.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:52:23.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:52:23.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:52:23.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:52:23.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:52:23.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:52:23.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:52:23.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:52:23.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:52:23.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:52:23.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:52:23.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:52:23.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:52:23.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:52:23.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2021-03-10T13:52:23.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:52:23.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:52:23.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.merge_operator: 2021-03-10T13:52:23.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:52:23.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:52:23.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:52:23.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.894+0000 7f0b9e3ef700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:52:23.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558ca84be230) 2021-03-10T13:52:23.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: cache_index_and_filter_blocks: 1 2021-03-10T13:52:23.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:52:23.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:52:23.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: pin_top_level_index_and_filter: 1 2021-03-10T13:52:23.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: index_type: 0 2021-03-10T13:52:23.217 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: data_block_index_type: 0 2021-03-10T13:52:23.217 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: index_shortening: 1 2021-03-10T13:52:23.217 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:52:23.217 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: hash_index_allow_collision: 1 2021-03-10T13:52:23.217 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: checksum: 1 2021-03-10T13:52:23.218 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: no_block_cache: 0 2021-03-10T13:52:23.218 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_cache: 0x558ca84f6510 2021-03-10T13:52:23.218 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_cache_name: BinnedLRUCache 2021-03-10T13:52:23.218 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_cache_options: 2021-03-10T13:52:23.218 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: capacity : 536870912 2021-03-10T13:52:23.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: num_shard_bits : 4 2021-03-10T13:52:23.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: strict_capacity_limit : 0 2021-03-10T13:52:23.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: high_pri_pool_ratio: 0.000 2021-03-10T13:52:23.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_cache_compressed: (nil) 2021-03-10T13:52:23.219 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: persistent_cache: (nil) 2021-03-10T13:52:23.220 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_size: 4096 2021-03-10T13:52:23.220 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_size_deviation: 10 2021-03-10T13:52:23.220 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_restart_interval: 16 2021-03-10T13:52:23.220 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: index_block_restart_interval: 1 2021-03-10T13:52:23.220 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: metadata_block_size: 4096 2021-03-10T13:52:23.221 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: partition_filters: 0 2021-03-10T13:52:23.221 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: use_delta_encoding: 1 2021-03-10T13:52:23.221 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:52:23.221 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: whole_key_filtering: 1 2021-03-10T13:52:23.221 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: verify_compression: 0 2021-03-10T13:52:23.222 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: read_amp_bytes_per_bit: 0 2021-03-10T13:52:23.222 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: format_version: 2 2021-03-10T13:52:23.222 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: enable_index_compression: 1 2021-03-10T13:52:23.222 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: block_align: 0 2021-03-10T13:52:23.222 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:52:23.223 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:52:23.223 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:52:23.223 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:52:23.223 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:52:23.223 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:52:23.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:52:23.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:52:23.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:52:23.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:52:23.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:52:23.225 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:52:23.225 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:52:23.225 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:52:23.225 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:52:23.225 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:52:23.225 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:52:23.226 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:52:23.226 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:52:23.226 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:52:23.226 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:52:23.227 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:52:23.227 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:52:23.227 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:52:23.227 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:52:23.227 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:52:23.228 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:52:23.228 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:52:23.228 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:52:23.228 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:52:23.228 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:52:23.229 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:52:23.229 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:52:23.229 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:52:23.229 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:52:23.229 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:52:23.230 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:52:23.230 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:52:23.230 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:52:23.230 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:52:23.230 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:52:23.231 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:52:23.231 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:52:23.231 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:52:23.231 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:52:23.232 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:52:23.232 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:52:23.232 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:52:23.232 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:52:23.232 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:52:23.233 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:52:23.233 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:52:23.233 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:52:23.233 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:52:23.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:52:23.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:52:23.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:52:23.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:52:23.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:52:23.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:52:23.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:52:23.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:52:23.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:52:23.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:52:23.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:52:23.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:52:23.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:52:23.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:52:23.237 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 24, last_sequence is 9257, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:52:23.237 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T13:52:23.237 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384342899540, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T13:52:23.237 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.898+0000 7f0b9e3ef700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T13:52:23.237 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.910+0000 7f0b9e3ef700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:52:23.238 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b9e3ef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384342923103, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 14725149, "table_properties": {"data_size": 14717527, "index_size": 5966, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 837, "raw_key_size": 7027, "raw_average_key_size": 22, "raw_value_size": 14708268, "raw_average_value_size": 47754, "num_data_blocks": 187, "num_entries": 308, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384342, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:52:23.238 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b9e3ef700 4 rocksdb: [version_set.cc:3826] Creating manifest 25 2021-03-10T13:52:23.238 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b9e3ef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384342923980, "job": 1, "event": "recovery_finished"} 2021-03-10T13:52:23.238 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b9e3ef700 4 rocksdb: DB pointer 0x558ca85bb800 2021-03-10T13:52:23.239 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b85202700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:52:23.239 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b85202700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:52:23.239 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** DB Stats ** 2021-03-10T13:52:23.239 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:23.239 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:52:23.240 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:52:23.240 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:52:23.240 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:52:23.240 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:52:23.240 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:52:23.241 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** Compaction Stats [default] ** 2021-03-10T13:52:23.241 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:23.241 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:23.241 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: L0 1/0 14.04 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.241 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: L6 1/0 62.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:23.242 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Sum 2/0 76.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.242 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.242 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** Compaction Stats [default] ** 2021-03-10T13:52:23.242 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:23.242 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:23.243 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.243 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:23.243 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Flush(GB): cumulative 0.014, interval 0.014 2021-03-10T13:52:23.243 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:52:23.243 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:52:23.244 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:52:23.244 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:52:23.244 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Cumulative compaction: 0.01 GB write, 522.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:23.244 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Interval compaction: 0.01 GB write, 522.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:23.244 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:52:23.245 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:52:23.245 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** Compaction Stats [default] ** 2021-03-10T13:52:23.245 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:23.245 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:23.245 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: L0 1/0 14.04 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.246 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: L6 1/0 62.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:23.246 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Sum 2/0 76.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.246 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:23.246 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** Compaction Stats [default] ** 2021-03-10T13:52:23.246 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:23.247 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:23.247 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1175.7 0.01 0.00 1 0.012 0 0 2021-03-10T13:52:23.247 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:23.247 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Flush(GB): cumulative 0.014, interval 0.000 2021-03-10T13:52:23.247 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:52:23.248 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:52:23.248 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:52:23.248 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:52:23.248 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Cumulative compaction: 0.01 GB write, 522.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:23.248 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:23.249 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:52:23.249 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:52:23.249 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b9e3ef700 0 starting mon.c rank 1 at public addrs [v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0] at bind addrs [v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:52:23.249 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.922+0000 7f0b9e3ef700 1 mon.c@-1(???) e3 preinit fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:52:23.249 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 0 mon.c@-1(???).mds e1 new map 2021-03-10T13:52:23.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 0 mon.c@-1(???).mds e1 print_map 2021-03-10T13:52:23.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: e1 2021-03-10T13:52:23.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:52:23.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:52:23.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: legacy client fscid: -1 2021-03-10T13:52:23.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: 2021-03-10T13:52:23.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: No filesystems configured 2021-03-10T13:52:23.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 0 mon.c@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:52:23.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 0 mon.c@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:23.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 0 mon.c@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:23.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 0 mon.c@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:23.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: cephadm 2021-03-10T13:52:19.056459+0000 mgr.gibba043.dnkmem (mgr.34373) 14 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:52:23.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: cephadm 2021-03-10T13:52:19.071890+0000 mgr.gibba043.dnkmem (mgr.34373) 15 : cephadm [INF] Deploying daemon mon.c on gibba003 2021-03-10T13:52:23.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: cluster 2021-03-10T13:52:19.124431+0000 mgr.gibba043.dnkmem (mgr.34373) 16 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:23.253 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:22 gibba003 bash[32348]: debug 2021-03-10T13:52:22.926+0000 7f0b9e3ef700 1 mon.c@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2021-03-10T13:52:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:21.125242+0000 mgr.gibba043.dnkmem (mgr.34373) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: audit 2021-03-10T13:52:21.936331+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37822136, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574468Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373607628, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574587Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49524244, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574698Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49251614, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574853Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46630174, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574976Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49157242, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575092Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22858956, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575205Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12373196, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:52:16.575263Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575316Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:19.071825Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.942857+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.943665+0000 mon.a (mon.0) 34 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.965484+0000 mon.a (mon.0) 35 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.972422+0000 mon.a (mon.0) 36 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.972457+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2021-03-10T13:52:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.972476+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.972756+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 11s), standbys: y, x 2021-03-10T13:52:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.980662+0000 mon.a (mon.0) 40 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.980676+0000 mon.a (mon.0) 41 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.980685+0000 mon.a (mon.0) 42 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.980693+0000 mon.a (mon.0) 43 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: cluster 2021-03-10T13:52:22.980701+0000 mon.a (mon.0) 44 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: audit 2021-03-10T13:52:22.983771+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:23 gibba043 bash[9839]: audit 2021-03-10T13:52:22.986035+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:21.125242+0000 mgr.gibba043.dnkmem (mgr.34373) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:24.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:21.125242+0000 mgr.gibba043.dnkmem (mgr.34373) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: audit 2021-03-10T13:52:21.936331+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37822136, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574468Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373607628, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574587Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49524244, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574698Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49251614, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574853Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46630174, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574976Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49157242, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575092Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22858956, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575205Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12373196, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:52:16.575263Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575316Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:19.071825Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.942857+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.943665+0000 mon.a (mon.0) 34 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.965484+0000 mon.a (mon.0) 35 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.972422+0000 mon.a (mon.0) 36 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.972457+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2021-03-10T13:52:24.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.972476+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:24.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.972756+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 11s), standbys: y, x 2021-03-10T13:52:24.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.980662+0000 mon.a (mon.0) 40 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.980676+0000 mon.a (mon.0) 41 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:24.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.980685+0000 mon.a (mon.0) 42 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: audit 2021-03-10T13:52:21.936331+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37822136, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574468Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373607628, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574587Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49524244, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574698Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49251614, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574853Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46630174, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.574976Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49157242, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575092Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22858956, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575205Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12373196, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:52:16.575263Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:16.575316Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:19.071825Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.942857+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.943665+0000 mon.a (mon.0) 34 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.965484+0000 mon.a (mon.0) 35 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.972422+0000 mon.a (mon.0) 36 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.972457+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2021-03-10T13:52:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.972476+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.972756+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 11s), standbys: y, x 2021-03-10T13:52:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.980662+0000 mon.a (mon.0) 40 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.980676+0000 mon.a (mon.0) 41 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.980685+0000 mon.a (mon.0) 42 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.980693+0000 mon.a (mon.0) 43 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: cluster 2021-03-10T13:52:22.980701+0000 mon.a (mon.0) 44 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: audit 2021-03-10T13:52:22.983771+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:24.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[31385]: audit 2021-03-10T13:52:22.986035+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.980693+0000 mon.a (mon.0) 43 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: cluster 2021-03-10T13:52:22.980701+0000 mon.a (mon.0) 44 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: audit 2021-03-10T13:52:22.983771+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:23 gibba003 bash[32348]: audit 2021-03-10T13:52:22.986035+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:24 gibba043 bash[9839]: cluster 2021-03-10T13:52:23.126480+0000 mgr.gibba043.dnkmem (mgr.34373) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:24 gibba003 bash[31385]: cluster 2021-03-10T13:52:23.126480+0000 mgr.gibba043.dnkmem (mgr.34373) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:25.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:25 gibba003 bash[32348]: cluster 2021-03-10T13:52:23.126480+0000 mgr.gibba043.dnkmem (mgr.34373) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: cluster 2021-03-10T13:52:25.128677+0000 mgr.gibba043.dnkmem (mgr.34373) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.667801+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43138416, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662066Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373712486, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662548Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"bc2a1df68b29\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 40611348, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662870Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:52:21.960289Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49283072, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.663171Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49692016, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.663920Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46619688, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.664592Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49241128, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.665226Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23005757, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.665850Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12771655, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.666179Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.666475Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:19.071825Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:26.666816Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.671166+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.673762+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.675927+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.681530+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.682941+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:27 gibba043 bash[9839]: audit 2021-03-10T13:52:26.684108+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:52:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: cluster 2021-03-10T13:52:25.128677+0000 mgr.gibba043.dnkmem (mgr.34373) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: cluster 2021-03-10T13:52:25.128677+0000 mgr.gibba043.dnkmem (mgr.34373) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.667801+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43138416, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662066Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373712486, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662548Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"bc2a1df68b29\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 40611348, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662870Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:52:21.960289Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49283072, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.663171Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49692016, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.663920Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46619688, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.664592Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49241128, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.665226Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23005757, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.665850Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12771655, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.666179Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.666475Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:19.071825Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:26.666816Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.671166+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.673762+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.675927+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.681530+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.682941+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[31385]: audit 2021-03-10T13:52:26.684108+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:52:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.667801+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba003","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"01c3ec489599\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43138416, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662066Z\", \"created\": \"2021-03-10T13:41:02.654424Z\", \"started\": \"2021-03-10T13:52:05.578940Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba003\", \"container_id\": \"53ffea2dbd22\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373712486, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662548Z\", \"created\": \"2021-03-10T13:41:09.854424Z\", \"started\": \"2021-03-10T13:51:56.659047Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba003\", \"container_id\": \"bc2a1df68b29\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 40611348, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.662870Z\", \"created\": \"2021-03-10T13:42:17.618426Z\", \"started\": \"2021-03-10T13:52:21.960289Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba003\", \"container_id\": \"8f0b52d3cade\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49283072, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.663171Z\", \"created\": \"2021-03-10T13:43:04.558427Z\", \"started\": \"2021-03-10T13:43:07.346285Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba003\", \"container_id\": \"cc8e95189180\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49692016, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.663920Z\", \"created\": \"2021-03-10T13:43:25.670427Z\", \"started\": \"2021-03-10T13:43:52.130582Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba003\", \"container_id\": \"6a58ef7f7d42\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46619688, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.664592Z\", \"created\": \"2021-03-10T13:43:51.772801Z\", \"started\": \"2021-03-10T13:43:55.442950Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba003\", \"container_id\": \"f5835a5b1877\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49241128, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.665226Z\", \"created\": \"2021-03-10T13:44:15.080913Z\", \"started\": \"2021-03-10T13:44:18.055588Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"09ef7847eaa6\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23005757, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.665850Z\", \"created\": \"2021-03-10T13:46:09.388916Z\", \"started\": \"2021-03-10T13:46:12.160337Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba003\", \"container_id\": \"3766a55d6174\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12771655, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.666179Z\", \"created\": \"2021-03-10T13:46:19.384917Z\", \"started\": \"2021-03-10T13:51:37.619927Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba003.uvtpth\", \"hostname\": \"gibba003\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:52:26.666475Z\", \"created\": \"2021-03-10T13:48:10.520919Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cd6542e9-2018-4531-8712-34829d2fa049\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"BTIppL-rsIo-v0US-3Otc-MFlM-7URJ-lryr7p\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2bee355c-eb6f-4174-a4ad-c1927a01db68\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"GKqxQM-gULj-NY6a-WkNR-iyib-WwOC-Jd2sp1\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d1969538-9fbe-4d1c-a6a2-564d7b3d7b92\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"erwzg6-NcGm-bFms-8olY-J7Kc-XUjj-NowWpL\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0d26860c-9743-487b-8483-5d559e1f056b\", \"cluster_fsid\": \"33572ad6-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"d0j4Iq-sqN7-HnB8-dTYn-FoLr-lIMU-QNXmKf\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200008A375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9IVK2O6F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:19.071825Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:51:43.672106Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:02.893098Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:45.373143Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:49.505574Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:13.195559Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:08.983532Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba043.dnkmem\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:51:31.273224Z\"}, \"rgw.r.z.gibba003.uvtpth\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:07.601089Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:02.502441Z\"}}, \"last_daemon_update\": \"2021-03-10T13:52:26.666816Z\", \"last_device_update\": \"2021-03-10T13:44:21.206613Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.103\"], \"172.21.15.254\": [\"172.21.2.103\"]}, \"last_host_check\": \"2021-03-10T13:51:56.826229Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:52:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.671166+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.673762+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:52:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.675927+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.681530+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.682941+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:27 gibba003 bash[32348]: audit 2021-03-10T13:52:26.684108+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:52:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:28 gibba043 bash[9839]: cephadm 2021-03-10T13:52:26.680970+0000 mgr.gibba043.dnkmem (mgr.34373) 20 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:28 gibba043 bash[9839]: cephadm 2021-03-10T13:52:26.682535+0000 mgr.gibba043.dnkmem (mgr.34373) 21 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:28 gibba043 bash[9839]: cephadm 2021-03-10T13:52:26.683775+0000 mgr.gibba043.dnkmem (mgr.34373) 22 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:28 gibba043 bash[9839]: cephadm 2021-03-10T13:52:26.683825+0000 mgr.gibba043.dnkmem (mgr.34373) 23 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:28 gibba043 bash[9839]: cephadm 2021-03-10T13:52:26.684809+0000 mgr.gibba043.dnkmem (mgr.34373) 24 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:52:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:28 gibba043 bash[9839]: cephadm 2021-03-10T13:52:26.684850+0000 mgr.gibba043.dnkmem (mgr.34373) 25 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:52:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[31385]: cephadm 2021-03-10T13:52:26.680970+0000 mgr.gibba043.dnkmem (mgr.34373) 20 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[31385]: cephadm 2021-03-10T13:52:26.682535+0000 mgr.gibba043.dnkmem (mgr.34373) 21 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[31385]: cephadm 2021-03-10T13:52:26.683775+0000 mgr.gibba043.dnkmem (mgr.34373) 22 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[31385]: cephadm 2021-03-10T13:52:26.683825+0000 mgr.gibba043.dnkmem (mgr.34373) 23 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[31385]: cephadm 2021-03-10T13:52:26.684809+0000 mgr.gibba043.dnkmem (mgr.34373) 24 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:52:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[31385]: cephadm 2021-03-10T13:52:26.684850+0000 mgr.gibba043.dnkmem (mgr.34373) 25 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:52:28.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[32348]: cephadm 2021-03-10T13:52:26.680970+0000 mgr.gibba043.dnkmem (mgr.34373) 20 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:28.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[32348]: cephadm 2021-03-10T13:52:26.682535+0000 mgr.gibba043.dnkmem (mgr.34373) 21 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:28.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[32348]: cephadm 2021-03-10T13:52:26.683775+0000 mgr.gibba043.dnkmem (mgr.34373) 22 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:28.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[32348]: cephadm 2021-03-10T13:52:26.683825+0000 mgr.gibba043.dnkmem (mgr.34373) 23 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:28.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[32348]: cephadm 2021-03-10T13:52:26.684809+0000 mgr.gibba043.dnkmem (mgr.34373) 24 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:52:28.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:28 gibba003 bash[32348]: cephadm 2021-03-10T13:52:26.684850+0000 mgr.gibba043.dnkmem (mgr.34373) 25 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:52:29.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: cluster 2021-03-10T13:52:27.129693+0000 mgr.gibba043.dnkmem (mgr.34373) 26 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:29.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: audit 2021-03-10T13:52:28.855171+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.b"}]: dispatch 2021-03-10T13:52:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: audit 2021-03-10T13:52:28.864967+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: audit 2021-03-10T13:52:28.867249+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: audit 2021-03-10T13:52:28.868019+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: audit 2021-03-10T13:52:28.868758+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:29 gibba043 bash[9839]: audit 2021-03-10T13:52:28.869728+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:52:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: cluster 2021-03-10T13:52:27.129693+0000 mgr.gibba043.dnkmem (mgr.34373) 26 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: audit 2021-03-10T13:52:28.855171+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.b"}]: dispatch 2021-03-10T13:52:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: audit 2021-03-10T13:52:28.864967+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: audit 2021-03-10T13:52:28.867249+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: audit 2021-03-10T13:52:28.868019+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: audit 2021-03-10T13:52:28.868758+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[31385]: audit 2021-03-10T13:52:28.869728+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:52:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: cluster 2021-03-10T13:52:27.129693+0000 mgr.gibba043.dnkmem (mgr.34373) 26 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: audit 2021-03-10T13:52:28.855171+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.b"}]: dispatch 2021-03-10T13:52:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: audit 2021-03-10T13:52:28.864967+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: audit 2021-03-10T13:52:28.867249+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: audit 2021-03-10T13:52:28.868019+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: audit 2021-03-10T13:52:28.868758+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:29.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:29 gibba003 bash[32348]: audit 2021-03-10T13:52:28.869728+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:52:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:30 gibba043 bash[9839]: cephadm 2021-03-10T13:52:28.854813+0000 mgr.gibba043.dnkmem (mgr.34373) 27 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:52:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:30 gibba043 bash[9839]: cephadm 2021-03-10T13:52:28.869440+0000 mgr.gibba043.dnkmem (mgr.34373) 28 : cephadm [INF] Deploying daemon mon.b on gibba043 2021-03-10T13:52:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:30 gibba043 bash[9839]: cluster 2021-03-10T13:52:29.131455+0000 mgr.gibba043.dnkmem (mgr.34373) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:30.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:30 gibba003 bash[31385]: cephadm 2021-03-10T13:52:28.854813+0000 mgr.gibba043.dnkmem (mgr.34373) 27 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:52:30.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:30 gibba003 bash[31385]: cephadm 2021-03-10T13:52:28.869440+0000 mgr.gibba043.dnkmem (mgr.34373) 28 : cephadm [INF] Deploying daemon mon.b on gibba043 2021-03-10T13:52:30.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:30 gibba003 bash[31385]: cluster 2021-03-10T13:52:29.131455+0000 mgr.gibba043.dnkmem (mgr.34373) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:30.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:30 gibba003 bash[32348]: cephadm 2021-03-10T13:52:28.854813+0000 mgr.gibba043.dnkmem (mgr.34373) 27 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:52:30.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:30 gibba003 bash[32348]: cephadm 2021-03-10T13:52:28.869440+0000 mgr.gibba043.dnkmem (mgr.34373) 28 : cephadm [INF] Deploying daemon mon.b on gibba043 2021-03-10T13:52:30.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:30 gibba003 bash[32348]: cluster 2021-03-10T13:52:29.131455+0000 mgr.gibba043.dnkmem (mgr.34373) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:31.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:31 gibba043 systemd[1]: Stopping Ceph mon.b for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:52:31.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:31 gibba043 bash[9839]: debug 2021-03-10T13:52:31.117+0000 7efc65ee4700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:52:31.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:31 gibba043 bash[9839]: debug 2021-03-10T13:52:31.117+0000 7efc65ee4700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-03-10T13:52:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:32 gibba043 docker[23938]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-mon.b 2021-03-10T13:52:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:32 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@mon.b.service: Succeeded. 2021-03-10T13:52:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:32 gibba043 systemd[1]: Stopped Ceph mon.b for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:32 gibba043 systemd[1]: Started Ceph mon.b for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:33.325 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:52:33.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.273+0000 7fe599906700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:52:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.273+0000 7fe599906700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:52:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.273+0000 7fe599906700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:52:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 0 load: jerasure load: lrc load: isa 2021-03-10T13:52:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:52:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:52:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:52:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: DB SUMMARY 2021-03-10T13:52:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:52:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:52:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 719 Bytes 2021-03-10T13:52:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000022.sst 2021-03-10T13:52:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000020.log size: 24116990 ; 2021-03-10T13:52:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:52:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:52:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:52:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.env: 0x557a5b9d01c0 2021-03-10T13:52:33.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:52:33.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.info_log: 0x557a5c9291e0 2021-03-10T13:52:33.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:52:33.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:52:33.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:52:33.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:52:33.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:52:33.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:52:33.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:52:33.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:52:33.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:52:33.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:52:33.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:52:33.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:52:33.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:52:33.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:52:33.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:52:33.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T13:52:33.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:52:33.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:52:33.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:52:33.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:52:33.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:52:33.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:52:33.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:52:33.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:52:33.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:52:33.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:52:33.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.write_buffer_manager: 0x557a5c97dc50 2021-03-10T13:52:33.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:52:33.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:52:33.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:52:33.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:52:33.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:52:33.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:52:33.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:52:33.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:52:33.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:52:33.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:52:33.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:52:33.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:52:33.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:52:33.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:52:33.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.row_cache: None 2021-03-10T13:52:33.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:52:33.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:52:33.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:52:33.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:52:33.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:52:33.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:52:33.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:52:33.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:52:33.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:52:33.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:52:33.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:52:33.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:52:33.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:52:33.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:52:33.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:52:33.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:52:33.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:52:33.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:52:33.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:52:33.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:52:33.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:52:33.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:52:33.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:52:33.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:52:33.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:52:33.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:52:33.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:52:33.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:52:33.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:52:33.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:52:33.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:52:33.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:52:33.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:52:33.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:52:33.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:52:33.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:52:33.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:52:33.542 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2021-03-10T13:52:33.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:52:33.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:52:33.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.merge_operator: 2021-03-10T13:52:33.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:52:33.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:52:33.543 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:52:33.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:52:33.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557a5c8cc230) 2021-03-10T13:52:33.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: cache_index_and_filter_blocks: 1 2021-03-10T13:52:33.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:52:33.544 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:52:33.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: pin_top_level_index_and_filter: 1 2021-03-10T13:52:33.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: index_type: 0 2021-03-10T13:52:33.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: data_block_index_type: 0 2021-03-10T13:52:33.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: index_shortening: 1 2021-03-10T13:52:33.545 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:52:33.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: hash_index_allow_collision: 1 2021-03-10T13:52:33.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: checksum: 1 2021-03-10T13:52:33.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: no_block_cache: 0 2021-03-10T13:52:33.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_cache: 0x557a5c904510 2021-03-10T13:52:33.546 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_cache_name: BinnedLRUCache 2021-03-10T13:52:33.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_cache_options: 2021-03-10T13:52:33.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: capacity : 536870912 2021-03-10T13:52:33.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: num_shard_bits : 4 2021-03-10T13:52:33.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: strict_capacity_limit : 0 2021-03-10T13:52:33.547 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: high_pri_pool_ratio: 0.000 2021-03-10T13:52:33.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_cache_compressed: (nil) 2021-03-10T13:52:33.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: persistent_cache: (nil) 2021-03-10T13:52:33.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_size: 4096 2021-03-10T13:52:33.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_size_deviation: 10 2021-03-10T13:52:33.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_restart_interval: 16 2021-03-10T13:52:33.548 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: index_block_restart_interval: 1 2021-03-10T13:52:33.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: metadata_block_size: 4096 2021-03-10T13:52:33.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: partition_filters: 0 2021-03-10T13:52:33.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: use_delta_encoding: 1 2021-03-10T13:52:33.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:52:33.549 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: whole_key_filtering: 1 2021-03-10T13:52:33.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: verify_compression: 0 2021-03-10T13:52:33.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: read_amp_bytes_per_bit: 0 2021-03-10T13:52:33.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: format_version: 2 2021-03-10T13:52:33.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: enable_index_compression: 1 2021-03-10T13:52:33.550 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: block_align: 0 2021-03-10T13:52:33.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:52:33.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:52:33.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:52:33.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:52:33.551 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:52:33.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:52:33.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:52:33.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:52:33.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:52:33.552 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:52:33.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:52:33.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:52:33.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:52:33.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:52:33.553 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:52:33.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:52:33.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:52:33.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:52:33.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:52:33.554 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:52:33.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:52:33.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:52:33.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:52:33.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:52:33.555 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:52:33.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:52:33.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:52:33.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:52:33.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:52:33.556 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:52:33.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:52:33.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:52:33.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:52:33.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:52:33.557 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:52:33.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:52:33.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:52:33.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:52:33.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:52:33.558 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:52:33.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:52:33.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:52:33.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:52:33.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:52:33.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:52:33.559 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:52:33.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:52:33.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:52:33.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:52:33.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:52:33.560 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:52:33.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:52:33.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:52:33.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:52:33.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:52:33.561 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:52:33.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:52:33.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:52:33.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:52:33.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:52:33.562 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:52:33.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:52:33.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:52:33.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:52:33.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:52:33.563 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:52:33.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:52:33.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:52:33.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 24, last_sequence is 9172, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:52:33.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T13:52:33.564 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384353281111, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T13:52:33.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.277+0000 7fe599906700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T13:52:33.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.289+0000 7fe599906700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:52:33.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe599906700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384353304468, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 15858413, "table_properties": {"data_size": 15849781, "index_size": 6848, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 965, "raw_key_size": 7913, "raw_average_key_size": 22, "raw_value_size": 15839240, "raw_average_value_size": 44997, "num_data_blocks": 215, "num_entries": 352, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384353, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:52:33.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe599906700 4 rocksdb: [version_set.cc:3826] Creating manifest 25 2021-03-10T13:52:33.565 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe599906700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384353305346, "job": 1, "event": "recovery_finished"} 2021-03-10T13:52:33.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe599906700 4 rocksdb: DB pointer 0x557a5c9c9800 2021-03-10T13:52:33.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe580719700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:52:33.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe580719700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:52:33.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** DB Stats ** 2021-03-10T13:52:33.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:33.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:52:33.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:52:33.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:52:33.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:52:33.567 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:52:33.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:52:33.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** Compaction Stats [default] ** 2021-03-10T13:52:33.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:33.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:33.568 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: L0 1/0 15.12 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: L6 1/0 62.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:33.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Sum 2/0 77.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** Compaction Stats [default] ** 2021-03-10T13:52:33.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:33.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:33.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:33.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Flush(GB): cumulative 0.015, interval 0.015 2021-03-10T13:52:33.570 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:52:33.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:52:33.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:52:33.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:52:33.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Cumulative compaction: 0.01 GB write, 569.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:33.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Interval compaction: 0.01 GB write, 569.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:33.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:52:33.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:52:33.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** Compaction Stats [default] ** 2021-03-10T13:52:33.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:33.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:33.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: L0 1/0 15.12 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: L6 1/0 62.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:33.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Sum 2/0 77.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:52:33.573 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** Compaction Stats [default] ** 2021-03-10T13:52:33.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:52:33.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:52:33.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1209.2 0.01 0.00 1 0.013 0 0 2021-03-10T13:52:33.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:52:33.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Flush(GB): cumulative 0.015, interval 0.000 2021-03-10T13:52:33.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:52:33.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:52:33.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:52:33.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:52:33.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Cumulative compaction: 0.01 GB write, 569.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:33.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:52:33.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:52:33.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:52:33.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.301+0000 7fe599906700 0 starting mon.b rank 2 at public addrs [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] at bind addrs [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:52:33.576 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 1 mon.b@-1(???) e3 preinit fsid 33572ad6-81a6-11eb-9080-001a4aab830c 2021-03-10T13:52:33.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 0 mon.b@-1(???).mds e1 new map 2021-03-10T13:52:33.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 0 mon.b@-1(???).mds e1 print_map 2021-03-10T13:52:33.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: e1 2021-03-10T13:52:33.577 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:52:33.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:52:33.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: legacy client fscid: -1 2021-03-10T13:52:33.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: 2021-03-10T13:52:33.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: No filesystems configured 2021-03-10T13:52:33.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 0 mon.b@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:52:33.578 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:33.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:33.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:52:33.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: cephadm 2021-03-10T13:52:28.854813+0000 mgr.gibba043.dnkmem (mgr.34373) 27 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:52:33.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: cephadm 2021-03-10T13:52:28.869440+0000 mgr.gibba043.dnkmem (mgr.34373) 28 : cephadm [INF] Deploying daemon mon.b on gibba043 2021-03-10T13:52:33.579 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: cluster 2021-03-10T13:52:29.131455+0000 mgr.gibba043.dnkmem (mgr.34373) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:33.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 1 mon.b@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2021-03-10T13:52:33.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:52:33.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:52:33.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:52:33.580 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:52:33.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:52:33.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:52:33.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:52:33.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:52:33.581 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:52:33.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:52:33.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:52:33.582 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:33 gibba043 bash[24019]: debug 2021-03-10T13:52:33.305+0000 7fe599906700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:52:33.582 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:52:33.583 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (55s) 6s ago 6m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:52:33.583 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (6m) 16s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:52:33.583 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (76s) 16s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:52:33.583 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (94s) 16s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:52:33.583 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (36s) 6s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:52:33.584 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (27s) 6s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:52:33.584 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 starting - - 2021-03-10T13:52:33.584 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (11s) 6s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:52:33.584 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (6m) 6s ago 6m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:52:33.584 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (6m) 16s ago 6m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:52:33.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (9m) 6s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8f0b52d3cade 2021-03-10T13:52:33.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (8m) 6s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:52:33.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (8m) 6s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:52:33.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (8m) 6s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:52:33.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (7m) 16s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:52:33.586 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (7m) 16s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:52:33.586 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (7m) 16s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:52:33.586 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (6m) 16s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:52:33.586 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (5m) 16s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:52:33.586 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:52:33.803 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:52:33.803 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:52:33.803 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:52:33.803 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:52:33.804 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:52:33.804 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:52:33.804 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:33.804 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:52:33.805 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:52:33.805 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:52:33.805 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:52:33.805 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:52:33.805 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:52:33.806 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2021-03-10T13:52:33.806 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T13:52:33.806 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:52:33.806 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:52:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:34 gibba003 bash[31385]: debug 2021-03-10T13:52:34.219+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:34.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:34 gibba003 bash[31385]: debug 2021-03-10T13:52:34.219+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:34.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:34 gibba003 bash[31385]: debug 2021-03-10T13:52:34.219+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:34.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:34 gibba003 bash[31385]: debug 2021-03-10T13:52:34.219+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:34.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:34 gibba003 bash[31385]: debug 2021-03-10T13:52:34.219+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.223+0000 7fe486a75700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.223+0000 7fe486a75700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.223+0000 7fe486a75700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.223+0000 7fe486a75700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.223+0000 7fe486a75700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.259+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.259+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.259+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.259+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: debug 2021-03-10T13:52:39.259+0000 7fe485272700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.223465+0000 mon.a (mon.0) 56 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.223475+0000 mon.a (mon.0) 57 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.223480+0000 mon.a (mon.0) 58 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.223484+0000 mon.a (mon.0) 59 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.223491+0000 mon.a (mon.0) 60 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.224116+0000 mon.a (mon.0) 61 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:39.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.224270+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:39.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:34.226911+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:52:39.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:35.136629+0000 mgr.gibba043.dnkmem (mgr.34373) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:39.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:37.137569+0000 mgr.gibba043.dnkmem (mgr.34373) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:39.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.226387+0000 mon.a (mon.0) 62 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:52:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.223465+0000 mon.a (mon.0) 56 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.223475+0000 mon.a (mon.0) 57 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.223480+0000 mon.a (mon.0) 58 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.223484+0000 mon.a (mon.0) 59 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.223491+0000 mon.a (mon.0) 60 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.224116+0000 mon.a (mon.0) 61 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.224270+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:34.226911+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:52:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:35.136629+0000 mgr.gibba043.dnkmem (mgr.34373) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:37.137569+0000 mgr.gibba043.dnkmem (mgr.34373) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.226387+0000 mon.a (mon.0) 62 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:52:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.230029+0000 mon.a (mon.0) 63 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.230093+0000 mon.a (mon.0) 64 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.230121+0000 mon.a (mon.0) 65 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.230148+0000 mon.a (mon.0) 66 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.230188+0000 mon.a (mon.0) 67 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.230334+0000 mon.a (mon.0) 68 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:39.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.231351+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:39.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.254292+0000 mon.a (mon.0) 69 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:39.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.261542+0000 mon.a (mon.0) 70 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:39.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.261565+0000 mon.a (mon.0) 71 : cluster [DBG] fsmap 2021-03-10T13:52:39.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.261577+0000 mon.a (mon.0) 72 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:39.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.261827+0000 mon.a (mon.0) 73 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 27s), standbys: y, x 2021-03-10T13:52:39.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.265363+0000 mon.a (mon.0) 74 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.265372+0000 mon.a (mon.0) 75 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.265382+0000 mon.a (mon.0) 76 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.265394+0000 mon.a (mon.0) 77 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.265403+0000 mon.a (mon.0) 78 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: audit 2021-03-10T13:52:39.277441+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:39.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: audit 2021-03-10T13:52:39.280089+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:39.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[32348]: audit 2021-03-10T13:52:39.281109+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:39.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.230029+0000 mon.a (mon.0) 63 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.230093+0000 mon.a (mon.0) 64 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.230121+0000 mon.a (mon.0) 65 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.230148+0000 mon.a (mon.0) 66 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.230188+0000 mon.a (mon.0) 67 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.230334+0000 mon.a (mon.0) 68 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:39.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.231351+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:39.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.254292+0000 mon.a (mon.0) 69 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:39.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.261542+0000 mon.a (mon.0) 70 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:39.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.261565+0000 mon.a (mon.0) 71 : cluster [DBG] fsmap 2021-03-10T13:52:39.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.261577+0000 mon.a (mon.0) 72 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:39.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.261827+0000 mon.a (mon.0) 73 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 27s), standbys: y, x 2021-03-10T13:52:39.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.265363+0000 mon.a (mon.0) 74 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.708 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.265372+0000 mon.a (mon.0) 75 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.265382+0000 mon.a (mon.0) 76 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.265394+0000 mon.a (mon.0) 77 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.265403+0000 mon.a (mon.0) 78 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: audit 2021-03-10T13:52:39.277441+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:39.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: audit 2021-03-10T13:52:39.280089+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:39.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:39 gibba003 bash[31385]: audit 2021-03-10T13:52:39.281109+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.223465+0000 mon.a (mon.0) 56 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.223475+0000 mon.a (mon.0) 57 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.223480+0000 mon.a (mon.0) 58 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.223484+0000 mon.a (mon.0) 59 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.223491+0000 mon.a (mon.0) 60 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.224116+0000 mon.a (mon.0) 61 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.224270+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:34.226911+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:52:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:35.136629+0000 mgr.gibba043.dnkmem (mgr.34373) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:37.137569+0000 mgr.gibba043.dnkmem (mgr.34373) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.226387+0000 mon.a (mon.0) 62 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:52:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.230029+0000 mon.a (mon.0) 63 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.230093+0000 mon.a (mon.0) 64 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.230121+0000 mon.a (mon.0) 65 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.230148+0000 mon.a (mon.0) 66 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.230188+0000 mon.a (mon.0) 67 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.230334+0000 mon.a (mon.0) 68 : cluster [INF] mon.a calling monitor election 2021-03-10T13:52:39.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.231351+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:52:39.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.254292+0000 mon.a (mon.0) 69 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:52:39.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.261542+0000 mon.a (mon.0) 70 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.103:3300/0,v1:172.21.2.103:6789/0],b=[v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0],c=[v2:172.21.2.103:3301/0,v1:172.21.2.103:6790/0]} 2021-03-10T13:52:39.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.261565+0000 mon.a (mon.0) 71 : cluster [DBG] fsmap 2021-03-10T13:52:39.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.261577+0000 mon.a (mon.0) 72 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T13:52:39.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.261827+0000 mon.a (mon.0) 73 : cluster [DBG] mgrmap e25: gibba043.dnkmem(active, since 27s), standbys: y, x 2021-03-10T13:52:39.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.265363+0000 mon.a (mon.0) 74 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.265372+0000 mon.a (mon.0) 75 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:52:39.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.265382+0000 mon.a (mon.0) 76 : cluster [ERR] daemon rgw.r.z.gibba003.uvtpth on gibba003 is in error state 2021-03-10T13:52:39.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.265394+0000 mon.a (mon.0) 77 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.265403+0000 mon.a (mon.0) 78 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:52:39.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: audit 2021-03-10T13:52:39.277441+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:39.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: audit 2021-03-10T13:52:39.280089+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:39.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:39 gibba043 bash[24019]: audit 2021-03-10T13:52:39.281109+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34373 ' entity='' 2021-03-10T13:52:40.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:40 gibba003 bash[31385]: cluster 2021-03-10T13:52:39.139646+0000 mgr.gibba043.dnkmem (mgr.34373) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:40.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:40 gibba003 bash[32348]: cluster 2021-03-10T13:52:39.139646+0000 mgr.gibba043.dnkmem (mgr.34373) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:40.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:40 gibba043 bash[24019]: cluster 2021-03-10T13:52:39.139646+0000 mgr.gibba043.dnkmem (mgr.34373) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:42.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:42 gibba003 bash[31385]: cluster 2021-03-10T13:52:41.140916+0000 mgr.gibba043.dnkmem (mgr.34373) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:42.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:42 gibba003 bash[32348]: cluster 2021-03-10T13:52:41.140916+0000 mgr.gibba043.dnkmem (mgr.34373) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:43.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:42 gibba043 bash[24019]: cluster 2021-03-10T13:52:41.140916+0000 mgr.gibba043.dnkmem (mgr.34373) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.399 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: audit 2021-03-10T13:52:43.131218+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:44.400 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: audit 2021-03-10T13:52:43.136477+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:44.400 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: cluster 2021-03-10T13:52:43.141520+0000 mgr.gibba043.dnkmem (mgr.34373) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.400 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: audit 2021-03-10T13:52:43.141832+0000 mon.c (mon.1) 5 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:44.400 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: cephadm 2021-03-10T13:52:43.142031+0000 mgr.gibba043.dnkmem (mgr.34373) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:52:44.400 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: audit 2021-03-10T13:52:43.143443+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:44.401 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: audit 2021-03-10T13:52:43.145337+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:44.401 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: cephadm 2021-03-10T13:52:43.148234+0000 mgr.gibba043.dnkmem (mgr.34373) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba003 2021-03-10T13:52:44.401 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[31385]: audit 2021-03-10T13:52:43.148966+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:52:44.402 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: audit 2021-03-10T13:52:43.131218+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:44.402 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: audit 2021-03-10T13:52:43.136477+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:44.402 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: cluster 2021-03-10T13:52:43.141520+0000 mgr.gibba043.dnkmem (mgr.34373) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.402 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: audit 2021-03-10T13:52:43.141832+0000 mon.c (mon.1) 5 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:44.402 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: cephadm 2021-03-10T13:52:43.142031+0000 mgr.gibba043.dnkmem (mgr.34373) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:52:44.403 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: audit 2021-03-10T13:52:43.143443+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:44.403 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: audit 2021-03-10T13:52:43.145337+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:44.403 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: cephadm 2021-03-10T13:52:43.148234+0000 mgr.gibba043.dnkmem (mgr.34373) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba003 2021-03-10T13:52:44.403 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:44 gibba003 bash[32348]: audit 2021-03-10T13:52:43.148966+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:52:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: audit 2021-03-10T13:52:43.131218+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: audit 2021-03-10T13:52:43.136477+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: cluster 2021-03-10T13:52:43.141520+0000 mgr.gibba043.dnkmem (mgr.34373) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: audit 2021-03-10T13:52:43.141832+0000 mon.c (mon.1) 5 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: cephadm 2021-03-10T13:52:43.142031+0000 mgr.gibba043.dnkmem (mgr.34373) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:52:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: audit 2021-03-10T13:52:43.143443+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: audit 2021-03-10T13:52:43.145337+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:44.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: cephadm 2021-03-10T13:52:43.148234+0000 mgr.gibba043.dnkmem (mgr.34373) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba003 2021-03-10T13:52:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:44 gibba043 bash[24019]: audit 2021-03-10T13:52:43.148966+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:52:46.340 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: audit 2021-03-10T13:52:45.077378+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:46.341 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: cephadm 2021-03-10T13:52:45.080567+0000 mgr.gibba043.dnkmem (mgr.34373) 41 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:52:46.341 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: audit 2021-03-10T13:52:45.080734+0000 mon.c (mon.1) 9 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:52:46.341 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: audit 2021-03-10T13:52:45.081043+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:52:46.342 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: audit 2021-03-10T13:52:45.083618+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:52:46.342 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: audit 2021-03-10T13:52:45.086555+0000 mon.c (mon.1) 11 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:46.342 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: cephadm 2021-03-10T13:52:45.089477+0000 mgr.gibba043.dnkmem (mgr.34373) 42 : cephadm [INF] Reconfiguring daemon mgr.y on gibba003 2021-03-10T13:52:46.342 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: audit 2021-03-10T13:52:45.089963+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:52:46.342 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[31385]: cluster 2021-03-10T13:52:45.142293+0000 mgr.gibba043.dnkmem (mgr.34373) 43 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:46.343 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: audit 2021-03-10T13:52:45.077378+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:46.343 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: cephadm 2021-03-10T13:52:45.080567+0000 mgr.gibba043.dnkmem (mgr.34373) 41 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:52:46.343 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: audit 2021-03-10T13:52:45.080734+0000 mon.c (mon.1) 9 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:52:46.343 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: audit 2021-03-10T13:52:45.081043+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:52:46.344 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: audit 2021-03-10T13:52:45.083618+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:52:46.344 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: audit 2021-03-10T13:52:45.086555+0000 mon.c (mon.1) 11 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:46.344 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: cephadm 2021-03-10T13:52:45.089477+0000 mgr.gibba043.dnkmem (mgr.34373) 42 : cephadm [INF] Reconfiguring daemon mgr.y on gibba003 2021-03-10T13:52:46.344 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: audit 2021-03-10T13:52:45.089963+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:52:46.344 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:46 gibba003 bash[32348]: cluster 2021-03-10T13:52:45.142293+0000 mgr.gibba043.dnkmem (mgr.34373) 43 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: audit 2021-03-10T13:52:45.077378+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: cephadm 2021-03-10T13:52:45.080567+0000 mgr.gibba043.dnkmem (mgr.34373) 41 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:52:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: audit 2021-03-10T13:52:45.080734+0000 mon.c (mon.1) 9 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:52:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: audit 2021-03-10T13:52:45.081043+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:52:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: audit 2021-03-10T13:52:45.083618+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:52:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: audit 2021-03-10T13:52:45.086555+0000 mon.c (mon.1) 11 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:46.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: cephadm 2021-03-10T13:52:45.089477+0000 mgr.gibba043.dnkmem (mgr.34373) 42 : cephadm [INF] Reconfiguring daemon mgr.y on gibba003 2021-03-10T13:52:46.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: audit 2021-03-10T13:52:45.089963+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:52:46.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:46 gibba043 bash[24019]: cluster 2021-03-10T13:52:45.142293+0000 mgr.gibba043.dnkmem (mgr.34373) 43 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:48.107 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: audit 2021-03-10T13:52:46.887986+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:48.108 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: cephadm 2021-03-10T13:52:46.891515+0000 mgr.gibba043.dnkmem (mgr.34373) 44 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:52:48.108 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: audit 2021-03-10T13:52:46.891703+0000 mon.c (mon.1) 13 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:48.108 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: audit 2021-03-10T13:52:46.894107+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:48.108 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: audit 2021-03-10T13:52:46.896986+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:48.108 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: cephadm 2021-03-10T13:52:46.899801+0000 mgr.gibba043.dnkmem (mgr.34373) 45 : cephadm [INF] Reconfiguring daemon mon.c on gibba003 2021-03-10T13:52:48.109 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[32348]: audit 2021-03-10T13:52:46.900415+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:52:48.109 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: audit 2021-03-10T13:52:46.887986+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:48.109 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: cephadm 2021-03-10T13:52:46.891515+0000 mgr.gibba043.dnkmem (mgr.34373) 44 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:52:48.109 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: audit 2021-03-10T13:52:46.891703+0000 mon.c (mon.1) 13 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:48.110 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: audit 2021-03-10T13:52:46.894107+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:48.110 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: audit 2021-03-10T13:52:46.896986+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:48.110 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: cephadm 2021-03-10T13:52:46.899801+0000 mgr.gibba043.dnkmem (mgr.34373) 45 : cephadm [INF] Reconfiguring daemon mon.c on gibba003 2021-03-10T13:52:48.110 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:47 gibba003 bash[31385]: audit 2021-03-10T13:52:46.900415+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:52:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: audit 2021-03-10T13:52:46.887986+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: cephadm 2021-03-10T13:52:46.891515+0000 mgr.gibba043.dnkmem (mgr.34373) 44 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:52:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: audit 2021-03-10T13:52:46.891703+0000 mon.c (mon.1) 13 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: audit 2021-03-10T13:52:46.894107+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: audit 2021-03-10T13:52:46.896986+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: cephadm 2021-03-10T13:52:46.899801+0000 mgr.gibba043.dnkmem (mgr.34373) 45 : cephadm [INF] Reconfiguring daemon mon.c on gibba003 2021-03-10T13:52:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:47 gibba043 bash[24019]: audit 2021-03-10T13:52:46.900415+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:52:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:48 gibba003 bash[31385]: cluster 2021-03-10T13:52:47.143391+0000 mgr.gibba043.dnkmem (mgr.34373) 46 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:48 gibba003 bash[31385]: audit 2021-03-10T13:52:48.635424+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:48 gibba003 bash[31385]: audit 2021-03-10T13:52:48.637247+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:52:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:48 gibba003 bash[32348]: cluster 2021-03-10T13:52:47.143391+0000 mgr.gibba043.dnkmem (mgr.34373) 46 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:48 gibba003 bash[32348]: audit 2021-03-10T13:52:48.635424+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:48 gibba003 bash[32348]: audit 2021-03-10T13:52:48.637247+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:52:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:48 gibba043 bash[24019]: cluster 2021-03-10T13:52:47.143391+0000 mgr.gibba043.dnkmem (mgr.34373) 46 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:48 gibba043 bash[24019]: audit 2021-03-10T13:52:48.635424+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:48 gibba043 bash[24019]: audit 2021-03-10T13:52:48.637247+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:52:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:49 gibba003 bash[31385]: cephadm 2021-03-10T13:52:48.637078+0000 mgr.gibba043.dnkmem (mgr.34373) 47 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:52:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:49 gibba003 bash[31385]: cephadm 2021-03-10T13:52:48.637512+0000 mgr.gibba043.dnkmem (mgr.34373) 48 : cephadm [INF] Reconfiguring daemon osd.0 on gibba003 2021-03-10T13:52:50.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:49 gibba003 bash[32348]: cephadm 2021-03-10T13:52:48.637078+0000 mgr.gibba043.dnkmem (mgr.34373) 47 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:52:50.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:49 gibba003 bash[32348]: cephadm 2021-03-10T13:52:48.637512+0000 mgr.gibba043.dnkmem (mgr.34373) 48 : cephadm [INF] Reconfiguring daemon osd.0 on gibba003 2021-03-10T13:52:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:49 gibba043 bash[24019]: cephadm 2021-03-10T13:52:48.637078+0000 mgr.gibba043.dnkmem (mgr.34373) 47 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:52:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:49 gibba043 bash[24019]: cephadm 2021-03-10T13:52:48.637512+0000 mgr.gibba043.dnkmem (mgr.34373) 48 : cephadm [INF] Reconfiguring daemon osd.0 on gibba003 2021-03-10T13:52:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:50 gibba003 bash[32348]: cluster 2021-03-10T13:52:49.145348+0000 mgr.gibba043.dnkmem (mgr.34373) 49 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:50 gibba003 bash[32348]: audit 2021-03-10T13:52:50.384062+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:50 gibba003 bash[32348]: audit 2021-03-10T13:52:50.389088+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:52:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:50 gibba003 bash[31385]: cluster 2021-03-10T13:52:49.145348+0000 mgr.gibba043.dnkmem (mgr.34373) 49 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:50 gibba003 bash[31385]: audit 2021-03-10T13:52:50.384062+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:50 gibba003 bash[31385]: audit 2021-03-10T13:52:50.389088+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:52:51.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:50 gibba043 bash[24019]: cluster 2021-03-10T13:52:49.145348+0000 mgr.gibba043.dnkmem (mgr.34373) 49 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:51.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:50 gibba043 bash[24019]: audit 2021-03-10T13:52:50.384062+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:51.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:50 gibba043 bash[24019]: audit 2021-03-10T13:52:50.389088+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:52:51.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:51 gibba003 bash[31385]: cephadm 2021-03-10T13:52:50.388261+0000 mgr.gibba043.dnkmem (mgr.34373) 50 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:52:51.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:51 gibba003 bash[31385]: cephadm 2021-03-10T13:52:50.388735+0000 mgr.gibba043.dnkmem (mgr.34373) 51 : cephadm [INF] Reconfiguring daemon osd.1 on gibba003 2021-03-10T13:52:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:51 gibba003 bash[32348]: cephadm 2021-03-10T13:52:50.388261+0000 mgr.gibba043.dnkmem (mgr.34373) 50 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:52:51.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:51 gibba003 bash[32348]: cephadm 2021-03-10T13:52:50.388735+0000 mgr.gibba043.dnkmem (mgr.34373) 51 : cephadm [INF] Reconfiguring daemon osd.1 on gibba003 2021-03-10T13:52:52.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:51 gibba043 bash[24019]: cephadm 2021-03-10T13:52:50.388261+0000 mgr.gibba043.dnkmem (mgr.34373) 50 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:52:52.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:51 gibba043 bash[24019]: cephadm 2021-03-10T13:52:50.388735+0000 mgr.gibba043.dnkmem (mgr.34373) 51 : cephadm [INF] Reconfiguring daemon osd.1 on gibba003 2021-03-10T13:52:53.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:52 gibba003 bash[31385]: cluster 2021-03-10T13:52:51.146529+0000 mgr.gibba043.dnkmem (mgr.34373) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:53.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:52 gibba003 bash[31385]: audit 2021-03-10T13:52:52.228060+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:52 gibba003 bash[31385]: audit 2021-03-10T13:52:52.233732+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:52:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:52 gibba003 bash[32348]: cluster 2021-03-10T13:52:51.146529+0000 mgr.gibba043.dnkmem (mgr.34373) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:52 gibba003 bash[32348]: audit 2021-03-10T13:52:52.228060+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:52 gibba003 bash[32348]: audit 2021-03-10T13:52:52.233732+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:52:53.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:52 gibba043 bash[24019]: cluster 2021-03-10T13:52:51.146529+0000 mgr.gibba043.dnkmem (mgr.34373) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:53.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:52 gibba043 bash[24019]: audit 2021-03-10T13:52:52.228060+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:53.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:52 gibba043 bash[24019]: audit 2021-03-10T13:52:52.233732+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:52:54.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:53 gibba043 bash[24019]: cephadm 2021-03-10T13:52:52.231147+0000 mgr.gibba043.dnkmem (mgr.34373) 53 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:52:54.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:53 gibba043 bash[24019]: cephadm 2021-03-10T13:52:52.233374+0000 mgr.gibba043.dnkmem (mgr.34373) 54 : cephadm [INF] Reconfiguring daemon osd.2 on gibba003 2021-03-10T13:52:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:53 gibba003 bash[31385]: cephadm 2021-03-10T13:52:52.231147+0000 mgr.gibba043.dnkmem (mgr.34373) 53 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:52:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:53 gibba003 bash[31385]: cephadm 2021-03-10T13:52:52.233374+0000 mgr.gibba043.dnkmem (mgr.34373) 54 : cephadm [INF] Reconfiguring daemon osd.2 on gibba003 2021-03-10T13:52:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:53 gibba003 bash[32348]: cephadm 2021-03-10T13:52:52.231147+0000 mgr.gibba043.dnkmem (mgr.34373) 53 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:52:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:53 gibba003 bash[32348]: cephadm 2021-03-10T13:52:52.233374+0000 mgr.gibba043.dnkmem (mgr.34373) 54 : cephadm [INF] Reconfiguring daemon osd.2 on gibba003 2021-03-10T13:52:55.249 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[31385]: cluster 2021-03-10T13:52:53.147839+0000 mgr.gibba043.dnkmem (mgr.34373) 55 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:55.249 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[31385]: audit 2021-03-10T13:52:53.956856+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:55.249 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[31385]: cephadm 2021-03-10T13:52:53.958515+0000 mgr.gibba043.dnkmem (mgr.34373) 56 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:52:55.249 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[31385]: audit 2021-03-10T13:52:53.958708+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:52:55.250 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[31385]: cephadm 2021-03-10T13:52:53.958980+0000 mgr.gibba043.dnkmem (mgr.34373) 57 : cephadm [INF] Reconfiguring daemon osd.3 on gibba003 2021-03-10T13:52:55.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[32348]: cluster 2021-03-10T13:52:53.147839+0000 mgr.gibba043.dnkmem (mgr.34373) 55 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:55.250 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[32348]: audit 2021-03-10T13:52:53.956856+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:55.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[32348]: cephadm 2021-03-10T13:52:53.958515+0000 mgr.gibba043.dnkmem (mgr.34373) 56 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:52:55.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[32348]: audit 2021-03-10T13:52:53.958708+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:52:55.251 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:54 gibba003 bash[32348]: cephadm 2021-03-10T13:52:53.958980+0000 mgr.gibba043.dnkmem (mgr.34373) 57 : cephadm [INF] Reconfiguring daemon osd.3 on gibba003 2021-03-10T13:52:55.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:54 gibba043 bash[24019]: cluster 2021-03-10T13:52:53.147839+0000 mgr.gibba043.dnkmem (mgr.34373) 55 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:55.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:54 gibba043 bash[24019]: audit 2021-03-10T13:52:53.956856+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:55.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:54 gibba043 bash[24019]: cephadm 2021-03-10T13:52:53.958515+0000 mgr.gibba043.dnkmem (mgr.34373) 56 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:52:55.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:54 gibba043 bash[24019]: audit 2021-03-10T13:52:53.958708+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:52:55.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:54 gibba043 bash[24019]: cephadm 2021-03-10T13:52:53.958980+0000 mgr.gibba043.dnkmem (mgr.34373) 57 : cephadm [INF] Reconfiguring daemon osd.3 on gibba003 2021-03-10T13:52:57.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: cluster 2021-03-10T13:52:55.149765+0000 mgr.gibba043.dnkmem (mgr.34373) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:57.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: audit 2021-03-10T13:52:55.741290+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:57.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: cephadm 2021-03-10T13:52:55.745905+0000 mgr.gibba043.dnkmem (mgr.34373) 59 : cephadm [INF] Reconfiguring rgw.r.z.gibba003.uvtpth (monmap changed)... 2021-03-10T13:52:57.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: audit 2021-03-10T13:52:55.746029+0000 mon.c (mon.1) 21 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:52:57.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: audit 2021-03-10T13:52:55.746316+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:52:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: audit 2021-03-10T13:52:55.748199+0000 mon.c (mon.1) 22 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba003.uvtpth"}]: dispatch 2021-03-10T13:52:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: audit 2021-03-10T13:52:55.749455+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: audit 2021-03-10T13:52:55.750687+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba003.uvtpth","key": "container_image"}]: dispatch 2021-03-10T13:52:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:56 gibba043 bash[24019]: cephadm 2021-03-10T13:52:55.750806+0000 mgr.gibba043.dnkmem (mgr.34373) 60 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba003.uvtpth on gibba003 2021-03-10T13:52:57.057 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: cluster 2021-03-10T13:52:55.149765+0000 mgr.gibba043.dnkmem (mgr.34373) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:57.058 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: audit 2021-03-10T13:52:55.741290+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:57.058 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: cephadm 2021-03-10T13:52:55.745905+0000 mgr.gibba043.dnkmem (mgr.34373) 59 : cephadm [INF] Reconfiguring rgw.r.z.gibba003.uvtpth (monmap changed)... 2021-03-10T13:52:57.058 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: audit 2021-03-10T13:52:55.746029+0000 mon.c (mon.1) 21 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:52:57.058 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: audit 2021-03-10T13:52:55.746316+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:52:57.058 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: audit 2021-03-10T13:52:55.748199+0000 mon.c (mon.1) 22 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba003.uvtpth"}]: dispatch 2021-03-10T13:52:57.062 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: audit 2021-03-10T13:52:55.749455+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:57.062 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: audit 2021-03-10T13:52:55.750687+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba003.uvtpth","key": "container_image"}]: dispatch 2021-03-10T13:52:57.063 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[31385]: cephadm 2021-03-10T13:52:55.750806+0000 mgr.gibba043.dnkmem (mgr.34373) 60 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba003.uvtpth on gibba003 2021-03-10T13:52:57.063 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: cluster 2021-03-10T13:52:55.149765+0000 mgr.gibba043.dnkmem (mgr.34373) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:57.063 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: audit 2021-03-10T13:52:55.741290+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:57.063 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: cephadm 2021-03-10T13:52:55.745905+0000 mgr.gibba043.dnkmem (mgr.34373) 59 : cephadm [INF] Reconfiguring rgw.r.z.gibba003.uvtpth (monmap changed)... 2021-03-10T13:52:57.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: audit 2021-03-10T13:52:55.746029+0000 mon.c (mon.1) 21 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:52:57.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: audit 2021-03-10T13:52:55.746316+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba003.uvtpth", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:52:57.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: audit 2021-03-10T13:52:55.748199+0000 mon.c (mon.1) 22 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba003.uvtpth"}]: dispatch 2021-03-10T13:52:57.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: audit 2021-03-10T13:52:55.749455+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:57.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: audit 2021-03-10T13:52:55.750687+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba003.uvtpth","key": "container_image"}]: dispatch 2021-03-10T13:52:57.065 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:56 gibba003 bash[32348]: cephadm 2021-03-10T13:52:55.750806+0000 mgr.gibba043.dnkmem (mgr.34373) 60 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba003.uvtpth on gibba003 2021-03-10T13:52:58.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: cluster 2021-03-10T13:52:57.150903+0000 mgr.gibba043.dnkmem (mgr.34373) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: audit 2021-03-10T13:52:57.513725+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: audit 2021-03-10T13:52:57.516184+0000 mon.c (mon.1) 25 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: cephadm 2021-03-10T13:52:57.516384+0000 mgr.gibba043.dnkmem (mgr.34373) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:52:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: audit 2021-03-10T13:52:57.518092+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:58.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: audit 2021-03-10T13:52:57.519334+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:58.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: audit 2021-03-10T13:52:57.520771+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:52:58.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:52:58 gibba043 bash[24019]: cephadm 2021-03-10T13:52:57.521006+0000 mgr.gibba043.dnkmem (mgr.34373) 63 : cephadm [INF] Reconfiguring daemon mon.b on gibba043 2021-03-10T13:52:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: cluster 2021-03-10T13:52:57.150903+0000 mgr.gibba043.dnkmem (mgr.34373) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: audit 2021-03-10T13:52:57.513725+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: audit 2021-03-10T13:52:57.516184+0000 mon.c (mon.1) 25 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: cephadm 2021-03-10T13:52:57.516384+0000 mgr.gibba043.dnkmem (mgr.34373) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:52:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: audit 2021-03-10T13:52:57.518092+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: audit 2021-03-10T13:52:57.519334+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: audit 2021-03-10T13:52:57.520771+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:52:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[31385]: cephadm 2021-03-10T13:52:57.521006+0000 mgr.gibba043.dnkmem (mgr.34373) 63 : cephadm [INF] Reconfiguring daemon mon.b on gibba043 2021-03-10T13:52:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: cluster 2021-03-10T13:52:57.150903+0000 mgr.gibba043.dnkmem (mgr.34373) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: audit 2021-03-10T13:52:57.513725+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:52:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: audit 2021-03-10T13:52:57.516184+0000 mon.c (mon.1) 25 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:52:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: cephadm 2021-03-10T13:52:57.516384+0000 mgr.gibba043.dnkmem (mgr.34373) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:52:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: audit 2021-03-10T13:52:57.518092+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:52:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: audit 2021-03-10T13:52:57.519334+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: audit 2021-03-10T13:52:57.520771+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:52:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:52:58 gibba003 bash[32348]: cephadm 2021-03-10T13:52:57.521006+0000 mgr.gibba043.dnkmem (mgr.34373) 63 : cephadm [INF] Reconfiguring daemon mon.b on gibba043 2021-03-10T13:53:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: cluster 2021-03-10T13:52:59.153033+0000 mgr.gibba043.dnkmem (mgr.34373) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: audit 2021-03-10T13:52:59.515670+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:00.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: audit 2021-03-10T13:52:59.517660+0000 mon.c (mon.1) 29 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:00.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: cephadm 2021-03-10T13:52:59.517900+0000 mgr.gibba043.dnkmem (mgr.34373) 65 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:53:00.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: audit 2021-03-10T13:52:59.519480+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:00.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: audit 2021-03-10T13:52:59.520754+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:00.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: audit 2021-03-10T13:52:59.521691+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:00.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: audit 2021-03-10T13:52:59.523255+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:53:00.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:00 gibba043 bash[24019]: cephadm 2021-03-10T13:52:59.523402+0000 mgr.gibba043.dnkmem (mgr.34373) 66 : cephadm [INF] Reconfiguring daemon mgr.x on gibba043 2021-03-10T13:53:00.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: cluster 2021-03-10T13:52:59.153033+0000 mgr.gibba043.dnkmem (mgr.34373) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:00.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: audit 2021-03-10T13:52:59.515670+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:00.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: audit 2021-03-10T13:52:59.517660+0000 mon.c (mon.1) 29 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:00.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: cephadm 2021-03-10T13:52:59.517900+0000 mgr.gibba043.dnkmem (mgr.34373) 65 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:53:00.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: audit 2021-03-10T13:52:59.519480+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: audit 2021-03-10T13:52:59.520754+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: audit 2021-03-10T13:52:59.521691+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: audit 2021-03-10T13:52:59.523255+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:53:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[31385]: cephadm 2021-03-10T13:52:59.523402+0000 mgr.gibba043.dnkmem (mgr.34373) 66 : cephadm [INF] Reconfiguring daemon mgr.x on gibba043 2021-03-10T13:53:00.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: cluster 2021-03-10T13:52:59.153033+0000 mgr.gibba043.dnkmem (mgr.34373) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:00.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: audit 2021-03-10T13:52:59.515670+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:00.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: audit 2021-03-10T13:52:59.517660+0000 mon.c (mon.1) 29 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:00.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: cephadm 2021-03-10T13:52:59.517900+0000 mgr.gibba043.dnkmem (mgr.34373) 65 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:53:00.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: audit 2021-03-10T13:52:59.519480+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:00.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: audit 2021-03-10T13:52:59.520754+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:00.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: audit 2021-03-10T13:52:59.521691+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:00.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: audit 2021-03-10T13:52:59.523255+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:53:00.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:00 gibba003 bash[32348]: cephadm 2021-03-10T13:52:59.523402+0000 mgr.gibba043.dnkmem (mgr.34373) 66 : cephadm [INF] Reconfiguring daemon mgr.x on gibba043 2021-03-10T13:53:02.651 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: cluster 2021-03-10T13:53:01.154066+0000 mgr.gibba043.dnkmem (mgr.34373) 67 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:02.651 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: audit 2021-03-10T13:53:01.384708+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:02.652 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: cephadm 2021-03-10T13:53:01.386732+0000 mgr.gibba043.dnkmem (mgr.34373) 68 : cephadm [INF] Reconfiguring mgr.gibba043.dnkmem (monmap changed)... 2021-03-10T13:53:02.652 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: audit 2021-03-10T13:53:01.386751+0000 mon.c (mon.1) 33 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:02.652 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: audit 2021-03-10T13:53:01.387099+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:02.652 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: audit 2021-03-10T13:53:01.389394+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:02.653 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: audit 2021-03-10T13:53:01.391146+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:02.653 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: audit 2021-03-10T13:53:01.392946+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.gibba043.dnkmem","key": "container_image"}]: dispatch 2021-03-10T13:53:02.653 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:02 gibba043 bash[24019]: cephadm 2021-03-10T13:53:01.392959+0000 mgr.gibba043.dnkmem (mgr.34373) 69 : cephadm [INF] Reconfiguring daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:53:02.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: cluster 2021-03-10T13:53:01.154066+0000 mgr.gibba043.dnkmem (mgr.34373) 67 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:02.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: audit 2021-03-10T13:53:01.384708+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:02.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: cephadm 2021-03-10T13:53:01.386732+0000 mgr.gibba043.dnkmem (mgr.34373) 68 : cephadm [INF] Reconfiguring mgr.gibba043.dnkmem (monmap changed)... 2021-03-10T13:53:02.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: audit 2021-03-10T13:53:01.386751+0000 mon.c (mon.1) 33 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:02.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: audit 2021-03-10T13:53:01.387099+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:02.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: audit 2021-03-10T13:53:01.389394+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:02.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: audit 2021-03-10T13:53:01.391146+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: audit 2021-03-10T13:53:01.392946+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.gibba043.dnkmem","key": "container_image"}]: dispatch 2021-03-10T13:53:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[32348]: cephadm 2021-03-10T13:53:01.392959+0000 mgr.gibba043.dnkmem (mgr.34373) 69 : cephadm [INF] Reconfiguring daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:53:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: cluster 2021-03-10T13:53:01.154066+0000 mgr.gibba043.dnkmem (mgr.34373) 67 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: audit 2021-03-10T13:53:01.384708+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:02.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: cephadm 2021-03-10T13:53:01.386732+0000 mgr.gibba043.dnkmem (mgr.34373) 68 : cephadm [INF] Reconfiguring mgr.gibba043.dnkmem (monmap changed)... 2021-03-10T13:53:02.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: audit 2021-03-10T13:53:01.386751+0000 mon.c (mon.1) 33 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:02.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: audit 2021-03-10T13:53:01.387099+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba043.dnkmem", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:02.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: audit 2021-03-10T13:53:01.389394+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:02.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: audit 2021-03-10T13:53:01.391146+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:02.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: audit 2021-03-10T13:53:01.392946+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mgr.gibba043.dnkmem","key": "container_image"}]: dispatch 2021-03-10T13:53:02.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:02 gibba003 bash[31385]: cephadm 2021-03-10T13:53:01.392959+0000 mgr.gibba043.dnkmem (mgr.34373) 69 : cephadm [INF] Reconfiguring daemon mgr.gibba043.dnkmem on gibba043 2021-03-10T13:53:04.050 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:53:04.299 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:53:04.299 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (86s) 37s ago 6m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:53:04.300 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (6m) 21s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:53:04.300 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (107s) 21s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:53:04.300 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2m) 21s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:53:04.300 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (67s) 37s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:53:04.301 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (58s) 37s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:53:04.301 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (32s) 21s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:53:04.301 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (42s) 37s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:53:04.301 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (6m) 37s ago 6m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:53:04.302 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (6m) 21s ago 6m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:53:04.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (9m) 37s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8f0b52d3cade 2021-03-10T13:53:04.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (9m) 37s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:53:04.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (9m) 37s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:53:04.303 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (8m) 37s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:53:04.303 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (8m) 21s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:53:04.303 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (8m) 21s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:53:04.303 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (7m) 21s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:53:04.304 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (7m) 21s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:53:04.304 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (6m) 21s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:53:04.304 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 37s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:53:04.547 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:53:04.547 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:53:04.547 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:04.547 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:53:04.548 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:53:04.548 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:04.548 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:53:04.548 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:53:04.548 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:53:04.549 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:53:04.549 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:53:04.549 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:53:04.549 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2021-03-10T13:53:04.549 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T13:53:04.550 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:53:04.550 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:53:04.574 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:04 gibba043 bash[24019]: cluster 2021-03-10T13:53:03.155111+0000 mgr.gibba043.dnkmem (mgr.34373) 70 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:04.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:04 gibba043 bash[24019]: audit 2021-03-10T13:53:03.292612+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:04.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:04 gibba043 bash[24019]: cephadm 2021-03-10T13:53:03.294691+0000 mgr.gibba043.dnkmem (mgr.34373) 71 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:53:04.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:04 gibba043 bash[24019]: audit 2021-03-10T13:53:03.295173+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:53:04.575 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:04 gibba043 bash[24019]: cephadm 2021-03-10T13:53:03.295272+0000 mgr.gibba043.dnkmem (mgr.34373) 72 : cephadm [INF] Reconfiguring daemon osd.4 on gibba043 2021-03-10T13:53:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[31385]: cluster 2021-03-10T13:53:03.155111+0000 mgr.gibba043.dnkmem (mgr.34373) 70 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:04.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[31385]: audit 2021-03-10T13:53:03.292612+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:04.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[31385]: cephadm 2021-03-10T13:53:03.294691+0000 mgr.gibba043.dnkmem (mgr.34373) 71 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:53:04.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[31385]: audit 2021-03-10T13:53:03.295173+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:53:04.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[31385]: cephadm 2021-03-10T13:53:03.295272+0000 mgr.gibba043.dnkmem (mgr.34373) 72 : cephadm [INF] Reconfiguring daemon osd.4 on gibba043 2021-03-10T13:53:04.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[32348]: cluster 2021-03-10T13:53:03.155111+0000 mgr.gibba043.dnkmem (mgr.34373) 70 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:04.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[32348]: audit 2021-03-10T13:53:03.292612+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:04.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[32348]: cephadm 2021-03-10T13:53:03.294691+0000 mgr.gibba043.dnkmem (mgr.34373) 71 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:53:04.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[32348]: audit 2021-03-10T13:53:03.295173+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:53:04.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:04 gibba003 bash[32348]: cephadm 2021-03-10T13:53:03.295272+0000 mgr.gibba043.dnkmem (mgr.34373) 72 : cephadm [INF] Reconfiguring daemon osd.4 on gibba043 2021-03-10T13:53:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[31385]: audit 2021-03-10T13:53:04.041773+0000 mgr.gibba043.dnkmem (mgr.34373) 73 : audit [DBG] from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[31385]: audit 2021-03-10T13:53:04.269632+0000 mgr.gibba043.dnkmem (mgr.34373) 74 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[31385]: audit 2021-03-10T13:53:04.546785+0000 mon.a (mon.0) 98 : audit [DBG] from='client.? 172.21.2.103:0/688715915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[31385]: audit 2021-03-10T13:53:05.098730+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[31385]: audit 2021-03-10T13:53:05.101101+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:53:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[32348]: audit 2021-03-10T13:53:04.041773+0000 mgr.gibba043.dnkmem (mgr.34373) 73 : audit [DBG] from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[32348]: audit 2021-03-10T13:53:04.269632+0000 mgr.gibba043.dnkmem (mgr.34373) 74 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[32348]: audit 2021-03-10T13:53:04.546785+0000 mon.a (mon.0) 98 : audit [DBG] from='client.? 172.21.2.103:0/688715915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:05.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[32348]: audit 2021-03-10T13:53:05.098730+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:05.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:05 gibba003 bash[32348]: audit 2021-03-10T13:53:05.101101+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:53:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:05 gibba043 bash[24019]: audit 2021-03-10T13:53:04.041773+0000 mgr.gibba043.dnkmem (mgr.34373) 73 : audit [DBG] from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:05 gibba043 bash[24019]: audit 2021-03-10T13:53:04.269632+0000 mgr.gibba043.dnkmem (mgr.34373) 74 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:05 gibba043 bash[24019]: audit 2021-03-10T13:53:04.546785+0000 mon.a (mon.0) 98 : audit [DBG] from='client.? 172.21.2.103:0/688715915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:05 gibba043 bash[24019]: audit 2021-03-10T13:53:05.098730+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:05 gibba043 bash[24019]: audit 2021-03-10T13:53:05.101101+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:53:06.425 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:06 gibba043 bash[24019]: cephadm 2021-03-10T13:53:05.100663+0000 mgr.gibba043.dnkmem (mgr.34373) 75 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:53:06.425 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:06 gibba043 bash[24019]: cephadm 2021-03-10T13:53:05.101322+0000 mgr.gibba043.dnkmem (mgr.34373) 76 : cephadm [INF] Reconfiguring daemon osd.5 on gibba043 2021-03-10T13:53:06.425 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:06 gibba043 bash[24019]: cluster 2021-03-10T13:53:05.155738+0000 mgr.gibba043.dnkmem (mgr.34373) 77 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:06.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:06 gibba003 bash[31385]: cephadm 2021-03-10T13:53:05.100663+0000 mgr.gibba043.dnkmem (mgr.34373) 75 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:53:06.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:06 gibba003 bash[31385]: cephadm 2021-03-10T13:53:05.101322+0000 mgr.gibba043.dnkmem (mgr.34373) 76 : cephadm [INF] Reconfiguring daemon osd.5 on gibba043 2021-03-10T13:53:06.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:06 gibba003 bash[31385]: cluster 2021-03-10T13:53:05.155738+0000 mgr.gibba043.dnkmem (mgr.34373) 77 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:06.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:06 gibba003 bash[32348]: cephadm 2021-03-10T13:53:05.100663+0000 mgr.gibba043.dnkmem (mgr.34373) 75 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:53:06.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:06 gibba003 bash[32348]: cephadm 2021-03-10T13:53:05.101322+0000 mgr.gibba043.dnkmem (mgr.34373) 76 : cephadm [INF] Reconfiguring daemon osd.5 on gibba043 2021-03-10T13:53:06.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:06 gibba003 bash[32348]: cluster 2021-03-10T13:53:05.155738+0000 mgr.gibba043.dnkmem (mgr.34373) 77 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[31385]: audit 2021-03-10T13:53:06.888519+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[31385]: cephadm 2021-03-10T13:53:06.890583+0000 mgr.gibba043.dnkmem (mgr.34373) 78 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:53:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[31385]: audit 2021-03-10T13:53:06.890831+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:53:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[31385]: cephadm 2021-03-10T13:53:06.891050+0000 mgr.gibba043.dnkmem (mgr.34373) 79 : cephadm [INF] Reconfiguring daemon osd.6 on gibba043 2021-03-10T13:53:08.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[32348]: audit 2021-03-10T13:53:06.888519+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:08.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[32348]: cephadm 2021-03-10T13:53:06.890583+0000 mgr.gibba043.dnkmem (mgr.34373) 78 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:53:08.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[32348]: audit 2021-03-10T13:53:06.890831+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:53:08.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:07 gibba003 bash[32348]: cephadm 2021-03-10T13:53:06.891050+0000 mgr.gibba043.dnkmem (mgr.34373) 79 : cephadm [INF] Reconfiguring daemon osd.6 on gibba043 2021-03-10T13:53:08.241 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:07 gibba043 bash[24019]: audit 2021-03-10T13:53:06.888519+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:08.241 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:07 gibba043 bash[24019]: cephadm 2021-03-10T13:53:06.890583+0000 mgr.gibba043.dnkmem (mgr.34373) 78 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:53:08.241 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:07 gibba043 bash[24019]: audit 2021-03-10T13:53:06.890831+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:53:08.242 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:07 gibba043 bash[24019]: cephadm 2021-03-10T13:53:06.891050+0000 mgr.gibba043.dnkmem (mgr.34373) 79 : cephadm [INF] Reconfiguring daemon osd.6 on gibba043 2021-03-10T13:53:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:08 gibba003 bash[31385]: cluster 2021-03-10T13:53:07.156493+0000 mgr.gibba043.dnkmem (mgr.34373) 80 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:08 gibba003 bash[31385]: audit 2021-03-10T13:53:08.780802+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:08 gibba003 bash[31385]: audit 2021-03-10T13:53:08.783400+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:53:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:08 gibba003 bash[32348]: cluster 2021-03-10T13:53:07.156493+0000 mgr.gibba043.dnkmem (mgr.34373) 80 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:08 gibba003 bash[32348]: audit 2021-03-10T13:53:08.780802+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:08 gibba003 bash[32348]: audit 2021-03-10T13:53:08.783400+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:53:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:08 gibba043 bash[24019]: cluster 2021-03-10T13:53:07.156493+0000 mgr.gibba043.dnkmem (mgr.34373) 80 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:08 gibba043 bash[24019]: audit 2021-03-10T13:53:08.780802+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:08 gibba043 bash[24019]: audit 2021-03-10T13:53:08.783400+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:53:10.150 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:09 gibba043 bash[24019]: cephadm 2021-03-10T13:53:08.782906+0000 mgr.gibba043.dnkmem (mgr.34373) 81 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:53:10.150 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:09 gibba043 bash[24019]: cephadm 2021-03-10T13:53:08.783606+0000 mgr.gibba043.dnkmem (mgr.34373) 82 : cephadm [INF] Reconfiguring daemon osd.7 on gibba043 2021-03-10T13:53:10.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:09 gibba003 bash[31385]: cephadm 2021-03-10T13:53:08.782906+0000 mgr.gibba043.dnkmem (mgr.34373) 81 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:53:10.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:09 gibba003 bash[31385]: cephadm 2021-03-10T13:53:08.783606+0000 mgr.gibba043.dnkmem (mgr.34373) 82 : cephadm [INF] Reconfiguring daemon osd.7 on gibba043 2021-03-10T13:53:10.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:09 gibba003 bash[32348]: cephadm 2021-03-10T13:53:08.782906+0000 mgr.gibba043.dnkmem (mgr.34373) 81 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:53:10.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:09 gibba003 bash[32348]: cephadm 2021-03-10T13:53:08.783606+0000 mgr.gibba043.dnkmem (mgr.34373) 82 : cephadm [INF] Reconfiguring daemon osd.7 on gibba043 2021-03-10T13:53:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: cluster 2021-03-10T13:53:09.158542+0000 mgr.gibba043.dnkmem (mgr.34373) 83 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.626514+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.629594+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.632956+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.635735+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.647997+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.649590+0000 mon.c (mon.1) 44 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:53:11.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.649807+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:53:11.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.652639+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:53:11.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.654186+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:53:11.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.654499+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:53:11.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.657858+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:53:11.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.659434+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:53:11.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.659758+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:53:11.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.662854+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:53:11.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.664762+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.670210+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[31385]: audit 2021-03-10T13:53:10.673162+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:53:11.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: cluster 2021-03-10T13:53:09.158542+0000 mgr.gibba043.dnkmem (mgr.34373) 83 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:11.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.626514+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.629594+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:11.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.632956+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.635735+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.647997+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.649590+0000 mon.c (mon.1) 44 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:53:11.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.649807+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:53:11.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.652639+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:53:11.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.654186+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:53:11.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.654499+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:53:11.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.657858+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:53:11.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.659434+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:53:11.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.659758+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:53:11.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.662854+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:53:11.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.664762+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.670210+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:10 gibba003 bash[32348]: audit 2021-03-10T13:53:10.673162+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:53:11.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: cluster 2021-03-10T13:53:09.158542+0000 mgr.gibba043.dnkmem (mgr.34373) 83 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.626514+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.629594+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.632956+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.635735+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.647997+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.649590+0000 mon.c (mon.1) 44 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:53:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.649807+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:53:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.652639+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:53:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.654186+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:53:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.654499+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:53:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.657858+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:53:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.659434+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:53:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.659758+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:53:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.662854+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:53:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.664762+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.670210+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:10 gibba043 bash[24019]: audit 2021-03-10T13:53:10.673162+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:53:12.141 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.629150+0000 mgr.gibba043.dnkmem (mgr.34373) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:12.141 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.632669+0000 mgr.gibba043.dnkmem (mgr.34373) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:12.141 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.635584+0000 mgr.gibba043.dnkmem (mgr.34373) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:12.142 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.635642+0000 mgr.gibba043.dnkmem (mgr.34373) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:12.142 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.638183+0000 mgr.gibba043.dnkmem (mgr.34373) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:53:12.142 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.664917+0000 mgr.gibba043.dnkmem (mgr.34373) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:12.142 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.665067+0000 mgr.gibba043.dnkmem (mgr.34373) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:12.142 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.666637+0000 mgr.gibba043.dnkmem (mgr.34373) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:12.143 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.672540+0000 mgr.gibba043.dnkmem (mgr.34373) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:12.143 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.672816+0000 mgr.gibba043.dnkmem (mgr.34373) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:12.143 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: audit 2021-03-10T13:53:10.674057+0000 mgr.gibba043.dnkmem (mgr.34373) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:53:12.143 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[31385]: cephadm 2021-03-10T13:53:10.676279+0000 mgr.gibba043.dnkmem (mgr.34373) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:53:12.144 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.629150+0000 mgr.gibba043.dnkmem (mgr.34373) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:12.144 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.632669+0000 mgr.gibba043.dnkmem (mgr.34373) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:12.144 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.635584+0000 mgr.gibba043.dnkmem (mgr.34373) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:12.144 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.635642+0000 mgr.gibba043.dnkmem (mgr.34373) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:12.145 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.638183+0000 mgr.gibba043.dnkmem (mgr.34373) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:53:12.145 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.664917+0000 mgr.gibba043.dnkmem (mgr.34373) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:12.145 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.665067+0000 mgr.gibba043.dnkmem (mgr.34373) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:12.145 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.666637+0000 mgr.gibba043.dnkmem (mgr.34373) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:12.145 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.672540+0000 mgr.gibba043.dnkmem (mgr.34373) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:12.146 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.672816+0000 mgr.gibba043.dnkmem (mgr.34373) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:12.146 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: audit 2021-03-10T13:53:10.674057+0000 mgr.gibba043.dnkmem (mgr.34373) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:53:12.146 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:11 gibba003 bash[32348]: cephadm 2021-03-10T13:53:10.676279+0000 mgr.gibba043.dnkmem (mgr.34373) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:53:12.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.629150+0000 mgr.gibba043.dnkmem (mgr.34373) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:12.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.632669+0000 mgr.gibba043.dnkmem (mgr.34373) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.635584+0000 mgr.gibba043.dnkmem (mgr.34373) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.635642+0000 mgr.gibba043.dnkmem (mgr.34373) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.638183+0000 mgr.gibba043.dnkmem (mgr.34373) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:53:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.664917+0000 mgr.gibba043.dnkmem (mgr.34373) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.665067+0000 mgr.gibba043.dnkmem (mgr.34373) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.666637+0000 mgr.gibba043.dnkmem (mgr.34373) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.672540+0000 mgr.gibba043.dnkmem (mgr.34373) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.672816+0000 mgr.gibba043.dnkmem (mgr.34373) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: audit 2021-03-10T13:53:10.674057+0000 mgr.gibba043.dnkmem (mgr.34373) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:53:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:11 gibba043 bash[24019]: cephadm 2021-03-10T13:53:10.676279+0000 mgr.gibba043.dnkmem (mgr.34373) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:53:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: cluster 2021-03-10T13:53:11.159721+0000 mgr.gibba043.dnkmem (mgr.34373) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.581591+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T13:53:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.581789+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.581964+0000 mon.c (mon.1) 51 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.581970+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T13:53:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.582183+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.582203+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.582446+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.582657+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.595658+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.597795+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:53:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.694208+0000 mon.c (mon.1) 54 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.694531+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.696714+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[31385]: audit 2021-03-10T13:53:12.697022+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: cluster 2021-03-10T13:53:11.159721+0000 mgr.gibba043.dnkmem (mgr.34373) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.581591+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T13:53:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.581789+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.581964+0000 mon.c (mon.1) 51 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.581970+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T13:53:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.582183+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.582203+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.582446+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.582657+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.595658+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.597795+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:53:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.694208+0000 mon.c (mon.1) 54 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.694531+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.696714+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:12 gibba003 bash[32348]: audit 2021-03-10T13:53:12.697022+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: cluster 2021-03-10T13:53:11.159721+0000 mgr.gibba043.dnkmem (mgr.34373) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.581591+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T13:53:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.581789+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.581964+0000 mon.c (mon.1) 51 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.581970+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T13:53:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.582183+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.582203+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.582446+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.582657+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T13:53:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.595658+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.597795+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:53:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.694208+0000 mon.c (mon.1) 54 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.694531+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.696714+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:12 gibba043 bash[24019]: audit 2021-03-10T13:53:12.697022+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:13 gibba003 bash[31385]: cephadm 2021-03-10T13:53:12.592270+0000 mgr.gibba043.dnkmem (mgr.34373) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:53:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:13 gibba003 bash[31385]: cephadm 2021-03-10T13:53:12.597910+0000 mgr.gibba043.dnkmem (mgr.34373) 98 : cephadm [INF] Deploying daemon osd.0 on gibba003 2021-03-10T13:53:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:13 gibba003 bash[32348]: cephadm 2021-03-10T13:53:12.592270+0000 mgr.gibba043.dnkmem (mgr.34373) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:53:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:13 gibba003 bash[32348]: cephadm 2021-03-10T13:53:12.597910+0000 mgr.gibba043.dnkmem (mgr.34373) 98 : cephadm [INF] Deploying daemon osd.0 on gibba003 2021-03-10T13:53:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:13 gibba043 bash[24019]: cephadm 2021-03-10T13:53:12.592270+0000 mgr.gibba043.dnkmem (mgr.34373) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:53:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:13 gibba043 bash[24019]: cephadm 2021-03-10T13:53:12.597910+0000 mgr.gibba043.dnkmem (mgr.34373) 98 : cephadm [INF] Deploying daemon osd.0 on gibba003 2021-03-10T13:53:14.691 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:14 gibba003 systemd[1]: Stopping Ceph osd.0 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:53:14.691 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[14861]: debug 2021-03-10T13:53:14.560+0000 7f3a2b28f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:53:14.691 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[14861]: debug 2021-03-10T13:53:14.560+0000 7f3a2b28f700 -1 osd.0 65 *** Got signal Terminated *** 2021-03-10T13:53:14.692 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[14861]: debug 2021-03-10T13:53:14.560+0000 7f3a2b28f700 -1 osd.0 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:53:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:13.160664+0000 mgr.gibba043.dnkmem (mgr.34373) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.887241+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:53:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.887339+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 failed (root=default,host=gibba003) (connection refused reported by osd.1) 2021-03-10T13:53:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.887807+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:53:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.887992+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:53:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.888481+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:53:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.888659+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:53:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.889068+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:53:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.889363+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:53:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.889751+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:53:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.889936+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:53:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.890327+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:53:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.890493+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:53:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.890972+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:53:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.891288+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:53:15.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.891781+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:53:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:13.160664+0000 mgr.gibba043.dnkmem (mgr.34373) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.887241+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:53:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.887339+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 failed (root=default,host=gibba003) (connection refused reported by osd.1) 2021-03-10T13:53:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.887807+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:53:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.887992+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:53:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.888481+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:53:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.888659+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:53:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.889068+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:53:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.889363+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:53:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.889751+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:53:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.889936+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:53:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.890327+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:53:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.890493+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:53:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.890972+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:53:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.891288+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:53:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:14 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.891781+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:53:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:13.160664+0000 mgr.gibba043.dnkmem (mgr.34373) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.887241+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:53:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.887339+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 failed (root=default,host=gibba003) (connection refused reported by osd.1) 2021-03-10T13:53:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.887807+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:53:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.887992+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:53:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.888481+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:53:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.888659+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:53:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.889068+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:53:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.889363+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:53:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.889751+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:53:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.889936+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:53:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.890327+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:53:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.890493+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:53:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.890972+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:53:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.891288+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:53:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:14 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.891781+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:53:15.691 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:15 gibba003 docker[33877]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.0 2021-03-10T13:53:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:15 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.944826+0000 mon.a (mon.0) 133 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:15 gibba043 bash[24019]: cluster 2021-03-10T13:53:14.954830+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2021-03-10T13:53:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:15 gibba043 bash[24019]: audit 2021-03-10T13:53:14.958031+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:53:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:15 gibba043 bash[24019]: audit 2021-03-10T13:53:14.961746+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:53:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:15 gibba043 bash[24019]: audit 2021-03-10T13:53:14.963480+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:53:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:15 gibba043 bash[24019]: audit 2021-03-10T13:53:14.963719+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:53:16.338 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.944826+0000 mon.a (mon.0) 133 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:16.339 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[31385]: cluster 2021-03-10T13:53:14.954830+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2021-03-10T13:53:16.339 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[31385]: audit 2021-03-10T13:53:14.958031+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:53:16.339 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[31385]: audit 2021-03-10T13:53:14.961746+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:53:16.339 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[31385]: audit 2021-03-10T13:53:14.963480+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:53:16.340 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[31385]: audit 2021-03-10T13:53:14.963719+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:53:16.340 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.944826+0000 mon.a (mon.0) 133 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:16.340 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[32348]: cluster 2021-03-10T13:53:14.954830+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2021-03-10T13:53:16.340 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[32348]: audit 2021-03-10T13:53:14.958031+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:53:16.341 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[32348]: audit 2021-03-10T13:53:14.961746+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:53:16.341 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[32348]: audit 2021-03-10T13:53:14.963480+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:53:16.341 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:15 gibba003 bash[32348]: audit 2021-03-10T13:53:14.963719+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:53:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:16 gibba003 bash[31385]: cluster 2021-03-10T13:53:15.161720+0000 mgr.gibba043.dnkmem (mgr.34373) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:16 gibba003 bash[31385]: audit 2021-03-10T13:53:15.970415+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:53:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:16 gibba003 bash[31385]: cluster 2021-03-10T13:53:15.970675+0000 mon.a (mon.0) 138 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2021-03-10T13:53:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:16 gibba003 bash[32348]: cluster 2021-03-10T13:53:15.161720+0000 mgr.gibba043.dnkmem (mgr.34373) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:16 gibba003 bash[32348]: audit 2021-03-10T13:53:15.970415+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:53:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:16 gibba003 bash[32348]: cluster 2021-03-10T13:53:15.970675+0000 mon.a (mon.0) 138 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2021-03-10T13:53:17.266 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:17 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.0.service: Succeeded. 2021-03-10T13:53:17.266 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:17 gibba003 systemd[1]: Stopped Ceph osd.0 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:16 gibba043 bash[24019]: cluster 2021-03-10T13:53:15.161720+0000 mgr.gibba043.dnkmem (mgr.34373) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:16 gibba043 bash[24019]: audit 2021-03-10T13:53:15.970415+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:53:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:16 gibba043 bash[24019]: cluster 2021-03-10T13:53:15.970675+0000 mon.a (mon.0) 138 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2021-03-10T13:53:17.691 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:17 gibba003 systemd[1]: Started Ceph osd.0 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:18.587 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[31385]: cluster 2021-03-10T13:53:17.162900+0000 mgr.gibba043.dnkmem (mgr.34373) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:18.669 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[31385]: audit 2021-03-10T13:53:17.364072+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:18.670 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[31385]: audit 2021-03-10T13:53:17.367743+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:18.670 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[31385]: cephadm 2021-03-10T13:53:17.368440+0000 mgr.gibba043.dnkmem (mgr.34373) 102 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:53:18.671 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[32348]: cluster 2021-03-10T13:53:17.162900+0000 mgr.gibba043.dnkmem (mgr.34373) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:18.671 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[32348]: audit 2021-03-10T13:53:17.364072+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:18.672 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[32348]: audit 2021-03-10T13:53:17.367743+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:18.672 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[32348]: cephadm 2021-03-10T13:53:17.368440+0000 mgr.gibba043.dnkmem (mgr.34373) 102 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:53:18.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:18 gibba043 bash[24019]: cluster 2021-03-10T13:53:17.162900+0000 mgr.gibba043.dnkmem (mgr.34373) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:18.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:18 gibba043 bash[24019]: audit 2021-03-10T13:53:17.364072+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:18.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:18 gibba043 bash[24019]: audit 2021-03-10T13:53:17.367743+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:18.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:18 gibba043 bash[24019]: cephadm 2021-03-10T13:53:17.368440+0000 mgr.gibba043.dnkmem (mgr.34373) 102 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:53:18.941 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:53:18.942 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T13:53:18.942 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:53:18.943 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:53:18.943 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:53:18.943 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:53:18.944 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:18 gibba003 bash[34053]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T13:53:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:19 gibba003 bash[31385]: cluster 2021-03-10T13:53:19.365962+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Degraded data redundancy: 24/195 objects degraded (12.308%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:19 gibba003 bash[32348]: cluster 2021-03-10T13:53:19.365962+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Degraded data redundancy: 24/195 objects degraded (12.308%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:19 gibba043 bash[24019]: cluster 2021-03-10T13:53:19.365962+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Degraded data redundancy: 24/195 objects degraded (12.308%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:20.422 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:20 gibba003 bash[34179]: debug 2021-03-10T13:53:20.128+0000 7fb20f447700 1 -- 172.21.2.103:0/417504800 <== mon.0 v2:172.21.2.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653f917c4e0 con 0x5653f91f8c00 2021-03-10T13:53:20.679 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:20 gibba003 bash[32348]: cluster 2021-03-10T13:53:19.165415+0000 mgr.gibba043.dnkmem (mgr.34373) 103 : cluster [DBG] pgmap v39: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:20.680 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:20 gibba003 bash[31385]: cluster 2021-03-10T13:53:19.165415+0000 mgr.gibba043.dnkmem (mgr.34373) 103 : cluster [DBG] pgmap v39: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:20.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:20 gibba043 bash[24019]: cluster 2021-03-10T13:53:19.165415+0000 mgr.gibba043.dnkmem (mgr.34373) 103 : cluster [DBG] pgmap v39: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:20.955 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:20 gibba003 bash[34179]: debug 2021-03-10T13:53:20.676+0000 7fb216edc080 -1 Falling back to public interface 2021-03-10T13:53:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.075305+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.077090+0000 mgr.gibba043.dnkmem (mgr.34373) 104 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:53:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cluster 2021-03-10T13:53:21.166661+0000 mgr.gibba043.dnkmem (mgr.34373) 105 : cluster [DBG] pgmap v40: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.299665+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.308919+0000 mgr.gibba043.dnkmem (mgr.34373) 106 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.308984+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.310989+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.311013+0000 mgr.gibba043.dnkmem (mgr.34373) 107 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.312862+0000 mgr.gibba043.dnkmem (mgr.34373) 108 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.312928+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.312984+0000 mgr.gibba043.dnkmem (mgr.34373) 109 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.314510+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.314604+0000 mgr.gibba043.dnkmem (mgr.34373) 110 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.314669+0000 mgr.gibba043.dnkmem (mgr.34373) 111 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.315914+0000 mgr.gibba043.dnkmem (mgr.34373) 112 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.317914+0000 mgr.gibba043.dnkmem (mgr.34373) 113 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.317934+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.317979+0000 mgr.gibba043.dnkmem (mgr.34373) 114 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: audit 2021-03-10T13:53:21.318754+0000 mgr.gibba043.dnkmem (mgr.34373) 115 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[31385]: cephadm 2021-03-10T13:53:21.319771+0000 mgr.gibba043.dnkmem (mgr.34373) 116 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:53:22.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.075305+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.077090+0000 mgr.gibba043.dnkmem (mgr.34373) 104 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:53:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cluster 2021-03-10T13:53:21.166661+0000 mgr.gibba043.dnkmem (mgr.34373) 105 : cluster [DBG] pgmap v40: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.299665+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:22.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.308919+0000 mgr.gibba043.dnkmem (mgr.34373) 106 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.308984+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.310989+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.311013+0000 mgr.gibba043.dnkmem (mgr.34373) 107 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.312862+0000 mgr.gibba043.dnkmem (mgr.34373) 108 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:22.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.312928+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.312984+0000 mgr.gibba043.dnkmem (mgr.34373) 109 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.314510+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.314604+0000 mgr.gibba043.dnkmem (mgr.34373) 110 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.314669+0000 mgr.gibba043.dnkmem (mgr.34373) 111 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.315914+0000 mgr.gibba043.dnkmem (mgr.34373) 112 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.317914+0000 mgr.gibba043.dnkmem (mgr.34373) 113 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.317934+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.317979+0000 mgr.gibba043.dnkmem (mgr.34373) 114 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: audit 2021-03-10T13:53:21.318754+0000 mgr.gibba043.dnkmem (mgr.34373) 115 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:22.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:22 gibba003 bash[32348]: cephadm 2021-03-10T13:53:21.319771+0000 mgr.gibba043.dnkmem (mgr.34373) 116 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:53:22.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.075305+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.077090+0000 mgr.gibba043.dnkmem (mgr.34373) 104 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:53:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cluster 2021-03-10T13:53:21.166661+0000 mgr.gibba043.dnkmem (mgr.34373) 105 : cluster [DBG] pgmap v40: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.299665+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.308919+0000 mgr.gibba043.dnkmem (mgr.34373) 106 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.308984+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.310989+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.311013+0000 mgr.gibba043.dnkmem (mgr.34373) 107 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.312862+0000 mgr.gibba043.dnkmem (mgr.34373) 108 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.312928+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.312984+0000 mgr.gibba043.dnkmem (mgr.34373) 109 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.314510+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.314604+0000 mgr.gibba043.dnkmem (mgr.34373) 110 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.314669+0000 mgr.gibba043.dnkmem (mgr.34373) 111 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.315914+0000 mgr.gibba043.dnkmem (mgr.34373) 112 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.317914+0000 mgr.gibba043.dnkmem (mgr.34373) 113 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.317934+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.317979+0000 mgr.gibba043.dnkmem (mgr.34373) 114 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: audit 2021-03-10T13:53:21.318754+0000 mgr.gibba043.dnkmem (mgr.34373) 115 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:22 gibba043 bash[24019]: cephadm 2021-03-10T13:53:21.319771+0000 mgr.gibba043.dnkmem (mgr.34373) 116 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:53:24.191 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:23 gibba003 bash[34179]: debug 2021-03-10T13:53:23.912+0000 7fb216edc080 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:53:24.192 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:23 gibba003 bash[34179]: debug 2021-03-10T13:53:23.912+0000 7fb20119f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:53:24.192 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:23 gibba003 bash[34179]: debug 2021-03-10T13:53:23.912+0000 7fb20119f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #1:bc060cea:::INTEL_SSDPEL1K375GA_PHKM9200008A375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:53:24.192 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:24 gibba003 bash[34179]: debug 2021-03-10T13:53:24.040+0000 7fb216edc080 -1 osd.0 65 log_to_monitors {default=true} 2021-03-10T13:53:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:24 gibba043 bash[24019]: cluster 2021-03-10T13:53:23.168021+0000 mgr.gibba043.dnkmem (mgr.34373) 117 : cluster [DBG] pgmap v41: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:24 gibba043 bash[24019]: audit 2021-03-10T13:53:24.045680+0000 mon.a (mon.0) 143 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:53:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:24 gibba003 bash[32348]: cluster 2021-03-10T13:53:23.168021+0000 mgr.gibba043.dnkmem (mgr.34373) 117 : cluster [DBG] pgmap v41: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:24 gibba003 bash[32348]: audit 2021-03-10T13:53:24.045680+0000 mon.a (mon.0) 143 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:53:24.692 INFO:journalctl@ceph.osd.0.gibba003.stdout:Mar 10 13:53:24 gibba003 bash[34179]: debug 2021-03-10T13:53:24.240+0000 7fb206bb9700 -1 osd.0 65 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:53:24.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:24 gibba003 bash[31385]: cluster 2021-03-10T13:53:23.168021+0000 mgr.gibba043.dnkmem (mgr.34373) 117 : cluster [DBG] pgmap v41: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:24.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:24 gibba003 bash[31385]: audit 2021-03-10T13:53:24.045680+0000 mon.a (mon.0) 143 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:53:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:25 gibba043 bash[24019]: audit 2021-03-10T13:53:24.238634+0000 mon.a (mon.0) 144 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:53:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:25 gibba043 bash[24019]: cluster 2021-03-10T13:53:24.238688+0000 mon.a (mon.0) 145 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:53:25.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:25 gibba043 bash[24019]: audit 2021-03-10T13:53:24.239118+0000 mon.a (mon.0) 146 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:53:25.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:25 gibba003 bash[31385]: audit 2021-03-10T13:53:24.238634+0000 mon.a (mon.0) 144 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:53:25.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:25 gibba003 bash[31385]: cluster 2021-03-10T13:53:24.238688+0000 mon.a (mon.0) 145 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:53:25.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:25 gibba003 bash[31385]: audit 2021-03-10T13:53:24.239118+0000 mon.a (mon.0) 146 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:53:25.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:25 gibba003 bash[32348]: audit 2021-03-10T13:53:24.238634+0000 mon.a (mon.0) 144 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:53:25.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:25 gibba003 bash[32348]: cluster 2021-03-10T13:53:24.238688+0000 mon.a (mon.0) 145 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:53:25.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:25 gibba003 bash[32348]: audit 2021-03-10T13:53:24.239118+0000 mon.a (mon.0) 146 : audit [INF] from='osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:53:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:26 gibba043 bash[24019]: cluster 2021-03-10T13:53:25.169217+0000 mgr.gibba043.dnkmem (mgr.34373) 118 : cluster [DBG] pgmap v43: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:26 gibba043 bash[24019]: cluster 2021-03-10T13:53:25.242064+0000 mon.a (mon.0) 147 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:26 gibba043 bash[24019]: cluster 2021-03-10T13:53:25.252960+0000 mon.a (mon.0) 148 : cluster [INF] osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326] boot 2021-03-10T13:53:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:26 gibba043 bash[24019]: cluster 2021-03-10T13:53:25.253280+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-03-10T13:53:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:26 gibba043 bash[24019]: audit 2021-03-10T13:53:25.255000+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:53:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:26 gibba043 bash[24019]: cluster 2021-03-10T13:53:26.256347+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-03-10T13:53:26.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[31385]: cluster 2021-03-10T13:53:25.169217+0000 mgr.gibba043.dnkmem (mgr.34373) 118 : cluster [DBG] pgmap v43: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:26.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[31385]: cluster 2021-03-10T13:53:25.242064+0000 mon.a (mon.0) 147 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:26.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[31385]: cluster 2021-03-10T13:53:25.252960+0000 mon.a (mon.0) 148 : cluster [INF] osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326] boot 2021-03-10T13:53:26.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[31385]: cluster 2021-03-10T13:53:25.253280+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-03-10T13:53:26.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[31385]: audit 2021-03-10T13:53:25.255000+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:53:26.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[31385]: cluster 2021-03-10T13:53:26.256347+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-03-10T13:53:26.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[32348]: cluster 2021-03-10T13:53:25.169217+0000 mgr.gibba043.dnkmem (mgr.34373) 118 : cluster [DBG] pgmap v43: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:26.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[32348]: cluster 2021-03-10T13:53:25.242064+0000 mon.a (mon.0) 147 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:26.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[32348]: cluster 2021-03-10T13:53:25.252960+0000 mon.a (mon.0) 148 : cluster [INF] osd.0 [v2:172.21.2.103:6800/309122326,v1:172.21.2.103:6801/309122326] boot 2021-03-10T13:53:26.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[32348]: cluster 2021-03-10T13:53:25.253280+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-03-10T13:53:26.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[32348]: audit 2021-03-10T13:53:25.255000+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:53:26.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:26 gibba003 bash[32348]: cluster 2021-03-10T13:53:26.256347+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-03-10T13:53:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:28 gibba003 bash[31385]: cluster 2021-03-10T13:53:27.170648+0000 mgr.gibba043.dnkmem (mgr.34373) 119 : cluster [DBG] pgmap v46: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:28.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:28 gibba003 bash[32348]: cluster 2021-03-10T13:53:27.170648+0000 mgr.gibba043.dnkmem (mgr.34373) 119 : cluster [DBG] pgmap v46: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:29.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:28 gibba043 bash[24019]: cluster 2021-03-10T13:53:27.170648+0000 mgr.gibba043.dnkmem (mgr.34373) 119 : cluster [DBG] pgmap v46: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T13:53:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:29 gibba003 bash[31385]: cluster 2021-03-10T13:53:29.573877+0000 mon.a (mon.0) 151 : cluster [WRN] Health check update: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:29 gibba003 bash[32348]: cluster 2021-03-10T13:53:29.573877+0000 mon.a (mon.0) 151 : cluster [WRN] Health check update: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:30.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:29 gibba043 bash[24019]: cluster 2021-03-10T13:53:29.573877+0000 mon.a (mon.0) 151 : cluster [WRN] Health check update: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:30 gibba003 bash[31385]: cluster 2021-03-10T13:53:29.172797+0000 mgr.gibba043.dnkmem (mgr.34373) 120 : cluster [DBG] pgmap v47: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:53:30.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:30 gibba003 bash[32348]: cluster 2021-03-10T13:53:29.172797+0000 mgr.gibba043.dnkmem (mgr.34373) 120 : cluster [DBG] pgmap v47: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:53:31.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:30 gibba043 bash[24019]: cluster 2021-03-10T13:53:29.172797+0000 mgr.gibba043.dnkmem (mgr.34373) 120 : cluster [DBG] pgmap v47: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:53:32.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:32 gibba003 bash[31385]: cluster 2021-03-10T13:53:31.174337+0000 mgr.gibba043.dnkmem (mgr.34373) 121 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:32.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:32 gibba003 bash[31385]: cluster 2021-03-10T13:53:31.632078+0000 mon.a (mon.0) 152 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded) 2021-03-10T13:53:32.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:32 gibba003 bash[32348]: cluster 2021-03-10T13:53:31.174337+0000 mgr.gibba043.dnkmem (mgr.34373) 121 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:32.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:32 gibba003 bash[32348]: cluster 2021-03-10T13:53:31.632078+0000 mon.a (mon.0) 152 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded) 2021-03-10T13:53:33.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:32 gibba043 bash[24019]: cluster 2021-03-10T13:53:31.174337+0000 mgr.gibba043.dnkmem (mgr.34373) 121 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:33.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:32 gibba043 bash[24019]: cluster 2021-03-10T13:53:31.632078+0000 mon.a (mon.0) 152 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded) 2021-03-10T13:53:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:33 gibba043 bash[24019]: audit 2021-03-10T13:53:32.707608+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:33 gibba003 bash[31385]: audit 2021-03-10T13:53:32.707608+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:33 gibba003 bash[32348]: audit 2021-03-10T13:53:32.707608+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:34.839 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:53:35.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:34 gibba043 bash[24019]: cluster 2021-03-10T13:53:33.175342+0000 mgr.gibba043.dnkmem (mgr.34373) 122 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:35.064 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:53:35.064 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (117s) 13s ago 7m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:53:35.065 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (7m) 51s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:53:35.065 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2m) 51s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:53:35.065 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2m) 51s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:53:35.065 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (98s) 13s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:53:35.066 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (89s) 13s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:53:35.066 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (62s) 51s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:53:35.066 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (73s) 13s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:53:35.066 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (7m) 13s ago 7m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:53:35.067 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (7m) 51s ago 7m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:53:35.067 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (15s) 13s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:53:35.067 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (9m) 13s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cc8e95189180 2021-03-10T13:53:35.067 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (9m) 13s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:53:35.067 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (9m) 13s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:53:35.068 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (8m) 51s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:53:35.068 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (8m) 51s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:53:35.068 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (8m) 51s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:53:35.068 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (7m) 51s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:53:35.068 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (6m) 51s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:53:35.069 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 13s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:53:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:34 gibba003 bash[31385]: cluster 2021-03-10T13:53:33.175342+0000 mgr.gibba043.dnkmem (mgr.34373) 122 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:35.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:34 gibba003 bash[32348]: cluster 2021-03-10T13:53:33.175342+0000 mgr.gibba043.dnkmem (mgr.34373) 122 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:35.315 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:53:35.315 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:53:35.315 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:35.316 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:53:35.316 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:53:35.316 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:35.316 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:53:35.316 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:53:35.317 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T13:53:35.317 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 1 2021-03-10T13:53:35.317 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:53:35.317 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:53:35.318 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:53:35.318 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T13:53:35.318 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T13:53:35.318 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:53:35.318 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:53:36.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:35 gibba043 bash[24019]: audit 2021-03-10T13:53:34.831484+0000 mgr.gibba043.dnkmem (mgr.34373) 123 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:35 gibba043 bash[24019]: audit 2021-03-10T13:53:35.315109+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.103:0/503970491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:35 gibba003 bash[31385]: audit 2021-03-10T13:53:34.831484+0000 mgr.gibba043.dnkmem (mgr.34373) 123 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:35 gibba003 bash[31385]: audit 2021-03-10T13:53:35.315109+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.103:0/503970491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:35 gibba003 bash[32348]: audit 2021-03-10T13:53:34.831484+0000 mgr.gibba043.dnkmem (mgr.34373) 123 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:36.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:35 gibba003 bash[32348]: audit 2021-03-10T13:53:35.315109+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.103:0/503970491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:36 gibba003 bash[31385]: audit 2021-03-10T13:53:35.053908+0000 mgr.gibba043.dnkmem (mgr.34373) 124 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:36.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:36 gibba003 bash[31385]: cluster 2021-03-10T13:53:35.177343+0000 mgr.gibba043.dnkmem (mgr.34373) 125 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:36 gibba003 bash[31385]: audit 2021-03-10T13:53:36.332899+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:36.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:36 gibba003 bash[32348]: audit 2021-03-10T13:53:35.053908+0000 mgr.gibba043.dnkmem (mgr.34373) 124 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:36.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:36 gibba003 bash[32348]: cluster 2021-03-10T13:53:35.177343+0000 mgr.gibba043.dnkmem (mgr.34373) 125 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:36.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:36 gibba003 bash[32348]: audit 2021-03-10T13:53:36.332899+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:37.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:36 gibba043 bash[24019]: audit 2021-03-10T13:53:35.053908+0000 mgr.gibba043.dnkmem (mgr.34373) 124 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:37.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:36 gibba043 bash[24019]: cluster 2021-03-10T13:53:35.177343+0000 mgr.gibba043.dnkmem (mgr.34373) 125 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:37.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:36 gibba043 bash[24019]: audit 2021-03-10T13:53:36.332899+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:37 gibba043 bash[24019]: audit 2021-03-10T13:53:36.334349+0000 mgr.gibba043.dnkmem (mgr.34373) 126 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:37 gibba043 bash[24019]: cephadm 2021-03-10T13:53:36.339338+0000 mgr.gibba043.dnkmem (mgr.34373) 127 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:53:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:37 gibba003 bash[31385]: audit 2021-03-10T13:53:36.334349+0000 mgr.gibba043.dnkmem (mgr.34373) 126 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:37 gibba003 bash[31385]: cephadm 2021-03-10T13:53:36.339338+0000 mgr.gibba043.dnkmem (mgr.34373) 127 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:53:38.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:37 gibba003 bash[32348]: audit 2021-03-10T13:53:36.334349+0000 mgr.gibba043.dnkmem (mgr.34373) 126 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:53:38.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:37 gibba003 bash[32348]: cephadm 2021-03-10T13:53:36.339338+0000 mgr.gibba043.dnkmem (mgr.34373) 127 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:53:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:38 gibba003 bash[31385]: cluster 2021-03-10T13:53:37.178595+0000 mgr.gibba043.dnkmem (mgr.34373) 128 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:38 gibba003 bash[31385]: audit 2021-03-10T13:53:38.334978+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:38 gibba003 bash[31385]: audit 2021-03-10T13:53:38.340156+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:53:38.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:38 gibba003 bash[32348]: cluster 2021-03-10T13:53:37.178595+0000 mgr.gibba043.dnkmem (mgr.34373) 128 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:38.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:38 gibba003 bash[32348]: audit 2021-03-10T13:53:38.334978+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:38 gibba003 bash[32348]: audit 2021-03-10T13:53:38.340156+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:53:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:38 gibba043 bash[24019]: cluster 2021-03-10T13:53:37.178595+0000 mgr.gibba043.dnkmem (mgr.34373) 128 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:38 gibba043 bash[24019]: audit 2021-03-10T13:53:38.334978+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:38 gibba043 bash[24019]: audit 2021-03-10T13:53:38.340156+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:53:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:39 gibba003 bash[31385]: cephadm 2021-03-10T13:53:38.329539+0000 mgr.gibba043.dnkmem (mgr.34373) 129 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:53:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:39 gibba003 bash[31385]: cephadm 2021-03-10T13:53:38.340341+0000 mgr.gibba043.dnkmem (mgr.34373) 130 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:53:39.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:39 gibba003 bash[32348]: cephadm 2021-03-10T13:53:38.329539+0000 mgr.gibba043.dnkmem (mgr.34373) 129 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:53:39.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:39 gibba003 bash[32348]: cephadm 2021-03-10T13:53:38.340341+0000 mgr.gibba043.dnkmem (mgr.34373) 130 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:53:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:39 gibba043 bash[24019]: cephadm 2021-03-10T13:53:38.329539+0000 mgr.gibba043.dnkmem (mgr.34373) 129 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:53:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:39 gibba043 bash[24019]: cephadm 2021-03-10T13:53:38.340341+0000 mgr.gibba043.dnkmem (mgr.34373) 130 : cephadm [INF] Deploying daemon osd.1 on gibba003 2021-03-10T13:53:40.440 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:40 gibba003 systemd[1]: Stopping Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:53:40.441 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[17982]: debug 2021-03-10T13:53:40.288+0000 7f8dad654700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:53:40.441 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[17982]: debug 2021-03-10T13:53:40.288+0000 7f8dad654700 -1 osd.1 70 *** Got signal Terminated *** 2021-03-10T13:53:40.441 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[17982]: debug 2021-03-10T13:53:40.288+0000 7f8dad654700 -1 osd.1 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:53:40.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:39.180406+0000 mgr.gibba043.dnkmem (mgr.34373) 131 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:40.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.619069+0000 mon.a (mon.0) 156 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:53:40.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.619175+0000 mon.a (mon.0) 157 : cluster [INF] osd.1 failed (root=default,host=gibba003) (connection refused reported by osd.2) 2021-03-10T13:53:40.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.619834+0000 mon.a (mon.0) 158 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:53:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.620154+0000 mon.a (mon.0) 159 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:53:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.620526+0000 mon.a (mon.0) 160 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:53:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.620833+0000 mon.a (mon.0) 161 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:53:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.621130+0000 mon.a (mon.0) 162 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:53:40.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.621596+0000 mon.a (mon.0) 163 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:53:40.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.621904+0000 mon.a (mon.0) 164 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:53:40.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.622397+0000 mon.a (mon.0) 165 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:53:40.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.622737+0000 mon.a (mon.0) 166 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:53:40.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.623213+0000 mon.a (mon.0) 167 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:53:40.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.623501+0000 mon.a (mon.0) 168 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:53:40.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.624031+0000 mon.a (mon.0) 169 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:53:40.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.624318+0000 mon.a (mon.0) 170 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:53:40.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:39.180406+0000 mgr.gibba043.dnkmem (mgr.34373) 131 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:40.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.619069+0000 mon.a (mon.0) 156 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:53:40.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.619175+0000 mon.a (mon.0) 157 : cluster [INF] osd.1 failed (root=default,host=gibba003) (connection refused reported by osd.2) 2021-03-10T13:53:40.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.619834+0000 mon.a (mon.0) 158 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:53:40.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.620154+0000 mon.a (mon.0) 159 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:53:40.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.620526+0000 mon.a (mon.0) 160 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:53:40.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.620833+0000 mon.a (mon.0) 161 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:53:40.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.621130+0000 mon.a (mon.0) 162 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:53:40.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.621596+0000 mon.a (mon.0) 163 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:53:40.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.621904+0000 mon.a (mon.0) 164 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:53:40.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.622397+0000 mon.a (mon.0) 165 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:53:40.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.622737+0000 mon.a (mon.0) 166 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:53:40.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.623213+0000 mon.a (mon.0) 167 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:53:40.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.623501+0000 mon.a (mon.0) 168 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:53:40.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.624031+0000 mon.a (mon.0) 169 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:53:40.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:40 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.624318+0000 mon.a (mon.0) 170 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:53:41.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:39.180406+0000 mgr.gibba043.dnkmem (mgr.34373) 131 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.619069+0000 mon.a (mon.0) 156 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:53:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.619175+0000 mon.a (mon.0) 157 : cluster [INF] osd.1 failed (root=default,host=gibba003) (connection refused reported by osd.2) 2021-03-10T13:53:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.619834+0000 mon.a (mon.0) 158 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:53:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.620154+0000 mon.a (mon.0) 159 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:53:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.620526+0000 mon.a (mon.0) 160 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:53:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.620833+0000 mon.a (mon.0) 161 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:53:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.621130+0000 mon.a (mon.0) 162 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:53:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.621596+0000 mon.a (mon.0) 163 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:53:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.621904+0000 mon.a (mon.0) 164 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:53:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.622397+0000 mon.a (mon.0) 165 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:53:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.622737+0000 mon.a (mon.0) 166 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:53:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.623213+0000 mon.a (mon.0) 167 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:53:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.623501+0000 mon.a (mon.0) 168 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:53:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.624031+0000 mon.a (mon.0) 169 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:53:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:40 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.624318+0000 mon.a (mon.0) 170 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:53:41.440 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:41 gibba003 docker[35108]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.1 2021-03-10T13:53:42.037 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:41 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.774225+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:42.037 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:41 gibba003 bash[31385]: cluster 2021-03-10T13:53:40.786644+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e71: 8 total, 7 up, 8 in 2021-03-10T13:53:42.038 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:41 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.774225+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:42.038 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:41 gibba003 bash[32348]: cluster 2021-03-10T13:53:40.786644+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e71: 8 total, 7 up, 8 in 2021-03-10T13:53:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:41 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.774225+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:42.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:41 gibba043 bash[24019]: cluster 2021-03-10T13:53:40.786644+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e71: 8 total, 7 up, 8 in 2021-03-10T13:53:43.085 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:42 gibba003 bash[31385]: cluster 2021-03-10T13:53:41.181617+0000 mgr.gibba043.dnkmem (mgr.34373) 132 : cluster [DBG] pgmap v54: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:43.085 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:42 gibba003 bash[31385]: cluster 2021-03-10T13:53:41.789714+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2021-03-10T13:53:43.086 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:42 gibba003 bash[32348]: cluster 2021-03-10T13:53:41.181617+0000 mgr.gibba043.dnkmem (mgr.34373) 132 : cluster [DBG] pgmap v54: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:43.086 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:42 gibba003 bash[32348]: cluster 2021-03-10T13:53:41.789714+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2021-03-10T13:53:43.086 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:42 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.1.service: Succeeded. 2021-03-10T13:53:43.087 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:42 gibba003 systemd[1]: Stopped Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:43.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:42 gibba043 bash[24019]: cluster 2021-03-10T13:53:41.181617+0000 mgr.gibba043.dnkmem (mgr.34373) 132 : cluster [DBG] pgmap v54: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:43.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:42 gibba043 bash[24019]: cluster 2021-03-10T13:53:41.789714+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2021-03-10T13:53:43.441 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:43 gibba003 systemd[1]: Started Ceph osd.1 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:44.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[32348]: audit 2021-03-10T13:53:43.108061+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:44.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[32348]: audit 2021-03-10T13:53:43.111642+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:44.252 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[32348]: cluster 2021-03-10T13:53:43.182385+0000 mgr.gibba043.dnkmem (mgr.34373) 133 : cluster [DBG] pgmap v56: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:44.253 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[31385]: audit 2021-03-10T13:53:43.108061+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:44.253 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[31385]: audit 2021-03-10T13:53:43.111642+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:44.253 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[31385]: cluster 2021-03-10T13:53:43.182385+0000 mgr.gibba043.dnkmem (mgr.34373) 133 : cluster [DBG] pgmap v56: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:44 gibba043 bash[24019]: audit 2021-03-10T13:53:43.108061+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:44 gibba043 bash[24019]: audit 2021-03-10T13:53:43.111642+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:44 gibba043 bash[24019]: cluster 2021-03-10T13:53:43.182385+0000 mgr.gibba043.dnkmem (mgr.34373) 133 : cluster [DBG] pgmap v56: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:53:44.691 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:53:44.691 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:53:44.691 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:53:44.692 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:53:44.692 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:53:44.692 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:53:44.692 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:44 gibba003 bash[35287]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:53:45.665 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:45 gibba003 bash[31385]: cluster 2021-03-10T13:53:45.236274+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: Degraded data redundancy: 26/195 objects degraded (13.333%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:45.666 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:45 gibba003 bash[32348]: cluster 2021-03-10T13:53:45.236274+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: Degraded data redundancy: 26/195 objects degraded (13.333%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:45 gibba043 bash[24019]: cluster 2021-03-10T13:53:45.236274+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: Degraded data redundancy: 26/195 objects degraded (13.333%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:45.941 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:45 gibba003 bash[35418]: debug 2021-03-10T13:53:45.749+0000 7f36ea2e2700 1 -- 172.21.2.103:0/1564980868 <== mon.0 v2:172.21.2.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55af7b7204e0 con 0x55af7b79d400 2021-03-10T13:53:46.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:46 gibba003 bash[31385]: cluster 2021-03-10T13:53:45.184737+0000 mgr.gibba043.dnkmem (mgr.34373) 134 : cluster [DBG] pgmap v57: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:46.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:46 gibba003 bash[32348]: cluster 2021-03-10T13:53:45.184737+0000 mgr.gibba043.dnkmem (mgr.34373) 134 : cluster [DBG] pgmap v57: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:46.692 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:46 gibba003 bash[35418]: debug 2021-03-10T13:53:46.309+0000 7f36f1d77080 -1 Falling back to public interface 2021-03-10T13:53:46.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:46 gibba043 bash[24019]: cluster 2021-03-10T13:53:45.184737+0000 mgr.gibba043.dnkmem (mgr.34373) 134 : cluster [DBG] pgmap v57: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:48.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: cluster 2021-03-10T13:53:47.185872+0000 mgr.gibba043.dnkmem (mgr.34373) 135 : cluster [DBG] pgmap v58: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:48.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.333219+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:48.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.337754+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:48.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.342881+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:48.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.344544+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.346021+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.347506+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:48 gibba043 bash[24019]: audit 2021-03-10T13:53:48.351026+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:53:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: cluster 2021-03-10T13:53:47.185872+0000 mgr.gibba043.dnkmem (mgr.34373) 135 : cluster [DBG] pgmap v58: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.333219+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.337754+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.342881+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.344544+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.346021+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.347506+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[31385]: audit 2021-03-10T13:53:48.351026+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:53:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: cluster 2021-03-10T13:53:47.185872+0000 mgr.gibba043.dnkmem (mgr.34373) 135 : cluster [DBG] pgmap v58: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.333219+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.337754+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:53:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.342881+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.344544+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.346021+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.347506+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:48 gibba003 bash[32348]: audit 2021-03-10T13:53:48.351026+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:53:49.941 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[35418]: debug 2021-03-10T13:53:49.601+0000 7f36f1d77080 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:53:49.997 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[35418]: debug 2021-03-10T13:53:49.601+0000 7f36db038700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:53:49.998 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[35418]: debug 2021-03-10T13:53:49.729+0000 7f36f1d77080 -1 osd.1 70 log_to_monitors {default=true} 2021-03-10T13:53:49.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.342605+0000 mgr.gibba043.dnkmem (mgr.34373) 136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:49.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.344686+0000 mgr.gibba043.dnkmem (mgr.34373) 137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:49.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.346094+0000 mgr.gibba043.dnkmem (mgr.34373) 138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:49.999 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.346138+0000 mgr.gibba043.dnkmem (mgr.34373) 139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:50.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.347587+0000 mgr.gibba043.dnkmem (mgr.34373) 140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:50.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.347651+0000 mgr.gibba043.dnkmem (mgr.34373) 141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:50.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.349053+0000 mgr.gibba043.dnkmem (mgr.34373) 142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:50.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.350931+0000 mgr.gibba043.dnkmem (mgr.34373) 143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:50.000 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.350977+0000 mgr.gibba043.dnkmem (mgr.34373) 144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:50.001 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: audit 2021-03-10T13:53:48.351810+0000 mgr.gibba043.dnkmem (mgr.34373) 145 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:53:50.001 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[31385]: cephadm 2021-03-10T13:53:48.353026+0000 mgr.gibba043.dnkmem (mgr.34373) 146 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:53:50.001 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.342605+0000 mgr.gibba043.dnkmem (mgr.34373) 136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:50.002 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.344686+0000 mgr.gibba043.dnkmem (mgr.34373) 137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:50.002 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.346094+0000 mgr.gibba043.dnkmem (mgr.34373) 138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:50.002 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.346138+0000 mgr.gibba043.dnkmem (mgr.34373) 139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:50.002 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.347587+0000 mgr.gibba043.dnkmem (mgr.34373) 140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:50.002 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.347651+0000 mgr.gibba043.dnkmem (mgr.34373) 141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:50.003 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.349053+0000 mgr.gibba043.dnkmem (mgr.34373) 142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:50.003 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.350931+0000 mgr.gibba043.dnkmem (mgr.34373) 143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:50.003 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.350977+0000 mgr.gibba043.dnkmem (mgr.34373) 144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:50.003 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: audit 2021-03-10T13:53:48.351810+0000 mgr.gibba043.dnkmem (mgr.34373) 145 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:53:50.003 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:49 gibba003 bash[32348]: cephadm 2021-03-10T13:53:48.353026+0000 mgr.gibba043.dnkmem (mgr.34373) 146 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:53:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.342605+0000 mgr.gibba043.dnkmem (mgr.34373) 136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.344686+0000 mgr.gibba043.dnkmem (mgr.34373) 137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.346094+0000 mgr.gibba043.dnkmem (mgr.34373) 138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.346138+0000 mgr.gibba043.dnkmem (mgr.34373) 139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.347587+0000 mgr.gibba043.dnkmem (mgr.34373) 140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.347651+0000 mgr.gibba043.dnkmem (mgr.34373) 141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.349053+0000 mgr.gibba043.dnkmem (mgr.34373) 142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.350931+0000 mgr.gibba043.dnkmem (mgr.34373) 143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.350977+0000 mgr.gibba043.dnkmem (mgr.34373) 144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: audit 2021-03-10T13:53:48.351810+0000 mgr.gibba043.dnkmem (mgr.34373) 145 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:53:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:49 gibba043 bash[24019]: cephadm 2021-03-10T13:53:48.353026+0000 mgr.gibba043.dnkmem (mgr.34373) 146 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:53:50.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:50 gibba003 bash[31385]: cluster 2021-03-10T13:53:49.187936+0000 mgr.gibba043.dnkmem (mgr.34373) 147 : cluster [DBG] pgmap v59: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:50.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:50 gibba003 bash[31385]: audit 2021-03-10T13:53:49.735312+0000 mon.a (mon.0) 178 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:53:50.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:50 gibba003 bash[32348]: cluster 2021-03-10T13:53:49.187936+0000 mgr.gibba043.dnkmem (mgr.34373) 147 : cluster [DBG] pgmap v59: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:50.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:50 gibba003 bash[32348]: audit 2021-03-10T13:53:49.735312+0000 mon.a (mon.0) 178 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:53:50.942 INFO:journalctl@ceph.osd.1.gibba003.stdout:Mar 10 13:53:50 gibba003 bash[35418]: debug 2021-03-10T13:53:50.605+0000 7f36e1253700 -1 osd.1 70 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:53:51.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:50 gibba043 bash[24019]: cluster 2021-03-10T13:53:49.187936+0000 mgr.gibba043.dnkmem (mgr.34373) 147 : cluster [DBG] pgmap v59: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:51.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:50 gibba043 bash[24019]: audit 2021-03-10T13:53:49.735312+0000 mon.a (mon.0) 178 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:53:51.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:51 gibba003 bash[31385]: audit 2021-03-10T13:53:50.600349+0000 mon.a (mon.0) 179 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:53:51.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:51 gibba003 bash[31385]: cluster 2021-03-10T13:53:50.600377+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:53:51.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:51 gibba003 bash[31385]: audit 2021-03-10T13:53:50.600893+0000 mon.a (mon.0) 181 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:53:51.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:51 gibba003 bash[32348]: audit 2021-03-10T13:53:50.600349+0000 mon.a (mon.0) 179 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:53:51.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:51 gibba003 bash[32348]: cluster 2021-03-10T13:53:50.600377+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:53:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:51 gibba003 bash[32348]: audit 2021-03-10T13:53:50.600893+0000 mon.a (mon.0) 181 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:53:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:51 gibba043 bash[24019]: audit 2021-03-10T13:53:50.600349+0000 mon.a (mon.0) 179 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:53:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:51 gibba043 bash[24019]: cluster 2021-03-10T13:53:50.600377+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:53:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:51 gibba043 bash[24019]: audit 2021-03-10T13:53:50.600893+0000 mon.a (mon.0) 181 : audit [INF] from='osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:53:52.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[31385]: cluster 2021-03-10T13:53:51.188879+0000 mgr.gibba043.dnkmem (mgr.34373) 148 : cluster [DBG] pgmap v61: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:52.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[31385]: cluster 2021-03-10T13:53:51.599248+0000 mon.a (mon.0) 182 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[31385]: cluster 2021-03-10T13:53:51.603178+0000 mon.a (mon.0) 183 : cluster [INF] osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125] boot 2021-03-10T13:53:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[31385]: cluster 2021-03-10T13:53:51.603229+0000 mon.a (mon.0) 184 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-03-10T13:53:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[31385]: audit 2021-03-10T13:53:51.604419+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:53:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[32348]: cluster 2021-03-10T13:53:51.188879+0000 mgr.gibba043.dnkmem (mgr.34373) 148 : cluster [DBG] pgmap v61: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[32348]: cluster 2021-03-10T13:53:51.599248+0000 mon.a (mon.0) 182 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[32348]: cluster 2021-03-10T13:53:51.603178+0000 mon.a (mon.0) 183 : cluster [INF] osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125] boot 2021-03-10T13:53:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[32348]: cluster 2021-03-10T13:53:51.603229+0000 mon.a (mon.0) 184 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-03-10T13:53:52.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:52 gibba003 bash[32348]: audit 2021-03-10T13:53:51.604419+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:53:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:52 gibba043 bash[24019]: cluster 2021-03-10T13:53:51.188879+0000 mgr.gibba043.dnkmem (mgr.34373) 148 : cluster [DBG] pgmap v61: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:52 gibba043 bash[24019]: cluster 2021-03-10T13:53:51.599248+0000 mon.a (mon.0) 182 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:52 gibba043 bash[24019]: cluster 2021-03-10T13:53:51.603178+0000 mon.a (mon.0) 183 : cluster [INF] osd.1 [v2:172.21.2.103:6808/4118633125,v1:172.21.2.103:6809/4118633125] boot 2021-03-10T13:53:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:52 gibba043 bash[24019]: cluster 2021-03-10T13:53:51.603229+0000 mon.a (mon.0) 184 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-03-10T13:53:53.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:52 gibba043 bash[24019]: audit 2021-03-10T13:53:51.604419+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:53:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:53 gibba003 bash[31385]: cluster 2021-03-10T13:53:52.624128+0000 mon.a (mon.0) 185 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-03-10T13:53:54.099 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:53 gibba003 bash[32348]: cluster 2021-03-10T13:53:52.624128+0000 mon.a (mon.0) 185 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-03-10T13:53:54.099 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:53 gibba043 bash[24019]: cluster 2021-03-10T13:53:52.624128+0000 mon.a (mon.0) 185 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-03-10T13:53:54.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:54 gibba003 bash[31385]: cluster 2021-03-10T13:53:53.190299+0000 mgr.gibba043.dnkmem (mgr.34373) 149 : cluster [DBG] pgmap v64: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:54 gibba003 bash[32348]: cluster 2021-03-10T13:53:53.190299+0000 mgr.gibba043.dnkmem (mgr.34373) 149 : cluster [DBG] pgmap v64: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:55.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:54 gibba043 bash[24019]: cluster 2021-03-10T13:53:53.190299+0000 mgr.gibba043.dnkmem (mgr.34373) 149 : cluster [DBG] pgmap v64: 129 pgs: 19 active+undersized+degraded, 37 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:53:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:55 gibba043 bash[24019]: cluster 2021-03-10T13:53:55.640251+0000 mon.a (mon.0) 186 : cluster [WRN] Health check update: Degraded data redundancy: 9/195 objects degraded (4.615%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:55 gibba003 bash[31385]: cluster 2021-03-10T13:53:55.640251+0000 mon.a (mon.0) 186 : cluster [WRN] Health check update: Degraded data redundancy: 9/195 objects degraded (4.615%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:55 gibba003 bash[32348]: cluster 2021-03-10T13:53:55.640251+0000 mon.a (mon.0) 186 : cluster [WRN] Health check update: Degraded data redundancy: 9/195 objects degraded (4.615%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:57.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:56 gibba043 bash[24019]: cluster 2021-03-10T13:53:55.192245+0000 mgr.gibba043.dnkmem (mgr.34373) 150 : cluster [DBG] pgmap v65: 129 pgs: 5 active+undersized+degraded, 13 active+undersized, 111 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 9/195 objects degraded (4.615%) 2021-03-10T13:53:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:56 gibba003 bash[31385]: cluster 2021-03-10T13:53:55.192245+0000 mgr.gibba043.dnkmem (mgr.34373) 150 : cluster [DBG] pgmap v65: 129 pgs: 5 active+undersized+degraded, 13 active+undersized, 111 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 9/195 objects degraded (4.615%) 2021-03-10T13:53:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:56 gibba003 bash[32348]: cluster 2021-03-10T13:53:55.192245+0000 mgr.gibba043.dnkmem (mgr.34373) 150 : cluster [DBG] pgmap v65: 129 pgs: 5 active+undersized+degraded, 13 active+undersized, 111 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 9/195 objects degraded (4.615%) 2021-03-10T13:53:58.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:57 gibba043 bash[24019]: cluster 2021-03-10T13:53:57.699635+0000 mon.a (mon.0) 187 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/195 objects degraded (4.615%), 5 pgs degraded) 2021-03-10T13:53:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:57 gibba003 bash[31385]: cluster 2021-03-10T13:53:57.699635+0000 mon.a (mon.0) 187 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/195 objects degraded (4.615%), 5 pgs degraded) 2021-03-10T13:53:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:57 gibba003 bash[32348]: cluster 2021-03-10T13:53:57.699635+0000 mon.a (mon.0) 187 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/195 objects degraded (4.615%), 5 pgs degraded) 2021-03-10T13:53:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:53:58 gibba043 bash[24019]: cluster 2021-03-10T13:53:57.193645+0000 mgr.gibba043.dnkmem (mgr.34373) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:53:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:53:58 gibba003 bash[31385]: cluster 2021-03-10T13:53:57.193645+0000 mgr.gibba043.dnkmem (mgr.34373) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:53:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:53:58 gibba003 bash[32348]: cluster 2021-03-10T13:53:57.193645+0000 mgr.gibba043.dnkmem (mgr.34373) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:01.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:00 gibba043 bash[24019]: cluster 2021-03-10T13:53:59.195605+0000 mgr.gibba043.dnkmem (mgr.34373) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:00 gibba003 bash[31385]: cluster 2021-03-10T13:53:59.195605+0000 mgr.gibba043.dnkmem (mgr.34373) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:00 gibba003 bash[32348]: cluster 2021-03-10T13:53:59.195605+0000 mgr.gibba043.dnkmem (mgr.34373) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:03.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:02 gibba003 bash[31385]: cluster 2021-03-10T13:54:01.197109+0000 mgr.gibba043.dnkmem (mgr.34373) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:03.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:02 gibba003 bash[31385]: audit 2021-03-10T13:54:02.730160+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:02 gibba003 bash[32348]: cluster 2021-03-10T13:54:01.197109+0000 mgr.gibba043.dnkmem (mgr.34373) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:03.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:02 gibba003 bash[32348]: audit 2021-03-10T13:54:02.730160+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:03.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:02 gibba043 bash[24019]: cluster 2021-03-10T13:54:01.197109+0000 mgr.gibba043.dnkmem (mgr.34373) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:03.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:02 gibba043 bash[24019]: audit 2021-03-10T13:54:02.730160+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:03.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:03 gibba003 bash[31385]: audit 2021-03-10T13:54:03.369334+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:54:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:03 gibba003 bash[32348]: audit 2021-03-10T13:54:03.369334+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:54:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:03 gibba043 bash[24019]: audit 2021-03-10T13:54:03.369334+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:54:04.891 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:04 gibba003 bash[31385]: cluster 2021-03-10T13:54:03.198012+0000 mgr.gibba043.dnkmem (mgr.34373) 154 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:04.891 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:04 gibba003 bash[31385]: audit 2021-03-10T13:54:03.370780+0000 mgr.gibba043.dnkmem (mgr.34373) 155 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:54:04.891 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:04 gibba003 bash[31385]: cephadm 2021-03-10T13:54:03.375585+0000 mgr.gibba043.dnkmem (mgr.34373) 156 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:54:04.892 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:04 gibba003 bash[32348]: cluster 2021-03-10T13:54:03.198012+0000 mgr.gibba043.dnkmem (mgr.34373) 154 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:04.892 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:04 gibba003 bash[32348]: audit 2021-03-10T13:54:03.370780+0000 mgr.gibba043.dnkmem (mgr.34373) 155 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:54:04.892 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:04 gibba003 bash[32348]: cephadm 2021-03-10T13:54:03.375585+0000 mgr.gibba043.dnkmem (mgr.34373) 156 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:54:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:04 gibba043 bash[24019]: cluster 2021-03-10T13:54:03.198012+0000 mgr.gibba043.dnkmem (mgr.34373) 154 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:04 gibba043 bash[24019]: audit 2021-03-10T13:54:03.370780+0000 mgr.gibba043.dnkmem (mgr.34373) 155 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:54:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:04 gibba043 bash[24019]: cephadm 2021-03-10T13:54:03.375585+0000 mgr.gibba043.dnkmem (mgr.34373) 156 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:54:05.564 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:54:05.797 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:54:05.797 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2m) 17s ago 7m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:54:05.797 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (7m) 82s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:54:05.798 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2m) 82s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:54:05.798 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3m) 82s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:54:05.798 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2m) 17s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:54:05.798 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2m) 17s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:54:05.798 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (93s) 82s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:54:05.799 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (103s) 17s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:54:05.799 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (7m) 17s ago 7m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:54:05.799 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (7m) 82s ago 7m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:54:05.799 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (46s) 17s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:54:05.799 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (20s) 17s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:54:05.800 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (10m) 17s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6a58ef7f7d42 2021-03-10T13:54:05.800 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (9m) 17s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f5835a5b1877 2021-03-10T13:54:05.800 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (9m) 82s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:54:05.800 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (9m) 82s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:54:05.800 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (8m) 82s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:54:05.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (8m) 82s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:54:05.801 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (7m) 82s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:54:05.801 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 17s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:54:06.048 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:54:06.048 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:54:06.048 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:06.048 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:54:06.048 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:54:06.049 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:06.049 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:54:06.049 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:54:06.049 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T13:54:06.049 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:54:06.050 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:54:06.050 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:54:06.050 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:54:06.050 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T13:54:06.050 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:54:06.051 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:54:06.051 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:54:06.675 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: cluster 2021-03-10T13:54:05.199890+0000 mgr.gibba043.dnkmem (mgr.34373) 157 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:06.675 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: cephadm 2021-03-10T13:54:05.401140+0000 mgr.gibba043.dnkmem (mgr.34373) 158 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:54:06.675 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: audit 2021-03-10T13:54:05.406037+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:06.675 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: cephadm 2021-03-10T13:54:05.410913+0000 mgr.gibba043.dnkmem (mgr.34373) 159 : cephadm [INF] Deploying daemon osd.2 on gibba003 2021-03-10T13:54:06.676 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: audit 2021-03-10T13:54:05.410931+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:54:06.676 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: audit 2021-03-10T13:54:05.555309+0000 mgr.gibba043.dnkmem (mgr.34373) 160 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:06.676 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: audit 2021-03-10T13:54:05.785597+0000 mgr.gibba043.dnkmem (mgr.34373) 161 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:06.676 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[32348]: audit 2021-03-10T13:54:06.048016+0000 mon.a (mon.0) 190 : audit [DBG] from='client.? 172.21.2.103:0/3659814965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:06.677 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: cluster 2021-03-10T13:54:05.199890+0000 mgr.gibba043.dnkmem (mgr.34373) 157 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:06.677 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: cephadm 2021-03-10T13:54:05.401140+0000 mgr.gibba043.dnkmem (mgr.34373) 158 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:54:06.677 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: audit 2021-03-10T13:54:05.406037+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:06.677 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: cephadm 2021-03-10T13:54:05.410913+0000 mgr.gibba043.dnkmem (mgr.34373) 159 : cephadm [INF] Deploying daemon osd.2 on gibba003 2021-03-10T13:54:06.677 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: audit 2021-03-10T13:54:05.410931+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:54:06.678 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: audit 2021-03-10T13:54:05.555309+0000 mgr.gibba043.dnkmem (mgr.34373) 160 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:06.678 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: audit 2021-03-10T13:54:05.785597+0000 mgr.gibba043.dnkmem (mgr.34373) 161 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:06.678 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:06 gibba003 bash[31385]: audit 2021-03-10T13:54:06.048016+0000 mon.a (mon.0) 190 : audit [DBG] from='client.? 172.21.2.103:0/3659814965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:06.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: cluster 2021-03-10T13:54:05.199890+0000 mgr.gibba043.dnkmem (mgr.34373) 157 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:06.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: cephadm 2021-03-10T13:54:05.401140+0000 mgr.gibba043.dnkmem (mgr.34373) 158 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:54:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: audit 2021-03-10T13:54:05.406037+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: cephadm 2021-03-10T13:54:05.410913+0000 mgr.gibba043.dnkmem (mgr.34373) 159 : cephadm [INF] Deploying daemon osd.2 on gibba003 2021-03-10T13:54:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: audit 2021-03-10T13:54:05.410931+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:54:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: audit 2021-03-10T13:54:05.555309+0000 mgr.gibba043.dnkmem (mgr.34373) 160 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: audit 2021-03-10T13:54:05.785597+0000 mgr.gibba043.dnkmem (mgr.34373) 161 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:06.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:06 gibba043 bash[24019]: audit 2021-03-10T13:54:06.048016+0000 mon.a (mon.0) 190 : audit [DBG] from='client.? 172.21.2.103:0/3659814965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:07.441 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:07 gibba003 systemd[1]: Stopping Ceph osd.2 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:54:07.441 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:07 gibba003 bash[18319]: debug 2021-03-10T13:54:07.373+0000 7f5ee17b1700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:54:07.441 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:07 gibba003 bash[18319]: debug 2021-03-10T13:54:07.373+0000 7f5ee17b1700 -1 osd.2 75 *** Got signal Terminated *** 2021-03-10T13:54:07.442 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:07 gibba003 bash[18319]: debug 2021-03-10T13:54:07.373+0000 7f5ee17b1700 -1 osd.2 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:54:08.441 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:08 gibba003 docker[36344]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.2 2021-03-10T13:54:08.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.200993+0000 mgr.gibba043.dnkmem (mgr.34373) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:08.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.667040+0000 mon.a (mon.0) 191 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.667214+0000 mon.a (mon.0) 192 : cluster [INF] osd.2 failed (root=default,host=gibba003) (connection refused reported by osd.3) 2021-03-10T13:54:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.667721+0000 mon.a (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.667892+0000 mon.a (mon.0) 194 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.668321+0000 mon.a (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.668663+0000 mon.a (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.668832+0000 mon.a (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.669341+0000 mon.a (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.669624+0000 mon.a (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.669896+0000 mon.a (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.670216+0000 mon.a (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.670398+0000 mon.a (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.670940+0000 mon.a (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.671273+0000 mon.a (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:07.671769+0000 mon.a (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.065160+0000 mon.a (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.065373+0000 mon.a (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.065808+0000 mon.a (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.066319+0000 mon.a (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.066509+0000 mon.a (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.067486+0000 mon.a (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.068766+0000 mon.a (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.068952+0000 mon.a (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.069445+0000 mon.a (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.200993+0000 mgr.gibba043.dnkmem (mgr.34373) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:08.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.667040+0000 mon.a (mon.0) 191 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.667214+0000 mon.a (mon.0) 192 : cluster [INF] osd.2 failed (root=default,host=gibba003) (connection refused reported by osd.3) 2021-03-10T13:54:08.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.667721+0000 mon.a (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.667892+0000 mon.a (mon.0) 194 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.668321+0000 mon.a (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.668663+0000 mon.a (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.668832+0000 mon.a (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.669341+0000 mon.a (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.669624+0000 mon.a (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.669896+0000 mon.a (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.670216+0000 mon.a (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.670398+0000 mon.a (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.670940+0000 mon.a (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.671273+0000 mon.a (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:07.671769+0000 mon.a (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.065160+0000 mon.a (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.065373+0000 mon.a (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.065808+0000 mon.a (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:08.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.066319+0000 mon.a (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.066509+0000 mon.a (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:08.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.067486+0000 mon.a (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:08.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.068766+0000 mon.a (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.068952+0000 mon.a (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:08.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.069445+0000 mon.a (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.069883+0000 mon.a (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.070364+0000 mon.a (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.070670+0000 mon.a (mon.0) 217 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.071212+0000 mon.a (mon.0) 218 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.071500+0000 mon.a (mon.0) 219 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.069883+0000 mon.a (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:08.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.070364+0000 mon.a (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:08.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.070670+0000 mon.a (mon.0) 217 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.071212+0000 mon.a (mon.0) 218 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:08.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:08 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.071500+0000 mon.a (mon.0) 219 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.200993+0000 mgr.gibba043.dnkmem (mgr.34373) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.667040+0000 mon.a (mon.0) 191 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.667214+0000 mon.a (mon.0) 192 : cluster [INF] osd.2 failed (root=default,host=gibba003) (connection refused reported by osd.3) 2021-03-10T13:54:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.667721+0000 mon.a (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.667892+0000 mon.a (mon.0) 194 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.668321+0000 mon.a (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.668663+0000 mon.a (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.668832+0000 mon.a (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.669341+0000 mon.a (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.669624+0000 mon.a (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.669896+0000 mon.a (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.670216+0000 mon.a (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.670398+0000 mon.a (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.670940+0000 mon.a (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.671273+0000 mon.a (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:07.671769+0000 mon.a (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.065160+0000 mon.a (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.065373+0000 mon.a (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.065808+0000 mon.a (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:54:09.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.066319+0000 mon.a (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:09.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.066509+0000 mon.a (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:54:09.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.067486+0000 mon.a (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:54:09.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.068766+0000 mon.a (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:09.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.068952+0000 mon.a (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:54:09.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.069445+0000 mon.a (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:09.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.069883+0000 mon.a (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:09.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.070364+0000 mon.a (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:54:09.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.070670+0000 mon.a (mon.0) 217 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:09.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.071212+0000 mon.a (mon.0) 218 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:54:09.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:08 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.071500+0000 mon.a (mon.0) 219 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:54:09.925 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:09 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.588343+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:54:09.925 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:09 gibba003 bash[31385]: cluster 2021-03-10T13:54:08.600477+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e76: 8 total, 7 up, 8 in 2021-03-10T13:54:09.926 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:09 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.588343+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:54:09.926 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:09 gibba003 bash[32348]: cluster 2021-03-10T13:54:08.600477+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e76: 8 total, 7 up, 8 in 2021-03-10T13:54:10.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:09 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.588343+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:54:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:09 gibba043 bash[24019]: cluster 2021-03-10T13:54:08.600477+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e76: 8 total, 7 up, 8 in 2021-03-10T13:54:10.190 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:09 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.2.service: Succeeded. 2021-03-10T13:54:10.190 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:09 gibba003 systemd[1]: Stopped Ceph osd.2 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:10.191 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:10 gibba003 systemd[1]: Started Ceph osd.2 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:10.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[31385]: cluster 2021-03-10T13:54:09.202061+0000 mgr.gibba043.dnkmem (mgr.34373) 163 : cluster [DBG] pgmap v73: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:10.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[31385]: cluster 2021-03-10T13:54:09.611696+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2021-03-10T13:54:10.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[31385]: audit 2021-03-10T13:54:10.096376+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:10.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[31385]: audit 2021-03-10T13:54:10.100082+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:10.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[32348]: cluster 2021-03-10T13:54:09.202061+0000 mgr.gibba043.dnkmem (mgr.34373) 163 : cluster [DBG] pgmap v73: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:10.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[32348]: cluster 2021-03-10T13:54:09.611696+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2021-03-10T13:54:10.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[32348]: audit 2021-03-10T13:54:10.096376+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:10.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:10 gibba003 bash[32348]: audit 2021-03-10T13:54:10.100082+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:11.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:10 gibba043 bash[24019]: cluster 2021-03-10T13:54:09.202061+0000 mgr.gibba043.dnkmem (mgr.34373) 163 : cluster [DBG] pgmap v73: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:54:11.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:10 gibba043 bash[24019]: cluster 2021-03-10T13:54:09.611696+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2021-03-10T13:54:11.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:10 gibba043 bash[24019]: audit 2021-03-10T13:54:10.096376+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:11.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:10 gibba043 bash[24019]: audit 2021-03-10T13:54:10.100082+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:11.691 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:54:11.691 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T13:54:11.691 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:54:11.691 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:54:11.692 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:54:11.692 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:54:11.692 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:11 gibba003 bash[36521]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T13:54:12.859 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:12 gibba003 bash[31385]: cluster 2021-03-10T13:54:11.203557+0000 mgr.gibba043.dnkmem (mgr.34373) 164 : cluster [DBG] pgmap v75: 129 pgs: 6 stale+active+clean, 2 active+undersized+degraded, 5 peering, 4 active+undersized, 112 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:12.860 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:12 gibba003 bash[31385]: cluster 2021-03-10T13:54:11.614413+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 2 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:12.860 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:12 gibba003 bash[32348]: cluster 2021-03-10T13:54:11.203557+0000 mgr.gibba043.dnkmem (mgr.34373) 164 : cluster [DBG] pgmap v75: 129 pgs: 6 stale+active+clean, 2 active+undersized+degraded, 5 peering, 4 active+undersized, 112 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:12.860 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:12 gibba003 bash[32348]: cluster 2021-03-10T13:54:11.614413+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 2 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:12 gibba043 bash[24019]: cluster 2021-03-10T13:54:11.203557+0000 mgr.gibba043.dnkmem (mgr.34373) 164 : cluster [DBG] pgmap v75: 129 pgs: 6 stale+active+clean, 2 active+undersized+degraded, 5 peering, 4 active+undersized, 112 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:12 gibba043 bash[24019]: cluster 2021-03-10T13:54:11.614413+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 2 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:13.190 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:12 gibba003 bash[36651]: debug 2021-03-10T13:54:12.873+0000 7f5e49c8a700 1 -- 172.21.2.103:0/3432523834 <== mon.0 v2:172.21.2.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560f635d24e0 con 0x560f6364ec00 2021-03-10T13:54:13.941 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[36651]: debug 2021-03-10T13:54:13.469+0000 7f5e5171f080 -1 Falling back to public interface 2021-03-10T13:54:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[32348]: audit 2021-03-10T13:54:12.699978+0000 mon.c (mon.1) 77 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[32348]: audit 2021-03-10T13:54:12.700925+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[32348]: audit 2021-03-10T13:54:12.701116+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[32348]: audit 2021-03-10T13:54:12.702249+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[31385]: audit 2021-03-10T13:54:12.699978+0000 mon.c (mon.1) 77 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[31385]: audit 2021-03-10T13:54:12.700925+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[31385]: audit 2021-03-10T13:54:12.701116+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:13 gibba003 bash[31385]: audit 2021-03-10T13:54:12.702249+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:13 gibba043 bash[24019]: audit 2021-03-10T13:54:12.699978+0000 mon.c (mon.1) 77 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:13 gibba043 bash[24019]: audit 2021-03-10T13:54:12.700925+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:13 gibba043 bash[24019]: audit 2021-03-10T13:54:12.701116+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:13 gibba043 bash[24019]: audit 2021-03-10T13:54:12.702249+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cluster 2021-03-10T13:54:13.204906+0000 mgr.gibba043.dnkmem (mgr.34373) 165 : cluster [DBG] pgmap v76: 129 pgs: 6 stale+active+clean, 2 active+undersized+degraded, 5 peering, 4 active+undersized, 112 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.694233+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.698634+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.702866+0000 mgr.gibba043.dnkmem (mgr.34373) 166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.702988+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.704694+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.704800+0000 mgr.gibba043.dnkmem (mgr.34373) 167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.706275+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.706378+0000 mgr.gibba043.dnkmem (mgr.34373) 168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.706425+0000 mgr.gibba043.dnkmem (mgr.34373) 169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.707564+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.707686+0000 mgr.gibba043.dnkmem (mgr.34373) 170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.707821+0000 mgr.gibba043.dnkmem (mgr.34373) 171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.709136+0000 mgr.gibba043.dnkmem (mgr.34373) 172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.710698+0000 mgr.gibba043.dnkmem (mgr.34373) 173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.710747+0000 mgr.gibba043.dnkmem (mgr.34373) 174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.710768+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: audit 2021-03-10T13:54:13.711528+0000 mgr.gibba043.dnkmem (mgr.34373) 175 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:15.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:14 gibba043 bash[24019]: cephadm 2021-03-10T13:54:13.712754+0000 mgr.gibba043.dnkmem (mgr.34373) 176 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-03-10T13:54:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cluster 2021-03-10T13:54:13.204906+0000 mgr.gibba043.dnkmem (mgr.34373) 165 : cluster [DBG] pgmap v76: 129 pgs: 6 stale+active+clean, 2 active+undersized+degraded, 5 peering, 4 active+undersized, 112 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.694233+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.698634+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.702866+0000 mgr.gibba043.dnkmem (mgr.34373) 166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.702988+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.704694+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.704800+0000 mgr.gibba043.dnkmem (mgr.34373) 167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.706275+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.706378+0000 mgr.gibba043.dnkmem (mgr.34373) 168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.706425+0000 mgr.gibba043.dnkmem (mgr.34373) 169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.707564+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.707686+0000 mgr.gibba043.dnkmem (mgr.34373) 170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.707821+0000 mgr.gibba043.dnkmem (mgr.34373) 171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.709136+0000 mgr.gibba043.dnkmem (mgr.34373) 172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.710698+0000 mgr.gibba043.dnkmem (mgr.34373) 173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.710747+0000 mgr.gibba043.dnkmem (mgr.34373) 174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:15.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.710768+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:15.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: audit 2021-03-10T13:54:13.711528+0000 mgr.gibba043.dnkmem (mgr.34373) 175 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:15.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[31385]: cephadm 2021-03-10T13:54:13.712754+0000 mgr.gibba043.dnkmem (mgr.34373) 176 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-03-10T13:54:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cluster 2021-03-10T13:54:13.204906+0000 mgr.gibba043.dnkmem (mgr.34373) 165 : cluster [DBG] pgmap v76: 129 pgs: 6 stale+active+clean, 2 active+undersized+degraded, 5 peering, 4 active+undersized, 112 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.694233+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.698634+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.702866+0000 mgr.gibba043.dnkmem (mgr.34373) 166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.702988+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.704694+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.704800+0000 mgr.gibba043.dnkmem (mgr.34373) 167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.706275+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.706378+0000 mgr.gibba043.dnkmem (mgr.34373) 168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.706425+0000 mgr.gibba043.dnkmem (mgr.34373) 169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.707564+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.707686+0000 mgr.gibba043.dnkmem (mgr.34373) 170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.707821+0000 mgr.gibba043.dnkmem (mgr.34373) 171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.709136+0000 mgr.gibba043.dnkmem (mgr.34373) 172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.710698+0000 mgr.gibba043.dnkmem (mgr.34373) 173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.710747+0000 mgr.gibba043.dnkmem (mgr.34373) 174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.710768+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:15.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: audit 2021-03-10T13:54:13.711528+0000 mgr.gibba043.dnkmem (mgr.34373) 175 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:15.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:14 gibba003 bash[32348]: cephadm 2021-03-10T13:54:13.712754+0000 mgr.gibba043.dnkmem (mgr.34373) 176 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-03-10T13:54:17.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:16 gibba043 bash[24019]: cluster 2021-03-10T13:54:15.207219+0000 mgr.gibba043.dnkmem (mgr.34373) 177 : cluster [DBG] pgmap v77: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:17.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:16 gibba003 bash[32348]: cluster 2021-03-10T13:54:15.207219+0000 mgr.gibba043.dnkmem (mgr.34373) 177 : cluster [DBG] pgmap v77: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:16 gibba003 bash[31385]: cluster 2021-03-10T13:54:15.207219+0000 mgr.gibba043.dnkmem (mgr.34373) 177 : cluster [DBG] pgmap v77: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:17.192 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:16 gibba003 bash[36651]: debug 2021-03-10T13:54:16.685+0000 7f5e5171f080 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:54:17.192 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:16 gibba003 bash[36651]: debug 2021-03-10T13:54:16.689+0000 7f5e3c1e3700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:54:17.192 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:16 gibba003 bash[36651]: debug 2021-03-10T13:54:16.813+0000 7f5e5171f080 -1 osd.2 75 log_to_monitors {default=true} 2021-03-10T13:54:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:17 gibba043 bash[24019]: audit 2021-03-10T13:54:16.818834+0000 mon.a (mon.0) 229 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:54:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:17 gibba003 bash[32348]: audit 2021-03-10T13:54:16.818834+0000 mon.a (mon.0) 229 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:54:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:17 gibba003 bash[31385]: audit 2021-03-10T13:54:16.818834+0000 mon.a (mon.0) 229 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:54:18.192 INFO:journalctl@ceph.osd.2.gibba003.stdout:Mar 10 13:54:17 gibba003 bash[36651]: debug 2021-03-10T13:54:17.721+0000 7f5e41bfd700 -1 osd.2 75 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:54:19.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:18 gibba043 bash[24019]: cluster 2021-03-10T13:54:17.208800+0000 mgr.gibba043.dnkmem (mgr.34373) 178 : cluster [DBG] pgmap v78: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:19.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:18 gibba043 bash[24019]: audit 2021-03-10T13:54:17.717789+0000 mon.a (mon.0) 230 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:54:19.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:18 gibba043 bash[24019]: cluster 2021-03-10T13:54:17.717823+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:54:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:18 gibba043 bash[24019]: audit 2021-03-10T13:54:17.718180+0000 mon.a (mon.0) 232 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[31385]: cluster 2021-03-10T13:54:17.208800+0000 mgr.gibba043.dnkmem (mgr.34373) 178 : cluster [DBG] pgmap v78: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[31385]: audit 2021-03-10T13:54:17.717789+0000 mon.a (mon.0) 230 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:54:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[31385]: cluster 2021-03-10T13:54:17.717823+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:54:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[31385]: audit 2021-03-10T13:54:17.718180+0000 mon.a (mon.0) 232 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[32348]: cluster 2021-03-10T13:54:17.208800+0000 mgr.gibba043.dnkmem (mgr.34373) 178 : cluster [DBG] pgmap v78: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[32348]: audit 2021-03-10T13:54:17.717789+0000 mon.a (mon.0) 230 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:54:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[32348]: cluster 2021-03-10T13:54:17.717823+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:54:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:18 gibba003 bash[32348]: audit 2021-03-10T13:54:17.718180+0000 mon.a (mon.0) 232 : audit [INF] from='osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:20.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:19 gibba043 bash[24019]: cluster 2021-03-10T13:54:18.717903+0000 mon.a (mon.0) 233 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:19 gibba043 bash[24019]: cluster 2021-03-10T13:54:18.729355+0000 mon.a (mon.0) 234 : cluster [INF] osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695] boot 2021-03-10T13:54:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:19 gibba043 bash[24019]: cluster 2021-03-10T13:54:18.729398+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-03-10T13:54:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:19 gibba043 bash[24019]: audit 2021-03-10T13:54:18.729535+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:54:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[31385]: cluster 2021-03-10T13:54:18.717903+0000 mon.a (mon.0) 233 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[31385]: cluster 2021-03-10T13:54:18.729355+0000 mon.a (mon.0) 234 : cluster [INF] osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695] boot 2021-03-10T13:54:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[31385]: cluster 2021-03-10T13:54:18.729398+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-03-10T13:54:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[31385]: audit 2021-03-10T13:54:18.729535+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:54:20.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[32348]: cluster 2021-03-10T13:54:18.717903+0000 mon.a (mon.0) 233 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:20.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[32348]: cluster 2021-03-10T13:54:18.729355+0000 mon.a (mon.0) 234 : cluster [INF] osd.2 [v2:172.21.2.103:6816/424387695,v1:172.21.2.103:6817/424387695] boot 2021-03-10T13:54:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[32348]: cluster 2021-03-10T13:54:18.729398+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-03-10T13:54:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:19 gibba003 bash[32348]: audit 2021-03-10T13:54:18.729535+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:54:21.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:20 gibba043 bash[24019]: cluster 2021-03-10T13:54:19.209882+0000 mgr.gibba043.dnkmem (mgr.34373) 179 : cluster [DBG] pgmap v81: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:21.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:20 gibba043 bash[24019]: cluster 2021-03-10T13:54:19.732153+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-03-10T13:54:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:20 gibba003 bash[31385]: cluster 2021-03-10T13:54:19.209882+0000 mgr.gibba043.dnkmem (mgr.34373) 179 : cluster [DBG] pgmap v81: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:20 gibba003 bash[31385]: cluster 2021-03-10T13:54:19.732153+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-03-10T13:54:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:20 gibba003 bash[32348]: cluster 2021-03-10T13:54:19.209882+0000 mgr.gibba043.dnkmem (mgr.34373) 179 : cluster [DBG] pgmap v81: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:54:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:20 gibba003 bash[32348]: cluster 2021-03-10T13:54:19.732153+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-03-10T13:54:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:21 gibba043 bash[24019]: cluster 2021-03-10T13:54:21.581816+0000 mon.a (mon.0) 237 : cluster [WRN] Health check update: Degraded data redundancy: 14/195 objects degraded (7.179%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:21 gibba003 bash[31385]: cluster 2021-03-10T13:54:21.581816+0000 mon.a (mon.0) 237 : cluster [WRN] Health check update: Degraded data redundancy: 14/195 objects degraded (7.179%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:21 gibba003 bash[32348]: cluster 2021-03-10T13:54:21.581816+0000 mon.a (mon.0) 237 : cluster [WRN] Health check update: Degraded data redundancy: 14/195 objects degraded (7.179%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:23.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:22 gibba043 bash[24019]: cluster 2021-03-10T13:54:21.211386+0000 mgr.gibba043.dnkmem (mgr.34373) 180 : cluster [DBG] pgmap v83: 129 pgs: 3 peering, 6 active+undersized+degraded, 19 active+undersized, 101 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T13:54:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:22 gibba003 bash[31385]: cluster 2021-03-10T13:54:21.211386+0000 mgr.gibba043.dnkmem (mgr.34373) 180 : cluster [DBG] pgmap v83: 129 pgs: 3 peering, 6 active+undersized+degraded, 19 active+undersized, 101 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T13:54:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:22 gibba003 bash[32348]: cluster 2021-03-10T13:54:21.211386+0000 mgr.gibba043.dnkmem (mgr.34373) 180 : cluster [DBG] pgmap v83: 129 pgs: 3 peering, 6 active+undersized+degraded, 19 active+undersized, 101 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T13:54:25.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:24 gibba043 bash[24019]: cluster 2021-03-10T13:54:23.212855+0000 mgr.gibba043.dnkmem (mgr.34373) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 3 peering, 5 active+undersized+degraded, 10 active+undersized, 101 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:24 gibba003 bash[31385]: cluster 2021-03-10T13:54:23.212855+0000 mgr.gibba043.dnkmem (mgr.34373) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 3 peering, 5 active+undersized+degraded, 10 active+undersized, 101 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:24 gibba003 bash[32348]: cluster 2021-03-10T13:54:23.212855+0000 mgr.gibba043.dnkmem (mgr.34373) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 3 peering, 5 active+undersized+degraded, 10 active+undersized, 101 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:25 gibba003 bash[31385]: cluster 2021-03-10T13:54:25.764951+0000 mon.a (mon.0) 238 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded) 2021-03-10T13:54:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:25 gibba003 bash[32348]: cluster 2021-03-10T13:54:25.764951+0000 mon.a (mon.0) 238 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded) 2021-03-10T13:54:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:25 gibba043 bash[24019]: cluster 2021-03-10T13:54:25.764951+0000 mon.a (mon.0) 238 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded) 2021-03-10T13:54:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:26 gibba003 bash[31385]: cluster 2021-03-10T13:54:25.214704+0000 mgr.gibba043.dnkmem (mgr.34373) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:26 gibba003 bash[32348]: cluster 2021-03-10T13:54:25.214704+0000 mgr.gibba043.dnkmem (mgr.34373) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:26 gibba043 bash[24019]: cluster 2021-03-10T13:54:25.214704+0000 mgr.gibba043.dnkmem (mgr.34373) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:28 gibba043 bash[24019]: cluster 2021-03-10T13:54:27.216110+0000 mgr.gibba043.dnkmem (mgr.34373) 183 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:28 gibba043 bash[24019]: audit 2021-03-10T13:54:27.742696+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:28 gibba043 bash[24019]: audit 2021-03-10T13:54:28.714730+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:28 gibba003 bash[31385]: cluster 2021-03-10T13:54:27.216110+0000 mgr.gibba043.dnkmem (mgr.34373) 183 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:28 gibba003 bash[31385]: audit 2021-03-10T13:54:27.742696+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:28 gibba003 bash[31385]: audit 2021-03-10T13:54:28.714730+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:28 gibba003 bash[32348]: cluster 2021-03-10T13:54:27.216110+0000 mgr.gibba043.dnkmem (mgr.34373) 183 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:28 gibba003 bash[32348]: audit 2021-03-10T13:54:27.742696+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:28 gibba003 bash[32348]: audit 2021-03-10T13:54:28.714730+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:30.011 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:29 gibba003 bash[31385]: audit 2021-03-10T13:54:28.716150+0000 mgr.gibba043.dnkmem (mgr.34373) 184 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:30.011 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:29 gibba003 bash[31385]: cephadm 2021-03-10T13:54:28.721037+0000 mgr.gibba043.dnkmem (mgr.34373) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:54:30.011 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:29 gibba003 bash[32348]: audit 2021-03-10T13:54:28.716150+0000 mgr.gibba043.dnkmem (mgr.34373) 184 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:30.012 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:29 gibba003 bash[32348]: cephadm 2021-03-10T13:54:28.721037+0000 mgr.gibba043.dnkmem (mgr.34373) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:54:30.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:29 gibba043 bash[24019]: audit 2021-03-10T13:54:28.716150+0000 mgr.gibba043.dnkmem (mgr.34373) 184 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:54:30.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:29 gibba043 bash[24019]: cephadm 2021-03-10T13:54:28.721037+0000 mgr.gibba043.dnkmem (mgr.34373) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:54:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:30 gibba043 bash[24019]: cluster 2021-03-10T13:54:29.218152+0000 mgr.gibba043.dnkmem (mgr.34373) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:30 gibba043 bash[24019]: audit 2021-03-10T13:54:30.614684+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:30 gibba043 bash[24019]: audit 2021-03-10T13:54:30.619546+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:54:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:30 gibba003 bash[31385]: cluster 2021-03-10T13:54:29.218152+0000 mgr.gibba043.dnkmem (mgr.34373) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:30 gibba003 bash[31385]: audit 2021-03-10T13:54:30.614684+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:30 gibba003 bash[31385]: audit 2021-03-10T13:54:30.619546+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:54:31.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:30 gibba003 bash[32348]: cluster 2021-03-10T13:54:29.218152+0000 mgr.gibba043.dnkmem (mgr.34373) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:31.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:30 gibba003 bash[32348]: audit 2021-03-10T13:54:30.614684+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:31.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:30 gibba003 bash[32348]: audit 2021-03-10T13:54:30.619546+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:54:31.933 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:31 gibba003 bash[32348]: cephadm 2021-03-10T13:54:30.609204+0000 mgr.gibba043.dnkmem (mgr.34373) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:54:31.933 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:31 gibba003 bash[32348]: cephadm 2021-03-10T13:54:30.619580+0000 mgr.gibba043.dnkmem (mgr.34373) 188 : cephadm [INF] Deploying daemon osd.3 on gibba003 2021-03-10T13:54:31.933 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:31 gibba003 bash[31385]: cephadm 2021-03-10T13:54:30.609204+0000 mgr.gibba043.dnkmem (mgr.34373) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:54:31.934 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:31 gibba003 bash[31385]: cephadm 2021-03-10T13:54:30.619580+0000 mgr.gibba043.dnkmem (mgr.34373) 188 : cephadm [INF] Deploying daemon osd.3 on gibba003 2021-03-10T13:54:32.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:31 gibba043 bash[24019]: cephadm 2021-03-10T13:54:30.609204+0000 mgr.gibba043.dnkmem (mgr.34373) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:54:32.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:31 gibba043 bash[24019]: cephadm 2021-03-10T13:54:30.619580+0000 mgr.gibba043.dnkmem (mgr.34373) 188 : cephadm [INF] Deploying daemon osd.3 on gibba003 2021-03-10T13:54:32.656 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:32 gibba003 systemd[1]: Stopping Ceph osd.3 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:54:32.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[19890]: debug 2021-03-10T13:54:32.654+0000 7f8cfc607700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:54:32.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[19890]: debug 2021-03-10T13:54:32.654+0000 7f8cfc607700 -1 osd.3 80 *** Got signal Terminated *** 2021-03-10T13:54:32.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[19890]: debug 2021-03-10T13:54:32.654+0000 7f8cfc607700 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:54:32.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:31.219619+0000 mgr.gibba043.dnkmem (mgr.34373) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:32.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729053+0000 mon.a (mon.0) 241 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:54:32.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729078+0000 mon.a (mon.0) 242 : cluster [INF] osd.3 failed (root=default,host=gibba003) (connection refused reported by osd.6) 2021-03-10T13:54:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729205+0000 mon.a (mon.0) 243 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:54:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729244+0000 mon.a (mon.0) 244 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:54:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729310+0000 mon.a (mon.0) 245 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:54:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729477+0000 mon.a (mon.0) 246 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:54:32.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729582+0000 mon.a (mon.0) 247 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:54:32.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729680+0000 mon.a (mon.0) 248 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:54:32.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.729741+0000 mon.a (mon.0) 249 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:54:32.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:31.219619+0000 mgr.gibba043.dnkmem (mgr.34373) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:32.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729053+0000 mon.a (mon.0) 241 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:54:32.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729078+0000 mon.a (mon.0) 242 : cluster [INF] osd.3 failed (root=default,host=gibba003) (connection refused reported by osd.6) 2021-03-10T13:54:32.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729205+0000 mon.a (mon.0) 243 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:54:32.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729244+0000 mon.a (mon.0) 244 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:54:32.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729310+0000 mon.a (mon.0) 245 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:54:32.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729477+0000 mon.a (mon.0) 246 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:54:32.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729582+0000 mon.a (mon.0) 247 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:54:32.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729680+0000 mon.a (mon.0) 248 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:54:32.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:32 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.729741+0000 mon.a (mon.0) 249 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:54:33.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:31.219619+0000 mgr.gibba043.dnkmem (mgr.34373) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:33.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729053+0000 mon.a (mon.0) 241 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:54:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729078+0000 mon.a (mon.0) 242 : cluster [INF] osd.3 failed (root=default,host=gibba003) (connection refused reported by osd.6) 2021-03-10T13:54:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729205+0000 mon.a (mon.0) 243 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:54:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729244+0000 mon.a (mon.0) 244 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:54:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729310+0000 mon.a (mon.0) 245 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:54:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729477+0000 mon.a (mon.0) 246 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:54:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729582+0000 mon.a (mon.0) 247 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:54:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729680+0000 mon.a (mon.0) 248 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:54:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:32 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.729741+0000 mon.a (mon.0) 249 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:54:33.691 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:33 gibba003 docker[37483]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.3 2021-03-10T13:54:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:33 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.770106+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:54:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:33 gibba003 bash[31385]: cluster 2021-03-10T13:54:32.775164+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e81: 8 total, 7 up, 8 in 2021-03-10T13:54:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:33 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.770106+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:54:34.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:33 gibba003 bash[32348]: cluster 2021-03-10T13:54:32.775164+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e81: 8 total, 7 up, 8 in 2021-03-10T13:54:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:33 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.770106+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:54:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:33 gibba043 bash[24019]: cluster 2021-03-10T13:54:32.775164+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e81: 8 total, 7 up, 8 in 2021-03-10T13:54:34.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:34 gibba003 bash[31385]: cluster 2021-03-10T13:54:33.220752+0000 mgr.gibba043.dnkmem (mgr.34373) 190 : cluster [DBG] pgmap v90: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:34 gibba003 bash[31385]: cluster 2021-03-10T13:54:33.783768+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2021-03-10T13:54:34.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:34 gibba003 bash[32348]: cluster 2021-03-10T13:54:33.220752+0000 mgr.gibba043.dnkmem (mgr.34373) 190 : cluster [DBG] pgmap v90: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:34 gibba003 bash[32348]: cluster 2021-03-10T13:54:33.783768+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2021-03-10T13:54:35.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:34 gibba043 bash[24019]: cluster 2021-03-10T13:54:33.220752+0000 mgr.gibba043.dnkmem (mgr.34373) 190 : cluster [DBG] pgmap v90: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:54:35.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:34 gibba043 bash[24019]: cluster 2021-03-10T13:54:33.783768+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2021-03-10T13:54:35.440 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:35 gibba003 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.3.service: Succeeded. 2021-03-10T13:54:35.441 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:35 gibba003 systemd[1]: Stopped Ceph osd.3 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:35.441 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:35 gibba003 systemd[1]: Started Ceph osd.3 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:36.298 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:54:36.535 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[31385]: cluster 2021-03-10T13:54:35.222308+0000 mgr.gibba043.dnkmem (mgr.34373) 191 : cluster [DBG] pgmap v92: 129 pgs: 7 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+clean+wait, 5 active+undersized, 80 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:36.536 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[31385]: audit 2021-03-10T13:54:35.366862+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:36.536 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[31385]: audit 2021-03-10T13:54:35.370366+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:36.536 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[31385]: cephadm 2021-03-10T13:54:35.370936+0000 mgr.gibba043.dnkmem (mgr.34373) 192 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:54:36.536 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[31385]: cluster 2021-03-10T13:54:35.794547+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T13:54:36.537 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[31385]: cluster 2021-03-10T13:54:35.794641+0000 mon.a (mon.0) 255 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:36.537 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[32348]: cluster 2021-03-10T13:54:35.222308+0000 mgr.gibba043.dnkmem (mgr.34373) 191 : cluster [DBG] pgmap v92: 129 pgs: 7 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+clean+wait, 5 active+undersized, 80 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:36.537 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[32348]: audit 2021-03-10T13:54:35.366862+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:36.538 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[32348]: audit 2021-03-10T13:54:35.370366+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:36.538 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[32348]: cephadm 2021-03-10T13:54:35.370936+0000 mgr.gibba043.dnkmem (mgr.34373) 192 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:54:36.538 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[32348]: cluster 2021-03-10T13:54:35.794547+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T13:54:36.538 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[32348]: cluster 2021-03-10T13:54:35.794641+0000 mon.a (mon.0) 255 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:36.539 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:54:36.539 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2m) 22s ago 8m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:54:36.539 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (8m) 113s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:54:36.539 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3m) 113s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:54:36.540 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3m) 113s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:54:36.540 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2m) 22s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:54:36.540 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2m) 22s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:54:36.540 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2m) 113s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:54:36.540 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2m) 22s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:54:36.541 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (8m) 22s ago 8m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:54:36.541 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (8m) 113s ago 8m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:54:36.541 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (77s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:54:36.541 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (51s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:54:36.541 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (24s) 22s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:54:36.542 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 starting - - 2021-03-10T13:54:36.542 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (9m) 113s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 865d9dcbf7c8 2021-03-10T13:54:36.542 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (9m) 113s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:54:36.542 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (9m) 113s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:54:36.543 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (8m) 113s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:54:36.543 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (7m) 113s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:54:36.543 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 22s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:54:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:36 gibba043 bash[24019]: cluster 2021-03-10T13:54:35.222308+0000 mgr.gibba043.dnkmem (mgr.34373) 191 : cluster [DBG] pgmap v92: 129 pgs: 7 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+clean+wait, 5 active+undersized, 80 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T13:54:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:36 gibba043 bash[24019]: audit 2021-03-10T13:54:35.366862+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:36 gibba043 bash[24019]: audit 2021-03-10T13:54:35.370366+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:36 gibba043 bash[24019]: cephadm 2021-03-10T13:54:35.370936+0000 mgr.gibba043.dnkmem (mgr.34373) 192 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:54:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:36 gibba043 bash[24019]: cluster 2021-03-10T13:54:35.794547+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T13:54:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:36 gibba043 bash[24019]: cluster 2021-03-10T13:54:35.794641+0000 mon.a (mon.0) 255 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:36.797 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:54:36.798 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:54:36.798 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:36.799 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:54:36.799 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:54:36.800 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:36.800 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:54:36.800 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:54:36.801 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2021-03-10T13:54:36.801 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:36.802 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:54:36.802 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:54:36.802 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:54:36.803 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2021-03-10T13:54:36.803 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 9 2021-03-10T13:54:36.804 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:54:36.804 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:54:36.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:54:36.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T13:54:36.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:54:36.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:54:36.942 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:54:36.942 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:54:36.942 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:36 gibba003 bash[37660]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T13:54:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:37 gibba003 bash[31385]: audit 2021-03-10T13:54:36.289970+0000 mgr.gibba043.dnkmem (mgr.34373) 193 : audit [DBG] from='client.44208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:37 gibba003 bash[31385]: audit 2021-03-10T13:54:36.526560+0000 mgr.gibba043.dnkmem (mgr.34373) 194 : audit [DBG] from='client.44214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:37 gibba003 bash[31385]: audit 2021-03-10T13:54:36.797855+0000 mon.c (mon.1) 88 : audit [DBG] from='client.? 172.21.2.103:0/96676247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:37 gibba003 bash[32348]: audit 2021-03-10T13:54:36.289970+0000 mgr.gibba043.dnkmem (mgr.34373) 193 : audit [DBG] from='client.44208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:37 gibba003 bash[32348]: audit 2021-03-10T13:54:36.526560+0000 mgr.gibba043.dnkmem (mgr.34373) 194 : audit [DBG] from='client.44214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:37 gibba003 bash[32348]: audit 2021-03-10T13:54:36.797855+0000 mon.c (mon.1) 88 : audit [DBG] from='client.? 172.21.2.103:0/96676247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:37 gibba043 bash[24019]: audit 2021-03-10T13:54:36.289970+0000 mgr.gibba043.dnkmem (mgr.34373) 193 : audit [DBG] from='client.44208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:37 gibba043 bash[24019]: audit 2021-03-10T13:54:36.526560+0000 mgr.gibba043.dnkmem (mgr.34373) 194 : audit [DBG] from='client.44214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:37 gibba043 bash[24019]: audit 2021-03-10T13:54:36.797855+0000 mon.c (mon.1) 88 : audit [DBG] from='client.? 172.21.2.103:0/96676247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:38.440 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:38 gibba003 bash[37862]: debug 2021-03-10T13:54:38.118+0000 7fdb77394700 1 -- 172.21.2.103:0/1672485693 <== mon.0 v2:172.21.2.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fde2db44e0 con 0x55fde2e31000 2021-03-10T13:54:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:38 gibba003 bash[31385]: cluster 2021-03-10T13:54:37.224125+0000 mgr.gibba043.dnkmem (mgr.34373) 195 : cluster [DBG] pgmap v93: 129 pgs: 1 stale+active+clean, 10 active+undersized+degraded, 22 peering, 10 active+clean+wait, 13 active+undersized, 73 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T13:54:38.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:38 gibba003 bash[32348]: cluster 2021-03-10T13:54:37.224125+0000 mgr.gibba043.dnkmem (mgr.34373) 195 : cluster [DBG] pgmap v93: 129 pgs: 1 stale+active+clean, 10 active+undersized+degraded, 22 peering, 10 active+clean+wait, 13 active+undersized, 73 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T13:54:38.941 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:38 gibba003 bash[37862]: debug 2021-03-10T13:54:38.706+0000 7fdb7ee29080 -1 Falling back to public interface 2021-03-10T13:54:39.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:38 gibba043 bash[24019]: cluster 2021-03-10T13:54:37.224125+0000 mgr.gibba043.dnkmem (mgr.34373) 195 : cluster [DBG] pgmap v93: 129 pgs: 1 stale+active+clean, 10 active+undersized+degraded, 22 peering, 10 active+clean+wait, 13 active+undersized, 73 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T13:54:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:38.899082+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: cephadm 2021-03-10T13:54:38.900561+0000 mgr.gibba043.dnkmem (mgr.34373) 196 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:54:40.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:39.102976+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:40.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:39.111657+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:40.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:39.114891+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:39.117603+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:39.120058+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[31385]: audit 2021-03-10T13:54:39.126347+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:38.899082+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: cephadm 2021-03-10T13:54:38.900561+0000 mgr.gibba043.dnkmem (mgr.34373) 196 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:54:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:39.102976+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:39.111657+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:39.114891+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:39.117603+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:39.120058+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:39 gibba003 bash[32348]: audit 2021-03-10T13:54:39.126347+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:38.899082+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: cephadm 2021-03-10T13:54:38.900561+0000 mgr.gibba043.dnkmem (mgr.34373) 196 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:54:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:39.102976+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:39.111657+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:39.114891+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:39.117603+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:39.120058+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:39 gibba043 bash[24019]: audit 2021-03-10T13:54:39.126347+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.111179+0000 mgr.gibba043.dnkmem (mgr.34373) 197 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.114738+0000 mgr.gibba043.dnkmem (mgr.34373) 198 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.117239+0000 mgr.gibba043.dnkmem (mgr.34373) 199 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.117278+0000 mgr.gibba043.dnkmem (mgr.34373) 200 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.119935+0000 mgr.gibba043.dnkmem (mgr.34373) 201 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.119976+0000 mgr.gibba043.dnkmem (mgr.34373) 202 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.122282+0000 mgr.gibba043.dnkmem (mgr.34373) 203 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.125981+0000 mgr.gibba043.dnkmem (mgr.34373) 204 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.126024+0000 mgr.gibba043.dnkmem (mgr.34373) 205 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: audit 2021-03-10T13:54:39.127249+0000 mgr.gibba043.dnkmem (mgr.34373) 206 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cephadm 2021-03-10T13:54:39.129492+0000 mgr.gibba043.dnkmem (mgr.34373) 207 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:54:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cluster 2021-03-10T13:54:39.226150+0000 mgr.gibba043.dnkmem (mgr.34373) 208 : cluster [DBG] pgmap v94: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[31385]: cluster 2021-03-10T13:54:40.102057+0000 mon.a (mon.0) 258 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T13:54:41.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.111179+0000 mgr.gibba043.dnkmem (mgr.34373) 197 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.114738+0000 mgr.gibba043.dnkmem (mgr.34373) 198 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.117239+0000 mgr.gibba043.dnkmem (mgr.34373) 199 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.117278+0000 mgr.gibba043.dnkmem (mgr.34373) 200 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.119935+0000 mgr.gibba043.dnkmem (mgr.34373) 201 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.119976+0000 mgr.gibba043.dnkmem (mgr.34373) 202 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.122282+0000 mgr.gibba043.dnkmem (mgr.34373) 203 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.125981+0000 mgr.gibba043.dnkmem (mgr.34373) 204 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.126024+0000 mgr.gibba043.dnkmem (mgr.34373) 205 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: audit 2021-03-10T13:54:39.127249+0000 mgr.gibba043.dnkmem (mgr.34373) 206 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cephadm 2021-03-10T13:54:39.129492+0000 mgr.gibba043.dnkmem (mgr.34373) 207 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:54:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cluster 2021-03-10T13:54:39.226150+0000 mgr.gibba043.dnkmem (mgr.34373) 208 : cluster [DBG] pgmap v94: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:40 gibba003 bash[32348]: cluster 2021-03-10T13:54:40.102057+0000 mon.a (mon.0) 258 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T13:54:41.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.111179+0000 mgr.gibba043.dnkmem (mgr.34373) 197 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:41.414 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.114738+0000 mgr.gibba043.dnkmem (mgr.34373) 198 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:41.414 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.117239+0000 mgr.gibba043.dnkmem (mgr.34373) 199 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:41.415 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.117278+0000 mgr.gibba043.dnkmem (mgr.34373) 200 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:41.415 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.119935+0000 mgr.gibba043.dnkmem (mgr.34373) 201 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:41.415 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.119976+0000 mgr.gibba043.dnkmem (mgr.34373) 202 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:41.415 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.122282+0000 mgr.gibba043.dnkmem (mgr.34373) 203 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:41.416 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.125981+0000 mgr.gibba043.dnkmem (mgr.34373) 204 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:41.416 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.126024+0000 mgr.gibba043.dnkmem (mgr.34373) 205 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:41.416 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: audit 2021-03-10T13:54:39.127249+0000 mgr.gibba043.dnkmem (mgr.34373) 206 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:41.416 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cephadm 2021-03-10T13:54:39.129492+0000 mgr.gibba043.dnkmem (mgr.34373) 207 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:54:41.416 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cluster 2021-03-10T13:54:39.226150+0000 mgr.gibba043.dnkmem (mgr.34373) 208 : cluster [DBG] pgmap v94: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:41.417 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:40 gibba043 bash[24019]: cluster 2021-03-10T13:54:40.102057+0000 mon.a (mon.0) 258 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T13:54:42.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:41 gibba003 bash[31385]: cluster 2021-03-10T13:54:41.589646+0000 mon.a (mon.0) 259 : cluster [WRN] Health check update: Degraded data redundancy: 23/195 objects degraded (11.795%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:42.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:41 gibba003 bash[32348]: cluster 2021-03-10T13:54:41.589646+0000 mon.a (mon.0) 259 : cluster [WRN] Health check update: Degraded data redundancy: 23/195 objects degraded (11.795%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:42.192 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:41 gibba003 bash[37862]: debug 2021-03-10T13:54:41.970+0000 7fdb7ee29080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:54:42.192 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:41 gibba003 bash[37862]: debug 2021-03-10T13:54:41.970+0000 7fdb7ee29080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:54:42.192 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[37862]: debug 2021-03-10T13:54:42.098+0000 7fdb7ee29080 -1 osd.3 80 log_to_monitors {default=true} 2021-03-10T13:54:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:41 gibba043 bash[24019]: cluster 2021-03-10T13:54:41.589646+0000 mon.a (mon.0) 259 : cluster [WRN] Health check update: Degraded data redundancy: 23/195 objects degraded (11.795%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:43.190 INFO:journalctl@ceph.osd.3.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[37862]: debug 2021-03-10T13:54:42.942+0000 7fdb70b0a700 -1 osd.3 80 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:54:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[31385]: cluster 2021-03-10T13:54:41.228108+0000 mgr.gibba043.dnkmem (mgr.34373) 209 : cluster [DBG] pgmap v95: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[31385]: audit 2021-03-10T13:54:42.102718+0000 mon.c (mon.1) 94 : audit [INF] from='osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:54:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[31385]: audit 2021-03-10T13:54:42.102960+0000 mon.a (mon.0) 260 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:54:43.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[32348]: cluster 2021-03-10T13:54:41.228108+0000 mgr.gibba043.dnkmem (mgr.34373) 209 : cluster [DBG] pgmap v95: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:43.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[32348]: audit 2021-03-10T13:54:42.102718+0000 mon.c (mon.1) 94 : audit [INF] from='osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:54:43.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:42 gibba003 bash[32348]: audit 2021-03-10T13:54:42.102960+0000 mon.a (mon.0) 260 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:54:43.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:42 gibba043 bash[24019]: cluster 2021-03-10T13:54:41.228108+0000 mgr.gibba043.dnkmem (mgr.34373) 209 : cluster [DBG] pgmap v95: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:43.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:42 gibba043 bash[24019]: audit 2021-03-10T13:54:42.102718+0000 mon.c (mon.1) 94 : audit [INF] from='osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:54:43.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:42 gibba043 bash[24019]: audit 2021-03-10T13:54:42.102960+0000 mon.a (mon.0) 260 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:54:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:43 gibba043 bash[24019]: audit 2021-03-10T13:54:42.938287+0000 mon.a (mon.0) 261 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:54:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:43 gibba043 bash[24019]: cluster 2021-03-10T13:54:42.938330+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:54:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:43 gibba043 bash[24019]: audit 2021-03-10T13:54:42.938987+0000 mon.c (mon.1) 95 : audit [INF] from='osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:43 gibba043 bash[24019]: audit 2021-03-10T13:54:42.939257+0000 mon.a (mon.0) 263 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[31385]: audit 2021-03-10T13:54:42.938287+0000 mon.a (mon.0) 261 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:54:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[31385]: cluster 2021-03-10T13:54:42.938330+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:54:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[31385]: audit 2021-03-10T13:54:42.938987+0000 mon.c (mon.1) 95 : audit [INF] from='osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[31385]: audit 2021-03-10T13:54:42.939257+0000 mon.a (mon.0) 263 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[32348]: audit 2021-03-10T13:54:42.938287+0000 mon.a (mon.0) 261 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:54:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[32348]: cluster 2021-03-10T13:54:42.938330+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:54:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[32348]: audit 2021-03-10T13:54:42.938987+0000 mon.c (mon.1) 95 : audit [INF] from='osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:43 gibba003 bash[32348]: audit 2021-03-10T13:54:42.939257+0000 mon.a (mon.0) 263 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba003", "root=default"]}]: dispatch 2021-03-10T13:54:45.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:44 gibba043 bash[24019]: cluster 2021-03-10T13:54:43.229636+0000 mgr.gibba043.dnkmem (mgr.34373) 210 : cluster [DBG] pgmap v97: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:45.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:44 gibba043 bash[24019]: cluster 2021-03-10T13:54:43.933297+0000 mon.a (mon.0) 264 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:45.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:44 gibba043 bash[24019]: cluster 2021-03-10T13:54:43.943805+0000 mon.a (mon.0) 265 : cluster [INF] osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102] boot 2021-03-10T13:54:45.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:44 gibba043 bash[24019]: cluster 2021-03-10T13:54:43.943856+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-03-10T13:54:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:44 gibba043 bash[24019]: audit 2021-03-10T13:54:43.945082+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:54:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[31385]: cluster 2021-03-10T13:54:43.229636+0000 mgr.gibba043.dnkmem (mgr.34373) 210 : cluster [DBG] pgmap v97: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[31385]: cluster 2021-03-10T13:54:43.933297+0000 mon.a (mon.0) 264 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[31385]: cluster 2021-03-10T13:54:43.943805+0000 mon.a (mon.0) 265 : cluster [INF] osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102] boot 2021-03-10T13:54:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[31385]: cluster 2021-03-10T13:54:43.943856+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-03-10T13:54:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[31385]: audit 2021-03-10T13:54:43.945082+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:54:45.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[32348]: cluster 2021-03-10T13:54:43.229636+0000 mgr.gibba043.dnkmem (mgr.34373) 210 : cluster [DBG] pgmap v97: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T13:54:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[32348]: cluster 2021-03-10T13:54:43.933297+0000 mon.a (mon.0) 264 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[32348]: cluster 2021-03-10T13:54:43.943805+0000 mon.a (mon.0) 265 : cluster [INF] osd.3 [v2:172.21.2.103:6824/1744285102,v1:172.21.2.103:6825/1744285102] boot 2021-03-10T13:54:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[32348]: cluster 2021-03-10T13:54:43.943856+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-03-10T13:54:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:44 gibba003 bash[32348]: audit 2021-03-10T13:54:43.945082+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:54:46.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:45 gibba043 bash[24019]: cluster 2021-03-10T13:54:44.948858+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-03-10T13:54:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:45 gibba003 bash[31385]: cluster 2021-03-10T13:54:44.948858+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-03-10T13:54:46.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:45 gibba003 bash[32348]: cluster 2021-03-10T13:54:44.948858+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-03-10T13:54:47.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:46 gibba043 bash[24019]: cluster 2021-03-10T13:54:45.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 211 : cluster [DBG] pgmap v100: 129 pgs: 6 peering, 16 active+undersized+degraded, 28 active+undersized, 79 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:54:47.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:46 gibba043 bash[24019]: cluster 2021-03-10T13:54:46.592380+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:46 gibba003 bash[31385]: cluster 2021-03-10T13:54:45.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 211 : cluster [DBG] pgmap v100: 129 pgs: 6 peering, 16 active+undersized+degraded, 28 active+undersized, 79 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:54:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:46 gibba003 bash[31385]: cluster 2021-03-10T13:54:46.592380+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:46 gibba003 bash[32348]: cluster 2021-03-10T13:54:45.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 211 : cluster [DBG] pgmap v100: 129 pgs: 6 peering, 16 active+undersized+degraded, 28 active+undersized, 79 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:54:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:46 gibba003 bash[32348]: cluster 2021-03-10T13:54:46.592380+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:48 gibba043 bash[24019]: cluster 2021-03-10T13:54:47.232309+0000 mgr.gibba043.dnkmem (mgr.34373) 212 : cluster [DBG] pgmap v101: 129 pgs: 6 peering, 13 active+undersized+degraded, 24 active+undersized, 86 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T13:54:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:48 gibba003 bash[31385]: cluster 2021-03-10T13:54:47.232309+0000 mgr.gibba043.dnkmem (mgr.34373) 212 : cluster [DBG] pgmap v101: 129 pgs: 6 peering, 13 active+undersized+degraded, 24 active+undersized, 86 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T13:54:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:48 gibba003 bash[32348]: cluster 2021-03-10T13:54:47.232309+0000 mgr.gibba043.dnkmem (mgr.34373) 212 : cluster [DBG] pgmap v101: 129 pgs: 6 peering, 13 active+undersized+degraded, 24 active+undersized, 86 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T13:54:50.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:50 gibba003 bash[31385]: cluster 2021-03-10T13:54:49.979449+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 13 pgs degraded) 2021-03-10T13:54:50.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:50 gibba003 bash[32348]: cluster 2021-03-10T13:54:49.979449+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 13 pgs degraded) 2021-03-10T13:54:50.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:50 gibba043 bash[24019]: cluster 2021-03-10T13:54:49.979449+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 13 pgs degraded) 2021-03-10T13:54:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:51 gibba003 bash[31385]: cluster 2021-03-10T13:54:49.234065+0000 mgr.gibba043.dnkmem (mgr.34373) 213 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 6 peering, 103 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:51 gibba003 bash[32348]: cluster 2021-03-10T13:54:49.234065+0000 mgr.gibba043.dnkmem (mgr.34373) 213 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 6 peering, 103 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:51 gibba043 bash[24019]: cluster 2021-03-10T13:54:49.234065+0000 mgr.gibba043.dnkmem (mgr.34373) 213 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 6 peering, 103 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:53 gibba003 bash[31385]: cluster 2021-03-10T13:54:51.235561+0000 mgr.gibba043.dnkmem (mgr.34373) 214 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:53 gibba003 bash[32348]: cluster 2021-03-10T13:54:51.235561+0000 mgr.gibba043.dnkmem (mgr.34373) 214 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:53 gibba043 bash[24019]: cluster 2021-03-10T13:54:51.235561+0000 mgr.gibba043.dnkmem (mgr.34373) 214 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:55.326 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:55 gibba043 bash[24019]: cluster 2021-03-10T13:54:53.236834+0000 mgr.gibba043.dnkmem (mgr.34373) 215 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:55.327 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:55 gibba043 bash[24019]: audit 2021-03-10T13:54:54.145652+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:55 gibba003 bash[31385]: cluster 2021-03-10T13:54:53.236834+0000 mgr.gibba043.dnkmem (mgr.34373) 215 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:55 gibba003 bash[31385]: audit 2021-03-10T13:54:54.145652+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:55 gibba003 bash[32348]: cluster 2021-03-10T13:54:53.236834+0000 mgr.gibba043.dnkmem (mgr.34373) 215 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:55 gibba003 bash[32348]: audit 2021-03-10T13:54:54.145652+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:56 gibba003 bash[31385]: audit 2021-03-10T13:54:54.146913+0000 mgr.gibba043.dnkmem (mgr.34373) 216 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:56 gibba003 bash[31385]: cephadm 2021-03-10T13:54:54.151491+0000 mgr.gibba043.dnkmem (mgr.34373) 217 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:54:56.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:56 gibba003 bash[32348]: audit 2021-03-10T13:54:54.146913+0000 mgr.gibba043.dnkmem (mgr.34373) 216 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:56.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:56 gibba003 bash[32348]: cephadm 2021-03-10T13:54:54.151491+0000 mgr.gibba043.dnkmem (mgr.34373) 217 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:54:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:56 gibba043 bash[24019]: audit 2021-03-10T13:54:54.146913+0000 mgr.gibba043.dnkmem (mgr.34373) 216 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:54:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:56 gibba043 bash[24019]: cephadm 2021-03-10T13:54:54.151491+0000 mgr.gibba043.dnkmem (mgr.34373) 217 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:54:57.370 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:57 gibba043 bash[24019]: cluster 2021-03-10T13:54:55.238446+0000 mgr.gibba043.dnkmem (mgr.34373) 218 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:57.370 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:57 gibba043 bash[24019]: cephadm 2021-03-10T13:54:56.120618+0000 mgr.gibba043.dnkmem (mgr.34373) 219 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:54:57.371 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:57 gibba043 bash[24019]: audit 2021-03-10T13:54:56.128610+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:57.371 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:57 gibba043 bash[24019]: cephadm 2021-03-10T13:54:56.131913+0000 mgr.gibba043.dnkmem (mgr.34373) 220 : cephadm [INF] Deploying daemon osd.4 on gibba043 2021-03-10T13:54:57.371 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:57 gibba043 bash[24019]: audit 2021-03-10T13:54:56.131992+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:54:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[31385]: cluster 2021-03-10T13:54:55.238446+0000 mgr.gibba043.dnkmem (mgr.34373) 218 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[31385]: cephadm 2021-03-10T13:54:56.120618+0000 mgr.gibba043.dnkmem (mgr.34373) 219 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:54:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[31385]: audit 2021-03-10T13:54:56.128610+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[31385]: cephadm 2021-03-10T13:54:56.131913+0000 mgr.gibba043.dnkmem (mgr.34373) 220 : cephadm [INF] Deploying daemon osd.4 on gibba043 2021-03-10T13:54:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[31385]: audit 2021-03-10T13:54:56.131992+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:54:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[32348]: cluster 2021-03-10T13:54:55.238446+0000 mgr.gibba043.dnkmem (mgr.34373) 218 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[32348]: cephadm 2021-03-10T13:54:56.120618+0000 mgr.gibba043.dnkmem (mgr.34373) 219 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:54:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[32348]: audit 2021-03-10T13:54:56.128610+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[32348]: cephadm 2021-03-10T13:54:56.131913+0000 mgr.gibba043.dnkmem (mgr.34373) 220 : cephadm [INF] Deploying daemon osd.4 on gibba043 2021-03-10T13:54:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:57 gibba003 bash[32348]: audit 2021-03-10T13:54:56.131992+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:54:58.270 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:54:58 gibba043 systemd[1]: Stopping Ceph osd.4 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:54:58.270 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[12217]: debug 2021-03-10T13:54:58.190+0000 7f95f3690700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:54:58.270 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[12217]: debug 2021-03-10T13:54:58.190+0000 7f95f3690700 -1 osd.4 85 *** Got signal Terminated *** 2021-03-10T13:54:58.271 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[12217]: debug 2021-03-10T13:54:58.190+0000 7f95f3690700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:54:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:57.239792+0000 mgr.gibba043.dnkmem (mgr.34373) 221 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: audit 2021-03-10T13:54:57.758390+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.523581+0000 mon.a (mon.0) 272 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:54:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.523767+0000 mon.a (mon.0) 273 : cluster [INF] osd.4 failed (root=default,host=gibba043) (connection refused reported by osd.6) 2021-03-10T13:54:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.524337+0000 mon.a (mon.0) 274 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:54:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.524710+0000 mon.a (mon.0) 275 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:54:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.524998+0000 mon.a (mon.0) 276 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:54:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.525192+0000 mon.a (mon.0) 277 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.525707+0000 mon.a (mon.0) 278 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.525892+0000 mon.a (mon.0) 279 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.526335+0000 mon.a (mon.0) 280 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.526500+0000 mon.a (mon.0) 281 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.526882+0000 mon.a (mon.0) 282 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.527080+0000 mon.a (mon.0) 283 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.527586+0000 mon.a (mon.0) 284 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.527858+0000 mon.a (mon.0) 285 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:58 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.528219+0000 mon.a (mon.0) 286 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:54:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:57.239792+0000 mgr.gibba043.dnkmem (mgr.34373) 221 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: audit 2021-03-10T13:54:57.758390+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.523581+0000 mon.a (mon.0) 272 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:54:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.523767+0000 mon.a (mon.0) 273 : cluster [INF] osd.4 failed (root=default,host=gibba043) (connection refused reported by osd.6) 2021-03-10T13:54:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.524337+0000 mon.a (mon.0) 274 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:54:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.524710+0000 mon.a (mon.0) 275 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:54:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.524998+0000 mon.a (mon.0) 276 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:54:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.525192+0000 mon.a (mon.0) 277 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:54:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.525707+0000 mon.a (mon.0) 278 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:54:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.525892+0000 mon.a (mon.0) 279 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:54:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.526335+0000 mon.a (mon.0) 280 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:54:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.526500+0000 mon.a (mon.0) 281 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:54:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.526882+0000 mon.a (mon.0) 282 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:54:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.527080+0000 mon.a (mon.0) 283 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:54:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.527586+0000 mon.a (mon.0) 284 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:54:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.527858+0000 mon.a (mon.0) 285 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:54:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.528219+0000 mon.a (mon.0) 286 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:54:59.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:57.239792+0000 mgr.gibba043.dnkmem (mgr.34373) 221 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:54:59.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: audit 2021-03-10T13:54:57.758390+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:54:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.523581+0000 mon.a (mon.0) 272 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:54:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.523767+0000 mon.a (mon.0) 273 : cluster [INF] osd.4 failed (root=default,host=gibba043) (connection refused reported by osd.6) 2021-03-10T13:54:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.524337+0000 mon.a (mon.0) 274 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:54:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.524710+0000 mon.a (mon.0) 275 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:54:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.524998+0000 mon.a (mon.0) 276 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:54:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.525192+0000 mon.a (mon.0) 277 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:54:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.525707+0000 mon.a (mon.0) 278 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:54:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.525892+0000 mon.a (mon.0) 279 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:54:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.526335+0000 mon.a (mon.0) 280 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:54:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.526500+0000 mon.a (mon.0) 281 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:54:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.526882+0000 mon.a (mon.0) 282 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:54:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.527080+0000 mon.a (mon.0) 283 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:54:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.527586+0000 mon.a (mon.0) 284 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:54:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.527858+0000 mon.a (mon.0) 285 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:54:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:58 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.528219+0000 mon.a (mon.0) 286 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:54:59.519 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:54:59 gibba043 docker[25413]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.4 2021-03-10T13:55:00.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.920601+0000 mon.a (mon.0) 287 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:55:00.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.920800+0000 mon.a (mon.0) 288 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:55:00.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.923002+0000 mon.a (mon.0) 289 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:55:00.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.924281+0000 mon.a (mon.0) 290 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:55:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.924745+0000 mon.a (mon.0) 291 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:55:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.925104+0000 mon.a (mon.0) 292 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:55:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.925421+0000 mon.a (mon.0) 293 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:55:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.925834+0000 mon.a (mon.0) 294 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:55:00.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.925993+0000 mon.a (mon.0) 295 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:55:00.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.926372+0000 mon.a (mon.0) 296 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:55:00.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.926657+0000 mon.a (mon.0) 297 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:55:00.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.927104+0000 mon.a (mon.0) 298 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:55:00.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.927378+0000 mon.a (mon.0) 299 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:55:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:58.927959+0000 mon.a (mon.0) 300 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:55:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:59.077106+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:54:59 gibba043 bash[24019]: cluster 2021-03-10T13:54:59.087395+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e86: 8 total, 7 up, 8 in 2021-03-10T13:55:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.920601+0000 mon.a (mon.0) 287 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:55:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.920800+0000 mon.a (mon.0) 288 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:55:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.923002+0000 mon.a (mon.0) 289 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:55:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.924281+0000 mon.a (mon.0) 290 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:55:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.924745+0000 mon.a (mon.0) 291 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:55:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.925104+0000 mon.a (mon.0) 292 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:55:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.925421+0000 mon.a (mon.0) 293 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:55:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.925834+0000 mon.a (mon.0) 294 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:55:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.925993+0000 mon.a (mon.0) 295 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:55:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.926372+0000 mon.a (mon.0) 296 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:55:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.926657+0000 mon.a (mon.0) 297 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:55:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.927104+0000 mon.a (mon.0) 298 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:55:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.927378+0000 mon.a (mon.0) 299 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:55:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:58.927959+0000 mon.a (mon.0) 300 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:55:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:59.077106+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:00.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[31385]: cluster 2021-03-10T13:54:59.087395+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e86: 8 total, 7 up, 8 in 2021-03-10T13:55:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.920601+0000 mon.a (mon.0) 287 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:55:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.920800+0000 mon.a (mon.0) 288 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:55:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.923002+0000 mon.a (mon.0) 289 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:55:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.924281+0000 mon.a (mon.0) 290 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:55:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.924745+0000 mon.a (mon.0) 291 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:55:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.925104+0000 mon.a (mon.0) 292 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:55:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.925421+0000 mon.a (mon.0) 293 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:55:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.925834+0000 mon.a (mon.0) 294 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:55:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.925993+0000 mon.a (mon.0) 295 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:55:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.926372+0000 mon.a (mon.0) 296 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:55:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.926657+0000 mon.a (mon.0) 297 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:55:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.927104+0000 mon.a (mon.0) 298 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:55:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.927378+0000 mon.a (mon.0) 299 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:55:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:58.927959+0000 mon.a (mon.0) 300 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:55:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:59.077106+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:54:59 gibba003 bash[32348]: cluster 2021-03-10T13:54:59.087395+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e86: 8 total, 7 up, 8 in 2021-03-10T13:55:01.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:00 gibba043 bash[24019]: cluster 2021-03-10T13:54:59.240968+0000 mgr.gibba043.dnkmem (mgr.34373) 222 : cluster [DBG] pgmap v108: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:55:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:00 gibba043 bash[24019]: cluster 2021-03-10T13:55:00.091921+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2021-03-10T13:55:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:00 gibba003 bash[31385]: cluster 2021-03-10T13:54:59.240968+0000 mgr.gibba043.dnkmem (mgr.34373) 222 : cluster [DBG] pgmap v108: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:55:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:00 gibba003 bash[31385]: cluster 2021-03-10T13:55:00.091921+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2021-03-10T13:55:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:00 gibba003 bash[32348]: cluster 2021-03-10T13:54:59.240968+0000 mgr.gibba043.dnkmem (mgr.34373) 222 : cluster [DBG] pgmap v108: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:55:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:00 gibba003 bash[32348]: cluster 2021-03-10T13:55:00.091921+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2021-03-10T13:55:01.520 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:01 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.4.service: Succeeded. 2021-03-10T13:55:01.520 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:01 gibba043 systemd[1]: Stopped Ceph osd.4 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:01.520 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:01 gibba043 systemd[1]: Started Ceph osd.4 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[24019]: cluster 2021-03-10T13:55:01.241456+0000 mgr.gibba043.dnkmem (mgr.34373) 223 : cluster [DBG] pgmap v110: 129 pgs: 3 active+undersized+degraded, 9 peering, 14 stale+active+clean, 6 active+undersized, 97 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T13:55:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[24019]: audit 2021-03-10T13:55:01.250597+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[24019]: audit 2021-03-10T13:55:01.252185+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[24019]: cluster 2021-03-10T13:55:01.765800+0000 mon.a (mon.0) 305 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[24019]: cluster 2021-03-10T13:55:01.765902+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:02.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[31385]: cluster 2021-03-10T13:55:01.241456+0000 mgr.gibba043.dnkmem (mgr.34373) 223 : cluster [DBG] pgmap v110: 129 pgs: 3 active+undersized+degraded, 9 peering, 14 stale+active+clean, 6 active+undersized, 97 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T13:55:02.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[31385]: audit 2021-03-10T13:55:01.250597+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:02.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[31385]: audit 2021-03-10T13:55:01.252185+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:02.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[31385]: cluster 2021-03-10T13:55:01.765800+0000 mon.a (mon.0) 305 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:02.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[31385]: cluster 2021-03-10T13:55:01.765902+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:02.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[32348]: cluster 2021-03-10T13:55:01.241456+0000 mgr.gibba043.dnkmem (mgr.34373) 223 : cluster [DBG] pgmap v110: 129 pgs: 3 active+undersized+degraded, 9 peering, 14 stale+active+clean, 6 active+undersized, 97 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T13:55:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[32348]: audit 2021-03-10T13:55:01.250597+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[32348]: audit 2021-03-10T13:55:01.252185+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[32348]: cluster 2021-03-10T13:55:01.765800+0000 mon.a (mon.0) 305 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:02 gibba003 bash[32348]: cluster 2021-03-10T13:55:01.765902+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:03.020 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:55:03.020 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T13:55:03.020 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:55:03.020 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:55:03.021 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:55:03.021 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:55:03.021 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:02 gibba043 bash[25587]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T13:55:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:04 gibba043 bash[24019]: cluster 2021-03-10T13:55:03.242096+0000 mgr.gibba043.dnkmem (mgr.34373) 224 : cluster [DBG] pgmap v111: 129 pgs: 6 active+undersized+degraded, 9 peering, 7 stale+active+clean, 14 active+undersized, 93 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T13:55:04.520 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:04 gibba043 bash[25715]: debug 2021-03-10T13:55:04.166+0000 7fe0ec006700 1 -- 172.21.2.143:0/3803346547 <== mon.2 v2:172.21.2.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644203de4e0 con 0x56442045b000 2021-03-10T13:55:04.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:04 gibba003 bash[31385]: cluster 2021-03-10T13:55:03.242096+0000 mgr.gibba043.dnkmem (mgr.34373) 224 : cluster [DBG] pgmap v111: 129 pgs: 6 active+undersized+degraded, 9 peering, 7 stale+active+clean, 14 active+undersized, 93 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T13:55:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:04 gibba003 bash[32348]: cluster 2021-03-10T13:55:03.242096+0000 mgr.gibba043.dnkmem (mgr.34373) 224 : cluster [DBG] pgmap v111: 129 pgs: 6 active+undersized+degraded, 9 peering, 7 stale+active+clean, 14 active+undersized, 93 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T13:55:05.019 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:04 gibba043 bash[25715]: debug 2021-03-10T13:55:04.730+0000 7fe0f3a9b080 -1 Falling back to public interface 2021-03-10T13:55:06.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.082179+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:06.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.093698+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:06.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.099602+0000 mgr.gibba043.dnkmem (mgr.34373) 225 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:06.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.100383+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:06.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.102923+0000 mgr.gibba043.dnkmem (mgr.34373) 226 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:06.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.103222+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.105397+0000 mgr.gibba043.dnkmem (mgr.34373) 227 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.105665+0000 mgr.gibba043.dnkmem (mgr.34373) 228 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.105818+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.107494+0000 mgr.gibba043.dnkmem (mgr.34373) 229 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.107577+0000 mgr.gibba043.dnkmem (mgr.34373) 230 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.107697+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.109610+0000 mgr.gibba043.dnkmem (mgr.34373) 231 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.111822+0000 mgr.gibba043.dnkmem (mgr.34373) 232 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.111905+0000 mgr.gibba043.dnkmem (mgr.34373) 233 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:06.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.112237+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:06.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: audit 2021-03-10T13:55:05.112985+0000 mgr.gibba043.dnkmem (mgr.34373) 234 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:06.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cephadm 2021-03-10T13:55:05.114693+0000 mgr.gibba043.dnkmem (mgr.34373) 235 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2021-03-10T13:55:06.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[32348]: cluster 2021-03-10T13:55:05.244252+0000 mgr.gibba043.dnkmem (mgr.34373) 236 : cluster [DBG] pgmap v112: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:06.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.082179+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:06.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.093698+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:06.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.099602+0000 mgr.gibba043.dnkmem (mgr.34373) 225 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:06.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.100383+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:06.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.102923+0000 mgr.gibba043.dnkmem (mgr.34373) 226 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:06.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.103222+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.105397+0000 mgr.gibba043.dnkmem (mgr.34373) 227 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:06.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.105665+0000 mgr.gibba043.dnkmem (mgr.34373) 228 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:06.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.105818+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.107494+0000 mgr.gibba043.dnkmem (mgr.34373) 229 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:06.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.107577+0000 mgr.gibba043.dnkmem (mgr.34373) 230 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:06.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.107697+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.109610+0000 mgr.gibba043.dnkmem (mgr.34373) 231 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:06.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.111822+0000 mgr.gibba043.dnkmem (mgr.34373) 232 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:06.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.111905+0000 mgr.gibba043.dnkmem (mgr.34373) 233 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:06.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.112237+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:06.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: audit 2021-03-10T13:55:05.112985+0000 mgr.gibba043.dnkmem (mgr.34373) 234 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:06.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cephadm 2021-03-10T13:55:05.114693+0000 mgr.gibba043.dnkmem (mgr.34373) 235 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2021-03-10T13:55:06.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:06 gibba003 bash[31385]: cluster 2021-03-10T13:55:05.244252+0000 mgr.gibba043.dnkmem (mgr.34373) 236 : cluster [DBG] pgmap v112: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.082179+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.093698+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:06.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.099602+0000 mgr.gibba043.dnkmem (mgr.34373) 225 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:06.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.100383+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:06.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.102923+0000 mgr.gibba043.dnkmem (mgr.34373) 226 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:06.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.103222+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.105397+0000 mgr.gibba043.dnkmem (mgr.34373) 227 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:06.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.105665+0000 mgr.gibba043.dnkmem (mgr.34373) 228 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:06.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.105818+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.107494+0000 mgr.gibba043.dnkmem (mgr.34373) 229 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:06.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.107577+0000 mgr.gibba043.dnkmem (mgr.34373) 230 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:06.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.107697+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.109610+0000 mgr.gibba043.dnkmem (mgr.34373) 231 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.111822+0000 mgr.gibba043.dnkmem (mgr.34373) 232 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.111905+0000 mgr.gibba043.dnkmem (mgr.34373) 233 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.112237+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:06.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: audit 2021-03-10T13:55:05.112985+0000 mgr.gibba043.dnkmem (mgr.34373) 234 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:06.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cephadm 2021-03-10T13:55:05.114693+0000 mgr.gibba043.dnkmem (mgr.34373) 235 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2021-03-10T13:55:06.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:06 gibba043 bash[24019]: cluster 2021-03-10T13:55:05.244252+0000 mgr.gibba043.dnkmem (mgr.34373) 236 : cluster [DBG] pgmap v112: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:07.041 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:55:07.272 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:55:07.273 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3m) 28s ago 8m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:55:07.273 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (8m) 2s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:55:07.273 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3m) 2s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:55:07.273 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (4m) 2s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:55:07.273 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3m) 28s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:55:07.274 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3m) 28s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:55:07.274 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2m) 2s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:55:07.274 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2m) 28s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:55:07.274 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (8m) 28s ago 8m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:55:07.275 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (8m) 2s ago 8m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:55:07.275 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (108s) 28s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:55:07.275 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (82s) 28s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:55:07.275 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (55s) 28s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:55:07.275 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (30s) 28s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:55:07.276 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (4s) 2s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:55:07.276 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (10m) 2s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4fa1e6ee0db0 2021-03-10T13:55:07.276 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (9m) 2s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:55:07.276 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (9m) 2s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:55:07.276 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (8m) 2s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:55:07.277 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 28s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:55:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:07 gibba003 bash[31385]: cluster 2021-03-10T13:55:06.088634+0000 mon.a (mon.0) 309 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-03-10T13:55:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:07 gibba003 bash[31385]: audit 2021-03-10T13:55:07.033027+0000 mgr.gibba043.dnkmem (mgr.34373) 237 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:07 gibba003 bash[32348]: cluster 2021-03-10T13:55:06.088634+0000 mon.a (mon.0) 309 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-03-10T13:55:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:07 gibba003 bash[32348]: audit 2021-03-10T13:55:07.033027+0000 mgr.gibba043.dnkmem (mgr.34373) 237 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:07 gibba043 bash[24019]: cluster 2021-03-10T13:55:06.088634+0000 mon.a (mon.0) 309 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-03-10T13:55:07.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:07 gibba043 bash[24019]: audit 2021-03-10T13:55:07.033027+0000 mgr.gibba043.dnkmem (mgr.34373) 237 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:07.525 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:55:07.525 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:55:07.526 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:07.526 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:55:07.526 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:55:07.526 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:07.526 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:55:07.527 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:55:07.527 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T13:55:07.527 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 4 2021-03-10T13:55:07.527 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:55:07.527 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:55:07.528 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:55:07.528 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T13:55:07.528 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 10 2021-03-10T13:55:07.528 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:55:07.529 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:55:08.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[24019]: cluster 2021-03-10T13:55:07.245959+0000 mgr.gibba043.dnkmem (mgr.34373) 238 : cluster [DBG] pgmap v113: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:08.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[24019]: audit 2021-03-10T13:55:07.261885+0000 mgr.gibba043.dnkmem (mgr.34373) 239 : audit [DBG] from='client.44238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[24019]: audit 2021-03-10T13:55:07.525473+0000 mon.a (mon.0) 310 : audit [DBG] from='client.? 172.21.2.103:0/1659229001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[24019]: audit 2021-03-10T13:55:08.074698+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:55:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[24019]: audit 2021-03-10T13:55:08.075047+0000 mon.a (mon.0) 311 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:55:08.271 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:07 gibba043 bash[25715]: debug 2021-03-10T13:55:07.942+0000 7fe0f3a9b080 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:55:08.272 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:07 gibba043 bash[25715]: debug 2021-03-10T13:55:07.942+0000 7fe0ddd5e700 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:55:08.272 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[25715]: debug 2021-03-10T13:55:08.070+0000 7fe0f3a9b080 -1 osd.4 85 log_to_monitors {default=true} 2021-03-10T13:55:08.272 INFO:journalctl@ceph.osd.4.gibba043.stdout:Mar 10 13:55:08 gibba043 bash[25715]: debug 2021-03-10T13:55:08.106+0000 7fe0e3f79700 -1 osd.4 85 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:55:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[31385]: cluster 2021-03-10T13:55:07.245959+0000 mgr.gibba043.dnkmem (mgr.34373) 238 : cluster [DBG] pgmap v113: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[31385]: audit 2021-03-10T13:55:07.261885+0000 mgr.gibba043.dnkmem (mgr.34373) 239 : audit [DBG] from='client.44238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[31385]: audit 2021-03-10T13:55:07.525473+0000 mon.a (mon.0) 310 : audit [DBG] from='client.? 172.21.2.103:0/1659229001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[31385]: audit 2021-03-10T13:55:08.074698+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:55:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[31385]: audit 2021-03-10T13:55:08.075047+0000 mon.a (mon.0) 311 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:55:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[32348]: cluster 2021-03-10T13:55:07.245959+0000 mgr.gibba043.dnkmem (mgr.34373) 238 : cluster [DBG] pgmap v113: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[32348]: audit 2021-03-10T13:55:07.261885+0000 mgr.gibba043.dnkmem (mgr.34373) 239 : audit [DBG] from='client.44238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[32348]: audit 2021-03-10T13:55:07.525473+0000 mon.a (mon.0) 310 : audit [DBG] from='client.? 172.21.2.103:0/1659229001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[32348]: audit 2021-03-10T13:55:08.074698+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:55:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:08 gibba003 bash[32348]: audit 2021-03-10T13:55:08.075047+0000 mon.a (mon.0) 311 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:55:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[31385]: audit 2021-03-10T13:55:08.097683+0000 mon.a (mon.0) 312 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:55:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[31385]: cluster 2021-03-10T13:55:08.097720+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:55:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[31385]: audit 2021-03-10T13:55:08.099511+0000 mon.a (mon.0) 314 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[31385]: audit 2021-03-10T13:55:08.099629+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[32348]: audit 2021-03-10T13:55:08.097683+0000 mon.a (mon.0) 312 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:55:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[32348]: cluster 2021-03-10T13:55:08.097720+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:55:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[32348]: audit 2021-03-10T13:55:08.099511+0000 mon.a (mon.0) 314 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:09 gibba003 bash[32348]: audit 2021-03-10T13:55:08.099629+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:09 gibba043 bash[24019]: audit 2021-03-10T13:55:08.097683+0000 mon.a (mon.0) 312 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:55:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:09 gibba043 bash[24019]: cluster 2021-03-10T13:55:08.097720+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:55:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:09 gibba043 bash[24019]: audit 2021-03-10T13:55:08.099511+0000 mon.a (mon.0) 314 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:09 gibba043 bash[24019]: audit 2021-03-10T13:55:08.099629+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:10.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[31385]: cluster 2021-03-10T13:55:09.097337+0000 mon.a (mon.0) 315 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:10.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[31385]: cluster 2021-03-10T13:55:09.108032+0000 mon.a (mon.0) 316 : cluster [INF] osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844] boot 2021-03-10T13:55:10.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[31385]: cluster 2021-03-10T13:55:09.108193+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-03-10T13:55:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[31385]: audit 2021-03-10T13:55:09.110899+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:55:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[31385]: cluster 2021-03-10T13:55:09.247392+0000 mgr.gibba043.dnkmem (mgr.34373) 240 : cluster [DBG] pgmap v116: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:10.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[32348]: cluster 2021-03-10T13:55:09.097337+0000 mon.a (mon.0) 315 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[32348]: cluster 2021-03-10T13:55:09.108032+0000 mon.a (mon.0) 316 : cluster [INF] osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844] boot 2021-03-10T13:55:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[32348]: cluster 2021-03-10T13:55:09.108193+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-03-10T13:55:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[32348]: audit 2021-03-10T13:55:09.110899+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:55:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:10 gibba003 bash[32348]: cluster 2021-03-10T13:55:09.247392+0000 mgr.gibba043.dnkmem (mgr.34373) 240 : cluster [DBG] pgmap v116: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:10.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:10 gibba043 bash[24019]: cluster 2021-03-10T13:55:09.097337+0000 mon.a (mon.0) 315 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:10 gibba043 bash[24019]: cluster 2021-03-10T13:55:09.108032+0000 mon.a (mon.0) 316 : cluster [INF] osd.4 [v2:172.21.2.143:6800/1570287844,v1:172.21.2.143:6801/1570287844] boot 2021-03-10T13:55:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:10 gibba043 bash[24019]: cluster 2021-03-10T13:55:09.108193+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-03-10T13:55:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:10 gibba043 bash[24019]: audit 2021-03-10T13:55:09.110899+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:55:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:10 gibba043 bash[24019]: cluster 2021-03-10T13:55:09.247392+0000 mgr.gibba043.dnkmem (mgr.34373) 240 : cluster [DBG] pgmap v116: 129 pgs: 25 active+undersized+degraded, 31 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 33/195 objects degraded (16.923%) 2021-03-10T13:55:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:11 gibba003 bash[31385]: cluster 2021-03-10T13:55:10.112231+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-03-10T13:55:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:11 gibba003 bash[32348]: cluster 2021-03-10T13:55:10.112231+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-03-10T13:55:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:11 gibba043 bash[24019]: cluster 2021-03-10T13:55:10.112231+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-03-10T13:55:12.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:12 gibba003 bash[31385]: cluster 2021-03-10T13:55:11.249108+0000 mgr.gibba043.dnkmem (mgr.34373) 241 : cluster [DBG] pgmap v118: 129 pgs: 7 peering, 22 active+undersized+degraded, 20 active+undersized, 80 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 30/195 objects degraded (15.385%) 2021-03-10T13:55:12.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:12 gibba003 bash[31385]: cluster 2021-03-10T13:55:11.604319+0000 mon.a (mon.0) 319 : cluster [WRN] Health check update: Degraded data redundancy: 33/195 objects degraded (16.923%), 25 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:12 gibba003 bash[32348]: cluster 2021-03-10T13:55:11.249108+0000 mgr.gibba043.dnkmem (mgr.34373) 241 : cluster [DBG] pgmap v118: 129 pgs: 7 peering, 22 active+undersized+degraded, 20 active+undersized, 80 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 30/195 objects degraded (15.385%) 2021-03-10T13:55:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:12 gibba003 bash[32348]: cluster 2021-03-10T13:55:11.604319+0000 mon.a (mon.0) 319 : cluster [WRN] Health check update: Degraded data redundancy: 33/195 objects degraded (16.923%), 25 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:12.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:12 gibba043 bash[24019]: cluster 2021-03-10T13:55:11.249108+0000 mgr.gibba043.dnkmem (mgr.34373) 241 : cluster [DBG] pgmap v118: 129 pgs: 7 peering, 22 active+undersized+degraded, 20 active+undersized, 80 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 30/195 objects degraded (15.385%) 2021-03-10T13:55:12.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:12 gibba043 bash[24019]: cluster 2021-03-10T13:55:11.604319+0000 mon.a (mon.0) 319 : cluster [WRN] Health check update: Degraded data redundancy: 33/195 objects degraded (16.923%), 25 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[31385]: audit 2021-03-10T13:55:12.715840+0000 mon.c (mon.1) 106 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[31385]: audit 2021-03-10T13:55:12.716912+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[31385]: audit 2021-03-10T13:55:12.719287+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[31385]: audit 2021-03-10T13:55:12.720293+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[32348]: audit 2021-03-10T13:55:12.715840+0000 mon.c (mon.1) 106 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[32348]: audit 2021-03-10T13:55:12.716912+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[32348]: audit 2021-03-10T13:55:12.719287+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:13 gibba003 bash[32348]: audit 2021-03-10T13:55:12.720293+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:13 gibba043 bash[24019]: audit 2021-03-10T13:55:12.715840+0000 mon.c (mon.1) 106 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:13 gibba043 bash[24019]: audit 2021-03-10T13:55:12.716912+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:13 gibba043 bash[24019]: audit 2021-03-10T13:55:12.719287+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:13 gibba043 bash[24019]: audit 2021-03-10T13:55:12.720293+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:14 gibba003 bash[31385]: cluster 2021-03-10T13:55:13.250936+0000 mgr.gibba043.dnkmem (mgr.34373) 242 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 7 peering, 13 active+undersized+degraded, 7 active+undersized, 84 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T13:55:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:14 gibba003 bash[32348]: cluster 2021-03-10T13:55:13.250936+0000 mgr.gibba043.dnkmem (mgr.34373) 242 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 7 peering, 13 active+undersized+degraded, 7 active+undersized, 84 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T13:55:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:14 gibba043 bash[24019]: cluster 2021-03-10T13:55:13.250936+0000 mgr.gibba043.dnkmem (mgr.34373) 242 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 7 peering, 13 active+undersized+degraded, 7 active+undersized, 84 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T13:55:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:15 gibba003 bash[31385]: cluster 2021-03-10T13:55:15.306522+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 13 pgs degraded) 2021-03-10T13:55:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:15 gibba003 bash[32348]: cluster 2021-03-10T13:55:15.306522+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 13 pgs degraded) 2021-03-10T13:55:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:15 gibba043 bash[24019]: cluster 2021-03-10T13:55:15.306522+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 13 pgs degraded) 2021-03-10T13:55:16.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:16 gibba003 bash[31385]: cluster 2021-03-10T13:55:15.252772+0000 mgr.gibba043.dnkmem (mgr.34373) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:16.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:16 gibba003 bash[32348]: cluster 2021-03-10T13:55:15.252772+0000 mgr.gibba043.dnkmem (mgr.34373) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:16.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:16 gibba043 bash[24019]: cluster 2021-03-10T13:55:15.252772+0000 mgr.gibba043.dnkmem (mgr.34373) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:18 gibba003 bash[31385]: cluster 2021-03-10T13:55:17.254034+0000 mgr.gibba043.dnkmem (mgr.34373) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:18 gibba003 bash[31385]: audit 2021-03-10T13:55:17.773866+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:18 gibba003 bash[32348]: cluster 2021-03-10T13:55:17.254034+0000 mgr.gibba043.dnkmem (mgr.34373) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:18 gibba003 bash[32348]: audit 2021-03-10T13:55:17.773866+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:19.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:18 gibba043 bash[24019]: cluster 2021-03-10T13:55:17.254034+0000 mgr.gibba043.dnkmem (mgr.34373) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:19.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:18 gibba043 bash[24019]: audit 2021-03-10T13:55:17.773866+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:20 gibba003 bash[31385]: cluster 2021-03-10T13:55:19.255862+0000 mgr.gibba043.dnkmem (mgr.34373) 245 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:20 gibba003 bash[31385]: audit 2021-03-10T13:55:20.130738+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:20 gibba003 bash[32348]: cluster 2021-03-10T13:55:19.255862+0000 mgr.gibba043.dnkmem (mgr.34373) 245 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:20 gibba003 bash[32348]: audit 2021-03-10T13:55:20.130738+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:21.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:20 gibba043 bash[24019]: cluster 2021-03-10T13:55:19.255862+0000 mgr.gibba043.dnkmem (mgr.34373) 245 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:21.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:20 gibba043 bash[24019]: audit 2021-03-10T13:55:20.130738+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:21 gibba043 bash[24019]: audit 2021-03-10T13:55:20.131945+0000 mgr.gibba043.dnkmem (mgr.34373) 246 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:21 gibba043 bash[24019]: cephadm 2021-03-10T13:55:20.136732+0000 mgr.gibba043.dnkmem (mgr.34373) 247 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:55:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:21 gibba003 bash[31385]: audit 2021-03-10T13:55:20.131945+0000 mgr.gibba043.dnkmem (mgr.34373) 246 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:21 gibba003 bash[31385]: cephadm 2021-03-10T13:55:20.136732+0000 mgr.gibba043.dnkmem (mgr.34373) 247 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:55:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:21 gibba003 bash[32348]: audit 2021-03-10T13:55:20.131945+0000 mgr.gibba043.dnkmem (mgr.34373) 246 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:55:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:21 gibba003 bash[32348]: cephadm 2021-03-10T13:55:20.136732+0000 mgr.gibba043.dnkmem (mgr.34373) 247 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:55:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:22 gibba003 bash[31385]: cluster 2021-03-10T13:55:21.257200+0000 mgr.gibba043.dnkmem (mgr.34373) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:22 gibba003 bash[31385]: audit 2021-03-10T13:55:22.142970+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:22 gibba003 bash[31385]: audit 2021-03-10T13:55:22.145166+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:55:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:22 gibba003 bash[32348]: cluster 2021-03-10T13:55:21.257200+0000 mgr.gibba043.dnkmem (mgr.34373) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:22 gibba003 bash[32348]: audit 2021-03-10T13:55:22.142970+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:22 gibba003 bash[32348]: audit 2021-03-10T13:55:22.145166+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:55:23.225 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:22 gibba043 bash[24019]: cluster 2021-03-10T13:55:21.257200+0000 mgr.gibba043.dnkmem (mgr.34373) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:23.225 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:22 gibba043 bash[24019]: audit 2021-03-10T13:55:22.142970+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:23.226 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:22 gibba043 bash[24019]: audit 2021-03-10T13:55:22.145166+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:55:24.076 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:23 gibba043 bash[24019]: cephadm 2021-03-10T13:55:22.132169+0000 mgr.gibba043.dnkmem (mgr.34373) 249 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:55:24.076 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:23 gibba043 bash[24019]: cephadm 2021-03-10T13:55:22.145346+0000 mgr.gibba043.dnkmem (mgr.34373) 250 : cephadm [INF] Deploying daemon osd.5 on gibba043 2021-03-10T13:55:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:23 gibba003 bash[31385]: cephadm 2021-03-10T13:55:22.132169+0000 mgr.gibba043.dnkmem (mgr.34373) 249 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:55:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:23 gibba003 bash[31385]: cephadm 2021-03-10T13:55:22.145346+0000 mgr.gibba043.dnkmem (mgr.34373) 250 : cephadm [INF] Deploying daemon osd.5 on gibba043 2021-03-10T13:55:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:23 gibba003 bash[32348]: cephadm 2021-03-10T13:55:22.132169+0000 mgr.gibba043.dnkmem (mgr.34373) 249 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:55:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:23 gibba003 bash[32348]: cephadm 2021-03-10T13:55:22.145346+0000 mgr.gibba043.dnkmem (mgr.34373) 250 : cephadm [INF] Deploying daemon osd.5 on gibba043 2021-03-10T13:55:24.430 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:24 gibba043 systemd[1]: Stopping Ceph osd.5 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:55:24.430 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[13719]: debug 2021-03-10T13:55:24.287+0000 7f8843120700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:55:24.430 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[13719]: debug 2021-03-10T13:55:24.287+0000 7f8843120700 -1 osd.5 90 *** Got signal Terminated *** 2021-03-10T13:55:24.430 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[13719]: debug 2021-03-10T13:55:24.287+0000 7f8843120700 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:55:25.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:23.258020+0000 mgr.gibba043.dnkmem (mgr.34373) 251 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:25.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.607732+0000 mon.a (mon.0) 325 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:55:25.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.607851+0000 mon.a (mon.0) 326 : cluster [INF] osd.5 failed (root=default,host=gibba043) (connection refused reported by osd.0) 2021-03-10T13:55:25.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.608382+0000 mon.a (mon.0) 327 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:55:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.610926+0000 mon.a (mon.0) 328 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:55:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.611331+0000 mon.a (mon.0) 329 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:55:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.611508+0000 mon.a (mon.0) 330 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:55:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.611986+0000 mon.a (mon.0) 331 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:55:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.612163+0000 mon.a (mon.0) 332 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:55:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.612544+0000 mon.a (mon.0) 333 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:55:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.612851+0000 mon.a (mon.0) 334 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:55:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.613364+0000 mon.a (mon.0) 335 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:55:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.613555+0000 mon.a (mon.0) 336 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:55:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.613951+0000 mon.a (mon.0) 337 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:55:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.614226+0000 mon.a (mon.0) 338 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:55:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:24 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.614750+0000 mon.a (mon.0) 339 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:55:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:23.258020+0000 mgr.gibba043.dnkmem (mgr.34373) 251 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.607732+0000 mon.a (mon.0) 325 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:55:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.607851+0000 mon.a (mon.0) 326 : cluster [INF] osd.5 failed (root=default,host=gibba043) (connection refused reported by osd.0) 2021-03-10T13:55:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.608382+0000 mon.a (mon.0) 327 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:55:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.610926+0000 mon.a (mon.0) 328 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:55:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.611331+0000 mon.a (mon.0) 329 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:55:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.611508+0000 mon.a (mon.0) 330 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:55:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.611986+0000 mon.a (mon.0) 331 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:55:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.612163+0000 mon.a (mon.0) 332 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:55:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.612544+0000 mon.a (mon.0) 333 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:55:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.612851+0000 mon.a (mon.0) 334 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:55:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.613364+0000 mon.a (mon.0) 335 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:55:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.613555+0000 mon.a (mon.0) 336 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:55:25.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.613951+0000 mon.a (mon.0) 337 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:55:25.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.614226+0000 mon.a (mon.0) 338 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:55:25.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.614750+0000 mon.a (mon.0) 339 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:55:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:23.258020+0000 mgr.gibba043.dnkmem (mgr.34373) 251 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.607732+0000 mon.a (mon.0) 325 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:55:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.607851+0000 mon.a (mon.0) 326 : cluster [INF] osd.5 failed (root=default,host=gibba043) (connection refused reported by osd.0) 2021-03-10T13:55:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.608382+0000 mon.a (mon.0) 327 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:55:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.610926+0000 mon.a (mon.0) 328 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:55:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.611331+0000 mon.a (mon.0) 329 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:55:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.611508+0000 mon.a (mon.0) 330 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:55:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.611986+0000 mon.a (mon.0) 331 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:55:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.612163+0000 mon.a (mon.0) 332 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:55:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.612544+0000 mon.a (mon.0) 333 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:55:25.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.612851+0000 mon.a (mon.0) 334 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:55:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.613364+0000 mon.a (mon.0) 335 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:55:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.613555+0000 mon.a (mon.0) 336 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:55:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.613951+0000 mon.a (mon.0) 337 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:55:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.614226+0000 mon.a (mon.0) 338 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:55:25.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:24 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.614750+0000 mon.a (mon.0) 339 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:55:25.519 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:25 gibba043 docker[26628]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.5 2021-03-10T13:55:26.149 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:25 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.813054+0000 mon.a (mon.0) 340 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:26.150 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:25 gibba043 bash[24019]: cluster 2021-03-10T13:55:24.826736+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2021-03-10T13:55:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:25 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.813054+0000 mon.a (mon.0) 340 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:25 gibba003 bash[31385]: cluster 2021-03-10T13:55:24.826736+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2021-03-10T13:55:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:25 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.813054+0000 mon.a (mon.0) 340 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:25 gibba003 bash[32348]: cluster 2021-03-10T13:55:24.826736+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2021-03-10T13:55:27.016 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:26 gibba043 bash[24019]: cluster 2021-03-10T13:55:25.258990+0000 mgr.gibba043.dnkmem (mgr.34373) 252 : cluster [DBG] pgmap v126: 129 pgs: 17 stale+active+clean, 18 active+clean+wait, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:27.016 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:26 gibba043 bash[24019]: cluster 2021-03-10T13:55:25.830157+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2021-03-10T13:55:27.087 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:27 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.5.service: Succeeded. 2021-03-10T13:55:27.087 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:27 gibba043 systemd[1]: Stopped Ceph osd.5 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:26 gibba003 bash[31385]: cluster 2021-03-10T13:55:25.258990+0000 mgr.gibba043.dnkmem (mgr.34373) 252 : cluster [DBG] pgmap v126: 129 pgs: 17 stale+active+clean, 18 active+clean+wait, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:26 gibba003 bash[31385]: cluster 2021-03-10T13:55:25.830157+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2021-03-10T13:55:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:26 gibba003 bash[32348]: cluster 2021-03-10T13:55:25.258990+0000 mgr.gibba043.dnkmem (mgr.34373) 252 : cluster [DBG] pgmap v126: 129 pgs: 17 stale+active+clean, 18 active+clean+wait, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:26 gibba003 bash[32348]: cluster 2021-03-10T13:55:25.830157+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2021-03-10T13:55:27.519 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:27 gibba043 systemd[1]: Started Ceph osd.5 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:28.468 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[24019]: audit 2021-03-10T13:55:27.190621+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:28.468 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[24019]: audit 2021-03-10T13:55:27.192282+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:28.468 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[24019]: cluster 2021-03-10T13:55:27.259427+0000 mgr.gibba043.dnkmem (mgr.34373) 253 : cluster [DBG] pgmap v128: 129 pgs: 14 stale+active+clean, 9 peering, 18 active+clean+wait, 88 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:28.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:28 gibba003 bash[31385]: audit 2021-03-10T13:55:27.190621+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:28.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:28 gibba003 bash[31385]: audit 2021-03-10T13:55:27.192282+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:28.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:28 gibba003 bash[31385]: cluster 2021-03-10T13:55:27.259427+0000 mgr.gibba043.dnkmem (mgr.34373) 253 : cluster [DBG] pgmap v128: 129 pgs: 14 stale+active+clean, 9 peering, 18 active+clean+wait, 88 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:28.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:28 gibba003 bash[32348]: audit 2021-03-10T13:55:27.190621+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:28.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:28 gibba003 bash[32348]: audit 2021-03-10T13:55:27.192282+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:28.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:28 gibba003 bash[32348]: cluster 2021-03-10T13:55:27.259427+0000 mgr.gibba043.dnkmem (mgr.34373) 253 : cluster [DBG] pgmap v128: 129 pgs: 14 stale+active+clean, 9 peering, 18 active+clean+wait, 88 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:55:28.769 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:55:28.769 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T13:55:28.770 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:55:28.770 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:55:28.770 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:55:28.770 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:55:28.771 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:28 gibba043 bash[26802]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T13:55:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:29 gibba043 bash[24019]: cluster 2021-03-10T13:55:28.185246+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:29 gibba003 bash[31385]: cluster 2021-03-10T13:55:28.185246+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:29 gibba003 bash[32348]: cluster 2021-03-10T13:55:28.185246+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:30.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:30 gibba043 bash[24019]: cluster 2021-03-10T13:55:29.260610+0000 mgr.gibba043.dnkmem (mgr.34373) 254 : cluster [DBG] pgmap v129: 129 pgs: 1 stale+active+clean, 11 active+undersized+degraded, 9 peering, 19 active+undersized, 89 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:55:30.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:30 gibba003 bash[31385]: cluster 2021-03-10T13:55:29.260610+0000 mgr.gibba043.dnkmem (mgr.34373) 254 : cluster [DBG] pgmap v129: 129 pgs: 1 stale+active+clean, 11 active+undersized+degraded, 9 peering, 19 active+undersized, 89 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:55:30.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:30 gibba003 bash[32348]: cluster 2021-03-10T13:55:29.260610+0000 mgr.gibba043.dnkmem (mgr.34373) 254 : cluster [DBG] pgmap v129: 129 pgs: 1 stale+active+clean, 11 active+undersized+degraded, 9 peering, 19 active+undersized, 89 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T13:55:31.218 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:30 gibba043 bash[26929]: debug 2021-03-10T13:55:30.811+0000 7fe4f6aaf080 -1 Falling back to public interface 2021-03-10T13:55:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cluster 2021-03-10T13:55:30.200810+0000 mon.a (mon.0) 345 : cluster [WRN] Health check failed: Degraded data redundancy: 14/195 objects degraded (7.179%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.021185+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.025619+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.030192+0000 mgr.gibba043.dnkmem (mgr.34373) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.030609+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.032364+0000 mgr.gibba043.dnkmem (mgr.34373) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.032464+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.034015+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.034042+0000 mgr.gibba043.dnkmem (mgr.34373) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.034102+0000 mgr.gibba043.dnkmem (mgr.34373) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.035289+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.035546+0000 mgr.gibba043.dnkmem (mgr.34373) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.035605+0000 mgr.gibba043.dnkmem (mgr.34373) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.036817+0000 mgr.gibba043.dnkmem (mgr.34373) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.038820+0000 mgr.gibba043.dnkmem (mgr.34373) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.038885+0000 mgr.gibba043.dnkmem (mgr.34373) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.039165+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: audit 2021-03-10T13:55:31.039974+0000 mgr.gibba043.dnkmem (mgr.34373) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:31 gibba043 bash[24019]: cephadm 2021-03-10T13:55:31.041208+0000 mgr.gibba043.dnkmem (mgr.34373) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2021-03-10T13:55:31.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cluster 2021-03-10T13:55:30.200810+0000 mon.a (mon.0) 345 : cluster [WRN] Health check failed: Degraded data redundancy: 14/195 objects degraded (7.179%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:31.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.021185+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:31.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.025619+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.030192+0000 mgr.gibba043.dnkmem (mgr.34373) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.030609+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.032364+0000 mgr.gibba043.dnkmem (mgr.34373) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.032464+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.034015+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.034042+0000 mgr.gibba043.dnkmem (mgr.34373) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.034102+0000 mgr.gibba043.dnkmem (mgr.34373) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.035289+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.035546+0000 mgr.gibba043.dnkmem (mgr.34373) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:31.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.035605+0000 mgr.gibba043.dnkmem (mgr.34373) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:31.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.036817+0000 mgr.gibba043.dnkmem (mgr.34373) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:31.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.038820+0000 mgr.gibba043.dnkmem (mgr.34373) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:31.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.038885+0000 mgr.gibba043.dnkmem (mgr.34373) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:31.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.039165+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:31.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: audit 2021-03-10T13:55:31.039974+0000 mgr.gibba043.dnkmem (mgr.34373) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:31.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[31385]: cephadm 2021-03-10T13:55:31.041208+0000 mgr.gibba043.dnkmem (mgr.34373) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2021-03-10T13:55:31.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cluster 2021-03-10T13:55:30.200810+0000 mon.a (mon.0) 345 : cluster [WRN] Health check failed: Degraded data redundancy: 14/195 objects degraded (7.179%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:31.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.021185+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:31.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.025619+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:31.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.030192+0000 mgr.gibba043.dnkmem (mgr.34373) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:31.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.030609+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:31.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.032364+0000 mgr.gibba043.dnkmem (mgr.34373) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:31.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.032464+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.034015+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.034042+0000 mgr.gibba043.dnkmem (mgr.34373) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:31.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.034102+0000 mgr.gibba043.dnkmem (mgr.34373) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:31.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.035289+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:31.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.035546+0000 mgr.gibba043.dnkmem (mgr.34373) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:31.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.035605+0000 mgr.gibba043.dnkmem (mgr.34373) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:31.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.036817+0000 mgr.gibba043.dnkmem (mgr.34373) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:31.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.038820+0000 mgr.gibba043.dnkmem (mgr.34373) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:31.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.038885+0000 mgr.gibba043.dnkmem (mgr.34373) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:31.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.039165+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:31.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: audit 2021-03-10T13:55:31.039974+0000 mgr.gibba043.dnkmem (mgr.34373) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:31.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:31 gibba003 bash[32348]: cephadm 2021-03-10T13:55:31.041208+0000 mgr.gibba043.dnkmem (mgr.34373) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2021-03-10T13:55:32.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:32 gibba003 bash[31385]: cluster 2021-03-10T13:55:31.262083+0000 mgr.gibba043.dnkmem (mgr.34373) 266 : cluster [DBG] pgmap v130: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:32.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:32 gibba003 bash[31385]: cluster 2021-03-10T13:55:32.216566+0000 mon.a (mon.0) 348 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2021-03-10T13:55:32.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:32 gibba003 bash[32348]: cluster 2021-03-10T13:55:31.262083+0000 mgr.gibba043.dnkmem (mgr.34373) 266 : cluster [DBG] pgmap v130: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:32.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:32 gibba003 bash[32348]: cluster 2021-03-10T13:55:32.216566+0000 mon.a (mon.0) 348 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2021-03-10T13:55:33.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:32 gibba043 bash[24019]: cluster 2021-03-10T13:55:31.262083+0000 mgr.gibba043.dnkmem (mgr.34373) 266 : cluster [DBG] pgmap v130: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:33.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:32 gibba043 bash[24019]: cluster 2021-03-10T13:55:32.216566+0000 mon.a (mon.0) 348 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2021-03-10T13:55:34.269 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:33 gibba043 bash[26929]: debug 2021-03-10T13:55:33.915+0000 7fe4f6aaf080 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:55:34.269 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:33 gibba043 bash[26929]: debug 2021-03-10T13:55:33.919+0000 7fe4e1d74700 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:55:34.270 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:34 gibba043 bash[26929]: debug 2021-03-10T13:55:34.043+0000 7fe4f6aaf080 -1 osd.5 90 log_to_monitors {default=true} 2021-03-10T13:55:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:34 gibba003 bash[31385]: cluster 2021-03-10T13:55:33.264088+0000 mgr.gibba043.dnkmem (mgr.34373) 267 : cluster [DBG] pgmap v131: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:34 gibba003 bash[31385]: audit 2021-03-10T13:55:34.050137+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:55:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:34 gibba003 bash[31385]: audit 2021-03-10T13:55:34.050529+0000 mon.a (mon.0) 349 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:55:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:34 gibba003 bash[32348]: cluster 2021-03-10T13:55:33.264088+0000 mgr.gibba043.dnkmem (mgr.34373) 267 : cluster [DBG] pgmap v131: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:34 gibba003 bash[32348]: audit 2021-03-10T13:55:34.050137+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:55:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:34 gibba003 bash[32348]: audit 2021-03-10T13:55:34.050529+0000 mon.a (mon.0) 349 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:55:35.019 INFO:journalctl@ceph.osd.5.gibba043.stdout:Mar 10 13:55:34 gibba043 bash[26929]: debug 2021-03-10T13:55:34.655+0000 7fe4e7f8f700 -1 osd.5 90 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:55:35.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:34 gibba043 bash[24019]: cluster 2021-03-10T13:55:33.264088+0000 mgr.gibba043.dnkmem (mgr.34373) 267 : cluster [DBG] pgmap v131: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:35.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:34 gibba043 bash[24019]: audit 2021-03-10T13:55:34.050137+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:55:35.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:34 gibba043 bash[24019]: audit 2021-03-10T13:55:34.050529+0000 mon.a (mon.0) 349 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:55:35.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[31385]: audit 2021-03-10T13:55:34.642293+0000 mon.a (mon.0) 350 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:55:35.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[31385]: cluster 2021-03-10T13:55:34.642329+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:55:35.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[31385]: audit 2021-03-10T13:55:34.648266+0000 mon.a (mon.0) 352 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:35.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[31385]: audit 2021-03-10T13:55:34.648516+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[32348]: audit 2021-03-10T13:55:34.642293+0000 mon.a (mon.0) 350 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:55:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[32348]: cluster 2021-03-10T13:55:34.642329+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:55:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[32348]: audit 2021-03-10T13:55:34.648266+0000 mon.a (mon.0) 352 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:35 gibba003 bash[32348]: audit 2021-03-10T13:55:34.648516+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:36.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:35 gibba043 bash[24019]: audit 2021-03-10T13:55:34.642293+0000 mon.a (mon.0) 350 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:55:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:35 gibba043 bash[24019]: cluster 2021-03-10T13:55:34.642329+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:55:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:35 gibba043 bash[24019]: audit 2021-03-10T13:55:34.648266+0000 mon.a (mon.0) 352 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:35 gibba043 bash[24019]: audit 2021-03-10T13:55:34.648516+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:55:36.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: cluster 2021-03-10T13:55:35.265563+0000 mgr.gibba043.dnkmem (mgr.34373) 268 : cluster [DBG] pgmap v133: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:36.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: cluster 2021-03-10T13:55:35.642378+0000 mon.a (mon.0) 353 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:36.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: cluster 2021-03-10T13:55:35.653601+0000 mon.a (mon.0) 354 : cluster [INF] osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381] boot 2021-03-10T13:55:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: cluster 2021-03-10T13:55:35.653639+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-03-10T13:55:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: audit 2021-03-10T13:55:35.654580+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:55:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: cluster 2021-03-10T13:55:36.616144+0000 mon.a (mon.0) 356 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[31385]: cluster 2021-03-10T13:55:36.650453+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-03-10T13:55:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: cluster 2021-03-10T13:55:35.265563+0000 mgr.gibba043.dnkmem (mgr.34373) 268 : cluster [DBG] pgmap v133: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: cluster 2021-03-10T13:55:35.642378+0000 mon.a (mon.0) 353 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: cluster 2021-03-10T13:55:35.653601+0000 mon.a (mon.0) 354 : cluster [INF] osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381] boot 2021-03-10T13:55:36.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: cluster 2021-03-10T13:55:35.653639+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-03-10T13:55:36.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: audit 2021-03-10T13:55:35.654580+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:55:36.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: cluster 2021-03-10T13:55:36.616144+0000 mon.a (mon.0) 356 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:36.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:36 gibba003 bash[32348]: cluster 2021-03-10T13:55:36.650453+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-03-10T13:55:37.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: cluster 2021-03-10T13:55:35.265563+0000 mgr.gibba043.dnkmem (mgr.34373) 268 : cluster [DBG] pgmap v133: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:37.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: cluster 2021-03-10T13:55:35.642378+0000 mon.a (mon.0) 353 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:37.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: cluster 2021-03-10T13:55:35.653601+0000 mon.a (mon.0) 354 : cluster [INF] osd.5 [v2:172.21.2.143:6808/2988112381,v1:172.21.2.143:6809/2988112381] boot 2021-03-10T13:55:37.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: cluster 2021-03-10T13:55:35.653639+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-03-10T13:55:37.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: audit 2021-03-10T13:55:35.654580+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:55:37.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: cluster 2021-03-10T13:55:36.616144+0000 mon.a (mon.0) 356 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:37.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:36 gibba043 bash[24019]: cluster 2021-03-10T13:55:36.650453+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-03-10T13:55:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:55:37.996 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:55:37.997 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (4m) 59s ago 9m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:55:37.997 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (9m) 6s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:55:37.997 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (4m) 6s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:55:37.997 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (4m) 6s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:55:37.998 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3m) 59s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:55:37.998 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3m) 59s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:55:37.998 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3m) 6s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:55:37.998 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3m) 59s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:55:37.998 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (9m) 59s ago 9m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:55:37.999 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (9m) 6s ago 9m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:55:37.999 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2m) 59s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:55:37.999 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (113s) 59s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:55:37.999 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (85s) 59s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:55:38.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (60s) 59s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:55:38.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (34s) 6s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:55:38.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (8s) 6s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:55:38.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (10m) 6s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cb28a4d085dd 2021-03-10T13:55:38.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (9m) 6s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:55:38.001 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (8m) 6s ago 9m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:55:38.001 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 59s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:55:38.246 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:55:38.246 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:55:38.246 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:38.247 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:55:38.247 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:55:38.247 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:38.247 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:55:38.247 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:55:38.248 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T13:55:38.248 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T13:55:38.248 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:55:38.248 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:55:38.249 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:55:38.249 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T13:55:38.249 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 12 2021-03-10T13:55:38.249 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:55:38.249 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:55:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[31385]: cluster 2021-03-10T13:55:37.266973+0000 mgr.gibba043.dnkmem (mgr.34373) 269 : cluster [DBG] pgmap v136: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[31385]: audit 2021-03-10T13:55:37.761767+0000 mgr.gibba043.dnkmem (mgr.34373) 270 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[31385]: audit 2021-03-10T13:55:37.985611+0000 mgr.gibba043.dnkmem (mgr.34373) 271 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[31385]: audit 2021-03-10T13:55:38.246245+0000 mon.a (mon.0) 358 : audit [DBG] from='client.? 172.21.2.103:0/2685799728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:38.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[32348]: cluster 2021-03-10T13:55:37.266973+0000 mgr.gibba043.dnkmem (mgr.34373) 269 : cluster [DBG] pgmap v136: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:38.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[32348]: audit 2021-03-10T13:55:37.761767+0000 mgr.gibba043.dnkmem (mgr.34373) 270 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:38.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[32348]: audit 2021-03-10T13:55:37.985611+0000 mgr.gibba043.dnkmem (mgr.34373) 271 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:38 gibba003 bash[32348]: audit 2021-03-10T13:55:38.246245+0000 mon.a (mon.0) 358 : audit [DBG] from='client.? 172.21.2.103:0/2685799728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:39.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:38 gibba043 bash[24019]: cluster 2021-03-10T13:55:37.266973+0000 mgr.gibba043.dnkmem (mgr.34373) 269 : cluster [DBG] pgmap v136: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T13:55:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:38 gibba043 bash[24019]: audit 2021-03-10T13:55:37.761767+0000 mgr.gibba043.dnkmem (mgr.34373) 270 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:38 gibba043 bash[24019]: audit 2021-03-10T13:55:37.985611+0000 mgr.gibba043.dnkmem (mgr.34373) 271 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:38 gibba043 bash[24019]: audit 2021-03-10T13:55:38.246245+0000 mon.a (mon.0) 358 : audit [DBG] from='client.? 172.21.2.103:0/2685799728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:40.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:40 gibba003 bash[31385]: cluster 2021-03-10T13:55:39.269246+0000 mgr.gibba043.dnkmem (mgr.34373) 272 : cluster [DBG] pgmap v137: 129 pgs: 11 active+undersized+degraded, 16 active+undersized, 102 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T13:55:40.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:40 gibba003 bash[32348]: cluster 2021-03-10T13:55:39.269246+0000 mgr.gibba043.dnkmem (mgr.34373) 272 : cluster [DBG] pgmap v137: 129 pgs: 11 active+undersized+degraded, 16 active+undersized, 102 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T13:55:41.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:40 gibba043 bash[24019]: cluster 2021-03-10T13:55:39.269246+0000 mgr.gibba043.dnkmem (mgr.34373) 272 : cluster [DBG] pgmap v137: 129 pgs: 11 active+undersized+degraded, 16 active+undersized, 102 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T13:55:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:41 gibba003 bash[31385]: cluster 2021-03-10T13:55:41.618609+0000 mon.a (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 15/195 objects degraded (7.692%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:41 gibba003 bash[32348]: cluster 2021-03-10T13:55:41.618609+0000 mon.a (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 15/195 objects degraded (7.692%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:41 gibba043 bash[24019]: cluster 2021-03-10T13:55:41.618609+0000 mon.a (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 15/195 objects degraded (7.692%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:42.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:42 gibba003 bash[31385]: cluster 2021-03-10T13:55:41.270981+0000 mgr.gibba043.dnkmem (mgr.34373) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:42.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:42 gibba003 bash[31385]: cluster 2021-03-10T13:55:41.673669+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/195 objects degraded (7.692%), 11 pgs degraded) 2021-03-10T13:55:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:42 gibba003 bash[32348]: cluster 2021-03-10T13:55:41.270981+0000 mgr.gibba043.dnkmem (mgr.34373) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:42.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:42 gibba003 bash[32348]: cluster 2021-03-10T13:55:41.673669+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/195 objects degraded (7.692%), 11 pgs degraded) 2021-03-10T13:55:43.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:42 gibba043 bash[24019]: cluster 2021-03-10T13:55:41.270981+0000 mgr.gibba043.dnkmem (mgr.34373) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:43.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:42 gibba043 bash[24019]: cluster 2021-03-10T13:55:41.673669+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/195 objects degraded (7.692%), 11 pgs degraded) 2021-03-10T13:55:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:43 gibba003 bash[31385]: audit 2021-03-10T13:55:42.790944+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:43 gibba003 bash[32348]: audit 2021-03-10T13:55:42.790944+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:43 gibba043 bash[24019]: audit 2021-03-10T13:55:42.790944+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:44 gibba003 bash[31385]: cluster 2021-03-10T13:55:43.272683+0000 mgr.gibba043.dnkmem (mgr.34373) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:44 gibba003 bash[32348]: cluster 2021-03-10T13:55:43.272683+0000 mgr.gibba043.dnkmem (mgr.34373) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:44 gibba043 bash[24019]: cluster 2021-03-10T13:55:43.272683+0000 mgr.gibba043.dnkmem (mgr.34373) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[31385]: cluster 2021-03-10T13:55:45.274296+0000 mgr.gibba043.dnkmem (mgr.34373) 275 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[31385]: audit 2021-03-10T13:55:46.057478+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[31385]: audit 2021-03-10T13:55:46.058954+0000 mgr.gibba043.dnkmem (mgr.34373) 276 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[31385]: cephadm 2021-03-10T13:55:46.063814+0000 mgr.gibba043.dnkmem (mgr.34373) 277 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:55:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[32348]: cluster 2021-03-10T13:55:45.274296+0000 mgr.gibba043.dnkmem (mgr.34373) 275 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[32348]: audit 2021-03-10T13:55:46.057478+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[32348]: audit 2021-03-10T13:55:46.058954+0000 mgr.gibba043.dnkmem (mgr.34373) 276 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:46 gibba003 bash[32348]: cephadm 2021-03-10T13:55:46.063814+0000 mgr.gibba043.dnkmem (mgr.34373) 277 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:55:47.236 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:46 gibba043 bash[24019]: cluster 2021-03-10T13:55:45.274296+0000 mgr.gibba043.dnkmem (mgr.34373) 275 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:47.236 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:46 gibba043 bash[24019]: audit 2021-03-10T13:55:46.057478+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:47.236 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:46 gibba043 bash[24019]: audit 2021-03-10T13:55:46.058954+0000 mgr.gibba043.dnkmem (mgr.34373) 276 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:55:47.237 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:46 gibba043 bash[24019]: cephadm 2021-03-10T13:55:46.063814+0000 mgr.gibba043.dnkmem (mgr.34373) 277 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:55:49.425 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:49 gibba043 bash[24019]: cluster 2021-03-10T13:55:47.274810+0000 mgr.gibba043.dnkmem (mgr.34373) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:49.426 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:49 gibba043 bash[24019]: cephadm 2021-03-10T13:55:48.038494+0000 mgr.gibba043.dnkmem (mgr.34373) 279 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:55:49.426 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:49 gibba043 bash[24019]: audit 2021-03-10T13:55:48.049476+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:49.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:49 gibba043 bash[24019]: audit 2021-03-10T13:55:48.051601+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:55:49.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:49 gibba043 bash[24019]: cephadm 2021-03-10T13:55:48.051681+0000 mgr.gibba043.dnkmem (mgr.34373) 280 : cephadm [INF] Deploying daemon osd.6 on gibba043 2021-03-10T13:55:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[31385]: cluster 2021-03-10T13:55:47.274810+0000 mgr.gibba043.dnkmem (mgr.34373) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[31385]: cephadm 2021-03-10T13:55:48.038494+0000 mgr.gibba043.dnkmem (mgr.34373) 279 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:55:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[31385]: audit 2021-03-10T13:55:48.049476+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[31385]: audit 2021-03-10T13:55:48.051601+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:55:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[31385]: cephadm 2021-03-10T13:55:48.051681+0000 mgr.gibba043.dnkmem (mgr.34373) 280 : cephadm [INF] Deploying daemon osd.6 on gibba043 2021-03-10T13:55:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[32348]: cluster 2021-03-10T13:55:47.274810+0000 mgr.gibba043.dnkmem (mgr.34373) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[32348]: cephadm 2021-03-10T13:55:48.038494+0000 mgr.gibba043.dnkmem (mgr.34373) 279 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:55:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[32348]: audit 2021-03-10T13:55:48.049476+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[32348]: audit 2021-03-10T13:55:48.051601+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:55:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:49 gibba003 bash[32348]: cephadm 2021-03-10T13:55:48.051681+0000 mgr.gibba043.dnkmem (mgr.34373) 280 : cephadm [INF] Deploying daemon osd.6 on gibba043 2021-03-10T13:55:50.269 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:50 gibba043 systemd[1]: Stopping Ceph osd.6 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:55:50.269 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:50 gibba043 bash[15153]: debug 2021-03-10T13:55:50.139+0000 7f92dc708700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:55:50.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:50 gibba043 bash[15153]: debug 2021-03-10T13:55:50.139+0000 7f92dc708700 -1 osd.6 95 *** Got signal Terminated *** 2021-03-10T13:55:50.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:50 gibba043 bash[15153]: debug 2021-03-10T13:55:50.139+0000 7f92dc708700 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:55:51.269 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:50 gibba043 docker[27829]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.6 2021-03-10T13:55:51.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:49.276678+0000 mgr.gibba043.dnkmem (mgr.34373) 281 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:51.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.272315+0000 mon.a (mon.0) 363 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.272409+0000 mon.a (mon.0) 364 : cluster [INF] osd.6 failed (root=default,host=gibba043) (connection refused reported by osd.7) 2021-03-10T13:55:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.460344+0000 mon.a (mon.0) 365 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.460574+0000 mon.a (mon.0) 366 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.461052+0000 mon.a (mon.0) 367 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.461246+0000 mon.a (mon.0) 368 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.463624+0000 mon.a (mon.0) 369 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.463995+0000 mon.a (mon.0) 370 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.464577+0000 mon.a (mon.0) 371 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.464879+0000 mon.a (mon.0) 372 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.465477+0000 mon.a (mon.0) 373 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.465669+0000 mon.a (mon.0) 374 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.466211+0000 mon.a (mon.0) 375 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.466499+0000 mon.a (mon.0) 376 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.467086+0000 mon.a (mon.0) 377 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.467375+0000 mon.a (mon.0) 378 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.472971+0000 mon.a (mon.0) 379 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.861359+0000 mon.a (mon.0) 380 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.861908+0000 mon.a (mon.0) 381 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.862271+0000 mon.a (mon.0) 382 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.862637+0000 mon.a (mon.0) 383 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.862978+0000 mon.a (mon.0) 384 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.863401+0000 mon.a (mon.0) 385 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.863712+0000 mon.a (mon.0) 386 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.864056+0000 mon.a (mon.0) 387 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.865198+0000 mon.a (mon.0) 388 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.865704+0000 mon.a (mon.0) 389 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.866146+0000 mon.a (mon.0) 390 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.866660+0000 mon.a (mon.0) 391 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.867123+0000 mon.a (mon.0) 392 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.867612+0000 mon.a (mon.0) 393 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:51 gibba043 bash[24019]: cluster 2021-03-10T13:55:50.873818+0000 mon.a (mon.0) 394 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:49.276678+0000 mgr.gibba043.dnkmem (mgr.34373) 281 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.272315+0000 mon.a (mon.0) 363 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.272409+0000 mon.a (mon.0) 364 : cluster [INF] osd.6 failed (root=default,host=gibba043) (connection refused reported by osd.7) 2021-03-10T13:55:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.460344+0000 mon.a (mon.0) 365 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.460574+0000 mon.a (mon.0) 366 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.461052+0000 mon.a (mon.0) 367 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.461246+0000 mon.a (mon.0) 368 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.463624+0000 mon.a (mon.0) 369 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.463995+0000 mon.a (mon.0) 370 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.464577+0000 mon.a (mon.0) 371 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.464879+0000 mon.a (mon.0) 372 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.465477+0000 mon.a (mon.0) 373 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.465669+0000 mon.a (mon.0) 374 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.466211+0000 mon.a (mon.0) 375 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.466499+0000 mon.a (mon.0) 376 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.467086+0000 mon.a (mon.0) 377 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.467375+0000 mon.a (mon.0) 378 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.472971+0000 mon.a (mon.0) 379 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.861359+0000 mon.a (mon.0) 380 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.861908+0000 mon.a (mon.0) 381 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.862271+0000 mon.a (mon.0) 382 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.862637+0000 mon.a (mon.0) 383 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.862978+0000 mon.a (mon.0) 384 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.863401+0000 mon.a (mon.0) 385 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.863712+0000 mon.a (mon.0) 386 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.864056+0000 mon.a (mon.0) 387 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.865198+0000 mon.a (mon.0) 388 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.865704+0000 mon.a (mon.0) 389 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.866146+0000 mon.a (mon.0) 390 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.866660+0000 mon.a (mon.0) 391 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.867123+0000 mon.a (mon.0) 392 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.867612+0000 mon.a (mon.0) 393 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[31385]: cluster 2021-03-10T13:55:50.873818+0000 mon.a (mon.0) 394 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:49.276678+0000 mgr.gibba043.dnkmem (mgr.34373) 281 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:51.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.272315+0000 mon.a (mon.0) 363 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.272409+0000 mon.a (mon.0) 364 : cluster [INF] osd.6 failed (root=default,host=gibba043) (connection refused reported by osd.7) 2021-03-10T13:55:51.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.460344+0000 mon.a (mon.0) 365 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.460574+0000 mon.a (mon.0) 366 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.461052+0000 mon.a (mon.0) 367 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.461246+0000 mon.a (mon.0) 368 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.463624+0000 mon.a (mon.0) 369 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.463995+0000 mon.a (mon.0) 370 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.464577+0000 mon.a (mon.0) 371 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.464879+0000 mon.a (mon.0) 372 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.465477+0000 mon.a (mon.0) 373 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.465669+0000 mon.a (mon.0) 374 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.466211+0000 mon.a (mon.0) 375 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.466499+0000 mon.a (mon.0) 376 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.467086+0000 mon.a (mon.0) 377 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.467375+0000 mon.a (mon.0) 378 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.472971+0000 mon.a (mon.0) 379 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.861359+0000 mon.a (mon.0) 380 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.861908+0000 mon.a (mon.0) 381 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:51.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.862271+0000 mon.a (mon.0) 382 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.862637+0000 mon.a (mon.0) 383 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.862978+0000 mon.a (mon.0) 384 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:55:51.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.863401+0000 mon.a (mon.0) 385 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:55:51.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.863712+0000 mon.a (mon.0) 386 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.864056+0000 mon.a (mon.0) 387 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:55:51.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.865198+0000 mon.a (mon.0) 388 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.865704+0000 mon.a (mon.0) 389 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.866146+0000 mon.a (mon.0) 390 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.866660+0000 mon.a (mon.0) 391 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:55:51.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.867123+0000 mon.a (mon.0) 392 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:55:51.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.867612+0000 mon.a (mon.0) 393 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:55:51.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:51 gibba003 bash[32348]: cluster 2021-03-10T13:55:50.873818+0000 mon.a (mon.0) 394 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:55:52.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:52 gibba043 bash[24019]: cluster 2021-03-10T13:55:51.052434+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:52.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:52 gibba043 bash[24019]: cluster 2021-03-10T13:55:51.063393+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e96: 8 total, 7 up, 8 in 2021-03-10T13:55:52.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:52 gibba003 bash[31385]: cluster 2021-03-10T13:55:51.052434+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:52.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:52 gibba003 bash[31385]: cluster 2021-03-10T13:55:51.063393+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e96: 8 total, 7 up, 8 in 2021-03-10T13:55:52.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:52 gibba003 bash[32348]: cluster 2021-03-10T13:55:51.052434+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:52.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:52 gibba003 bash[32348]: cluster 2021-03-10T13:55:51.063393+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e96: 8 total, 7 up, 8 in 2021-03-10T13:55:53.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:53 gibba043 bash[24019]: cluster 2021-03-10T13:55:51.277542+0000 mgr.gibba043.dnkmem (mgr.34373) 282 : cluster [DBG] pgmap v144: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:53.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:53 gibba043 bash[24019]: cluster 2021-03-10T13:55:52.067796+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2021-03-10T13:55:53.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:52 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.6.service: Succeeded. 2021-03-10T13:55:53.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:52 gibba043 systemd[1]: Stopped Ceph osd.6 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:53.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:53 gibba043 systemd[1]: Started Ceph osd.6 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:53 gibba003 bash[31385]: cluster 2021-03-10T13:55:51.277542+0000 mgr.gibba043.dnkmem (mgr.34373) 282 : cluster [DBG] pgmap v144: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:53 gibba003 bash[31385]: cluster 2021-03-10T13:55:52.067796+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2021-03-10T13:55:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:53 gibba003 bash[32348]: cluster 2021-03-10T13:55:51.277542+0000 mgr.gibba043.dnkmem (mgr.34373) 282 : cluster [DBG] pgmap v144: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:55:53.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:53 gibba003 bash[32348]: cluster 2021-03-10T13:55:52.067796+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2021-03-10T13:55:54.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[24019]: audit 2021-03-10T13:55:53.105568+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:54.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[24019]: audit 2021-03-10T13:55:53.107239+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:54.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[24019]: cephadm 2021-03-10T13:55:53.107377+0000 mgr.gibba043.dnkmem (mgr.34373) 283 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:55:54.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[24019]: cluster 2021-03-10T13:55:53.278280+0000 mgr.gibba043.dnkmem (mgr.34373) 284 : cluster [DBG] pgmap v146: 129 pgs: 6 stale+active+clean, 8 active+undersized+degraded, 17 active+clean+wait, 13 active+undersized, 85 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T13:55:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[31385]: audit 2021-03-10T13:55:53.105568+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[31385]: audit 2021-03-10T13:55:53.107239+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[31385]: cephadm 2021-03-10T13:55:53.107377+0000 mgr.gibba043.dnkmem (mgr.34373) 283 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:55:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[31385]: cluster 2021-03-10T13:55:53.278280+0000 mgr.gibba043.dnkmem (mgr.34373) 284 : cluster [DBG] pgmap v146: 129 pgs: 6 stale+active+clean, 8 active+undersized+degraded, 17 active+clean+wait, 13 active+undersized, 85 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T13:55:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[32348]: audit 2021-03-10T13:55:53.105568+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[32348]: audit 2021-03-10T13:55:53.107239+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[32348]: cephadm 2021-03-10T13:55:53.107377+0000 mgr.gibba043.dnkmem (mgr.34373) 283 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:55:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:54 gibba003 bash[32348]: cluster 2021-03-10T13:55:53.278280+0000 mgr.gibba043.dnkmem (mgr.34373) 284 : cluster [DBG] pgmap v146: 129 pgs: 6 stale+active+clean, 8 active+undersized+degraded, 17 active+clean+wait, 13 active+undersized, 85 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T13:55:54.769 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:55:54.770 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T13:55:54.770 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:55:54.770 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:55:54.770 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:55:54.771 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:55:54.771 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:54 gibba043 bash[28001]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T13:55:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:55 gibba003 bash[31385]: cluster 2021-03-10T13:55:54.100315+0000 mon.a (mon.0) 399 : cluster [WRN] Health check failed: Degraded data redundancy: 11/195 objects degraded (5.641%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:55 gibba003 bash[32348]: cluster 2021-03-10T13:55:54.100315+0000 mon.a (mon.0) 399 : cluster [WRN] Health check failed: Degraded data redundancy: 11/195 objects degraded (5.641%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:55 gibba043 bash[24019]: cluster 2021-03-10T13:55:54.100315+0000 mon.a (mon.0) 399 : cluster [WRN] Health check failed: Degraded data redundancy: 11/195 objects degraded (5.641%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:56.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:56 gibba043 bash[24019]: cluster 2021-03-10T13:55:55.280125+0000 mgr.gibba043.dnkmem (mgr.34373) 285 : cluster [DBG] pgmap v147: 129 pgs: 1 stale+active+clean, 14 active+undersized+degraded, 25 active+undersized, 89 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T13:55:56.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:56 gibba043 bash[28135]: debug 2021-03-10T13:55:56.007+0000 7f0dda19b700 1 -- 172.21.2.143:0/4199625852 <== mon.2 v2:172.21.2.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ef043984e0 con 0x55ef04415400 2021-03-10T13:55:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:56 gibba003 bash[31385]: cluster 2021-03-10T13:55:55.280125+0000 mgr.gibba043.dnkmem (mgr.34373) 285 : cluster [DBG] pgmap v147: 129 pgs: 1 stale+active+clean, 14 active+undersized+degraded, 25 active+undersized, 89 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T13:55:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:56 gibba003 bash[32348]: cluster 2021-03-10T13:55:55.280125+0000 mgr.gibba043.dnkmem (mgr.34373) 285 : cluster [DBG] pgmap v147: 129 pgs: 1 stale+active+clean, 14 active+undersized+degraded, 25 active+undersized, 89 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T13:55:57.019 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:56 gibba043 bash[28135]: debug 2021-03-10T13:55:56.567+0000 7f0de1c30080 -1 Falling back to public interface 2021-03-10T13:55:58.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:56.981788+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: cephadm 2021-03-10T13:55:56.983746+0000 mgr.gibba043.dnkmem (mgr.34373) 286 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:55:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:57.184451+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:57.188343+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:57.190014+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:57.191624+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:57.193111+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:57 gibba043 bash[24019]: audit 2021-03-10T13:55:57.196480+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:55:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:56.981788+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: cephadm 2021-03-10T13:55:56.983746+0000 mgr.gibba043.dnkmem (mgr.34373) 286 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:55:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:57.184451+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:57.188343+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:57.190014+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:57.191624+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:57.193111+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[31385]: audit 2021-03-10T13:55:57.196480+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:55:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:56.981788+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: cephadm 2021-03-10T13:55:56.983746+0000 mgr.gibba043.dnkmem (mgr.34373) 286 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:55:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:57.184451+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:55:58.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:57.188343+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:58.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:57.190014+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:57.191624+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:57.193111+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:58.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:57 gibba003 bash[32348]: audit 2021-03-10T13:55:57.196480+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:55:59.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.188285+0000 mgr.gibba043.dnkmem (mgr.34373) 287 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.190156+0000 mgr.gibba043.dnkmem (mgr.34373) 288 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.191594+0000 mgr.gibba043.dnkmem (mgr.34373) 289 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.191660+0000 mgr.gibba043.dnkmem (mgr.34373) 290 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.193232+0000 mgr.gibba043.dnkmem (mgr.34373) 291 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.193270+0000 mgr.gibba043.dnkmem (mgr.34373) 292 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.194646+0000 mgr.gibba043.dnkmem (mgr.34373) 293 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.196493+0000 mgr.gibba043.dnkmem (mgr.34373) 294 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.196528+0000 mgr.gibba043.dnkmem (mgr.34373) 295 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: audit 2021-03-10T13:55:57.197319+0000 mgr.gibba043.dnkmem (mgr.34373) 296 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:55:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cephadm 2021-03-10T13:55:57.198687+0000 mgr.gibba043.dnkmem (mgr.34373) 297 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:55:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:55:58 gibba043 bash[24019]: cluster 2021-03-10T13:55:57.281428+0000 mgr.gibba043.dnkmem (mgr.34373) 298 : cluster [DBG] pgmap v148: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:55:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.188285+0000 mgr.gibba043.dnkmem (mgr.34373) 287 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.190156+0000 mgr.gibba043.dnkmem (mgr.34373) 288 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.191594+0000 mgr.gibba043.dnkmem (mgr.34373) 289 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.191660+0000 mgr.gibba043.dnkmem (mgr.34373) 290 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.193232+0000 mgr.gibba043.dnkmem (mgr.34373) 291 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.193270+0000 mgr.gibba043.dnkmem (mgr.34373) 292 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.194646+0000 mgr.gibba043.dnkmem (mgr.34373) 293 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.196493+0000 mgr.gibba043.dnkmem (mgr.34373) 294 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.196528+0000 mgr.gibba043.dnkmem (mgr.34373) 295 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: audit 2021-03-10T13:55:57.197319+0000 mgr.gibba043.dnkmem (mgr.34373) 296 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:55:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cephadm 2021-03-10T13:55:57.198687+0000 mgr.gibba043.dnkmem (mgr.34373) 297 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:55:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[31385]: cluster 2021-03-10T13:55:57.281428+0000 mgr.gibba043.dnkmem (mgr.34373) 298 : cluster [DBG] pgmap v148: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:55:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.188285+0000 mgr.gibba043.dnkmem (mgr.34373) 287 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.190156+0000 mgr.gibba043.dnkmem (mgr.34373) 288 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.191594+0000 mgr.gibba043.dnkmem (mgr.34373) 289 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.191660+0000 mgr.gibba043.dnkmem (mgr.34373) 290 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.193232+0000 mgr.gibba043.dnkmem (mgr.34373) 291 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.193270+0000 mgr.gibba043.dnkmem (mgr.34373) 292 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.194646+0000 mgr.gibba043.dnkmem (mgr.34373) 293 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.196493+0000 mgr.gibba043.dnkmem (mgr.34373) 294 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.196528+0000 mgr.gibba043.dnkmem (mgr.34373) 295 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: audit 2021-03-10T13:55:57.197319+0000 mgr.gibba043.dnkmem (mgr.34373) 296 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:55:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cephadm 2021-03-10T13:55:57.198687+0000 mgr.gibba043.dnkmem (mgr.34373) 297 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:55:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:55:58 gibba003 bash[32348]: cluster 2021-03-10T13:55:57.281428+0000 mgr.gibba043.dnkmem (mgr.34373) 298 : cluster [DBG] pgmap v148: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:00.269 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:59 gibba043 bash[28135]: debug 2021-03-10T13:55:59.871+0000 7f0de1c30080 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:56:00.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:59 gibba043 bash[28135]: debug 2021-03-10T13:55:59.871+0000 7f0dcdef7700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:56:00.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:59 gibba043 bash[28135]: debug 2021-03-10T13:55:59.871+0000 7f0dcdef7700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #1:bc060cea:::INTEL_SSDPEL1K375GA_PHKM9200008A375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:56:00.270 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:55:59 gibba043 bash[28135]: debug 2021-03-10T13:55:59.995+0000 7f0de1c30080 -1 osd.6 95 log_to_monitors {default=true} 2021-03-10T13:56:01.269 INFO:journalctl@ceph.osd.6.gibba043.stdout:Mar 10 13:56:01 gibba043 bash[28135]: debug 2021-03-10T13:56:01.011+0000 7f0dd3911700 -1 osd.6 95 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:56:01.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:01 gibba043 bash[24019]: cluster 2021-03-10T13:55:59.283337+0000 mgr.gibba043.dnkmem (mgr.34373) 299 : cluster [DBG] pgmap v149: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:01.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:01 gibba043 bash[24019]: audit 2021-03-10T13:56:00.001332+0000 mon.c (mon.1) 125 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:56:01.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:01 gibba043 bash[24019]: audit 2021-03-10T13:56:00.001640+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:56:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:01 gibba003 bash[31385]: cluster 2021-03-10T13:55:59.283337+0000 mgr.gibba043.dnkmem (mgr.34373) 299 : cluster [DBG] pgmap v149: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:01 gibba003 bash[31385]: audit 2021-03-10T13:56:00.001332+0000 mon.c (mon.1) 125 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:56:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:01 gibba003 bash[31385]: audit 2021-03-10T13:56:00.001640+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:56:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:01 gibba003 bash[32348]: cluster 2021-03-10T13:55:59.283337+0000 mgr.gibba043.dnkmem (mgr.34373) 299 : cluster [DBG] pgmap v149: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:01 gibba003 bash[32348]: audit 2021-03-10T13:56:00.001332+0000 mon.c (mon.1) 125 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:56:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:01 gibba003 bash[32348]: audit 2021-03-10T13:56:00.001640+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:56:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:02 gibba043 bash[24019]: audit 2021-03-10T13:56:01.001560+0000 mon.a (mon.0) 403 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:56:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:02 gibba043 bash[24019]: cluster 2021-03-10T13:56:01.001624+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:56:02.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:02 gibba043 bash[24019]: audit 2021-03-10T13:56:01.003397+0000 mon.c (mon.1) 126 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:02.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:02 gibba043 bash[24019]: audit 2021-03-10T13:56:01.006401+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:02.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:02 gibba043 bash[24019]: cluster 2021-03-10T13:56:01.628408+0000 mon.a (mon.0) 406 : cluster [WRN] Health check update: Degraded data redundancy: 21/195 objects degraded (10.769%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[31385]: audit 2021-03-10T13:56:01.001560+0000 mon.a (mon.0) 403 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:56:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[31385]: cluster 2021-03-10T13:56:01.001624+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:56:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[31385]: audit 2021-03-10T13:56:01.003397+0000 mon.c (mon.1) 126 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[31385]: audit 2021-03-10T13:56:01.006401+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[31385]: cluster 2021-03-10T13:56:01.628408+0000 mon.a (mon.0) 406 : cluster [WRN] Health check update: Degraded data redundancy: 21/195 objects degraded (10.769%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[32348]: audit 2021-03-10T13:56:01.001560+0000 mon.a (mon.0) 403 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:56:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[32348]: cluster 2021-03-10T13:56:01.001624+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:56:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[32348]: audit 2021-03-10T13:56:01.003397+0000 mon.c (mon.1) 126 : audit [INF] from='osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[32348]: audit 2021-03-10T13:56:01.006401+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:02 gibba003 bash[32348]: cluster 2021-03-10T13:56:01.628408+0000 mon.a (mon.0) 406 : cluster [WRN] Health check update: Degraded data redundancy: 21/195 objects degraded (10.769%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:03.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:03 gibba043 bash[24019]: cluster 2021-03-10T13:56:01.284769+0000 mgr.gibba043.dnkmem (mgr.34373) 300 : cluster [DBG] pgmap v151: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:03.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:03 gibba043 bash[24019]: cluster 2021-03-10T13:56:02.007285+0000 mon.a (mon.0) 407 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:03.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:03 gibba043 bash[24019]: cluster 2021-03-10T13:56:02.018304+0000 mon.a (mon.0) 408 : cluster [INF] osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831] boot 2021-03-10T13:56:03.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:03 gibba043 bash[24019]: cluster 2021-03-10T13:56:02.018343+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-03-10T13:56:03.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:03 gibba043 bash[24019]: audit 2021-03-10T13:56:02.019084+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:56:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[31385]: cluster 2021-03-10T13:56:01.284769+0000 mgr.gibba043.dnkmem (mgr.34373) 300 : cluster [DBG] pgmap v151: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[31385]: cluster 2021-03-10T13:56:02.007285+0000 mon.a (mon.0) 407 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[31385]: cluster 2021-03-10T13:56:02.018304+0000 mon.a (mon.0) 408 : cluster [INF] osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831] boot 2021-03-10T13:56:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[31385]: cluster 2021-03-10T13:56:02.018343+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-03-10T13:56:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[31385]: audit 2021-03-10T13:56:02.019084+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:56:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[32348]: cluster 2021-03-10T13:56:01.284769+0000 mgr.gibba043.dnkmem (mgr.34373) 300 : cluster [DBG] pgmap v151: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T13:56:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[32348]: cluster 2021-03-10T13:56:02.007285+0000 mon.a (mon.0) 407 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[32348]: cluster 2021-03-10T13:56:02.018304+0000 mon.a (mon.0) 408 : cluster [INF] osd.6 [v2:172.21.2.143:6816/737142831,v1:172.21.2.143:6817/737142831] boot 2021-03-10T13:56:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[32348]: cluster 2021-03-10T13:56:02.018343+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-03-10T13:56:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:03 gibba003 bash[32348]: audit 2021-03-10T13:56:02.019084+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:56:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:04 gibba003 bash[31385]: cluster 2021-03-10T13:56:03.023117+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-03-10T13:56:04.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:04 gibba003 bash[32348]: cluster 2021-03-10T13:56:03.023117+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-03-10T13:56:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:04 gibba043 bash[24019]: cluster 2021-03-10T13:56:03.023117+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-03-10T13:56:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:05 gibba003 bash[31385]: cluster 2021-03-10T13:56:03.286047+0000 mgr.gibba043.dnkmem (mgr.34373) 301 : cluster [DBG] pgmap v154: 129 pgs: 6 peering, 11 active+undersized+degraded, 18 active+undersized, 94 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T13:56:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:05 gibba003 bash[32348]: cluster 2021-03-10T13:56:03.286047+0000 mgr.gibba043.dnkmem (mgr.34373) 301 : cluster [DBG] pgmap v154: 129 pgs: 6 peering, 11 active+undersized+degraded, 18 active+undersized, 94 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T13:56:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:05 gibba043 bash[24019]: cluster 2021-03-10T13:56:03.286047+0000 mgr.gibba043.dnkmem (mgr.34373) 301 : cluster [DBG] pgmap v154: 129 pgs: 6 peering, 11 active+undersized+degraded, 18 active+undersized, 94 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T13:56:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:07 gibba003 bash[31385]: cluster 2021-03-10T13:56:05.287516+0000 mgr.gibba043.dnkmem (mgr.34373) 302 : cluster [DBG] pgmap v155: 129 pgs: 6 peering, 6 active+undersized+degraded, 10 active+undersized, 107 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 9/195 objects degraded (4.615%) 2021-03-10T13:56:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:07 gibba003 bash[31385]: cluster 2021-03-10T13:56:06.631120+0000 mon.a (mon.0) 411 : cluster [WRN] Health check update: Degraded data redundancy: 9/195 objects degraded (4.615%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:07 gibba003 bash[32348]: cluster 2021-03-10T13:56:05.287516+0000 mgr.gibba043.dnkmem (mgr.34373) 302 : cluster [DBG] pgmap v155: 129 pgs: 6 peering, 6 active+undersized+degraded, 10 active+undersized, 107 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 9/195 objects degraded (4.615%) 2021-03-10T13:56:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:07 gibba003 bash[32348]: cluster 2021-03-10T13:56:06.631120+0000 mon.a (mon.0) 411 : cluster [WRN] Health check update: Degraded data redundancy: 9/195 objects degraded (4.615%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:07 gibba043 bash[24019]: cluster 2021-03-10T13:56:05.287516+0000 mgr.gibba043.dnkmem (mgr.34373) 302 : cluster [DBG] pgmap v155: 129 pgs: 6 peering, 6 active+undersized+degraded, 10 active+undersized, 107 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 9/195 objects degraded (4.615%) 2021-03-10T13:56:07.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:07 gibba043 bash[24019]: cluster 2021-03-10T13:56:06.631120+0000 mon.a (mon.0) 411 : cluster [WRN] Health check update: Degraded data redundancy: 9/195 objects degraded (4.615%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:08.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:08 gibba003 bash[32348]: cluster 2021-03-10T13:56:07.288638+0000 mgr.gibba043.dnkmem (mgr.34373) 303 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 6 peering, 110 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:08.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:08 gibba003 bash[32348]: cluster 2021-03-10T13:56:08.048014+0000 mon.a (mon.0) 412 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/195 objects degraded (4.615%), 6 pgs degraded) 2021-03-10T13:56:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:08 gibba003 bash[31385]: cluster 2021-03-10T13:56:07.288638+0000 mgr.gibba043.dnkmem (mgr.34373) 303 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 6 peering, 110 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:08 gibba003 bash[31385]: cluster 2021-03-10T13:56:08.048014+0000 mon.a (mon.0) 412 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/195 objects degraded (4.615%), 6 pgs degraded) 2021-03-10T13:56:08.490 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:56:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:08 gibba043 bash[24019]: cluster 2021-03-10T13:56:07.288638+0000 mgr.gibba043.dnkmem (mgr.34373) 303 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 6 peering, 110 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:08 gibba043 bash[24019]: cluster 2021-03-10T13:56:08.048014+0000 mon.a (mon.0) 412 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/195 objects degraded (4.615%), 6 pgs degraded) 2021-03-10T13:56:08.719 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:56:08.720 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (4m) 89s ago 9m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:56:08.720 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (9m) 11s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:56:08.720 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (4m) 11s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:56:08.721 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (5m) 11s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:56:08.721 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (4m) 89s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:56:08.721 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (4m) 89s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:56:08.721 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3m) 11s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:56:08.721 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3m) 89s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:56:08.722 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (9m) 89s ago 9m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:56:08.722 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (9m) 11s ago 9m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:56:08.722 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2m) 89s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:56:08.722 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2m) 89s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:56:08.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (116s) 89s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:56:08.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (91s) 89s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:56:08.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (65s) 11s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:56:08.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (39s) 11s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:56:08.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (13s) 11s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:56:08.724 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (10m) 11s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3c249f64edab 2021-03-10T13:56:08.724 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (9m) 11s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:56:08.724 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 89s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:56:08.967 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:56:08.968 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:56:08.968 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:08.968 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:56:08.968 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:56:08.969 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:08.969 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:56:08.969 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:56:08.969 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:56:08.969 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T13:56:08.970 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:56:08.970 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:56:08.970 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:56:08.970 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:56:08.971 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 13 2021-03-10T13:56:08.971 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:56:08.971 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:56:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:09 gibba003 bash[31385]: audit 2021-03-10T13:56:08.482175+0000 mgr.gibba043.dnkmem (mgr.34373) 304 : audit [DBG] from='client.44271 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:09 gibba003 bash[31385]: audit 2021-03-10T13:56:08.708367+0000 mgr.gibba043.dnkmem (mgr.34373) 305 : audit [DBG] from='client.54262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:09 gibba003 bash[31385]: audit 2021-03-10T13:56:08.967943+0000 mon.c (mon.1) 128 : audit [DBG] from='client.? 172.21.2.103:0/349588669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:09 gibba003 bash[32348]: audit 2021-03-10T13:56:08.482175+0000 mgr.gibba043.dnkmem (mgr.34373) 304 : audit [DBG] from='client.44271 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:09 gibba003 bash[32348]: audit 2021-03-10T13:56:08.708367+0000 mgr.gibba043.dnkmem (mgr.34373) 305 : audit [DBG] from='client.54262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:09 gibba003 bash[32348]: audit 2021-03-10T13:56:08.967943+0000 mon.c (mon.1) 128 : audit [DBG] from='client.? 172.21.2.103:0/349588669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:09 gibba043 bash[24019]: audit 2021-03-10T13:56:08.482175+0000 mgr.gibba043.dnkmem (mgr.34373) 304 : audit [DBG] from='client.44271 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:09 gibba043 bash[24019]: audit 2021-03-10T13:56:08.708367+0000 mgr.gibba043.dnkmem (mgr.34373) 305 : audit [DBG] from='client.54262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:09 gibba043 bash[24019]: audit 2021-03-10T13:56:08.967943+0000 mon.c (mon.1) 128 : audit [DBG] from='client.? 172.21.2.103:0/349588669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:10 gibba003 bash[31385]: cluster 2021-03-10T13:56:09.290240+0000 mgr.gibba043.dnkmem (mgr.34373) 306 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:10.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:10 gibba003 bash[32348]: cluster 2021-03-10T13:56:09.290240+0000 mgr.gibba043.dnkmem (mgr.34373) 306 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:10.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:10 gibba043 bash[24019]: cluster 2021-03-10T13:56:09.290240+0000 mgr.gibba043.dnkmem (mgr.34373) 306 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: cluster 2021-03-10T13:56:11.291587+0000 mgr.gibba043.dnkmem (mgr.34373) 307 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.214519+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:56:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.595917+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T13:56:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.597063+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T13:56:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.597307+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T13:56:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.598140+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.598391+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T13:56:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.599466+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.599722+0000 mon.c (mon.1) 133 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:12 gibba043 bash[24019]: audit 2021-03-10T13:56:12.600182+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: cluster 2021-03-10T13:56:11.291587+0000 mgr.gibba043.dnkmem (mgr.34373) 307 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.214519+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:56:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.595917+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T13:56:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.597063+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T13:56:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.597307+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T13:56:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.598140+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.598391+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T13:56:12.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.599466+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.599722+0000 mon.c (mon.1) 133 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[31385]: audit 2021-03-10T13:56:12.600182+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: cluster 2021-03-10T13:56:11.291587+0000 mgr.gibba043.dnkmem (mgr.34373) 307 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.214519+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:56:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.595917+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T13:56:12.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.597063+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T13:56:12.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.597307+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T13:56:12.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.598140+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.598391+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T13:56:12.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.599466+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.599722+0000 mon.c (mon.1) 133 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:56:12.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:12 gibba003 bash[32348]: audit 2021-03-10T13:56:12.600182+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:56:13.867 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:13 gibba043 bash[24019]: audit 2021-03-10T13:56:12.216231+0000 mgr.gibba043.dnkmem (mgr.34373) 308 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:56:13.867 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:13 gibba043 bash[24019]: cephadm 2021-03-10T13:56:12.221349+0000 mgr.gibba043.dnkmem (mgr.34373) 309 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:56:13.868 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:13 gibba043 bash[24019]: audit 2021-03-10T13:56:12.726103+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:13.868 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:13 gibba043 bash[24019]: audit 2021-03-10T13:56:12.727248+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:13.868 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:13 gibba043 bash[24019]: audit 2021-03-10T13:56:12.727248+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:13.868 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:13 gibba043 bash[24019]: audit 2021-03-10T13:56:12.728168+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[31385]: audit 2021-03-10T13:56:12.216231+0000 mgr.gibba043.dnkmem (mgr.34373) 308 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:56:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[31385]: cephadm 2021-03-10T13:56:12.221349+0000 mgr.gibba043.dnkmem (mgr.34373) 309 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:56:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[31385]: audit 2021-03-10T13:56:12.726103+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[31385]: audit 2021-03-10T13:56:12.727248+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[31385]: audit 2021-03-10T13:56:12.727248+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[31385]: audit 2021-03-10T13:56:12.728168+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[32348]: audit 2021-03-10T13:56:12.216231+0000 mgr.gibba043.dnkmem (mgr.34373) 308 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:56:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[32348]: cephadm 2021-03-10T13:56:12.221349+0000 mgr.gibba043.dnkmem (mgr.34373) 309 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:56:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[32348]: audit 2021-03-10T13:56:12.726103+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[32348]: audit 2021-03-10T13:56:12.727248+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[32348]: audit 2021-03-10T13:56:12.727248+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:13 gibba003 bash[32348]: audit 2021-03-10T13:56:12.728168+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:14 gibba043 bash[24019]: cluster 2021-03-10T13:56:13.292914+0000 mgr.gibba043.dnkmem (mgr.34373) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:14 gibba043 bash[24019]: audit 2021-03-10T13:56:14.339518+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:14 gibba043 bash[24019]: audit 2021-03-10T13:56:14.341606+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:14 gibba003 bash[31385]: cluster 2021-03-10T13:56:13.292914+0000 mgr.gibba043.dnkmem (mgr.34373) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:14 gibba003 bash[31385]: audit 2021-03-10T13:56:14.339518+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:14 gibba003 bash[31385]: audit 2021-03-10T13:56:14.341606+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:56:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:14 gibba003 bash[32348]: cluster 2021-03-10T13:56:13.292914+0000 mgr.gibba043.dnkmem (mgr.34373) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:14 gibba003 bash[32348]: audit 2021-03-10T13:56:14.339518+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:14 gibba003 bash[32348]: audit 2021-03-10T13:56:14.341606+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:56:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:15 gibba003 bash[31385]: cephadm 2021-03-10T13:56:14.329159+0000 mgr.gibba043.dnkmem (mgr.34373) 311 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:56:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:15 gibba003 bash[31385]: cephadm 2021-03-10T13:56:14.341933+0000 mgr.gibba043.dnkmem (mgr.34373) 312 : cephadm [INF] Deploying daemon osd.7 on gibba043 2021-03-10T13:56:15.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:15 gibba003 bash[32348]: cephadm 2021-03-10T13:56:14.329159+0000 mgr.gibba043.dnkmem (mgr.34373) 311 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:56:15.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:15 gibba003 bash[32348]: cephadm 2021-03-10T13:56:14.341933+0000 mgr.gibba043.dnkmem (mgr.34373) 312 : cephadm [INF] Deploying daemon osd.7 on gibba043 2021-03-10T13:56:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:15 gibba043 bash[24019]: cephadm 2021-03-10T13:56:14.329159+0000 mgr.gibba043.dnkmem (mgr.34373) 311 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:56:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:15 gibba043 bash[24019]: cephadm 2021-03-10T13:56:14.341933+0000 mgr.gibba043.dnkmem (mgr.34373) 312 : cephadm [INF] Deploying daemon osd.7 on gibba043 2021-03-10T13:56:16.454 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:16 gibba043 systemd[1]: Stopping Ceph osd.7 for 33572ad6-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:56:16.454 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[16691]: debug 2021-03-10T13:56:16.315+0000 7ff925d3f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:56:16.454 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[16691]: debug 2021-03-10T13:56:16.315+0000 7ff925d3f700 -1 osd.7 100 *** Got signal Terminated *** 2021-03-10T13:56:16.454 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[16691]: debug 2021-03-10T13:56:16.315+0000 7ff925d3f700 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:56:16.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:15.294304+0000 mgr.gibba043.dnkmem (mgr.34373) 313 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:16.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.635433+0000 mon.a (mon.0) 420 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.635583+0000 mon.a (mon.0) 421 : cluster [INF] osd.7 failed (root=default,host=gibba043) (connection refused reported by osd.2) 2021-03-10T13:56:16.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.636368+0000 mon.a (mon.0) 422 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.638825+0000 mon.a (mon.0) 423 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.639750+0000 mon.a (mon.0) 424 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:56:16.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.640657+0000 mon.a (mon.0) 425 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.640942+0000 mon.a (mon.0) 426 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.641534+0000 mon.a (mon.0) 427 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.641824+0000 mon.a (mon.0) 428 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:56:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.642391+0000 mon.a (mon.0) 429 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.647906+0000 mon.a (mon.0) 430 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.648105+0000 mon.a (mon.0) 431 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.648288+0000 mon.a (mon.0) 432 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:56:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.648339+0000 mon.a (mon.0) 433 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:56:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.649508+0000 mon.a (mon.0) 434 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:56:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.649565+0000 mon.a (mon.0) 435 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:56:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.658629+0000 mon.a (mon.0) 436 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.659369+0000 mon.a (mon.0) 437 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:16 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.661427+0000 mon.a (mon.0) 438 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:15.294304+0000 mgr.gibba043.dnkmem (mgr.34373) 313 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.635433+0000 mon.a (mon.0) 420 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.635583+0000 mon.a (mon.0) 421 : cluster [INF] osd.7 failed (root=default,host=gibba043) (connection refused reported by osd.2) 2021-03-10T13:56:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.636368+0000 mon.a (mon.0) 422 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.638825+0000 mon.a (mon.0) 423 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.639750+0000 mon.a (mon.0) 424 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:56:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.640657+0000 mon.a (mon.0) 425 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.640942+0000 mon.a (mon.0) 426 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.641534+0000 mon.a (mon.0) 427 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.641824+0000 mon.a (mon.0) 428 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:56:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.642391+0000 mon.a (mon.0) 429 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.647906+0000 mon.a (mon.0) 430 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.648105+0000 mon.a (mon.0) 431 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.648288+0000 mon.a (mon.0) 432 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:56:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.648339+0000 mon.a (mon.0) 433 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:56:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.649508+0000 mon.a (mon.0) 434 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:56:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.649565+0000 mon.a (mon.0) 435 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:56:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.658629+0000 mon.a (mon.0) 436 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.659369+0000 mon.a (mon.0) 437 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.661427+0000 mon.a (mon.0) 438 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:15.294304+0000 mgr.gibba043.dnkmem (mgr.34373) 313 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.635433+0000 mon.a (mon.0) 420 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.635583+0000 mon.a (mon.0) 421 : cluster [INF] osd.7 failed (root=default,host=gibba043) (connection refused reported by osd.2) 2021-03-10T13:56:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.636368+0000 mon.a (mon.0) 422 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.638825+0000 mon.a (mon.0) 423 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.639750+0000 mon.a (mon.0) 424 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:56:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.640657+0000 mon.a (mon.0) 425 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.640942+0000 mon.a (mon.0) 426 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.641534+0000 mon.a (mon.0) 427 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.641824+0000 mon.a (mon.0) 428 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:56:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.642391+0000 mon.a (mon.0) 429 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.647906+0000 mon.a (mon.0) 430 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.648105+0000 mon.a (mon.0) 431 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:56:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.648288+0000 mon.a (mon.0) 432 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:56:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.648339+0000 mon.a (mon.0) 433 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:56:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.649508+0000 mon.a (mon.0) 434 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:56:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.649565+0000 mon.a (mon.0) 435 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:56:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.658629+0000 mon.a (mon.0) 436 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:56:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.659369+0000 mon.a (mon.0) 437 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:56:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:16 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.661427+0000 mon.a (mon.0) 438 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:56:17.519 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:17 gibba043 docker[29047]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c-osd.7 2021-03-10T13:56:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:17 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.669445+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:17.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:17 gibba003 bash[31385]: cluster 2021-03-10T13:56:16.682010+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:56:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:17 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.669445+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:17 gibba003 bash[32348]: cluster 2021-03-10T13:56:16.682010+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:56:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:17 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.669445+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:17 gibba043 bash[24019]: cluster 2021-03-10T13:56:16.682010+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:56:18.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:18 gibba003 bash[31385]: cluster 2021-03-10T13:56:17.295216+0000 mgr.gibba043.dnkmem (mgr.34373) 314 : cluster [DBG] pgmap v162: 129 pgs: 17 stale+active+clean, 13 active+clean+wait, 99 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:18.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:18 gibba003 bash[31385]: cluster 2021-03-10T13:56:17.684721+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2021-03-10T13:56:18.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:18 gibba003 bash[31385]: audit 2021-03-10T13:56:17.807721+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:18.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:18 gibba003 bash[32348]: cluster 2021-03-10T13:56:17.295216+0000 mgr.gibba043.dnkmem (mgr.34373) 314 : cluster [DBG] pgmap v162: 129 pgs: 17 stale+active+clean, 13 active+clean+wait, 99 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:18.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:18 gibba003 bash[32348]: cluster 2021-03-10T13:56:17.684721+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2021-03-10T13:56:18.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:18 gibba003 bash[32348]: audit 2021-03-10T13:56:17.807721+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:18.969 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:18 gibba043 bash[24019]: cluster 2021-03-10T13:56:17.295216+0000 mgr.gibba043.dnkmem (mgr.34373) 314 : cluster [DBG] pgmap v162: 129 pgs: 17 stale+active+clean, 13 active+clean+wait, 99 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:56:18.970 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:18 gibba043 bash[24019]: cluster 2021-03-10T13:56:17.684721+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2021-03-10T13:56:18.970 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:18 gibba043 bash[24019]: audit 2021-03-10T13:56:17.807721+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:19.268 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:18 gibba043 systemd[1]: ceph-33572ad6-81a6-11eb-9080-001a4aab830c@osd.7.service: Succeeded. 2021-03-10T13:56:19.269 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:18 gibba043 systemd[1]: Stopped Ceph osd.7 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:19.269 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:19 gibba043 systemd[1]: Started Ceph osd.7 for 33572ad6-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:20.376 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[24019]: audit 2021-03-10T13:56:19.144836+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:20.377 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[24019]: audit 2021-03-10T13:56:19.146564+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:20.377 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[24019]: cluster 2021-03-10T13:56:19.295861+0000 mgr.gibba043.dnkmem (mgr.34373) 315 : cluster [DBG] pgmap v164: 129 pgs: 5 stale+active+clean, 20 active+undersized+degraded, 13 active+clean+wait, 15 active+undersized, 76 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:56:20.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:20 gibba003 bash[31385]: audit 2021-03-10T13:56:19.144836+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:20 gibba003 bash[31385]: audit 2021-03-10T13:56:19.146564+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:20 gibba003 bash[31385]: cluster 2021-03-10T13:56:19.295861+0000 mgr.gibba043.dnkmem (mgr.34373) 315 : cluster [DBG] pgmap v164: 129 pgs: 5 stale+active+clean, 20 active+undersized+degraded, 13 active+clean+wait, 15 active+undersized, 76 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:56:20.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:20 gibba003 bash[32348]: audit 2021-03-10T13:56:19.144836+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:20.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:20 gibba003 bash[32348]: audit 2021-03-10T13:56:19.146564+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:20.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:20 gibba003 bash[32348]: cluster 2021-03-10T13:56:19.295861+0000 mgr.gibba043.dnkmem (mgr.34373) 315 : cluster [DBG] pgmap v164: 129 pgs: 5 stale+active+clean, 20 active+undersized+degraded, 13 active+clean+wait, 15 active+undersized, 76 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T13:56:20.769 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:56:20.770 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T13:56:20.770 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:56:20.771 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:56:20.771 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:56:20.771 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:56:20.772 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:20 gibba043 bash[29220]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T13:56:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:21 gibba003 bash[31385]: cluster 2021-03-10T13:56:20.141233+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: Degraded data redundancy: 26/195 objects degraded (13.333%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:21 gibba003 bash[32348]: cluster 2021-03-10T13:56:20.141233+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: Degraded data redundancy: 26/195 objects degraded (13.333%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:21 gibba043 bash[24019]: cluster 2021-03-10T13:56:20.141233+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: Degraded data redundancy: 26/195 objects degraded (13.333%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:22.268 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:22 gibba043 bash[29353]: debug 2021-03-10T13:56:22.039+0000 7fa5c16a7700 1 -- 172.21.2.143:0/1457604287 <== mon.2 v2:172.21.2.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5593033d24e0 con 0x55930344f400 2021-03-10T13:56:22.647 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:22 gibba043 bash[29353]: debug 2021-03-10T13:56:22.387+0000 7fa5c913c080 -1 Falling back to public interface 2021-03-10T13:56:22.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:22 gibba003 bash[31385]: cluster 2021-03-10T13:56:21.297502+0000 mgr.gibba043.dnkmem (mgr.34373) 316 : cluster [DBG] pgmap v165: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:22.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:22 gibba003 bash[32348]: cluster 2021-03-10T13:56:21.297502+0000 mgr.gibba043.dnkmem (mgr.34373) 316 : cluster [DBG] pgmap v165: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:23.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:22 gibba043 bash[24019]: cluster 2021-03-10T13:56:21.297502+0000 mgr.gibba043.dnkmem (mgr.34373) 316 : cluster [DBG] pgmap v165: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.773890+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.778182+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.781928+0000 mgr.gibba043.dnkmem (mgr.34373) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:24.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.781981+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.783199+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.783643+0000 mgr.gibba043.dnkmem (mgr.34373) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.784419+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.784717+0000 mgr.gibba043.dnkmem (mgr.34373) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:24.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.784755+0000 mgr.gibba043.dnkmem (mgr.34373) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:24.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.785739+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.786213+0000 mgr.gibba043.dnkmem (mgr.34373) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:24.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.786254+0000 mgr.gibba043.dnkmem (mgr.34373) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:24.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.787326+0000 mgr.gibba043.dnkmem (mgr.34373) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:24.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.788597+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.788885+0000 mgr.gibba043.dnkmem (mgr.34373) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:24.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.788928+0000 mgr.gibba043.dnkmem (mgr.34373) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:24.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.790186+0000 mgr.gibba043.dnkmem (mgr.34373) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:56:24.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.793220+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.794892+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:56:24.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.795106+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:56:24.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.773890+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.778182+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.781928+0000 mgr.gibba043.dnkmem (mgr.34373) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:24.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.781981+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:24.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.783199+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.783643+0000 mgr.gibba043.dnkmem (mgr.34373) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:24.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.784419+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.784717+0000 mgr.gibba043.dnkmem (mgr.34373) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:24.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.784755+0000 mgr.gibba043.dnkmem (mgr.34373) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:24.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.785739+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.786213+0000 mgr.gibba043.dnkmem (mgr.34373) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:24.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.786254+0000 mgr.gibba043.dnkmem (mgr.34373) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:24.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.787326+0000 mgr.gibba043.dnkmem (mgr.34373) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:24.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.788597+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.788885+0000 mgr.gibba043.dnkmem (mgr.34373) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:24.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.788928+0000 mgr.gibba043.dnkmem (mgr.34373) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:24.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.790186+0000 mgr.gibba043.dnkmem (mgr.34373) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:56:24.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.793220+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.794892+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:56:24.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.795106+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:56:24.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.798382+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:56:24.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.800064+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:56:24.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.800375+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:56:24.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.803962+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:56:24.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.805686+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:56:24.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.806016+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:56:24.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.809598+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:56:24.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.811309+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:56:24.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.811608+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:56:24.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.815699+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:56:24.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.817659+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:56:24.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.818166+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:56:24.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.822814+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:56:24.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.825210+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:56:24.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.825805+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:56:24.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.832429+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:56:24.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.835565+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:56:24.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.798382+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:56:24.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.800064+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:56:24.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.800375+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:56:24.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.803962+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:56:24.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.805686+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:56:24.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.806016+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:56:24.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.809598+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:56:24.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.811309+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:56:24.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.811608+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:56:24.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.815699+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:56:24.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.817659+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:56:24.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.818166+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:56:24.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.822814+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:56:24.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.825210+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:56:24.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.825805+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:56:24.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.832429+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:56:24.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.835565+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:56:24.209 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.836246+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:56:24.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.845910+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:56:24.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.848645+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:56:24.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.848941+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:56:24.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.852501+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:56:24.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.855703+0000 mgr.gibba043.dnkmem (mgr.34373) 327 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:56:24.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.857784+0000 mon.c (mon.1) 151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:56:24.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: cephadm 2021-03-10T13:56:22.858019+0000 mgr.gibba043.dnkmem (mgr.34373) 328 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:56:24.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[31385]: audit 2021-03-10T13:56:22.858099+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:56:24.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.836246+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:56:24.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.845910+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:56:24.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.848645+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:56:24.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.848941+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:56:24.212 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.852501+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:56:24.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.855703+0000 mgr.gibba043.dnkmem (mgr.34373) 327 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:56:24.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.857784+0000 mon.c (mon.1) 151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:56:24.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: cephadm 2021-03-10T13:56:22.858019+0000 mgr.gibba043.dnkmem (mgr.34373) 328 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:56:24.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:23 gibba003 bash[32348]: audit 2021-03-10T13:56:22.858099+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:56:24.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.773890+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.778182+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.781928+0000 mgr.gibba043.dnkmem (mgr.34373) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.781981+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.783199+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.783643+0000 mgr.gibba043.dnkmem (mgr.34373) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.784419+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.784717+0000 mgr.gibba043.dnkmem (mgr.34373) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.784755+0000 mgr.gibba043.dnkmem (mgr.34373) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.785739+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.786213+0000 mgr.gibba043.dnkmem (mgr.34373) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.786254+0000 mgr.gibba043.dnkmem (mgr.34373) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.787326+0000 mgr.gibba043.dnkmem (mgr.34373) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.788597+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.788885+0000 mgr.gibba043.dnkmem (mgr.34373) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.788928+0000 mgr.gibba043.dnkmem (mgr.34373) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.790186+0000 mgr.gibba043.dnkmem (mgr.34373) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:56:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.793220+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.794892+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:56:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.795106+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:56:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.798382+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:56:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.800064+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:56:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.800375+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:56:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.803962+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:56:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.805686+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:56:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.806016+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:56:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.809598+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:56:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.811309+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:56:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.811608+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:56:24.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.815699+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:56:24.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.817659+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:56:24.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.818166+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:56:24.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.822814+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:56:24.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.825210+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:56:24.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.825805+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:56:24.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.832429+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:56:24.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.835565+0000 mon.c (mon.1) 149 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:56:24.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.836246+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:56:24.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.845910+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:56:24.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.848645+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:56:24.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.848941+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:56:24.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.852501+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:56:24.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.855703+0000 mgr.gibba043.dnkmem (mgr.34373) 327 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:56:24.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.857784+0000 mon.c (mon.1) 151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:56:24.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: cephadm 2021-03-10T13:56:22.858019+0000 mgr.gibba043.dnkmem (mgr.34373) 328 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:56:24.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:23 gibba043 bash[24019]: audit 2021-03-10T13:56:22.858099+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:56:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cluster 2021-03-10T13:56:23.299497+0000 mgr.gibba043.dnkmem (mgr.34373) 329 : cluster [DBG] pgmap v166: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: audit 2021-03-10T13:56:23.861907+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:56:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cluster 2021-03-10T13:56:23.861965+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2021-03-10T13:56:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: audit 2021-03-10T13:56:23.865916+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cephadm 2021-03-10T13:56:23.866530+0000 mgr.gibba043.dnkmem (mgr.34373) 330 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:56:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cephadm 2021-03-10T13:56:23.867234+0000 mgr.gibba043.dnkmem (mgr.34373) 331 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:56:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: audit 2021-03-10T13:56:23.869891+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cephadm 2021-03-10T13:56:23.871837+0000 mgr.gibba043.dnkmem (mgr.34373) 332 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:56:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cephadm 2021-03-10T13:56:23.871887+0000 mgr.gibba043.dnkmem (mgr.34373) 333 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:56:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[31385]: cephadm 2021-03-10T13:56:23.872018+0000 mgr.gibba043.dnkmem (mgr.34373) 334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cluster 2021-03-10T13:56:23.299497+0000 mgr.gibba043.dnkmem (mgr.34373) 329 : cluster [DBG] pgmap v166: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: audit 2021-03-10T13:56:23.861907+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:56:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cluster 2021-03-10T13:56:23.861965+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2021-03-10T13:56:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: audit 2021-03-10T13:56:23.865916+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cephadm 2021-03-10T13:56:23.866530+0000 mgr.gibba043.dnkmem (mgr.34373) 330 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:56:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cephadm 2021-03-10T13:56:23.867234+0000 mgr.gibba043.dnkmem (mgr.34373) 331 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:56:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: audit 2021-03-10T13:56:23.869891+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cephadm 2021-03-10T13:56:23.871837+0000 mgr.gibba043.dnkmem (mgr.34373) 332 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:56:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cephadm 2021-03-10T13:56:23.871887+0000 mgr.gibba043.dnkmem (mgr.34373) 333 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:56:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:24 gibba003 bash[32348]: cephadm 2021-03-10T13:56:23.872018+0000 mgr.gibba043.dnkmem (mgr.34373) 334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cluster 2021-03-10T13:56:23.299497+0000 mgr.gibba043.dnkmem (mgr.34373) 329 : cluster [DBG] pgmap v166: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: audit 2021-03-10T13:56:23.861907+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:56:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cluster 2021-03-10T13:56:23.861965+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2021-03-10T13:56:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: audit 2021-03-10T13:56:23.865916+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cephadm 2021-03-10T13:56:23.866530+0000 mgr.gibba043.dnkmem (mgr.34373) 330 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:56:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cephadm 2021-03-10T13:56:23.867234+0000 mgr.gibba043.dnkmem (mgr.34373) 331 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:56:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: audit 2021-03-10T13:56:23.869891+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cephadm 2021-03-10T13:56:23.871837+0000 mgr.gibba043.dnkmem (mgr.34373) 332 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:56:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cephadm 2021-03-10T13:56:23.871887+0000 mgr.gibba043.dnkmem (mgr.34373) 333 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:56:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:24 gibba043 bash[24019]: cephadm 2021-03-10T13:56:23.872018+0000 mgr.gibba043.dnkmem (mgr.34373) 334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[24019]: audit 2021-03-10T13:56:25.816863+0000 mon.b (mon.2) 7 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:56:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[24019]: audit 2021-03-10T13:56:25.817109+0000 mon.a (mon.0) 468 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:56:26.019 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[29353]: debug 2021-03-10T13:56:25.679+0000 7fa5c913c080 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:56:26.020 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[29353]: debug 2021-03-10T13:56:25.679+0000 7fa5b5c04700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:56:26.020 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[29353]: debug 2021-03-10T13:56:25.679+0000 7fa5b5c04700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #1:bc060cea:::INTEL_SSDPEL1K375GA_PHKM9200008A375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:56:26.020 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[29353]: debug 2021-03-10T13:56:25.807+0000 7fa5c913c080 -1 osd.7 100 log_to_monitors {default=true} 2021-03-10T13:56:26.020 INFO:journalctl@ceph.osd.7.gibba043.stdout:Mar 10 13:56:25 gibba043 bash[29353]: debug 2021-03-10T13:56:25.875+0000 7fa5bb61e700 -1 osd.7 100 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:56:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:25 gibba003 bash[31385]: audit 2021-03-10T13:56:25.816863+0000 mon.b (mon.2) 7 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:56:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:25 gibba003 bash[31385]: audit 2021-03-10T13:56:25.817109+0000 mon.a (mon.0) 468 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:56:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:25 gibba003 bash[32348]: audit 2021-03-10T13:56:25.816863+0000 mon.b (mon.2) 7 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:56:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:25 gibba003 bash[32348]: audit 2021-03-10T13:56:25.817109+0000 mon.a (mon.0) 468 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:56:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[31385]: cluster 2021-03-10T13:56:25.300092+0000 mgr.gibba043.dnkmem (mgr.34373) 335 : cluster [DBG] pgmap v168: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[31385]: audit 2021-03-10T13:56:25.872369+0000 mon.a (mon.0) 469 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:56:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[31385]: cluster 2021-03-10T13:56:25.872410+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2021-03-10T13:56:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[31385]: audit 2021-03-10T13:56:25.874592+0000 mon.a (mon.0) 471 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[31385]: audit 2021-03-10T13:56:25.875079+0000 mon.b (mon.2) 8 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[31385]: cluster 2021-03-10T13:56:26.641278+0000 mon.a (mon.0) 472 : cluster [WRN] Health check update: Degraded data redundancy: 34/195 objects degraded (17.436%), 28 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:27.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[32348]: cluster 2021-03-10T13:56:25.300092+0000 mgr.gibba043.dnkmem (mgr.34373) 335 : cluster [DBG] pgmap v168: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[32348]: audit 2021-03-10T13:56:25.872369+0000 mon.a (mon.0) 469 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:56:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[32348]: cluster 2021-03-10T13:56:25.872410+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2021-03-10T13:56:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[32348]: audit 2021-03-10T13:56:25.874592+0000 mon.a (mon.0) 471 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[32348]: audit 2021-03-10T13:56:25.875079+0000 mon.b (mon.2) 8 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:26 gibba003 bash[32348]: cluster 2021-03-10T13:56:26.641278+0000 mon.a (mon.0) 472 : cluster [WRN] Health check update: Degraded data redundancy: 34/195 objects degraded (17.436%), 28 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:26 gibba043 bash[24019]: cluster 2021-03-10T13:56:25.300092+0000 mgr.gibba043.dnkmem (mgr.34373) 335 : cluster [DBG] pgmap v168: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:26 gibba043 bash[24019]: audit 2021-03-10T13:56:25.872369+0000 mon.a (mon.0) 469 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:56:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:26 gibba043 bash[24019]: cluster 2021-03-10T13:56:25.872410+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2021-03-10T13:56:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:26 gibba043 bash[24019]: audit 2021-03-10T13:56:25.874592+0000 mon.a (mon.0) 471 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:26 gibba043 bash[24019]: audit 2021-03-10T13:56:25.875079+0000 mon.b (mon.2) 8 : audit [INF] from='osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba043", "root=default"]}]: dispatch 2021-03-10T13:56:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:26 gibba043 bash[24019]: cluster 2021-03-10T13:56:26.641278+0000 mon.a (mon.0) 472 : cluster [WRN] Health check update: Degraded data redundancy: 34/195 objects degraded (17.436%), 28 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[31385]: cluster 2021-03-10T13:56:26.872141+0000 mon.a (mon.0) 473 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[31385]: cluster 2021-03-10T13:56:26.882393+0000 mon.a (mon.0) 474 : cluster [INF] osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381] boot 2021-03-10T13:56:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[31385]: cluster 2021-03-10T13:56:26.882429+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-03-10T13:56:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[31385]: audit 2021-03-10T13:56:26.883417+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:56:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[32348]: cluster 2021-03-10T13:56:26.872141+0000 mon.a (mon.0) 473 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[32348]: cluster 2021-03-10T13:56:26.882393+0000 mon.a (mon.0) 474 : cluster [INF] osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381] boot 2021-03-10T13:56:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[32348]: cluster 2021-03-10T13:56:26.882429+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-03-10T13:56:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:27 gibba003 bash[32348]: audit 2021-03-10T13:56:26.883417+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:56:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:27 gibba043 bash[24019]: cluster 2021-03-10T13:56:26.872141+0000 mon.a (mon.0) 473 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:27 gibba043 bash[24019]: cluster 2021-03-10T13:56:26.882393+0000 mon.a (mon.0) 474 : cluster [INF] osd.7 [v2:172.21.2.143:6824/3007091381,v1:172.21.2.143:6825/3007091381] boot 2021-03-10T13:56:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:27 gibba043 bash[24019]: cluster 2021-03-10T13:56:26.882429+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-03-10T13:56:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:27 gibba043 bash[24019]: audit 2021-03-10T13:56:26.883417+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:56:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:28 gibba003 bash[31385]: cluster 2021-03-10T13:56:27.301514+0000 mgr.gibba043.dnkmem (mgr.34373) 336 : cluster [DBG] pgmap v171: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:28 gibba003 bash[31385]: cluster 2021-03-10T13:56:27.887223+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-03-10T13:56:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:28 gibba003 bash[32348]: cluster 2021-03-10T13:56:27.301514+0000 mgr.gibba043.dnkmem (mgr.34373) 336 : cluster [DBG] pgmap v171: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:28 gibba003 bash[32348]: cluster 2021-03-10T13:56:27.887223+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-03-10T13:56:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:28 gibba043 bash[24019]: cluster 2021-03-10T13:56:27.301514+0000 mgr.gibba043.dnkmem (mgr.34373) 336 : cluster [DBG] pgmap v171: 129 pgs: 28 active+undersized+degraded, 29 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 34/195 objects degraded (17.436%) 2021-03-10T13:56:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:28 gibba043 bash[24019]: cluster 2021-03-10T13:56:27.887223+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-03-10T13:56:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:30 gibba003 bash[31385]: cluster 2021-03-10T13:56:29.303241+0000 mgr.gibba043.dnkmem (mgr.34373) 337 : cluster [DBG] pgmap v173: 129 pgs: 3 peering, 17 active+undersized+degraded, 17 active+undersized, 92 active+clean; 7.0 KiB data, 57 MiB used, 672 GiB / 672 GiB avail; 19/195 objects degraded (9.744%) 2021-03-10T13:56:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:30 gibba003 bash[32348]: cluster 2021-03-10T13:56:29.303241+0000 mgr.gibba043.dnkmem (mgr.34373) 337 : cluster [DBG] pgmap v173: 129 pgs: 3 peering, 17 active+undersized+degraded, 17 active+undersized, 92 active+clean; 7.0 KiB data, 57 MiB used, 672 GiB / 672 GiB avail; 19/195 objects degraded (9.744%) 2021-03-10T13:56:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:30 gibba043 bash[24019]: cluster 2021-03-10T13:56:29.303241+0000 mgr.gibba043.dnkmem (mgr.34373) 337 : cluster [DBG] pgmap v173: 129 pgs: 3 peering, 17 active+undersized+degraded, 17 active+undersized, 92 active+clean; 7.0 KiB data, 57 MiB used, 672 GiB / 672 GiB avail; 19/195 objects degraded (9.744%) 2021-03-10T13:56:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:31 gibba003 bash[31385]: cluster 2021-03-10T13:56:31.643762+0000 mon.a (mon.0) 477 : cluster [WRN] Health check update: Degraded data redundancy: 19/195 objects degraded (9.744%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:31 gibba003 bash[32348]: cluster 2021-03-10T13:56:31.643762+0000 mon.a (mon.0) 477 : cluster [WRN] Health check update: Degraded data redundancy: 19/195 objects degraded (9.744%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:32.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:31 gibba043 bash[24019]: cluster 2021-03-10T13:56:31.643762+0000 mon.a (mon.0) 477 : cluster [WRN] Health check update: Degraded data redundancy: 19/195 objects degraded (9.744%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:32 gibba003 bash[31385]: cluster 2021-03-10T13:56:31.304980+0000 mgr.gibba043.dnkmem (mgr.34373) 338 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 3 peering, 109 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:32 gibba003 bash[31385]: cluster 2021-03-10T13:56:31.903266+0000 mon.a (mon.0) 478 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/195 objects degraded (9.744%), 17 pgs degraded) 2021-03-10T13:56:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:32 gibba003 bash[32348]: cluster 2021-03-10T13:56:31.304980+0000 mgr.gibba043.dnkmem (mgr.34373) 338 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 3 peering, 109 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:32 gibba003 bash[32348]: cluster 2021-03-10T13:56:31.903266+0000 mon.a (mon.0) 478 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/195 objects degraded (9.744%), 17 pgs degraded) 2021-03-10T13:56:33.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:32 gibba043 bash[24019]: cluster 2021-03-10T13:56:31.304980+0000 mgr.gibba043.dnkmem (mgr.34373) 338 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 3 peering, 109 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:33.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:32 gibba043 bash[24019]: cluster 2021-03-10T13:56:31.903266+0000 mon.a (mon.0) 478 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/195 objects degraded (9.744%), 17 pgs degraded) 2021-03-10T13:56:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:34 gibba003 bash[31385]: cluster 2021-03-10T13:56:33.306447+0000 mgr.gibba043.dnkmem (mgr.34373) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:35.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:34 gibba003 bash[32348]: cluster 2021-03-10T13:56:33.306447+0000 mgr.gibba043.dnkmem (mgr.34373) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:35.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:34 gibba043 bash[24019]: cluster 2021-03-10T13:56:33.306447+0000 mgr.gibba043.dnkmem (mgr.34373) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:36 gibba003 bash[31385]: cluster 2021-03-10T13:56:35.307930+0000 mgr.gibba043.dnkmem (mgr.34373) 340 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:36 gibba003 bash[32348]: cluster 2021-03-10T13:56:35.307930+0000 mgr.gibba043.dnkmem (mgr.34373) 340 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:37.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:36 gibba043 bash[24019]: cluster 2021-03-10T13:56:35.307930+0000 mgr.gibba043.dnkmem (mgr.34373) 340 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:38 gibba003 bash[31385]: cluster 2021-03-10T13:56:37.309325+0000 mgr.gibba043.dnkmem (mgr.34373) 341 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:38 gibba003 bash[31385]: audit 2021-03-10T13:56:37.824640+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:38 gibba003 bash[32348]: cluster 2021-03-10T13:56:37.309325+0000 mgr.gibba043.dnkmem (mgr.34373) 341 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:38 gibba003 bash[32348]: audit 2021-03-10T13:56:37.824640+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:39.213 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:56:39.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:38 gibba043 bash[24019]: cluster 2021-03-10T13:56:37.309325+0000 mgr.gibba043.dnkmem (mgr.34373) 341 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:38 gibba043 bash[24019]: audit 2021-03-10T13:56:37.824640+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:56:39.443 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:56:39.443 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (5m) 2m ago 10m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:56:39.444 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (10m) 16s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:56:39.444 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (5m) 16s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:56:39.444 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (5m) 16s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:56:39.444 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (4m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:56:39.445 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (4m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:56:39.445 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (4m) 16s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:56:39.445 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:56:39.445 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (10m) 2m ago 10m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:56:39.445 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (10m) 16s ago 10m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:56:39.446 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:56:39.446 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:56:39.446 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:56:39.446 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:56:39.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (96s) 16s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:56:39.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (70s) 16s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:56:39.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (44s) 16s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:56:39.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (18s) 16s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:56:39.447 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (9m) 16s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:56:39.448 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:56:39.699 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:56:39.699 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:56:39.699 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:39.700 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:56:39.700 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:56:39.700 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:39.700 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:56:39.701 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:56:39.701 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:56:39.701 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:56:39.701 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:56:39.701 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:56:39.702 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:56:39.702 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:56:39.702 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:56:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:39 gibba003 bash[31385]: cephadm 2021-03-10T13:56:38.887641+0000 mgr.gibba043.dnkmem (mgr.34373) 342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:39 gibba003 bash[31385]: audit 2021-03-10T13:56:39.699656+0000 mon.a (mon.0) 480 : audit [DBG] from='client.? 172.21.2.103:0/1506025469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:40.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:39 gibba003 bash[32348]: cephadm 2021-03-10T13:56:38.887641+0000 mgr.gibba043.dnkmem (mgr.34373) 342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:40.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:39 gibba003 bash[32348]: audit 2021-03-10T13:56:39.699656+0000 mon.a (mon.0) 480 : audit [DBG] from='client.? 172.21.2.103:0/1506025469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:40.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:39 gibba043 bash[24019]: cephadm 2021-03-10T13:56:38.887641+0000 mgr.gibba043.dnkmem (mgr.34373) 342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:40.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:39 gibba043 bash[24019]: audit 2021-03-10T13:56:39.699656+0000 mon.a (mon.0) 480 : audit [DBG] from='client.? 172.21.2.103:0/1506025469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:40 gibba003 bash[31385]: audit 2021-03-10T13:56:39.205875+0000 mgr.gibba043.dnkmem (mgr.34373) 343 : audit [DBG] from='client.44289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:40 gibba003 bash[31385]: cluster 2021-03-10T13:56:39.310812+0000 mgr.gibba043.dnkmem (mgr.34373) 344 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:40 gibba003 bash[31385]: audit 2021-03-10T13:56:39.432904+0000 mgr.gibba043.dnkmem (mgr.34373) 345 : audit [DBG] from='client.54280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:40 gibba003 bash[32348]: audit 2021-03-10T13:56:39.205875+0000 mgr.gibba043.dnkmem (mgr.34373) 343 : audit [DBG] from='client.44289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:40 gibba003 bash[32348]: cluster 2021-03-10T13:56:39.310812+0000 mgr.gibba043.dnkmem (mgr.34373) 344 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:40 gibba003 bash[32348]: audit 2021-03-10T13:56:39.432904+0000 mgr.gibba043.dnkmem (mgr.34373) 345 : audit [DBG] from='client.54280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:40 gibba043 bash[24019]: audit 2021-03-10T13:56:39.205875+0000 mgr.gibba043.dnkmem (mgr.34373) 343 : audit [DBG] from='client.44289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:40 gibba043 bash[24019]: cluster 2021-03-10T13:56:39.310812+0000 mgr.gibba043.dnkmem (mgr.34373) 344 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:40 gibba043 bash[24019]: audit 2021-03-10T13:56:39.432904+0000 mgr.gibba043.dnkmem (mgr.34373) 345 : audit [DBG] from='client.54280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:42 gibba003 bash[31385]: cluster 2021-03-10T13:56:41.312511+0000 mgr.gibba043.dnkmem (mgr.34373) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:43.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:42 gibba003 bash[32348]: cluster 2021-03-10T13:56:41.312511+0000 mgr.gibba043.dnkmem (mgr.34373) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:43.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:42 gibba043 bash[24019]: cluster 2021-03-10T13:56:41.312511+0000 mgr.gibba043.dnkmem (mgr.34373) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:44 gibba003 bash[31385]: cluster 2021-03-10T13:56:43.313878+0000 mgr.gibba043.dnkmem (mgr.34373) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:44 gibba003 bash[32348]: cluster 2021-03-10T13:56:43.313878+0000 mgr.gibba043.dnkmem (mgr.34373) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:44 gibba043 bash[24019]: cluster 2021-03-10T13:56:43.313878+0000 mgr.gibba043.dnkmem (mgr.34373) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:46 gibba003 bash[31385]: cluster 2021-03-10T13:56:45.315345+0000 mgr.gibba043.dnkmem (mgr.34373) 348 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:47.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:46 gibba003 bash[32348]: cluster 2021-03-10T13:56:45.315345+0000 mgr.gibba043.dnkmem (mgr.34373) 348 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:47.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:46 gibba043 bash[24019]: cluster 2021-03-10T13:56:45.315345+0000 mgr.gibba043.dnkmem (mgr.34373) 348 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:48 gibba003 bash[31385]: cluster 2021-03-10T13:56:47.317097+0000 mgr.gibba043.dnkmem (mgr.34373) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:48 gibba003 bash[32348]: cluster 2021-03-10T13:56:47.317097+0000 mgr.gibba043.dnkmem (mgr.34373) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:48 gibba043 bash[24019]: cluster 2021-03-10T13:56:47.317097+0000 mgr.gibba043.dnkmem (mgr.34373) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:50 gibba003 bash[31385]: cluster 2021-03-10T13:56:49.318754+0000 mgr.gibba043.dnkmem (mgr.34373) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:50 gibba003 bash[32348]: cluster 2021-03-10T13:56:49.318754+0000 mgr.gibba043.dnkmem (mgr.34373) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:51.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:50 gibba043 bash[24019]: cluster 2021-03-10T13:56:49.318754+0000 mgr.gibba043.dnkmem (mgr.34373) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:52 gibba003 bash[31385]: cluster 2021-03-10T13:56:51.320301+0000 mgr.gibba043.dnkmem (mgr.34373) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:52 gibba003 bash[32348]: cluster 2021-03-10T13:56:51.320301+0000 mgr.gibba043.dnkmem (mgr.34373) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:52 gibba043 bash[24019]: cluster 2021-03-10T13:56:51.320301+0000 mgr.gibba043.dnkmem (mgr.34373) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:54 gibba003 bash[31385]: cluster 2021-03-10T13:56:53.321698+0000 mgr.gibba043.dnkmem (mgr.34373) 352 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:55.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:54 gibba003 bash[31385]: cephadm 2021-03-10T13:56:53.900459+0000 mgr.gibba043.dnkmem (mgr.34373) 353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:54 gibba003 bash[32348]: cluster 2021-03-10T13:56:53.321698+0000 mgr.gibba043.dnkmem (mgr.34373) 352 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:55.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:54 gibba003 bash[32348]: cephadm 2021-03-10T13:56:53.900459+0000 mgr.gibba043.dnkmem (mgr.34373) 353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:55.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:54 gibba043 bash[24019]: cluster 2021-03-10T13:56:53.321698+0000 mgr.gibba043.dnkmem (mgr.34373) 352 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:55.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:54 gibba043 bash[24019]: cephadm 2021-03-10T13:56:53.900459+0000 mgr.gibba043.dnkmem (mgr.34373) 353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:56:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:56 gibba003 bash[31385]: cluster 2021-03-10T13:56:55.322942+0000 mgr.gibba043.dnkmem (mgr.34373) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:56 gibba003 bash[32348]: cluster 2021-03-10T13:56:55.322942+0000 mgr.gibba043.dnkmem (mgr.34373) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:57.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:56 gibba043 bash[24019]: cluster 2021-03-10T13:56:55.322942+0000 mgr.gibba043.dnkmem (mgr.34373) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:56:58 gibba003 bash[31385]: cluster 2021-03-10T13:56:57.324336+0000 mgr.gibba043.dnkmem (mgr.34373) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:56:58 gibba003 bash[32348]: cluster 2021-03-10T13:56:57.324336+0000 mgr.gibba043.dnkmem (mgr.34373) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:56:58 gibba043 bash[24019]: cluster 2021-03-10T13:56:57.324336+0000 mgr.gibba043.dnkmem (mgr.34373) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:00 gibba003 bash[31385]: cluster 2021-03-10T13:56:59.325860+0000 mgr.gibba043.dnkmem (mgr.34373) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:00 gibba003 bash[32348]: cluster 2021-03-10T13:56:59.325860+0000 mgr.gibba043.dnkmem (mgr.34373) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:01.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:00 gibba043 bash[24019]: cluster 2021-03-10T13:56:59.325860+0000 mgr.gibba043.dnkmem (mgr.34373) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:03.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:02 gibba003 bash[31385]: cluster 2021-03-10T13:57:01.327545+0000 mgr.gibba043.dnkmem (mgr.34373) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:02 gibba003 bash[32348]: cluster 2021-03-10T13:57:01.327545+0000 mgr.gibba043.dnkmem (mgr.34373) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:03.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:02 gibba043 bash[24019]: cluster 2021-03-10T13:57:01.327545+0000 mgr.gibba043.dnkmem (mgr.34373) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:05.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:04 gibba043 bash[24019]: cluster 2021-03-10T13:57:03.328914+0000 mgr.gibba043.dnkmem (mgr.34373) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:04 gibba003 bash[31385]: cluster 2021-03-10T13:57:03.328914+0000 mgr.gibba043.dnkmem (mgr.34373) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:04 gibba003 bash[32348]: cluster 2021-03-10T13:57:03.328914+0000 mgr.gibba043.dnkmem (mgr.34373) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:07.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:06 gibba043 bash[24019]: cluster 2021-03-10T13:57:05.330313+0000 mgr.gibba043.dnkmem (mgr.34373) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:06 gibba003 bash[31385]: cluster 2021-03-10T13:57:05.330313+0000 mgr.gibba043.dnkmem (mgr.34373) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:06 gibba003 bash[32348]: cluster 2021-03-10T13:57:05.330313+0000 mgr.gibba043.dnkmem (mgr.34373) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:08 gibba043 bash[24019]: cluster 2021-03-10T13:57:07.331970+0000 mgr.gibba043.dnkmem (mgr.34373) 360 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:08 gibba003 bash[31385]: cluster 2021-03-10T13:57:07.331970+0000 mgr.gibba043.dnkmem (mgr.34373) 360 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:08 gibba003 bash[32348]: cluster 2021-03-10T13:57:07.331970+0000 mgr.gibba043.dnkmem (mgr.34373) 360 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.943 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:57:10.176 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:57:10.176 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (5m) 2m ago 10m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:57:10.177 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (10m) 47s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:57:10.177 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (5m) 47s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:57:10.177 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (6m) 47s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:57:10.177 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:57:10.177 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:57:10.178 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (4m) 47s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:57:10.178 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:57:10.178 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (10m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:57:10.178 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (10m) 47s ago 11m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:57:10.178 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:57:10.179 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:57:10.179 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:57:10.179 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:57:10.179 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2m) 47s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:57:10.180 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (100s) 47s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:57:10.180 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (75s) 47s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:57:10.180 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (49s) 47s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:57:10.180 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (10m) 47s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:57:10.180 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:57:10.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:09 gibba043 bash[24019]: cephadm 2021-03-10T13:57:08.916435+0000 mgr.gibba043.dnkmem (mgr.34373) 361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:10.431 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:57:10.431 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:57:10.431 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:10.431 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:57:10.432 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:57:10.432 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:10.432 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:57:10.432 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:57:10.432 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:57:10.433 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:57:10.433 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:57:10.433 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:57:10.433 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:57:10.433 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:57:10.434 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:57:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:09 gibba003 bash[31385]: cephadm 2021-03-10T13:57:08.916435+0000 mgr.gibba043.dnkmem (mgr.34373) 361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:09 gibba003 bash[32348]: cephadm 2021-03-10T13:57:08.916435+0000 mgr.gibba043.dnkmem (mgr.34373) 361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:11.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:10 gibba043 bash[24019]: cluster 2021-03-10T13:57:09.333595+0000 mgr.gibba043.dnkmem (mgr.34373) 362 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:11.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:10 gibba043 bash[24019]: audit 2021-03-10T13:57:09.936021+0000 mgr.gibba043.dnkmem (mgr.34373) 363 : audit [DBG] from='client.44307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:11.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:10 gibba043 bash[24019]: audit 2021-03-10T13:57:10.431704+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.2.103:0/206564233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:10 gibba003 bash[31385]: cluster 2021-03-10T13:57:09.333595+0000 mgr.gibba043.dnkmem (mgr.34373) 362 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:10 gibba003 bash[31385]: audit 2021-03-10T13:57:09.936021+0000 mgr.gibba043.dnkmem (mgr.34373) 363 : audit [DBG] from='client.44307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:10 gibba003 bash[31385]: audit 2021-03-10T13:57:10.431704+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.2.103:0/206564233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:10 gibba003 bash[32348]: cluster 2021-03-10T13:57:09.333595+0000 mgr.gibba043.dnkmem (mgr.34373) 362 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:10 gibba003 bash[32348]: audit 2021-03-10T13:57:09.936021+0000 mgr.gibba043.dnkmem (mgr.34373) 363 : audit [DBG] from='client.44307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:10 gibba003 bash[32348]: audit 2021-03-10T13:57:10.431704+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.2.103:0/206564233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:11 gibba043 bash[24019]: audit 2021-03-10T13:57:10.165749+0000 mgr.gibba043.dnkmem (mgr.34373) 364 : audit [DBG] from='client.44313 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:12.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:11 gibba003 bash[31385]: audit 2021-03-10T13:57:10.165749+0000 mgr.gibba043.dnkmem (mgr.34373) 364 : audit [DBG] from='client.44313 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:12.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:11 gibba003 bash[32348]: audit 2021-03-10T13:57:10.165749+0000 mgr.gibba043.dnkmem (mgr.34373) 364 : audit [DBG] from='client.44313 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: cluster 2021-03-10T13:57:11.335120+0000 mgr.gibba043.dnkmem (mgr.34373) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.607268+0000 mon.c (mon.1) 155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:57:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.607980+0000 mon.c (mon.1) 156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T13:57:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.608475+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:57:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.608687+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.609537+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.609736+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T13:57:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.610969+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.611775+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.740648+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.741807+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.742284+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:12 gibba043 bash[24019]: audit 2021-03-10T13:57:12.743359+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: cluster 2021-03-10T13:57:11.335120+0000 mgr.gibba043.dnkmem (mgr.34373) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.607268+0000 mon.c (mon.1) 155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:57:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.607980+0000 mon.c (mon.1) 156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T13:57:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.608475+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:57:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.608687+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.609537+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.609736+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T13:57:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.610969+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.611775+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.740648+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.741807+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.742284+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[31385]: audit 2021-03-10T13:57:12.743359+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: cluster 2021-03-10T13:57:11.335120+0000 mgr.gibba043.dnkmem (mgr.34373) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.607268+0000 mon.c (mon.1) 155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:57:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.607980+0000 mon.c (mon.1) 156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T13:57:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.608475+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:57:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.608687+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.609537+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.609736+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T13:57:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.610969+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.611775+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:57:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.740648+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.741807+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.742284+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:12 gibba003 bash[32348]: audit 2021-03-10T13:57:12.743359+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:15 gibba043 bash[24019]: cluster 2021-03-10T13:57:13.336600+0000 mgr.gibba043.dnkmem (mgr.34373) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:15 gibba003 bash[31385]: cluster 2021-03-10T13:57:13.336600+0000 mgr.gibba043.dnkmem (mgr.34373) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:15 gibba003 bash[32348]: cluster 2021-03-10T13:57:13.336600+0000 mgr.gibba043.dnkmem (mgr.34373) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:17.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:17 gibba043 bash[24019]: cluster 2021-03-10T13:57:15.337829+0000 mgr.gibba043.dnkmem (mgr.34373) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:17 gibba003 bash[31385]: cluster 2021-03-10T13:57:15.337829+0000 mgr.gibba043.dnkmem (mgr.34373) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:17 gibba003 bash[32348]: cluster 2021-03-10T13:57:15.337829+0000 mgr.gibba043.dnkmem (mgr.34373) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:19 gibba003 bash[31385]: cluster 2021-03-10T13:57:17.339344+0000 mgr.gibba043.dnkmem (mgr.34373) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:19 gibba003 bash[32348]: cluster 2021-03-10T13:57:17.339344+0000 mgr.gibba043.dnkmem (mgr.34373) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:19.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:19 gibba043 bash[24019]: cluster 2021-03-10T13:57:17.339344+0000 mgr.gibba043.dnkmem (mgr.34373) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:21 gibba003 bash[31385]: cluster 2021-03-10T13:57:19.341093+0000 mgr.gibba043.dnkmem (mgr.34373) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:21 gibba003 bash[32348]: cluster 2021-03-10T13:57:19.341093+0000 mgr.gibba043.dnkmem (mgr.34373) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:21.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:21 gibba043 bash[24019]: cluster 2021-03-10T13:57:19.341093+0000 mgr.gibba043.dnkmem (mgr.34373) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:23 gibba003 bash[31385]: cluster 2021-03-10T13:57:21.342923+0000 mgr.gibba043.dnkmem (mgr.34373) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:23 gibba003 bash[32348]: cluster 2021-03-10T13:57:21.342923+0000 mgr.gibba043.dnkmem (mgr.34373) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:23.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:23 gibba043 bash[24019]: cluster 2021-03-10T13:57:21.342923+0000 mgr.gibba043.dnkmem (mgr.34373) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: cluster 2021-03-10T13:57:23.344582+0000 mgr.gibba043.dnkmem (mgr.34373) 371 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: cephadm 2021-03-10T13:57:23.932021+0000 mgr.gibba043.dnkmem (mgr.34373) 372 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:57:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: cephadm 2021-03-10T13:57:23.932521+0000 mgr.gibba043.dnkmem (mgr.34373) 373 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:57:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.168345+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:57:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.184627+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.189505+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.193866+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.197518+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.205028+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[31385]: audit 2021-03-10T13:57:24.209748+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: cluster 2021-03-10T13:57:23.344582+0000 mgr.gibba043.dnkmem (mgr.34373) 371 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: cephadm 2021-03-10T13:57:23.932021+0000 mgr.gibba043.dnkmem (mgr.34373) 372 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:57:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: cephadm 2021-03-10T13:57:23.932521+0000 mgr.gibba043.dnkmem (mgr.34373) 373 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:57:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.168345+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:57:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.184627+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.189505+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.193866+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.197518+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.205028+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:25 gibba003 bash[32348]: audit 2021-03-10T13:57:24.209748+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: cluster 2021-03-10T13:57:23.344582+0000 mgr.gibba043.dnkmem (mgr.34373) 371 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: cephadm 2021-03-10T13:57:23.932021+0000 mgr.gibba043.dnkmem (mgr.34373) 372 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:57:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: cephadm 2021-03-10T13:57:23.932521+0000 mgr.gibba043.dnkmem (mgr.34373) 373 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:57:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.168345+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:57:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.184627+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.189505+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.193866+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.197518+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.205028+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:25.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:25 gibba043 bash[24019]: audit 2021-03-10T13:57:24.209748+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.182807+0000 mgr.gibba043.dnkmem (mgr.34373) 374 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:26.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.189021+0000 mgr.gibba043.dnkmem (mgr.34373) 375 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.192887+0000 mgr.gibba043.dnkmem (mgr.34373) 376 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.193388+0000 mgr.gibba043.dnkmem (mgr.34373) 377 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.197237+0000 mgr.gibba043.dnkmem (mgr.34373) 378 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.197737+0000 mgr.gibba043.dnkmem (mgr.34373) 379 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.200806+0000 mgr.gibba043.dnkmem (mgr.34373) 380 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.204301+0000 mgr.gibba043.dnkmem (mgr.34373) 381 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.204500+0000 mgr.gibba043.dnkmem (mgr.34373) 382 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.207921+0000 mgr.gibba043.dnkmem (mgr.34373) 383 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:57:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.209949+0000 mgr.gibba043.dnkmem (mgr.34373) 384 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:57:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.212822+0000 mgr.gibba043.dnkmem (mgr.34373) 385 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:57:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.213319+0000 mgr.gibba043.dnkmem (mgr.34373) 386 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:57:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[31385]: cephadm 2021-03-10T13:57:24.213851+0000 mgr.gibba043.dnkmem (mgr.34373) 387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.182807+0000 mgr.gibba043.dnkmem (mgr.34373) 374 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.189021+0000 mgr.gibba043.dnkmem (mgr.34373) 375 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.192887+0000 mgr.gibba043.dnkmem (mgr.34373) 376 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.193388+0000 mgr.gibba043.dnkmem (mgr.34373) 377 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.197237+0000 mgr.gibba043.dnkmem (mgr.34373) 378 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.197737+0000 mgr.gibba043.dnkmem (mgr.34373) 379 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.200806+0000 mgr.gibba043.dnkmem (mgr.34373) 380 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.204301+0000 mgr.gibba043.dnkmem (mgr.34373) 381 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.204500+0000 mgr.gibba043.dnkmem (mgr.34373) 382 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.207921+0000 mgr.gibba043.dnkmem (mgr.34373) 383 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:57:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.209949+0000 mgr.gibba043.dnkmem (mgr.34373) 384 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:57:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.212822+0000 mgr.gibba043.dnkmem (mgr.34373) 385 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:57:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.213319+0000 mgr.gibba043.dnkmem (mgr.34373) 386 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:57:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:26 gibba003 bash[32348]: cephadm 2021-03-10T13:57:24.213851+0000 mgr.gibba043.dnkmem (mgr.34373) 387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.182807+0000 mgr.gibba043.dnkmem (mgr.34373) 374 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.189021+0000 mgr.gibba043.dnkmem (mgr.34373) 375 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.192887+0000 mgr.gibba043.dnkmem (mgr.34373) 376 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.193388+0000 mgr.gibba043.dnkmem (mgr.34373) 377 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.197237+0000 mgr.gibba043.dnkmem (mgr.34373) 378 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.197737+0000 mgr.gibba043.dnkmem (mgr.34373) 379 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.200806+0000 mgr.gibba043.dnkmem (mgr.34373) 380 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.204301+0000 mgr.gibba043.dnkmem (mgr.34373) 381 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.204500+0000 mgr.gibba043.dnkmem (mgr.34373) 382 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.207921+0000 mgr.gibba043.dnkmem (mgr.34373) 383 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:57:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.209949+0000 mgr.gibba043.dnkmem (mgr.34373) 384 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:57:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.212822+0000 mgr.gibba043.dnkmem (mgr.34373) 385 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:57:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.213319+0000 mgr.gibba043.dnkmem (mgr.34373) 386 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:57:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:26 gibba043 bash[24019]: cephadm 2021-03-10T13:57:24.213851+0000 mgr.gibba043.dnkmem (mgr.34373) 387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:27 gibba003 bash[31385]: cluster 2021-03-10T13:57:25.345961+0000 mgr.gibba043.dnkmem (mgr.34373) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:27 gibba003 bash[32348]: cluster 2021-03-10T13:57:25.345961+0000 mgr.gibba043.dnkmem (mgr.34373) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:27 gibba043 bash[24019]: cluster 2021-03-10T13:57:25.345961+0000 mgr.gibba043.dnkmem (mgr.34373) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:29 gibba003 bash[31385]: cluster 2021-03-10T13:57:27.347509+0000 mgr.gibba043.dnkmem (mgr.34373) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:29 gibba003 bash[32348]: cluster 2021-03-10T13:57:27.347509+0000 mgr.gibba043.dnkmem (mgr.34373) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:29.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:29 gibba043 bash[24019]: cluster 2021-03-10T13:57:27.347509+0000 mgr.gibba043.dnkmem (mgr.34373) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:31 gibba003 bash[31385]: cluster 2021-03-10T13:57:29.349204+0000 mgr.gibba043.dnkmem (mgr.34373) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:31 gibba003 bash[32348]: cluster 2021-03-10T13:57:29.349204+0000 mgr.gibba043.dnkmem (mgr.34373) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:31.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:31 gibba043 bash[24019]: cluster 2021-03-10T13:57:29.349204+0000 mgr.gibba043.dnkmem (mgr.34373) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:33 gibba003 bash[31385]: cluster 2021-03-10T13:57:31.351186+0000 mgr.gibba043.dnkmem (mgr.34373) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:33 gibba003 bash[32348]: cluster 2021-03-10T13:57:31.351186+0000 mgr.gibba043.dnkmem (mgr.34373) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:33 gibba043 bash[24019]: cluster 2021-03-10T13:57:31.351186+0000 mgr.gibba043.dnkmem (mgr.34373) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:35 gibba003 bash[31385]: cluster 2021-03-10T13:57:33.352784+0000 mgr.gibba043.dnkmem (mgr.34373) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:35 gibba003 bash[32348]: cluster 2021-03-10T13:57:33.352784+0000 mgr.gibba043.dnkmem (mgr.34373) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:35 gibba043 bash[24019]: cluster 2021-03-10T13:57:33.352784+0000 mgr.gibba043.dnkmem (mgr.34373) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:37 gibba003 bash[31385]: cluster 2021-03-10T13:57:35.354265+0000 mgr.gibba043.dnkmem (mgr.34373) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:37 gibba003 bash[32348]: cluster 2021-03-10T13:57:35.354265+0000 mgr.gibba043.dnkmem (mgr.34373) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:37.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:37 gibba043 bash[24019]: cluster 2021-03-10T13:57:35.354265+0000 mgr.gibba043.dnkmem (mgr.34373) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:39 gibba003 bash[31385]: cluster 2021-03-10T13:57:37.355817+0000 mgr.gibba043.dnkmem (mgr.34373) 394 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:39 gibba003 bash[32348]: cluster 2021-03-10T13:57:37.355817+0000 mgr.gibba043.dnkmem (mgr.34373) 394 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:39.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:39 gibba043 bash[24019]: cluster 2021-03-10T13:57:37.355817+0000 mgr.gibba043.dnkmem (mgr.34373) 394 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:40.674 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:57:40.902 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:57:40.902 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (6m) 3m ago 11m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:57:40.903 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (11m) 78s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:57:40.903 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (6m) 78s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:57:40.903 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (6m) 78s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:57:40.903 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (5m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:57:40.904 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (5m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:57:40.904 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (5m) 78s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:57:40.904 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:57:40.904 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (11m) 3m ago 11m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:57:40.905 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (11m) 78s ago 11m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:57:40.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:57:40.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:57:40.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:57:40.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:57:40.906 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2m) 78s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:57:40.906 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2m) 78s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:57:40.906 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (105s) 78s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:57:40.906 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (79s) 78s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:57:40.906 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (10m) 78s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:57:40.907 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:57:41.152 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:57:41.152 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:57:41.152 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:41.153 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:57:41.153 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:57:41.153 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:41.153 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:57:41.154 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:57:41.154 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:57:41.154 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:57:41.154 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:57:41.154 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:57:41.155 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:57:41.155 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:57:41.155 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:57:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:41 gibba003 bash[31385]: cephadm 2021-03-10T13:57:39.229907+0000 mgr.gibba043.dnkmem (mgr.34373) 395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:41 gibba003 bash[31385]: cluster 2021-03-10T13:57:39.357621+0000 mgr.gibba043.dnkmem (mgr.34373) 396 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:41 gibba003 bash[32348]: cephadm 2021-03-10T13:57:39.229907+0000 mgr.gibba043.dnkmem (mgr.34373) 395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:41 gibba003 bash[32348]: cluster 2021-03-10T13:57:39.357621+0000 mgr.gibba043.dnkmem (mgr.34373) 396 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:41 gibba043 bash[24019]: cephadm 2021-03-10T13:57:39.229907+0000 mgr.gibba043.dnkmem (mgr.34373) 395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:41 gibba043 bash[24019]: cluster 2021-03-10T13:57:39.357621+0000 mgr.gibba043.dnkmem (mgr.34373) 396 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:42 gibba003 bash[31385]: audit 2021-03-10T13:57:40.666639+0000 mgr.gibba043.dnkmem (mgr.34373) 397 : audit [DBG] from='client.44325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:42.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:42 gibba003 bash[31385]: audit 2021-03-10T13:57:40.891916+0000 mgr.gibba043.dnkmem (mgr.34373) 398 : audit [DBG] from='client.54316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:42.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:42 gibba003 bash[31385]: audit 2021-03-10T13:57:41.152894+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.2.103:0/3361493189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:42 gibba003 bash[32348]: audit 2021-03-10T13:57:40.666639+0000 mgr.gibba043.dnkmem (mgr.34373) 397 : audit [DBG] from='client.44325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:42 gibba003 bash[32348]: audit 2021-03-10T13:57:40.891916+0000 mgr.gibba043.dnkmem (mgr.34373) 398 : audit [DBG] from='client.54316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:42 gibba003 bash[32348]: audit 2021-03-10T13:57:41.152894+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.2.103:0/3361493189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:42 gibba043 bash[24019]: audit 2021-03-10T13:57:40.666639+0000 mgr.gibba043.dnkmem (mgr.34373) 397 : audit [DBG] from='client.44325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:42 gibba043 bash[24019]: audit 2021-03-10T13:57:40.891916+0000 mgr.gibba043.dnkmem (mgr.34373) 398 : audit [DBG] from='client.54316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:42 gibba043 bash[24019]: audit 2021-03-10T13:57:41.152894+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.2.103:0/3361493189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:43 gibba003 bash[31385]: cluster 2021-03-10T13:57:41.359268+0000 mgr.gibba043.dnkmem (mgr.34373) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:43 gibba003 bash[32348]: cluster 2021-03-10T13:57:41.359268+0000 mgr.gibba043.dnkmem (mgr.34373) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:43.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:43 gibba043 bash[24019]: cluster 2021-03-10T13:57:41.359268+0000 mgr.gibba043.dnkmem (mgr.34373) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:44.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:44 gibba003 bash[31385]: cluster 2021-03-10T13:57:43.360806+0000 mgr.gibba043.dnkmem (mgr.34373) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:44 gibba003 bash[32348]: cluster 2021-03-10T13:57:43.360806+0000 mgr.gibba043.dnkmem (mgr.34373) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:44.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:44 gibba043 bash[24019]: cluster 2021-03-10T13:57:43.360806+0000 mgr.gibba043.dnkmem (mgr.34373) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:46.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:46 gibba003 bash[32348]: cluster 2021-03-10T13:57:45.362109+0000 mgr.gibba043.dnkmem (mgr.34373) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:46.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:46 gibba003 bash[31385]: cluster 2021-03-10T13:57:45.362109+0000 mgr.gibba043.dnkmem (mgr.34373) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:46.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:46 gibba043 bash[24019]: cluster 2021-03-10T13:57:45.362109+0000 mgr.gibba043.dnkmem (mgr.34373) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:49.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:48 gibba043 bash[24019]: cluster 2021-03-10T13:57:47.363715+0000 mgr.gibba043.dnkmem (mgr.34373) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:48 gibba003 bash[31385]: cluster 2021-03-10T13:57:47.363715+0000 mgr.gibba043.dnkmem (mgr.34373) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:49.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:48 gibba003 bash[32348]: cluster 2021-03-10T13:57:47.363715+0000 mgr.gibba043.dnkmem (mgr.34373) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:51.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:50 gibba043 bash[24019]: cluster 2021-03-10T13:57:49.365460+0000 mgr.gibba043.dnkmem (mgr.34373) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:50 gibba003 bash[31385]: cluster 2021-03-10T13:57:49.365460+0000 mgr.gibba043.dnkmem (mgr.34373) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:50 gibba003 bash[32348]: cluster 2021-03-10T13:57:49.365460+0000 mgr.gibba043.dnkmem (mgr.34373) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:53.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:52 gibba043 bash[24019]: cluster 2021-03-10T13:57:51.367176+0000 mgr.gibba043.dnkmem (mgr.34373) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:52 gibba003 bash[31385]: cluster 2021-03-10T13:57:51.367176+0000 mgr.gibba043.dnkmem (mgr.34373) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:52 gibba003 bash[32348]: cluster 2021-03-10T13:57:51.367176+0000 mgr.gibba043.dnkmem (mgr.34373) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:55.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:54 gibba043 bash[24019]: cluster 2021-03-10T13:57:53.368573+0000 mgr.gibba043.dnkmem (mgr.34373) 405 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:55.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:54 gibba003 bash[31385]: cluster 2021-03-10T13:57:53.368573+0000 mgr.gibba043.dnkmem (mgr.34373) 405 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:54 gibba003 bash[32348]: cluster 2021-03-10T13:57:53.368573+0000 mgr.gibba043.dnkmem (mgr.34373) 405 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:56.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:55 gibba043 bash[24019]: cephadm 2021-03-10T13:57:54.244604+0000 mgr.gibba043.dnkmem (mgr.34373) 406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:55 gibba003 bash[31385]: cephadm 2021-03-10T13:57:54.244604+0000 mgr.gibba043.dnkmem (mgr.34373) 406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:55 gibba003 bash[32348]: cephadm 2021-03-10T13:57:54.244604+0000 mgr.gibba043.dnkmem (mgr.34373) 406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:57:57.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:56 gibba043 bash[24019]: cluster 2021-03-10T13:57:55.369881+0000 mgr.gibba043.dnkmem (mgr.34373) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:56 gibba003 bash[31385]: cluster 2021-03-10T13:57:55.369881+0000 mgr.gibba043.dnkmem (mgr.34373) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:56 gibba003 bash[32348]: cluster 2021-03-10T13:57:55.369881+0000 mgr.gibba043.dnkmem (mgr.34373) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:59.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:57:58 gibba043 bash[24019]: cluster 2021-03-10T13:57:57.371223+0000 mgr.gibba043.dnkmem (mgr.34373) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:57:58 gibba003 bash[31385]: cluster 2021-03-10T13:57:57.371223+0000 mgr.gibba043.dnkmem (mgr.34373) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:57:58 gibba003 bash[32348]: cluster 2021-03-10T13:57:57.371223+0000 mgr.gibba043.dnkmem (mgr.34373) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:01.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:00 gibba043 bash[24019]: cluster 2021-03-10T13:57:59.372753+0000 mgr.gibba043.dnkmem (mgr.34373) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:00 gibba003 bash[31385]: cluster 2021-03-10T13:57:59.372753+0000 mgr.gibba043.dnkmem (mgr.34373) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:00 gibba003 bash[32348]: cluster 2021-03-10T13:57:59.372753+0000 mgr.gibba043.dnkmem (mgr.34373) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:02 gibba043 bash[24019]: cluster 2021-03-10T13:58:01.374393+0000 mgr.gibba043.dnkmem (mgr.34373) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:02 gibba003 bash[31385]: cluster 2021-03-10T13:58:01.374393+0000 mgr.gibba043.dnkmem (mgr.34373) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:02 gibba003 bash[32348]: cluster 2021-03-10T13:58:01.374393+0000 mgr.gibba043.dnkmem (mgr.34373) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:05.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:04 gibba003 bash[31385]: cluster 2021-03-10T13:58:03.375907+0000 mgr.gibba043.dnkmem (mgr.34373) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:05.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:04 gibba003 bash[32348]: cluster 2021-03-10T13:58:03.375907+0000 mgr.gibba043.dnkmem (mgr.34373) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:04 gibba043 bash[24019]: cluster 2021-03-10T13:58:03.375907+0000 mgr.gibba043.dnkmem (mgr.34373) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:06 gibba003 bash[31385]: cluster 2021-03-10T13:58:05.377155+0000 mgr.gibba043.dnkmem (mgr.34373) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:07.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:06 gibba003 bash[32348]: cluster 2021-03-10T13:58:05.377155+0000 mgr.gibba043.dnkmem (mgr.34373) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:07.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:06 gibba043 bash[24019]: cluster 2021-03-10T13:58:05.377155+0000 mgr.gibba043.dnkmem (mgr.34373) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:08 gibba003 bash[31385]: cluster 2021-03-10T13:58:07.378596+0000 mgr.gibba043.dnkmem (mgr.34373) 413 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:08 gibba003 bash[32348]: cluster 2021-03-10T13:58:07.378596+0000 mgr.gibba043.dnkmem (mgr.34373) 413 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:09.256 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:08 gibba043 bash[24019]: cluster 2021-03-10T13:58:07.378596+0000 mgr.gibba043.dnkmem (mgr.34373) 413 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:10 gibba003 bash[31385]: cephadm 2021-03-10T13:58:09.257174+0000 mgr.gibba043.dnkmem (mgr.34373) 414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:10 gibba003 bash[31385]: cluster 2021-03-10T13:58:09.380269+0000 mgr.gibba043.dnkmem (mgr.34373) 415 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:10 gibba003 bash[32348]: cephadm 2021-03-10T13:58:09.257174+0000 mgr.gibba043.dnkmem (mgr.34373) 414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:10 gibba003 bash[32348]: cluster 2021-03-10T13:58:09.380269+0000 mgr.gibba043.dnkmem (mgr.34373) 415 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:10 gibba043 bash[24019]: cephadm 2021-03-10T13:58:09.257174+0000 mgr.gibba043.dnkmem (mgr.34373) 414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:11.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:10 gibba043 bash[24019]: cluster 2021-03-10T13:58:09.380269+0000 mgr.gibba043.dnkmem (mgr.34373) 415 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.404 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:58:11.678 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:58:11.678 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (6m) 3m ago 11m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:58:11.678 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (11m) 108s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:58:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (6m) 108s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:58:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (7m) 108s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:58:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:58:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:58:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (5m) 108s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:58:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:58:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (11m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:58:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (12m) 108s ago 12m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:58:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:58:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:58:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:58:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:58:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3m) 108s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:58:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2m) 108s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:58:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2m) 108s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:58:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (110s) 108s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:58:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (11m) 108s ago 12m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:58:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:58:11.939 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:58:11.939 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:58:11.939 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:11.940 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:58:11.940 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:58:11.940 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:11.940 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:58:11.940 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:58:11.941 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:58:11.941 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:58:11.941 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:58:11.941 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:58:11.942 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:58:11.942 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:58:11.942 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:58:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: cluster 2021-03-10T13:58:11.381765+0000 mgr.gibba043.dnkmem (mgr.34373) 416 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:11.388233+0000 mgr.gibba043.dnkmem (mgr.34373) 417 : audit [DBG] from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:11.639779+0000 mgr.gibba043.dnkmem (mgr.34373) 418 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:11.939574+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.2.103:0/3265976151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.615295+0000 mon.c (mon.1) 167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:58:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.616017+0000 mon.c (mon.1) 168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.616506+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:58:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.616708+0000 mon.c (mon.1) 169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.617528+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.617719+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.619237+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.620235+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.752308+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.753464+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.761830+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[31385]: audit 2021-03-10T13:58:12.762977+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: cluster 2021-03-10T13:58:11.381765+0000 mgr.gibba043.dnkmem (mgr.34373) 416 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:11.388233+0000 mgr.gibba043.dnkmem (mgr.34373) 417 : audit [DBG] from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:11.639779+0000 mgr.gibba043.dnkmem (mgr.34373) 418 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:11.939574+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.2.103:0/3265976151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.615295+0000 mon.c (mon.1) 167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:58:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.616017+0000 mon.c (mon.1) 168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.616506+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:58:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.616708+0000 mon.c (mon.1) 169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.617528+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.617719+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.619237+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.620235+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.752308+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.753464+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.761830+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:12 gibba003 bash[32348]: audit 2021-03-10T13:58:12.762977+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: cluster 2021-03-10T13:58:11.381765+0000 mgr.gibba043.dnkmem (mgr.34373) 416 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:11.388233+0000 mgr.gibba043.dnkmem (mgr.34373) 417 : audit [DBG] from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:11.639779+0000 mgr.gibba043.dnkmem (mgr.34373) 418 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:11.939574+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.2.103:0/3265976151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.615295+0000 mon.c (mon.1) 167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:58:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.616017+0000 mon.c (mon.1) 168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.616506+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:58:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.616708+0000 mon.c (mon.1) 169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.617528+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.617719+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.619237+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:58:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.620235+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.752308+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.753464+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.761830+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:12 gibba043 bash[24019]: audit 2021-03-10T13:58:12.762977+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:14 gibba003 bash[31385]: cluster 2021-03-10T13:58:13.383102+0000 mgr.gibba043.dnkmem (mgr.34373) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:14 gibba003 bash[32348]: cluster 2021-03-10T13:58:13.383102+0000 mgr.gibba043.dnkmem (mgr.34373) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:14 gibba043 bash[24019]: cluster 2021-03-10T13:58:13.383102+0000 mgr.gibba043.dnkmem (mgr.34373) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:16 gibba003 bash[31385]: cluster 2021-03-10T13:58:15.384628+0000 mgr.gibba043.dnkmem (mgr.34373) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:17.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:16 gibba003 bash[32348]: cluster 2021-03-10T13:58:15.384628+0000 mgr.gibba043.dnkmem (mgr.34373) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:17.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:16 gibba043 bash[24019]: cluster 2021-03-10T13:58:15.384628+0000 mgr.gibba043.dnkmem (mgr.34373) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:18 gibba003 bash[31385]: cluster 2021-03-10T13:58:17.386110+0000 mgr.gibba043.dnkmem (mgr.34373) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:18 gibba003 bash[32348]: cluster 2021-03-10T13:58:17.386110+0000 mgr.gibba043.dnkmem (mgr.34373) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:18 gibba043 bash[24019]: cluster 2021-03-10T13:58:17.386110+0000 mgr.gibba043.dnkmem (mgr.34373) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:20 gibba003 bash[31385]: cluster 2021-03-10T13:58:19.387799+0000 mgr.gibba043.dnkmem (mgr.34373) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:20 gibba003 bash[32348]: cluster 2021-03-10T13:58:19.387799+0000 mgr.gibba043.dnkmem (mgr.34373) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:21.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:20 gibba043 bash[24019]: cluster 2021-03-10T13:58:19.387799+0000 mgr.gibba043.dnkmem (mgr.34373) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:22 gibba003 bash[31385]: cluster 2021-03-10T13:58:21.389229+0000 mgr.gibba043.dnkmem (mgr.34373) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:22 gibba003 bash[32348]: cluster 2021-03-10T13:58:21.389229+0000 mgr.gibba043.dnkmem (mgr.34373) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:23.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:22 gibba043 bash[24019]: cluster 2021-03-10T13:58:21.389229+0000 mgr.gibba043.dnkmem (mgr.34373) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: cluster 2021-03-10T13:58:23.390717+0000 mgr.gibba043.dnkmem (mgr.34373) 424 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.479983+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:58:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.483750+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.485152+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.486420+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.487797+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.490536+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[31385]: audit 2021-03-10T13:58:24.491836+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: cluster 2021-03-10T13:58:23.390717+0000 mgr.gibba043.dnkmem (mgr.34373) 424 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.479983+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:58:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.483750+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.485152+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.486420+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.487797+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.490536+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:24 gibba003 bash[32348]: audit 2021-03-10T13:58:24.491836+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: cluster 2021-03-10T13:58:23.390717+0000 mgr.gibba043.dnkmem (mgr.34373) 424 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.479983+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:58:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.483750+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.485152+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.486420+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.487797+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.490536+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:24 gibba043 bash[24019]: audit 2021-03-10T13:58:24.491836+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.274017+0000 mgr.gibba043.dnkmem (mgr.34373) 425 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:58:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.275563+0000 mgr.gibba043.dnkmem (mgr.34373) 426 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:58:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.484216+0000 mgr.gibba043.dnkmem (mgr.34373) 427 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:26.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.486039+0000 mgr.gibba043.dnkmem (mgr.34373) 428 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:26.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.487257+0000 mgr.gibba043.dnkmem (mgr.34373) 429 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:26.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.487296+0000 mgr.gibba043.dnkmem (mgr.34373) 430 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:26.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.488651+0000 mgr.gibba043.dnkmem (mgr.34373) 431 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:26.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.488688+0000 mgr.gibba043.dnkmem (mgr.34373) 432 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:26.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.489777+0000 mgr.gibba043.dnkmem (mgr.34373) 433 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:26.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.491385+0000 mgr.gibba043.dnkmem (mgr.34373) 434 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:26.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.491471+0000 mgr.gibba043.dnkmem (mgr.34373) 435 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:26.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.492513+0000 mgr.gibba043.dnkmem (mgr.34373) 436 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:26.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.492822+0000 mgr.gibba043.dnkmem (mgr.34373) 437 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:26.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.493808+0000 mgr.gibba043.dnkmem (mgr.34373) 438 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:26.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.493847+0000 mgr.gibba043.dnkmem (mgr.34373) 439 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:26.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[31385]: cephadm 2021-03-10T13:58:24.493950+0000 mgr.gibba043.dnkmem (mgr.34373) 440 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:26.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.274017+0000 mgr.gibba043.dnkmem (mgr.34373) 425 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:58:26.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.275563+0000 mgr.gibba043.dnkmem (mgr.34373) 426 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:58:26.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.484216+0000 mgr.gibba043.dnkmem (mgr.34373) 427 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:26.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.486039+0000 mgr.gibba043.dnkmem (mgr.34373) 428 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:26.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.487257+0000 mgr.gibba043.dnkmem (mgr.34373) 429 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:26.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.487296+0000 mgr.gibba043.dnkmem (mgr.34373) 430 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:26.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.488651+0000 mgr.gibba043.dnkmem (mgr.34373) 431 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:26.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.488688+0000 mgr.gibba043.dnkmem (mgr.34373) 432 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.489777+0000 mgr.gibba043.dnkmem (mgr.34373) 433 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.491385+0000 mgr.gibba043.dnkmem (mgr.34373) 434 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.491471+0000 mgr.gibba043.dnkmem (mgr.34373) 435 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.492513+0000 mgr.gibba043.dnkmem (mgr.34373) 436 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.492822+0000 mgr.gibba043.dnkmem (mgr.34373) 437 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:26.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.493808+0000 mgr.gibba043.dnkmem (mgr.34373) 438 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:26.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.493847+0000 mgr.gibba043.dnkmem (mgr.34373) 439 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:26.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:25 gibba003 bash[32348]: cephadm 2021-03-10T13:58:24.493950+0000 mgr.gibba043.dnkmem (mgr.34373) 440 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.274017+0000 mgr.gibba043.dnkmem (mgr.34373) 425 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:58:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.275563+0000 mgr.gibba043.dnkmem (mgr.34373) 426 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:58:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.484216+0000 mgr.gibba043.dnkmem (mgr.34373) 427 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.486039+0000 mgr.gibba043.dnkmem (mgr.34373) 428 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.487257+0000 mgr.gibba043.dnkmem (mgr.34373) 429 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.487296+0000 mgr.gibba043.dnkmem (mgr.34373) 430 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.488651+0000 mgr.gibba043.dnkmem (mgr.34373) 431 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.488688+0000 mgr.gibba043.dnkmem (mgr.34373) 432 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.489777+0000 mgr.gibba043.dnkmem (mgr.34373) 433 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.491385+0000 mgr.gibba043.dnkmem (mgr.34373) 434 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.491471+0000 mgr.gibba043.dnkmem (mgr.34373) 435 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.492513+0000 mgr.gibba043.dnkmem (mgr.34373) 436 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.492822+0000 mgr.gibba043.dnkmem (mgr.34373) 437 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.493808+0000 mgr.gibba043.dnkmem (mgr.34373) 438 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.493847+0000 mgr.gibba043.dnkmem (mgr.34373) 439 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:25 gibba043 bash[24019]: cephadm 2021-03-10T13:58:24.493950+0000 mgr.gibba043.dnkmem (mgr.34373) 440 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:26 gibba003 bash[31385]: cluster 2021-03-10T13:58:25.392268+0000 mgr.gibba043.dnkmem (mgr.34373) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:26 gibba003 bash[32348]: cluster 2021-03-10T13:58:25.392268+0000 mgr.gibba043.dnkmem (mgr.34373) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:27.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:26 gibba043 bash[24019]: cluster 2021-03-10T13:58:25.392268+0000 mgr.gibba043.dnkmem (mgr.34373) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:28 gibba003 bash[31385]: cluster 2021-03-10T13:58:27.393852+0000 mgr.gibba043.dnkmem (mgr.34373) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:28 gibba003 bash[32348]: cluster 2021-03-10T13:58:27.393852+0000 mgr.gibba043.dnkmem (mgr.34373) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:29.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:28 gibba043 bash[24019]: cluster 2021-03-10T13:58:27.393852+0000 mgr.gibba043.dnkmem (mgr.34373) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:30 gibba003 bash[31385]: cluster 2021-03-10T13:58:29.395664+0000 mgr.gibba043.dnkmem (mgr.34373) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:30 gibba003 bash[32348]: cluster 2021-03-10T13:58:29.395664+0000 mgr.gibba043.dnkmem (mgr.34373) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:31.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:30 gibba043 bash[24019]: cluster 2021-03-10T13:58:29.395664+0000 mgr.gibba043.dnkmem (mgr.34373) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:33.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:32 gibba003 bash[31385]: cluster 2021-03-10T13:58:31.397428+0000 mgr.gibba043.dnkmem (mgr.34373) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:32 gibba003 bash[32348]: cluster 2021-03-10T13:58:31.397428+0000 mgr.gibba043.dnkmem (mgr.34373) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:33.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:32 gibba043 bash[24019]: cluster 2021-03-10T13:58:31.397428+0000 mgr.gibba043.dnkmem (mgr.34373) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:34 gibba003 bash[31385]: cluster 2021-03-10T13:58:33.398915+0000 mgr.gibba043.dnkmem (mgr.34373) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:34 gibba003 bash[32348]: cluster 2021-03-10T13:58:33.398915+0000 mgr.gibba043.dnkmem (mgr.34373) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:34 gibba043 bash[24019]: cluster 2021-03-10T13:58:33.398915+0000 mgr.gibba043.dnkmem (mgr.34373) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:36 gibba003 bash[31385]: cluster 2021-03-10T13:58:35.400403+0000 mgr.gibba043.dnkmem (mgr.34373) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:36 gibba003 bash[32348]: cluster 2021-03-10T13:58:35.400403+0000 mgr.gibba043.dnkmem (mgr.34373) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:37.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:36 gibba043 bash[24019]: cluster 2021-03-10T13:58:35.400403+0000 mgr.gibba043.dnkmem (mgr.34373) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:38 gibba003 bash[31385]: cluster 2021-03-10T13:58:37.402014+0000 mgr.gibba043.dnkmem (mgr.34373) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:38 gibba003 bash[32348]: cluster 2021-03-10T13:58:37.402014+0000 mgr.gibba043.dnkmem (mgr.34373) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:39.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:38 gibba043 bash[24019]: cluster 2021-03-10T13:58:37.402014+0000 mgr.gibba043.dnkmem (mgr.34373) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:40 gibba003 bash[31385]: cluster 2021-03-10T13:58:39.403693+0000 mgr.gibba043.dnkmem (mgr.34373) 448 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:40 gibba003 bash[31385]: cephadm 2021-03-10T13:58:39.510009+0000 mgr.gibba043.dnkmem (mgr.34373) 449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:40 gibba003 bash[32348]: cluster 2021-03-10T13:58:39.403693+0000 mgr.gibba043.dnkmem (mgr.34373) 448 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:40 gibba003 bash[32348]: cephadm 2021-03-10T13:58:39.510009+0000 mgr.gibba043.dnkmem (mgr.34373) 449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:41.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:40 gibba043 bash[24019]: cluster 2021-03-10T13:58:39.403693+0000 mgr.gibba043.dnkmem (mgr.34373) 448 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:40 gibba043 bash[24019]: cephadm 2021-03-10T13:58:39.510009+0000 mgr.gibba043.dnkmem (mgr.34373) 449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:42.187 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:58:42.414 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:58:42.414 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (7m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:58:42.415 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:58:42.415 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:58:42.415 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:58:42.415 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:58:42.415 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:58:42.416 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:58:42.416 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:58:42.416 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (12m) 4m ago 12m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:58:42.416 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (12m) 2m ago 12m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:58:42.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:58:42.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:58:42.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:58:42.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:58:42.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:58:42.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:58:42.418 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:58:42.418 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:58:42.418 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (11m) 2m ago 12m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:58:42.418 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:58:42.662 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:58:42.663 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:58:42.663 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:42.664 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:58:42.664 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:58:42.664 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:42.665 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:58:42.665 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:58:42.666 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:58:42.666 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:58:42.666 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:58:42.667 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:58:42.667 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:58:42.668 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:58:42.668 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:58:43.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:42 gibba043 bash[24019]: cluster 2021-03-10T13:58:41.405988+0000 mgr.gibba043.dnkmem (mgr.34373) 450 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:43.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:42 gibba043 bash[24019]: audit 2021-03-10T13:58:42.662511+0000 mon.c (mon.1) 179 : audit [DBG] from='client.? 172.21.2.103:0/344694780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:42 gibba003 bash[31385]: cluster 2021-03-10T13:58:41.405988+0000 mgr.gibba043.dnkmem (mgr.34373) 450 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:42 gibba003 bash[31385]: audit 2021-03-10T13:58:42.662511+0000 mon.c (mon.1) 179 : audit [DBG] from='client.? 172.21.2.103:0/344694780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:43.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:42 gibba003 bash[32348]: cluster 2021-03-10T13:58:41.405988+0000 mgr.gibba043.dnkmem (mgr.34373) 450 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:43.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:42 gibba003 bash[32348]: audit 2021-03-10T13:58:42.662511+0000 mon.c (mon.1) 179 : audit [DBG] from='client.? 172.21.2.103:0/344694780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:43 gibba043 bash[24019]: audit 2021-03-10T13:58:42.179572+0000 mgr.gibba043.dnkmem (mgr.34373) 451 : audit [DBG] from='client.54346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:43 gibba043 bash[24019]: audit 2021-03-10T13:58:42.403824+0000 mgr.gibba043.dnkmem (mgr.34373) 452 : audit [DBG] from='client.54352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:44.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:43 gibba003 bash[31385]: audit 2021-03-10T13:58:42.179572+0000 mgr.gibba043.dnkmem (mgr.34373) 451 : audit [DBG] from='client.54346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:43 gibba003 bash[31385]: audit 2021-03-10T13:58:42.403824+0000 mgr.gibba043.dnkmem (mgr.34373) 452 : audit [DBG] from='client.54352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:43 gibba003 bash[32348]: audit 2021-03-10T13:58:42.179572+0000 mgr.gibba043.dnkmem (mgr.34373) 451 : audit [DBG] from='client.54346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:43 gibba003 bash[32348]: audit 2021-03-10T13:58:42.403824+0000 mgr.gibba043.dnkmem (mgr.34373) 452 : audit [DBG] from='client.54352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:45.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:44 gibba043 bash[24019]: cluster 2021-03-10T13:58:43.407541+0000 mgr.gibba043.dnkmem (mgr.34373) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:44 gibba003 bash[31385]: cluster 2021-03-10T13:58:43.407541+0000 mgr.gibba043.dnkmem (mgr.34373) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:44 gibba003 bash[32348]: cluster 2021-03-10T13:58:43.407541+0000 mgr.gibba043.dnkmem (mgr.34373) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:47.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:46 gibba043 bash[24019]: cluster 2021-03-10T13:58:45.408769+0000 mgr.gibba043.dnkmem (mgr.34373) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:46 gibba003 bash[31385]: cluster 2021-03-10T13:58:45.408769+0000 mgr.gibba043.dnkmem (mgr.34373) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:46 gibba003 bash[32348]: cluster 2021-03-10T13:58:45.408769+0000 mgr.gibba043.dnkmem (mgr.34373) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:48 gibba043 bash[24019]: cluster 2021-03-10T13:58:47.410248+0000 mgr.gibba043.dnkmem (mgr.34373) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:48 gibba003 bash[31385]: cluster 2021-03-10T13:58:47.410248+0000 mgr.gibba043.dnkmem (mgr.34373) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:48 gibba003 bash[32348]: cluster 2021-03-10T13:58:47.410248+0000 mgr.gibba043.dnkmem (mgr.34373) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:51.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:50 gibba043 bash[24019]: cluster 2021-03-10T13:58:49.411979+0000 mgr.gibba043.dnkmem (mgr.34373) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:50 gibba003 bash[31385]: cluster 2021-03-10T13:58:49.411979+0000 mgr.gibba043.dnkmem (mgr.34373) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:50 gibba003 bash[32348]: cluster 2021-03-10T13:58:49.411979+0000 mgr.gibba043.dnkmem (mgr.34373) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:53.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:52 gibba043 bash[24019]: cluster 2021-03-10T13:58:51.413642+0000 mgr.gibba043.dnkmem (mgr.34373) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:52 gibba003 bash[31385]: cluster 2021-03-10T13:58:51.413642+0000 mgr.gibba043.dnkmem (mgr.34373) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:52 gibba003 bash[32348]: cluster 2021-03-10T13:58:51.413642+0000 mgr.gibba043.dnkmem (mgr.34373) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:55.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:55 gibba043 bash[24019]: cluster 2021-03-10T13:58:53.415260+0000 mgr.gibba043.dnkmem (mgr.34373) 458 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:55 gibba003 bash[31385]: cluster 2021-03-10T13:58:53.415260+0000 mgr.gibba043.dnkmem (mgr.34373) 458 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:55 gibba003 bash[32348]: cluster 2021-03-10T13:58:53.415260+0000 mgr.gibba043.dnkmem (mgr.34373) 458 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:56 gibba043 bash[24019]: cephadm 2021-03-10T13:58:54.526133+0000 mgr.gibba043.dnkmem (mgr.34373) 459 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:56 gibba003 bash[31385]: cephadm 2021-03-10T13:58:54.526133+0000 mgr.gibba043.dnkmem (mgr.34373) 459 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:56 gibba003 bash[32348]: cephadm 2021-03-10T13:58:54.526133+0000 mgr.gibba043.dnkmem (mgr.34373) 459 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:58:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:57 gibba003 bash[31385]: cluster 2021-03-10T13:58:55.416661+0000 mgr.gibba043.dnkmem (mgr.34373) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:57 gibba003 bash[32348]: cluster 2021-03-10T13:58:55.416661+0000 mgr.gibba043.dnkmem (mgr.34373) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:57.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:57 gibba043 bash[24019]: cluster 2021-03-10T13:58:55.416661+0000 mgr.gibba043.dnkmem (mgr.34373) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:58:59 gibba003 bash[31385]: cluster 2021-03-10T13:58:57.418231+0000 mgr.gibba043.dnkmem (mgr.34373) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:58:59 gibba003 bash[32348]: cluster 2021-03-10T13:58:57.418231+0000 mgr.gibba043.dnkmem (mgr.34373) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:59.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:58:59 gibba043 bash[24019]: cluster 2021-03-10T13:58:57.418231+0000 mgr.gibba043.dnkmem (mgr.34373) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:01 gibba003 bash[31385]: cluster 2021-03-10T13:58:59.419918+0000 mgr.gibba043.dnkmem (mgr.34373) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:01 gibba003 bash[32348]: cluster 2021-03-10T13:58:59.419918+0000 mgr.gibba043.dnkmem (mgr.34373) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:01.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:01 gibba043 bash[24019]: cluster 2021-03-10T13:58:59.419918+0000 mgr.gibba043.dnkmem (mgr.34373) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:03 gibba003 bash[31385]: cluster 2021-03-10T13:59:01.421401+0000 mgr.gibba043.dnkmem (mgr.34373) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:03 gibba003 bash[32348]: cluster 2021-03-10T13:59:01.421401+0000 mgr.gibba043.dnkmem (mgr.34373) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:03.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:03 gibba043 bash[24019]: cluster 2021-03-10T13:59:01.421401+0000 mgr.gibba043.dnkmem (mgr.34373) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:05 gibba003 bash[31385]: cluster 2021-03-10T13:59:03.422782+0000 mgr.gibba043.dnkmem (mgr.34373) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:05 gibba003 bash[32348]: cluster 2021-03-10T13:59:03.422782+0000 mgr.gibba043.dnkmem (mgr.34373) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:05.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:05 gibba043 bash[24019]: cluster 2021-03-10T13:59:03.422782+0000 mgr.gibba043.dnkmem (mgr.34373) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:07 gibba003 bash[31385]: cluster 2021-03-10T13:59:05.424279+0000 mgr.gibba043.dnkmem (mgr.34373) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:07 gibba003 bash[32348]: cluster 2021-03-10T13:59:05.424279+0000 mgr.gibba043.dnkmem (mgr.34373) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:07.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:07 gibba043 bash[24019]: cluster 2021-03-10T13:59:05.424279+0000 mgr.gibba043.dnkmem (mgr.34373) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:09 gibba003 bash[31385]: cluster 2021-03-10T13:59:07.425751+0000 mgr.gibba043.dnkmem (mgr.34373) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:09 gibba003 bash[32348]: cluster 2021-03-10T13:59:07.425751+0000 mgr.gibba043.dnkmem (mgr.34373) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:09.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:09 gibba043 bash[24019]: cluster 2021-03-10T13:59:07.425751+0000 mgr.gibba043.dnkmem (mgr.34373) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:11 gibba003 bash[31385]: cluster 2021-03-10T13:59:09.427448+0000 mgr.gibba043.dnkmem (mgr.34373) 467 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:11 gibba003 bash[31385]: cephadm 2021-03-10T13:59:09.540655+0000 mgr.gibba043.dnkmem (mgr.34373) 468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:11 gibba003 bash[32348]: cluster 2021-03-10T13:59:09.427448+0000 mgr.gibba043.dnkmem (mgr.34373) 467 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:11 gibba003 bash[32348]: cephadm 2021-03-10T13:59:09.540655+0000 mgr.gibba043.dnkmem (mgr.34373) 468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:11.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:11 gibba043 bash[24019]: cluster 2021-03-10T13:59:09.427448+0000 mgr.gibba043.dnkmem (mgr.34373) 467 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:11 gibba043 bash[24019]: cephadm 2021-03-10T13:59:09.540655+0000 mgr.gibba043.dnkmem (mgr.34373) 468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:12.903 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:59:13.132 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:59:13.133 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (7m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:59:13.133 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:59:13.133 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:59:13.134 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (8m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:59:13.134 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:59:13.134 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:59:13.134 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:59:13.134 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:59:13.135 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:59:13.135 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (13m) 2m ago 13m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:59:13.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:59:13.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:59:13.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:59:13.136 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:59:13.136 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:59:13.136 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:59:13.136 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:59:13.137 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:59:13.137 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (12m) 2m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:59:13.137 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:59:13.386 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:59:13.386 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:59:13.386 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:13.387 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:59:13.387 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:59:13.387 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:13.387 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:59:13.387 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:59:13.388 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:59:13.388 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:59:13.388 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:59:13.388 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:59:13.388 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:59:13.389 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:59:13.389 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:59:13.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: cluster 2021-03-10T13:59:11.429123+0000 mgr.gibba043.dnkmem (mgr.34373) 469 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.625569+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:59:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.626703+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T13:59:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.627104+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:59:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.627792+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.628840+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T13:59:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.629073+0000 mon.c (mon.1) 183 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.630197+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.630577+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.757888+0000 mon.c (mon.1) 184 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.758229+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.774074+0000 mon.c (mon.1) 185 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[31385]: audit 2021-03-10T13:59:12.774325+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: cluster 2021-03-10T13:59:11.429123+0000 mgr.gibba043.dnkmem (mgr.34373) 469 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.625569+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:59:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.626703+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T13:59:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.627104+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:59:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.627792+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.628840+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T13:59:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.629073+0000 mon.c (mon.1) 183 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.630197+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.630577+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.757888+0000 mon.c (mon.1) 184 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.758229+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.774074+0000 mon.c (mon.1) 185 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:13 gibba003 bash[32348]: audit 2021-03-10T13:59:12.774325+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: cluster 2021-03-10T13:59:11.429123+0000 mgr.gibba043.dnkmem (mgr.34373) 469 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.625569+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:59:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.626703+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T13:59:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.627104+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:59:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.627792+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.628840+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T13:59:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.629073+0000 mon.c (mon.1) 183 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.630197+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.630577+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T13:59:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.757888+0000 mon.c (mon.1) 184 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.758229+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.774074+0000 mon.c (mon.1) 185 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:13 gibba043 bash[24019]: audit 2021-03-10T13:59:12.774325+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:14 gibba003 bash[31385]: audit 2021-03-10T13:59:12.895965+0000 mgr.gibba043.dnkmem (mgr.34373) 470 : audit [DBG] from='client.44379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:14 gibba003 bash[31385]: audit 2021-03-10T13:59:13.121085+0000 mgr.gibba043.dnkmem (mgr.34373) 471 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:14 gibba003 bash[31385]: audit 2021-03-10T13:59:13.386464+0000 mon.a (mon.0) 503 : audit [DBG] from='client.? 172.21.2.103:0/932509171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:14 gibba003 bash[32348]: audit 2021-03-10T13:59:12.895965+0000 mgr.gibba043.dnkmem (mgr.34373) 470 : audit [DBG] from='client.44379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:14 gibba003 bash[32348]: audit 2021-03-10T13:59:13.121085+0000 mgr.gibba043.dnkmem (mgr.34373) 471 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:14 gibba003 bash[32348]: audit 2021-03-10T13:59:13.386464+0000 mon.a (mon.0) 503 : audit [DBG] from='client.? 172.21.2.103:0/932509171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:14.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:14 gibba043 bash[24019]: audit 2021-03-10T13:59:12.895965+0000 mgr.gibba043.dnkmem (mgr.34373) 470 : audit [DBG] from='client.44379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:14 gibba043 bash[24019]: audit 2021-03-10T13:59:13.121085+0000 mgr.gibba043.dnkmem (mgr.34373) 471 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:14 gibba043 bash[24019]: audit 2021-03-10T13:59:13.386464+0000 mon.a (mon.0) 503 : audit [DBG] from='client.? 172.21.2.103:0/932509171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:15 gibba003 bash[31385]: cluster 2021-03-10T13:59:13.430737+0000 mgr.gibba043.dnkmem (mgr.34373) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:15 gibba003 bash[32348]: cluster 2021-03-10T13:59:13.430737+0000 mgr.gibba043.dnkmem (mgr.34373) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:15.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:15 gibba043 bash[24019]: cluster 2021-03-10T13:59:13.430737+0000 mgr.gibba043.dnkmem (mgr.34373) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:17 gibba003 bash[31385]: cluster 2021-03-10T13:59:15.432096+0000 mgr.gibba043.dnkmem (mgr.34373) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:17 gibba003 bash[32348]: cluster 2021-03-10T13:59:15.432096+0000 mgr.gibba043.dnkmem (mgr.34373) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:17.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:17 gibba043 bash[24019]: cluster 2021-03-10T13:59:15.432096+0000 mgr.gibba043.dnkmem (mgr.34373) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:19 gibba003 bash[31385]: cluster 2021-03-10T13:59:17.433626+0000 mgr.gibba043.dnkmem (mgr.34373) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:19 gibba003 bash[32348]: cluster 2021-03-10T13:59:17.433626+0000 mgr.gibba043.dnkmem (mgr.34373) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:19.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:19 gibba043 bash[24019]: cluster 2021-03-10T13:59:17.433626+0000 mgr.gibba043.dnkmem (mgr.34373) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:21 gibba003 bash[31385]: cluster 2021-03-10T13:59:19.435275+0000 mgr.gibba043.dnkmem (mgr.34373) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:21 gibba003 bash[32348]: cluster 2021-03-10T13:59:19.435275+0000 mgr.gibba043.dnkmem (mgr.34373) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:21.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:21 gibba043 bash[24019]: cluster 2021-03-10T13:59:19.435275+0000 mgr.gibba043.dnkmem (mgr.34373) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:23 gibba003 bash[31385]: cluster 2021-03-10T13:59:21.436926+0000 mgr.gibba043.dnkmem (mgr.34373) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:23 gibba003 bash[32348]: cluster 2021-03-10T13:59:21.436926+0000 mgr.gibba043.dnkmem (mgr.34373) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:23.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:23 gibba043 bash[24019]: cluster 2021-03-10T13:59:21.436926+0000 mgr.gibba043.dnkmem (mgr.34373) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: cluster 2021-03-10T13:59:23.438416+0000 mgr.gibba043.dnkmem (mgr.34373) 477 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.783321+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:59:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.787336+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.790383+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.793195+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.795785+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.806149+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[31385]: audit 2021-03-10T13:59:24.812843+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: cluster 2021-03-10T13:59:23.438416+0000 mgr.gibba043.dnkmem (mgr.34373) 477 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.783321+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:59:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.787336+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.790383+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.793195+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.795785+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.806149+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:25 gibba003 bash[32348]: audit 2021-03-10T13:59:24.812843+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: cluster 2021-03-10T13:59:23.438416+0000 mgr.gibba043.dnkmem (mgr.34373) 477 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:25.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.783321+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T13:59:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.787336+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.790383+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.793195+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.795785+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.806149+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:25 gibba043 bash[24019]: audit 2021-03-10T13:59:24.812843+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.557492+0000 mgr.gibba043.dnkmem (mgr.34373) 478 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:59:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.559041+0000 mgr.gibba043.dnkmem (mgr.34373) 479 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:59:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.787779+0000 mgr.gibba043.dnkmem (mgr.34373) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.791199+0000 mgr.gibba043.dnkmem (mgr.34373) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.793919+0000 mgr.gibba043.dnkmem (mgr.34373) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.794039+0000 mgr.gibba043.dnkmem (mgr.34373) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.796647+0000 mgr.gibba043.dnkmem (mgr.34373) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.796684+0000 mgr.gibba043.dnkmem (mgr.34373) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.799749+0000 mgr.gibba043.dnkmem (mgr.34373) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.805302+0000 mgr.gibba043.dnkmem (mgr.34373) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.805511+0000 mgr.gibba043.dnkmem (mgr.34373) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.811016+0000 mgr.gibba043.dnkmem (mgr.34373) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.813012+0000 mgr.gibba043.dnkmem (mgr.34373) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.818055+0000 mgr.gibba043.dnkmem (mgr.34373) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.818688+0000 mgr.gibba043.dnkmem (mgr.34373) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[31385]: cephadm 2021-03-10T13:59:24.819275+0000 mgr.gibba043.dnkmem (mgr.34373) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.557492+0000 mgr.gibba043.dnkmem (mgr.34373) 478 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:59:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.559041+0000 mgr.gibba043.dnkmem (mgr.34373) 479 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:59:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.787779+0000 mgr.gibba043.dnkmem (mgr.34373) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.791199+0000 mgr.gibba043.dnkmem (mgr.34373) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.793919+0000 mgr.gibba043.dnkmem (mgr.34373) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.794039+0000 mgr.gibba043.dnkmem (mgr.34373) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.796647+0000 mgr.gibba043.dnkmem (mgr.34373) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.796684+0000 mgr.gibba043.dnkmem (mgr.34373) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.799749+0000 mgr.gibba043.dnkmem (mgr.34373) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.805302+0000 mgr.gibba043.dnkmem (mgr.34373) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.805511+0000 mgr.gibba043.dnkmem (mgr.34373) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.811016+0000 mgr.gibba043.dnkmem (mgr.34373) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.813012+0000 mgr.gibba043.dnkmem (mgr.34373) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.818055+0000 mgr.gibba043.dnkmem (mgr.34373) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.818688+0000 mgr.gibba043.dnkmem (mgr.34373) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:26 gibba003 bash[32348]: cephadm 2021-03-10T13:59:24.819275+0000 mgr.gibba043.dnkmem (mgr.34373) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.557492+0000 mgr.gibba043.dnkmem (mgr.34373) 478 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T13:59:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.559041+0000 mgr.gibba043.dnkmem (mgr.34373) 479 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T13:59:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.787779+0000 mgr.gibba043.dnkmem (mgr.34373) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.791199+0000 mgr.gibba043.dnkmem (mgr.34373) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.793919+0000 mgr.gibba043.dnkmem (mgr.34373) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.794039+0000 mgr.gibba043.dnkmem (mgr.34373) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.796647+0000 mgr.gibba043.dnkmem (mgr.34373) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.796684+0000 mgr.gibba043.dnkmem (mgr.34373) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.799749+0000 mgr.gibba043.dnkmem (mgr.34373) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.805302+0000 mgr.gibba043.dnkmem (mgr.34373) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.805511+0000 mgr.gibba043.dnkmem (mgr.34373) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.811016+0000 mgr.gibba043.dnkmem (mgr.34373) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.813012+0000 mgr.gibba043.dnkmem (mgr.34373) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.818055+0000 mgr.gibba043.dnkmem (mgr.34373) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.818688+0000 mgr.gibba043.dnkmem (mgr.34373) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:26 gibba043 bash[24019]: cephadm 2021-03-10T13:59:24.819275+0000 mgr.gibba043.dnkmem (mgr.34373) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:27 gibba003 bash[31385]: cluster 2021-03-10T13:59:25.440026+0000 mgr.gibba043.dnkmem (mgr.34373) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:27 gibba003 bash[32348]: cluster 2021-03-10T13:59:25.440026+0000 mgr.gibba043.dnkmem (mgr.34373) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:27.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:27 gibba043 bash[24019]: cluster 2021-03-10T13:59:25.440026+0000 mgr.gibba043.dnkmem (mgr.34373) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:28.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:28 gibba003 bash[31385]: cluster 2021-03-10T13:59:27.441466+0000 mgr.gibba043.dnkmem (mgr.34373) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:28.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:28 gibba003 bash[32348]: cluster 2021-03-10T13:59:27.441466+0000 mgr.gibba043.dnkmem (mgr.34373) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:28.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:28 gibba043 bash[24019]: cluster 2021-03-10T13:59:27.441466+0000 mgr.gibba043.dnkmem (mgr.34373) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:30.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:30 gibba043 bash[24019]: cluster 2021-03-10T13:59:29.443269+0000 mgr.gibba043.dnkmem (mgr.34373) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:30.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:30 gibba003 bash[31385]: cluster 2021-03-10T13:59:29.443269+0000 mgr.gibba043.dnkmem (mgr.34373) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:30.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:30 gibba003 bash[32348]: cluster 2021-03-10T13:59:29.443269+0000 mgr.gibba043.dnkmem (mgr.34373) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:33.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:32 gibba003 bash[31385]: cluster 2021-03-10T13:59:31.444777+0000 mgr.gibba043.dnkmem (mgr.34373) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:32 gibba003 bash[32348]: cluster 2021-03-10T13:59:31.444777+0000 mgr.gibba043.dnkmem (mgr.34373) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:33.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:32 gibba043 bash[24019]: cluster 2021-03-10T13:59:31.444777+0000 mgr.gibba043.dnkmem (mgr.34373) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:34 gibba003 bash[31385]: cluster 2021-03-10T13:59:33.446059+0000 mgr.gibba043.dnkmem (mgr.34373) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:34 gibba003 bash[32348]: cluster 2021-03-10T13:59:33.446059+0000 mgr.gibba043.dnkmem (mgr.34373) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:34 gibba043 bash[24019]: cluster 2021-03-10T13:59:33.446059+0000 mgr.gibba043.dnkmem (mgr.34373) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:36 gibba003 bash[31385]: cluster 2021-03-10T13:59:35.447308+0000 mgr.gibba043.dnkmem (mgr.34373) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:36 gibba003 bash[32348]: cluster 2021-03-10T13:59:35.447308+0000 mgr.gibba043.dnkmem (mgr.34373) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:37.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:36 gibba043 bash[24019]: cluster 2021-03-10T13:59:35.447308+0000 mgr.gibba043.dnkmem (mgr.34373) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:38 gibba003 bash[31385]: cluster 2021-03-10T13:59:37.448923+0000 mgr.gibba043.dnkmem (mgr.34373) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:38 gibba003 bash[32348]: cluster 2021-03-10T13:59:37.448923+0000 mgr.gibba043.dnkmem (mgr.34373) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:39.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:38 gibba043 bash[24019]: cluster 2021-03-10T13:59:37.448923+0000 mgr.gibba043.dnkmem (mgr.34373) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:40 gibba003 bash[31385]: cluster 2021-03-10T13:59:39.450559+0000 mgr.gibba043.dnkmem (mgr.34373) 501 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:40 gibba003 bash[31385]: cephadm 2021-03-10T13:59:39.832375+0000 mgr.gibba043.dnkmem (mgr.34373) 502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:40 gibba003 bash[32348]: cluster 2021-03-10T13:59:39.450559+0000 mgr.gibba043.dnkmem (mgr.34373) 501 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:40 gibba003 bash[32348]: cephadm 2021-03-10T13:59:39.832375+0000 mgr.gibba043.dnkmem (mgr.34373) 502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:41.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:40 gibba043 bash[24019]: cluster 2021-03-10T13:59:39.450559+0000 mgr.gibba043.dnkmem (mgr.34373) 501 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:40 gibba043 bash[24019]: cephadm 2021-03-10T13:59:39.832375+0000 mgr.gibba043.dnkmem (mgr.34373) 502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:43.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:42 gibba003 bash[31385]: cluster 2021-03-10T13:59:41.452064+0000 mgr.gibba043.dnkmem (mgr.34373) 503 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:43.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:42 gibba003 bash[32348]: cluster 2021-03-10T13:59:41.452064+0000 mgr.gibba043.dnkmem (mgr.34373) 503 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:43.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:42 gibba043 bash[24019]: cluster 2021-03-10T13:59:41.452064+0000 mgr.gibba043.dnkmem (mgr.34373) 503 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:43.625 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T13:59:43.851 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:59:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T13:59:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T13:59:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T13:59:43.853 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T13:59:43.853 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T13:59:43.853 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T13:59:43.853 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T13:59:43.854 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T13:59:43.854 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (13m) 5m ago 13m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T13:59:43.854 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (13m) 3m ago 13m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T13:59:43.854 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T13:59:43.855 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T13:59:43.855 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T13:59:43.855 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T13:59:43.855 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T13:59:43.855 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T13:59:43.856 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T13:59:43.856 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T13:59:43.856 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (12m) 3m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T13:59:43.856 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:59:44.103 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T13:59:44.103 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T13:59:44.103 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:44.103 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:59:44.104 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T13:59:44.104 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:44.104 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:59:44.104 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T13:59:44.105 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:59:44.105 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T13:59:44.105 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T13:59:44.105 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T13:59:44.106 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:59:44.106 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T13:59:44.106 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T13:59:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[31385]: cluster 2021-03-10T13:59:43.453477+0000 mgr.gibba043.dnkmem (mgr.34373) 504 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[31385]: audit 2021-03-10T13:59:43.618208+0000 mgr.gibba043.dnkmem (mgr.34373) 505 : audit [DBG] from='client.44397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[31385]: audit 2021-03-10T13:59:43.842408+0000 mgr.gibba043.dnkmem (mgr.34373) 506 : audit [DBG] from='client.54388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[31385]: audit 2021-03-10T13:59:44.103206+0000 mon.a (mon.0) 505 : audit [DBG] from='client.? 172.21.2.103:0/1059200069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[32348]: cluster 2021-03-10T13:59:43.453477+0000 mgr.gibba043.dnkmem (mgr.34373) 504 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[32348]: audit 2021-03-10T13:59:43.618208+0000 mgr.gibba043.dnkmem (mgr.34373) 505 : audit [DBG] from='client.44397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[32348]: audit 2021-03-10T13:59:43.842408+0000 mgr.gibba043.dnkmem (mgr.34373) 506 : audit [DBG] from='client.54388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:44 gibba003 bash[32348]: audit 2021-03-10T13:59:44.103206+0000 mon.a (mon.0) 505 : audit [DBG] from='client.? 172.21.2.103:0/1059200069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:45.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:44 gibba043 bash[24019]: cluster 2021-03-10T13:59:43.453477+0000 mgr.gibba043.dnkmem (mgr.34373) 504 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:44 gibba043 bash[24019]: audit 2021-03-10T13:59:43.618208+0000 mgr.gibba043.dnkmem (mgr.34373) 505 : audit [DBG] from='client.44397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:44 gibba043 bash[24019]: audit 2021-03-10T13:59:43.842408+0000 mgr.gibba043.dnkmem (mgr.34373) 506 : audit [DBG] from='client.54388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:44 gibba043 bash[24019]: audit 2021-03-10T13:59:44.103206+0000 mon.a (mon.0) 505 : audit [DBG] from='client.? 172.21.2.103:0/1059200069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:46 gibba003 bash[31385]: cluster 2021-03-10T13:59:45.455100+0000 mgr.gibba043.dnkmem (mgr.34373) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:46 gibba003 bash[32348]: cluster 2021-03-10T13:59:45.455100+0000 mgr.gibba043.dnkmem (mgr.34373) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:46 gibba043 bash[24019]: cluster 2021-03-10T13:59:45.455100+0000 mgr.gibba043.dnkmem (mgr.34373) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:48 gibba003 bash[31385]: cluster 2021-03-10T13:59:47.456693+0000 mgr.gibba043.dnkmem (mgr.34373) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:48 gibba003 bash[32348]: cluster 2021-03-10T13:59:47.456693+0000 mgr.gibba043.dnkmem (mgr.34373) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:48 gibba043 bash[24019]: cluster 2021-03-10T13:59:47.456693+0000 mgr.gibba043.dnkmem (mgr.34373) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:50 gibba003 bash[31385]: cluster 2021-03-10T13:59:49.458471+0000 mgr.gibba043.dnkmem (mgr.34373) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:50 gibba003 bash[32348]: cluster 2021-03-10T13:59:49.458471+0000 mgr.gibba043.dnkmem (mgr.34373) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:51.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:50 gibba043 bash[24019]: cluster 2021-03-10T13:59:49.458471+0000 mgr.gibba043.dnkmem (mgr.34373) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:52 gibba003 bash[31385]: cluster 2021-03-10T13:59:51.459265+0000 mgr.gibba043.dnkmem (mgr.34373) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:52 gibba003 bash[32348]: cluster 2021-03-10T13:59:51.459265+0000 mgr.gibba043.dnkmem (mgr.34373) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:53.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:52 gibba043 bash[24019]: cluster 2021-03-10T13:59:51.459265+0000 mgr.gibba043.dnkmem (mgr.34373) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:54 gibba003 bash[31385]: cluster 2021-03-10T13:59:53.460703+0000 mgr.gibba043.dnkmem (mgr.34373) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:54 gibba003 bash[32348]: cluster 2021-03-10T13:59:53.460703+0000 mgr.gibba043.dnkmem (mgr.34373) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:55.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:54 gibba043 bash[24019]: cluster 2021-03-10T13:59:53.460703+0000 mgr.gibba043.dnkmem (mgr.34373) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:55 gibba003 bash[31385]: cephadm 2021-03-10T13:59:54.834527+0000 mgr.gibba043.dnkmem (mgr.34373) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:55 gibba003 bash[32348]: cephadm 2021-03-10T13:59:54.834527+0000 mgr.gibba043.dnkmem (mgr.34373) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:55 gibba043 bash[24019]: cephadm 2021-03-10T13:59:54.834527+0000 mgr.gibba043.dnkmem (mgr.34373) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T13:59:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:56 gibba003 bash[31385]: cluster 2021-03-10T13:59:55.462276+0000 mgr.gibba043.dnkmem (mgr.34373) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:56 gibba003 bash[32348]: cluster 2021-03-10T13:59:55.462276+0000 mgr.gibba043.dnkmem (mgr.34373) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:57.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:56 gibba043 bash[24019]: cluster 2021-03-10T13:59:55.462276+0000 mgr.gibba043.dnkmem (mgr.34373) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 13:59:58 gibba003 bash[31385]: cluster 2021-03-10T13:59:57.463873+0000 mgr.gibba043.dnkmem (mgr.34373) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 13:59:58 gibba003 bash[32348]: cluster 2021-03-10T13:59:57.463873+0000 mgr.gibba043.dnkmem (mgr.34373) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:59.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 13:59:58 gibba043 bash[24019]: cluster 2021-03-10T13:59:57.463873+0000 mgr.gibba043.dnkmem (mgr.34373) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:00 gibba003 bash[31385]: debug 2021-03-10T13:59:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:00 gibba003 bash[31385]: cluster 2021-03-10T13:59:59.465625+0000 mgr.gibba043.dnkmem (mgr.34373) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:00 gibba003 bash[31385]: cluster 2021-03-10T14:00:00.000450+0000 mon.a (mon.0) 506 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:00 gibba003 bash[32348]: cluster 2021-03-10T13:59:59.465625+0000 mgr.gibba043.dnkmem (mgr.34373) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:00 gibba003 bash[32348]: cluster 2021-03-10T14:00:00.000450+0000 mon.a (mon.0) 506 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:00 gibba043 bash[24019]: cluster 2021-03-10T13:59:59.465625+0000 mgr.gibba043.dnkmem (mgr.34373) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:01.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:00 gibba043 bash[24019]: cluster 2021-03-10T14:00:00.000450+0000 mon.a (mon.0) 506 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:03.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:02 gibba003 bash[31385]: cluster 2021-03-10T14:00:01.466361+0000 mgr.gibba043.dnkmem (mgr.34373) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:02 gibba003 bash[32348]: cluster 2021-03-10T14:00:01.466361+0000 mgr.gibba043.dnkmem (mgr.34373) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:03.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:02 gibba043 bash[24019]: cluster 2021-03-10T14:00:01.466361+0000 mgr.gibba043.dnkmem (mgr.34373) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:05.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:04 gibba003 bash[31385]: cluster 2021-03-10T14:00:03.467887+0000 mgr.gibba043.dnkmem (mgr.34373) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:05.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:04 gibba003 bash[32348]: cluster 2021-03-10T14:00:03.467887+0000 mgr.gibba043.dnkmem (mgr.34373) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:04 gibba043 bash[24019]: cluster 2021-03-10T14:00:03.467887+0000 mgr.gibba043.dnkmem (mgr.34373) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:06 gibba003 bash[31385]: cluster 2021-03-10T14:00:05.469150+0000 mgr.gibba043.dnkmem (mgr.34373) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:06 gibba003 bash[32348]: cluster 2021-03-10T14:00:05.469150+0000 mgr.gibba043.dnkmem (mgr.34373) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:07.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:06 gibba043 bash[24019]: cluster 2021-03-10T14:00:05.469150+0000 mgr.gibba043.dnkmem (mgr.34373) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:09.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:08 gibba043 bash[24019]: cluster 2021-03-10T14:00:07.470506+0000 mgr.gibba043.dnkmem (mgr.34373) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:08 gibba003 bash[31385]: cluster 2021-03-10T14:00:07.470506+0000 mgr.gibba043.dnkmem (mgr.34373) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:08 gibba003 bash[32348]: cluster 2021-03-10T14:00:07.470506+0000 mgr.gibba043.dnkmem (mgr.34373) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:11.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:10 gibba043 bash[24019]: cluster 2021-03-10T14:00:09.472291+0000 mgr.gibba043.dnkmem (mgr.34373) 520 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:11.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:10 gibba043 bash[24019]: cephadm 2021-03-10T14:00:09.850334+0000 mgr.gibba043.dnkmem (mgr.34373) 521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:10 gibba003 bash[31385]: cluster 2021-03-10T14:00:09.472291+0000 mgr.gibba043.dnkmem (mgr.34373) 520 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:10 gibba003 bash[31385]: cephadm 2021-03-10T14:00:09.850334+0000 mgr.gibba043.dnkmem (mgr.34373) 521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:10 gibba003 bash[32348]: cluster 2021-03-10T14:00:09.472291+0000 mgr.gibba043.dnkmem (mgr.34373) 520 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:10 gibba003 bash[32348]: cephadm 2021-03-10T14:00:09.850334+0000 mgr.gibba043.dnkmem (mgr.34373) 521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: cluster 2021-03-10T14:00:11.472902+0000 mgr.gibba043.dnkmem (mgr.34373) 522 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.633975+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:00:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.634744+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.635212+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:00:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.635478+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.636301+0000 mon.c (mon.1) 195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.636509+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.637644+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.638464+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.762519+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.763640+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.779997+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:12 gibba043 bash[24019]: audit 2021-03-10T14:00:12.781148+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: cluster 2021-03-10T14:00:11.472902+0000 mgr.gibba043.dnkmem (mgr.34373) 522 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.633975+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:00:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.634744+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.635212+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.635478+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.636301+0000 mon.c (mon.1) 195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.636509+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.637644+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.638464+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.762519+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.763640+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:13.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.779997+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:13.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[31385]: audit 2021-03-10T14:00:12.781148+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: cluster 2021-03-10T14:00:11.472902+0000 mgr.gibba043.dnkmem (mgr.34373) 522 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.633975+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:00:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.634744+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.635212+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:00:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.635478+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.636301+0000 mon.c (mon.1) 195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.636509+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.637644+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.638464+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:00:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.762519+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.763640+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.779997+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:12 gibba003 bash[32348]: audit 2021-03-10T14:00:12.781148+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:14.353 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:00:14.584 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:00:14.584 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:00:14.585 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:00:14.585 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:00:14.585 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (9m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:00:14.586 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:00:14.586 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:00:14.587 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:00:14.587 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:00:14.588 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (14m) 5m ago 14m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:00:14.588 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (14m) 3m ago 14m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:00:14.589 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:00:14.589 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:00:14.590 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:00:14.590 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:00:14.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:00:14.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:00:14.592 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:00:14.592 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:00:14.593 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (13m) 3m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:00:14.593 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:00:14.835 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:00:14.835 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:00:14.836 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:14.836 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:00:14.836 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:00:14.836 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:14.837 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:00:14.837 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:00:14.837 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:00:14.837 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:00:14.837 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:00:14.838 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:00:14.838 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:00:14.838 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:00:14.838 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:00:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:14 gibba043 bash[24019]: cluster 2021-03-10T14:00:13.474399+0000 mgr.gibba043.dnkmem (mgr.34373) 523 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:14 gibba043 bash[24019]: audit 2021-03-10T14:00:14.835978+0000 mon.a (mon.0) 513 : audit [DBG] from='client.? 172.21.2.103:0/3916118197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:14 gibba003 bash[31385]: cluster 2021-03-10T14:00:13.474399+0000 mgr.gibba043.dnkmem (mgr.34373) 523 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:14 gibba003 bash[31385]: audit 2021-03-10T14:00:14.835978+0000 mon.a (mon.0) 513 : audit [DBG] from='client.? 172.21.2.103:0/3916118197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:14 gibba003 bash[32348]: cluster 2021-03-10T14:00:13.474399+0000 mgr.gibba043.dnkmem (mgr.34373) 523 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:14 gibba003 bash[32348]: audit 2021-03-10T14:00:14.835978+0000 mon.a (mon.0) 513 : audit [DBG] from='client.? 172.21.2.103:0/3916118197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:15 gibba043 bash[24019]: audit 2021-03-10T14:00:14.346017+0000 mgr.gibba043.dnkmem (mgr.34373) 524 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:16.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:15 gibba043 bash[24019]: audit 2021-03-10T14:00:14.572350+0000 mgr.gibba043.dnkmem (mgr.34373) 525 : audit [DBG] from='client.54406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:16.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:15 gibba003 bash[31385]: audit 2021-03-10T14:00:14.346017+0000 mgr.gibba043.dnkmem (mgr.34373) 524 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:16.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:15 gibba003 bash[31385]: audit 2021-03-10T14:00:14.572350+0000 mgr.gibba043.dnkmem (mgr.34373) 525 : audit [DBG] from='client.54406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:15 gibba003 bash[32348]: audit 2021-03-10T14:00:14.346017+0000 mgr.gibba043.dnkmem (mgr.34373) 524 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:15 gibba003 bash[32348]: audit 2021-03-10T14:00:14.572350+0000 mgr.gibba043.dnkmem (mgr.34373) 525 : audit [DBG] from='client.54406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:17.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:16 gibba043 bash[24019]: cluster 2021-03-10T14:00:15.475882+0000 mgr.gibba043.dnkmem (mgr.34373) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:16 gibba003 bash[31385]: cluster 2021-03-10T14:00:15.475882+0000 mgr.gibba043.dnkmem (mgr.34373) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:16 gibba003 bash[32348]: cluster 2021-03-10T14:00:15.475882+0000 mgr.gibba043.dnkmem (mgr.34373) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:19 gibba043 bash[24019]: cluster 2021-03-10T14:00:17.477297+0000 mgr.gibba043.dnkmem (mgr.34373) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:19 gibba003 bash[31385]: cluster 2021-03-10T14:00:17.477297+0000 mgr.gibba043.dnkmem (mgr.34373) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:19 gibba003 bash[32348]: cluster 2021-03-10T14:00:17.477297+0000 mgr.gibba043.dnkmem (mgr.34373) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:21.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:21 gibba043 bash[24019]: cluster 2021-03-10T14:00:19.479100+0000 mgr.gibba043.dnkmem (mgr.34373) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:21 gibba003 bash[31385]: cluster 2021-03-10T14:00:19.479100+0000 mgr.gibba043.dnkmem (mgr.34373) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:21 gibba003 bash[32348]: cluster 2021-03-10T14:00:19.479100+0000 mgr.gibba043.dnkmem (mgr.34373) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:23 gibba003 bash[31385]: cluster 2021-03-10T14:00:21.479896+0000 mgr.gibba043.dnkmem (mgr.34373) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:23 gibba003 bash[32348]: cluster 2021-03-10T14:00:21.479896+0000 mgr.gibba043.dnkmem (mgr.34373) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:23 gibba043 bash[24019]: cluster 2021-03-10T14:00:21.479896+0000 mgr.gibba043.dnkmem (mgr.34373) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:25 gibba003 bash[31385]: cluster 2021-03-10T14:00:23.481109+0000 mgr.gibba043.dnkmem (mgr.34373) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:25 gibba003 bash[32348]: cluster 2021-03-10T14:00:23.481109+0000 mgr.gibba043.dnkmem (mgr.34373) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:25.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:25 gibba043 bash[24019]: cluster 2021-03-10T14:00:23.481109+0000 mgr.gibba043.dnkmem (mgr.34373) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:26.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:24.866771+0000 mgr.gibba043.dnkmem (mgr.34373) 531 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:00:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:24.868224+0000 mgr.gibba043.dnkmem (mgr.34373) 532 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:00:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.094689+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:00:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.098507+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.099412+0000 mgr.gibba043.dnkmem (mgr.34373) 533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.100213+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.101392+0000 mgr.gibba043.dnkmem (mgr.34373) 534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.101850+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.102980+0000 mgr.gibba043.dnkmem (mgr.34373) 535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.103018+0000 mgr.gibba043.dnkmem (mgr.34373) 536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.103242+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.104700+0000 mgr.gibba043.dnkmem (mgr.34373) 537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:26.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.104738+0000 mgr.gibba043.dnkmem (mgr.34373) 538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.106151+0000 mgr.gibba043.dnkmem (mgr.34373) 539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.109142+0000 mgr.gibba043.dnkmem (mgr.34373) 540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:26.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.109268+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.109612+0000 mgr.gibba043.dnkmem (mgr.34373) 541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:26.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.113097+0000 mgr.gibba043.dnkmem (mgr.34373) 542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:26.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: audit 2021-03-10T14:00:25.113814+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.114961+0000 mgr.gibba043.dnkmem (mgr.34373) 543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:26.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.117670+0000 mgr.gibba043.dnkmem (mgr.34373) 544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:24.866771+0000 mgr.gibba043.dnkmem (mgr.34373) 531 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:00:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:24.868224+0000 mgr.gibba043.dnkmem (mgr.34373) 532 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:00:26.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.094689+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:00:26.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.098507+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:26.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.099412+0000 mgr.gibba043.dnkmem (mgr.34373) 533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:26.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.100213+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.101392+0000 mgr.gibba043.dnkmem (mgr.34373) 534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:26.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.101850+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.102980+0000 mgr.gibba043.dnkmem (mgr.34373) 535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:26.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.103018+0000 mgr.gibba043.dnkmem (mgr.34373) 536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:26.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.103242+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.104700+0000 mgr.gibba043.dnkmem (mgr.34373) 537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:26.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.104738+0000 mgr.gibba043.dnkmem (mgr.34373) 538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:26.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.106151+0000 mgr.gibba043.dnkmem (mgr.34373) 539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:26.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.109142+0000 mgr.gibba043.dnkmem (mgr.34373) 540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:26.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.109268+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.109612+0000 mgr.gibba043.dnkmem (mgr.34373) 541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:26.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.113097+0000 mgr.gibba043.dnkmem (mgr.34373) 542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:26.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: audit 2021-03-10T14:00:25.113814+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.114961+0000 mgr.gibba043.dnkmem (mgr.34373) 543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:26.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.117670+0000 mgr.gibba043.dnkmem (mgr.34373) 544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:26.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.118022+0000 mgr.gibba043.dnkmem (mgr.34373) 545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:26.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[31385]: cephadm 2021-03-10T14:00:25.118552+0000 mgr.gibba043.dnkmem (mgr.34373) 546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:26.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.118022+0000 mgr.gibba043.dnkmem (mgr.34373) 545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:26.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:26 gibba003 bash[32348]: cephadm 2021-03-10T14:00:25.118552+0000 mgr.gibba043.dnkmem (mgr.34373) 546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:24.866771+0000 mgr.gibba043.dnkmem (mgr.34373) 531 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:00:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:24.868224+0000 mgr.gibba043.dnkmem (mgr.34373) 532 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:00:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.094689+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:00:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.098507+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.099412+0000 mgr.gibba043.dnkmem (mgr.34373) 533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.100213+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.101392+0000 mgr.gibba043.dnkmem (mgr.34373) 534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.101850+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.102980+0000 mgr.gibba043.dnkmem (mgr.34373) 535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.103018+0000 mgr.gibba043.dnkmem (mgr.34373) 536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:26.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.103242+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.104700+0000 mgr.gibba043.dnkmem (mgr.34373) 537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.104738+0000 mgr.gibba043.dnkmem (mgr.34373) 538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.106151+0000 mgr.gibba043.dnkmem (mgr.34373) 539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.109142+0000 mgr.gibba043.dnkmem (mgr.34373) 540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:26.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.109268+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.109612+0000 mgr.gibba043.dnkmem (mgr.34373) 541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.113097+0000 mgr.gibba043.dnkmem (mgr.34373) 542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: audit 2021-03-10T14:00:25.113814+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.114961+0000 mgr.gibba043.dnkmem (mgr.34373) 543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.117670+0000 mgr.gibba043.dnkmem (mgr.34373) 544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.118022+0000 mgr.gibba043.dnkmem (mgr.34373) 545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:26 gibba043 bash[24019]: cephadm 2021-03-10T14:00:25.118552+0000 mgr.gibba043.dnkmem (mgr.34373) 546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:27 gibba003 bash[31385]: cluster 2021-03-10T14:00:25.482472+0000 mgr.gibba043.dnkmem (mgr.34373) 547 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:27 gibba003 bash[32348]: cluster 2021-03-10T14:00:25.482472+0000 mgr.gibba043.dnkmem (mgr.34373) 547 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:27.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:27 gibba043 bash[24019]: cluster 2021-03-10T14:00:25.482472+0000 mgr.gibba043.dnkmem (mgr.34373) 547 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:29 gibba003 bash[31385]: cluster 2021-03-10T14:00:27.484019+0000 mgr.gibba043.dnkmem (mgr.34373) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:29 gibba003 bash[32348]: cluster 2021-03-10T14:00:27.484019+0000 mgr.gibba043.dnkmem (mgr.34373) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:29.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:29 gibba043 bash[24019]: cluster 2021-03-10T14:00:27.484019+0000 mgr.gibba043.dnkmem (mgr.34373) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:31 gibba003 bash[32348]: cluster 2021-03-10T14:00:29.485513+0000 mgr.gibba043.dnkmem (mgr.34373) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:31 gibba003 bash[31385]: cluster 2021-03-10T14:00:29.485513+0000 mgr.gibba043.dnkmem (mgr.34373) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:31 gibba043 bash[24019]: cluster 2021-03-10T14:00:29.485513+0000 mgr.gibba043.dnkmem (mgr.34373) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:33 gibba003 bash[31385]: cluster 2021-03-10T14:00:31.487139+0000 mgr.gibba043.dnkmem (mgr.34373) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:33 gibba003 bash[32348]: cluster 2021-03-10T14:00:31.487139+0000 mgr.gibba043.dnkmem (mgr.34373) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:33 gibba043 bash[24019]: cluster 2021-03-10T14:00:31.487139+0000 mgr.gibba043.dnkmem (mgr.34373) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:35 gibba003 bash[31385]: cluster 2021-03-10T14:00:33.488668+0000 mgr.gibba043.dnkmem (mgr.34373) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:35 gibba003 bash[32348]: cluster 2021-03-10T14:00:33.488668+0000 mgr.gibba043.dnkmem (mgr.34373) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:35.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:35 gibba043 bash[24019]: cluster 2021-03-10T14:00:33.488668+0000 mgr.gibba043.dnkmem (mgr.34373) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:37 gibba003 bash[31385]: cluster 2021-03-10T14:00:35.490057+0000 mgr.gibba043.dnkmem (mgr.34373) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:37 gibba003 bash[32348]: cluster 2021-03-10T14:00:35.490057+0000 mgr.gibba043.dnkmem (mgr.34373) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:37.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:37 gibba043 bash[24019]: cluster 2021-03-10T14:00:35.490057+0000 mgr.gibba043.dnkmem (mgr.34373) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:39 gibba003 bash[31385]: cluster 2021-03-10T14:00:37.491601+0000 mgr.gibba043.dnkmem (mgr.34373) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:39 gibba003 bash[32348]: cluster 2021-03-10T14:00:37.491601+0000 mgr.gibba043.dnkmem (mgr.34373) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:39.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:39 gibba043 bash[24019]: cluster 2021-03-10T14:00:37.491601+0000 mgr.gibba043.dnkmem (mgr.34373) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:41 gibba003 bash[31385]: cluster 2021-03-10T14:00:39.493422+0000 mgr.gibba043.dnkmem (mgr.34373) 554 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:41 gibba003 bash[31385]: cephadm 2021-03-10T14:00:40.123939+0000 mgr.gibba043.dnkmem (mgr.34373) 555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:41 gibba003 bash[32348]: cluster 2021-03-10T14:00:39.493422+0000 mgr.gibba043.dnkmem (mgr.34373) 554 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:41 gibba003 bash[32348]: cephadm 2021-03-10T14:00:40.123939+0000 mgr.gibba043.dnkmem (mgr.34373) 555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:41 gibba043 bash[24019]: cluster 2021-03-10T14:00:39.493422+0000 mgr.gibba043.dnkmem (mgr.34373) 554 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:41 gibba043 bash[24019]: cephadm 2021-03-10T14:00:40.123939+0000 mgr.gibba043.dnkmem (mgr.34373) 555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:43 gibba003 bash[31385]: cluster 2021-03-10T14:00:41.494285+0000 mgr.gibba043.dnkmem (mgr.34373) 556 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:43 gibba003 bash[32348]: cluster 2021-03-10T14:00:41.494285+0000 mgr.gibba043.dnkmem (mgr.34373) 556 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:43.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:43 gibba043 bash[24019]: cluster 2021-03-10T14:00:41.494285+0000 mgr.gibba043.dnkmem (mgr.34373) 556 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:44.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:44 gibba043 bash[24019]: cluster 2021-03-10T14:00:43.495781+0000 mgr.gibba043.dnkmem (mgr.34373) 557 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:44.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:44 gibba003 bash[31385]: cluster 2021-03-10T14:00:43.495781+0000 mgr.gibba043.dnkmem (mgr.34373) 557 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:44 gibba003 bash[32348]: cluster 2021-03-10T14:00:43.495781+0000 mgr.gibba043.dnkmem (mgr.34373) 557 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:45.080 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:00:45.308 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:00:45.308 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:00:45.308 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:00:45.309 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:00:45.309 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:00:45.309 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:00:45.309 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:00:45.310 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:00:45.310 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:00:45.310 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (14m) 6m ago 14m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:00:45.310 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (14m) 4m ago 14m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:00:45.310 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:00:45.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:00:45.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:00:45.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:00:45.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:00:45.312 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:00:45.312 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:00:45.312 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:00:45.312 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (13m) 4m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:00:45.313 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:00:45.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:45 gibba043 bash[24019]: audit 2021-03-10T14:00:45.073502+0000 mgr.gibba043.dnkmem (mgr.34373) 558 : audit [DBG] from='client.54418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:45.555 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:00:45.555 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:00:45.555 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:45.556 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:00:45.556 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:00:45.556 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:45.556 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:00:45.557 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:00:45.557 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:00:45.557 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:00:45.557 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:00:45.557 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:00:45.558 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:00:45.558 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:00:45.558 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:00:45.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:45 gibba003 bash[31385]: audit 2021-03-10T14:00:45.073502+0000 mgr.gibba043.dnkmem (mgr.34373) 558 : audit [DBG] from='client.54418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:45.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:45 gibba003 bash[32348]: audit 2021-03-10T14:00:45.073502+0000 mgr.gibba043.dnkmem (mgr.34373) 558 : audit [DBG] from='client.54418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:46 gibba043 bash[24019]: audit 2021-03-10T14:00:45.298222+0000 mgr.gibba043.dnkmem (mgr.34373) 559 : audit [DBG] from='client.54424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:46 gibba043 bash[24019]: cluster 2021-03-10T14:00:45.497016+0000 mgr.gibba043.dnkmem (mgr.34373) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:46 gibba043 bash[24019]: audit 2021-03-10T14:00:45.555681+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.2.103:0/863761253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:46.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:46 gibba003 bash[31385]: audit 2021-03-10T14:00:45.298222+0000 mgr.gibba043.dnkmem (mgr.34373) 559 : audit [DBG] from='client.54424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:46.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:46 gibba003 bash[31385]: cluster 2021-03-10T14:00:45.497016+0000 mgr.gibba043.dnkmem (mgr.34373) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:46.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:46 gibba003 bash[31385]: audit 2021-03-10T14:00:45.555681+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.2.103:0/863761253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:46.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:46 gibba003 bash[32348]: audit 2021-03-10T14:00:45.298222+0000 mgr.gibba043.dnkmem (mgr.34373) 559 : audit [DBG] from='client.54424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:46.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:46 gibba003 bash[32348]: cluster 2021-03-10T14:00:45.497016+0000 mgr.gibba043.dnkmem (mgr.34373) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:46.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:46 gibba003 bash[32348]: audit 2021-03-10T14:00:45.555681+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.2.103:0/863761253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:48 gibba003 bash[31385]: cluster 2021-03-10T14:00:47.498629+0000 mgr.gibba043.dnkmem (mgr.34373) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:48 gibba003 bash[32348]: cluster 2021-03-10T14:00:47.498629+0000 mgr.gibba043.dnkmem (mgr.34373) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:48 gibba043 bash[24019]: cluster 2021-03-10T14:00:47.498629+0000 mgr.gibba043.dnkmem (mgr.34373) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:50 gibba003 bash[31385]: cluster 2021-03-10T14:00:49.500471+0000 mgr.gibba043.dnkmem (mgr.34373) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:50 gibba003 bash[32348]: cluster 2021-03-10T14:00:49.500471+0000 mgr.gibba043.dnkmem (mgr.34373) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:51.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:50 gibba043 bash[24019]: cluster 2021-03-10T14:00:49.500471+0000 mgr.gibba043.dnkmem (mgr.34373) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:52 gibba003 bash[31385]: cluster 2021-03-10T14:00:51.501365+0000 mgr.gibba043.dnkmem (mgr.34373) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:52 gibba003 bash[32348]: cluster 2021-03-10T14:00:51.501365+0000 mgr.gibba043.dnkmem (mgr.34373) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:52 gibba043 bash[24019]: cluster 2021-03-10T14:00:51.501365+0000 mgr.gibba043.dnkmem (mgr.34373) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:55.138 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:54 gibba043 bash[24019]: cluster 2021-03-10T14:00:53.502877+0000 mgr.gibba043.dnkmem (mgr.34373) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:54 gibba003 bash[31385]: cluster 2021-03-10T14:00:53.502877+0000 mgr.gibba043.dnkmem (mgr.34373) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:54 gibba003 bash[32348]: cluster 2021-03-10T14:00:53.502877+0000 mgr.gibba043.dnkmem (mgr.34373) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:55 gibba003 bash[31385]: cephadm 2021-03-10T14:00:55.140077+0000 mgr.gibba043.dnkmem (mgr.34373) 565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:55 gibba003 bash[32348]: cephadm 2021-03-10T14:00:55.140077+0000 mgr.gibba043.dnkmem (mgr.34373) 565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:55 gibba043 bash[24019]: cephadm 2021-03-10T14:00:55.140077+0000 mgr.gibba043.dnkmem (mgr.34373) 565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:00:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:56 gibba003 bash[31385]: cluster 2021-03-10T14:00:55.504311+0000 mgr.gibba043.dnkmem (mgr.34373) 566 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:56 gibba003 bash[32348]: cluster 2021-03-10T14:00:55.504311+0000 mgr.gibba043.dnkmem (mgr.34373) 566 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:57.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:56 gibba043 bash[24019]: cluster 2021-03-10T14:00:55.504311+0000 mgr.gibba043.dnkmem (mgr.34373) 566 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:00:58 gibba003 bash[31385]: cluster 2021-03-10T14:00:57.505674+0000 mgr.gibba043.dnkmem (mgr.34373) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:00:58 gibba003 bash[32348]: cluster 2021-03-10T14:00:57.505674+0000 mgr.gibba043.dnkmem (mgr.34373) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:59.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:00:58 gibba043 bash[24019]: cluster 2021-03-10T14:00:57.505674+0000 mgr.gibba043.dnkmem (mgr.34373) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:00 gibba003 bash[31385]: cluster 2021-03-10T14:00:59.507174+0000 mgr.gibba043.dnkmem (mgr.34373) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:00 gibba003 bash[32348]: cluster 2021-03-10T14:00:59.507174+0000 mgr.gibba043.dnkmem (mgr.34373) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:00 gibba043 bash[24019]: cluster 2021-03-10T14:00:59.507174+0000 mgr.gibba043.dnkmem (mgr.34373) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:03.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:02 gibba003 bash[31385]: cluster 2021-03-10T14:01:01.508139+0000 mgr.gibba043.dnkmem (mgr.34373) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:02 gibba003 bash[32348]: cluster 2021-03-10T14:01:01.508139+0000 mgr.gibba043.dnkmem (mgr.34373) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:03.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:02 gibba043 bash[24019]: cluster 2021-03-10T14:01:01.508139+0000 mgr.gibba043.dnkmem (mgr.34373) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:04 gibba003 bash[31385]: cluster 2021-03-10T14:01:03.509561+0000 mgr.gibba043.dnkmem (mgr.34373) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:04 gibba003 bash[32348]: cluster 2021-03-10T14:01:03.509561+0000 mgr.gibba043.dnkmem (mgr.34373) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:04 gibba043 bash[24019]: cluster 2021-03-10T14:01:03.509561+0000 mgr.gibba043.dnkmem (mgr.34373) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:06 gibba003 bash[31385]: cluster 2021-03-10T14:01:05.511106+0000 mgr.gibba043.dnkmem (mgr.34373) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:07.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:06 gibba003 bash[32348]: cluster 2021-03-10T14:01:05.511106+0000 mgr.gibba043.dnkmem (mgr.34373) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:07.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:06 gibba043 bash[24019]: cluster 2021-03-10T14:01:05.511106+0000 mgr.gibba043.dnkmem (mgr.34373) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:08 gibba003 bash[31385]: cluster 2021-03-10T14:01:07.512782+0000 mgr.gibba043.dnkmem (mgr.34373) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:08 gibba003 bash[32348]: cluster 2021-03-10T14:01:07.512782+0000 mgr.gibba043.dnkmem (mgr.34373) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:09.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:08 gibba043 bash[24019]: cluster 2021-03-10T14:01:07.512782+0000 mgr.gibba043.dnkmem (mgr.34373) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:10 gibba003 bash[31385]: cluster 2021-03-10T14:01:09.514595+0000 mgr.gibba043.dnkmem (mgr.34373) 573 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:10 gibba003 bash[31385]: cephadm 2021-03-10T14:01:10.152434+0000 mgr.gibba043.dnkmem (mgr.34373) 574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:10 gibba003 bash[32348]: cluster 2021-03-10T14:01:09.514595+0000 mgr.gibba043.dnkmem (mgr.34373) 573 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:10 gibba003 bash[32348]: cephadm 2021-03-10T14:01:10.152434+0000 mgr.gibba043.dnkmem (mgr.34373) 574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:11.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:10 gibba043 bash[24019]: cluster 2021-03-10T14:01:09.514595+0000 mgr.gibba043.dnkmem (mgr.34373) 573 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:10 gibba043 bash[24019]: cephadm 2021-03-10T14:01:10.152434+0000 mgr.gibba043.dnkmem (mgr.34373) 574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: cluster 2021-03-10T14:01:11.515488+0000 mgr.gibba043.dnkmem (mgr.34373) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.639912+0000 mon.c (mon.1) 205 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:01:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.640652+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.641165+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:01:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.641346+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.642033+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:01:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.643248+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.644344+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.645239+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:01:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.768724+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.769860+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.787982+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[31385]: audit 2021-03-10T14:01:12.789132+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: cluster 2021-03-10T14:01:11.515488+0000 mgr.gibba043.dnkmem (mgr.34373) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.639912+0000 mon.c (mon.1) 205 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:01:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.640652+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.641165+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:01:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.641346+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.642033+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:01:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.643248+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.644344+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.645239+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:01:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.768724+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.769860+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.787982+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:12 gibba003 bash[32348]: audit 2021-03-10T14:01:12.789132+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:13.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: cluster 2021-03-10T14:01:11.515488+0000 mgr.gibba043.dnkmem (mgr.34373) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:13.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.639912+0000 mon.c (mon.1) 205 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:01:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.640652+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.641165+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:01:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.641346+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.642033+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:01:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.643248+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.644344+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.645239+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:01:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.768724+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.769860+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.787982+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:12 gibba043 bash[24019]: audit 2021-03-10T14:01:12.789132+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:14 gibba043 bash[24019]: cluster 2021-03-10T14:01:13.517017+0000 mgr.gibba043.dnkmem (mgr.34373) 576 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:14 gibba003 bash[31385]: cluster 2021-03-10T14:01:13.517017+0000 mgr.gibba043.dnkmem (mgr.34373) 576 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:14 gibba003 bash[32348]: cluster 2021-03-10T14:01:13.517017+0000 mgr.gibba043.dnkmem (mgr.34373) 576 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:15.800 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:01:16.060 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:01:16.060 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:01:16.061 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:01:16.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (9m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:01:16.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (10m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:01:16.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:01:16.062 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:01:16.062 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:01:16.062 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:01:16.062 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (15m) 6m ago 15m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:01:16.063 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (15m) 4m ago 15m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:01:16.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:01:16.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:01:16.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:01:16.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:01:16.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:01:16.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:01:16.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:01:16.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:01:16.065 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (14m) 4m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:01:16.065 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:01:16.313 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:01:16.313 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:01:16.314 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:16.314 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:01:16.314 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:01:16.314 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:16.315 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:01:16.315 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:01:16.315 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:01:16.315 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:01:16.315 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:01:16.316 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:01:16.316 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:01:16.316 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:01:16.316 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:01:17.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:16 gibba043 bash[24019]: cluster 2021-03-10T14:01:15.518472+0000 mgr.gibba043.dnkmem (mgr.34373) 577 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:17.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:16 gibba043 bash[24019]: audit 2021-03-10T14:01:15.793777+0000 mgr.gibba043.dnkmem (mgr.34373) 578 : audit [DBG] from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:17.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:16 gibba043 bash[24019]: audit 2021-03-10T14:01:16.023738+0000 mgr.gibba043.dnkmem (mgr.34373) 579 : audit [DBG] from='client.44457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:17.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:16 gibba043 bash[24019]: audit 2021-03-10T14:01:16.313568+0000 mon.a (mon.0) 521 : audit [DBG] from='client.? 172.21.2.103:0/1118291311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[31385]: cluster 2021-03-10T14:01:15.518472+0000 mgr.gibba043.dnkmem (mgr.34373) 577 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[31385]: audit 2021-03-10T14:01:15.793777+0000 mgr.gibba043.dnkmem (mgr.34373) 578 : audit [DBG] from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[31385]: audit 2021-03-10T14:01:16.023738+0000 mgr.gibba043.dnkmem (mgr.34373) 579 : audit [DBG] from='client.44457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[31385]: audit 2021-03-10T14:01:16.313568+0000 mon.a (mon.0) 521 : audit [DBG] from='client.? 172.21.2.103:0/1118291311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[32348]: cluster 2021-03-10T14:01:15.518472+0000 mgr.gibba043.dnkmem (mgr.34373) 577 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[32348]: audit 2021-03-10T14:01:15.793777+0000 mgr.gibba043.dnkmem (mgr.34373) 578 : audit [DBG] from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[32348]: audit 2021-03-10T14:01:16.023738+0000 mgr.gibba043.dnkmem (mgr.34373) 579 : audit [DBG] from='client.44457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:16 gibba003 bash[32348]: audit 2021-03-10T14:01:16.313568+0000 mon.a (mon.0) 521 : audit [DBG] from='client.? 172.21.2.103:0/1118291311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:18 gibba043 bash[24019]: cluster 2021-03-10T14:01:17.520079+0000 mgr.gibba043.dnkmem (mgr.34373) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:18 gibba003 bash[31385]: cluster 2021-03-10T14:01:17.520079+0000 mgr.gibba043.dnkmem (mgr.34373) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:18 gibba003 bash[32348]: cluster 2021-03-10T14:01:17.520079+0000 mgr.gibba043.dnkmem (mgr.34373) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:20 gibba043 bash[24019]: cluster 2021-03-10T14:01:19.521887+0000 mgr.gibba043.dnkmem (mgr.34373) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:20 gibba003 bash[31385]: cluster 2021-03-10T14:01:19.521887+0000 mgr.gibba043.dnkmem (mgr.34373) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:20 gibba003 bash[32348]: cluster 2021-03-10T14:01:19.521887+0000 mgr.gibba043.dnkmem (mgr.34373) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:23.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:22 gibba043 bash[24019]: cluster 2021-03-10T14:01:21.522880+0000 mgr.gibba043.dnkmem (mgr.34373) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:22 gibba003 bash[31385]: cluster 2021-03-10T14:01:21.522880+0000 mgr.gibba043.dnkmem (mgr.34373) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:22 gibba003 bash[32348]: cluster 2021-03-10T14:01:21.522880+0000 mgr.gibba043.dnkmem (mgr.34373) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:24 gibba043 bash[24019]: cluster 2021-03-10T14:01:23.524497+0000 mgr.gibba043.dnkmem (mgr.34373) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:24 gibba003 bash[31385]: cluster 2021-03-10T14:01:23.524497+0000 mgr.gibba043.dnkmem (mgr.34373) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:24 gibba003 bash[32348]: cluster 2021-03-10T14:01:23.524497+0000 mgr.gibba043.dnkmem (mgr.34373) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.169033+0000 mgr.gibba043.dnkmem (mgr.34373) 584 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:01:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.170555+0000 mgr.gibba043.dnkmem (mgr.34373) 585 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:01:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.397563+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:01:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.401057+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.402881+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.404035+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.405108+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.407542+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:25 gibba043 bash[24019]: audit 2021-03-10T14:01:25.409096+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.169033+0000 mgr.gibba043.dnkmem (mgr.34373) 584 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:01:26.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.170555+0000 mgr.gibba043.dnkmem (mgr.34373) 585 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:01:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.397563+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:01:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.401057+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.402881+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.404035+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.405108+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.407542+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[31385]: audit 2021-03-10T14:01:25.409096+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.169033+0000 mgr.gibba043.dnkmem (mgr.34373) 584 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:01:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.170555+0000 mgr.gibba043.dnkmem (mgr.34373) 585 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:01:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.397563+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:01:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.401057+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.402881+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.404035+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.405108+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.407542+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:25 gibba003 bash[32348]: audit 2021-03-10T14:01:25.409096+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:27.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.402418+0000 mgr.gibba043.dnkmem (mgr.34373) 586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:27.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.404440+0000 mgr.gibba043.dnkmem (mgr.34373) 587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.405718+0000 mgr.gibba043.dnkmem (mgr.34373) 588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.405760+0000 mgr.gibba043.dnkmem (mgr.34373) 589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.406819+0000 mgr.gibba043.dnkmem (mgr.34373) 590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.406859+0000 mgr.gibba043.dnkmem (mgr.34373) 591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.407764+0000 mgr.gibba043.dnkmem (mgr.34373) 592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.409165+0000 mgr.gibba043.dnkmem (mgr.34373) 593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.409208+0000 mgr.gibba043.dnkmem (mgr.34373) 594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.410394+0000 mgr.gibba043.dnkmem (mgr.34373) 595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.410739+0000 mgr.gibba043.dnkmem (mgr.34373) 596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.411996+0000 mgr.gibba043.dnkmem (mgr.34373) 597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.412039+0000 mgr.gibba043.dnkmem (mgr.34373) 598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cephadm 2021-03-10T14:01:25.412242+0000 mgr.gibba043.dnkmem (mgr.34373) 599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:26 gibba043 bash[24019]: cluster 2021-03-10T14:01:25.526013+0000 mgr.gibba043.dnkmem (mgr.34373) 600 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.402418+0000 mgr.gibba043.dnkmem (mgr.34373) 586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.404440+0000 mgr.gibba043.dnkmem (mgr.34373) 587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.405718+0000 mgr.gibba043.dnkmem (mgr.34373) 588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.405760+0000 mgr.gibba043.dnkmem (mgr.34373) 589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.406819+0000 mgr.gibba043.dnkmem (mgr.34373) 590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.406859+0000 mgr.gibba043.dnkmem (mgr.34373) 591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.407764+0000 mgr.gibba043.dnkmem (mgr.34373) 592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.409165+0000 mgr.gibba043.dnkmem (mgr.34373) 593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.409208+0000 mgr.gibba043.dnkmem (mgr.34373) 594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.410394+0000 mgr.gibba043.dnkmem (mgr.34373) 595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.410739+0000 mgr.gibba043.dnkmem (mgr.34373) 596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.411996+0000 mgr.gibba043.dnkmem (mgr.34373) 597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.412039+0000 mgr.gibba043.dnkmem (mgr.34373) 598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cephadm 2021-03-10T14:01:25.412242+0000 mgr.gibba043.dnkmem (mgr.34373) 599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[31385]: cluster 2021-03-10T14:01:25.526013+0000 mgr.gibba043.dnkmem (mgr.34373) 600 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.402418+0000 mgr.gibba043.dnkmem (mgr.34373) 586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.404440+0000 mgr.gibba043.dnkmem (mgr.34373) 587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.405718+0000 mgr.gibba043.dnkmem (mgr.34373) 588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.405760+0000 mgr.gibba043.dnkmem (mgr.34373) 589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.406819+0000 mgr.gibba043.dnkmem (mgr.34373) 590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.406859+0000 mgr.gibba043.dnkmem (mgr.34373) 591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.407764+0000 mgr.gibba043.dnkmem (mgr.34373) 592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.409165+0000 mgr.gibba043.dnkmem (mgr.34373) 593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.409208+0000 mgr.gibba043.dnkmem (mgr.34373) 594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.410394+0000 mgr.gibba043.dnkmem (mgr.34373) 595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.410739+0000 mgr.gibba043.dnkmem (mgr.34373) 596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.411996+0000 mgr.gibba043.dnkmem (mgr.34373) 597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.412039+0000 mgr.gibba043.dnkmem (mgr.34373) 598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:27.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cephadm 2021-03-10T14:01:25.412242+0000 mgr.gibba043.dnkmem (mgr.34373) 599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:27.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:26 gibba003 bash[32348]: cluster 2021-03-10T14:01:25.526013+0000 mgr.gibba043.dnkmem (mgr.34373) 600 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:29.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:29 gibba043 bash[24019]: cluster 2021-03-10T14:01:27.527423+0000 mgr.gibba043.dnkmem (mgr.34373) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:29 gibba003 bash[31385]: cluster 2021-03-10T14:01:27.527423+0000 mgr.gibba043.dnkmem (mgr.34373) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:29 gibba003 bash[32348]: cluster 2021-03-10T14:01:27.527423+0000 mgr.gibba043.dnkmem (mgr.34373) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:31.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:31 gibba043 bash[24019]: cluster 2021-03-10T14:01:29.529327+0000 mgr.gibba043.dnkmem (mgr.34373) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:31 gibba003 bash[31385]: cluster 2021-03-10T14:01:29.529327+0000 mgr.gibba043.dnkmem (mgr.34373) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:31 gibba003 bash[32348]: cluster 2021-03-10T14:01:29.529327+0000 mgr.gibba043.dnkmem (mgr.34373) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:33 gibba003 bash[31385]: cluster 2021-03-10T14:01:31.530448+0000 mgr.gibba043.dnkmem (mgr.34373) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:33 gibba003 bash[32348]: cluster 2021-03-10T14:01:31.530448+0000 mgr.gibba043.dnkmem (mgr.34373) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:33 gibba043 bash[24019]: cluster 2021-03-10T14:01:31.530448+0000 mgr.gibba043.dnkmem (mgr.34373) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:35 gibba003 bash[31385]: cluster 2021-03-10T14:01:33.531917+0000 mgr.gibba043.dnkmem (mgr.34373) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:35 gibba003 bash[32348]: cluster 2021-03-10T14:01:33.531917+0000 mgr.gibba043.dnkmem (mgr.34373) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:35.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:35 gibba043 bash[24019]: cluster 2021-03-10T14:01:33.531917+0000 mgr.gibba043.dnkmem (mgr.34373) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:37 gibba003 bash[31385]: cluster 2021-03-10T14:01:35.533083+0000 mgr.gibba043.dnkmem (mgr.34373) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:37 gibba003 bash[32348]: cluster 2021-03-10T14:01:35.533083+0000 mgr.gibba043.dnkmem (mgr.34373) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:37.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:37 gibba043 bash[24019]: cluster 2021-03-10T14:01:35.533083+0000 mgr.gibba043.dnkmem (mgr.34373) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:39 gibba003 bash[31385]: cluster 2021-03-10T14:01:37.534579+0000 mgr.gibba043.dnkmem (mgr.34373) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:39 gibba003 bash[32348]: cluster 2021-03-10T14:01:37.534579+0000 mgr.gibba043.dnkmem (mgr.34373) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:39.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:39 gibba043 bash[24019]: cluster 2021-03-10T14:01:37.534579+0000 mgr.gibba043.dnkmem (mgr.34373) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:41 gibba003 bash[31385]: cluster 2021-03-10T14:01:39.536252+0000 mgr.gibba043.dnkmem (mgr.34373) 607 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:41 gibba003 bash[32348]: cluster 2021-03-10T14:01:39.536252+0000 mgr.gibba043.dnkmem (mgr.34373) 607 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:41.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:41 gibba043 bash[24019]: cluster 2021-03-10T14:01:39.536252+0000 mgr.gibba043.dnkmem (mgr.34373) 607 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:42 gibba003 bash[31385]: cephadm 2021-03-10T14:01:40.428312+0000 mgr.gibba043.dnkmem (mgr.34373) 608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:42 gibba003 bash[32348]: cephadm 2021-03-10T14:01:40.428312+0000 mgr.gibba043.dnkmem (mgr.34373) 608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:42.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:42 gibba043 bash[24019]: cephadm 2021-03-10T14:01:40.428312+0000 mgr.gibba043.dnkmem (mgr.34373) 608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:43 gibba003 bash[31385]: cluster 2021-03-10T14:01:41.537268+0000 mgr.gibba043.dnkmem (mgr.34373) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:43 gibba003 bash[32348]: cluster 2021-03-10T14:01:41.537268+0000 mgr.gibba043.dnkmem (mgr.34373) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:43.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:43 gibba043 bash[24019]: cluster 2021-03-10T14:01:41.537268+0000 mgr.gibba043.dnkmem (mgr.34373) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:45 gibba003 bash[31385]: cluster 2021-03-10T14:01:43.538673+0000 mgr.gibba043.dnkmem (mgr.34373) 610 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:45 gibba003 bash[32348]: cluster 2021-03-10T14:01:43.538673+0000 mgr.gibba043.dnkmem (mgr.34373) 610 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:45.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:45 gibba043 bash[24019]: cluster 2021-03-10T14:01:43.538673+0000 mgr.gibba043.dnkmem (mgr.34373) 610 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:46.570 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:01:46.800 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:01:46.800 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:01:46.801 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:01:46.801 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:01:46.801 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:01:46.801 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:01:46.802 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:01:46.802 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:01:46.802 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:01:46.802 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (15m) 7m ago 15m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:01:46.803 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (15m) 5m ago 15m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:01:46.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:01:46.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:01:46.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:01:46.804 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:01:46.804 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:01:46.804 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:01:46.804 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:01:46.805 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:01:46.805 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (14m) 5m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:01:46.805 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:01:47.046 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:01:47.046 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:01:47.046 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:47.047 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:01:47.047 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:01:47.047 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:47.047 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:01:47.048 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:01:47.048 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:01:47.048 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:01:47.049 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:01:47.049 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:01:47.049 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:01:47.049 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:01:47.050 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:01:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:47 gibba003 bash[31385]: cluster 2021-03-10T14:01:45.540118+0000 mgr.gibba043.dnkmem (mgr.34373) 611 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:47 gibba003 bash[31385]: audit 2021-03-10T14:01:47.046596+0000 mon.a (mon.0) 523 : audit [DBG] from='client.? 172.21.2.103:0/4219808683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:47 gibba003 bash[32348]: cluster 2021-03-10T14:01:45.540118+0000 mgr.gibba043.dnkmem (mgr.34373) 611 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:47 gibba003 bash[32348]: audit 2021-03-10T14:01:47.046596+0000 mon.a (mon.0) 523 : audit [DBG] from='client.? 172.21.2.103:0/4219808683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:47.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:47 gibba043 bash[24019]: cluster 2021-03-10T14:01:45.540118+0000 mgr.gibba043.dnkmem (mgr.34373) 611 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:47.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:47 gibba043 bash[24019]: audit 2021-03-10T14:01:47.046596+0000 mon.a (mon.0) 523 : audit [DBG] from='client.? 172.21.2.103:0/4219808683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:48.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:48 gibba003 bash[31385]: audit 2021-03-10T14:01:46.555283+0000 mgr.gibba043.dnkmem (mgr.34373) 612 : audit [DBG] from='client.54454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:48 gibba003 bash[31385]: audit 2021-03-10T14:01:46.791095+0000 mgr.gibba043.dnkmem (mgr.34373) 613 : audit [DBG] from='client.54460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:48.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:48 gibba003 bash[32348]: audit 2021-03-10T14:01:46.555283+0000 mgr.gibba043.dnkmem (mgr.34373) 612 : audit [DBG] from='client.54454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:48 gibba003 bash[32348]: audit 2021-03-10T14:01:46.791095+0000 mgr.gibba043.dnkmem (mgr.34373) 613 : audit [DBG] from='client.54460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:48.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:48 gibba043 bash[24019]: audit 2021-03-10T14:01:46.555283+0000 mgr.gibba043.dnkmem (mgr.34373) 612 : audit [DBG] from='client.54454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:48.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:48 gibba043 bash[24019]: audit 2021-03-10T14:01:46.791095+0000 mgr.gibba043.dnkmem (mgr.34373) 613 : audit [DBG] from='client.54460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:49 gibba003 bash[31385]: cluster 2021-03-10T14:01:47.541471+0000 mgr.gibba043.dnkmem (mgr.34373) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:49 gibba003 bash[32348]: cluster 2021-03-10T14:01:47.541471+0000 mgr.gibba043.dnkmem (mgr.34373) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:49.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:49 gibba043 bash[24019]: cluster 2021-03-10T14:01:47.541471+0000 mgr.gibba043.dnkmem (mgr.34373) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:51 gibba003 bash[31385]: cluster 2021-03-10T14:01:49.543200+0000 mgr.gibba043.dnkmem (mgr.34373) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:51 gibba003 bash[32348]: cluster 2021-03-10T14:01:49.543200+0000 mgr.gibba043.dnkmem (mgr.34373) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:51 gibba043 bash[24019]: cluster 2021-03-10T14:01:49.543200+0000 mgr.gibba043.dnkmem (mgr.34373) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:53 gibba003 bash[31385]: cluster 2021-03-10T14:01:51.544405+0000 mgr.gibba043.dnkmem (mgr.34373) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:53 gibba003 bash[32348]: cluster 2021-03-10T14:01:51.544405+0000 mgr.gibba043.dnkmem (mgr.34373) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:53.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:53 gibba043 bash[24019]: cluster 2021-03-10T14:01:51.544405+0000 mgr.gibba043.dnkmem (mgr.34373) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:55.436 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:55 gibba043 bash[24019]: cluster 2021-03-10T14:01:53.545951+0000 mgr.gibba043.dnkmem (mgr.34373) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:55 gibba003 bash[31385]: cluster 2021-03-10T14:01:53.545951+0000 mgr.gibba043.dnkmem (mgr.34373) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:55 gibba003 bash[32348]: cluster 2021-03-10T14:01:53.545951+0000 mgr.gibba043.dnkmem (mgr.34373) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:57 gibba003 bash[31385]: cephadm 2021-03-10T14:01:55.438583+0000 mgr.gibba043.dnkmem (mgr.34373) 618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:57 gibba003 bash[31385]: cluster 2021-03-10T14:01:55.547537+0000 mgr.gibba043.dnkmem (mgr.34373) 619 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:57 gibba003 bash[32348]: cephadm 2021-03-10T14:01:55.438583+0000 mgr.gibba043.dnkmem (mgr.34373) 618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:57 gibba003 bash[32348]: cluster 2021-03-10T14:01:55.547537+0000 mgr.gibba043.dnkmem (mgr.34373) 619 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:57.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:57 gibba043 bash[24019]: cephadm 2021-03-10T14:01:55.438583+0000 mgr.gibba043.dnkmem (mgr.34373) 618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:01:57.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:57 gibba043 bash[24019]: cluster 2021-03-10T14:01:55.547537+0000 mgr.gibba043.dnkmem (mgr.34373) 619 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:01:59 gibba003 bash[31385]: cluster 2021-03-10T14:01:57.548975+0000 mgr.gibba043.dnkmem (mgr.34373) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:01:59 gibba003 bash[32348]: cluster 2021-03-10T14:01:57.548975+0000 mgr.gibba043.dnkmem (mgr.34373) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:59.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:01:59 gibba043 bash[24019]: cluster 2021-03-10T14:01:57.548975+0000 mgr.gibba043.dnkmem (mgr.34373) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:01 gibba003 bash[31385]: cluster 2021-03-10T14:01:59.550593+0000 mgr.gibba043.dnkmem (mgr.34373) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:01 gibba003 bash[32348]: cluster 2021-03-10T14:01:59.550593+0000 mgr.gibba043.dnkmem (mgr.34373) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:01.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:01 gibba043 bash[24019]: cluster 2021-03-10T14:01:59.550593+0000 mgr.gibba043.dnkmem (mgr.34373) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:03 gibba003 bash[31385]: cluster 2021-03-10T14:02:01.552253+0000 mgr.gibba043.dnkmem (mgr.34373) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:03 gibba003 bash[32348]: cluster 2021-03-10T14:02:01.552253+0000 mgr.gibba043.dnkmem (mgr.34373) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:03 gibba043 bash[24019]: cluster 2021-03-10T14:02:01.552253+0000 mgr.gibba043.dnkmem (mgr.34373) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:05 gibba003 bash[31385]: cluster 2021-03-10T14:02:03.553749+0000 mgr.gibba043.dnkmem (mgr.34373) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:05 gibba003 bash[32348]: cluster 2021-03-10T14:02:03.553749+0000 mgr.gibba043.dnkmem (mgr.34373) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:05 gibba043 bash[24019]: cluster 2021-03-10T14:02:03.553749+0000 mgr.gibba043.dnkmem (mgr.34373) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:07 gibba003 bash[31385]: cluster 2021-03-10T14:02:05.555408+0000 mgr.gibba043.dnkmem (mgr.34373) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:07 gibba003 bash[32348]: cluster 2021-03-10T14:02:05.555408+0000 mgr.gibba043.dnkmem (mgr.34373) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:07.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:07 gibba043 bash[24019]: cluster 2021-03-10T14:02:05.555408+0000 mgr.gibba043.dnkmem (mgr.34373) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:09 gibba003 bash[31385]: cluster 2021-03-10T14:02:07.556844+0000 mgr.gibba043.dnkmem (mgr.34373) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:09 gibba003 bash[32348]: cluster 2021-03-10T14:02:07.556844+0000 mgr.gibba043.dnkmem (mgr.34373) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:09.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:09 gibba043 bash[24019]: cluster 2021-03-10T14:02:07.556844+0000 mgr.gibba043.dnkmem (mgr.34373) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:11.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:11 gibba043 bash[24019]: cluster 2021-03-10T14:02:09.558567+0000 mgr.gibba043.dnkmem (mgr.34373) 626 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:11 gibba003 bash[31385]: cluster 2021-03-10T14:02:09.558567+0000 mgr.gibba043.dnkmem (mgr.34373) 626 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:11 gibba003 bash[32348]: cluster 2021-03-10T14:02:09.558567+0000 mgr.gibba043.dnkmem (mgr.34373) 626 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:12.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:12 gibba043 bash[24019]: cephadm 2021-03-10T14:02:10.454597+0000 mgr.gibba043.dnkmem (mgr.34373) 627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:12.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:12 gibba003 bash[31385]: cephadm 2021-03-10T14:02:10.454597+0000 mgr.gibba043.dnkmem (mgr.34373) 627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:12.757 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:12 gibba003 bash[32348]: cephadm 2021-03-10T14:02:10.454597+0000 mgr.gibba043.dnkmem (mgr.34373) 627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:13.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: cluster 2021-03-10T14:02:11.560249+0000 mgr.gibba043.dnkmem (mgr.34373) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.646514+0000 mon.c (mon.1) 217 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.647290+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.647892+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.648427+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.649819+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.650425+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.651403+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.651537+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.776547+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.777692+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.796092+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:13 gibba043 bash[24019]: audit 2021-03-10T14:02:12.797240+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: cluster 2021-03-10T14:02:11.560249+0000 mgr.gibba043.dnkmem (mgr.34373) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:13.744 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.646514+0000 mon.c (mon.1) 217 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:13.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.647290+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.647892+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:13.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.648427+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.649819+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.745 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.650425+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.651403+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.651537+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.776547+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:13.746 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.777692+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:13.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.796092+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:13.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[31385]: audit 2021-03-10T14:02:12.797240+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:13.747 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: cluster 2021-03-10T14:02:11.560249+0000 mgr.gibba043.dnkmem (mgr.34373) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:13.747 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.646514+0000 mon.c (mon.1) 217 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:13.748 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.647290+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.748 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.647892+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:13.748 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.648427+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.748 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.649819+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.749 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.650425+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.749 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.651403+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.749 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.651537+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:13.749 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.776547+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:13.749 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.777692+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:13.750 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.796092+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:13.750 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:13 gibba003 bash[32348]: audit 2021-03-10T14:02:12.797240+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:14.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:14 gibba043 bash[24019]: cluster 2021-03-10T14:02:13.561609+0000 mgr.gibba043.dnkmem (mgr.34373) 629 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:14 gibba003 bash[31385]: cluster 2021-03-10T14:02:13.561609+0000 mgr.gibba043.dnkmem (mgr.34373) 629 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:14 gibba003 bash[32348]: cluster 2021-03-10T14:02:13.561609+0000 mgr.gibba043.dnkmem (mgr.34373) 629 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:16 gibba003 bash[31385]: cluster 2021-03-10T14:02:15.562991+0000 mgr.gibba043.dnkmem (mgr.34373) 630 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:16.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:16 gibba003 bash[32348]: cluster 2021-03-10T14:02:15.562991+0000 mgr.gibba043.dnkmem (mgr.34373) 630 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:17.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:16 gibba043 bash[24019]: cluster 2021-03-10T14:02:15.562991+0000 mgr.gibba043.dnkmem (mgr.34373) 630 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:17.288 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:02:17.514 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:02:17.515 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:02:17.515 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:02:17.515 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:02:17.516 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:02:17.516 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:02:17.516 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:02:17.516 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:02:17.516 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:02:17.517 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (16m) 7m ago 16m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:02:17.517 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (16m) 5m ago 16m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:02:17.517 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:02:17.517 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:02:17.518 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:02:17.518 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:02:17.518 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:02:17.518 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:02:17.519 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:02:17.519 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:02:17.519 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (15m) 5m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:02:17.519 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:02:17.763 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:02:17.763 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:02:17.764 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:17.764 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:02:17.764 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:02:17.764 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:17.765 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:02:17.765 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:02:17.765 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:02:17.765 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:02:17.766 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:02:17.766 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:02:17.766 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:02:17.766 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:02:17.767 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:02:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:17 gibba003 bash[31385]: audit 2021-03-10T14:02:17.763859+0000 mon.c (mon.1) 223 : audit [DBG] from='client.? 172.21.2.103:0/2737294976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:17 gibba003 bash[32348]: audit 2021-03-10T14:02:17.763859+0000 mon.c (mon.1) 223 : audit [DBG] from='client.? 172.21.2.103:0/2737294976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:18.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:17 gibba043 bash[24019]: audit 2021-03-10T14:02:17.763859+0000 mon.c (mon.1) 223 : audit [DBG] from='client.? 172.21.2.103:0/2737294976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:18 gibba003 bash[31385]: audit 2021-03-10T14:02:17.281151+0000 mgr.gibba043.dnkmem (mgr.34373) 631 : audit [DBG] from='client.44487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:18 gibba003 bash[31385]: audit 2021-03-10T14:02:17.505551+0000 mgr.gibba043.dnkmem (mgr.34373) 632 : audit [DBG] from='client.44493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:18 gibba003 bash[31385]: cluster 2021-03-10T14:02:17.563981+0000 mgr.gibba043.dnkmem (mgr.34373) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:18 gibba003 bash[32348]: audit 2021-03-10T14:02:17.281151+0000 mgr.gibba043.dnkmem (mgr.34373) 631 : audit [DBG] from='client.44487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:18 gibba003 bash[32348]: audit 2021-03-10T14:02:17.505551+0000 mgr.gibba043.dnkmem (mgr.34373) 632 : audit [DBG] from='client.44493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:18 gibba003 bash[32348]: cluster 2021-03-10T14:02:17.563981+0000 mgr.gibba043.dnkmem (mgr.34373) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:19.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:18 gibba043 bash[24019]: audit 2021-03-10T14:02:17.281151+0000 mgr.gibba043.dnkmem (mgr.34373) 631 : audit [DBG] from='client.44487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:18 gibba043 bash[24019]: audit 2021-03-10T14:02:17.505551+0000 mgr.gibba043.dnkmem (mgr.34373) 632 : audit [DBG] from='client.44493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:18 gibba043 bash[24019]: cluster 2021-03-10T14:02:17.563981+0000 mgr.gibba043.dnkmem (mgr.34373) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:20 gibba003 bash[31385]: cluster 2021-03-10T14:02:19.565340+0000 mgr.gibba043.dnkmem (mgr.34373) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:20 gibba003 bash[32348]: cluster 2021-03-10T14:02:19.565340+0000 mgr.gibba043.dnkmem (mgr.34373) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:20 gibba043 bash[24019]: cluster 2021-03-10T14:02:19.565340+0000 mgr.gibba043.dnkmem (mgr.34373) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:22 gibba003 bash[31385]: cluster 2021-03-10T14:02:21.566883+0000 mgr.gibba043.dnkmem (mgr.34373) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:22 gibba003 bash[32348]: cluster 2021-03-10T14:02:21.566883+0000 mgr.gibba043.dnkmem (mgr.34373) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:23.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:22 gibba043 bash[24019]: cluster 2021-03-10T14:02:21.566883+0000 mgr.gibba043.dnkmem (mgr.34373) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:24 gibba003 bash[31385]: cluster 2021-03-10T14:02:23.568242+0000 mgr.gibba043.dnkmem (mgr.34373) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:24 gibba003 bash[32348]: cluster 2021-03-10T14:02:23.568242+0000 mgr.gibba043.dnkmem (mgr.34373) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:25.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:24 gibba043 bash[24019]: cluster 2021-03-10T14:02:23.568242+0000 mgr.gibba043.dnkmem (mgr.34373) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cluster 2021-03-10T14:02:25.568741+0000 mgr.gibba043.dnkmem (mgr.34373) 637 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.672357+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.676329+0000 mgr.gibba043.dnkmem (mgr.34373) 638 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:02:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.677716+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.682203+0000 mgr.gibba043.dnkmem (mgr.34373) 639 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:02:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.894024+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.898603+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.899980+0000 mgr.gibba043.dnkmem (mgr.34373) 640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.900081+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.901788+0000 mgr.gibba043.dnkmem (mgr.34373) 641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.902018+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.903583+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.903584+0000 mgr.gibba043.dnkmem (mgr.34373) 642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.903715+0000 mgr.gibba043.dnkmem (mgr.34373) 643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.905264+0000 mgr.gibba043.dnkmem (mgr.34373) 644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.905323+0000 mgr.gibba043.dnkmem (mgr.34373) 645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.908048+0000 mgr.gibba043.dnkmem (mgr.34373) 646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.911723+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.911927+0000 mgr.gibba043.dnkmem (mgr.34373) 647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.912303+0000 mgr.gibba043.dnkmem (mgr.34373) 648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.915993+0000 mgr.gibba043.dnkmem (mgr.34373) 649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cluster 2021-03-10T14:02:25.568741+0000 mgr.gibba043.dnkmem (mgr.34373) 637 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.672357+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.676329+0000 mgr.gibba043.dnkmem (mgr.34373) 638 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:02:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.677716+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.682203+0000 mgr.gibba043.dnkmem (mgr.34373) 639 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:02:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.894024+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.898603+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.899980+0000 mgr.gibba043.dnkmem (mgr.34373) 640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.900081+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.901788+0000 mgr.gibba043.dnkmem (mgr.34373) 641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.902018+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.903583+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.903584+0000 mgr.gibba043.dnkmem (mgr.34373) 642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.903715+0000 mgr.gibba043.dnkmem (mgr.34373) 643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.905264+0000 mgr.gibba043.dnkmem (mgr.34373) 644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.905323+0000 mgr.gibba043.dnkmem (mgr.34373) 645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.908048+0000 mgr.gibba043.dnkmem (mgr.34373) 646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.911723+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.911927+0000 mgr.gibba043.dnkmem (mgr.34373) 647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.912303+0000 mgr.gibba043.dnkmem (mgr.34373) 648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.915993+0000 mgr.gibba043.dnkmem (mgr.34373) 649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:26.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: audit 2021-03-10T14:02:25.916726+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.918233+0000 mgr.gibba043.dnkmem (mgr.34373) 650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:26.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.920995+0000 mgr.gibba043.dnkmem (mgr.34373) 651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:26.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.921300+0000 mgr.gibba043.dnkmem (mgr.34373) 652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:26.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[31385]: cephadm 2021-03-10T14:02:25.922022+0000 mgr.gibba043.dnkmem (mgr.34373) 653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:26.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: audit 2021-03-10T14:02:25.916726+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:26.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.918233+0000 mgr.gibba043.dnkmem (mgr.34373) 650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:26.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.920995+0000 mgr.gibba043.dnkmem (mgr.34373) 651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:26.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.921300+0000 mgr.gibba043.dnkmem (mgr.34373) 652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:26.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:26 gibba003 bash[32348]: cephadm 2021-03-10T14:02:25.922022+0000 mgr.gibba043.dnkmem (mgr.34373) 653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:27.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cluster 2021-03-10T14:02:25.568741+0000 mgr.gibba043.dnkmem (mgr.34373) 637 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:27.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.672357+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:27.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.676329+0000 mgr.gibba043.dnkmem (mgr.34373) 638 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:02:27.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.677716+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:27.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.682203+0000 mgr.gibba043.dnkmem (mgr.34373) 639 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:02:27.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.894024+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:02:27.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.898603+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:27.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.899980+0000 mgr.gibba043.dnkmem (mgr.34373) 640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:27.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.900081+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:27.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.901788+0000 mgr.gibba043.dnkmem (mgr.34373) 641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:27.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.902018+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:27.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.903583+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:27.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.903584+0000 mgr.gibba043.dnkmem (mgr.34373) 642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:27.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.903715+0000 mgr.gibba043.dnkmem (mgr.34373) 643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:27.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.905264+0000 mgr.gibba043.dnkmem (mgr.34373) 644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:27.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.905323+0000 mgr.gibba043.dnkmem (mgr.34373) 645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:27.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.908048+0000 mgr.gibba043.dnkmem (mgr.34373) 646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.911723+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.911927+0000 mgr.gibba043.dnkmem (mgr.34373) 647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.912303+0000 mgr.gibba043.dnkmem (mgr.34373) 648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.915993+0000 mgr.gibba043.dnkmem (mgr.34373) 649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: audit 2021-03-10T14:02:25.916726+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.918233+0000 mgr.gibba043.dnkmem (mgr.34373) 650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.920995+0000 mgr.gibba043.dnkmem (mgr.34373) 651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.921300+0000 mgr.gibba043.dnkmem (mgr.34373) 652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:26 gibba043 bash[24019]: cephadm 2021-03-10T14:02:25.922022+0000 mgr.gibba043.dnkmem (mgr.34373) 653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:28 gibba003 bash[31385]: cluster 2021-03-10T14:02:27.570236+0000 mgr.gibba043.dnkmem (mgr.34373) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:29.231 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:28 gibba003 bash[32348]: cluster 2021-03-10T14:02:27.570236+0000 mgr.gibba043.dnkmem (mgr.34373) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:29.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:28 gibba043 bash[24019]: cluster 2021-03-10T14:02:27.570236+0000 mgr.gibba043.dnkmem (mgr.34373) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:30 gibba003 bash[31385]: cluster 2021-03-10T14:02:29.571919+0000 mgr.gibba043.dnkmem (mgr.34373) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:30 gibba003 bash[32348]: cluster 2021-03-10T14:02:29.571919+0000 mgr.gibba043.dnkmem (mgr.34373) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:31.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:30 gibba043 bash[24019]: cluster 2021-03-10T14:02:29.571919+0000 mgr.gibba043.dnkmem (mgr.34373) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:33.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:32 gibba003 bash[31385]: cluster 2021-03-10T14:02:31.573660+0000 mgr.gibba043.dnkmem (mgr.34373) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:32 gibba003 bash[32348]: cluster 2021-03-10T14:02:31.573660+0000 mgr.gibba043.dnkmem (mgr.34373) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:33.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:32 gibba043 bash[24019]: cluster 2021-03-10T14:02:31.573660+0000 mgr.gibba043.dnkmem (mgr.34373) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:34 gibba003 bash[31385]: cluster 2021-03-10T14:02:33.575253+0000 mgr.gibba043.dnkmem (mgr.34373) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:35.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:34 gibba003 bash[32348]: cluster 2021-03-10T14:02:33.575253+0000 mgr.gibba043.dnkmem (mgr.34373) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:35.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:34 gibba043 bash[24019]: cluster 2021-03-10T14:02:33.575253+0000 mgr.gibba043.dnkmem (mgr.34373) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:36 gibba003 bash[31385]: cluster 2021-03-10T14:02:35.576728+0000 mgr.gibba043.dnkmem (mgr.34373) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:36 gibba003 bash[32348]: cluster 2021-03-10T14:02:35.576728+0000 mgr.gibba043.dnkmem (mgr.34373) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:37.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:36 gibba043 bash[24019]: cluster 2021-03-10T14:02:35.576728+0000 mgr.gibba043.dnkmem (mgr.34373) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:38 gibba003 bash[31385]: cluster 2021-03-10T14:02:37.578322+0000 mgr.gibba043.dnkmem (mgr.34373) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:38 gibba003 bash[32348]: cluster 2021-03-10T14:02:37.578322+0000 mgr.gibba043.dnkmem (mgr.34373) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:39.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:38 gibba043 bash[24019]: cluster 2021-03-10T14:02:37.578322+0000 mgr.gibba043.dnkmem (mgr.34373) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:40 gibba003 bash[31385]: cluster 2021-03-10T14:02:39.579965+0000 mgr.gibba043.dnkmem (mgr.34373) 660 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:40 gibba003 bash[32348]: cluster 2021-03-10T14:02:39.579965+0000 mgr.gibba043.dnkmem (mgr.34373) 660 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:41.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:40 gibba043 bash[24019]: cluster 2021-03-10T14:02:39.579965+0000 mgr.gibba043.dnkmem (mgr.34373) 660 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:41 gibba003 bash[31385]: cephadm 2021-03-10T14:02:40.936011+0000 mgr.gibba043.dnkmem (mgr.34373) 661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:42.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:41 gibba003 bash[32348]: cephadm 2021-03-10T14:02:40.936011+0000 mgr.gibba043.dnkmem (mgr.34373) 661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:42.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:41 gibba043 bash[24019]: cephadm 2021-03-10T14:02:40.936011+0000 mgr.gibba043.dnkmem (mgr.34373) 661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:43.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:42 gibba003 bash[31385]: cluster 2021-03-10T14:02:41.581525+0000 mgr.gibba043.dnkmem (mgr.34373) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:43.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:42 gibba003 bash[32348]: cluster 2021-03-10T14:02:41.581525+0000 mgr.gibba043.dnkmem (mgr.34373) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:43.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:42 gibba043 bash[24019]: cluster 2021-03-10T14:02:41.581525+0000 mgr.gibba043.dnkmem (mgr.34373) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:44 gibba003 bash[31385]: cluster 2021-03-10T14:02:43.583112+0000 mgr.gibba043.dnkmem (mgr.34373) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:44 gibba003 bash[32348]: cluster 2021-03-10T14:02:43.583112+0000 mgr.gibba043.dnkmem (mgr.34373) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:45.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:44 gibba043 bash[24019]: cluster 2021-03-10T14:02:43.583112+0000 mgr.gibba043.dnkmem (mgr.34373) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:47.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:46 gibba043 bash[24019]: cluster 2021-03-10T14:02:45.584690+0000 mgr.gibba043.dnkmem (mgr.34373) 664 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:46 gibba003 bash[31385]: cluster 2021-03-10T14:02:45.584690+0000 mgr.gibba043.dnkmem (mgr.34373) 664 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:46 gibba003 bash[32348]: cluster 2021-03-10T14:02:45.584690+0000 mgr.gibba043.dnkmem (mgr.34373) 664 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:48.008 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:02:48.233 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:02:48.233 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:02:48.233 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:02:48.234 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (11m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:02:48.234 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (11m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:02:48.234 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:02:48.234 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:02:48.235 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:02:48.235 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:02:48.235 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (16m) 8m ago 16m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:02:48.235 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (16m) 6m ago 16m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:02:48.235 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:02:48.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:02:48.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:02:48.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:02:48.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:02:48.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:02:48.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:02:48.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:02:48.237 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (16m) 6m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:02:48.237 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:02:48.485 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:02:48.485 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:02:48.486 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:48.486 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:02:48.486 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:02:48.487 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:48.487 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:02:48.487 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:02:48.487 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:02:48.488 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:02:48.488 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:02:48.488 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:02:48.488 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:02:48.489 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:02:48.489 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:02:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:48 gibba043 bash[24019]: cluster 2021-03-10T14:02:47.586181+0000 mgr.gibba043.dnkmem (mgr.34373) 665 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:48 gibba043 bash[24019]: audit 2021-03-10T14:02:48.002473+0000 mgr.gibba043.dnkmem (mgr.34373) 666 : audit [DBG] from='client.54490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:48 gibba043 bash[24019]: audit 2021-03-10T14:02:48.485840+0000 mon.a (mon.0) 533 : audit [DBG] from='client.? 172.21.2.103:0/3506918554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:48 gibba003 bash[31385]: cluster 2021-03-10T14:02:47.586181+0000 mgr.gibba043.dnkmem (mgr.34373) 665 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:48 gibba003 bash[31385]: audit 2021-03-10T14:02:48.002473+0000 mgr.gibba043.dnkmem (mgr.34373) 666 : audit [DBG] from='client.54490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:48 gibba003 bash[31385]: audit 2021-03-10T14:02:48.485840+0000 mon.a (mon.0) 533 : audit [DBG] from='client.? 172.21.2.103:0/3506918554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:48 gibba003 bash[32348]: cluster 2021-03-10T14:02:47.586181+0000 mgr.gibba043.dnkmem (mgr.34373) 665 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:48 gibba003 bash[32348]: audit 2021-03-10T14:02:48.002473+0000 mgr.gibba043.dnkmem (mgr.34373) 666 : audit [DBG] from='client.54490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:48 gibba003 bash[32348]: audit 2021-03-10T14:02:48.485840+0000 mon.a (mon.0) 533 : audit [DBG] from='client.? 172.21.2.103:0/3506918554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:49 gibba043 bash[24019]: audit 2021-03-10T14:02:48.225621+0000 mgr.gibba043.dnkmem (mgr.34373) 667 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:50.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:49 gibba003 bash[31385]: audit 2021-03-10T14:02:48.225621+0000 mgr.gibba043.dnkmem (mgr.34373) 667 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:50.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:49 gibba003 bash[32348]: audit 2021-03-10T14:02:48.225621+0000 mgr.gibba043.dnkmem (mgr.34373) 667 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:51.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:50 gibba043 bash[24019]: cluster 2021-03-10T14:02:49.586698+0000 mgr.gibba043.dnkmem (mgr.34373) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:50 gibba003 bash[31385]: cluster 2021-03-10T14:02:49.586698+0000 mgr.gibba043.dnkmem (mgr.34373) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:50 gibba003 bash[32348]: cluster 2021-03-10T14:02:49.586698+0000 mgr.gibba043.dnkmem (mgr.34373) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:53.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:52 gibba043 bash[24019]: cluster 2021-03-10T14:02:51.588354+0000 mgr.gibba043.dnkmem (mgr.34373) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:52 gibba003 bash[31385]: cluster 2021-03-10T14:02:51.588354+0000 mgr.gibba043.dnkmem (mgr.34373) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:52 gibba003 bash[32348]: cluster 2021-03-10T14:02:51.588354+0000 mgr.gibba043.dnkmem (mgr.34373) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:55.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:54 gibba043 bash[24019]: cluster 2021-03-10T14:02:53.589714+0000 mgr.gibba043.dnkmem (mgr.34373) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:54 gibba003 bash[31385]: cluster 2021-03-10T14:02:53.589714+0000 mgr.gibba043.dnkmem (mgr.34373) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:54 gibba003 bash[32348]: cluster 2021-03-10T14:02:53.589714+0000 mgr.gibba043.dnkmem (mgr.34373) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:57.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:56 gibba043 bash[24019]: cluster 2021-03-10T14:02:55.591266+0000 mgr.gibba043.dnkmem (mgr.34373) 671 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:57.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:56 gibba043 bash[24019]: cephadm 2021-03-10T14:02:55.951995+0000 mgr.gibba043.dnkmem (mgr.34373) 672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:56 gibba003 bash[31385]: cluster 2021-03-10T14:02:55.591266+0000 mgr.gibba043.dnkmem (mgr.34373) 671 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:56 gibba003 bash[31385]: cephadm 2021-03-10T14:02:55.951995+0000 mgr.gibba043.dnkmem (mgr.34373) 672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:56 gibba003 bash[32348]: cluster 2021-03-10T14:02:55.591266+0000 mgr.gibba043.dnkmem (mgr.34373) 671 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:56 gibba003 bash[32348]: cephadm 2021-03-10T14:02:55.951995+0000 mgr.gibba043.dnkmem (mgr.34373) 672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:02:59.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:02:59 gibba043 bash[24019]: cluster 2021-03-10T14:02:57.592880+0000 mgr.gibba043.dnkmem (mgr.34373) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:02:59 gibba003 bash[31385]: cluster 2021-03-10T14:02:57.592880+0000 mgr.gibba043.dnkmem (mgr.34373) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:02:59 gibba003 bash[32348]: cluster 2021-03-10T14:02:57.592880+0000 mgr.gibba043.dnkmem (mgr.34373) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:01.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:01 gibba043 bash[24019]: cluster 2021-03-10T14:02:59.593434+0000 mgr.gibba043.dnkmem (mgr.34373) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:01 gibba003 bash[31385]: cluster 2021-03-10T14:02:59.593434+0000 mgr.gibba043.dnkmem (mgr.34373) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:01 gibba003 bash[32348]: cluster 2021-03-10T14:02:59.593434+0000 mgr.gibba043.dnkmem (mgr.34373) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:03 gibba003 bash[31385]: cluster 2021-03-10T14:03:01.595097+0000 mgr.gibba043.dnkmem (mgr.34373) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:03 gibba003 bash[32348]: cluster 2021-03-10T14:03:01.595097+0000 mgr.gibba043.dnkmem (mgr.34373) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:03.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:03 gibba043 bash[24019]: cluster 2021-03-10T14:03:01.595097+0000 mgr.gibba043.dnkmem (mgr.34373) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:05 gibba003 bash[31385]: cluster 2021-03-10T14:03:03.596647+0000 mgr.gibba043.dnkmem (mgr.34373) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:05 gibba003 bash[32348]: cluster 2021-03-10T14:03:03.596647+0000 mgr.gibba043.dnkmem (mgr.34373) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:05.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:05 gibba043 bash[24019]: cluster 2021-03-10T14:03:03.596647+0000 mgr.gibba043.dnkmem (mgr.34373) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:07 gibba003 bash[31385]: cluster 2021-03-10T14:03:05.598022+0000 mgr.gibba043.dnkmem (mgr.34373) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:07 gibba003 bash[32348]: cluster 2021-03-10T14:03:05.598022+0000 mgr.gibba043.dnkmem (mgr.34373) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:07.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:07 gibba043 bash[24019]: cluster 2021-03-10T14:03:05.598022+0000 mgr.gibba043.dnkmem (mgr.34373) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:09 gibba003 bash[31385]: cluster 2021-03-10T14:03:07.599852+0000 mgr.gibba043.dnkmem (mgr.34373) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:09 gibba003 bash[32348]: cluster 2021-03-10T14:03:07.599852+0000 mgr.gibba043.dnkmem (mgr.34373) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:09 gibba043 bash[24019]: cluster 2021-03-10T14:03:07.599852+0000 mgr.gibba043.dnkmem (mgr.34373) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:11.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:11 gibba043 bash[24019]: cluster 2021-03-10T14:03:09.600416+0000 mgr.gibba043.dnkmem (mgr.34373) 679 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:11 gibba003 bash[31385]: cluster 2021-03-10T14:03:09.600416+0000 mgr.gibba043.dnkmem (mgr.34373) 679 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:11 gibba003 bash[32348]: cluster 2021-03-10T14:03:09.600416+0000 mgr.gibba043.dnkmem (mgr.34373) 679 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:12.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:12 gibba003 bash[31385]: cephadm 2021-03-10T14:03:10.968077+0000 mgr.gibba043.dnkmem (mgr.34373) 680 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:12.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:12 gibba003 bash[32348]: cephadm 2021-03-10T14:03:10.968077+0000 mgr.gibba043.dnkmem (mgr.34373) 680 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:12.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:12 gibba043 bash[24019]: cephadm 2021-03-10T14:03:10.968077+0000 mgr.gibba043.dnkmem (mgr.34373) 680 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: cluster 2021-03-10T14:03:11.601978+0000 mgr.gibba043.dnkmem (mgr.34373) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.654471+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:03:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.655400+0000 mon.c (mon.1) 231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.655722+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:03:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.656390+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:03:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.656950+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.657620+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.657750+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:03:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.658690+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.783870+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.784979+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.804032+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[31385]: audit 2021-03-10T14:03:12.805143+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: cluster 2021-03-10T14:03:11.601978+0000 mgr.gibba043.dnkmem (mgr.34373) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.654471+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:03:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.655400+0000 mon.c (mon.1) 231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.655722+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:03:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.656390+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:03:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.656950+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.657620+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.657750+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:03:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.658690+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.783870+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.784979+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.804032+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:13 gibba003 bash[32348]: audit 2021-03-10T14:03:12.805143+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:13.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: cluster 2021-03-10T14:03:11.601978+0000 mgr.gibba043.dnkmem (mgr.34373) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:13.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.654471+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:03:13.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.655400+0000 mon.c (mon.1) 231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.655722+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:03:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.656390+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:03:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.656950+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.657620+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.657750+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:03:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.658690+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:03:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.783870+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.784979+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.804032+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:13 gibba043 bash[24019]: audit 2021-03-10T14:03:12.805143+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:15 gibba003 bash[31385]: cluster 2021-03-10T14:03:13.603552+0000 mgr.gibba043.dnkmem (mgr.34373) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:15 gibba003 bash[32348]: cluster 2021-03-10T14:03:13.603552+0000 mgr.gibba043.dnkmem (mgr.34373) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:15.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:15 gibba043 bash[24019]: cluster 2021-03-10T14:03:13.603552+0000 mgr.gibba043.dnkmem (mgr.34373) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:17 gibba003 bash[31385]: cluster 2021-03-10T14:03:15.605080+0000 mgr.gibba043.dnkmem (mgr.34373) 683 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:17 gibba003 bash[32348]: cluster 2021-03-10T14:03:15.605080+0000 mgr.gibba043.dnkmem (mgr.34373) 683 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:17.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:17 gibba043 bash[24019]: cluster 2021-03-10T14:03:15.605080+0000 mgr.gibba043.dnkmem (mgr.34373) 683 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:18.728 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:03:18.985 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:03:18.986 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:03:18.986 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:03:18.986 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:03:18.986 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:03:18.987 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:03:18.987 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:03:18.987 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:03:18.987 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:03:18.987 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (17m) 8m ago 17m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:03:18.988 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (17m) 6m ago 17m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:03:18.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:03:18.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:03:18.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:03:18.989 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:03:18.989 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:03:18.989 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:03:18.989 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:03:18.989 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:03:18.990 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (16m) 6m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:03:18.990 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:03:19.244 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:03:19.244 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:03:19.244 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:19.245 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:03:19.245 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:03:19.245 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:19.245 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:03:19.245 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:03:19.246 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:03:19.246 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:03:19.246 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:03:19.246 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:03:19.247 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:03:19.247 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:03:19.247 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:03:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:19 gibba003 bash[31385]: cluster 2021-03-10T14:03:17.606810+0000 mgr.gibba043.dnkmem (mgr.34373) 684 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:19 gibba003 bash[32348]: cluster 2021-03-10T14:03:17.606810+0000 mgr.gibba043.dnkmem (mgr.34373) 684 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:19.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:19 gibba043 bash[24019]: cluster 2021-03-10T14:03:17.606810+0000 mgr.gibba043.dnkmem (mgr.34373) 684 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:20.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:20 gibba003 bash[31385]: audit 2021-03-10T14:03:18.721947+0000 mgr.gibba043.dnkmem (mgr.34373) 685 : audit [DBG] from='client.54508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:20 gibba003 bash[31385]: audit 2021-03-10T14:03:18.947553+0000 mgr.gibba043.dnkmem (mgr.34373) 686 : audit [DBG] from='client.54514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:20 gibba003 bash[31385]: audit 2021-03-10T14:03:19.244440+0000 mon.a (mon.0) 540 : audit [DBG] from='client.? 172.21.2.103:0/1627555369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:20.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:20 gibba003 bash[32348]: audit 2021-03-10T14:03:18.721947+0000 mgr.gibba043.dnkmem (mgr.34373) 685 : audit [DBG] from='client.54508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:20.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:20 gibba003 bash[32348]: audit 2021-03-10T14:03:18.947553+0000 mgr.gibba043.dnkmem (mgr.34373) 686 : audit [DBG] from='client.54514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:20.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:20 gibba003 bash[32348]: audit 2021-03-10T14:03:19.244440+0000 mon.a (mon.0) 540 : audit [DBG] from='client.? 172.21.2.103:0/1627555369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:20.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:20 gibba043 bash[24019]: audit 2021-03-10T14:03:18.721947+0000 mgr.gibba043.dnkmem (mgr.34373) 685 : audit [DBG] from='client.54508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:20.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:20 gibba043 bash[24019]: audit 2021-03-10T14:03:18.947553+0000 mgr.gibba043.dnkmem (mgr.34373) 686 : audit [DBG] from='client.54514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:20.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:20 gibba043 bash[24019]: audit 2021-03-10T14:03:19.244440+0000 mon.a (mon.0) 540 : audit [DBG] from='client.? 172.21.2.103:0/1627555369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:21 gibba003 bash[31385]: cluster 2021-03-10T14:03:19.608369+0000 mgr.gibba043.dnkmem (mgr.34373) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:21 gibba003 bash[32348]: cluster 2021-03-10T14:03:19.608369+0000 mgr.gibba043.dnkmem (mgr.34373) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:21.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:21 gibba043 bash[24019]: cluster 2021-03-10T14:03:19.608369+0000 mgr.gibba043.dnkmem (mgr.34373) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:23 gibba003 bash[31385]: cluster 2021-03-10T14:03:21.610178+0000 mgr.gibba043.dnkmem (mgr.34373) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:23 gibba003 bash[32348]: cluster 2021-03-10T14:03:21.610178+0000 mgr.gibba043.dnkmem (mgr.34373) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:23.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:23 gibba043 bash[24019]: cluster 2021-03-10T14:03:21.610178+0000 mgr.gibba043.dnkmem (mgr.34373) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:25 gibba003 bash[31385]: cluster 2021-03-10T14:03:23.611904+0000 mgr.gibba043.dnkmem (mgr.34373) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:25 gibba003 bash[32348]: cluster 2021-03-10T14:03:23.611904+0000 mgr.gibba043.dnkmem (mgr.34373) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:25 gibba043 bash[24019]: cluster 2021-03-10T14:03:23.611904+0000 mgr.gibba043.dnkmem (mgr.34373) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:27.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cluster 2021-03-10T14:03:25.613152+0000 mgr.gibba043.dnkmem (mgr.34373) 690 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:25.984660+0000 mgr.gibba043.dnkmem (mgr.34373) 691 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:03:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:25.986172+0000 mgr.gibba043.dnkmem (mgr.34373) 692 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:03:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.197789+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:03:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.201122+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.202767+0000 mgr.gibba043.dnkmem (mgr.34373) 693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.202773+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.204614+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.204625+0000 mgr.gibba043.dnkmem (mgr.34373) 694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:27.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.205947+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.206429+0000 mgr.gibba043.dnkmem (mgr.34373) 695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:27.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.206469+0000 mgr.gibba043.dnkmem (mgr.34373) 696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:27.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.207843+0000 mgr.gibba043.dnkmem (mgr.34373) 697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.207914+0000 mgr.gibba043.dnkmem (mgr.34373) 698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.209307+0000 mgr.gibba043.dnkmem (mgr.34373) 699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.209384+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.211092+0000 mgr.gibba043.dnkmem (mgr.34373) 700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.211127+0000 mgr.gibba043.dnkmem (mgr.34373) 701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: audit 2021-03-10T14:03:26.211352+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.212945+0000 mgr.gibba043.dnkmem (mgr.34373) 702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.213256+0000 mgr.gibba043.dnkmem (mgr.34373) 703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.214792+0000 mgr.gibba043.dnkmem (mgr.34373) 704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.214828+0000 mgr.gibba043.dnkmem (mgr.34373) 705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:27 gibba043 bash[24019]: cephadm 2021-03-10T14:03:26.214931+0000 mgr.gibba043.dnkmem (mgr.34373) 706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cluster 2021-03-10T14:03:25.613152+0000 mgr.gibba043.dnkmem (mgr.34373) 690 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:25.984660+0000 mgr.gibba043.dnkmem (mgr.34373) 691 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:03:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:25.986172+0000 mgr.gibba043.dnkmem (mgr.34373) 692 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:03:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.197789+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:03:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.201122+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.202767+0000 mgr.gibba043.dnkmem (mgr.34373) 693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.202773+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.204614+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.204625+0000 mgr.gibba043.dnkmem (mgr.34373) 694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.205947+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.206429+0000 mgr.gibba043.dnkmem (mgr.34373) 695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.206469+0000 mgr.gibba043.dnkmem (mgr.34373) 696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.207843+0000 mgr.gibba043.dnkmem (mgr.34373) 697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.207914+0000 mgr.gibba043.dnkmem (mgr.34373) 698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.209307+0000 mgr.gibba043.dnkmem (mgr.34373) 699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.209384+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.211092+0000 mgr.gibba043.dnkmem (mgr.34373) 700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.211127+0000 mgr.gibba043.dnkmem (mgr.34373) 701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: audit 2021-03-10T14:03:26.211352+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.212945+0000 mgr.gibba043.dnkmem (mgr.34373) 702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.213256+0000 mgr.gibba043.dnkmem (mgr.34373) 703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:27.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cluster 2021-03-10T14:03:25.613152+0000 mgr.gibba043.dnkmem (mgr.34373) 690 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:27.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:25.984660+0000 mgr.gibba043.dnkmem (mgr.34373) 691 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:03:27.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:25.986172+0000 mgr.gibba043.dnkmem (mgr.34373) 692 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:03:27.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.197789+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:03:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.201122+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.202767+0000 mgr.gibba043.dnkmem (mgr.34373) 693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.202773+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.204614+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.204625+0000 mgr.gibba043.dnkmem (mgr.34373) 694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.205947+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.206429+0000 mgr.gibba043.dnkmem (mgr.34373) 695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.206469+0000 mgr.gibba043.dnkmem (mgr.34373) 696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.207843+0000 mgr.gibba043.dnkmem (mgr.34373) 697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.207914+0000 mgr.gibba043.dnkmem (mgr.34373) 698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.209307+0000 mgr.gibba043.dnkmem (mgr.34373) 699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.209384+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.211092+0000 mgr.gibba043.dnkmem (mgr.34373) 700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.211127+0000 mgr.gibba043.dnkmem (mgr.34373) 701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: audit 2021-03-10T14:03:26.211352+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.212945+0000 mgr.gibba043.dnkmem (mgr.34373) 702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.213256+0000 mgr.gibba043.dnkmem (mgr.34373) 703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:27.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.214792+0000 mgr.gibba043.dnkmem (mgr.34373) 704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:27.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.214828+0000 mgr.gibba043.dnkmem (mgr.34373) 705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:27.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[31385]: cephadm 2021-03-10T14:03:26.214931+0000 mgr.gibba043.dnkmem (mgr.34373) 706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:27.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.214792+0000 mgr.gibba043.dnkmem (mgr.34373) 704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:27.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.214828+0000 mgr.gibba043.dnkmem (mgr.34373) 705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:27.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:27 gibba003 bash[32348]: cephadm 2021-03-10T14:03:26.214931+0000 mgr.gibba043.dnkmem (mgr.34373) 706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:29.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:29 gibba043 bash[24019]: cluster 2021-03-10T14:03:27.614652+0000 mgr.gibba043.dnkmem (mgr.34373) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:29 gibba003 bash[31385]: cluster 2021-03-10T14:03:27.614652+0000 mgr.gibba043.dnkmem (mgr.34373) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:29 gibba003 bash[32348]: cluster 2021-03-10T14:03:27.614652+0000 mgr.gibba043.dnkmem (mgr.34373) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:31.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:31 gibba043 bash[24019]: cluster 2021-03-10T14:03:29.615195+0000 mgr.gibba043.dnkmem (mgr.34373) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:31 gibba003 bash[31385]: cluster 2021-03-10T14:03:29.615195+0000 mgr.gibba043.dnkmem (mgr.34373) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:31.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:31 gibba003 bash[32348]: cluster 2021-03-10T14:03:29.615195+0000 mgr.gibba043.dnkmem (mgr.34373) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:33.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:33 gibba043 bash[24019]: cluster 2021-03-10T14:03:31.616889+0000 mgr.gibba043.dnkmem (mgr.34373) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:33 gibba003 bash[31385]: cluster 2021-03-10T14:03:31.616889+0000 mgr.gibba043.dnkmem (mgr.34373) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:33 gibba003 bash[32348]: cluster 2021-03-10T14:03:31.616889+0000 mgr.gibba043.dnkmem (mgr.34373) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:35 gibba043 bash[24019]: cluster 2021-03-10T14:03:33.618470+0000 mgr.gibba043.dnkmem (mgr.34373) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:35 gibba003 bash[31385]: cluster 2021-03-10T14:03:33.618470+0000 mgr.gibba043.dnkmem (mgr.34373) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:35 gibba003 bash[32348]: cluster 2021-03-10T14:03:33.618470+0000 mgr.gibba043.dnkmem (mgr.34373) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:36.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:36 gibba043 bash[24019]: cluster 2021-03-10T14:03:35.619894+0000 mgr.gibba043.dnkmem (mgr.34373) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:36 gibba003 bash[31385]: cluster 2021-03-10T14:03:35.619894+0000 mgr.gibba043.dnkmem (mgr.34373) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:36.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:36 gibba003 bash[32348]: cluster 2021-03-10T14:03:35.619894+0000 mgr.gibba043.dnkmem (mgr.34373) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:38 gibba003 bash[31385]: cluster 2021-03-10T14:03:37.621573+0000 mgr.gibba043.dnkmem (mgr.34373) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:38 gibba003 bash[32348]: cluster 2021-03-10T14:03:37.621573+0000 mgr.gibba043.dnkmem (mgr.34373) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:39.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:38 gibba043 bash[24019]: cluster 2021-03-10T14:03:37.621573+0000 mgr.gibba043.dnkmem (mgr.34373) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:40 gibba003 bash[31385]: cluster 2021-03-10T14:03:39.622239+0000 mgr.gibba043.dnkmem (mgr.34373) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:40 gibba003 bash[32348]: cluster 2021-03-10T14:03:39.622239+0000 mgr.gibba043.dnkmem (mgr.34373) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:41.226 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:40 gibba043 bash[24019]: cluster 2021-03-10T14:03:39.622239+0000 mgr.gibba043.dnkmem (mgr.34373) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:42.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:41 gibba003 bash[31385]: cephadm 2021-03-10T14:03:41.228560+0000 mgr.gibba043.dnkmem (mgr.34373) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:42.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:41 gibba003 bash[32348]: cephadm 2021-03-10T14:03:41.228560+0000 mgr.gibba043.dnkmem (mgr.34373) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:42.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:41 gibba043 bash[24019]: cephadm 2021-03-10T14:03:41.228560+0000 mgr.gibba043.dnkmem (mgr.34373) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:43.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:42 gibba003 bash[32348]: cluster 2021-03-10T14:03:41.623900+0000 mgr.gibba043.dnkmem (mgr.34373) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:42 gibba003 bash[31385]: cluster 2021-03-10T14:03:41.623900+0000 mgr.gibba043.dnkmem (mgr.34373) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:43.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:42 gibba043 bash[24019]: cluster 2021-03-10T14:03:41.623900+0000 mgr.gibba043.dnkmem (mgr.34373) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:44 gibba003 bash[31385]: cluster 2021-03-10T14:03:43.625558+0000 mgr.gibba043.dnkmem (mgr.34373) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:44 gibba003 bash[32348]: cluster 2021-03-10T14:03:43.625558+0000 mgr.gibba043.dnkmem (mgr.34373) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:45.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:44 gibba043 bash[24019]: cluster 2021-03-10T14:03:43.625558+0000 mgr.gibba043.dnkmem (mgr.34373) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:46 gibba003 bash[31385]: cluster 2021-03-10T14:03:45.627050+0000 mgr.gibba043.dnkmem (mgr.34373) 717 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:47.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:46 gibba003 bash[32348]: cluster 2021-03-10T14:03:45.627050+0000 mgr.gibba043.dnkmem (mgr.34373) 717 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:47.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:46 gibba043 bash[24019]: cluster 2021-03-10T14:03:45.627050+0000 mgr.gibba043.dnkmem (mgr.34373) 717 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:48 gibba043 bash[24019]: cluster 2021-03-10T14:03:47.628424+0000 mgr.gibba043.dnkmem (mgr.34373) 718 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:48 gibba003 bash[31385]: cluster 2021-03-10T14:03:47.628424+0000 mgr.gibba043.dnkmem (mgr.34373) 718 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:48 gibba003 bash[32348]: cluster 2021-03-10T14:03:47.628424+0000 mgr.gibba043.dnkmem (mgr.34373) 718 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.490 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:03:49.719 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:03:49.719 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (12m) 9m ago 17m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:03:49.719 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:03:49.719 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (12m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:03:49.720 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (12m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:03:49.720 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:03:49.720 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:03:49.720 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:03:49.721 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:03:49.721 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (17m) 9m ago 17m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:03:49.721 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (17m) 7m ago 17m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:03:49.721 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:03:49.721 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:03:49.722 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:03:49.722 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:03:49.722 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:03:49.722 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:03:49.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:03:49.723 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:03:49.723 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (17m) 7m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:03:49.723 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:03:49.969 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:03:49.970 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:03:49.970 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:49.970 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:03:49.971 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:03:49.971 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:49.971 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:03:49.971 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:03:49.971 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:03:49.972 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:03:49.972 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:03:49.972 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:03:49.972 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:03:49.973 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:03:49.973 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:03:51.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:50 gibba043 bash[24019]: audit 2021-03-10T14:03:49.484339+0000 mgr.gibba043.dnkmem (mgr.34373) 719 : audit [DBG] from='client.54526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:51.303 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:50 gibba043 bash[24019]: cluster 2021-03-10T14:03:49.629155+0000 mgr.gibba043.dnkmem (mgr.34373) 720 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:51.303 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:50 gibba043 bash[24019]: audit 2021-03-10T14:03:49.709949+0000 mgr.gibba043.dnkmem (mgr.34373) 721 : audit [DBG] from='client.44547 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:51.304 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:50 gibba043 bash[24019]: audit 2021-03-10T14:03:49.970095+0000 mon.c (mon.1) 242 : audit [DBG] from='client.? 172.21.2.103:0/2971082924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[32348]: audit 2021-03-10T14:03:49.484339+0000 mgr.gibba043.dnkmem (mgr.34373) 719 : audit [DBG] from='client.54526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[32348]: cluster 2021-03-10T14:03:49.629155+0000 mgr.gibba043.dnkmem (mgr.34373) 720 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[32348]: audit 2021-03-10T14:03:49.709949+0000 mgr.gibba043.dnkmem (mgr.34373) 721 : audit [DBG] from='client.44547 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[32348]: audit 2021-03-10T14:03:49.970095+0000 mon.c (mon.1) 242 : audit [DBG] from='client.? 172.21.2.103:0/2971082924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[31385]: audit 2021-03-10T14:03:49.484339+0000 mgr.gibba043.dnkmem (mgr.34373) 719 : audit [DBG] from='client.54526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[31385]: cluster 2021-03-10T14:03:49.629155+0000 mgr.gibba043.dnkmem (mgr.34373) 720 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[31385]: audit 2021-03-10T14:03:49.709949+0000 mgr.gibba043.dnkmem (mgr.34373) 721 : audit [DBG] from='client.44547 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:50 gibba003 bash[31385]: audit 2021-03-10T14:03:49.970095+0000 mon.c (mon.1) 242 : audit [DBG] from='client.? 172.21.2.103:0/2971082924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:53.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:52 gibba043 bash[24019]: cluster 2021-03-10T14:03:51.630544+0000 mgr.gibba043.dnkmem (mgr.34373) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:52 gibba003 bash[31385]: cluster 2021-03-10T14:03:51.630544+0000 mgr.gibba043.dnkmem (mgr.34373) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:52 gibba003 bash[32348]: cluster 2021-03-10T14:03:51.630544+0000 mgr.gibba043.dnkmem (mgr.34373) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:55.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:54 gibba043 bash[24019]: cluster 2021-03-10T14:03:53.632198+0000 mgr.gibba043.dnkmem (mgr.34373) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:54 gibba003 bash[31385]: cluster 2021-03-10T14:03:53.632198+0000 mgr.gibba043.dnkmem (mgr.34373) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:54 gibba003 bash[32348]: cluster 2021-03-10T14:03:53.632198+0000 mgr.gibba043.dnkmem (mgr.34373) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:57.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:56 gibba043 bash[24019]: cluster 2021-03-10T14:03:55.633478+0000 mgr.gibba043.dnkmem (mgr.34373) 724 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:56 gibba003 bash[31385]: cluster 2021-03-10T14:03:55.633478+0000 mgr.gibba043.dnkmem (mgr.34373) 724 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:56 gibba003 bash[32348]: cluster 2021-03-10T14:03:55.633478+0000 mgr.gibba043.dnkmem (mgr.34373) 724 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:58.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:57 gibba043 bash[24019]: cephadm 2021-03-10T14:03:56.244401+0000 mgr.gibba043.dnkmem (mgr.34373) 725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:58.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:57 gibba003 bash[31385]: cephadm 2021-03-10T14:03:56.244401+0000 mgr.gibba043.dnkmem (mgr.34373) 725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:58.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:57 gibba003 bash[32348]: cephadm 2021-03-10T14:03:56.244401+0000 mgr.gibba043.dnkmem (mgr.34373) 725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:03:59.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:03:58 gibba043 bash[24019]: cluster 2021-03-10T14:03:57.634035+0000 mgr.gibba043.dnkmem (mgr.34373) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:03:58 gibba003 bash[31385]: cluster 2021-03-10T14:03:57.634035+0000 mgr.gibba043.dnkmem (mgr.34373) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:03:58 gibba003 bash[32348]: cluster 2021-03-10T14:03:57.634035+0000 mgr.gibba043.dnkmem (mgr.34373) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:01 gibba043 bash[24019]: cluster 2021-03-10T14:03:59.635348+0000 mgr.gibba043.dnkmem (mgr.34373) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:01 gibba003 bash[31385]: cluster 2021-03-10T14:03:59.635348+0000 mgr.gibba043.dnkmem (mgr.34373) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:01 gibba003 bash[32348]: cluster 2021-03-10T14:03:59.635348+0000 mgr.gibba043.dnkmem (mgr.34373) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:03 gibba043 bash[24019]: cluster 2021-03-10T14:04:01.637051+0000 mgr.gibba043.dnkmem (mgr.34373) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:03 gibba003 bash[31385]: cluster 2021-03-10T14:04:01.637051+0000 mgr.gibba043.dnkmem (mgr.34373) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:03 gibba003 bash[32348]: cluster 2021-03-10T14:04:01.637051+0000 mgr.gibba043.dnkmem (mgr.34373) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:05 gibba003 bash[31385]: cluster 2021-03-10T14:04:03.637847+0000 mgr.gibba043.dnkmem (mgr.34373) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:05 gibba003 bash[32348]: cluster 2021-03-10T14:04:03.637847+0000 mgr.gibba043.dnkmem (mgr.34373) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:05.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:05 gibba043 bash[24019]: cluster 2021-03-10T14:04:03.637847+0000 mgr.gibba043.dnkmem (mgr.34373) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:07 gibba003 bash[31385]: cluster 2021-03-10T14:04:05.639115+0000 mgr.gibba043.dnkmem (mgr.34373) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:07 gibba003 bash[32348]: cluster 2021-03-10T14:04:05.639115+0000 mgr.gibba043.dnkmem (mgr.34373) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:07.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:07 gibba043 bash[24019]: cluster 2021-03-10T14:04:05.639115+0000 mgr.gibba043.dnkmem (mgr.34373) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:09 gibba003 bash[31385]: cluster 2021-03-10T14:04:07.640628+0000 mgr.gibba043.dnkmem (mgr.34373) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:09 gibba003 bash[32348]: cluster 2021-03-10T14:04:07.640628+0000 mgr.gibba043.dnkmem (mgr.34373) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:09 gibba043 bash[24019]: cluster 2021-03-10T14:04:07.640628+0000 mgr.gibba043.dnkmem (mgr.34373) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:11 gibba003 bash[31385]: cluster 2021-03-10T14:04:09.641255+0000 mgr.gibba043.dnkmem (mgr.34373) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:11 gibba003 bash[32348]: cluster 2021-03-10T14:04:09.641255+0000 mgr.gibba043.dnkmem (mgr.34373) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:11.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:11 gibba043 bash[24019]: cluster 2021-03-10T14:04:09.641255+0000 mgr.gibba043.dnkmem (mgr.34373) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: cephadm 2021-03-10T14:04:11.260323+0000 mgr.gibba043.dnkmem (mgr.34373) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: cluster 2021-03-10T14:04:11.642753+0000 mgr.gibba043.dnkmem (mgr.34373) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.662805+0000 mon.c (mon.1) 243 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:04:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.663647+0000 mon.c (mon.1) 244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.664062+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:04:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.664340+0000 mon.c (mon.1) 245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.665403+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.665473+0000 mon.c (mon.1) 246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.666369+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.667366+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.791684+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.792801+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.812131+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[31385]: audit 2021-03-10T14:04:12.813081+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: cephadm 2021-03-10T14:04:11.260323+0000 mgr.gibba043.dnkmem (mgr.34373) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: cluster 2021-03-10T14:04:11.642753+0000 mgr.gibba043.dnkmem (mgr.34373) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.662805+0000 mon.c (mon.1) 243 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:04:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.663647+0000 mon.c (mon.1) 244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.664062+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:04:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.664340+0000 mon.c (mon.1) 245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.665403+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.665473+0000 mon.c (mon.1) 246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.666369+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.667366+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.791684+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.792801+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.812131+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:13.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:13 gibba003 bash[32348]: audit 2021-03-10T14:04:12.813081+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:13.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: cephadm 2021-03-10T14:04:11.260323+0000 mgr.gibba043.dnkmem (mgr.34373) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:13.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: cluster 2021-03-10T14:04:11.642753+0000 mgr.gibba043.dnkmem (mgr.34373) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.662805+0000 mon.c (mon.1) 243 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:04:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.663647+0000 mon.c (mon.1) 244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.664062+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:04:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.664340+0000 mon.c (mon.1) 245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.665403+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.665473+0000 mon.c (mon.1) 246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.666369+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.667366+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:04:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.791684+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.792801+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.812131+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:13 gibba043 bash[24019]: audit 2021-03-10T14:04:12.813081+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:15 gibba003 bash[31385]: cluster 2021-03-10T14:04:13.644304+0000 mgr.gibba043.dnkmem (mgr.34373) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:15 gibba003 bash[32348]: cluster 2021-03-10T14:04:13.644304+0000 mgr.gibba043.dnkmem (mgr.34373) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:15.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:15 gibba043 bash[24019]: cluster 2021-03-10T14:04:13.644304+0000 mgr.gibba043.dnkmem (mgr.34373) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:17 gibba003 bash[31385]: cluster 2021-03-10T14:04:15.644900+0000 mgr.gibba043.dnkmem (mgr.34373) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:17 gibba003 bash[32348]: cluster 2021-03-10T14:04:15.644900+0000 mgr.gibba043.dnkmem (mgr.34373) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:17.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:17 gibba043 bash[24019]: cluster 2021-03-10T14:04:15.644900+0000 mgr.gibba043.dnkmem (mgr.34373) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:19 gibba003 bash[31385]: cluster 2021-03-10T14:04:17.646090+0000 mgr.gibba043.dnkmem (mgr.34373) 737 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:19 gibba003 bash[32348]: cluster 2021-03-10T14:04:17.646090+0000 mgr.gibba043.dnkmem (mgr.34373) 737 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:19.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:19 gibba043 bash[24019]: cluster 2021-03-10T14:04:17.646090+0000 mgr.gibba043.dnkmem (mgr.34373) 737 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:20.212 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:04:20.440 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:04:20.440 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (12m) 9m ago 18m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:04:20.441 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:04:20.441 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:04:20.441 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:04:20.441 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:04:20.442 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:04:20.442 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:04:20.442 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:04:20.442 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (18m) 9m ago 18m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:04:20.443 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (18m) 7m ago 18m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:04:20.443 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:04:20.443 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:04:20.443 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:04:20.443 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:04:20.444 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:04:20.444 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:04:20.444 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:04:20.444 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:04:20.445 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (17m) 7m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:04:20.445 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:04:20.688 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:04:20.689 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:04:20.689 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:20.689 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:04:20.689 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:04:20.690 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:20.690 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:04:20.690 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:04:20.690 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:04:20.691 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:04:20.691 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:04:20.691 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:04:20.691 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:04:20.691 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:04:20.692 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:04:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:21 gibba003 bash[31385]: cluster 2021-03-10T14:04:19.647604+0000 mgr.gibba043.dnkmem (mgr.34373) 738 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:21 gibba003 bash[31385]: audit 2021-03-10T14:04:20.205883+0000 mgr.gibba043.dnkmem (mgr.34373) 739 : audit [DBG] from='client.54544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:21 gibba003 bash[31385]: audit 2021-03-10T14:04:20.689093+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.2.103:0/3076808297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:21 gibba003 bash[32348]: cluster 2021-03-10T14:04:19.647604+0000 mgr.gibba043.dnkmem (mgr.34373) 738 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:21 gibba003 bash[32348]: audit 2021-03-10T14:04:20.205883+0000 mgr.gibba043.dnkmem (mgr.34373) 739 : audit [DBG] from='client.54544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:21 gibba003 bash[32348]: audit 2021-03-10T14:04:20.689093+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.2.103:0/3076808297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:21.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:21 gibba043 bash[24019]: cluster 2021-03-10T14:04:19.647604+0000 mgr.gibba043.dnkmem (mgr.34373) 738 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:21.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:21 gibba043 bash[24019]: audit 2021-03-10T14:04:20.205883+0000 mgr.gibba043.dnkmem (mgr.34373) 739 : audit [DBG] from='client.54544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:21.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:21 gibba043 bash[24019]: audit 2021-03-10T14:04:20.689093+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.2.103:0/3076808297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:22.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:22 gibba003 bash[31385]: audit 2021-03-10T14:04:20.430711+0000 mgr.gibba043.dnkmem (mgr.34373) 740 : audit [DBG] from='client.44565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:22.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:22 gibba003 bash[32348]: audit 2021-03-10T14:04:20.430711+0000 mgr.gibba043.dnkmem (mgr.34373) 740 : audit [DBG] from='client.44565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:22.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:22 gibba043 bash[24019]: audit 2021-03-10T14:04:20.430711+0000 mgr.gibba043.dnkmem (mgr.34373) 740 : audit [DBG] from='client.44565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:23 gibba003 bash[31385]: cluster 2021-03-10T14:04:21.648143+0000 mgr.gibba043.dnkmem (mgr.34373) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:23 gibba003 bash[32348]: cluster 2021-03-10T14:04:21.648143+0000 mgr.gibba043.dnkmem (mgr.34373) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:23.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:23 gibba043 bash[24019]: cluster 2021-03-10T14:04:21.648143+0000 mgr.gibba043.dnkmem (mgr.34373) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:25 gibba003 bash[31385]: cluster 2021-03-10T14:04:23.649480+0000 mgr.gibba043.dnkmem (mgr.34373) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:25 gibba003 bash[32348]: cluster 2021-03-10T14:04:23.649480+0000 mgr.gibba043.dnkmem (mgr.34373) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:25.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:25 gibba043 bash[24019]: cluster 2021-03-10T14:04:23.649480+0000 mgr.gibba043.dnkmem (mgr.34373) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: cluster 2021-03-10T14:04:25.650843+0000 mgr.gibba043.dnkmem (mgr.34373) 743 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.518984+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:04:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.522685+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.523923+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.525153+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.526401+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.529098+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[31385]: audit 2021-03-10T14:04:26.530423+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: cluster 2021-03-10T14:04:25.650843+0000 mgr.gibba043.dnkmem (mgr.34373) 743 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.518984+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:04:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.522685+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.523923+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.525153+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.526401+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.529098+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:27 gibba003 bash[32348]: audit 2021-03-10T14:04:26.530423+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: cluster 2021-03-10T14:04:25.650843+0000 mgr.gibba043.dnkmem (mgr.34373) 743 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.518984+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:04:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.522685+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.523923+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.525153+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.526401+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.529098+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:27 gibba043 bash[24019]: audit 2021-03-10T14:04:26.530423+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.276948+0000 mgr.gibba043.dnkmem (mgr.34373) 744 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:04:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.278273+0000 mgr.gibba043.dnkmem (mgr.34373) 745 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:04:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.523840+0000 mgr.gibba043.dnkmem (mgr.34373) 746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.525425+0000 mgr.gibba043.dnkmem (mgr.34373) 747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.526484+0000 mgr.gibba043.dnkmem (mgr.34373) 748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.526522+0000 mgr.gibba043.dnkmem (mgr.34373) 749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.527835+0000 mgr.gibba043.dnkmem (mgr.34373) 750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.527900+0000 mgr.gibba043.dnkmem (mgr.34373) 751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.528917+0000 mgr.gibba043.dnkmem (mgr.34373) 752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.530442+0000 mgr.gibba043.dnkmem (mgr.34373) 753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.530479+0000 mgr.gibba043.dnkmem (mgr.34373) 754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.531577+0000 mgr.gibba043.dnkmem (mgr.34373) 755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.531964+0000 mgr.gibba043.dnkmem (mgr.34373) 756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.532908+0000 mgr.gibba043.dnkmem (mgr.34373) 757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.532947+0000 mgr.gibba043.dnkmem (mgr.34373) 758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[31385]: cephadm 2021-03-10T14:04:26.533050+0000 mgr.gibba043.dnkmem (mgr.34373) 759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.276948+0000 mgr.gibba043.dnkmem (mgr.34373) 744 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:04:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.278273+0000 mgr.gibba043.dnkmem (mgr.34373) 745 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:04:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.523840+0000 mgr.gibba043.dnkmem (mgr.34373) 746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.525425+0000 mgr.gibba043.dnkmem (mgr.34373) 747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.526484+0000 mgr.gibba043.dnkmem (mgr.34373) 748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.526522+0000 mgr.gibba043.dnkmem (mgr.34373) 749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.527835+0000 mgr.gibba043.dnkmem (mgr.34373) 750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.527900+0000 mgr.gibba043.dnkmem (mgr.34373) 751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.528917+0000 mgr.gibba043.dnkmem (mgr.34373) 752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.530442+0000 mgr.gibba043.dnkmem (mgr.34373) 753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.530479+0000 mgr.gibba043.dnkmem (mgr.34373) 754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.531577+0000 mgr.gibba043.dnkmem (mgr.34373) 755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.531964+0000 mgr.gibba043.dnkmem (mgr.34373) 756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.532908+0000 mgr.gibba043.dnkmem (mgr.34373) 757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.532947+0000 mgr.gibba043.dnkmem (mgr.34373) 758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:28 gibba003 bash[32348]: cephadm 2021-03-10T14:04:26.533050+0000 mgr.gibba043.dnkmem (mgr.34373) 759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:28.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.276948+0000 mgr.gibba043.dnkmem (mgr.34373) 744 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:04:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.278273+0000 mgr.gibba043.dnkmem (mgr.34373) 745 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:04:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.523840+0000 mgr.gibba043.dnkmem (mgr.34373) 746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.525425+0000 mgr.gibba043.dnkmem (mgr.34373) 747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.526484+0000 mgr.gibba043.dnkmem (mgr.34373) 748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.526522+0000 mgr.gibba043.dnkmem (mgr.34373) 749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.527835+0000 mgr.gibba043.dnkmem (mgr.34373) 750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.527900+0000 mgr.gibba043.dnkmem (mgr.34373) 751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.528917+0000 mgr.gibba043.dnkmem (mgr.34373) 752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:28.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.530442+0000 mgr.gibba043.dnkmem (mgr.34373) 753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:28.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.530479+0000 mgr.gibba043.dnkmem (mgr.34373) 754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:28.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.531577+0000 mgr.gibba043.dnkmem (mgr.34373) 755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:28.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.531964+0000 mgr.gibba043.dnkmem (mgr.34373) 756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:28.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.532908+0000 mgr.gibba043.dnkmem (mgr.34373) 757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.532947+0000 mgr.gibba043.dnkmem (mgr.34373) 758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:28 gibba043 bash[24019]: cephadm 2021-03-10T14:04:26.533050+0000 mgr.gibba043.dnkmem (mgr.34373) 759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:29 gibba003 bash[31385]: cluster 2021-03-10T14:04:27.651645+0000 mgr.gibba043.dnkmem (mgr.34373) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:29 gibba003 bash[32348]: cluster 2021-03-10T14:04:27.651645+0000 mgr.gibba043.dnkmem (mgr.34373) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:29.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:29 gibba043 bash[24019]: cluster 2021-03-10T14:04:27.651645+0000 mgr.gibba043.dnkmem (mgr.34373) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:31 gibba003 bash[31385]: cluster 2021-03-10T14:04:29.652879+0000 mgr.gibba043.dnkmem (mgr.34373) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:31 gibba003 bash[32348]: cluster 2021-03-10T14:04:29.652879+0000 mgr.gibba043.dnkmem (mgr.34373) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:31.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:31 gibba043 bash[24019]: cluster 2021-03-10T14:04:29.652879+0000 mgr.gibba043.dnkmem (mgr.34373) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:33 gibba003 bash[31385]: cluster 2021-03-10T14:04:31.654515+0000 mgr.gibba043.dnkmem (mgr.34373) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:33 gibba003 bash[32348]: cluster 2021-03-10T14:04:31.654515+0000 mgr.gibba043.dnkmem (mgr.34373) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:33 gibba043 bash[24019]: cluster 2021-03-10T14:04:31.654515+0000 mgr.gibba043.dnkmem (mgr.34373) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:35 gibba003 bash[31385]: cluster 2021-03-10T14:04:33.655280+0000 mgr.gibba043.dnkmem (mgr.34373) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:35 gibba003 bash[32348]: cluster 2021-03-10T14:04:33.655280+0000 mgr.gibba043.dnkmem (mgr.34373) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:35.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:35 gibba043 bash[24019]: cluster 2021-03-10T14:04:33.655280+0000 mgr.gibba043.dnkmem (mgr.34373) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:37 gibba003 bash[31385]: cluster 2021-03-10T14:04:35.656609+0000 mgr.gibba043.dnkmem (mgr.34373) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:37 gibba003 bash[32348]: cluster 2021-03-10T14:04:35.656609+0000 mgr.gibba043.dnkmem (mgr.34373) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:37 gibba043 bash[24019]: cluster 2021-03-10T14:04:35.656609+0000 mgr.gibba043.dnkmem (mgr.34373) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:39 gibba003 bash[31385]: cluster 2021-03-10T14:04:37.657993+0000 mgr.gibba043.dnkmem (mgr.34373) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:39 gibba003 bash[32348]: cluster 2021-03-10T14:04:37.657993+0000 mgr.gibba043.dnkmem (mgr.34373) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:39.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:39 gibba043 bash[24019]: cluster 2021-03-10T14:04:37.657993+0000 mgr.gibba043.dnkmem (mgr.34373) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:41 gibba003 bash[31385]: cluster 2021-03-10T14:04:39.659347+0000 mgr.gibba043.dnkmem (mgr.34373) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:41 gibba003 bash[32348]: cluster 2021-03-10T14:04:39.659347+0000 mgr.gibba043.dnkmem (mgr.34373) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:41 gibba043 bash[24019]: cluster 2021-03-10T14:04:39.659347+0000 mgr.gibba043.dnkmem (mgr.34373) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:43.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:43 gibba043 bash[24019]: cephadm 2021-03-10T14:04:41.548799+0000 mgr.gibba043.dnkmem (mgr.34373) 767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:43.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:43 gibba043 bash[24019]: cluster 2021-03-10T14:04:41.661046+0000 mgr.gibba043.dnkmem (mgr.34373) 768 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:43 gibba003 bash[31385]: cephadm 2021-03-10T14:04:41.548799+0000 mgr.gibba043.dnkmem (mgr.34373) 767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:43.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:43 gibba003 bash[31385]: cluster 2021-03-10T14:04:41.661046+0000 mgr.gibba043.dnkmem (mgr.34373) 768 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:43 gibba003 bash[32348]: cephadm 2021-03-10T14:04:41.548799+0000 mgr.gibba043.dnkmem (mgr.34373) 767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:43 gibba003 bash[32348]: cluster 2021-03-10T14:04:41.661046+0000 mgr.gibba043.dnkmem (mgr.34373) 768 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:45.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:45 gibba043 bash[24019]: cluster 2021-03-10T14:04:43.662567+0000 mgr.gibba043.dnkmem (mgr.34373) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:45 gibba003 bash[31385]: cluster 2021-03-10T14:04:43.662567+0000 mgr.gibba043.dnkmem (mgr.34373) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:45 gibba003 bash[32348]: cluster 2021-03-10T14:04:43.662567+0000 mgr.gibba043.dnkmem (mgr.34373) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:47.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:47 gibba043 bash[24019]: cluster 2021-03-10T14:04:45.663190+0000 mgr.gibba043.dnkmem (mgr.34373) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:47 gibba003 bash[31385]: cluster 2021-03-10T14:04:45.663190+0000 mgr.gibba043.dnkmem (mgr.34373) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:47 gibba003 bash[32348]: cluster 2021-03-10T14:04:45.663190+0000 mgr.gibba043.dnkmem (mgr.34373) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:49.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:49 gibba043 bash[24019]: cluster 2021-03-10T14:04:47.664656+0000 mgr.gibba043.dnkmem (mgr.34373) 771 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:49 gibba003 bash[31385]: cluster 2021-03-10T14:04:47.664656+0000 mgr.gibba043.dnkmem (mgr.34373) 771 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:49 gibba003 bash[32348]: cluster 2021-03-10T14:04:47.664656+0000 mgr.gibba043.dnkmem (mgr.34373) 771 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:50.933 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:04:51.160 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:04:51.161 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (13m) 10m ago 18m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:04:51.161 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:04:51.161 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (13m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:04:51.162 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (13m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:04:51.162 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:04:51.162 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:04:51.163 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:04:51.163 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:04:51.163 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (18m) 10m ago 18m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:04:51.163 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (18m) 8m ago 18m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:04:51.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:04:51.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:04:51.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:04:51.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:04:51.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:04:51.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:04:51.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:04:51.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:04:51.166 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (18m) 8m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:04:51.166 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:04:51.411 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:04:51.411 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:04:51.411 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:51.412 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:04:51.412 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:04:51.412 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:51.412 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:04:51.413 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:04:51.413 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:04:51.413 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:04:51.413 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:04:51.413 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:04:51.414 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:04:51.414 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:04:51.414 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:04:51.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:51 gibba043 bash[24019]: cluster 2021-03-10T14:04:49.666031+0000 mgr.gibba043.dnkmem (mgr.34373) 772 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:51 gibba003 bash[31385]: cluster 2021-03-10T14:04:49.666031+0000 mgr.gibba043.dnkmem (mgr.34373) 772 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:51 gibba003 bash[32348]: cluster 2021-03-10T14:04:49.666031+0000 mgr.gibba043.dnkmem (mgr.34373) 772 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:52.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:52 gibba043 bash[24019]: audit 2021-03-10T14:04:50.925978+0000 mgr.gibba043.dnkmem (mgr.34373) 773 : audit [DBG] from='client.54562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:52.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:52 gibba043 bash[24019]: audit 2021-03-10T14:04:51.150399+0000 mgr.gibba043.dnkmem (mgr.34373) 774 : audit [DBG] from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:52.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:52 gibba043 bash[24019]: audit 2021-03-10T14:04:51.411741+0000 mon.a (mon.0) 550 : audit [DBG] from='client.? 172.21.2.103:0/57555009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:52.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:52 gibba003 bash[31385]: audit 2021-03-10T14:04:50.925978+0000 mgr.gibba043.dnkmem (mgr.34373) 773 : audit [DBG] from='client.54562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:52.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:52 gibba003 bash[31385]: audit 2021-03-10T14:04:51.150399+0000 mgr.gibba043.dnkmem (mgr.34373) 774 : audit [DBG] from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:52.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:52 gibba003 bash[31385]: audit 2021-03-10T14:04:51.411741+0000 mon.a (mon.0) 550 : audit [DBG] from='client.? 172.21.2.103:0/57555009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:52.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:52 gibba003 bash[32348]: audit 2021-03-10T14:04:50.925978+0000 mgr.gibba043.dnkmem (mgr.34373) 773 : audit [DBG] from='client.54562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:52.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:52 gibba003 bash[32348]: audit 2021-03-10T14:04:51.150399+0000 mgr.gibba043.dnkmem (mgr.34373) 774 : audit [DBG] from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:52.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:52 gibba003 bash[32348]: audit 2021-03-10T14:04:51.411741+0000 mon.a (mon.0) 550 : audit [DBG] from='client.? 172.21.2.103:0/57555009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:53.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:53 gibba043 bash[24019]: cluster 2021-03-10T14:04:51.666846+0000 mgr.gibba043.dnkmem (mgr.34373) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:53 gibba003 bash[31385]: cluster 2021-03-10T14:04:51.666846+0000 mgr.gibba043.dnkmem (mgr.34373) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:53 gibba003 bash[32348]: cluster 2021-03-10T14:04:51.666846+0000 mgr.gibba043.dnkmem (mgr.34373) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:55.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:55 gibba043 bash[24019]: cluster 2021-03-10T14:04:53.668432+0000 mgr.gibba043.dnkmem (mgr.34373) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:55 gibba003 bash[31385]: cluster 2021-03-10T14:04:53.668432+0000 mgr.gibba043.dnkmem (mgr.34373) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:55 gibba003 bash[32348]: cluster 2021-03-10T14:04:53.668432+0000 mgr.gibba043.dnkmem (mgr.34373) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:57.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:57 gibba043 bash[24019]: cluster 2021-03-10T14:04:55.669893+0000 mgr.gibba043.dnkmem (mgr.34373) 777 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:57 gibba003 bash[31385]: cluster 2021-03-10T14:04:55.669893+0000 mgr.gibba043.dnkmem (mgr.34373) 777 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:57 gibba003 bash[32348]: cluster 2021-03-10T14:04:55.669893+0000 mgr.gibba043.dnkmem (mgr.34373) 777 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:58.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:58 gibba003 bash[31385]: cephadm 2021-03-10T14:04:56.554253+0000 mgr.gibba043.dnkmem (mgr.34373) 778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:58.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:58 gibba003 bash[32348]: cephadm 2021-03-10T14:04:56.554253+0000 mgr.gibba043.dnkmem (mgr.34373) 778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:58.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:58 gibba043 bash[24019]: cephadm 2021-03-10T14:04:56.554253+0000 mgr.gibba043.dnkmem (mgr.34373) 778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:04:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:04:59 gibba003 bash[31385]: cluster 2021-03-10T14:04:57.670791+0000 mgr.gibba043.dnkmem (mgr.34373) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:04:59 gibba003 bash[32348]: cluster 2021-03-10T14:04:57.670791+0000 mgr.gibba043.dnkmem (mgr.34373) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:04:59 gibba043 bash[24019]: cluster 2021-03-10T14:04:57.670791+0000 mgr.gibba043.dnkmem (mgr.34373) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:00.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:00 gibba003 bash[31385]: cluster 2021-03-10T14:04:59.672266+0000 mgr.gibba043.dnkmem (mgr.34373) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:00.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:00 gibba003 bash[32348]: cluster 2021-03-10T14:04:59.672266+0000 mgr.gibba043.dnkmem (mgr.34373) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:00.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:00 gibba043 bash[24019]: cluster 2021-03-10T14:04:59.672266+0000 mgr.gibba043.dnkmem (mgr.34373) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:03.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:02 gibba003 bash[31385]: cluster 2021-03-10T14:05:01.674027+0000 mgr.gibba043.dnkmem (mgr.34373) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:02 gibba003 bash[32348]: cluster 2021-03-10T14:05:01.674027+0000 mgr.gibba043.dnkmem (mgr.34373) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:03.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:02 gibba043 bash[24019]: cluster 2021-03-10T14:05:01.674027+0000 mgr.gibba043.dnkmem (mgr.34373) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:04 gibba043 bash[24019]: cluster 2021-03-10T14:05:03.674890+0000 mgr.gibba043.dnkmem (mgr.34373) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:04 gibba003 bash[31385]: cluster 2021-03-10T14:05:03.674890+0000 mgr.gibba043.dnkmem (mgr.34373) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:04 gibba003 bash[32348]: cluster 2021-03-10T14:05:03.674890+0000 mgr.gibba043.dnkmem (mgr.34373) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:07.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:06 gibba043 bash[24019]: cluster 2021-03-10T14:05:05.676340+0000 mgr.gibba043.dnkmem (mgr.34373) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:06 gibba003 bash[31385]: cluster 2021-03-10T14:05:05.676340+0000 mgr.gibba043.dnkmem (mgr.34373) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:07.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:06 gibba003 bash[32348]: cluster 2021-03-10T14:05:05.676340+0000 mgr.gibba043.dnkmem (mgr.34373) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:08 gibba043 bash[24019]: cluster 2021-03-10T14:05:07.678018+0000 mgr.gibba043.dnkmem (mgr.34373) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:08 gibba003 bash[31385]: cluster 2021-03-10T14:05:07.678018+0000 mgr.gibba043.dnkmem (mgr.34373) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:08 gibba003 bash[32348]: cluster 2021-03-10T14:05:07.678018+0000 mgr.gibba043.dnkmem (mgr.34373) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:11.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:10 gibba043 bash[24019]: cluster 2021-03-10T14:05:09.679359+0000 mgr.gibba043.dnkmem (mgr.34373) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:10 gibba003 bash[31385]: cluster 2021-03-10T14:05:09.679359+0000 mgr.gibba043.dnkmem (mgr.34373) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:10 gibba003 bash[32348]: cluster 2021-03-10T14:05:09.679359+0000 mgr.gibba043.dnkmem (mgr.34373) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: cephadm 2021-03-10T14:05:11.556539+0000 mgr.gibba043.dnkmem (mgr.34373) 786 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: cluster 2021-03-10T14:05:11.681165+0000 mgr.gibba043.dnkmem (mgr.34373) 787 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.670985+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:05:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.672167+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.672481+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:05:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.673269+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:05:13.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.673425+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.674312+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:05:13.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.674755+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.675933+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.799086+0000 mon.c (mon.1) 259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:13.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.800387+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:13.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.820685+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:13.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:12 gibba043 bash[24019]: audit 2021-03-10T14:05:12.821960+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: cephadm 2021-03-10T14:05:11.556539+0000 mgr.gibba043.dnkmem (mgr.34373) 786 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:13.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: cluster 2021-03-10T14:05:11.681165+0000 mgr.gibba043.dnkmem (mgr.34373) 787 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.670985+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:05:13.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.672167+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.672481+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:05:13.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.673269+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:05:13.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.673425+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.674312+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:05:13.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.674755+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.675933+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.799086+0000 mon.c (mon.1) 259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:13.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.800387+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:13.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.820685+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:13.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[31385]: audit 2021-03-10T14:05:12.821960+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:13.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: cephadm 2021-03-10T14:05:11.556539+0000 mgr.gibba043.dnkmem (mgr.34373) 786 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:13.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: cluster 2021-03-10T14:05:11.681165+0000 mgr.gibba043.dnkmem (mgr.34373) 787 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.670985+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:05:13.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.672167+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.672481+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:05:13.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.673269+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:05:13.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.673425+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.674312+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:05:13.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.674755+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.675933+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:05:13.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.799086+0000 mon.c (mon.1) 259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:13.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.800387+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:13.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.820685+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:13.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:12 gibba003 bash[32348]: audit 2021-03-10T14:05:12.821960+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:14 gibba043 bash[24019]: cluster 2021-03-10T14:05:13.682785+0000 mgr.gibba043.dnkmem (mgr.34373) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:14 gibba003 bash[31385]: cluster 2021-03-10T14:05:13.682785+0000 mgr.gibba043.dnkmem (mgr.34373) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:14 gibba003 bash[32348]: cluster 2021-03-10T14:05:13.682785+0000 mgr.gibba043.dnkmem (mgr.34373) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:17.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:17 gibba043 bash[24019]: cluster 2021-03-10T14:05:15.683803+0000 mgr.gibba043.dnkmem (mgr.34373) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:16 gibba003 bash[31385]: cluster 2021-03-10T14:05:15.683803+0000 mgr.gibba043.dnkmem (mgr.34373) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:16 gibba003 bash[32348]: cluster 2021-03-10T14:05:15.683803+0000 mgr.gibba043.dnkmem (mgr.34373) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:19 gibba043 bash[24019]: cluster 2021-03-10T14:05:17.685331+0000 mgr.gibba043.dnkmem (mgr.34373) 790 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:19 gibba003 bash[31385]: cluster 2021-03-10T14:05:17.685331+0000 mgr.gibba043.dnkmem (mgr.34373) 790 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:19 gibba003 bash[32348]: cluster 2021-03-10T14:05:17.685331+0000 mgr.gibba043.dnkmem (mgr.34373) 790 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:21 gibba043 bash[24019]: cluster 2021-03-10T14:05:19.686679+0000 mgr.gibba043.dnkmem (mgr.34373) 791 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:21 gibba003 bash[31385]: cluster 2021-03-10T14:05:19.686679+0000 mgr.gibba043.dnkmem (mgr.34373) 791 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:21 gibba003 bash[32348]: cluster 2021-03-10T14:05:19.686679+0000 mgr.gibba043.dnkmem (mgr.34373) 791 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.660 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:05:21.888 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:05:21.888 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (13m) 10m ago 19m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:05:21.888 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:05:21.889 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:05:21.889 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:05:21.889 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:05:21.889 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:05:21.889 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:05:21.890 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:05:21.890 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (19m) 10m ago 19m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:05:21.890 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (19m) 8m ago 19m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:05:21.890 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:05:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:05:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:05:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:05:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:05:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:05:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:05:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:05:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (18m) 8m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:05:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:05:22.139 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:05:22.139 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:05:22.139 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:22.139 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:05:22.140 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:05:22.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:22.140 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:05:22.140 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:05:22.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:05:22.141 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:05:22.141 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:05:22.141 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:05:22.141 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:05:22.141 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:05:22.142 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:05:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[31385]: audit 2021-03-10T14:05:21.653853+0000 mgr.gibba043.dnkmem (mgr.34373) 792 : audit [DBG] from='client.44595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[31385]: cluster 2021-03-10T14:05:21.687686+0000 mgr.gibba043.dnkmem (mgr.34373) 793 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[31385]: audit 2021-03-10T14:05:21.878206+0000 mgr.gibba043.dnkmem (mgr.34373) 794 : audit [DBG] from='client.44601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[31385]: audit 2021-03-10T14:05:22.139553+0000 mon.a (mon.0) 557 : audit [DBG] from='client.? 172.21.2.103:0/1579177177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[32348]: audit 2021-03-10T14:05:21.653853+0000 mgr.gibba043.dnkmem (mgr.34373) 792 : audit [DBG] from='client.44595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[32348]: cluster 2021-03-10T14:05:21.687686+0000 mgr.gibba043.dnkmem (mgr.34373) 793 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[32348]: audit 2021-03-10T14:05:21.878206+0000 mgr.gibba043.dnkmem (mgr.34373) 794 : audit [DBG] from='client.44601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:23 gibba003 bash[32348]: audit 2021-03-10T14:05:22.139553+0000 mon.a (mon.0) 557 : audit [DBG] from='client.? 172.21.2.103:0/1579177177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:23 gibba043 bash[24019]: audit 2021-03-10T14:05:21.653853+0000 mgr.gibba043.dnkmem (mgr.34373) 792 : audit [DBG] from='client.44595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:23 gibba043 bash[24019]: cluster 2021-03-10T14:05:21.687686+0000 mgr.gibba043.dnkmem (mgr.34373) 793 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:23 gibba043 bash[24019]: audit 2021-03-10T14:05:21.878206+0000 mgr.gibba043.dnkmem (mgr.34373) 794 : audit [DBG] from='client.44601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:23 gibba043 bash[24019]: audit 2021-03-10T14:05:22.139553+0000 mon.a (mon.0) 557 : audit [DBG] from='client.? 172.21.2.103:0/1579177177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:25 gibba003 bash[31385]: cluster 2021-03-10T14:05:23.689297+0000 mgr.gibba043.dnkmem (mgr.34373) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:25 gibba003 bash[32348]: cluster 2021-03-10T14:05:23.689297+0000 mgr.gibba043.dnkmem (mgr.34373) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:25.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:25 gibba043 bash[24019]: cluster 2021-03-10T14:05:23.689297+0000 mgr.gibba043.dnkmem (mgr.34373) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:27 gibba003 bash[31385]: cluster 2021-03-10T14:05:25.690700+0000 mgr.gibba043.dnkmem (mgr.34373) 796 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:27.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:27 gibba003 bash[31385]: audit 2021-03-10T14:05:26.569349+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:05:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:27 gibba003 bash[32348]: cluster 2021-03-10T14:05:25.690700+0000 mgr.gibba043.dnkmem (mgr.34373) 796 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:27 gibba003 bash[32348]: audit 2021-03-10T14:05:26.569349+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:05:27.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:27 gibba043 bash[24019]: cluster 2021-03-10T14:05:25.690700+0000 mgr.gibba043.dnkmem (mgr.34373) 796 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:27 gibba043 bash[24019]: audit 2021-03-10T14:05:26.569349+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:05:28.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:28 gibba003 bash[31385]: cephadm 2021-03-10T14:05:26.570058+0000 mgr.gibba043.dnkmem (mgr.34373) 797 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:05:28.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:28 gibba003 bash[32348]: cephadm 2021-03-10T14:05:26.570058+0000 mgr.gibba043.dnkmem (mgr.34373) 797 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:05:28.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:28 gibba043 bash[24019]: cephadm 2021-03-10T14:05:26.570058+0000 mgr.gibba043.dnkmem (mgr.34373) 797 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:05:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:29 gibba003 bash[31385]: cluster 2021-03-10T14:05:27.691719+0000 mgr.gibba043.dnkmem (mgr.34373) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:29 gibba003 bash[32348]: cluster 2021-03-10T14:05:27.691719+0000 mgr.gibba043.dnkmem (mgr.34373) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:29.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:29 gibba043 bash[24019]: cluster 2021-03-10T14:05:27.691719+0000 mgr.gibba043.dnkmem (mgr.34373) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: cluster 2021-03-10T14:05:29.693074+0000 mgr.gibba043.dnkmem (mgr.34373) 799 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.064952+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:05:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.067092+0000 mgr.gibba043.dnkmem (mgr.34373) 800 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:05:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.286447+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:05:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.295180+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.297049+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.298407+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.299610+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.305308+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[31385]: audit 2021-03-10T14:05:30.310122+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: cluster 2021-03-10T14:05:29.693074+0000 mgr.gibba043.dnkmem (mgr.34373) 799 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.064952+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:05:31.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.067092+0000 mgr.gibba043.dnkmem (mgr.34373) 800 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:05:31.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.286447+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:05:31.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.295180+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:31.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.297049+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.298407+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.299610+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.305308+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:31 gibba003 bash[32348]: audit 2021-03-10T14:05:30.310122+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: cluster 2021-03-10T14:05:29.693074+0000 mgr.gibba043.dnkmem (mgr.34373) 799 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.064952+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:05:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.067092+0000 mgr.gibba043.dnkmem (mgr.34373) 800 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:05:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.286447+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:05:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.295180+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.297049+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.298407+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.299610+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.305308+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:31 gibba043 bash[24019]: audit 2021-03-10T14:05:30.310122+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:32.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.295450+0000 mgr.gibba043.dnkmem (mgr.34373) 801 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:32.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.297657+0000 mgr.gibba043.dnkmem (mgr.34373) 802 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.299005+0000 mgr.gibba043.dnkmem (mgr.34373) 803 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.299045+0000 mgr.gibba043.dnkmem (mgr.34373) 804 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.300216+0000 mgr.gibba043.dnkmem (mgr.34373) 805 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.300269+0000 mgr.gibba043.dnkmem (mgr.34373) 806 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.301440+0000 mgr.gibba043.dnkmem (mgr.34373) 807 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.304321+0000 mgr.gibba043.dnkmem (mgr.34373) 808 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.304630+0000 mgr.gibba043.dnkmem (mgr.34373) 809 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:32.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.308465+0000 mgr.gibba043.dnkmem (mgr.34373) 810 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:32.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.310589+0000 mgr.gibba043.dnkmem (mgr.34373) 811 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:32.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.313411+0000 mgr.gibba043.dnkmem (mgr.34373) 812 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:32.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.313648+0000 mgr.gibba043.dnkmem (mgr.34373) 813 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:32.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[31385]: cephadm 2021-03-10T14:05:30.314253+0000 mgr.gibba043.dnkmem (mgr.34373) 814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:32.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.295450+0000 mgr.gibba043.dnkmem (mgr.34373) 801 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:32.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.297657+0000 mgr.gibba043.dnkmem (mgr.34373) 802 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:32.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.299005+0000 mgr.gibba043.dnkmem (mgr.34373) 803 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:32.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.299045+0000 mgr.gibba043.dnkmem (mgr.34373) 804 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:32.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.300216+0000 mgr.gibba043.dnkmem (mgr.34373) 805 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:32.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.300269+0000 mgr.gibba043.dnkmem (mgr.34373) 806 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:32.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.301440+0000 mgr.gibba043.dnkmem (mgr.34373) 807 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.304321+0000 mgr.gibba043.dnkmem (mgr.34373) 808 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.304630+0000 mgr.gibba043.dnkmem (mgr.34373) 809 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.308465+0000 mgr.gibba043.dnkmem (mgr.34373) 810 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.310589+0000 mgr.gibba043.dnkmem (mgr.34373) 811 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:32.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.313411+0000 mgr.gibba043.dnkmem (mgr.34373) 812 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:32.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.313648+0000 mgr.gibba043.dnkmem (mgr.34373) 813 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:32.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:32 gibba003 bash[32348]: cephadm 2021-03-10T14:05:30.314253+0000 mgr.gibba043.dnkmem (mgr.34373) 814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:32.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.295450+0000 mgr.gibba043.dnkmem (mgr.34373) 801 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:32.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.297657+0000 mgr.gibba043.dnkmem (mgr.34373) 802 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.299005+0000 mgr.gibba043.dnkmem (mgr.34373) 803 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.299045+0000 mgr.gibba043.dnkmem (mgr.34373) 804 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.300216+0000 mgr.gibba043.dnkmem (mgr.34373) 805 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.300269+0000 mgr.gibba043.dnkmem (mgr.34373) 806 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.301440+0000 mgr.gibba043.dnkmem (mgr.34373) 807 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.304321+0000 mgr.gibba043.dnkmem (mgr.34373) 808 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.304630+0000 mgr.gibba043.dnkmem (mgr.34373) 809 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.308465+0000 mgr.gibba043.dnkmem (mgr.34373) 810 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.310589+0000 mgr.gibba043.dnkmem (mgr.34373) 811 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.313411+0000 mgr.gibba043.dnkmem (mgr.34373) 812 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.313648+0000 mgr.gibba043.dnkmem (mgr.34373) 813 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:32 gibba043 bash[24019]: cephadm 2021-03-10T14:05:30.314253+0000 mgr.gibba043.dnkmem (mgr.34373) 814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:33 gibba003 bash[32348]: cluster 2021-03-10T14:05:31.694823+0000 mgr.gibba043.dnkmem (mgr.34373) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:33 gibba003 bash[31385]: cluster 2021-03-10T14:05:31.694823+0000 mgr.gibba043.dnkmem (mgr.34373) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:33 gibba043 bash[24019]: cluster 2021-03-10T14:05:31.694823+0000 mgr.gibba043.dnkmem (mgr.34373) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:35 gibba003 bash[31385]: cluster 2021-03-10T14:05:33.695820+0000 mgr.gibba043.dnkmem (mgr.34373) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:35 gibba003 bash[32348]: cluster 2021-03-10T14:05:33.695820+0000 mgr.gibba043.dnkmem (mgr.34373) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:35 gibba043 bash[24019]: cluster 2021-03-10T14:05:33.695820+0000 mgr.gibba043.dnkmem (mgr.34373) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:37 gibba003 bash[31385]: cluster 2021-03-10T14:05:35.697308+0000 mgr.gibba043.dnkmem (mgr.34373) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:37 gibba003 bash[32348]: cluster 2021-03-10T14:05:35.697308+0000 mgr.gibba043.dnkmem (mgr.34373) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:37 gibba043 bash[24019]: cluster 2021-03-10T14:05:35.697308+0000 mgr.gibba043.dnkmem (mgr.34373) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:39 gibba003 bash[31385]: cluster 2021-03-10T14:05:37.698974+0000 mgr.gibba043.dnkmem (mgr.34373) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:39 gibba003 bash[32348]: cluster 2021-03-10T14:05:37.698974+0000 mgr.gibba043.dnkmem (mgr.34373) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:39.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:39 gibba043 bash[24019]: cluster 2021-03-10T14:05:37.698974+0000 mgr.gibba043.dnkmem (mgr.34373) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:41.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:41 gibba003 bash[31385]: cluster 2021-03-10T14:05:39.700348+0000 mgr.gibba043.dnkmem (mgr.34373) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:41 gibba003 bash[32348]: cluster 2021-03-10T14:05:39.700348+0000 mgr.gibba043.dnkmem (mgr.34373) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:41 gibba043 bash[24019]: cluster 2021-03-10T14:05:39.700348+0000 mgr.gibba043.dnkmem (mgr.34373) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:43 gibba003 bash[31385]: cluster 2021-03-10T14:05:41.701854+0000 mgr.gibba043.dnkmem (mgr.34373) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:43 gibba003 bash[32348]: cluster 2021-03-10T14:05:41.701854+0000 mgr.gibba043.dnkmem (mgr.34373) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:43.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:43 gibba043 bash[24019]: cluster 2021-03-10T14:05:41.701854+0000 mgr.gibba043.dnkmem (mgr.34373) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:45 gibba003 bash[31385]: cluster 2021-03-10T14:05:43.703542+0000 mgr.gibba043.dnkmem (mgr.34373) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:45 gibba003 bash[32348]: cluster 2021-03-10T14:05:43.703542+0000 mgr.gibba043.dnkmem (mgr.34373) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:45.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:45 gibba043 bash[24019]: cluster 2021-03-10T14:05:43.703542+0000 mgr.gibba043.dnkmem (mgr.34373) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:47 gibba003 bash[31385]: cephadm 2021-03-10T14:05:45.330263+0000 mgr.gibba043.dnkmem (mgr.34373) 822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:47 gibba003 bash[31385]: cluster 2021-03-10T14:05:45.704582+0000 mgr.gibba043.dnkmem (mgr.34373) 823 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:47 gibba003 bash[32348]: cephadm 2021-03-10T14:05:45.330263+0000 mgr.gibba043.dnkmem (mgr.34373) 822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:47 gibba003 bash[32348]: cluster 2021-03-10T14:05:45.704582+0000 mgr.gibba043.dnkmem (mgr.34373) 823 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:47 gibba043 bash[24019]: cephadm 2021-03-10T14:05:45.330263+0000 mgr.gibba043.dnkmem (mgr.34373) 822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:05:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:47 gibba043 bash[24019]: cluster 2021-03-10T14:05:45.704582+0000 mgr.gibba043.dnkmem (mgr.34373) 823 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:49 gibba003 bash[31385]: cluster 2021-03-10T14:05:47.706146+0000 mgr.gibba043.dnkmem (mgr.34373) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:49 gibba003 bash[32348]: cluster 2021-03-10T14:05:47.706146+0000 mgr.gibba043.dnkmem (mgr.34373) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:49.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:49 gibba043 bash[24019]: cluster 2021-03-10T14:05:47.706146+0000 mgr.gibba043.dnkmem (mgr.34373) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:51 gibba003 bash[31385]: cluster 2021-03-10T14:05:49.707553+0000 mgr.gibba043.dnkmem (mgr.34373) 825 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:51 gibba003 bash[32348]: cluster 2021-03-10T14:05:49.707553+0000 mgr.gibba043.dnkmem (mgr.34373) 825 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:51 gibba043 bash[24019]: cluster 2021-03-10T14:05:49.707553+0000 mgr.gibba043.dnkmem (mgr.34373) 825 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:52.382 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:05:52.606 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:05:52.606 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (14m) 22s ago 19m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:05:52.607 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:05:52.607 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (14m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:05:52.607 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (14m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:05:52.607 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (13m) 22s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:05:52.608 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (13m) 22s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:05:52.608 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:05:52.608 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (13m) 22s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:05:52.608 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (19m) 22s ago 19m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:05:52.608 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (19m) 9m ago 19m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:05:52.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (12m) 22s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:05:52.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (12m) 22s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:05:52.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (11m) 22s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:05:52.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (11m) 22s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:05:52.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:05:52.610 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:05:52.610 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:05:52.610 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:05:52.610 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (19m) 9m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:05:52.610 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 22s ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:05:52.855 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:05:52.855 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:05:52.856 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:52.856 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:05:52.856 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:05:52.856 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:52.857 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:05:52.857 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:05:52.857 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:05:52.857 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:05:52.857 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:05:52.858 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:05:52.858 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:05:52.858 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:05:52.858 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:05:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:53 gibba003 bash[31385]: cluster 2021-03-10T14:05:51.708963+0000 mgr.gibba043.dnkmem (mgr.34373) 826 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:53 gibba003 bash[31385]: audit 2021-03-10T14:05:52.856104+0000 mon.c (mon.1) 268 : audit [DBG] from='client.? 172.21.2.103:0/2287022577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:53 gibba003 bash[32348]: cluster 2021-03-10T14:05:51.708963+0000 mgr.gibba043.dnkmem (mgr.34373) 826 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:53 gibba003 bash[32348]: audit 2021-03-10T14:05:52.856104+0000 mon.c (mon.1) 268 : audit [DBG] from='client.? 172.21.2.103:0/2287022577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:53.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:53 gibba043 bash[24019]: cluster 2021-03-10T14:05:51.708963+0000 mgr.gibba043.dnkmem (mgr.34373) 826 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:53 gibba043 bash[24019]: audit 2021-03-10T14:05:52.856104+0000 mon.c (mon.1) 268 : audit [DBG] from='client.? 172.21.2.103:0/2287022577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:54.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:54 gibba003 bash[31385]: audit 2021-03-10T14:05:52.375084+0000 mgr.gibba043.dnkmem (mgr.34373) 827 : audit [DBG] from='client.54598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:54 gibba003 bash[31385]: audit 2021-03-10T14:05:52.596102+0000 mgr.gibba043.dnkmem (mgr.34373) 828 : audit [DBG] from='client.54604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:54.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:54 gibba003 bash[32348]: audit 2021-03-10T14:05:52.375084+0000 mgr.gibba043.dnkmem (mgr.34373) 827 : audit [DBG] from='client.54598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:54.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:54 gibba003 bash[32348]: audit 2021-03-10T14:05:52.596102+0000 mgr.gibba043.dnkmem (mgr.34373) 828 : audit [DBG] from='client.54604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:54.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:54 gibba043 bash[24019]: audit 2021-03-10T14:05:52.375084+0000 mgr.gibba043.dnkmem (mgr.34373) 827 : audit [DBG] from='client.54598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:54.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:54 gibba043 bash[24019]: audit 2021-03-10T14:05:52.596102+0000 mgr.gibba043.dnkmem (mgr.34373) 828 : audit [DBG] from='client.54604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:55 gibba043 bash[24019]: cluster 2021-03-10T14:05:53.710564+0000 mgr.gibba043.dnkmem (mgr.34373) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:55 gibba003 bash[31385]: cluster 2021-03-10T14:05:53.710564+0000 mgr.gibba043.dnkmem (mgr.34373) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:55 gibba003 bash[32348]: cluster 2021-03-10T14:05:53.710564+0000 mgr.gibba043.dnkmem (mgr.34373) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:57.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:57 gibba043 bash[24019]: cluster 2021-03-10T14:05:55.711950+0000 mgr.gibba043.dnkmem (mgr.34373) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:57 gibba003 bash[31385]: cluster 2021-03-10T14:05:55.711950+0000 mgr.gibba043.dnkmem (mgr.34373) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:57 gibba003 bash[32348]: cluster 2021-03-10T14:05:55.711950+0000 mgr.gibba043.dnkmem (mgr.34373) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:05:59 gibba043 bash[24019]: cluster 2021-03-10T14:05:57.713300+0000 mgr.gibba043.dnkmem (mgr.34373) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:05:59 gibba003 bash[31385]: cluster 2021-03-10T14:05:57.713300+0000 mgr.gibba043.dnkmem (mgr.34373) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:05:59 gibba003 bash[32348]: cluster 2021-03-10T14:05:57.713300+0000 mgr.gibba043.dnkmem (mgr.34373) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:01.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:01 gibba043 bash[24019]: cluster 2021-03-10T14:05:59.714809+0000 mgr.gibba043.dnkmem (mgr.34373) 832 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:01 gibba003 bash[31385]: cluster 2021-03-10T14:05:59.714809+0000 mgr.gibba043.dnkmem (mgr.34373) 832 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:01 gibba003 bash[32348]: cluster 2021-03-10T14:05:59.714809+0000 mgr.gibba043.dnkmem (mgr.34373) 832 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:02 gibba043 bash[24019]: cephadm 2021-03-10T14:06:00.346351+0000 mgr.gibba043.dnkmem (mgr.34373) 833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:02.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:02 gibba003 bash[31385]: cephadm 2021-03-10T14:06:00.346351+0000 mgr.gibba043.dnkmem (mgr.34373) 833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:02.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:02 gibba003 bash[32348]: cephadm 2021-03-10T14:06:00.346351+0000 mgr.gibba043.dnkmem (mgr.34373) 833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:03.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:03 gibba043 bash[24019]: cluster 2021-03-10T14:06:01.716587+0000 mgr.gibba043.dnkmem (mgr.34373) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:03 gibba003 bash[31385]: cluster 2021-03-10T14:06:01.716587+0000 mgr.gibba043.dnkmem (mgr.34373) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:03.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:03 gibba003 bash[32348]: cluster 2021-03-10T14:06:01.716587+0000 mgr.gibba043.dnkmem (mgr.34373) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:05.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:05 gibba043 bash[24019]: cluster 2021-03-10T14:06:03.717861+0000 mgr.gibba043.dnkmem (mgr.34373) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:05 gibba003 bash[31385]: cluster 2021-03-10T14:06:03.717861+0000 mgr.gibba043.dnkmem (mgr.34373) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:05 gibba003 bash[32348]: cluster 2021-03-10T14:06:03.717861+0000 mgr.gibba043.dnkmem (mgr.34373) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:07.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:07 gibba043 bash[24019]: cluster 2021-03-10T14:06:05.719129+0000 mgr.gibba043.dnkmem (mgr.34373) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:07 gibba003 bash[31385]: cluster 2021-03-10T14:06:05.719129+0000 mgr.gibba043.dnkmem (mgr.34373) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:07 gibba003 bash[32348]: cluster 2021-03-10T14:06:05.719129+0000 mgr.gibba043.dnkmem (mgr.34373) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:09 gibba043 bash[24019]: cluster 2021-03-10T14:06:07.720683+0000 mgr.gibba043.dnkmem (mgr.34373) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:09 gibba003 bash[31385]: cluster 2021-03-10T14:06:07.720683+0000 mgr.gibba043.dnkmem (mgr.34373) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:09 gibba003 bash[32348]: cluster 2021-03-10T14:06:07.720683+0000 mgr.gibba043.dnkmem (mgr.34373) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:11 gibba003 bash[31385]: cluster 2021-03-10T14:06:09.722069+0000 mgr.gibba043.dnkmem (mgr.34373) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:11 gibba003 bash[32348]: cluster 2021-03-10T14:06:09.722069+0000 mgr.gibba043.dnkmem (mgr.34373) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:11 gibba043 bash[24019]: cluster 2021-03-10T14:06:09.722069+0000 mgr.gibba043.dnkmem (mgr.34373) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: cluster 2021-03-10T14:06:11.723790+0000 mgr.gibba043.dnkmem (mgr.34373) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.680782+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:06:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.681864+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.682136+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:06:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.682944+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.683175+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.684192+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.684500+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-03-10T14:06:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.685745+0000 mon.c (mon.1) 273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T14:06:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.685753+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-03-10T14:06:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.686397+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T14:06:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.806980+0000 mon.c (mon.1) 274 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.808379+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.829711+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[31385]: audit 2021-03-10T14:06:12.831085+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: cluster 2021-03-10T14:06:11.723790+0000 mgr.gibba043.dnkmem (mgr.34373) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.680782+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:06:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.681864+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.682136+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:06:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.682944+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.683175+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.684192+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.684500+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-03-10T14:06:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.685745+0000 mon.c (mon.1) 273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T14:06:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.685753+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-03-10T14:06:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.686397+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T14:06:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.806980+0000 mon.c (mon.1) 274 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.808379+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.829711+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:13 gibba003 bash[32348]: audit 2021-03-10T14:06:12.831085+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: cluster 2021-03-10T14:06:11.723790+0000 mgr.gibba043.dnkmem (mgr.34373) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.680782+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:06:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.681864+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.682136+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:06:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.682944+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.683175+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.684192+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:06:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.684500+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-03-10T14:06:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.685745+0000 mon.c (mon.1) 273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T14:06:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.685753+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [3, 2]}]: dispatch 2021-03-10T14:06:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.686397+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T14:06:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.806980+0000 mon.c (mon.1) 274 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.808379+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.829711+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:13 gibba043 bash[24019]: audit 2021-03-10T14:06:12.831085+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:15 gibba003 bash[31385]: cluster 2021-03-10T14:06:13.725369+0000 mgr.gibba043.dnkmem (mgr.34373) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:15 gibba003 bash[32348]: cluster 2021-03-10T14:06:13.725369+0000 mgr.gibba043.dnkmem (mgr.34373) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:15.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:15 gibba043 bash[24019]: cluster 2021-03-10T14:06:13.725369+0000 mgr.gibba043.dnkmem (mgr.34373) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:17 gibba003 bash[31385]: cephadm 2021-03-10T14:06:15.360344+0000 mgr.gibba043.dnkmem (mgr.34373) 841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:17 gibba003 bash[31385]: cluster 2021-03-10T14:06:15.726950+0000 mgr.gibba043.dnkmem (mgr.34373) 842 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:17 gibba003 bash[32348]: cephadm 2021-03-10T14:06:15.360344+0000 mgr.gibba043.dnkmem (mgr.34373) 841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:17 gibba003 bash[32348]: cluster 2021-03-10T14:06:15.726950+0000 mgr.gibba043.dnkmem (mgr.34373) 842 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:17.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:17 gibba043 bash[24019]: cephadm 2021-03-10T14:06:15.360344+0000 mgr.gibba043.dnkmem (mgr.34373) 841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:17 gibba043 bash[24019]: cluster 2021-03-10T14:06:15.726950+0000 mgr.gibba043.dnkmem (mgr.34373) 842 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:18.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:18 gibba003 bash[31385]: cluster 2021-03-10T14:06:17.728535+0000 mgr.gibba043.dnkmem (mgr.34373) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:18.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:18 gibba003 bash[32348]: cluster 2021-03-10T14:06:17.728535+0000 mgr.gibba043.dnkmem (mgr.34373) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:18.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:18 gibba043 bash[24019]: cluster 2021-03-10T14:06:17.728535+0000 mgr.gibba043.dnkmem (mgr.34373) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:20 gibba003 bash[31385]: cluster 2021-03-10T14:06:19.729959+0000 mgr.gibba043.dnkmem (mgr.34373) 844 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:20 gibba003 bash[32348]: cluster 2021-03-10T14:06:19.729959+0000 mgr.gibba043.dnkmem (mgr.34373) 844 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:21.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:20 gibba043 bash[24019]: cluster 2021-03-10T14:06:19.729959+0000 mgr.gibba043.dnkmem (mgr.34373) 844 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.100 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:06:23.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:22 gibba043 bash[24019]: cluster 2021-03-10T14:06:21.731465+0000 mgr.gibba043.dnkmem (mgr.34373) 845 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.326 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:06:23.326 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (14m) 53s ago 20m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:06:23.327 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (19m) 10m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:06:23.327 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (15m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:06:23.327 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (15m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:06:23.327 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (14m) 53s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:06:23.328 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (14m) 53s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:06:23.328 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (13m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:06:23.328 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (14m) 53s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:06:23.328 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (20m) 53s ago 20m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:06:23.329 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (20m) 10m ago 20m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:06:23.329 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (13m) 53s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:06:23.329 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (12m) 53s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:06:23.329 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (12m) 53s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:06:23.329 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (11m) 53s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:06:23.330 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:06:23.330 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:06:23.330 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:06:23.330 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:06:23.331 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (19m) 10m ago 20m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:06:23.331 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 53s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:06:23.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:22 gibba003 bash[31385]: cluster 2021-03-10T14:06:21.731465+0000 mgr.gibba043.dnkmem (mgr.34373) 845 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:22 gibba003 bash[32348]: cluster 2021-03-10T14:06:21.731465+0000 mgr.gibba043.dnkmem (mgr.34373) 845 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.574 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:06:23.575 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:06:23.575 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:23.575 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:06:23.575 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:06:23.576 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:23.576 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:06:23.576 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:06:23.576 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:06:23.577 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:06:23.577 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:06:23.577 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:06:23.577 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:06:23.577 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:06:23.578 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:06:24.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:23 gibba043 bash[24019]: audit 2021-03-10T14:06:23.092446+0000 mgr.gibba043.dnkmem (mgr.34373) 846 : audit [DBG] from='client.44631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:24.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:23 gibba043 bash[24019]: audit 2021-03-10T14:06:23.575416+0000 mon.c (mon.1) 276 : audit [DBG] from='client.? 172.21.2.103:0/2542457660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:24.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:23 gibba003 bash[31385]: audit 2021-03-10T14:06:23.092446+0000 mgr.gibba043.dnkmem (mgr.34373) 846 : audit [DBG] from='client.44631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:23 gibba003 bash[31385]: audit 2021-03-10T14:06:23.575416+0000 mon.c (mon.1) 276 : audit [DBG] from='client.? 172.21.2.103:0/2542457660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:24.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:23 gibba003 bash[32348]: audit 2021-03-10T14:06:23.092446+0000 mgr.gibba043.dnkmem (mgr.34373) 846 : audit [DBG] from='client.44631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:24.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:23 gibba003 bash[32348]: audit 2021-03-10T14:06:23.575416+0000 mon.c (mon.1) 276 : audit [DBG] from='client.? 172.21.2.103:0/2542457660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:24 gibba043 bash[24019]: audit 2021-03-10T14:06:23.315146+0000 mgr.gibba043.dnkmem (mgr.34373) 847 : audit [DBG] from='client.54622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:24 gibba043 bash[24019]: cluster 2021-03-10T14:06:23.733116+0000 mgr.gibba043.dnkmem (mgr.34373) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:24 gibba003 bash[31385]: audit 2021-03-10T14:06:23.315146+0000 mgr.gibba043.dnkmem (mgr.34373) 847 : audit [DBG] from='client.54622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:24 gibba003 bash[31385]: cluster 2021-03-10T14:06:23.733116+0000 mgr.gibba043.dnkmem (mgr.34373) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:24 gibba003 bash[32348]: audit 2021-03-10T14:06:23.315146+0000 mgr.gibba043.dnkmem (mgr.34373) 847 : audit [DBG] from='client.54622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:24 gibba003 bash[32348]: cluster 2021-03-10T14:06:23.733116+0000 mgr.gibba043.dnkmem (mgr.34373) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:26 gibba043 bash[24019]: cluster 2021-03-10T14:06:25.734538+0000 mgr.gibba043.dnkmem (mgr.34373) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:26 gibba003 bash[31385]: cluster 2021-03-10T14:06:25.734538+0000 mgr.gibba043.dnkmem (mgr.34373) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:26 gibba003 bash[32348]: cluster 2021-03-10T14:06:25.734538+0000 mgr.gibba043.dnkmem (mgr.34373) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:29 gibba043 bash[24019]: cluster 2021-03-10T14:06:27.736117+0000 mgr.gibba043.dnkmem (mgr.34373) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:29 gibba003 bash[31385]: cluster 2021-03-10T14:06:27.736117+0000 mgr.gibba043.dnkmem (mgr.34373) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:29 gibba003 bash[32348]: cluster 2021-03-10T14:06:27.736117+0000 mgr.gibba043.dnkmem (mgr.34373) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:31 gibba043 bash[24019]: cluster 2021-03-10T14:06:29.737604+0000 mgr.gibba043.dnkmem (mgr.34373) 851 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:31 gibba043 bash[24019]: audit 2021-03-10T14:06:30.378395+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:06:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:31 gibba003 bash[31385]: cluster 2021-03-10T14:06:29.737604+0000 mgr.gibba043.dnkmem (mgr.34373) 851 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:31.679 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:31 gibba003 bash[31385]: audit 2021-03-10T14:06:30.378395+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:06:31.680 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:31 gibba003 bash[32348]: cluster 2021-03-10T14:06:29.737604+0000 mgr.gibba043.dnkmem (mgr.34373) 851 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:31.680 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:31 gibba003 bash[32348]: audit 2021-03-10T14:06:30.378395+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:06:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:32 gibba003 bash[31385]: cephadm 2021-03-10T14:06:30.376905+0000 mgr.gibba043.dnkmem (mgr.34373) 852 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:06:32.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:32 gibba003 bash[32348]: cephadm 2021-03-10T14:06:30.376905+0000 mgr.gibba043.dnkmem (mgr.34373) 852 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:06:32.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:32 gibba043 bash[24019]: cephadm 2021-03-10T14:06:30.376905+0000 mgr.gibba043.dnkmem (mgr.34373) 852 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:06:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:33 gibba003 bash[31385]: cluster 2021-03-10T14:06:31.739171+0000 mgr.gibba043.dnkmem (mgr.34373) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:33 gibba003 bash[32348]: cluster 2021-03-10T14:06:31.739171+0000 mgr.gibba043.dnkmem (mgr.34373) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:33 gibba043 bash[24019]: cluster 2021-03-10T14:06:31.739171+0000 mgr.gibba043.dnkmem (mgr.34373) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: cluster 2021-03-10T14:06:33.739650+0000 mgr.gibba043.dnkmem (mgr.34373) 854 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.088309+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:06:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.090193+0000 mgr.gibba043.dnkmem (mgr.34373) 855 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:06:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.316817+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:06:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.320837+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.323337+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.325684+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.328444+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.334550+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[31385]: audit 2021-03-10T14:06:34.337151+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: cluster 2021-03-10T14:06:33.739650+0000 mgr.gibba043.dnkmem (mgr.34373) 854 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.088309+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:06:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.090193+0000 mgr.gibba043.dnkmem (mgr.34373) 855 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:06:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.316817+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:06:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.320837+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.323337+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.325684+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.328444+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.334550+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:35 gibba003 bash[32348]: audit 2021-03-10T14:06:34.337151+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: cluster 2021-03-10T14:06:33.739650+0000 mgr.gibba043.dnkmem (mgr.34373) 854 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.088309+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:06:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.090193+0000 mgr.gibba043.dnkmem (mgr.34373) 855 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:06:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.316817+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:06:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.320837+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.323337+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.325684+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.328444+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.334550+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:35 gibba043 bash[24019]: audit 2021-03-10T14:06:34.337151+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.320329+0000 mgr.gibba043.dnkmem (mgr.34373) 856 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.323218+0000 mgr.gibba043.dnkmem (mgr.34373) 857 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.325495+0000 mgr.gibba043.dnkmem (mgr.34373) 858 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.325533+0000 mgr.gibba043.dnkmem (mgr.34373) 859 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.328116+0000 mgr.gibba043.dnkmem (mgr.34373) 860 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.328153+0000 mgr.gibba043.dnkmem (mgr.34373) 861 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.330708+0000 mgr.gibba043.dnkmem (mgr.34373) 862 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.334302+0000 mgr.gibba043.dnkmem (mgr.34373) 863 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.334337+0000 mgr.gibba043.dnkmem (mgr.34373) 864 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.336761+0000 mgr.gibba043.dnkmem (mgr.34373) 865 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.337090+0000 mgr.gibba043.dnkmem (mgr.34373) 866 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.339726+0000 mgr.gibba043.dnkmem (mgr.34373) 867 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.339790+0000 mgr.gibba043.dnkmem (mgr.34373) 868 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[31385]: cephadm 2021-03-10T14:06:34.339904+0000 mgr.gibba043.dnkmem (mgr.34373) 869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:36.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.320329+0000 mgr.gibba043.dnkmem (mgr.34373) 856 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.323218+0000 mgr.gibba043.dnkmem (mgr.34373) 857 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.325495+0000 mgr.gibba043.dnkmem (mgr.34373) 858 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.325533+0000 mgr.gibba043.dnkmem (mgr.34373) 859 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.328116+0000 mgr.gibba043.dnkmem (mgr.34373) 860 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.328153+0000 mgr.gibba043.dnkmem (mgr.34373) 861 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.330708+0000 mgr.gibba043.dnkmem (mgr.34373) 862 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.334302+0000 mgr.gibba043.dnkmem (mgr.34373) 863 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.334337+0000 mgr.gibba043.dnkmem (mgr.34373) 864 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.336761+0000 mgr.gibba043.dnkmem (mgr.34373) 865 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.337090+0000 mgr.gibba043.dnkmem (mgr.34373) 866 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.339726+0000 mgr.gibba043.dnkmem (mgr.34373) 867 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.339790+0000 mgr.gibba043.dnkmem (mgr.34373) 868 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:36 gibba003 bash[32348]: cephadm 2021-03-10T14:06:34.339904+0000 mgr.gibba043.dnkmem (mgr.34373) 869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.320329+0000 mgr.gibba043.dnkmem (mgr.34373) 856 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.323218+0000 mgr.gibba043.dnkmem (mgr.34373) 857 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.325495+0000 mgr.gibba043.dnkmem (mgr.34373) 858 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.325533+0000 mgr.gibba043.dnkmem (mgr.34373) 859 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.328116+0000 mgr.gibba043.dnkmem (mgr.34373) 860 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.328153+0000 mgr.gibba043.dnkmem (mgr.34373) 861 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.330708+0000 mgr.gibba043.dnkmem (mgr.34373) 862 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.334302+0000 mgr.gibba043.dnkmem (mgr.34373) 863 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.334337+0000 mgr.gibba043.dnkmem (mgr.34373) 864 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.336761+0000 mgr.gibba043.dnkmem (mgr.34373) 865 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.337090+0000 mgr.gibba043.dnkmem (mgr.34373) 866 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.339726+0000 mgr.gibba043.dnkmem (mgr.34373) 867 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.339790+0000 mgr.gibba043.dnkmem (mgr.34373) 868 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:36.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:36 gibba043 bash[24019]: cephadm 2021-03-10T14:06:34.339904+0000 mgr.gibba043.dnkmem (mgr.34373) 869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:37 gibba003 bash[31385]: cluster 2021-03-10T14:06:35.740693+0000 mgr.gibba043.dnkmem (mgr.34373) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:37 gibba003 bash[32348]: cluster 2021-03-10T14:06:35.740693+0000 mgr.gibba043.dnkmem (mgr.34373) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:37.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:37 gibba043 bash[24019]: cluster 2021-03-10T14:06:35.740693+0000 mgr.gibba043.dnkmem (mgr.34373) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:39 gibba003 bash[31385]: cluster 2021-03-10T14:06:37.742042+0000 mgr.gibba043.dnkmem (mgr.34373) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:39 gibba003 bash[32348]: cluster 2021-03-10T14:06:37.742042+0000 mgr.gibba043.dnkmem (mgr.34373) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:39 gibba043 bash[24019]: cluster 2021-03-10T14:06:37.742042+0000 mgr.gibba043.dnkmem (mgr.34373) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:41 gibba003 bash[31385]: cluster 2021-03-10T14:06:39.743367+0000 mgr.gibba043.dnkmem (mgr.34373) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:41 gibba003 bash[32348]: cluster 2021-03-10T14:06:39.743367+0000 mgr.gibba043.dnkmem (mgr.34373) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:41 gibba043 bash[24019]: cluster 2021-03-10T14:06:39.743367+0000 mgr.gibba043.dnkmem (mgr.34373) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:43 gibba003 bash[31385]: cluster 2021-03-10T14:06:41.745139+0000 mgr.gibba043.dnkmem (mgr.34373) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:43.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:43 gibba003 bash[32348]: cluster 2021-03-10T14:06:41.745139+0000 mgr.gibba043.dnkmem (mgr.34373) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:43 gibba043 bash[24019]: cluster 2021-03-10T14:06:41.745139+0000 mgr.gibba043.dnkmem (mgr.34373) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:45 gibba003 bash[31385]: cluster 2021-03-10T14:06:43.746723+0000 mgr.gibba043.dnkmem (mgr.34373) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:45 gibba003 bash[32348]: cluster 2021-03-10T14:06:43.746723+0000 mgr.gibba043.dnkmem (mgr.34373) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:45.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:45 gibba043 bash[24019]: cluster 2021-03-10T14:06:43.746723+0000 mgr.gibba043.dnkmem (mgr.34373) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:47 gibba003 bash[31385]: cluster 2021-03-10T14:06:45.748294+0000 mgr.gibba043.dnkmem (mgr.34373) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:47 gibba003 bash[32348]: cluster 2021-03-10T14:06:45.748294+0000 mgr.gibba043.dnkmem (mgr.34373) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:47 gibba043 bash[24019]: cluster 2021-03-10T14:06:45.748294+0000 mgr.gibba043.dnkmem (mgr.34373) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:49 gibba003 bash[31385]: cluster 2021-03-10T14:06:47.749751+0000 mgr.gibba043.dnkmem (mgr.34373) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:49 gibba003 bash[32348]: cluster 2021-03-10T14:06:47.749751+0000 mgr.gibba043.dnkmem (mgr.34373) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:49 gibba043 bash[24019]: cluster 2021-03-10T14:06:47.749751+0000 mgr.gibba043.dnkmem (mgr.34373) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:51 gibba003 bash[31385]: cephadm 2021-03-10T14:06:49.356008+0000 mgr.gibba043.dnkmem (mgr.34373) 877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:51 gibba003 bash[31385]: cluster 2021-03-10T14:06:49.751183+0000 mgr.gibba043.dnkmem (mgr.34373) 878 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:51 gibba003 bash[32348]: cephadm 2021-03-10T14:06:49.356008+0000 mgr.gibba043.dnkmem (mgr.34373) 877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:51 gibba003 bash[32348]: cluster 2021-03-10T14:06:49.751183+0000 mgr.gibba043.dnkmem (mgr.34373) 878 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:51 gibba043 bash[24019]: cephadm 2021-03-10T14:06:49.356008+0000 mgr.gibba043.dnkmem (mgr.34373) 877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:06:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:51 gibba043 bash[24019]: cluster 2021-03-10T14:06:49.751183+0000 mgr.gibba043.dnkmem (mgr.34373) 878 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:53 gibba003 bash[31385]: cluster 2021-03-10T14:06:51.752867+0000 mgr.gibba043.dnkmem (mgr.34373) 879 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:53 gibba003 bash[32348]: cluster 2021-03-10T14:06:51.752867+0000 mgr.gibba043.dnkmem (mgr.34373) 879 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:53 gibba043 bash[24019]: cluster 2021-03-10T14:06:51.752867+0000 mgr.gibba043.dnkmem (mgr.34373) 879 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.820 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:06:54.048 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:06:54.048 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (15m) 83s ago 20m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:06:54.049 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (20m) 19s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:06:54.049 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (15m) 19s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:06:54.049 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (15m) 19s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:06:54.049 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (14m) 83s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:06:54.049 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (14m) 83s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:06:54.050 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (14m) 19s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:06:54.050 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (14m) 83s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:06:54.050 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (20m) 83s ago 20m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:06:54.050 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (20m) 19s ago 20m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:06:54.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (13m) 83s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:06:54.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (13m) 83s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:06:54.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (12m) 83s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:06:54.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (12m) 83s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:06:54.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (11m) 19s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:06:54.052 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (11m) 19s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:06:54.052 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (10m) 19s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:06:54.052 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (10m) 19s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:06:54.052 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (20m) 19s ago 20m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:06:54.052 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 83s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:06:54.299 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:06:54.299 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:06:54.299 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:54.299 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:06:54.300 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:06:54.300 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:54.300 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:06:54.300 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:06:54.300 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:06:54.301 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:06:54.301 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:06:54.301 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:06:54.301 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:06:54.302 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:06:54.302 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:06:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[31385]: cluster 2021-03-10T14:06:53.754226+0000 mgr.gibba043.dnkmem (mgr.34373) 880 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[31385]: audit 2021-03-10T14:06:53.812389+0000 mgr.gibba043.dnkmem (mgr.34373) 881 : audit [DBG] from='client.54634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[31385]: audit 2021-03-10T14:06:54.037754+0000 mgr.gibba043.dnkmem (mgr.34373) 882 : audit [DBG] from='client.54640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[31385]: audit 2021-03-10T14:06:54.299823+0000 mon.c (mon.1) 284 : audit [DBG] from='client.? 172.21.2.103:0/1659916943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[32348]: cluster 2021-03-10T14:06:53.754226+0000 mgr.gibba043.dnkmem (mgr.34373) 880 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[32348]: audit 2021-03-10T14:06:53.812389+0000 mgr.gibba043.dnkmem (mgr.34373) 881 : audit [DBG] from='client.54634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[32348]: audit 2021-03-10T14:06:54.037754+0000 mgr.gibba043.dnkmem (mgr.34373) 882 : audit [DBG] from='client.54640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:55 gibba003 bash[32348]: audit 2021-03-10T14:06:54.299823+0000 mon.c (mon.1) 284 : audit [DBG] from='client.? 172.21.2.103:0/1659916943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:55 gibba043 bash[24019]: cluster 2021-03-10T14:06:53.754226+0000 mgr.gibba043.dnkmem (mgr.34373) 880 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:55 gibba043 bash[24019]: audit 2021-03-10T14:06:53.812389+0000 mgr.gibba043.dnkmem (mgr.34373) 881 : audit [DBG] from='client.54634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:55 gibba043 bash[24019]: audit 2021-03-10T14:06:54.037754+0000 mgr.gibba043.dnkmem (mgr.34373) 882 : audit [DBG] from='client.54640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:55 gibba043 bash[24019]: audit 2021-03-10T14:06:54.299823+0000 mon.c (mon.1) 284 : audit [DBG] from='client.? 172.21.2.103:0/1659916943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:57 gibba043 bash[24019]: cluster 2021-03-10T14:06:55.755758+0000 mgr.gibba043.dnkmem (mgr.34373) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:57 gibba003 bash[31385]: cluster 2021-03-10T14:06:55.755758+0000 mgr.gibba043.dnkmem (mgr.34373) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:57 gibba003 bash[32348]: cluster 2021-03-10T14:06:55.755758+0000 mgr.gibba043.dnkmem (mgr.34373) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:06:59 gibba043 bash[24019]: cluster 2021-03-10T14:06:57.757239+0000 mgr.gibba043.dnkmem (mgr.34373) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:06:59 gibba003 bash[31385]: cluster 2021-03-10T14:06:57.757239+0000 mgr.gibba043.dnkmem (mgr.34373) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:59.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:06:59 gibba003 bash[32348]: cluster 2021-03-10T14:06:57.757239+0000 mgr.gibba043.dnkmem (mgr.34373) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:01 gibba043 bash[24019]: cluster 2021-03-10T14:06:59.758879+0000 mgr.gibba043.dnkmem (mgr.34373) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:01 gibba003 bash[31385]: cluster 2021-03-10T14:06:59.758879+0000 mgr.gibba043.dnkmem (mgr.34373) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:01 gibba003 bash[32348]: cluster 2021-03-10T14:06:59.758879+0000 mgr.gibba043.dnkmem (mgr.34373) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:03 gibba043 bash[24019]: cluster 2021-03-10T14:07:01.760438+0000 mgr.gibba043.dnkmem (mgr.34373) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:03 gibba003 bash[31385]: cluster 2021-03-10T14:07:01.760438+0000 mgr.gibba043.dnkmem (mgr.34373) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:03 gibba003 bash[32348]: cluster 2021-03-10T14:07:01.760438+0000 mgr.gibba043.dnkmem (mgr.34373) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:05 gibba043 bash[24019]: cluster 2021-03-10T14:07:03.762070+0000 mgr.gibba043.dnkmem (mgr.34373) 887 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:05 gibba003 bash[31385]: cluster 2021-03-10T14:07:03.762070+0000 mgr.gibba043.dnkmem (mgr.34373) 887 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:05.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:05 gibba003 bash[32348]: cluster 2021-03-10T14:07:03.762070+0000 mgr.gibba043.dnkmem (mgr.34373) 887 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:06 gibba043 bash[24019]: cephadm 2021-03-10T14:07:04.368763+0000 mgr.gibba043.dnkmem (mgr.34373) 888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:06.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:06 gibba003 bash[31385]: cephadm 2021-03-10T14:07:04.368763+0000 mgr.gibba043.dnkmem (mgr.34373) 888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:06.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:06 gibba003 bash[32348]: cephadm 2021-03-10T14:07:04.368763+0000 mgr.gibba043.dnkmem (mgr.34373) 888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:07 gibba043 bash[24019]: cluster 2021-03-10T14:07:05.763628+0000 mgr.gibba043.dnkmem (mgr.34373) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:07 gibba003 bash[31385]: cluster 2021-03-10T14:07:05.763628+0000 mgr.gibba043.dnkmem (mgr.34373) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:07 gibba003 bash[32348]: cluster 2021-03-10T14:07:05.763628+0000 mgr.gibba043.dnkmem (mgr.34373) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:09 gibba043 bash[24019]: cluster 2021-03-10T14:07:07.765167+0000 mgr.gibba043.dnkmem (mgr.34373) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:09 gibba003 bash[31385]: cluster 2021-03-10T14:07:07.765167+0000 mgr.gibba043.dnkmem (mgr.34373) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:09 gibba003 bash[32348]: cluster 2021-03-10T14:07:07.765167+0000 mgr.gibba043.dnkmem (mgr.34373) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:11 gibba043 bash[24019]: cluster 2021-03-10T14:07:09.766684+0000 mgr.gibba043.dnkmem (mgr.34373) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:11 gibba003 bash[31385]: cluster 2021-03-10T14:07:09.766684+0000 mgr.gibba043.dnkmem (mgr.34373) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:11 gibba003 bash[32348]: cluster 2021-03-10T14:07:09.766684+0000 mgr.gibba043.dnkmem (mgr.34373) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: cluster 2021-03-10T14:07:11.768389+0000 mgr.gibba043.dnkmem (mgr.34373) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.692057+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:07:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.693194+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.693504+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:07:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.694208+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:07:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.694657+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.695488+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.695501+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:07:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.696834+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.814450+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.815755+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.839120+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[31385]: audit 2021-03-10T14:07:12.840432+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: cluster 2021-03-10T14:07:11.768389+0000 mgr.gibba043.dnkmem (mgr.34373) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.692057+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:07:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.693194+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.693504+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:07:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.694208+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:07:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.694657+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.695488+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.695501+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:07:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.696834+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.814450+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.815755+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.839120+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:13 gibba003 bash[32348]: audit 2021-03-10T14:07:12.840432+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: cluster 2021-03-10T14:07:11.768389+0000 mgr.gibba043.dnkmem (mgr.34373) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.692057+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:07:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.693194+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.693504+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:07:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.694208+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:07:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.694657+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.695488+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.695501+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:07:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.696834+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:07:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.814450+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.815755+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.839120+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:13 gibba043 bash[24019]: audit 2021-03-10T14:07:12.840432+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:15 gibba003 bash[31385]: cluster 2021-03-10T14:07:13.769687+0000 mgr.gibba043.dnkmem (mgr.34373) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:15 gibba003 bash[32348]: cluster 2021-03-10T14:07:13.769687+0000 mgr.gibba043.dnkmem (mgr.34373) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:15 gibba043 bash[24019]: cluster 2021-03-10T14:07:13.769687+0000 mgr.gibba043.dnkmem (mgr.34373) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:17 gibba003 bash[31385]: cluster 2021-03-10T14:07:15.771262+0000 mgr.gibba043.dnkmem (mgr.34373) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:17.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:17 gibba003 bash[32348]: cluster 2021-03-10T14:07:15.771262+0000 mgr.gibba043.dnkmem (mgr.34373) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:17 gibba043 bash[24019]: cluster 2021-03-10T14:07:15.771262+0000 mgr.gibba043.dnkmem (mgr.34373) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:19 gibba003 bash[31385]: cluster 2021-03-10T14:07:17.772521+0000 mgr.gibba043.dnkmem (mgr.34373) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:19 gibba003 bash[32348]: cluster 2021-03-10T14:07:17.772521+0000 mgr.gibba043.dnkmem (mgr.34373) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:19 gibba043 bash[24019]: cluster 2021-03-10T14:07:17.772521+0000 mgr.gibba043.dnkmem (mgr.34373) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:21 gibba003 bash[31385]: cephadm 2021-03-10T14:07:19.384749+0000 mgr.gibba043.dnkmem (mgr.34373) 896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:21 gibba003 bash[31385]: cluster 2021-03-10T14:07:19.774163+0000 mgr.gibba043.dnkmem (mgr.34373) 897 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:21 gibba003 bash[32348]: cephadm 2021-03-10T14:07:19.384749+0000 mgr.gibba043.dnkmem (mgr.34373) 896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:21 gibba003 bash[32348]: cluster 2021-03-10T14:07:19.774163+0000 mgr.gibba043.dnkmem (mgr.34373) 897 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:21 gibba043 bash[24019]: cephadm 2021-03-10T14:07:19.384749+0000 mgr.gibba043.dnkmem (mgr.34373) 896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:21 gibba043 bash[24019]: cluster 2021-03-10T14:07:19.774163+0000 mgr.gibba043.dnkmem (mgr.34373) 897 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:23 gibba003 bash[31385]: cluster 2021-03-10T14:07:21.775723+0000 mgr.gibba043.dnkmem (mgr.34373) 898 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:23 gibba003 bash[32348]: cluster 2021-03-10T14:07:21.775723+0000 mgr.gibba043.dnkmem (mgr.34373) 898 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:23 gibba043 bash[24019]: cluster 2021-03-10T14:07:21.775723+0000 mgr.gibba043.dnkmem (mgr.34373) 898 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:24.544 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:07:24.799 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:07:24.799 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (15m) 114s ago 21m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:07:24.799 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (20m) 50s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:07:24.799 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (16m) 50s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:07:24.800 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (16m) 50s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:07:24.800 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (15m) 114s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:07:24.800 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (15m) 114s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:07:24.800 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (14m) 50s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:07:24.800 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (15m) 114s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:07:24.801 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (21m) 114s ago 21m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:07:24.801 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (21m) 50s ago 21m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:07:24.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (14m) 114s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:07:24.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (13m) 114s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:07:24.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (13m) 114s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:07:24.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (12m) 114s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:07:24.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (12m) 50s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:07:24.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (11m) 50s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:07:24.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (11m) 50s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:07:24.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (11m) 50s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:07:24.802 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (20m) 50s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:07:24.803 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 114s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:07:25.053 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:07:25.053 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:07:25.053 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:25.053 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:07:25.054 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:07:25.054 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:25.054 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:07:25.054 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:07:25.054 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:07:25.055 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:07:25.055 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:07:25.055 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:07:25.055 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:07:25.055 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:07:25.056 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:07:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:25 gibba003 bash[31385]: cluster 2021-03-10T14:07:23.777090+0000 mgr.gibba043.dnkmem (mgr.34373) 899 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:25 gibba003 bash[31385]: audit 2021-03-10T14:07:25.054199+0000 mon.a (mon.0) 575 : audit [DBG] from='client.? 172.21.2.103:0/312146759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:25 gibba003 bash[32348]: cluster 2021-03-10T14:07:23.777090+0000 mgr.gibba043.dnkmem (mgr.34373) 899 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:25 gibba003 bash[32348]: audit 2021-03-10T14:07:25.054199+0000 mon.a (mon.0) 575 : audit [DBG] from='client.? 172.21.2.103:0/312146759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:25 gibba043 bash[24019]: cluster 2021-03-10T14:07:23.777090+0000 mgr.gibba043.dnkmem (mgr.34373) 899 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:25 gibba043 bash[24019]: audit 2021-03-10T14:07:25.054199+0000 mon.a (mon.0) 575 : audit [DBG] from='client.? 172.21.2.103:0/312146759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:26.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:26 gibba003 bash[31385]: audit 2021-03-10T14:07:24.536110+0000 mgr.gibba043.dnkmem (mgr.34373) 900 : audit [DBG] from='client.44667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:26.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:26 gibba003 bash[31385]: audit 2021-03-10T14:07:24.761552+0000 mgr.gibba043.dnkmem (mgr.34373) 901 : audit [DBG] from='client.54658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:26.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:26 gibba003 bash[31385]: cluster 2021-03-10T14:07:25.778669+0000 mgr.gibba043.dnkmem (mgr.34373) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:26 gibba003 bash[32348]: audit 2021-03-10T14:07:24.536110+0000 mgr.gibba043.dnkmem (mgr.34373) 900 : audit [DBG] from='client.44667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:26 gibba003 bash[32348]: audit 2021-03-10T14:07:24.761552+0000 mgr.gibba043.dnkmem (mgr.34373) 901 : audit [DBG] from='client.54658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:26 gibba003 bash[32348]: cluster 2021-03-10T14:07:25.778669+0000 mgr.gibba043.dnkmem (mgr.34373) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:26.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:26 gibba043 bash[24019]: audit 2021-03-10T14:07:24.536110+0000 mgr.gibba043.dnkmem (mgr.34373) 900 : audit [DBG] from='client.44667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:26 gibba043 bash[24019]: audit 2021-03-10T14:07:24.761552+0000 mgr.gibba043.dnkmem (mgr.34373) 901 : audit [DBG] from='client.54658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:26 gibba043 bash[24019]: cluster 2021-03-10T14:07:25.778669+0000 mgr.gibba043.dnkmem (mgr.34373) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:29 gibba043 bash[24019]: cluster 2021-03-10T14:07:27.780213+0000 mgr.gibba043.dnkmem (mgr.34373) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:29 gibba003 bash[31385]: cluster 2021-03-10T14:07:27.780213+0000 mgr.gibba043.dnkmem (mgr.34373) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:29 gibba003 bash[32348]: cluster 2021-03-10T14:07:27.780213+0000 mgr.gibba043.dnkmem (mgr.34373) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:31 gibba003 bash[31385]: cluster 2021-03-10T14:07:29.781822+0000 mgr.gibba043.dnkmem (mgr.34373) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:31 gibba003 bash[32348]: cluster 2021-03-10T14:07:29.781822+0000 mgr.gibba043.dnkmem (mgr.34373) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:31 gibba043 bash[24019]: cluster 2021-03-10T14:07:29.781822+0000 mgr.gibba043.dnkmem (mgr.34373) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:33 gibba003 bash[31385]: cluster 2021-03-10T14:07:31.783413+0000 mgr.gibba043.dnkmem (mgr.34373) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:33 gibba003 bash[32348]: cluster 2021-03-10T14:07:31.783413+0000 mgr.gibba043.dnkmem (mgr.34373) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:33 gibba043 bash[24019]: cluster 2021-03-10T14:07:31.783413+0000 mgr.gibba043.dnkmem (mgr.34373) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: cluster 2021-03-10T14:07:33.785008+0000 mgr.gibba043.dnkmem (mgr.34373) 906 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.625573+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:07:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.629341+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.630876+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.632216+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.633221+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.635746+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[31385]: audit 2021-03-10T14:07:34.637490+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: cluster 2021-03-10T14:07:33.785008+0000 mgr.gibba043.dnkmem (mgr.34373) 906 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.625573+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:07:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.629341+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.630876+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.632216+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.633221+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.635746+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:35 gibba003 bash[32348]: audit 2021-03-10T14:07:34.637490+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: cluster 2021-03-10T14:07:33.785008+0000 mgr.gibba043.dnkmem (mgr.34373) 906 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.625573+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:07:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.629341+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.630876+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.632216+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.633221+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.635746+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:35 gibba043 bash[24019]: audit 2021-03-10T14:07:34.637490+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.401326+0000 mgr.gibba043.dnkmem (mgr.34373) 907 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:07:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.402933+0000 mgr.gibba043.dnkmem (mgr.34373) 908 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:07:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.628565+0000 mgr.gibba043.dnkmem (mgr.34373) 909 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.630332+0000 mgr.gibba043.dnkmem (mgr.34373) 910 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.631610+0000 mgr.gibba043.dnkmem (mgr.34373) 911 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.631658+0000 mgr.gibba043.dnkmem (mgr.34373) 912 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.632886+0000 mgr.gibba043.dnkmem (mgr.34373) 913 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.632924+0000 mgr.gibba043.dnkmem (mgr.34373) 914 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.633801+0000 mgr.gibba043.dnkmem (mgr.34373) 915 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.635117+0000 mgr.gibba043.dnkmem (mgr.34373) 916 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.635158+0000 mgr.gibba043.dnkmem (mgr.34373) 917 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.636682+0000 mgr.gibba043.dnkmem (mgr.34373) 918 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.637002+0000 mgr.gibba043.dnkmem (mgr.34373) 919 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.638210+0000 mgr.gibba043.dnkmem (mgr.34373) 920 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.638248+0000 mgr.gibba043.dnkmem (mgr.34373) 921 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[31385]: cephadm 2021-03-10T14:07:34.638354+0000 mgr.gibba043.dnkmem (mgr.34373) 922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:36.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.401326+0000 mgr.gibba043.dnkmem (mgr.34373) 907 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:07:36.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.402933+0000 mgr.gibba043.dnkmem (mgr.34373) 908 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:07:36.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.628565+0000 mgr.gibba043.dnkmem (mgr.34373) 909 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:36.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.630332+0000 mgr.gibba043.dnkmem (mgr.34373) 910 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:36.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.631610+0000 mgr.gibba043.dnkmem (mgr.34373) 911 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.631658+0000 mgr.gibba043.dnkmem (mgr.34373) 912 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.632886+0000 mgr.gibba043.dnkmem (mgr.34373) 913 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.632924+0000 mgr.gibba043.dnkmem (mgr.34373) 914 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.633801+0000 mgr.gibba043.dnkmem (mgr.34373) 915 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:36.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.635117+0000 mgr.gibba043.dnkmem (mgr.34373) 916 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.635158+0000 mgr.gibba043.dnkmem (mgr.34373) 917 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.636682+0000 mgr.gibba043.dnkmem (mgr.34373) 918 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.637002+0000 mgr.gibba043.dnkmem (mgr.34373) 919 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:36.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.638210+0000 mgr.gibba043.dnkmem (mgr.34373) 920 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.638248+0000 mgr.gibba043.dnkmem (mgr.34373) 921 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:36 gibba003 bash[32348]: cephadm 2021-03-10T14:07:34.638354+0000 mgr.gibba043.dnkmem (mgr.34373) 922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.401326+0000 mgr.gibba043.dnkmem (mgr.34373) 907 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:07:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.402933+0000 mgr.gibba043.dnkmem (mgr.34373) 908 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:07:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.628565+0000 mgr.gibba043.dnkmem (mgr.34373) 909 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.630332+0000 mgr.gibba043.dnkmem (mgr.34373) 910 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.631610+0000 mgr.gibba043.dnkmem (mgr.34373) 911 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.631658+0000 mgr.gibba043.dnkmem (mgr.34373) 912 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.632886+0000 mgr.gibba043.dnkmem (mgr.34373) 913 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.632924+0000 mgr.gibba043.dnkmem (mgr.34373) 914 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.633801+0000 mgr.gibba043.dnkmem (mgr.34373) 915 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.635117+0000 mgr.gibba043.dnkmem (mgr.34373) 916 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.635158+0000 mgr.gibba043.dnkmem (mgr.34373) 917 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.636682+0000 mgr.gibba043.dnkmem (mgr.34373) 918 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.637002+0000 mgr.gibba043.dnkmem (mgr.34373) 919 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.638210+0000 mgr.gibba043.dnkmem (mgr.34373) 920 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.638248+0000 mgr.gibba043.dnkmem (mgr.34373) 921 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:36.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:36 gibba043 bash[24019]: cephadm 2021-03-10T14:07:34.638354+0000 mgr.gibba043.dnkmem (mgr.34373) 922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:37 gibba003 bash[31385]: cluster 2021-03-10T14:07:35.786629+0000 mgr.gibba043.dnkmem (mgr.34373) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:37 gibba003 bash[32348]: cluster 2021-03-10T14:07:35.786629+0000 mgr.gibba043.dnkmem (mgr.34373) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:37.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:37 gibba043 bash[24019]: cluster 2021-03-10T14:07:35.786629+0000 mgr.gibba043.dnkmem (mgr.34373) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:39 gibba003 bash[31385]: cluster 2021-03-10T14:07:37.788004+0000 mgr.gibba043.dnkmem (mgr.34373) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:39 gibba003 bash[32348]: cluster 2021-03-10T14:07:37.788004+0000 mgr.gibba043.dnkmem (mgr.34373) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:39.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:39 gibba043 bash[24019]: cluster 2021-03-10T14:07:37.788004+0000 mgr.gibba043.dnkmem (mgr.34373) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:41.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:41 gibba003 bash[32348]: cluster 2021-03-10T14:07:39.789608+0000 mgr.gibba043.dnkmem (mgr.34373) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:41 gibba003 bash[31385]: cluster 2021-03-10T14:07:39.789608+0000 mgr.gibba043.dnkmem (mgr.34373) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:41.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:41 gibba043 bash[24019]: cluster 2021-03-10T14:07:39.789608+0000 mgr.gibba043.dnkmem (mgr.34373) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:43 gibba003 bash[31385]: cluster 2021-03-10T14:07:41.791245+0000 mgr.gibba043.dnkmem (mgr.34373) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:43.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:43 gibba003 bash[32348]: cluster 2021-03-10T14:07:41.791245+0000 mgr.gibba043.dnkmem (mgr.34373) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:43 gibba043 bash[24019]: cluster 2021-03-10T14:07:41.791245+0000 mgr.gibba043.dnkmem (mgr.34373) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:45 gibba003 bash[31385]: cluster 2021-03-10T14:07:43.792775+0000 mgr.gibba043.dnkmem (mgr.34373) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:45 gibba003 bash[32348]: cluster 2021-03-10T14:07:43.792775+0000 mgr.gibba043.dnkmem (mgr.34373) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:45.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:45 gibba043 bash[24019]: cluster 2021-03-10T14:07:43.792775+0000 mgr.gibba043.dnkmem (mgr.34373) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:47 gibba003 bash[31385]: cluster 2021-03-10T14:07:45.794295+0000 mgr.gibba043.dnkmem (mgr.34373) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:47 gibba003 bash[32348]: cluster 2021-03-10T14:07:45.794295+0000 mgr.gibba043.dnkmem (mgr.34373) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:47 gibba043 bash[24019]: cluster 2021-03-10T14:07:45.794295+0000 mgr.gibba043.dnkmem (mgr.34373) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:49 gibba003 bash[31385]: cluster 2021-03-10T14:07:47.795790+0000 mgr.gibba043.dnkmem (mgr.34373) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:49 gibba003 bash[32348]: cluster 2021-03-10T14:07:47.795790+0000 mgr.gibba043.dnkmem (mgr.34373) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:49 gibba043 bash[24019]: cluster 2021-03-10T14:07:47.795790+0000 mgr.gibba043.dnkmem (mgr.34373) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:51 gibba003 bash[31385]: cephadm 2021-03-10T14:07:49.654029+0000 mgr.gibba043.dnkmem (mgr.34373) 930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:51 gibba003 bash[31385]: cluster 2021-03-10T14:07:49.797497+0000 mgr.gibba043.dnkmem (mgr.34373) 931 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:51 gibba003 bash[32348]: cephadm 2021-03-10T14:07:49.654029+0000 mgr.gibba043.dnkmem (mgr.34373) 930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:51 gibba003 bash[32348]: cluster 2021-03-10T14:07:49.797497+0000 mgr.gibba043.dnkmem (mgr.34373) 931 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:51 gibba043 bash[24019]: cephadm 2021-03-10T14:07:49.654029+0000 mgr.gibba043.dnkmem (mgr.34373) 930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:07:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:51 gibba043 bash[24019]: cluster 2021-03-10T14:07:49.797497+0000 mgr.gibba043.dnkmem (mgr.34373) 931 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:53 gibba003 bash[31385]: cluster 2021-03-10T14:07:51.799000+0000 mgr.gibba043.dnkmem (mgr.34373) 932 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:53 gibba003 bash[32348]: cluster 2021-03-10T14:07:51.799000+0000 mgr.gibba043.dnkmem (mgr.34373) 932 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:53 gibba043 bash[24019]: cluster 2021-03-10T14:07:51.799000+0000 mgr.gibba043.dnkmem (mgr.34373) 932 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.299 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:07:55.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:55 gibba003 bash[32348]: cluster 2021-03-10T14:07:53.800659+0000 mgr.gibba043.dnkmem (mgr.34373) 933 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:55 gibba003 bash[31385]: cluster 2021-03-10T14:07:53.800659+0000 mgr.gibba043.dnkmem (mgr.34373) 933 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:55 gibba043 bash[24019]: cluster 2021-03-10T14:07:53.800659+0000 mgr.gibba043.dnkmem (mgr.34373) 933 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.529 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:07:55.529 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (16m) 2m ago 21m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:07:55.529 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (21m) 81s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:07:55.530 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (16m) 81s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:07:55.530 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (16m) 81s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:07:55.530 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:07:55.530 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:07:55.530 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (15m) 81s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:07:55.531 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:07:55.531 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (21m) 2m ago 21m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:07:55.531 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (21m) 81s ago 21m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:07:55.531 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:07:55.531 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:07:55.532 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:07:55.532 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:07:55.532 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (12m) 81s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:07:55.532 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (12m) 81s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:07:55.532 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (12m) 81s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:07:55.533 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (11m) 81s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:07:55.533 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (21m) 81s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:07:55.533 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:07:55.777 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:07:55.777 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:07:55.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:55.778 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:07:55.778 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:07:55.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:55.779 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:07:55.779 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:07:55.779 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:07:55.779 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:07:55.779 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:07:55.780 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:07:55.780 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:07:55.780 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:07:55.780 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:07:56.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:56 gibba003 bash[31385]: audit 2021-03-10T14:07:55.290749+0000 mgr.gibba043.dnkmem (mgr.34373) 934 : audit [DBG] from='client.44685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:56 gibba003 bash[31385]: audit 2021-03-10T14:07:55.778360+0000 mon.c (mon.1) 297 : audit [DBG] from='client.? 172.21.2.103:0/3708478950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:56 gibba003 bash[32348]: audit 2021-03-10T14:07:55.290749+0000 mgr.gibba043.dnkmem (mgr.34373) 934 : audit [DBG] from='client.44685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:56 gibba003 bash[32348]: audit 2021-03-10T14:07:55.778360+0000 mon.c (mon.1) 297 : audit [DBG] from='client.? 172.21.2.103:0/3708478950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:56 gibba043 bash[24019]: audit 2021-03-10T14:07:55.290749+0000 mgr.gibba043.dnkmem (mgr.34373) 934 : audit [DBG] from='client.44685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:56 gibba043 bash[24019]: audit 2021-03-10T14:07:55.778360+0000 mon.c (mon.1) 297 : audit [DBG] from='client.? 172.21.2.103:0/3708478950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:57.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:57 gibba003 bash[31385]: audit 2021-03-10T14:07:55.517333+0000 mgr.gibba043.dnkmem (mgr.34373) 935 : audit [DBG] from='client.44691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:57 gibba003 bash[31385]: cluster 2021-03-10T14:07:55.802271+0000 mgr.gibba043.dnkmem (mgr.34373) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:57 gibba003 bash[32348]: audit 2021-03-10T14:07:55.517333+0000 mgr.gibba043.dnkmem (mgr.34373) 935 : audit [DBG] from='client.44691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:57 gibba003 bash[32348]: cluster 2021-03-10T14:07:55.802271+0000 mgr.gibba043.dnkmem (mgr.34373) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:57 gibba043 bash[24019]: audit 2021-03-10T14:07:55.517333+0000 mgr.gibba043.dnkmem (mgr.34373) 935 : audit [DBG] from='client.44691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:57 gibba043 bash[24019]: cluster 2021-03-10T14:07:55.802271+0000 mgr.gibba043.dnkmem (mgr.34373) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:07:59 gibba003 bash[31385]: cluster 2021-03-10T14:07:57.803820+0000 mgr.gibba043.dnkmem (mgr.34373) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:07:59 gibba003 bash[32348]: cluster 2021-03-10T14:07:57.803820+0000 mgr.gibba043.dnkmem (mgr.34373) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:07:59 gibba043 bash[24019]: cluster 2021-03-10T14:07:57.803820+0000 mgr.gibba043.dnkmem (mgr.34373) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:01.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:01 gibba003 bash[31385]: cluster 2021-03-10T14:07:59.805319+0000 mgr.gibba043.dnkmem (mgr.34373) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:01 gibba003 bash[32348]: cluster 2021-03-10T14:07:59.805319+0000 mgr.gibba043.dnkmem (mgr.34373) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:01 gibba043 bash[24019]: cluster 2021-03-10T14:07:59.805319+0000 mgr.gibba043.dnkmem (mgr.34373) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:03 gibba003 bash[31385]: cluster 2021-03-10T14:08:01.806938+0000 mgr.gibba043.dnkmem (mgr.34373) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:03 gibba003 bash[32348]: cluster 2021-03-10T14:08:01.806938+0000 mgr.gibba043.dnkmem (mgr.34373) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:03 gibba043 bash[24019]: cluster 2021-03-10T14:08:01.806938+0000 mgr.gibba043.dnkmem (mgr.34373) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:05 gibba003 bash[31385]: cluster 2021-03-10T14:08:03.808640+0000 mgr.gibba043.dnkmem (mgr.34373) 940 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:05 gibba003 bash[32348]: cluster 2021-03-10T14:08:03.808640+0000 mgr.gibba043.dnkmem (mgr.34373) 940 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:05 gibba043 bash[24019]: cluster 2021-03-10T14:08:03.808640+0000 mgr.gibba043.dnkmem (mgr.34373) 940 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:06 gibba043 bash[24019]: cephadm 2021-03-10T14:08:04.669952+0000 mgr.gibba043.dnkmem (mgr.34373) 941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:06.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:06 gibba003 bash[31385]: cephadm 2021-03-10T14:08:04.669952+0000 mgr.gibba043.dnkmem (mgr.34373) 941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:06.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:06 gibba003 bash[32348]: cephadm 2021-03-10T14:08:04.669952+0000 mgr.gibba043.dnkmem (mgr.34373) 941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:07 gibba043 bash[24019]: cluster 2021-03-10T14:08:05.810356+0000 mgr.gibba043.dnkmem (mgr.34373) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:07 gibba003 bash[31385]: cluster 2021-03-10T14:08:05.810356+0000 mgr.gibba043.dnkmem (mgr.34373) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:07 gibba003 bash[32348]: cluster 2021-03-10T14:08:05.810356+0000 mgr.gibba043.dnkmem (mgr.34373) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:09 gibba043 bash[24019]: cluster 2021-03-10T14:08:07.811856+0000 mgr.gibba043.dnkmem (mgr.34373) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:09 gibba003 bash[31385]: cluster 2021-03-10T14:08:07.811856+0000 mgr.gibba043.dnkmem (mgr.34373) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:09 gibba003 bash[32348]: cluster 2021-03-10T14:08:07.811856+0000 mgr.gibba043.dnkmem (mgr.34373) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:11 gibba043 bash[24019]: cluster 2021-03-10T14:08:09.813450+0000 mgr.gibba043.dnkmem (mgr.34373) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:11 gibba003 bash[31385]: cluster 2021-03-10T14:08:09.813450+0000 mgr.gibba043.dnkmem (mgr.34373) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:11 gibba003 bash[32348]: cluster 2021-03-10T14:08:09.813450+0000 mgr.gibba043.dnkmem (mgr.34373) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: cluster 2021-03-10T14:08:11.815085+0000 mgr.gibba043.dnkmem (mgr.34373) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.701837+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.702604+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:08:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.703247+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.703384+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.704308+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.705159+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:08:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.706287+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.707234+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.821774+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.823043+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.847997+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:13 gibba043 bash[24019]: audit 2021-03-10T14:08:12.849112+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: cluster 2021-03-10T14:08:11.815085+0000 mgr.gibba043.dnkmem (mgr.34373) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.701837+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.702604+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:08:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.703247+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.703384+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.704308+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.705159+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:08:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.706287+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.707234+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.821774+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.823043+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.847997+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[31385]: audit 2021-03-10T14:08:12.849112+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: cluster 2021-03-10T14:08:11.815085+0000 mgr.gibba043.dnkmem (mgr.34373) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.701837+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.702604+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:08:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.703247+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.703384+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.704308+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.705159+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:08:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.706287+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.707234+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:08:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.821774+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.823043+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.847997+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:13 gibba003 bash[32348]: audit 2021-03-10T14:08:12.849112+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:15 gibba043 bash[24019]: cluster 2021-03-10T14:08:13.816815+0000 mgr.gibba043.dnkmem (mgr.34373) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:15 gibba003 bash[31385]: cluster 2021-03-10T14:08:13.816815+0000 mgr.gibba043.dnkmem (mgr.34373) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:15 gibba003 bash[32348]: cluster 2021-03-10T14:08:13.816815+0000 mgr.gibba043.dnkmem (mgr.34373) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:17 gibba043 bash[24019]: cluster 2021-03-10T14:08:15.818343+0000 mgr.gibba043.dnkmem (mgr.34373) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:17 gibba003 bash[31385]: cluster 2021-03-10T14:08:15.818343+0000 mgr.gibba043.dnkmem (mgr.34373) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:17.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:17 gibba003 bash[32348]: cluster 2021-03-10T14:08:15.818343+0000 mgr.gibba043.dnkmem (mgr.34373) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:19.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:19 gibba043 bash[24019]: cluster 2021-03-10T14:08:17.819860+0000 mgr.gibba043.dnkmem (mgr.34373) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:19 gibba003 bash[31385]: cluster 2021-03-10T14:08:17.819860+0000 mgr.gibba043.dnkmem (mgr.34373) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:19 gibba003 bash[32348]: cluster 2021-03-10T14:08:17.819860+0000 mgr.gibba043.dnkmem (mgr.34373) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:21 gibba003 bash[31385]: cephadm 2021-03-10T14:08:19.685638+0000 mgr.gibba043.dnkmem (mgr.34373) 949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:21 gibba003 bash[31385]: cluster 2021-03-10T14:08:19.821522+0000 mgr.gibba043.dnkmem (mgr.34373) 950 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:21 gibba003 bash[32348]: cephadm 2021-03-10T14:08:19.685638+0000 mgr.gibba043.dnkmem (mgr.34373) 949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:21 gibba003 bash[32348]: cluster 2021-03-10T14:08:19.821522+0000 mgr.gibba043.dnkmem (mgr.34373) 950 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:21 gibba043 bash[24019]: cephadm 2021-03-10T14:08:19.685638+0000 mgr.gibba043.dnkmem (mgr.34373) 949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:21 gibba043 bash[24019]: cluster 2021-03-10T14:08:19.821522+0000 mgr.gibba043.dnkmem (mgr.34373) 950 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:23 gibba003 bash[31385]: cluster 2021-03-10T14:08:21.823137+0000 mgr.gibba043.dnkmem (mgr.34373) 951 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:23 gibba003 bash[32348]: cluster 2021-03-10T14:08:21.823137+0000 mgr.gibba043.dnkmem (mgr.34373) 951 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:23 gibba043 bash[24019]: cluster 2021-03-10T14:08:21.823137+0000 mgr.gibba043.dnkmem (mgr.34373) 951 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:25 gibba003 bash[31385]: cluster 2021-03-10T14:08:23.824772+0000 mgr.gibba043.dnkmem (mgr.34373) 952 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:25 gibba003 bash[32348]: cluster 2021-03-10T14:08:23.824772+0000 mgr.gibba043.dnkmem (mgr.34373) 952 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:25 gibba043 bash[24019]: cluster 2021-03-10T14:08:23.824772+0000 mgr.gibba043.dnkmem (mgr.34373) 952 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:26.020 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:08:26.245 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:08:26.246 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (16m) 2m ago 22m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:08:26.246 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (21m) 112s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:08:26.246 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (17m) 112s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:08:26.246 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (17m) 112s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:08:26.247 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:08:26.247 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:08:26.247 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (15m) 112s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:08:26.247 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:08:26.247 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:08:26.248 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (22m) 112s ago 22m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:08:26.248 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:08:26.248 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (14m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:08:26.248 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:08:26.248 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:08:26.249 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (13m) 112s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:08:26.249 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (12m) 112s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:08:26.249 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (12m) 112s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:08:26.249 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (12m) 112s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:08:26.249 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (21m) 112s ago 22m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:08:26.250 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:08:26.503 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:08:26.503 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:08:26.503 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:26.504 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:08:26.504 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:08:26.504 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:26.504 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:08:26.504 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:08:26.505 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:08:26.505 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:08:26.505 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:08:26.505 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:08:26.505 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:08:26.506 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:08:26.506 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:08:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[31385]: cluster 2021-03-10T14:08:25.826287+0000 mgr.gibba043.dnkmem (mgr.34373) 953 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[31385]: audit 2021-03-10T14:08:26.011356+0000 mgr.gibba043.dnkmem (mgr.34373) 954 : audit [DBG] from='client.44703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[31385]: audit 2021-03-10T14:08:26.234102+0000 mgr.gibba043.dnkmem (mgr.34373) 955 : audit [DBG] from='client.54694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[31385]: audit 2021-03-10T14:08:26.504144+0000 mon.c (mon.1) 304 : audit [DBG] from='client.? 172.21.2.103:0/4086773851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[32348]: cluster 2021-03-10T14:08:25.826287+0000 mgr.gibba043.dnkmem (mgr.34373) 953 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:27.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[32348]: audit 2021-03-10T14:08:26.011356+0000 mgr.gibba043.dnkmem (mgr.34373) 954 : audit [DBG] from='client.44703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:27.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[32348]: audit 2021-03-10T14:08:26.234102+0000 mgr.gibba043.dnkmem (mgr.34373) 955 : audit [DBG] from='client.54694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:27.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:27 gibba003 bash[32348]: audit 2021-03-10T14:08:26.504144+0000 mon.c (mon.1) 304 : audit [DBG] from='client.? 172.21.2.103:0/4086773851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:27 gibba043 bash[24019]: cluster 2021-03-10T14:08:25.826287+0000 mgr.gibba043.dnkmem (mgr.34373) 953 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:27 gibba043 bash[24019]: audit 2021-03-10T14:08:26.011356+0000 mgr.gibba043.dnkmem (mgr.34373) 954 : audit [DBG] from='client.44703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:27 gibba043 bash[24019]: audit 2021-03-10T14:08:26.234102+0000 mgr.gibba043.dnkmem (mgr.34373) 955 : audit [DBG] from='client.54694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:27 gibba043 bash[24019]: audit 2021-03-10T14:08:26.504144+0000 mon.c (mon.1) 304 : audit [DBG] from='client.? 172.21.2.103:0/4086773851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:29 gibba003 bash[31385]: cluster 2021-03-10T14:08:27.827457+0000 mgr.gibba043.dnkmem (mgr.34373) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:29 gibba003 bash[32348]: cluster 2021-03-10T14:08:27.827457+0000 mgr.gibba043.dnkmem (mgr.34373) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:29 gibba043 bash[24019]: cluster 2021-03-10T14:08:27.827457+0000 mgr.gibba043.dnkmem (mgr.34373) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:31 gibba003 bash[31385]: cluster 2021-03-10T14:08:29.829110+0000 mgr.gibba043.dnkmem (mgr.34373) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:31 gibba003 bash[32348]: cluster 2021-03-10T14:08:29.829110+0000 mgr.gibba043.dnkmem (mgr.34373) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:31.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:31 gibba043 bash[24019]: cluster 2021-03-10T14:08:29.829110+0000 mgr.gibba043.dnkmem (mgr.34373) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:33 gibba003 bash[31385]: cluster 2021-03-10T14:08:31.830613+0000 mgr.gibba043.dnkmem (mgr.34373) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:33 gibba003 bash[32348]: cluster 2021-03-10T14:08:31.830613+0000 mgr.gibba043.dnkmem (mgr.34373) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:33 gibba043 bash[24019]: cluster 2021-03-10T14:08:31.830613+0000 mgr.gibba043.dnkmem (mgr.34373) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: cluster 2021-03-10T14:08:33.831999+0000 mgr.gibba043.dnkmem (mgr.34373) 959 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.929687+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:08:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.933807+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.935279+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.936668+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.937929+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.941211+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[31385]: audit 2021-03-10T14:08:34.942817+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: cluster 2021-03-10T14:08:33.831999+0000 mgr.gibba043.dnkmem (mgr.34373) 959 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.929687+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:08:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.933807+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.935279+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.936668+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.937929+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.941211+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:35 gibba003 bash[32348]: audit 2021-03-10T14:08:34.942817+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: cluster 2021-03-10T14:08:33.831999+0000 mgr.gibba043.dnkmem (mgr.34373) 959 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.929687+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:08:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.933807+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.935279+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.936668+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.937929+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.941211+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:35 gibba043 bash[24019]: audit 2021-03-10T14:08:34.942817+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.702067+0000 mgr.gibba043.dnkmem (mgr.34373) 960 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:08:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.703516+0000 mgr.gibba043.dnkmem (mgr.34373) 961 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:08:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.932421+0000 mgr.gibba043.dnkmem (mgr.34373) 962 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.934385+0000 mgr.gibba043.dnkmem (mgr.34373) 963 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.935748+0000 mgr.gibba043.dnkmem (mgr.34373) 964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.935787+0000 mgr.gibba043.dnkmem (mgr.34373) 965 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.937108+0000 mgr.gibba043.dnkmem (mgr.34373) 966 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.937148+0000 mgr.gibba043.dnkmem (mgr.34373) 967 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.938427+0000 mgr.gibba043.dnkmem (mgr.34373) 968 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.940245+0000 mgr.gibba043.dnkmem (mgr.34373) 969 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.940286+0000 mgr.gibba043.dnkmem (mgr.34373) 970 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.941657+0000 mgr.gibba043.dnkmem (mgr.34373) 971 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.941991+0000 mgr.gibba043.dnkmem (mgr.34373) 972 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.943257+0000 mgr.gibba043.dnkmem (mgr.34373) 973 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.943299+0000 mgr.gibba043.dnkmem (mgr.34373) 974 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:36.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[31385]: cephadm 2021-03-10T14:08:34.943411+0000 mgr.gibba043.dnkmem (mgr.34373) 975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.702067+0000 mgr.gibba043.dnkmem (mgr.34373) 960 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:08:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.703516+0000 mgr.gibba043.dnkmem (mgr.34373) 961 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:08:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.932421+0000 mgr.gibba043.dnkmem (mgr.34373) 962 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.934385+0000 mgr.gibba043.dnkmem (mgr.34373) 963 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.935748+0000 mgr.gibba043.dnkmem (mgr.34373) 964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.935787+0000 mgr.gibba043.dnkmem (mgr.34373) 965 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.937108+0000 mgr.gibba043.dnkmem (mgr.34373) 966 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.937148+0000 mgr.gibba043.dnkmem (mgr.34373) 967 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.938427+0000 mgr.gibba043.dnkmem (mgr.34373) 968 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.940245+0000 mgr.gibba043.dnkmem (mgr.34373) 969 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.940286+0000 mgr.gibba043.dnkmem (mgr.34373) 970 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.941657+0000 mgr.gibba043.dnkmem (mgr.34373) 971 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.941991+0000 mgr.gibba043.dnkmem (mgr.34373) 972 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.943257+0000 mgr.gibba043.dnkmem (mgr.34373) 973 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.943299+0000 mgr.gibba043.dnkmem (mgr.34373) 974 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:36 gibba003 bash[32348]: cephadm 2021-03-10T14:08:34.943411+0000 mgr.gibba043.dnkmem (mgr.34373) 975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.702067+0000 mgr.gibba043.dnkmem (mgr.34373) 960 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:08:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.703516+0000 mgr.gibba043.dnkmem (mgr.34373) 961 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:08:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.932421+0000 mgr.gibba043.dnkmem (mgr.34373) 962 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.934385+0000 mgr.gibba043.dnkmem (mgr.34373) 963 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.935748+0000 mgr.gibba043.dnkmem (mgr.34373) 964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.935787+0000 mgr.gibba043.dnkmem (mgr.34373) 965 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.937108+0000 mgr.gibba043.dnkmem (mgr.34373) 966 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.937148+0000 mgr.gibba043.dnkmem (mgr.34373) 967 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.938427+0000 mgr.gibba043.dnkmem (mgr.34373) 968 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.940245+0000 mgr.gibba043.dnkmem (mgr.34373) 969 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.940286+0000 mgr.gibba043.dnkmem (mgr.34373) 970 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.941657+0000 mgr.gibba043.dnkmem (mgr.34373) 971 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.941991+0000 mgr.gibba043.dnkmem (mgr.34373) 972 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.943257+0000 mgr.gibba043.dnkmem (mgr.34373) 973 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.943299+0000 mgr.gibba043.dnkmem (mgr.34373) 974 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:36 gibba043 bash[24019]: cephadm 2021-03-10T14:08:34.943411+0000 mgr.gibba043.dnkmem (mgr.34373) 975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:37 gibba003 bash[31385]: cluster 2021-03-10T14:08:35.833561+0000 mgr.gibba043.dnkmem (mgr.34373) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:37 gibba003 bash[32348]: cluster 2021-03-10T14:08:35.833561+0000 mgr.gibba043.dnkmem (mgr.34373) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:37 gibba043 bash[24019]: cluster 2021-03-10T14:08:35.833561+0000 mgr.gibba043.dnkmem (mgr.34373) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:38.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:38 gibba003 bash[31385]: cluster 2021-03-10T14:08:37.834897+0000 mgr.gibba043.dnkmem (mgr.34373) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:38.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:38 gibba003 bash[32348]: cluster 2021-03-10T14:08:37.834897+0000 mgr.gibba043.dnkmem (mgr.34373) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:38 gibba043 bash[24019]: cluster 2021-03-10T14:08:37.834897+0000 mgr.gibba043.dnkmem (mgr.34373) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:40 gibba003 bash[31385]: cluster 2021-03-10T14:08:39.836550+0000 mgr.gibba043.dnkmem (mgr.34373) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:40 gibba003 bash[32348]: cluster 2021-03-10T14:08:39.836550+0000 mgr.gibba043.dnkmem (mgr.34373) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:40 gibba043 bash[24019]: cluster 2021-03-10T14:08:39.836550+0000 mgr.gibba043.dnkmem (mgr.34373) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:43 gibba003 bash[31385]: cluster 2021-03-10T14:08:41.838176+0000 mgr.gibba043.dnkmem (mgr.34373) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:43.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:43 gibba003 bash[32348]: cluster 2021-03-10T14:08:41.838176+0000 mgr.gibba043.dnkmem (mgr.34373) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:43 gibba043 bash[24019]: cluster 2021-03-10T14:08:41.838176+0000 mgr.gibba043.dnkmem (mgr.34373) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:45 gibba003 bash[31385]: cluster 2021-03-10T14:08:43.839508+0000 mgr.gibba043.dnkmem (mgr.34373) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:45 gibba003 bash[32348]: cluster 2021-03-10T14:08:43.839508+0000 mgr.gibba043.dnkmem (mgr.34373) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:45 gibba043 bash[24019]: cluster 2021-03-10T14:08:43.839508+0000 mgr.gibba043.dnkmem (mgr.34373) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:47 gibba003 bash[31385]: cluster 2021-03-10T14:08:45.841184+0000 mgr.gibba043.dnkmem (mgr.34373) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:47 gibba003 bash[32348]: cluster 2021-03-10T14:08:45.841184+0000 mgr.gibba043.dnkmem (mgr.34373) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:47 gibba043 bash[24019]: cluster 2021-03-10T14:08:45.841184+0000 mgr.gibba043.dnkmem (mgr.34373) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:49 gibba003 bash[31385]: cluster 2021-03-10T14:08:47.842386+0000 mgr.gibba043.dnkmem (mgr.34373) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:49 gibba003 bash[32348]: cluster 2021-03-10T14:08:47.842386+0000 mgr.gibba043.dnkmem (mgr.34373) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:49 gibba043 bash[24019]: cluster 2021-03-10T14:08:47.842386+0000 mgr.gibba043.dnkmem (mgr.34373) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:51 gibba003 bash[31385]: cluster 2021-03-10T14:08:49.844109+0000 mgr.gibba043.dnkmem (mgr.34373) 983 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:51 gibba003 bash[31385]: cephadm 2021-03-10T14:08:49.959213+0000 mgr.gibba043.dnkmem (mgr.34373) 984 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:51 gibba003 bash[32348]: cluster 2021-03-10T14:08:49.844109+0000 mgr.gibba043.dnkmem (mgr.34373) 983 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:51 gibba003 bash[32348]: cephadm 2021-03-10T14:08:49.959213+0000 mgr.gibba043.dnkmem (mgr.34373) 984 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:51 gibba043 bash[24019]: cluster 2021-03-10T14:08:49.844109+0000 mgr.gibba043.dnkmem (mgr.34373) 983 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:51 gibba043 bash[24019]: cephadm 2021-03-10T14:08:49.959213+0000 mgr.gibba043.dnkmem (mgr.34373) 984 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:08:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:53 gibba003 bash[31385]: cluster 2021-03-10T14:08:51.845710+0000 mgr.gibba043.dnkmem (mgr.34373) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:53.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:53 gibba003 bash[32348]: cluster 2021-03-10T14:08:51.845710+0000 mgr.gibba043.dnkmem (mgr.34373) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:53 gibba043 bash[24019]: cluster 2021-03-10T14:08:51.845710+0000 mgr.gibba043.dnkmem (mgr.34373) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:55 gibba003 bash[31385]: cluster 2021-03-10T14:08:53.847306+0000 mgr.gibba043.dnkmem (mgr.34373) 986 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:55 gibba003 bash[32348]: cluster 2021-03-10T14:08:53.847306+0000 mgr.gibba043.dnkmem (mgr.34373) 986 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:55 gibba043 bash[24019]: cluster 2021-03-10T14:08:53.847306+0000 mgr.gibba043.dnkmem (mgr.34373) 986 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:56.752 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:08:56.983 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:08:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (17m) 3m ago 22m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:08:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:08:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:08:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:08:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:08:56.985 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:08:56.985 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:08:56.985 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:08:56.985 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (22m) 3m ago 22m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:08:56.986 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:08:56.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:08:56.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:08:56.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:08:56.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:08:56.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:08:56.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:08:56.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:08:56.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:08:56.987 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (22m) 2m ago 22m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:08:56.988 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:08:57.237 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:08:57.238 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:08:57.238 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:57.238 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:08:57.238 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:08:57.239 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:57.239 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:08:57.239 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:08:57.239 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:08:57.240 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:08:57.240 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:08:57.240 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:08:57.240 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:08:57.240 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:08:57.241 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:08:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:57 gibba003 bash[31385]: cluster 2021-03-10T14:08:55.848933+0000 mgr.gibba043.dnkmem (mgr.34373) 987 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:57 gibba003 bash[32348]: cluster 2021-03-10T14:08:55.848933+0000 mgr.gibba043.dnkmem (mgr.34373) 987 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:57 gibba043 bash[24019]: cluster 2021-03-10T14:08:55.848933+0000 mgr.gibba043.dnkmem (mgr.34373) 987 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:58.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:58 gibba003 bash[31385]: audit 2021-03-10T14:08:56.743662+0000 mgr.gibba043.dnkmem (mgr.34373) 988 : audit [DBG] from='client.54706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:58.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:58 gibba003 bash[31385]: audit 2021-03-10T14:08:56.971813+0000 mgr.gibba043.dnkmem (mgr.34373) 989 : audit [DBG] from='client.44727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:58 gibba003 bash[31385]: audit 2021-03-10T14:08:57.238811+0000 mon.a (mon.0) 584 : audit [DBG] from='client.? 172.21.2.103:0/3819659557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:58.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:58 gibba003 bash[32348]: audit 2021-03-10T14:08:56.743662+0000 mgr.gibba043.dnkmem (mgr.34373) 988 : audit [DBG] from='client.54706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:58.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:58 gibba003 bash[32348]: audit 2021-03-10T14:08:56.971813+0000 mgr.gibba043.dnkmem (mgr.34373) 989 : audit [DBG] from='client.44727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:58.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:58 gibba003 bash[32348]: audit 2021-03-10T14:08:57.238811+0000 mon.a (mon.0) 584 : audit [DBG] from='client.? 172.21.2.103:0/3819659557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:58 gibba043 bash[24019]: audit 2021-03-10T14:08:56.743662+0000 mgr.gibba043.dnkmem (mgr.34373) 988 : audit [DBG] from='client.54706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:58 gibba043 bash[24019]: audit 2021-03-10T14:08:56.971813+0000 mgr.gibba043.dnkmem (mgr.34373) 989 : audit [DBG] from='client.44727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:58 gibba043 bash[24019]: audit 2021-03-10T14:08:57.238811+0000 mon.a (mon.0) 584 : audit [DBG] from='client.? 172.21.2.103:0/3819659557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:08:59 gibba003 bash[31385]: cluster 2021-03-10T14:08:57.850278+0000 mgr.gibba043.dnkmem (mgr.34373) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:08:59 gibba003 bash[32348]: cluster 2021-03-10T14:08:57.850278+0000 mgr.gibba043.dnkmem (mgr.34373) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:08:59 gibba043 bash[24019]: cluster 2021-03-10T14:08:57.850278+0000 mgr.gibba043.dnkmem (mgr.34373) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:01 gibba003 bash[32348]: cluster 2021-03-10T14:08:59.851917+0000 mgr.gibba043.dnkmem (mgr.34373) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:01 gibba003 bash[31385]: cluster 2021-03-10T14:08:59.851917+0000 mgr.gibba043.dnkmem (mgr.34373) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:01 gibba043 bash[24019]: cluster 2021-03-10T14:08:59.851917+0000 mgr.gibba043.dnkmem (mgr.34373) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:03 gibba003 bash[31385]: cluster 2021-03-10T14:09:01.853395+0000 mgr.gibba043.dnkmem (mgr.34373) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:03 gibba003 bash[32348]: cluster 2021-03-10T14:09:01.853395+0000 mgr.gibba043.dnkmem (mgr.34373) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:03 gibba043 bash[24019]: cluster 2021-03-10T14:09:01.853395+0000 mgr.gibba043.dnkmem (mgr.34373) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:05 gibba043 bash[24019]: cluster 2021-03-10T14:09:03.854724+0000 mgr.gibba043.dnkmem (mgr.34373) 993 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:05 gibba003 bash[31385]: cluster 2021-03-10T14:09:03.854724+0000 mgr.gibba043.dnkmem (mgr.34373) 993 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:05 gibba003 bash[32348]: cluster 2021-03-10T14:09:03.854724+0000 mgr.gibba043.dnkmem (mgr.34373) 993 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:06 gibba003 bash[31385]: cephadm 2021-03-10T14:09:04.974998+0000 mgr.gibba043.dnkmem (mgr.34373) 994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:06.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:06 gibba003 bash[32348]: cephadm 2021-03-10T14:09:04.974998+0000 mgr.gibba043.dnkmem (mgr.34373) 994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:06 gibba043 bash[24019]: cephadm 2021-03-10T14:09:04.974998+0000 mgr.gibba043.dnkmem (mgr.34373) 994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:07 gibba003 bash[31385]: cluster 2021-03-10T14:09:05.856347+0000 mgr.gibba043.dnkmem (mgr.34373) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:07.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:07 gibba003 bash[32348]: cluster 2021-03-10T14:09:05.856347+0000 mgr.gibba043.dnkmem (mgr.34373) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:07 gibba043 bash[24019]: cluster 2021-03-10T14:09:05.856347+0000 mgr.gibba043.dnkmem (mgr.34373) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:09 gibba003 bash[31385]: cluster 2021-03-10T14:09:07.857839+0000 mgr.gibba043.dnkmem (mgr.34373) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:09 gibba003 bash[32348]: cluster 2021-03-10T14:09:07.857839+0000 mgr.gibba043.dnkmem (mgr.34373) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:09 gibba043 bash[24019]: cluster 2021-03-10T14:09:07.857839+0000 mgr.gibba043.dnkmem (mgr.34373) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:11.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:11 gibba003 bash[31385]: cluster 2021-03-10T14:09:09.859574+0000 mgr.gibba043.dnkmem (mgr.34373) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:11 gibba003 bash[32348]: cluster 2021-03-10T14:09:09.859574+0000 mgr.gibba043.dnkmem (mgr.34373) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:11 gibba043 bash[24019]: cluster 2021-03-10T14:09:09.859574+0000 mgr.gibba043.dnkmem (mgr.34373) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: cluster 2021-03-10T14:09:11.861044+0000 mgr.gibba043.dnkmem (mgr.34373) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.711495+0000 mon.c (mon.1) 311 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:09:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.712272+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.712791+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:09:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.712963+0000 mon.c (mon.1) 313 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.713663+0000 mon.c (mon.1) 314 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.714780+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.715959+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.716847+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.828938+0000 mon.c (mon.1) 315 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.830107+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.856187+0000 mon.c (mon.1) 316 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:13 gibba043 bash[24019]: audit 2021-03-10T14:09:12.857329+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: cluster 2021-03-10T14:09:11.861044+0000 mgr.gibba043.dnkmem (mgr.34373) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.711495+0000 mon.c (mon.1) 311 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:09:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.712272+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.712791+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:09:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.712963+0000 mon.c (mon.1) 313 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.713663+0000 mon.c (mon.1) 314 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.714780+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.715959+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.716847+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.828938+0000 mon.c (mon.1) 315 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.830107+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.856187+0000 mon.c (mon.1) 316 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[31385]: audit 2021-03-10T14:09:12.857329+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: cluster 2021-03-10T14:09:11.861044+0000 mgr.gibba043.dnkmem (mgr.34373) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.711495+0000 mon.c (mon.1) 311 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:09:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.712272+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.712791+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:09:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.712963+0000 mon.c (mon.1) 313 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.713663+0000 mon.c (mon.1) 314 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.714780+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.715959+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:09:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.716847+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.828938+0000 mon.c (mon.1) 315 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.830107+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.856187+0000 mon.c (mon.1) 316 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:13 gibba003 bash[32348]: audit 2021-03-10T14:09:12.857329+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:15 gibba043 bash[24019]: cluster 2021-03-10T14:09:13.862645+0000 mgr.gibba043.dnkmem (mgr.34373) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:15 gibba003 bash[31385]: cluster 2021-03-10T14:09:13.862645+0000 mgr.gibba043.dnkmem (mgr.34373) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:15 gibba003 bash[32348]: cluster 2021-03-10T14:09:13.862645+0000 mgr.gibba043.dnkmem (mgr.34373) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:17 gibba043 bash[24019]: cluster 2021-03-10T14:09:15.864293+0000 mgr.gibba043.dnkmem (mgr.34373) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:17 gibba003 bash[31385]: cluster 2021-03-10T14:09:15.864293+0000 mgr.gibba043.dnkmem (mgr.34373) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:17.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:17 gibba003 bash[32348]: cluster 2021-03-10T14:09:15.864293+0000 mgr.gibba043.dnkmem (mgr.34373) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:19 gibba043 bash[24019]: cluster 2021-03-10T14:09:17.865605+0000 mgr.gibba043.dnkmem (mgr.34373) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:19 gibba003 bash[31385]: cluster 2021-03-10T14:09:17.865605+0000 mgr.gibba043.dnkmem (mgr.34373) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:19 gibba003 bash[32348]: cluster 2021-03-10T14:09:17.865605+0000 mgr.gibba043.dnkmem (mgr.34373) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:21 gibba043 bash[24019]: cluster 2021-03-10T14:09:19.867226+0000 mgr.gibba043.dnkmem (mgr.34373) 1002 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:21 gibba043 bash[24019]: cephadm 2021-03-10T14:09:19.987592+0000 mgr.gibba043.dnkmem (mgr.34373) 1003 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:21 gibba003 bash[31385]: cluster 2021-03-10T14:09:19.867226+0000 mgr.gibba043.dnkmem (mgr.34373) 1002 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:21 gibba003 bash[31385]: cephadm 2021-03-10T14:09:19.987592+0000 mgr.gibba043.dnkmem (mgr.34373) 1003 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:21 gibba003 bash[32348]: cluster 2021-03-10T14:09:19.867226+0000 mgr.gibba043.dnkmem (mgr.34373) 1002 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:21 gibba003 bash[32348]: cephadm 2021-03-10T14:09:19.987592+0000 mgr.gibba043.dnkmem (mgr.34373) 1003 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:23 gibba043 bash[24019]: cluster 2021-03-10T14:09:21.868859+0000 mgr.gibba043.dnkmem (mgr.34373) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:23 gibba003 bash[31385]: cluster 2021-03-10T14:09:21.868859+0000 mgr.gibba043.dnkmem (mgr.34373) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:23 gibba003 bash[32348]: cluster 2021-03-10T14:09:21.868859+0000 mgr.gibba043.dnkmem (mgr.34373) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:25 gibba043 bash[24019]: cluster 2021-03-10T14:09:23.870379+0000 mgr.gibba043.dnkmem (mgr.34373) 1005 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:25 gibba003 bash[31385]: cluster 2021-03-10T14:09:23.870379+0000 mgr.gibba043.dnkmem (mgr.34373) 1005 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:25 gibba003 bash[32348]: cluster 2021-03-10T14:09:23.870379+0000 mgr.gibba043.dnkmem (mgr.34373) 1005 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.482 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:09:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:27 gibba043 bash[24019]: cluster 2021-03-10T14:09:25.871913+0000 mgr.gibba043.dnkmem (mgr.34373) 1006 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:27 gibba003 bash[31385]: cluster 2021-03-10T14:09:25.871913+0000 mgr.gibba043.dnkmem (mgr.34373) 1006 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:27 gibba003 bash[32348]: cluster 2021-03-10T14:09:25.871913+0000 mgr.gibba043.dnkmem (mgr.34373) 1006 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.707 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:09:27.707 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (17m) 3m ago 23m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:09:27.707 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:09:27.707 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:09:27.707 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:09:27.708 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:09:27.708 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:09:27.708 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:09:27.708 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:09:27.709 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:09:27.709 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (23m) 2m ago 23m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:09:27.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:09:27.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (15m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:09:27.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:09:27.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:09:27.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:09:27.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:09:27.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:09:27.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:09:27.710 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (22m) 2m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:09:27.711 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:09:27.953 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:09:27.953 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:09:27.954 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:27.954 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:09:27.954 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:09:27.954 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:27.955 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:09:27.955 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:09:27.955 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:09:27.955 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:09:27.955 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:09:27.955 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:09:27.956 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:09:27.956 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:09:27.956 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:09:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:28 gibba043 bash[24019]: audit 2021-03-10T14:09:27.954660+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.2.103:0/3983066090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:28 gibba003 bash[32348]: audit 2021-03-10T14:09:27.954660+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.2.103:0/3983066090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:28 gibba003 bash[31385]: audit 2021-03-10T14:09:27.954660+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.2.103:0/3983066090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:29 gibba003 bash[31385]: audit 2021-03-10T14:09:27.473023+0000 mgr.gibba043.dnkmem (mgr.34373) 1007 : audit [DBG] from='client.44739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:29 gibba003 bash[31385]: audit 2021-03-10T14:09:27.696686+0000 mgr.gibba043.dnkmem (mgr.34373) 1008 : audit [DBG] from='client.44745 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:29 gibba003 bash[31385]: cluster 2021-03-10T14:09:27.873378+0000 mgr.gibba043.dnkmem (mgr.34373) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:29 gibba003 bash[32348]: audit 2021-03-10T14:09:27.473023+0000 mgr.gibba043.dnkmem (mgr.34373) 1007 : audit [DBG] from='client.44739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:29 gibba003 bash[32348]: audit 2021-03-10T14:09:27.696686+0000 mgr.gibba043.dnkmem (mgr.34373) 1008 : audit [DBG] from='client.44745 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:29 gibba003 bash[32348]: cluster 2021-03-10T14:09:27.873378+0000 mgr.gibba043.dnkmem (mgr.34373) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:29 gibba043 bash[24019]: audit 2021-03-10T14:09:27.473023+0000 mgr.gibba043.dnkmem (mgr.34373) 1007 : audit [DBG] from='client.44739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:29 gibba043 bash[24019]: audit 2021-03-10T14:09:27.696686+0000 mgr.gibba043.dnkmem (mgr.34373) 1008 : audit [DBG] from='client.44745 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:29 gibba043 bash[24019]: cluster 2021-03-10T14:09:27.873378+0000 mgr.gibba043.dnkmem (mgr.34373) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:31 gibba003 bash[31385]: cluster 2021-03-10T14:09:29.874853+0000 mgr.gibba043.dnkmem (mgr.34373) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:31 gibba003 bash[32348]: cluster 2021-03-10T14:09:29.874853+0000 mgr.gibba043.dnkmem (mgr.34373) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:31 gibba043 bash[24019]: cluster 2021-03-10T14:09:29.874853+0000 mgr.gibba043.dnkmem (mgr.34373) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:33 gibba003 bash[31385]: cluster 2021-03-10T14:09:31.876543+0000 mgr.gibba043.dnkmem (mgr.34373) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:33 gibba003 bash[32348]: cluster 2021-03-10T14:09:31.876543+0000 mgr.gibba043.dnkmem (mgr.34373) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:33 gibba043 bash[24019]: cluster 2021-03-10T14:09:31.876543+0000 mgr.gibba043.dnkmem (mgr.34373) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: cluster 2021-03-10T14:09:33.878143+0000 mgr.gibba043.dnkmem (mgr.34373) 1012 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.221598+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:09:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.225207+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.227069+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.228539+0000 mon.c (mon.1) 320 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.230104+0000 mon.c (mon.1) 321 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.233995+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:35 gibba043 bash[24019]: audit 2021-03-10T14:09:35.235520+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: cluster 2021-03-10T14:09:33.878143+0000 mgr.gibba043.dnkmem (mgr.34373) 1012 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.221598+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:09:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.225207+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.227069+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.228539+0000 mon.c (mon.1) 320 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.230104+0000 mon.c (mon.1) 321 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.233995+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[31385]: audit 2021-03-10T14:09:35.235520+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: cluster 2021-03-10T14:09:33.878143+0000 mgr.gibba043.dnkmem (mgr.34373) 1012 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.221598+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:09:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.225207+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.227069+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.228539+0000 mon.c (mon.1) 320 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.230104+0000 mon.c (mon.1) 321 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.233995+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:35.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:35 gibba003 bash[32348]: audit 2021-03-10T14:09:35.235520+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.001520+0000 mgr.gibba043.dnkmem (mgr.34373) 1013 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:09:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.002835+0000 mgr.gibba043.dnkmem (mgr.34373) 1014 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:09:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.224001+0000 mgr.gibba043.dnkmem (mgr.34373) 1015 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.226026+0000 mgr.gibba043.dnkmem (mgr.34373) 1016 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.227544+0000 mgr.gibba043.dnkmem (mgr.34373) 1017 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.227598+0000 mgr.gibba043.dnkmem (mgr.34373) 1018 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.229061+0000 mgr.gibba043.dnkmem (mgr.34373) 1019 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.229098+0000 mgr.gibba043.dnkmem (mgr.34373) 1020 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.230656+0000 mgr.gibba043.dnkmem (mgr.34373) 1021 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.232842+0000 mgr.gibba043.dnkmem (mgr.34373) 1022 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.232880+0000 mgr.gibba043.dnkmem (mgr.34373) 1023 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.234341+0000 mgr.gibba043.dnkmem (mgr.34373) 1024 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.234674+0000 mgr.gibba043.dnkmem (mgr.34373) 1025 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.236319+0000 mgr.gibba043.dnkmem (mgr.34373) 1026 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.236360+0000 mgr.gibba043.dnkmem (mgr.34373) 1027 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[31385]: cephadm 2021-03-10T14:09:35.236478+0000 mgr.gibba043.dnkmem (mgr.34373) 1028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.001520+0000 mgr.gibba043.dnkmem (mgr.34373) 1013 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:09:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.002835+0000 mgr.gibba043.dnkmem (mgr.34373) 1014 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:09:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.224001+0000 mgr.gibba043.dnkmem (mgr.34373) 1015 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.226026+0000 mgr.gibba043.dnkmem (mgr.34373) 1016 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.227544+0000 mgr.gibba043.dnkmem (mgr.34373) 1017 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.227598+0000 mgr.gibba043.dnkmem (mgr.34373) 1018 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.229061+0000 mgr.gibba043.dnkmem (mgr.34373) 1019 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.229098+0000 mgr.gibba043.dnkmem (mgr.34373) 1020 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.230656+0000 mgr.gibba043.dnkmem (mgr.34373) 1021 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.232842+0000 mgr.gibba043.dnkmem (mgr.34373) 1022 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.232880+0000 mgr.gibba043.dnkmem (mgr.34373) 1023 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.234341+0000 mgr.gibba043.dnkmem (mgr.34373) 1024 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.234674+0000 mgr.gibba043.dnkmem (mgr.34373) 1025 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.236319+0000 mgr.gibba043.dnkmem (mgr.34373) 1026 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.236360+0000 mgr.gibba043.dnkmem (mgr.34373) 1027 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:36 gibba003 bash[32348]: cephadm 2021-03-10T14:09:35.236478+0000 mgr.gibba043.dnkmem (mgr.34373) 1028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.001520+0000 mgr.gibba043.dnkmem (mgr.34373) 1013 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:09:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.002835+0000 mgr.gibba043.dnkmem (mgr.34373) 1014 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:09:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.224001+0000 mgr.gibba043.dnkmem (mgr.34373) 1015 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.226026+0000 mgr.gibba043.dnkmem (mgr.34373) 1016 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.227544+0000 mgr.gibba043.dnkmem (mgr.34373) 1017 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.227598+0000 mgr.gibba043.dnkmem (mgr.34373) 1018 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.229061+0000 mgr.gibba043.dnkmem (mgr.34373) 1019 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.229098+0000 mgr.gibba043.dnkmem (mgr.34373) 1020 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.230656+0000 mgr.gibba043.dnkmem (mgr.34373) 1021 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.232842+0000 mgr.gibba043.dnkmem (mgr.34373) 1022 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.232880+0000 mgr.gibba043.dnkmem (mgr.34373) 1023 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.234341+0000 mgr.gibba043.dnkmem (mgr.34373) 1024 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.234674+0000 mgr.gibba043.dnkmem (mgr.34373) 1025 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.236319+0000 mgr.gibba043.dnkmem (mgr.34373) 1026 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.236360+0000 mgr.gibba043.dnkmem (mgr.34373) 1027 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:36 gibba043 bash[24019]: cephadm 2021-03-10T14:09:35.236478+0000 mgr.gibba043.dnkmem (mgr.34373) 1028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:37 gibba003 bash[31385]: cluster 2021-03-10T14:09:35.879709+0000 mgr.gibba043.dnkmem (mgr.34373) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:37 gibba003 bash[32348]: cluster 2021-03-10T14:09:35.879709+0000 mgr.gibba043.dnkmem (mgr.34373) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:37 gibba043 bash[24019]: cluster 2021-03-10T14:09:35.879709+0000 mgr.gibba043.dnkmem (mgr.34373) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:39 gibba003 bash[31385]: cluster 2021-03-10T14:09:37.881088+0000 mgr.gibba043.dnkmem (mgr.34373) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:39 gibba003 bash[32348]: cluster 2021-03-10T14:09:37.881088+0000 mgr.gibba043.dnkmem (mgr.34373) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:39 gibba043 bash[24019]: cluster 2021-03-10T14:09:37.881088+0000 mgr.gibba043.dnkmem (mgr.34373) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:41.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:41 gibba003 bash[31385]: cluster 2021-03-10T14:09:39.882652+0000 mgr.gibba043.dnkmem (mgr.34373) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:41 gibba003 bash[32348]: cluster 2021-03-10T14:09:39.882652+0000 mgr.gibba043.dnkmem (mgr.34373) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:41 gibba043 bash[24019]: cluster 2021-03-10T14:09:39.882652+0000 mgr.gibba043.dnkmem (mgr.34373) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:43 gibba003 bash[31385]: cluster 2021-03-10T14:09:41.884372+0000 mgr.gibba043.dnkmem (mgr.34373) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:43 gibba003 bash[32348]: cluster 2021-03-10T14:09:41.884372+0000 mgr.gibba043.dnkmem (mgr.34373) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:43.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:43 gibba043 bash[24019]: cluster 2021-03-10T14:09:41.884372+0000 mgr.gibba043.dnkmem (mgr.34373) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:45 gibba003 bash[31385]: cluster 2021-03-10T14:09:43.886000+0000 mgr.gibba043.dnkmem (mgr.34373) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:45 gibba003 bash[32348]: cluster 2021-03-10T14:09:43.886000+0000 mgr.gibba043.dnkmem (mgr.34373) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:45 gibba043 bash[24019]: cluster 2021-03-10T14:09:43.886000+0000 mgr.gibba043.dnkmem (mgr.34373) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:47 gibba003 bash[31385]: cluster 2021-03-10T14:09:45.887657+0000 mgr.gibba043.dnkmem (mgr.34373) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:47 gibba003 bash[32348]: cluster 2021-03-10T14:09:45.887657+0000 mgr.gibba043.dnkmem (mgr.34373) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:47 gibba043 bash[24019]: cluster 2021-03-10T14:09:45.887657+0000 mgr.gibba043.dnkmem (mgr.34373) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:49 gibba003 bash[31385]: cluster 2021-03-10T14:09:47.888921+0000 mgr.gibba043.dnkmem (mgr.34373) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:49 gibba003 bash[32348]: cluster 2021-03-10T14:09:47.888921+0000 mgr.gibba043.dnkmem (mgr.34373) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:49 gibba043 bash[24019]: cluster 2021-03-10T14:09:47.888921+0000 mgr.gibba043.dnkmem (mgr.34373) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:51 gibba003 bash[31385]: cluster 2021-03-10T14:09:49.890448+0000 mgr.gibba043.dnkmem (mgr.34373) 1036 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:51 gibba003 bash[31385]: cephadm 2021-03-10T14:09:50.252497+0000 mgr.gibba043.dnkmem (mgr.34373) 1037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:51.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:51 gibba003 bash[32348]: cluster 2021-03-10T14:09:49.890448+0000 mgr.gibba043.dnkmem (mgr.34373) 1036 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:51 gibba003 bash[32348]: cephadm 2021-03-10T14:09:50.252497+0000 mgr.gibba043.dnkmem (mgr.34373) 1037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:51 gibba043 bash[24019]: cluster 2021-03-10T14:09:49.890448+0000 mgr.gibba043.dnkmem (mgr.34373) 1036 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:51 gibba043 bash[24019]: cephadm 2021-03-10T14:09:50.252497+0000 mgr.gibba043.dnkmem (mgr.34373) 1037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:09:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:53 gibba003 bash[31385]: cluster 2021-03-10T14:09:51.892226+0000 mgr.gibba043.dnkmem (mgr.34373) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:53 gibba003 bash[32348]: cluster 2021-03-10T14:09:51.892226+0000 mgr.gibba043.dnkmem (mgr.34373) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:53 gibba043 bash[24019]: cluster 2021-03-10T14:09:51.892226+0000 mgr.gibba043.dnkmem (mgr.34373) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:55 gibba003 bash[31385]: cluster 2021-03-10T14:09:53.893604+0000 mgr.gibba043.dnkmem (mgr.34373) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:55 gibba003 bash[32348]: cluster 2021-03-10T14:09:53.893604+0000 mgr.gibba043.dnkmem (mgr.34373) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:55 gibba043 bash[24019]: cluster 2021-03-10T14:09:53.893604+0000 mgr.gibba043.dnkmem (mgr.34373) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:57 gibba003 bash[31385]: cluster 2021-03-10T14:09:55.895406+0000 mgr.gibba043.dnkmem (mgr.34373) 1040 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:57 gibba003 bash[32348]: cluster 2021-03-10T14:09:55.895406+0000 mgr.gibba043.dnkmem (mgr.34373) 1040 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:57 gibba043 bash[24019]: cluster 2021-03-10T14:09:55.895406+0000 mgr.gibba043.dnkmem (mgr.34373) 1040 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:58.194 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:09:58.423 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:09:58.423 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (18m) 4m ago 23m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:09:58.423 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:09:58.424 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:09:58.424 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:09:58.424 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:09:58.424 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:09:58.425 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:09:58.425 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:09:58.425 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (23m) 4m ago 23m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:09:58.425 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:09:58.426 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:09:58.426 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:09:58.426 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:09:58.426 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:09:58.427 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:09:58.427 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:09:58.427 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:09:58.427 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:09:58.428 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (23m) 3m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:09:58.428 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:09:58.669 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:09:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:09:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:09:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:09:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:09:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:09:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:09:58.671 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:09:58.671 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:09:58.671 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:09:58.671 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:09:58.671 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:09:58.672 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:09:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:59 gibba003 bash[31385]: cluster 2021-03-10T14:09:57.896936+0000 mgr.gibba043.dnkmem (mgr.34373) 1041 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:59 gibba003 bash[31385]: audit 2021-03-10T14:09:58.186150+0000 mgr.gibba043.dnkmem (mgr.34373) 1042 : audit [DBG] from='client.44757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:09:59 gibba003 bash[31385]: audit 2021-03-10T14:09:58.669971+0000 mon.c (mon.1) 324 : audit [DBG] from='client.? 172.21.2.103:0/772249583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:59 gibba003 bash[32348]: cluster 2021-03-10T14:09:57.896936+0000 mgr.gibba043.dnkmem (mgr.34373) 1041 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:59 gibba003 bash[32348]: audit 2021-03-10T14:09:58.186150+0000 mgr.gibba043.dnkmem (mgr.34373) 1042 : audit [DBG] from='client.44757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:09:59 gibba003 bash[32348]: audit 2021-03-10T14:09:58.669971+0000 mon.c (mon.1) 324 : audit [DBG] from='client.? 172.21.2.103:0/772249583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:59 gibba043 bash[24019]: cluster 2021-03-10T14:09:57.896936+0000 mgr.gibba043.dnkmem (mgr.34373) 1041 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:59 gibba043 bash[24019]: audit 2021-03-10T14:09:58.186150+0000 mgr.gibba043.dnkmem (mgr.34373) 1042 : audit [DBG] from='client.44757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:09:59 gibba043 bash[24019]: audit 2021-03-10T14:09:58.669971+0000 mon.c (mon.1) 324 : audit [DBG] from='client.? 172.21.2.103:0/772249583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:00 gibba003 bash[31385]: debug 2021-03-10T14:09:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:00 gibba003 bash[31385]: audit 2021-03-10T14:09:58.411255+0000 mgr.gibba043.dnkmem (mgr.34373) 1043 : audit [DBG] from='client.44763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:00 gibba003 bash[31385]: cluster 2021-03-10T14:10:00.000411+0000 mon.a (mon.0) 592 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:00 gibba003 bash[32348]: audit 2021-03-10T14:09:58.411255+0000 mgr.gibba043.dnkmem (mgr.34373) 1043 : audit [DBG] from='client.44763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:00.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:00 gibba003 bash[32348]: cluster 2021-03-10T14:10:00.000411+0000 mon.a (mon.0) 592 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:00 gibba043 bash[24019]: audit 2021-03-10T14:09:58.411255+0000 mgr.gibba043.dnkmem (mgr.34373) 1043 : audit [DBG] from='client.44763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:00 gibba043 bash[24019]: cluster 2021-03-10T14:10:00.000411+0000 mon.a (mon.0) 592 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:01.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:01 gibba003 bash[31385]: cluster 2021-03-10T14:09:59.898502+0000 mgr.gibba043.dnkmem (mgr.34373) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:01 gibba003 bash[32348]: cluster 2021-03-10T14:09:59.898502+0000 mgr.gibba043.dnkmem (mgr.34373) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:01 gibba043 bash[24019]: cluster 2021-03-10T14:09:59.898502+0000 mgr.gibba043.dnkmem (mgr.34373) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:03 gibba003 bash[31385]: cluster 2021-03-10T14:10:01.900207+0000 mgr.gibba043.dnkmem (mgr.34373) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:03 gibba003 bash[32348]: cluster 2021-03-10T14:10:01.900207+0000 mgr.gibba043.dnkmem (mgr.34373) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:03 gibba043 bash[24019]: cluster 2021-03-10T14:10:01.900207+0000 mgr.gibba043.dnkmem (mgr.34373) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:05 gibba003 bash[31385]: cluster 2021-03-10T14:10:03.901876+0000 mgr.gibba043.dnkmem (mgr.34373) 1046 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:05 gibba003 bash[32348]: cluster 2021-03-10T14:10:03.901876+0000 mgr.gibba043.dnkmem (mgr.34373) 1046 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:05.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:05 gibba043 bash[24019]: cluster 2021-03-10T14:10:03.901876+0000 mgr.gibba043.dnkmem (mgr.34373) 1046 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:06 gibba003 bash[31385]: cephadm 2021-03-10T14:10:05.264445+0000 mgr.gibba043.dnkmem (mgr.34373) 1047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:06.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:06 gibba003 bash[32348]: cephadm 2021-03-10T14:10:05.264445+0000 mgr.gibba043.dnkmem (mgr.34373) 1047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:06 gibba043 bash[24019]: cephadm 2021-03-10T14:10:05.264445+0000 mgr.gibba043.dnkmem (mgr.34373) 1047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:07 gibba003 bash[31385]: cluster 2021-03-10T14:10:05.903528+0000 mgr.gibba043.dnkmem (mgr.34373) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:07.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:07 gibba003 bash[32348]: cluster 2021-03-10T14:10:05.903528+0000 mgr.gibba043.dnkmem (mgr.34373) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:07 gibba043 bash[24019]: cluster 2021-03-10T14:10:05.903528+0000 mgr.gibba043.dnkmem (mgr.34373) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:09 gibba003 bash[31385]: cluster 2021-03-10T14:10:07.904925+0000 mgr.gibba043.dnkmem (mgr.34373) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:09 gibba003 bash[32348]: cluster 2021-03-10T14:10:07.904925+0000 mgr.gibba043.dnkmem (mgr.34373) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:09 gibba043 bash[24019]: cluster 2021-03-10T14:10:07.904925+0000 mgr.gibba043.dnkmem (mgr.34373) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:11 gibba003 bash[31385]: cluster 2021-03-10T14:10:09.906474+0000 mgr.gibba043.dnkmem (mgr.34373) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:11 gibba003 bash[32348]: cluster 2021-03-10T14:10:09.906474+0000 mgr.gibba043.dnkmem (mgr.34373) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:11 gibba043 bash[24019]: cluster 2021-03-10T14:10:09.906474+0000 mgr.gibba043.dnkmem (mgr.34373) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: cluster 2021-03-10T14:10:11.908098+0000 mgr.gibba043.dnkmem (mgr.34373) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.722717+0000 mon.c (mon.1) 325 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.723483+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.724072+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.724162+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.724824+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:10:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.726024+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.727152+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.728055+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:10:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.835951+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.837072+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.864775+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[31385]: audit 2021-03-10T14:10:12.865913+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: cluster 2021-03-10T14:10:11.908098+0000 mgr.gibba043.dnkmem (mgr.34373) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.722717+0000 mon.c (mon.1) 325 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.723483+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.724072+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.724162+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.724824+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:10:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.726024+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.727152+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.728055+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:10:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.835951+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.837072+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.864775+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:13 gibba003 bash[32348]: audit 2021-03-10T14:10:12.865913+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: cluster 2021-03-10T14:10:11.908098+0000 mgr.gibba043.dnkmem (mgr.34373) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.722717+0000 mon.c (mon.1) 325 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.723483+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.724072+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.724162+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.724824+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:10:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.726024+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.727152+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.728055+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:10:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.835951+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.837072+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.864775+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:13 gibba043 bash[24019]: audit 2021-03-10T14:10:12.865913+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:15 gibba043 bash[24019]: cluster 2021-03-10T14:10:13.909595+0000 mgr.gibba043.dnkmem (mgr.34373) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:15 gibba003 bash[31385]: cluster 2021-03-10T14:10:13.909595+0000 mgr.gibba043.dnkmem (mgr.34373) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:15 gibba003 bash[32348]: cluster 2021-03-10T14:10:13.909595+0000 mgr.gibba043.dnkmem (mgr.34373) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:17 gibba043 bash[24019]: cluster 2021-03-10T14:10:15.911322+0000 mgr.gibba043.dnkmem (mgr.34373) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:17 gibba003 bash[31385]: cluster 2021-03-10T14:10:15.911322+0000 mgr.gibba043.dnkmem (mgr.34373) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:17 gibba003 bash[32348]: cluster 2021-03-10T14:10:15.911322+0000 mgr.gibba043.dnkmem (mgr.34373) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:19 gibba043 bash[24019]: cluster 2021-03-10T14:10:17.913177+0000 mgr.gibba043.dnkmem (mgr.34373) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:19 gibba003 bash[31385]: cluster 2021-03-10T14:10:17.913177+0000 mgr.gibba043.dnkmem (mgr.34373) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:19 gibba003 bash[32348]: cluster 2021-03-10T14:10:17.913177+0000 mgr.gibba043.dnkmem (mgr.34373) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:21 gibba043 bash[24019]: cluster 2021-03-10T14:10:19.914915+0000 mgr.gibba043.dnkmem (mgr.34373) 1055 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:21 gibba043 bash[24019]: cephadm 2021-03-10T14:10:20.265675+0000 mgr.gibba043.dnkmem (mgr.34373) 1056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:21 gibba003 bash[31385]: cluster 2021-03-10T14:10:19.914915+0000 mgr.gibba043.dnkmem (mgr.34373) 1055 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:21 gibba003 bash[31385]: cephadm 2021-03-10T14:10:20.265675+0000 mgr.gibba043.dnkmem (mgr.34373) 1056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:21 gibba003 bash[32348]: cluster 2021-03-10T14:10:19.914915+0000 mgr.gibba043.dnkmem (mgr.34373) 1055 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:21 gibba003 bash[32348]: cephadm 2021-03-10T14:10:20.265675+0000 mgr.gibba043.dnkmem (mgr.34373) 1056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:23.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:23 gibba043 bash[24019]: cluster 2021-03-10T14:10:21.916789+0000 mgr.gibba043.dnkmem (mgr.34373) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:23 gibba003 bash[31385]: cluster 2021-03-10T14:10:21.916789+0000 mgr.gibba043.dnkmem (mgr.34373) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:23 gibba003 bash[32348]: cluster 2021-03-10T14:10:21.916789+0000 mgr.gibba043.dnkmem (mgr.34373) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:25 gibba043 bash[24019]: cluster 2021-03-10T14:10:23.918464+0000 mgr.gibba043.dnkmem (mgr.34373) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:25 gibba003 bash[31385]: cluster 2021-03-10T14:10:23.918464+0000 mgr.gibba043.dnkmem (mgr.34373) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:25 gibba003 bash[32348]: cluster 2021-03-10T14:10:23.918464+0000 mgr.gibba043.dnkmem (mgr.34373) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:27 gibba043 bash[24019]: cluster 2021-03-10T14:10:25.920005+0000 mgr.gibba043.dnkmem (mgr.34373) 1059 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:27 gibba003 bash[31385]: cluster 2021-03-10T14:10:25.920005+0000 mgr.gibba043.dnkmem (mgr.34373) 1059 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:27 gibba003 bash[32348]: cluster 2021-03-10T14:10:25.920005+0000 mgr.gibba043.dnkmem (mgr.34373) 1059 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:28.909 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:10:29.136 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:10:29.137 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (18m) 4m ago 24m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:10:29.137 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:10:29.137 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:10:29.137 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:10:29.138 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:10:29.138 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:10:29.138 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:10:29.138 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:10:29.138 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:10:29.139 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (24m) 3m ago 24m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:10:29.139 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:10:29.139 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (16m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:10:29.139 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:10:29.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:10:29.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:10:29.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:10:29.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:10:29.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:10:29.141 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (23m) 3m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:10:29.141 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:10:29.385 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:10:29.385 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:10:29.385 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:29.386 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:10:29.386 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:10:29.386 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:29.386 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:10:29.387 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:10:29.387 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:10:29.387 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:10:29.387 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:10:29.387 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:10:29.388 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:10:29.388 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:10:29.388 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:10:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:29 gibba043 bash[24019]: cluster 2021-03-10T14:10:27.921274+0000 mgr.gibba043.dnkmem (mgr.34373) 1060 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:29 gibba003 bash[31385]: cluster 2021-03-10T14:10:27.921274+0000 mgr.gibba043.dnkmem (mgr.34373) 1060 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:29 gibba003 bash[32348]: cluster 2021-03-10T14:10:27.921274+0000 mgr.gibba043.dnkmem (mgr.34373) 1060 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:30 gibba043 bash[24019]: audit 2021-03-10T14:10:28.900701+0000 mgr.gibba043.dnkmem (mgr.34373) 1061 : audit [DBG] from='client.44775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:30 gibba043 bash[24019]: audit 2021-03-10T14:10:29.125072+0000 mgr.gibba043.dnkmem (mgr.34373) 1062 : audit [DBG] from='client.44781 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:30 gibba043 bash[24019]: audit 2021-03-10T14:10:29.386222+0000 mon.c (mon.1) 331 : audit [DBG] from='client.? 172.21.2.103:0/271130195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:30.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:30 gibba003 bash[31385]: audit 2021-03-10T14:10:28.900701+0000 mgr.gibba043.dnkmem (mgr.34373) 1061 : audit [DBG] from='client.44775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:30.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:30 gibba003 bash[31385]: audit 2021-03-10T14:10:29.125072+0000 mgr.gibba043.dnkmem (mgr.34373) 1062 : audit [DBG] from='client.44781 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:30.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:30 gibba003 bash[31385]: audit 2021-03-10T14:10:29.386222+0000 mon.c (mon.1) 331 : audit [DBG] from='client.? 172.21.2.103:0/271130195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:30.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:30 gibba003 bash[32348]: audit 2021-03-10T14:10:28.900701+0000 mgr.gibba043.dnkmem (mgr.34373) 1061 : audit [DBG] from='client.44775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:30.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:30 gibba003 bash[32348]: audit 2021-03-10T14:10:29.125072+0000 mgr.gibba043.dnkmem (mgr.34373) 1062 : audit [DBG] from='client.44781 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:30.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:30 gibba003 bash[32348]: audit 2021-03-10T14:10:29.386222+0000 mon.c (mon.1) 331 : audit [DBG] from='client.? 172.21.2.103:0/271130195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:31 gibba003 bash[31385]: cluster 2021-03-10T14:10:29.922637+0000 mgr.gibba043.dnkmem (mgr.34373) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:31 gibba003 bash[32348]: cluster 2021-03-10T14:10:29.922637+0000 mgr.gibba043.dnkmem (mgr.34373) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:31 gibba043 bash[24019]: cluster 2021-03-10T14:10:29.922637+0000 mgr.gibba043.dnkmem (mgr.34373) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:33 gibba003 bash[31385]: cluster 2021-03-10T14:10:31.924072+0000 mgr.gibba043.dnkmem (mgr.34373) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:33 gibba003 bash[32348]: cluster 2021-03-10T14:10:31.924072+0000 mgr.gibba043.dnkmem (mgr.34373) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:33 gibba043 bash[24019]: cluster 2021-03-10T14:10:31.924072+0000 mgr.gibba043.dnkmem (mgr.34373) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:35 gibba003 bash[31385]: cluster 2021-03-10T14:10:33.925699+0000 mgr.gibba043.dnkmem (mgr.34373) 1065 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:35.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:35 gibba003 bash[32348]: cluster 2021-03-10T14:10:33.925699+0000 mgr.gibba043.dnkmem (mgr.34373) 1065 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:35 gibba043 bash[24019]: cluster 2021-03-10T14:10:33.925699+0000 mgr.gibba043.dnkmem (mgr.34373) 1065 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.281166+0000 mgr.gibba043.dnkmem (mgr.34373) 1066 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:10:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.282660+0000 mgr.gibba043.dnkmem (mgr.34373) 1067 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:10:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.501587+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:10:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.505337+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.506684+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.507978+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.509250+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.512408+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[31385]: audit 2021-03-10T14:10:35.514292+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.281166+0000 mgr.gibba043.dnkmem (mgr.34373) 1066 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:10:36.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.282660+0000 mgr.gibba043.dnkmem (mgr.34373) 1067 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:10:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.501587+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:10:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.505337+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.506684+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.507978+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.509250+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.512408+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:36 gibba003 bash[32348]: audit 2021-03-10T14:10:35.514292+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.281166+0000 mgr.gibba043.dnkmem (mgr.34373) 1066 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:10:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.282660+0000 mgr.gibba043.dnkmem (mgr.34373) 1067 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:10:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.501587+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:10:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.505337+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.506684+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.507978+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.509250+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.512408+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:36 gibba043 bash[24019]: audit 2021-03-10T14:10:35.514292+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.503763+0000 mgr.gibba043.dnkmem (mgr.34373) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.505491+0000 mgr.gibba043.dnkmem (mgr.34373) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.506722+0000 mgr.gibba043.dnkmem (mgr.34373) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.506799+0000 mgr.gibba043.dnkmem (mgr.34373) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.508107+0000 mgr.gibba043.dnkmem (mgr.34373) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.508167+0000 mgr.gibba043.dnkmem (mgr.34373) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.509352+0000 mgr.gibba043.dnkmem (mgr.34373) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.511070+0000 mgr.gibba043.dnkmem (mgr.34373) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.511154+0000 mgr.gibba043.dnkmem (mgr.34373) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.512829+0000 mgr.gibba043.dnkmem (mgr.34373) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.513195+0000 mgr.gibba043.dnkmem (mgr.34373) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.514470+0000 mgr.gibba043.dnkmem (mgr.34373) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.514544+0000 mgr.gibba043.dnkmem (mgr.34373) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cephadm 2021-03-10T14:10:35.514704+0000 mgr.gibba043.dnkmem (mgr.34373) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[31385]: cluster 2021-03-10T14:10:35.927445+0000 mgr.gibba043.dnkmem (mgr.34373) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.503763+0000 mgr.gibba043.dnkmem (mgr.34373) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.505491+0000 mgr.gibba043.dnkmem (mgr.34373) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.506722+0000 mgr.gibba043.dnkmem (mgr.34373) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.506799+0000 mgr.gibba043.dnkmem (mgr.34373) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.508107+0000 mgr.gibba043.dnkmem (mgr.34373) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.508167+0000 mgr.gibba043.dnkmem (mgr.34373) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.509352+0000 mgr.gibba043.dnkmem (mgr.34373) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.511070+0000 mgr.gibba043.dnkmem (mgr.34373) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.511154+0000 mgr.gibba043.dnkmem (mgr.34373) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.512829+0000 mgr.gibba043.dnkmem (mgr.34373) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.513195+0000 mgr.gibba043.dnkmem (mgr.34373) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.514470+0000 mgr.gibba043.dnkmem (mgr.34373) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.514544+0000 mgr.gibba043.dnkmem (mgr.34373) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:37.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cephadm 2021-03-10T14:10:35.514704+0000 mgr.gibba043.dnkmem (mgr.34373) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:37.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:37 gibba003 bash[32348]: cluster 2021-03-10T14:10:35.927445+0000 mgr.gibba043.dnkmem (mgr.34373) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.503763+0000 mgr.gibba043.dnkmem (mgr.34373) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.505491+0000 mgr.gibba043.dnkmem (mgr.34373) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.506722+0000 mgr.gibba043.dnkmem (mgr.34373) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.506799+0000 mgr.gibba043.dnkmem (mgr.34373) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.508107+0000 mgr.gibba043.dnkmem (mgr.34373) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.508167+0000 mgr.gibba043.dnkmem (mgr.34373) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.509352+0000 mgr.gibba043.dnkmem (mgr.34373) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.511070+0000 mgr.gibba043.dnkmem (mgr.34373) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.511154+0000 mgr.gibba043.dnkmem (mgr.34373) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.512829+0000 mgr.gibba043.dnkmem (mgr.34373) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.513195+0000 mgr.gibba043.dnkmem (mgr.34373) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.514470+0000 mgr.gibba043.dnkmem (mgr.34373) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.514544+0000 mgr.gibba043.dnkmem (mgr.34373) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cephadm 2021-03-10T14:10:35.514704+0000 mgr.gibba043.dnkmem (mgr.34373) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:37 gibba043 bash[24019]: cluster 2021-03-10T14:10:35.927445+0000 mgr.gibba043.dnkmem (mgr.34373) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:39 gibba003 bash[31385]: cluster 2021-03-10T14:10:37.928939+0000 mgr.gibba043.dnkmem (mgr.34373) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:39 gibba003 bash[32348]: cluster 2021-03-10T14:10:37.928939+0000 mgr.gibba043.dnkmem (mgr.34373) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:39 gibba043 bash[24019]: cluster 2021-03-10T14:10:37.928939+0000 mgr.gibba043.dnkmem (mgr.34373) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:41.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:41 gibba003 bash[31385]: cluster 2021-03-10T14:10:39.930355+0000 mgr.gibba043.dnkmem (mgr.34373) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:41 gibba003 bash[32348]: cluster 2021-03-10T14:10:39.930355+0000 mgr.gibba043.dnkmem (mgr.34373) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:41 gibba043 bash[24019]: cluster 2021-03-10T14:10:39.930355+0000 mgr.gibba043.dnkmem (mgr.34373) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:43 gibba003 bash[31385]: cluster 2021-03-10T14:10:41.932012+0000 mgr.gibba043.dnkmem (mgr.34373) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:43 gibba003 bash[32348]: cluster 2021-03-10T14:10:41.932012+0000 mgr.gibba043.dnkmem (mgr.34373) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:43.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:43 gibba043 bash[24019]: cluster 2021-03-10T14:10:41.932012+0000 mgr.gibba043.dnkmem (mgr.34373) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:45 gibba003 bash[31385]: cluster 2021-03-10T14:10:43.933598+0000 mgr.gibba043.dnkmem (mgr.34373) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:45 gibba003 bash[32348]: cluster 2021-03-10T14:10:43.933598+0000 mgr.gibba043.dnkmem (mgr.34373) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:45 gibba043 bash[24019]: cluster 2021-03-10T14:10:43.933598+0000 mgr.gibba043.dnkmem (mgr.34373) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:47 gibba003 bash[31385]: cluster 2021-03-10T14:10:45.935328+0000 mgr.gibba043.dnkmem (mgr.34373) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:47 gibba003 bash[32348]: cluster 2021-03-10T14:10:45.935328+0000 mgr.gibba043.dnkmem (mgr.34373) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:47 gibba043 bash[24019]: cluster 2021-03-10T14:10:45.935328+0000 mgr.gibba043.dnkmem (mgr.34373) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:49 gibba003 bash[31385]: cluster 2021-03-10T14:10:47.936846+0000 mgr.gibba043.dnkmem (mgr.34373) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:49 gibba003 bash[32348]: cluster 2021-03-10T14:10:47.936846+0000 mgr.gibba043.dnkmem (mgr.34373) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:49 gibba043 bash[24019]: cluster 2021-03-10T14:10:47.936846+0000 mgr.gibba043.dnkmem (mgr.34373) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:51 gibba003 bash[31385]: cluster 2021-03-10T14:10:49.938397+0000 mgr.gibba043.dnkmem (mgr.34373) 1089 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:51 gibba003 bash[32348]: cluster 2021-03-10T14:10:49.938397+0000 mgr.gibba043.dnkmem (mgr.34373) 1089 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:51 gibba043 bash[24019]: cluster 2021-03-10T14:10:49.938397+0000 mgr.gibba043.dnkmem (mgr.34373) 1089 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:52.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:52 gibba003 bash[31385]: cephadm 2021-03-10T14:10:50.516595+0000 mgr.gibba043.dnkmem (mgr.34373) 1090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:52.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:52 gibba003 bash[32348]: cephadm 2021-03-10T14:10:50.516595+0000 mgr.gibba043.dnkmem (mgr.34373) 1090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:52.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:52 gibba043 bash[24019]: cephadm 2021-03-10T14:10:50.516595+0000 mgr.gibba043.dnkmem (mgr.34373) 1090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:10:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:53 gibba003 bash[31385]: cluster 2021-03-10T14:10:51.940028+0000 mgr.gibba043.dnkmem (mgr.34373) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:53.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:53 gibba003 bash[32348]: cluster 2021-03-10T14:10:51.940028+0000 mgr.gibba043.dnkmem (mgr.34373) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:53 gibba043 bash[24019]: cluster 2021-03-10T14:10:51.940028+0000 mgr.gibba043.dnkmem (mgr.34373) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:55 gibba003 bash[31385]: cluster 2021-03-10T14:10:53.941389+0000 mgr.gibba043.dnkmem (mgr.34373) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:55 gibba003 bash[32348]: cluster 2021-03-10T14:10:53.941389+0000 mgr.gibba043.dnkmem (mgr.34373) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:55 gibba043 bash[24019]: cluster 2021-03-10T14:10:53.941389+0000 mgr.gibba043.dnkmem (mgr.34373) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:57 gibba003 bash[31385]: cluster 2021-03-10T14:10:55.943088+0000 mgr.gibba043.dnkmem (mgr.34373) 1093 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:57 gibba003 bash[32348]: cluster 2021-03-10T14:10:55.943088+0000 mgr.gibba043.dnkmem (mgr.34373) 1093 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:57 gibba043 bash[24019]: cluster 2021-03-10T14:10:55.943088+0000 mgr.gibba043.dnkmem (mgr.34373) 1093 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.627 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:10:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:10:59 gibba003 bash[31385]: cluster 2021-03-10T14:10:57.944448+0000 mgr.gibba043.dnkmem (mgr.34373) 1094 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:10:59 gibba003 bash[32348]: cluster 2021-03-10T14:10:57.944448+0000 mgr.gibba043.dnkmem (mgr.34373) 1094 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:10:59 gibba043 bash[24019]: cluster 2021-03-10T14:10:57.944448+0000 mgr.gibba043.dnkmem (mgr.34373) 1094 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.855 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:10:59.856 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (19m) 5m ago 24m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:10:59.856 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:10:59.856 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (19m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:10:59.856 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:10:59.857 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:10:59.857 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:10:59.857 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:10:59.857 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:10:59.857 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (24m) 5m ago 24m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:10:59.858 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:10:59.858 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:10:59.858 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:10:59.858 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:10:59.858 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:10:59.859 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:10:59.859 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:10:59.859 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:10:59.859 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (14m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:10:59.859 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (24m) 4m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:10:59.860 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:11:00.105 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:11:00.106 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:11:00.106 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:00.106 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:11:00.106 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:11:00.107 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:00.107 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:11:00.107 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:11:00.107 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:11:00.107 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:11:00.108 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:11:00.108 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:11:00.108 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:11:00.108 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:11:00.108 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:11:00.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:00 gibba003 bash[31385]: audit 2021-03-10T14:11:00.106811+0000 mon.a (mon.0) 600 : audit [DBG] from='client.? 172.21.2.103:0/1558490120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:00 gibba003 bash[32348]: audit 2021-03-10T14:11:00.106811+0000 mon.a (mon.0) 600 : audit [DBG] from='client.? 172.21.2.103:0/1558490120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:00.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:00 gibba043 bash[24019]: audit 2021-03-10T14:11:00.106811+0000 mon.a (mon.0) 600 : audit [DBG] from='client.? 172.21.2.103:0/1558490120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:01 gibba003 bash[31385]: audit 2021-03-10T14:10:59.619652+0000 mgr.gibba043.dnkmem (mgr.34373) 1095 : audit [DBG] from='client.54778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:01 gibba003 bash[31385]: audit 2021-03-10T14:10:59.843705+0000 mgr.gibba043.dnkmem (mgr.34373) 1096 : audit [DBG] from='client.54784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:01 gibba003 bash[31385]: cluster 2021-03-10T14:10:59.945909+0000 mgr.gibba043.dnkmem (mgr.34373) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:01 gibba003 bash[32348]: audit 2021-03-10T14:10:59.619652+0000 mgr.gibba043.dnkmem (mgr.34373) 1095 : audit [DBG] from='client.54778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:01 gibba003 bash[32348]: audit 2021-03-10T14:10:59.843705+0000 mgr.gibba043.dnkmem (mgr.34373) 1096 : audit [DBG] from='client.54784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:01 gibba003 bash[32348]: cluster 2021-03-10T14:10:59.945909+0000 mgr.gibba043.dnkmem (mgr.34373) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:01 gibba043 bash[24019]: audit 2021-03-10T14:10:59.619652+0000 mgr.gibba043.dnkmem (mgr.34373) 1095 : audit [DBG] from='client.54778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:01 gibba043 bash[24019]: audit 2021-03-10T14:10:59.843705+0000 mgr.gibba043.dnkmem (mgr.34373) 1096 : audit [DBG] from='client.54784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:01 gibba043 bash[24019]: cluster 2021-03-10T14:10:59.945909+0000 mgr.gibba043.dnkmem (mgr.34373) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:03 gibba003 bash[31385]: cluster 2021-03-10T14:11:01.947456+0000 mgr.gibba043.dnkmem (mgr.34373) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:03 gibba003 bash[32348]: cluster 2021-03-10T14:11:01.947456+0000 mgr.gibba043.dnkmem (mgr.34373) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:03 gibba043 bash[24019]: cluster 2021-03-10T14:11:01.947456+0000 mgr.gibba043.dnkmem (mgr.34373) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:05 gibba003 bash[31385]: cluster 2021-03-10T14:11:03.949128+0000 mgr.gibba043.dnkmem (mgr.34373) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:05 gibba003 bash[32348]: cluster 2021-03-10T14:11:03.949128+0000 mgr.gibba043.dnkmem (mgr.34373) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:05.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:05 gibba043 bash[24019]: cluster 2021-03-10T14:11:03.949128+0000 mgr.gibba043.dnkmem (mgr.34373) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:07 gibba003 bash[31385]: cephadm 2021-03-10T14:11:05.528654+0000 mgr.gibba043.dnkmem (mgr.34373) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:07 gibba003 bash[31385]: cluster 2021-03-10T14:11:05.950742+0000 mgr.gibba043.dnkmem (mgr.34373) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:07 gibba003 bash[32348]: cephadm 2021-03-10T14:11:05.528654+0000 mgr.gibba043.dnkmem (mgr.34373) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:07 gibba003 bash[32348]: cluster 2021-03-10T14:11:05.950742+0000 mgr.gibba043.dnkmem (mgr.34373) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:07.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:07 gibba043 bash[24019]: cephadm 2021-03-10T14:11:05.528654+0000 mgr.gibba043.dnkmem (mgr.34373) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:07.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:07 gibba043 bash[24019]: cluster 2021-03-10T14:11:05.950742+0000 mgr.gibba043.dnkmem (mgr.34373) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:09 gibba003 bash[31385]: cluster 2021-03-10T14:11:07.952148+0000 mgr.gibba043.dnkmem (mgr.34373) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:09 gibba003 bash[32348]: cluster 2021-03-10T14:11:07.952148+0000 mgr.gibba043.dnkmem (mgr.34373) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:09 gibba043 bash[24019]: cluster 2021-03-10T14:11:07.952148+0000 mgr.gibba043.dnkmem (mgr.34373) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:11 gibba003 bash[32348]: cluster 2021-03-10T14:11:09.953892+0000 mgr.gibba043.dnkmem (mgr.34373) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:11 gibba003 bash[31385]: cluster 2021-03-10T14:11:09.953892+0000 mgr.gibba043.dnkmem (mgr.34373) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:11.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:11 gibba043 bash[24019]: cluster 2021-03-10T14:11:09.953892+0000 mgr.gibba043.dnkmem (mgr.34373) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: cluster 2021-03-10T14:11:11.955528+0000 mgr.gibba043.dnkmem (mgr.34373) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.733149+0000 mon.c (mon.1) 338 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:11:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.733930+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.734222+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:11:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.734617+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.735467+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.735500+0000 mon.c (mon.1) 341 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:11:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.736631+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.737449+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:11:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.842905+0000 mon.c (mon.1) 342 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.844075+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.873475+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[31385]: audit 2021-03-10T14:11:12.874612+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: cluster 2021-03-10T14:11:11.955528+0000 mgr.gibba043.dnkmem (mgr.34373) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.733149+0000 mon.c (mon.1) 338 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:11:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.733930+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.734222+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:11:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.734617+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.735467+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.735500+0000 mon.c (mon.1) 341 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:11:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.736631+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.737449+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:11:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.842905+0000 mon.c (mon.1) 342 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.844075+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.873475+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:13 gibba003 bash[32348]: audit 2021-03-10T14:11:12.874612+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: cluster 2021-03-10T14:11:11.955528+0000 mgr.gibba043.dnkmem (mgr.34373) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.733149+0000 mon.c (mon.1) 338 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:11:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.733930+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.734222+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:11:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.734617+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.735467+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.735500+0000 mon.c (mon.1) 341 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:11:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.736631+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:11:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.737449+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:11:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.842905+0000 mon.c (mon.1) 342 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.844075+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.873475+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:13 gibba043 bash[24019]: audit 2021-03-10T14:11:12.874612+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:15 gibba003 bash[31385]: cluster 2021-03-10T14:11:13.957140+0000 mgr.gibba043.dnkmem (mgr.34373) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:15 gibba003 bash[32348]: cluster 2021-03-10T14:11:13.957140+0000 mgr.gibba043.dnkmem (mgr.34373) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:15 gibba043 bash[24019]: cluster 2021-03-10T14:11:13.957140+0000 mgr.gibba043.dnkmem (mgr.34373) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:17 gibba003 bash[31385]: cluster 2021-03-10T14:11:15.958851+0000 mgr.gibba043.dnkmem (mgr.34373) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:17 gibba003 bash[32348]: cluster 2021-03-10T14:11:15.958851+0000 mgr.gibba043.dnkmem (mgr.34373) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:17 gibba043 bash[24019]: cluster 2021-03-10T14:11:15.958851+0000 mgr.gibba043.dnkmem (mgr.34373) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:19 gibba003 bash[31385]: cluster 2021-03-10T14:11:17.960209+0000 mgr.gibba043.dnkmem (mgr.34373) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:19 gibba003 bash[32348]: cluster 2021-03-10T14:11:17.960209+0000 mgr.gibba043.dnkmem (mgr.34373) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:19 gibba043 bash[24019]: cluster 2021-03-10T14:11:17.960209+0000 mgr.gibba043.dnkmem (mgr.34373) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:21.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:21 gibba043 bash[24019]: cluster 2021-03-10T14:11:19.961766+0000 mgr.gibba043.dnkmem (mgr.34373) 1108 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:21 gibba003 bash[31385]: cluster 2021-03-10T14:11:19.961766+0000 mgr.gibba043.dnkmem (mgr.34373) 1108 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:21 gibba003 bash[32348]: cluster 2021-03-10T14:11:19.961766+0000 mgr.gibba043.dnkmem (mgr.34373) 1108 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:22.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:22 gibba043 bash[24019]: cephadm 2021-03-10T14:11:20.544594+0000 mgr.gibba043.dnkmem (mgr.34373) 1109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:22.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:22 gibba003 bash[31385]: cephadm 2021-03-10T14:11:20.544594+0000 mgr.gibba043.dnkmem (mgr.34373) 1109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:22.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:22 gibba003 bash[32348]: cephadm 2021-03-10T14:11:20.544594+0000 mgr.gibba043.dnkmem (mgr.34373) 1109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:23.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:23 gibba043 bash[24019]: cluster 2021-03-10T14:11:21.963375+0000 mgr.gibba043.dnkmem (mgr.34373) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:23 gibba003 bash[31385]: cluster 2021-03-10T14:11:21.963375+0000 mgr.gibba043.dnkmem (mgr.34373) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:23 gibba003 bash[32348]: cluster 2021-03-10T14:11:21.963375+0000 mgr.gibba043.dnkmem (mgr.34373) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:25.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:25 gibba043 bash[24019]: cluster 2021-03-10T14:11:23.965051+0000 mgr.gibba043.dnkmem (mgr.34373) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:25 gibba003 bash[31385]: cluster 2021-03-10T14:11:23.965051+0000 mgr.gibba043.dnkmem (mgr.34373) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:25 gibba003 bash[32348]: cluster 2021-03-10T14:11:23.965051+0000 mgr.gibba043.dnkmem (mgr.34373) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:27 gibba043 bash[24019]: cluster 2021-03-10T14:11:25.966852+0000 mgr.gibba043.dnkmem (mgr.34373) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:27 gibba003 bash[31385]: cluster 2021-03-10T14:11:25.966852+0000 mgr.gibba043.dnkmem (mgr.34373) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:27 gibba003 bash[32348]: cluster 2021-03-10T14:11:25.966852+0000 mgr.gibba043.dnkmem (mgr.34373) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:29 gibba043 bash[24019]: cluster 2021-03-10T14:11:27.968498+0000 mgr.gibba043.dnkmem (mgr.34373) 1113 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:29 gibba003 bash[31385]: cluster 2021-03-10T14:11:27.968498+0000 mgr.gibba043.dnkmem (mgr.34373) 1113 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:29 gibba003 bash[32348]: cluster 2021-03-10T14:11:27.968498+0000 mgr.gibba043.dnkmem (mgr.34373) 1113 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:30.345 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:11:30.577 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:11:30.577 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (19m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:11:30.577 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:11:30.578 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:11:30.578 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:11:30.578 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:11:30.578 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:11:30.579 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:11:30.579 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:11:30.579 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (25m) 6m ago 25m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:11:30.579 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (25m) 4m ago 25m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:11:30.579 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:11:30.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:11:30.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:11:30.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:11:30.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:11:30.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:11:30.581 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:11:30.581 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:11:30.581 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (24m) 4m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:11:30.581 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:11:30.824 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:11:30.825 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:11:30.825 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:30.825 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:11:30.825 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:11:30.826 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:30.826 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:11:30.826 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:11:30.826 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:11:30.827 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:11:30.827 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:11:30.827 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:11:30.827 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:11:30.827 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:11:30.828 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:11:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:31 gibba043 bash[24019]: cluster 2021-03-10T14:11:29.970232+0000 mgr.gibba043.dnkmem (mgr.34373) 1114 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:31 gibba043 bash[24019]: audit 2021-03-10T14:11:30.336879+0000 mgr.gibba043.dnkmem (mgr.34373) 1115 : audit [DBG] from='client.44811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:31 gibba043 bash[24019]: audit 2021-03-10T14:11:30.825653+0000 mon.c (mon.1) 344 : audit [DBG] from='client.? 172.21.2.103:0/3642063252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:31 gibba003 bash[31385]: cluster 2021-03-10T14:11:29.970232+0000 mgr.gibba043.dnkmem (mgr.34373) 1114 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:31 gibba003 bash[31385]: audit 2021-03-10T14:11:30.336879+0000 mgr.gibba043.dnkmem (mgr.34373) 1115 : audit [DBG] from='client.44811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:31 gibba003 bash[31385]: audit 2021-03-10T14:11:30.825653+0000 mon.c (mon.1) 344 : audit [DBG] from='client.? 172.21.2.103:0/3642063252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:31.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:31 gibba003 bash[32348]: cluster 2021-03-10T14:11:29.970232+0000 mgr.gibba043.dnkmem (mgr.34373) 1114 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:31 gibba003 bash[32348]: audit 2021-03-10T14:11:30.336879+0000 mgr.gibba043.dnkmem (mgr.34373) 1115 : audit [DBG] from='client.44811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:31.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:31 gibba003 bash[32348]: audit 2021-03-10T14:11:30.825653+0000 mon.c (mon.1) 344 : audit [DBG] from='client.? 172.21.2.103:0/3642063252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:32.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:32 gibba043 bash[24019]: audit 2021-03-10T14:11:30.564785+0000 mgr.gibba043.dnkmem (mgr.34373) 1116 : audit [DBG] from='client.54802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:32.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:32 gibba003 bash[31385]: audit 2021-03-10T14:11:30.564785+0000 mgr.gibba043.dnkmem (mgr.34373) 1116 : audit [DBG] from='client.54802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:32.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:32 gibba003 bash[32348]: audit 2021-03-10T14:11:30.564785+0000 mgr.gibba043.dnkmem (mgr.34373) 1116 : audit [DBG] from='client.54802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:33.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:33 gibba043 bash[24019]: cluster 2021-03-10T14:11:31.972126+0000 mgr.gibba043.dnkmem (mgr.34373) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:33 gibba003 bash[31385]: cluster 2021-03-10T14:11:31.972126+0000 mgr.gibba043.dnkmem (mgr.34373) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:33 gibba003 bash[32348]: cluster 2021-03-10T14:11:31.972126+0000 mgr.gibba043.dnkmem (mgr.34373) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:35 gibba003 bash[31385]: cluster 2021-03-10T14:11:33.973733+0000 mgr.gibba043.dnkmem (mgr.34373) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:35.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:35 gibba003 bash[32348]: cluster 2021-03-10T14:11:33.973733+0000 mgr.gibba043.dnkmem (mgr.34373) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:35 gibba043 bash[24019]: cluster 2021-03-10T14:11:33.973733+0000 mgr.gibba043.dnkmem (mgr.34373) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.561401+0000 mgr.gibba043.dnkmem (mgr.34373) 1119 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:11:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.562955+0000 mgr.gibba043.dnkmem (mgr.34373) 1120 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:11:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.793974+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:11:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.796201+0000 mgr.gibba043.dnkmem (mgr.34373) 1121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.797917+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.798567+0000 mgr.gibba043.dnkmem (mgr.34373) 1122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.800011+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.800131+0000 mgr.gibba043.dnkmem (mgr.34373) 1123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.800245+0000 mgr.gibba043.dnkmem (mgr.34373) 1124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.801551+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.801810+0000 mgr.gibba043.dnkmem (mgr.34373) 1125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.801884+0000 mgr.gibba043.dnkmem (mgr.34373) 1126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.803176+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.803789+0000 mgr.gibba043.dnkmem (mgr.34373) 1127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.806028+0000 mgr.gibba043.dnkmem (mgr.34373) 1128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.806110+0000 mgr.gibba043.dnkmem (mgr.34373) 1129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.807395+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.807612+0000 mgr.gibba043.dnkmem (mgr.34373) 1130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.808077+0000 mgr.gibba043.dnkmem (mgr.34373) 1131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: audit 2021-03-10T14:11:35.809489+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.809616+0000 mgr.gibba043.dnkmem (mgr.34373) 1132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.809737+0000 mgr.gibba043.dnkmem (mgr.34373) 1133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cephadm 2021-03-10T14:11:35.809878+0000 mgr.gibba043.dnkmem (mgr.34373) 1134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[31385]: cluster 2021-03-10T14:11:35.975445+0000 mgr.gibba043.dnkmem (mgr.34373) 1135 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.561401+0000 mgr.gibba043.dnkmem (mgr.34373) 1119 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:11:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.562955+0000 mgr.gibba043.dnkmem (mgr.34373) 1120 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:11:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.793974+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:11:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.796201+0000 mgr.gibba043.dnkmem (mgr.34373) 1121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.797917+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.798567+0000 mgr.gibba043.dnkmem (mgr.34373) 1122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.800011+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.800131+0000 mgr.gibba043.dnkmem (mgr.34373) 1123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.800245+0000 mgr.gibba043.dnkmem (mgr.34373) 1124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.801551+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.801810+0000 mgr.gibba043.dnkmem (mgr.34373) 1125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.801884+0000 mgr.gibba043.dnkmem (mgr.34373) 1126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.803176+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.803789+0000 mgr.gibba043.dnkmem (mgr.34373) 1127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.806028+0000 mgr.gibba043.dnkmem (mgr.34373) 1128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.806110+0000 mgr.gibba043.dnkmem (mgr.34373) 1129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.807395+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.807612+0000 mgr.gibba043.dnkmem (mgr.34373) 1130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.808077+0000 mgr.gibba043.dnkmem (mgr.34373) 1131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: audit 2021-03-10T14:11:35.809489+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.809616+0000 mgr.gibba043.dnkmem (mgr.34373) 1132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.809737+0000 mgr.gibba043.dnkmem (mgr.34373) 1133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cephadm 2021-03-10T14:11:35.809878+0000 mgr.gibba043.dnkmem (mgr.34373) 1134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:36 gibba003 bash[32348]: cluster 2021-03-10T14:11:35.975445+0000 mgr.gibba043.dnkmem (mgr.34373) 1135 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.561401+0000 mgr.gibba043.dnkmem (mgr.34373) 1119 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:11:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.562955+0000 mgr.gibba043.dnkmem (mgr.34373) 1120 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:11:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.793974+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:11:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.796201+0000 mgr.gibba043.dnkmem (mgr.34373) 1121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.797917+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.798567+0000 mgr.gibba043.dnkmem (mgr.34373) 1122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.800011+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.800131+0000 mgr.gibba043.dnkmem (mgr.34373) 1123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.800245+0000 mgr.gibba043.dnkmem (mgr.34373) 1124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.801551+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.801810+0000 mgr.gibba043.dnkmem (mgr.34373) 1125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.801884+0000 mgr.gibba043.dnkmem (mgr.34373) 1126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.803176+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.803789+0000 mgr.gibba043.dnkmem (mgr.34373) 1127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.806028+0000 mgr.gibba043.dnkmem (mgr.34373) 1128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.806110+0000 mgr.gibba043.dnkmem (mgr.34373) 1129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.807395+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.807612+0000 mgr.gibba043.dnkmem (mgr.34373) 1130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.808077+0000 mgr.gibba043.dnkmem (mgr.34373) 1131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: audit 2021-03-10T14:11:35.809489+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.809616+0000 mgr.gibba043.dnkmem (mgr.34373) 1132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.809737+0000 mgr.gibba043.dnkmem (mgr.34373) 1133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cephadm 2021-03-10T14:11:35.809878+0000 mgr.gibba043.dnkmem (mgr.34373) 1134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:36 gibba043 bash[24019]: cluster 2021-03-10T14:11:35.975445+0000 mgr.gibba043.dnkmem (mgr.34373) 1135 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:39 gibba003 bash[31385]: cluster 2021-03-10T14:11:37.976968+0000 mgr.gibba043.dnkmem (mgr.34373) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:39 gibba003 bash[32348]: cluster 2021-03-10T14:11:37.976968+0000 mgr.gibba043.dnkmem (mgr.34373) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:39 gibba043 bash[24019]: cluster 2021-03-10T14:11:37.976968+0000 mgr.gibba043.dnkmem (mgr.34373) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:41.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:41 gibba003 bash[31385]: cluster 2021-03-10T14:11:39.977482+0000 mgr.gibba043.dnkmem (mgr.34373) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:41 gibba003 bash[32348]: cluster 2021-03-10T14:11:39.977482+0000 mgr.gibba043.dnkmem (mgr.34373) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:41 gibba043 bash[24019]: cluster 2021-03-10T14:11:39.977482+0000 mgr.gibba043.dnkmem (mgr.34373) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:43 gibba003 bash[31385]: cluster 2021-03-10T14:11:41.978988+0000 mgr.gibba043.dnkmem (mgr.34373) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:43 gibba003 bash[32348]: cluster 2021-03-10T14:11:41.978988+0000 mgr.gibba043.dnkmem (mgr.34373) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:43 gibba043 bash[24019]: cluster 2021-03-10T14:11:41.978988+0000 mgr.gibba043.dnkmem (mgr.34373) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:45 gibba003 bash[31385]: cluster 2021-03-10T14:11:43.980718+0000 mgr.gibba043.dnkmem (mgr.34373) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:45 gibba003 bash[32348]: cluster 2021-03-10T14:11:43.980718+0000 mgr.gibba043.dnkmem (mgr.34373) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:45 gibba043 bash[24019]: cluster 2021-03-10T14:11:43.980718+0000 mgr.gibba043.dnkmem (mgr.34373) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:47 gibba003 bash[31385]: cluster 2021-03-10T14:11:45.982247+0000 mgr.gibba043.dnkmem (mgr.34373) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:47 gibba003 bash[32348]: cluster 2021-03-10T14:11:45.982247+0000 mgr.gibba043.dnkmem (mgr.34373) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:47 gibba043 bash[24019]: cluster 2021-03-10T14:11:45.982247+0000 mgr.gibba043.dnkmem (mgr.34373) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:49 gibba003 bash[31385]: cluster 2021-03-10T14:11:47.982755+0000 mgr.gibba043.dnkmem (mgr.34373) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:49 gibba003 bash[32348]: cluster 2021-03-10T14:11:47.982755+0000 mgr.gibba043.dnkmem (mgr.34373) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:49 gibba043 bash[24019]: cluster 2021-03-10T14:11:47.982755+0000 mgr.gibba043.dnkmem (mgr.34373) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:51 gibba043 bash[24019]: cluster 2021-03-10T14:11:49.984248+0000 mgr.gibba043.dnkmem (mgr.34373) 1142 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:51 gibba003 bash[31385]: cluster 2021-03-10T14:11:49.984248+0000 mgr.gibba043.dnkmem (mgr.34373) 1142 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:51 gibba003 bash[32348]: cluster 2021-03-10T14:11:49.984248+0000 mgr.gibba043.dnkmem (mgr.34373) 1142 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:52.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:52 gibba043 bash[24019]: cephadm 2021-03-10T14:11:50.825888+0000 mgr.gibba043.dnkmem (mgr.34373) 1143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:52.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:52 gibba003 bash[31385]: cephadm 2021-03-10T14:11:50.825888+0000 mgr.gibba043.dnkmem (mgr.34373) 1143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:52.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:52 gibba003 bash[32348]: cephadm 2021-03-10T14:11:50.825888+0000 mgr.gibba043.dnkmem (mgr.34373) 1143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:11:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:53 gibba043 bash[24019]: cluster 2021-03-10T14:11:51.985870+0000 mgr.gibba043.dnkmem (mgr.34373) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:53 gibba003 bash[31385]: cluster 2021-03-10T14:11:51.985870+0000 mgr.gibba043.dnkmem (mgr.34373) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:53.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:53 gibba003 bash[32348]: cluster 2021-03-10T14:11:51.985870+0000 mgr.gibba043.dnkmem (mgr.34373) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:55 gibba043 bash[24019]: cluster 2021-03-10T14:11:53.987459+0000 mgr.gibba043.dnkmem (mgr.34373) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:55 gibba003 bash[31385]: cluster 2021-03-10T14:11:53.987459+0000 mgr.gibba043.dnkmem (mgr.34373) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:55 gibba003 bash[32348]: cluster 2021-03-10T14:11:53.987459+0000 mgr.gibba043.dnkmem (mgr.34373) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:57 gibba043 bash[24019]: cluster 2021-03-10T14:11:55.988052+0000 mgr.gibba043.dnkmem (mgr.34373) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:57 gibba003 bash[31385]: cluster 2021-03-10T14:11:55.988052+0000 mgr.gibba043.dnkmem (mgr.34373) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:57 gibba003 bash[32348]: cluster 2021-03-10T14:11:55.988052+0000 mgr.gibba043.dnkmem (mgr.34373) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:11:59 gibba043 bash[24019]: cluster 2021-03-10T14:11:57.989343+0000 mgr.gibba043.dnkmem (mgr.34373) 1147 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:11:59 gibba003 bash[31385]: cluster 2021-03-10T14:11:57.989343+0000 mgr.gibba043.dnkmem (mgr.34373) 1147 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:59.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:11:59 gibba003 bash[32348]: cluster 2021-03-10T14:11:57.989343+0000 mgr.gibba043.dnkmem (mgr.34373) 1147 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.067 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:12:01.294 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:12:01.295 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (20m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:12:01.295 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:12:01.295 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (20m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:12:01.296 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:12:01.296 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:12:01.296 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:12:01.296 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:12:01.297 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:12:01.297 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (25m) 6m ago 25m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:12:01.297 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:12:01.297 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:12:01.297 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:12:01.298 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:12:01.298 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:12:01.298 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:12:01.298 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:12:01.299 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:12:01.299 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (15m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:12:01.299 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (25m) 5m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:12:01.299 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:12:01.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:01 gibba043 bash[24019]: cluster 2021-03-10T14:11:59.990716+0000 mgr.gibba043.dnkmem (mgr.34373) 1148 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.572 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:12:01.572 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:12:01.572 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:01.573 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:12:01.573 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:12:01.573 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:01.573 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:12:01.574 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:12:01.574 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:12:01.574 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:12:01.574 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:12:01.575 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:12:01.575 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:12:01.575 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:12:01.575 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:12:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:01 gibba003 bash[31385]: cluster 2021-03-10T14:11:59.990716+0000 mgr.gibba043.dnkmem (mgr.34373) 1148 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:01 gibba003 bash[32348]: cluster 2021-03-10T14:11:59.990716+0000 mgr.gibba043.dnkmem (mgr.34373) 1148 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:02.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:02 gibba043 bash[24019]: audit 2021-03-10T14:12:01.058210+0000 mgr.gibba043.dnkmem (mgr.34373) 1149 : audit [DBG] from='client.44829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:02 gibba043 bash[24019]: audit 2021-03-10T14:12:01.282961+0000 mgr.gibba043.dnkmem (mgr.34373) 1150 : audit [DBG] from='client.54820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:02.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:02 gibba043 bash[24019]: audit 2021-03-10T14:12:01.546764+0000 mon.a (mon.0) 608 : audit [DBG] from='client.? 172.21.2.103:0/1122923056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:02.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:02 gibba003 bash[32348]: audit 2021-03-10T14:12:01.058210+0000 mgr.gibba043.dnkmem (mgr.34373) 1149 : audit [DBG] from='client.44829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:02.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:02 gibba003 bash[32348]: audit 2021-03-10T14:12:01.282961+0000 mgr.gibba043.dnkmem (mgr.34373) 1150 : audit [DBG] from='client.54820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:02.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:02 gibba003 bash[32348]: audit 2021-03-10T14:12:01.546764+0000 mon.a (mon.0) 608 : audit [DBG] from='client.? 172.21.2.103:0/1122923056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:02.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:02 gibba003 bash[31385]: audit 2021-03-10T14:12:01.058210+0000 mgr.gibba043.dnkmem (mgr.34373) 1149 : audit [DBG] from='client.44829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:02.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:02 gibba003 bash[31385]: audit 2021-03-10T14:12:01.282961+0000 mgr.gibba043.dnkmem (mgr.34373) 1150 : audit [DBG] from='client.54820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:02.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:02 gibba003 bash[31385]: audit 2021-03-10T14:12:01.546764+0000 mon.a (mon.0) 608 : audit [DBG] from='client.? 172.21.2.103:0/1122923056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:03 gibba043 bash[24019]: cluster 2021-03-10T14:12:01.992421+0000 mgr.gibba043.dnkmem (mgr.34373) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:03 gibba003 bash[31385]: cluster 2021-03-10T14:12:01.992421+0000 mgr.gibba043.dnkmem (mgr.34373) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:03.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:03 gibba003 bash[32348]: cluster 2021-03-10T14:12:01.992421+0000 mgr.gibba043.dnkmem (mgr.34373) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:05.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:05 gibba043 bash[24019]: cluster 2021-03-10T14:12:03.992929+0000 mgr.gibba043.dnkmem (mgr.34373) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:05 gibba003 bash[31385]: cluster 2021-03-10T14:12:03.992929+0000 mgr.gibba043.dnkmem (mgr.34373) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:05 gibba003 bash[32348]: cluster 2021-03-10T14:12:03.992929+0000 mgr.gibba043.dnkmem (mgr.34373) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:07 gibba003 bash[31385]: cephadm 2021-03-10T14:12:05.841949+0000 mgr.gibba043.dnkmem (mgr.34373) 1153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:07.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:07 gibba003 bash[31385]: cluster 2021-03-10T14:12:05.994346+0000 mgr.gibba043.dnkmem (mgr.34373) 1154 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:07 gibba003 bash[32348]: cephadm 2021-03-10T14:12:05.841949+0000 mgr.gibba043.dnkmem (mgr.34373) 1153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:07 gibba003 bash[32348]: cluster 2021-03-10T14:12:05.994346+0000 mgr.gibba043.dnkmem (mgr.34373) 1154 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:07 gibba043 bash[24019]: cephadm 2021-03-10T14:12:05.841949+0000 mgr.gibba043.dnkmem (mgr.34373) 1153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:07 gibba043 bash[24019]: cluster 2021-03-10T14:12:05.994346+0000 mgr.gibba043.dnkmem (mgr.34373) 1154 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:09 gibba003 bash[31385]: cluster 2021-03-10T14:12:07.995866+0000 mgr.gibba043.dnkmem (mgr.34373) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:09 gibba003 bash[32348]: cluster 2021-03-10T14:12:07.995866+0000 mgr.gibba043.dnkmem (mgr.34373) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:09 gibba043 bash[24019]: cluster 2021-03-10T14:12:07.995866+0000 mgr.gibba043.dnkmem (mgr.34373) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:11 gibba003 bash[31385]: cluster 2021-03-10T14:12:09.997369+0000 mgr.gibba043.dnkmem (mgr.34373) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:11 gibba003 bash[32348]: cluster 2021-03-10T14:12:09.997369+0000 mgr.gibba043.dnkmem (mgr.34373) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:11 gibba043 bash[24019]: cluster 2021-03-10T14:12:09.997369+0000 mgr.gibba043.dnkmem (mgr.34373) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: cluster 2021-03-10T14:12:11.998302+0000 mgr.gibba043.dnkmem (mgr.34373) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.743434+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.744210+0000 mon.c (mon.1) 352 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:12:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.744648+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.744885+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.745699+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.745830+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:12:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.746947+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.747809+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.850028+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.851247+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.882134+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[31385]: audit 2021-03-10T14:12:12.883315+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: cluster 2021-03-10T14:12:11.998302+0000 mgr.gibba043.dnkmem (mgr.34373) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.743434+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.744210+0000 mon.c (mon.1) 352 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:12:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.744648+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.744885+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.745699+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.745830+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:12:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.746947+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.747809+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.850028+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.851247+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.882134+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:13 gibba003 bash[32348]: audit 2021-03-10T14:12:12.883315+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: cluster 2021-03-10T14:12:11.998302+0000 mgr.gibba043.dnkmem (mgr.34373) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.743434+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.744210+0000 mon.c (mon.1) 352 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:12:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.744648+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.744885+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.745699+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.745830+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:12:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.746947+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.747809+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.850028+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.851247+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.882134+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:13 gibba043 bash[24019]: audit 2021-03-10T14:12:12.883315+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:15 gibba003 bash[31385]: cluster 2021-03-10T14:12:13.999556+0000 mgr.gibba043.dnkmem (mgr.34373) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:15 gibba003 bash[32348]: cluster 2021-03-10T14:12:13.999556+0000 mgr.gibba043.dnkmem (mgr.34373) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:15 gibba043 bash[24019]: cluster 2021-03-10T14:12:13.999556+0000 mgr.gibba043.dnkmem (mgr.34373) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:17 gibba003 bash[31385]: cluster 2021-03-10T14:12:16.001250+0000 mgr.gibba043.dnkmem (mgr.34373) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:17 gibba003 bash[32348]: cluster 2021-03-10T14:12:16.001250+0000 mgr.gibba043.dnkmem (mgr.34373) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:17 gibba043 bash[24019]: cluster 2021-03-10T14:12:16.001250+0000 mgr.gibba043.dnkmem (mgr.34373) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:19 gibba003 bash[31385]: cluster 2021-03-10T14:12:18.002908+0000 mgr.gibba043.dnkmem (mgr.34373) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:19 gibba003 bash[32348]: cluster 2021-03-10T14:12:18.002908+0000 mgr.gibba043.dnkmem (mgr.34373) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:19 gibba043 bash[24019]: cluster 2021-03-10T14:12:18.002908+0000 mgr.gibba043.dnkmem (mgr.34373) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:21 gibba003 bash[31385]: cluster 2021-03-10T14:12:20.003490+0000 mgr.gibba043.dnkmem (mgr.34373) 1161 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:21 gibba003 bash[32348]: cluster 2021-03-10T14:12:20.003490+0000 mgr.gibba043.dnkmem (mgr.34373) 1161 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:21 gibba043 bash[24019]: cluster 2021-03-10T14:12:20.003490+0000 mgr.gibba043.dnkmem (mgr.34373) 1161 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:22.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:22 gibba003 bash[31385]: cephadm 2021-03-10T14:12:20.853732+0000 mgr.gibba043.dnkmem (mgr.34373) 1162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:22.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:22 gibba003 bash[32348]: cephadm 2021-03-10T14:12:20.853732+0000 mgr.gibba043.dnkmem (mgr.34373) 1162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:22.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:22 gibba043 bash[24019]: cephadm 2021-03-10T14:12:20.853732+0000 mgr.gibba043.dnkmem (mgr.34373) 1162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:23 gibba003 bash[31385]: cluster 2021-03-10T14:12:22.004937+0000 mgr.gibba043.dnkmem (mgr.34373) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:23 gibba003 bash[32348]: cluster 2021-03-10T14:12:22.004937+0000 mgr.gibba043.dnkmem (mgr.34373) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:23 gibba043 bash[24019]: cluster 2021-03-10T14:12:22.004937+0000 mgr.gibba043.dnkmem (mgr.34373) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:25 gibba003 bash[31385]: cluster 2021-03-10T14:12:24.006311+0000 mgr.gibba043.dnkmem (mgr.34373) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:25 gibba003 bash[32348]: cluster 2021-03-10T14:12:24.006311+0000 mgr.gibba043.dnkmem (mgr.34373) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:25.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:25 gibba043 bash[24019]: cluster 2021-03-10T14:12:24.006311+0000 mgr.gibba043.dnkmem (mgr.34373) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:27 gibba003 bash[31385]: cluster 2021-03-10T14:12:26.008106+0000 mgr.gibba043.dnkmem (mgr.34373) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:27 gibba003 bash[32348]: cluster 2021-03-10T14:12:26.008106+0000 mgr.gibba043.dnkmem (mgr.34373) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:27 gibba043 bash[24019]: cluster 2021-03-10T14:12:26.008106+0000 mgr.gibba043.dnkmem (mgr.34373) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:29 gibba003 bash[31385]: cluster 2021-03-10T14:12:28.008956+0000 mgr.gibba043.dnkmem (mgr.34373) 1166 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:29 gibba003 bash[32348]: cluster 2021-03-10T14:12:28.008956+0000 mgr.gibba043.dnkmem (mgr.34373) 1166 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:29 gibba043 bash[24019]: cluster 2021-03-10T14:12:28.008956+0000 mgr.gibba043.dnkmem (mgr.34373) 1166 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:31 gibba003 bash[31385]: cluster 2021-03-10T14:12:30.009469+0000 mgr.gibba043.dnkmem (mgr.34373) 1167 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:31 gibba003 bash[32348]: cluster 2021-03-10T14:12:30.009469+0000 mgr.gibba043.dnkmem (mgr.34373) 1167 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:31 gibba043 bash[24019]: cluster 2021-03-10T14:12:30.009469+0000 mgr.gibba043.dnkmem (mgr.34373) 1167 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.792 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:12:32.018 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:12:32.018 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (20m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:12:32.018 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:12:32.018 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:12:32.019 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:12:32.019 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:12:32.019 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:12:32.019 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:12:32.019 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:12:32.020 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (26m) 7m ago 26m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:12:32.020 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (26m) 5m ago 26m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:12:32.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:12:32.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:12:32.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:12:32.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:12:32.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:12:32.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:12:32.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:12:32.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:12:32.022 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (25m) 5m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:12:32.022 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:12:32.267 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:12:32.267 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:12:32.267 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:32.267 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:12:32.267 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:12:32.268 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:32.268 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:12:32.268 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:12:32.268 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:12:32.269 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:12:32.269 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:12:32.269 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:12:32.269 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:12:32.269 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:12:32.270 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:12:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[31385]: audit 2021-03-10T14:12:31.783194+0000 mgr.gibba043.dnkmem (mgr.34373) 1168 : audit [DBG] from='client.54832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[31385]: audit 2021-03-10T14:12:32.007508+0000 mgr.gibba043.dnkmem (mgr.34373) 1169 : audit [DBG] from='client.44853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[31385]: cluster 2021-03-10T14:12:32.010665+0000 mgr.gibba043.dnkmem (mgr.34373) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[31385]: audit 2021-03-10T14:12:32.267941+0000 mon.c (mon.1) 357 : audit [DBG] from='client.? 172.21.2.103:0/3966167106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[32348]: audit 2021-03-10T14:12:31.783194+0000 mgr.gibba043.dnkmem (mgr.34373) 1168 : audit [DBG] from='client.54832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:33.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[32348]: audit 2021-03-10T14:12:32.007508+0000 mgr.gibba043.dnkmem (mgr.34373) 1169 : audit [DBG] from='client.44853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:33.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[32348]: cluster 2021-03-10T14:12:32.010665+0000 mgr.gibba043.dnkmem (mgr.34373) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:33.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:33 gibba003 bash[32348]: audit 2021-03-10T14:12:32.267941+0000 mon.c (mon.1) 357 : audit [DBG] from='client.? 172.21.2.103:0/3966167106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:33.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:33 gibba043 bash[24019]: audit 2021-03-10T14:12:31.783194+0000 mgr.gibba043.dnkmem (mgr.34373) 1168 : audit [DBG] from='client.54832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:33 gibba043 bash[24019]: audit 2021-03-10T14:12:32.007508+0000 mgr.gibba043.dnkmem (mgr.34373) 1169 : audit [DBG] from='client.44853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:33 gibba043 bash[24019]: cluster 2021-03-10T14:12:32.010665+0000 mgr.gibba043.dnkmem (mgr.34373) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:33 gibba043 bash[24019]: audit 2021-03-10T14:12:32.267941+0000 mon.c (mon.1) 357 : audit [DBG] from='client.? 172.21.2.103:0/3966167106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:35 gibba003 bash[31385]: cluster 2021-03-10T14:12:34.012332+0000 mgr.gibba043.dnkmem (mgr.34373) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:35.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:35 gibba003 bash[32348]: cluster 2021-03-10T14:12:34.012332+0000 mgr.gibba043.dnkmem (mgr.34373) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:35.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:35 gibba043 bash[24019]: cluster 2021-03-10T14:12:34.012332+0000 mgr.gibba043.dnkmem (mgr.34373) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cluster 2021-03-10T14:12:36.012865+0000 mgr.gibba043.dnkmem (mgr.34373) 1172 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.066482+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.067009+0000 mgr.gibba043.dnkmem (mgr.34373) 1173 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:12:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.070776+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.071003+0000 mgr.gibba043.dnkmem (mgr.34373) 1174 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:12:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.277988+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.280541+0000 mgr.gibba043.dnkmem (mgr.34373) 1175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.282165+0000 mon.c (mon.1) 358 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.282655+0000 mgr.gibba043.dnkmem (mgr.34373) 1176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.283847+0000 mon.c (mon.1) 359 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.284213+0000 mgr.gibba043.dnkmem (mgr.34373) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.284257+0000 mgr.gibba043.dnkmem (mgr.34373) 1178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.285377+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.285771+0000 mgr.gibba043.dnkmem (mgr.34373) 1179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.285816+0000 mgr.gibba043.dnkmem (mgr.34373) 1180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.286975+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.287104+0000 mgr.gibba043.dnkmem (mgr.34373) 1181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.289009+0000 mgr.gibba043.dnkmem (mgr.34373) 1182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.289053+0000 mgr.gibba043.dnkmem (mgr.34373) 1183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.290346+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.290796+0000 mgr.gibba043.dnkmem (mgr.34373) 1184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cluster 2021-03-10T14:12:36.012865+0000 mgr.gibba043.dnkmem (mgr.34373) 1172 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.066482+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.067009+0000 mgr.gibba043.dnkmem (mgr.34373) 1173 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:12:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.070776+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.071003+0000 mgr.gibba043.dnkmem (mgr.34373) 1174 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:12:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.277988+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.280541+0000 mgr.gibba043.dnkmem (mgr.34373) 1175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.282165+0000 mon.c (mon.1) 358 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.282655+0000 mgr.gibba043.dnkmem (mgr.34373) 1176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.283847+0000 mon.c (mon.1) 359 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.284213+0000 mgr.gibba043.dnkmem (mgr.34373) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.284257+0000 mgr.gibba043.dnkmem (mgr.34373) 1178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.285377+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.285771+0000 mgr.gibba043.dnkmem (mgr.34373) 1179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.285816+0000 mgr.gibba043.dnkmem (mgr.34373) 1180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.286975+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.287104+0000 mgr.gibba043.dnkmem (mgr.34373) 1181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.289009+0000 mgr.gibba043.dnkmem (mgr.34373) 1182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.289053+0000 mgr.gibba043.dnkmem (mgr.34373) 1183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.290346+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.290796+0000 mgr.gibba043.dnkmem (mgr.34373) 1184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:37.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.291198+0000 mgr.gibba043.dnkmem (mgr.34373) 1185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:37.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: audit 2021-03-10T14:12:36.292305+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.292802+0000 mgr.gibba043.dnkmem (mgr.34373) 1186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:37.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.292874+0000 mgr.gibba043.dnkmem (mgr.34373) 1187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:37.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[31385]: cephadm 2021-03-10T14:12:36.293018+0000 mgr.gibba043.dnkmem (mgr.34373) 1188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.291198+0000 mgr.gibba043.dnkmem (mgr.34373) 1185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: audit 2021-03-10T14:12:36.292305+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.292802+0000 mgr.gibba043.dnkmem (mgr.34373) 1186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.292874+0000 mgr.gibba043.dnkmem (mgr.34373) 1187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:37 gibba003 bash[32348]: cephadm 2021-03-10T14:12:36.293018+0000 mgr.gibba043.dnkmem (mgr.34373) 1188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cluster 2021-03-10T14:12:36.012865+0000 mgr.gibba043.dnkmem (mgr.34373) 1172 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.066482+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.067009+0000 mgr.gibba043.dnkmem (mgr.34373) 1173 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:12:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.070776+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.071003+0000 mgr.gibba043.dnkmem (mgr.34373) 1174 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:12:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.277988+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:12:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.280541+0000 mgr.gibba043.dnkmem (mgr.34373) 1175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.282165+0000 mon.c (mon.1) 358 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.282655+0000 mgr.gibba043.dnkmem (mgr.34373) 1176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.283847+0000 mon.c (mon.1) 359 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.284213+0000 mgr.gibba043.dnkmem (mgr.34373) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.284257+0000 mgr.gibba043.dnkmem (mgr.34373) 1178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.285377+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.285771+0000 mgr.gibba043.dnkmem (mgr.34373) 1179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.285816+0000 mgr.gibba043.dnkmem (mgr.34373) 1180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.286975+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.287104+0000 mgr.gibba043.dnkmem (mgr.34373) 1181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.289009+0000 mgr.gibba043.dnkmem (mgr.34373) 1182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.289053+0000 mgr.gibba043.dnkmem (mgr.34373) 1183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.290346+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.290796+0000 mgr.gibba043.dnkmem (mgr.34373) 1184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.291198+0000 mgr.gibba043.dnkmem (mgr.34373) 1185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: audit 2021-03-10T14:12:36.292305+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.292802+0000 mgr.gibba043.dnkmem (mgr.34373) 1186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.292874+0000 mgr.gibba043.dnkmem (mgr.34373) 1187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:37 gibba043 bash[24019]: cephadm 2021-03-10T14:12:36.293018+0000 mgr.gibba043.dnkmem (mgr.34373) 1188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:39 gibba003 bash[31385]: cluster 2021-03-10T14:12:38.014205+0000 mgr.gibba043.dnkmem (mgr.34373) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:39 gibba003 bash[32348]: cluster 2021-03-10T14:12:38.014205+0000 mgr.gibba043.dnkmem (mgr.34373) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:39 gibba043 bash[24019]: cluster 2021-03-10T14:12:38.014205+0000 mgr.gibba043.dnkmem (mgr.34373) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:41 gibba003 bash[31385]: cluster 2021-03-10T14:12:40.015433+0000 mgr.gibba043.dnkmem (mgr.34373) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:41 gibba003 bash[32348]: cluster 2021-03-10T14:12:40.015433+0000 mgr.gibba043.dnkmem (mgr.34373) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:41 gibba043 bash[24019]: cluster 2021-03-10T14:12:40.015433+0000 mgr.gibba043.dnkmem (mgr.34373) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:43 gibba003 bash[31385]: cluster 2021-03-10T14:12:42.016980+0000 mgr.gibba043.dnkmem (mgr.34373) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:43 gibba003 bash[32348]: cluster 2021-03-10T14:12:42.016980+0000 mgr.gibba043.dnkmem (mgr.34373) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:43 gibba043 bash[24019]: cluster 2021-03-10T14:12:42.016980+0000 mgr.gibba043.dnkmem (mgr.34373) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:45 gibba043 bash[24019]: cluster 2021-03-10T14:12:44.017925+0000 mgr.gibba043.dnkmem (mgr.34373) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:45 gibba003 bash[31385]: cluster 2021-03-10T14:12:44.017925+0000 mgr.gibba043.dnkmem (mgr.34373) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:45 gibba003 bash[32348]: cluster 2021-03-10T14:12:44.017925+0000 mgr.gibba043.dnkmem (mgr.34373) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:47 gibba043 bash[24019]: cluster 2021-03-10T14:12:46.019606+0000 mgr.gibba043.dnkmem (mgr.34373) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:47 gibba003 bash[31385]: cluster 2021-03-10T14:12:46.019606+0000 mgr.gibba043.dnkmem (mgr.34373) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:47 gibba003 bash[32348]: cluster 2021-03-10T14:12:46.019606+0000 mgr.gibba043.dnkmem (mgr.34373) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:49 gibba043 bash[24019]: cluster 2021-03-10T14:12:48.021300+0000 mgr.gibba043.dnkmem (mgr.34373) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:49 gibba003 bash[31385]: cluster 2021-03-10T14:12:48.021300+0000 mgr.gibba043.dnkmem (mgr.34373) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:49 gibba003 bash[32348]: cluster 2021-03-10T14:12:48.021300+0000 mgr.gibba043.dnkmem (mgr.34373) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:51 gibba043 bash[24019]: cluster 2021-03-10T14:12:50.022635+0000 mgr.gibba043.dnkmem (mgr.34373) 1195 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:51 gibba003 bash[31385]: cluster 2021-03-10T14:12:50.022635+0000 mgr.gibba043.dnkmem (mgr.34373) 1195 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:51 gibba003 bash[32348]: cluster 2021-03-10T14:12:50.022635+0000 mgr.gibba043.dnkmem (mgr.34373) 1195 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:52.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:52 gibba043 bash[24019]: cephadm 2021-03-10T14:12:51.295092+0000 mgr.gibba043.dnkmem (mgr.34373) 1196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:52.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:52 gibba003 bash[31385]: cephadm 2021-03-10T14:12:51.295092+0000 mgr.gibba043.dnkmem (mgr.34373) 1196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:52.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:52 gibba003 bash[32348]: cephadm 2021-03-10T14:12:51.295092+0000 mgr.gibba043.dnkmem (mgr.34373) 1196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:12:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:53 gibba043 bash[24019]: cluster 2021-03-10T14:12:52.023442+0000 mgr.gibba043.dnkmem (mgr.34373) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:53 gibba003 bash[31385]: cluster 2021-03-10T14:12:52.023442+0000 mgr.gibba043.dnkmem (mgr.34373) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:53 gibba003 bash[32348]: cluster 2021-03-10T14:12:52.023442+0000 mgr.gibba043.dnkmem (mgr.34373) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:55 gibba043 bash[24019]: cluster 2021-03-10T14:12:54.024958+0000 mgr.gibba043.dnkmem (mgr.34373) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:55 gibba003 bash[31385]: cluster 2021-03-10T14:12:54.024958+0000 mgr.gibba043.dnkmem (mgr.34373) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:55 gibba003 bash[32348]: cluster 2021-03-10T14:12:54.024958+0000 mgr.gibba043.dnkmem (mgr.34373) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:57 gibba043 bash[24019]: cluster 2021-03-10T14:12:56.026756+0000 mgr.gibba043.dnkmem (mgr.34373) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:57 gibba003 bash[31385]: cluster 2021-03-10T14:12:56.026756+0000 mgr.gibba043.dnkmem (mgr.34373) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:57 gibba003 bash[32348]: cluster 2021-03-10T14:12:56.026756+0000 mgr.gibba043.dnkmem (mgr.34373) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:12:59 gibba043 bash[24019]: cluster 2021-03-10T14:12:58.028459+0000 mgr.gibba043.dnkmem (mgr.34373) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:12:59 gibba003 bash[31385]: cluster 2021-03-10T14:12:58.028459+0000 mgr.gibba043.dnkmem (mgr.34373) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:12:59 gibba003 bash[32348]: cluster 2021-03-10T14:12:58.028459+0000 mgr.gibba043.dnkmem (mgr.34373) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:01.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:01 gibba043 bash[24019]: cluster 2021-03-10T14:13:00.029313+0000 mgr.gibba043.dnkmem (mgr.34373) 1201 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:01 gibba003 bash[31385]: cluster 2021-03-10T14:13:00.029313+0000 mgr.gibba043.dnkmem (mgr.34373) 1201 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:01 gibba003 bash[32348]: cluster 2021-03-10T14:13:00.029313+0000 mgr.gibba043.dnkmem (mgr.34373) 1201 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:02.510 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:13:02.738 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:13:02.738 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (21m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:13:02.738 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (26m) 6m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:13:02.739 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (21m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:13:02.739 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:13:02.739 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:13:02.739 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (20m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:13:02.740 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:13:02.740 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:13:02.740 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (26m) 7m ago 26m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:13:02.740 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:13:02.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:13:02.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:13:02.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:13:02.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:13:02.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:13:02.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:13:02.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:13:02.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:13:02.742 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (26m) 6m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:13:02.742 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:13:02.993 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:13:02.993 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:13:02.993 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:02.994 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:13:02.994 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:13:02.994 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:02.994 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:13:02.995 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:13:02.995 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:13:02.995 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:13:02.995 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:13:02.995 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:13:02.996 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:13:02.996 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:13:02.996 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:13:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:03 gibba003 bash[31385]: cluster 2021-03-10T14:13:02.030881+0000 mgr.gibba043.dnkmem (mgr.34373) 1202 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:03.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:03 gibba003 bash[31385]: audit 2021-03-10T14:13:02.994027+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.2.103:0/2822892537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:03 gibba003 bash[32348]: cluster 2021-03-10T14:13:02.030881+0000 mgr.gibba043.dnkmem (mgr.34373) 1202 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:03 gibba003 bash[32348]: audit 2021-03-10T14:13:02.994027+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.2.103:0/2822892537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:03 gibba043 bash[24019]: cluster 2021-03-10T14:13:02.030881+0000 mgr.gibba043.dnkmem (mgr.34373) 1202 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:03 gibba043 bash[24019]: audit 2021-03-10T14:13:02.994027+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.2.103:0/2822892537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:04.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:04 gibba003 bash[31385]: audit 2021-03-10T14:13:02.501714+0000 mgr.gibba043.dnkmem (mgr.34373) 1203 : audit [DBG] from='client.44865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:04 gibba003 bash[31385]: audit 2021-03-10T14:13:02.726035+0000 mgr.gibba043.dnkmem (mgr.34373) 1204 : audit [DBG] from='client.54856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:04 gibba003 bash[32348]: audit 2021-03-10T14:13:02.501714+0000 mgr.gibba043.dnkmem (mgr.34373) 1203 : audit [DBG] from='client.44865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:04 gibba003 bash[32348]: audit 2021-03-10T14:13:02.726035+0000 mgr.gibba043.dnkmem (mgr.34373) 1204 : audit [DBG] from='client.54856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:04 gibba043 bash[24019]: audit 2021-03-10T14:13:02.501714+0000 mgr.gibba043.dnkmem (mgr.34373) 1203 : audit [DBG] from='client.44865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:04 gibba043 bash[24019]: audit 2021-03-10T14:13:02.726035+0000 mgr.gibba043.dnkmem (mgr.34373) 1204 : audit [DBG] from='client.54856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:05 gibba003 bash[31385]: cluster 2021-03-10T14:13:04.032564+0000 mgr.gibba043.dnkmem (mgr.34373) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:05 gibba003 bash[32348]: cluster 2021-03-10T14:13:04.032564+0000 mgr.gibba043.dnkmem (mgr.34373) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:05 gibba043 bash[24019]: cluster 2021-03-10T14:13:04.032564+0000 mgr.gibba043.dnkmem (mgr.34373) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:07 gibba003 bash[31385]: cluster 2021-03-10T14:13:06.034114+0000 mgr.gibba043.dnkmem (mgr.34373) 1206 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:07 gibba003 bash[31385]: cephadm 2021-03-10T14:13:06.303018+0000 mgr.gibba043.dnkmem (mgr.34373) 1207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:07 gibba003 bash[32348]: cluster 2021-03-10T14:13:06.034114+0000 mgr.gibba043.dnkmem (mgr.34373) 1206 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:07 gibba003 bash[32348]: cephadm 2021-03-10T14:13:06.303018+0000 mgr.gibba043.dnkmem (mgr.34373) 1207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:07 gibba043 bash[24019]: cluster 2021-03-10T14:13:06.034114+0000 mgr.gibba043.dnkmem (mgr.34373) 1206 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:07 gibba043 bash[24019]: cephadm 2021-03-10T14:13:06.303018+0000 mgr.gibba043.dnkmem (mgr.34373) 1207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:09 gibba003 bash[31385]: cluster 2021-03-10T14:13:08.035106+0000 mgr.gibba043.dnkmem (mgr.34373) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:09 gibba003 bash[32348]: cluster 2021-03-10T14:13:08.035106+0000 mgr.gibba043.dnkmem (mgr.34373) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:09 gibba043 bash[24019]: cluster 2021-03-10T14:13:08.035106+0000 mgr.gibba043.dnkmem (mgr.34373) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:11 gibba003 bash[31385]: cluster 2021-03-10T14:13:10.035604+0000 mgr.gibba043.dnkmem (mgr.34373) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:11 gibba003 bash[32348]: cluster 2021-03-10T14:13:10.035604+0000 mgr.gibba043.dnkmem (mgr.34373) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:11 gibba043 bash[24019]: cluster 2021-03-10T14:13:10.035604+0000 mgr.gibba043.dnkmem (mgr.34373) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: cluster 2021-03-10T14:13:12.036978+0000 mgr.gibba043.dnkmem (mgr.34373) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.753714+0000 mon.c (mon.1) 365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:13:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.754471+0000 mon.c (mon.1) 366 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.754870+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:13:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.755195+0000 mon.c (mon.1) 367 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.756010+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.756023+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:13:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.756941+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.757929+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:13:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.857027+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.858191+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.889840+0000 mon.c (mon.1) 370 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[31385]: audit 2021-03-10T14:13:12.890981+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: cluster 2021-03-10T14:13:12.036978+0000 mgr.gibba043.dnkmem (mgr.34373) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.753714+0000 mon.c (mon.1) 365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:13:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.754471+0000 mon.c (mon.1) 366 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.754870+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:13:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.755195+0000 mon.c (mon.1) 367 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.756010+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.756023+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:13:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.756941+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.757929+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:13:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.857027+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.858191+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.889840+0000 mon.c (mon.1) 370 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:13 gibba003 bash[32348]: audit 2021-03-10T14:13:12.890981+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: cluster 2021-03-10T14:13:12.036978+0000 mgr.gibba043.dnkmem (mgr.34373) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.753714+0000 mon.c (mon.1) 365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:13:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.754471+0000 mon.c (mon.1) 366 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.754870+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:13:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.755195+0000 mon.c (mon.1) 367 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.756010+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.756023+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:13:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.756941+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:13:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.757929+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:13:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.857027+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.858191+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.889840+0000 mon.c (mon.1) 370 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:13 gibba043 bash[24019]: audit 2021-03-10T14:13:12.890981+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:15 gibba003 bash[31385]: cluster 2021-03-10T14:13:14.044445+0000 mgr.gibba043.dnkmem (mgr.34373) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:15 gibba003 bash[32348]: cluster 2021-03-10T14:13:14.044445+0000 mgr.gibba043.dnkmem (mgr.34373) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:15 gibba043 bash[24019]: cluster 2021-03-10T14:13:14.044445+0000 mgr.gibba043.dnkmem (mgr.34373) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:17 gibba003 bash[31385]: cluster 2021-03-10T14:13:16.046189+0000 mgr.gibba043.dnkmem (mgr.34373) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:17 gibba003 bash[32348]: cluster 2021-03-10T14:13:16.046189+0000 mgr.gibba043.dnkmem (mgr.34373) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:17 gibba043 bash[24019]: cluster 2021-03-10T14:13:16.046189+0000 mgr.gibba043.dnkmem (mgr.34373) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:19 gibba003 bash[31385]: cluster 2021-03-10T14:13:18.047756+0000 mgr.gibba043.dnkmem (mgr.34373) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:19 gibba003 bash[32348]: cluster 2021-03-10T14:13:18.047756+0000 mgr.gibba043.dnkmem (mgr.34373) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:19 gibba043 bash[24019]: cluster 2021-03-10T14:13:18.047756+0000 mgr.gibba043.dnkmem (mgr.34373) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:21 gibba003 bash[31385]: cluster 2021-03-10T14:13:20.048459+0000 mgr.gibba043.dnkmem (mgr.34373) 1214 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:21 gibba003 bash[32348]: cluster 2021-03-10T14:13:20.048459+0000 mgr.gibba043.dnkmem (mgr.34373) 1214 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:21 gibba043 bash[24019]: cluster 2021-03-10T14:13:20.048459+0000 mgr.gibba043.dnkmem (mgr.34373) 1214 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:22.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:22 gibba003 bash[31385]: cephadm 2021-03-10T14:13:21.319171+0000 mgr.gibba043.dnkmem (mgr.34373) 1215 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:22.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:22 gibba003 bash[32348]: cephadm 2021-03-10T14:13:21.319171+0000 mgr.gibba043.dnkmem (mgr.34373) 1215 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:22.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:22 gibba043 bash[24019]: cephadm 2021-03-10T14:13:21.319171+0000 mgr.gibba043.dnkmem (mgr.34373) 1215 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:23 gibba003 bash[31385]: cluster 2021-03-10T14:13:22.049186+0000 mgr.gibba043.dnkmem (mgr.34373) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:23 gibba003 bash[32348]: cluster 2021-03-10T14:13:22.049186+0000 mgr.gibba043.dnkmem (mgr.34373) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:23 gibba043 bash[24019]: cluster 2021-03-10T14:13:22.049186+0000 mgr.gibba043.dnkmem (mgr.34373) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:25 gibba003 bash[31385]: cluster 2021-03-10T14:13:24.050330+0000 mgr.gibba043.dnkmem (mgr.34373) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:25 gibba003 bash[32348]: cluster 2021-03-10T14:13:24.050330+0000 mgr.gibba043.dnkmem (mgr.34373) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:25 gibba043 bash[24019]: cluster 2021-03-10T14:13:24.050330+0000 mgr.gibba043.dnkmem (mgr.34373) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:27 gibba003 bash[31385]: cluster 2021-03-10T14:13:26.051892+0000 mgr.gibba043.dnkmem (mgr.34373) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:27.836 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:27 gibba003 bash[32348]: cluster 2021-03-10T14:13:26.051892+0000 mgr.gibba043.dnkmem (mgr.34373) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:27.836 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:27 gibba043 bash[24019]: cluster 2021-03-10T14:13:26.051892+0000 mgr.gibba043.dnkmem (mgr.34373) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:29 gibba003 bash[31385]: cluster 2021-03-10T14:13:28.053414+0000 mgr.gibba043.dnkmem (mgr.34373) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:29 gibba003 bash[32348]: cluster 2021-03-10T14:13:28.053414+0000 mgr.gibba043.dnkmem (mgr.34373) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:29 gibba043 bash[24019]: cluster 2021-03-10T14:13:28.053414+0000 mgr.gibba043.dnkmem (mgr.34373) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:31 gibba003 bash[31385]: cluster 2021-03-10T14:13:30.054341+0000 mgr.gibba043.dnkmem (mgr.34373) 1220 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:31.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:31 gibba003 bash[32348]: cluster 2021-03-10T14:13:30.054341+0000 mgr.gibba043.dnkmem (mgr.34373) 1220 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:31 gibba043 bash[24019]: cluster 2021-03-10T14:13:30.054341+0000 mgr.gibba043.dnkmem (mgr.34373) 1220 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:33.236 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:13:33.459 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:13:33.459 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (21m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:13:33.459 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (27m) 6m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:13:33.459 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:13:33.460 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:13:33.460 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:13:33.460 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:13:33.460 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (21m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:13:33.460 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:13:33.461 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:13:33.461 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (27m) 6m ago 27m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:13:33.461 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:13:33.461 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:13:33.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:13:33.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:13:33.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:13:33.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:13:33.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:13:33.463 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:13:33.463 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (26m) 6m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:13:33.463 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:13:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:33 gibba003 bash[31385]: cluster 2021-03-10T14:13:32.055185+0000 mgr.gibba043.dnkmem (mgr.34373) 1221 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:33 gibba003 bash[32348]: cluster 2021-03-10T14:13:32.055185+0000 mgr.gibba043.dnkmem (mgr.34373) 1221 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:33.712 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:13:33.712 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:13:33.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:33.713 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:13:33.713 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:13:33.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:33.713 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:13:33.714 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:13:33.714 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:13:33.714 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:13:33.714 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:13:33.715 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:13:33.715 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:13:33.715 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:13:33.715 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:13:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:33 gibba043 bash[24019]: cluster 2021-03-10T14:13:32.055185+0000 mgr.gibba043.dnkmem (mgr.34373) 1221 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:34.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:34 gibba003 bash[31385]: audit 2021-03-10T14:13:33.227256+0000 mgr.gibba043.dnkmem (mgr.34373) 1222 : audit [DBG] from='client.44883 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:34.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:34 gibba003 bash[31385]: audit 2021-03-10T14:13:33.450157+0000 mgr.gibba043.dnkmem (mgr.34373) 1223 : audit [DBG] from='client.54874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:34 gibba003 bash[31385]: audit 2021-03-10T14:13:33.713308+0000 mon.a (mon.0) 624 : audit [DBG] from='client.? 172.21.2.103:0/3801836046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:34.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:34 gibba003 bash[32348]: audit 2021-03-10T14:13:33.227256+0000 mgr.gibba043.dnkmem (mgr.34373) 1222 : audit [DBG] from='client.44883 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:34.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:34 gibba003 bash[32348]: audit 2021-03-10T14:13:33.450157+0000 mgr.gibba043.dnkmem (mgr.34373) 1223 : audit [DBG] from='client.54874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:34.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:34 gibba003 bash[32348]: audit 2021-03-10T14:13:33.713308+0000 mon.a (mon.0) 624 : audit [DBG] from='client.? 172.21.2.103:0/3801836046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:34 gibba043 bash[24019]: audit 2021-03-10T14:13:33.227256+0000 mgr.gibba043.dnkmem (mgr.34373) 1222 : audit [DBG] from='client.44883 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:34 gibba043 bash[24019]: audit 2021-03-10T14:13:33.450157+0000 mgr.gibba043.dnkmem (mgr.34373) 1223 : audit [DBG] from='client.54874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:34 gibba043 bash[24019]: audit 2021-03-10T14:13:33.713308+0000 mon.a (mon.0) 624 : audit [DBG] from='client.? 172.21.2.103:0/3801836046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:35 gibba043 bash[24019]: cluster 2021-03-10T14:13:34.056765+0000 mgr.gibba043.dnkmem (mgr.34373) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:35 gibba003 bash[31385]: cluster 2021-03-10T14:13:34.056765+0000 mgr.gibba043.dnkmem (mgr.34373) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:35 gibba003 bash[32348]: cluster 2021-03-10T14:13:34.056765+0000 mgr.gibba043.dnkmem (mgr.34373) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: cluster 2021-03-10T14:13:36.058638+0000 mgr.gibba043.dnkmem (mgr.34373) 1225 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.332414+0000 mgr.gibba043.dnkmem (mgr.34373) 1226 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:13:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.333967+0000 mgr.gibba043.dnkmem (mgr.34373) 1227 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:13:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.546030+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:13:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.549732+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.551169+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.552802+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.553882+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.556436+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:37 gibba043 bash[24019]: audit 2021-03-10T14:13:36.557700+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: cluster 2021-03-10T14:13:36.058638+0000 mgr.gibba043.dnkmem (mgr.34373) 1225 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.332414+0000 mgr.gibba043.dnkmem (mgr.34373) 1226 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:13:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.333967+0000 mgr.gibba043.dnkmem (mgr.34373) 1227 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:13:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.546030+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:13:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.549732+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.551169+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.552802+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.553882+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.556436+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[31385]: audit 2021-03-10T14:13:36.557700+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: cluster 2021-03-10T14:13:36.058638+0000 mgr.gibba043.dnkmem (mgr.34373) 1225 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.332414+0000 mgr.gibba043.dnkmem (mgr.34373) 1226 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:13:37.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.333967+0000 mgr.gibba043.dnkmem (mgr.34373) 1227 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:13:37.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.546030+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:13:37.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.549732+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:37.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.551169+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.552802+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.553882+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.556436+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:37.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:37 gibba003 bash[32348]: audit 2021-03-10T14:13:36.557700+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.548364+0000 mgr.gibba043.dnkmem (mgr.34373) 1228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.550040+0000 mgr.gibba043.dnkmem (mgr.34373) 1229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.551578+0000 mgr.gibba043.dnkmem (mgr.34373) 1230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.551659+0000 mgr.gibba043.dnkmem (mgr.34373) 1231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.552952+0000 mgr.gibba043.dnkmem (mgr.34373) 1232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.552989+0000 mgr.gibba043.dnkmem (mgr.34373) 1233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.554108+0000 mgr.gibba043.dnkmem (mgr.34373) 1234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.555382+0000 mgr.gibba043.dnkmem (mgr.34373) 1235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.555418+0000 mgr.gibba043.dnkmem (mgr.34373) 1236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.556473+0000 mgr.gibba043.dnkmem (mgr.34373) 1237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.556801+0000 mgr.gibba043.dnkmem (mgr.34373) 1238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.557775+0000 mgr.gibba043.dnkmem (mgr.34373) 1239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:38.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.557821+0000 mgr.gibba043.dnkmem (mgr.34373) 1240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:38.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:38 gibba043 bash[24019]: cephadm 2021-03-10T14:13:36.557923+0000 mgr.gibba043.dnkmem (mgr.34373) 1241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.548364+0000 mgr.gibba043.dnkmem (mgr.34373) 1228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.550040+0000 mgr.gibba043.dnkmem (mgr.34373) 1229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.551578+0000 mgr.gibba043.dnkmem (mgr.34373) 1230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.551659+0000 mgr.gibba043.dnkmem (mgr.34373) 1231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.552952+0000 mgr.gibba043.dnkmem (mgr.34373) 1232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.552989+0000 mgr.gibba043.dnkmem (mgr.34373) 1233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.554108+0000 mgr.gibba043.dnkmem (mgr.34373) 1234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.555382+0000 mgr.gibba043.dnkmem (mgr.34373) 1235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.555418+0000 mgr.gibba043.dnkmem (mgr.34373) 1236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.556473+0000 mgr.gibba043.dnkmem (mgr.34373) 1237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.556801+0000 mgr.gibba043.dnkmem (mgr.34373) 1238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.557775+0000 mgr.gibba043.dnkmem (mgr.34373) 1239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.557821+0000 mgr.gibba043.dnkmem (mgr.34373) 1240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[31385]: cephadm 2021-03-10T14:13:36.557923+0000 mgr.gibba043.dnkmem (mgr.34373) 1241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.548364+0000 mgr.gibba043.dnkmem (mgr.34373) 1228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.550040+0000 mgr.gibba043.dnkmem (mgr.34373) 1229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.551578+0000 mgr.gibba043.dnkmem (mgr.34373) 1230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.551659+0000 mgr.gibba043.dnkmem (mgr.34373) 1231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.552952+0000 mgr.gibba043.dnkmem (mgr.34373) 1232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.552989+0000 mgr.gibba043.dnkmem (mgr.34373) 1233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.554108+0000 mgr.gibba043.dnkmem (mgr.34373) 1234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.555382+0000 mgr.gibba043.dnkmem (mgr.34373) 1235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.555418+0000 mgr.gibba043.dnkmem (mgr.34373) 1236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.556473+0000 mgr.gibba043.dnkmem (mgr.34373) 1237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.556801+0000 mgr.gibba043.dnkmem (mgr.34373) 1238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.557775+0000 mgr.gibba043.dnkmem (mgr.34373) 1239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.557821+0000 mgr.gibba043.dnkmem (mgr.34373) 1240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:38 gibba003 bash[32348]: cephadm 2021-03-10T14:13:36.557923+0000 mgr.gibba043.dnkmem (mgr.34373) 1241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:39 gibba043 bash[24019]: cluster 2021-03-10T14:13:38.060056+0000 mgr.gibba043.dnkmem (mgr.34373) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:39 gibba003 bash[31385]: cluster 2021-03-10T14:13:38.060056+0000 mgr.gibba043.dnkmem (mgr.34373) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:39.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:39 gibba003 bash[32348]: cluster 2021-03-10T14:13:38.060056+0000 mgr.gibba043.dnkmem (mgr.34373) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:41 gibba043 bash[24019]: cluster 2021-03-10T14:13:40.061464+0000 mgr.gibba043.dnkmem (mgr.34373) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:41 gibba003 bash[31385]: cluster 2021-03-10T14:13:40.061464+0000 mgr.gibba043.dnkmem (mgr.34373) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:41 gibba003 bash[32348]: cluster 2021-03-10T14:13:40.061464+0000 mgr.gibba043.dnkmem (mgr.34373) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:43 gibba043 bash[24019]: cluster 2021-03-10T14:13:42.062429+0000 mgr.gibba043.dnkmem (mgr.34373) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:43 gibba003 bash[31385]: cluster 2021-03-10T14:13:42.062429+0000 mgr.gibba043.dnkmem (mgr.34373) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:43 gibba003 bash[32348]: cluster 2021-03-10T14:13:42.062429+0000 mgr.gibba043.dnkmem (mgr.34373) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:45 gibba043 bash[24019]: cluster 2021-03-10T14:13:44.063819+0000 mgr.gibba043.dnkmem (mgr.34373) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:45 gibba003 bash[31385]: cluster 2021-03-10T14:13:44.063819+0000 mgr.gibba043.dnkmem (mgr.34373) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:45.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:45 gibba003 bash[32348]: cluster 2021-03-10T14:13:44.063819+0000 mgr.gibba043.dnkmem (mgr.34373) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:47 gibba043 bash[24019]: cluster 2021-03-10T14:13:46.065754+0000 mgr.gibba043.dnkmem (mgr.34373) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:47 gibba003 bash[31385]: cluster 2021-03-10T14:13:46.065754+0000 mgr.gibba043.dnkmem (mgr.34373) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:47 gibba003 bash[32348]: cluster 2021-03-10T14:13:46.065754+0000 mgr.gibba043.dnkmem (mgr.34373) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:49 gibba043 bash[24019]: cluster 2021-03-10T14:13:48.067125+0000 mgr.gibba043.dnkmem (mgr.34373) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:49 gibba003 bash[31385]: cluster 2021-03-10T14:13:48.067125+0000 mgr.gibba043.dnkmem (mgr.34373) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:49 gibba003 bash[32348]: cluster 2021-03-10T14:13:48.067125+0000 mgr.gibba043.dnkmem (mgr.34373) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:51 gibba043 bash[24019]: cluster 2021-03-10T14:13:50.067953+0000 mgr.gibba043.dnkmem (mgr.34373) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:51 gibba003 bash[31385]: cluster 2021-03-10T14:13:50.067953+0000 mgr.gibba043.dnkmem (mgr.34373) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:51 gibba003 bash[32348]: cluster 2021-03-10T14:13:50.067953+0000 mgr.gibba043.dnkmem (mgr.34373) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:53 gibba043 bash[24019]: cephadm 2021-03-10T14:13:51.573819+0000 mgr.gibba043.dnkmem (mgr.34373) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:53.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:53 gibba043 bash[24019]: cluster 2021-03-10T14:13:52.068587+0000 mgr.gibba043.dnkmem (mgr.34373) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:53 gibba003 bash[31385]: cephadm 2021-03-10T14:13:51.573819+0000 mgr.gibba043.dnkmem (mgr.34373) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:53 gibba003 bash[31385]: cluster 2021-03-10T14:13:52.068587+0000 mgr.gibba043.dnkmem (mgr.34373) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:53 gibba003 bash[32348]: cephadm 2021-03-10T14:13:51.573819+0000 mgr.gibba043.dnkmem (mgr.34373) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:13:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:53 gibba003 bash[32348]: cluster 2021-03-10T14:13:52.068587+0000 mgr.gibba043.dnkmem (mgr.34373) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:55 gibba043 bash[24019]: cluster 2021-03-10T14:13:54.070135+0000 mgr.gibba043.dnkmem (mgr.34373) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:55 gibba003 bash[31385]: cluster 2021-03-10T14:13:54.070135+0000 mgr.gibba043.dnkmem (mgr.34373) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:55 gibba003 bash[32348]: cluster 2021-03-10T14:13:54.070135+0000 mgr.gibba043.dnkmem (mgr.34373) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:57 gibba043 bash[24019]: cluster 2021-03-10T14:13:56.071821+0000 mgr.gibba043.dnkmem (mgr.34373) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:57 gibba003 bash[31385]: cluster 2021-03-10T14:13:56.071821+0000 mgr.gibba043.dnkmem (mgr.34373) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:57 gibba003 bash[32348]: cluster 2021-03-10T14:13:56.071821+0000 mgr.gibba043.dnkmem (mgr.34373) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:13:59 gibba043 bash[24019]: cluster 2021-03-10T14:13:58.073308+0000 mgr.gibba043.dnkmem (mgr.34373) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:13:59 gibba003 bash[31385]: cluster 2021-03-10T14:13:58.073308+0000 mgr.gibba043.dnkmem (mgr.34373) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:59.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:13:59 gibba003 bash[32348]: cluster 2021-03-10T14:13:58.073308+0000 mgr.gibba043.dnkmem (mgr.34373) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:01 gibba003 bash[31385]: cluster 2021-03-10T14:14:00.074581+0000 mgr.gibba043.dnkmem (mgr.34373) 1254 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:01 gibba003 bash[32348]: cluster 2021-03-10T14:14:00.074581+0000 mgr.gibba043.dnkmem (mgr.34373) 1254 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:01 gibba043 bash[24019]: cluster 2021-03-10T14:14:00.074581+0000 mgr.gibba043.dnkmem (mgr.34373) 1254 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:03 gibba003 bash[31385]: cluster 2021-03-10T14:14:02.075443+0000 mgr.gibba043.dnkmem (mgr.34373) 1255 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:03 gibba003 bash[32348]: cluster 2021-03-10T14:14:02.075443+0000 mgr.gibba043.dnkmem (mgr.34373) 1255 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:03 gibba043 bash[24019]: cluster 2021-03-10T14:14:02.075443+0000 mgr.gibba043.dnkmem (mgr.34373) 1255 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.957 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:14:04.187 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:14:04.187 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (22m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:14:04.187 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (27m) 7m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:14:04.188 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (22m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:14:04.188 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:14:04.188 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:14:04.188 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (21m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:14:04.189 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:14:04.189 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:14:04.189 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:14:04.189 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:14:04.189 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:14:04.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:14:04.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:14:04.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:14:04.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:14:04.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:14:04.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:14:04.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:14:04.191 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (27m) 7m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:14:04.191 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:14:04.436 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:14:04.436 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:14:04.437 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:04.437 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:14:04.437 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:14:04.437 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:04.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:14:04.438 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:14:04.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:14:04.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:14:04.439 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:14:04.439 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:14:04.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:14:04.439 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:14:04.439 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:14:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[31385]: audit 2021-03-10T14:14:03.948630+0000 mgr.gibba043.dnkmem (mgr.34373) 1256 : audit [DBG] from='client.44901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[31385]: cluster 2021-03-10T14:14:04.076844+0000 mgr.gibba043.dnkmem (mgr.34373) 1257 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[31385]: audit 2021-03-10T14:14:04.177162+0000 mgr.gibba043.dnkmem (mgr.34373) 1258 : audit [DBG] from='client.44907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[31385]: audit 2021-03-10T14:14:04.437080+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.2.103:0/2072117794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[32348]: audit 2021-03-10T14:14:03.948630+0000 mgr.gibba043.dnkmem (mgr.34373) 1256 : audit [DBG] from='client.44901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:05.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[32348]: cluster 2021-03-10T14:14:04.076844+0000 mgr.gibba043.dnkmem (mgr.34373) 1257 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:05.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[32348]: audit 2021-03-10T14:14:04.177162+0000 mgr.gibba043.dnkmem (mgr.34373) 1258 : audit [DBG] from='client.44907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:05.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:05 gibba003 bash[32348]: audit 2021-03-10T14:14:04.437080+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.2.103:0/2072117794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:05 gibba043 bash[24019]: audit 2021-03-10T14:14:03.948630+0000 mgr.gibba043.dnkmem (mgr.34373) 1256 : audit [DBG] from='client.44901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:05 gibba043 bash[24019]: cluster 2021-03-10T14:14:04.076844+0000 mgr.gibba043.dnkmem (mgr.34373) 1257 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:05 gibba043 bash[24019]: audit 2021-03-10T14:14:04.177162+0000 mgr.gibba043.dnkmem (mgr.34373) 1258 : audit [DBG] from='client.44907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:05 gibba043 bash[24019]: audit 2021-03-10T14:14:04.437080+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.2.103:0/2072117794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:07 gibba003 bash[31385]: cluster 2021-03-10T14:14:06.078571+0000 mgr.gibba043.dnkmem (mgr.34373) 1259 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:07 gibba003 bash[32348]: cluster 2021-03-10T14:14:06.078571+0000 mgr.gibba043.dnkmem (mgr.34373) 1259 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:07 gibba043 bash[24019]: cluster 2021-03-10T14:14:06.078571+0000 mgr.gibba043.dnkmem (mgr.34373) 1259 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:08.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:08 gibba003 bash[31385]: cephadm 2021-03-10T14:14:06.589849+0000 mgr.gibba043.dnkmem (mgr.34373) 1260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:08.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:08 gibba003 bash[32348]: cephadm 2021-03-10T14:14:06.589849+0000 mgr.gibba043.dnkmem (mgr.34373) 1260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:08.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:08 gibba043 bash[24019]: cephadm 2021-03-10T14:14:06.589849+0000 mgr.gibba043.dnkmem (mgr.34373) 1260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:09 gibba003 bash[31385]: cluster 2021-03-10T14:14:08.080083+0000 mgr.gibba043.dnkmem (mgr.34373) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:09 gibba003 bash[32348]: cluster 2021-03-10T14:14:08.080083+0000 mgr.gibba043.dnkmem (mgr.34373) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:09 gibba043 bash[24019]: cluster 2021-03-10T14:14:08.080083+0000 mgr.gibba043.dnkmem (mgr.34373) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:11 gibba003 bash[31385]: cluster 2021-03-10T14:14:10.081392+0000 mgr.gibba043.dnkmem (mgr.34373) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:11 gibba003 bash[32348]: cluster 2021-03-10T14:14:10.081392+0000 mgr.gibba043.dnkmem (mgr.34373) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:11 gibba043 bash[24019]: cluster 2021-03-10T14:14:10.081392+0000 mgr.gibba043.dnkmem (mgr.34373) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: cluster 2021-03-10T14:14:12.082960+0000 mgr.gibba043.dnkmem (mgr.34373) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.761935+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:14:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.763145+0000 mon.c (mon.1) 378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.763401+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:14:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.764212+0000 mon.c (mon.1) 379 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.764443+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.765491+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.765841+0000 mon.c (mon.1) 380 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.766880+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.863866+0000 mon.c (mon.1) 381 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.865150+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.898137+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[31385]: audit 2021-03-10T14:14:12.899436+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: cluster 2021-03-10T14:14:12.082960+0000 mgr.gibba043.dnkmem (mgr.34373) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.761935+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:14:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.763145+0000 mon.c (mon.1) 378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.763401+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:14:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.764212+0000 mon.c (mon.1) 379 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.764443+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.765491+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.765841+0000 mon.c (mon.1) 380 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.766880+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.863866+0000 mon.c (mon.1) 381 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.865150+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.898137+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:13 gibba003 bash[32348]: audit 2021-03-10T14:14:12.899436+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: cluster 2021-03-10T14:14:12.082960+0000 mgr.gibba043.dnkmem (mgr.34373) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.761935+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:14:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.763145+0000 mon.c (mon.1) 378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.763401+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:14:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.764212+0000 mon.c (mon.1) 379 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.764443+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.765491+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:14:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.765841+0000 mon.c (mon.1) 380 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.766880+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.863866+0000 mon.c (mon.1) 381 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.865150+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.898137+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:13 gibba043 bash[24019]: audit 2021-03-10T14:14:12.899436+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:15 gibba003 bash[31385]: cluster 2021-03-10T14:14:14.084504+0000 mgr.gibba043.dnkmem (mgr.34373) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:15 gibba003 bash[32348]: cluster 2021-03-10T14:14:14.084504+0000 mgr.gibba043.dnkmem (mgr.34373) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:15 gibba043 bash[24019]: cluster 2021-03-10T14:14:14.084504+0000 mgr.gibba043.dnkmem (mgr.34373) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:17 gibba003 bash[31385]: cluster 2021-03-10T14:14:16.086324+0000 mgr.gibba043.dnkmem (mgr.34373) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:17 gibba003 bash[32348]: cluster 2021-03-10T14:14:16.086324+0000 mgr.gibba043.dnkmem (mgr.34373) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:17 gibba043 bash[24019]: cluster 2021-03-10T14:14:16.086324+0000 mgr.gibba043.dnkmem (mgr.34373) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:19 gibba003 bash[31385]: cluster 2021-03-10T14:14:18.087712+0000 mgr.gibba043.dnkmem (mgr.34373) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:19 gibba003 bash[32348]: cluster 2021-03-10T14:14:18.087712+0000 mgr.gibba043.dnkmem (mgr.34373) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:19 gibba043 bash[24019]: cluster 2021-03-10T14:14:18.087712+0000 mgr.gibba043.dnkmem (mgr.34373) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:21 gibba003 bash[31385]: cluster 2021-03-10T14:14:20.089079+0000 mgr.gibba043.dnkmem (mgr.34373) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:21 gibba003 bash[32348]: cluster 2021-03-10T14:14:20.089079+0000 mgr.gibba043.dnkmem (mgr.34373) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:21 gibba043 bash[24019]: cluster 2021-03-10T14:14:20.089079+0000 mgr.gibba043.dnkmem (mgr.34373) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:23 gibba003 bash[31385]: cephadm 2021-03-10T14:14:21.605882+0000 mgr.gibba043.dnkmem (mgr.34373) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:23 gibba003 bash[31385]: cluster 2021-03-10T14:14:22.090030+0000 mgr.gibba043.dnkmem (mgr.34373) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:23 gibba003 bash[32348]: cephadm 2021-03-10T14:14:21.605882+0000 mgr.gibba043.dnkmem (mgr.34373) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:23 gibba003 bash[32348]: cluster 2021-03-10T14:14:22.090030+0000 mgr.gibba043.dnkmem (mgr.34373) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:23 gibba043 bash[24019]: cephadm 2021-03-10T14:14:21.605882+0000 mgr.gibba043.dnkmem (mgr.34373) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:23 gibba043 bash[24019]: cluster 2021-03-10T14:14:22.090030+0000 mgr.gibba043.dnkmem (mgr.34373) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:25 gibba003 bash[31385]: cluster 2021-03-10T14:14:24.091566+0000 mgr.gibba043.dnkmem (mgr.34373) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:25 gibba003 bash[32348]: cluster 2021-03-10T14:14:24.091566+0000 mgr.gibba043.dnkmem (mgr.34373) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:25.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:25 gibba043 bash[24019]: cluster 2021-03-10T14:14:24.091566+0000 mgr.gibba043.dnkmem (mgr.34373) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:27 gibba003 bash[31385]: cluster 2021-03-10T14:14:26.093547+0000 mgr.gibba043.dnkmem (mgr.34373) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:27 gibba003 bash[32348]: cluster 2021-03-10T14:14:26.093547+0000 mgr.gibba043.dnkmem (mgr.34373) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:27 gibba043 bash[24019]: cluster 2021-03-10T14:14:26.093547+0000 mgr.gibba043.dnkmem (mgr.34373) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:29 gibba003 bash[31385]: cluster 2021-03-10T14:14:28.094987+0000 mgr.gibba043.dnkmem (mgr.34373) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:29 gibba003 bash[32348]: cluster 2021-03-10T14:14:28.094987+0000 mgr.gibba043.dnkmem (mgr.34373) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:29 gibba043 bash[24019]: cluster 2021-03-10T14:14:28.094987+0000 mgr.gibba043.dnkmem (mgr.34373) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:31 gibba003 bash[31385]: cluster 2021-03-10T14:14:30.096543+0000 mgr.gibba043.dnkmem (mgr.34373) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:31.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:31 gibba003 bash[32348]: cluster 2021-03-10T14:14:30.096543+0000 mgr.gibba043.dnkmem (mgr.34373) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:31 gibba043 bash[24019]: cluster 2021-03-10T14:14:30.096543+0000 mgr.gibba043.dnkmem (mgr.34373) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:33 gibba003 bash[31385]: cluster 2021-03-10T14:14:32.097122+0000 mgr.gibba043.dnkmem (mgr.34373) 1274 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:33 gibba003 bash[32348]: cluster 2021-03-10T14:14:32.097122+0000 mgr.gibba043.dnkmem (mgr.34373) 1274 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:33 gibba043 bash[24019]: cluster 2021-03-10T14:14:32.097122+0000 mgr.gibba043.dnkmem (mgr.34373) 1274 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:34.673 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:14:34.902 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:14:34.902 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (22m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:14:34.902 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:14:34.903 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (23m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:14:34.903 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (23m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:14:34.903 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:14:34.903 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:14:34.904 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:14:34.904 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:14:34.904 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:14:34.904 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:14:34.904 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:14:34.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:14:34.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:14:34.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:14:34.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:14:34.905 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:14:34.906 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:14:34.906 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (18m) 8m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:14:34.906 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (27m) 8m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:14:34.906 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:14:35.160 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:14:35.160 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:14:35.160 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:35.160 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:14:35.161 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:14:35.161 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:35.161 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:14:35.161 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:14:35.161 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:14:35.162 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:14:35.162 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:14:35.162 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:14:35.162 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:14:35.163 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:14:35.163 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:14:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:35 gibba003 bash[31385]: cluster 2021-03-10T14:14:34.098683+0000 mgr.gibba043.dnkmem (mgr.34373) 1275 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:35 gibba003 bash[31385]: audit 2021-03-10T14:14:35.160513+0000 mon.c (mon.1) 383 : audit [DBG] from='client.? 172.21.2.103:0/2608017121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:35 gibba003 bash[32348]: cluster 2021-03-10T14:14:34.098683+0000 mgr.gibba043.dnkmem (mgr.34373) 1275 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:35 gibba003 bash[32348]: audit 2021-03-10T14:14:35.160513+0000 mon.c (mon.1) 383 : audit [DBG] from='client.? 172.21.2.103:0/2608017121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:35 gibba043 bash[24019]: cluster 2021-03-10T14:14:34.098683+0000 mgr.gibba043.dnkmem (mgr.34373) 1275 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:35 gibba043 bash[24019]: audit 2021-03-10T14:14:35.160513+0000 mon.c (mon.1) 383 : audit [DBG] from='client.? 172.21.2.103:0/2608017121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:36 gibba043 bash[24019]: audit 2021-03-10T14:14:34.664751+0000 mgr.gibba043.dnkmem (mgr.34373) 1276 : audit [DBG] from='client.44919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:36 gibba043 bash[24019]: audit 2021-03-10T14:14:34.889795+0000 mgr.gibba043.dnkmem (mgr.34373) 1277 : audit [DBG] from='client.54910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:36.801 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:36 gibba003 bash[31385]: audit 2021-03-10T14:14:34.664751+0000 mgr.gibba043.dnkmem (mgr.34373) 1276 : audit [DBG] from='client.44919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:36.802 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:36 gibba003 bash[31385]: audit 2021-03-10T14:14:34.889795+0000 mgr.gibba043.dnkmem (mgr.34373) 1277 : audit [DBG] from='client.54910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:36.802 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:36 gibba003 bash[32348]: audit 2021-03-10T14:14:34.664751+0000 mgr.gibba043.dnkmem (mgr.34373) 1276 : audit [DBG] from='client.44919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:36.802 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:36 gibba003 bash[32348]: audit 2021-03-10T14:14:34.889795+0000 mgr.gibba043.dnkmem (mgr.34373) 1277 : audit [DBG] from='client.54910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:37 gibba043 bash[24019]: cluster 2021-03-10T14:14:36.100653+0000 mgr.gibba043.dnkmem (mgr.34373) 1278 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:37 gibba043 bash[24019]: audit 2021-03-10T14:14:36.617873+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:14:37.816 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:37 gibba003 bash[31385]: cluster 2021-03-10T14:14:36.100653+0000 mgr.gibba043.dnkmem (mgr.34373) 1278 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:37.816 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:37 gibba003 bash[31385]: audit 2021-03-10T14:14:36.617873+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:14:37.817 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:37 gibba003 bash[32348]: cluster 2021-03-10T14:14:36.100653+0000 mgr.gibba043.dnkmem (mgr.34373) 1278 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:37.817 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:37 gibba003 bash[32348]: audit 2021-03-10T14:14:36.617873+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:14:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:38 gibba043 bash[24019]: cephadm 2021-03-10T14:14:36.616583+0000 mgr.gibba043.dnkmem (mgr.34373) 1279 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:14:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:38 gibba003 bash[31385]: cephadm 2021-03-10T14:14:36.616583+0000 mgr.gibba043.dnkmem (mgr.34373) 1279 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:14:38.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:38 gibba003 bash[32348]: cephadm 2021-03-10T14:14:36.616583+0000 mgr.gibba043.dnkmem (mgr.34373) 1279 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:14:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:39 gibba043 bash[24019]: cluster 2021-03-10T14:14:38.102164+0000 mgr.gibba043.dnkmem (mgr.34373) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:39 gibba003 bash[31385]: cluster 2021-03-10T14:14:38.102164+0000 mgr.gibba043.dnkmem (mgr.34373) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:39.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:39 gibba003 bash[32348]: cluster 2021-03-10T14:14:38.102164+0000 mgr.gibba043.dnkmem (mgr.34373) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:41 gibba043 bash[24019]: cluster 2021-03-10T14:14:40.103478+0000 mgr.gibba043.dnkmem (mgr.34373) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:41 gibba043 bash[24019]: audit 2021-03-10T14:14:41.402889+0000 mon.c (mon.1) 385 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:41 gibba003 bash[31385]: cluster 2021-03-10T14:14:40.103478+0000 mgr.gibba043.dnkmem (mgr.34373) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:41 gibba003 bash[31385]: audit 2021-03-10T14:14:41.402889+0000 mon.c (mon.1) 385 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:41 gibba003 bash[32348]: cluster 2021-03-10T14:14:40.103478+0000 mgr.gibba043.dnkmem (mgr.34373) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:41 gibba003 bash[32348]: audit 2021-03-10T14:14:41.402889+0000 mon.c (mon.1) 385 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:42.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.585869+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:14:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.587059+0000 mgr.gibba043.dnkmem (mgr.34373) 1282 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:14:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.778795+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:14:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.785298+0000 mgr.gibba043.dnkmem (mgr.34373) 1283 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.787211+0000 mon.c (mon.1) 386 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.788580+0000 mgr.gibba043.dnkmem (mgr.34373) 1284 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.789947+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.791227+0000 mgr.gibba043.dnkmem (mgr.34373) 1285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.791265+0000 mgr.gibba043.dnkmem (mgr.34373) 1286 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.792830+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.794047+0000 mgr.gibba043.dnkmem (mgr.34373) 1287 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:42.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.794087+0000 mgr.gibba043.dnkmem (mgr.34373) 1288 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:42.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.795420+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.796669+0000 mgr.gibba043.dnkmem (mgr.34373) 1289 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:42.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.800669+0000 mgr.gibba043.dnkmem (mgr.34373) 1290 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:42.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.800715+0000 mgr.gibba043.dnkmem (mgr.34373) 1291 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:42.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.802205+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.803309+0000 mgr.gibba043.dnkmem (mgr.34373) 1292 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:42.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.803810+0000 mgr.gibba043.dnkmem (mgr.34373) 1293 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:42.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: audit 2021-03-10T14:14:41.805356+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.806508+0000 mgr.gibba043.dnkmem (mgr.34373) 1294 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:42.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.585869+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:14:42.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.587059+0000 mgr.gibba043.dnkmem (mgr.34373) 1282 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:14:42.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.778795+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:14:42.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.785298+0000 mgr.gibba043.dnkmem (mgr.34373) 1283 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:42.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.787211+0000 mon.c (mon.1) 386 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:42.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.788580+0000 mgr.gibba043.dnkmem (mgr.34373) 1284 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:42.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.789947+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.791227+0000 mgr.gibba043.dnkmem (mgr.34373) 1285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:42.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.791265+0000 mgr.gibba043.dnkmem (mgr.34373) 1286 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:42.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.792830+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.794047+0000 mgr.gibba043.dnkmem (mgr.34373) 1287 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:42.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.794087+0000 mgr.gibba043.dnkmem (mgr.34373) 1288 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:42.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.795420+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.796669+0000 mgr.gibba043.dnkmem (mgr.34373) 1289 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:42.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.800669+0000 mgr.gibba043.dnkmem (mgr.34373) 1290 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:42.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.800715+0000 mgr.gibba043.dnkmem (mgr.34373) 1291 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:42.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.802205+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.803309+0000 mgr.gibba043.dnkmem (mgr.34373) 1292 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:42.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.803810+0000 mgr.gibba043.dnkmem (mgr.34373) 1293 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:42.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: audit 2021-03-10T14:14:41.805356+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:42.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.806508+0000 mgr.gibba043.dnkmem (mgr.34373) 1294 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:42.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.806557+0000 mgr.gibba043.dnkmem (mgr.34373) 1295 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:42.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cephadm 2021-03-10T14:14:41.806695+0000 mgr.gibba043.dnkmem (mgr.34373) 1296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:42.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[31385]: cluster 2021-03-10T14:14:42.104409+0000 mgr.gibba043.dnkmem (mgr.34373) 1297 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:42.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.806557+0000 mgr.gibba043.dnkmem (mgr.34373) 1295 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:42.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cephadm 2021-03-10T14:14:41.806695+0000 mgr.gibba043.dnkmem (mgr.34373) 1296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:42.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:42 gibba003 bash[32348]: cluster 2021-03-10T14:14:42.104409+0000 mgr.gibba043.dnkmem (mgr.34373) 1297 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.585869+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:14:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.587059+0000 mgr.gibba043.dnkmem (mgr.34373) 1282 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:14:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.778795+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:14:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.785298+0000 mgr.gibba043.dnkmem (mgr.34373) 1283 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.787211+0000 mon.c (mon.1) 386 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.788580+0000 mgr.gibba043.dnkmem (mgr.34373) 1284 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.789947+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.791227+0000 mgr.gibba043.dnkmem (mgr.34373) 1285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.791265+0000 mgr.gibba043.dnkmem (mgr.34373) 1286 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.792830+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.794047+0000 mgr.gibba043.dnkmem (mgr.34373) 1287 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.794087+0000 mgr.gibba043.dnkmem (mgr.34373) 1288 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.795420+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.796669+0000 mgr.gibba043.dnkmem (mgr.34373) 1289 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:43.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.800669+0000 mgr.gibba043.dnkmem (mgr.34373) 1290 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:43.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.800715+0000 mgr.gibba043.dnkmem (mgr.34373) 1291 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:43.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.802205+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:43.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.803309+0000 mgr.gibba043.dnkmem (mgr.34373) 1292 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:43.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.803810+0000 mgr.gibba043.dnkmem (mgr.34373) 1293 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:43.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: audit 2021-03-10T14:14:41.805356+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:43.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.806508+0000 mgr.gibba043.dnkmem (mgr.34373) 1294 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:43.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.806557+0000 mgr.gibba043.dnkmem (mgr.34373) 1295 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:43.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cephadm 2021-03-10T14:14:41.806695+0000 mgr.gibba043.dnkmem (mgr.34373) 1296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:43.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:42 gibba043 bash[24019]: cluster 2021-03-10T14:14:42.104409+0000 mgr.gibba043.dnkmem (mgr.34373) 1297 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:45 gibba003 bash[31385]: cluster 2021-03-10T14:14:44.105854+0000 mgr.gibba043.dnkmem (mgr.34373) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:45 gibba003 bash[32348]: cluster 2021-03-10T14:14:44.105854+0000 mgr.gibba043.dnkmem (mgr.34373) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:45 gibba043 bash[24019]: cluster 2021-03-10T14:14:44.105854+0000 mgr.gibba043.dnkmem (mgr.34373) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:47 gibba003 bash[31385]: cluster 2021-03-10T14:14:46.107587+0000 mgr.gibba043.dnkmem (mgr.34373) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:47 gibba003 bash[32348]: cluster 2021-03-10T14:14:46.107587+0000 mgr.gibba043.dnkmem (mgr.34373) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:47 gibba043 bash[24019]: cluster 2021-03-10T14:14:46.107587+0000 mgr.gibba043.dnkmem (mgr.34373) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:49 gibba043 bash[24019]: cluster 2021-03-10T14:14:48.109090+0000 mgr.gibba043.dnkmem (mgr.34373) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:49 gibba003 bash[31385]: cluster 2021-03-10T14:14:48.109090+0000 mgr.gibba043.dnkmem (mgr.34373) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:49 gibba003 bash[32348]: cluster 2021-03-10T14:14:48.109090+0000 mgr.gibba043.dnkmem (mgr.34373) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:51 gibba043 bash[24019]: cluster 2021-03-10T14:14:50.109871+0000 mgr.gibba043.dnkmem (mgr.34373) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:51 gibba003 bash[31385]: cluster 2021-03-10T14:14:50.109871+0000 mgr.gibba043.dnkmem (mgr.34373) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:51 gibba003 bash[32348]: cluster 2021-03-10T14:14:50.109871+0000 mgr.gibba043.dnkmem (mgr.34373) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:53 gibba043 bash[24019]: cluster 2021-03-10T14:14:52.111425+0000 mgr.gibba043.dnkmem (mgr.34373) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:53 gibba003 bash[31385]: cluster 2021-03-10T14:14:52.111425+0000 mgr.gibba043.dnkmem (mgr.34373) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:53 gibba003 bash[32348]: cluster 2021-03-10T14:14:52.111425+0000 mgr.gibba043.dnkmem (mgr.34373) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:55.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:55 gibba043 bash[24019]: cluster 2021-03-10T14:14:54.113053+0000 mgr.gibba043.dnkmem (mgr.34373) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:55 gibba003 bash[31385]: cluster 2021-03-10T14:14:54.113053+0000 mgr.gibba043.dnkmem (mgr.34373) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:55 gibba003 bash[32348]: cluster 2021-03-10T14:14:54.113053+0000 mgr.gibba043.dnkmem (mgr.34373) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:57 gibba003 bash[31385]: cluster 2021-03-10T14:14:56.114948+0000 mgr.gibba043.dnkmem (mgr.34373) 1304 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:57 gibba003 bash[32348]: cluster 2021-03-10T14:14:56.114948+0000 mgr.gibba043.dnkmem (mgr.34373) 1304 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:57 gibba043 bash[24019]: cluster 2021-03-10T14:14:56.114948+0000 mgr.gibba043.dnkmem (mgr.34373) 1304 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:58.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:58 gibba003 bash[31385]: cephadm 2021-03-10T14:14:56.822772+0000 mgr.gibba043.dnkmem (mgr.34373) 1305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:58.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:58 gibba003 bash[32348]: cephadm 2021-03-10T14:14:56.822772+0000 mgr.gibba043.dnkmem (mgr.34373) 1305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:58 gibba043 bash[24019]: cephadm 2021-03-10T14:14:56.822772+0000 mgr.gibba043.dnkmem (mgr.34373) 1305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:14:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:14:59 gibba003 bash[31385]: cluster 2021-03-10T14:14:58.116395+0000 mgr.gibba043.dnkmem (mgr.34373) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:14:59 gibba003 bash[32348]: cluster 2021-03-10T14:14:58.116395+0000 mgr.gibba043.dnkmem (mgr.34373) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:14:59 gibba043 bash[24019]: cluster 2021-03-10T14:14:58.116395+0000 mgr.gibba043.dnkmem (mgr.34373) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:01 gibba003 bash[31385]: cluster 2021-03-10T14:15:00.118090+0000 mgr.gibba043.dnkmem (mgr.34373) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:01 gibba003 bash[32348]: cluster 2021-03-10T14:15:00.118090+0000 mgr.gibba043.dnkmem (mgr.34373) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:01 gibba043 bash[24019]: cluster 2021-03-10T14:15:00.118090+0000 mgr.gibba043.dnkmem (mgr.34373) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:03 gibba003 bash[31385]: cluster 2021-03-10T14:15:02.119157+0000 mgr.gibba043.dnkmem (mgr.34373) 1308 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:03 gibba003 bash[32348]: cluster 2021-03-10T14:15:02.119157+0000 mgr.gibba043.dnkmem (mgr.34373) 1308 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:03 gibba043 bash[24019]: cluster 2021-03-10T14:15:02.119157+0000 mgr.gibba043.dnkmem (mgr.34373) 1308 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:05.402 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:15:05.638 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:15:05.638 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (23m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:15:05.639 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:15:05.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (23m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:15:05.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:15:05.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:15:05.639 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (23m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:15:05.640 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:15:05.640 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:15:05.640 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:15:05.640 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:15:05.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (21m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:15:05.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:15:05.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:15:05.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:15:05.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:15:05.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:15:05.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:15:05.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:15:05.642 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (28m) 8m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:15:05.643 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:15:05.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:05 gibba003 bash[32348]: cluster 2021-03-10T14:15:04.120677+0000 mgr.gibba043.dnkmem (mgr.34373) 1309 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:05 gibba003 bash[31385]: cluster 2021-03-10T14:15:04.120677+0000 mgr.gibba043.dnkmem (mgr.34373) 1309 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:05 gibba043 bash[24019]: cluster 2021-03-10T14:15:04.120677+0000 mgr.gibba043.dnkmem (mgr.34373) 1309 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:05.887 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:15:05.888 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:15:05.888 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:05.888 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:15:05.888 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:15:05.888 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:05.889 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:15:05.889 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:15:05.889 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:15:05.889 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:15:05.890 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:15:05.890 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:15:05.890 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:15:05.890 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:15:05.891 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:15:06.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:06 gibba003 bash[31385]: audit 2021-03-10T14:15:05.393139+0000 mgr.gibba043.dnkmem (mgr.34373) 1310 : audit [DBG] from='client.44937 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:06.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:06 gibba003 bash[31385]: audit 2021-03-10T14:15:05.888039+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.103:0/2134822467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:06.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:06 gibba003 bash[32348]: audit 2021-03-10T14:15:05.393139+0000 mgr.gibba043.dnkmem (mgr.34373) 1310 : audit [DBG] from='client.44937 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:06.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:06 gibba003 bash[32348]: audit 2021-03-10T14:15:05.888039+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.103:0/2134822467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:06.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:06 gibba043 bash[24019]: audit 2021-03-10T14:15:05.393139+0000 mgr.gibba043.dnkmem (mgr.34373) 1310 : audit [DBG] from='client.44937 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:06 gibba043 bash[24019]: audit 2021-03-10T14:15:05.888039+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.103:0/2134822467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:07 gibba003 bash[31385]: audit 2021-03-10T14:15:05.625871+0000 mgr.gibba043.dnkmem (mgr.34373) 1311 : audit [DBG] from='client.44943 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:07.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:07 gibba003 bash[31385]: cluster 2021-03-10T14:15:06.122632+0000 mgr.gibba043.dnkmem (mgr.34373) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:07 gibba003 bash[32348]: audit 2021-03-10T14:15:05.625871+0000 mgr.gibba043.dnkmem (mgr.34373) 1311 : audit [DBG] from='client.44943 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:07 gibba003 bash[32348]: cluster 2021-03-10T14:15:06.122632+0000 mgr.gibba043.dnkmem (mgr.34373) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:07 gibba043 bash[24019]: audit 2021-03-10T14:15:05.625871+0000 mgr.gibba043.dnkmem (mgr.34373) 1311 : audit [DBG] from='client.44943 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:07 gibba043 bash[24019]: cluster 2021-03-10T14:15:06.122632+0000 mgr.gibba043.dnkmem (mgr.34373) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:09 gibba003 bash[31385]: cluster 2021-03-10T14:15:08.124147+0000 mgr.gibba043.dnkmem (mgr.34373) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:09 gibba003 bash[32348]: cluster 2021-03-10T14:15:08.124147+0000 mgr.gibba043.dnkmem (mgr.34373) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:09 gibba043 bash[24019]: cluster 2021-03-10T14:15:08.124147+0000 mgr.gibba043.dnkmem (mgr.34373) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:11 gibba003 bash[31385]: cluster 2021-03-10T14:15:10.125519+0000 mgr.gibba043.dnkmem (mgr.34373) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:11 gibba003 bash[32348]: cluster 2021-03-10T14:15:10.125519+0000 mgr.gibba043.dnkmem (mgr.34373) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:11 gibba043 bash[24019]: cluster 2021-03-10T14:15:10.125519+0000 mgr.gibba043.dnkmem (mgr.34373) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: cephadm 2021-03-10T14:15:11.828946+0000 mgr.gibba043.dnkmem (mgr.34373) 1315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: cluster 2021-03-10T14:15:12.126693+0000 mgr.gibba043.dnkmem (mgr.34373) 1316 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.773011+0000 mon.c (mon.1) 392 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:15:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.773729+0000 mon.c (mon.1) 393 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.774406+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:15:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.774448+0000 mon.c (mon.1) 394 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:15:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.775172+0000 mon.c (mon.1) 395 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.776558+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.777380+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:15:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.778291+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.871149+0000 mon.c (mon.1) 396 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.872241+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.906804+0000 mon.c (mon.1) 397 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[31385]: audit 2021-03-10T14:15:12.907987+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: cephadm 2021-03-10T14:15:11.828946+0000 mgr.gibba043.dnkmem (mgr.34373) 1315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: cluster 2021-03-10T14:15:12.126693+0000 mgr.gibba043.dnkmem (mgr.34373) 1316 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.773011+0000 mon.c (mon.1) 392 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:15:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.773729+0000 mon.c (mon.1) 393 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.774406+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:15:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.774448+0000 mon.c (mon.1) 394 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:15:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.775172+0000 mon.c (mon.1) 395 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.776558+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.777380+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:15:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.778291+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.871149+0000 mon.c (mon.1) 396 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.872241+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.906804+0000 mon.c (mon.1) 397 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:13 gibba003 bash[32348]: audit 2021-03-10T14:15:12.907987+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: cephadm 2021-03-10T14:15:11.828946+0000 mgr.gibba043.dnkmem (mgr.34373) 1315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: cluster 2021-03-10T14:15:12.126693+0000 mgr.gibba043.dnkmem (mgr.34373) 1316 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.773011+0000 mon.c (mon.1) 392 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:15:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.773729+0000 mon.c (mon.1) 393 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.774406+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:15:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.774448+0000 mon.c (mon.1) 394 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:15:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.775172+0000 mon.c (mon.1) 395 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.776558+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.777380+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:15:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.778291+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.871149+0000 mon.c (mon.1) 396 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.872241+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.906804+0000 mon.c (mon.1) 397 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:13 gibba043 bash[24019]: audit 2021-03-10T14:15:12.907987+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:15 gibba003 bash[31385]: cluster 2021-03-10T14:15:14.128272+0000 mgr.gibba043.dnkmem (mgr.34373) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:15 gibba003 bash[32348]: cluster 2021-03-10T14:15:14.128272+0000 mgr.gibba043.dnkmem (mgr.34373) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:15 gibba043 bash[24019]: cluster 2021-03-10T14:15:14.128272+0000 mgr.gibba043.dnkmem (mgr.34373) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:17 gibba003 bash[31385]: cluster 2021-03-10T14:15:16.130207+0000 mgr.gibba043.dnkmem (mgr.34373) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:17 gibba003 bash[32348]: cluster 2021-03-10T14:15:16.130207+0000 mgr.gibba043.dnkmem (mgr.34373) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:17 gibba043 bash[24019]: cluster 2021-03-10T14:15:16.130207+0000 mgr.gibba043.dnkmem (mgr.34373) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:19 gibba003 bash[31385]: cluster 2021-03-10T14:15:18.131644+0000 mgr.gibba043.dnkmem (mgr.34373) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:19 gibba003 bash[32348]: cluster 2021-03-10T14:15:18.131644+0000 mgr.gibba043.dnkmem (mgr.34373) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:19 gibba043 bash[24019]: cluster 2021-03-10T14:15:18.131644+0000 mgr.gibba043.dnkmem (mgr.34373) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:21 gibba003 bash[31385]: cluster 2021-03-10T14:15:20.133466+0000 mgr.gibba043.dnkmem (mgr.34373) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:21 gibba003 bash[32348]: cluster 2021-03-10T14:15:20.133466+0000 mgr.gibba043.dnkmem (mgr.34373) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:21 gibba043 bash[24019]: cluster 2021-03-10T14:15:20.133466+0000 mgr.gibba043.dnkmem (mgr.34373) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:23 gibba003 bash[31385]: cluster 2021-03-10T14:15:22.134689+0000 mgr.gibba043.dnkmem (mgr.34373) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:23 gibba003 bash[32348]: cluster 2021-03-10T14:15:22.134689+0000 mgr.gibba043.dnkmem (mgr.34373) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:23 gibba043 bash[24019]: cluster 2021-03-10T14:15:22.134689+0000 mgr.gibba043.dnkmem (mgr.34373) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:25 gibba003 bash[31385]: cluster 2021-03-10T14:15:24.136239+0000 mgr.gibba043.dnkmem (mgr.34373) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:25 gibba003 bash[32348]: cluster 2021-03-10T14:15:24.136239+0000 mgr.gibba043.dnkmem (mgr.34373) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:25 gibba043 bash[24019]: cluster 2021-03-10T14:15:24.136239+0000 mgr.gibba043.dnkmem (mgr.34373) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:27 gibba003 bash[31385]: cluster 2021-03-10T14:15:26.137879+0000 mgr.gibba043.dnkmem (mgr.34373) 1323 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:27 gibba003 bash[32348]: cluster 2021-03-10T14:15:26.137879+0000 mgr.gibba043.dnkmem (mgr.34373) 1323 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:27 gibba043 bash[24019]: cluster 2021-03-10T14:15:26.137879+0000 mgr.gibba043.dnkmem (mgr.34373) 1323 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:28.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:28 gibba003 bash[31385]: cephadm 2021-03-10T14:15:26.845022+0000 mgr.gibba043.dnkmem (mgr.34373) 1324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:28.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:28 gibba003 bash[32348]: cephadm 2021-03-10T14:15:26.845022+0000 mgr.gibba043.dnkmem (mgr.34373) 1324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:28.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:28 gibba043 bash[24019]: cephadm 2021-03-10T14:15:26.845022+0000 mgr.gibba043.dnkmem (mgr.34373) 1324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:29 gibba043 bash[24019]: cluster 2021-03-10T14:15:28.139274+0000 mgr.gibba043.dnkmem (mgr.34373) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:29 gibba003 bash[31385]: cluster 2021-03-10T14:15:28.139274+0000 mgr.gibba043.dnkmem (mgr.34373) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:29 gibba003 bash[32348]: cluster 2021-03-10T14:15:28.139274+0000 mgr.gibba043.dnkmem (mgr.34373) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:31 gibba043 bash[24019]: cluster 2021-03-10T14:15:30.140697+0000 mgr.gibba043.dnkmem (mgr.34373) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:31 gibba003 bash[31385]: cluster 2021-03-10T14:15:30.140697+0000 mgr.gibba043.dnkmem (mgr.34373) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:31.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:31 gibba003 bash[32348]: cluster 2021-03-10T14:15:30.140697+0000 mgr.gibba043.dnkmem (mgr.34373) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:33 gibba043 bash[24019]: cluster 2021-03-10T14:15:32.142206+0000 mgr.gibba043.dnkmem (mgr.34373) 1327 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:33 gibba003 bash[31385]: cluster 2021-03-10T14:15:32.142206+0000 mgr.gibba043.dnkmem (mgr.34373) 1327 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:33 gibba003 bash[32348]: cluster 2021-03-10T14:15:32.142206+0000 mgr.gibba043.dnkmem (mgr.34373) 1327 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:35 gibba043 bash[24019]: cluster 2021-03-10T14:15:34.143523+0000 mgr.gibba043.dnkmem (mgr.34373) 1328 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:35 gibba003 bash[31385]: cluster 2021-03-10T14:15:34.143523+0000 mgr.gibba043.dnkmem (mgr.34373) 1328 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:35 gibba003 bash[32348]: cluster 2021-03-10T14:15:34.143523+0000 mgr.gibba043.dnkmem (mgr.34373) 1328 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:36.131 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:15:36.356 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:15:36.356 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (23m) 10m ago 29m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:15:36.357 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:15:36.357 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (24m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:15:36.357 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (24m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:15:36.357 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:15:36.357 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:15:36.358 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:15:36.358 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (23m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:15:36.358 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (29m) 10m ago 29m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:15:36.358 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:15:36.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (22m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:15:36.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:15:36.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:15:36.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:15:36.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:15:36.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:15:36.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:15:36.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (19m) 9m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:15:36.360 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (28m) 9m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:15:36.360 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:15:36.610 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:15:36.610 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:15:36.611 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:36.611 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:15:36.612 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:15:36.612 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:36.612 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:15:36.613 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:15:36.613 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:15:36.613 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:15:36.614 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:15:36.614 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:15:36.614 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:15:36.615 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:15:36.615 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:15:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:37 gibba043 bash[24019]: audit 2021-03-10T14:15:36.121898+0000 mgr.gibba043.dnkmem (mgr.34373) 1329 : audit [DBG] from='client.54940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:37 gibba043 bash[24019]: cluster 2021-03-10T14:15:36.145218+0000 mgr.gibba043.dnkmem (mgr.34373) 1330 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:37 gibba043 bash[24019]: audit 2021-03-10T14:15:36.344615+0000 mgr.gibba043.dnkmem (mgr.34373) 1331 : audit [DBG] from='client.44961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:37 gibba043 bash[24019]: audit 2021-03-10T14:15:36.610573+0000 mon.a (mon.0) 642 : audit [DBG] from='client.? 172.21.2.103:0/347055537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[31385]: audit 2021-03-10T14:15:36.121898+0000 mgr.gibba043.dnkmem (mgr.34373) 1329 : audit [DBG] from='client.54940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[31385]: cluster 2021-03-10T14:15:36.145218+0000 mgr.gibba043.dnkmem (mgr.34373) 1330 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[31385]: audit 2021-03-10T14:15:36.344615+0000 mgr.gibba043.dnkmem (mgr.34373) 1331 : audit [DBG] from='client.44961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[31385]: audit 2021-03-10T14:15:36.610573+0000 mon.a (mon.0) 642 : audit [DBG] from='client.? 172.21.2.103:0/347055537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[32348]: audit 2021-03-10T14:15:36.121898+0000 mgr.gibba043.dnkmem (mgr.34373) 1329 : audit [DBG] from='client.54940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[32348]: cluster 2021-03-10T14:15:36.145218+0000 mgr.gibba043.dnkmem (mgr.34373) 1330 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[32348]: audit 2021-03-10T14:15:36.344615+0000 mgr.gibba043.dnkmem (mgr.34373) 1331 : audit [DBG] from='client.44961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:37 gibba003 bash[32348]: audit 2021-03-10T14:15:36.610573+0000 mon.a (mon.0) 642 : audit [DBG] from='client.? 172.21.2.103:0/347055537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:39 gibba043 bash[24019]: cluster 2021-03-10T14:15:38.146767+0000 mgr.gibba043.dnkmem (mgr.34373) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:39 gibba003 bash[31385]: cluster 2021-03-10T14:15:38.146767+0000 mgr.gibba043.dnkmem (mgr.34373) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:39.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:39 gibba003 bash[32348]: cluster 2021-03-10T14:15:38.146767+0000 mgr.gibba043.dnkmem (mgr.34373) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:41 gibba043 bash[24019]: cluster 2021-03-10T14:15:40.148337+0000 mgr.gibba043.dnkmem (mgr.34373) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:41 gibba003 bash[31385]: cluster 2021-03-10T14:15:40.148337+0000 mgr.gibba043.dnkmem (mgr.34373) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:41 gibba003 bash[32348]: cluster 2021-03-10T14:15:40.148337+0000 mgr.gibba043.dnkmem (mgr.34373) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:42.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:42 gibba043 bash[24019]: audit 2021-03-10T14:15:41.863927+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:15:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:42 gibba003 bash[31385]: audit 2021-03-10T14:15:41.863927+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:15:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:42 gibba003 bash[32348]: audit 2021-03-10T14:15:41.863927+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:15:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:43 gibba043 bash[24019]: cephadm 2021-03-10T14:15:41.862519+0000 mgr.gibba043.dnkmem (mgr.34373) 1334 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:15:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:43 gibba043 bash[24019]: cluster 2021-03-10T14:15:42.149437+0000 mgr.gibba043.dnkmem (mgr.34373) 1335 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:43 gibba003 bash[31385]: cephadm 2021-03-10T14:15:41.862519+0000 mgr.gibba043.dnkmem (mgr.34373) 1334 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:15:43.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:43 gibba003 bash[31385]: cluster 2021-03-10T14:15:42.149437+0000 mgr.gibba043.dnkmem (mgr.34373) 1335 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:43 gibba003 bash[32348]: cephadm 2021-03-10T14:15:41.862519+0000 mgr.gibba043.dnkmem (mgr.34373) 1334 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:15:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:43 gibba003 bash[32348]: cluster 2021-03-10T14:15:42.149437+0000 mgr.gibba043.dnkmem (mgr.34373) 1335 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:45 gibba043 bash[24019]: cluster 2021-03-10T14:15:44.151022+0000 mgr.gibba043.dnkmem (mgr.34373) 1336 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:45 gibba043 bash[24019]: audit 2021-03-10T14:15:45.424476+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:15:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:45 gibba003 bash[31385]: cluster 2021-03-10T14:15:44.151022+0000 mgr.gibba043.dnkmem (mgr.34373) 1336 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:45 gibba003 bash[31385]: audit 2021-03-10T14:15:45.424476+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:15:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:45 gibba003 bash[32348]: cluster 2021-03-10T14:15:44.151022+0000 mgr.gibba043.dnkmem (mgr.34373) 1336 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:45 gibba003 bash[32348]: audit 2021-03-10T14:15:45.424476+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:15:46.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.424467+0000 mgr.gibba043.dnkmem (mgr.34373) 1337 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:15:46.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.632425+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:15:46.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.638185+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:46.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.639358+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.640530+0000 mon.c (mon.1) 401 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.641640+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.644388+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:46 gibba043 bash[24019]: audit 2021-03-10T14:15:45.645831+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.424467+0000 mgr.gibba043.dnkmem (mgr.34373) 1337 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:15:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.632425+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:15:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.638185+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.639358+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.640530+0000 mon.c (mon.1) 401 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.641640+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.644388+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[31385]: audit 2021-03-10T14:15:45.645831+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.424467+0000 mgr.gibba043.dnkmem (mgr.34373) 1337 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:15:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.632425+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:15:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.638185+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.639358+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.640530+0000 mon.c (mon.1) 401 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.641640+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.644388+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:46 gibba003 bash[32348]: audit 2021-03-10T14:15:45.645831+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.636100+0000 mgr.gibba043.dnkmem (mgr.34373) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.638003+0000 mgr.gibba043.dnkmem (mgr.34373) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.639047+0000 mgr.gibba043.dnkmem (mgr.34373) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.639085+0000 mgr.gibba043.dnkmem (mgr.34373) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.640177+0000 mgr.gibba043.dnkmem (mgr.34373) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.640218+0000 mgr.gibba043.dnkmem (mgr.34373) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.641280+0000 mgr.gibba043.dnkmem (mgr.34373) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.642775+0000 mgr.gibba043.dnkmem (mgr.34373) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.642818+0000 mgr.gibba043.dnkmem (mgr.34373) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.644061+0000 mgr.gibba043.dnkmem (mgr.34373) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.644424+0000 mgr.gibba043.dnkmem (mgr.34373) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.645657+0000 mgr.gibba043.dnkmem (mgr.34373) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.645700+0000 mgr.gibba043.dnkmem (mgr.34373) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cephadm 2021-03-10T14:15:45.645847+0000 mgr.gibba043.dnkmem (mgr.34373) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[31385]: cluster 2021-03-10T14:15:46.152646+0000 mgr.gibba043.dnkmem (mgr.34373) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.636100+0000 mgr.gibba043.dnkmem (mgr.34373) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.638003+0000 mgr.gibba043.dnkmem (mgr.34373) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.639047+0000 mgr.gibba043.dnkmem (mgr.34373) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.639085+0000 mgr.gibba043.dnkmem (mgr.34373) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.640177+0000 mgr.gibba043.dnkmem (mgr.34373) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.640218+0000 mgr.gibba043.dnkmem (mgr.34373) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.641280+0000 mgr.gibba043.dnkmem (mgr.34373) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.642775+0000 mgr.gibba043.dnkmem (mgr.34373) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.642818+0000 mgr.gibba043.dnkmem (mgr.34373) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.644061+0000 mgr.gibba043.dnkmem (mgr.34373) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.644424+0000 mgr.gibba043.dnkmem (mgr.34373) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.645657+0000 mgr.gibba043.dnkmem (mgr.34373) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.645700+0000 mgr.gibba043.dnkmem (mgr.34373) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cephadm 2021-03-10T14:15:45.645847+0000 mgr.gibba043.dnkmem (mgr.34373) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:47 gibba003 bash[32348]: cluster 2021-03-10T14:15:46.152646+0000 mgr.gibba043.dnkmem (mgr.34373) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.636100+0000 mgr.gibba043.dnkmem (mgr.34373) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.638003+0000 mgr.gibba043.dnkmem (mgr.34373) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.639047+0000 mgr.gibba043.dnkmem (mgr.34373) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.639085+0000 mgr.gibba043.dnkmem (mgr.34373) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.640177+0000 mgr.gibba043.dnkmem (mgr.34373) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.640218+0000 mgr.gibba043.dnkmem (mgr.34373) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.641280+0000 mgr.gibba043.dnkmem (mgr.34373) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.642775+0000 mgr.gibba043.dnkmem (mgr.34373) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.642818+0000 mgr.gibba043.dnkmem (mgr.34373) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.644061+0000 mgr.gibba043.dnkmem (mgr.34373) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.644424+0000 mgr.gibba043.dnkmem (mgr.34373) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.645657+0000 mgr.gibba043.dnkmem (mgr.34373) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.645700+0000 mgr.gibba043.dnkmem (mgr.34373) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cephadm 2021-03-10T14:15:45.645847+0000 mgr.gibba043.dnkmem (mgr.34373) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:15:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:47 gibba043 bash[24019]: cluster 2021-03-10T14:15:46.152646+0000 mgr.gibba043.dnkmem (mgr.34373) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:49 gibba003 bash[31385]: cluster 2021-03-10T14:15:48.153850+0000 mgr.gibba043.dnkmem (mgr.34373) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:49 gibba003 bash[32348]: cluster 2021-03-10T14:15:48.153850+0000 mgr.gibba043.dnkmem (mgr.34373) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:49 gibba043 bash[24019]: cluster 2021-03-10T14:15:48.153850+0000 mgr.gibba043.dnkmem (mgr.34373) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:50.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:50 gibba003 bash[31385]: cluster 2021-03-10T14:15:50.154921+0000 mgr.gibba043.dnkmem (mgr.34373) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:50.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:50 gibba003 bash[32348]: cluster 2021-03-10T14:15:50.154921+0000 mgr.gibba043.dnkmem (mgr.34373) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:51.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:50 gibba043 bash[24019]: cluster 2021-03-10T14:15:50.154921+0000 mgr.gibba043.dnkmem (mgr.34373) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:53 gibba043 bash[24019]: cluster 2021-03-10T14:15:52.156318+0000 mgr.gibba043.dnkmem (mgr.34373) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:53 gibba003 bash[31385]: cluster 2021-03-10T14:15:52.156318+0000 mgr.gibba043.dnkmem (mgr.34373) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:53 gibba003 bash[32348]: cluster 2021-03-10T14:15:52.156318+0000 mgr.gibba043.dnkmem (mgr.34373) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:55 gibba003 bash[31385]: cluster 2021-03-10T14:15:54.157613+0000 mgr.gibba043.dnkmem (mgr.34373) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:55 gibba003 bash[32348]: cluster 2021-03-10T14:15:54.157613+0000 mgr.gibba043.dnkmem (mgr.34373) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:55.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:55 gibba043 bash[24019]: cluster 2021-03-10T14:15:54.157613+0000 mgr.gibba043.dnkmem (mgr.34373) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:57 gibba003 bash[31385]: cluster 2021-03-10T14:15:56.159282+0000 mgr.gibba043.dnkmem (mgr.34373) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:57 gibba003 bash[32348]: cluster 2021-03-10T14:15:56.159282+0000 mgr.gibba043.dnkmem (mgr.34373) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:57 gibba043 bash[24019]: cluster 2021-03-10T14:15:56.159282+0000 mgr.gibba043.dnkmem (mgr.34373) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:15:59 gibba003 bash[31385]: cluster 2021-03-10T14:15:58.160717+0000 mgr.gibba043.dnkmem (mgr.34373) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:15:59 gibba003 bash[32348]: cluster 2021-03-10T14:15:58.160717+0000 mgr.gibba043.dnkmem (mgr.34373) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:15:59 gibba043 bash[24019]: cluster 2021-03-10T14:15:58.160717+0000 mgr.gibba043.dnkmem (mgr.34373) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:01 gibba003 bash[31385]: cluster 2021-03-10T14:16:00.162079+0000 mgr.gibba043.dnkmem (mgr.34373) 1359 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:01 gibba003 bash[32348]: cluster 2021-03-10T14:16:00.162079+0000 mgr.gibba043.dnkmem (mgr.34373) 1359 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:01 gibba043 bash[24019]: cluster 2021-03-10T14:16:00.162079+0000 mgr.gibba043.dnkmem (mgr.34373) 1359 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:02.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:02 gibba003 bash[31385]: cephadm 2021-03-10T14:16:00.654407+0000 mgr.gibba043.dnkmem (mgr.34373) 1360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:02.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:02 gibba003 bash[32348]: cephadm 2021-03-10T14:16:00.654407+0000 mgr.gibba043.dnkmem (mgr.34373) 1360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:02.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:02 gibba043 bash[24019]: cephadm 2021-03-10T14:16:00.654407+0000 mgr.gibba043.dnkmem (mgr.34373) 1360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:03 gibba003 bash[31385]: cluster 2021-03-10T14:16:02.163718+0000 mgr.gibba043.dnkmem (mgr.34373) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:03 gibba003 bash[32348]: cluster 2021-03-10T14:16:02.163718+0000 mgr.gibba043.dnkmem (mgr.34373) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:03 gibba043 bash[24019]: cluster 2021-03-10T14:16:02.163718+0000 mgr.gibba043.dnkmem (mgr.34373) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:05 gibba003 bash[31385]: cluster 2021-03-10T14:16:04.165060+0000 mgr.gibba043.dnkmem (mgr.34373) 1362 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:05 gibba003 bash[32348]: cluster 2021-03-10T14:16:04.165060+0000 mgr.gibba043.dnkmem (mgr.34373) 1362 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:05 gibba043 bash[24019]: cluster 2021-03-10T14:16:04.165060+0000 mgr.gibba043.dnkmem (mgr.34373) 1362 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.900 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:16:07.125 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:16:07.125 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (24m) 21s ago 29m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:16:07.126 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:16:07.126 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (24m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:16:07.126 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:16:07.126 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (24m) 21s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:16:07.127 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (24m) 21s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:16:07.127 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:16:07.127 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (23m) 21s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:16:07.127 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (29m) 21s ago 29m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:16:07.127 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:16:07.128 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (22m) 21s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:16:07.128 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (22m) 21s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:16:07.128 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (21m) 21s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:16:07.128 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (21m) 21s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:16:07.129 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:16:07.129 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:16:07.129 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:16:07.129 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:16:07.129 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (29m) 9m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:16:07.130 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 21s ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:16:07.384 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:16:07.384 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:16:07.385 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:07.385 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:16:07.385 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:16:07.385 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:07.385 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:16:07.386 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:16:07.386 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:16:07.386 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:16:07.386 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:16:07.387 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:16:07.387 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:16:07.387 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:16:07.387 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:16:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:07 gibba003 bash[31385]: cluster 2021-03-10T14:16:06.166671+0000 mgr.gibba043.dnkmem (mgr.34373) 1363 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:07 gibba003 bash[32348]: cluster 2021-03-10T14:16:06.166671+0000 mgr.gibba043.dnkmem (mgr.34373) 1363 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:07 gibba043 bash[24019]: cluster 2021-03-10T14:16:06.166671+0000 mgr.gibba043.dnkmem (mgr.34373) 1363 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:08.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:08 gibba003 bash[31385]: audit 2021-03-10T14:16:06.890792+0000 mgr.gibba043.dnkmem (mgr.34373) 1364 : audit [DBG] from='client.44973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:08.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:08 gibba003 bash[31385]: audit 2021-03-10T14:16:07.113251+0000 mgr.gibba043.dnkmem (mgr.34373) 1365 : audit [DBG] from='client.44979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:08.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:08 gibba003 bash[31385]: audit 2021-03-10T14:16:07.385039+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.103:0/1330546879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:08.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:08 gibba003 bash[32348]: audit 2021-03-10T14:16:06.890792+0000 mgr.gibba043.dnkmem (mgr.34373) 1364 : audit [DBG] from='client.44973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:08.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:08 gibba003 bash[32348]: audit 2021-03-10T14:16:07.113251+0000 mgr.gibba043.dnkmem (mgr.34373) 1365 : audit [DBG] from='client.44979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:08.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:08 gibba003 bash[32348]: audit 2021-03-10T14:16:07.385039+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.103:0/1330546879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:08.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:08 gibba043 bash[24019]: audit 2021-03-10T14:16:06.890792+0000 mgr.gibba043.dnkmem (mgr.34373) 1364 : audit [DBG] from='client.44973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:08.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:08 gibba043 bash[24019]: audit 2021-03-10T14:16:07.113251+0000 mgr.gibba043.dnkmem (mgr.34373) 1365 : audit [DBG] from='client.44979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:08.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:08 gibba043 bash[24019]: audit 2021-03-10T14:16:07.385039+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.103:0/1330546879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:09 gibba003 bash[31385]: cluster 2021-03-10T14:16:08.168063+0000 mgr.gibba043.dnkmem (mgr.34373) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:09 gibba003 bash[32348]: cluster 2021-03-10T14:16:08.168063+0000 mgr.gibba043.dnkmem (mgr.34373) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:09 gibba043 bash[24019]: cluster 2021-03-10T14:16:08.168063+0000 mgr.gibba043.dnkmem (mgr.34373) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:11 gibba003 bash[31385]: cluster 2021-03-10T14:16:10.169446+0000 mgr.gibba043.dnkmem (mgr.34373) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:11 gibba003 bash[32348]: cluster 2021-03-10T14:16:10.169446+0000 mgr.gibba043.dnkmem (mgr.34373) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:11 gibba043 bash[24019]: cluster 2021-03-10T14:16:10.169446+0000 mgr.gibba043.dnkmem (mgr.34373) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: cluster 2021-03-10T14:16:12.171109+0000 mgr.gibba043.dnkmem (mgr.34373) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.777 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.784055+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:16:13.777 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.784770+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.778 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.785419+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:16:13.778 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.785458+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.778 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.786170+0000 mon.c (mon.1) 408 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:16:13.778 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.787438+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.779 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.788355+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.779 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.789246+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:16:13.779 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.878679+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:13.779 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.879884+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:13.779 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.915729+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:13.780 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[31385]: audit 2021-03-10T14:16:12.916932+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:13.780 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: cluster 2021-03-10T14:16:12.171109+0000 mgr.gibba043.dnkmem (mgr.34373) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.780 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.784055+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:16:13.781 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.784770+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.781 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.785419+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:16:13.781 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.785458+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.781 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.786170+0000 mon.c (mon.1) 408 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:16:13.781 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.787438+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.782 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.788355+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.782 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.789246+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:16:13.782 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.878679+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:13.782 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.879884+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:13.783 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.915729+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:13.783 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:13 gibba003 bash[32348]: audit 2021-03-10T14:16:12.916932+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:13.783 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: cluster 2021-03-10T14:16:12.171109+0000 mgr.gibba043.dnkmem (mgr.34373) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.784055+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:16:13.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.784770+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.785419+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:16:13.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.785458+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.786170+0000 mon.c (mon.1) 408 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:16:13.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.787438+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.788355+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:16:13.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.789246+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:16:13.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.878679+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:13.786 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.879884+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:13.786 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.915729+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:13.786 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:13 gibba043 bash[24019]: audit 2021-03-10T14:16:12.916932+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:15.665 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:15 gibba043 bash[24019]: cluster 2021-03-10T14:16:14.172676+0000 mgr.gibba043.dnkmem (mgr.34373) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:15 gibba003 bash[31385]: cluster 2021-03-10T14:16:14.172676+0000 mgr.gibba043.dnkmem (mgr.34373) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:15 gibba003 bash[32348]: cluster 2021-03-10T14:16:14.172676+0000 mgr.gibba043.dnkmem (mgr.34373) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:17 gibba003 bash[31385]: cephadm 2021-03-10T14:16:15.665006+0000 mgr.gibba043.dnkmem (mgr.34373) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:17 gibba003 bash[31385]: cluster 2021-03-10T14:16:16.174570+0000 mgr.gibba043.dnkmem (mgr.34373) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:17 gibba003 bash[32348]: cephadm 2021-03-10T14:16:15.665006+0000 mgr.gibba043.dnkmem (mgr.34373) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:17 gibba003 bash[32348]: cluster 2021-03-10T14:16:16.174570+0000 mgr.gibba043.dnkmem (mgr.34373) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:17 gibba043 bash[24019]: cephadm 2021-03-10T14:16:15.665006+0000 mgr.gibba043.dnkmem (mgr.34373) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:17 gibba043 bash[24019]: cluster 2021-03-10T14:16:16.174570+0000 mgr.gibba043.dnkmem (mgr.34373) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:19 gibba003 bash[31385]: cluster 2021-03-10T14:16:18.175791+0000 mgr.gibba043.dnkmem (mgr.34373) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:19 gibba003 bash[32348]: cluster 2021-03-10T14:16:18.175791+0000 mgr.gibba043.dnkmem (mgr.34373) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:19 gibba043 bash[24019]: cluster 2021-03-10T14:16:18.175791+0000 mgr.gibba043.dnkmem (mgr.34373) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:21 gibba003 bash[31385]: cluster 2021-03-10T14:16:20.177476+0000 mgr.gibba043.dnkmem (mgr.34373) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:21 gibba003 bash[32348]: cluster 2021-03-10T14:16:20.177476+0000 mgr.gibba043.dnkmem (mgr.34373) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:21 gibba043 bash[24019]: cluster 2021-03-10T14:16:20.177476+0000 mgr.gibba043.dnkmem (mgr.34373) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:23 gibba003 bash[31385]: cluster 2021-03-10T14:16:22.178845+0000 mgr.gibba043.dnkmem (mgr.34373) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:23 gibba003 bash[32348]: cluster 2021-03-10T14:16:22.178845+0000 mgr.gibba043.dnkmem (mgr.34373) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:23 gibba043 bash[24019]: cluster 2021-03-10T14:16:22.178845+0000 mgr.gibba043.dnkmem (mgr.34373) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:25 gibba003 bash[31385]: cluster 2021-03-10T14:16:24.180229+0000 mgr.gibba043.dnkmem (mgr.34373) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:25 gibba003 bash[32348]: cluster 2021-03-10T14:16:24.180229+0000 mgr.gibba043.dnkmem (mgr.34373) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:25 gibba043 bash[24019]: cluster 2021-03-10T14:16:24.180229+0000 mgr.gibba043.dnkmem (mgr.34373) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:27 gibba003 bash[31385]: cluster 2021-03-10T14:16:26.181884+0000 mgr.gibba043.dnkmem (mgr.34373) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:27 gibba003 bash[32348]: cluster 2021-03-10T14:16:26.181884+0000 mgr.gibba043.dnkmem (mgr.34373) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:27 gibba043 bash[24019]: cluster 2021-03-10T14:16:26.181884+0000 mgr.gibba043.dnkmem (mgr.34373) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:29 gibba003 bash[31385]: cluster 2021-03-10T14:16:28.183141+0000 mgr.gibba043.dnkmem (mgr.34373) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:29 gibba003 bash[32348]: cluster 2021-03-10T14:16:28.183141+0000 mgr.gibba043.dnkmem (mgr.34373) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:29 gibba043 bash[24019]: cluster 2021-03-10T14:16:28.183141+0000 mgr.gibba043.dnkmem (mgr.34373) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:31 gibba043 bash[24019]: cluster 2021-03-10T14:16:30.184366+0000 mgr.gibba043.dnkmem (mgr.34373) 1378 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:31 gibba003 bash[31385]: cluster 2021-03-10T14:16:30.184366+0000 mgr.gibba043.dnkmem (mgr.34373) 1378 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:31 gibba003 bash[32348]: cluster 2021-03-10T14:16:30.184366+0000 mgr.gibba043.dnkmem (mgr.34373) 1378 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:32.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:32 gibba043 bash[24019]: cephadm 2021-03-10T14:16:30.680633+0000 mgr.gibba043.dnkmem (mgr.34373) 1379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:32.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:32 gibba003 bash[31385]: cephadm 2021-03-10T14:16:30.680633+0000 mgr.gibba043.dnkmem (mgr.34373) 1379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:32.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:32 gibba003 bash[32348]: cephadm 2021-03-10T14:16:30.680633+0000 mgr.gibba043.dnkmem (mgr.34373) 1379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:33 gibba043 bash[24019]: cluster 2021-03-10T14:16:32.185709+0000 mgr.gibba043.dnkmem (mgr.34373) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:33 gibba003 bash[31385]: cluster 2021-03-10T14:16:32.185709+0000 mgr.gibba043.dnkmem (mgr.34373) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:33 gibba003 bash[32348]: cluster 2021-03-10T14:16:32.185709+0000 mgr.gibba043.dnkmem (mgr.34373) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:35 gibba043 bash[24019]: cluster 2021-03-10T14:16:34.187257+0000 mgr.gibba043.dnkmem (mgr.34373) 1381 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:35 gibba003 bash[31385]: cluster 2021-03-10T14:16:34.187257+0000 mgr.gibba043.dnkmem (mgr.34373) 1381 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:35 gibba003 bash[32348]: cluster 2021-03-10T14:16:34.187257+0000 mgr.gibba043.dnkmem (mgr.34373) 1381 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:37.631 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:16:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:37 gibba043 bash[24019]: cluster 2021-03-10T14:16:36.188956+0000 mgr.gibba043.dnkmem (mgr.34373) 1382 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:37.859 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:16:37.860 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (25m) 52s ago 30m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:16:37.860 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (30m) 10m ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:16:37.860 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (25m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:16:37.861 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (25m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:16:37.861 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (24m) 52s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:16:37.861 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (24m) 52s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:16:37.861 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (24m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:16:37.862 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (24m) 52s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:16:37.862 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (30m) 52s ago 30m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:16:37.862 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (30m) 10m ago 30m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:16:37.863 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (23m) 52s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:16:37.863 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (22m) 52s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:16:37.863 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (22m) 52s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:16:37.863 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (22m) 52s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:16:37.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:16:37.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:16:37.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:16:37.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (20m) 10m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:16:37.865 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (29m) 10m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:16:37.865 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 52s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:16:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:37 gibba003 bash[31385]: cluster 2021-03-10T14:16:36.188956+0000 mgr.gibba043.dnkmem (mgr.34373) 1382 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:37 gibba003 bash[32348]: cluster 2021-03-10T14:16:36.188956+0000 mgr.gibba043.dnkmem (mgr.34373) 1382 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:38.107 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:16:38.107 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:16:38.108 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:38.108 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:16:38.108 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:16:38.108 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:38.109 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:16:38.109 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:16:38.109 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:16:38.109 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:16:38.110 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:16:38.110 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:16:38.110 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:16:38.110 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:16:38.111 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:16:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:38 gibba043 bash[24019]: audit 2021-03-10T14:16:38.107893+0000 mon.c (mon.1) 411 : audit [DBG] from='client.? 172.21.2.103:0/1878297099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:38 gibba003 bash[31385]: audit 2021-03-10T14:16:38.107893+0000 mon.c (mon.1) 411 : audit [DBG] from='client.? 172.21.2.103:0/1878297099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:38.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:38 gibba003 bash[32348]: audit 2021-03-10T14:16:38.107893+0000 mon.c (mon.1) 411 : audit [DBG] from='client.? 172.21.2.103:0/1878297099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:39 gibba043 bash[24019]: audit 2021-03-10T14:16:37.622163+0000 mgr.gibba043.dnkmem (mgr.34373) 1383 : audit [DBG] from='client.54976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:39 gibba043 bash[24019]: audit 2021-03-10T14:16:37.847414+0000 mgr.gibba043.dnkmem (mgr.34373) 1384 : audit [DBG] from='client.44997 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:39 gibba043 bash[24019]: cluster 2021-03-10T14:16:38.190261+0000 mgr.gibba043.dnkmem (mgr.34373) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:39 gibba003 bash[31385]: audit 2021-03-10T14:16:37.622163+0000 mgr.gibba043.dnkmem (mgr.34373) 1383 : audit [DBG] from='client.54976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:40.063 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:39 gibba003 bash[31385]: audit 2021-03-10T14:16:37.847414+0000 mgr.gibba043.dnkmem (mgr.34373) 1384 : audit [DBG] from='client.44997 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:40.064 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:39 gibba003 bash[31385]: cluster 2021-03-10T14:16:38.190261+0000 mgr.gibba043.dnkmem (mgr.34373) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:40.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:39 gibba003 bash[32348]: audit 2021-03-10T14:16:37.622163+0000 mgr.gibba043.dnkmem (mgr.34373) 1383 : audit [DBG] from='client.54976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:40.064 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:39 gibba003 bash[32348]: audit 2021-03-10T14:16:37.847414+0000 mgr.gibba043.dnkmem (mgr.34373) 1384 : audit [DBG] from='client.44997 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:40.065 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:39 gibba003 bash[32348]: cluster 2021-03-10T14:16:38.190261+0000 mgr.gibba043.dnkmem (mgr.34373) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:41 gibba043 bash[24019]: cluster 2021-03-10T14:16:40.191482+0000 mgr.gibba043.dnkmem (mgr.34373) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:41 gibba003 bash[31385]: cluster 2021-03-10T14:16:40.191482+0000 mgr.gibba043.dnkmem (mgr.34373) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:41 gibba003 bash[32348]: cluster 2021-03-10T14:16:40.191482+0000 mgr.gibba043.dnkmem (mgr.34373) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:43 gibba043 bash[24019]: cluster 2021-03-10T14:16:42.193172+0000 mgr.gibba043.dnkmem (mgr.34373) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:43 gibba003 bash[31385]: cluster 2021-03-10T14:16:42.193172+0000 mgr.gibba043.dnkmem (mgr.34373) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:43 gibba003 bash[32348]: cluster 2021-03-10T14:16:42.193172+0000 mgr.gibba043.dnkmem (mgr.34373) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:45 gibba043 bash[24019]: cluster 2021-03-10T14:16:44.194669+0000 mgr.gibba043.dnkmem (mgr.34373) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:45 gibba003 bash[31385]: cluster 2021-03-10T14:16:44.194669+0000 mgr.gibba043.dnkmem (mgr.34373) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:45 gibba003 bash[32348]: cluster 2021-03-10T14:16:44.194669+0000 mgr.gibba043.dnkmem (mgr.34373) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:46.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:46 gibba003 bash[31385]: audit 2021-03-10T14:16:45.700018+0000 mon.c (mon.1) 412 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:46.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:46 gibba003 bash[32348]: audit 2021-03-10T14:16:45.700018+0000 mon.c (mon.1) 412 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:47.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:46 gibba043 bash[24019]: audit 2021-03-10T14:16:45.700018+0000 mon.c (mon.1) 412 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:47 gibba003 bash[31385]: cephadm 2021-03-10T14:16:45.697031+0000 mgr.gibba043.dnkmem (mgr.34373) 1389 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:16:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:47 gibba003 bash[31385]: cluster 2021-03-10T14:16:46.196628+0000 mgr.gibba043.dnkmem (mgr.34373) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:47 gibba003 bash[32348]: cephadm 2021-03-10T14:16:45.697031+0000 mgr.gibba043.dnkmem (mgr.34373) 1389 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:16:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:47 gibba003 bash[32348]: cluster 2021-03-10T14:16:46.196628+0000 mgr.gibba043.dnkmem (mgr.34373) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:47 gibba043 bash[24019]: cephadm 2021-03-10T14:16:45.697031+0000 mgr.gibba043.dnkmem (mgr.34373) 1389 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:16:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:47 gibba043 bash[24019]: cluster 2021-03-10T14:16:46.196628+0000 mgr.gibba043.dnkmem (mgr.34373) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:49 gibba003 bash[31385]: cluster 2021-03-10T14:16:48.198309+0000 mgr.gibba043.dnkmem (mgr.34373) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:49 gibba003 bash[31385]: audit 2021-03-10T14:16:49.381035+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:49 gibba003 bash[31385]: audit 2021-03-10T14:16:49.382531+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:16:49.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:49 gibba003 bash[32348]: cluster 2021-03-10T14:16:48.198309+0000 mgr.gibba043.dnkmem (mgr.34373) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:49 gibba003 bash[32348]: audit 2021-03-10T14:16:49.381035+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:49 gibba003 bash[32348]: audit 2021-03-10T14:16:49.382531+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:16:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:49 gibba043 bash[24019]: cluster 2021-03-10T14:16:48.198309+0000 mgr.gibba043.dnkmem (mgr.34373) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:49 gibba043 bash[24019]: audit 2021-03-10T14:16:49.381035+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:49 gibba043 bash[24019]: audit 2021-03-10T14:16:49.382531+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:16:51.814 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:51 gibba043 bash[24019]: cluster 2021-03-10T14:16:50.199848+0000 mgr.gibba043.dnkmem (mgr.34373) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:51 gibba003 bash[32348]: cluster 2021-03-10T14:16:50.199848+0000 mgr.gibba043.dnkmem (mgr.34373) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:51.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:51 gibba003 bash[31385]: cluster 2021-03-10T14:16:50.199848+0000 mgr.gibba043.dnkmem (mgr.34373) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:53 gibba003 bash[31385]: cluster 2021-03-10T14:16:52.200660+0000 mgr.gibba043.dnkmem (mgr.34373) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:53 gibba003 bash[32348]: cluster 2021-03-10T14:16:52.200660+0000 mgr.gibba043.dnkmem (mgr.34373) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.968 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:53 gibba043 bash[24019]: cluster 2021-03-10T14:16:52.200660+0000 mgr.gibba043.dnkmem (mgr.34373) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.579209+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.753629+0000 mgr.gibba043.dnkmem (mgr.34373) 1394 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:16:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.753653+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.944739+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.946421+0000 mgr.gibba043.dnkmem (mgr.34373) 1395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.948560+0000 mgr.gibba043.dnkmem (mgr.34373) 1396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.948792+0000 mon.c (mon.1) 415 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.950247+0000 mgr.gibba043.dnkmem (mgr.34373) 1397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.950285+0000 mgr.gibba043.dnkmem (mgr.34373) 1398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.950334+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.951741+0000 mgr.gibba043.dnkmem (mgr.34373) 1399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.951799+0000 mgr.gibba043.dnkmem (mgr.34373) 1400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.952199+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.953074+0000 mgr.gibba043.dnkmem (mgr.34373) 1401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:54.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.953521+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.955798+0000 mgr.gibba043.dnkmem (mgr.34373) 1402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:54.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.956263+0000 mgr.gibba043.dnkmem (mgr.34373) 1403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:54.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.959335+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.960847+0000 mgr.gibba043.dnkmem (mgr.34373) 1404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:54.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.962613+0000 mgr.gibba043.dnkmem (mgr.34373) 1405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:54.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.579209+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:54.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.753629+0000 mgr.gibba043.dnkmem (mgr.34373) 1394 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:16:54.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.753653+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:54.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.944739+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:54.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.946421+0000 mgr.gibba043.dnkmem (mgr.34373) 1395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:54.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.948560+0000 mgr.gibba043.dnkmem (mgr.34373) 1396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:54.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.948792+0000 mon.c (mon.1) 415 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:54.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.950247+0000 mgr.gibba043.dnkmem (mgr.34373) 1397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:54.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.950285+0000 mgr.gibba043.dnkmem (mgr.34373) 1398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:54.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.950334+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.951741+0000 mgr.gibba043.dnkmem (mgr.34373) 1399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:54.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.951799+0000 mgr.gibba043.dnkmem (mgr.34373) 1400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:54.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.952199+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.953074+0000 mgr.gibba043.dnkmem (mgr.34373) 1401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:54.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.953521+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.955798+0000 mgr.gibba043.dnkmem (mgr.34373) 1402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:54.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.956263+0000 mgr.gibba043.dnkmem (mgr.34373) 1403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:54.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.959335+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.960847+0000 mgr.gibba043.dnkmem (mgr.34373) 1404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:54.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.962613+0000 mgr.gibba043.dnkmem (mgr.34373) 1405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:54.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: audit 2021-03-10T14:16:53.965140+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.966626+0000 mgr.gibba043.dnkmem (mgr.34373) 1406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:54.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.967098+0000 mgr.gibba043.dnkmem (mgr.34373) 1407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:54.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cephadm 2021-03-10T14:16:53.967696+0000 mgr.gibba043.dnkmem (mgr.34373) 1408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:54.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[32348]: cluster 2021-03-10T14:16:54.202028+0000 mgr.gibba043.dnkmem (mgr.34373) 1409 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:54.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: audit 2021-03-10T14:16:53.965140+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:54.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.966626+0000 mgr.gibba043.dnkmem (mgr.34373) 1406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:54.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.967098+0000 mgr.gibba043.dnkmem (mgr.34373) 1407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:54.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cephadm 2021-03-10T14:16:53.967696+0000 mgr.gibba043.dnkmem (mgr.34373) 1408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:54.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:54 gibba003 bash[31385]: cluster 2021-03-10T14:16:54.202028+0000 mgr.gibba043.dnkmem (mgr.34373) 1409 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.579209+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.753629+0000 mgr.gibba043.dnkmem (mgr.34373) 1394 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:16:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.753653+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.944739+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:16:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.946421+0000 mgr.gibba043.dnkmem (mgr.34373) 1395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.948560+0000 mgr.gibba043.dnkmem (mgr.34373) 1396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.948792+0000 mon.c (mon.1) 415 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.950247+0000 mgr.gibba043.dnkmem (mgr.34373) 1397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:55.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.950285+0000 mgr.gibba043.dnkmem (mgr.34373) 1398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:55.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.950334+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.951741+0000 mgr.gibba043.dnkmem (mgr.34373) 1399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:55.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.951799+0000 mgr.gibba043.dnkmem (mgr.34373) 1400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:55.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.952199+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.953074+0000 mgr.gibba043.dnkmem (mgr.34373) 1401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:55.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.953521+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.955798+0000 mgr.gibba043.dnkmem (mgr.34373) 1402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:55.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.956263+0000 mgr.gibba043.dnkmem (mgr.34373) 1403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:55.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.959335+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.960847+0000 mgr.gibba043.dnkmem (mgr.34373) 1404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:55.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.962613+0000 mgr.gibba043.dnkmem (mgr.34373) 1405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:55.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: audit 2021-03-10T14:16:53.965140+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.966626+0000 mgr.gibba043.dnkmem (mgr.34373) 1406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:55.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.967098+0000 mgr.gibba043.dnkmem (mgr.34373) 1407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:55.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cephadm 2021-03-10T14:16:53.967696+0000 mgr.gibba043.dnkmem (mgr.34373) 1408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:16:55.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:54 gibba043 bash[24019]: cluster 2021-03-10T14:16:54.202028+0000 mgr.gibba043.dnkmem (mgr.34373) 1409 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:57.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:57 gibba043 bash[24019]: cluster 2021-03-10T14:16:56.203845+0000 mgr.gibba043.dnkmem (mgr.34373) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:57 gibba003 bash[31385]: cluster 2021-03-10T14:16:56.203845+0000 mgr.gibba043.dnkmem (mgr.34373) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:57 gibba003 bash[32348]: cluster 2021-03-10T14:16:56.203845+0000 mgr.gibba043.dnkmem (mgr.34373) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:16:59 gibba003 bash[31385]: cluster 2021-03-10T14:16:58.205513+0000 mgr.gibba043.dnkmem (mgr.34373) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:16:59 gibba003 bash[32348]: cluster 2021-03-10T14:16:58.205513+0000 mgr.gibba043.dnkmem (mgr.34373) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:16:59 gibba043 bash[24019]: cluster 2021-03-10T14:16:58.205513+0000 mgr.gibba043.dnkmem (mgr.34373) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:01 gibba003 bash[31385]: cluster 2021-03-10T14:17:00.206689+0000 mgr.gibba043.dnkmem (mgr.34373) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:01 gibba003 bash[32348]: cluster 2021-03-10T14:17:00.206689+0000 mgr.gibba043.dnkmem (mgr.34373) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:01 gibba043 bash[24019]: cluster 2021-03-10T14:17:00.206689+0000 mgr.gibba043.dnkmem (mgr.34373) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:03 gibba003 bash[31385]: cluster 2021-03-10T14:17:02.208375+0000 mgr.gibba043.dnkmem (mgr.34373) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:03 gibba003 bash[32348]: cluster 2021-03-10T14:17:02.208375+0000 mgr.gibba043.dnkmem (mgr.34373) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:03 gibba043 bash[24019]: cluster 2021-03-10T14:17:02.208375+0000 mgr.gibba043.dnkmem (mgr.34373) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:05 gibba003 bash[31385]: cluster 2021-03-10T14:17:04.209992+0000 mgr.gibba043.dnkmem (mgr.34373) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:05 gibba003 bash[32348]: cluster 2021-03-10T14:17:04.209992+0000 mgr.gibba043.dnkmem (mgr.34373) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:05 gibba043 bash[24019]: cluster 2021-03-10T14:17:04.209992+0000 mgr.gibba043.dnkmem (mgr.34373) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:07 gibba003 bash[31385]: cluster 2021-03-10T14:17:06.211898+0000 mgr.gibba043.dnkmem (mgr.34373) 1415 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:07 gibba003 bash[32348]: cluster 2021-03-10T14:17:06.211898+0000 mgr.gibba043.dnkmem (mgr.34373) 1415 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:07 gibba043 bash[24019]: cluster 2021-03-10T14:17:06.211898+0000 mgr.gibba043.dnkmem (mgr.34373) 1415 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:08.392 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:17:08.619 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:17:08.619 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (25m) 83s ago 30m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:17:08.620 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (30m) 19s ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:17:08.620 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (25m) 19s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:17:08.620 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (26m) 19s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:17:08.620 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (25m) 83s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:17:08.620 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (25m) 83s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:17:08.621 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (24m) 19s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:17:08.621 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (24m) 83s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:17:08.621 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (30m) 83s ago 30m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:17:08.621 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (30m) 19s ago 30m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:17:08.622 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (23m) 83s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:17:08.622 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (23m) 83s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:17:08.622 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (22m) 83s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:17:08.622 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (22m) 83s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:17:08.622 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (22m) 19s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:17:08.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (21m) 19s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:17:08.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (21m) 19s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:17:08.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (20m) 19s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:17:08.623 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (30m) 19s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:17:08.623 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 83s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:17:08.866 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:17:08.867 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:17:08.867 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:08.867 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:17:08.867 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:17:08.867 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:08.868 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:17:08.868 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:17:08.868 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:17:08.868 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:17:08.869 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:17:08.869 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:17:08.869 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:17:08.869 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:17:08.870 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:17:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:09 gibba003 bash[31385]: cluster 2021-03-10T14:17:08.213207+0000 mgr.gibba043.dnkmem (mgr.34373) 1416 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:09 gibba003 bash[31385]: audit 2021-03-10T14:17:08.382354+0000 mgr.gibba043.dnkmem (mgr.34373) 1417 : audit [DBG] from='client.45009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:09 gibba003 bash[31385]: audit 2021-03-10T14:17:08.867095+0000 mon.c (mon.1) 421 : audit [DBG] from='client.? 172.21.2.103:0/1689483984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:09 gibba003 bash[32348]: cluster 2021-03-10T14:17:08.213207+0000 mgr.gibba043.dnkmem (mgr.34373) 1416 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:09.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:09 gibba003 bash[32348]: audit 2021-03-10T14:17:08.382354+0000 mgr.gibba043.dnkmem (mgr.34373) 1417 : audit [DBG] from='client.45009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:09.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:09 gibba003 bash[32348]: audit 2021-03-10T14:17:08.867095+0000 mon.c (mon.1) 421 : audit [DBG] from='client.? 172.21.2.103:0/1689483984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:09 gibba043 bash[24019]: cluster 2021-03-10T14:17:08.213207+0000 mgr.gibba043.dnkmem (mgr.34373) 1416 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:09 gibba043 bash[24019]: audit 2021-03-10T14:17:08.382354+0000 mgr.gibba043.dnkmem (mgr.34373) 1417 : audit [DBG] from='client.45009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:09 gibba043 bash[24019]: audit 2021-03-10T14:17:08.867095+0000 mon.c (mon.1) 421 : audit [DBG] from='client.? 172.21.2.103:0/1689483984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:10.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:10 gibba003 bash[31385]: audit 2021-03-10T14:17:08.606248+0000 mgr.gibba043.dnkmem (mgr.34373) 1418 : audit [DBG] from='client.55000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:10.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:10 gibba003 bash[31385]: cephadm 2021-03-10T14:17:08.983849+0000 mgr.gibba043.dnkmem (mgr.34373) 1419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:10.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:10 gibba003 bash[32348]: audit 2021-03-10T14:17:08.606248+0000 mgr.gibba043.dnkmem (mgr.34373) 1418 : audit [DBG] from='client.55000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:10.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:10 gibba003 bash[32348]: cephadm 2021-03-10T14:17:08.983849+0000 mgr.gibba043.dnkmem (mgr.34373) 1419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:10.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:10 gibba043 bash[24019]: audit 2021-03-10T14:17:08.606248+0000 mgr.gibba043.dnkmem (mgr.34373) 1418 : audit [DBG] from='client.55000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:10.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:10 gibba043 bash[24019]: cephadm 2021-03-10T14:17:08.983849+0000 mgr.gibba043.dnkmem (mgr.34373) 1419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:11 gibba003 bash[31385]: cluster 2021-03-10T14:17:10.214541+0000 mgr.gibba043.dnkmem (mgr.34373) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:11 gibba003 bash[32348]: cluster 2021-03-10T14:17:10.214541+0000 mgr.gibba043.dnkmem (mgr.34373) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:11 gibba043 bash[24019]: cluster 2021-03-10T14:17:10.214541+0000 mgr.gibba043.dnkmem (mgr.34373) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: cluster 2021-03-10T14:17:12.216175+0000 mgr.gibba043.dnkmem (mgr.34373) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.795866+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:17:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.796113+0000 mon.c (mon.1) 423 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:17:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.796349+0000 mon.c (mon.1) 424 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.796452+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:17:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.796584+0000 mon.c (mon.1) 425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.796841+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:17:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.797184+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.797448+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.885922+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.887128+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.924205+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[31385]: audit 2021-03-10T14:17:12.925350+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: cluster 2021-03-10T14:17:12.216175+0000 mgr.gibba043.dnkmem (mgr.34373) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.795866+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:17:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.796113+0000 mon.c (mon.1) 423 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:17:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.796349+0000 mon.c (mon.1) 424 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.796452+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:17:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.796584+0000 mon.c (mon.1) 425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.796841+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:17:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.797184+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.797448+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.885922+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.887128+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.924205+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:13 gibba003 bash[32348]: audit 2021-03-10T14:17:12.925350+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: cluster 2021-03-10T14:17:12.216175+0000 mgr.gibba043.dnkmem (mgr.34373) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.795866+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:17:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.796113+0000 mon.c (mon.1) 423 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:17:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.796349+0000 mon.c (mon.1) 424 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.796452+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:17:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.796584+0000 mon.c (mon.1) 425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.796841+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:17:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.797184+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.797448+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:17:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.885922+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.887128+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.924205+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:13 gibba043 bash[24019]: audit 2021-03-10T14:17:12.925350+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:15 gibba003 bash[31385]: cluster 2021-03-10T14:17:14.217657+0000 mgr.gibba043.dnkmem (mgr.34373) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:15 gibba003 bash[32348]: cluster 2021-03-10T14:17:14.217657+0000 mgr.gibba043.dnkmem (mgr.34373) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:15 gibba043 bash[24019]: cluster 2021-03-10T14:17:14.217657+0000 mgr.gibba043.dnkmem (mgr.34373) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:17 gibba003 bash[31385]: cluster 2021-03-10T14:17:16.219541+0000 mgr.gibba043.dnkmem (mgr.34373) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:17 gibba003 bash[32348]: cluster 2021-03-10T14:17:16.219541+0000 mgr.gibba043.dnkmem (mgr.34373) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:17 gibba043 bash[24019]: cluster 2021-03-10T14:17:16.219541+0000 mgr.gibba043.dnkmem (mgr.34373) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:19 gibba003 bash[31385]: cluster 2021-03-10T14:17:18.220878+0000 mgr.gibba043.dnkmem (mgr.34373) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:19 gibba003 bash[32348]: cluster 2021-03-10T14:17:18.220878+0000 mgr.gibba043.dnkmem (mgr.34373) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:19 gibba043 bash[24019]: cluster 2021-03-10T14:17:18.220878+0000 mgr.gibba043.dnkmem (mgr.34373) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:21 gibba003 bash[31385]: cluster 2021-03-10T14:17:20.222408+0000 mgr.gibba043.dnkmem (mgr.34373) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:21 gibba003 bash[32348]: cluster 2021-03-10T14:17:20.222408+0000 mgr.gibba043.dnkmem (mgr.34373) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:21 gibba043 bash[24019]: cluster 2021-03-10T14:17:20.222408+0000 mgr.gibba043.dnkmem (mgr.34373) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:23 gibba003 bash[31385]: cluster 2021-03-10T14:17:22.224030+0000 mgr.gibba043.dnkmem (mgr.34373) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:23 gibba003 bash[32348]: cluster 2021-03-10T14:17:22.224030+0000 mgr.gibba043.dnkmem (mgr.34373) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:23 gibba043 bash[24019]: cluster 2021-03-10T14:17:22.224030+0000 mgr.gibba043.dnkmem (mgr.34373) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:25 gibba003 bash[31385]: cephadm 2021-03-10T14:17:23.996461+0000 mgr.gibba043.dnkmem (mgr.34373) 1427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:25.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:25 gibba003 bash[31385]: cluster 2021-03-10T14:17:24.225703+0000 mgr.gibba043.dnkmem (mgr.34373) 1428 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:25 gibba003 bash[32348]: cephadm 2021-03-10T14:17:23.996461+0000 mgr.gibba043.dnkmem (mgr.34373) 1427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:25 gibba003 bash[32348]: cluster 2021-03-10T14:17:24.225703+0000 mgr.gibba043.dnkmem (mgr.34373) 1428 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:25 gibba043 bash[24019]: cephadm 2021-03-10T14:17:23.996461+0000 mgr.gibba043.dnkmem (mgr.34373) 1427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:25 gibba043 bash[24019]: cluster 2021-03-10T14:17:24.225703+0000 mgr.gibba043.dnkmem (mgr.34373) 1428 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:27 gibba003 bash[31385]: cluster 2021-03-10T14:17:26.227962+0000 mgr.gibba043.dnkmem (mgr.34373) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:27 gibba003 bash[32348]: cluster 2021-03-10T14:17:26.227962+0000 mgr.gibba043.dnkmem (mgr.34373) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:27 gibba043 bash[24019]: cluster 2021-03-10T14:17:26.227962+0000 mgr.gibba043.dnkmem (mgr.34373) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:29 gibba003 bash[31385]: cluster 2021-03-10T14:17:28.229491+0000 mgr.gibba043.dnkmem (mgr.34373) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:29 gibba003 bash[32348]: cluster 2021-03-10T14:17:28.229491+0000 mgr.gibba043.dnkmem (mgr.34373) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:29 gibba043 bash[24019]: cluster 2021-03-10T14:17:28.229491+0000 mgr.gibba043.dnkmem (mgr.34373) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:31 gibba043 bash[24019]: cluster 2021-03-10T14:17:30.230841+0000 mgr.gibba043.dnkmem (mgr.34373) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:31 gibba003 bash[31385]: cluster 2021-03-10T14:17:30.230841+0000 mgr.gibba043.dnkmem (mgr.34373) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:31 gibba003 bash[32348]: cluster 2021-03-10T14:17:30.230841+0000 mgr.gibba043.dnkmem (mgr.34373) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:33 gibba043 bash[24019]: cluster 2021-03-10T14:17:32.232515+0000 mgr.gibba043.dnkmem (mgr.34373) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:33 gibba003 bash[31385]: cluster 2021-03-10T14:17:32.232515+0000 mgr.gibba043.dnkmem (mgr.34373) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:33 gibba003 bash[32348]: cluster 2021-03-10T14:17:32.232515+0000 mgr.gibba043.dnkmem (mgr.34373) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:35 gibba043 bash[24019]: cluster 2021-03-10T14:17:34.233866+0000 mgr.gibba043.dnkmem (mgr.34373) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:35 gibba003 bash[31385]: cluster 2021-03-10T14:17:34.233866+0000 mgr.gibba043.dnkmem (mgr.34373) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:35 gibba003 bash[32348]: cluster 2021-03-10T14:17:34.233866+0000 mgr.gibba043.dnkmem (mgr.34373) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:37 gibba043 bash[24019]: cluster 2021-03-10T14:17:36.235861+0000 mgr.gibba043.dnkmem (mgr.34373) 1434 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:37 gibba003 bash[31385]: cluster 2021-03-10T14:17:36.235861+0000 mgr.gibba043.dnkmem (mgr.34373) 1434 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:37 gibba003 bash[32348]: cluster 2021-03-10T14:17:36.235861+0000 mgr.gibba043.dnkmem (mgr.34373) 1434 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:39.110 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:17:39.342 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:17:39.342 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (26m) 113s ago 31m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:17:39.343 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (31m) 49s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:17:39.343 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (26m) 49s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:17:39.343 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (26m) 49s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:17:39.343 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (25m) 113s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:17:39.344 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (25m) 113s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:17:39.344 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (25m) 49s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:17:39.344 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (25m) 113s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:17:39.344 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (31m) 113s ago 31m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:17:39.345 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (31m) 49s ago 31m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:17:39.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (24m) 113s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:17:39.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (23m) 113s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:17:39.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (23m) 113s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:17:39.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (23m) 113s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:17:39.346 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (22m) 49s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:17:39.346 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (22m) 49s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:17:39.346 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (21m) 49s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:17:39.346 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (21m) 49s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:17:39.347 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (30m) 49s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:17:39.347 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 113s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:17:39.592 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:17:39.593 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:17:39.593 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:39.593 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:17:39.593 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:17:39.594 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:39.594 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:17:39.594 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:17:39.594 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:17:39.594 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:17:39.595 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:17:39.595 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:17:39.595 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:17:39.595 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:17:39.596 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:17:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:39 gibba043 bash[24019]: cluster 2021-03-10T14:17:38.237477+0000 mgr.gibba043.dnkmem (mgr.34373) 1435 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:39 gibba003 bash[31385]: cluster 2021-03-10T14:17:38.237477+0000 mgr.gibba043.dnkmem (mgr.34373) 1435 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:39.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:39 gibba003 bash[32348]: cluster 2021-03-10T14:17:38.237477+0000 mgr.gibba043.dnkmem (mgr.34373) 1435 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:40.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:40 gibba043 bash[24019]: cephadm 2021-03-10T14:17:39.000746+0000 mgr.gibba043.dnkmem (mgr.34373) 1436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:40.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:40 gibba043 bash[24019]: audit 2021-03-10T14:17:39.101285+0000 mgr.gibba043.dnkmem (mgr.34373) 1437 : audit [DBG] from='client.55012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:40.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:40 gibba043 bash[24019]: audit 2021-03-10T14:17:39.328865+0000 mgr.gibba043.dnkmem (mgr.34373) 1438 : audit [DBG] from='client.55018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:40.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:40 gibba043 bash[24019]: audit 2021-03-10T14:17:39.593457+0000 mon.c (mon.1) 428 : audit [DBG] from='client.? 172.21.2.103:0/516483031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[31385]: cephadm 2021-03-10T14:17:39.000746+0000 mgr.gibba043.dnkmem (mgr.34373) 1436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:40.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[31385]: audit 2021-03-10T14:17:39.101285+0000 mgr.gibba043.dnkmem (mgr.34373) 1437 : audit [DBG] from='client.55012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:40.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[31385]: audit 2021-03-10T14:17:39.328865+0000 mgr.gibba043.dnkmem (mgr.34373) 1438 : audit [DBG] from='client.55018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:40.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[31385]: audit 2021-03-10T14:17:39.593457+0000 mon.c (mon.1) 428 : audit [DBG] from='client.? 172.21.2.103:0/516483031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[32348]: cephadm 2021-03-10T14:17:39.000746+0000 mgr.gibba043.dnkmem (mgr.34373) 1436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:40.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[32348]: audit 2021-03-10T14:17:39.101285+0000 mgr.gibba043.dnkmem (mgr.34373) 1437 : audit [DBG] from='client.55012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:40.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[32348]: audit 2021-03-10T14:17:39.328865+0000 mgr.gibba043.dnkmem (mgr.34373) 1438 : audit [DBG] from='client.55018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:40.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:40 gibba003 bash[32348]: audit 2021-03-10T14:17:39.593457+0000 mon.c (mon.1) 428 : audit [DBG] from='client.? 172.21.2.103:0/516483031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:41 gibba043 bash[24019]: cluster 2021-03-10T14:17:40.238876+0000 mgr.gibba043.dnkmem (mgr.34373) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:41 gibba003 bash[31385]: cluster 2021-03-10T14:17:40.238876+0000 mgr.gibba043.dnkmem (mgr.34373) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:41 gibba003 bash[32348]: cluster 2021-03-10T14:17:40.238876+0000 mgr.gibba043.dnkmem (mgr.34373) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:43 gibba043 bash[24019]: cluster 2021-03-10T14:17:42.240354+0000 mgr.gibba043.dnkmem (mgr.34373) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:43 gibba003 bash[31385]: cluster 2021-03-10T14:17:42.240354+0000 mgr.gibba043.dnkmem (mgr.34373) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:43 gibba003 bash[32348]: cluster 2021-03-10T14:17:42.240354+0000 mgr.gibba043.dnkmem (mgr.34373) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:45 gibba043 bash[24019]: cluster 2021-03-10T14:17:44.241978+0000 mgr.gibba043.dnkmem (mgr.34373) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:45 gibba003 bash[31385]: cluster 2021-03-10T14:17:44.241978+0000 mgr.gibba043.dnkmem (mgr.34373) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:45 gibba003 bash[32348]: cluster 2021-03-10T14:17:44.241978+0000 mgr.gibba043.dnkmem (mgr.34373) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:47 gibba003 bash[31385]: cluster 2021-03-10T14:17:46.243875+0000 mgr.gibba043.dnkmem (mgr.34373) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:47 gibba003 bash[32348]: cluster 2021-03-10T14:17:46.243875+0000 mgr.gibba043.dnkmem (mgr.34373) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:47 gibba043 bash[24019]: cluster 2021-03-10T14:17:46.243875+0000 mgr.gibba043.dnkmem (mgr.34373) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:49 gibba003 bash[31385]: cluster 2021-03-10T14:17:48.245240+0000 mgr.gibba043.dnkmem (mgr.34373) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:49 gibba003 bash[32348]: cluster 2021-03-10T14:17:48.245240+0000 mgr.gibba043.dnkmem (mgr.34373) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:49 gibba043 bash[24019]: cluster 2021-03-10T14:17:48.245240+0000 mgr.gibba043.dnkmem (mgr.34373) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:51 gibba003 bash[31385]: cluster 2021-03-10T14:17:50.246476+0000 mgr.gibba043.dnkmem (mgr.34373) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:51 gibba003 bash[32348]: cluster 2021-03-10T14:17:50.246476+0000 mgr.gibba043.dnkmem (mgr.34373) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:51 gibba043 bash[24019]: cluster 2021-03-10T14:17:50.246476+0000 mgr.gibba043.dnkmem (mgr.34373) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:53 gibba003 bash[31385]: cluster 2021-03-10T14:17:52.247846+0000 mgr.gibba043.dnkmem (mgr.34373) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:53 gibba003 bash[32348]: cluster 2021-03-10T14:17:52.247846+0000 mgr.gibba043.dnkmem (mgr.34373) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:53 gibba043 bash[24019]: cluster 2021-03-10T14:17:52.247846+0000 mgr.gibba043.dnkmem (mgr.34373) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.017622+0000 mgr.gibba043.dnkmem (mgr.34373) 1446 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:17:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.019252+0000 mgr.gibba043.dnkmem (mgr.34373) 1447 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:17:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.225795+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:17:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.227078+0000 mgr.gibba043.dnkmem (mgr.34373) 1448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.228837+0000 mgr.gibba043.dnkmem (mgr.34373) 1449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.229249+0000 mon.c (mon.1) 429 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.230383+0000 mgr.gibba043.dnkmem (mgr.34373) 1450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.230421+0000 mgr.gibba043.dnkmem (mgr.34373) 1451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.230883+0000 mon.c (mon.1) 430 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.231749+0000 mgr.gibba043.dnkmem (mgr.34373) 1452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:55.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.231803+0000 mgr.gibba043.dnkmem (mgr.34373) 1453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:55.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.232503+0000 mon.c (mon.1) 431 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.233257+0000 mgr.gibba043.dnkmem (mgr.34373) 1454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:55.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.233798+0000 mon.c (mon.1) 432 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.234956+0000 mgr.gibba043.dnkmem (mgr.34373) 1455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:55.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.234996+0000 mgr.gibba043.dnkmem (mgr.34373) 1456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:55.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.236296+0000 mgr.gibba043.dnkmem (mgr.34373) 1457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:55.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.236663+0000 mgr.gibba043.dnkmem (mgr.34373) 1458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:55.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.236912+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.237964+0000 mgr.gibba043.dnkmem (mgr.34373) 1459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:55.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.238002+0000 mgr.gibba043.dnkmem (mgr.34373) 1460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:55.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cephadm 2021-03-10T14:17:54.238109+0000 mgr.gibba043.dnkmem (mgr.34373) 1461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:55.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: audit 2021-03-10T14:17:54.238600+0000 mon.c (mon.1) 434 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:55 gibba043 bash[24019]: cluster 2021-03-10T14:17:54.248464+0000 mgr.gibba043.dnkmem (mgr.34373) 1462 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.017622+0000 mgr.gibba043.dnkmem (mgr.34373) 1446 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:17:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.019252+0000 mgr.gibba043.dnkmem (mgr.34373) 1447 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:17:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.225795+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:17:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.227078+0000 mgr.gibba043.dnkmem (mgr.34373) 1448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.228837+0000 mgr.gibba043.dnkmem (mgr.34373) 1449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.229249+0000 mon.c (mon.1) 429 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.230383+0000 mgr.gibba043.dnkmem (mgr.34373) 1450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.230421+0000 mgr.gibba043.dnkmem (mgr.34373) 1451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.230883+0000 mon.c (mon.1) 430 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.231749+0000 mgr.gibba043.dnkmem (mgr.34373) 1452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.231803+0000 mgr.gibba043.dnkmem (mgr.34373) 1453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:55.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.232503+0000 mon.c (mon.1) 431 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.233257+0000 mgr.gibba043.dnkmem (mgr.34373) 1454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:55.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.233798+0000 mon.c (mon.1) 432 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.234956+0000 mgr.gibba043.dnkmem (mgr.34373) 1455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:55.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.234996+0000 mgr.gibba043.dnkmem (mgr.34373) 1456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:55.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.236296+0000 mgr.gibba043.dnkmem (mgr.34373) 1457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:55.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.236663+0000 mgr.gibba043.dnkmem (mgr.34373) 1458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:55.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.236912+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.237964+0000 mgr.gibba043.dnkmem (mgr.34373) 1459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:55.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.238002+0000 mgr.gibba043.dnkmem (mgr.34373) 1460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:55.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.017622+0000 mgr.gibba043.dnkmem (mgr.34373) 1446 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:17:55.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.019252+0000 mgr.gibba043.dnkmem (mgr.34373) 1447 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:17:55.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.225795+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:17:55.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.227078+0000 mgr.gibba043.dnkmem (mgr.34373) 1448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:55.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.228837+0000 mgr.gibba043.dnkmem (mgr.34373) 1449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:55.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.229249+0000 mon.c (mon.1) 429 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:55.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.230383+0000 mgr.gibba043.dnkmem (mgr.34373) 1450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:55.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.230421+0000 mgr.gibba043.dnkmem (mgr.34373) 1451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:55.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.230883+0000 mon.c (mon.1) 430 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.231749+0000 mgr.gibba043.dnkmem (mgr.34373) 1452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:55.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.231803+0000 mgr.gibba043.dnkmem (mgr.34373) 1453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:55.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.232503+0000 mon.c (mon.1) 431 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.233257+0000 mgr.gibba043.dnkmem (mgr.34373) 1454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:55.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.233798+0000 mon.c (mon.1) 432 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.234956+0000 mgr.gibba043.dnkmem (mgr.34373) 1455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:55.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.234996+0000 mgr.gibba043.dnkmem (mgr.34373) 1456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:55.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.236296+0000 mgr.gibba043.dnkmem (mgr.34373) 1457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:55.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.236663+0000 mgr.gibba043.dnkmem (mgr.34373) 1458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:55.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.236912+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.237964+0000 mgr.gibba043.dnkmem (mgr.34373) 1459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:55.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.238002+0000 mgr.gibba043.dnkmem (mgr.34373) 1460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:55.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cephadm 2021-03-10T14:17:54.238109+0000 mgr.gibba043.dnkmem (mgr.34373) 1461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:55.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: audit 2021-03-10T14:17:54.238600+0000 mon.c (mon.1) 434 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[31385]: cluster 2021-03-10T14:17:54.248464+0000 mgr.gibba043.dnkmem (mgr.34373) 1462 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:55.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cephadm 2021-03-10T14:17:54.238109+0000 mgr.gibba043.dnkmem (mgr.34373) 1461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:17:55.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: audit 2021-03-10T14:17:54.238600+0000 mon.c (mon.1) 434 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:55.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:55 gibba003 bash[32348]: cluster 2021-03-10T14:17:54.248464+0000 mgr.gibba043.dnkmem (mgr.34373) 1462 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:57 gibba003 bash[31385]: cluster 2021-03-10T14:17:56.249974+0000 mgr.gibba043.dnkmem (mgr.34373) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:57 gibba003 bash[32348]: cluster 2021-03-10T14:17:56.249974+0000 mgr.gibba043.dnkmem (mgr.34373) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:57 gibba043 bash[24019]: cluster 2021-03-10T14:17:56.249974+0000 mgr.gibba043.dnkmem (mgr.34373) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:17:59 gibba003 bash[31385]: cluster 2021-03-10T14:17:58.251462+0000 mgr.gibba043.dnkmem (mgr.34373) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:59.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:17:59 gibba003 bash[32348]: cluster 2021-03-10T14:17:58.251462+0000 mgr.gibba043.dnkmem (mgr.34373) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:17:59 gibba043 bash[24019]: cluster 2021-03-10T14:17:58.251462+0000 mgr.gibba043.dnkmem (mgr.34373) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:01 gibba003 bash[31385]: cluster 2021-03-10T14:18:00.252876+0000 mgr.gibba043.dnkmem (mgr.34373) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:01.719 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:01 gibba003 bash[32348]: cluster 2021-03-10T14:18:00.252876+0000 mgr.gibba043.dnkmem (mgr.34373) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:01 gibba043 bash[24019]: cluster 2021-03-10T14:18:00.252876+0000 mgr.gibba043.dnkmem (mgr.34373) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:03.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:03 gibba003 bash[32348]: cluster 2021-03-10T14:18:02.254368+0000 mgr.gibba043.dnkmem (mgr.34373) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:03.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:03 gibba003 bash[31385]: cluster 2021-03-10T14:18:02.254368+0000 mgr.gibba043.dnkmem (mgr.34373) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:03 gibba043 bash[24019]: cluster 2021-03-10T14:18:02.254368+0000 mgr.gibba043.dnkmem (mgr.34373) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:05 gibba003 bash[31385]: cluster 2021-03-10T14:18:04.255770+0000 mgr.gibba043.dnkmem (mgr.34373) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:05 gibba003 bash[32348]: cluster 2021-03-10T14:18:04.255770+0000 mgr.gibba043.dnkmem (mgr.34373) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:05 gibba043 bash[24019]: cluster 2021-03-10T14:18:04.255770+0000 mgr.gibba043.dnkmem (mgr.34373) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:07 gibba003 bash[31385]: cluster 2021-03-10T14:18:06.257547+0000 mgr.gibba043.dnkmem (mgr.34373) 1468 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:07 gibba003 bash[32348]: cluster 2021-03-10T14:18:06.257547+0000 mgr.gibba043.dnkmem (mgr.34373) 1468 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:07 gibba043 bash[24019]: cluster 2021-03-10T14:18:06.257547+0000 mgr.gibba043.dnkmem (mgr.34373) 1468 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:09 gibba043 bash[24019]: cluster 2021-03-10T14:18:08.259089+0000 mgr.gibba043.dnkmem (mgr.34373) 1469 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:09 gibba003 bash[31385]: cluster 2021-03-10T14:18:08.259089+0000 mgr.gibba043.dnkmem (mgr.34373) 1469 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:09 gibba003 bash[32348]: cluster 2021-03-10T14:18:08.259089+0000 mgr.gibba043.dnkmem (mgr.34373) 1469 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.834 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:18:10.058 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:18:10.059 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (26m) 2m ago 31m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:18:10.059 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (31m) 80s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:18:10.059 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (26m) 80s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:18:10.060 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (27m) 80s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:18:10.060 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:18:10.060 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:18:10.060 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (25m) 80s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:18:10.061 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:18:10.061 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (31m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:18:10.061 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (31m) 80s ago 32m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:18:10.061 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:18:10.061 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:18:10.062 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:18:10.062 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:18:10.062 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (23m) 80s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:18:10.062 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (22m) 80s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:18:10.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (22m) 80s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:18:10.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (21m) 80s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:18:10.063 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (31m) 80s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:18:10.063 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:18:10.308 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:18:10.308 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:18:10.308 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:10.309 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:18:10.309 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:18:10.309 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:10.309 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:18:10.310 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:18:10.310 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:18:10.310 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:18:10.310 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:18:10.311 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:18:10.311 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:18:10.311 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:18:10.311 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:18:10.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:10 gibba003 bash[31385]: cephadm 2021-03-10T14:18:09.252438+0000 mgr.gibba043.dnkmem (mgr.34373) 1470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:10.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:10 gibba003 bash[31385]: audit 2021-03-10T14:18:10.308797+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.2.103:0/1432207329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:10.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:10 gibba003 bash[32348]: cephadm 2021-03-10T14:18:09.252438+0000 mgr.gibba043.dnkmem (mgr.34373) 1470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:10.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:10 gibba003 bash[32348]: audit 2021-03-10T14:18:10.308797+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.2.103:0/1432207329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:10.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:10 gibba043 bash[24019]: cephadm 2021-03-10T14:18:09.252438+0000 mgr.gibba043.dnkmem (mgr.34373) 1470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:10.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:10 gibba043 bash[24019]: audit 2021-03-10T14:18:10.308797+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.2.103:0/1432207329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:11 gibba003 bash[31385]: audit 2021-03-10T14:18:09.823992+0000 mgr.gibba043.dnkmem (mgr.34373) 1471 : audit [DBG] from='client.45045 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:11 gibba003 bash[31385]: audit 2021-03-10T14:18:10.047088+0000 mgr.gibba043.dnkmem (mgr.34373) 1472 : audit [DBG] from='client.45051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:11.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:11 gibba003 bash[31385]: cluster 2021-03-10T14:18:10.260355+0000 mgr.gibba043.dnkmem (mgr.34373) 1473 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:11 gibba003 bash[32348]: audit 2021-03-10T14:18:09.823992+0000 mgr.gibba043.dnkmem (mgr.34373) 1471 : audit [DBG] from='client.45045 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:11 gibba003 bash[32348]: audit 2021-03-10T14:18:10.047088+0000 mgr.gibba043.dnkmem (mgr.34373) 1472 : audit [DBG] from='client.45051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:11 gibba003 bash[32348]: cluster 2021-03-10T14:18:10.260355+0000 mgr.gibba043.dnkmem (mgr.34373) 1473 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:11 gibba043 bash[24019]: audit 2021-03-10T14:18:09.823992+0000 mgr.gibba043.dnkmem (mgr.34373) 1471 : audit [DBG] from='client.45045 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:11 gibba043 bash[24019]: audit 2021-03-10T14:18:10.047088+0000 mgr.gibba043.dnkmem (mgr.34373) 1472 : audit [DBG] from='client.45051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:11 gibba043 bash[24019]: cluster 2021-03-10T14:18:10.260355+0000 mgr.gibba043.dnkmem (mgr.34373) 1473 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: cluster 2021-03-10T14:18:12.261905+0000 mgr.gibba043.dnkmem (mgr.34373) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.806618+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.807692+0000 mon.c (mon.1) 436 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:18:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.807845+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.808619+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.808887+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:18:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.809854+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.809961+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.811004+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.893114+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.894110+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.932739+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[31385]: audit 2021-03-10T14:18:12.933861+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: cluster 2021-03-10T14:18:12.261905+0000 mgr.gibba043.dnkmem (mgr.34373) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.806618+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.807692+0000 mon.c (mon.1) 436 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:18:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.807845+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.808619+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.808887+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:18:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.809854+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.809961+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.811004+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.893114+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.894110+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.932739+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:13 gibba003 bash[32348]: audit 2021-03-10T14:18:12.933861+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: cluster 2021-03-10T14:18:12.261905+0000 mgr.gibba043.dnkmem (mgr.34373) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.806618+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.807692+0000 mon.c (mon.1) 436 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:18:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.807845+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.808619+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.808887+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:18:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.809854+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.809961+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.811004+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:18:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.893114+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.894110+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.932739+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:13 gibba043 bash[24019]: audit 2021-03-10T14:18:12.933861+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:15 gibba003 bash[31385]: cluster 2021-03-10T14:18:14.263409+0000 mgr.gibba043.dnkmem (mgr.34373) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:15 gibba003 bash[32348]: cluster 2021-03-10T14:18:14.263409+0000 mgr.gibba043.dnkmem (mgr.34373) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:15 gibba043 bash[24019]: cluster 2021-03-10T14:18:14.263409+0000 mgr.gibba043.dnkmem (mgr.34373) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:17 gibba003 bash[31385]: cluster 2021-03-10T14:18:16.265189+0000 mgr.gibba043.dnkmem (mgr.34373) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:17 gibba003 bash[32348]: cluster 2021-03-10T14:18:16.265189+0000 mgr.gibba043.dnkmem (mgr.34373) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:17 gibba043 bash[24019]: cluster 2021-03-10T14:18:16.265189+0000 mgr.gibba043.dnkmem (mgr.34373) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:19 gibba003 bash[31385]: cluster 2021-03-10T14:18:18.266668+0000 mgr.gibba043.dnkmem (mgr.34373) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:19 gibba003 bash[32348]: cluster 2021-03-10T14:18:18.266668+0000 mgr.gibba043.dnkmem (mgr.34373) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:19 gibba043 bash[24019]: cluster 2021-03-10T14:18:18.266668+0000 mgr.gibba043.dnkmem (mgr.34373) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:21 gibba003 bash[31385]: cluster 2021-03-10T14:18:20.268229+0000 mgr.gibba043.dnkmem (mgr.34373) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:21 gibba003 bash[32348]: cluster 2021-03-10T14:18:20.268229+0000 mgr.gibba043.dnkmem (mgr.34373) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:21 gibba043 bash[24019]: cluster 2021-03-10T14:18:20.268229+0000 mgr.gibba043.dnkmem (mgr.34373) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:23 gibba043 bash[24019]: cluster 2021-03-10T14:18:22.269611+0000 mgr.gibba043.dnkmem (mgr.34373) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:23 gibba003 bash[31385]: cluster 2021-03-10T14:18:22.269611+0000 mgr.gibba043.dnkmem (mgr.34373) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:23 gibba003 bash[32348]: cluster 2021-03-10T14:18:22.269611+0000 mgr.gibba043.dnkmem (mgr.34373) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:25 gibba043 bash[24019]: cephadm 2021-03-10T14:18:24.268409+0000 mgr.gibba043.dnkmem (mgr.34373) 1480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:25 gibba043 bash[24019]: cluster 2021-03-10T14:18:24.270937+0000 mgr.gibba043.dnkmem (mgr.34373) 1481 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:25 gibba003 bash[31385]: cephadm 2021-03-10T14:18:24.268409+0000 mgr.gibba043.dnkmem (mgr.34373) 1480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:25 gibba003 bash[31385]: cluster 2021-03-10T14:18:24.270937+0000 mgr.gibba043.dnkmem (mgr.34373) 1481 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:25 gibba003 bash[32348]: cephadm 2021-03-10T14:18:24.268409+0000 mgr.gibba043.dnkmem (mgr.34373) 1480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:25 gibba003 bash[32348]: cluster 2021-03-10T14:18:24.270937+0000 mgr.gibba043.dnkmem (mgr.34373) 1481 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:27 gibba043 bash[24019]: cluster 2021-03-10T14:18:26.272854+0000 mgr.gibba043.dnkmem (mgr.34373) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:27 gibba003 bash[31385]: cluster 2021-03-10T14:18:26.272854+0000 mgr.gibba043.dnkmem (mgr.34373) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:27 gibba003 bash[32348]: cluster 2021-03-10T14:18:26.272854+0000 mgr.gibba043.dnkmem (mgr.34373) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:29 gibba043 bash[24019]: cluster 2021-03-10T14:18:28.274359+0000 mgr.gibba043.dnkmem (mgr.34373) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:29 gibba003 bash[31385]: cluster 2021-03-10T14:18:28.274359+0000 mgr.gibba043.dnkmem (mgr.34373) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:29 gibba003 bash[32348]: cluster 2021-03-10T14:18:28.274359+0000 mgr.gibba043.dnkmem (mgr.34373) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:31 gibba043 bash[24019]: cluster 2021-03-10T14:18:30.275952+0000 mgr.gibba043.dnkmem (mgr.34373) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:31 gibba003 bash[31385]: cluster 2021-03-10T14:18:30.275952+0000 mgr.gibba043.dnkmem (mgr.34373) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:31 gibba003 bash[32348]: cluster 2021-03-10T14:18:30.275952+0000 mgr.gibba043.dnkmem (mgr.34373) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:33 gibba043 bash[24019]: cluster 2021-03-10T14:18:32.277626+0000 mgr.gibba043.dnkmem (mgr.34373) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:33 gibba003 bash[31385]: cluster 2021-03-10T14:18:32.277626+0000 mgr.gibba043.dnkmem (mgr.34373) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:33 gibba003 bash[32348]: cluster 2021-03-10T14:18:32.277626+0000 mgr.gibba043.dnkmem (mgr.34373) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:35 gibba043 bash[24019]: cluster 2021-03-10T14:18:34.279281+0000 mgr.gibba043.dnkmem (mgr.34373) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:35 gibba003 bash[31385]: cluster 2021-03-10T14:18:34.279281+0000 mgr.gibba043.dnkmem (mgr.34373) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:35 gibba003 bash[32348]: cluster 2021-03-10T14:18:34.279281+0000 mgr.gibba043.dnkmem (mgr.34373) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:37 gibba043 bash[24019]: cluster 2021-03-10T14:18:36.281174+0000 mgr.gibba043.dnkmem (mgr.34373) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:37 gibba003 bash[31385]: cluster 2021-03-10T14:18:36.281174+0000 mgr.gibba043.dnkmem (mgr.34373) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:37 gibba003 bash[32348]: cluster 2021-03-10T14:18:36.281174+0000 mgr.gibba043.dnkmem (mgr.34373) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:39 gibba043 bash[24019]: cluster 2021-03-10T14:18:38.282645+0000 mgr.gibba043.dnkmem (mgr.34373) 1488 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:39 gibba003 bash[31385]: cluster 2021-03-10T14:18:38.282645+0000 mgr.gibba043.dnkmem (mgr.34373) 1488 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:39 gibba003 bash[32348]: cluster 2021-03-10T14:18:38.282645+0000 mgr.gibba043.dnkmem (mgr.34373) 1488 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:40.551 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:18:40.782 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:18:40.782 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (27m) 2m ago 32m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:18:40.782 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (32m) 111s ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:18:40.783 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (27m) 111s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:18:40.783 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (27m) 111s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:18:40.783 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:18:40.783 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:18:40.783 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (26m) 111s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:18:40.784 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:18:40.784 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:18:40.784 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (32m) 111s ago 32m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:18:40.784 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:18:40.785 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:18:40.785 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:18:40.785 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:18:40.785 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (23m) 111s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:18:40.786 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (23m) 111s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:18:40.786 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (22m) 111s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:18:40.786 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (22m) 111s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:18:40.786 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (31m) 111s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:18:40.787 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:18:40.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:40 gibba003 bash[31385]: cephadm 2021-03-10T14:18:39.284220+0000 mgr.gibba043.dnkmem (mgr.34373) 1489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:40.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:40 gibba003 bash[32348]: cephadm 2021-03-10T14:18:39.284220+0000 mgr.gibba043.dnkmem (mgr.34373) 1489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:41.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:40 gibba043 bash[24019]: cephadm 2021-03-10T14:18:39.284220+0000 mgr.gibba043.dnkmem (mgr.34373) 1489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:41.032 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:18:41.032 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:18:41.032 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:41.033 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:18:41.033 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:18:41.033 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:41.033 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:18:41.034 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:18:41.034 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:18:41.034 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:18:41.034 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:18:41.035 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:18:41.035 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:18:41.035 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:18:41.035 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:18:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:41 gibba003 bash[31385]: cluster 2021-03-10T14:18:40.284237+0000 mgr.gibba043.dnkmem (mgr.34373) 1490 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:41 gibba003 bash[31385]: audit 2021-03-10T14:18:40.542217+0000 mgr.gibba043.dnkmem (mgr.34373) 1491 : audit [DBG] from='client.45063 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:41.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:41 gibba003 bash[31385]: audit 2021-03-10T14:18:41.033019+0000 mon.c (mon.1) 441 : audit [DBG] from='client.? 172.21.2.103:0/1146193665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:41 gibba003 bash[32348]: cluster 2021-03-10T14:18:40.284237+0000 mgr.gibba043.dnkmem (mgr.34373) 1490 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:41 gibba003 bash[32348]: audit 2021-03-10T14:18:40.542217+0000 mgr.gibba043.dnkmem (mgr.34373) 1491 : audit [DBG] from='client.45063 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:41.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:41 gibba003 bash[32348]: audit 2021-03-10T14:18:41.033019+0000 mon.c (mon.1) 441 : audit [DBG] from='client.? 172.21.2.103:0/1146193665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:41 gibba043 bash[24019]: cluster 2021-03-10T14:18:40.284237+0000 mgr.gibba043.dnkmem (mgr.34373) 1490 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:41 gibba043 bash[24019]: audit 2021-03-10T14:18:40.542217+0000 mgr.gibba043.dnkmem (mgr.34373) 1491 : audit [DBG] from='client.45063 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:42.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:41 gibba043 bash[24019]: audit 2021-03-10T14:18:41.033019+0000 mon.c (mon.1) 441 : audit [DBG] from='client.? 172.21.2.103:0/1146193665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:42 gibba003 bash[31385]: audit 2021-03-10T14:18:40.769021+0000 mgr.gibba043.dnkmem (mgr.34373) 1492 : audit [DBG] from='client.55054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:42.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:42 gibba003 bash[32348]: audit 2021-03-10T14:18:40.769021+0000 mgr.gibba043.dnkmem (mgr.34373) 1492 : audit [DBG] from='client.55054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:42 gibba043 bash[24019]: audit 2021-03-10T14:18:40.769021+0000 mgr.gibba043.dnkmem (mgr.34373) 1492 : audit [DBG] from='client.55054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:43 gibba003 bash[31385]: cluster 2021-03-10T14:18:42.285754+0000 mgr.gibba043.dnkmem (mgr.34373) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:43 gibba003 bash[32348]: cluster 2021-03-10T14:18:42.285754+0000 mgr.gibba043.dnkmem (mgr.34373) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:43 gibba043 bash[24019]: cluster 2021-03-10T14:18:42.285754+0000 mgr.gibba043.dnkmem (mgr.34373) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:45 gibba003 bash[31385]: cluster 2021-03-10T14:18:44.287221+0000 mgr.gibba043.dnkmem (mgr.34373) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:45 gibba003 bash[32348]: cluster 2021-03-10T14:18:44.287221+0000 mgr.gibba043.dnkmem (mgr.34373) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:45 gibba043 bash[24019]: cluster 2021-03-10T14:18:44.287221+0000 mgr.gibba043.dnkmem (mgr.34373) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:47 gibba003 bash[31385]: cluster 2021-03-10T14:18:46.289030+0000 mgr.gibba043.dnkmem (mgr.34373) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:47 gibba003 bash[32348]: cluster 2021-03-10T14:18:46.289030+0000 mgr.gibba043.dnkmem (mgr.34373) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:47 gibba043 bash[24019]: cluster 2021-03-10T14:18:46.289030+0000 mgr.gibba043.dnkmem (mgr.34373) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:49 gibba003 bash[31385]: cluster 2021-03-10T14:18:48.290481+0000 mgr.gibba043.dnkmem (mgr.34373) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:49 gibba003 bash[32348]: cluster 2021-03-10T14:18:48.290481+0000 mgr.gibba043.dnkmem (mgr.34373) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:49 gibba043 bash[24019]: cluster 2021-03-10T14:18:48.290481+0000 mgr.gibba043.dnkmem (mgr.34373) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:51 gibba003 bash[31385]: cluster 2021-03-10T14:18:50.292067+0000 mgr.gibba043.dnkmem (mgr.34373) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:51 gibba003 bash[32348]: cluster 2021-03-10T14:18:50.292067+0000 mgr.gibba043.dnkmem (mgr.34373) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:51 gibba043 bash[24019]: cluster 2021-03-10T14:18:50.292067+0000 mgr.gibba043.dnkmem (mgr.34373) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:53 gibba003 bash[31385]: cluster 2021-03-10T14:18:52.293742+0000 mgr.gibba043.dnkmem (mgr.34373) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:53 gibba003 bash[32348]: cluster 2021-03-10T14:18:52.293742+0000 mgr.gibba043.dnkmem (mgr.34373) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:53 gibba043 bash[24019]: cluster 2021-03-10T14:18:52.293742+0000 mgr.gibba043.dnkmem (mgr.34373) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cluster 2021-03-10T14:18:54.295423+0000 mgr.gibba043.dnkmem (mgr.34373) 1499 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.295816+0000 mgr.gibba043.dnkmem (mgr.34373) 1500 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:18:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.297352+0000 mgr.gibba043.dnkmem (mgr.34373) 1501 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:18:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.508598+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:18:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.509728+0000 mgr.gibba043.dnkmem (mgr.34373) 1502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.511768+0000 mgr.gibba043.dnkmem (mgr.34373) 1503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.512302+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.513162+0000 mgr.gibba043.dnkmem (mgr.34373) 1504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.513199+0000 mgr.gibba043.dnkmem (mgr.34373) 1505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.514053+0000 mon.c (mon.1) 443 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.514445+0000 mgr.gibba043.dnkmem (mgr.34373) 1506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:55.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.514482+0000 mgr.gibba043.dnkmem (mgr.34373) 1507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:55.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.515335+0000 mon.c (mon.1) 444 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.515799+0000 mgr.gibba043.dnkmem (mgr.34373) 1508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:55.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.516692+0000 mon.c (mon.1) 445 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.517389+0000 mgr.gibba043.dnkmem (mgr.34373) 1509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:55.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.517422+0000 mgr.gibba043.dnkmem (mgr.34373) 1510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:55.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.518964+0000 mgr.gibba043.dnkmem (mgr.34373) 1511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:55.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.519273+0000 mgr.gibba043.dnkmem (mgr.34373) 1512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:55.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.519863+0000 mon.c (mon.1) 446 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.520712+0000 mgr.gibba043.dnkmem (mgr.34373) 1513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:55.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.520748+0000 mgr.gibba043.dnkmem (mgr.34373) 1514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:55.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: cephadm 2021-03-10T14:18:54.520849+0000 mgr.gibba043.dnkmem (mgr.34373) 1515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:55.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:55 gibba043 bash[24019]: audit 2021-03-10T14:18:54.521458+0000 mon.c (mon.1) 447 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cluster 2021-03-10T14:18:54.295423+0000 mgr.gibba043.dnkmem (mgr.34373) 1499 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.295816+0000 mgr.gibba043.dnkmem (mgr.34373) 1500 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:18:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.297352+0000 mgr.gibba043.dnkmem (mgr.34373) 1501 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:18:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.508598+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:18:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.509728+0000 mgr.gibba043.dnkmem (mgr.34373) 1502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.511768+0000 mgr.gibba043.dnkmem (mgr.34373) 1503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.512302+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.513162+0000 mgr.gibba043.dnkmem (mgr.34373) 1504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.513199+0000 mgr.gibba043.dnkmem (mgr.34373) 1505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.514053+0000 mon.c (mon.1) 443 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.514445+0000 mgr.gibba043.dnkmem (mgr.34373) 1506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.514482+0000 mgr.gibba043.dnkmem (mgr.34373) 1507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:55.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.515335+0000 mon.c (mon.1) 444 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.515799+0000 mgr.gibba043.dnkmem (mgr.34373) 1508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:55.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.516692+0000 mon.c (mon.1) 445 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.517389+0000 mgr.gibba043.dnkmem (mgr.34373) 1509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:55.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.517422+0000 mgr.gibba043.dnkmem (mgr.34373) 1510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:55.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.518964+0000 mgr.gibba043.dnkmem (mgr.34373) 1511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:55.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.519273+0000 mgr.gibba043.dnkmem (mgr.34373) 1512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:55.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.519863+0000 mon.c (mon.1) 446 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.520712+0000 mgr.gibba043.dnkmem (mgr.34373) 1513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:55.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cluster 2021-03-10T14:18:54.295423+0000 mgr.gibba043.dnkmem (mgr.34373) 1499 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:55.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.295816+0000 mgr.gibba043.dnkmem (mgr.34373) 1500 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:18:55.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.297352+0000 mgr.gibba043.dnkmem (mgr.34373) 1501 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:18:55.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.508598+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:18:55.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.509728+0000 mgr.gibba043.dnkmem (mgr.34373) 1502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:55.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.511768+0000 mgr.gibba043.dnkmem (mgr.34373) 1503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:55.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.512302+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:55.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.513162+0000 mgr.gibba043.dnkmem (mgr.34373) 1504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:55.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.513199+0000 mgr.gibba043.dnkmem (mgr.34373) 1505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:55.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.514053+0000 mon.c (mon.1) 443 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.514445+0000 mgr.gibba043.dnkmem (mgr.34373) 1506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:55.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.514482+0000 mgr.gibba043.dnkmem (mgr.34373) 1507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:55.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.515335+0000 mon.c (mon.1) 444 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.515799+0000 mgr.gibba043.dnkmem (mgr.34373) 1508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:55.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.516692+0000 mon.c (mon.1) 445 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.517389+0000 mgr.gibba043.dnkmem (mgr.34373) 1509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:55.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.517422+0000 mgr.gibba043.dnkmem (mgr.34373) 1510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:55.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.518964+0000 mgr.gibba043.dnkmem (mgr.34373) 1511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:55.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.519273+0000 mgr.gibba043.dnkmem (mgr.34373) 1512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:55.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.519863+0000 mon.c (mon.1) 446 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.520712+0000 mgr.gibba043.dnkmem (mgr.34373) 1513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:55.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.520748+0000 mgr.gibba043.dnkmem (mgr.34373) 1514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:55.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: cephadm 2021-03-10T14:18:54.520849+0000 mgr.gibba043.dnkmem (mgr.34373) 1515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:55.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[32348]: audit 2021-03-10T14:18:54.521458+0000 mon.c (mon.1) 447 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:55.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.520748+0000 mgr.gibba043.dnkmem (mgr.34373) 1514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:55.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: cephadm 2021-03-10T14:18:54.520849+0000 mgr.gibba043.dnkmem (mgr.34373) 1515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:18:55.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:55 gibba003 bash[31385]: audit 2021-03-10T14:18:54.521458+0000 mon.c (mon.1) 447 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:57 gibba003 bash[31385]: cluster 2021-03-10T14:18:56.297350+0000 mgr.gibba043.dnkmem (mgr.34373) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:57 gibba003 bash[32348]: cluster 2021-03-10T14:18:56.297350+0000 mgr.gibba043.dnkmem (mgr.34373) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:57 gibba043 bash[24019]: cluster 2021-03-10T14:18:56.297350+0000 mgr.gibba043.dnkmem (mgr.34373) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:18:59 gibba003 bash[31385]: cluster 2021-03-10T14:18:58.298943+0000 mgr.gibba043.dnkmem (mgr.34373) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:59.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:18:59 gibba003 bash[32348]: cluster 2021-03-10T14:18:58.298943+0000 mgr.gibba043.dnkmem (mgr.34373) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:18:59 gibba043 bash[24019]: cluster 2021-03-10T14:18:58.298943+0000 mgr.gibba043.dnkmem (mgr.34373) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:01.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:01 gibba003 bash[31385]: cluster 2021-03-10T14:19:00.300215+0000 mgr.gibba043.dnkmem (mgr.34373) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:01.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:01 gibba003 bash[32348]: cluster 2021-03-10T14:19:00.300215+0000 mgr.gibba043.dnkmem (mgr.34373) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:01 gibba043 bash[24019]: cluster 2021-03-10T14:19:00.300215+0000 mgr.gibba043.dnkmem (mgr.34373) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:03 gibba003 bash[31385]: cluster 2021-03-10T14:19:02.301885+0000 mgr.gibba043.dnkmem (mgr.34373) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:03 gibba003 bash[32348]: cluster 2021-03-10T14:19:02.301885+0000 mgr.gibba043.dnkmem (mgr.34373) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:03 gibba043 bash[24019]: cluster 2021-03-10T14:19:02.301885+0000 mgr.gibba043.dnkmem (mgr.34373) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:05 gibba003 bash[31385]: cluster 2021-03-10T14:19:04.303433+0000 mgr.gibba043.dnkmem (mgr.34373) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:05 gibba003 bash[32348]: cluster 2021-03-10T14:19:04.303433+0000 mgr.gibba043.dnkmem (mgr.34373) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:05 gibba043 bash[24019]: cluster 2021-03-10T14:19:04.303433+0000 mgr.gibba043.dnkmem (mgr.34373) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:07 gibba003 bash[31385]: cluster 2021-03-10T14:19:06.305293+0000 mgr.gibba043.dnkmem (mgr.34373) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:07 gibba003 bash[32348]: cluster 2021-03-10T14:19:06.305293+0000 mgr.gibba043.dnkmem (mgr.34373) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:07 gibba043 bash[24019]: cluster 2021-03-10T14:19:06.305293+0000 mgr.gibba043.dnkmem (mgr.34373) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:09 gibba003 bash[31385]: cluster 2021-03-10T14:19:08.306588+0000 mgr.gibba043.dnkmem (mgr.34373) 1522 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:09 gibba003 bash[32348]: cluster 2021-03-10T14:19:08.306588+0000 mgr.gibba043.dnkmem (mgr.34373) 1522 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:09 gibba043 bash[24019]: cluster 2021-03-10T14:19:08.306588+0000 mgr.gibba043.dnkmem (mgr.34373) 1522 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:10.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:10 gibba003 bash[31385]: cephadm 2021-03-10T14:19:09.536440+0000 mgr.gibba043.dnkmem (mgr.34373) 1523 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:10.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:10 gibba003 bash[32348]: cephadm 2021-03-10T14:19:09.536440+0000 mgr.gibba043.dnkmem (mgr.34373) 1523 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:11.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:10 gibba043 bash[24019]: cephadm 2021-03-10T14:19:09.536440+0000 mgr.gibba043.dnkmem (mgr.34373) 1523 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:11.274 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:19:11.501 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:19:11.501 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (27m) 3m ago 32m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:19:11.501 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (32m) 2m ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:19:11.501 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (27m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:19:11.502 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:19:11.502 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:19:11.502 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:19:11.502 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:19:11.503 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:19:11.503 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (32m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:19:11.503 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:19:11.503 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:19:11.503 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:19:11.504 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:19:11.504 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:19:11.504 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:19:11.504 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:19:11.505 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:19:11.505 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (22m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:19:11.505 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:19:11.505 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:19:11.754 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:19:11.755 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:19:11.755 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:11.755 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:19:11.756 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:19:11.756 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:11.756 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:19:11.756 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:19:11.756 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:19:11.757 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:19:11.757 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:19:11.757 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:19:11.757 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:19:11.758 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:19:11.758 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:19:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:11 gibba003 bash[31385]: cluster 2021-03-10T14:19:10.308147+0000 mgr.gibba043.dnkmem (mgr.34373) 1524 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:11 gibba003 bash[32348]: cluster 2021-03-10T14:19:10.308147+0000 mgr.gibba043.dnkmem (mgr.34373) 1524 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:11 gibba043 bash[24019]: cluster 2021-03-10T14:19:10.308147+0000 mgr.gibba043.dnkmem (mgr.34373) 1524 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:12.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:12 gibba003 bash[31385]: audit 2021-03-10T14:19:11.264133+0000 mgr.gibba043.dnkmem (mgr.34373) 1525 : audit [DBG] from='client.45081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:12.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:12 gibba003 bash[31385]: audit 2021-03-10T14:19:11.490361+0000 mgr.gibba043.dnkmem (mgr.34373) 1526 : audit [DBG] from='client.55072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:12 gibba003 bash[31385]: audit 2021-03-10T14:19:11.755428+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? 172.21.2.103:0/2791728872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:12 gibba003 bash[32348]: audit 2021-03-10T14:19:11.264133+0000 mgr.gibba043.dnkmem (mgr.34373) 1525 : audit [DBG] from='client.45081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:12 gibba003 bash[32348]: audit 2021-03-10T14:19:11.490361+0000 mgr.gibba043.dnkmem (mgr.34373) 1526 : audit [DBG] from='client.55072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:12 gibba003 bash[32348]: audit 2021-03-10T14:19:11.755428+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? 172.21.2.103:0/2791728872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:12 gibba043 bash[24019]: audit 2021-03-10T14:19:11.264133+0000 mgr.gibba043.dnkmem (mgr.34373) 1525 : audit [DBG] from='client.45081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:12 gibba043 bash[24019]: audit 2021-03-10T14:19:11.490361+0000 mgr.gibba043.dnkmem (mgr.34373) 1526 : audit [DBG] from='client.55072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:12 gibba043 bash[24019]: audit 2021-03-10T14:19:11.755428+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? 172.21.2.103:0/2791728872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: cluster 2021-03-10T14:19:12.309786+0000 mgr.gibba043.dnkmem (mgr.34373) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.819324+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:19:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.820091+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.820725+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:19:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.820768+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:19:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.821497+0000 mon.c (mon.1) 451 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.822982+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.823821+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:19:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.824709+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.899374+0000 mon.c (mon.1) 452 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.900284+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.941269+0000 mon.c (mon.1) 453 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[31385]: audit 2021-03-10T14:19:12.942439+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: cluster 2021-03-10T14:19:12.309786+0000 mgr.gibba043.dnkmem (mgr.34373) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.819324+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:19:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.820091+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.820725+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:19:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.820768+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:19:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.821497+0000 mon.c (mon.1) 451 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.822982+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.823821+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:19:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.824709+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:19:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.899374+0000 mon.c (mon.1) 452 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.900284+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.941269+0000 mon.c (mon.1) 453 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:13 gibba003 bash[32348]: audit 2021-03-10T14:19:12.942439+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: cluster 2021-03-10T14:19:12.309786+0000 mgr.gibba043.dnkmem (mgr.34373) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.819324+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:19:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.820091+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.820725+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:19:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.820768+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:19:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.821497+0000 mon.c (mon.1) 451 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:19:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.822982+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.823821+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:19:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.824709+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:19:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.899374+0000 mon.c (mon.1) 452 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.900284+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.941269+0000 mon.c (mon.1) 453 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:13 gibba043 bash[24019]: audit 2021-03-10T14:19:12.942439+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:15 gibba003 bash[31385]: cluster 2021-03-10T14:19:14.311342+0000 mgr.gibba043.dnkmem (mgr.34373) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:15.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:15 gibba003 bash[32348]: cluster 2021-03-10T14:19:14.311342+0000 mgr.gibba043.dnkmem (mgr.34373) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:15 gibba043 bash[24019]: cluster 2021-03-10T14:19:14.311342+0000 mgr.gibba043.dnkmem (mgr.34373) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:16 gibba003 bash[31385]: cluster 2021-03-10T14:19:16.313289+0000 mgr.gibba043.dnkmem (mgr.34373) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:16.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:16 gibba003 bash[32348]: cluster 2021-03-10T14:19:16.313289+0000 mgr.gibba043.dnkmem (mgr.34373) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:17.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:16 gibba043 bash[24019]: cluster 2021-03-10T14:19:16.313289+0000 mgr.gibba043.dnkmem (mgr.34373) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:19 gibba003 bash[31385]: cluster 2021-03-10T14:19:18.314886+0000 mgr.gibba043.dnkmem (mgr.34373) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:19 gibba003 bash[32348]: cluster 2021-03-10T14:19:18.314886+0000 mgr.gibba043.dnkmem (mgr.34373) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:19 gibba043 bash[24019]: cluster 2021-03-10T14:19:18.314886+0000 mgr.gibba043.dnkmem (mgr.34373) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:21.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:21 gibba003 bash[31385]: cluster 2021-03-10T14:19:20.316392+0000 mgr.gibba043.dnkmem (mgr.34373) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:21.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:21 gibba003 bash[32348]: cluster 2021-03-10T14:19:20.316392+0000 mgr.gibba043.dnkmem (mgr.34373) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:21 gibba043 bash[24019]: cluster 2021-03-10T14:19:20.316392+0000 mgr.gibba043.dnkmem (mgr.34373) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:23 gibba003 bash[31385]: cluster 2021-03-10T14:19:22.317764+0000 mgr.gibba043.dnkmem (mgr.34373) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:23 gibba003 bash[32348]: cluster 2021-03-10T14:19:22.317764+0000 mgr.gibba043.dnkmem (mgr.34373) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:23 gibba043 bash[24019]: cluster 2021-03-10T14:19:22.317764+0000 mgr.gibba043.dnkmem (mgr.34373) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:25 gibba003 bash[31385]: cluster 2021-03-10T14:19:24.319359+0000 mgr.gibba043.dnkmem (mgr.34373) 1533 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:25 gibba003 bash[31385]: cephadm 2021-03-10T14:19:24.552454+0000 mgr.gibba043.dnkmem (mgr.34373) 1534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:25 gibba003 bash[32348]: cluster 2021-03-10T14:19:24.319359+0000 mgr.gibba043.dnkmem (mgr.34373) 1533 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:25 gibba003 bash[32348]: cephadm 2021-03-10T14:19:24.552454+0000 mgr.gibba043.dnkmem (mgr.34373) 1534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:25 gibba043 bash[24019]: cluster 2021-03-10T14:19:24.319359+0000 mgr.gibba043.dnkmem (mgr.34373) 1533 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:25 gibba043 bash[24019]: cephadm 2021-03-10T14:19:24.552454+0000 mgr.gibba043.dnkmem (mgr.34373) 1534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:27 gibba003 bash[31385]: cluster 2021-03-10T14:19:26.321132+0000 mgr.gibba043.dnkmem (mgr.34373) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:27 gibba003 bash[32348]: cluster 2021-03-10T14:19:26.321132+0000 mgr.gibba043.dnkmem (mgr.34373) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:27 gibba043 bash[24019]: cluster 2021-03-10T14:19:26.321132+0000 mgr.gibba043.dnkmem (mgr.34373) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:29 gibba003 bash[31385]: cluster 2021-03-10T14:19:28.322750+0000 mgr.gibba043.dnkmem (mgr.34373) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:29 gibba003 bash[32348]: cluster 2021-03-10T14:19:28.322750+0000 mgr.gibba043.dnkmem (mgr.34373) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:29 gibba043 bash[24019]: cluster 2021-03-10T14:19:28.322750+0000 mgr.gibba043.dnkmem (mgr.34373) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:31 gibba003 bash[31385]: cluster 2021-03-10T14:19:30.324245+0000 mgr.gibba043.dnkmem (mgr.34373) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:31 gibba003 bash[32348]: cluster 2021-03-10T14:19:30.324245+0000 mgr.gibba043.dnkmem (mgr.34373) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:31 gibba043 bash[24019]: cluster 2021-03-10T14:19:30.324245+0000 mgr.gibba043.dnkmem (mgr.34373) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:33 gibba003 bash[31385]: cluster 2021-03-10T14:19:32.325869+0000 mgr.gibba043.dnkmem (mgr.34373) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:33 gibba003 bash[32348]: cluster 2021-03-10T14:19:32.325869+0000 mgr.gibba043.dnkmem (mgr.34373) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:33 gibba043 bash[24019]: cluster 2021-03-10T14:19:32.325869+0000 mgr.gibba043.dnkmem (mgr.34373) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:35 gibba043 bash[24019]: cluster 2021-03-10T14:19:34.327353+0000 mgr.gibba043.dnkmem (mgr.34373) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:35 gibba003 bash[31385]: cluster 2021-03-10T14:19:34.327353+0000 mgr.gibba043.dnkmem (mgr.34373) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:35 gibba003 bash[32348]: cluster 2021-03-10T14:19:34.327353+0000 mgr.gibba043.dnkmem (mgr.34373) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:37 gibba043 bash[24019]: cluster 2021-03-10T14:19:36.329228+0000 mgr.gibba043.dnkmem (mgr.34373) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:37 gibba003 bash[31385]: cluster 2021-03-10T14:19:36.329228+0000 mgr.gibba043.dnkmem (mgr.34373) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:37 gibba003 bash[32348]: cluster 2021-03-10T14:19:36.329228+0000 mgr.gibba043.dnkmem (mgr.34373) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:39 gibba043 bash[24019]: cluster 2021-03-10T14:19:38.330726+0000 mgr.gibba043.dnkmem (mgr.34373) 1541 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:39 gibba003 bash[31385]: cluster 2021-03-10T14:19:38.330726+0000 mgr.gibba043.dnkmem (mgr.34373) 1541 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:39 gibba003 bash[32348]: cluster 2021-03-10T14:19:38.330726+0000 mgr.gibba043.dnkmem (mgr.34373) 1541 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:40.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:40 gibba043 bash[24019]: cephadm 2021-03-10T14:19:39.568556+0000 mgr.gibba043.dnkmem (mgr.34373) 1542 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:40.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:40 gibba003 bash[31385]: cephadm 2021-03-10T14:19:39.568556+0000 mgr.gibba043.dnkmem (mgr.34373) 1542 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:40.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:40 gibba003 bash[32348]: cephadm 2021-03-10T14:19:39.568556+0000 mgr.gibba043.dnkmem (mgr.34373) 1542 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:41 gibba043 bash[24019]: cluster 2021-03-10T14:19:40.332231+0000 mgr.gibba043.dnkmem (mgr.34373) 1543 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:41 gibba003 bash[31385]: cluster 2021-03-10T14:19:40.332231+0000 mgr.gibba043.dnkmem (mgr.34373) 1543 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:41 gibba003 bash[32348]: cluster 2021-03-10T14:19:40.332231+0000 mgr.gibba043.dnkmem (mgr.34373) 1543 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:42.004 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:19:42.260 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:19:42.260 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (28m) 3m ago 33m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:19:42.260 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (33m) 2m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:19:42.261 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:19:42.261 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:19:42.261 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:19:42.261 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:19:42.262 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (27m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:19:42.262 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:19:42.262 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:19:42.262 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:19:42.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:19:42.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:19:42.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:19:42.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:19:42.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:19:42.264 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:19:42.264 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:19:42.264 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:19:42.264 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:19:42.264 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:19:42.512 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:19:42.512 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:19:42.512 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:42.513 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:19:42.513 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:19:42.513 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:42.513 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:19:42.514 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:19:42.514 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:19:42.514 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:19:42.514 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:19:42.515 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:19:42.515 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:19:42.515 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:19:42.515 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:19:43.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:43 gibba043 bash[24019]: audit 2021-03-10T14:19:41.994557+0000 mgr.gibba043.dnkmem (mgr.34373) 1544 : audit [DBG] from='client.55084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:43.858 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:43 gibba043 bash[24019]: audit 2021-03-10T14:19:42.219248+0000 mgr.gibba043.dnkmem (mgr.34373) 1545 : audit [DBG] from='client.45105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:43.859 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:43 gibba043 bash[24019]: cluster 2021-03-10T14:19:42.333557+0000 mgr.gibba043.dnkmem (mgr.34373) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:43.860 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:43 gibba043 bash[24019]: audit 2021-03-10T14:19:42.513118+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? 172.21.2.103:0/2920297436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[31385]: audit 2021-03-10T14:19:41.994557+0000 mgr.gibba043.dnkmem (mgr.34373) 1544 : audit [DBG] from='client.55084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[31385]: audit 2021-03-10T14:19:42.219248+0000 mgr.gibba043.dnkmem (mgr.34373) 1545 : audit [DBG] from='client.45105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[31385]: cluster 2021-03-10T14:19:42.333557+0000 mgr.gibba043.dnkmem (mgr.34373) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[31385]: audit 2021-03-10T14:19:42.513118+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? 172.21.2.103:0/2920297436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:43.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[32348]: audit 2021-03-10T14:19:41.994557+0000 mgr.gibba043.dnkmem (mgr.34373) 1544 : audit [DBG] from='client.55084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:43.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[32348]: audit 2021-03-10T14:19:42.219248+0000 mgr.gibba043.dnkmem (mgr.34373) 1545 : audit [DBG] from='client.45105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:43.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[32348]: cluster 2021-03-10T14:19:42.333557+0000 mgr.gibba043.dnkmem (mgr.34373) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:43.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:43 gibba003 bash[32348]: audit 2021-03-10T14:19:42.513118+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? 172.21.2.103:0/2920297436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:45 gibba043 bash[24019]: cluster 2021-03-10T14:19:44.335176+0000 mgr.gibba043.dnkmem (mgr.34373) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:45 gibba003 bash[31385]: cluster 2021-03-10T14:19:44.335176+0000 mgr.gibba043.dnkmem (mgr.34373) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:45 gibba003 bash[32348]: cluster 2021-03-10T14:19:44.335176+0000 mgr.gibba043.dnkmem (mgr.34373) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:47 gibba043 bash[24019]: cluster 2021-03-10T14:19:46.337150+0000 mgr.gibba043.dnkmem (mgr.34373) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:47 gibba003 bash[31385]: cluster 2021-03-10T14:19:46.337150+0000 mgr.gibba043.dnkmem (mgr.34373) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:47 gibba003 bash[32348]: cluster 2021-03-10T14:19:46.337150+0000 mgr.gibba043.dnkmem (mgr.34373) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:49 gibba043 bash[24019]: cluster 2021-03-10T14:19:48.338767+0000 mgr.gibba043.dnkmem (mgr.34373) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:49 gibba003 bash[31385]: cluster 2021-03-10T14:19:48.338767+0000 mgr.gibba043.dnkmem (mgr.34373) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:49 gibba003 bash[32348]: cluster 2021-03-10T14:19:48.338767+0000 mgr.gibba043.dnkmem (mgr.34373) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:51 gibba043 bash[24019]: cluster 2021-03-10T14:19:50.340319+0000 mgr.gibba043.dnkmem (mgr.34373) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:51 gibba003 bash[31385]: cluster 2021-03-10T14:19:50.340319+0000 mgr.gibba043.dnkmem (mgr.34373) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:51 gibba003 bash[32348]: cluster 2021-03-10T14:19:50.340319+0000 mgr.gibba043.dnkmem (mgr.34373) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:53 gibba003 bash[31385]: cluster 2021-03-10T14:19:52.341967+0000 mgr.gibba043.dnkmem (mgr.34373) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:53 gibba003 bash[32348]: cluster 2021-03-10T14:19:52.341967+0000 mgr.gibba043.dnkmem (mgr.34373) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:53 gibba043 bash[24019]: cluster 2021-03-10T14:19:52.341967+0000 mgr.gibba043.dnkmem (mgr.34373) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: cluster 2021-03-10T14:19:54.343543+0000 mgr.gibba043.dnkmem (mgr.34373) 1552 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.580508+0000 mgr.gibba043.dnkmem (mgr.34373) 1553 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:19:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.581045+0000 mgr.gibba043.dnkmem (mgr.34373) 1554 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:19:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.780601+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:19:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.784271+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.785493+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.787015+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.788698+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.791667+0000 mon.c (mon.1) 458 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[31385]: audit 2021-03-10T14:19:54.793433+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: cluster 2021-03-10T14:19:54.343543+0000 mgr.gibba043.dnkmem (mgr.34373) 1552 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.580508+0000 mgr.gibba043.dnkmem (mgr.34373) 1553 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:19:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.581045+0000 mgr.gibba043.dnkmem (mgr.34373) 1554 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:19:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.780601+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:19:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.784271+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.785493+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.787015+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.788698+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.791667+0000 mon.c (mon.1) 458 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:55 gibba003 bash[32348]: audit 2021-03-10T14:19:54.793433+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: cluster 2021-03-10T14:19:54.343543+0000 mgr.gibba043.dnkmem (mgr.34373) 1552 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.580508+0000 mgr.gibba043.dnkmem (mgr.34373) 1553 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:19:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.581045+0000 mgr.gibba043.dnkmem (mgr.34373) 1554 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:19:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.780601+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:19:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.784271+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.785493+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.787015+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.788698+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.791667+0000 mon.c (mon.1) 458 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:56.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:55 gibba043 bash[24019]: audit 2021-03-10T14:19:54.793433+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.781671+0000 mgr.gibba043.dnkmem (mgr.34373) 1555 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.783106+0000 mgr.gibba043.dnkmem (mgr.34373) 1556 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.784512+0000 mgr.gibba043.dnkmem (mgr.34373) 1557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.784550+0000 mgr.gibba043.dnkmem (mgr.34373) 1558 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.786267+0000 mgr.gibba043.dnkmem (mgr.34373) 1559 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.786307+0000 mgr.gibba043.dnkmem (mgr.34373) 1560 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.787567+0000 mgr.gibba043.dnkmem (mgr.34373) 1561 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.789159+0000 mgr.gibba043.dnkmem (mgr.34373) 1562 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.789197+0000 mgr.gibba043.dnkmem (mgr.34373) 1563 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.790747+0000 mgr.gibba043.dnkmem (mgr.34373) 1564 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.791078+0000 mgr.gibba043.dnkmem (mgr.34373) 1565 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.792351+0000 mgr.gibba043.dnkmem (mgr.34373) 1566 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.792388+0000 mgr.gibba043.dnkmem (mgr.34373) 1567 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[31385]: cephadm 2021-03-10T14:19:54.792493+0000 mgr.gibba043.dnkmem (mgr.34373) 1568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.781671+0000 mgr.gibba043.dnkmem (mgr.34373) 1555 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.783106+0000 mgr.gibba043.dnkmem (mgr.34373) 1556 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.784512+0000 mgr.gibba043.dnkmem (mgr.34373) 1557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.784550+0000 mgr.gibba043.dnkmem (mgr.34373) 1558 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.786267+0000 mgr.gibba043.dnkmem (mgr.34373) 1559 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.786307+0000 mgr.gibba043.dnkmem (mgr.34373) 1560 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.787567+0000 mgr.gibba043.dnkmem (mgr.34373) 1561 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.789159+0000 mgr.gibba043.dnkmem (mgr.34373) 1562 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.789197+0000 mgr.gibba043.dnkmem (mgr.34373) 1563 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.790747+0000 mgr.gibba043.dnkmem (mgr.34373) 1564 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.791078+0000 mgr.gibba043.dnkmem (mgr.34373) 1565 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.792351+0000 mgr.gibba043.dnkmem (mgr.34373) 1566 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.792388+0000 mgr.gibba043.dnkmem (mgr.34373) 1567 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:56 gibba003 bash[32348]: cephadm 2021-03-10T14:19:54.792493+0000 mgr.gibba043.dnkmem (mgr.34373) 1568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:57.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.781671+0000 mgr.gibba043.dnkmem (mgr.34373) 1555 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.783106+0000 mgr.gibba043.dnkmem (mgr.34373) 1556 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.784512+0000 mgr.gibba043.dnkmem (mgr.34373) 1557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.784550+0000 mgr.gibba043.dnkmem (mgr.34373) 1558 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.786267+0000 mgr.gibba043.dnkmem (mgr.34373) 1559 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.786307+0000 mgr.gibba043.dnkmem (mgr.34373) 1560 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.787567+0000 mgr.gibba043.dnkmem (mgr.34373) 1561 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.789159+0000 mgr.gibba043.dnkmem (mgr.34373) 1562 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.789197+0000 mgr.gibba043.dnkmem (mgr.34373) 1563 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.790747+0000 mgr.gibba043.dnkmem (mgr.34373) 1564 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.791078+0000 mgr.gibba043.dnkmem (mgr.34373) 1565 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.792351+0000 mgr.gibba043.dnkmem (mgr.34373) 1566 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.792388+0000 mgr.gibba043.dnkmem (mgr.34373) 1567 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:56 gibba043 bash[24019]: cephadm 2021-03-10T14:19:54.792493+0000 mgr.gibba043.dnkmem (mgr.34373) 1568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:19:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:57 gibba003 bash[31385]: cluster 2021-03-10T14:19:56.345500+0000 mgr.gibba043.dnkmem (mgr.34373) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:57.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:57 gibba003 bash[32348]: cluster 2021-03-10T14:19:56.345500+0000 mgr.gibba043.dnkmem (mgr.34373) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:57 gibba043 bash[24019]: cluster 2021-03-10T14:19:56.345500+0000 mgr.gibba043.dnkmem (mgr.34373) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:19:59 gibba003 bash[31385]: cluster 2021-03-10T14:19:58.347021+0000 mgr.gibba043.dnkmem (mgr.34373) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:19:59 gibba003 bash[32348]: cluster 2021-03-10T14:19:58.347021+0000 mgr.gibba043.dnkmem (mgr.34373) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:19:59 gibba043 bash[24019]: cluster 2021-03-10T14:19:58.347021+0000 mgr.gibba043.dnkmem (mgr.34373) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:00 gibba003 bash[31385]: debug 2021-03-10T14:19:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:00 gibba003 bash[31385]: cluster 2021-03-10T14:20:00.000225+0000 mon.a (mon.0) 679 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:00 gibba003 bash[32348]: cluster 2021-03-10T14:20:00.000225+0000 mon.a (mon.0) 679 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:00 gibba043 bash[24019]: cluster 2021-03-10T14:20:00.000225+0000 mon.a (mon.0) 679 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:01.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:01 gibba003 bash[31385]: cluster 2021-03-10T14:20:00.348627+0000 mgr.gibba043.dnkmem (mgr.34373) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:01.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:01 gibba003 bash[32348]: cluster 2021-03-10T14:20:00.348627+0000 mgr.gibba043.dnkmem (mgr.34373) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:01 gibba043 bash[24019]: cluster 2021-03-10T14:20:00.348627+0000 mgr.gibba043.dnkmem (mgr.34373) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:03 gibba003 bash[31385]: cluster 2021-03-10T14:20:02.350302+0000 mgr.gibba043.dnkmem (mgr.34373) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:03 gibba003 bash[32348]: cluster 2021-03-10T14:20:02.350302+0000 mgr.gibba043.dnkmem (mgr.34373) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:03 gibba043 bash[24019]: cluster 2021-03-10T14:20:02.350302+0000 mgr.gibba043.dnkmem (mgr.34373) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:05 gibba003 bash[31385]: cluster 2021-03-10T14:20:04.351994+0000 mgr.gibba043.dnkmem (mgr.34373) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:05 gibba003 bash[32348]: cluster 2021-03-10T14:20:04.351994+0000 mgr.gibba043.dnkmem (mgr.34373) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:05 gibba043 bash[24019]: cluster 2021-03-10T14:20:04.351994+0000 mgr.gibba043.dnkmem (mgr.34373) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:07 gibba003 bash[31385]: cluster 2021-03-10T14:20:06.353860+0000 mgr.gibba043.dnkmem (mgr.34373) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:07 gibba003 bash[32348]: cluster 2021-03-10T14:20:06.353860+0000 mgr.gibba043.dnkmem (mgr.34373) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:07 gibba043 bash[24019]: cluster 2021-03-10T14:20:06.353860+0000 mgr.gibba043.dnkmem (mgr.34373) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:09 gibba003 bash[31385]: cluster 2021-03-10T14:20:08.355463+0000 mgr.gibba043.dnkmem (mgr.34373) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:09 gibba003 bash[32348]: cluster 2021-03-10T14:20:08.355463+0000 mgr.gibba043.dnkmem (mgr.34373) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:09 gibba043 bash[24019]: cluster 2021-03-10T14:20:08.355463+0000 mgr.gibba043.dnkmem (mgr.34373) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:11 gibba003 bash[31385]: cephadm 2021-03-10T14:20:09.808297+0000 mgr.gibba043.dnkmem (mgr.34373) 1576 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:11 gibba003 bash[31385]: cluster 2021-03-10T14:20:10.356737+0000 mgr.gibba043.dnkmem (mgr.34373) 1577 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:11 gibba003 bash[32348]: cephadm 2021-03-10T14:20:09.808297+0000 mgr.gibba043.dnkmem (mgr.34373) 1576 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:11 gibba003 bash[32348]: cluster 2021-03-10T14:20:10.356737+0000 mgr.gibba043.dnkmem (mgr.34373) 1577 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:11 gibba043 bash[24019]: cephadm 2021-03-10T14:20:09.808297+0000 mgr.gibba043.dnkmem (mgr.34373) 1576 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:11 gibba043 bash[24019]: cluster 2021-03-10T14:20:10.356737+0000 mgr.gibba043.dnkmem (mgr.34373) 1577 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:12.758 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:20:12.979 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:20:12.980 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (28m) 4m ago 33m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:20:12.980 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (33m) 3m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:20:12.980 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (28m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:20:12.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:20:12.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:20:12.981 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:20:12.981 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:20:12.981 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:20:12.982 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:20:12.982 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:20:12.982 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:20:12.982 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:20:12.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:20:12.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:20:12.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:20:12.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:20:12.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:20:12.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (23m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:20:12.984 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:20:12.984 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:20:13.231 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:20:13.231 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:20:13.231 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:13.232 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:20:13.232 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:20:13.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:13.232 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:20:13.232 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:20:13.233 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:20:13.233 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:20:13.233 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:20:13.233 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:20:13.234 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:20:13.234 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:20:13.234 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:20:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: cluster 2021-03-10T14:20:12.358416+0000 mgr.gibba043.dnkmem (mgr.34373) 1578 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.829882+0000 mon.c (mon.1) 460 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:20:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.830084+0000 mon.c (mon.1) 461 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:20:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.830236+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:20:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.830246+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.830393+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.830598+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:20:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.830874+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.831017+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.904858+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.905156+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.948808+0000 mon.c (mon.1) 465 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:12.949073+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[31385]: audit 2021-03-10T14:20:13.232041+0000 mon.c (mon.1) 466 : audit [DBG] from='client.? 172.21.2.103:0/1350874209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: cluster 2021-03-10T14:20:12.358416+0000 mgr.gibba043.dnkmem (mgr.34373) 1578 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.829882+0000 mon.c (mon.1) 460 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:20:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.830084+0000 mon.c (mon.1) 461 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:20:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.830236+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:20:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.830246+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.830393+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.830598+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:20:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.830874+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.831017+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:20:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.904858+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.905156+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.948808+0000 mon.c (mon.1) 465 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:12.949073+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:13 gibba003 bash[32348]: audit 2021-03-10T14:20:13.232041+0000 mon.c (mon.1) 466 : audit [DBG] from='client.? 172.21.2.103:0/1350874209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: cluster 2021-03-10T14:20:12.358416+0000 mgr.gibba043.dnkmem (mgr.34373) 1578 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.829882+0000 mon.c (mon.1) 460 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:20:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.830084+0000 mon.c (mon.1) 461 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:20:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.830236+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:20:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.830246+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:20:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.830393+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:20:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.830598+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:20:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.830874+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:20:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.831017+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:20:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.904858+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.905156+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.948808+0000 mon.c (mon.1) 465 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:12.949073+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:13 gibba043 bash[24019]: audit 2021-03-10T14:20:13.232041+0000 mon.c (mon.1) 466 : audit [DBG] from='client.? 172.21.2.103:0/1350874209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:14 gibba003 bash[31385]: audit 2021-03-10T14:20:12.747651+0000 mgr.gibba043.dnkmem (mgr.34373) 1579 : audit [DBG] from='client.55102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:14 gibba003 bash[31385]: audit 2021-03-10T14:20:12.970985+0000 mgr.gibba043.dnkmem (mgr.34373) 1580 : audit [DBG] from='client.45123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:14 gibba003 bash[32348]: audit 2021-03-10T14:20:12.747651+0000 mgr.gibba043.dnkmem (mgr.34373) 1579 : audit [DBG] from='client.55102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:14 gibba003 bash[32348]: audit 2021-03-10T14:20:12.970985+0000 mgr.gibba043.dnkmem (mgr.34373) 1580 : audit [DBG] from='client.45123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:14 gibba043 bash[24019]: audit 2021-03-10T14:20:12.747651+0000 mgr.gibba043.dnkmem (mgr.34373) 1579 : audit [DBG] from='client.55102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:14 gibba043 bash[24019]: audit 2021-03-10T14:20:12.970985+0000 mgr.gibba043.dnkmem (mgr.34373) 1580 : audit [DBG] from='client.45123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:15 gibba003 bash[31385]: cluster 2021-03-10T14:20:14.359958+0000 mgr.gibba043.dnkmem (mgr.34373) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:15 gibba003 bash[32348]: cluster 2021-03-10T14:20:14.359958+0000 mgr.gibba043.dnkmem (mgr.34373) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:15 gibba043 bash[24019]: cluster 2021-03-10T14:20:14.359958+0000 mgr.gibba043.dnkmem (mgr.34373) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:16 gibba003 bash[31385]: cluster 2021-03-10T14:20:16.361600+0000 mgr.gibba043.dnkmem (mgr.34373) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:16.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:16 gibba003 bash[32348]: cluster 2021-03-10T14:20:16.361600+0000 mgr.gibba043.dnkmem (mgr.34373) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:17.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:16 gibba043 bash[24019]: cluster 2021-03-10T14:20:16.361600+0000 mgr.gibba043.dnkmem (mgr.34373) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:19 gibba003 bash[31385]: cluster 2021-03-10T14:20:18.363170+0000 mgr.gibba043.dnkmem (mgr.34373) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:19 gibba003 bash[32348]: cluster 2021-03-10T14:20:18.363170+0000 mgr.gibba043.dnkmem (mgr.34373) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:19 gibba043 bash[24019]: cluster 2021-03-10T14:20:18.363170+0000 mgr.gibba043.dnkmem (mgr.34373) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:21 gibba003 bash[31385]: cluster 2021-03-10T14:20:20.364610+0000 mgr.gibba043.dnkmem (mgr.34373) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:21 gibba003 bash[32348]: cluster 2021-03-10T14:20:20.364610+0000 mgr.gibba043.dnkmem (mgr.34373) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:21 gibba043 bash[24019]: cluster 2021-03-10T14:20:20.364610+0000 mgr.gibba043.dnkmem (mgr.34373) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:23 gibba003 bash[31385]: cluster 2021-03-10T14:20:22.366188+0000 mgr.gibba043.dnkmem (mgr.34373) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:23 gibba003 bash[32348]: cluster 2021-03-10T14:20:22.366188+0000 mgr.gibba043.dnkmem (mgr.34373) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:23 gibba043 bash[24019]: cluster 2021-03-10T14:20:22.366188+0000 mgr.gibba043.dnkmem (mgr.34373) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:25 gibba003 bash[31385]: cluster 2021-03-10T14:20:24.367659+0000 mgr.gibba043.dnkmem (mgr.34373) 1586 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:25 gibba003 bash[32348]: cluster 2021-03-10T14:20:24.367659+0000 mgr.gibba043.dnkmem (mgr.34373) 1586 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:25 gibba043 bash[24019]: cluster 2021-03-10T14:20:24.367659+0000 mgr.gibba043.dnkmem (mgr.34373) 1586 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:26.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:26 gibba003 bash[31385]: cephadm 2021-03-10T14:20:24.820511+0000 mgr.gibba043.dnkmem (mgr.34373) 1587 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:26 gibba003 bash[32348]: cephadm 2021-03-10T14:20:24.820511+0000 mgr.gibba043.dnkmem (mgr.34373) 1587 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:26 gibba043 bash[24019]: cephadm 2021-03-10T14:20:24.820511+0000 mgr.gibba043.dnkmem (mgr.34373) 1587 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:27 gibba043 bash[24019]: cluster 2021-03-10T14:20:26.369138+0000 mgr.gibba043.dnkmem (mgr.34373) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:27 gibba003 bash[31385]: cluster 2021-03-10T14:20:26.369138+0000 mgr.gibba043.dnkmem (mgr.34373) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:27 gibba003 bash[32348]: cluster 2021-03-10T14:20:26.369138+0000 mgr.gibba043.dnkmem (mgr.34373) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:29 gibba043 bash[24019]: cluster 2021-03-10T14:20:28.370823+0000 mgr.gibba043.dnkmem (mgr.34373) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:29 gibba003 bash[31385]: cluster 2021-03-10T14:20:28.370823+0000 mgr.gibba043.dnkmem (mgr.34373) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:29 gibba003 bash[32348]: cluster 2021-03-10T14:20:28.370823+0000 mgr.gibba043.dnkmem (mgr.34373) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:31 gibba043 bash[24019]: cluster 2021-03-10T14:20:30.372078+0000 mgr.gibba043.dnkmem (mgr.34373) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:31 gibba003 bash[31385]: cluster 2021-03-10T14:20:30.372078+0000 mgr.gibba043.dnkmem (mgr.34373) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:31 gibba003 bash[32348]: cluster 2021-03-10T14:20:30.372078+0000 mgr.gibba043.dnkmem (mgr.34373) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:33 gibba043 bash[24019]: cluster 2021-03-10T14:20:32.373439+0000 mgr.gibba043.dnkmem (mgr.34373) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:33 gibba003 bash[31385]: cluster 2021-03-10T14:20:32.373439+0000 mgr.gibba043.dnkmem (mgr.34373) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:33 gibba003 bash[32348]: cluster 2021-03-10T14:20:32.373439+0000 mgr.gibba043.dnkmem (mgr.34373) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:35 gibba043 bash[24019]: cluster 2021-03-10T14:20:34.375186+0000 mgr.gibba043.dnkmem (mgr.34373) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:35 gibba003 bash[31385]: cluster 2021-03-10T14:20:34.375186+0000 mgr.gibba043.dnkmem (mgr.34373) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:35 gibba003 bash[32348]: cluster 2021-03-10T14:20:34.375186+0000 mgr.gibba043.dnkmem (mgr.34373) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:37 gibba043 bash[24019]: cluster 2021-03-10T14:20:36.376938+0000 mgr.gibba043.dnkmem (mgr.34373) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:37 gibba003 bash[31385]: cluster 2021-03-10T14:20:36.376938+0000 mgr.gibba043.dnkmem (mgr.34373) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:37 gibba003 bash[32348]: cluster 2021-03-10T14:20:36.376938+0000 mgr.gibba043.dnkmem (mgr.34373) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:39 gibba043 bash[24019]: cluster 2021-03-10T14:20:38.378514+0000 mgr.gibba043.dnkmem (mgr.34373) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:39 gibba003 bash[31385]: cluster 2021-03-10T14:20:38.378514+0000 mgr.gibba043.dnkmem (mgr.34373) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:39 gibba003 bash[32348]: cluster 2021-03-10T14:20:38.378514+0000 mgr.gibba043.dnkmem (mgr.34373) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:41 gibba043 bash[24019]: cephadm 2021-03-10T14:20:39.832390+0000 mgr.gibba043.dnkmem (mgr.34373) 1595 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:41.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:41 gibba043 bash[24019]: cluster 2021-03-10T14:20:40.380108+0000 mgr.gibba043.dnkmem (mgr.34373) 1596 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:41 gibba003 bash[32348]: cephadm 2021-03-10T14:20:39.832390+0000 mgr.gibba043.dnkmem (mgr.34373) 1595 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:41 gibba003 bash[32348]: cluster 2021-03-10T14:20:40.380108+0000 mgr.gibba043.dnkmem (mgr.34373) 1596 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:41 gibba003 bash[31385]: cephadm 2021-03-10T14:20:39.832390+0000 mgr.gibba043.dnkmem (mgr.34373) 1595 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:41.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:41 gibba003 bash[31385]: cluster 2021-03-10T14:20:40.380108+0000 mgr.gibba043.dnkmem (mgr.34373) 1596 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.473 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:20:43.704 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:20:43.704 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (29m) 4m ago 34m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:20:43.704 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (34m) 3m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:20:43.704 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:20:43.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:20:43.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:20:43.705 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:20:43.705 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (28m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:20:43.706 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:20:43.706 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:20:43.706 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:20:43.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:20:43.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:20:43.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:20:43.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:20:43.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:20:43.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:20:43.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:20:43.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:20:43.708 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:20:43.708 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:20:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:43 gibba043 bash[24019]: cluster 2021-03-10T14:20:42.381559+0000 mgr.gibba043.dnkmem (mgr.34373) 1597 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:43 gibba003 bash[31385]: cluster 2021-03-10T14:20:42.381559+0000 mgr.gibba043.dnkmem (mgr.34373) 1597 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:43 gibba003 bash[32348]: cluster 2021-03-10T14:20:42.381559+0000 mgr.gibba043.dnkmem (mgr.34373) 1597 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.956 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:20:43.956 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:20:43.956 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:43.957 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:20:43.957 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:20:43.957 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:43.957 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:20:43.958 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:20:43.958 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:20:43.958 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:20:43.958 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:20:43.959 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:20:43.959 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:20:43.959 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:20:43.959 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:20:44.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:44 gibba043 bash[24019]: audit 2021-03-10T14:20:43.462593+0000 mgr.gibba043.dnkmem (mgr.34373) 1598 : audit [DBG] from='client.55120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:44.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:44 gibba043 bash[24019]: audit 2021-03-10T14:20:43.957631+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.2.103:0/3610882681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:44.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:44 gibba003 bash[31385]: audit 2021-03-10T14:20:43.462593+0000 mgr.gibba043.dnkmem (mgr.34373) 1598 : audit [DBG] from='client.55120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:44.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:44 gibba003 bash[31385]: audit 2021-03-10T14:20:43.957631+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.2.103:0/3610882681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:44.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:44 gibba003 bash[32348]: audit 2021-03-10T14:20:43.462593+0000 mgr.gibba043.dnkmem (mgr.34373) 1598 : audit [DBG] from='client.55120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:44.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:44 gibba003 bash[32348]: audit 2021-03-10T14:20:43.957631+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.2.103:0/3610882681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:45 gibba003 bash[31385]: audit 2021-03-10T14:20:43.690581+0000 mgr.gibba043.dnkmem (mgr.34373) 1599 : audit [DBG] from='client.45141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:45 gibba003 bash[31385]: cluster 2021-03-10T14:20:44.383041+0000 mgr.gibba043.dnkmem (mgr.34373) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:45 gibba003 bash[32348]: audit 2021-03-10T14:20:43.690581+0000 mgr.gibba043.dnkmem (mgr.34373) 1599 : audit [DBG] from='client.45141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:45 gibba003 bash[32348]: cluster 2021-03-10T14:20:44.383041+0000 mgr.gibba043.dnkmem (mgr.34373) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:45 gibba043 bash[24019]: audit 2021-03-10T14:20:43.690581+0000 mgr.gibba043.dnkmem (mgr.34373) 1599 : audit [DBG] from='client.45141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:46.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:45 gibba043 bash[24019]: cluster 2021-03-10T14:20:44.383041+0000 mgr.gibba043.dnkmem (mgr.34373) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:47 gibba003 bash[31385]: cluster 2021-03-10T14:20:46.384832+0000 mgr.gibba043.dnkmem (mgr.34373) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:47 gibba003 bash[32348]: cluster 2021-03-10T14:20:46.384832+0000 mgr.gibba043.dnkmem (mgr.34373) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:47 gibba043 bash[24019]: cluster 2021-03-10T14:20:46.384832+0000 mgr.gibba043.dnkmem (mgr.34373) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:49 gibba003 bash[31385]: cluster 2021-03-10T14:20:48.386508+0000 mgr.gibba043.dnkmem (mgr.34373) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:49 gibba003 bash[32348]: cluster 2021-03-10T14:20:48.386508+0000 mgr.gibba043.dnkmem (mgr.34373) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:49 gibba043 bash[24019]: cluster 2021-03-10T14:20:48.386508+0000 mgr.gibba043.dnkmem (mgr.34373) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:51 gibba003 bash[31385]: cluster 2021-03-10T14:20:50.388066+0000 mgr.gibba043.dnkmem (mgr.34373) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:51 gibba003 bash[32348]: cluster 2021-03-10T14:20:50.388066+0000 mgr.gibba043.dnkmem (mgr.34373) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:51 gibba043 bash[24019]: cluster 2021-03-10T14:20:50.388066+0000 mgr.gibba043.dnkmem (mgr.34373) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:53 gibba003 bash[31385]: cluster 2021-03-10T14:20:52.389454+0000 mgr.gibba043.dnkmem (mgr.34373) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:53 gibba003 bash[32348]: cluster 2021-03-10T14:20:52.389454+0000 mgr.gibba043.dnkmem (mgr.34373) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:53 gibba043 bash[24019]: cluster 2021-03-10T14:20:52.389454+0000 mgr.gibba043.dnkmem (mgr.34373) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: cluster 2021-03-10T14:20:54.391122+0000 mgr.gibba043.dnkmem (mgr.34373) 1605 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.085187+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:20:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.089176+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.090880+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.092280+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.093730+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.096973+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[31385]: audit 2021-03-10T14:20:55.098521+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: cluster 2021-03-10T14:20:54.391122+0000 mgr.gibba043.dnkmem (mgr.34373) 1605 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.085187+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:20:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.089176+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.090880+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.092280+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.093730+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.096973+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:55 gibba003 bash[32348]: audit 2021-03-10T14:20:55.098521+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: cluster 2021-03-10T14:20:54.391122+0000 mgr.gibba043.dnkmem (mgr.34373) 1605 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.085187+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:20:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.089176+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.090880+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.092280+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:56.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.093730+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:56.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.096973+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:56.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:55 gibba043 bash[24019]: audit 2021-03-10T14:20:55.098521+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:54.849172+0000 mgr.gibba043.dnkmem (mgr.34373) 1606 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:20:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:54.850793+0000 mgr.gibba043.dnkmem (mgr.34373) 1607 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:20:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.086098+0000 mgr.gibba043.dnkmem (mgr.34373) 1608 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.088255+0000 mgr.gibba043.dnkmem (mgr.34373) 1609 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.089753+0000 mgr.gibba043.dnkmem (mgr.34373) 1610 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.089796+0000 mgr.gibba043.dnkmem (mgr.34373) 1611 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.091203+0000 mgr.gibba043.dnkmem (mgr.34373) 1612 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.091248+0000 mgr.gibba043.dnkmem (mgr.34373) 1613 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.092405+0000 mgr.gibba043.dnkmem (mgr.34373) 1614 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.094323+0000 mgr.gibba043.dnkmem (mgr.34373) 1615 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.094369+0000 mgr.gibba043.dnkmem (mgr.34373) 1616 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.095486+0000 mgr.gibba043.dnkmem (mgr.34373) 1617 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.095957+0000 mgr.gibba043.dnkmem (mgr.34373) 1618 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.097022+0000 mgr.gibba043.dnkmem (mgr.34373) 1619 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.097119+0000 mgr.gibba043.dnkmem (mgr.34373) 1620 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[31385]: cephadm 2021-03-10T14:20:55.097255+0000 mgr.gibba043.dnkmem (mgr.34373) 1621 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:54.849172+0000 mgr.gibba043.dnkmem (mgr.34373) 1606 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:20:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:54.850793+0000 mgr.gibba043.dnkmem (mgr.34373) 1607 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:20:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.086098+0000 mgr.gibba043.dnkmem (mgr.34373) 1608 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.088255+0000 mgr.gibba043.dnkmem (mgr.34373) 1609 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.089753+0000 mgr.gibba043.dnkmem (mgr.34373) 1610 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.089796+0000 mgr.gibba043.dnkmem (mgr.34373) 1611 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.091203+0000 mgr.gibba043.dnkmem (mgr.34373) 1612 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.091248+0000 mgr.gibba043.dnkmem (mgr.34373) 1613 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.092405+0000 mgr.gibba043.dnkmem (mgr.34373) 1614 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.094323+0000 mgr.gibba043.dnkmem (mgr.34373) 1615 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.094369+0000 mgr.gibba043.dnkmem (mgr.34373) 1616 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.095486+0000 mgr.gibba043.dnkmem (mgr.34373) 1617 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.095957+0000 mgr.gibba043.dnkmem (mgr.34373) 1618 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.097022+0000 mgr.gibba043.dnkmem (mgr.34373) 1619 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.097119+0000 mgr.gibba043.dnkmem (mgr.34373) 1620 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:56.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:56 gibba003 bash[32348]: cephadm 2021-03-10T14:20:55.097255+0000 mgr.gibba043.dnkmem (mgr.34373) 1621 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:54.849172+0000 mgr.gibba043.dnkmem (mgr.34373) 1606 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:20:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:54.850793+0000 mgr.gibba043.dnkmem (mgr.34373) 1607 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:20:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.086098+0000 mgr.gibba043.dnkmem (mgr.34373) 1608 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.088255+0000 mgr.gibba043.dnkmem (mgr.34373) 1609 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.089753+0000 mgr.gibba043.dnkmem (mgr.34373) 1610 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.089796+0000 mgr.gibba043.dnkmem (mgr.34373) 1611 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.091203+0000 mgr.gibba043.dnkmem (mgr.34373) 1612 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.091248+0000 mgr.gibba043.dnkmem (mgr.34373) 1613 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.092405+0000 mgr.gibba043.dnkmem (mgr.34373) 1614 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.094323+0000 mgr.gibba043.dnkmem (mgr.34373) 1615 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.094369+0000 mgr.gibba043.dnkmem (mgr.34373) 1616 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.095486+0000 mgr.gibba043.dnkmem (mgr.34373) 1617 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:57.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.095957+0000 mgr.gibba043.dnkmem (mgr.34373) 1618 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:57.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.097022+0000 mgr.gibba043.dnkmem (mgr.34373) 1619 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:57.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.097119+0000 mgr.gibba043.dnkmem (mgr.34373) 1620 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:57.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:56 gibba043 bash[24019]: cephadm 2021-03-10T14:20:55.097255+0000 mgr.gibba043.dnkmem (mgr.34373) 1621 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:20:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:57 gibba003 bash[31385]: cluster 2021-03-10T14:20:56.393064+0000 mgr.gibba043.dnkmem (mgr.34373) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:57 gibba003 bash[32348]: cluster 2021-03-10T14:20:56.393064+0000 mgr.gibba043.dnkmem (mgr.34373) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:57 gibba043 bash[24019]: cluster 2021-03-10T14:20:56.393064+0000 mgr.gibba043.dnkmem (mgr.34373) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:20:59 gibba003 bash[31385]: cluster 2021-03-10T14:20:58.394723+0000 mgr.gibba043.dnkmem (mgr.34373) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:20:59 gibba003 bash[32348]: cluster 2021-03-10T14:20:58.394723+0000 mgr.gibba043.dnkmem (mgr.34373) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:20:59 gibba043 bash[24019]: cluster 2021-03-10T14:20:58.394723+0000 mgr.gibba043.dnkmem (mgr.34373) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:01 gibba003 bash[31385]: cluster 2021-03-10T14:21:00.396468+0000 mgr.gibba043.dnkmem (mgr.34373) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:01 gibba003 bash[32348]: cluster 2021-03-10T14:21:00.396468+0000 mgr.gibba043.dnkmem (mgr.34373) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:01 gibba043 bash[24019]: cluster 2021-03-10T14:21:00.396468+0000 mgr.gibba043.dnkmem (mgr.34373) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:03 gibba003 bash[31385]: cluster 2021-03-10T14:21:02.397969+0000 mgr.gibba043.dnkmem (mgr.34373) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:03 gibba003 bash[32348]: cluster 2021-03-10T14:21:02.397969+0000 mgr.gibba043.dnkmem (mgr.34373) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:03 gibba043 bash[24019]: cluster 2021-03-10T14:21:02.397969+0000 mgr.gibba043.dnkmem (mgr.34373) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:05 gibba003 bash[31385]: cluster 2021-03-10T14:21:04.400001+0000 mgr.gibba043.dnkmem (mgr.34373) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:05 gibba003 bash[32348]: cluster 2021-03-10T14:21:04.400001+0000 mgr.gibba043.dnkmem (mgr.34373) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:05 gibba043 bash[24019]: cluster 2021-03-10T14:21:04.400001+0000 mgr.gibba043.dnkmem (mgr.34373) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:07 gibba003 bash[31385]: cluster 2021-03-10T14:21:06.401843+0000 mgr.gibba043.dnkmem (mgr.34373) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:07 gibba003 bash[32348]: cluster 2021-03-10T14:21:06.401843+0000 mgr.gibba043.dnkmem (mgr.34373) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:07 gibba043 bash[24019]: cluster 2021-03-10T14:21:06.401843+0000 mgr.gibba043.dnkmem (mgr.34373) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:09 gibba003 bash[31385]: cluster 2021-03-10T14:21:08.403397+0000 mgr.gibba043.dnkmem (mgr.34373) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:09 gibba003 bash[32348]: cluster 2021-03-10T14:21:08.403397+0000 mgr.gibba043.dnkmem (mgr.34373) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:09 gibba043 bash[24019]: cluster 2021-03-10T14:21:08.403397+0000 mgr.gibba043.dnkmem (mgr.34373) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:11 gibba003 bash[31385]: cephadm 2021-03-10T14:21:10.113052+0000 mgr.gibba043.dnkmem (mgr.34373) 1629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:11 gibba003 bash[31385]: cluster 2021-03-10T14:21:10.404937+0000 mgr.gibba043.dnkmem (mgr.34373) 1630 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:11 gibba003 bash[32348]: cephadm 2021-03-10T14:21:10.113052+0000 mgr.gibba043.dnkmem (mgr.34373) 1629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:11 gibba003 bash[32348]: cluster 2021-03-10T14:21:10.404937+0000 mgr.gibba043.dnkmem (mgr.34373) 1630 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:11 gibba043 bash[24019]: cephadm 2021-03-10T14:21:10.113052+0000 mgr.gibba043.dnkmem (mgr.34373) 1629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:11 gibba043 bash[24019]: cluster 2021-03-10T14:21:10.404937+0000 mgr.gibba043.dnkmem (mgr.34373) 1630 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: cluster 2021-03-10T14:21:12.406310+0000 mgr.gibba043.dnkmem (mgr.34373) 1631 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.838635+0000 mon.c (mon.1) 473 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:21:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.839403+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.839989+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:21:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.840088+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.840732+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.841928+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.843142+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.844101+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.909967+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.911107+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.955156+0000 mon.c (mon.1) 478 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[31385]: audit 2021-03-10T14:21:12.956241+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: cluster 2021-03-10T14:21:12.406310+0000 mgr.gibba043.dnkmem (mgr.34373) 1631 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.838635+0000 mon.c (mon.1) 473 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:21:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.839403+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.839989+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:21:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.840088+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.840732+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.841928+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.843142+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:21:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.844101+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.909967+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.911107+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.955156+0000 mon.c (mon.1) 478 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:13 gibba003 bash[32348]: audit 2021-03-10T14:21:12.956241+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: cluster 2021-03-10T14:21:12.406310+0000 mgr.gibba043.dnkmem (mgr.34373) 1631 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.838635+0000 mon.c (mon.1) 473 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:21:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.839403+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:21:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.839989+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:21:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.840088+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:21:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.840732+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.841928+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:21:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.843142+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:21:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.844101+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.909967+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.911107+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.955156+0000 mon.c (mon.1) 478 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:13 gibba043 bash[24019]: audit 2021-03-10T14:21:12.956241+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:14.200 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:21:14.427 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:21:14.428 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (29m) 5m ago 34m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:21:14.428 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (34m) 4m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:21:14.428 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (29m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:21:14.429 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:21:14.429 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:21:14.429 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:21:14.429 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:21:14.430 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:21:14.430 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:21:14.430 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:21:14.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:21:14.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:21:14.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:21:14.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:21:14.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:21:14.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:21:14.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:21:14.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (24m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:21:14.432 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:21:14.433 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:21:14.679 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:21:14.679 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:21:14.679 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:14.680 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:21:14.680 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:21:14.680 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:14.681 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:21:14.681 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:21:14.681 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:21:14.681 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:21:14.682 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:21:14.682 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:21:14.682 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:21:14.683 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:21:14.683 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:14 gibba043 bash[24019]: audit 2021-03-10T14:21:14.191105+0000 mgr.gibba043.dnkmem (mgr.34373) 1632 : audit [DBG] from='client.55138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:14 gibba043 bash[24019]: cluster 2021-03-10T14:21:14.408096+0000 mgr.gibba043.dnkmem (mgr.34373) 1633 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:14 gibba043 bash[24019]: audit 2021-03-10T14:21:14.413867+0000 mgr.gibba043.dnkmem (mgr.34373) 1634 : audit [DBG] from='client.45159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:14 gibba043 bash[24019]: audit 2021-03-10T14:21:14.680014+0000 mon.a (mon.0) 694 : audit [DBG] from='client.? 172.21.2.103:0/1778982173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[31385]: audit 2021-03-10T14:21:14.191105+0000 mgr.gibba043.dnkmem (mgr.34373) 1632 : audit [DBG] from='client.55138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[31385]: cluster 2021-03-10T14:21:14.408096+0000 mgr.gibba043.dnkmem (mgr.34373) 1633 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[31385]: audit 2021-03-10T14:21:14.413867+0000 mgr.gibba043.dnkmem (mgr.34373) 1634 : audit [DBG] from='client.45159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[31385]: audit 2021-03-10T14:21:14.680014+0000 mon.a (mon.0) 694 : audit [DBG] from='client.? 172.21.2.103:0/1778982173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[32348]: audit 2021-03-10T14:21:14.191105+0000 mgr.gibba043.dnkmem (mgr.34373) 1632 : audit [DBG] from='client.55138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[32348]: cluster 2021-03-10T14:21:14.408096+0000 mgr.gibba043.dnkmem (mgr.34373) 1633 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[32348]: audit 2021-03-10T14:21:14.413867+0000 mgr.gibba043.dnkmem (mgr.34373) 1634 : audit [DBG] from='client.45159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:14 gibba003 bash[32348]: audit 2021-03-10T14:21:14.680014+0000 mon.a (mon.0) 694 : audit [DBG] from='client.? 172.21.2.103:0/1778982173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:17 gibba043 bash[24019]: cluster 2021-03-10T14:21:16.409841+0000 mgr.gibba043.dnkmem (mgr.34373) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:17 gibba003 bash[31385]: cluster 2021-03-10T14:21:16.409841+0000 mgr.gibba043.dnkmem (mgr.34373) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:17 gibba003 bash[32348]: cluster 2021-03-10T14:21:16.409841+0000 mgr.gibba043.dnkmem (mgr.34373) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:19 gibba043 bash[24019]: cluster 2021-03-10T14:21:18.411476+0000 mgr.gibba043.dnkmem (mgr.34373) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:19 gibba003 bash[31385]: cluster 2021-03-10T14:21:18.411476+0000 mgr.gibba043.dnkmem (mgr.34373) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:19 gibba003 bash[32348]: cluster 2021-03-10T14:21:18.411476+0000 mgr.gibba043.dnkmem (mgr.34373) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:21 gibba043 bash[24019]: cluster 2021-03-10T14:21:20.412774+0000 mgr.gibba043.dnkmem (mgr.34373) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:21 gibba003 bash[31385]: cluster 2021-03-10T14:21:20.412774+0000 mgr.gibba043.dnkmem (mgr.34373) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:21 gibba003 bash[32348]: cluster 2021-03-10T14:21:20.412774+0000 mgr.gibba043.dnkmem (mgr.34373) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:23 gibba043 bash[24019]: cluster 2021-03-10T14:21:22.414137+0000 mgr.gibba043.dnkmem (mgr.34373) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:23 gibba003 bash[31385]: cluster 2021-03-10T14:21:22.414137+0000 mgr.gibba043.dnkmem (mgr.34373) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:23 gibba003 bash[32348]: cluster 2021-03-10T14:21:22.414137+0000 mgr.gibba043.dnkmem (mgr.34373) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:25 gibba043 bash[24019]: cluster 2021-03-10T14:21:24.415817+0000 mgr.gibba043.dnkmem (mgr.34373) 1639 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:25 gibba003 bash[31385]: cluster 2021-03-10T14:21:24.415817+0000 mgr.gibba043.dnkmem (mgr.34373) 1639 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:25 gibba003 bash[32348]: cluster 2021-03-10T14:21:24.415817+0000 mgr.gibba043.dnkmem (mgr.34373) 1639 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:26 gibba043 bash[24019]: cephadm 2021-03-10T14:21:25.128980+0000 mgr.gibba043.dnkmem (mgr.34373) 1640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:26.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:26 gibba003 bash[31385]: cephadm 2021-03-10T14:21:25.128980+0000 mgr.gibba043.dnkmem (mgr.34373) 1640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:26.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:26 gibba003 bash[32348]: cephadm 2021-03-10T14:21:25.128980+0000 mgr.gibba043.dnkmem (mgr.34373) 1640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:27 gibba003 bash[31385]: cluster 2021-03-10T14:21:26.417561+0000 mgr.gibba043.dnkmem (mgr.34373) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:27 gibba003 bash[32348]: cluster 2021-03-10T14:21:26.417561+0000 mgr.gibba043.dnkmem (mgr.34373) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:27 gibba043 bash[24019]: cluster 2021-03-10T14:21:26.417561+0000 mgr.gibba043.dnkmem (mgr.34373) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:29 gibba003 bash[31385]: cluster 2021-03-10T14:21:28.419203+0000 mgr.gibba043.dnkmem (mgr.34373) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:29 gibba003 bash[32348]: cluster 2021-03-10T14:21:28.419203+0000 mgr.gibba043.dnkmem (mgr.34373) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:29 gibba043 bash[24019]: cluster 2021-03-10T14:21:28.419203+0000 mgr.gibba043.dnkmem (mgr.34373) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:31 gibba003 bash[31385]: cluster 2021-03-10T14:21:30.420494+0000 mgr.gibba043.dnkmem (mgr.34373) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:31.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:31 gibba003 bash[32348]: cluster 2021-03-10T14:21:30.420494+0000 mgr.gibba043.dnkmem (mgr.34373) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:31 gibba043 bash[24019]: cluster 2021-03-10T14:21:30.420494+0000 mgr.gibba043.dnkmem (mgr.34373) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:33 gibba003 bash[31385]: cluster 2021-03-10T14:21:32.422158+0000 mgr.gibba043.dnkmem (mgr.34373) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:33 gibba003 bash[32348]: cluster 2021-03-10T14:21:32.422158+0000 mgr.gibba043.dnkmem (mgr.34373) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:33 gibba043 bash[24019]: cluster 2021-03-10T14:21:32.422158+0000 mgr.gibba043.dnkmem (mgr.34373) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:35 gibba003 bash[31385]: cluster 2021-03-10T14:21:34.423843+0000 mgr.gibba043.dnkmem (mgr.34373) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:35 gibba003 bash[32348]: cluster 2021-03-10T14:21:34.423843+0000 mgr.gibba043.dnkmem (mgr.34373) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:35 gibba043 bash[24019]: cluster 2021-03-10T14:21:34.423843+0000 mgr.gibba043.dnkmem (mgr.34373) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:37 gibba003 bash[31385]: cluster 2021-03-10T14:21:36.425655+0000 mgr.gibba043.dnkmem (mgr.34373) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:37 gibba003 bash[32348]: cluster 2021-03-10T14:21:36.425655+0000 mgr.gibba043.dnkmem (mgr.34373) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:37 gibba043 bash[24019]: cluster 2021-03-10T14:21:36.425655+0000 mgr.gibba043.dnkmem (mgr.34373) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:39 gibba003 bash[31385]: cluster 2021-03-10T14:21:38.426967+0000 mgr.gibba043.dnkmem (mgr.34373) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:39 gibba003 bash[32348]: cluster 2021-03-10T14:21:38.426967+0000 mgr.gibba043.dnkmem (mgr.34373) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:39 gibba043 bash[24019]: cluster 2021-03-10T14:21:38.426967+0000 mgr.gibba043.dnkmem (mgr.34373) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:41 gibba003 bash[31385]: cephadm 2021-03-10T14:21:40.144711+0000 mgr.gibba043.dnkmem (mgr.34373) 1648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:41 gibba003 bash[31385]: cluster 2021-03-10T14:21:40.428562+0000 mgr.gibba043.dnkmem (mgr.34373) 1649 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:41 gibba003 bash[32348]: cephadm 2021-03-10T14:21:40.144711+0000 mgr.gibba043.dnkmem (mgr.34373) 1648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:41 gibba003 bash[32348]: cluster 2021-03-10T14:21:40.428562+0000 mgr.gibba043.dnkmem (mgr.34373) 1649 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:41 gibba043 bash[24019]: cephadm 2021-03-10T14:21:40.144711+0000 mgr.gibba043.dnkmem (mgr.34373) 1648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:42.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:41 gibba043 bash[24019]: cluster 2021-03-10T14:21:40.428562+0000 mgr.gibba043.dnkmem (mgr.34373) 1649 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:43 gibba043 bash[24019]: cluster 2021-03-10T14:21:42.429937+0000 mgr.gibba043.dnkmem (mgr.34373) 1650 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:43 gibba003 bash[31385]: cluster 2021-03-10T14:21:42.429937+0000 mgr.gibba043.dnkmem (mgr.34373) 1650 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:43 gibba003 bash[32348]: cluster 2021-03-10T14:21:42.429937+0000 mgr.gibba043.dnkmem (mgr.34373) 1650 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:44.934 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:21:45.178 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:21:45.179 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (30m) 5m ago 35m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:21:45.179 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (35m) 4m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:21:45.179 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:21:45.179 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:21:45.180 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:21:45.180 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:21:45.180 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (29m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:21:45.180 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:21:45.180 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:21:45.181 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:21:45.181 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:21:45.181 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:21:45.181 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:21:45.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:21:45.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:21:45.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:21:45.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:21:45.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:21:45.183 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:21:45.183 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:21:45.426 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:21:45.426 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:21:45.426 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:45.427 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:21:45.427 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:21:45.427 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:45.427 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:21:45.427 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:21:45.428 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:21:45.428 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:21:45.428 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:21:45.428 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:21:45.429 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:21:45.429 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:21:45.429 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:21:45.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:45 gibba043 bash[24019]: cluster 2021-03-10T14:21:44.431799+0000 mgr.gibba043.dnkmem (mgr.34373) 1651 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:45 gibba043 bash[24019]: audit 2021-03-10T14:21:45.426780+0000 mon.a (mon.0) 695 : audit [DBG] from='client.? 172.21.2.103:0/1494794082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:45 gibba003 bash[31385]: cluster 2021-03-10T14:21:44.431799+0000 mgr.gibba043.dnkmem (mgr.34373) 1651 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:45 gibba003 bash[31385]: audit 2021-03-10T14:21:45.426780+0000 mon.a (mon.0) 695 : audit [DBG] from='client.? 172.21.2.103:0/1494794082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:45 gibba003 bash[32348]: cluster 2021-03-10T14:21:44.431799+0000 mgr.gibba043.dnkmem (mgr.34373) 1651 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:45 gibba003 bash[32348]: audit 2021-03-10T14:21:45.426780+0000 mon.a (mon.0) 695 : audit [DBG] from='client.? 172.21.2.103:0/1494794082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:46.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:46 gibba043 bash[24019]: audit 2021-03-10T14:21:44.915768+0000 mgr.gibba043.dnkmem (mgr.34373) 1652 : audit [DBG] from='client.45171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:46.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:46 gibba043 bash[24019]: audit 2021-03-10T14:21:45.165320+0000 mgr.gibba043.dnkmem (mgr.34373) 1653 : audit [DBG] from='client.45177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:46.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:46 gibba003 bash[31385]: audit 2021-03-10T14:21:44.915768+0000 mgr.gibba043.dnkmem (mgr.34373) 1652 : audit [DBG] from='client.45171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:46.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:46 gibba003 bash[31385]: audit 2021-03-10T14:21:45.165320+0000 mgr.gibba043.dnkmem (mgr.34373) 1653 : audit [DBG] from='client.45177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:46.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:46 gibba003 bash[32348]: audit 2021-03-10T14:21:44.915768+0000 mgr.gibba043.dnkmem (mgr.34373) 1652 : audit [DBG] from='client.45171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:46 gibba003 bash[32348]: audit 2021-03-10T14:21:45.165320+0000 mgr.gibba043.dnkmem (mgr.34373) 1653 : audit [DBG] from='client.45177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:47 gibba043 bash[24019]: cluster 2021-03-10T14:21:46.433262+0000 mgr.gibba043.dnkmem (mgr.34373) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:47 gibba003 bash[31385]: cluster 2021-03-10T14:21:46.433262+0000 mgr.gibba043.dnkmem (mgr.34373) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:47 gibba003 bash[32348]: cluster 2021-03-10T14:21:46.433262+0000 mgr.gibba043.dnkmem (mgr.34373) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:49 gibba043 bash[24019]: cluster 2021-03-10T14:21:48.434902+0000 mgr.gibba043.dnkmem (mgr.34373) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:49 gibba003 bash[31385]: cluster 2021-03-10T14:21:48.434902+0000 mgr.gibba043.dnkmem (mgr.34373) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:49 gibba003 bash[32348]: cluster 2021-03-10T14:21:48.434902+0000 mgr.gibba043.dnkmem (mgr.34373) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:51 gibba043 bash[24019]: cluster 2021-03-10T14:21:50.436134+0000 mgr.gibba043.dnkmem (mgr.34373) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:51 gibba003 bash[31385]: cluster 2021-03-10T14:21:50.436134+0000 mgr.gibba043.dnkmem (mgr.34373) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:51 gibba003 bash[32348]: cluster 2021-03-10T14:21:50.436134+0000 mgr.gibba043.dnkmem (mgr.34373) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:53 gibba043 bash[24019]: cluster 2021-03-10T14:21:52.437477+0000 mgr.gibba043.dnkmem (mgr.34373) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:53 gibba003 bash[31385]: cluster 2021-03-10T14:21:52.437477+0000 mgr.gibba043.dnkmem (mgr.34373) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:53 gibba003 bash[32348]: cluster 2021-03-10T14:21:52.437477+0000 mgr.gibba043.dnkmem (mgr.34373) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: cluster 2021-03-10T14:21:54.439271+0000 mgr.gibba043.dnkmem (mgr.34373) 1658 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.370759+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:21:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.374707+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.376386+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.377925+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.379608+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.383174+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:55 gibba043 bash[24019]: audit 2021-03-10T14:21:55.385144+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: cluster 2021-03-10T14:21:54.439271+0000 mgr.gibba043.dnkmem (mgr.34373) 1658 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.370759+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:21:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.374707+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.376386+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.377925+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.379608+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.383174+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[31385]: audit 2021-03-10T14:21:55.385144+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: cluster 2021-03-10T14:21:54.439271+0000 mgr.gibba043.dnkmem (mgr.34373) 1658 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.370759+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:21:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.374707+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.376386+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.377925+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.379608+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.383174+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:55 gibba003 bash[32348]: audit 2021-03-10T14:21:55.385144+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.161573+0000 mgr.gibba043.dnkmem (mgr.34373) 1659 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:21:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.162782+0000 mgr.gibba043.dnkmem (mgr.34373) 1660 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:21:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.371497+0000 mgr.gibba043.dnkmem (mgr.34373) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.373630+0000 mgr.gibba043.dnkmem (mgr.34373) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.374993+0000 mgr.gibba043.dnkmem (mgr.34373) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.375029+0000 mgr.gibba043.dnkmem (mgr.34373) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.376718+0000 mgr.gibba043.dnkmem (mgr.34373) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.376755+0000 mgr.gibba043.dnkmem (mgr.34373) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.378234+0000 mgr.gibba043.dnkmem (mgr.34373) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.380048+0000 mgr.gibba043.dnkmem (mgr.34373) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.380086+0000 mgr.gibba043.dnkmem (mgr.34373) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.381874+0000 mgr.gibba043.dnkmem (mgr.34373) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.382222+0000 mgr.gibba043.dnkmem (mgr.34373) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.383849+0000 mgr.gibba043.dnkmem (mgr.34373) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.383892+0000 mgr.gibba043.dnkmem (mgr.34373) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:56.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:56 gibba043 bash[24019]: cephadm 2021-03-10T14:21:55.384006+0000 mgr.gibba043.dnkmem (mgr.34373) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.161573+0000 mgr.gibba043.dnkmem (mgr.34373) 1659 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:21:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.162782+0000 mgr.gibba043.dnkmem (mgr.34373) 1660 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:21:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.371497+0000 mgr.gibba043.dnkmem (mgr.34373) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.373630+0000 mgr.gibba043.dnkmem (mgr.34373) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.374993+0000 mgr.gibba043.dnkmem (mgr.34373) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.375029+0000 mgr.gibba043.dnkmem (mgr.34373) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.376718+0000 mgr.gibba043.dnkmem (mgr.34373) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.376755+0000 mgr.gibba043.dnkmem (mgr.34373) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.378234+0000 mgr.gibba043.dnkmem (mgr.34373) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.380048+0000 mgr.gibba043.dnkmem (mgr.34373) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.380086+0000 mgr.gibba043.dnkmem (mgr.34373) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.381874+0000 mgr.gibba043.dnkmem (mgr.34373) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.382222+0000 mgr.gibba043.dnkmem (mgr.34373) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.383849+0000 mgr.gibba043.dnkmem (mgr.34373) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.383892+0000 mgr.gibba043.dnkmem (mgr.34373) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[31385]: cephadm 2021-03-10T14:21:55.384006+0000 mgr.gibba043.dnkmem (mgr.34373) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.161573+0000 mgr.gibba043.dnkmem (mgr.34373) 1659 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:21:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.162782+0000 mgr.gibba043.dnkmem (mgr.34373) 1660 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:21:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.371497+0000 mgr.gibba043.dnkmem (mgr.34373) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.373630+0000 mgr.gibba043.dnkmem (mgr.34373) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.374993+0000 mgr.gibba043.dnkmem (mgr.34373) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.375029+0000 mgr.gibba043.dnkmem (mgr.34373) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.376718+0000 mgr.gibba043.dnkmem (mgr.34373) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.376755+0000 mgr.gibba043.dnkmem (mgr.34373) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.378234+0000 mgr.gibba043.dnkmem (mgr.34373) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.380048+0000 mgr.gibba043.dnkmem (mgr.34373) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.380086+0000 mgr.gibba043.dnkmem (mgr.34373) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.381874+0000 mgr.gibba043.dnkmem (mgr.34373) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.382222+0000 mgr.gibba043.dnkmem (mgr.34373) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.383849+0000 mgr.gibba043.dnkmem (mgr.34373) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.383892+0000 mgr.gibba043.dnkmem (mgr.34373) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:56 gibba003 bash[32348]: cephadm 2021-03-10T14:21:55.384006+0000 mgr.gibba043.dnkmem (mgr.34373) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:21:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:57 gibba043 bash[24019]: cluster 2021-03-10T14:21:56.441095+0000 mgr.gibba043.dnkmem (mgr.34373) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:57 gibba003 bash[31385]: cluster 2021-03-10T14:21:56.441095+0000 mgr.gibba043.dnkmem (mgr.34373) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:57 gibba003 bash[32348]: cluster 2021-03-10T14:21:56.441095+0000 mgr.gibba043.dnkmem (mgr.34373) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:21:59 gibba043 bash[24019]: cluster 2021-03-10T14:21:58.442624+0000 mgr.gibba043.dnkmem (mgr.34373) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:21:59 gibba003 bash[31385]: cluster 2021-03-10T14:21:58.442624+0000 mgr.gibba043.dnkmem (mgr.34373) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:21:59 gibba003 bash[32348]: cluster 2021-03-10T14:21:58.442624+0000 mgr.gibba043.dnkmem (mgr.34373) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:01 gibba043 bash[24019]: cluster 2021-03-10T14:22:00.444179+0000 mgr.gibba043.dnkmem (mgr.34373) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:01 gibba003 bash[31385]: cluster 2021-03-10T14:22:00.444179+0000 mgr.gibba043.dnkmem (mgr.34373) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:01 gibba003 bash[32348]: cluster 2021-03-10T14:22:00.444179+0000 mgr.gibba043.dnkmem (mgr.34373) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:03 gibba043 bash[24019]: cluster 2021-03-10T14:22:02.445858+0000 mgr.gibba043.dnkmem (mgr.34373) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:03 gibba003 bash[31385]: cluster 2021-03-10T14:22:02.445858+0000 mgr.gibba043.dnkmem (mgr.34373) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:03 gibba003 bash[32348]: cluster 2021-03-10T14:22:02.445858+0000 mgr.gibba043.dnkmem (mgr.34373) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:05 gibba043 bash[24019]: cluster 2021-03-10T14:22:04.447582+0000 mgr.gibba043.dnkmem (mgr.34373) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:05 gibba003 bash[31385]: cluster 2021-03-10T14:22:04.447582+0000 mgr.gibba043.dnkmem (mgr.34373) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:05 gibba003 bash[32348]: cluster 2021-03-10T14:22:04.447582+0000 mgr.gibba043.dnkmem (mgr.34373) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:07 gibba043 bash[24019]: cluster 2021-03-10T14:22:06.449109+0000 mgr.gibba043.dnkmem (mgr.34373) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:07 gibba003 bash[31385]: cluster 2021-03-10T14:22:06.449109+0000 mgr.gibba043.dnkmem (mgr.34373) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:07 gibba003 bash[32348]: cluster 2021-03-10T14:22:06.449109+0000 mgr.gibba043.dnkmem (mgr.34373) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:09 gibba003 bash[31385]: cluster 2021-03-10T14:22:08.450610+0000 mgr.gibba043.dnkmem (mgr.34373) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:09 gibba003 bash[32348]: cluster 2021-03-10T14:22:08.450610+0000 mgr.gibba043.dnkmem (mgr.34373) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:09 gibba043 bash[24019]: cluster 2021-03-10T14:22:08.450610+0000 mgr.gibba043.dnkmem (mgr.34373) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:11 gibba003 bash[31385]: cephadm 2021-03-10T14:22:10.392717+0000 mgr.gibba043.dnkmem (mgr.34373) 1682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:11 gibba003 bash[31385]: cluster 2021-03-10T14:22:10.452136+0000 mgr.gibba043.dnkmem (mgr.34373) 1683 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:11 gibba003 bash[32348]: cephadm 2021-03-10T14:22:10.392717+0000 mgr.gibba043.dnkmem (mgr.34373) 1682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:11 gibba003 bash[32348]: cluster 2021-03-10T14:22:10.452136+0000 mgr.gibba043.dnkmem (mgr.34373) 1683 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:11 gibba043 bash[24019]: cephadm 2021-03-10T14:22:10.392717+0000 mgr.gibba043.dnkmem (mgr.34373) 1682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:11 gibba043 bash[24019]: cluster 2021-03-10T14:22:10.452136+0000 mgr.gibba043.dnkmem (mgr.34373) 1683 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: cluster 2021-03-10T14:22:12.453827+0000 mgr.gibba043.dnkmem (mgr.34373) 1684 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.848308+0000 mon.c (mon.1) 485 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:22:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.849414+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.849730+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:22:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.850490+0000 mon.c (mon.1) 487 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.850981+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.851804+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.851879+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.852841+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.915877+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.917148+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.963887+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:13 gibba043 bash[24019]: audit 2021-03-10T14:22:12.965199+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: cluster 2021-03-10T14:22:12.453827+0000 mgr.gibba043.dnkmem (mgr.34373) 1684 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.848308+0000 mon.c (mon.1) 485 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:22:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.849414+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.849730+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:22:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.850490+0000 mon.c (mon.1) 487 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.850981+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.851804+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.851879+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.852841+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.915877+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.917148+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.963887+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[31385]: audit 2021-03-10T14:22:12.965199+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: cluster 2021-03-10T14:22:12.453827+0000 mgr.gibba043.dnkmem (mgr.34373) 1684 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.848308+0000 mon.c (mon.1) 485 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:22:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.849414+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.849730+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:22:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.850490+0000 mon.c (mon.1) 487 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.850981+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.851804+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.851879+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.852841+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:22:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.915877+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.917148+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.963887+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:13 gibba003 bash[32348]: audit 2021-03-10T14:22:12.965199+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:15.671 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:22:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:15 gibba043 bash[24019]: cluster 2021-03-10T14:22:14.455471+0000 mgr.gibba043.dnkmem (mgr.34373) 1685 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.898 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:22:15.898 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (30m) 6m ago 35m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:22:15.898 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (35m) 5m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:22:15.899 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (30m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:22:15.899 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:22:15.899 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:22:15.899 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:22:15.900 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:22:15.900 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:22:15.900 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:22:15.900 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:22:15.901 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:22:15.901 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:22:15.901 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:22:15.901 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:22:15.901 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:22:15.902 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:22:15.902 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:22:15.902 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (25m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:22:15.902 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:22:15.903 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:22:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:15 gibba003 bash[31385]: cluster 2021-03-10T14:22:14.455471+0000 mgr.gibba043.dnkmem (mgr.34373) 1685 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:15 gibba003 bash[32348]: cluster 2021-03-10T14:22:14.455471+0000 mgr.gibba043.dnkmem (mgr.34373) 1685 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:16.152 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:22:16.152 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:22:16.153 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:16.153 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:22:16.153 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:22:16.153 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:16.153 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:22:16.154 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:22:16.154 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:22:16.154 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:22:16.154 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:22:16.155 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:22:16.155 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:22:16.155 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:22:16.155 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:22:16.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:16 gibba043 bash[24019]: audit 2021-03-10T14:22:15.661259+0000 mgr.gibba043.dnkmem (mgr.34373) 1686 : audit [DBG] from='client.55174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:16.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:16 gibba043 bash[24019]: audit 2021-03-10T14:22:16.153470+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.2.103:0/3925698056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:16.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:16 gibba003 bash[31385]: audit 2021-03-10T14:22:15.661259+0000 mgr.gibba043.dnkmem (mgr.34373) 1686 : audit [DBG] from='client.55174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:16 gibba003 bash[31385]: audit 2021-03-10T14:22:16.153470+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.2.103:0/3925698056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:16.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:16 gibba003 bash[32348]: audit 2021-03-10T14:22:15.661259+0000 mgr.gibba043.dnkmem (mgr.34373) 1686 : audit [DBG] from='client.55174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:16.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:16 gibba003 bash[32348]: audit 2021-03-10T14:22:16.153470+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.2.103:0/3925698056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:17 gibba043 bash[24019]: audit 2021-03-10T14:22:15.884669+0000 mgr.gibba043.dnkmem (mgr.34373) 1687 : audit [DBG] from='client.55180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:17 gibba043 bash[24019]: cluster 2021-03-10T14:22:16.456292+0000 mgr.gibba043.dnkmem (mgr.34373) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:17 gibba003 bash[31385]: audit 2021-03-10T14:22:15.884669+0000 mgr.gibba043.dnkmem (mgr.34373) 1687 : audit [DBG] from='client.55180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:17 gibba003 bash[31385]: cluster 2021-03-10T14:22:16.456292+0000 mgr.gibba043.dnkmem (mgr.34373) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:17 gibba003 bash[32348]: audit 2021-03-10T14:22:15.884669+0000 mgr.gibba043.dnkmem (mgr.34373) 1687 : audit [DBG] from='client.55180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:17 gibba003 bash[32348]: cluster 2021-03-10T14:22:16.456292+0000 mgr.gibba043.dnkmem (mgr.34373) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:19 gibba043 bash[24019]: cluster 2021-03-10T14:22:18.457674+0000 mgr.gibba043.dnkmem (mgr.34373) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:19 gibba003 bash[31385]: cluster 2021-03-10T14:22:18.457674+0000 mgr.gibba043.dnkmem (mgr.34373) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:19 gibba003 bash[32348]: cluster 2021-03-10T14:22:18.457674+0000 mgr.gibba043.dnkmem (mgr.34373) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:21 gibba043 bash[24019]: cluster 2021-03-10T14:22:20.459075+0000 mgr.gibba043.dnkmem (mgr.34373) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:21 gibba003 bash[31385]: cluster 2021-03-10T14:22:20.459075+0000 mgr.gibba043.dnkmem (mgr.34373) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:21 gibba003 bash[32348]: cluster 2021-03-10T14:22:20.459075+0000 mgr.gibba043.dnkmem (mgr.34373) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:23 gibba043 bash[24019]: cluster 2021-03-10T14:22:22.460428+0000 mgr.gibba043.dnkmem (mgr.34373) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:23 gibba003 bash[31385]: cluster 2021-03-10T14:22:22.460428+0000 mgr.gibba043.dnkmem (mgr.34373) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.994 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:23 gibba003 bash[32348]: cluster 2021-03-10T14:22:22.460428+0000 mgr.gibba043.dnkmem (mgr.34373) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:25 gibba043 bash[24019]: cluster 2021-03-10T14:22:24.462051+0000 mgr.gibba043.dnkmem (mgr.34373) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:25 gibba003 bash[31385]: cluster 2021-03-10T14:22:24.462051+0000 mgr.gibba043.dnkmem (mgr.34373) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:25 gibba003 bash[32348]: cluster 2021-03-10T14:22:24.462051+0000 mgr.gibba043.dnkmem (mgr.34373) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:26 gibba043 bash[24019]: cephadm 2021-03-10T14:22:25.400469+0000 mgr.gibba043.dnkmem (mgr.34373) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:26.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:26 gibba003 bash[31385]: cephadm 2021-03-10T14:22:25.400469+0000 mgr.gibba043.dnkmem (mgr.34373) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:26.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:26 gibba003 bash[32348]: cephadm 2021-03-10T14:22:25.400469+0000 mgr.gibba043.dnkmem (mgr.34373) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:27 gibba043 bash[24019]: cluster 2021-03-10T14:22:26.462627+0000 mgr.gibba043.dnkmem (mgr.34373) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:27 gibba003 bash[31385]: cluster 2021-03-10T14:22:26.462627+0000 mgr.gibba043.dnkmem (mgr.34373) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:27 gibba003 bash[32348]: cluster 2021-03-10T14:22:26.462627+0000 mgr.gibba043.dnkmem (mgr.34373) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:29 gibba043 bash[24019]: cluster 2021-03-10T14:22:28.464123+0000 mgr.gibba043.dnkmem (mgr.34373) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:29 gibba003 bash[31385]: cluster 2021-03-10T14:22:28.464123+0000 mgr.gibba043.dnkmem (mgr.34373) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:29 gibba003 bash[32348]: cluster 2021-03-10T14:22:28.464123+0000 mgr.gibba043.dnkmem (mgr.34373) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:31 gibba043 bash[24019]: cluster 2021-03-10T14:22:30.465581+0000 mgr.gibba043.dnkmem (mgr.34373) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:31 gibba003 bash[31385]: cluster 2021-03-10T14:22:30.465581+0000 mgr.gibba043.dnkmem (mgr.34373) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:31 gibba003 bash[32348]: cluster 2021-03-10T14:22:30.465581+0000 mgr.gibba043.dnkmem (mgr.34373) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:33 gibba043 bash[24019]: cluster 2021-03-10T14:22:32.467091+0000 mgr.gibba043.dnkmem (mgr.34373) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:33 gibba003 bash[31385]: cluster 2021-03-10T14:22:32.467091+0000 mgr.gibba043.dnkmem (mgr.34373) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:33 gibba003 bash[32348]: cluster 2021-03-10T14:22:32.467091+0000 mgr.gibba043.dnkmem (mgr.34373) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:35 gibba043 bash[24019]: cluster 2021-03-10T14:22:34.468856+0000 mgr.gibba043.dnkmem (mgr.34373) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:35 gibba003 bash[31385]: cluster 2021-03-10T14:22:34.468856+0000 mgr.gibba043.dnkmem (mgr.34373) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:35 gibba003 bash[32348]: cluster 2021-03-10T14:22:34.468856+0000 mgr.gibba043.dnkmem (mgr.34373) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:37 gibba043 bash[24019]: cluster 2021-03-10T14:22:36.469720+0000 mgr.gibba043.dnkmem (mgr.34373) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:37 gibba003 bash[31385]: cluster 2021-03-10T14:22:36.469720+0000 mgr.gibba043.dnkmem (mgr.34373) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:37 gibba003 bash[32348]: cluster 2021-03-10T14:22:36.469720+0000 mgr.gibba043.dnkmem (mgr.34373) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:39 gibba043 bash[24019]: cluster 2021-03-10T14:22:38.471288+0000 mgr.gibba043.dnkmem (mgr.34373) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:39 gibba003 bash[31385]: cluster 2021-03-10T14:22:38.471288+0000 mgr.gibba043.dnkmem (mgr.34373) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:39 gibba003 bash[32348]: cluster 2021-03-10T14:22:38.471288+0000 mgr.gibba043.dnkmem (mgr.34373) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:41 gibba043 bash[24019]: cephadm 2021-03-10T14:22:40.416503+0000 mgr.gibba043.dnkmem (mgr.34373) 1701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:41.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:41 gibba043 bash[24019]: cluster 2021-03-10T14:22:40.472863+0000 mgr.gibba043.dnkmem (mgr.34373) 1702 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:41 gibba003 bash[31385]: cephadm 2021-03-10T14:22:40.416503+0000 mgr.gibba043.dnkmem (mgr.34373) 1701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:41 gibba003 bash[31385]: cluster 2021-03-10T14:22:40.472863+0000 mgr.gibba043.dnkmem (mgr.34373) 1702 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:41 gibba003 bash[32348]: cephadm 2021-03-10T14:22:40.416503+0000 mgr.gibba043.dnkmem (mgr.34373) 1701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:41 gibba003 bash[32348]: cluster 2021-03-10T14:22:40.472863+0000 mgr.gibba043.dnkmem (mgr.34373) 1702 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:43 gibba043 bash[24019]: cluster 2021-03-10T14:22:42.474201+0000 mgr.gibba043.dnkmem (mgr.34373) 1703 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:43 gibba003 bash[31385]: cluster 2021-03-10T14:22:42.474201+0000 mgr.gibba043.dnkmem (mgr.34373) 1703 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:43 gibba003 bash[32348]: cluster 2021-03-10T14:22:42.474201+0000 mgr.gibba043.dnkmem (mgr.34373) 1703 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:45 gibba043 bash[24019]: cluster 2021-03-10T14:22:44.476135+0000 mgr.gibba043.dnkmem (mgr.34373) 1704 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:45 gibba003 bash[31385]: cluster 2021-03-10T14:22:44.476135+0000 mgr.gibba043.dnkmem (mgr.34373) 1704 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:45 gibba003 bash[32348]: cluster 2021-03-10T14:22:44.476135+0000 mgr.gibba043.dnkmem (mgr.34373) 1704 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:46.396 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:22:46.635 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:22:46.635 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (31m) 7m ago 36m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:22:46.636 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (36m) 5m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:22:46.636 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:22:46.636 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:22:46.636 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (30m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:22:46.636 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (30m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:22:46.637 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (30m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:22:46.637 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:22:46.637 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (36m) 7m ago 36m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:22:46.637 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:22:46.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:22:46.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:22:46.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:22:46.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:22:46.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:22:46.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:22:46.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:22:46.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:22:46.639 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:22:46.639 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:22:46.881 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:22:46.881 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:22:46.882 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:46.882 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:22:46.882 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:22:46.882 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:46.883 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:22:46.883 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:22:46.883 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:22:46.883 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:22:46.884 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:22:46.884 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:22:46.884 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:22:46.884 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:22:46.885 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:22:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:47 gibba043 bash[24019]: audit 2021-03-10T14:22:46.386569+0000 mgr.gibba043.dnkmem (mgr.34373) 1705 : audit [DBG] from='client.55192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:47 gibba043 bash[24019]: cluster 2021-03-10T14:22:46.476931+0000 mgr.gibba043.dnkmem (mgr.34373) 1706 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:47 gibba043 bash[24019]: audit 2021-03-10T14:22:46.621187+0000 mgr.gibba043.dnkmem (mgr.34373) 1707 : audit [DBG] from='client.45213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:47 gibba043 bash[24019]: audit 2021-03-10T14:22:46.882708+0000 mon.a (mon.0) 704 : audit [DBG] from='client.? 172.21.2.103:0/3717867285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[31385]: audit 2021-03-10T14:22:46.386569+0000 mgr.gibba043.dnkmem (mgr.34373) 1705 : audit [DBG] from='client.55192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[31385]: cluster 2021-03-10T14:22:46.476931+0000 mgr.gibba043.dnkmem (mgr.34373) 1706 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[31385]: audit 2021-03-10T14:22:46.621187+0000 mgr.gibba043.dnkmem (mgr.34373) 1707 : audit [DBG] from='client.45213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[31385]: audit 2021-03-10T14:22:46.882708+0000 mon.a (mon.0) 704 : audit [DBG] from='client.? 172.21.2.103:0/3717867285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[32348]: audit 2021-03-10T14:22:46.386569+0000 mgr.gibba043.dnkmem (mgr.34373) 1705 : audit [DBG] from='client.55192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[32348]: cluster 2021-03-10T14:22:46.476931+0000 mgr.gibba043.dnkmem (mgr.34373) 1706 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[32348]: audit 2021-03-10T14:22:46.621187+0000 mgr.gibba043.dnkmem (mgr.34373) 1707 : audit [DBG] from='client.45213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:47 gibba003 bash[32348]: audit 2021-03-10T14:22:46.882708+0000 mon.a (mon.0) 704 : audit [DBG] from='client.? 172.21.2.103:0/3717867285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:49 gibba043 bash[24019]: cluster 2021-03-10T14:22:48.478302+0000 mgr.gibba043.dnkmem (mgr.34373) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:49 gibba003 bash[31385]: cluster 2021-03-10T14:22:48.478302+0000 mgr.gibba043.dnkmem (mgr.34373) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:49 gibba003 bash[32348]: cluster 2021-03-10T14:22:48.478302+0000 mgr.gibba043.dnkmem (mgr.34373) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:51 gibba043 bash[24019]: cluster 2021-03-10T14:22:50.479863+0000 mgr.gibba043.dnkmem (mgr.34373) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:51 gibba003 bash[31385]: cluster 2021-03-10T14:22:50.479863+0000 mgr.gibba043.dnkmem (mgr.34373) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:51 gibba003 bash[32348]: cluster 2021-03-10T14:22:50.479863+0000 mgr.gibba043.dnkmem (mgr.34373) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:53 gibba043 bash[24019]: cluster 2021-03-10T14:22:52.481221+0000 mgr.gibba043.dnkmem (mgr.34373) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:53 gibba003 bash[31385]: cluster 2021-03-10T14:22:52.481221+0000 mgr.gibba043.dnkmem (mgr.34373) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:53 gibba003 bash[32348]: cluster 2021-03-10T14:22:52.481221+0000 mgr.gibba043.dnkmem (mgr.34373) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:55 gibba043 bash[24019]: cluster 2021-03-10T14:22:54.482846+0000 mgr.gibba043.dnkmem (mgr.34373) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:55 gibba003 bash[31385]: cluster 2021-03-10T14:22:54.482846+0000 mgr.gibba043.dnkmem (mgr.34373) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:55 gibba003 bash[32348]: cluster 2021-03-10T14:22:54.482846+0000 mgr.gibba043.dnkmem (mgr.34373) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.636854+0000 mgr.gibba043.dnkmem (mgr.34373) 1712 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:22:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.638494+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.640430+0000 mgr.gibba043.dnkmem (mgr.34373) 1713 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:22:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.641781+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.846613+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.850319+0000 mon.c (mon.1) 491 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.851638+0000 mon.c (mon.1) 492 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.852880+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.853994+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.857185+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[31385]: audit 2021-03-10T14:22:55.858520+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.636854+0000 mgr.gibba043.dnkmem (mgr.34373) 1712 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:22:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.638494+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.640430+0000 mgr.gibba043.dnkmem (mgr.34373) 1713 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:22:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.641781+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.846613+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.850319+0000 mon.c (mon.1) 491 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.851638+0000 mon.c (mon.1) 492 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.852880+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.853994+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.857185+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:56 gibba003 bash[32348]: audit 2021-03-10T14:22:55.858520+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.636854+0000 mgr.gibba043.dnkmem (mgr.34373) 1712 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:22:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.638494+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.640430+0000 mgr.gibba043.dnkmem (mgr.34373) 1713 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:22:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.641781+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.846613+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:22:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.850319+0000 mon.c (mon.1) 491 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.851638+0000 mon.c (mon.1) 492 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.852880+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.853994+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.857185+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:56 gibba043 bash[24019]: audit 2021-03-10T14:22:55.858520+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.846926+0000 mgr.gibba043.dnkmem (mgr.34373) 1714 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.848632+0000 mgr.gibba043.dnkmem (mgr.34373) 1715 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.849854+0000 mgr.gibba043.dnkmem (mgr.34373) 1716 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.849891+0000 mgr.gibba043.dnkmem (mgr.34373) 1717 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.851081+0000 mgr.gibba043.dnkmem (mgr.34373) 1718 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.851117+0000 mgr.gibba043.dnkmem (mgr.34373) 1719 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.852060+0000 mgr.gibba043.dnkmem (mgr.34373) 1720 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.853929+0000 mgr.gibba043.dnkmem (mgr.34373) 1721 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.853967+0000 mgr.gibba043.dnkmem (mgr.34373) 1722 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.855296+0000 mgr.gibba043.dnkmem (mgr.34373) 1723 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.855612+0000 mgr.gibba043.dnkmem (mgr.34373) 1724 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.856786+0000 mgr.gibba043.dnkmem (mgr.34373) 1725 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.856822+0000 mgr.gibba043.dnkmem (mgr.34373) 1726 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cephadm 2021-03-10T14:22:55.856922+0000 mgr.gibba043.dnkmem (mgr.34373) 1727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[31385]: cluster 2021-03-10T14:22:56.483845+0000 mgr.gibba043.dnkmem (mgr.34373) 1728 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.846926+0000 mgr.gibba043.dnkmem (mgr.34373) 1714 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.848632+0000 mgr.gibba043.dnkmem (mgr.34373) 1715 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.849854+0000 mgr.gibba043.dnkmem (mgr.34373) 1716 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.849891+0000 mgr.gibba043.dnkmem (mgr.34373) 1717 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.851081+0000 mgr.gibba043.dnkmem (mgr.34373) 1718 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.851117+0000 mgr.gibba043.dnkmem (mgr.34373) 1719 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.852060+0000 mgr.gibba043.dnkmem (mgr.34373) 1720 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.853929+0000 mgr.gibba043.dnkmem (mgr.34373) 1721 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.853967+0000 mgr.gibba043.dnkmem (mgr.34373) 1722 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.855296+0000 mgr.gibba043.dnkmem (mgr.34373) 1723 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.855612+0000 mgr.gibba043.dnkmem (mgr.34373) 1724 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.856786+0000 mgr.gibba043.dnkmem (mgr.34373) 1725 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.856822+0000 mgr.gibba043.dnkmem (mgr.34373) 1726 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cephadm 2021-03-10T14:22:55.856922+0000 mgr.gibba043.dnkmem (mgr.34373) 1727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:57 gibba003 bash[32348]: cluster 2021-03-10T14:22:56.483845+0000 mgr.gibba043.dnkmem (mgr.34373) 1728 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.846926+0000 mgr.gibba043.dnkmem (mgr.34373) 1714 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.848632+0000 mgr.gibba043.dnkmem (mgr.34373) 1715 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.849854+0000 mgr.gibba043.dnkmem (mgr.34373) 1716 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.849891+0000 mgr.gibba043.dnkmem (mgr.34373) 1717 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.851081+0000 mgr.gibba043.dnkmem (mgr.34373) 1718 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.851117+0000 mgr.gibba043.dnkmem (mgr.34373) 1719 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.852060+0000 mgr.gibba043.dnkmem (mgr.34373) 1720 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.853929+0000 mgr.gibba043.dnkmem (mgr.34373) 1721 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.853967+0000 mgr.gibba043.dnkmem (mgr.34373) 1722 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.855296+0000 mgr.gibba043.dnkmem (mgr.34373) 1723 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.855612+0000 mgr.gibba043.dnkmem (mgr.34373) 1724 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.856786+0000 mgr.gibba043.dnkmem (mgr.34373) 1725 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.856822+0000 mgr.gibba043.dnkmem (mgr.34373) 1726 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cephadm 2021-03-10T14:22:55.856922+0000 mgr.gibba043.dnkmem (mgr.34373) 1727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:22:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:57 gibba043 bash[24019]: cluster 2021-03-10T14:22:56.483845+0000 mgr.gibba043.dnkmem (mgr.34373) 1728 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:22:59 gibba003 bash[31385]: cluster 2021-03-10T14:22:58.485079+0000 mgr.gibba043.dnkmem (mgr.34373) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:22:59 gibba003 bash[32348]: cluster 2021-03-10T14:22:58.485079+0000 mgr.gibba043.dnkmem (mgr.34373) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:22:59 gibba043 bash[24019]: cluster 2021-03-10T14:22:58.485079+0000 mgr.gibba043.dnkmem (mgr.34373) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:01 gibba003 bash[31385]: cluster 2021-03-10T14:23:00.486596+0000 mgr.gibba043.dnkmem (mgr.34373) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:01 gibba003 bash[32348]: cluster 2021-03-10T14:23:00.486596+0000 mgr.gibba043.dnkmem (mgr.34373) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:01 gibba043 bash[24019]: cluster 2021-03-10T14:23:00.486596+0000 mgr.gibba043.dnkmem (mgr.34373) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:03 gibba043 bash[24019]: cluster 2021-03-10T14:23:02.488064+0000 mgr.gibba043.dnkmem (mgr.34373) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:03 gibba003 bash[31385]: cluster 2021-03-10T14:23:02.488064+0000 mgr.gibba043.dnkmem (mgr.34373) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:03 gibba003 bash[32348]: cluster 2021-03-10T14:23:02.488064+0000 mgr.gibba043.dnkmem (mgr.34373) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:05 gibba003 bash[31385]: cluster 2021-03-10T14:23:04.489764+0000 mgr.gibba043.dnkmem (mgr.34373) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:05 gibba003 bash[32348]: cluster 2021-03-10T14:23:04.489764+0000 mgr.gibba043.dnkmem (mgr.34373) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:05 gibba043 bash[24019]: cluster 2021-03-10T14:23:04.489764+0000 mgr.gibba043.dnkmem (mgr.34373) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:07 gibba003 bash[31385]: cluster 2021-03-10T14:23:06.490700+0000 mgr.gibba043.dnkmem (mgr.34373) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:07 gibba003 bash[32348]: cluster 2021-03-10T14:23:06.490700+0000 mgr.gibba043.dnkmem (mgr.34373) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:07 gibba043 bash[24019]: cluster 2021-03-10T14:23:06.490700+0000 mgr.gibba043.dnkmem (mgr.34373) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:09 gibba003 bash[31385]: cluster 2021-03-10T14:23:08.492261+0000 mgr.gibba043.dnkmem (mgr.34373) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:09 gibba003 bash[32348]: cluster 2021-03-10T14:23:08.492261+0000 mgr.gibba043.dnkmem (mgr.34373) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:09 gibba043 bash[24019]: cluster 2021-03-10T14:23:08.492261+0000 mgr.gibba043.dnkmem (mgr.34373) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:11 gibba003 bash[31385]: cluster 2021-03-10T14:23:10.493797+0000 mgr.gibba043.dnkmem (mgr.34373) 1735 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:11 gibba003 bash[32348]: cluster 2021-03-10T14:23:10.493797+0000 mgr.gibba043.dnkmem (mgr.34373) 1735 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:11 gibba043 bash[24019]: cluster 2021-03-10T14:23:10.493797+0000 mgr.gibba043.dnkmem (mgr.34373) 1735 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:12.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:12 gibba003 bash[31385]: cephadm 2021-03-10T14:23:10.872930+0000 mgr.gibba043.dnkmem (mgr.34373) 1736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:12.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:12 gibba003 bash[32348]: cephadm 2021-03-10T14:23:10.872930+0000 mgr.gibba043.dnkmem (mgr.34373) 1736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:12 gibba043 bash[24019]: cephadm 2021-03-10T14:23:10.872930+0000 mgr.gibba043.dnkmem (mgr.34373) 1736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: cluster 2021-03-10T14:23:12.495317+0000 mgr.gibba043.dnkmem (mgr.34373) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.861578+0000 mon.c (mon.1) 497 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:23:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.862402+0000 mon.c (mon.1) 498 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.862864+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:23:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.863176+0000 mon.c (mon.1) 499 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.864081+0000 mon.c (mon.1) 500 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:23:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.864195+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.865400+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.866235+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:23:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.922308+0000 mon.c (mon.1) 501 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.923497+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.972379+0000 mon.c (mon.1) 502 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[31385]: audit 2021-03-10T14:23:12.973517+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: cluster 2021-03-10T14:23:12.495317+0000 mgr.gibba043.dnkmem (mgr.34373) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.861578+0000 mon.c (mon.1) 497 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:23:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.862402+0000 mon.c (mon.1) 498 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.862864+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:23:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.863176+0000 mon.c (mon.1) 499 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.864081+0000 mon.c (mon.1) 500 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:23:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.864195+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.865400+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:23:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.866235+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:23:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.922308+0000 mon.c (mon.1) 501 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.923497+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.972379+0000 mon.c (mon.1) 502 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:13 gibba003 bash[32348]: audit 2021-03-10T14:23:12.973517+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: cluster 2021-03-10T14:23:12.495317+0000 mgr.gibba043.dnkmem (mgr.34373) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.861578+0000 mon.c (mon.1) 497 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:23:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.862402+0000 mon.c (mon.1) 498 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:23:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.862864+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:23:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.863176+0000 mon.c (mon.1) 499 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:23:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.864081+0000 mon.c (mon.1) 500 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:23:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.864195+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:23:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.865400+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:23:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.866235+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:23:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.922308+0000 mon.c (mon.1) 501 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.923497+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.972379+0000 mon.c (mon.1) 502 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:13 gibba043 bash[24019]: audit 2021-03-10T14:23:12.973517+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:15 gibba003 bash[31385]: cluster 2021-03-10T14:23:14.497109+0000 mgr.gibba043.dnkmem (mgr.34373) 1738 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:15 gibba003 bash[32348]: cluster 2021-03-10T14:23:14.497109+0000 mgr.gibba043.dnkmem (mgr.34373) 1738 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:15 gibba043 bash[24019]: cluster 2021-03-10T14:23:14.497109+0000 mgr.gibba043.dnkmem (mgr.34373) 1738 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:17.131 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:23:17.388 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:23:17.388 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (31m) 7m ago 36m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:23:17.388 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (36m) 6m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:23:17.388 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:23:17.389 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:23:17.389 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:23:17.389 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:23:17.389 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:23:17.390 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:23:17.390 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:23:17.390 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:23:17.390 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:23:17.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:23:17.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:23:17.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:23:17.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:23:17.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:23:17.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:23:17.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (26m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:23:17.392 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (36m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:23:17.392 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:23:17.649 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:23:17.649 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:23:17.650 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:17.650 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:23:17.650 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:23:17.650 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:17.651 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:23:17.651 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:23:17.651 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:23:17.651 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:23:17.651 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:23:17.652 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:23:17.652 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:23:17.652 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:23:17.652 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:23:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:17 gibba003 bash[31385]: cluster 2021-03-10T14:23:16.498148+0000 mgr.gibba043.dnkmem (mgr.34373) 1739 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:17 gibba003 bash[32348]: cluster 2021-03-10T14:23:16.498148+0000 mgr.gibba043.dnkmem (mgr.34373) 1739 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:17 gibba043 bash[24019]: cluster 2021-03-10T14:23:16.498148+0000 mgr.gibba043.dnkmem (mgr.34373) 1739 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:18.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:18 gibba003 bash[31385]: audit 2021-03-10T14:23:17.117658+0000 mgr.gibba043.dnkmem (mgr.34373) 1740 : audit [DBG] from='client.45225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:18.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:18 gibba003 bash[31385]: audit 2021-03-10T14:23:17.346238+0000 mgr.gibba043.dnkmem (mgr.34373) 1741 : audit [DBG] from='client.55216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:18.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:18 gibba003 bash[31385]: audit 2021-03-10T14:23:17.650775+0000 mon.a (mon.0) 714 : audit [DBG] from='client.? 172.21.2.103:0/1471507440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:18.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:18 gibba003 bash[32348]: audit 2021-03-10T14:23:17.117658+0000 mgr.gibba043.dnkmem (mgr.34373) 1740 : audit [DBG] from='client.45225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:18.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:18 gibba003 bash[32348]: audit 2021-03-10T14:23:17.346238+0000 mgr.gibba043.dnkmem (mgr.34373) 1741 : audit [DBG] from='client.55216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:18.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:18 gibba003 bash[32348]: audit 2021-03-10T14:23:17.650775+0000 mon.a (mon.0) 714 : audit [DBG] from='client.? 172.21.2.103:0/1471507440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:18 gibba043 bash[24019]: audit 2021-03-10T14:23:17.117658+0000 mgr.gibba043.dnkmem (mgr.34373) 1740 : audit [DBG] from='client.45225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:18 gibba043 bash[24019]: audit 2021-03-10T14:23:17.346238+0000 mgr.gibba043.dnkmem (mgr.34373) 1741 : audit [DBG] from='client.55216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:18 gibba043 bash[24019]: audit 2021-03-10T14:23:17.650775+0000 mon.a (mon.0) 714 : audit [DBG] from='client.? 172.21.2.103:0/1471507440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:19 gibba003 bash[31385]: cluster 2021-03-10T14:23:18.499707+0000 mgr.gibba043.dnkmem (mgr.34373) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:19 gibba003 bash[32348]: cluster 2021-03-10T14:23:18.499707+0000 mgr.gibba043.dnkmem (mgr.34373) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:19 gibba043 bash[24019]: cluster 2021-03-10T14:23:18.499707+0000 mgr.gibba043.dnkmem (mgr.34373) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:21 gibba003 bash[31385]: cluster 2021-03-10T14:23:20.501225+0000 mgr.gibba043.dnkmem (mgr.34373) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:21 gibba003 bash[32348]: cluster 2021-03-10T14:23:20.501225+0000 mgr.gibba043.dnkmem (mgr.34373) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:21 gibba043 bash[24019]: cluster 2021-03-10T14:23:20.501225+0000 mgr.gibba043.dnkmem (mgr.34373) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:23 gibba043 bash[24019]: cluster 2021-03-10T14:23:22.501859+0000 mgr.gibba043.dnkmem (mgr.34373) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:23 gibba003 bash[31385]: cluster 2021-03-10T14:23:22.501859+0000 mgr.gibba043.dnkmem (mgr.34373) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:23 gibba003 bash[32348]: cluster 2021-03-10T14:23:22.501859+0000 mgr.gibba043.dnkmem (mgr.34373) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.890 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:25 gibba043 bash[24019]: cluster 2021-03-10T14:23:24.503460+0000 mgr.gibba043.dnkmem (mgr.34373) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:25 gibba003 bash[31385]: cluster 2021-03-10T14:23:24.503460+0000 mgr.gibba043.dnkmem (mgr.34373) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:25 gibba003 bash[32348]: cluster 2021-03-10T14:23:24.503460+0000 mgr.gibba043.dnkmem (mgr.34373) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:27 gibba003 bash[31385]: cephadm 2021-03-10T14:23:25.888757+0000 mgr.gibba043.dnkmem (mgr.34373) 1746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:27 gibba003 bash[31385]: cluster 2021-03-10T14:23:26.504402+0000 mgr.gibba043.dnkmem (mgr.34373) 1747 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:27 gibba003 bash[32348]: cephadm 2021-03-10T14:23:25.888757+0000 mgr.gibba043.dnkmem (mgr.34373) 1746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:27 gibba003 bash[32348]: cluster 2021-03-10T14:23:26.504402+0000 mgr.gibba043.dnkmem (mgr.34373) 1747 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:27 gibba043 bash[24019]: cephadm 2021-03-10T14:23:25.888757+0000 mgr.gibba043.dnkmem (mgr.34373) 1746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:27 gibba043 bash[24019]: cluster 2021-03-10T14:23:26.504402+0000 mgr.gibba043.dnkmem (mgr.34373) 1747 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:29 gibba003 bash[31385]: cluster 2021-03-10T14:23:28.505616+0000 mgr.gibba043.dnkmem (mgr.34373) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:29 gibba003 bash[32348]: cluster 2021-03-10T14:23:28.505616+0000 mgr.gibba043.dnkmem (mgr.34373) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:29 gibba043 bash[24019]: cluster 2021-03-10T14:23:28.505616+0000 mgr.gibba043.dnkmem (mgr.34373) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:31 gibba003 bash[31385]: cluster 2021-03-10T14:23:30.506878+0000 mgr.gibba043.dnkmem (mgr.34373) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:31 gibba003 bash[32348]: cluster 2021-03-10T14:23:30.506878+0000 mgr.gibba043.dnkmem (mgr.34373) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:31 gibba043 bash[24019]: cluster 2021-03-10T14:23:30.506878+0000 mgr.gibba043.dnkmem (mgr.34373) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:33 gibba043 bash[24019]: cluster 2021-03-10T14:23:32.507688+0000 mgr.gibba043.dnkmem (mgr.34373) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:33 gibba003 bash[31385]: cluster 2021-03-10T14:23:32.507688+0000 mgr.gibba043.dnkmem (mgr.34373) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:33 gibba003 bash[32348]: cluster 2021-03-10T14:23:32.507688+0000 mgr.gibba043.dnkmem (mgr.34373) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:35 gibba003 bash[31385]: cluster 2021-03-10T14:23:34.509331+0000 mgr.gibba043.dnkmem (mgr.34373) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:35 gibba003 bash[32348]: cluster 2021-03-10T14:23:34.509331+0000 mgr.gibba043.dnkmem (mgr.34373) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:35 gibba043 bash[24019]: cluster 2021-03-10T14:23:34.509331+0000 mgr.gibba043.dnkmem (mgr.34373) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:37 gibba003 bash[31385]: cluster 2021-03-10T14:23:36.510984+0000 mgr.gibba043.dnkmem (mgr.34373) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:37 gibba003 bash[32348]: cluster 2021-03-10T14:23:36.510984+0000 mgr.gibba043.dnkmem (mgr.34373) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:37 gibba043 bash[24019]: cluster 2021-03-10T14:23:36.510984+0000 mgr.gibba043.dnkmem (mgr.34373) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:39 gibba003 bash[31385]: cluster 2021-03-10T14:23:38.512407+0000 mgr.gibba043.dnkmem (mgr.34373) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:39 gibba003 bash[32348]: cluster 2021-03-10T14:23:38.512407+0000 mgr.gibba043.dnkmem (mgr.34373) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:39 gibba043 bash[24019]: cluster 2021-03-10T14:23:38.512407+0000 mgr.gibba043.dnkmem (mgr.34373) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:41 gibba003 bash[31385]: cluster 2021-03-10T14:23:40.513873+0000 mgr.gibba043.dnkmem (mgr.34373) 1754 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:41 gibba003 bash[32348]: cluster 2021-03-10T14:23:40.513873+0000 mgr.gibba043.dnkmem (mgr.34373) 1754 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:41 gibba043 bash[24019]: cluster 2021-03-10T14:23:40.513873+0000 mgr.gibba043.dnkmem (mgr.34373) 1754 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:42 gibba003 bash[31385]: cephadm 2021-03-10T14:23:40.904752+0000 mgr.gibba043.dnkmem (mgr.34373) 1755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:42.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:42 gibba003 bash[32348]: cephadm 2021-03-10T14:23:40.904752+0000 mgr.gibba043.dnkmem (mgr.34373) 1755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:42 gibba043 bash[24019]: cephadm 2021-03-10T14:23:40.904752+0000 mgr.gibba043.dnkmem (mgr.34373) 1755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:43 gibba003 bash[31385]: cluster 2021-03-10T14:23:42.514669+0000 mgr.gibba043.dnkmem (mgr.34373) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:43 gibba003 bash[32348]: cluster 2021-03-10T14:23:42.514669+0000 mgr.gibba043.dnkmem (mgr.34373) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:43 gibba043 bash[24019]: cluster 2021-03-10T14:23:42.514669+0000 mgr.gibba043.dnkmem (mgr.34373) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:45 gibba003 bash[31385]: cluster 2021-03-10T14:23:44.516250+0000 mgr.gibba043.dnkmem (mgr.34373) 1757 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:45 gibba003 bash[32348]: cluster 2021-03-10T14:23:44.516250+0000 mgr.gibba043.dnkmem (mgr.34373) 1757 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:45 gibba043 bash[24019]: cluster 2021-03-10T14:23:44.516250+0000 mgr.gibba043.dnkmem (mgr.34373) 1757 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:47.888 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:23:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:47 gibba003 bash[31385]: cluster 2021-03-10T14:23:46.517223+0000 mgr.gibba043.dnkmem (mgr.34373) 1758 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:47.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:47 gibba003 bash[32348]: cluster 2021-03-10T14:23:46.517223+0000 mgr.gibba043.dnkmem (mgr.34373) 1758 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:47 gibba043 bash[24019]: cluster 2021-03-10T14:23:46.517223+0000 mgr.gibba043.dnkmem (mgr.34373) 1758 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:48.147 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:23:48.148 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (32m) 8m ago 37m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:23:48.148 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (37m) 6m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:23:48.148 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:23:48.148 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (32m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:23:48.149 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:23:48.149 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:23:48.149 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (31m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:23:48.149 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (31m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:23:48.149 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (37m) 8m ago 37m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:23:48.150 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:23:48.150 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:23:48.150 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:23:48.150 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:23:48.151 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:23:48.151 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:23:48.151 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:23:48.151 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:23:48.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:23:48.152 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (37m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:23:48.152 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:23:48.403 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:23:48.403 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:23:48.403 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:48.404 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:23:48.404 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:23:48.404 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:48.404 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:23:48.404 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:23:48.405 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:23:48.405 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:23:48.405 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:23:48.405 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:23:48.405 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:23:48.406 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:23:48.406 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:23:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:48 gibba003 bash[31385]: audit 2021-03-10T14:23:48.404743+0000 mon.a (mon.0) 715 : audit [DBG] from='client.? 172.21.2.103:0/4206116115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:48.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:48 gibba003 bash[32348]: audit 2021-03-10T14:23:48.404743+0000 mon.a (mon.0) 715 : audit [DBG] from='client.? 172.21.2.103:0/4206116115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:48 gibba043 bash[24019]: audit 2021-03-10T14:23:48.404743+0000 mon.a (mon.0) 715 : audit [DBG] from='client.? 172.21.2.103:0/4206116115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:49 gibba003 bash[31385]: audit 2021-03-10T14:23:47.879212+0000 mgr.gibba043.dnkmem (mgr.34373) 1759 : audit [DBG] from='client.55228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:49 gibba003 bash[31385]: audit 2021-03-10T14:23:48.107274+0000 mgr.gibba043.dnkmem (mgr.34373) 1760 : audit [DBG] from='client.55234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:49 gibba003 bash[31385]: cluster 2021-03-10T14:23:48.518648+0000 mgr.gibba043.dnkmem (mgr.34373) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:49 gibba003 bash[32348]: audit 2021-03-10T14:23:47.879212+0000 mgr.gibba043.dnkmem (mgr.34373) 1759 : audit [DBG] from='client.55228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:49 gibba003 bash[32348]: audit 2021-03-10T14:23:48.107274+0000 mgr.gibba043.dnkmem (mgr.34373) 1760 : audit [DBG] from='client.55234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:49 gibba003 bash[32348]: cluster 2021-03-10T14:23:48.518648+0000 mgr.gibba043.dnkmem (mgr.34373) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:49 gibba043 bash[24019]: audit 2021-03-10T14:23:47.879212+0000 mgr.gibba043.dnkmem (mgr.34373) 1759 : audit [DBG] from='client.55228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:49 gibba043 bash[24019]: audit 2021-03-10T14:23:48.107274+0000 mgr.gibba043.dnkmem (mgr.34373) 1760 : audit [DBG] from='client.55234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:49 gibba043 bash[24019]: cluster 2021-03-10T14:23:48.518648+0000 mgr.gibba043.dnkmem (mgr.34373) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:51 gibba003 bash[31385]: cluster 2021-03-10T14:23:50.520117+0000 mgr.gibba043.dnkmem (mgr.34373) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:51 gibba003 bash[32348]: cluster 2021-03-10T14:23:50.520117+0000 mgr.gibba043.dnkmem (mgr.34373) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:51 gibba043 bash[24019]: cluster 2021-03-10T14:23:50.520117+0000 mgr.gibba043.dnkmem (mgr.34373) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:53 gibba043 bash[24019]: cluster 2021-03-10T14:23:52.521614+0000 mgr.gibba043.dnkmem (mgr.34373) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:53 gibba003 bash[31385]: cluster 2021-03-10T14:23:52.521614+0000 mgr.gibba043.dnkmem (mgr.34373) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:53 gibba003 bash[32348]: cluster 2021-03-10T14:23:52.521614+0000 mgr.gibba043.dnkmem (mgr.34373) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:55 gibba003 bash[31385]: cluster 2021-03-10T14:23:54.523415+0000 mgr.gibba043.dnkmem (mgr.34373) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:55 gibba003 bash[32348]: cluster 2021-03-10T14:23:54.523415+0000 mgr.gibba043.dnkmem (mgr.34373) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:55 gibba043 bash[24019]: cluster 2021-03-10T14:23:54.523415+0000 mgr.gibba043.dnkmem (mgr.34373) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:55.921607+0000 mgr.gibba043.dnkmem (mgr.34373) 1765 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:23:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:55.923170+0000 mgr.gibba043.dnkmem (mgr.34373) 1766 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:23:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.145490+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:23:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.145743+0000 mgr.gibba043.dnkmem (mgr.34373) 1767 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.147676+0000 mgr.gibba043.dnkmem (mgr.34373) 1768 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.148981+0000 mgr.gibba043.dnkmem (mgr.34373) 1769 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.149020+0000 mgr.gibba043.dnkmem (mgr.34373) 1770 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.149162+0000 mon.c (mon.1) 503 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.150366+0000 mgr.gibba043.dnkmem (mgr.34373) 1771 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.150404+0000 mgr.gibba043.dnkmem (mgr.34373) 1772 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.150844+0000 mon.c (mon.1) 504 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.151628+0000 mgr.gibba043.dnkmem (mgr.34373) 1773 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.152094+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.153312+0000 mgr.gibba043.dnkmem (mgr.34373) 1774 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.153349+0000 mgr.gibba043.dnkmem (mgr.34373) 1775 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.153416+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.154690+0000 mgr.gibba043.dnkmem (mgr.34373) 1776 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.155008+0000 mgr.gibba043.dnkmem (mgr.34373) 1777 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.156268+0000 mgr.gibba043.dnkmem (mgr.34373) 1778 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.156307+0000 mgr.gibba043.dnkmem (mgr.34373) 1779 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cephadm 2021-03-10T14:23:56.156413+0000 mgr.gibba043.dnkmem (mgr.34373) 1780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:57.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:55.921607+0000 mgr.gibba043.dnkmem (mgr.34373) 1765 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:23:57.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:55.923170+0000 mgr.gibba043.dnkmem (mgr.34373) 1766 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:23:57.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.145490+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:23:57.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.145743+0000 mgr.gibba043.dnkmem (mgr.34373) 1767 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:57.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.147676+0000 mgr.gibba043.dnkmem (mgr.34373) 1768 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.148981+0000 mgr.gibba043.dnkmem (mgr.34373) 1769 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.149020+0000 mgr.gibba043.dnkmem (mgr.34373) 1770 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.149162+0000 mon.c (mon.1) 503 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.150366+0000 mgr.gibba043.dnkmem (mgr.34373) 1771 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.150404+0000 mgr.gibba043.dnkmem (mgr.34373) 1772 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.150844+0000 mon.c (mon.1) 504 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.151628+0000 mgr.gibba043.dnkmem (mgr.34373) 1773 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.152094+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.153312+0000 mgr.gibba043.dnkmem (mgr.34373) 1774 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.153349+0000 mgr.gibba043.dnkmem (mgr.34373) 1775 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.153416+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.154690+0000 mgr.gibba043.dnkmem (mgr.34373) 1776 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.155008+0000 mgr.gibba043.dnkmem (mgr.34373) 1777 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.156268+0000 mgr.gibba043.dnkmem (mgr.34373) 1778 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.156307+0000 mgr.gibba043.dnkmem (mgr.34373) 1779 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cephadm 2021-03-10T14:23:56.156413+0000 mgr.gibba043.dnkmem (mgr.34373) 1780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.156497+0000 mon.c (mon.1) 507 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: audit 2021-03-10T14:23:56.158006+0000 mon.c (mon.1) 508 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[32348]: cluster 2021-03-10T14:23:56.524238+0000 mgr.gibba043.dnkmem (mgr.34373) 1781 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:57.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.156497+0000 mon.c (mon.1) 507 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: audit 2021-03-10T14:23:56.158006+0000 mon.c (mon.1) 508 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:57 gibba003 bash[31385]: cluster 2021-03-10T14:23:56.524238+0000 mgr.gibba043.dnkmem (mgr.34373) 1781 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:57.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:55.921607+0000 mgr.gibba043.dnkmem (mgr.34373) 1765 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:23:57.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:55.923170+0000 mgr.gibba043.dnkmem (mgr.34373) 1766 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:23:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.145490+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:23:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.145743+0000 mgr.gibba043.dnkmem (mgr.34373) 1767 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.147676+0000 mgr.gibba043.dnkmem (mgr.34373) 1768 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.148981+0000 mgr.gibba043.dnkmem (mgr.34373) 1769 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.149020+0000 mgr.gibba043.dnkmem (mgr.34373) 1770 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.149162+0000 mon.c (mon.1) 503 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.150366+0000 mgr.gibba043.dnkmem (mgr.34373) 1771 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.150404+0000 mgr.gibba043.dnkmem (mgr.34373) 1772 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.150844+0000 mon.c (mon.1) 504 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.151628+0000 mgr.gibba043.dnkmem (mgr.34373) 1773 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.152094+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.153312+0000 mgr.gibba043.dnkmem (mgr.34373) 1774 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.153349+0000 mgr.gibba043.dnkmem (mgr.34373) 1775 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.153416+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.154690+0000 mgr.gibba043.dnkmem (mgr.34373) 1776 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.155008+0000 mgr.gibba043.dnkmem (mgr.34373) 1777 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.156268+0000 mgr.gibba043.dnkmem (mgr.34373) 1778 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.156307+0000 mgr.gibba043.dnkmem (mgr.34373) 1779 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cephadm 2021-03-10T14:23:56.156413+0000 mgr.gibba043.dnkmem (mgr.34373) 1780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:23:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.156497+0000 mon.c (mon.1) 507 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: audit 2021-03-10T14:23:56.158006+0000 mon.c (mon.1) 508 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:57 gibba043 bash[24019]: cluster 2021-03-10T14:23:56.524238+0000 mgr.gibba043.dnkmem (mgr.34373) 1781 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:23:59 gibba003 bash[31385]: cluster 2021-03-10T14:23:58.525679+0000 mgr.gibba043.dnkmem (mgr.34373) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:23:59 gibba003 bash[32348]: cluster 2021-03-10T14:23:58.525679+0000 mgr.gibba043.dnkmem (mgr.34373) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:23:59 gibba043 bash[24019]: cluster 2021-03-10T14:23:58.525679+0000 mgr.gibba043.dnkmem (mgr.34373) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:01 gibba003 bash[31385]: cluster 2021-03-10T14:24:00.527219+0000 mgr.gibba043.dnkmem (mgr.34373) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:01 gibba003 bash[32348]: cluster 2021-03-10T14:24:00.527219+0000 mgr.gibba043.dnkmem (mgr.34373) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:01 gibba043 bash[24019]: cluster 2021-03-10T14:24:00.527219+0000 mgr.gibba043.dnkmem (mgr.34373) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:03 gibba003 bash[31385]: cluster 2021-03-10T14:24:02.527771+0000 mgr.gibba043.dnkmem (mgr.34373) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:03 gibba003 bash[32348]: cluster 2021-03-10T14:24:02.527771+0000 mgr.gibba043.dnkmem (mgr.34373) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:04.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:03 gibba043 bash[24019]: cluster 2021-03-10T14:24:02.527771+0000 mgr.gibba043.dnkmem (mgr.34373) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:05 gibba003 bash[31385]: cluster 2021-03-10T14:24:04.529397+0000 mgr.gibba043.dnkmem (mgr.34373) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:05 gibba003 bash[32348]: cluster 2021-03-10T14:24:04.529397+0000 mgr.gibba043.dnkmem (mgr.34373) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:05 gibba043 bash[24019]: cluster 2021-03-10T14:24:04.529397+0000 mgr.gibba043.dnkmem (mgr.34373) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:07 gibba003 bash[31385]: cluster 2021-03-10T14:24:06.530348+0000 mgr.gibba043.dnkmem (mgr.34373) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:07 gibba003 bash[32348]: cluster 2021-03-10T14:24:06.530348+0000 mgr.gibba043.dnkmem (mgr.34373) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:07 gibba043 bash[24019]: cluster 2021-03-10T14:24:06.530348+0000 mgr.gibba043.dnkmem (mgr.34373) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:09 gibba003 bash[31385]: cluster 2021-03-10T14:24:08.531915+0000 mgr.gibba043.dnkmem (mgr.34373) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:09 gibba003 bash[32348]: cluster 2021-03-10T14:24:08.531915+0000 mgr.gibba043.dnkmem (mgr.34373) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:09 gibba043 bash[24019]: cluster 2021-03-10T14:24:08.531915+0000 mgr.gibba043.dnkmem (mgr.34373) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:11 gibba003 bash[31385]: cluster 2021-03-10T14:24:10.533407+0000 mgr.gibba043.dnkmem (mgr.34373) 1788 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:11 gibba003 bash[32348]: cluster 2021-03-10T14:24:10.533407+0000 mgr.gibba043.dnkmem (mgr.34373) 1788 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:11 gibba043 bash[24019]: cluster 2021-03-10T14:24:10.533407+0000 mgr.gibba043.dnkmem (mgr.34373) 1788 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:12.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:12 gibba003 bash[31385]: cephadm 2021-03-10T14:24:11.172333+0000 mgr.gibba043.dnkmem (mgr.34373) 1789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:12.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:12 gibba003 bash[32348]: cephadm 2021-03-10T14:24:11.172333+0000 mgr.gibba043.dnkmem (mgr.34373) 1789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:12 gibba043 bash[24019]: cephadm 2021-03-10T14:24:11.172333+0000 mgr.gibba043.dnkmem (mgr.34373) 1789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: cluster 2021-03-10T14:24:12.534170+0000 mgr.gibba043.dnkmem (mgr.34373) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.874788+0000 mon.c (mon.1) 509 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:24:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.875930+0000 mon.c (mon.1) 510 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.876189+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:24:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.876977+0000 mon.c (mon.1) 511 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.877438+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.878195+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.878295+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.879427+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.928770+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.929349+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.980699+0000 mon.c (mon.1) 514 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[31385]: audit 2021-03-10T14:24:12.981800+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: cluster 2021-03-10T14:24:12.534170+0000 mgr.gibba043.dnkmem (mgr.34373) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.874788+0000 mon.c (mon.1) 509 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:24:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.875930+0000 mon.c (mon.1) 510 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.876189+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:24:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.876977+0000 mon.c (mon.1) 511 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.877438+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.878195+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.878295+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.879427+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:24:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.928770+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.929349+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.980699+0000 mon.c (mon.1) 514 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:13 gibba003 bash[32348]: audit 2021-03-10T14:24:12.981800+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: cluster 2021-03-10T14:24:12.534170+0000 mgr.gibba043.dnkmem (mgr.34373) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.874788+0000 mon.c (mon.1) 509 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:24:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.875930+0000 mon.c (mon.1) 510 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.876189+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:24:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.876977+0000 mon.c (mon.1) 511 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.877438+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.878195+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.878295+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.879427+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.928770+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.929349+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.980699+0000 mon.c (mon.1) 514 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:13 gibba043 bash[24019]: audit 2021-03-10T14:24:12.981800+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:15 gibba003 bash[31385]: cluster 2021-03-10T14:24:14.535912+0000 mgr.gibba043.dnkmem (mgr.34373) 1791 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:15 gibba003 bash[32348]: cluster 2021-03-10T14:24:14.535912+0000 mgr.gibba043.dnkmem (mgr.34373) 1791 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:15 gibba043 bash[24019]: cluster 2021-03-10T14:24:14.535912+0000 mgr.gibba043.dnkmem (mgr.34373) 1791 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:17 gibba003 bash[31385]: cluster 2021-03-10T14:24:16.536889+0000 mgr.gibba043.dnkmem (mgr.34373) 1792 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:17 gibba003 bash[32348]: cluster 2021-03-10T14:24:16.536889+0000 mgr.gibba043.dnkmem (mgr.34373) 1792 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:17 gibba043 bash[24019]: cluster 2021-03-10T14:24:16.536889+0000 mgr.gibba043.dnkmem (mgr.34373) 1792 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:18.643 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:24:18.874 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:24:18.874 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (32m) 8m ago 37m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:24:18.875 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (37m) 7m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:24:18.875 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:24:18.875 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:24:18.875 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:24:18.876 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:24:18.876 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:24:18.876 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:24:18.876 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:24:18.876 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:24:18.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:24:18.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:24:18.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:24:18.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:24:18.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:24:18.878 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:24:18.878 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:24:18.878 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:24:18.878 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (37m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:24:18.879 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:24:19.123 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:24:19.124 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:24:19.124 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:19.124 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:24:19.124 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:24:19.125 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:19.125 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:24:19.125 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:24:19.125 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:24:19.125 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:24:19.126 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:24:19.126 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:24:19.126 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:24:19.126 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:24:19.126 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:24:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:19 gibba003 bash[31385]: cluster 2021-03-10T14:24:18.538329+0000 mgr.gibba043.dnkmem (mgr.34373) 1793 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:19 gibba003 bash[31385]: audit 2021-03-10T14:24:18.633722+0000 mgr.gibba043.dnkmem (mgr.34373) 1794 : audit [DBG] from='client.45261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:19 gibba003 bash[31385]: audit 2021-03-10T14:24:19.125142+0000 mon.a (mon.0) 723 : audit [DBG] from='client.? 172.21.2.103:0/4132155262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:19.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:19 gibba003 bash[32348]: cluster 2021-03-10T14:24:18.538329+0000 mgr.gibba043.dnkmem (mgr.34373) 1793 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:19 gibba003 bash[32348]: audit 2021-03-10T14:24:18.633722+0000 mgr.gibba043.dnkmem (mgr.34373) 1794 : audit [DBG] from='client.45261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:19.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:19 gibba003 bash[32348]: audit 2021-03-10T14:24:19.125142+0000 mon.a (mon.0) 723 : audit [DBG] from='client.? 172.21.2.103:0/4132155262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:19 gibba043 bash[24019]: cluster 2021-03-10T14:24:18.538329+0000 mgr.gibba043.dnkmem (mgr.34373) 1793 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:19 gibba043 bash[24019]: audit 2021-03-10T14:24:18.633722+0000 mgr.gibba043.dnkmem (mgr.34373) 1794 : audit [DBG] from='client.45261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:19 gibba043 bash[24019]: audit 2021-03-10T14:24:19.125142+0000 mon.a (mon.0) 723 : audit [DBG] from='client.? 172.21.2.103:0/4132155262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:20.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:20 gibba003 bash[31385]: audit 2021-03-10T14:24:18.860985+0000 mgr.gibba043.dnkmem (mgr.34373) 1795 : audit [DBG] from='client.45267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:20.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:20 gibba003 bash[32348]: audit 2021-03-10T14:24:18.860985+0000 mgr.gibba043.dnkmem (mgr.34373) 1795 : audit [DBG] from='client.45267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:21.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:20 gibba043 bash[24019]: audit 2021-03-10T14:24:18.860985+0000 mgr.gibba043.dnkmem (mgr.34373) 1795 : audit [DBG] from='client.45267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:21 gibba003 bash[31385]: cluster 2021-03-10T14:24:20.539880+0000 mgr.gibba043.dnkmem (mgr.34373) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:21 gibba003 bash[32348]: cluster 2021-03-10T14:24:20.539880+0000 mgr.gibba043.dnkmem (mgr.34373) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:21 gibba043 bash[24019]: cluster 2021-03-10T14:24:20.539880+0000 mgr.gibba043.dnkmem (mgr.34373) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:23 gibba003 bash[31385]: cluster 2021-03-10T14:24:22.540612+0000 mgr.gibba043.dnkmem (mgr.34373) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:23 gibba003 bash[32348]: cluster 2021-03-10T14:24:22.540612+0000 mgr.gibba043.dnkmem (mgr.34373) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:23 gibba043 bash[24019]: cluster 2021-03-10T14:24:22.540612+0000 mgr.gibba043.dnkmem (mgr.34373) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:25 gibba003 bash[31385]: cluster 2021-03-10T14:24:24.542255+0000 mgr.gibba043.dnkmem (mgr.34373) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:25 gibba003 bash[32348]: cluster 2021-03-10T14:24:24.542255+0000 mgr.gibba043.dnkmem (mgr.34373) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:25 gibba043 bash[24019]: cluster 2021-03-10T14:24:24.542255+0000 mgr.gibba043.dnkmem (mgr.34373) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:27 gibba003 bash[31385]: cephadm 2021-03-10T14:24:26.188415+0000 mgr.gibba043.dnkmem (mgr.34373) 1799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:27 gibba003 bash[31385]: cluster 2021-03-10T14:24:26.543333+0000 mgr.gibba043.dnkmem (mgr.34373) 1800 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:27 gibba003 bash[32348]: cephadm 2021-03-10T14:24:26.188415+0000 mgr.gibba043.dnkmem (mgr.34373) 1799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:27 gibba003 bash[32348]: cluster 2021-03-10T14:24:26.543333+0000 mgr.gibba043.dnkmem (mgr.34373) 1800 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:27 gibba043 bash[24019]: cephadm 2021-03-10T14:24:26.188415+0000 mgr.gibba043.dnkmem (mgr.34373) 1799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:27 gibba043 bash[24019]: cluster 2021-03-10T14:24:26.543333+0000 mgr.gibba043.dnkmem (mgr.34373) 1800 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:29 gibba003 bash[31385]: cluster 2021-03-10T14:24:28.544810+0000 mgr.gibba043.dnkmem (mgr.34373) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:29 gibba003 bash[32348]: cluster 2021-03-10T14:24:28.544810+0000 mgr.gibba043.dnkmem (mgr.34373) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:29 gibba043 bash[24019]: cluster 2021-03-10T14:24:28.544810+0000 mgr.gibba043.dnkmem (mgr.34373) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:31 gibba003 bash[31385]: cluster 2021-03-10T14:24:30.546327+0000 mgr.gibba043.dnkmem (mgr.34373) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:31 gibba003 bash[32348]: cluster 2021-03-10T14:24:30.546327+0000 mgr.gibba043.dnkmem (mgr.34373) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:31 gibba043 bash[24019]: cluster 2021-03-10T14:24:30.546327+0000 mgr.gibba043.dnkmem (mgr.34373) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:33 gibba003 bash[31385]: cluster 2021-03-10T14:24:32.547204+0000 mgr.gibba043.dnkmem (mgr.34373) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:33 gibba003 bash[32348]: cluster 2021-03-10T14:24:32.547204+0000 mgr.gibba043.dnkmem (mgr.34373) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:33 gibba043 bash[24019]: cluster 2021-03-10T14:24:32.547204+0000 mgr.gibba043.dnkmem (mgr.34373) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:35 gibba003 bash[31385]: cluster 2021-03-10T14:24:34.548928+0000 mgr.gibba043.dnkmem (mgr.34373) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:35 gibba003 bash[32348]: cluster 2021-03-10T14:24:34.548928+0000 mgr.gibba043.dnkmem (mgr.34373) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:35 gibba043 bash[24019]: cluster 2021-03-10T14:24:34.548928+0000 mgr.gibba043.dnkmem (mgr.34373) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:37 gibba003 bash[31385]: cluster 2021-03-10T14:24:36.550141+0000 mgr.gibba043.dnkmem (mgr.34373) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:37 gibba003 bash[32348]: cluster 2021-03-10T14:24:36.550141+0000 mgr.gibba043.dnkmem (mgr.34373) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:37 gibba043 bash[24019]: cluster 2021-03-10T14:24:36.550141+0000 mgr.gibba043.dnkmem (mgr.34373) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:39 gibba003 bash[31385]: cluster 2021-03-10T14:24:38.551608+0000 mgr.gibba043.dnkmem (mgr.34373) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:39 gibba003 bash[32348]: cluster 2021-03-10T14:24:38.551608+0000 mgr.gibba043.dnkmem (mgr.34373) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:39 gibba043 bash[24019]: cluster 2021-03-10T14:24:38.551608+0000 mgr.gibba043.dnkmem (mgr.34373) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:41 gibba003 bash[31385]: cluster 2021-03-10T14:24:40.553231+0000 mgr.gibba043.dnkmem (mgr.34373) 1807 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:41 gibba003 bash[32348]: cluster 2021-03-10T14:24:40.553231+0000 mgr.gibba043.dnkmem (mgr.34373) 1807 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:41 gibba043 bash[24019]: cluster 2021-03-10T14:24:40.553231+0000 mgr.gibba043.dnkmem (mgr.34373) 1807 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:42 gibba003 bash[31385]: cephadm 2021-03-10T14:24:41.204476+0000 mgr.gibba043.dnkmem (mgr.34373) 1808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:42.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:42 gibba003 bash[32348]: cephadm 2021-03-10T14:24:41.204476+0000 mgr.gibba043.dnkmem (mgr.34373) 1808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:42 gibba043 bash[24019]: cephadm 2021-03-10T14:24:41.204476+0000 mgr.gibba043.dnkmem (mgr.34373) 1808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:43 gibba003 bash[31385]: cluster 2021-03-10T14:24:42.554155+0000 mgr.gibba043.dnkmem (mgr.34373) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:43 gibba003 bash[32348]: cluster 2021-03-10T14:24:42.554155+0000 mgr.gibba043.dnkmem (mgr.34373) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:43 gibba043 bash[24019]: cluster 2021-03-10T14:24:42.554155+0000 mgr.gibba043.dnkmem (mgr.34373) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:45 gibba003 bash[31385]: cluster 2021-03-10T14:24:44.555729+0000 mgr.gibba043.dnkmem (mgr.34373) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:45 gibba003 bash[32348]: cluster 2021-03-10T14:24:44.555729+0000 mgr.gibba043.dnkmem (mgr.34373) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:45 gibba043 bash[24019]: cluster 2021-03-10T14:24:44.555729+0000 mgr.gibba043.dnkmem (mgr.34373) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:47 gibba003 bash[31385]: cluster 2021-03-10T14:24:46.556584+0000 mgr.gibba043.dnkmem (mgr.34373) 1811 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:47 gibba003 bash[32348]: cluster 2021-03-10T14:24:46.556584+0000 mgr.gibba043.dnkmem (mgr.34373) 1811 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:47 gibba043 bash[24019]: cluster 2021-03-10T14:24:46.556584+0000 mgr.gibba043.dnkmem (mgr.34373) 1811 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.369 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:24:49.592 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:24:49.593 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (33m) 9m ago 38m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:24:49.593 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (38m) 8m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:24:49.593 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (33m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:24:49.593 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (33m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:24:49.594 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:24:49.594 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:24:49.594 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:24:49.594 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:24:49.595 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (38m) 9m ago 38m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:24:49.595 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:24:49.595 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:24:49.595 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:24:49.595 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:24:49.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:24:49.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:24:49.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:24:49.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:24:49.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:24:49.597 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (38m) 8m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:24:49.597 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:24:49.842 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:24:49.842 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:24:49.842 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:49.843 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:24:49.843 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:24:49.843 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:49.843 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:24:49.843 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:24:49.844 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:24:49.844 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:24:49.844 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:24:49.844 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:24:49.844 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:24:49.845 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:24:49.845 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:24:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:49 gibba003 bash[32348]: cluster 2021-03-10T14:24:48.557896+0000 mgr.gibba043.dnkmem (mgr.34373) 1812 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:49 gibba003 bash[31385]: cluster 2021-03-10T14:24:48.557896+0000 mgr.gibba043.dnkmem (mgr.34373) 1812 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:49 gibba043 bash[24019]: cluster 2021-03-10T14:24:48.557896+0000 mgr.gibba043.dnkmem (mgr.34373) 1812 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:50.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:50 gibba003 bash[31385]: audit 2021-03-10T14:24:49.358672+0000 mgr.gibba043.dnkmem (mgr.34373) 1813 : audit [DBG] from='client.45279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:50.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:50 gibba003 bash[31385]: audit 2021-03-10T14:24:49.582200+0000 mgr.gibba043.dnkmem (mgr.34373) 1814 : audit [DBG] from='client.55270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:50.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:50 gibba003 bash[31385]: audit 2021-03-10T14:24:49.843240+0000 mon.a (mon.0) 724 : audit [DBG] from='client.? 172.21.2.103:0/1961008336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:50.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:50 gibba003 bash[32348]: audit 2021-03-10T14:24:49.358672+0000 mgr.gibba043.dnkmem (mgr.34373) 1813 : audit [DBG] from='client.45279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:50.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:50 gibba003 bash[32348]: audit 2021-03-10T14:24:49.582200+0000 mgr.gibba043.dnkmem (mgr.34373) 1814 : audit [DBG] from='client.55270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:50.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:50 gibba003 bash[32348]: audit 2021-03-10T14:24:49.843240+0000 mon.a (mon.0) 724 : audit [DBG] from='client.? 172.21.2.103:0/1961008336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:50 gibba043 bash[24019]: audit 2021-03-10T14:24:49.358672+0000 mgr.gibba043.dnkmem (mgr.34373) 1813 : audit [DBG] from='client.45279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:51.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:50 gibba043 bash[24019]: audit 2021-03-10T14:24:49.582200+0000 mgr.gibba043.dnkmem (mgr.34373) 1814 : audit [DBG] from='client.55270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:51.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:50 gibba043 bash[24019]: audit 2021-03-10T14:24:49.843240+0000 mon.a (mon.0) 724 : audit [DBG] from='client.? 172.21.2.103:0/1961008336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:51 gibba003 bash[31385]: cluster 2021-03-10T14:24:50.559193+0000 mgr.gibba043.dnkmem (mgr.34373) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:51 gibba003 bash[32348]: cluster 2021-03-10T14:24:50.559193+0000 mgr.gibba043.dnkmem (mgr.34373) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:51 gibba043 bash[24019]: cluster 2021-03-10T14:24:50.559193+0000 mgr.gibba043.dnkmem (mgr.34373) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:53 gibba003 bash[31385]: cluster 2021-03-10T14:24:52.559978+0000 mgr.gibba043.dnkmem (mgr.34373) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:53 gibba003 bash[32348]: cluster 2021-03-10T14:24:52.559978+0000 mgr.gibba043.dnkmem (mgr.34373) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:53 gibba043 bash[24019]: cluster 2021-03-10T14:24:52.559978+0000 mgr.gibba043.dnkmem (mgr.34373) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:55 gibba003 bash[31385]: cluster 2021-03-10T14:24:54.561697+0000 mgr.gibba043.dnkmem (mgr.34373) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:55 gibba003 bash[32348]: cluster 2021-03-10T14:24:54.561697+0000 mgr.gibba043.dnkmem (mgr.34373) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:55 gibba043 bash[24019]: cluster 2021-03-10T14:24:54.561697+0000 mgr.gibba043.dnkmem (mgr.34373) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.221333+0000 mgr.gibba043.dnkmem (mgr.34373) 1818 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:24:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.222908+0000 mgr.gibba043.dnkmem (mgr.34373) 1819 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:24:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.451515+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:24:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.456654+0000 mgr.gibba043.dnkmem (mgr.34373) 1820 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.458663+0000 mgr.gibba043.dnkmem (mgr.34373) 1821 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.459919+0000 mgr.gibba043.dnkmem (mgr.34373) 1822 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.459956+0000 mgr.gibba043.dnkmem (mgr.34373) 1823 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.459983+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.461482+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.461554+0000 mgr.gibba043.dnkmem (mgr.34373) 1824 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.461589+0000 mgr.gibba043.dnkmem (mgr.34373) 1825 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.462771+0000 mon.c (mon.1) 517 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.462908+0000 mgr.gibba043.dnkmem (mgr.34373) 1826 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.464308+0000 mon.c (mon.1) 518 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.464584+0000 mgr.gibba043.dnkmem (mgr.34373) 1827 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.464619+0000 mgr.gibba043.dnkmem (mgr.34373) 1828 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.466022+0000 mgr.gibba043.dnkmem (mgr.34373) 1829 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.466334+0000 mgr.gibba043.dnkmem (mgr.34373) 1830 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.467676+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.467760+0000 mgr.gibba043.dnkmem (mgr.34373) 1831 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.467797+0000 mgr.gibba043.dnkmem (mgr.34373) 1832 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cephadm 2021-03-10T14:24:56.467897+0000 mgr.gibba043.dnkmem (mgr.34373) 1833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: audit 2021-03-10T14:24:56.469040+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:57 gibba043 bash[24019]: cluster 2021-03-10T14:24:56.563210+0000 mgr.gibba043.dnkmem (mgr.34373) 1834 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.221333+0000 mgr.gibba043.dnkmem (mgr.34373) 1818 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:24:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.222908+0000 mgr.gibba043.dnkmem (mgr.34373) 1819 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:24:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.451515+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:24:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.456654+0000 mgr.gibba043.dnkmem (mgr.34373) 1820 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.458663+0000 mgr.gibba043.dnkmem (mgr.34373) 1821 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.459919+0000 mgr.gibba043.dnkmem (mgr.34373) 1822 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.459956+0000 mgr.gibba043.dnkmem (mgr.34373) 1823 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.459983+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.461482+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.461554+0000 mgr.gibba043.dnkmem (mgr.34373) 1824 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.461589+0000 mgr.gibba043.dnkmem (mgr.34373) 1825 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.462771+0000 mon.c (mon.1) 517 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.462908+0000 mgr.gibba043.dnkmem (mgr.34373) 1826 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.464308+0000 mon.c (mon.1) 518 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.464584+0000 mgr.gibba043.dnkmem (mgr.34373) 1827 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.464619+0000 mgr.gibba043.dnkmem (mgr.34373) 1828 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.466022+0000 mgr.gibba043.dnkmem (mgr.34373) 1829 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.466334+0000 mgr.gibba043.dnkmem (mgr.34373) 1830 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.467676+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.467760+0000 mgr.gibba043.dnkmem (mgr.34373) 1831 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.467797+0000 mgr.gibba043.dnkmem (mgr.34373) 1832 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.221333+0000 mgr.gibba043.dnkmem (mgr.34373) 1818 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:24:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.222908+0000 mgr.gibba043.dnkmem (mgr.34373) 1819 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:24:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.451515+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:24:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.456654+0000 mgr.gibba043.dnkmem (mgr.34373) 1820 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.458663+0000 mgr.gibba043.dnkmem (mgr.34373) 1821 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.459919+0000 mgr.gibba043.dnkmem (mgr.34373) 1822 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.459956+0000 mgr.gibba043.dnkmem (mgr.34373) 1823 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.459983+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.461482+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.461554+0000 mgr.gibba043.dnkmem (mgr.34373) 1824 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.461589+0000 mgr.gibba043.dnkmem (mgr.34373) 1825 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.462771+0000 mon.c (mon.1) 517 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.462908+0000 mgr.gibba043.dnkmem (mgr.34373) 1826 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.464308+0000 mon.c (mon.1) 518 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.464584+0000 mgr.gibba043.dnkmem (mgr.34373) 1827 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.464619+0000 mgr.gibba043.dnkmem (mgr.34373) 1828 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.466022+0000 mgr.gibba043.dnkmem (mgr.34373) 1829 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.466334+0000 mgr.gibba043.dnkmem (mgr.34373) 1830 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.467676+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.467760+0000 mgr.gibba043.dnkmem (mgr.34373) 1831 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.467797+0000 mgr.gibba043.dnkmem (mgr.34373) 1832 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:57.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cephadm 2021-03-10T14:24:56.467897+0000 mgr.gibba043.dnkmem (mgr.34373) 1833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:57.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: audit 2021-03-10T14:24:56.469040+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[31385]: cluster 2021-03-10T14:24:56.563210+0000 mgr.gibba043.dnkmem (mgr.34373) 1834 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:57.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cephadm 2021-03-10T14:24:56.467897+0000 mgr.gibba043.dnkmem (mgr.34373) 1833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:24:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: audit 2021-03-10T14:24:56.469040+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:57 gibba003 bash[32348]: cluster 2021-03-10T14:24:56.563210+0000 mgr.gibba043.dnkmem (mgr.34373) 1834 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:24:59 gibba003 bash[31385]: cluster 2021-03-10T14:24:58.564820+0000 mgr.gibba043.dnkmem (mgr.34373) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:24:59 gibba003 bash[32348]: cluster 2021-03-10T14:24:58.564820+0000 mgr.gibba043.dnkmem (mgr.34373) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:24:59 gibba043 bash[24019]: cluster 2021-03-10T14:24:58.564820+0000 mgr.gibba043.dnkmem (mgr.34373) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.932 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:01 gibba003 bash[31385]: cluster 2021-03-10T14:25:00.566418+0000 mgr.gibba043.dnkmem (mgr.34373) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.933 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:01 gibba003 bash[32348]: cluster 2021-03-10T14:25:00.566418+0000 mgr.gibba043.dnkmem (mgr.34373) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:01 gibba043 bash[24019]: cluster 2021-03-10T14:25:00.566418+0000 mgr.gibba043.dnkmem (mgr.34373) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:03 gibba003 bash[31385]: cluster 2021-03-10T14:25:02.568005+0000 mgr.gibba043.dnkmem (mgr.34373) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:03 gibba003 bash[32348]: cluster 2021-03-10T14:25:02.568005+0000 mgr.gibba043.dnkmem (mgr.34373) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:03 gibba043 bash[24019]: cluster 2021-03-10T14:25:02.568005+0000 mgr.gibba043.dnkmem (mgr.34373) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:05 gibba003 bash[31385]: cluster 2021-03-10T14:25:04.569766+0000 mgr.gibba043.dnkmem (mgr.34373) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:05 gibba003 bash[32348]: cluster 2021-03-10T14:25:04.569766+0000 mgr.gibba043.dnkmem (mgr.34373) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:05 gibba043 bash[24019]: cluster 2021-03-10T14:25:04.569766+0000 mgr.gibba043.dnkmem (mgr.34373) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:07 gibba003 bash[31385]: cluster 2021-03-10T14:25:06.571560+0000 mgr.gibba043.dnkmem (mgr.34373) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:07 gibba003 bash[32348]: cluster 2021-03-10T14:25:06.571560+0000 mgr.gibba043.dnkmem (mgr.34373) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:07 gibba043 bash[24019]: cluster 2021-03-10T14:25:06.571560+0000 mgr.gibba043.dnkmem (mgr.34373) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:09 gibba003 bash[31385]: cluster 2021-03-10T14:25:08.573274+0000 mgr.gibba043.dnkmem (mgr.34373) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:09 gibba003 bash[32348]: cluster 2021-03-10T14:25:08.573274+0000 mgr.gibba043.dnkmem (mgr.34373) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:09 gibba043 bash[24019]: cluster 2021-03-10T14:25:08.573274+0000 mgr.gibba043.dnkmem (mgr.34373) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:11 gibba043 bash[24019]: cluster 2021-03-10T14:25:10.574873+0000 mgr.gibba043.dnkmem (mgr.34373) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:11 gibba003 bash[31385]: cluster 2021-03-10T14:25:10.574873+0000 mgr.gibba043.dnkmem (mgr.34373) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:11 gibba003 bash[32348]: cluster 2021-03-10T14:25:10.574873+0000 mgr.gibba043.dnkmem (mgr.34373) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:12.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:12 gibba003 bash[31385]: cephadm 2021-03-10T14:25:11.483442+0000 mgr.gibba043.dnkmem (mgr.34373) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:12.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:12 gibba003 bash[32348]: cephadm 2021-03-10T14:25:11.483442+0000 mgr.gibba043.dnkmem (mgr.34373) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:12 gibba043 bash[24019]: cephadm 2021-03-10T14:25:11.483442+0000 mgr.gibba043.dnkmem (mgr.34373) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: cluster 2021-03-10T14:25:12.575831+0000 mgr.gibba043.dnkmem (mgr.34373) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.888129+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:25:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.888933+0000 mon.c (mon.1) 522 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.889535+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:25:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.889629+0000 mon.c (mon.1) 523 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:25:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.890298+0000 mon.c (mon.1) 524 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.891359+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.892467+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:25:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.893328+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.934093+0000 mon.c (mon.1) 525 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.935297+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.988642+0000 mon.c (mon.1) 526 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[31385]: audit 2021-03-10T14:25:12.989829+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: cluster 2021-03-10T14:25:12.575831+0000 mgr.gibba043.dnkmem (mgr.34373) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.888129+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:25:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.888933+0000 mon.c (mon.1) 522 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.889535+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:25:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.889629+0000 mon.c (mon.1) 523 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:25:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.890298+0000 mon.c (mon.1) 524 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.891359+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.892467+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:25:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.893328+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.934093+0000 mon.c (mon.1) 525 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.935297+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.988642+0000 mon.c (mon.1) 526 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:13 gibba003 bash[32348]: audit 2021-03-10T14:25:12.989829+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: cluster 2021-03-10T14:25:12.575831+0000 mgr.gibba043.dnkmem (mgr.34373) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.888129+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:25:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.888933+0000 mon.c (mon.1) 522 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:25:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.889535+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:25:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.889629+0000 mon.c (mon.1) 523 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:25:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.890298+0000 mon.c (mon.1) 524 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.891359+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:25:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.892467+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:25:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.893328+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.934093+0000 mon.c (mon.1) 525 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.935297+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.988642+0000 mon.c (mon.1) 526 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:13 gibba043 bash[24019]: audit 2021-03-10T14:25:12.989829+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:15 gibba003 bash[31385]: cluster 2021-03-10T14:25:14.577310+0000 mgr.gibba043.dnkmem (mgr.34373) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:15 gibba003 bash[32348]: cluster 2021-03-10T14:25:14.577310+0000 mgr.gibba043.dnkmem (mgr.34373) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:15 gibba043 bash[24019]: cluster 2021-03-10T14:25:14.577310+0000 mgr.gibba043.dnkmem (mgr.34373) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:17 gibba003 bash[31385]: cluster 2021-03-10T14:25:16.578981+0000 mgr.gibba043.dnkmem (mgr.34373) 1845 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:17 gibba003 bash[32348]: cluster 2021-03-10T14:25:16.578981+0000 mgr.gibba043.dnkmem (mgr.34373) 1845 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:17 gibba043 bash[24019]: cluster 2021-03-10T14:25:16.578981+0000 mgr.gibba043.dnkmem (mgr.34373) 1845 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:19 gibba043 bash[24019]: cluster 2021-03-10T14:25:18.580704+0000 mgr.gibba043.dnkmem (mgr.34373) 1846 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:20.088 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:25:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:19 gibba003 bash[31385]: cluster 2021-03-10T14:25:18.580704+0000 mgr.gibba043.dnkmem (mgr.34373) 1846 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:20.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:19 gibba003 bash[32348]: cluster 2021-03-10T14:25:18.580704+0000 mgr.gibba043.dnkmem (mgr.34373) 1846 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:20.317 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:25:20.317 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (33m) 9m ago 39m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:25:20.318 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (38m) 8m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:25:20.318 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:25:20.318 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:25:20.318 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:25:20.319 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:25:20.319 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:25:20.319 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:25:20.319 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:25:20.320 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:25:20.320 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:25:20.320 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:25:20.320 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:25:20.320 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:25:20.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:25:20.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:25:20.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:25:20.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:25:20.321 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (38m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:25:20.322 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:25:20.566 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:25:20.566 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:25:20.566 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:20.567 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:25:20.567 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:25:20.567 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:20.567 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:25:20.567 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:25:20.568 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:25:20.568 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:25:20.568 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:25:20.568 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:25:20.568 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:25:20.569 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:25:20.569 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:25:21.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:20 gibba043 bash[24019]: audit 2021-03-10T14:25:20.567179+0000 mon.c (mon.1) 527 : audit [DBG] from='client.? 172.21.2.103:0/2471157529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:20 gibba003 bash[31385]: audit 2021-03-10T14:25:20.567179+0000 mon.c (mon.1) 527 : audit [DBG] from='client.? 172.21.2.103:0/2471157529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:21.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:20 gibba003 bash[32348]: audit 2021-03-10T14:25:20.567179+0000 mon.c (mon.1) 527 : audit [DBG] from='client.? 172.21.2.103:0/2471157529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:22.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:21 gibba043 bash[24019]: audit 2021-03-10T14:25:20.077770+0000 mgr.gibba043.dnkmem (mgr.34373) 1847 : audit [DBG] from='client.55282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:22.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:21 gibba043 bash[24019]: audit 2021-03-10T14:25:20.304291+0000 mgr.gibba043.dnkmem (mgr.34373) 1848 : audit [DBG] from='client.55288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:22.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:21 gibba043 bash[24019]: cluster 2021-03-10T14:25:20.582094+0000 mgr.gibba043.dnkmem (mgr.34373) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:21 gibba003 bash[31385]: audit 2021-03-10T14:25:20.077770+0000 mgr.gibba043.dnkmem (mgr.34373) 1847 : audit [DBG] from='client.55282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:21 gibba003 bash[31385]: audit 2021-03-10T14:25:20.304291+0000 mgr.gibba043.dnkmem (mgr.34373) 1848 : audit [DBG] from='client.55288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:21 gibba003 bash[31385]: cluster 2021-03-10T14:25:20.582094+0000 mgr.gibba043.dnkmem (mgr.34373) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:21 gibba003 bash[32348]: audit 2021-03-10T14:25:20.077770+0000 mgr.gibba043.dnkmem (mgr.34373) 1847 : audit [DBG] from='client.55282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:21 gibba003 bash[32348]: audit 2021-03-10T14:25:20.304291+0000 mgr.gibba043.dnkmem (mgr.34373) 1848 : audit [DBG] from='client.55288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:21 gibba003 bash[32348]: cluster 2021-03-10T14:25:20.582094+0000 mgr.gibba043.dnkmem (mgr.34373) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:23 gibba003 bash[31385]: cluster 2021-03-10T14:25:22.582880+0000 mgr.gibba043.dnkmem (mgr.34373) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:23 gibba003 bash[32348]: cluster 2021-03-10T14:25:22.582880+0000 mgr.gibba043.dnkmem (mgr.34373) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:23 gibba043 bash[24019]: cluster 2021-03-10T14:25:22.582880+0000 mgr.gibba043.dnkmem (mgr.34373) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:25 gibba003 bash[31385]: cluster 2021-03-10T14:25:24.584272+0000 mgr.gibba043.dnkmem (mgr.34373) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:25 gibba003 bash[32348]: cluster 2021-03-10T14:25:24.584272+0000 mgr.gibba043.dnkmem (mgr.34373) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:25 gibba043 bash[24019]: cluster 2021-03-10T14:25:24.584272+0000 mgr.gibba043.dnkmem (mgr.34373) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:27 gibba003 bash[31385]: cephadm 2021-03-10T14:25:26.495339+0000 mgr.gibba043.dnkmem (mgr.34373) 1852 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:27 gibba003 bash[31385]: cluster 2021-03-10T14:25:26.585856+0000 mgr.gibba043.dnkmem (mgr.34373) 1853 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:27 gibba003 bash[32348]: cephadm 2021-03-10T14:25:26.495339+0000 mgr.gibba043.dnkmem (mgr.34373) 1852 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:27 gibba003 bash[32348]: cluster 2021-03-10T14:25:26.585856+0000 mgr.gibba043.dnkmem (mgr.34373) 1853 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:27 gibba043 bash[24019]: cephadm 2021-03-10T14:25:26.495339+0000 mgr.gibba043.dnkmem (mgr.34373) 1852 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:27 gibba043 bash[24019]: cluster 2021-03-10T14:25:26.585856+0000 mgr.gibba043.dnkmem (mgr.34373) 1853 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.666 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:29 gibba003 bash[31385]: cluster 2021-03-10T14:25:28.587533+0000 mgr.gibba043.dnkmem (mgr.34373) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.667 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:29 gibba003 bash[32348]: cluster 2021-03-10T14:25:28.587533+0000 mgr.gibba043.dnkmem (mgr.34373) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:29 gibba043 bash[24019]: cluster 2021-03-10T14:25:28.587533+0000 mgr.gibba043.dnkmem (mgr.34373) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:31 gibba003 bash[31385]: cluster 2021-03-10T14:25:30.588842+0000 mgr.gibba043.dnkmem (mgr.34373) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:31 gibba003 bash[32348]: cluster 2021-03-10T14:25:30.588842+0000 mgr.gibba043.dnkmem (mgr.34373) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:31 gibba043 bash[24019]: cluster 2021-03-10T14:25:30.588842+0000 mgr.gibba043.dnkmem (mgr.34373) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:33 gibba003 bash[31385]: cluster 2021-03-10T14:25:32.589812+0000 mgr.gibba043.dnkmem (mgr.34373) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:33 gibba003 bash[32348]: cluster 2021-03-10T14:25:32.589812+0000 mgr.gibba043.dnkmem (mgr.34373) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:33 gibba043 bash[24019]: cluster 2021-03-10T14:25:32.589812+0000 mgr.gibba043.dnkmem (mgr.34373) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:35 gibba003 bash[31385]: cluster 2021-03-10T14:25:34.590238+0000 mgr.gibba043.dnkmem (mgr.34373) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:35 gibba003 bash[32348]: cluster 2021-03-10T14:25:34.590238+0000 mgr.gibba043.dnkmem (mgr.34373) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:35 gibba043 bash[24019]: cluster 2021-03-10T14:25:34.590238+0000 mgr.gibba043.dnkmem (mgr.34373) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:37 gibba003 bash[31385]: cluster 2021-03-10T14:25:36.591907+0000 mgr.gibba043.dnkmem (mgr.34373) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:37 gibba003 bash[32348]: cluster 2021-03-10T14:25:36.591907+0000 mgr.gibba043.dnkmem (mgr.34373) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:37 gibba043 bash[24019]: cluster 2021-03-10T14:25:36.591907+0000 mgr.gibba043.dnkmem (mgr.34373) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:39 gibba003 bash[31385]: cluster 2021-03-10T14:25:38.593291+0000 mgr.gibba043.dnkmem (mgr.34373) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:39 gibba003 bash[32348]: cluster 2021-03-10T14:25:38.593291+0000 mgr.gibba043.dnkmem (mgr.34373) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:39 gibba043 bash[24019]: cluster 2021-03-10T14:25:38.593291+0000 mgr.gibba043.dnkmem (mgr.34373) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:41 gibba043 bash[24019]: cluster 2021-03-10T14:25:40.594800+0000 mgr.gibba043.dnkmem (mgr.34373) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:41 gibba003 bash[31385]: cluster 2021-03-10T14:25:40.594800+0000 mgr.gibba043.dnkmem (mgr.34373) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:41 gibba003 bash[32348]: cluster 2021-03-10T14:25:40.594800+0000 mgr.gibba043.dnkmem (mgr.34373) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:42 gibba003 bash[31385]: cephadm 2021-03-10T14:25:41.510944+0000 mgr.gibba043.dnkmem (mgr.34373) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:42 gibba003 bash[32348]: cephadm 2021-03-10T14:25:41.510944+0000 mgr.gibba043.dnkmem (mgr.34373) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:42 gibba043 bash[24019]: cephadm 2021-03-10T14:25:41.510944+0000 mgr.gibba043.dnkmem (mgr.34373) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:25:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:43 gibba003 bash[31385]: cluster 2021-03-10T14:25:42.595693+0000 mgr.gibba043.dnkmem (mgr.34373) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:43 gibba003 bash[32348]: cluster 2021-03-10T14:25:42.595693+0000 mgr.gibba043.dnkmem (mgr.34373) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:43 gibba043 bash[24019]: cluster 2021-03-10T14:25:42.595693+0000 mgr.gibba043.dnkmem (mgr.34373) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:45 gibba043 bash[24019]: cluster 2021-03-10T14:25:44.596114+0000 mgr.gibba043.dnkmem (mgr.34373) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:45 gibba003 bash[31385]: cluster 2021-03-10T14:25:44.596114+0000 mgr.gibba043.dnkmem (mgr.34373) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:45 gibba003 bash[32348]: cluster 2021-03-10T14:25:44.596114+0000 mgr.gibba043.dnkmem (mgr.34373) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:47 gibba043 bash[24019]: cluster 2021-03-10T14:25:46.597849+0000 mgr.gibba043.dnkmem (mgr.34373) 1864 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:47 gibba003 bash[31385]: cluster 2021-03-10T14:25:46.597849+0000 mgr.gibba043.dnkmem (mgr.34373) 1864 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:47 gibba003 bash[32348]: cluster 2021-03-10T14:25:46.597849+0000 mgr.gibba043.dnkmem (mgr.34373) 1864 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:49 gibba043 bash[24019]: cluster 2021-03-10T14:25:48.599230+0000 mgr.gibba043.dnkmem (mgr.34373) 1865 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:49 gibba003 bash[31385]: cluster 2021-03-10T14:25:48.599230+0000 mgr.gibba043.dnkmem (mgr.34373) 1865 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:49 gibba003 bash[32348]: cluster 2021-03-10T14:25:48.599230+0000 mgr.gibba043.dnkmem (mgr.34373) 1865 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:50.810 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:25:51.040 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:25:51.040 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (34m) 10m ago 39m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:25:51.040 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (39m) 9m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:25:51.041 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (34m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:25:51.041 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (34m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:25:51.041 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:25:51.041 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:25:51.041 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:25:51.042 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (33m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:25:51.042 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (39m) 10m ago 39m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:25:51.042 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:25:51.042 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:25:51.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:25:51.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:25:51.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:25:51.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:25:51.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:25:51.044 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:25:51.044 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:25:51.044 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (39m) 9m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:25:51.044 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:25:51.287 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:25:51.287 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:25:51.287 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:51.288 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:25:51.288 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:25:51.288 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:51.288 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:25:51.289 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:25:51.289 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:25:51.289 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:25:51.289 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:25:51.290 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:25:51.290 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:25:51.290 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:25:51.290 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:25:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:51 gibba043 bash[24019]: cluster 2021-03-10T14:25:50.600749+0000 mgr.gibba043.dnkmem (mgr.34373) 1866 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:52.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:51 gibba043 bash[24019]: audit 2021-03-10T14:25:51.288298+0000 mon.a (mon.0) 732 : audit [DBG] from='client.? 172.21.2.103:0/2464842882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:51 gibba003 bash[31385]: cluster 2021-03-10T14:25:50.600749+0000 mgr.gibba043.dnkmem (mgr.34373) 1866 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:51 gibba003 bash[31385]: audit 2021-03-10T14:25:51.288298+0000 mon.a (mon.0) 732 : audit [DBG] from='client.? 172.21.2.103:0/2464842882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:51 gibba003 bash[32348]: cluster 2021-03-10T14:25:50.600749+0000 mgr.gibba043.dnkmem (mgr.34373) 1866 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:51 gibba003 bash[32348]: audit 2021-03-10T14:25:51.288298+0000 mon.a (mon.0) 732 : audit [DBG] from='client.? 172.21.2.103:0/2464842882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:53.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:52 gibba043 bash[24019]: audit 2021-03-10T14:25:50.799964+0000 mgr.gibba043.dnkmem (mgr.34373) 1867 : audit [DBG] from='client.45315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:53.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:52 gibba043 bash[24019]: audit 2021-03-10T14:25:51.026583+0000 mgr.gibba043.dnkmem (mgr.34373) 1868 : audit [DBG] from='client.55306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:52 gibba003 bash[31385]: audit 2021-03-10T14:25:50.799964+0000 mgr.gibba043.dnkmem (mgr.34373) 1867 : audit [DBG] from='client.45315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:52 gibba003 bash[31385]: audit 2021-03-10T14:25:51.026583+0000 mgr.gibba043.dnkmem (mgr.34373) 1868 : audit [DBG] from='client.55306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:53.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:52 gibba003 bash[32348]: audit 2021-03-10T14:25:50.799964+0000 mgr.gibba043.dnkmem (mgr.34373) 1867 : audit [DBG] from='client.45315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:52 gibba003 bash[32348]: audit 2021-03-10T14:25:51.026583+0000 mgr.gibba043.dnkmem (mgr.34373) 1868 : audit [DBG] from='client.55306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:53 gibba043 bash[24019]: cluster 2021-03-10T14:25:52.601708+0000 mgr.gibba043.dnkmem (mgr.34373) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:53 gibba003 bash[31385]: cluster 2021-03-10T14:25:52.601708+0000 mgr.gibba043.dnkmem (mgr.34373) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:53 gibba003 bash[32348]: cluster 2021-03-10T14:25:52.601708+0000 mgr.gibba043.dnkmem (mgr.34373) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:55 gibba043 bash[24019]: cluster 2021-03-10T14:25:54.603126+0000 mgr.gibba043.dnkmem (mgr.34373) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:55 gibba003 bash[31385]: cluster 2021-03-10T14:25:54.603126+0000 mgr.gibba043.dnkmem (mgr.34373) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:55 gibba003 bash[32348]: cluster 2021-03-10T14:25:54.603126+0000 mgr.gibba043.dnkmem (mgr.34373) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:56 gibba043 bash[24019]: audit 2021-03-10T14:25:56.529966+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:25:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:56 gibba003 bash[31385]: audit 2021-03-10T14:25:56.529966+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:25:57.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:56 gibba003 bash[32348]: audit 2021-03-10T14:25:56.529966+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:25:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:57 gibba043 bash[24019]: cephadm 2021-03-10T14:25:56.526997+0000 mgr.gibba043.dnkmem (mgr.34373) 1871 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:25:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:57 gibba043 bash[24019]: cluster 2021-03-10T14:25:56.603675+0000 mgr.gibba043.dnkmem (mgr.34373) 1872 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:57 gibba003 bash[31385]: cephadm 2021-03-10T14:25:56.526997+0000 mgr.gibba043.dnkmem (mgr.34373) 1871 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:25:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:57 gibba003 bash[31385]: cluster 2021-03-10T14:25:56.603675+0000 mgr.gibba043.dnkmem (mgr.34373) 1872 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:57 gibba003 bash[32348]: cephadm 2021-03-10T14:25:56.526997+0000 mgr.gibba043.dnkmem (mgr.34373) 1871 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:25:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:57 gibba003 bash[32348]: cluster 2021-03-10T14:25:56.603675+0000 mgr.gibba043.dnkmem (mgr.34373) 1872 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:25:59 gibba043 bash[24019]: cluster 2021-03-10T14:25:58.604919+0000 mgr.gibba043.dnkmem (mgr.34373) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:25:59 gibba003 bash[31385]: cluster 2021-03-10T14:25:58.604919+0000 mgr.gibba043.dnkmem (mgr.34373) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:25:59 gibba003 bash[32348]: cluster 2021-03-10T14:25:58.604919+0000 mgr.gibba043.dnkmem (mgr.34373) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.134263+0000 mgr.gibba043.dnkmem (mgr.34373) 1874 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:26:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.135652+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:26:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.348675+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:26:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.352981+0000 mgr.gibba043.dnkmem (mgr.34373) 1875 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.354941+0000 mgr.gibba043.dnkmem (mgr.34373) 1876 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.356058+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.356619+0000 mgr.gibba043.dnkmem (mgr.34373) 1877 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.356654+0000 mgr.gibba043.dnkmem (mgr.34373) 1878 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.357866+0000 mon.c (mon.1) 530 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.358218+0000 mgr.gibba043.dnkmem (mgr.34373) 1879 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.358259+0000 mgr.gibba043.dnkmem (mgr.34373) 1880 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.359602+0000 mon.c (mon.1) 531 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.359653+0000 mgr.gibba043.dnkmem (mgr.34373) 1881 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.361074+0000 mon.c (mon.1) 532 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.361282+0000 mgr.gibba043.dnkmem (mgr.34373) 1882 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.361321+0000 mgr.gibba043.dnkmem (mgr.34373) 1883 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.362897+0000 mgr.gibba043.dnkmem (mgr.34373) 1884 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.363235+0000 mgr.gibba043.dnkmem (mgr.34373) 1885 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:01.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.364264+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.364489+0000 mgr.gibba043.dnkmem (mgr.34373) 1886 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:01.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.364530+0000 mgr.gibba043.dnkmem (mgr.34373) 1887 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.134263+0000 mgr.gibba043.dnkmem (mgr.34373) 1874 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:26:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.135652+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:26:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.348675+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:26:01.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.352981+0000 mgr.gibba043.dnkmem (mgr.34373) 1875 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.354941+0000 mgr.gibba043.dnkmem (mgr.34373) 1876 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.356058+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.356619+0000 mgr.gibba043.dnkmem (mgr.34373) 1877 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.356654+0000 mgr.gibba043.dnkmem (mgr.34373) 1878 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:01.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.357866+0000 mon.c (mon.1) 530 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.358218+0000 mgr.gibba043.dnkmem (mgr.34373) 1879 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.358259+0000 mgr.gibba043.dnkmem (mgr.34373) 1880 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.359602+0000 mon.c (mon.1) 531 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.359653+0000 mgr.gibba043.dnkmem (mgr.34373) 1881 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.361074+0000 mon.c (mon.1) 532 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.361282+0000 mgr.gibba043.dnkmem (mgr.34373) 1882 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.361321+0000 mgr.gibba043.dnkmem (mgr.34373) 1883 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.362897+0000 mgr.gibba043.dnkmem (mgr.34373) 1884 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:01.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.363235+0000 mgr.gibba043.dnkmem (mgr.34373) 1885 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:01.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.364264+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.364489+0000 mgr.gibba043.dnkmem (mgr.34373) 1886 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:01.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.364530+0000 mgr.gibba043.dnkmem (mgr.34373) 1887 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:01.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cephadm 2021-03-10T14:26:00.364641+0000 mgr.gibba043.dnkmem (mgr.34373) 1888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:01.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: audit 2021-03-10T14:26:00.365903+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[31385]: cluster 2021-03-10T14:26:00.606328+0000 mgr.gibba043.dnkmem (mgr.34373) 1889 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cephadm 2021-03-10T14:26:00.364641+0000 mgr.gibba043.dnkmem (mgr.34373) 1888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:01.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: audit 2021-03-10T14:26:00.365903+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:01 gibba003 bash[32348]: cluster 2021-03-10T14:26:00.606328+0000 mgr.gibba043.dnkmem (mgr.34373) 1889 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.134263+0000 mgr.gibba043.dnkmem (mgr.34373) 1874 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:26:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.135652+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:26:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.348675+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:26:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.352981+0000 mgr.gibba043.dnkmem (mgr.34373) 1875 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.354941+0000 mgr.gibba043.dnkmem (mgr.34373) 1876 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.356058+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.356619+0000 mgr.gibba043.dnkmem (mgr.34373) 1877 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.356654+0000 mgr.gibba043.dnkmem (mgr.34373) 1878 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.357866+0000 mon.c (mon.1) 530 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.358218+0000 mgr.gibba043.dnkmem (mgr.34373) 1879 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.358259+0000 mgr.gibba043.dnkmem (mgr.34373) 1880 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.359602+0000 mon.c (mon.1) 531 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.359653+0000 mgr.gibba043.dnkmem (mgr.34373) 1881 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:01.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.361074+0000 mon.c (mon.1) 532 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.361282+0000 mgr.gibba043.dnkmem (mgr.34373) 1882 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:01.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.361321+0000 mgr.gibba043.dnkmem (mgr.34373) 1883 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:01.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.362897+0000 mgr.gibba043.dnkmem (mgr.34373) 1884 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:01.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.363235+0000 mgr.gibba043.dnkmem (mgr.34373) 1885 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:01.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.364264+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.364489+0000 mgr.gibba043.dnkmem (mgr.34373) 1886 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:01.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.364530+0000 mgr.gibba043.dnkmem (mgr.34373) 1887 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:01.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cephadm 2021-03-10T14:26:00.364641+0000 mgr.gibba043.dnkmem (mgr.34373) 1888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:01.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: audit 2021-03-10T14:26:00.365903+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:01 gibba043 bash[24019]: cluster 2021-03-10T14:26:00.606328+0000 mgr.gibba043.dnkmem (mgr.34373) 1889 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:03 gibba003 bash[31385]: cluster 2021-03-10T14:26:02.608030+0000 mgr.gibba043.dnkmem (mgr.34373) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:03 gibba003 bash[32348]: cluster 2021-03-10T14:26:02.608030+0000 mgr.gibba043.dnkmem (mgr.34373) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:03 gibba043 bash[24019]: cluster 2021-03-10T14:26:02.608030+0000 mgr.gibba043.dnkmem (mgr.34373) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:05 gibba003 bash[31385]: cluster 2021-03-10T14:26:04.608671+0000 mgr.gibba043.dnkmem (mgr.34373) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:05 gibba003 bash[32348]: cluster 2021-03-10T14:26:04.608671+0000 mgr.gibba043.dnkmem (mgr.34373) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:05 gibba043 bash[24019]: cluster 2021-03-10T14:26:04.608671+0000 mgr.gibba043.dnkmem (mgr.34373) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:07 gibba003 bash[31385]: cluster 2021-03-10T14:26:06.610299+0000 mgr.gibba043.dnkmem (mgr.34373) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:07 gibba003 bash[32348]: cluster 2021-03-10T14:26:06.610299+0000 mgr.gibba043.dnkmem (mgr.34373) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:07 gibba043 bash[24019]: cluster 2021-03-10T14:26:06.610299+0000 mgr.gibba043.dnkmem (mgr.34373) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:09 gibba003 bash[31385]: cluster 2021-03-10T14:26:08.611714+0000 mgr.gibba043.dnkmem (mgr.34373) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:09 gibba003 bash[32348]: cluster 2021-03-10T14:26:08.611714+0000 mgr.gibba043.dnkmem (mgr.34373) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:09 gibba043 bash[24019]: cluster 2021-03-10T14:26:08.611714+0000 mgr.gibba043.dnkmem (mgr.34373) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:11 gibba043 bash[24019]: cluster 2021-03-10T14:26:10.613350+0000 mgr.gibba043.dnkmem (mgr.34373) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:12.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:11 gibba003 bash[31385]: cluster 2021-03-10T14:26:10.613350+0000 mgr.gibba043.dnkmem (mgr.34373) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:11 gibba003 bash[32348]: cluster 2021-03-10T14:26:10.613350+0000 mgr.gibba043.dnkmem (mgr.34373) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: cluster 2021-03-10T14:26:12.614951+0000 mgr.gibba043.dnkmem (mgr.34373) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.900635+0000 mon.c (mon.1) 535 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:26:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.901363+0000 mon.c (mon.1) 536 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.902041+0000 mon.c (mon.1) 537 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:26:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.902075+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:26:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.902711+0000 mon.c (mon.1) 538 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.904243+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.905184+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:26:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.906071+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.940547+0000 mon.c (mon.1) 539 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.941709+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.996744+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[31385]: audit 2021-03-10T14:26:12.997943+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: cluster 2021-03-10T14:26:12.614951+0000 mgr.gibba043.dnkmem (mgr.34373) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.900635+0000 mon.c (mon.1) 535 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:26:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.901363+0000 mon.c (mon.1) 536 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.902041+0000 mon.c (mon.1) 537 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:26:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.902075+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:26:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.902711+0000 mon.c (mon.1) 538 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.904243+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.905184+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:26:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.906071+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:26:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.940547+0000 mon.c (mon.1) 539 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.941709+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.996744+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:13 gibba003 bash[32348]: audit 2021-03-10T14:26:12.997943+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: cluster 2021-03-10T14:26:12.614951+0000 mgr.gibba043.dnkmem (mgr.34373) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.900635+0000 mon.c (mon.1) 535 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:26:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.901363+0000 mon.c (mon.1) 536 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:26:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.902041+0000 mon.c (mon.1) 537 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:26:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.902075+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:26:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.902711+0000 mon.c (mon.1) 538 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:26:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.904243+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:26:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.905184+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:26:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.906071+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:26:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.940547+0000 mon.c (mon.1) 539 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.941709+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.996744+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:13 gibba043 bash[24019]: audit 2021-03-10T14:26:12.997943+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:15 gibba003 bash[31385]: cluster 2021-03-10T14:26:14.615702+0000 mgr.gibba043.dnkmem (mgr.34373) 1896 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:15 gibba003 bash[32348]: cluster 2021-03-10T14:26:14.615702+0000 mgr.gibba043.dnkmem (mgr.34373) 1896 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:15 gibba043 bash[24019]: cluster 2021-03-10T14:26:14.615702+0000 mgr.gibba043.dnkmem (mgr.34373) 1896 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:17.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:16 gibba043 bash[24019]: cephadm 2021-03-10T14:26:15.380656+0000 mgr.gibba043.dnkmem (mgr.34373) 1897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:16 gibba003 bash[31385]: cephadm 2021-03-10T14:26:15.380656+0000 mgr.gibba043.dnkmem (mgr.34373) 1897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:17.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:16 gibba003 bash[32348]: cephadm 2021-03-10T14:26:15.380656+0000 mgr.gibba043.dnkmem (mgr.34373) 1897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:17 gibba043 bash[24019]: cluster 2021-03-10T14:26:16.617263+0000 mgr.gibba043.dnkmem (mgr.34373) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:17 gibba003 bash[31385]: cluster 2021-03-10T14:26:16.617263+0000 mgr.gibba043.dnkmem (mgr.34373) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:17 gibba003 bash[32348]: cluster 2021-03-10T14:26:16.617263+0000 mgr.gibba043.dnkmem (mgr.34373) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:19 gibba043 bash[24019]: cluster 2021-03-10T14:26:18.618790+0000 mgr.gibba043.dnkmem (mgr.34373) 1899 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:19 gibba003 bash[31385]: cluster 2021-03-10T14:26:18.618790+0000 mgr.gibba043.dnkmem (mgr.34373) 1899 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:19 gibba003 bash[32348]: cluster 2021-03-10T14:26:18.618790+0000 mgr.gibba043.dnkmem (mgr.34373) 1899 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:21.532 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:26:21.764 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:26:21.765 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (34m) 21s ago 40m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:26:21.765 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (39m) 9m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:26:21.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:26:21.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:26:21.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (34m) 21s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:26:21.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (34m) 21s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:26:21.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:26:21.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (33m) 21s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:26:21.766 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (40m) 21s ago 40m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:26:21.767 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:26:21.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (33m) 21s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:26:21.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (32m) 21s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:26:21.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (32m) 21s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:26:21.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (31m) 21s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:26:21.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:26:21.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:26:21.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:26:21.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:26:21.768 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (39m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:26:21.769 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 21s ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:26:22.011 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:26:22.012 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:26:22.012 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:22.012 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:26:22.012 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:26:22.013 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:22.013 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:26:22.013 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:26:22.013 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:26:22.014 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:26:22.014 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:26:22.014 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:26:22.014 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:26:22.015 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:26:22.015 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:26:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:21 gibba043 bash[24019]: cluster 2021-03-10T14:26:20.620274+0000 mgr.gibba043.dnkmem (mgr.34373) 1900 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:21 gibba003 bash[31385]: cluster 2021-03-10T14:26:20.620274+0000 mgr.gibba043.dnkmem (mgr.34373) 1900 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:21 gibba003 bash[32348]: cluster 2021-03-10T14:26:20.620274+0000 mgr.gibba043.dnkmem (mgr.34373) 1900 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:23.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:22 gibba043 bash[24019]: audit 2021-03-10T14:26:21.522868+0000 mgr.gibba043.dnkmem (mgr.34373) 1901 : audit [DBG] from='client.55318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:23.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:22 gibba043 bash[24019]: audit 2021-03-10T14:26:21.751656+0000 mgr.gibba043.dnkmem (mgr.34373) 1902 : audit [DBG] from='client.55324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:23.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:22 gibba043 bash[24019]: audit 2021-03-10T14:26:22.012787+0000 mon.a (mon.0) 741 : audit [DBG] from='client.? 172.21.2.103:0/2489883740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:22 gibba003 bash[31385]: audit 2021-03-10T14:26:21.522868+0000 mgr.gibba043.dnkmem (mgr.34373) 1901 : audit [DBG] from='client.55318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:22 gibba003 bash[31385]: audit 2021-03-10T14:26:21.751656+0000 mgr.gibba043.dnkmem (mgr.34373) 1902 : audit [DBG] from='client.55324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:22 gibba003 bash[31385]: audit 2021-03-10T14:26:22.012787+0000 mon.a (mon.0) 741 : audit [DBG] from='client.? 172.21.2.103:0/2489883740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:22 gibba003 bash[32348]: audit 2021-03-10T14:26:21.522868+0000 mgr.gibba043.dnkmem (mgr.34373) 1901 : audit [DBG] from='client.55318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:22 gibba003 bash[32348]: audit 2021-03-10T14:26:21.751656+0000 mgr.gibba043.dnkmem (mgr.34373) 1902 : audit [DBG] from='client.55324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:22 gibba003 bash[32348]: audit 2021-03-10T14:26:22.012787+0000 mon.a (mon.0) 741 : audit [DBG] from='client.? 172.21.2.103:0/2489883740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:23 gibba043 bash[24019]: cluster 2021-03-10T14:26:22.621974+0000 mgr.gibba043.dnkmem (mgr.34373) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:23 gibba003 bash[31385]: cluster 2021-03-10T14:26:22.621974+0000 mgr.gibba043.dnkmem (mgr.34373) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:23 gibba003 bash[32348]: cluster 2021-03-10T14:26:22.621974+0000 mgr.gibba043.dnkmem (mgr.34373) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:25 gibba043 bash[24019]: cluster 2021-03-10T14:26:24.623550+0000 mgr.gibba043.dnkmem (mgr.34373) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:25 gibba003 bash[31385]: cluster 2021-03-10T14:26:24.623550+0000 mgr.gibba043.dnkmem (mgr.34373) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:26.260 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:25 gibba003 bash[32348]: cluster 2021-03-10T14:26:24.623550+0000 mgr.gibba043.dnkmem (mgr.34373) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:27 gibba043 bash[24019]: cluster 2021-03-10T14:26:26.625252+0000 mgr.gibba043.dnkmem (mgr.34373) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:27 gibba003 bash[31385]: cluster 2021-03-10T14:26:26.625252+0000 mgr.gibba043.dnkmem (mgr.34373) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:27 gibba003 bash[32348]: cluster 2021-03-10T14:26:26.625252+0000 mgr.gibba043.dnkmem (mgr.34373) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:29 gibba043 bash[24019]: cluster 2021-03-10T14:26:28.626771+0000 mgr.gibba043.dnkmem (mgr.34373) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:29 gibba003 bash[31385]: cluster 2021-03-10T14:26:28.626771+0000 mgr.gibba043.dnkmem (mgr.34373) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:29 gibba003 bash[32348]: cluster 2021-03-10T14:26:28.626771+0000 mgr.gibba043.dnkmem (mgr.34373) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:32.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:31 gibba043 bash[24019]: cephadm 2021-03-10T14:26:30.396758+0000 mgr.gibba043.dnkmem (mgr.34373) 1907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:32.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:31 gibba043 bash[24019]: cluster 2021-03-10T14:26:30.628386+0000 mgr.gibba043.dnkmem (mgr.34373) 1908 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:31 gibba003 bash[31385]: cephadm 2021-03-10T14:26:30.396758+0000 mgr.gibba043.dnkmem (mgr.34373) 1907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:31 gibba003 bash[31385]: cluster 2021-03-10T14:26:30.628386+0000 mgr.gibba043.dnkmem (mgr.34373) 1908 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:31 gibba003 bash[32348]: cephadm 2021-03-10T14:26:30.396758+0000 mgr.gibba043.dnkmem (mgr.34373) 1907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:31 gibba003 bash[32348]: cluster 2021-03-10T14:26:30.628386+0000 mgr.gibba043.dnkmem (mgr.34373) 1908 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:33 gibba003 bash[31385]: cluster 2021-03-10T14:26:32.630047+0000 mgr.gibba043.dnkmem (mgr.34373) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:33 gibba003 bash[32348]: cluster 2021-03-10T14:26:32.630047+0000 mgr.gibba043.dnkmem (mgr.34373) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:33 gibba043 bash[24019]: cluster 2021-03-10T14:26:32.630047+0000 mgr.gibba043.dnkmem (mgr.34373) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:35 gibba043 bash[24019]: cluster 2021-03-10T14:26:34.630854+0000 mgr.gibba043.dnkmem (mgr.34373) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:35 gibba003 bash[31385]: cluster 2021-03-10T14:26:34.630854+0000 mgr.gibba043.dnkmem (mgr.34373) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:35 gibba003 bash[32348]: cluster 2021-03-10T14:26:34.630854+0000 mgr.gibba043.dnkmem (mgr.34373) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:37 gibba043 bash[24019]: cluster 2021-03-10T14:26:36.632300+0000 mgr.gibba043.dnkmem (mgr.34373) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:37 gibba003 bash[31385]: cluster 2021-03-10T14:26:36.632300+0000 mgr.gibba043.dnkmem (mgr.34373) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:37 gibba003 bash[32348]: cluster 2021-03-10T14:26:36.632300+0000 mgr.gibba043.dnkmem (mgr.34373) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:39 gibba043 bash[24019]: cluster 2021-03-10T14:26:38.633761+0000 mgr.gibba043.dnkmem (mgr.34373) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:39 gibba003 bash[31385]: cluster 2021-03-10T14:26:38.633761+0000 mgr.gibba043.dnkmem (mgr.34373) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:39 gibba003 bash[32348]: cluster 2021-03-10T14:26:38.633761+0000 mgr.gibba043.dnkmem (mgr.34373) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:42.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:41 gibba043 bash[24019]: cluster 2021-03-10T14:26:40.635325+0000 mgr.gibba043.dnkmem (mgr.34373) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:41 gibba003 bash[31385]: cluster 2021-03-10T14:26:40.635325+0000 mgr.gibba043.dnkmem (mgr.34373) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:42.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:41 gibba003 bash[32348]: cluster 2021-03-10T14:26:40.635325+0000 mgr.gibba043.dnkmem (mgr.34373) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:43 gibba003 bash[31385]: cluster 2021-03-10T14:26:42.636151+0000 mgr.gibba043.dnkmem (mgr.34373) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:43 gibba003 bash[32348]: cluster 2021-03-10T14:26:42.636151+0000 mgr.gibba043.dnkmem (mgr.34373) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:43 gibba043 bash[24019]: cluster 2021-03-10T14:26:42.636151+0000 mgr.gibba043.dnkmem (mgr.34373) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:45 gibba043 bash[24019]: cluster 2021-03-10T14:26:44.637553+0000 mgr.gibba043.dnkmem (mgr.34373) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:45 gibba003 bash[31385]: cluster 2021-03-10T14:26:44.637553+0000 mgr.gibba043.dnkmem (mgr.34373) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:45 gibba003 bash[32348]: cluster 2021-03-10T14:26:44.637553+0000 mgr.gibba043.dnkmem (mgr.34373) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:46 gibba043 bash[24019]: cephadm 2021-03-10T14:26:45.412618+0000 mgr.gibba043.dnkmem (mgr.34373) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:46 gibba003 bash[31385]: cephadm 2021-03-10T14:26:45.412618+0000 mgr.gibba043.dnkmem (mgr.34373) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:47.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:46 gibba003 bash[32348]: cephadm 2021-03-10T14:26:45.412618+0000 mgr.gibba043.dnkmem (mgr.34373) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:26:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:47 gibba043 bash[24019]: cluster 2021-03-10T14:26:46.639276+0000 mgr.gibba043.dnkmem (mgr.34373) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:47 gibba003 bash[31385]: cluster 2021-03-10T14:26:46.639276+0000 mgr.gibba043.dnkmem (mgr.34373) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:47 gibba003 bash[32348]: cluster 2021-03-10T14:26:46.639276+0000 mgr.gibba043.dnkmem (mgr.34373) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:49 gibba043 bash[24019]: cluster 2021-03-10T14:26:48.640065+0000 mgr.gibba043.dnkmem (mgr.34373) 1918 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:49 gibba003 bash[31385]: cluster 2021-03-10T14:26:48.640065+0000 mgr.gibba043.dnkmem (mgr.34373) 1918 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:49 gibba003 bash[32348]: cluster 2021-03-10T14:26:48.640065+0000 mgr.gibba043.dnkmem (mgr.34373) 1918 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:51 gibba043 bash[24019]: cluster 2021-03-10T14:26:50.641460+0000 mgr.gibba043.dnkmem (mgr.34373) 1919 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:52.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:51 gibba003 bash[31385]: cluster 2021-03-10T14:26:50.641460+0000 mgr.gibba043.dnkmem (mgr.34373) 1919 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:51 gibba003 bash[32348]: cluster 2021-03-10T14:26:50.641460+0000 mgr.gibba043.dnkmem (mgr.34373) 1919 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:52.263 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:26:52.519 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:26:52.519 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (35m) 52s ago 40m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:26:52.520 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (40m) 10m ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:26:52.520 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (35m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:26:52.520 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (35m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:26:52.520 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (34m) 52s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:26:52.521 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (34m) 52s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:26:52.521 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (34m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:26:52.521 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (34m) 52s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:26:52.521 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (40m) 52s ago 40m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:26:52.522 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (40m) 10m ago 40m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:26:52.522 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (33m) 52s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:26:52.522 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (33m) 52s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:26:52.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (32m) 52s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:26:52.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (32m) 52s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:26:52.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (31m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:26:52.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:26:52.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (30m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:26:52.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (30m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:26:52.524 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (40m) 10m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:26:52.524 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 52s ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:26:52.768 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:26:52.769 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:26:52.769 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:52.769 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:26:52.770 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:26:52.770 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:52.770 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:26:52.770 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:26:52.770 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:26:52.771 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:26:52.771 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:26:52.771 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:26:52.771 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:26:52.772 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:26:52.772 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:26:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[31385]: audit 2021-03-10T14:26:52.252989+0000 mgr.gibba043.dnkmem (mgr.34373) 1920 : audit [DBG] from='client.55336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[31385]: audit 2021-03-10T14:26:52.476898+0000 mgr.gibba043.dnkmem (mgr.34373) 1921 : audit [DBG] from='client.55342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[31385]: cluster 2021-03-10T14:26:52.642385+0000 mgr.gibba043.dnkmem (mgr.34373) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[31385]: audit 2021-03-10T14:26:52.769687+0000 mon.a (mon.0) 742 : audit [DBG] from='client.? 172.21.2.103:0/2739257327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[32348]: audit 2021-03-10T14:26:52.252989+0000 mgr.gibba043.dnkmem (mgr.34373) 1920 : audit [DBG] from='client.55336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[32348]: audit 2021-03-10T14:26:52.476898+0000 mgr.gibba043.dnkmem (mgr.34373) 1921 : audit [DBG] from='client.55342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:53.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[32348]: cluster 2021-03-10T14:26:52.642385+0000 mgr.gibba043.dnkmem (mgr.34373) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:53 gibba003 bash[32348]: audit 2021-03-10T14:26:52.769687+0000 mon.a (mon.0) 742 : audit [DBG] from='client.? 172.21.2.103:0/2739257327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:53 gibba043 bash[24019]: audit 2021-03-10T14:26:52.252989+0000 mgr.gibba043.dnkmem (mgr.34373) 1920 : audit [DBG] from='client.55336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:53 gibba043 bash[24019]: audit 2021-03-10T14:26:52.476898+0000 mgr.gibba043.dnkmem (mgr.34373) 1921 : audit [DBG] from='client.55342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:53 gibba043 bash[24019]: cluster 2021-03-10T14:26:52.642385+0000 mgr.gibba043.dnkmem (mgr.34373) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:53 gibba043 bash[24019]: audit 2021-03-10T14:26:52.769687+0000 mon.a (mon.0) 742 : audit [DBG] from='client.? 172.21.2.103:0/2739257327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:55 gibba043 bash[24019]: cluster 2021-03-10T14:26:54.643884+0000 mgr.gibba043.dnkmem (mgr.34373) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:55 gibba003 bash[31385]: cluster 2021-03-10T14:26:54.643884+0000 mgr.gibba043.dnkmem (mgr.34373) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:55 gibba003 bash[32348]: cluster 2021-03-10T14:26:54.643884+0000 mgr.gibba043.dnkmem (mgr.34373) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:57 gibba043 bash[24019]: cluster 2021-03-10T14:26:56.645599+0000 mgr.gibba043.dnkmem (mgr.34373) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:57 gibba003 bash[31385]: cluster 2021-03-10T14:26:56.645599+0000 mgr.gibba043.dnkmem (mgr.34373) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:57 gibba003 bash[32348]: cluster 2021-03-10T14:26:56.645599+0000 mgr.gibba043.dnkmem (mgr.34373) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:26:59 gibba043 bash[24019]: cluster 2021-03-10T14:26:58.647267+0000 mgr.gibba043.dnkmem (mgr.34373) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:26:59 gibba003 bash[31385]: cluster 2021-03-10T14:26:58.647267+0000 mgr.gibba043.dnkmem (mgr.34373) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:26:59 gibba003 bash[32348]: cluster 2021-03-10T14:26:58.647267+0000 mgr.gibba043.dnkmem (mgr.34373) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:00 gibba043 bash[24019]: audit 2021-03-10T14:27:00.433771+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:27:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:00 gibba003 bash[31385]: audit 2021-03-10T14:27:00.433771+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:27:01.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:00 gibba003 bash[32348]: audit 2021-03-10T14:27:00.433771+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:27:02.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:01 gibba043 bash[24019]: cephadm 2021-03-10T14:27:00.429435+0000 mgr.gibba043.dnkmem (mgr.34373) 1926 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:27:02.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:01 gibba043 bash[24019]: cluster 2021-03-10T14:27:00.648071+0000 mgr.gibba043.dnkmem (mgr.34373) 1927 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:01 gibba003 bash[31385]: cephadm 2021-03-10T14:27:00.429435+0000 mgr.gibba043.dnkmem (mgr.34373) 1926 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:27:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:01 gibba003 bash[31385]: cluster 2021-03-10T14:27:00.648071+0000 mgr.gibba043.dnkmem (mgr.34373) 1927 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:01 gibba003 bash[32348]: cephadm 2021-03-10T14:27:00.429435+0000 mgr.gibba043.dnkmem (mgr.34373) 1926 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:27:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:01 gibba003 bash[32348]: cluster 2021-03-10T14:27:00.648071+0000 mgr.gibba043.dnkmem (mgr.34373) 1927 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:03 gibba003 bash[31385]: cluster 2021-03-10T14:27:02.648843+0000 mgr.gibba043.dnkmem (mgr.34373) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:03 gibba003 bash[32348]: cluster 2021-03-10T14:27:02.648843+0000 mgr.gibba043.dnkmem (mgr.34373) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:03 gibba043 bash[24019]: cluster 2021-03-10T14:27:02.648843+0000 mgr.gibba043.dnkmem (mgr.34373) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.121663+0000 mgr.gibba043.dnkmem (mgr.34373) 1929 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:27:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.122801+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:27:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.314638+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:27:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.315145+0000 mgr.gibba043.dnkmem (mgr.34373) 1930 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.317042+0000 mgr.gibba043.dnkmem (mgr.34373) 1931 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.318250+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.318669+0000 mgr.gibba043.dnkmem (mgr.34373) 1932 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.318764+0000 mgr.gibba043.dnkmem (mgr.34373) 1933 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:05.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.320159+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.320246+0000 mgr.gibba043.dnkmem (mgr.34373) 1934 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:05.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.320308+0000 mgr.gibba043.dnkmem (mgr.34373) 1935 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:05.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.321497+0000 mgr.gibba043.dnkmem (mgr.34373) 1936 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:05.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.321723+0000 mon.c (mon.1) 544 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.323020+0000 mon.c (mon.1) 545 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.323287+0000 mgr.gibba043.dnkmem (mgr.34373) 1937 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.323344+0000 mgr.gibba043.dnkmem (mgr.34373) 1938 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.324729+0000 mgr.gibba043.dnkmem (mgr.34373) 1939 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:05.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.325131+0000 mgr.gibba043.dnkmem (mgr.34373) 1940 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:05.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.326232+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.326326+0000 mgr.gibba043.dnkmem (mgr.34373) 1941 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:05.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.326395+0000 mgr.gibba043.dnkmem (mgr.34373) 1942 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:05.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.121663+0000 mgr.gibba043.dnkmem (mgr.34373) 1929 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:27:05.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.122801+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:27:05.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.314638+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:27:05.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.315145+0000 mgr.gibba043.dnkmem (mgr.34373) 1930 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:05.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.317042+0000 mgr.gibba043.dnkmem (mgr.34373) 1931 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.318250+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.318669+0000 mgr.gibba043.dnkmem (mgr.34373) 1932 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.318764+0000 mgr.gibba043.dnkmem (mgr.34373) 1933 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:05.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.320159+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.320246+0000 mgr.gibba043.dnkmem (mgr.34373) 1934 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:05.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.320308+0000 mgr.gibba043.dnkmem (mgr.34373) 1935 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:05.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.321497+0000 mgr.gibba043.dnkmem (mgr.34373) 1936 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:05.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.321723+0000 mon.c (mon.1) 544 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.323020+0000 mon.c (mon.1) 545 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.323287+0000 mgr.gibba043.dnkmem (mgr.34373) 1937 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:05.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.323344+0000 mgr.gibba043.dnkmem (mgr.34373) 1938 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:05.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.324729+0000 mgr.gibba043.dnkmem (mgr.34373) 1939 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:05.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.325131+0000 mgr.gibba043.dnkmem (mgr.34373) 1940 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:05.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.326232+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.326326+0000 mgr.gibba043.dnkmem (mgr.34373) 1941 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:05.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.326395+0000 mgr.gibba043.dnkmem (mgr.34373) 1942 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:05.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cephadm 2021-03-10T14:27:04.326507+0000 mgr.gibba043.dnkmem (mgr.34373) 1943 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:05.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: audit 2021-03-10T14:27:04.327862+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[32348]: cluster 2021-03-10T14:27:04.650139+0000 mgr.gibba043.dnkmem (mgr.34373) 1944 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cephadm 2021-03-10T14:27:04.326507+0000 mgr.gibba043.dnkmem (mgr.34373) 1943 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:05.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: audit 2021-03-10T14:27:04.327862+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:05 gibba003 bash[31385]: cluster 2021-03-10T14:27:04.650139+0000 mgr.gibba043.dnkmem (mgr.34373) 1944 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.121663+0000 mgr.gibba043.dnkmem (mgr.34373) 1929 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:27:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.122801+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:27:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.314638+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:27:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.315145+0000 mgr.gibba043.dnkmem (mgr.34373) 1930 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.317042+0000 mgr.gibba043.dnkmem (mgr.34373) 1931 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.318250+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.318669+0000 mgr.gibba043.dnkmem (mgr.34373) 1932 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.318764+0000 mgr.gibba043.dnkmem (mgr.34373) 1933 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.320159+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.320246+0000 mgr.gibba043.dnkmem (mgr.34373) 1934 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:05.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.320308+0000 mgr.gibba043.dnkmem (mgr.34373) 1935 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:05.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.321497+0000 mgr.gibba043.dnkmem (mgr.34373) 1936 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:05.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.321723+0000 mon.c (mon.1) 544 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.323020+0000 mon.c (mon.1) 545 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.323287+0000 mgr.gibba043.dnkmem (mgr.34373) 1937 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:05.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.323344+0000 mgr.gibba043.dnkmem (mgr.34373) 1938 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:05.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.324729+0000 mgr.gibba043.dnkmem (mgr.34373) 1939 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:05.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.325131+0000 mgr.gibba043.dnkmem (mgr.34373) 1940 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:05.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.326232+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.326326+0000 mgr.gibba043.dnkmem (mgr.34373) 1941 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:05.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.326395+0000 mgr.gibba043.dnkmem (mgr.34373) 1942 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:05.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cephadm 2021-03-10T14:27:04.326507+0000 mgr.gibba043.dnkmem (mgr.34373) 1943 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:05.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: audit 2021-03-10T14:27:04.327862+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:05.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:05 gibba043 bash[24019]: cluster 2021-03-10T14:27:04.650139+0000 mgr.gibba043.dnkmem (mgr.34373) 1944 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:07 gibba043 bash[24019]: cluster 2021-03-10T14:27:06.650847+0000 mgr.gibba043.dnkmem (mgr.34373) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:07 gibba003 bash[31385]: cluster 2021-03-10T14:27:06.650847+0000 mgr.gibba043.dnkmem (mgr.34373) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:07 gibba003 bash[32348]: cluster 2021-03-10T14:27:06.650847+0000 mgr.gibba043.dnkmem (mgr.34373) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:09 gibba043 bash[24019]: cluster 2021-03-10T14:27:08.652369+0000 mgr.gibba043.dnkmem (mgr.34373) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:09 gibba003 bash[31385]: cluster 2021-03-10T14:27:08.652369+0000 mgr.gibba043.dnkmem (mgr.34373) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:09 gibba003 bash[32348]: cluster 2021-03-10T14:27:08.652369+0000 mgr.gibba043.dnkmem (mgr.34373) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:11 gibba043 bash[24019]: cluster 2021-03-10T14:27:10.654009+0000 mgr.gibba043.dnkmem (mgr.34373) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:11 gibba003 bash[31385]: cluster 2021-03-10T14:27:10.654009+0000 mgr.gibba043.dnkmem (mgr.34373) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:11 gibba003 bash[32348]: cluster 2021-03-10T14:27:10.654009+0000 mgr.gibba043.dnkmem (mgr.34373) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: cluster 2021-03-10T14:27:12.655393+0000 mgr.gibba043.dnkmem (mgr.34373) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.910325+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:27:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.911111+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.911536+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:27:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.911789+0000 mon.c (mon.1) 550 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.912766+0000 mon.c (mon.1) 551 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:27:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.913189+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.914417+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.915278+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:27:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.946799+0000 mon.c (mon.1) 552 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:12.947919+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:13.005055+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[31385]: audit 2021-03-10T14:27:13.006177+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: cluster 2021-03-10T14:27:12.655393+0000 mgr.gibba043.dnkmem (mgr.34373) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.910325+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:27:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.911111+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.911536+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:27:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.911789+0000 mon.c (mon.1) 550 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.912766+0000 mon.c (mon.1) 551 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:27:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.913189+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.914417+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:27:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.915278+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:27:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.946799+0000 mon.c (mon.1) 552 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:12.947919+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:13.005055+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:13 gibba003 bash[32348]: audit 2021-03-10T14:27:13.006177+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: cluster 2021-03-10T14:27:12.655393+0000 mgr.gibba043.dnkmem (mgr.34373) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.910325+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:27:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.911111+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:27:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.911536+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:27:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.911789+0000 mon.c (mon.1) 550 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:27:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.912766+0000 mon.c (mon.1) 551 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:27:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.913189+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:27:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.914417+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:27:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.915278+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:27:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.946799+0000 mon.c (mon.1) 552 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:12.947919+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:13.005055+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:13 gibba043 bash[24019]: audit 2021-03-10T14:27:13.006177+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:15 gibba043 bash[24019]: cluster 2021-03-10T14:27:14.656876+0000 mgr.gibba043.dnkmem (mgr.34373) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:15 gibba003 bash[31385]: cluster 2021-03-10T14:27:14.656876+0000 mgr.gibba043.dnkmem (mgr.34373) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:15 gibba003 bash[32348]: cluster 2021-03-10T14:27:14.656876+0000 mgr.gibba043.dnkmem (mgr.34373) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:17 gibba043 bash[24019]: cluster 2021-03-10T14:27:16.658653+0000 mgr.gibba043.dnkmem (mgr.34373) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:17 gibba003 bash[31385]: cluster 2021-03-10T14:27:16.658653+0000 mgr.gibba043.dnkmem (mgr.34373) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:17 gibba003 bash[32348]: cluster 2021-03-10T14:27:16.658653+0000 mgr.gibba043.dnkmem (mgr.34373) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:19 gibba043 bash[24019]: cluster 2021-03-10T14:27:18.659480+0000 mgr.gibba043.dnkmem (mgr.34373) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:19 gibba003 bash[31385]: cluster 2021-03-10T14:27:18.659480+0000 mgr.gibba043.dnkmem (mgr.34373) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:19 gibba003 bash[32348]: cluster 2021-03-10T14:27:18.659480+0000 mgr.gibba043.dnkmem (mgr.34373) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:21.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:20 gibba043 bash[24019]: cephadm 2021-03-10T14:27:19.328658+0000 mgr.gibba043.dnkmem (mgr.34373) 1952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:20 gibba003 bash[31385]: cephadm 2021-03-10T14:27:19.328658+0000 mgr.gibba043.dnkmem (mgr.34373) 1952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:21.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:20 gibba003 bash[32348]: cephadm 2021-03-10T14:27:19.328658+0000 mgr.gibba043.dnkmem (mgr.34373) 1952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:21 gibba043 bash[24019]: cluster 2021-03-10T14:27:20.661003+0000 mgr.gibba043.dnkmem (mgr.34373) 1953 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:21 gibba003 bash[31385]: cluster 2021-03-10T14:27:20.661003+0000 mgr.gibba043.dnkmem (mgr.34373) 1953 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:21 gibba003 bash[32348]: cluster 2021-03-10T14:27:20.661003+0000 mgr.gibba043.dnkmem (mgr.34373) 1953 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.013 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:27:23.242 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:27:23.242 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (35m) 83s ago 41m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:27:23.242 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (40m) 19s ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:27:23.243 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (36m) 19s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:27:23.243 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (36m) 19s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:27:23.243 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (35m) 83s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:27:23.243 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (35m) 83s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:27:23.244 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (34m) 19s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:27:23.244 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (35m) 83s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:27:23.244 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (41m) 83s ago 41m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:27:23.244 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (41m) 19s ago 41m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:27:23.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (34m) 83s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:27:23.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (33m) 83s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:27:23.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (33m) 83s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:27:23.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (32m) 83s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:27:23.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (32m) 19s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:27:23.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (31m) 19s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:27:23.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (31m) 19s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:27:23.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (31m) 19s ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:27:23.246 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (40m) 19s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:27:23.247 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 83s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:27:23.490 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:27:23.491 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:27:23.491 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:23.491 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:27:23.492 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:27:23.492 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:23.492 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:27:23.492 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:27:23.492 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:27:23.493 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:27:23.493 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:27:23.493 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:27:23.493 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:27:23.494 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:27:23.494 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:27:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:23 gibba003 bash[31385]: cluster 2021-03-10T14:27:22.662455+0000 mgr.gibba043.dnkmem (mgr.34373) 1954 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:23 gibba003 bash[31385]: audit 2021-03-10T14:27:23.491849+0000 mon.a (mon.0) 751 : audit [DBG] from='client.? 172.21.2.103:0/2013487033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:23 gibba003 bash[32348]: cluster 2021-03-10T14:27:22.662455+0000 mgr.gibba043.dnkmem (mgr.34373) 1954 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:23 gibba003 bash[32348]: audit 2021-03-10T14:27:23.491849+0000 mon.a (mon.0) 751 : audit [DBG] from='client.? 172.21.2.103:0/2013487033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:23 gibba043 bash[24019]: cluster 2021-03-10T14:27:22.662455+0000 mgr.gibba043.dnkmem (mgr.34373) 1954 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:24.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:23 gibba043 bash[24019]: audit 2021-03-10T14:27:23.491849+0000 mon.a (mon.0) 751 : audit [DBG] from='client.? 172.21.2.103:0/2013487033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:24.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:24 gibba003 bash[31385]: audit 2021-03-10T14:27:23.003718+0000 mgr.gibba043.dnkmem (mgr.34373) 1955 : audit [DBG] from='client.45369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:24.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:24 gibba003 bash[31385]: audit 2021-03-10T14:27:23.229011+0000 mgr.gibba043.dnkmem (mgr.34373) 1956 : audit [DBG] from='client.55360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:24.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:24 gibba003 bash[32348]: audit 2021-03-10T14:27:23.003718+0000 mgr.gibba043.dnkmem (mgr.34373) 1955 : audit [DBG] from='client.45369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:24.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:24 gibba003 bash[32348]: audit 2021-03-10T14:27:23.229011+0000 mgr.gibba043.dnkmem (mgr.34373) 1956 : audit [DBG] from='client.55360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:24 gibba043 bash[24019]: audit 2021-03-10T14:27:23.003718+0000 mgr.gibba043.dnkmem (mgr.34373) 1955 : audit [DBG] from='client.45369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:24 gibba043 bash[24019]: audit 2021-03-10T14:27:23.229011+0000 mgr.gibba043.dnkmem (mgr.34373) 1956 : audit [DBG] from='client.55360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:25 gibba003 bash[31385]: cluster 2021-03-10T14:27:24.663873+0000 mgr.gibba043.dnkmem (mgr.34373) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:25 gibba003 bash[32348]: cluster 2021-03-10T14:27:24.663873+0000 mgr.gibba043.dnkmem (mgr.34373) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:25 gibba043 bash[24019]: cluster 2021-03-10T14:27:24.663873+0000 mgr.gibba043.dnkmem (mgr.34373) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:27 gibba043 bash[24019]: cluster 2021-03-10T14:27:26.665629+0000 mgr.gibba043.dnkmem (mgr.34373) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:27 gibba003 bash[31385]: cluster 2021-03-10T14:27:26.665629+0000 mgr.gibba043.dnkmem (mgr.34373) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:27 gibba003 bash[32348]: cluster 2021-03-10T14:27:26.665629+0000 mgr.gibba043.dnkmem (mgr.34373) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:29 gibba043 bash[24019]: cluster 2021-03-10T14:27:28.667248+0000 mgr.gibba043.dnkmem (mgr.34373) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:29 gibba003 bash[31385]: cluster 2021-03-10T14:27:28.667248+0000 mgr.gibba043.dnkmem (mgr.34373) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:29 gibba003 bash[32348]: cluster 2021-03-10T14:27:28.667248+0000 mgr.gibba043.dnkmem (mgr.34373) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:31 gibba043 bash[24019]: cluster 2021-03-10T14:27:30.668217+0000 mgr.gibba043.dnkmem (mgr.34373) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:31 gibba003 bash[31385]: cluster 2021-03-10T14:27:30.668217+0000 mgr.gibba043.dnkmem (mgr.34373) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:31 gibba003 bash[32348]: cluster 2021-03-10T14:27:30.668217+0000 mgr.gibba043.dnkmem (mgr.34373) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:33 gibba003 bash[31385]: cluster 2021-03-10T14:27:32.668896+0000 mgr.gibba043.dnkmem (mgr.34373) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:33 gibba003 bash[32348]: cluster 2021-03-10T14:27:32.668896+0000 mgr.gibba043.dnkmem (mgr.34373) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:33 gibba043 bash[24019]: cluster 2021-03-10T14:27:32.668896+0000 mgr.gibba043.dnkmem (mgr.34373) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:36.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:35 gibba043 bash[24019]: cephadm 2021-03-10T14:27:34.344346+0000 mgr.gibba043.dnkmem (mgr.34373) 1962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:36.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:35 gibba043 bash[24019]: cluster 2021-03-10T14:27:34.670020+0000 mgr.gibba043.dnkmem (mgr.34373) 1963 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:35 gibba003 bash[31385]: cephadm 2021-03-10T14:27:34.344346+0000 mgr.gibba043.dnkmem (mgr.34373) 1962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:35 gibba003 bash[31385]: cluster 2021-03-10T14:27:34.670020+0000 mgr.gibba043.dnkmem (mgr.34373) 1963 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:35 gibba003 bash[32348]: cephadm 2021-03-10T14:27:34.344346+0000 mgr.gibba043.dnkmem (mgr.34373) 1962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:35 gibba003 bash[32348]: cluster 2021-03-10T14:27:34.670020+0000 mgr.gibba043.dnkmem (mgr.34373) 1963 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:37 gibba043 bash[24019]: cluster 2021-03-10T14:27:36.671576+0000 mgr.gibba043.dnkmem (mgr.34373) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:37 gibba003 bash[31385]: cluster 2021-03-10T14:27:36.671576+0000 mgr.gibba043.dnkmem (mgr.34373) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:37 gibba003 bash[32348]: cluster 2021-03-10T14:27:36.671576+0000 mgr.gibba043.dnkmem (mgr.34373) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:39 gibba043 bash[24019]: cluster 2021-03-10T14:27:38.673325+0000 mgr.gibba043.dnkmem (mgr.34373) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:39 gibba003 bash[31385]: cluster 2021-03-10T14:27:38.673325+0000 mgr.gibba043.dnkmem (mgr.34373) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:39 gibba003 bash[32348]: cluster 2021-03-10T14:27:38.673325+0000 mgr.gibba043.dnkmem (mgr.34373) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:41 gibba043 bash[24019]: cluster 2021-03-10T14:27:40.675039+0000 mgr.gibba043.dnkmem (mgr.34373) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:41 gibba003 bash[31385]: cluster 2021-03-10T14:27:40.675039+0000 mgr.gibba043.dnkmem (mgr.34373) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:42.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:41 gibba003 bash[32348]: cluster 2021-03-10T14:27:40.675039+0000 mgr.gibba043.dnkmem (mgr.34373) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:43 gibba003 bash[31385]: cluster 2021-03-10T14:27:42.675882+0000 mgr.gibba043.dnkmem (mgr.34373) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:43 gibba003 bash[32348]: cluster 2021-03-10T14:27:42.675882+0000 mgr.gibba043.dnkmem (mgr.34373) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:43 gibba043 bash[24019]: cluster 2021-03-10T14:27:42.675882+0000 mgr.gibba043.dnkmem (mgr.34373) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:45 gibba043 bash[24019]: cluster 2021-03-10T14:27:44.677326+0000 mgr.gibba043.dnkmem (mgr.34373) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:45 gibba003 bash[31385]: cluster 2021-03-10T14:27:44.677326+0000 mgr.gibba043.dnkmem (mgr.34373) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:45 gibba003 bash[32348]: cluster 2021-03-10T14:27:44.677326+0000 mgr.gibba043.dnkmem (mgr.34373) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:47 gibba043 bash[24019]: cluster 2021-03-10T14:27:46.678936+0000 mgr.gibba043.dnkmem (mgr.34373) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:47 gibba003 bash[31385]: cluster 2021-03-10T14:27:46.678936+0000 mgr.gibba043.dnkmem (mgr.34373) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:47 gibba003 bash[32348]: cluster 2021-03-10T14:27:46.678936+0000 mgr.gibba043.dnkmem (mgr.34373) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:49 gibba043 bash[24019]: cluster 2021-03-10T14:27:48.679959+0000 mgr.gibba043.dnkmem (mgr.34373) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:49 gibba003 bash[31385]: cluster 2021-03-10T14:27:48.679959+0000 mgr.gibba043.dnkmem (mgr.34373) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:49 gibba003 bash[32348]: cluster 2021-03-10T14:27:48.679959+0000 mgr.gibba043.dnkmem (mgr.34373) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:51.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:50 gibba043 bash[24019]: cephadm 2021-03-10T14:27:49.360303+0000 mgr.gibba043.dnkmem (mgr.34373) 1971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:50 gibba003 bash[31385]: cephadm 2021-03-10T14:27:49.360303+0000 mgr.gibba043.dnkmem (mgr.34373) 1971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:51.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:50 gibba003 bash[32348]: cephadm 2021-03-10T14:27:49.360303+0000 mgr.gibba043.dnkmem (mgr.34373) 1971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:27:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:51 gibba003 bash[31385]: cluster 2021-03-10T14:27:50.681186+0000 mgr.gibba043.dnkmem (mgr.34373) 1972 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:51 gibba003 bash[32348]: cluster 2021-03-10T14:27:50.681186+0000 mgr.gibba043.dnkmem (mgr.34373) 1972 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:52.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:51 gibba043 bash[24019]: cluster 2021-03-10T14:27:50.681186+0000 mgr.gibba043.dnkmem (mgr.34373) 1972 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.735 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:27:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:53 gibba003 bash[31385]: cluster 2021-03-10T14:27:52.682037+0000 mgr.gibba043.dnkmem (mgr.34373) 1973 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:53 gibba003 bash[32348]: cluster 2021-03-10T14:27:52.682037+0000 mgr.gibba043.dnkmem (mgr.34373) 1973 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.964 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:27:53.965 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (36m) 113s ago 41m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:27:53.965 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (41m) 49s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:27:53.965 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (36m) 49s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:27:53.965 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (36m) 49s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:27:53.966 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (35m) 113s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:27:53.966 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (35m) 113s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:27:53.966 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (35m) 49s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:27:53.966 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (35m) 113s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:27:53.966 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (41m) 113s ago 41m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:27:53.967 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (41m) 49s ago 41m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:27:53.967 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (34m) 113s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:27:53.967 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (34m) 113s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:27:53.967 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (33m) 113s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:27:53.968 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (33m) 113s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:27:53.968 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (32m) 49s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:27:53.968 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (32m) 49s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:27:53.968 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (31m) 49s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:27:53.968 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (31m) 49s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:27:53.969 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (41m) 49s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:27:53.969 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 113s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:27:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:53 gibba043 bash[24019]: cluster 2021-03-10T14:27:52.682037+0000 mgr.gibba043.dnkmem (mgr.34373) 1973 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:54.214 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:27:54.215 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:27:54.215 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:54.215 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:27:54.216 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:27:54.216 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:54.216 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:27:54.216 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:27:54.216 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:27:54.217 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:27:54.217 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:27:54.217 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:27:54.217 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:27:54.217 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:27:54.218 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:27:54.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:54 gibba003 bash[31385]: audit 2021-03-10T14:27:53.725384+0000 mgr.gibba043.dnkmem (mgr.34373) 1974 : audit [DBG] from='client.45387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:54.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:54 gibba003 bash[31385]: audit 2021-03-10T14:27:54.215835+0000 mon.a (mon.0) 752 : audit [DBG] from='client.? 172.21.2.103:0/3032463141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:54 gibba003 bash[32348]: audit 2021-03-10T14:27:53.725384+0000 mgr.gibba043.dnkmem (mgr.34373) 1974 : audit [DBG] from='client.45387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:54 gibba003 bash[32348]: audit 2021-03-10T14:27:54.215835+0000 mon.a (mon.0) 752 : audit [DBG] from='client.? 172.21.2.103:0/3032463141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:54 gibba043 bash[24019]: audit 2021-03-10T14:27:53.725384+0000 mgr.gibba043.dnkmem (mgr.34373) 1974 : audit [DBG] from='client.45387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:54 gibba043 bash[24019]: audit 2021-03-10T14:27:54.215835+0000 mon.a (mon.0) 752 : audit [DBG] from='client.? 172.21.2.103:0/3032463141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:55 gibba003 bash[31385]: audit 2021-03-10T14:27:53.951155+0000 mgr.gibba043.dnkmem (mgr.34373) 1975 : audit [DBG] from='client.55378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:55 gibba003 bash[31385]: cluster 2021-03-10T14:27:54.683335+0000 mgr.gibba043.dnkmem (mgr.34373) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:55 gibba003 bash[32348]: audit 2021-03-10T14:27:53.951155+0000 mgr.gibba043.dnkmem (mgr.34373) 1975 : audit [DBG] from='client.55378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:55 gibba003 bash[32348]: cluster 2021-03-10T14:27:54.683335+0000 mgr.gibba043.dnkmem (mgr.34373) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:55 gibba043 bash[24019]: audit 2021-03-10T14:27:53.951155+0000 mgr.gibba043.dnkmem (mgr.34373) 1975 : audit [DBG] from='client.55378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:55 gibba043 bash[24019]: cluster 2021-03-10T14:27:54.683335+0000 mgr.gibba043.dnkmem (mgr.34373) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:57 gibba043 bash[24019]: cluster 2021-03-10T14:27:56.684979+0000 mgr.gibba043.dnkmem (mgr.34373) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:57 gibba003 bash[31385]: cluster 2021-03-10T14:27:56.684979+0000 mgr.gibba043.dnkmem (mgr.34373) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:57 gibba003 bash[32348]: cluster 2021-03-10T14:27:56.684979+0000 mgr.gibba043.dnkmem (mgr.34373) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:27:59 gibba043 bash[24019]: cluster 2021-03-10T14:27:58.686612+0000 mgr.gibba043.dnkmem (mgr.34373) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:27:59 gibba003 bash[31385]: cluster 2021-03-10T14:27:58.686612+0000 mgr.gibba043.dnkmem (mgr.34373) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:27:59 gibba003 bash[32348]: cluster 2021-03-10T14:27:58.686612+0000 mgr.gibba043.dnkmem (mgr.34373) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:01 gibba043 bash[24019]: cluster 2021-03-10T14:28:00.687685+0000 mgr.gibba043.dnkmem (mgr.34373) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:01 gibba003 bash[31385]: cluster 2021-03-10T14:28:00.687685+0000 mgr.gibba043.dnkmem (mgr.34373) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:01 gibba003 bash[32348]: cluster 2021-03-10T14:28:00.687685+0000 mgr.gibba043.dnkmem (mgr.34373) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:03 gibba003 bash[31385]: cluster 2021-03-10T14:28:02.688247+0000 mgr.gibba043.dnkmem (mgr.34373) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:03 gibba003 bash[32348]: cluster 2021-03-10T14:28:02.688247+0000 mgr.gibba043.dnkmem (mgr.34373) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:03 gibba043 bash[24019]: cluster 2021-03-10T14:28:02.688247+0000 mgr.gibba043.dnkmem (mgr.34373) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.377027+0000 mgr.gibba043.dnkmem (mgr.34373) 1981 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:28:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.378628+0000 mgr.gibba043.dnkmem (mgr.34373) 1982 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:28:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.588253+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:28:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.588855+0000 mgr.gibba043.dnkmem (mgr.34373) 1983 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:05.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.590452+0000 mgr.gibba043.dnkmem (mgr.34373) 1984 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:05.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.591878+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:05.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.591955+0000 mgr.gibba043.dnkmem (mgr.34373) 1985 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:05.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.591992+0000 mgr.gibba043.dnkmem (mgr.34373) 1986 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:05.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.593242+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.593315+0000 mgr.gibba043.dnkmem (mgr.34373) 1987 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:05.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.593353+0000 mgr.gibba043.dnkmem (mgr.34373) 1988 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:05.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.594549+0000 mgr.gibba043.dnkmem (mgr.34373) 1989 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:05.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.594779+0000 mon.c (mon.1) 556 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.595893+0000 mgr.gibba043.dnkmem (mgr.34373) 1990 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:05.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.595940+0000 mgr.gibba043.dnkmem (mgr.34373) 1991 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:05.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.596078+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.597182+0000 mgr.gibba043.dnkmem (mgr.34373) 1992 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:05.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.597498+0000 mgr.gibba043.dnkmem (mgr.34373) 1993 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:05.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.598761+0000 mon.c (mon.1) 558 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.598788+0000 mgr.gibba043.dnkmem (mgr.34373) 1994 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:05.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.598825+0000 mgr.gibba043.dnkmem (mgr.34373) 1995 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:05.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cephadm 2021-03-10T14:28:04.598929+0000 mgr.gibba043.dnkmem (mgr.34373) 1996 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:05.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: audit 2021-03-10T14:28:04.600172+0000 mon.c (mon.1) 559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[31385]: cluster 2021-03-10T14:28:04.689786+0000 mgr.gibba043.dnkmem (mgr.34373) 1997 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:05.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.377027+0000 mgr.gibba043.dnkmem (mgr.34373) 1981 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:28:05.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.378628+0000 mgr.gibba043.dnkmem (mgr.34373) 1982 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:28:05.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.588253+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:28:05.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.588855+0000 mgr.gibba043.dnkmem (mgr.34373) 1983 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:05.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.590452+0000 mgr.gibba043.dnkmem (mgr.34373) 1984 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:05.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.591878+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:05.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.591955+0000 mgr.gibba043.dnkmem (mgr.34373) 1985 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:05.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.591992+0000 mgr.gibba043.dnkmem (mgr.34373) 1986 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:05.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.593242+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.593315+0000 mgr.gibba043.dnkmem (mgr.34373) 1987 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:05.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.593353+0000 mgr.gibba043.dnkmem (mgr.34373) 1988 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:05.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.594549+0000 mgr.gibba043.dnkmem (mgr.34373) 1989 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:05.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.594779+0000 mon.c (mon.1) 556 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.595893+0000 mgr.gibba043.dnkmem (mgr.34373) 1990 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:05.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.595940+0000 mgr.gibba043.dnkmem (mgr.34373) 1991 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:05.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.596078+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.597182+0000 mgr.gibba043.dnkmem (mgr.34373) 1992 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:05.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.597498+0000 mgr.gibba043.dnkmem (mgr.34373) 1993 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:05.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.598761+0000 mon.c (mon.1) 558 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.598788+0000 mgr.gibba043.dnkmem (mgr.34373) 1994 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:05.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.598825+0000 mgr.gibba043.dnkmem (mgr.34373) 1995 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:05.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cephadm 2021-03-10T14:28:04.598929+0000 mgr.gibba043.dnkmem (mgr.34373) 1996 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:05.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: audit 2021-03-10T14:28:04.600172+0000 mon.c (mon.1) 559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:05 gibba003 bash[32348]: cluster 2021-03-10T14:28:04.689786+0000 mgr.gibba043.dnkmem (mgr.34373) 1997 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:06.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.377027+0000 mgr.gibba043.dnkmem (mgr.34373) 1981 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:28:06.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.378628+0000 mgr.gibba043.dnkmem (mgr.34373) 1982 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:28:06.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.588253+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:28:06.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.588855+0000 mgr.gibba043.dnkmem (mgr.34373) 1983 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:06.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.590452+0000 mgr.gibba043.dnkmem (mgr.34373) 1984 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:06.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.591878+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:06.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.591955+0000 mgr.gibba043.dnkmem (mgr.34373) 1985 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:06.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.591992+0000 mgr.gibba043.dnkmem (mgr.34373) 1986 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:06.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.593242+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:06.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.593315+0000 mgr.gibba043.dnkmem (mgr.34373) 1987 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:06.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.593353+0000 mgr.gibba043.dnkmem (mgr.34373) 1988 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:06.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.594549+0000 mgr.gibba043.dnkmem (mgr.34373) 1989 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:06.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.594779+0000 mon.c (mon.1) 556 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:06.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.595893+0000 mgr.gibba043.dnkmem (mgr.34373) 1990 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:06.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.595940+0000 mgr.gibba043.dnkmem (mgr.34373) 1991 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:06.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.596078+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:06.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.597182+0000 mgr.gibba043.dnkmem (mgr.34373) 1992 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:06.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.597498+0000 mgr.gibba043.dnkmem (mgr.34373) 1993 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:06.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.598761+0000 mon.c (mon.1) 558 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:06.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.598788+0000 mgr.gibba043.dnkmem (mgr.34373) 1994 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:06.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.598825+0000 mgr.gibba043.dnkmem (mgr.34373) 1995 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:06.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cephadm 2021-03-10T14:28:04.598929+0000 mgr.gibba043.dnkmem (mgr.34373) 1996 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:06.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: audit 2021-03-10T14:28:04.600172+0000 mon.c (mon.1) 559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:06.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:05 gibba043 bash[24019]: cluster 2021-03-10T14:28:04.689786+0000 mgr.gibba043.dnkmem (mgr.34373) 1997 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:07 gibba043 bash[24019]: cluster 2021-03-10T14:28:06.690359+0000 mgr.gibba043.dnkmem (mgr.34373) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:07 gibba003 bash[31385]: cluster 2021-03-10T14:28:06.690359+0000 mgr.gibba043.dnkmem (mgr.34373) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:07 gibba003 bash[32348]: cluster 2021-03-10T14:28:06.690359+0000 mgr.gibba043.dnkmem (mgr.34373) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:09 gibba043 bash[24019]: cluster 2021-03-10T14:28:08.691919+0000 mgr.gibba043.dnkmem (mgr.34373) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:09 gibba003 bash[31385]: cluster 2021-03-10T14:28:08.691919+0000 mgr.gibba043.dnkmem (mgr.34373) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:09 gibba003 bash[32348]: cluster 2021-03-10T14:28:08.691919+0000 mgr.gibba043.dnkmem (mgr.34373) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:11 gibba003 bash[31385]: cluster 2021-03-10T14:28:10.693292+0000 mgr.gibba043.dnkmem (mgr.34373) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:11 gibba003 bash[32348]: cluster 2021-03-10T14:28:10.693292+0000 mgr.gibba043.dnkmem (mgr.34373) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:11 gibba043 bash[24019]: cluster 2021-03-10T14:28:10.693292+0000 mgr.gibba043.dnkmem (mgr.34373) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: cluster 2021-03-10T14:28:12.694262+0000 mgr.gibba043.dnkmem (mgr.34373) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.921219+0000 mon.c (mon.1) 560 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.922136+0000 mon.c (mon.1) 561 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:28:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.922553+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.923123+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.924294+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.924398+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:28:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.926332+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.927548+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.950977+0000 mon.c (mon.1) 564 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:12.951417+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:13.013306+0000 mon.c (mon.1) 565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[31385]: audit 2021-03-10T14:28:13.014375+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:13.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: cluster 2021-03-10T14:28:12.694262+0000 mgr.gibba043.dnkmem (mgr.34373) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.921219+0000 mon.c (mon.1) 560 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.922136+0000 mon.c (mon.1) 561 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:28:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.922553+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.923123+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.924294+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.924398+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:28:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.926332+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.927548+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.950977+0000 mon.c (mon.1) 564 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:12.951417+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:13.013306+0000 mon.c (mon.1) 565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:13 gibba003 bash[32348]: audit 2021-03-10T14:28:13.014375+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: cluster 2021-03-10T14:28:12.694262+0000 mgr.gibba043.dnkmem (mgr.34373) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.921219+0000 mon.c (mon.1) 560 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.922136+0000 mon.c (mon.1) 561 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:28:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.922553+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.923123+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:28:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.924294+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.924398+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:28:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.926332+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.927548+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.950977+0000 mon.c (mon.1) 564 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:12.951417+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:13.013306+0000 mon.c (mon.1) 565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:13 gibba043 bash[24019]: audit 2021-03-10T14:28:13.014375+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:15 gibba043 bash[24019]: cluster 2021-03-10T14:28:14.696019+0000 mgr.gibba043.dnkmem (mgr.34373) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:15 gibba003 bash[31385]: cluster 2021-03-10T14:28:14.696019+0000 mgr.gibba043.dnkmem (mgr.34373) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:15 gibba003 bash[32348]: cluster 2021-03-10T14:28:14.696019+0000 mgr.gibba043.dnkmem (mgr.34373) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:17 gibba043 bash[24019]: cluster 2021-03-10T14:28:16.697684+0000 mgr.gibba043.dnkmem (mgr.34373) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:17 gibba003 bash[31385]: cluster 2021-03-10T14:28:16.697684+0000 mgr.gibba043.dnkmem (mgr.34373) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:17 gibba003 bash[32348]: cluster 2021-03-10T14:28:16.697684+0000 mgr.gibba043.dnkmem (mgr.34373) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:19 gibba043 bash[24019]: cluster 2021-03-10T14:28:18.698617+0000 mgr.gibba043.dnkmem (mgr.34373) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:20.220 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:19 gibba003 bash[31385]: cluster 2021-03-10T14:28:18.698617+0000 mgr.gibba043.dnkmem (mgr.34373) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:20.221 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:19 gibba003 bash[32348]: cluster 2021-03-10T14:28:18.698617+0000 mgr.gibba043.dnkmem (mgr.34373) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:20 gibba003 bash[31385]: cephadm 2021-03-10T14:28:19.611871+0000 mgr.gibba043.dnkmem (mgr.34373) 2005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:20 gibba003 bash[32348]: cephadm 2021-03-10T14:28:19.611871+0000 mgr.gibba043.dnkmem (mgr.34373) 2005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:21.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:20 gibba043 bash[24019]: cephadm 2021-03-10T14:28:19.611871+0000 mgr.gibba043.dnkmem (mgr.34373) 2005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:21 gibba003 bash[31385]: cluster 2021-03-10T14:28:20.700008+0000 mgr.gibba043.dnkmem (mgr.34373) 2006 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:21 gibba003 bash[32348]: cluster 2021-03-10T14:28:20.700008+0000 mgr.gibba043.dnkmem (mgr.34373) 2006 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:21 gibba043 bash[24019]: cluster 2021-03-10T14:28:20.700008+0000 mgr.gibba043.dnkmem (mgr.34373) 2006 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:23 gibba003 bash[31385]: cluster 2021-03-10T14:28:22.700963+0000 mgr.gibba043.dnkmem (mgr.34373) 2007 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:23 gibba003 bash[32348]: cluster 2021-03-10T14:28:22.700963+0000 mgr.gibba043.dnkmem (mgr.34373) 2007 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:23 gibba043 bash[24019]: cluster 2021-03-10T14:28:22.700963+0000 mgr.gibba043.dnkmem (mgr.34373) 2007 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:24.455 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:28:24.678 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:28:24.678 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (36m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:28:24.678 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (41m) 80s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:28:24.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (37m) 80s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:28:24.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (37m) 80s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:28:24.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:28:24.679 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:28:24.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (35m) 80s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:28:24.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:28:24.680 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:28:24.680 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (42m) 80s ago 42m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:28:24.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:28:24.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:28:24.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:28:24.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:28:24.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (33m) 80s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:28:24.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (32m) 80s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:28:24.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (32m) 80s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:28:24.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (32m) 80s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:28:24.682 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (41m) 80s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:28:24.683 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:28:24.934 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:28:24.935 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:28:24.935 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:24.935 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:28:24.936 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:28:24.936 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:24.936 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:28:24.936 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:28:24.936 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:28:24.937 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:28:24.937 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:28:24.937 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:28:24.937 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:28:24.937 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:28:24.938 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:28:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:25 gibba043 bash[24019]: audit 2021-03-10T14:28:24.444859+0000 mgr.gibba043.dnkmem (mgr.34373) 2008 : audit [DBG] from='client.45405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:25 gibba043 bash[24019]: audit 2021-03-10T14:28:24.667135+0000 mgr.gibba043.dnkmem (mgr.34373) 2009 : audit [DBG] from='client.55396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:25 gibba043 bash[24019]: cluster 2021-03-10T14:28:24.702295+0000 mgr.gibba043.dnkmem (mgr.34373) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:25 gibba043 bash[24019]: audit 2021-03-10T14:28:24.935836+0000 mon.a (mon.0) 760 : audit [DBG] from='client.? 172.21.2.103:0/3726769415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[31385]: audit 2021-03-10T14:28:24.444859+0000 mgr.gibba043.dnkmem (mgr.34373) 2008 : audit [DBG] from='client.45405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[31385]: audit 2021-03-10T14:28:24.667135+0000 mgr.gibba043.dnkmem (mgr.34373) 2009 : audit [DBG] from='client.55396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[31385]: cluster 2021-03-10T14:28:24.702295+0000 mgr.gibba043.dnkmem (mgr.34373) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[31385]: audit 2021-03-10T14:28:24.935836+0000 mon.a (mon.0) 760 : audit [DBG] from='client.? 172.21.2.103:0/3726769415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[32348]: audit 2021-03-10T14:28:24.444859+0000 mgr.gibba043.dnkmem (mgr.34373) 2008 : audit [DBG] from='client.45405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:26.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[32348]: audit 2021-03-10T14:28:24.667135+0000 mgr.gibba043.dnkmem (mgr.34373) 2009 : audit [DBG] from='client.55396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:26.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[32348]: cluster 2021-03-10T14:28:24.702295+0000 mgr.gibba043.dnkmem (mgr.34373) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:26.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:25 gibba003 bash[32348]: audit 2021-03-10T14:28:24.935836+0000 mon.a (mon.0) 760 : audit [DBG] from='client.? 172.21.2.103:0/3726769415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:27 gibba003 bash[32348]: cluster 2021-03-10T14:28:26.704010+0000 mgr.gibba043.dnkmem (mgr.34373) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:27 gibba003 bash[31385]: cluster 2021-03-10T14:28:26.704010+0000 mgr.gibba043.dnkmem (mgr.34373) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:27 gibba043 bash[24019]: cluster 2021-03-10T14:28:26.704010+0000 mgr.gibba043.dnkmem (mgr.34373) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:29 gibba003 bash[31385]: cluster 2021-03-10T14:28:28.705332+0000 mgr.gibba043.dnkmem (mgr.34373) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:29 gibba003 bash[32348]: cluster 2021-03-10T14:28:28.705332+0000 mgr.gibba043.dnkmem (mgr.34373) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:29 gibba043 bash[24019]: cluster 2021-03-10T14:28:28.705332+0000 mgr.gibba043.dnkmem (mgr.34373) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:31 gibba003 bash[31385]: cluster 2021-03-10T14:28:30.706335+0000 mgr.gibba043.dnkmem (mgr.34373) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:31 gibba003 bash[32348]: cluster 2021-03-10T14:28:30.706335+0000 mgr.gibba043.dnkmem (mgr.34373) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:31 gibba043 bash[24019]: cluster 2021-03-10T14:28:30.706335+0000 mgr.gibba043.dnkmem (mgr.34373) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:33 gibba003 bash[31385]: cluster 2021-03-10T14:28:32.707117+0000 mgr.gibba043.dnkmem (mgr.34373) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:33 gibba003 bash[32348]: cluster 2021-03-10T14:28:32.707117+0000 mgr.gibba043.dnkmem (mgr.34373) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:33 gibba043 bash[24019]: cluster 2021-03-10T14:28:32.707117+0000 mgr.gibba043.dnkmem (mgr.34373) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:35 gibba003 bash[31385]: cephadm 2021-03-10T14:28:34.627230+0000 mgr.gibba043.dnkmem (mgr.34373) 2015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:35 gibba003 bash[31385]: cluster 2021-03-10T14:28:34.708824+0000 mgr.gibba043.dnkmem (mgr.34373) 2016 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:35 gibba003 bash[32348]: cephadm 2021-03-10T14:28:34.627230+0000 mgr.gibba043.dnkmem (mgr.34373) 2015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:35 gibba003 bash[32348]: cluster 2021-03-10T14:28:34.708824+0000 mgr.gibba043.dnkmem (mgr.34373) 2016 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:35 gibba043 bash[24019]: cephadm 2021-03-10T14:28:34.627230+0000 mgr.gibba043.dnkmem (mgr.34373) 2015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:35 gibba043 bash[24019]: cluster 2021-03-10T14:28:34.708824+0000 mgr.gibba043.dnkmem (mgr.34373) 2016 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:37 gibba003 bash[31385]: cluster 2021-03-10T14:28:36.710192+0000 mgr.gibba043.dnkmem (mgr.34373) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:37 gibba003 bash[32348]: cluster 2021-03-10T14:28:36.710192+0000 mgr.gibba043.dnkmem (mgr.34373) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:37 gibba043 bash[24019]: cluster 2021-03-10T14:28:36.710192+0000 mgr.gibba043.dnkmem (mgr.34373) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:39 gibba003 bash[31385]: cluster 2021-03-10T14:28:38.711550+0000 mgr.gibba043.dnkmem (mgr.34373) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:39 gibba003 bash[32348]: cluster 2021-03-10T14:28:38.711550+0000 mgr.gibba043.dnkmem (mgr.34373) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:39 gibba043 bash[24019]: cluster 2021-03-10T14:28:38.711550+0000 mgr.gibba043.dnkmem (mgr.34373) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:41 gibba003 bash[31385]: cluster 2021-03-10T14:28:40.713190+0000 mgr.gibba043.dnkmem (mgr.34373) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:42.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:41 gibba003 bash[32348]: cluster 2021-03-10T14:28:40.713190+0000 mgr.gibba043.dnkmem (mgr.34373) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:42.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:41 gibba043 bash[24019]: cluster 2021-03-10T14:28:40.713190+0000 mgr.gibba043.dnkmem (mgr.34373) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:43 gibba003 bash[31385]: cluster 2021-03-10T14:28:42.714375+0000 mgr.gibba043.dnkmem (mgr.34373) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:43 gibba003 bash[32348]: cluster 2021-03-10T14:28:42.714375+0000 mgr.gibba043.dnkmem (mgr.34373) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:43 gibba043 bash[24019]: cluster 2021-03-10T14:28:42.714375+0000 mgr.gibba043.dnkmem (mgr.34373) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:45 gibba003 bash[31385]: cluster 2021-03-10T14:28:44.715823+0000 mgr.gibba043.dnkmem (mgr.34373) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:45 gibba003 bash[32348]: cluster 2021-03-10T14:28:44.715823+0000 mgr.gibba043.dnkmem (mgr.34373) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:46.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:45 gibba043 bash[24019]: cluster 2021-03-10T14:28:44.715823+0000 mgr.gibba043.dnkmem (mgr.34373) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:47 gibba003 bash[31385]: cluster 2021-03-10T14:28:46.717128+0000 mgr.gibba043.dnkmem (mgr.34373) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:47 gibba003 bash[32348]: cluster 2021-03-10T14:28:46.717128+0000 mgr.gibba043.dnkmem (mgr.34373) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:47 gibba043 bash[24019]: cluster 2021-03-10T14:28:46.717128+0000 mgr.gibba043.dnkmem (mgr.34373) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:49 gibba043 bash[24019]: cluster 2021-03-10T14:28:48.718735+0000 mgr.gibba043.dnkmem (mgr.34373) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:49 gibba003 bash[32348]: cluster 2021-03-10T14:28:48.718735+0000 mgr.gibba043.dnkmem (mgr.34373) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:49 gibba003 bash[31385]: cluster 2021-03-10T14:28:48.718735+0000 mgr.gibba043.dnkmem (mgr.34373) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:50 gibba003 bash[31385]: cephadm 2021-03-10T14:28:49.640403+0000 mgr.gibba043.dnkmem (mgr.34373) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:50 gibba003 bash[32348]: cephadm 2021-03-10T14:28:49.640403+0000 mgr.gibba043.dnkmem (mgr.34373) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:50 gibba043 bash[24019]: cephadm 2021-03-10T14:28:49.640403+0000 mgr.gibba043.dnkmem (mgr.34373) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:28:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:51 gibba003 bash[31385]: cluster 2021-03-10T14:28:50.720315+0000 mgr.gibba043.dnkmem (mgr.34373) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:51 gibba003 bash[32348]: cluster 2021-03-10T14:28:50.720315+0000 mgr.gibba043.dnkmem (mgr.34373) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:51 gibba043 bash[24019]: cluster 2021-03-10T14:28:50.720315+0000 mgr.gibba043.dnkmem (mgr.34373) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:53 gibba003 bash[31385]: cluster 2021-03-10T14:28:52.721233+0000 mgr.gibba043.dnkmem (mgr.34373) 2026 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:53 gibba003 bash[32348]: cluster 2021-03-10T14:28:52.721233+0000 mgr.gibba043.dnkmem (mgr.34373) 2026 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:53 gibba043 bash[24019]: cluster 2021-03-10T14:28:52.721233+0000 mgr.gibba043.dnkmem (mgr.34373) 2026 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:55.180 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:28:55.408 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:28:55.408 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (37m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:28:55.408 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (42m) 111s ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:28:55.409 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (37m) 111s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:28:55.409 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (37m) 111s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:28:55.409 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:28:55.409 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:28:55.410 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (36m) 111s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:28:55.410 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:28:55.410 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:28:55.410 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (42m) 111s ago 42m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:28:55.410 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:28:55.411 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:28:55.411 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:28:55.411 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:28:55.411 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (33m) 111s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:28:55.411 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (33m) 111s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:28:55.412 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (33m) 111s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:28:55.412 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (32m) 111s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:28:55.412 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (42m) 111s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:28:55.412 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:28:55.661 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:28:55.661 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:28:55.661 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:55.662 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:28:55.662 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:28:55.662 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:55.662 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:28:55.663 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:28:55.663 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:28:55.663 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:28:55.663 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:28:55.663 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:28:55.664 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:28:55.664 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:28:55.664 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:28:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:55 gibba003 bash[31385]: cluster 2021-03-10T14:28:54.722905+0000 mgr.gibba043.dnkmem (mgr.34373) 2027 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:55 gibba003 bash[31385]: audit 2021-03-10T14:28:55.662116+0000 mon.a (mon.0) 761 : audit [DBG] from='client.? 172.21.2.103:0/1948849245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:55 gibba003 bash[32348]: cluster 2021-03-10T14:28:54.722905+0000 mgr.gibba043.dnkmem (mgr.34373) 2027 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:55 gibba003 bash[32348]: audit 2021-03-10T14:28:55.662116+0000 mon.a (mon.0) 761 : audit [DBG] from='client.? 172.21.2.103:0/1948849245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:55 gibba043 bash[24019]: cluster 2021-03-10T14:28:54.722905+0000 mgr.gibba043.dnkmem (mgr.34373) 2027 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:55 gibba043 bash[24019]: audit 2021-03-10T14:28:55.662116+0000 mon.a (mon.0) 761 : audit [DBG] from='client.? 172.21.2.103:0/1948849245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:56 gibba003 bash[31385]: audit 2021-03-10T14:28:55.169624+0000 mgr.gibba043.dnkmem (mgr.34373) 2028 : audit [DBG] from='client.45423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:56 gibba003 bash[31385]: audit 2021-03-10T14:28:55.394716+0000 mgr.gibba043.dnkmem (mgr.34373) 2029 : audit [DBG] from='client.55414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:56 gibba003 bash[32348]: audit 2021-03-10T14:28:55.169624+0000 mgr.gibba043.dnkmem (mgr.34373) 2028 : audit [DBG] from='client.45423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:56 gibba003 bash[32348]: audit 2021-03-10T14:28:55.394716+0000 mgr.gibba043.dnkmem (mgr.34373) 2029 : audit [DBG] from='client.55414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:56 gibba043 bash[24019]: audit 2021-03-10T14:28:55.169624+0000 mgr.gibba043.dnkmem (mgr.34373) 2028 : audit [DBG] from='client.45423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:56 gibba043 bash[24019]: audit 2021-03-10T14:28:55.394716+0000 mgr.gibba043.dnkmem (mgr.34373) 2029 : audit [DBG] from='client.55414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:57 gibba003 bash[31385]: cluster 2021-03-10T14:28:56.724580+0000 mgr.gibba043.dnkmem (mgr.34373) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:57 gibba003 bash[32348]: cluster 2021-03-10T14:28:56.724580+0000 mgr.gibba043.dnkmem (mgr.34373) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:57 gibba043 bash[24019]: cluster 2021-03-10T14:28:56.724580+0000 mgr.gibba043.dnkmem (mgr.34373) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:28:59 gibba003 bash[31385]: cluster 2021-03-10T14:28:58.726256+0000 mgr.gibba043.dnkmem (mgr.34373) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:28:59 gibba003 bash[32348]: cluster 2021-03-10T14:28:58.726256+0000 mgr.gibba043.dnkmem (mgr.34373) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:28:59 gibba043 bash[24019]: cluster 2021-03-10T14:28:58.726256+0000 mgr.gibba043.dnkmem (mgr.34373) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:01 gibba003 bash[31385]: cluster 2021-03-10T14:29:00.727611+0000 mgr.gibba043.dnkmem (mgr.34373) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:01 gibba003 bash[32348]: cluster 2021-03-10T14:29:00.727611+0000 mgr.gibba043.dnkmem (mgr.34373) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:01 gibba043 bash[24019]: cluster 2021-03-10T14:29:00.727611+0000 mgr.gibba043.dnkmem (mgr.34373) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:03 gibba003 bash[31385]: cluster 2021-03-10T14:29:02.728614+0000 mgr.gibba043.dnkmem (mgr.34373) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:03 gibba003 bash[32348]: cluster 2021-03-10T14:29:02.728614+0000 mgr.gibba043.dnkmem (mgr.34373) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:03 gibba043 bash[24019]: cluster 2021-03-10T14:29:02.728614+0000 mgr.gibba043.dnkmem (mgr.34373) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.656877+0000 mgr.gibba043.dnkmem (mgr.34373) 2034 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:29:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.658363+0000 mgr.gibba043.dnkmem (mgr.34373) 2035 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:29:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: cluster 2021-03-10T14:29:04.729047+0000 mgr.gibba043.dnkmem (mgr.34373) 2036 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.917712+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:29:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.921530+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.922911+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.924308+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.925665+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.928745+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[31385]: audit 2021-03-10T14:29:04.930418+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.656877+0000 mgr.gibba043.dnkmem (mgr.34373) 2034 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:29:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.658363+0000 mgr.gibba043.dnkmem (mgr.34373) 2035 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:29:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: cluster 2021-03-10T14:29:04.729047+0000 mgr.gibba043.dnkmem (mgr.34373) 2036 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.917712+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:29:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.921530+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.922911+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.924308+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.925665+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.928745+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:05 gibba003 bash[32348]: audit 2021-03-10T14:29:04.930418+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.656877+0000 mgr.gibba043.dnkmem (mgr.34373) 2034 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:29:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.658363+0000 mgr.gibba043.dnkmem (mgr.34373) 2035 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:29:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: cluster 2021-03-10T14:29:04.729047+0000 mgr.gibba043.dnkmem (mgr.34373) 2036 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.917712+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:29:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.921530+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.922911+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.924308+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.925665+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.928745+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:05 gibba043 bash[24019]: audit 2021-03-10T14:29:04.930418+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.918399+0000 mgr.gibba043.dnkmem (mgr.34373) 2037 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.920211+0000 mgr.gibba043.dnkmem (mgr.34373) 2038 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.921502+0000 mgr.gibba043.dnkmem (mgr.34373) 2039 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.921543+0000 mgr.gibba043.dnkmem (mgr.34373) 2040 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.922919+0000 mgr.gibba043.dnkmem (mgr.34373) 2041 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.922961+0000 mgr.gibba043.dnkmem (mgr.34373) 2042 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.924076+0000 mgr.gibba043.dnkmem (mgr.34373) 2043 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.925867+0000 mgr.gibba043.dnkmem (mgr.34373) 2044 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.925909+0000 mgr.gibba043.dnkmem (mgr.34373) 2045 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.927366+0000 mgr.gibba043.dnkmem (mgr.34373) 2046 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.927745+0000 mgr.gibba043.dnkmem (mgr.34373) 2047 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.929036+0000 mgr.gibba043.dnkmem (mgr.34373) 2048 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.929082+0000 mgr.gibba043.dnkmem (mgr.34373) 2049 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[31385]: cephadm 2021-03-10T14:29:04.929201+0000 mgr.gibba043.dnkmem (mgr.34373) 2050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:07.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.918399+0000 mgr.gibba043.dnkmem (mgr.34373) 2037 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.920211+0000 mgr.gibba043.dnkmem (mgr.34373) 2038 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.921502+0000 mgr.gibba043.dnkmem (mgr.34373) 2039 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.921543+0000 mgr.gibba043.dnkmem (mgr.34373) 2040 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.922919+0000 mgr.gibba043.dnkmem (mgr.34373) 2041 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.922961+0000 mgr.gibba043.dnkmem (mgr.34373) 2042 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.924076+0000 mgr.gibba043.dnkmem (mgr.34373) 2043 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.925867+0000 mgr.gibba043.dnkmem (mgr.34373) 2044 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.925909+0000 mgr.gibba043.dnkmem (mgr.34373) 2045 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.927366+0000 mgr.gibba043.dnkmem (mgr.34373) 2046 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.927745+0000 mgr.gibba043.dnkmem (mgr.34373) 2047 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.929036+0000 mgr.gibba043.dnkmem (mgr.34373) 2048 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.929082+0000 mgr.gibba043.dnkmem (mgr.34373) 2049 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:06 gibba003 bash[32348]: cephadm 2021-03-10T14:29:04.929201+0000 mgr.gibba043.dnkmem (mgr.34373) 2050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.918399+0000 mgr.gibba043.dnkmem (mgr.34373) 2037 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.920211+0000 mgr.gibba043.dnkmem (mgr.34373) 2038 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.921502+0000 mgr.gibba043.dnkmem (mgr.34373) 2039 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.921543+0000 mgr.gibba043.dnkmem (mgr.34373) 2040 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.922919+0000 mgr.gibba043.dnkmem (mgr.34373) 2041 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.922961+0000 mgr.gibba043.dnkmem (mgr.34373) 2042 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.924076+0000 mgr.gibba043.dnkmem (mgr.34373) 2043 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.925867+0000 mgr.gibba043.dnkmem (mgr.34373) 2044 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.925909+0000 mgr.gibba043.dnkmem (mgr.34373) 2045 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.927366+0000 mgr.gibba043.dnkmem (mgr.34373) 2046 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.927745+0000 mgr.gibba043.dnkmem (mgr.34373) 2047 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.929036+0000 mgr.gibba043.dnkmem (mgr.34373) 2048 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.929082+0000 mgr.gibba043.dnkmem (mgr.34373) 2049 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:06 gibba043 bash[24019]: cephadm 2021-03-10T14:29:04.929201+0000 mgr.gibba043.dnkmem (mgr.34373) 2050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:07 gibba003 bash[31385]: cluster 2021-03-10T14:29:06.730528+0000 mgr.gibba043.dnkmem (mgr.34373) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:07 gibba003 bash[32348]: cluster 2021-03-10T14:29:06.730528+0000 mgr.gibba043.dnkmem (mgr.34373) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:07 gibba043 bash[24019]: cluster 2021-03-10T14:29:06.730528+0000 mgr.gibba043.dnkmem (mgr.34373) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:09 gibba003 bash[31385]: cluster 2021-03-10T14:29:08.732105+0000 mgr.gibba043.dnkmem (mgr.34373) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:09 gibba003 bash[32348]: cluster 2021-03-10T14:29:08.732105+0000 mgr.gibba043.dnkmem (mgr.34373) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:09 gibba043 bash[24019]: cluster 2021-03-10T14:29:08.732105+0000 mgr.gibba043.dnkmem (mgr.34373) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:11 gibba003 bash[31385]: cluster 2021-03-10T14:29:10.733730+0000 mgr.gibba043.dnkmem (mgr.34373) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:11 gibba003 bash[32348]: cluster 2021-03-10T14:29:10.733730+0000 mgr.gibba043.dnkmem (mgr.34373) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:11 gibba043 bash[24019]: cluster 2021-03-10T14:29:10.733730+0000 mgr.gibba043.dnkmem (mgr.34373) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: cluster 2021-03-10T14:29:12.735276+0000 mgr.gibba043.dnkmem (mgr.34373) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.931697+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:29:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.932462+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.932917+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:29:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.933132+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.934058+0000 mon.c (mon.1) 575 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.934315+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.935321+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.936094+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.954430+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:12.955617+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:13.021463+0000 mon.c (mon.1) 577 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[31385]: audit 2021-03-10T14:29:13.022609+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: cluster 2021-03-10T14:29:12.735276+0000 mgr.gibba043.dnkmem (mgr.34373) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.931697+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:29:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.932462+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.932917+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:29:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.933132+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.934058+0000 mon.c (mon.1) 575 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.934315+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.935321+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.936094+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.954430+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:12.955617+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:13.021463+0000 mon.c (mon.1) 577 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:13 gibba003 bash[32348]: audit 2021-03-10T14:29:13.022609+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: cluster 2021-03-10T14:29:12.735276+0000 mgr.gibba043.dnkmem (mgr.34373) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.931697+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:29:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.932462+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:29:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.932917+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:29:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.933132+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.934058+0000 mon.c (mon.1) 575 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.934315+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:29:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.935321+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.936094+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.954430+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:12.955617+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:13.021463+0000 mon.c (mon.1) 577 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:13 gibba043 bash[24019]: audit 2021-03-10T14:29:13.022609+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:15 gibba003 bash[31385]: cluster 2021-03-10T14:29:14.736929+0000 mgr.gibba043.dnkmem (mgr.34373) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:15 gibba003 bash[32348]: cluster 2021-03-10T14:29:14.736929+0000 mgr.gibba043.dnkmem (mgr.34373) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:15 gibba043 bash[24019]: cluster 2021-03-10T14:29:14.736929+0000 mgr.gibba043.dnkmem (mgr.34373) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:17 gibba003 bash[31385]: cluster 2021-03-10T14:29:16.738432+0000 mgr.gibba043.dnkmem (mgr.34373) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:17 gibba003 bash[32348]: cluster 2021-03-10T14:29:16.738432+0000 mgr.gibba043.dnkmem (mgr.34373) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:17 gibba043 bash[24019]: cluster 2021-03-10T14:29:16.738432+0000 mgr.gibba043.dnkmem (mgr.34373) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:19 gibba003 bash[31385]: cluster 2021-03-10T14:29:18.739975+0000 mgr.gibba043.dnkmem (mgr.34373) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:19 gibba003 bash[32348]: cluster 2021-03-10T14:29:18.739975+0000 mgr.gibba043.dnkmem (mgr.34373) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:20.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:19 gibba043 bash[24019]: cluster 2021-03-10T14:29:18.739975+0000 mgr.gibba043.dnkmem (mgr.34373) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:21 gibba003 bash[31385]: cephadm 2021-03-10T14:29:19.945049+0000 mgr.gibba043.dnkmem (mgr.34373) 2058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:21 gibba003 bash[31385]: cluster 2021-03-10T14:29:20.741666+0000 mgr.gibba043.dnkmem (mgr.34373) 2059 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:21 gibba003 bash[32348]: cephadm 2021-03-10T14:29:19.945049+0000 mgr.gibba043.dnkmem (mgr.34373) 2058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:21 gibba003 bash[32348]: cluster 2021-03-10T14:29:20.741666+0000 mgr.gibba043.dnkmem (mgr.34373) 2059 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:21 gibba043 bash[24019]: cephadm 2021-03-10T14:29:19.945049+0000 mgr.gibba043.dnkmem (mgr.34373) 2058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:21 gibba043 bash[24019]: cluster 2021-03-10T14:29:20.741666+0000 mgr.gibba043.dnkmem (mgr.34373) 2059 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:23 gibba043 bash[24019]: cluster 2021-03-10T14:29:22.742405+0000 mgr.gibba043.dnkmem (mgr.34373) 2060 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:23 gibba003 bash[31385]: cluster 2021-03-10T14:29:22.742405+0000 mgr.gibba043.dnkmem (mgr.34373) 2060 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:23 gibba003 bash[32348]: cluster 2021-03-10T14:29:22.742405+0000 mgr.gibba043.dnkmem (mgr.34373) 2060 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:25.908 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:29:26.137 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:29:26.138 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (37m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:29:26.138 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (42m) 2m ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:29:26.138 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:29:26.139 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:29:26.139 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:29:26.139 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:29:26.139 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:29:26.139 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:29:26.140 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:29:26.140 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:29:26.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:29:26.140 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:29:26.141 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:29:26.141 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:29:26.141 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:29:26.141 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:29:26.141 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:29:26.142 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (33m) 2m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:29:26.142 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (42m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:29:26.142 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:29:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:25 gibba003 bash[31385]: cluster 2021-03-10T14:29:24.743814+0000 mgr.gibba043.dnkmem (mgr.34373) 2061 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:26.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:25 gibba003 bash[32348]: cluster 2021-03-10T14:29:24.743814+0000 mgr.gibba043.dnkmem (mgr.34373) 2061 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:25 gibba043 bash[24019]: cluster 2021-03-10T14:29:24.743814+0000 mgr.gibba043.dnkmem (mgr.34373) 2061 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:26.389 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:29:26.389 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:29:26.389 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:26.390 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:29:26.390 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:29:26.390 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:26.390 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:29:26.390 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:29:26.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:29:26.391 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:29:26.391 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:29:26.391 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:29:26.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:29:26.392 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:29:26.392 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:29:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:26 gibba003 bash[31385]: audit 2021-03-10T14:29:26.390208+0000 mon.a (mon.0) 769 : audit [DBG] from='client.? 172.21.2.103:0/379565664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:26 gibba003 bash[32348]: audit 2021-03-10T14:29:26.390208+0000 mon.a (mon.0) 769 : audit [DBG] from='client.? 172.21.2.103:0/379565664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:26 gibba043 bash[24019]: audit 2021-03-10T14:29:26.390208+0000 mon.a (mon.0) 769 : audit [DBG] from='client.? 172.21.2.103:0/379565664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:27 gibba003 bash[31385]: audit 2021-03-10T14:29:25.897595+0000 mgr.gibba043.dnkmem (mgr.34373) 2062 : audit [DBG] from='client.45441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:27 gibba003 bash[31385]: audit 2021-03-10T14:29:26.124129+0000 mgr.gibba043.dnkmem (mgr.34373) 2063 : audit [DBG] from='client.55432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:27 gibba003 bash[31385]: cluster 2021-03-10T14:29:26.745157+0000 mgr.gibba043.dnkmem (mgr.34373) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:27 gibba003 bash[32348]: audit 2021-03-10T14:29:25.897595+0000 mgr.gibba043.dnkmem (mgr.34373) 2062 : audit [DBG] from='client.45441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:27 gibba003 bash[32348]: audit 2021-03-10T14:29:26.124129+0000 mgr.gibba043.dnkmem (mgr.34373) 2063 : audit [DBG] from='client.55432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:27 gibba003 bash[32348]: cluster 2021-03-10T14:29:26.745157+0000 mgr.gibba043.dnkmem (mgr.34373) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:27 gibba043 bash[24019]: audit 2021-03-10T14:29:25.897595+0000 mgr.gibba043.dnkmem (mgr.34373) 2062 : audit [DBG] from='client.45441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:27 gibba043 bash[24019]: audit 2021-03-10T14:29:26.124129+0000 mgr.gibba043.dnkmem (mgr.34373) 2063 : audit [DBG] from='client.55432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:27 gibba043 bash[24019]: cluster 2021-03-10T14:29:26.745157+0000 mgr.gibba043.dnkmem (mgr.34373) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:29 gibba003 bash[31385]: cluster 2021-03-10T14:29:28.746801+0000 mgr.gibba043.dnkmem (mgr.34373) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:29 gibba003 bash[32348]: cluster 2021-03-10T14:29:28.746801+0000 mgr.gibba043.dnkmem (mgr.34373) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:29 gibba043 bash[24019]: cluster 2021-03-10T14:29:28.746801+0000 mgr.gibba043.dnkmem (mgr.34373) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:31 gibba003 bash[31385]: cluster 2021-03-10T14:29:30.748470+0000 mgr.gibba043.dnkmem (mgr.34373) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:31 gibba003 bash[32348]: cluster 2021-03-10T14:29:30.748470+0000 mgr.gibba043.dnkmem (mgr.34373) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:31 gibba043 bash[24019]: cluster 2021-03-10T14:29:30.748470+0000 mgr.gibba043.dnkmem (mgr.34373) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:33 gibba043 bash[24019]: cluster 2021-03-10T14:29:32.749693+0000 mgr.gibba043.dnkmem (mgr.34373) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:33 gibba003 bash[31385]: cluster 2021-03-10T14:29:32.749693+0000 mgr.gibba043.dnkmem (mgr.34373) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:33 gibba003 bash[32348]: cluster 2021-03-10T14:29:32.749693+0000 mgr.gibba043.dnkmem (mgr.34373) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:35 gibba003 bash[31385]: cluster 2021-03-10T14:29:34.751161+0000 mgr.gibba043.dnkmem (mgr.34373) 2068 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:35 gibba003 bash[32348]: cluster 2021-03-10T14:29:34.751161+0000 mgr.gibba043.dnkmem (mgr.34373) 2068 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:35 gibba043 bash[24019]: cluster 2021-03-10T14:29:34.751161+0000 mgr.gibba043.dnkmem (mgr.34373) 2068 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:36 gibba003 bash[31385]: cephadm 2021-03-10T14:29:34.954397+0000 mgr.gibba043.dnkmem (mgr.34373) 2069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:36 gibba003 bash[32348]: cephadm 2021-03-10T14:29:34.954397+0000 mgr.gibba043.dnkmem (mgr.34373) 2069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:36 gibba043 bash[24019]: cephadm 2021-03-10T14:29:34.954397+0000 mgr.gibba043.dnkmem (mgr.34373) 2069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:37 gibba003 bash[31385]: cluster 2021-03-10T14:29:36.752720+0000 mgr.gibba043.dnkmem (mgr.34373) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:37 gibba003 bash[32348]: cluster 2021-03-10T14:29:36.752720+0000 mgr.gibba043.dnkmem (mgr.34373) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:37 gibba043 bash[24019]: cluster 2021-03-10T14:29:36.752720+0000 mgr.gibba043.dnkmem (mgr.34373) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:39 gibba003 bash[31385]: cluster 2021-03-10T14:29:38.754206+0000 mgr.gibba043.dnkmem (mgr.34373) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:39 gibba003 bash[32348]: cluster 2021-03-10T14:29:38.754206+0000 mgr.gibba043.dnkmem (mgr.34373) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:39 gibba043 bash[24019]: cluster 2021-03-10T14:29:38.754206+0000 mgr.gibba043.dnkmem (mgr.34373) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:40 gibba003 bash[31385]: cluster 2021-03-10T14:29:40.755971+0000 mgr.gibba043.dnkmem (mgr.34373) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:40 gibba003 bash[32348]: cluster 2021-03-10T14:29:40.755971+0000 mgr.gibba043.dnkmem (mgr.34373) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:40 gibba043 bash[24019]: cluster 2021-03-10T14:29:40.755971+0000 mgr.gibba043.dnkmem (mgr.34373) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:43 gibba043 bash[24019]: cluster 2021-03-10T14:29:42.757427+0000 mgr.gibba043.dnkmem (mgr.34373) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:43 gibba003 bash[31385]: cluster 2021-03-10T14:29:42.757427+0000 mgr.gibba043.dnkmem (mgr.34373) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:43 gibba003 bash[32348]: cluster 2021-03-10T14:29:42.757427+0000 mgr.gibba043.dnkmem (mgr.34373) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:45 gibba003 bash[31385]: cluster 2021-03-10T14:29:44.758901+0000 mgr.gibba043.dnkmem (mgr.34373) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:45 gibba003 bash[32348]: cluster 2021-03-10T14:29:44.758901+0000 mgr.gibba043.dnkmem (mgr.34373) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:46.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:45 gibba043 bash[24019]: cluster 2021-03-10T14:29:44.758901+0000 mgr.gibba043.dnkmem (mgr.34373) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:47 gibba003 bash[31385]: cluster 2021-03-10T14:29:46.760620+0000 mgr.gibba043.dnkmem (mgr.34373) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:47 gibba003 bash[32348]: cluster 2021-03-10T14:29:46.760620+0000 mgr.gibba043.dnkmem (mgr.34373) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:47 gibba043 bash[24019]: cluster 2021-03-10T14:29:46.760620+0000 mgr.gibba043.dnkmem (mgr.34373) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:49 gibba003 bash[31385]: cluster 2021-03-10T14:29:48.762018+0000 mgr.gibba043.dnkmem (mgr.34373) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:49 gibba003 bash[32348]: cluster 2021-03-10T14:29:48.762018+0000 mgr.gibba043.dnkmem (mgr.34373) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:49 gibba043 bash[24019]: cluster 2021-03-10T14:29:48.762018+0000 mgr.gibba043.dnkmem (mgr.34373) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:50 gibba003 bash[31385]: cephadm 2021-03-10T14:29:49.970249+0000 mgr.gibba043.dnkmem (mgr.34373) 2077 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:50 gibba003 bash[31385]: cluster 2021-03-10T14:29:50.763731+0000 mgr.gibba043.dnkmem (mgr.34373) 2078 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:50 gibba003 bash[32348]: cephadm 2021-03-10T14:29:49.970249+0000 mgr.gibba043.dnkmem (mgr.34373) 2077 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:50 gibba003 bash[32348]: cluster 2021-03-10T14:29:50.763731+0000 mgr.gibba043.dnkmem (mgr.34373) 2078 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:50 gibba043 bash[24019]: cephadm 2021-03-10T14:29:49.970249+0000 mgr.gibba043.dnkmem (mgr.34373) 2077 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:29:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:50 gibba043 bash[24019]: cluster 2021-03-10T14:29:50.763731+0000 mgr.gibba043.dnkmem (mgr.34373) 2078 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:53 gibba043 bash[24019]: cluster 2021-03-10T14:29:52.764449+0000 mgr.gibba043.dnkmem (mgr.34373) 2079 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:53 gibba003 bash[31385]: cluster 2021-03-10T14:29:52.764449+0000 mgr.gibba043.dnkmem (mgr.34373) 2079 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:53 gibba003 bash[32348]: cluster 2021-03-10T14:29:52.764449+0000 mgr.gibba043.dnkmem (mgr.34373) 2079 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:55 gibba003 bash[31385]: cluster 2021-03-10T14:29:54.766166+0000 mgr.gibba043.dnkmem (mgr.34373) 2080 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:55 gibba003 bash[32348]: cluster 2021-03-10T14:29:54.766166+0000 mgr.gibba043.dnkmem (mgr.34373) 2080 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:55 gibba043 bash[24019]: cluster 2021-03-10T14:29:54.766166+0000 mgr.gibba043.dnkmem (mgr.34373) 2080 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:56.643 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:29:56.866 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:29:56.867 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (38m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:29:56.867 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (43m) 2m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:29:56.867 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:29:56.868 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:29:56.868 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (38m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:29:56.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:29:56.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (37m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:29:56.869 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:29:56.869 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:29:56.869 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:29:56.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:29:56.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:29:56.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:29:56.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:29:56.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:29:56.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:29:56.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:29:56.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:29:56.871 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (43m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:29:56.871 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:29:57.116 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:29:57.116 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:29:57.116 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:57.117 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:29:57.117 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:29:57.117 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:57.117 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:29:57.118 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:29:57.118 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:29:57.118 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:29:57.118 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:29:57.118 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:29:57.119 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:29:57.119 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:29:57.119 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:29:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:57 gibba003 bash[31385]: audit 2021-03-10T14:29:56.633470+0000 mgr.gibba043.dnkmem (mgr.34373) 2081 : audit [DBG] from='client.55444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:57 gibba003 bash[31385]: cluster 2021-03-10T14:29:56.768017+0000 mgr.gibba043.dnkmem (mgr.34373) 2082 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:57 gibba003 bash[31385]: audit 2021-03-10T14:29:57.117321+0000 mon.a (mon.0) 770 : audit [DBG] from='client.? 172.21.2.103:0/1315379204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:57 gibba003 bash[32348]: audit 2021-03-10T14:29:56.633470+0000 mgr.gibba043.dnkmem (mgr.34373) 2081 : audit [DBG] from='client.55444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:58.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:57 gibba003 bash[32348]: cluster 2021-03-10T14:29:56.768017+0000 mgr.gibba043.dnkmem (mgr.34373) 2082 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:58.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:57 gibba003 bash[32348]: audit 2021-03-10T14:29:57.117321+0000 mon.a (mon.0) 770 : audit [DBG] from='client.? 172.21.2.103:0/1315379204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:57 gibba043 bash[24019]: audit 2021-03-10T14:29:56.633470+0000 mgr.gibba043.dnkmem (mgr.34373) 2081 : audit [DBG] from='client.55444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:57 gibba043 bash[24019]: cluster 2021-03-10T14:29:56.768017+0000 mgr.gibba043.dnkmem (mgr.34373) 2082 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:57 gibba043 bash[24019]: audit 2021-03-10T14:29:57.117321+0000 mon.a (mon.0) 770 : audit [DBG] from='client.? 172.21.2.103:0/1315379204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:58 gibba003 bash[31385]: audit 2021-03-10T14:29:56.857716+0000 mgr.gibba043.dnkmem (mgr.34373) 2083 : audit [DBG] from='client.55450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:58 gibba003 bash[32348]: audit 2021-03-10T14:29:56.857716+0000 mgr.gibba043.dnkmem (mgr.34373) 2083 : audit [DBG] from='client.55450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:58 gibba043 bash[24019]: audit 2021-03-10T14:29:56.857716+0000 mgr.gibba043.dnkmem (mgr.34373) 2083 : audit [DBG] from='client.55450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:29:59 gibba003 bash[31385]: cluster 2021-03-10T14:29:58.769585+0000 mgr.gibba043.dnkmem (mgr.34373) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:00 gibba003 bash[31385]: debug 2021-03-10T14:29:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:29:59 gibba003 bash[32348]: cluster 2021-03-10T14:29:58.769585+0000 mgr.gibba043.dnkmem (mgr.34373) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:29:59 gibba043 bash[24019]: cluster 2021-03-10T14:29:58.769585+0000 mgr.gibba043.dnkmem (mgr.34373) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:00 gibba003 bash[31385]: cluster 2021-03-10T14:30:00.000222+0000 mon.a (mon.0) 771 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:00 gibba003 bash[31385]: cluster 2021-03-10T14:30:00.771321+0000 mgr.gibba043.dnkmem (mgr.34373) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:00 gibba003 bash[32348]: cluster 2021-03-10T14:30:00.000222+0000 mon.a (mon.0) 771 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:00 gibba003 bash[32348]: cluster 2021-03-10T14:30:00.771321+0000 mgr.gibba043.dnkmem (mgr.34373) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:00 gibba043 bash[24019]: cluster 2021-03-10T14:30:00.000222+0000 mon.a (mon.0) 771 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:00 gibba043 bash[24019]: cluster 2021-03-10T14:30:00.771321+0000 mgr.gibba043.dnkmem (mgr.34373) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:03 gibba043 bash[24019]: cluster 2021-03-10T14:30:02.772385+0000 mgr.gibba043.dnkmem (mgr.34373) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:03 gibba003 bash[31385]: cluster 2021-03-10T14:30:02.772385+0000 mgr.gibba043.dnkmem (mgr.34373) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:03 gibba003 bash[32348]: cluster 2021-03-10T14:30:02.772385+0000 mgr.gibba043.dnkmem (mgr.34373) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: cluster 2021-03-10T14:30:04.774027+0000 mgr.gibba043.dnkmem (mgr.34373) 2087 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.214358+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:30:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.217950+0000 mon.c (mon.1) 578 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.219165+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.220462+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.221761+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.225071+0000 mon.c (mon.1) 582 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[31385]: audit 2021-03-10T14:30:05.226590+0000 mon.c (mon.1) 583 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: cluster 2021-03-10T14:30:04.774027+0000 mgr.gibba043.dnkmem (mgr.34373) 2087 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:06.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.214358+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:30:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.217950+0000 mon.c (mon.1) 578 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.219165+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.220462+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.221761+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.225071+0000 mon.c (mon.1) 582 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:05 gibba003 bash[32348]: audit 2021-03-10T14:30:05.226590+0000 mon.c (mon.1) 583 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: cluster 2021-03-10T14:30:04.774027+0000 mgr.gibba043.dnkmem (mgr.34373) 2087 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.214358+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:30:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.217950+0000 mon.c (mon.1) 578 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.219165+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.220462+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.221761+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.225071+0000 mon.c (mon.1) 582 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:05 gibba043 bash[24019]: audit 2021-03-10T14:30:05.226590+0000 mon.c (mon.1) 583 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:04.985218+0000 mgr.gibba043.dnkmem (mgr.34373) 2088 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:30:07.209 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:04.986775+0000 mgr.gibba043.dnkmem (mgr.34373) 2089 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:30:07.209 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.215015+0000 mgr.gibba043.dnkmem (mgr.34373) 2090 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:30:07.209 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.216568+0000 mgr.gibba043.dnkmem (mgr.34373) 2091 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:30:07.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.217669+0000 mgr.gibba043.dnkmem (mgr.34373) 2092 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:30:07.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.217708+0000 mgr.gibba043.dnkmem (mgr.34373) 2093 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:30:07.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.219023+0000 mgr.gibba043.dnkmem (mgr.34373) 2094 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:30:07.210 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.219061+0000 mgr.gibba043.dnkmem (mgr.34373) 2095 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:30:07.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.220505+0000 mgr.gibba043.dnkmem (mgr.34373) 2096 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:30:07.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.222194+0000 mgr.gibba043.dnkmem (mgr.34373) 2097 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:30:07.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.222233+0000 mgr.gibba043.dnkmem (mgr.34373) 2098 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:30:07.211 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.223607+0000 mgr.gibba043.dnkmem (mgr.34373) 2099 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:30:07.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.223967+0000 mgr.gibba043.dnkmem (mgr.34373) 2100 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:30:07.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.225275+0000 mgr.gibba043.dnkmem (mgr.34373) 2101 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:30:07.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.225314+0000 mgr.gibba043.dnkmem (mgr.34373) 2102 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:30:07.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[31385]: cephadm 2021-03-10T14:30:05.225434+0000 mgr.gibba043.dnkmem (mgr.34373) 2103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:07.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:04.985218+0000 mgr.gibba043.dnkmem (mgr.34373) 2088 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:30:07.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:04.986775+0000 mgr.gibba043.dnkmem (mgr.34373) 2089 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:30:07.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.215015+0000 mgr.gibba043.dnkmem (mgr.34373) 2090 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:30:07.213 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.216568+0000 mgr.gibba043.dnkmem (mgr.34373) 2091 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:30:07.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.217669+0000 mgr.gibba043.dnkmem (mgr.34373) 2092 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:30:07.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.217708+0000 mgr.gibba043.dnkmem (mgr.34373) 2093 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:30:07.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.219023+0000 mgr.gibba043.dnkmem (mgr.34373) 2094 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:30:07.214 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.219061+0000 mgr.gibba043.dnkmem (mgr.34373) 2095 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:30:07.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.220505+0000 mgr.gibba043.dnkmem (mgr.34373) 2096 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:30:07.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.222194+0000 mgr.gibba043.dnkmem (mgr.34373) 2097 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:30:07.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.222233+0000 mgr.gibba043.dnkmem (mgr.34373) 2098 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:30:07.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.223607+0000 mgr.gibba043.dnkmem (mgr.34373) 2099 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:30:07.215 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.223967+0000 mgr.gibba043.dnkmem (mgr.34373) 2100 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:30:07.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.225275+0000 mgr.gibba043.dnkmem (mgr.34373) 2101 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:30:07.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.225314+0000 mgr.gibba043.dnkmem (mgr.34373) 2102 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:30:07.216 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:06 gibba003 bash[32348]: cephadm 2021-03-10T14:30:05.225434+0000 mgr.gibba043.dnkmem (mgr.34373) 2103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:04.985218+0000 mgr.gibba043.dnkmem (mgr.34373) 2088 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:30:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:04.986775+0000 mgr.gibba043.dnkmem (mgr.34373) 2089 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:30:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.215015+0000 mgr.gibba043.dnkmem (mgr.34373) 2090 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:30:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.216568+0000 mgr.gibba043.dnkmem (mgr.34373) 2091 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:30:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.217669+0000 mgr.gibba043.dnkmem (mgr.34373) 2092 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:30:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.217708+0000 mgr.gibba043.dnkmem (mgr.34373) 2093 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:30:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.219023+0000 mgr.gibba043.dnkmem (mgr.34373) 2094 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:30:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.219061+0000 mgr.gibba043.dnkmem (mgr.34373) 2095 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:30:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.220505+0000 mgr.gibba043.dnkmem (mgr.34373) 2096 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:30:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.222194+0000 mgr.gibba043.dnkmem (mgr.34373) 2097 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:30:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.222233+0000 mgr.gibba043.dnkmem (mgr.34373) 2098 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:30:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.223607+0000 mgr.gibba043.dnkmem (mgr.34373) 2099 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:30:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.223967+0000 mgr.gibba043.dnkmem (mgr.34373) 2100 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:30:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.225275+0000 mgr.gibba043.dnkmem (mgr.34373) 2101 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:30:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.225314+0000 mgr.gibba043.dnkmem (mgr.34373) 2102 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:30:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:06 gibba043 bash[24019]: cephadm 2021-03-10T14:30:05.225434+0000 mgr.gibba043.dnkmem (mgr.34373) 2103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:07 gibba003 bash[31385]: cluster 2021-03-10T14:30:06.775350+0000 mgr.gibba043.dnkmem (mgr.34373) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:07 gibba003 bash[32348]: cluster 2021-03-10T14:30:06.775350+0000 mgr.gibba043.dnkmem (mgr.34373) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:07 gibba043 bash[24019]: cluster 2021-03-10T14:30:06.775350+0000 mgr.gibba043.dnkmem (mgr.34373) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:08 gibba003 bash[31385]: cluster 2021-03-10T14:30:08.777040+0000 mgr.gibba043.dnkmem (mgr.34373) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:09.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:08 gibba003 bash[32348]: cluster 2021-03-10T14:30:08.777040+0000 mgr.gibba043.dnkmem (mgr.34373) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:08 gibba043 bash[24019]: cluster 2021-03-10T14:30:08.777040+0000 mgr.gibba043.dnkmem (mgr.34373) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:11 gibba003 bash[31385]: cluster 2021-03-10T14:30:10.778432+0000 mgr.gibba043.dnkmem (mgr.34373) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:12.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:11 gibba003 bash[32348]: cluster 2021-03-10T14:30:10.778432+0000 mgr.gibba043.dnkmem (mgr.34373) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:11 gibba043 bash[24019]: cluster 2021-03-10T14:30:10.778432+0000 mgr.gibba043.dnkmem (mgr.34373) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: cluster 2021-03-10T14:30:12.779839+0000 mgr.gibba043.dnkmem (mgr.34373) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.940802+0000 mon.c (mon.1) 584 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.941508+0000 mon.c (mon.1) 585 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:30:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.942138+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.942210+0000 mon.c (mon.1) 586 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.942883+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.944427+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:30:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.945294+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.946133+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.960591+0000 mon.c (mon.1) 588 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:12.960955+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:13.029824+0000 mon.c (mon.1) 589 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:13 gibba043 bash[24019]: audit 2021-03-10T14:30:13.030746+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: cluster 2021-03-10T14:30:12.779839+0000 mgr.gibba043.dnkmem (mgr.34373) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.940802+0000 mon.c (mon.1) 584 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.941508+0000 mon.c (mon.1) 585 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:30:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.942138+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.942210+0000 mon.c (mon.1) 586 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.942883+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.944427+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:30:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.945294+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.946133+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.960591+0000 mon.c (mon.1) 588 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:12.960955+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:13.029824+0000 mon.c (mon.1) 589 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[31385]: audit 2021-03-10T14:30:13.030746+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: cluster 2021-03-10T14:30:12.779839+0000 mgr.gibba043.dnkmem (mgr.34373) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.940802+0000 mon.c (mon.1) 584 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.941508+0000 mon.c (mon.1) 585 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:30:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.942138+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.942210+0000 mon.c (mon.1) 586 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.942883+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.944427+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:30:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.945294+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.946133+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:30:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.960591+0000 mon.c (mon.1) 588 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:12.960955+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:13.029824+0000 mon.c (mon.1) 589 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:13 gibba003 bash[32348]: audit 2021-03-10T14:30:13.030746+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:15 gibba003 bash[31385]: cluster 2021-03-10T14:30:14.781494+0000 mgr.gibba043.dnkmem (mgr.34373) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:15 gibba003 bash[32348]: cluster 2021-03-10T14:30:14.781494+0000 mgr.gibba043.dnkmem (mgr.34373) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:15 gibba043 bash[24019]: cluster 2021-03-10T14:30:14.781494+0000 mgr.gibba043.dnkmem (mgr.34373) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:17 gibba003 bash[31385]: cluster 2021-03-10T14:30:16.783109+0000 mgr.gibba043.dnkmem (mgr.34373) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:17 gibba003 bash[32348]: cluster 2021-03-10T14:30:16.783109+0000 mgr.gibba043.dnkmem (mgr.34373) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:17 gibba043 bash[24019]: cluster 2021-03-10T14:30:16.783109+0000 mgr.gibba043.dnkmem (mgr.34373) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:18 gibba003 bash[31385]: cluster 2021-03-10T14:30:18.784796+0000 mgr.gibba043.dnkmem (mgr.34373) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:19.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:18 gibba003 bash[32348]: cluster 2021-03-10T14:30:18.784796+0000 mgr.gibba043.dnkmem (mgr.34373) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:18 gibba043 bash[24019]: cluster 2021-03-10T14:30:18.784796+0000 mgr.gibba043.dnkmem (mgr.34373) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:21 gibba003 bash[31385]: cephadm 2021-03-10T14:30:20.240613+0000 mgr.gibba043.dnkmem (mgr.34373) 2111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:21 gibba003 bash[31385]: cluster 2021-03-10T14:30:20.786228+0000 mgr.gibba043.dnkmem (mgr.34373) 2112 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:21 gibba003 bash[32348]: cephadm 2021-03-10T14:30:20.240613+0000 mgr.gibba043.dnkmem (mgr.34373) 2111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:21 gibba003 bash[32348]: cluster 2021-03-10T14:30:20.786228+0000 mgr.gibba043.dnkmem (mgr.34373) 2112 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:21 gibba043 bash[24019]: cephadm 2021-03-10T14:30:20.240613+0000 mgr.gibba043.dnkmem (mgr.34373) 2111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:21 gibba043 bash[24019]: cluster 2021-03-10T14:30:20.786228+0000 mgr.gibba043.dnkmem (mgr.34373) 2112 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:23 gibba043 bash[24019]: cluster 2021-03-10T14:30:22.787052+0000 mgr.gibba043.dnkmem (mgr.34373) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:23 gibba003 bash[31385]: cluster 2021-03-10T14:30:22.787052+0000 mgr.gibba043.dnkmem (mgr.34373) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:23 gibba003 bash[32348]: cluster 2021-03-10T14:30:22.787052+0000 mgr.gibba043.dnkmem (mgr.34373) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:25 gibba003 bash[31385]: cluster 2021-03-10T14:30:24.788690+0000 mgr.gibba043.dnkmem (mgr.34373) 2114 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:25 gibba003 bash[32348]: cluster 2021-03-10T14:30:24.788690+0000 mgr.gibba043.dnkmem (mgr.34373) 2114 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:25 gibba043 bash[24019]: cluster 2021-03-10T14:30:24.788690+0000 mgr.gibba043.dnkmem (mgr.34373) 2114 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:26 gibba003 bash[31385]: cluster 2021-03-10T14:30:26.790235+0000 mgr.gibba043.dnkmem (mgr.34373) 2115 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:26 gibba003 bash[32348]: cluster 2021-03-10T14:30:26.790235+0000 mgr.gibba043.dnkmem (mgr.34373) 2115 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:26 gibba043 bash[24019]: cluster 2021-03-10T14:30:26.790235+0000 mgr.gibba043.dnkmem (mgr.34373) 2115 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.366 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:30:27.596 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:30:27.596 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (38m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:30:27.597 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (43m) 3m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:30:27.597 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:30:27.598 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:30:27.598 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:30:27.599 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:30:27.599 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:30:27.599 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:30:27.600 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:30:27.600 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:30:27.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:30:27.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:30:27.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:30:27.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:30:27.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:30:27.603 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:30:27.603 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:30:27.604 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (34m) 3m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:30:27.604 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (43m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:30:27.604 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:30:27.847 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:30:27.847 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:30:27.847 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:27.847 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:30:27.848 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:30:27.848 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:27.848 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:30:27.848 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:30:27.848 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:30:27.849 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:30:27.849 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:30:27.849 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:30:27.849 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:30:27.850 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:30:27.850 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:30:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:28 gibba043 bash[24019]: audit 2021-03-10T14:30:27.356346+0000 mgr.gibba043.dnkmem (mgr.34373) 2116 : audit [DBG] from='client.55462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:28 gibba043 bash[24019]: audit 2021-03-10T14:30:27.582554+0000 mgr.gibba043.dnkmem (mgr.34373) 2117 : audit [DBG] from='client.55468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:28 gibba043 bash[24019]: audit 2021-03-10T14:30:27.847797+0000 mon.c (mon.1) 590 : audit [DBG] from='client.? 172.21.2.103:0/307079707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:28 gibba003 bash[31385]: audit 2021-03-10T14:30:27.356346+0000 mgr.gibba043.dnkmem (mgr.34373) 2116 : audit [DBG] from='client.55462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:28 gibba003 bash[31385]: audit 2021-03-10T14:30:27.582554+0000 mgr.gibba043.dnkmem (mgr.34373) 2117 : audit [DBG] from='client.55468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:28 gibba003 bash[31385]: audit 2021-03-10T14:30:27.847797+0000 mon.c (mon.1) 590 : audit [DBG] from='client.? 172.21.2.103:0/307079707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:28 gibba003 bash[32348]: audit 2021-03-10T14:30:27.356346+0000 mgr.gibba043.dnkmem (mgr.34373) 2116 : audit [DBG] from='client.55462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:28 gibba003 bash[32348]: audit 2021-03-10T14:30:27.582554+0000 mgr.gibba043.dnkmem (mgr.34373) 2117 : audit [DBG] from='client.55468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:28 gibba003 bash[32348]: audit 2021-03-10T14:30:27.847797+0000 mon.c (mon.1) 590 : audit [DBG] from='client.? 172.21.2.103:0/307079707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:29 gibba043 bash[24019]: cluster 2021-03-10T14:30:28.791038+0000 mgr.gibba043.dnkmem (mgr.34373) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:29 gibba003 bash[31385]: cluster 2021-03-10T14:30:28.791038+0000 mgr.gibba043.dnkmem (mgr.34373) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:29 gibba003 bash[32348]: cluster 2021-03-10T14:30:28.791038+0000 mgr.gibba043.dnkmem (mgr.34373) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:31 gibba003 bash[31385]: cluster 2021-03-10T14:30:30.792641+0000 mgr.gibba043.dnkmem (mgr.34373) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:31 gibba003 bash[32348]: cluster 2021-03-10T14:30:30.792641+0000 mgr.gibba043.dnkmem (mgr.34373) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:31 gibba043 bash[24019]: cluster 2021-03-10T14:30:30.792641+0000 mgr.gibba043.dnkmem (mgr.34373) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:33 gibba043 bash[24019]: cluster 2021-03-10T14:30:32.793725+0000 mgr.gibba043.dnkmem (mgr.34373) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:33 gibba003 bash[31385]: cluster 2021-03-10T14:30:32.793725+0000 mgr.gibba043.dnkmem (mgr.34373) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:33 gibba003 bash[32348]: cluster 2021-03-10T14:30:32.793725+0000 mgr.gibba043.dnkmem (mgr.34373) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:35 gibba003 bash[31385]: cluster 2021-03-10T14:30:34.795233+0000 mgr.gibba043.dnkmem (mgr.34373) 2121 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:35 gibba003 bash[32348]: cluster 2021-03-10T14:30:34.795233+0000 mgr.gibba043.dnkmem (mgr.34373) 2121 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:35 gibba043 bash[24019]: cluster 2021-03-10T14:30:34.795233+0000 mgr.gibba043.dnkmem (mgr.34373) 2121 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:36 gibba003 bash[31385]: cephadm 2021-03-10T14:30:35.256334+0000 mgr.gibba043.dnkmem (mgr.34373) 2122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:36 gibba003 bash[31385]: cluster 2021-03-10T14:30:36.796892+0000 mgr.gibba043.dnkmem (mgr.34373) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:36 gibba003 bash[32348]: cephadm 2021-03-10T14:30:35.256334+0000 mgr.gibba043.dnkmem (mgr.34373) 2122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:36 gibba003 bash[32348]: cluster 2021-03-10T14:30:36.796892+0000 mgr.gibba043.dnkmem (mgr.34373) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:36 gibba043 bash[24019]: cephadm 2021-03-10T14:30:35.256334+0000 mgr.gibba043.dnkmem (mgr.34373) 2122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:36 gibba043 bash[24019]: cluster 2021-03-10T14:30:36.796892+0000 mgr.gibba043.dnkmem (mgr.34373) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:39 gibba003 bash[31385]: cluster 2021-03-10T14:30:38.798563+0000 mgr.gibba043.dnkmem (mgr.34373) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:39 gibba003 bash[32348]: cluster 2021-03-10T14:30:38.798563+0000 mgr.gibba043.dnkmem (mgr.34373) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:39 gibba043 bash[24019]: cluster 2021-03-10T14:30:38.798563+0000 mgr.gibba043.dnkmem (mgr.34373) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:40 gibba003 bash[31385]: cluster 2021-03-10T14:30:40.800341+0000 mgr.gibba043.dnkmem (mgr.34373) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:40 gibba003 bash[32348]: cluster 2021-03-10T14:30:40.800341+0000 mgr.gibba043.dnkmem (mgr.34373) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:40 gibba043 bash[24019]: cluster 2021-03-10T14:30:40.800341+0000 mgr.gibba043.dnkmem (mgr.34373) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:43 gibba043 bash[24019]: cluster 2021-03-10T14:30:42.801919+0000 mgr.gibba043.dnkmem (mgr.34373) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:43 gibba003 bash[31385]: cluster 2021-03-10T14:30:42.801919+0000 mgr.gibba043.dnkmem (mgr.34373) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:43 gibba003 bash[32348]: cluster 2021-03-10T14:30:42.801919+0000 mgr.gibba043.dnkmem (mgr.34373) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:45 gibba003 bash[31385]: cluster 2021-03-10T14:30:44.803500+0000 mgr.gibba043.dnkmem (mgr.34373) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:45 gibba003 bash[32348]: cluster 2021-03-10T14:30:44.803500+0000 mgr.gibba043.dnkmem (mgr.34373) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:46.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:45 gibba043 bash[24019]: cluster 2021-03-10T14:30:44.803500+0000 mgr.gibba043.dnkmem (mgr.34373) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:46 gibba003 bash[31385]: cluster 2021-03-10T14:30:46.805127+0000 mgr.gibba043.dnkmem (mgr.34373) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:47.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:46 gibba003 bash[32348]: cluster 2021-03-10T14:30:46.805127+0000 mgr.gibba043.dnkmem (mgr.34373) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:46 gibba043 bash[24019]: cluster 2021-03-10T14:30:46.805127+0000 mgr.gibba043.dnkmem (mgr.34373) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:48 gibba003 bash[31385]: cluster 2021-03-10T14:30:48.806659+0000 mgr.gibba043.dnkmem (mgr.34373) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:49.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:48 gibba003 bash[32348]: cluster 2021-03-10T14:30:48.806659+0000 mgr.gibba043.dnkmem (mgr.34373) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:48 gibba043 bash[24019]: cluster 2021-03-10T14:30:48.806659+0000 mgr.gibba043.dnkmem (mgr.34373) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:50 gibba003 bash[31385]: cephadm 2021-03-10T14:30:50.272374+0000 mgr.gibba043.dnkmem (mgr.34373) 2130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:50 gibba003 bash[31385]: cluster 2021-03-10T14:30:50.808263+0000 mgr.gibba043.dnkmem (mgr.34373) 2131 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:50 gibba003 bash[32348]: cephadm 2021-03-10T14:30:50.272374+0000 mgr.gibba043.dnkmem (mgr.34373) 2130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:51.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:50 gibba003 bash[32348]: cluster 2021-03-10T14:30:50.808263+0000 mgr.gibba043.dnkmem (mgr.34373) 2131 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:50 gibba043 bash[24019]: cephadm 2021-03-10T14:30:50.272374+0000 mgr.gibba043.dnkmem (mgr.34373) 2130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:30:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:50 gibba043 bash[24019]: cluster 2021-03-10T14:30:50.808263+0000 mgr.gibba043.dnkmem (mgr.34373) 2131 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:53 gibba043 bash[24019]: cluster 2021-03-10T14:30:52.809867+0000 mgr.gibba043.dnkmem (mgr.34373) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:53 gibba003 bash[31385]: cluster 2021-03-10T14:30:52.809867+0000 mgr.gibba043.dnkmem (mgr.34373) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:53 gibba003 bash[32348]: cluster 2021-03-10T14:30:52.809867+0000 mgr.gibba043.dnkmem (mgr.34373) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:54 gibba003 bash[31385]: cluster 2021-03-10T14:30:54.811439+0000 mgr.gibba043.dnkmem (mgr.34373) 2133 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:54 gibba003 bash[32348]: cluster 2021-03-10T14:30:54.811439+0000 mgr.gibba043.dnkmem (mgr.34373) 2133 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:54 gibba043 bash[24019]: cluster 2021-03-10T14:30:54.811439+0000 mgr.gibba043.dnkmem (mgr.34373) 2133 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:56 gibba003 bash[31385]: cluster 2021-03-10T14:30:56.812875+0000 mgr.gibba043.dnkmem (mgr.34373) 2134 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:56 gibba003 bash[32348]: cluster 2021-03-10T14:30:56.812875+0000 mgr.gibba043.dnkmem (mgr.34373) 2134 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:56 gibba043 bash[24019]: cluster 2021-03-10T14:30:56.812875+0000 mgr.gibba043.dnkmem (mgr.34373) 2134 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:58.094 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:30:58.320 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:30:58.321 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (39m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:30:58.321 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (44m) 3m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:30:58.321 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:30:58.321 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:30:58.322 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (39m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:30:58.322 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:30:58.322 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (38m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:30:58.322 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:30:58.323 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:30:58.323 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:30:58.323 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:30:58.323 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:30:58.323 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:30:58.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:30:58.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:30:58.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:30:58.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:30:58.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:30:58.325 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (44m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:30:58.325 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:30:58.606 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:30:58.606 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:30:58.607 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:58.607 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:30:58.607 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:30:58.607 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:58.608 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:30:58.608 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:30:58.608 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:30:58.608 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:30:58.609 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:30:58.609 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:30:58.609 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:30:58.610 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:30:58.610 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:30:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:58 gibba043 bash[24019]: audit 2021-03-10T14:30:58.607180+0000 mon.a (mon.0) 779 : audit [DBG] from='client.? 172.21.2.103:0/2169244109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:58 gibba003 bash[31385]: audit 2021-03-10T14:30:58.607180+0000 mon.a (mon.0) 779 : audit [DBG] from='client.? 172.21.2.103:0/2169244109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:59.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:58 gibba003 bash[32348]: audit 2021-03-10T14:30:58.607180+0000 mon.a (mon.0) 779 : audit [DBG] from='client.? 172.21.2.103:0/2169244109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:59 gibba043 bash[24019]: audit 2021-03-10T14:30:58.083844+0000 mgr.gibba043.dnkmem (mgr.34373) 2135 : audit [DBG] from='client.55480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:00.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:59 gibba043 bash[24019]: audit 2021-03-10T14:30:58.308452+0000 mgr.gibba043.dnkmem (mgr.34373) 2136 : audit [DBG] from='client.55486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:00.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:30:59 gibba043 bash[24019]: cluster 2021-03-10T14:30:58.813731+0000 mgr.gibba043.dnkmem (mgr.34373) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:59 gibba003 bash[31385]: audit 2021-03-10T14:30:58.083844+0000 mgr.gibba043.dnkmem (mgr.34373) 2135 : audit [DBG] from='client.55480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:59 gibba003 bash[31385]: audit 2021-03-10T14:30:58.308452+0000 mgr.gibba043.dnkmem (mgr.34373) 2136 : audit [DBG] from='client.55486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:30:59 gibba003 bash[31385]: cluster 2021-03-10T14:30:58.813731+0000 mgr.gibba043.dnkmem (mgr.34373) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:59 gibba003 bash[32348]: audit 2021-03-10T14:30:58.083844+0000 mgr.gibba043.dnkmem (mgr.34373) 2135 : audit [DBG] from='client.55480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:59 gibba003 bash[32348]: audit 2021-03-10T14:30:58.308452+0000 mgr.gibba043.dnkmem (mgr.34373) 2136 : audit [DBG] from='client.55486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:30:59 gibba003 bash[32348]: cluster 2021-03-10T14:30:58.813731+0000 mgr.gibba043.dnkmem (mgr.34373) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:00 gibba003 bash[31385]: cluster 2021-03-10T14:31:00.815385+0000 mgr.gibba043.dnkmem (mgr.34373) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:01.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:00 gibba003 bash[32348]: cluster 2021-03-10T14:31:00.815385+0000 mgr.gibba043.dnkmem (mgr.34373) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:00 gibba043 bash[24019]: cluster 2021-03-10T14:31:00.815385+0000 mgr.gibba043.dnkmem (mgr.34373) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:03 gibba043 bash[24019]: cluster 2021-03-10T14:31:02.816587+0000 mgr.gibba043.dnkmem (mgr.34373) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:03 gibba003 bash[31385]: cluster 2021-03-10T14:31:02.816587+0000 mgr.gibba043.dnkmem (mgr.34373) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:03 gibba003 bash[32348]: cluster 2021-03-10T14:31:02.816587+0000 mgr.gibba043.dnkmem (mgr.34373) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:05.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:04 gibba003 bash[31385]: cluster 2021-03-10T14:31:04.818074+0000 mgr.gibba043.dnkmem (mgr.34373) 2140 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:05.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:04 gibba003 bash[32348]: cluster 2021-03-10T14:31:04.818074+0000 mgr.gibba043.dnkmem (mgr.34373) 2140 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:04 gibba043 bash[24019]: cluster 2021-03-10T14:31:04.818074+0000 mgr.gibba043.dnkmem (mgr.34373) 2140 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:06.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.285384+0000 mgr.gibba043.dnkmem (mgr.34373) 2141 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:31:06.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.286908+0000 mgr.gibba043.dnkmem (mgr.34373) 2142 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:31:06.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.497706+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:31:06.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.498554+0000 mgr.gibba043.dnkmem (mgr.34373) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:06.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.500784+0000 mgr.gibba043.dnkmem (mgr.34373) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:06.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.501726+0000 mon.c (mon.1) 591 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:06.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.502296+0000 mgr.gibba043.dnkmem (mgr.34373) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:06.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.502333+0000 mgr.gibba043.dnkmem (mgr.34373) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:06.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.503398+0000 mon.c (mon.1) 592 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.503960+0000 mgr.gibba043.dnkmem (mgr.34373) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:06.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.504043+0000 mgr.gibba043.dnkmem (mgr.34373) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:06.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.505113+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.505667+0000 mgr.gibba043.dnkmem (mgr.34373) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:06.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.506761+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.507760+0000 mgr.gibba043.dnkmem (mgr.34373) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:06.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.507799+0000 mgr.gibba043.dnkmem (mgr.34373) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:06.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.509197+0000 mgr.gibba043.dnkmem (mgr.34373) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:06.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.509557+0000 mgr.gibba043.dnkmem (mgr.34373) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:06.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.510628+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.510676+0000 mgr.gibba043.dnkmem (mgr.34373) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:06.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.510717+0000 mgr.gibba043.dnkmem (mgr.34373) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:06.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: cephadm 2021-03-10T14:31:05.510892+0000 mgr.gibba043.dnkmem (mgr.34373) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:06.782 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:06 gibba043 bash[24019]: audit 2021-03-10T14:31:05.512066+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.285384+0000 mgr.gibba043.dnkmem (mgr.34373) 2141 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:31:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.286908+0000 mgr.gibba043.dnkmem (mgr.34373) 2142 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:31:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.497706+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:31:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.498554+0000 mgr.gibba043.dnkmem (mgr.34373) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.500784+0000 mgr.gibba043.dnkmem (mgr.34373) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.501726+0000 mon.c (mon.1) 591 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.502296+0000 mgr.gibba043.dnkmem (mgr.34373) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.502333+0000 mgr.gibba043.dnkmem (mgr.34373) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:06.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.503398+0000 mon.c (mon.1) 592 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.503960+0000 mgr.gibba043.dnkmem (mgr.34373) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:06.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.504043+0000 mgr.gibba043.dnkmem (mgr.34373) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:06.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.505113+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.505667+0000 mgr.gibba043.dnkmem (mgr.34373) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:06.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.506761+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.507760+0000 mgr.gibba043.dnkmem (mgr.34373) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:06.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.507799+0000 mgr.gibba043.dnkmem (mgr.34373) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:06.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.509197+0000 mgr.gibba043.dnkmem (mgr.34373) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:06.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.509557+0000 mgr.gibba043.dnkmem (mgr.34373) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:06.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.510628+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.510676+0000 mgr.gibba043.dnkmem (mgr.34373) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:06.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.510717+0000 mgr.gibba043.dnkmem (mgr.34373) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:06.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: cephadm 2021-03-10T14:31:05.510892+0000 mgr.gibba043.dnkmem (mgr.34373) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:06.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[31385]: audit 2021-03-10T14:31:05.512066+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.285384+0000 mgr.gibba043.dnkmem (mgr.34373) 2141 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:31:06.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.286908+0000 mgr.gibba043.dnkmem (mgr.34373) 2142 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:31:06.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.497706+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:31:06.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.498554+0000 mgr.gibba043.dnkmem (mgr.34373) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:06.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.500784+0000 mgr.gibba043.dnkmem (mgr.34373) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:06.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.501726+0000 mon.c (mon.1) 591 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:06.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.502296+0000 mgr.gibba043.dnkmem (mgr.34373) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:06.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.502333+0000 mgr.gibba043.dnkmem (mgr.34373) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:06.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.503398+0000 mon.c (mon.1) 592 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.503960+0000 mgr.gibba043.dnkmem (mgr.34373) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:06.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.504043+0000 mgr.gibba043.dnkmem (mgr.34373) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:06.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.505113+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.505667+0000 mgr.gibba043.dnkmem (mgr.34373) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:06.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.506761+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.507760+0000 mgr.gibba043.dnkmem (mgr.34373) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:06.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.507799+0000 mgr.gibba043.dnkmem (mgr.34373) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:06.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.509197+0000 mgr.gibba043.dnkmem (mgr.34373) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:06.959 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.509557+0000 mgr.gibba043.dnkmem (mgr.34373) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:06.959 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.510628+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:06.960 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.510676+0000 mgr.gibba043.dnkmem (mgr.34373) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:06.960 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.510717+0000 mgr.gibba043.dnkmem (mgr.34373) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:06.961 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: cephadm 2021-03-10T14:31:05.510892+0000 mgr.gibba043.dnkmem (mgr.34373) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:06.961 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:06 gibba003 bash[32348]: audit 2021-03-10T14:31:05.512066+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:07 gibba043 bash[24019]: cluster 2021-03-10T14:31:06.819775+0000 mgr.gibba043.dnkmem (mgr.34373) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:07 gibba003 bash[31385]: cluster 2021-03-10T14:31:06.819775+0000 mgr.gibba043.dnkmem (mgr.34373) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:07 gibba003 bash[32348]: cluster 2021-03-10T14:31:06.819775+0000 mgr.gibba043.dnkmem (mgr.34373) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:08 gibba003 bash[31385]: cluster 2021-03-10T14:31:08.821144+0000 mgr.gibba043.dnkmem (mgr.34373) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:09.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:08 gibba003 bash[32348]: cluster 2021-03-10T14:31:08.821144+0000 mgr.gibba043.dnkmem (mgr.34373) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:08 gibba043 bash[24019]: cluster 2021-03-10T14:31:08.821144+0000 mgr.gibba043.dnkmem (mgr.34373) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:10 gibba003 bash[31385]: cluster 2021-03-10T14:31:10.822793+0000 mgr.gibba043.dnkmem (mgr.34373) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:11.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:10 gibba003 bash[32348]: cluster 2021-03-10T14:31:10.822793+0000 mgr.gibba043.dnkmem (mgr.34373) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:10 gibba043 bash[24019]: cluster 2021-03-10T14:31:10.822793+0000 mgr.gibba043.dnkmem (mgr.34373) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: cluster 2021-03-10T14:31:12.824394+0000 mgr.gibba043.dnkmem (mgr.34373) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.952438+0000 mon.c (mon.1) 597 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:31:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.953215+0000 mon.c (mon.1) 598 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.953791+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:31:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.953879+0000 mon.c (mon.1) 599 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:31:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.954564+0000 mon.c (mon.1) 600 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.956129+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.957089+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:31:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.957899+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.963835+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:12.964116+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:13.037735+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:13 gibba043 bash[24019]: audit 2021-03-10T14:31:13.038867+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: cluster 2021-03-10T14:31:12.824394+0000 mgr.gibba043.dnkmem (mgr.34373) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.952438+0000 mon.c (mon.1) 597 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:31:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.953215+0000 mon.c (mon.1) 598 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.953791+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:31:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.953879+0000 mon.c (mon.1) 599 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:31:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.954564+0000 mon.c (mon.1) 600 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.956129+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.957089+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:31:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.957899+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.963835+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:12.964116+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:13.037735+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[31385]: audit 2021-03-10T14:31:13.038867+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: cluster 2021-03-10T14:31:12.824394+0000 mgr.gibba043.dnkmem (mgr.34373) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.952438+0000 mon.c (mon.1) 597 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:31:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.953215+0000 mon.c (mon.1) 598 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.953791+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:31:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.953879+0000 mon.c (mon.1) 599 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:31:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.954564+0000 mon.c (mon.1) 600 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.956129+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.957089+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:31:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.957899+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:31:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.963835+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:12.964116+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:13.037735+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:13 gibba003 bash[32348]: audit 2021-03-10T14:31:13.038867+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:14 gibba003 bash[31385]: cluster 2021-03-10T14:31:14.825993+0000 mgr.gibba043.dnkmem (mgr.34373) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:14 gibba003 bash[32348]: cluster 2021-03-10T14:31:14.825993+0000 mgr.gibba043.dnkmem (mgr.34373) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:14 gibba043 bash[24019]: cluster 2021-03-10T14:31:14.825993+0000 mgr.gibba043.dnkmem (mgr.34373) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:16 gibba003 bash[31385]: cluster 2021-03-10T14:31:16.827489+0000 mgr.gibba043.dnkmem (mgr.34373) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:17.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:16 gibba003 bash[32348]: cluster 2021-03-10T14:31:16.827489+0000 mgr.gibba043.dnkmem (mgr.34373) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:16 gibba043 bash[24019]: cluster 2021-03-10T14:31:16.827489+0000 mgr.gibba043.dnkmem (mgr.34373) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:18 gibba003 bash[31385]: cluster 2021-03-10T14:31:18.829120+0000 mgr.gibba043.dnkmem (mgr.34373) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:18 gibba003 bash[32348]: cluster 2021-03-10T14:31:18.829120+0000 mgr.gibba043.dnkmem (mgr.34373) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:18 gibba043 bash[24019]: cluster 2021-03-10T14:31:18.829120+0000 mgr.gibba043.dnkmem (mgr.34373) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:20 gibba003 bash[31385]: cephadm 2021-03-10T14:31:20.526909+0000 mgr.gibba043.dnkmem (mgr.34373) 2164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:20 gibba003 bash[31385]: cluster 2021-03-10T14:31:20.830571+0000 mgr.gibba043.dnkmem (mgr.34373) 2165 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:20 gibba003 bash[32348]: cephadm 2021-03-10T14:31:20.526909+0000 mgr.gibba043.dnkmem (mgr.34373) 2164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:20 gibba003 bash[32348]: cluster 2021-03-10T14:31:20.830571+0000 mgr.gibba043.dnkmem (mgr.34373) 2165 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:21.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:20 gibba043 bash[24019]: cephadm 2021-03-10T14:31:20.526909+0000 mgr.gibba043.dnkmem (mgr.34373) 2164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:20 gibba043 bash[24019]: cluster 2021-03-10T14:31:20.830571+0000 mgr.gibba043.dnkmem (mgr.34373) 2165 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:23 gibba043 bash[24019]: cluster 2021-03-10T14:31:22.831770+0000 mgr.gibba043.dnkmem (mgr.34373) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:23 gibba003 bash[31385]: cluster 2021-03-10T14:31:22.831770+0000 mgr.gibba043.dnkmem (mgr.34373) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:23 gibba003 bash[32348]: cluster 2021-03-10T14:31:22.831770+0000 mgr.gibba043.dnkmem (mgr.34373) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:24 gibba003 bash[31385]: cluster 2021-03-10T14:31:24.833267+0000 mgr.gibba043.dnkmem (mgr.34373) 2167 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:24 gibba003 bash[32348]: cluster 2021-03-10T14:31:24.833267+0000 mgr.gibba043.dnkmem (mgr.34373) 2167 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:24 gibba043 bash[24019]: cluster 2021-03-10T14:31:24.833267+0000 mgr.gibba043.dnkmem (mgr.34373) 2167 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:26 gibba003 bash[31385]: cluster 2021-03-10T14:31:26.834971+0000 mgr.gibba043.dnkmem (mgr.34373) 2168 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:26 gibba003 bash[32348]: cluster 2021-03-10T14:31:26.834971+0000 mgr.gibba043.dnkmem (mgr.34373) 2168 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:26 gibba043 bash[24019]: cluster 2021-03-10T14:31:26.834971+0000 mgr.gibba043.dnkmem (mgr.34373) 2168 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:28.848 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:31:29.080 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:31:29.081 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (39m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:31:29.081 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (44m) 4m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:31:29.081 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:31:29.081 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:31:29.081 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:31:29.082 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:31:29.082 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:31:29.082 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:31:29.082 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:31:29.083 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:31:29.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:31:29.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:31:29.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:31:29.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:31:29.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:31:29.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:31:29.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:31:29.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (35m) 4m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:31:29.084 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (44m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:31:29.085 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:31:29.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:28 gibba003 bash[31385]: cluster 2021-03-10T14:31:28.835461+0000 mgr.gibba043.dnkmem (mgr.34373) 2169 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:28 gibba003 bash[31385]: audit 2021-03-10T14:31:28.838505+0000 mgr.gibba043.dnkmem (mgr.34373) 2170 : audit [DBG] from='client.45513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:28 gibba003 bash[32348]: cluster 2021-03-10T14:31:28.835461+0000 mgr.gibba043.dnkmem (mgr.34373) 2169 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:28 gibba003 bash[32348]: audit 2021-03-10T14:31:28.838505+0000 mgr.gibba043.dnkmem (mgr.34373) 2170 : audit [DBG] from='client.45513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:28 gibba043 bash[24019]: cluster 2021-03-10T14:31:28.835461+0000 mgr.gibba043.dnkmem (mgr.34373) 2169 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:28 gibba043 bash[24019]: audit 2021-03-10T14:31:28.838505+0000 mgr.gibba043.dnkmem (mgr.34373) 2170 : audit [DBG] from='client.45513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:29.331 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:31:29.331 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:31:29.331 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:29.331 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:31:29.331 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:31:29.332 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:29.332 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:31:29.332 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:31:29.332 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:31:29.332 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:31:29.333 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:31:29.333 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:31:29.333 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:31:29.333 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:31:29.334 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:31:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:29 gibba003 bash[31385]: audit 2021-03-10T14:31:29.066931+0000 mgr.gibba043.dnkmem (mgr.34373) 2171 : audit [DBG] from='client.45519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:29 gibba003 bash[31385]: audit 2021-03-10T14:31:29.332072+0000 mon.a (mon.0) 787 : audit [DBG] from='client.? 172.21.2.103:0/1891511353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:29 gibba003 bash[32348]: audit 2021-03-10T14:31:29.066931+0000 mgr.gibba043.dnkmem (mgr.34373) 2171 : audit [DBG] from='client.45519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:29 gibba003 bash[32348]: audit 2021-03-10T14:31:29.332072+0000 mon.a (mon.0) 787 : audit [DBG] from='client.? 172.21.2.103:0/1891511353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:29 gibba043 bash[24019]: audit 2021-03-10T14:31:29.066931+0000 mgr.gibba043.dnkmem (mgr.34373) 2171 : audit [DBG] from='client.45519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:30.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:29 gibba043 bash[24019]: audit 2021-03-10T14:31:29.332072+0000 mon.a (mon.0) 787 : audit [DBG] from='client.? 172.21.2.103:0/1891511353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:30 gibba043 bash[24019]: cluster 2021-03-10T14:31:30.837067+0000 mgr.gibba043.dnkmem (mgr.34373) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:30 gibba003 bash[31385]: cluster 2021-03-10T14:31:30.837067+0000 mgr.gibba043.dnkmem (mgr.34373) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:30 gibba003 bash[32348]: cluster 2021-03-10T14:31:30.837067+0000 mgr.gibba043.dnkmem (mgr.34373) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:33 gibba043 bash[24019]: cluster 2021-03-10T14:31:32.838024+0000 mgr.gibba043.dnkmem (mgr.34373) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:33 gibba003 bash[31385]: cluster 2021-03-10T14:31:32.838024+0000 mgr.gibba043.dnkmem (mgr.34373) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:33 gibba003 bash[32348]: cluster 2021-03-10T14:31:32.838024+0000 mgr.gibba043.dnkmem (mgr.34373) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:34 gibba003 bash[31385]: cluster 2021-03-10T14:31:34.839661+0000 mgr.gibba043.dnkmem (mgr.34373) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:35.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:34 gibba003 bash[32348]: cluster 2021-03-10T14:31:34.839661+0000 mgr.gibba043.dnkmem (mgr.34373) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:35.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:34 gibba043 bash[24019]: cluster 2021-03-10T14:31:34.839661+0000 mgr.gibba043.dnkmem (mgr.34373) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:35 gibba043 bash[24019]: cephadm 2021-03-10T14:31:35.539960+0000 mgr.gibba043.dnkmem (mgr.34373) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:36.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:35 gibba003 bash[32348]: cephadm 2021-03-10T14:31:35.539960+0000 mgr.gibba043.dnkmem (mgr.34373) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:35 gibba003 bash[31385]: cephadm 2021-03-10T14:31:35.539960+0000 mgr.gibba043.dnkmem (mgr.34373) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:36 gibba043 bash[24019]: cluster 2021-03-10T14:31:36.841057+0000 mgr.gibba043.dnkmem (mgr.34373) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:36 gibba003 bash[31385]: cluster 2021-03-10T14:31:36.841057+0000 mgr.gibba043.dnkmem (mgr.34373) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:36 gibba003 bash[32348]: cluster 2021-03-10T14:31:36.841057+0000 mgr.gibba043.dnkmem (mgr.34373) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:38 gibba003 bash[31385]: cluster 2021-03-10T14:31:38.842686+0000 mgr.gibba043.dnkmem (mgr.34373) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:38 gibba003 bash[32348]: cluster 2021-03-10T14:31:38.842686+0000 mgr.gibba043.dnkmem (mgr.34373) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:38 gibba043 bash[24019]: cluster 2021-03-10T14:31:38.842686+0000 mgr.gibba043.dnkmem (mgr.34373) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:40 gibba003 bash[31385]: cluster 2021-03-10T14:31:40.844153+0000 mgr.gibba043.dnkmem (mgr.34373) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:40 gibba003 bash[32348]: cluster 2021-03-10T14:31:40.844153+0000 mgr.gibba043.dnkmem (mgr.34373) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:40 gibba043 bash[24019]: cluster 2021-03-10T14:31:40.844153+0000 mgr.gibba043.dnkmem (mgr.34373) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:43 gibba043 bash[24019]: cluster 2021-03-10T14:31:42.845694+0000 mgr.gibba043.dnkmem (mgr.34373) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:43 gibba003 bash[31385]: cluster 2021-03-10T14:31:42.845694+0000 mgr.gibba043.dnkmem (mgr.34373) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:43 gibba003 bash[32348]: cluster 2021-03-10T14:31:42.845694+0000 mgr.gibba043.dnkmem (mgr.34373) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:44 gibba043 bash[24019]: cluster 2021-03-10T14:31:44.847123+0000 mgr.gibba043.dnkmem (mgr.34373) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:44 gibba003 bash[31385]: cluster 2021-03-10T14:31:44.847123+0000 mgr.gibba043.dnkmem (mgr.34373) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:44 gibba003 bash[32348]: cluster 2021-03-10T14:31:44.847123+0000 mgr.gibba043.dnkmem (mgr.34373) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:46 gibba043 bash[24019]: cluster 2021-03-10T14:31:46.848756+0000 mgr.gibba043.dnkmem (mgr.34373) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:46 gibba003 bash[31385]: cluster 2021-03-10T14:31:46.848756+0000 mgr.gibba043.dnkmem (mgr.34373) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:46 gibba003 bash[32348]: cluster 2021-03-10T14:31:46.848756+0000 mgr.gibba043.dnkmem (mgr.34373) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:48 gibba043 bash[24019]: cluster 2021-03-10T14:31:48.850128+0000 mgr.gibba043.dnkmem (mgr.34373) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:48 gibba003 bash[31385]: cluster 2021-03-10T14:31:48.850128+0000 mgr.gibba043.dnkmem (mgr.34373) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:48 gibba003 bash[32348]: cluster 2021-03-10T14:31:48.850128+0000 mgr.gibba043.dnkmem (mgr.34373) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:50 gibba043 bash[24019]: cephadm 2021-03-10T14:31:50.555961+0000 mgr.gibba043.dnkmem (mgr.34373) 2183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:50 gibba043 bash[24019]: cluster 2021-03-10T14:31:50.851734+0000 mgr.gibba043.dnkmem (mgr.34373) 2184 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:51.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:50 gibba003 bash[32348]: cephadm 2021-03-10T14:31:50.555961+0000 mgr.gibba043.dnkmem (mgr.34373) 2183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:50 gibba003 bash[32348]: cluster 2021-03-10T14:31:50.851734+0000 mgr.gibba043.dnkmem (mgr.34373) 2184 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:50 gibba003 bash[31385]: cephadm 2021-03-10T14:31:50.555961+0000 mgr.gibba043.dnkmem (mgr.34373) 2183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:31:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:50 gibba003 bash[31385]: cluster 2021-03-10T14:31:50.851734+0000 mgr.gibba043.dnkmem (mgr.34373) 2184 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:53 gibba003 bash[31385]: cluster 2021-03-10T14:31:52.853107+0000 mgr.gibba043.dnkmem (mgr.34373) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:53 gibba003 bash[32348]: cluster 2021-03-10T14:31:52.853107+0000 mgr.gibba043.dnkmem (mgr.34373) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:53 gibba043 bash[24019]: cluster 2021-03-10T14:31:52.853107+0000 mgr.gibba043.dnkmem (mgr.34373) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:55.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:54 gibba043 bash[24019]: cluster 2021-03-10T14:31:54.854649+0000 mgr.gibba043.dnkmem (mgr.34373) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:54 gibba003 bash[31385]: cluster 2021-03-10T14:31:54.854649+0000 mgr.gibba043.dnkmem (mgr.34373) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:54 gibba003 bash[32348]: cluster 2021-03-10T14:31:54.854649+0000 mgr.gibba043.dnkmem (mgr.34373) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:56 gibba043 bash[24019]: cluster 2021-03-10T14:31:56.856331+0000 mgr.gibba043.dnkmem (mgr.34373) 2187 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:56 gibba003 bash[31385]: cluster 2021-03-10T14:31:56.856331+0000 mgr.gibba043.dnkmem (mgr.34373) 2187 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:56 gibba003 bash[32348]: cluster 2021-03-10T14:31:56.856331+0000 mgr.gibba043.dnkmem (mgr.34373) 2187 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:58 gibba043 bash[24019]: cluster 2021-03-10T14:31:58.857700+0000 mgr.gibba043.dnkmem (mgr.34373) 2188 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:58 gibba003 bash[31385]: cluster 2021-03-10T14:31:58.857700+0000 mgr.gibba043.dnkmem (mgr.34373) 2188 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:58 gibba003 bash[32348]: cluster 2021-03-10T14:31:58.857700+0000 mgr.gibba043.dnkmem (mgr.34373) 2188 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:59.574 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:31:59.799 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:31:59.800 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (40m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:31:59.800 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (45m) 4m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:31:59.800 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (40m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:31:59.800 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (41m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:31:59.801 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (40m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:31:59.801 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:31:59.801 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (39m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:31:59.801 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:31:59.801 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:31:59.802 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:31:59.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:31:59.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:31:59.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:31:59.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:31:59.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:31:59.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:31:59.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:31:59.803 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:31:59.804 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (45m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:31:59.804 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:32:00.052 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:32:00.052 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:32:00.052 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:00.053 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:32:00.053 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:32:00.053 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:00.053 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:32:00.053 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:32:00.054 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:32:00.054 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:32:00.054 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:32:00.054 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:32:00.054 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:32:00.055 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:32:00.055 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:32:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:59 gibba043 bash[24019]: audit 2021-03-10T14:31:59.564172+0000 mgr.gibba043.dnkmem (mgr.34373) 2189 : audit [DBG] from='client.55516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:31:59 gibba043 bash[24019]: audit 2021-03-10T14:31:59.786116+0000 mgr.gibba043.dnkmem (mgr.34373) 2190 : audit [DBG] from='client.55522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:59 gibba003 bash[31385]: audit 2021-03-10T14:31:59.564172+0000 mgr.gibba043.dnkmem (mgr.34373) 2189 : audit [DBG] from='client.55516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:31:59 gibba003 bash[31385]: audit 2021-03-10T14:31:59.786116+0000 mgr.gibba043.dnkmem (mgr.34373) 2190 : audit [DBG] from='client.55522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:00.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:59 gibba003 bash[32348]: audit 2021-03-10T14:31:59.564172+0000 mgr.gibba043.dnkmem (mgr.34373) 2189 : audit [DBG] from='client.55516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:00.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:31:59 gibba003 bash[32348]: audit 2021-03-10T14:31:59.786116+0000 mgr.gibba043.dnkmem (mgr.34373) 2190 : audit [DBG] from='client.55522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:00 gibba043 bash[24019]: audit 2021-03-10T14:32:00.053371+0000 mon.a (mon.0) 788 : audit [DBG] from='client.? 172.21.2.103:0/401258388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:00 gibba043 bash[24019]: cluster 2021-03-10T14:32:00.859275+0000 mgr.gibba043.dnkmem (mgr.34373) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:00 gibba003 bash[31385]: audit 2021-03-10T14:32:00.053371+0000 mon.a (mon.0) 788 : audit [DBG] from='client.? 172.21.2.103:0/401258388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:00 gibba003 bash[31385]: cluster 2021-03-10T14:32:00.859275+0000 mgr.gibba043.dnkmem (mgr.34373) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:00 gibba003 bash[32348]: audit 2021-03-10T14:32:00.053371+0000 mon.a (mon.0) 788 : audit [DBG] from='client.? 172.21.2.103:0/401258388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:00 gibba003 bash[32348]: cluster 2021-03-10T14:32:00.859275+0000 mgr.gibba043.dnkmem (mgr.34373) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:03 gibba003 bash[31385]: cluster 2021-03-10T14:32:02.860406+0000 mgr.gibba043.dnkmem (mgr.34373) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:03 gibba003 bash[32348]: cluster 2021-03-10T14:32:02.860406+0000 mgr.gibba043.dnkmem (mgr.34373) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:03 gibba043 bash[24019]: cluster 2021-03-10T14:32:02.860406+0000 mgr.gibba043.dnkmem (mgr.34373) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:04 gibba043 bash[24019]: cluster 2021-03-10T14:32:04.861904+0000 mgr.gibba043.dnkmem (mgr.34373) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:04 gibba003 bash[31385]: cluster 2021-03-10T14:32:04.861904+0000 mgr.gibba043.dnkmem (mgr.34373) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:04 gibba003 bash[32348]: cluster 2021-03-10T14:32:04.861904+0000 mgr.gibba043.dnkmem (mgr.34373) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.572836+0000 mgr.gibba043.dnkmem (mgr.34373) 2194 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:32:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.574368+0000 mgr.gibba043.dnkmem (mgr.34373) 2195 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:32:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.797413+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:32:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.798376+0000 mgr.gibba043.dnkmem (mgr.34373) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.800050+0000 mgr.gibba043.dnkmem (mgr.34373) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.801237+0000 mgr.gibba043.dnkmem (mgr.34373) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.801282+0000 mgr.gibba043.dnkmem (mgr.34373) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.801377+0000 mon.c (mon.1) 603 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.802456+0000 mgr.gibba043.dnkmem (mgr.34373) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.802500+0000 mgr.gibba043.dnkmem (mgr.34373) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.802693+0000 mon.c (mon.1) 604 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.803877+0000 mgr.gibba043.dnkmem (mgr.34373) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.803932+0000 mon.c (mon.1) 605 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.805082+0000 mon.c (mon.1) 606 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.805570+0000 mgr.gibba043.dnkmem (mgr.34373) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.805616+0000 mgr.gibba043.dnkmem (mgr.34373) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.807249+0000 mgr.gibba043.dnkmem (mgr.34373) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.807583+0000 mgr.gibba043.dnkmem (mgr.34373) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.808552+0000 mon.c (mon.1) 607 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.809255+0000 mgr.gibba043.dnkmem (mgr.34373) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:07.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.809304+0000 mgr.gibba043.dnkmem (mgr.34373) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:07.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: cephadm 2021-03-10T14:32:05.809427+0000 mgr.gibba043.dnkmem (mgr.34373) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:07.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[31385]: audit 2021-03-10T14:32:05.810326+0000 mon.c (mon.1) 608 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.572836+0000 mgr.gibba043.dnkmem (mgr.34373) 2194 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:32:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.574368+0000 mgr.gibba043.dnkmem (mgr.34373) 2195 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:32:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.797413+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:32:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.798376+0000 mgr.gibba043.dnkmem (mgr.34373) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.800050+0000 mgr.gibba043.dnkmem (mgr.34373) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.801237+0000 mgr.gibba043.dnkmem (mgr.34373) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.801282+0000 mgr.gibba043.dnkmem (mgr.34373) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.801377+0000 mon.c (mon.1) 603 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.802456+0000 mgr.gibba043.dnkmem (mgr.34373) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.802500+0000 mgr.gibba043.dnkmem (mgr.34373) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.802693+0000 mon.c (mon.1) 604 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.803877+0000 mgr.gibba043.dnkmem (mgr.34373) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.803932+0000 mon.c (mon.1) 605 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.805082+0000 mon.c (mon.1) 606 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.805570+0000 mgr.gibba043.dnkmem (mgr.34373) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.805616+0000 mgr.gibba043.dnkmem (mgr.34373) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.807249+0000 mgr.gibba043.dnkmem (mgr.34373) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.807583+0000 mgr.gibba043.dnkmem (mgr.34373) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.808552+0000 mon.c (mon.1) 607 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.809255+0000 mgr.gibba043.dnkmem (mgr.34373) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.809304+0000 mgr.gibba043.dnkmem (mgr.34373) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: cephadm 2021-03-10T14:32:05.809427+0000 mgr.gibba043.dnkmem (mgr.34373) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:06 gibba003 bash[32348]: audit 2021-03-10T14:32:05.810326+0000 mon.c (mon.1) 608 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.572836+0000 mgr.gibba043.dnkmem (mgr.34373) 2194 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:32:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.574368+0000 mgr.gibba043.dnkmem (mgr.34373) 2195 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:32:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.797413+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:32:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.798376+0000 mgr.gibba043.dnkmem (mgr.34373) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.800050+0000 mgr.gibba043.dnkmem (mgr.34373) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.801237+0000 mgr.gibba043.dnkmem (mgr.34373) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.801282+0000 mgr.gibba043.dnkmem (mgr.34373) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.801377+0000 mon.c (mon.1) 603 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.802456+0000 mgr.gibba043.dnkmem (mgr.34373) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.802500+0000 mgr.gibba043.dnkmem (mgr.34373) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.802693+0000 mon.c (mon.1) 604 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.803877+0000 mgr.gibba043.dnkmem (mgr.34373) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.803932+0000 mon.c (mon.1) 605 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.805082+0000 mon.c (mon.1) 606 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.805570+0000 mgr.gibba043.dnkmem (mgr.34373) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.805616+0000 mgr.gibba043.dnkmem (mgr.34373) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.807249+0000 mgr.gibba043.dnkmem (mgr.34373) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.807583+0000 mgr.gibba043.dnkmem (mgr.34373) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.808552+0000 mon.c (mon.1) 607 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.809255+0000 mgr.gibba043.dnkmem (mgr.34373) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.809304+0000 mgr.gibba043.dnkmem (mgr.34373) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: cephadm 2021-03-10T14:32:05.809427+0000 mgr.gibba043.dnkmem (mgr.34373) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:06 gibba043 bash[24019]: audit 2021-03-10T14:32:05.810326+0000 mon.c (mon.1) 608 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:07 gibba003 bash[31385]: cluster 2021-03-10T14:32:06.862954+0000 mgr.gibba043.dnkmem (mgr.34373) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:07 gibba003 bash[32348]: cluster 2021-03-10T14:32:06.862954+0000 mgr.gibba043.dnkmem (mgr.34373) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:07 gibba043 bash[24019]: cluster 2021-03-10T14:32:06.862954+0000 mgr.gibba043.dnkmem (mgr.34373) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:08 gibba043 bash[24019]: cluster 2021-03-10T14:32:08.864564+0000 mgr.gibba043.dnkmem (mgr.34373) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:08 gibba003 bash[31385]: cluster 2021-03-10T14:32:08.864564+0000 mgr.gibba043.dnkmem (mgr.34373) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:08 gibba003 bash[32348]: cluster 2021-03-10T14:32:08.864564+0000 mgr.gibba043.dnkmem (mgr.34373) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:10 gibba043 bash[24019]: cluster 2021-03-10T14:32:10.865987+0000 mgr.gibba043.dnkmem (mgr.34373) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:11.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:10 gibba003 bash[31385]: cluster 2021-03-10T14:32:10.865987+0000 mgr.gibba043.dnkmem (mgr.34373) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:11.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:10 gibba003 bash[32348]: cluster 2021-03-10T14:32:10.865987+0000 mgr.gibba043.dnkmem (mgr.34373) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: cluster 2021-03-10T14:32:12.867230+0000 mgr.gibba043.dnkmem (mgr.34373) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.963827+0000 mon.c (mon.1) 609 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:32:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.964622+0000 mon.c (mon.1) 610 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.965189+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:32:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.965327+0000 mon.c (mon.1) 611 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.965997+0000 mon.c (mon.1) 612 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:32:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.967435+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.967723+0000 mon.c (mon.1) 613 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.968617+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.969583+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:32:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:12.969755+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:13.046407+0000 mon.c (mon.1) 614 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[31385]: audit 2021-03-10T14:32:13.047351+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: cluster 2021-03-10T14:32:12.867230+0000 mgr.gibba043.dnkmem (mgr.34373) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.963827+0000 mon.c (mon.1) 609 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:32:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.964622+0000 mon.c (mon.1) 610 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.965189+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:32:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.965327+0000 mon.c (mon.1) 611 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.965997+0000 mon.c (mon.1) 612 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:32:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.967435+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.967723+0000 mon.c (mon.1) 613 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.968617+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.969583+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:32:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:12.969755+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:13.046407+0000 mon.c (mon.1) 614 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:13 gibba003 bash[32348]: audit 2021-03-10T14:32:13.047351+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: cluster 2021-03-10T14:32:12.867230+0000 mgr.gibba043.dnkmem (mgr.34373) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.963827+0000 mon.c (mon.1) 609 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:32:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.964622+0000 mon.c (mon.1) 610 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.965189+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:32:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.965327+0000 mon.c (mon.1) 611 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.965997+0000 mon.c (mon.1) 612 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:32:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.967435+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.967723+0000 mon.c (mon.1) 613 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.968617+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:32:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.969583+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:32:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:12.969755+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:13.046407+0000 mon.c (mon.1) 614 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:13 gibba043 bash[24019]: audit 2021-03-10T14:32:13.047351+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:14 gibba043 bash[24019]: cluster 2021-03-10T14:32:14.868774+0000 mgr.gibba043.dnkmem (mgr.34373) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:14 gibba003 bash[31385]: cluster 2021-03-10T14:32:14.868774+0000 mgr.gibba043.dnkmem (mgr.34373) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:14 gibba003 bash[32348]: cluster 2021-03-10T14:32:14.868774+0000 mgr.gibba043.dnkmem (mgr.34373) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:16 gibba043 bash[24019]: cluster 2021-03-10T14:32:16.870178+0000 mgr.gibba043.dnkmem (mgr.34373) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:16 gibba003 bash[31385]: cluster 2021-03-10T14:32:16.870178+0000 mgr.gibba043.dnkmem (mgr.34373) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:17.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:16 gibba003 bash[32348]: cluster 2021-03-10T14:32:16.870178+0000 mgr.gibba043.dnkmem (mgr.34373) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:18 gibba043 bash[24019]: cluster 2021-03-10T14:32:18.871767+0000 mgr.gibba043.dnkmem (mgr.34373) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:18 gibba003 bash[31385]: cluster 2021-03-10T14:32:18.871767+0000 mgr.gibba043.dnkmem (mgr.34373) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:18 gibba003 bash[32348]: cluster 2021-03-10T14:32:18.871767+0000 mgr.gibba043.dnkmem (mgr.34373) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:20 gibba043 bash[24019]: cephadm 2021-03-10T14:32:20.825464+0000 mgr.gibba043.dnkmem (mgr.34373) 2217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:20 gibba043 bash[24019]: cluster 2021-03-10T14:32:20.873459+0000 mgr.gibba043.dnkmem (mgr.34373) 2218 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:21.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:20 gibba003 bash[31385]: cephadm 2021-03-10T14:32:20.825464+0000 mgr.gibba043.dnkmem (mgr.34373) 2217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:20 gibba003 bash[31385]: cluster 2021-03-10T14:32:20.873459+0000 mgr.gibba043.dnkmem (mgr.34373) 2218 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:20 gibba003 bash[32348]: cephadm 2021-03-10T14:32:20.825464+0000 mgr.gibba043.dnkmem (mgr.34373) 2217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:20 gibba003 bash[32348]: cluster 2021-03-10T14:32:20.873459+0000 mgr.gibba043.dnkmem (mgr.34373) 2218 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:23 gibba003 bash[31385]: cluster 2021-03-10T14:32:22.874818+0000 mgr.gibba043.dnkmem (mgr.34373) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:23 gibba003 bash[32348]: cluster 2021-03-10T14:32:22.874818+0000 mgr.gibba043.dnkmem (mgr.34373) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:23 gibba043 bash[24019]: cluster 2021-03-10T14:32:22.874818+0000 mgr.gibba043.dnkmem (mgr.34373) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:24 gibba043 bash[24019]: cluster 2021-03-10T14:32:24.876439+0000 mgr.gibba043.dnkmem (mgr.34373) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:24 gibba003 bash[31385]: cluster 2021-03-10T14:32:24.876439+0000 mgr.gibba043.dnkmem (mgr.34373) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:24 gibba003 bash[32348]: cluster 2021-03-10T14:32:24.876439+0000 mgr.gibba043.dnkmem (mgr.34373) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:26 gibba043 bash[24019]: cluster 2021-03-10T14:32:26.877944+0000 mgr.gibba043.dnkmem (mgr.34373) 2221 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:26 gibba003 bash[31385]: cluster 2021-03-10T14:32:26.877944+0000 mgr.gibba043.dnkmem (mgr.34373) 2221 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:26 gibba003 bash[32348]: cluster 2021-03-10T14:32:26.877944+0000 mgr.gibba043.dnkmem (mgr.34373) 2221 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:28 gibba043 bash[24019]: cluster 2021-03-10T14:32:28.879642+0000 mgr.gibba043.dnkmem (mgr.34373) 2222 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:28 gibba003 bash[31385]: cluster 2021-03-10T14:32:28.879642+0000 mgr.gibba043.dnkmem (mgr.34373) 2222 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:28 gibba003 bash[32348]: cluster 2021-03-10T14:32:28.879642+0000 mgr.gibba043.dnkmem (mgr.34373) 2222 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:30.294 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:32:30.521 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:32:30.522 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (40m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:32:30.522 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (45m) 5m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:32:30.522 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:32:30.523 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:32:30.523 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:32:30.523 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:32:30.523 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:32:30.523 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:32:30.524 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:32:30.524 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:32:30.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:32:30.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:32:30.525 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:32:30.525 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:32:30.525 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:32:30.525 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:32:30.525 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:32:30.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (36m) 5m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:32:30.526 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (45m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:32:30.526 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:32:30.768 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:32:30.768 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:32:30.768 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:30.769 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:32:30.769 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:32:30.769 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:30.769 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:32:30.770 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:32:30.770 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:32:30.770 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:32:30.770 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:32:30.770 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:32:30.771 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:32:30.771 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:32:30.771 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:32:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:30 gibba003 bash[31385]: audit 2021-03-10T14:32:30.769254+0000 mon.c (mon.1) 615 : audit [DBG] from='client.? 172.21.2.103:0/1246645335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:31.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:30 gibba003 bash[32348]: audit 2021-03-10T14:32:30.769254+0000 mon.c (mon.1) 615 : audit [DBG] from='client.? 172.21.2.103:0/1246645335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:30 gibba043 bash[24019]: audit 2021-03-10T14:32:30.769254+0000 mon.c (mon.1) 615 : audit [DBG] from='client.? 172.21.2.103:0/1246645335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:31 gibba003 bash[31385]: audit 2021-03-10T14:32:30.283525+0000 mgr.gibba043.dnkmem (mgr.34373) 2223 : audit [DBG] from='client.55534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:31 gibba003 bash[31385]: audit 2021-03-10T14:32:30.508293+0000 mgr.gibba043.dnkmem (mgr.34373) 2224 : audit [DBG] from='client.45555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:31 gibba003 bash[31385]: cluster 2021-03-10T14:32:30.881374+0000 mgr.gibba043.dnkmem (mgr.34373) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:31 gibba003 bash[32348]: audit 2021-03-10T14:32:30.283525+0000 mgr.gibba043.dnkmem (mgr.34373) 2223 : audit [DBG] from='client.55534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:31 gibba003 bash[32348]: audit 2021-03-10T14:32:30.508293+0000 mgr.gibba043.dnkmem (mgr.34373) 2224 : audit [DBG] from='client.45555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:31 gibba003 bash[32348]: cluster 2021-03-10T14:32:30.881374+0000 mgr.gibba043.dnkmem (mgr.34373) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:31 gibba043 bash[24019]: audit 2021-03-10T14:32:30.283525+0000 mgr.gibba043.dnkmem (mgr.34373) 2223 : audit [DBG] from='client.55534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:31 gibba043 bash[24019]: audit 2021-03-10T14:32:30.508293+0000 mgr.gibba043.dnkmem (mgr.34373) 2224 : audit [DBG] from='client.45555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:31 gibba043 bash[24019]: cluster 2021-03-10T14:32:30.881374+0000 mgr.gibba043.dnkmem (mgr.34373) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:33 gibba003 bash[31385]: cluster 2021-03-10T14:32:32.883015+0000 mgr.gibba043.dnkmem (mgr.34373) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:33 gibba003 bash[32348]: cluster 2021-03-10T14:32:32.883015+0000 mgr.gibba043.dnkmem (mgr.34373) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:33 gibba043 bash[24019]: cluster 2021-03-10T14:32:32.883015+0000 mgr.gibba043.dnkmem (mgr.34373) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:35.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:34 gibba043 bash[24019]: cluster 2021-03-10T14:32:34.884620+0000 mgr.gibba043.dnkmem (mgr.34373) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:34 gibba003 bash[31385]: cluster 2021-03-10T14:32:34.884620+0000 mgr.gibba043.dnkmem (mgr.34373) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:35.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:34 gibba003 bash[32348]: cluster 2021-03-10T14:32:34.884620+0000 mgr.gibba043.dnkmem (mgr.34373) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:35 gibba043 bash[24019]: cephadm 2021-03-10T14:32:35.841451+0000 mgr.gibba043.dnkmem (mgr.34373) 2228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:35 gibba003 bash[32348]: cephadm 2021-03-10T14:32:35.841451+0000 mgr.gibba043.dnkmem (mgr.34373) 2228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:35 gibba003 bash[31385]: cephadm 2021-03-10T14:32:35.841451+0000 mgr.gibba043.dnkmem (mgr.34373) 2228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:36 gibba043 bash[24019]: cluster 2021-03-10T14:32:36.886324+0000 mgr.gibba043.dnkmem (mgr.34373) 2229 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:36 gibba003 bash[31385]: cluster 2021-03-10T14:32:36.886324+0000 mgr.gibba043.dnkmem (mgr.34373) 2229 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:36 gibba003 bash[32348]: cluster 2021-03-10T14:32:36.886324+0000 mgr.gibba043.dnkmem (mgr.34373) 2229 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:38 gibba043 bash[24019]: cluster 2021-03-10T14:32:38.887997+0000 mgr.gibba043.dnkmem (mgr.34373) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:38 gibba003 bash[31385]: cluster 2021-03-10T14:32:38.887997+0000 mgr.gibba043.dnkmem (mgr.34373) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:38 gibba003 bash[32348]: cluster 2021-03-10T14:32:38.887997+0000 mgr.gibba043.dnkmem (mgr.34373) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:40 gibba043 bash[24019]: cluster 2021-03-10T14:32:40.889399+0000 mgr.gibba043.dnkmem (mgr.34373) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:40 gibba003 bash[31385]: cluster 2021-03-10T14:32:40.889399+0000 mgr.gibba043.dnkmem (mgr.34373) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:40 gibba003 bash[32348]: cluster 2021-03-10T14:32:40.889399+0000 mgr.gibba043.dnkmem (mgr.34373) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:43 gibba003 bash[31385]: cluster 2021-03-10T14:32:42.890749+0000 mgr.gibba043.dnkmem (mgr.34373) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:43 gibba003 bash[32348]: cluster 2021-03-10T14:32:42.890749+0000 mgr.gibba043.dnkmem (mgr.34373) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:43 gibba043 bash[24019]: cluster 2021-03-10T14:32:42.890749+0000 mgr.gibba043.dnkmem (mgr.34373) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:44 gibba043 bash[24019]: cluster 2021-03-10T14:32:44.892307+0000 mgr.gibba043.dnkmem (mgr.34373) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:44 gibba003 bash[31385]: cluster 2021-03-10T14:32:44.892307+0000 mgr.gibba043.dnkmem (mgr.34373) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:44 gibba003 bash[32348]: cluster 2021-03-10T14:32:44.892307+0000 mgr.gibba043.dnkmem (mgr.34373) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:46 gibba043 bash[24019]: cluster 2021-03-10T14:32:46.893900+0000 mgr.gibba043.dnkmem (mgr.34373) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:46 gibba003 bash[31385]: cluster 2021-03-10T14:32:46.893900+0000 mgr.gibba043.dnkmem (mgr.34373) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:46 gibba003 bash[32348]: cluster 2021-03-10T14:32:46.893900+0000 mgr.gibba043.dnkmem (mgr.34373) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:48 gibba043 bash[24019]: cluster 2021-03-10T14:32:48.895456+0000 mgr.gibba043.dnkmem (mgr.34373) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:48 gibba003 bash[31385]: cluster 2021-03-10T14:32:48.895456+0000 mgr.gibba043.dnkmem (mgr.34373) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:48 gibba003 bash[32348]: cluster 2021-03-10T14:32:48.895456+0000 mgr.gibba043.dnkmem (mgr.34373) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:50 gibba043 bash[24019]: cephadm 2021-03-10T14:32:50.857247+0000 mgr.gibba043.dnkmem (mgr.34373) 2236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:50 gibba043 bash[24019]: cluster 2021-03-10T14:32:50.897210+0000 mgr.gibba043.dnkmem (mgr.34373) 2237 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:51.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:50 gibba003 bash[31385]: cephadm 2021-03-10T14:32:50.857247+0000 mgr.gibba043.dnkmem (mgr.34373) 2236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:50 gibba003 bash[31385]: cluster 2021-03-10T14:32:50.897210+0000 mgr.gibba043.dnkmem (mgr.34373) 2237 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:50 gibba003 bash[32348]: cephadm 2021-03-10T14:32:50.857247+0000 mgr.gibba043.dnkmem (mgr.34373) 2236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:32:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:50 gibba003 bash[32348]: cluster 2021-03-10T14:32:50.897210+0000 mgr.gibba043.dnkmem (mgr.34373) 2237 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:53 gibba003 bash[31385]: cluster 2021-03-10T14:32:52.898765+0000 mgr.gibba043.dnkmem (mgr.34373) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:53 gibba003 bash[32348]: cluster 2021-03-10T14:32:52.898765+0000 mgr.gibba043.dnkmem (mgr.34373) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:53 gibba043 bash[24019]: cluster 2021-03-10T14:32:52.898765+0000 mgr.gibba043.dnkmem (mgr.34373) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:54 gibba043 bash[24019]: cluster 2021-03-10T14:32:54.900246+0000 mgr.gibba043.dnkmem (mgr.34373) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:54 gibba003 bash[31385]: cluster 2021-03-10T14:32:54.900246+0000 mgr.gibba043.dnkmem (mgr.34373) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:54 gibba003 bash[32348]: cluster 2021-03-10T14:32:54.900246+0000 mgr.gibba043.dnkmem (mgr.34373) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:56 gibba043 bash[24019]: cluster 2021-03-10T14:32:56.901950+0000 mgr.gibba043.dnkmem (mgr.34373) 2240 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:57.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:56 gibba003 bash[31385]: cluster 2021-03-10T14:32:56.901950+0000 mgr.gibba043.dnkmem (mgr.34373) 2240 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:56 gibba003 bash[32348]: cluster 2021-03-10T14:32:56.901950+0000 mgr.gibba043.dnkmem (mgr.34373) 2240 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:32:58 gibba043 bash[24019]: cluster 2021-03-10T14:32:58.903617+0000 mgr.gibba043.dnkmem (mgr.34373) 2241 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:32:58 gibba003 bash[31385]: cluster 2021-03-10T14:32:58.903617+0000 mgr.gibba043.dnkmem (mgr.34373) 2241 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:32:58 gibba003 bash[32348]: cluster 2021-03-10T14:32:58.903617+0000 mgr.gibba043.dnkmem (mgr.34373) 2241 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:01.012 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:33:01.241 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:33:01.241 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (41m) 7m ago 46m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:33:01.242 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:33:01.242 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (41m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:33:01.242 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (42m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:33:01.242 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:33:01.243 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (40m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:33:01.243 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (40m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:33:01.243 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:33:01.243 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (46m) 7m ago 46m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:33:01.243 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:33:01.244 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:33:01.244 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:33:01.244 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:33:01.244 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:33:01.244 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:33:01.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:33:01.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:33:01.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:33:01.245 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (46m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:33:01.245 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:33:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:00 gibba043 bash[24019]: cluster 2021-03-10T14:33:00.905367+0000 mgr.gibba043.dnkmem (mgr.34373) 2242 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:01.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:00 gibba003 bash[31385]: cluster 2021-03-10T14:33:00.905367+0000 mgr.gibba043.dnkmem (mgr.34373) 2242 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:00 gibba003 bash[32348]: cluster 2021-03-10T14:33:00.905367+0000 mgr.gibba043.dnkmem (mgr.34373) 2242 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:01.498 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:33:01.498 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:33:01.498 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:01.499 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:33:01.499 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:33:01.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:01.499 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:33:01.499 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:33:01.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:33:01.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:33:01.500 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:33:01.500 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:33:01.501 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:33:01.501 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:33:01.501 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:33:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:01 gibba043 bash[24019]: audit 2021-03-10T14:33:01.002315+0000 mgr.gibba043.dnkmem (mgr.34373) 2243 : audit [DBG] from='client.45567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:01 gibba043 bash[24019]: audit 2021-03-10T14:33:01.227528+0000 mgr.gibba043.dnkmem (mgr.34373) 2244 : audit [DBG] from='client.45573 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:01 gibba043 bash[24019]: audit 2021-03-10T14:33:01.498812+0000 mon.c (mon.1) 616 : audit [DBG] from='client.? 172.21.2.103:0/1206313963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:02.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:01 gibba003 bash[31385]: audit 2021-03-10T14:33:01.002315+0000 mgr.gibba043.dnkmem (mgr.34373) 2243 : audit [DBG] from='client.45567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:02.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:01 gibba003 bash[31385]: audit 2021-03-10T14:33:01.227528+0000 mgr.gibba043.dnkmem (mgr.34373) 2244 : audit [DBG] from='client.45573 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:02.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:01 gibba003 bash[31385]: audit 2021-03-10T14:33:01.498812+0000 mon.c (mon.1) 616 : audit [DBG] from='client.? 172.21.2.103:0/1206313963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:02.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:01 gibba003 bash[32348]: audit 2021-03-10T14:33:01.002315+0000 mgr.gibba043.dnkmem (mgr.34373) 2243 : audit [DBG] from='client.45567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:02.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:01 gibba003 bash[32348]: audit 2021-03-10T14:33:01.227528+0000 mgr.gibba043.dnkmem (mgr.34373) 2244 : audit [DBG] from='client.45573 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:02.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:01 gibba003 bash[32348]: audit 2021-03-10T14:33:01.498812+0000 mon.c (mon.1) 616 : audit [DBG] from='client.? 172.21.2.103:0/1206313963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:03 gibba003 bash[31385]: cluster 2021-03-10T14:33:02.906936+0000 mgr.gibba043.dnkmem (mgr.34373) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:03 gibba003 bash[32348]: cluster 2021-03-10T14:33:02.906936+0000 mgr.gibba043.dnkmem (mgr.34373) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:03 gibba043 bash[24019]: cluster 2021-03-10T14:33:02.906936+0000 mgr.gibba043.dnkmem (mgr.34373) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:04 gibba043 bash[24019]: cluster 2021-03-10T14:33:04.908425+0000 mgr.gibba043.dnkmem (mgr.34373) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:04 gibba003 bash[31385]: cluster 2021-03-10T14:33:04.908425+0000 mgr.gibba043.dnkmem (mgr.34373) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:04 gibba003 bash[32348]: cluster 2021-03-10T14:33:04.908425+0000 mgr.gibba043.dnkmem (mgr.34373) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.076604+0000 mgr.gibba043.dnkmem (mgr.34373) 2247 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:33:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.077872+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.079615+0000 mgr.gibba043.dnkmem (mgr.34373) 2248 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:33:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.080949+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.289440+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.298726+0000 mgr.gibba043.dnkmem (mgr.34373) 2249 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.303503+0000 mon.c (mon.1) 617 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.304896+0000 mgr.gibba043.dnkmem (mgr.34373) 2250 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.308570+0000 mon.c (mon.1) 618 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.309323+0000 mgr.gibba043.dnkmem (mgr.34373) 2251 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.309597+0000 mgr.gibba043.dnkmem (mgr.34373) 2252 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.313114+0000 mon.c (mon.1) 619 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.313531+0000 mgr.gibba043.dnkmem (mgr.34373) 2253 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.313800+0000 mgr.gibba043.dnkmem (mgr.34373) 2254 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.317193+0000 mon.c (mon.1) 620 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.317950+0000 mgr.gibba043.dnkmem (mgr.34373) 2255 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.322658+0000 mgr.gibba043.dnkmem (mgr.34373) 2256 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.322925+0000 mgr.gibba043.dnkmem (mgr.34373) 2257 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:07.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.327150+0000 mon.c (mon.1) 621 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.327869+0000 mgr.gibba043.dnkmem (mgr.34373) 2258 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:07.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.329365+0000 mgr.gibba043.dnkmem (mgr.34373) 2259 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.076604+0000 mgr.gibba043.dnkmem (mgr.34373) 2247 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:33:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.077872+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.079615+0000 mgr.gibba043.dnkmem (mgr.34373) 2248 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:33:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.080949+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.289440+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.298726+0000 mgr.gibba043.dnkmem (mgr.34373) 2249 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.303503+0000 mon.c (mon.1) 617 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.304896+0000 mgr.gibba043.dnkmem (mgr.34373) 2250 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.308570+0000 mon.c (mon.1) 618 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.309323+0000 mgr.gibba043.dnkmem (mgr.34373) 2251 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:07.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.309597+0000 mgr.gibba043.dnkmem (mgr.34373) 2252 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:07.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.313114+0000 mon.c (mon.1) 619 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.313531+0000 mgr.gibba043.dnkmem (mgr.34373) 2253 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.313800+0000 mgr.gibba043.dnkmem (mgr.34373) 2254 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.317193+0000 mon.c (mon.1) 620 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.317950+0000 mgr.gibba043.dnkmem (mgr.34373) 2255 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.322658+0000 mgr.gibba043.dnkmem (mgr.34373) 2256 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.322925+0000 mgr.gibba043.dnkmem (mgr.34373) 2257 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:07.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.327150+0000 mon.c (mon.1) 621 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.327869+0000 mgr.gibba043.dnkmem (mgr.34373) 2258 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:07.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.329365+0000 mgr.gibba043.dnkmem (mgr.34373) 2259 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:07.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: audit 2021-03-10T14:33:06.332992+0000 mon.c (mon.1) 622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.333256+0000 mgr.gibba043.dnkmem (mgr.34373) 2260 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:07.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.333646+0000 mgr.gibba043.dnkmem (mgr.34373) 2261 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:07.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cephadm 2021-03-10T14:33:06.334148+0000 mgr.gibba043.dnkmem (mgr.34373) 2262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:07.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[31385]: cluster 2021-03-10T14:33:06.910126+0000 mgr.gibba043.dnkmem (mgr.34373) 2263 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:07.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: audit 2021-03-10T14:33:06.332992+0000 mon.c (mon.1) 622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.333256+0000 mgr.gibba043.dnkmem (mgr.34373) 2260 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:07.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.333646+0000 mgr.gibba043.dnkmem (mgr.34373) 2261 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:07.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cephadm 2021-03-10T14:33:06.334148+0000 mgr.gibba043.dnkmem (mgr.34373) 2262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:07.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:07 gibba003 bash[32348]: cluster 2021-03-10T14:33:06.910126+0000 mgr.gibba043.dnkmem (mgr.34373) 2263 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.076604+0000 mgr.gibba043.dnkmem (mgr.34373) 2247 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:33:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.077872+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.079615+0000 mgr.gibba043.dnkmem (mgr.34373) 2248 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:33:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.080949+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.289440+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:33:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.298726+0000 mgr.gibba043.dnkmem (mgr.34373) 2249 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.303503+0000 mon.c (mon.1) 617 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.304896+0000 mgr.gibba043.dnkmem (mgr.34373) 2250 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.308570+0000 mon.c (mon.1) 618 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.309323+0000 mgr.gibba043.dnkmem (mgr.34373) 2251 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.309597+0000 mgr.gibba043.dnkmem (mgr.34373) 2252 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.313114+0000 mon.c (mon.1) 619 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.313531+0000 mgr.gibba043.dnkmem (mgr.34373) 2253 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.313800+0000 mgr.gibba043.dnkmem (mgr.34373) 2254 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:07.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.317193+0000 mon.c (mon.1) 620 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.317950+0000 mgr.gibba043.dnkmem (mgr.34373) 2255 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:07.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.322658+0000 mgr.gibba043.dnkmem (mgr.34373) 2256 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:07.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.322925+0000 mgr.gibba043.dnkmem (mgr.34373) 2257 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:07.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.327150+0000 mon.c (mon.1) 621 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.327869+0000 mgr.gibba043.dnkmem (mgr.34373) 2258 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:07.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.329365+0000 mgr.gibba043.dnkmem (mgr.34373) 2259 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:07.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: audit 2021-03-10T14:33:06.332992+0000 mon.c (mon.1) 622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:07.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.333256+0000 mgr.gibba043.dnkmem (mgr.34373) 2260 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:07.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.333646+0000 mgr.gibba043.dnkmem (mgr.34373) 2261 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:07.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cephadm 2021-03-10T14:33:06.334148+0000 mgr.gibba043.dnkmem (mgr.34373) 2262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:07.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:07 gibba043 bash[24019]: cluster 2021-03-10T14:33:06.910126+0000 mgr.gibba043.dnkmem (mgr.34373) 2263 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:08 gibba043 bash[24019]: cluster 2021-03-10T14:33:08.911661+0000 mgr.gibba043.dnkmem (mgr.34373) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:08 gibba003 bash[31385]: cluster 2021-03-10T14:33:08.911661+0000 mgr.gibba043.dnkmem (mgr.34373) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:08 gibba003 bash[32348]: cluster 2021-03-10T14:33:08.911661+0000 mgr.gibba043.dnkmem (mgr.34373) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:10 gibba043 bash[24019]: cluster 2021-03-10T14:33:10.913116+0000 mgr.gibba043.dnkmem (mgr.34373) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:11.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:10 gibba003 bash[31385]: cluster 2021-03-10T14:33:10.913116+0000 mgr.gibba043.dnkmem (mgr.34373) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:10 gibba003 bash[32348]: cluster 2021-03-10T14:33:10.913116+0000 mgr.gibba043.dnkmem (mgr.34373) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: cluster 2021-03-10T14:33:12.914562+0000 mgr.gibba043.dnkmem (mgr.34373) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.974066+0000 mon.c (mon.1) 623 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.975242+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.975828+0000 mon.c (mon.1) 624 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:33:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.976685+0000 mon.c (mon.1) 625 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.977069+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:33:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.977381+0000 mon.c (mon.1) 626 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.978184+0000 mon.c (mon.1) 627 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.979088+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.980239+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:12.981148+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:13.054547+0000 mon.c (mon.1) 628 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[31385]: audit 2021-03-10T14:33:13.055410+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: cluster 2021-03-10T14:33:12.914562+0000 mgr.gibba043.dnkmem (mgr.34373) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.974066+0000 mon.c (mon.1) 623 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.975242+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.975828+0000 mon.c (mon.1) 624 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:33:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.976685+0000 mon.c (mon.1) 625 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.977069+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:33:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.977381+0000 mon.c (mon.1) 626 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.978184+0000 mon.c (mon.1) 627 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.979088+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.980239+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:12.981148+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:13.054547+0000 mon.c (mon.1) 628 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:13 gibba003 bash[32348]: audit 2021-03-10T14:33:13.055410+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: cluster 2021-03-10T14:33:12.914562+0000 mgr.gibba043.dnkmem (mgr.34373) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.974066+0000 mon.c (mon.1) 623 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.975242+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.975828+0000 mon.c (mon.1) 624 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:33:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.976685+0000 mon.c (mon.1) 625 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.977069+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:33:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.977381+0000 mon.c (mon.1) 626 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.978184+0000 mon.c (mon.1) 627 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.979088+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.980239+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:12.981148+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:13.054547+0000 mon.c (mon.1) 628 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:13 gibba043 bash[24019]: audit 2021-03-10T14:33:13.055410+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:14 gibba043 bash[24019]: cluster 2021-03-10T14:33:14.916077+0000 mgr.gibba043.dnkmem (mgr.34373) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:14 gibba003 bash[31385]: cluster 2021-03-10T14:33:14.916077+0000 mgr.gibba043.dnkmem (mgr.34373) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:14 gibba003 bash[32348]: cluster 2021-03-10T14:33:14.916077+0000 mgr.gibba043.dnkmem (mgr.34373) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:16 gibba043 bash[24019]: cluster 2021-03-10T14:33:16.917459+0000 mgr.gibba043.dnkmem (mgr.34373) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:16 gibba003 bash[31385]: cluster 2021-03-10T14:33:16.917459+0000 mgr.gibba043.dnkmem (mgr.34373) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:17.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:16 gibba003 bash[32348]: cluster 2021-03-10T14:33:16.917459+0000 mgr.gibba043.dnkmem (mgr.34373) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:18 gibba043 bash[24019]: cluster 2021-03-10T14:33:18.919065+0000 mgr.gibba043.dnkmem (mgr.34373) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:18 gibba003 bash[31385]: cluster 2021-03-10T14:33:18.919065+0000 mgr.gibba043.dnkmem (mgr.34373) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:18 gibba003 bash[32348]: cluster 2021-03-10T14:33:18.919065+0000 mgr.gibba043.dnkmem (mgr.34373) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:21.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:20 gibba043 bash[24019]: cluster 2021-03-10T14:33:20.920781+0000 mgr.gibba043.dnkmem (mgr.34373) 2270 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:21.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:20 gibba003 bash[31385]: cluster 2021-03-10T14:33:20.920781+0000 mgr.gibba043.dnkmem (mgr.34373) 2270 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:21.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:20 gibba003 bash[32348]: cluster 2021-03-10T14:33:20.920781+0000 mgr.gibba043.dnkmem (mgr.34373) 2270 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:21 gibba043 bash[24019]: cephadm 2021-03-10T14:33:21.350157+0000 mgr.gibba043.dnkmem (mgr.34373) 2271 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:22.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:21 gibba003 bash[31385]: cephadm 2021-03-10T14:33:21.350157+0000 mgr.gibba043.dnkmem (mgr.34373) 2271 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:22.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:21 gibba003 bash[32348]: cephadm 2021-03-10T14:33:21.350157+0000 mgr.gibba043.dnkmem (mgr.34373) 2271 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:23 gibba003 bash[31385]: cluster 2021-03-10T14:33:22.922382+0000 mgr.gibba043.dnkmem (mgr.34373) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:23 gibba003 bash[32348]: cluster 2021-03-10T14:33:22.922382+0000 mgr.gibba043.dnkmem (mgr.34373) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:23 gibba043 bash[24019]: cluster 2021-03-10T14:33:22.922382+0000 mgr.gibba043.dnkmem (mgr.34373) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:24 gibba043 bash[24019]: cluster 2021-03-10T14:33:24.923946+0000 mgr.gibba043.dnkmem (mgr.34373) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:24 gibba003 bash[31385]: cluster 2021-03-10T14:33:24.923946+0000 mgr.gibba043.dnkmem (mgr.34373) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:25.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:24 gibba003 bash[32348]: cluster 2021-03-10T14:33:24.923946+0000 mgr.gibba043.dnkmem (mgr.34373) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:26 gibba043 bash[24019]: cluster 2021-03-10T14:33:26.925294+0000 mgr.gibba043.dnkmem (mgr.34373) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:27.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:26 gibba003 bash[31385]: cluster 2021-03-10T14:33:26.925294+0000 mgr.gibba043.dnkmem (mgr.34373) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:26 gibba003 bash[32348]: cluster 2021-03-10T14:33:26.925294+0000 mgr.gibba043.dnkmem (mgr.34373) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:28 gibba043 bash[24019]: cluster 2021-03-10T14:33:28.926966+0000 mgr.gibba043.dnkmem (mgr.34373) 2275 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:28 gibba003 bash[31385]: cluster 2021-03-10T14:33:28.926966+0000 mgr.gibba043.dnkmem (mgr.34373) 2275 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:28 gibba003 bash[32348]: cluster 2021-03-10T14:33:28.926966+0000 mgr.gibba043.dnkmem (mgr.34373) 2275 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:30 gibba043 bash[24019]: cluster 2021-03-10T14:33:30.928644+0000 mgr.gibba043.dnkmem (mgr.34373) 2276 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:30 gibba003 bash[31385]: cluster 2021-03-10T14:33:30.928644+0000 mgr.gibba043.dnkmem (mgr.34373) 2276 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:30 gibba003 bash[32348]: cluster 2021-03-10T14:33:30.928644+0000 mgr.gibba043.dnkmem (mgr.34373) 2276 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:31.745 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:33:31.977 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:33:31.978 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (41m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:33:31.978 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (46m) 6m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:33:31.978 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:33:31.979 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:33:31.979 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:33:31.979 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:33:31.979 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:33:31.979 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:33:31.980 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:33:31.980 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:33:31.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:33:31.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:33:31.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:33:31.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:33:31.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:33:31.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:33:31.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:33:31.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (37m) 6m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:33:31.982 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (46m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:33:31.982 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:33:32.231 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:33:32.231 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:33:32.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:32.232 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:33:32.232 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:33:32.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:32.232 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:33:32.233 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:33:32.233 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:33:32.233 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:33:32.233 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:33:32.234 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:33:32.234 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:33:32.234 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:33:32.234 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:33:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:31 gibba043 bash[24019]: audit 2021-03-10T14:33:31.734891+0000 mgr.gibba043.dnkmem (mgr.34373) 2277 : audit [DBG] from='client.45585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:31 gibba003 bash[31385]: audit 2021-03-10T14:33:31.734891+0000 mgr.gibba043.dnkmem (mgr.34373) 2277 : audit [DBG] from='client.45585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:32.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:31 gibba003 bash[32348]: audit 2021-03-10T14:33:31.734891+0000 mgr.gibba043.dnkmem (mgr.34373) 2277 : audit [DBG] from='client.45585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:33 gibba043 bash[24019]: audit 2021-03-10T14:33:31.963444+0000 mgr.gibba043.dnkmem (mgr.34373) 2278 : audit [DBG] from='client.45591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:33 gibba043 bash[24019]: audit 2021-03-10T14:33:32.232600+0000 mon.c (mon.1) 629 : audit [DBG] from='client.? 172.21.2.103:0/4039065644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:33 gibba003 bash[31385]: audit 2021-03-10T14:33:31.963444+0000 mgr.gibba043.dnkmem (mgr.34373) 2278 : audit [DBG] from='client.45591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:33 gibba003 bash[31385]: audit 2021-03-10T14:33:32.232600+0000 mon.c (mon.1) 629 : audit [DBG] from='client.? 172.21.2.103:0/4039065644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:33 gibba003 bash[32348]: audit 2021-03-10T14:33:31.963444+0000 mgr.gibba043.dnkmem (mgr.34373) 2278 : audit [DBG] from='client.45591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:33 gibba003 bash[32348]: audit 2021-03-10T14:33:32.232600+0000 mon.c (mon.1) 629 : audit [DBG] from='client.? 172.21.2.103:0/4039065644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:34 gibba003 bash[31385]: cluster 2021-03-10T14:33:32.930081+0000 mgr.gibba043.dnkmem (mgr.34373) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:35.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:34 gibba003 bash[32348]: cluster 2021-03-10T14:33:32.930081+0000 mgr.gibba043.dnkmem (mgr.34373) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:35.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:34 gibba043 bash[24019]: cluster 2021-03-10T14:33:32.930081+0000 mgr.gibba043.dnkmem (mgr.34373) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:36 gibba003 bash[31385]: cluster 2021-03-10T14:33:34.931584+0000 mgr.gibba043.dnkmem (mgr.34373) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:37.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:36 gibba003 bash[32348]: cluster 2021-03-10T14:33:34.931584+0000 mgr.gibba043.dnkmem (mgr.34373) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:36 gibba043 bash[24019]: cluster 2021-03-10T14:33:34.931584+0000 mgr.gibba043.dnkmem (mgr.34373) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:37 gibba003 bash[31385]: cephadm 2021-03-10T14:33:36.366293+0000 mgr.gibba043.dnkmem (mgr.34373) 2281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:37 gibba003 bash[32348]: cephadm 2021-03-10T14:33:36.366293+0000 mgr.gibba043.dnkmem (mgr.34373) 2281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:37 gibba043 bash[24019]: cephadm 2021-03-10T14:33:36.366293+0000 mgr.gibba043.dnkmem (mgr.34373) 2281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:38 gibba003 bash[31385]: cluster 2021-03-10T14:33:36.932902+0000 mgr.gibba043.dnkmem (mgr.34373) 2282 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:38 gibba003 bash[32348]: cluster 2021-03-10T14:33:36.932902+0000 mgr.gibba043.dnkmem (mgr.34373) 2282 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:38 gibba043 bash[24019]: cluster 2021-03-10T14:33:36.932902+0000 mgr.gibba043.dnkmem (mgr.34373) 2282 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:40 gibba003 bash[31385]: cluster 2021-03-10T14:33:38.934000+0000 mgr.gibba043.dnkmem (mgr.34373) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:40 gibba003 bash[32348]: cluster 2021-03-10T14:33:38.934000+0000 mgr.gibba043.dnkmem (mgr.34373) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:40 gibba043 bash[24019]: cluster 2021-03-10T14:33:38.934000+0000 mgr.gibba043.dnkmem (mgr.34373) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:43.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:42 gibba003 bash[31385]: cluster 2021-03-10T14:33:40.935073+0000 mgr.gibba043.dnkmem (mgr.34373) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:43.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:42 gibba003 bash[32348]: cluster 2021-03-10T14:33:40.935073+0000 mgr.gibba043.dnkmem (mgr.34373) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:43.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:42 gibba043 bash[24019]: cluster 2021-03-10T14:33:40.935073+0000 mgr.gibba043.dnkmem (mgr.34373) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:44 gibba003 bash[31385]: cluster 2021-03-10T14:33:42.935984+0000 mgr.gibba043.dnkmem (mgr.34373) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:45.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:44 gibba003 bash[32348]: cluster 2021-03-10T14:33:42.935984+0000 mgr.gibba043.dnkmem (mgr.34373) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:44 gibba043 bash[24019]: cluster 2021-03-10T14:33:42.935984+0000 mgr.gibba043.dnkmem (mgr.34373) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:46 gibba003 bash[31385]: cluster 2021-03-10T14:33:44.937431+0000 mgr.gibba043.dnkmem (mgr.34373) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:46 gibba003 bash[32348]: cluster 2021-03-10T14:33:44.937431+0000 mgr.gibba043.dnkmem (mgr.34373) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:46 gibba043 bash[24019]: cluster 2021-03-10T14:33:44.937431+0000 mgr.gibba043.dnkmem (mgr.34373) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:48 gibba003 bash[31385]: cluster 2021-03-10T14:33:46.938290+0000 mgr.gibba043.dnkmem (mgr.34373) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:49.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:48 gibba003 bash[32348]: cluster 2021-03-10T14:33:46.938290+0000 mgr.gibba043.dnkmem (mgr.34373) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:48 gibba043 bash[24019]: cluster 2021-03-10T14:33:46.938290+0000 mgr.gibba043.dnkmem (mgr.34373) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:50 gibba003 bash[31385]: cluster 2021-03-10T14:33:48.939828+0000 mgr.gibba043.dnkmem (mgr.34373) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:51.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:50 gibba003 bash[32348]: cluster 2021-03-10T14:33:48.939828+0000 mgr.gibba043.dnkmem (mgr.34373) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:50 gibba043 bash[24019]: cluster 2021-03-10T14:33:48.939828+0000 mgr.gibba043.dnkmem (mgr.34373) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:52 gibba003 bash[31385]: cluster 2021-03-10T14:33:50.940473+0000 mgr.gibba043.dnkmem (mgr.34373) 2289 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:52 gibba003 bash[31385]: cephadm 2021-03-10T14:33:51.382387+0000 mgr.gibba043.dnkmem (mgr.34373) 2290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:52 gibba003 bash[32348]: cluster 2021-03-10T14:33:50.940473+0000 mgr.gibba043.dnkmem (mgr.34373) 2289 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:52 gibba003 bash[32348]: cephadm 2021-03-10T14:33:51.382387+0000 mgr.gibba043.dnkmem (mgr.34373) 2290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:53.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:52 gibba043 bash[24019]: cluster 2021-03-10T14:33:50.940473+0000 mgr.gibba043.dnkmem (mgr.34373) 2289 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:52 gibba043 bash[24019]: cephadm 2021-03-10T14:33:51.382387+0000 mgr.gibba043.dnkmem (mgr.34373) 2290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:33:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:54 gibba003 bash[31385]: cluster 2021-03-10T14:33:52.941677+0000 mgr.gibba043.dnkmem (mgr.34373) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:55.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:54 gibba003 bash[32348]: cluster 2021-03-10T14:33:52.941677+0000 mgr.gibba043.dnkmem (mgr.34373) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:55.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:54 gibba043 bash[24019]: cluster 2021-03-10T14:33:52.941677+0000 mgr.gibba043.dnkmem (mgr.34373) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:56 gibba003 bash[31385]: cluster 2021-03-10T14:33:54.942500+0000 mgr.gibba043.dnkmem (mgr.34373) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:56 gibba003 bash[32348]: cluster 2021-03-10T14:33:54.942500+0000 mgr.gibba043.dnkmem (mgr.34373) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:56 gibba043 bash[24019]: cluster 2021-03-10T14:33:54.942500+0000 mgr.gibba043.dnkmem (mgr.34373) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:33:58 gibba003 bash[31385]: cluster 2021-03-10T14:33:56.943206+0000 mgr.gibba043.dnkmem (mgr.34373) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:33:58 gibba003 bash[32348]: cluster 2021-03-10T14:33:56.943206+0000 mgr.gibba043.dnkmem (mgr.34373) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:33:58 gibba043 bash[24019]: cluster 2021-03-10T14:33:56.943206+0000 mgr.gibba043.dnkmem (mgr.34373) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:00 gibba003 bash[31385]: cluster 2021-03-10T14:33:58.944414+0000 mgr.gibba043.dnkmem (mgr.34373) 2294 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:01.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:00 gibba003 bash[32348]: cluster 2021-03-10T14:33:58.944414+0000 mgr.gibba043.dnkmem (mgr.34373) 2294 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:00 gibba043 bash[24019]: cluster 2021-03-10T14:33:58.944414+0000 mgr.gibba043.dnkmem (mgr.34373) 2294 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:02.476 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:34:02.704 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:34:02.704 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (42m) 8m ago 47m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:34:02.704 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:34:02.704 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (42m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:34:02.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (43m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:34:02.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:34:02.705 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (41m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:34:02.705 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (41m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:34:02.705 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:34:02.706 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (47m) 8m ago 47m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:34:02.706 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:34:02.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:34:02.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:34:02.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:34:02.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:34:02.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:34:02.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:34:02.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:34:02.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:34:02.708 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (47m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:34:02.708 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:34:02.960 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:34:02.961 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:34:02.961 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:02.961 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:34:02.961 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:34:02.962 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:02.962 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:34:02.962 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:34:02.962 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:34:02.963 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:34:02.963 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:34:02.963 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:34:02.963 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:34:02.963 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:34:02.963 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:34:03.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:02 gibba043 bash[24019]: cluster 2021-03-10T14:34:00.945126+0000 mgr.gibba043.dnkmem (mgr.34373) 2295 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:02 gibba003 bash[31385]: cluster 2021-03-10T14:34:00.945126+0000 mgr.gibba043.dnkmem (mgr.34373) 2295 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:02 gibba003 bash[32348]: cluster 2021-03-10T14:34:00.945126+0000 mgr.gibba043.dnkmem (mgr.34373) 2295 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:03 gibba043 bash[24019]: audit 2021-03-10T14:34:02.465848+0000 mgr.gibba043.dnkmem (mgr.34373) 2296 : audit [DBG] from='client.45603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:03 gibba043 bash[24019]: audit 2021-03-10T14:34:02.690106+0000 mgr.gibba043.dnkmem (mgr.34373) 2297 : audit [DBG] from='client.55594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:03 gibba043 bash[24019]: audit 2021-03-10T14:34:02.961784+0000 mon.a (mon.0) 805 : audit [DBG] from='client.? 172.21.2.103:0/383635051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:04.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:03 gibba003 bash[31385]: audit 2021-03-10T14:34:02.465848+0000 mgr.gibba043.dnkmem (mgr.34373) 2296 : audit [DBG] from='client.45603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:04.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:03 gibba003 bash[31385]: audit 2021-03-10T14:34:02.690106+0000 mgr.gibba043.dnkmem (mgr.34373) 2297 : audit [DBG] from='client.55594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:04.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:03 gibba003 bash[31385]: audit 2021-03-10T14:34:02.961784+0000 mon.a (mon.0) 805 : audit [DBG] from='client.? 172.21.2.103:0/383635051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:04.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:03 gibba003 bash[32348]: audit 2021-03-10T14:34:02.465848+0000 mgr.gibba043.dnkmem (mgr.34373) 2296 : audit [DBG] from='client.45603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:04.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:03 gibba003 bash[32348]: audit 2021-03-10T14:34:02.690106+0000 mgr.gibba043.dnkmem (mgr.34373) 2297 : audit [DBG] from='client.55594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:04.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:03 gibba003 bash[32348]: audit 2021-03-10T14:34:02.961784+0000 mon.a (mon.0) 805 : audit [DBG] from='client.? 172.21.2.103:0/383635051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:04 gibba043 bash[24019]: cluster 2021-03-10T14:34:02.946230+0000 mgr.gibba043.dnkmem (mgr.34373) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:04 gibba003 bash[31385]: cluster 2021-03-10T14:34:02.946230+0000 mgr.gibba043.dnkmem (mgr.34373) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:04 gibba003 bash[32348]: cluster 2021-03-10T14:34:02.946230+0000 mgr.gibba043.dnkmem (mgr.34373) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:05 gibba043 bash[24019]: cluster 2021-03-10T14:34:04.947638+0000 mgr.gibba043.dnkmem (mgr.34373) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:05 gibba003 bash[31385]: cluster 2021-03-10T14:34:04.947638+0000 mgr.gibba043.dnkmem (mgr.34373) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:05 gibba003 bash[32348]: cluster 2021-03-10T14:34:04.947638+0000 mgr.gibba043.dnkmem (mgr.34373) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.385415+0000 mgr.gibba043.dnkmem (mgr.34373) 2300 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:34:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.387013+0000 mgr.gibba043.dnkmem (mgr.34373) 2301 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:34:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.601690+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:34:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.602156+0000 mgr.gibba043.dnkmem (mgr.34373) 2302 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.603870+0000 mgr.gibba043.dnkmem (mgr.34373) 2303 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.605193+0000 mgr.gibba043.dnkmem (mgr.34373) 2304 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.605265+0000 mgr.gibba043.dnkmem (mgr.34373) 2305 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.605324+0000 mon.c (mon.1) 630 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.606544+0000 mgr.gibba043.dnkmem (mgr.34373) 2306 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.606616+0000 mgr.gibba043.dnkmem (mgr.34373) 2307 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.606649+0000 mon.c (mon.1) 631 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.607692+0000 mgr.gibba043.dnkmem (mgr.34373) 2308 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.608013+0000 mon.c (mon.1) 632 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.609036+0000 mgr.gibba043.dnkmem (mgr.34373) 2309 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.609072+0000 mgr.gibba043.dnkmem (mgr.34373) 2310 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.609301+0000 mon.c (mon.1) 633 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.610212+0000 mgr.gibba043.dnkmem (mgr.34373) 2311 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.610524+0000 mgr.gibba043.dnkmem (mgr.34373) 2312 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.611767+0000 mgr.gibba043.dnkmem (mgr.34373) 2313 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.611805+0000 mgr.gibba043.dnkmem (mgr.34373) 2314 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.611811+0000 mon.c (mon.1) 634 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: cephadm 2021-03-10T14:34:06.611908+0000 mgr.gibba043.dnkmem (mgr.34373) 2315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:07.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[31385]: audit 2021-03-10T14:34:06.613187+0000 mon.c (mon.1) 635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.385415+0000 mgr.gibba043.dnkmem (mgr.34373) 2300 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:34:07.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.387013+0000 mgr.gibba043.dnkmem (mgr.34373) 2301 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:34:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.601690+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:34:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.602156+0000 mgr.gibba043.dnkmem (mgr.34373) 2302 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.603870+0000 mgr.gibba043.dnkmem (mgr.34373) 2303 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.605193+0000 mgr.gibba043.dnkmem (mgr.34373) 2304 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.605265+0000 mgr.gibba043.dnkmem (mgr.34373) 2305 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.605324+0000 mon.c (mon.1) 630 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.606544+0000 mgr.gibba043.dnkmem (mgr.34373) 2306 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.606616+0000 mgr.gibba043.dnkmem (mgr.34373) 2307 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.606649+0000 mon.c (mon.1) 631 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.607692+0000 mgr.gibba043.dnkmem (mgr.34373) 2308 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.608013+0000 mon.c (mon.1) 632 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.609036+0000 mgr.gibba043.dnkmem (mgr.34373) 2309 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.609072+0000 mgr.gibba043.dnkmem (mgr.34373) 2310 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.609301+0000 mon.c (mon.1) 633 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.610212+0000 mgr.gibba043.dnkmem (mgr.34373) 2311 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.610524+0000 mgr.gibba043.dnkmem (mgr.34373) 2312 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.611767+0000 mgr.gibba043.dnkmem (mgr.34373) 2313 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.611805+0000 mgr.gibba043.dnkmem (mgr.34373) 2314 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:07.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.611811+0000 mon.c (mon.1) 634 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:07.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: cephadm 2021-03-10T14:34:06.611908+0000 mgr.gibba043.dnkmem (mgr.34373) 2315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:07.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:07 gibba003 bash[32348]: audit 2021-03-10T14:34:06.613187+0000 mon.c (mon.1) 635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.385415+0000 mgr.gibba043.dnkmem (mgr.34373) 2300 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:34:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.387013+0000 mgr.gibba043.dnkmem (mgr.34373) 2301 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:34:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.601690+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:34:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.602156+0000 mgr.gibba043.dnkmem (mgr.34373) 2302 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.603870+0000 mgr.gibba043.dnkmem (mgr.34373) 2303 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.605193+0000 mgr.gibba043.dnkmem (mgr.34373) 2304 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.605265+0000 mgr.gibba043.dnkmem (mgr.34373) 2305 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:08.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.605324+0000 mon.c (mon.1) 630 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:08.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.606544+0000 mgr.gibba043.dnkmem (mgr.34373) 2306 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:08.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.606616+0000 mgr.gibba043.dnkmem (mgr.34373) 2307 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:08.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.606649+0000 mon.c (mon.1) 631 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:08.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.607692+0000 mgr.gibba043.dnkmem (mgr.34373) 2308 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:08.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.608013+0000 mon.c (mon.1) 632 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:08.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.609036+0000 mgr.gibba043.dnkmem (mgr.34373) 2309 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:08.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.609072+0000 mgr.gibba043.dnkmem (mgr.34373) 2310 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:08.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.609301+0000 mon.c (mon.1) 633 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:08.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.610212+0000 mgr.gibba043.dnkmem (mgr.34373) 2311 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:08.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.610524+0000 mgr.gibba043.dnkmem (mgr.34373) 2312 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:08.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.611767+0000 mgr.gibba043.dnkmem (mgr.34373) 2313 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:08.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.611805+0000 mgr.gibba043.dnkmem (mgr.34373) 2314 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:08.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.611811+0000 mon.c (mon.1) 634 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:08.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: cephadm 2021-03-10T14:34:06.611908+0000 mgr.gibba043.dnkmem (mgr.34373) 2315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:08.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:07 gibba043 bash[24019]: audit 2021-03-10T14:34:06.613187+0000 mon.c (mon.1) 635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:08 gibba003 bash[31385]: cluster 2021-03-10T14:34:06.949232+0000 mgr.gibba043.dnkmem (mgr.34373) 2316 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:09.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:08 gibba003 bash[32348]: cluster 2021-03-10T14:34:06.949232+0000 mgr.gibba043.dnkmem (mgr.34373) 2316 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:08 gibba043 bash[24019]: cluster 2021-03-10T14:34:06.949232+0000 mgr.gibba043.dnkmem (mgr.34373) 2316 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:10 gibba003 bash[31385]: cluster 2021-03-10T14:34:08.950741+0000 mgr.gibba043.dnkmem (mgr.34373) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:11.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:10 gibba003 bash[32348]: cluster 2021-03-10T14:34:08.950741+0000 mgr.gibba043.dnkmem (mgr.34373) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:10 gibba043 bash[24019]: cluster 2021-03-10T14:34:08.950741+0000 mgr.gibba043.dnkmem (mgr.34373) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:13.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:12 gibba003 bash[31385]: cluster 2021-03-10T14:34:10.952155+0000 mgr.gibba043.dnkmem (mgr.34373) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:13.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:12 gibba003 bash[32348]: cluster 2021-03-10T14:34:10.952155+0000 mgr.gibba043.dnkmem (mgr.34373) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:13.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:12 gibba043 bash[24019]: cluster 2021-03-10T14:34:10.952155+0000 mgr.gibba043.dnkmem (mgr.34373) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.980767+0000 mon.c (mon.1) 636 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.981920+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.989646+0000 mon.c (mon.1) 637 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.990486+0000 mon.c (mon.1) 638 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.990938+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.991705+0000 mon.c (mon.1) 639 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.993043+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.993124+0000 mon.c (mon.1) 640 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.994662+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:12.994832+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:13.062014+0000 mon.c (mon.1) 641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[31385]: audit 2021-03-10T14:34:13.062867+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.980767+0000 mon.c (mon.1) 636 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.981920+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.989646+0000 mon.c (mon.1) 637 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.990486+0000 mon.c (mon.1) 638 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.990938+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.991705+0000 mon.c (mon.1) 639 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.993043+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.993124+0000 mon.c (mon.1) 640 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.994662+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:12.994832+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:13.062014+0000 mon.c (mon.1) 641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:13 gibba003 bash[32348]: audit 2021-03-10T14:34:13.062867+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.980767+0000 mon.c (mon.1) 636 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.981920+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.989646+0000 mon.c (mon.1) 637 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.990486+0000 mon.c (mon.1) 638 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.990938+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.991705+0000 mon.c (mon.1) 639 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.993043+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.993124+0000 mon.c (mon.1) 640 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.994662+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:34:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:12.994832+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:13.062014+0000 mon.c (mon.1) 641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:13 gibba043 bash[24019]: audit 2021-03-10T14:34:13.062867+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:14 gibba003 bash[31385]: cluster 2021-03-10T14:34:12.953716+0000 mgr.gibba043.dnkmem (mgr.34373) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:15.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:14 gibba003 bash[32348]: cluster 2021-03-10T14:34:12.953716+0000 mgr.gibba043.dnkmem (mgr.34373) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:14 gibba043 bash[24019]: cluster 2021-03-10T14:34:12.953716+0000 mgr.gibba043.dnkmem (mgr.34373) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:16 gibba003 bash[31385]: cluster 2021-03-10T14:34:14.955415+0000 mgr.gibba043.dnkmem (mgr.34373) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:17.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:16 gibba003 bash[32348]: cluster 2021-03-10T14:34:14.955415+0000 mgr.gibba043.dnkmem (mgr.34373) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:16 gibba043 bash[24019]: cluster 2021-03-10T14:34:14.955415+0000 mgr.gibba043.dnkmem (mgr.34373) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:18 gibba003 bash[31385]: cluster 2021-03-10T14:34:16.956183+0000 mgr.gibba043.dnkmem (mgr.34373) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:19.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:18 gibba003 bash[32348]: cluster 2021-03-10T14:34:16.956183+0000 mgr.gibba043.dnkmem (mgr.34373) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:18 gibba043 bash[24019]: cluster 2021-03-10T14:34:16.956183+0000 mgr.gibba043.dnkmem (mgr.34373) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:20 gibba003 bash[31385]: cluster 2021-03-10T14:34:18.957118+0000 mgr.gibba043.dnkmem (mgr.34373) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:21.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:20 gibba003 bash[32348]: cluster 2021-03-10T14:34:18.957118+0000 mgr.gibba043.dnkmem (mgr.34373) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:21.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:20 gibba043 bash[24019]: cluster 2021-03-10T14:34:18.957118+0000 mgr.gibba043.dnkmem (mgr.34373) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:22 gibba003 bash[31385]: cluster 2021-03-10T14:34:20.958047+0000 mgr.gibba043.dnkmem (mgr.34373) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:22 gibba003 bash[31385]: cephadm 2021-03-10T14:34:21.627946+0000 mgr.gibba043.dnkmem (mgr.34373) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:22 gibba003 bash[32348]: cluster 2021-03-10T14:34:20.958047+0000 mgr.gibba043.dnkmem (mgr.34373) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:22 gibba003 bash[32348]: cephadm 2021-03-10T14:34:21.627946+0000 mgr.gibba043.dnkmem (mgr.34373) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:23.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:22 gibba043 bash[24019]: cluster 2021-03-10T14:34:20.958047+0000 mgr.gibba043.dnkmem (mgr.34373) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:22 gibba043 bash[24019]: cephadm 2021-03-10T14:34:21.627946+0000 mgr.gibba043.dnkmem (mgr.34373) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:24 gibba003 bash[31385]: cluster 2021-03-10T14:34:22.959390+0000 mgr.gibba043.dnkmem (mgr.34373) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:24 gibba003 bash[32348]: cluster 2021-03-10T14:34:22.959390+0000 mgr.gibba043.dnkmem (mgr.34373) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:24 gibba043 bash[24019]: cluster 2021-03-10T14:34:22.959390+0000 mgr.gibba043.dnkmem (mgr.34373) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:26 gibba003 bash[31385]: cluster 2021-03-10T14:34:24.960344+0000 mgr.gibba043.dnkmem (mgr.34373) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:26 gibba003 bash[32348]: cluster 2021-03-10T14:34:24.960344+0000 mgr.gibba043.dnkmem (mgr.34373) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:26 gibba043 bash[24019]: cluster 2021-03-10T14:34:24.960344+0000 mgr.gibba043.dnkmem (mgr.34373) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:28 gibba003 bash[31385]: cluster 2021-03-10T14:34:26.961080+0000 mgr.gibba043.dnkmem (mgr.34373) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:28 gibba003 bash[32348]: cluster 2021-03-10T14:34:26.961080+0000 mgr.gibba043.dnkmem (mgr.34373) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:28 gibba043 bash[24019]: cluster 2021-03-10T14:34:26.961080+0000 mgr.gibba043.dnkmem (mgr.34373) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:31.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:30 gibba043 bash[24019]: cluster 2021-03-10T14:34:28.961713+0000 mgr.gibba043.dnkmem (mgr.34373) 2328 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:31.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:30 gibba003 bash[31385]: cluster 2021-03-10T14:34:28.961713+0000 mgr.gibba043.dnkmem (mgr.34373) 2328 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:30 gibba003 bash[32348]: cluster 2021-03-10T14:34:28.961713+0000 mgr.gibba043.dnkmem (mgr.34373) 2328 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.198 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:34:33.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:32 gibba043 bash[24019]: cluster 2021-03-10T14:34:30.962380+0000 mgr.gibba043.dnkmem (mgr.34373) 2329 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.429 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:34:33.429 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (42m) 8m ago 48m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:34:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:34:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:34:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:34:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:34:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:34:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (42m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:34:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:34:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:34:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:34:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:34:33.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:34:33.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:34:33.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:34:33.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:34:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:34:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:34:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:34:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (47m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:34:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:34:33.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:32 gibba003 bash[31385]: cluster 2021-03-10T14:34:30.962380+0000 mgr.gibba043.dnkmem (mgr.34373) 2329 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:32 gibba003 bash[32348]: cluster 2021-03-10T14:34:30.962380+0000 mgr.gibba043.dnkmem (mgr.34373) 2329 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.677 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:34:33.677 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:34:33.677 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:33.678 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:34:33.678 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:34:33.678 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:33.678 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:34:33.679 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:34:33.679 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:34:33.679 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:34:33.679 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:34:33.679 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:34:33.680 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:34:33.680 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:34:33.680 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:34:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:33 gibba043 bash[24019]: audit 2021-03-10T14:34:33.678335+0000 mon.a (mon.0) 813 : audit [DBG] from='client.? 172.21.2.103:0/3812398906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:34.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:33 gibba003 bash[31385]: audit 2021-03-10T14:34:33.678335+0000 mon.a (mon.0) 813 : audit [DBG] from='client.? 172.21.2.103:0/3812398906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:34.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:33 gibba003 bash[32348]: audit 2021-03-10T14:34:33.678335+0000 mon.a (mon.0) 813 : audit [DBG] from='client.? 172.21.2.103:0/3812398906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:34 gibba043 bash[24019]: cluster 2021-03-10T14:34:32.963032+0000 mgr.gibba043.dnkmem (mgr.34373) 2330 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:34 gibba043 bash[24019]: audit 2021-03-10T14:34:33.188398+0000 mgr.gibba043.dnkmem (mgr.34373) 2331 : audit [DBG] from='client.55606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:34 gibba043 bash[24019]: audit 2021-03-10T14:34:33.416271+0000 mgr.gibba043.dnkmem (mgr.34373) 2332 : audit [DBG] from='client.55612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:34 gibba003 bash[31385]: cluster 2021-03-10T14:34:32.963032+0000 mgr.gibba043.dnkmem (mgr.34373) 2330 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:34 gibba003 bash[31385]: audit 2021-03-10T14:34:33.188398+0000 mgr.gibba043.dnkmem (mgr.34373) 2331 : audit [DBG] from='client.55606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:34 gibba003 bash[31385]: audit 2021-03-10T14:34:33.416271+0000 mgr.gibba043.dnkmem (mgr.34373) 2332 : audit [DBG] from='client.55612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:34 gibba003 bash[32348]: cluster 2021-03-10T14:34:32.963032+0000 mgr.gibba043.dnkmem (mgr.34373) 2330 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:34 gibba003 bash[32348]: audit 2021-03-10T14:34:33.188398+0000 mgr.gibba043.dnkmem (mgr.34373) 2331 : audit [DBG] from='client.55606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:34 gibba003 bash[32348]: audit 2021-03-10T14:34:33.416271+0000 mgr.gibba043.dnkmem (mgr.34373) 2332 : audit [DBG] from='client.55612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:36 gibba003 bash[31385]: cluster 2021-03-10T14:34:34.964819+0000 mgr.gibba043.dnkmem (mgr.34373) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:36.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:36 gibba003 bash[32348]: cluster 2021-03-10T14:34:34.964819+0000 mgr.gibba043.dnkmem (mgr.34373) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:36 gibba043 bash[24019]: cluster 2021-03-10T14:34:34.964819+0000 mgr.gibba043.dnkmem (mgr.34373) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:37 gibba003 bash[31385]: cephadm 2021-03-10T14:34:36.643747+0000 mgr.gibba043.dnkmem (mgr.34373) 2334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:37 gibba003 bash[32348]: cephadm 2021-03-10T14:34:36.643747+0000 mgr.gibba043.dnkmem (mgr.34373) 2334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:37 gibba043 bash[24019]: cephadm 2021-03-10T14:34:36.643747+0000 mgr.gibba043.dnkmem (mgr.34373) 2334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:38 gibba003 bash[31385]: cluster 2021-03-10T14:34:36.966458+0000 mgr.gibba043.dnkmem (mgr.34373) 2335 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:38 gibba003 bash[32348]: cluster 2021-03-10T14:34:36.966458+0000 mgr.gibba043.dnkmem (mgr.34373) 2335 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:38 gibba043 bash[24019]: cluster 2021-03-10T14:34:36.966458+0000 mgr.gibba043.dnkmem (mgr.34373) 2335 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:40 gibba003 bash[31385]: cluster 2021-03-10T14:34:38.968045+0000 mgr.gibba043.dnkmem (mgr.34373) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:40 gibba003 bash[32348]: cluster 2021-03-10T14:34:38.968045+0000 mgr.gibba043.dnkmem (mgr.34373) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:40 gibba043 bash[24019]: cluster 2021-03-10T14:34:38.968045+0000 mgr.gibba043.dnkmem (mgr.34373) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:42 gibba003 bash[31385]: cluster 2021-03-10T14:34:40.969541+0000 mgr.gibba043.dnkmem (mgr.34373) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:42 gibba003 bash[32348]: cluster 2021-03-10T14:34:40.969541+0000 mgr.gibba043.dnkmem (mgr.34373) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:42 gibba043 bash[24019]: cluster 2021-03-10T14:34:40.969541+0000 mgr.gibba043.dnkmem (mgr.34373) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:44 gibba003 bash[31385]: cluster 2021-03-10T14:34:42.971099+0000 mgr.gibba043.dnkmem (mgr.34373) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:44 gibba003 bash[32348]: cluster 2021-03-10T14:34:42.971099+0000 mgr.gibba043.dnkmem (mgr.34373) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:44 gibba043 bash[24019]: cluster 2021-03-10T14:34:42.971099+0000 mgr.gibba043.dnkmem (mgr.34373) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:46 gibba003 bash[31385]: cluster 2021-03-10T14:34:44.972906+0000 mgr.gibba043.dnkmem (mgr.34373) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:47.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:46 gibba003 bash[32348]: cluster 2021-03-10T14:34:44.972906+0000 mgr.gibba043.dnkmem (mgr.34373) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:46 gibba043 bash[24019]: cluster 2021-03-10T14:34:44.972906+0000 mgr.gibba043.dnkmem (mgr.34373) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:48 gibba003 bash[31385]: cluster 2021-03-10T14:34:46.974268+0000 mgr.gibba043.dnkmem (mgr.34373) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:48 gibba003 bash[32348]: cluster 2021-03-10T14:34:46.974268+0000 mgr.gibba043.dnkmem (mgr.34373) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:48 gibba043 bash[24019]: cluster 2021-03-10T14:34:46.974268+0000 mgr.gibba043.dnkmem (mgr.34373) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:50 gibba003 bash[31385]: cluster 2021-03-10T14:34:48.975756+0000 mgr.gibba043.dnkmem (mgr.34373) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:50 gibba003 bash[32348]: cluster 2021-03-10T14:34:48.975756+0000 mgr.gibba043.dnkmem (mgr.34373) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:50 gibba043 bash[24019]: cluster 2021-03-10T14:34:48.975756+0000 mgr.gibba043.dnkmem (mgr.34373) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:52 gibba003 bash[31385]: cluster 2021-03-10T14:34:50.976623+0000 mgr.gibba043.dnkmem (mgr.34373) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:52 gibba003 bash[31385]: cephadm 2021-03-10T14:34:51.656092+0000 mgr.gibba043.dnkmem (mgr.34373) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:53.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:52 gibba003 bash[32348]: cluster 2021-03-10T14:34:50.976623+0000 mgr.gibba043.dnkmem (mgr.34373) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:52 gibba003 bash[32348]: cephadm 2021-03-10T14:34:51.656092+0000 mgr.gibba043.dnkmem (mgr.34373) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:52 gibba043 bash[24019]: cluster 2021-03-10T14:34:50.976623+0000 mgr.gibba043.dnkmem (mgr.34373) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:52 gibba043 bash[24019]: cephadm 2021-03-10T14:34:51.656092+0000 mgr.gibba043.dnkmem (mgr.34373) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:34:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:54 gibba003 bash[31385]: cluster 2021-03-10T14:34:52.977962+0000 mgr.gibba043.dnkmem (mgr.34373) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:55.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:54 gibba003 bash[32348]: cluster 2021-03-10T14:34:52.977962+0000 mgr.gibba043.dnkmem (mgr.34373) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:54 gibba043 bash[24019]: cluster 2021-03-10T14:34:52.977962+0000 mgr.gibba043.dnkmem (mgr.34373) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:56 gibba003 bash[31385]: cluster 2021-03-10T14:34:54.979856+0000 mgr.gibba043.dnkmem (mgr.34373) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:57.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:56 gibba003 bash[32348]: cluster 2021-03-10T14:34:54.979856+0000 mgr.gibba043.dnkmem (mgr.34373) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:56 gibba043 bash[24019]: cluster 2021-03-10T14:34:54.979856+0000 mgr.gibba043.dnkmem (mgr.34373) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:34:58 gibba003 bash[31385]: cluster 2021-03-10T14:34:56.980884+0000 mgr.gibba043.dnkmem (mgr.34373) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:59.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:34:58 gibba003 bash[32348]: cluster 2021-03-10T14:34:56.980884+0000 mgr.gibba043.dnkmem (mgr.34373) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:34:58 gibba043 bash[24019]: cluster 2021-03-10T14:34:56.980884+0000 mgr.gibba043.dnkmem (mgr.34373) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:00 gibba003 bash[31385]: cluster 2021-03-10T14:34:58.981725+0000 mgr.gibba043.dnkmem (mgr.34373) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:00 gibba003 bash[32348]: cluster 2021-03-10T14:34:58.981725+0000 mgr.gibba043.dnkmem (mgr.34373) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:00 gibba043 bash[24019]: cluster 2021-03-10T14:34:58.981725+0000 mgr.gibba043.dnkmem (mgr.34373) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:02 gibba043 bash[24019]: cluster 2021-03-10T14:35:00.982552+0000 mgr.gibba043.dnkmem (mgr.34373) 2348 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:02 gibba003 bash[31385]: cluster 2021-03-10T14:35:00.982552+0000 mgr.gibba043.dnkmem (mgr.34373) 2348 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:02 gibba003 bash[32348]: cluster 2021-03-10T14:35:00.982552+0000 mgr.gibba043.dnkmem (mgr.34373) 2348 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.916 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:35:04.144 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:35:04.145 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (43m) 9m ago 48m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:35:04.145 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (48m) 8m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:35:04.145 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (43m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:35:04.145 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:35:04.146 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:35:04.146 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (42m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:35:04.146 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:35:04.146 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:35:04.147 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (48m) 9m ago 48m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:35:04.147 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:35:04.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:35:04.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:35:04.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:35:04.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:35:04.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:35:04.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:35:04.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:35:04.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (38m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:35:04.149 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (48m) 8m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:35:04.149 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:35:04.391 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:35:04.391 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:35:04.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:04.391 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:35:04.392 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:35:04.392 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:04.392 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:35:04.392 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:35:04.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:35:04.393 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:35:04.393 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:35:04.393 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:35:04.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:35:04.394 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:35:04.394 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:35:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:04 gibba043 bash[24019]: cluster 2021-03-10T14:35:02.983758+0000 mgr.gibba043.dnkmem (mgr.34373) 2349 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:04 gibba043 bash[24019]: audit 2021-03-10T14:35:03.905961+0000 mgr.gibba043.dnkmem (mgr.34373) 2350 : audit [DBG] from='client.45639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:04 gibba043 bash[24019]: audit 2021-03-10T14:35:04.391829+0000 mon.a (mon.0) 814 : audit [DBG] from='client.? 172.21.2.103:0/1329139027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:04 gibba003 bash[31385]: cluster 2021-03-10T14:35:02.983758+0000 mgr.gibba043.dnkmem (mgr.34373) 2349 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:04 gibba003 bash[31385]: audit 2021-03-10T14:35:03.905961+0000 mgr.gibba043.dnkmem (mgr.34373) 2350 : audit [DBG] from='client.45639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:04 gibba003 bash[31385]: audit 2021-03-10T14:35:04.391829+0000 mon.a (mon.0) 814 : audit [DBG] from='client.? 172.21.2.103:0/1329139027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:04 gibba003 bash[32348]: cluster 2021-03-10T14:35:02.983758+0000 mgr.gibba043.dnkmem (mgr.34373) 2349 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:04 gibba003 bash[32348]: audit 2021-03-10T14:35:03.905961+0000 mgr.gibba043.dnkmem (mgr.34373) 2350 : audit [DBG] from='client.45639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:04 gibba003 bash[32348]: audit 2021-03-10T14:35:04.391829+0000 mon.a (mon.0) 814 : audit [DBG] from='client.? 172.21.2.103:0/1329139027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:05 gibba043 bash[24019]: audit 2021-03-10T14:35:04.130665+0000 mgr.gibba043.dnkmem (mgr.34373) 2351 : audit [DBG] from='client.45645 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:06.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:05 gibba003 bash[31385]: audit 2021-03-10T14:35:04.130665+0000 mgr.gibba043.dnkmem (mgr.34373) 2351 : audit [DBG] from='client.45645 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:06.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:05 gibba003 bash[32348]: audit 2021-03-10T14:35:04.130665+0000 mgr.gibba043.dnkmem (mgr.34373) 2351 : audit [DBG] from='client.45645 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: cluster 2021-03-10T14:35:04.984450+0000 mgr.gibba043.dnkmem (mgr.34373) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.873637+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:35:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.877427+0000 mon.c (mon.1) 642 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.879215+0000 mon.c (mon.1) 643 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.880774+0000 mon.c (mon.1) 644 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.882305+0000 mon.c (mon.1) 645 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.885811+0000 mon.c (mon.1) 646 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:06 gibba043 bash[24019]: audit 2021-03-10T14:35:06.887254+0000 mon.c (mon.1) 647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: cluster 2021-03-10T14:35:04.984450+0000 mgr.gibba043.dnkmem (mgr.34373) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.873637+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:35:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.877427+0000 mon.c (mon.1) 642 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.879215+0000 mon.c (mon.1) 643 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.880774+0000 mon.c (mon.1) 644 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.882305+0000 mon.c (mon.1) 645 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.885811+0000 mon.c (mon.1) 646 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[31385]: audit 2021-03-10T14:35:06.887254+0000 mon.c (mon.1) 647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: cluster 2021-03-10T14:35:04.984450+0000 mgr.gibba043.dnkmem (mgr.34373) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.873637+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:35:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.877427+0000 mon.c (mon.1) 642 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.879215+0000 mon.c (mon.1) 643 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.880774+0000 mon.c (mon.1) 644 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.882305+0000 mon.c (mon.1) 645 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.885811+0000 mon.c (mon.1) 646 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:06 gibba003 bash[32348]: audit 2021-03-10T14:35:06.887254+0000 mon.c (mon.1) 647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.672044+0000 mgr.gibba043.dnkmem (mgr.34373) 2353 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:35:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.672546+0000 mgr.gibba043.dnkmem (mgr.34373) 2354 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:35:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.874163+0000 mgr.gibba043.dnkmem (mgr.34373) 2355 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.876205+0000 mgr.gibba043.dnkmem (mgr.34373) 2356 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.877822+0000 mgr.gibba043.dnkmem (mgr.34373) 2357 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.877858+0000 mgr.gibba043.dnkmem (mgr.34373) 2358 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.879396+0000 mgr.gibba043.dnkmem (mgr.34373) 2359 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.879432+0000 mgr.gibba043.dnkmem (mgr.34373) 2360 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.881064+0000 mgr.gibba043.dnkmem (mgr.34373) 2361 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.882771+0000 mgr.gibba043.dnkmem (mgr.34373) 2362 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.882808+0000 mgr.gibba043.dnkmem (mgr.34373) 2363 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.884124+0000 mgr.gibba043.dnkmem (mgr.34373) 2364 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.884437+0000 mgr.gibba043.dnkmem (mgr.34373) 2365 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.886059+0000 mgr.gibba043.dnkmem (mgr.34373) 2366 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.886097+0000 mgr.gibba043.dnkmem (mgr.34373) 2367 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cephadm 2021-03-10T14:35:06.886205+0000 mgr.gibba043.dnkmem (mgr.34373) 2368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:07 gibba043 bash[24019]: cluster 2021-03-10T14:35:06.985612+0000 mgr.gibba043.dnkmem (mgr.34373) 2369 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.672044+0000 mgr.gibba043.dnkmem (mgr.34373) 2353 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:35:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.672546+0000 mgr.gibba043.dnkmem (mgr.34373) 2354 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:35:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.874163+0000 mgr.gibba043.dnkmem (mgr.34373) 2355 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.876205+0000 mgr.gibba043.dnkmem (mgr.34373) 2356 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.877822+0000 mgr.gibba043.dnkmem (mgr.34373) 2357 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.877858+0000 mgr.gibba043.dnkmem (mgr.34373) 2358 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.879396+0000 mgr.gibba043.dnkmem (mgr.34373) 2359 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.879432+0000 mgr.gibba043.dnkmem (mgr.34373) 2360 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.881064+0000 mgr.gibba043.dnkmem (mgr.34373) 2361 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.882771+0000 mgr.gibba043.dnkmem (mgr.34373) 2362 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.882808+0000 mgr.gibba043.dnkmem (mgr.34373) 2363 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.884124+0000 mgr.gibba043.dnkmem (mgr.34373) 2364 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.884437+0000 mgr.gibba043.dnkmem (mgr.34373) 2365 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.886059+0000 mgr.gibba043.dnkmem (mgr.34373) 2366 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.886097+0000 mgr.gibba043.dnkmem (mgr.34373) 2367 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cephadm 2021-03-10T14:35:06.886205+0000 mgr.gibba043.dnkmem (mgr.34373) 2368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[31385]: cluster 2021-03-10T14:35:06.985612+0000 mgr.gibba043.dnkmem (mgr.34373) 2369 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.672044+0000 mgr.gibba043.dnkmem (mgr.34373) 2353 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:35:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.672546+0000 mgr.gibba043.dnkmem (mgr.34373) 2354 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:35:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.874163+0000 mgr.gibba043.dnkmem (mgr.34373) 2355 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.876205+0000 mgr.gibba043.dnkmem (mgr.34373) 2356 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.877822+0000 mgr.gibba043.dnkmem (mgr.34373) 2357 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.877858+0000 mgr.gibba043.dnkmem (mgr.34373) 2358 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.879396+0000 mgr.gibba043.dnkmem (mgr.34373) 2359 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.879432+0000 mgr.gibba043.dnkmem (mgr.34373) 2360 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.881064+0000 mgr.gibba043.dnkmem (mgr.34373) 2361 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.882771+0000 mgr.gibba043.dnkmem (mgr.34373) 2362 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.882808+0000 mgr.gibba043.dnkmem (mgr.34373) 2363 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.884124+0000 mgr.gibba043.dnkmem (mgr.34373) 2364 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.884437+0000 mgr.gibba043.dnkmem (mgr.34373) 2365 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.886059+0000 mgr.gibba043.dnkmem (mgr.34373) 2366 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.886097+0000 mgr.gibba043.dnkmem (mgr.34373) 2367 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cephadm 2021-03-10T14:35:06.886205+0000 mgr.gibba043.dnkmem (mgr.34373) 2368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:07 gibba003 bash[32348]: cluster 2021-03-10T14:35:06.985612+0000 mgr.gibba043.dnkmem (mgr.34373) 2369 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:10 gibba003 bash[31385]: cluster 2021-03-10T14:35:08.987196+0000 mgr.gibba043.dnkmem (mgr.34373) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:10 gibba003 bash[32348]: cluster 2021-03-10T14:35:08.987196+0000 mgr.gibba043.dnkmem (mgr.34373) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:10 gibba043 bash[24019]: cluster 2021-03-10T14:35:08.987196+0000 mgr.gibba043.dnkmem (mgr.34373) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:12 gibba003 bash[31385]: cluster 2021-03-10T14:35:10.988906+0000 mgr.gibba043.dnkmem (mgr.34373) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:12 gibba003 bash[32348]: cluster 2021-03-10T14:35:10.988906+0000 mgr.gibba043.dnkmem (mgr.34373) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:12 gibba043 bash[24019]: cluster 2021-03-10T14:35:10.988906+0000 mgr.gibba043.dnkmem (mgr.34373) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:12.988826+0000 mon.c (mon.1) 648 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:12.989914+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.002405+0000 mon.c (mon.1) 649 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:35:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.003149+0000 mon.c (mon.1) 650 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:35:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.003705+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:35:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.003905+0000 mon.c (mon.1) 651 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.004839+0000 mon.c (mon.1) 652 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.004964+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:35:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.005983+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.007059+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.069254+0000 mon.c (mon.1) 653 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[31385]: audit 2021-03-10T14:35:13.070397+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:12.988826+0000 mon.c (mon.1) 648 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:12.989914+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.002405+0000 mon.c (mon.1) 649 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:35:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.003149+0000 mon.c (mon.1) 650 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:35:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.003705+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:35:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.003905+0000 mon.c (mon.1) 651 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.004839+0000 mon.c (mon.1) 652 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.004964+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:35:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.005983+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.007059+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.069254+0000 mon.c (mon.1) 653 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:13 gibba003 bash[32348]: audit 2021-03-10T14:35:13.070397+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:12.988826+0000 mon.c (mon.1) 648 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:12.989914+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.002405+0000 mon.c (mon.1) 649 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:35:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.003149+0000 mon.c (mon.1) 650 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:35:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.003705+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:35:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.003905+0000 mon.c (mon.1) 651 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.004839+0000 mon.c (mon.1) 652 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.004964+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:35:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.005983+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.007059+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:35:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.069254+0000 mon.c (mon.1) 653 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:13 gibba043 bash[24019]: audit 2021-03-10T14:35:13.070397+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:14 gibba003 bash[31385]: cluster 2021-03-10T14:35:12.990037+0000 mgr.gibba043.dnkmem (mgr.34373) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:15.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:14 gibba003 bash[32348]: cluster 2021-03-10T14:35:12.990037+0000 mgr.gibba043.dnkmem (mgr.34373) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:14 gibba043 bash[24019]: cluster 2021-03-10T14:35:12.990037+0000 mgr.gibba043.dnkmem (mgr.34373) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:16 gibba003 bash[31385]: cluster 2021-03-10T14:35:14.991476+0000 mgr.gibba043.dnkmem (mgr.34373) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:17.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:16 gibba003 bash[32348]: cluster 2021-03-10T14:35:14.991476+0000 mgr.gibba043.dnkmem (mgr.34373) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:16 gibba043 bash[24019]: cluster 2021-03-10T14:35:14.991476+0000 mgr.gibba043.dnkmem (mgr.34373) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:18 gibba003 bash[31385]: cluster 2021-03-10T14:35:16.992980+0000 mgr.gibba043.dnkmem (mgr.34373) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:19.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:18 gibba003 bash[32348]: cluster 2021-03-10T14:35:16.992980+0000 mgr.gibba043.dnkmem (mgr.34373) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:18 gibba043 bash[24019]: cluster 2021-03-10T14:35:16.992980+0000 mgr.gibba043.dnkmem (mgr.34373) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:20 gibba003 bash[31385]: cluster 2021-03-10T14:35:18.994594+0000 mgr.gibba043.dnkmem (mgr.34373) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:21.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:20 gibba003 bash[32348]: cluster 2021-03-10T14:35:18.994594+0000 mgr.gibba043.dnkmem (mgr.34373) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:20 gibba043 bash[24019]: cluster 2021-03-10T14:35:18.994594+0000 mgr.gibba043.dnkmem (mgr.34373) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:22 gibba003 bash[31385]: cluster 2021-03-10T14:35:20.995780+0000 mgr.gibba043.dnkmem (mgr.34373) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:22 gibba003 bash[31385]: cephadm 2021-03-10T14:35:21.902298+0000 mgr.gibba043.dnkmem (mgr.34373) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:22 gibba003 bash[32348]: cluster 2021-03-10T14:35:20.995780+0000 mgr.gibba043.dnkmem (mgr.34373) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:22 gibba003 bash[32348]: cephadm 2021-03-10T14:35:21.902298+0000 mgr.gibba043.dnkmem (mgr.34373) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:23.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:22 gibba043 bash[24019]: cluster 2021-03-10T14:35:20.995780+0000 mgr.gibba043.dnkmem (mgr.34373) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:22 gibba043 bash[24019]: cephadm 2021-03-10T14:35:21.902298+0000 mgr.gibba043.dnkmem (mgr.34373) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:24 gibba003 bash[31385]: cluster 2021-03-10T14:35:22.997151+0000 mgr.gibba043.dnkmem (mgr.34373) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:24 gibba003 bash[32348]: cluster 2021-03-10T14:35:22.997151+0000 mgr.gibba043.dnkmem (mgr.34373) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:24 gibba043 bash[24019]: cluster 2021-03-10T14:35:22.997151+0000 mgr.gibba043.dnkmem (mgr.34373) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:26 gibba003 bash[31385]: cluster 2021-03-10T14:35:24.998630+0000 mgr.gibba043.dnkmem (mgr.34373) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:26 gibba003 bash[32348]: cluster 2021-03-10T14:35:24.998630+0000 mgr.gibba043.dnkmem (mgr.34373) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:26 gibba043 bash[24019]: cluster 2021-03-10T14:35:24.998630+0000 mgr.gibba043.dnkmem (mgr.34373) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:28 gibba003 bash[31385]: cluster 2021-03-10T14:35:26.999692+0000 mgr.gibba043.dnkmem (mgr.34373) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:28 gibba003 bash[32348]: cluster 2021-03-10T14:35:26.999692+0000 mgr.gibba043.dnkmem (mgr.34373) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:28 gibba043 bash[24019]: cluster 2021-03-10T14:35:26.999692+0000 mgr.gibba043.dnkmem (mgr.34373) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:30 gibba043 bash[24019]: cluster 2021-03-10T14:35:29.000489+0000 mgr.gibba043.dnkmem (mgr.34373) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:31.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:30 gibba003 bash[31385]: cluster 2021-03-10T14:35:29.000489+0000 mgr.gibba043.dnkmem (mgr.34373) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:30 gibba003 bash[32348]: cluster 2021-03-10T14:35:29.000489+0000 mgr.gibba043.dnkmem (mgr.34373) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:32 gibba043 bash[24019]: cluster 2021-03-10T14:35:31.001423+0000 mgr.gibba043.dnkmem (mgr.34373) 2382 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:32 gibba003 bash[31385]: cluster 2021-03-10T14:35:31.001423+0000 mgr.gibba043.dnkmem (mgr.34373) 2382 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:32 gibba003 bash[32348]: cluster 2021-03-10T14:35:31.001423+0000 mgr.gibba043.dnkmem (mgr.34373) 2382 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:34.631 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:35:34.861 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:35:34.861 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (43m) 9m ago 49m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:35:34.861 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:35:34.862 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:35:34.862 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:35:34.862 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:35:34.862 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:35:34.863 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (43m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:35:34.863 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:35:34.863 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:35:34.863 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:35:34.863 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:35:34.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:35:34.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:35:34.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:35:34.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:35:34.864 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:35:34.865 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:35:34.865 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:35:34.865 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (48m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:35:34.865 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:35:35.109 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:35:35.110 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:35:35.110 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:35.110 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:35:35.110 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:35:35.111 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:35.111 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:35:35.111 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:35:35.111 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:35:35.111 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:35:35.112 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:35:35.112 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:35:35.112 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:35:35.112 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:35:35.112 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:35:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:34 gibba043 bash[24019]: cluster 2021-03-10T14:35:33.002856+0000 mgr.gibba043.dnkmem (mgr.34373) 2383 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:34 gibba003 bash[31385]: cluster 2021-03-10T14:35:33.002856+0000 mgr.gibba043.dnkmem (mgr.34373) 2383 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:35.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:34 gibba003 bash[32348]: cluster 2021-03-10T14:35:33.002856+0000 mgr.gibba043.dnkmem (mgr.34373) 2383 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:35 gibba043 bash[24019]: audit 2021-03-10T14:35:34.621870+0000 mgr.gibba043.dnkmem (mgr.34373) 2384 : audit [DBG] from='client.55642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:35 gibba043 bash[24019]: audit 2021-03-10T14:35:34.847326+0000 mgr.gibba043.dnkmem (mgr.34373) 2385 : audit [DBG] from='client.45663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:35 gibba043 bash[24019]: audit 2021-03-10T14:35:35.110735+0000 mon.c (mon.1) 654 : audit [DBG] from='client.? 172.21.2.103:0/2656653708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:35 gibba003 bash[31385]: audit 2021-03-10T14:35:34.621870+0000 mgr.gibba043.dnkmem (mgr.34373) 2384 : audit [DBG] from='client.55642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:35 gibba003 bash[31385]: audit 2021-03-10T14:35:34.847326+0000 mgr.gibba043.dnkmem (mgr.34373) 2385 : audit [DBG] from='client.45663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:35 gibba003 bash[31385]: audit 2021-03-10T14:35:35.110735+0000 mon.c (mon.1) 654 : audit [DBG] from='client.? 172.21.2.103:0/2656653708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:36.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:35 gibba003 bash[32348]: audit 2021-03-10T14:35:34.621870+0000 mgr.gibba043.dnkmem (mgr.34373) 2384 : audit [DBG] from='client.55642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:36.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:35 gibba003 bash[32348]: audit 2021-03-10T14:35:34.847326+0000 mgr.gibba043.dnkmem (mgr.34373) 2385 : audit [DBG] from='client.45663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:36.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:35 gibba003 bash[32348]: audit 2021-03-10T14:35:35.110735+0000 mon.c (mon.1) 654 : audit [DBG] from='client.? 172.21.2.103:0/2656653708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:36 gibba043 bash[24019]: cluster 2021-03-10T14:35:35.003788+0000 mgr.gibba043.dnkmem (mgr.34373) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:36 gibba003 bash[31385]: cluster 2021-03-10T14:35:35.003788+0000 mgr.gibba043.dnkmem (mgr.34373) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:36 gibba003 bash[32348]: cluster 2021-03-10T14:35:35.003788+0000 mgr.gibba043.dnkmem (mgr.34373) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:37 gibba043 bash[24019]: cephadm 2021-03-10T14:35:36.918323+0000 mgr.gibba043.dnkmem (mgr.34373) 2387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:37 gibba003 bash[31385]: cephadm 2021-03-10T14:35:36.918323+0000 mgr.gibba043.dnkmem (mgr.34373) 2387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:37 gibba003 bash[32348]: cephadm 2021-03-10T14:35:36.918323+0000 mgr.gibba043.dnkmem (mgr.34373) 2387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:38 gibba043 bash[24019]: cluster 2021-03-10T14:35:37.004223+0000 mgr.gibba043.dnkmem (mgr.34373) 2388 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:38 gibba003 bash[31385]: cluster 2021-03-10T14:35:37.004223+0000 mgr.gibba043.dnkmem (mgr.34373) 2388 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:38 gibba003 bash[32348]: cluster 2021-03-10T14:35:37.004223+0000 mgr.gibba043.dnkmem (mgr.34373) 2388 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:40 gibba043 bash[24019]: cluster 2021-03-10T14:35:39.004711+0000 mgr.gibba043.dnkmem (mgr.34373) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:40 gibba003 bash[31385]: cluster 2021-03-10T14:35:39.004711+0000 mgr.gibba043.dnkmem (mgr.34373) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:40 gibba003 bash[32348]: cluster 2021-03-10T14:35:39.004711+0000 mgr.gibba043.dnkmem (mgr.34373) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:42 gibba003 bash[31385]: cluster 2021-03-10T14:35:41.006424+0000 mgr.gibba043.dnkmem (mgr.34373) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:42 gibba003 bash[32348]: cluster 2021-03-10T14:35:41.006424+0000 mgr.gibba043.dnkmem (mgr.34373) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:42 gibba043 bash[24019]: cluster 2021-03-10T14:35:41.006424+0000 mgr.gibba043.dnkmem (mgr.34373) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:44 gibba003 bash[31385]: cluster 2021-03-10T14:35:43.007762+0000 mgr.gibba043.dnkmem (mgr.34373) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:44 gibba003 bash[32348]: cluster 2021-03-10T14:35:43.007762+0000 mgr.gibba043.dnkmem (mgr.34373) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:44 gibba043 bash[24019]: cluster 2021-03-10T14:35:43.007762+0000 mgr.gibba043.dnkmem (mgr.34373) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:46 gibba003 bash[31385]: cluster 2021-03-10T14:35:45.009311+0000 mgr.gibba043.dnkmem (mgr.34373) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:47.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:46 gibba003 bash[32348]: cluster 2021-03-10T14:35:45.009311+0000 mgr.gibba043.dnkmem (mgr.34373) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:46 gibba043 bash[24019]: cluster 2021-03-10T14:35:45.009311+0000 mgr.gibba043.dnkmem (mgr.34373) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:48 gibba003 bash[31385]: cluster 2021-03-10T14:35:47.010953+0000 mgr.gibba043.dnkmem (mgr.34373) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:48 gibba003 bash[32348]: cluster 2021-03-10T14:35:47.010953+0000 mgr.gibba043.dnkmem (mgr.34373) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:48 gibba043 bash[24019]: cluster 2021-03-10T14:35:47.010953+0000 mgr.gibba043.dnkmem (mgr.34373) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:50 gibba003 bash[31385]: cluster 2021-03-10T14:35:49.012655+0000 mgr.gibba043.dnkmem (mgr.34373) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:50 gibba003 bash[32348]: cluster 2021-03-10T14:35:49.012655+0000 mgr.gibba043.dnkmem (mgr.34373) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:50 gibba043 bash[24019]: cluster 2021-03-10T14:35:49.012655+0000 mgr.gibba043.dnkmem (mgr.34373) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:52 gibba003 bash[31385]: cluster 2021-03-10T14:35:51.014508+0000 mgr.gibba043.dnkmem (mgr.34373) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:52 gibba003 bash[31385]: cephadm 2021-03-10T14:35:51.933599+0000 mgr.gibba043.dnkmem (mgr.34373) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:52 gibba003 bash[32348]: cluster 2021-03-10T14:35:51.014508+0000 mgr.gibba043.dnkmem (mgr.34373) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:52 gibba003 bash[32348]: cephadm 2021-03-10T14:35:51.933599+0000 mgr.gibba043.dnkmem (mgr.34373) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:53.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:52 gibba043 bash[24019]: cluster 2021-03-10T14:35:51.014508+0000 mgr.gibba043.dnkmem (mgr.34373) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:52 gibba043 bash[24019]: cephadm 2021-03-10T14:35:51.933599+0000 mgr.gibba043.dnkmem (mgr.34373) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:35:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:54 gibba003 bash[31385]: cluster 2021-03-10T14:35:53.015836+0000 mgr.gibba043.dnkmem (mgr.34373) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:54 gibba003 bash[32348]: cluster 2021-03-10T14:35:53.015836+0000 mgr.gibba043.dnkmem (mgr.34373) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:54 gibba043 bash[24019]: cluster 2021-03-10T14:35:53.015836+0000 mgr.gibba043.dnkmem (mgr.34373) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:56 gibba003 bash[31385]: cluster 2021-03-10T14:35:55.017388+0000 mgr.gibba043.dnkmem (mgr.34373) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:57.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:56 gibba003 bash[32348]: cluster 2021-03-10T14:35:55.017388+0000 mgr.gibba043.dnkmem (mgr.34373) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:56 gibba043 bash[24019]: cluster 2021-03-10T14:35:55.017388+0000 mgr.gibba043.dnkmem (mgr.34373) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:35:58 gibba043 bash[24019]: cluster 2021-03-10T14:35:57.019069+0000 mgr.gibba043.dnkmem (mgr.34373) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:35:58 gibba003 bash[31385]: cluster 2021-03-10T14:35:57.019069+0000 mgr.gibba043.dnkmem (mgr.34373) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:35:58 gibba003 bash[32348]: cluster 2021-03-10T14:35:57.019069+0000 mgr.gibba043.dnkmem (mgr.34373) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:00 gibba043 bash[24019]: cluster 2021-03-10T14:35:59.020285+0000 mgr.gibba043.dnkmem (mgr.34373) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:00 gibba003 bash[31385]: cluster 2021-03-10T14:35:59.020285+0000 mgr.gibba043.dnkmem (mgr.34373) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:00 gibba003 bash[32348]: cluster 2021-03-10T14:35:59.020285+0000 mgr.gibba043.dnkmem (mgr.34373) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:02 gibba043 bash[24019]: cluster 2021-03-10T14:36:01.022058+0000 mgr.gibba043.dnkmem (mgr.34373) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:02 gibba003 bash[31385]: cluster 2021-03-10T14:36:01.022058+0000 mgr.gibba043.dnkmem (mgr.34373) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:02 gibba003 bash[32348]: cluster 2021-03-10T14:36:01.022058+0000 mgr.gibba043.dnkmem (mgr.34373) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:04 gibba043 bash[24019]: cluster 2021-03-10T14:36:03.023324+0000 mgr.gibba043.dnkmem (mgr.34373) 2402 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:05.355 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:36:05.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:04 gibba003 bash[31385]: cluster 2021-03-10T14:36:03.023324+0000 mgr.gibba043.dnkmem (mgr.34373) 2402 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:04 gibba003 bash[32348]: cluster 2021-03-10T14:36:03.023324+0000 mgr.gibba043.dnkmem (mgr.34373) 2402 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:05.582 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:36:05.582 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (44m) 10m ago 49m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:36:05.582 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (49m) 9m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:36:05.583 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (44m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:36:05.583 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:36:05.583 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (44m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:36:05.583 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (43m) 10m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:36:05.583 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:36:05.584 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (43m) 10m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:36:05.584 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (49m) 10m ago 49m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:36:05.584 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:36:05.584 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (42m) 10m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:36:05.584 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:36:05.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:36:05.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:36:05.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:36:05.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:36:05.585 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:36:05.586 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (39m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:36:05.586 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (49m) 9m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:36:05.586 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:36:05.829 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:36:05.829 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:36:05.830 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:05.830 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:36:05.830 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:36:05.830 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:05.831 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:36:05.831 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:36:05.831 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:36:05.831 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:36:05.831 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:36:05.832 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:36:05.832 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:36:05.832 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:36:05.832 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:36:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:05 gibba043 bash[24019]: audit 2021-03-10T14:36:05.830509+0000 mon.a (mon.0) 822 : audit [DBG] from='client.? 172.21.2.103:0/2040403182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:05 gibba003 bash[31385]: audit 2021-03-10T14:36:05.830509+0000 mon.a (mon.0) 822 : audit [DBG] from='client.? 172.21.2.103:0/2040403182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:06.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:05 gibba003 bash[32348]: audit 2021-03-10T14:36:05.830509+0000 mon.a (mon.0) 822 : audit [DBG] from='client.? 172.21.2.103:0/2040403182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:06 gibba043 bash[24019]: cluster 2021-03-10T14:36:05.024249+0000 mgr.gibba043.dnkmem (mgr.34373) 2403 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:06 gibba043 bash[24019]: audit 2021-03-10T14:36:05.344998+0000 mgr.gibba043.dnkmem (mgr.34373) 2404 : audit [DBG] from='client.45675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:06 gibba043 bash[24019]: audit 2021-03-10T14:36:05.568902+0000 mgr.gibba043.dnkmem (mgr.34373) 2405 : audit [DBG] from='client.45681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:06 gibba043 bash[24019]: audit 2021-03-10T14:36:06.953978+0000 mon.c (mon.1) 655 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:36:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[31385]: cluster 2021-03-10T14:36:05.024249+0000 mgr.gibba043.dnkmem (mgr.34373) 2403 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[31385]: audit 2021-03-10T14:36:05.344998+0000 mgr.gibba043.dnkmem (mgr.34373) 2404 : audit [DBG] from='client.45675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[31385]: audit 2021-03-10T14:36:05.568902+0000 mgr.gibba043.dnkmem (mgr.34373) 2405 : audit [DBG] from='client.45681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[31385]: audit 2021-03-10T14:36:06.953978+0000 mon.c (mon.1) 655 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:36:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[32348]: cluster 2021-03-10T14:36:05.024249+0000 mgr.gibba043.dnkmem (mgr.34373) 2403 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[32348]: audit 2021-03-10T14:36:05.344998+0000 mgr.gibba043.dnkmem (mgr.34373) 2404 : audit [DBG] from='client.45675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[32348]: audit 2021-03-10T14:36:05.568902+0000 mgr.gibba043.dnkmem (mgr.34373) 2405 : audit [DBG] from='client.45681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:06 gibba003 bash[32348]: audit 2021-03-10T14:36:06.953978+0000 mon.c (mon.1) 655 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:36:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:07 gibba043 bash[24019]: cephadm 2021-03-10T14:36:06.950897+0000 mgr.gibba043.dnkmem (mgr.34373) 2406 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:36:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:07 gibba003 bash[31385]: cephadm 2021-03-10T14:36:06.950897+0000 mgr.gibba043.dnkmem (mgr.34373) 2406 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:36:08.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:07 gibba003 bash[32348]: cephadm 2021-03-10T14:36:06.950897+0000 mgr.gibba043.dnkmem (mgr.34373) 2406 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:36:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:09 gibba043 bash[24019]: cluster 2021-03-10T14:36:07.024662+0000 mgr.gibba043.dnkmem (mgr.34373) 2407 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:09 gibba003 bash[31385]: cluster 2021-03-10T14:36:07.024662+0000 mgr.gibba043.dnkmem (mgr.34373) 2407 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:09 gibba003 bash[32348]: cluster 2021-03-10T14:36:07.024662+0000 mgr.gibba043.dnkmem (mgr.34373) 2407 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:10 gibba043 bash[24019]: cluster 2021-03-10T14:36:09.025891+0000 mgr.gibba043.dnkmem (mgr.34373) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:10.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:10 gibba003 bash[31385]: cluster 2021-03-10T14:36:09.025891+0000 mgr.gibba043.dnkmem (mgr.34373) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:10 gibba003 bash[32348]: cluster 2021-03-10T14:36:09.025891+0000 mgr.gibba043.dnkmem (mgr.34373) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.561215+0000 mgr.gibba043.dnkmem (mgr.34373) 2409 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:36:11.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.561813+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:36:11.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.772392+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:36:11.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.783802+0000 mgr.gibba043.dnkmem (mgr.34373) 2410 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:11.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.789169+0000 mon.c (mon.1) 656 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:11.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.789839+0000 mgr.gibba043.dnkmem (mgr.34373) 2411 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:11.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.793738+0000 mon.c (mon.1) 657 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.793913+0000 mgr.gibba043.dnkmem (mgr.34373) 2412 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.794514+0000 mgr.gibba043.dnkmem (mgr.34373) 2413 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.798364+0000 mon.c (mon.1) 658 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.798858+0000 mgr.gibba043.dnkmem (mgr.34373) 2414 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.799469+0000 mgr.gibba043.dnkmem (mgr.34373) 2415 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:11.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.802416+0000 mgr.gibba043.dnkmem (mgr.34373) 2416 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:11.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.802856+0000 mon.c (mon.1) 659 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.805873+0000 mgr.gibba043.dnkmem (mgr.34373) 2417 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:11.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.806164+0000 mgr.gibba043.dnkmem (mgr.34373) 2418 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:11.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.810087+0000 mgr.gibba043.dnkmem (mgr.34373) 2419 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:11.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.810524+0000 mon.c (mon.1) 660 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.812155+0000 mgr.gibba043.dnkmem (mgr.34373) 2420 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:11.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.815155+0000 mgr.gibba043.dnkmem (mgr.34373) 2421 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:11.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: audit 2021-03-10T14:36:10.815504+0000 mon.c (mon.1) 661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.561215+0000 mgr.gibba043.dnkmem (mgr.34373) 2409 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:36:11.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.561813+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:36:11.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.772392+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:36:11.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.783802+0000 mgr.gibba043.dnkmem (mgr.34373) 2410 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:11.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.789169+0000 mon.c (mon.1) 656 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:11.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.789839+0000 mgr.gibba043.dnkmem (mgr.34373) 2411 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:11.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.793738+0000 mon.c (mon.1) 657 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.793913+0000 mgr.gibba043.dnkmem (mgr.34373) 2412 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:11.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.794514+0000 mgr.gibba043.dnkmem (mgr.34373) 2413 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:11.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.798364+0000 mon.c (mon.1) 658 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.798858+0000 mgr.gibba043.dnkmem (mgr.34373) 2414 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:11.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.799469+0000 mgr.gibba043.dnkmem (mgr.34373) 2415 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:11.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.802416+0000 mgr.gibba043.dnkmem (mgr.34373) 2416 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:11.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.802856+0000 mon.c (mon.1) 659 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.805873+0000 mgr.gibba043.dnkmem (mgr.34373) 2417 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:11.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.806164+0000 mgr.gibba043.dnkmem (mgr.34373) 2418 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:11.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.810087+0000 mgr.gibba043.dnkmem (mgr.34373) 2419 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:11.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.810524+0000 mon.c (mon.1) 660 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.812155+0000 mgr.gibba043.dnkmem (mgr.34373) 2420 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:11.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.815155+0000 mgr.gibba043.dnkmem (mgr.34373) 2421 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:11.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: audit 2021-03-10T14:36:10.815504+0000 mon.c (mon.1) 661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:11.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.815529+0000 mgr.gibba043.dnkmem (mgr.34373) 2422 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:11.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[32348]: cephadm 2021-03-10T14:36:10.816329+0000 mgr.gibba043.dnkmem (mgr.34373) 2423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:11.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.815529+0000 mgr.gibba043.dnkmem (mgr.34373) 2422 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:11.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:11 gibba003 bash[31385]: cephadm 2021-03-10T14:36:10.816329+0000 mgr.gibba043.dnkmem (mgr.34373) 2423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.561215+0000 mgr.gibba043.dnkmem (mgr.34373) 2409 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:36:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.561813+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:36:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.772392+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:36:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.783802+0000 mgr.gibba043.dnkmem (mgr.34373) 2410 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.789169+0000 mon.c (mon.1) 656 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:12.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.789839+0000 mgr.gibba043.dnkmem (mgr.34373) 2411 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:12.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.793738+0000 mon.c (mon.1) 657 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:12.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.793913+0000 mgr.gibba043.dnkmem (mgr.34373) 2412 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:12.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.794514+0000 mgr.gibba043.dnkmem (mgr.34373) 2413 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:12.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.798364+0000 mon.c (mon.1) 658 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:12.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.798858+0000 mgr.gibba043.dnkmem (mgr.34373) 2414 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:12.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.799469+0000 mgr.gibba043.dnkmem (mgr.34373) 2415 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:12.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.802416+0000 mgr.gibba043.dnkmem (mgr.34373) 2416 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:12.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.802856+0000 mon.c (mon.1) 659 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:12.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.805873+0000 mgr.gibba043.dnkmem (mgr.34373) 2417 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:12.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.806164+0000 mgr.gibba043.dnkmem (mgr.34373) 2418 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:12.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.810087+0000 mgr.gibba043.dnkmem (mgr.34373) 2419 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:12.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.810524+0000 mon.c (mon.1) 660 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:12.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.812155+0000 mgr.gibba043.dnkmem (mgr.34373) 2420 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:12.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.815155+0000 mgr.gibba043.dnkmem (mgr.34373) 2421 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:12.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: audit 2021-03-10T14:36:10.815504+0000 mon.c (mon.1) 661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:12.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.815529+0000 mgr.gibba043.dnkmem (mgr.34373) 2422 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:12.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:11 gibba043 bash[24019]: cephadm 2021-03-10T14:36:10.816329+0000 mgr.gibba043.dnkmem (mgr.34373) 2423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:13.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:12 gibba003 bash[31385]: cluster 2021-03-10T14:36:11.027747+0000 mgr.gibba043.dnkmem (mgr.34373) 2424 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:13.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:12 gibba003 bash[32348]: cluster 2021-03-10T14:36:11.027747+0000 mgr.gibba043.dnkmem (mgr.34373) 2424 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:12 gibba043 bash[24019]: cluster 2021-03-10T14:36:11.027747+0000 mgr.gibba043.dnkmem (mgr.34373) 2424 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:12.995867+0000 mon.c (mon.1) 662 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:12.997020+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.013993+0000 mon.c (mon.1) 663 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:36:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.014773+0000 mon.c (mon.1) 664 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.015298+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:36:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.015513+0000 mon.c (mon.1) 665 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.016348+0000 mon.c (mon.1) 666 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.016537+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.017901+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.018776+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.075807+0000 mon.c (mon.1) 667 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[31385]: audit 2021-03-10T14:36:13.076932+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:12.995867+0000 mon.c (mon.1) 662 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:12.997020+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.013993+0000 mon.c (mon.1) 663 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:36:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.014773+0000 mon.c (mon.1) 664 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.015298+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:36:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.015513+0000 mon.c (mon.1) 665 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.016348+0000 mon.c (mon.1) 666 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.016537+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.017901+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.018776+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.075807+0000 mon.c (mon.1) 667 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:13 gibba003 bash[32348]: audit 2021-03-10T14:36:13.076932+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:12.995867+0000 mon.c (mon.1) 662 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:12.997020+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.013993+0000 mon.c (mon.1) 663 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:36:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.014773+0000 mon.c (mon.1) 664 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.015298+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:36:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.015513+0000 mon.c (mon.1) 665 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.016348+0000 mon.c (mon.1) 666 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.016537+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.017901+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:36:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.018776+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.075807+0000 mon.c (mon.1) 667 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:13 gibba043 bash[24019]: audit 2021-03-10T14:36:13.076932+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:14 gibba003 bash[31385]: cluster 2021-03-10T14:36:13.029325+0000 mgr.gibba043.dnkmem (mgr.34373) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:14 gibba003 bash[32348]: cluster 2021-03-10T14:36:13.029325+0000 mgr.gibba043.dnkmem (mgr.34373) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:14 gibba043 bash[24019]: cluster 2021-03-10T14:36:13.029325+0000 mgr.gibba043.dnkmem (mgr.34373) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:16 gibba003 bash[31385]: cluster 2021-03-10T14:36:15.030859+0000 mgr.gibba043.dnkmem (mgr.34373) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:16 gibba003 bash[32348]: cluster 2021-03-10T14:36:15.030859+0000 mgr.gibba043.dnkmem (mgr.34373) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:16 gibba043 bash[24019]: cluster 2021-03-10T14:36:15.030859+0000 mgr.gibba043.dnkmem (mgr.34373) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:18 gibba003 bash[31385]: cluster 2021-03-10T14:36:17.032525+0000 mgr.gibba043.dnkmem (mgr.34373) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:19.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:18 gibba003 bash[32348]: cluster 2021-03-10T14:36:17.032525+0000 mgr.gibba043.dnkmem (mgr.34373) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:18 gibba043 bash[24019]: cluster 2021-03-10T14:36:17.032525+0000 mgr.gibba043.dnkmem (mgr.34373) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:20 gibba003 bash[31385]: cluster 2021-03-10T14:36:19.034019+0000 mgr.gibba043.dnkmem (mgr.34373) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:21.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:20 gibba003 bash[32348]: cluster 2021-03-10T14:36:19.034019+0000 mgr.gibba043.dnkmem (mgr.34373) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:20 gibba043 bash[24019]: cluster 2021-03-10T14:36:19.034019+0000 mgr.gibba043.dnkmem (mgr.34373) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:22 gibba003 bash[31385]: cluster 2021-03-10T14:36:21.035933+0000 mgr.gibba043.dnkmem (mgr.34373) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:22 gibba003 bash[32348]: cluster 2021-03-10T14:36:21.035933+0000 mgr.gibba043.dnkmem (mgr.34373) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:22 gibba043 bash[24019]: cluster 2021-03-10T14:36:21.035933+0000 mgr.gibba043.dnkmem (mgr.34373) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:24 gibba043 bash[24019]: cluster 2021-03-10T14:36:23.037552+0000 mgr.gibba043.dnkmem (mgr.34373) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:24 gibba003 bash[31385]: cluster 2021-03-10T14:36:23.037552+0000 mgr.gibba043.dnkmem (mgr.34373) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:25.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:24 gibba003 bash[32348]: cluster 2021-03-10T14:36:23.037552+0000 mgr.gibba043.dnkmem (mgr.34373) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:26 gibba043 bash[24019]: cluster 2021-03-10T14:36:25.039311+0000 mgr.gibba043.dnkmem (mgr.34373) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:26 gibba043 bash[24019]: cephadm 2021-03-10T14:36:25.832386+0000 mgr.gibba043.dnkmem (mgr.34373) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:26 gibba003 bash[31385]: cluster 2021-03-10T14:36:25.039311+0000 mgr.gibba043.dnkmem (mgr.34373) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:26 gibba003 bash[31385]: cephadm 2021-03-10T14:36:25.832386+0000 mgr.gibba043.dnkmem (mgr.34373) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:26 gibba003 bash[32348]: cluster 2021-03-10T14:36:25.039311+0000 mgr.gibba043.dnkmem (mgr.34373) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:26 gibba003 bash[32348]: cephadm 2021-03-10T14:36:25.832386+0000 mgr.gibba043.dnkmem (mgr.34373) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:28 gibba043 bash[24019]: cluster 2021-03-10T14:36:27.040532+0000 mgr.gibba043.dnkmem (mgr.34373) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:29.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:28 gibba003 bash[31385]: cluster 2021-03-10T14:36:27.040532+0000 mgr.gibba043.dnkmem (mgr.34373) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:28 gibba003 bash[32348]: cluster 2021-03-10T14:36:27.040532+0000 mgr.gibba043.dnkmem (mgr.34373) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:31.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:30 gibba043 bash[24019]: cluster 2021-03-10T14:36:29.041618+0000 mgr.gibba043.dnkmem (mgr.34373) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:31.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:30 gibba003 bash[31385]: cluster 2021-03-10T14:36:29.041618+0000 mgr.gibba043.dnkmem (mgr.34373) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:30 gibba003 bash[32348]: cluster 2021-03-10T14:36:29.041618+0000 mgr.gibba043.dnkmem (mgr.34373) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:32 gibba043 bash[24019]: cluster 2021-03-10T14:36:31.043269+0000 mgr.gibba043.dnkmem (mgr.34373) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:32 gibba003 bash[31385]: cluster 2021-03-10T14:36:31.043269+0000 mgr.gibba043.dnkmem (mgr.34373) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:32 gibba003 bash[32348]: cluster 2021-03-10T14:36:31.043269+0000 mgr.gibba043.dnkmem (mgr.34373) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:35.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:34 gibba043 bash[24019]: cluster 2021-03-10T14:36:33.044707+0000 mgr.gibba043.dnkmem (mgr.34373) 2436 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:34 gibba003 bash[31385]: cluster 2021-03-10T14:36:33.044707+0000 mgr.gibba043.dnkmem (mgr.34373) 2436 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:35.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:34 gibba003 bash[32348]: cluster 2021-03-10T14:36:33.044707+0000 mgr.gibba043.dnkmem (mgr.34373) 2436 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.071 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:36:36.302 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:36:36.302 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (44m) 25s ago 50m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:36:36.303 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:36:36.303 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:36:36.303 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:36:36.303 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (44m) 25s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:36:36.304 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (44m) 25s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:36:36.304 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (44m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:36:36.304 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (44m) 25s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:36:36.304 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (50m) 25s ago 50m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:36:36.305 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:36:36.305 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (43m) 25s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:36:36.305 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (42m) 25s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:36:36.305 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (42m) 25s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:36:36.305 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (41m) 25s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:36:36.306 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:36:36.306 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:36:36.306 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:36:36.306 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:36:36.306 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (49m) 9m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:36:36.307 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 25s ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:36:36.556 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:36:36.556 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:36:36.556 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:36.557 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:36:36.557 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:36:36.557 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:36.557 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:36:36.558 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:36:36.558 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:36:36.558 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:36:36.558 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:36:36.559 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:36:36.559 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:36:36.559 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:36:36.559 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:36:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:36 gibba043 bash[24019]: cluster 2021-03-10T14:36:35.046559+0000 mgr.gibba043.dnkmem (mgr.34373) 2437 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:36 gibba043 bash[24019]: audit 2021-03-10T14:36:36.557356+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.2.103:0/2221291417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:36 gibba003 bash[31385]: cluster 2021-03-10T14:36:35.046559+0000 mgr.gibba043.dnkmem (mgr.34373) 2437 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:36 gibba003 bash[31385]: audit 2021-03-10T14:36:36.557356+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.2.103:0/2221291417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:37 gibba003 bash[32348]: cluster 2021-03-10T14:36:35.046559+0000 mgr.gibba043.dnkmem (mgr.34373) 2437 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:37 gibba003 bash[32348]: audit 2021-03-10T14:36:36.557356+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.2.103:0/2221291417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:38 gibba043 bash[24019]: audit 2021-03-10T14:36:36.061365+0000 mgr.gibba043.dnkmem (mgr.34373) 2438 : audit [DBG] from='client.45693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:38 gibba043 bash[24019]: audit 2021-03-10T14:36:36.290468+0000 mgr.gibba043.dnkmem (mgr.34373) 2439 : audit [DBG] from='client.55684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:38 gibba003 bash[31385]: audit 2021-03-10T14:36:36.061365+0000 mgr.gibba043.dnkmem (mgr.34373) 2438 : audit [DBG] from='client.45693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:38 gibba003 bash[31385]: audit 2021-03-10T14:36:36.290468+0000 mgr.gibba043.dnkmem (mgr.34373) 2439 : audit [DBG] from='client.55684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:38.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:38 gibba003 bash[32348]: audit 2021-03-10T14:36:36.061365+0000 mgr.gibba043.dnkmem (mgr.34373) 2438 : audit [DBG] from='client.45693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:38.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:38 gibba003 bash[32348]: audit 2021-03-10T14:36:36.290468+0000 mgr.gibba043.dnkmem (mgr.34373) 2439 : audit [DBG] from='client.55684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:39 gibba043 bash[24019]: cluster 2021-03-10T14:36:37.047338+0000 mgr.gibba043.dnkmem (mgr.34373) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:39 gibba003 bash[31385]: cluster 2021-03-10T14:36:37.047338+0000 mgr.gibba043.dnkmem (mgr.34373) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:39 gibba003 bash[32348]: cluster 2021-03-10T14:36:37.047338+0000 mgr.gibba043.dnkmem (mgr.34373) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:40 gibba043 bash[24019]: cluster 2021-03-10T14:36:39.048032+0000 mgr.gibba043.dnkmem (mgr.34373) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:40.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:40 gibba003 bash[31385]: cluster 2021-03-10T14:36:39.048032+0000 mgr.gibba043.dnkmem (mgr.34373) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:40.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:40 gibba003 bash[32348]: cluster 2021-03-10T14:36:39.048032+0000 mgr.gibba043.dnkmem (mgr.34373) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:41 gibba043 bash[24019]: cephadm 2021-03-10T14:36:40.848489+0000 mgr.gibba043.dnkmem (mgr.34373) 2442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:41 gibba003 bash[31385]: cephadm 2021-03-10T14:36:40.848489+0000 mgr.gibba043.dnkmem (mgr.34373) 2442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:41 gibba003 bash[32348]: cephadm 2021-03-10T14:36:40.848489+0000 mgr.gibba043.dnkmem (mgr.34373) 2442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:42 gibba003 bash[31385]: cluster 2021-03-10T14:36:41.048479+0000 mgr.gibba043.dnkmem (mgr.34373) 2443 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:42.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:42 gibba003 bash[32348]: cluster 2021-03-10T14:36:41.048479+0000 mgr.gibba043.dnkmem (mgr.34373) 2443 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:42 gibba043 bash[24019]: cluster 2021-03-10T14:36:41.048479+0000 mgr.gibba043.dnkmem (mgr.34373) 2443 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:44 gibba003 bash[31385]: cluster 2021-03-10T14:36:43.049616+0000 mgr.gibba043.dnkmem (mgr.34373) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:44 gibba003 bash[32348]: cluster 2021-03-10T14:36:43.049616+0000 mgr.gibba043.dnkmem (mgr.34373) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:44 gibba043 bash[24019]: cluster 2021-03-10T14:36:43.049616+0000 mgr.gibba043.dnkmem (mgr.34373) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:46 gibba043 bash[24019]: cluster 2021-03-10T14:36:45.051306+0000 mgr.gibba043.dnkmem (mgr.34373) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:46 gibba003 bash[31385]: cluster 2021-03-10T14:36:45.051306+0000 mgr.gibba043.dnkmem (mgr.34373) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:46 gibba003 bash[32348]: cluster 2021-03-10T14:36:45.051306+0000 mgr.gibba043.dnkmem (mgr.34373) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:48 gibba043 bash[24019]: cluster 2021-03-10T14:36:47.052866+0000 mgr.gibba043.dnkmem (mgr.34373) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:48 gibba003 bash[31385]: cluster 2021-03-10T14:36:47.052866+0000 mgr.gibba043.dnkmem (mgr.34373) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:48 gibba003 bash[32348]: cluster 2021-03-10T14:36:47.052866+0000 mgr.gibba043.dnkmem (mgr.34373) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:50 gibba043 bash[24019]: cluster 2021-03-10T14:36:49.054476+0000 mgr.gibba043.dnkmem (mgr.34373) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:50 gibba003 bash[31385]: cluster 2021-03-10T14:36:49.054476+0000 mgr.gibba043.dnkmem (mgr.34373) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:50 gibba003 bash[32348]: cluster 2021-03-10T14:36:49.054476+0000 mgr.gibba043.dnkmem (mgr.34373) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:52 gibba043 bash[24019]: cluster 2021-03-10T14:36:51.056138+0000 mgr.gibba043.dnkmem (mgr.34373) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:52 gibba003 bash[31385]: cluster 2021-03-10T14:36:51.056138+0000 mgr.gibba043.dnkmem (mgr.34373) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:52 gibba003 bash[32348]: cluster 2021-03-10T14:36:51.056138+0000 mgr.gibba043.dnkmem (mgr.34373) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:54 gibba043 bash[24019]: cluster 2021-03-10T14:36:53.057403+0000 mgr.gibba043.dnkmem (mgr.34373) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:54 gibba003 bash[31385]: cluster 2021-03-10T14:36:53.057403+0000 mgr.gibba043.dnkmem (mgr.34373) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:54 gibba003 bash[32348]: cluster 2021-03-10T14:36:53.057403+0000 mgr.gibba043.dnkmem (mgr.34373) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:56 gibba043 bash[24019]: cluster 2021-03-10T14:36:55.059190+0000 mgr.gibba043.dnkmem (mgr.34373) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:56 gibba043 bash[24019]: cephadm 2021-03-10T14:36:55.855632+0000 mgr.gibba043.dnkmem (mgr.34373) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:56 gibba003 bash[31385]: cluster 2021-03-10T14:36:55.059190+0000 mgr.gibba043.dnkmem (mgr.34373) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:56 gibba003 bash[31385]: cephadm 2021-03-10T14:36:55.855632+0000 mgr.gibba043.dnkmem (mgr.34373) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:56 gibba003 bash[32348]: cluster 2021-03-10T14:36:55.059190+0000 mgr.gibba043.dnkmem (mgr.34373) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:56 gibba003 bash[32348]: cephadm 2021-03-10T14:36:55.855632+0000 mgr.gibba043.dnkmem (mgr.34373) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:36:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:36:58 gibba043 bash[24019]: cluster 2021-03-10T14:36:57.060074+0000 mgr.gibba043.dnkmem (mgr.34373) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:36:58 gibba003 bash[31385]: cluster 2021-03-10T14:36:57.060074+0000 mgr.gibba043.dnkmem (mgr.34373) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:36:58 gibba003 bash[32348]: cluster 2021-03-10T14:36:57.060074+0000 mgr.gibba043.dnkmem (mgr.34373) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:00 gibba043 bash[24019]: cluster 2021-03-10T14:36:59.060998+0000 mgr.gibba043.dnkmem (mgr.34373) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:00 gibba003 bash[32348]: cluster 2021-03-10T14:36:59.060998+0000 mgr.gibba043.dnkmem (mgr.34373) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:00 gibba003 bash[31385]: cluster 2021-03-10T14:36:59.060998+0000 mgr.gibba043.dnkmem (mgr.34373) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:03 gibba043 bash[24019]: cluster 2021-03-10T14:37:01.061705+0000 mgr.gibba043.dnkmem (mgr.34373) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:03 gibba003 bash[31385]: cluster 2021-03-10T14:37:01.061705+0000 mgr.gibba043.dnkmem (mgr.34373) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:03 gibba003 bash[32348]: cluster 2021-03-10T14:37:01.061705+0000 mgr.gibba043.dnkmem (mgr.34373) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:05 gibba043 bash[24019]: cluster 2021-03-10T14:37:03.062904+0000 mgr.gibba043.dnkmem (mgr.34373) 2455 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:05 gibba003 bash[31385]: cluster 2021-03-10T14:37:03.062904+0000 mgr.gibba043.dnkmem (mgr.34373) 2455 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:05 gibba003 bash[32348]: cluster 2021-03-10T14:37:03.062904+0000 mgr.gibba043.dnkmem (mgr.34373) 2455 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:06 gibba003 bash[31385]: cluster 2021-03-10T14:37:05.064472+0000 mgr.gibba043.dnkmem (mgr.34373) 2456 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:06 gibba003 bash[32348]: cluster 2021-03-10T14:37:05.064472+0000 mgr.gibba043.dnkmem (mgr.34373) 2456 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:06 gibba043 bash[24019]: cluster 2021-03-10T14:37:05.064472+0000 mgr.gibba043.dnkmem (mgr.34373) 2456 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.802 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:37:07.039 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:37:07.040 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (45m) 56s ago 50m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:37:07.040 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (50m) 10m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:37:07.040 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (45m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:37:07.040 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (46m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:37:07.041 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (45m) 56s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:37:07.041 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (45m) 56s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:37:07.041 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (44m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:37:07.041 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (44m) 56s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:37:07.042 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (50m) 56s ago 50m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:37:07.042 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (50m) 10m ago 50m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:37:07.042 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (43m) 56s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:37:07.042 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (43m) 56s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:37:07.042 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (42m) 56s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:37:07.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (42m) 56s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:37:07.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:37:07.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:37:07.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:37:07.043 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (40m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:37:07.044 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (50m) 10m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:37:07.044 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 56s ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:37:07.297 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:37:07.297 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:37:07.297 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:07.297 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:37:07.298 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:37:07.298 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:07.298 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:37:07.298 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:37:07.299 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:37:07.299 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:37:07.299 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:37:07.299 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:37:07.299 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:37:07.300 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:37:07.300 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:37:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:07 gibba003 bash[31385]: audit 2021-03-10T14:37:06.791026+0000 mgr.gibba043.dnkmem (mgr.34373) 2457 : audit [DBG] from='client.55696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:07.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:07 gibba003 bash[32348]: audit 2021-03-10T14:37:06.791026+0000 mgr.gibba043.dnkmem (mgr.34373) 2457 : audit [DBG] from='client.55696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:07 gibba043 bash[24019]: audit 2021-03-10T14:37:06.791026+0000 mgr.gibba043.dnkmem (mgr.34373) 2457 : audit [DBG] from='client.55696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:08 gibba003 bash[31385]: audit 2021-03-10T14:37:07.015991+0000 mgr.gibba043.dnkmem (mgr.34373) 2458 : audit [DBG] from='client.55702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:08 gibba003 bash[31385]: cluster 2021-03-10T14:37:07.065199+0000 mgr.gibba043.dnkmem (mgr.34373) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:08 gibba003 bash[31385]: audit 2021-03-10T14:37:07.297675+0000 mon.c (mon.1) 668 : audit [DBG] from='client.? 172.21.2.103:0/903834712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:08.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:08 gibba003 bash[32348]: audit 2021-03-10T14:37:07.015991+0000 mgr.gibba043.dnkmem (mgr.34373) 2458 : audit [DBG] from='client.55702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:08 gibba003 bash[32348]: cluster 2021-03-10T14:37:07.065199+0000 mgr.gibba043.dnkmem (mgr.34373) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:08 gibba003 bash[32348]: audit 2021-03-10T14:37:07.297675+0000 mon.c (mon.1) 668 : audit [DBG] from='client.? 172.21.2.103:0/903834712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:08 gibba043 bash[24019]: audit 2021-03-10T14:37:07.015991+0000 mgr.gibba043.dnkmem (mgr.34373) 2458 : audit [DBG] from='client.55702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:08 gibba043 bash[24019]: cluster 2021-03-10T14:37:07.065199+0000 mgr.gibba043.dnkmem (mgr.34373) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:08 gibba043 bash[24019]: audit 2021-03-10T14:37:07.297675+0000 mon.c (mon.1) 668 : audit [DBG] from='client.? 172.21.2.103:0/903834712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:10 gibba003 bash[31385]: cluster 2021-03-10T14:37:09.066748+0000 mgr.gibba043.dnkmem (mgr.34373) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:10.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:10 gibba003 bash[32348]: cluster 2021-03-10T14:37:09.066748+0000 mgr.gibba043.dnkmem (mgr.34373) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:10 gibba043 bash[24019]: cluster 2021-03-10T14:37:09.066748+0000 mgr.gibba043.dnkmem (mgr.34373) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:11 gibba003 bash[31385]: cephadm 2021-03-10T14:37:10.869204+0000 mgr.gibba043.dnkmem (mgr.34373) 2461 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:37:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:11 gibba003 bash[31385]: audit 2021-03-10T14:37:10.873723+0000 mon.c (mon.1) 669 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:37:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:11 gibba003 bash[32348]: cephadm 2021-03-10T14:37:10.869204+0000 mgr.gibba043.dnkmem (mgr.34373) 2461 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:37:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:11 gibba003 bash[32348]: audit 2021-03-10T14:37:10.873723+0000 mon.c (mon.1) 669 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:37:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:11 gibba043 bash[24019]: cephadm 2021-03-10T14:37:10.869204+0000 mgr.gibba043.dnkmem (mgr.34373) 2461 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:37:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:11 gibba043 bash[24019]: audit 2021-03-10T14:37:10.873723+0000 mon.c (mon.1) 669 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:37:12.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:12 gibba003 bash[31385]: cluster 2021-03-10T14:37:11.067284+0000 mgr.gibba043.dnkmem (mgr.34373) 2462 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:12.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:12 gibba003 bash[32348]: cluster 2021-03-10T14:37:11.067284+0000 mgr.gibba043.dnkmem (mgr.34373) 2462 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:12 gibba043 bash[24019]: cluster 2021-03-10T14:37:11.067284+0000 mgr.gibba043.dnkmem (mgr.34373) 2462 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.002526+0000 mon.c (mon.1) 670 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.003270+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.024793+0000 mon.c (mon.1) 671 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:37:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.025565+0000 mon.c (mon.1) 672 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.026146+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:37:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.026266+0000 mon.c (mon.1) 673 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:37:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.026947+0000 mon.c (mon.1) 674 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.028458+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.029289+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:37:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.030146+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.083831+0000 mon.c (mon.1) 675 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[31385]: audit 2021-03-10T14:37:13.084882+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.002526+0000 mon.c (mon.1) 670 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.003270+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.024793+0000 mon.c (mon.1) 671 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:37:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.025565+0000 mon.c (mon.1) 672 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.026146+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:37:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.026266+0000 mon.c (mon.1) 673 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:37:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.026947+0000 mon.c (mon.1) 674 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.028458+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.029289+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:37:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.030146+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.083831+0000 mon.c (mon.1) 675 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:13 gibba003 bash[32348]: audit 2021-03-10T14:37:13.084882+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.002526+0000 mon.c (mon.1) 670 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.003270+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.024793+0000 mon.c (mon.1) 671 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:37:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.025565+0000 mon.c (mon.1) 672 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.026146+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:37:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.026266+0000 mon.c (mon.1) 673 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:37:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.026947+0000 mon.c (mon.1) 674 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.028458+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.029289+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:37:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.030146+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:37:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.083831+0000 mon.c (mon.1) 675 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:13 gibba043 bash[24019]: audit 2021-03-10T14:37:13.084882+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: cluster 2021-03-10T14:37:13.068486+0000 mgr.gibba043.dnkmem (mgr.34373) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.652454+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:37:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.865162+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:37:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.868802+0000 mon.c (mon.1) 676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.870704+0000 mon.c (mon.1) 677 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.872198+0000 mon.c (mon.1) 678 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.873336+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.875800+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:14 gibba043 bash[24019]: audit 2021-03-10T14:37:14.877126+0000 mon.c (mon.1) 681 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: cluster 2021-03-10T14:37:13.068486+0000 mgr.gibba043.dnkmem (mgr.34373) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.652454+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:37:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.865162+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:37:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.868802+0000 mon.c (mon.1) 676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.870704+0000 mon.c (mon.1) 677 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.872198+0000 mon.c (mon.1) 678 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.873336+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.875800+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[31385]: audit 2021-03-10T14:37:14.877126+0000 mon.c (mon.1) 681 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: cluster 2021-03-10T14:37:13.068486+0000 mgr.gibba043.dnkmem (mgr.34373) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.652454+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:37:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.865162+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:37:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.868802+0000 mon.c (mon.1) 676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.870704+0000 mon.c (mon.1) 677 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.872198+0000 mon.c (mon.1) 678 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.873336+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.875800+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:14 gibba003 bash[32348]: audit 2021-03-10T14:37:14.877126+0000 mon.c (mon.1) 681 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.651136+0000 mgr.gibba043.dnkmem (mgr.34373) 2464 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:37:16.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.865565+0000 mgr.gibba043.dnkmem (mgr.34373) 2465 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:16.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.867514+0000 mgr.gibba043.dnkmem (mgr.34373) 2466 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:16.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.868979+0000 mgr.gibba043.dnkmem (mgr.34373) 2467 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.869023+0000 mgr.gibba043.dnkmem (mgr.34373) 2468 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.870373+0000 mgr.gibba043.dnkmem (mgr.34373) 2469 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.870419+0000 mgr.gibba043.dnkmem (mgr.34373) 2470 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.871550+0000 mgr.gibba043.dnkmem (mgr.34373) 2471 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.872762+0000 mgr.gibba043.dnkmem (mgr.34373) 2472 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.872806+0000 mgr.gibba043.dnkmem (mgr.34373) 2473 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.874000+0000 mgr.gibba043.dnkmem (mgr.34373) 2474 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.874321+0000 mgr.gibba043.dnkmem (mgr.34373) 2475 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.875410+0000 mgr.gibba043.dnkmem (mgr.34373) 2476 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:16.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.875456+0000 mgr.gibba043.dnkmem (mgr.34373) 2477 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:16.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:15 gibba043 bash[24019]: cephadm 2021-03-10T14:37:14.875574+0000 mgr.gibba043.dnkmem (mgr.34373) 2478 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.651136+0000 mgr.gibba043.dnkmem (mgr.34373) 2464 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:37:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.865565+0000 mgr.gibba043.dnkmem (mgr.34373) 2465 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.867514+0000 mgr.gibba043.dnkmem (mgr.34373) 2466 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.868979+0000 mgr.gibba043.dnkmem (mgr.34373) 2467 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.869023+0000 mgr.gibba043.dnkmem (mgr.34373) 2468 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.870373+0000 mgr.gibba043.dnkmem (mgr.34373) 2469 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.870419+0000 mgr.gibba043.dnkmem (mgr.34373) 2470 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.871550+0000 mgr.gibba043.dnkmem (mgr.34373) 2471 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.872762+0000 mgr.gibba043.dnkmem (mgr.34373) 2472 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.872806+0000 mgr.gibba043.dnkmem (mgr.34373) 2473 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.874000+0000 mgr.gibba043.dnkmem (mgr.34373) 2474 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.874321+0000 mgr.gibba043.dnkmem (mgr.34373) 2475 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:16.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.875410+0000 mgr.gibba043.dnkmem (mgr.34373) 2476 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:16.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.875456+0000 mgr.gibba043.dnkmem (mgr.34373) 2477 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:16.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[32348]: cephadm 2021-03-10T14:37:14.875574+0000 mgr.gibba043.dnkmem (mgr.34373) 2478 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:16.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.651136+0000 mgr.gibba043.dnkmem (mgr.34373) 2464 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:37:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.865565+0000 mgr.gibba043.dnkmem (mgr.34373) 2465 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.867514+0000 mgr.gibba043.dnkmem (mgr.34373) 2466 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.868979+0000 mgr.gibba043.dnkmem (mgr.34373) 2467 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:16.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.869023+0000 mgr.gibba043.dnkmem (mgr.34373) 2468 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:16.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.870373+0000 mgr.gibba043.dnkmem (mgr.34373) 2469 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:16.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.870419+0000 mgr.gibba043.dnkmem (mgr.34373) 2470 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:16.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.871550+0000 mgr.gibba043.dnkmem (mgr.34373) 2471 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:16.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.872762+0000 mgr.gibba043.dnkmem (mgr.34373) 2472 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:16.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.872806+0000 mgr.gibba043.dnkmem (mgr.34373) 2473 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.874000+0000 mgr.gibba043.dnkmem (mgr.34373) 2474 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.874321+0000 mgr.gibba043.dnkmem (mgr.34373) 2475 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.875410+0000 mgr.gibba043.dnkmem (mgr.34373) 2476 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.875456+0000 mgr.gibba043.dnkmem (mgr.34373) 2477 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:16.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:15 gibba003 bash[31385]: cephadm 2021-03-10T14:37:14.875574+0000 mgr.gibba043.dnkmem (mgr.34373) 2478 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:16 gibba043 bash[24019]: cluster 2021-03-10T14:37:15.070024+0000 mgr.gibba043.dnkmem (mgr.34373) 2479 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:16 gibba003 bash[31385]: cluster 2021-03-10T14:37:15.070024+0000 mgr.gibba043.dnkmem (mgr.34373) 2479 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:17.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:16 gibba003 bash[32348]: cluster 2021-03-10T14:37:15.070024+0000 mgr.gibba043.dnkmem (mgr.34373) 2479 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:18 gibba043 bash[24019]: cluster 2021-03-10T14:37:17.071536+0000 mgr.gibba043.dnkmem (mgr.34373) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:18 gibba003 bash[31385]: cluster 2021-03-10T14:37:17.071536+0000 mgr.gibba043.dnkmem (mgr.34373) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:18 gibba003 bash[32348]: cluster 2021-03-10T14:37:17.071536+0000 mgr.gibba043.dnkmem (mgr.34373) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:20 gibba043 bash[24019]: cluster 2021-03-10T14:37:19.073288+0000 mgr.gibba043.dnkmem (mgr.34373) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:20 gibba003 bash[31385]: cluster 2021-03-10T14:37:19.073288+0000 mgr.gibba043.dnkmem (mgr.34373) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:20 gibba003 bash[32348]: cluster 2021-03-10T14:37:19.073288+0000 mgr.gibba043.dnkmem (mgr.34373) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:22 gibba043 bash[24019]: cluster 2021-03-10T14:37:21.075057+0000 mgr.gibba043.dnkmem (mgr.34373) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:22 gibba003 bash[31385]: cluster 2021-03-10T14:37:21.075057+0000 mgr.gibba043.dnkmem (mgr.34373) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:22 gibba003 bash[32348]: cluster 2021-03-10T14:37:21.075057+0000 mgr.gibba043.dnkmem (mgr.34373) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:24 gibba043 bash[24019]: cluster 2021-03-10T14:37:23.076405+0000 mgr.gibba043.dnkmem (mgr.34373) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:24 gibba003 bash[31385]: cluster 2021-03-10T14:37:23.076405+0000 mgr.gibba043.dnkmem (mgr.34373) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:25.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:25 gibba003 bash[32348]: cluster 2021-03-10T14:37:23.076405+0000 mgr.gibba043.dnkmem (mgr.34373) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:27 gibba043 bash[24019]: cluster 2021-03-10T14:37:25.078213+0000 mgr.gibba043.dnkmem (mgr.34373) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:27 gibba003 bash[31385]: cluster 2021-03-10T14:37:25.078213+0000 mgr.gibba043.dnkmem (mgr.34373) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:27 gibba003 bash[32348]: cluster 2021-03-10T14:37:25.078213+0000 mgr.gibba043.dnkmem (mgr.34373) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:29 gibba043 bash[24019]: cluster 2021-03-10T14:37:27.079324+0000 mgr.gibba043.dnkmem (mgr.34373) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:29 gibba003 bash[31385]: cluster 2021-03-10T14:37:27.079324+0000 mgr.gibba043.dnkmem (mgr.34373) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:29 gibba003 bash[32348]: cluster 2021-03-10T14:37:27.079324+0000 mgr.gibba043.dnkmem (mgr.34373) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:31 gibba003 bash[32348]: cluster 2021-03-10T14:37:29.080043+0000 mgr.gibba043.dnkmem (mgr.34373) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:31 gibba003 bash[32348]: cephadm 2021-03-10T14:37:29.891348+0000 mgr.gibba043.dnkmem (mgr.34373) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:31 gibba003 bash[31385]: cluster 2021-03-10T14:37:29.080043+0000 mgr.gibba043.dnkmem (mgr.34373) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:31 gibba003 bash[31385]: cephadm 2021-03-10T14:37:29.891348+0000 mgr.gibba043.dnkmem (mgr.34373) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:31 gibba043 bash[24019]: cluster 2021-03-10T14:37:29.080043+0000 mgr.gibba043.dnkmem (mgr.34373) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:31 gibba043 bash[24019]: cephadm 2021-03-10T14:37:29.891348+0000 mgr.gibba043.dnkmem (mgr.34373) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:32 gibba003 bash[31385]: cluster 2021-03-10T14:37:31.081796+0000 mgr.gibba043.dnkmem (mgr.34373) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:32.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:32 gibba003 bash[32348]: cluster 2021-03-10T14:37:31.081796+0000 mgr.gibba043.dnkmem (mgr.34373) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:32 gibba043 bash[24019]: cluster 2021-03-10T14:37:31.081796+0000 mgr.gibba043.dnkmem (mgr.34373) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:34 gibba043 bash[24019]: cluster 2021-03-10T14:37:33.083111+0000 mgr.gibba043.dnkmem (mgr.34373) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:34 gibba003 bash[31385]: cluster 2021-03-10T14:37:33.083111+0000 mgr.gibba043.dnkmem (mgr.34373) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:35.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:34 gibba003 bash[32348]: cluster 2021-03-10T14:37:33.083111+0000 mgr.gibba043.dnkmem (mgr.34373) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:37.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:36 gibba043 bash[24019]: cluster 2021-03-10T14:37:35.084752+0000 mgr.gibba043.dnkmem (mgr.34373) 2490 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:37.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:36 gibba003 bash[31385]: cluster 2021-03-10T14:37:35.084752+0000 mgr.gibba043.dnkmem (mgr.34373) 2490 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:36 gibba003 bash[32348]: cluster 2021-03-10T14:37:35.084752+0000 mgr.gibba043.dnkmem (mgr.34373) 2490 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:37.541 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:37:37.767 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:37:37.767 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (46m) 87s ago 51m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:37:37.768 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (51m) 23s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:37:37.768 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (46m) 23s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:37:37.768 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (46m) 23s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:37:37.768 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (45m) 87s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:37:37.768 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (45m) 87s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:37:37.769 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (45m) 23s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:37:37.769 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (45m) 87s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:37:37.769 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (51m) 87s ago 51m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:37:37.769 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (51m) 23s ago 51m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:37:37.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (44m) 87s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:37:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (43m) 87s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:37:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (43m) 87s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:37:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (43m) 87s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:37:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (42m) 23s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:37:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (42m) 23s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:37:37.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (41m) 23s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:37:37.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (41m) 23s ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:37:37.771 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (50m) 23s ago 51m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:37:37.771 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 87s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:37:38.016 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:37:38.016 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:37:38.016 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:38.016 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:37:38.016 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:37:38.017 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:38.017 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:37:38.017 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:37:38.017 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:37:38.018 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:37:38.018 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:37:38.018 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:37:38.018 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:37:38.018 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:37:38.019 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:37:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:38 gibba043 bash[24019]: cluster 2021-03-10T14:37:37.086147+0000 mgr.gibba043.dnkmem (mgr.34373) 2491 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:38 gibba043 bash[24019]: audit 2021-03-10T14:37:37.530714+0000 mgr.gibba043.dnkmem (mgr.34373) 2492 : audit [DBG] from='client.45729 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:38 gibba043 bash[24019]: audit 2021-03-10T14:37:37.754101+0000 mgr.gibba043.dnkmem (mgr.34373) 2493 : audit [DBG] from='client.45735 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:38 gibba043 bash[24019]: audit 2021-03-10T14:37:38.016833+0000 mon.c (mon.1) 682 : audit [DBG] from='client.? 172.21.2.103:0/1193262864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[31385]: cluster 2021-03-10T14:37:37.086147+0000 mgr.gibba043.dnkmem (mgr.34373) 2491 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[31385]: audit 2021-03-10T14:37:37.530714+0000 mgr.gibba043.dnkmem (mgr.34373) 2492 : audit [DBG] from='client.45729 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[31385]: audit 2021-03-10T14:37:37.754101+0000 mgr.gibba043.dnkmem (mgr.34373) 2493 : audit [DBG] from='client.45735 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[31385]: audit 2021-03-10T14:37:38.016833+0000 mon.c (mon.1) 682 : audit [DBG] from='client.? 172.21.2.103:0/1193262864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[32348]: cluster 2021-03-10T14:37:37.086147+0000 mgr.gibba043.dnkmem (mgr.34373) 2491 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[32348]: audit 2021-03-10T14:37:37.530714+0000 mgr.gibba043.dnkmem (mgr.34373) 2492 : audit [DBG] from='client.45729 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[32348]: audit 2021-03-10T14:37:37.754101+0000 mgr.gibba043.dnkmem (mgr.34373) 2493 : audit [DBG] from='client.45735 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:38 gibba003 bash[32348]: audit 2021-03-10T14:37:38.016833+0000 mon.c (mon.1) 682 : audit [DBG] from='client.? 172.21.2.103:0/1193262864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:40 gibba043 bash[24019]: cluster 2021-03-10T14:37:39.087633+0000 mgr.gibba043.dnkmem (mgr.34373) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:40 gibba003 bash[32348]: cluster 2021-03-10T14:37:39.087633+0000 mgr.gibba043.dnkmem (mgr.34373) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:40 gibba003 bash[31385]: cluster 2021-03-10T14:37:39.087633+0000 mgr.gibba043.dnkmem (mgr.34373) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:42 gibba043 bash[24019]: cluster 2021-03-10T14:37:41.089180+0000 mgr.gibba043.dnkmem (mgr.34373) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:42 gibba003 bash[31385]: cluster 2021-03-10T14:37:41.089180+0000 mgr.gibba043.dnkmem (mgr.34373) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:42 gibba003 bash[32348]: cluster 2021-03-10T14:37:41.089180+0000 mgr.gibba043.dnkmem (mgr.34373) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:44 gibba043 bash[24019]: cluster 2021-03-10T14:37:43.090513+0000 mgr.gibba043.dnkmem (mgr.34373) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:44 gibba003 bash[31385]: cluster 2021-03-10T14:37:43.090513+0000 mgr.gibba043.dnkmem (mgr.34373) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:44 gibba003 bash[32348]: cluster 2021-03-10T14:37:43.090513+0000 mgr.gibba043.dnkmem (mgr.34373) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:45 gibba043 bash[24019]: cephadm 2021-03-10T14:37:44.901149+0000 mgr.gibba043.dnkmem (mgr.34373) 2497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:46.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:46 gibba003 bash[31385]: cephadm 2021-03-10T14:37:44.901149+0000 mgr.gibba043.dnkmem (mgr.34373) 2497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:46.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:46 gibba003 bash[32348]: cephadm 2021-03-10T14:37:44.901149+0000 mgr.gibba043.dnkmem (mgr.34373) 2497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:37:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:47 gibba043 bash[24019]: cluster 2021-03-10T14:37:45.091872+0000 mgr.gibba043.dnkmem (mgr.34373) 2498 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:47 gibba003 bash[31385]: cluster 2021-03-10T14:37:45.091872+0000 mgr.gibba043.dnkmem (mgr.34373) 2498 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:47.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:47 gibba003 bash[32348]: cluster 2021-03-10T14:37:45.091872+0000 mgr.gibba043.dnkmem (mgr.34373) 2498 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:49 gibba043 bash[24019]: cluster 2021-03-10T14:37:47.093270+0000 mgr.gibba043.dnkmem (mgr.34373) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:49 gibba003 bash[31385]: cluster 2021-03-10T14:37:47.093270+0000 mgr.gibba043.dnkmem (mgr.34373) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:49 gibba003 bash[32348]: cluster 2021-03-10T14:37:47.093270+0000 mgr.gibba043.dnkmem (mgr.34373) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:51 gibba043 bash[24019]: cluster 2021-03-10T14:37:49.094300+0000 mgr.gibba043.dnkmem (mgr.34373) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:51 gibba003 bash[31385]: cluster 2021-03-10T14:37:49.094300+0000 mgr.gibba043.dnkmem (mgr.34373) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:51 gibba003 bash[32348]: cluster 2021-03-10T14:37:49.094300+0000 mgr.gibba043.dnkmem (mgr.34373) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:53 gibba003 bash[31385]: cluster 2021-03-10T14:37:51.095172+0000 mgr.gibba043.dnkmem (mgr.34373) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:53 gibba003 bash[32348]: cluster 2021-03-10T14:37:51.095172+0000 mgr.gibba043.dnkmem (mgr.34373) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:53 gibba043 bash[24019]: cluster 2021-03-10T14:37:51.095172+0000 mgr.gibba043.dnkmem (mgr.34373) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:54 gibba003 bash[31385]: cluster 2021-03-10T14:37:53.096588+0000 mgr.gibba043.dnkmem (mgr.34373) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:54 gibba003 bash[32348]: cluster 2021-03-10T14:37:53.096588+0000 mgr.gibba043.dnkmem (mgr.34373) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:54 gibba043 bash[24019]: cluster 2021-03-10T14:37:53.096588+0000 mgr.gibba043.dnkmem (mgr.34373) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:56 gibba003 bash[32348]: cluster 2021-03-10T14:37:55.098131+0000 mgr.gibba043.dnkmem (mgr.34373) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:56 gibba003 bash[31385]: cluster 2021-03-10T14:37:55.098131+0000 mgr.gibba043.dnkmem (mgr.34373) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:56 gibba043 bash[24019]: cluster 2021-03-10T14:37:55.098131+0000 mgr.gibba043.dnkmem (mgr.34373) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:37:58 gibba043 bash[24019]: cluster 2021-03-10T14:37:57.099655+0000 mgr.gibba043.dnkmem (mgr.34373) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:37:58 gibba003 bash[31385]: cluster 2021-03-10T14:37:57.099655+0000 mgr.gibba043.dnkmem (mgr.34373) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:37:58 gibba003 bash[32348]: cluster 2021-03-10T14:37:57.099655+0000 mgr.gibba043.dnkmem (mgr.34373) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:00 gibba043 bash[24019]: cluster 2021-03-10T14:37:59.101047+0000 mgr.gibba043.dnkmem (mgr.34373) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:00 gibba043 bash[24019]: cephadm 2021-03-10T14:37:59.916435+0000 mgr.gibba043.dnkmem (mgr.34373) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:00 gibba003 bash[31385]: cluster 2021-03-10T14:37:59.101047+0000 mgr.gibba043.dnkmem (mgr.34373) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:00 gibba003 bash[31385]: cephadm 2021-03-10T14:37:59.916435+0000 mgr.gibba043.dnkmem (mgr.34373) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:00 gibba003 bash[32348]: cluster 2021-03-10T14:37:59.101047+0000 mgr.gibba043.dnkmem (mgr.34373) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:00 gibba003 bash[32348]: cephadm 2021-03-10T14:37:59.916435+0000 mgr.gibba043.dnkmem (mgr.34373) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:02 gibba043 bash[24019]: cluster 2021-03-10T14:38:01.102730+0000 mgr.gibba043.dnkmem (mgr.34373) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:02 gibba003 bash[31385]: cluster 2021-03-10T14:38:01.102730+0000 mgr.gibba043.dnkmem (mgr.34373) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:02 gibba003 bash[32348]: cluster 2021-03-10T14:38:01.102730+0000 mgr.gibba043.dnkmem (mgr.34373) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:04 gibba043 bash[24019]: cluster 2021-03-10T14:38:03.104251+0000 mgr.gibba043.dnkmem (mgr.34373) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:04 gibba003 bash[31385]: cluster 2021-03-10T14:38:03.104251+0000 mgr.gibba043.dnkmem (mgr.34373) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:04 gibba003 bash[32348]: cluster 2021-03-10T14:38:03.104251+0000 mgr.gibba043.dnkmem (mgr.34373) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:06 gibba043 bash[24019]: cluster 2021-03-10T14:38:05.105562+0000 mgr.gibba043.dnkmem (mgr.34373) 2509 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:06 gibba003 bash[31385]: cluster 2021-03-10T14:38:05.105562+0000 mgr.gibba043.dnkmem (mgr.34373) 2509 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:07.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:06 gibba003 bash[32348]: cluster 2021-03-10T14:38:05.105562+0000 mgr.gibba043.dnkmem (mgr.34373) 2509 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:08.258 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:38:08.484 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:38:08.485 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (46m) 117s ago 51m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:38:08.485 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (51m) 53s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:38:08.485 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (46m) 53s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:38:08.485 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (47m) 53s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:38:08.486 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (46m) 117s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:38:08.486 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (46m) 117s ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:38:08.486 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (45m) 53s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:38:08.486 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (45m) 117s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:38:08.486 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (51m) 117s ago 51m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:38:08.487 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (51m) 53s ago 51m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:38:08.487 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (44m) 117s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:38:08.487 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (44m) 117s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:38:08.487 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (43m) 117s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:38:08.488 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (43m) 117s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:38:08.488 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (43m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:38:08.488 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (42m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:38:08.488 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (42m) 53s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:38:08.489 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (41m) 53s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:38:08.489 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (51m) 53s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:38:08.489 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 117s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:38:08.735 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:38:08.736 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:38:08.736 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:08.736 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:38:08.736 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:38:08.737 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:08.737 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:38:08.737 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:38:08.737 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:38:08.738 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:38:08.738 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:38:08.738 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:38:08.738 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:38:08.739 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:38:08.739 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:38:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:08 gibba043 bash[24019]: cluster 2021-03-10T14:38:07.107292+0000 mgr.gibba043.dnkmem (mgr.34373) 2510 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:08 gibba043 bash[24019]: audit 2021-03-10T14:38:08.736636+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? 172.21.2.103:0/305753536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:08 gibba003 bash[31385]: cluster 2021-03-10T14:38:07.107292+0000 mgr.gibba043.dnkmem (mgr.34373) 2510 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:08 gibba003 bash[31385]: audit 2021-03-10T14:38:08.736636+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? 172.21.2.103:0/305753536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:08 gibba003 bash[32348]: cluster 2021-03-10T14:38:07.107292+0000 mgr.gibba043.dnkmem (mgr.34373) 2510 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:08 gibba003 bash[32348]: audit 2021-03-10T14:38:08.736636+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? 172.21.2.103:0/305753536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:10 gibba043 bash[24019]: audit 2021-03-10T14:38:08.246716+0000 mgr.gibba043.dnkmem (mgr.34373) 2511 : audit [DBG] from='client.45747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:10 gibba043 bash[24019]: audit 2021-03-10T14:38:08.470408+0000 mgr.gibba043.dnkmem (mgr.34373) 2512 : audit [DBG] from='client.55738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:10 gibba003 bash[31385]: audit 2021-03-10T14:38:08.246716+0000 mgr.gibba043.dnkmem (mgr.34373) 2511 : audit [DBG] from='client.45747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:10 gibba003 bash[31385]: audit 2021-03-10T14:38:08.470408+0000 mgr.gibba043.dnkmem (mgr.34373) 2512 : audit [DBG] from='client.55738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:10 gibba003 bash[32348]: audit 2021-03-10T14:38:08.246716+0000 mgr.gibba043.dnkmem (mgr.34373) 2511 : audit [DBG] from='client.45747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:10.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:10 gibba003 bash[32348]: audit 2021-03-10T14:38:08.470408+0000 mgr.gibba043.dnkmem (mgr.34373) 2512 : audit [DBG] from='client.55738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:11 gibba043 bash[24019]: cluster 2021-03-10T14:38:09.108819+0000 mgr.gibba043.dnkmem (mgr.34373) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:11 gibba003 bash[31385]: cluster 2021-03-10T14:38:09.108819+0000 mgr.gibba043.dnkmem (mgr.34373) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:11 gibba003 bash[32348]: cluster 2021-03-10T14:38:09.108819+0000 mgr.gibba043.dnkmem (mgr.34373) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:13 gibba043 bash[24019]: cluster 2021-03-10T14:38:11.110235+0000 mgr.gibba043.dnkmem (mgr.34373) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:13 gibba043 bash[24019]: audit 2021-03-10T14:38:13.006608+0000 mon.c (mon.1) 683 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:13 gibba043 bash[24019]: audit 2021-03-10T14:38:13.007133+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:13.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:13 gibba003 bash[31385]: cluster 2021-03-10T14:38:11.110235+0000 mgr.gibba043.dnkmem (mgr.34373) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:13.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:13 gibba003 bash[31385]: audit 2021-03-10T14:38:13.006608+0000 mon.c (mon.1) 683 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:13.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:13 gibba003 bash[31385]: audit 2021-03-10T14:38:13.007133+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:13.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:13 gibba003 bash[32348]: cluster 2021-03-10T14:38:11.110235+0000 mgr.gibba043.dnkmem (mgr.34373) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:13.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:13 gibba003 bash[32348]: audit 2021-03-10T14:38:13.006608+0000 mon.c (mon.1) 683 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:13.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:13 gibba003 bash[32348]: audit 2021-03-10T14:38:13.007133+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.032824+0000 mon.c (mon.1) 684 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.033267+0000 mon.c (mon.1) 685 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.033641+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.033670+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:38:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.034110+0000 mon.c (mon.1) 687 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.034513+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.035240+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:38:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.035776+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.092067+0000 mon.c (mon.1) 688 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[31385]: audit 2021-03-10T14:38:13.093196+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.032824+0000 mon.c (mon.1) 684 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.033267+0000 mon.c (mon.1) 685 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.033641+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.033670+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:38:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.034110+0000 mon.c (mon.1) 687 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.034513+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.035240+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:38:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.035776+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.092067+0000 mon.c (mon.1) 688 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:14 gibba003 bash[32348]: audit 2021-03-10T14:38:13.093196+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.032824+0000 mon.c (mon.1) 684 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.033267+0000 mon.c (mon.1) 685 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.033641+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.033670+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:38:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.034110+0000 mon.c (mon.1) 687 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.034513+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.035240+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:38:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.035776+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:38:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.092067+0000 mon.c (mon.1) 688 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:14 gibba043 bash[24019]: audit 2021-03-10T14:38:13.093196+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:15 gibba003 bash[31385]: cluster 2021-03-10T14:38:13.111119+0000 mgr.gibba043.dnkmem (mgr.34373) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:15 gibba003 bash[32348]: cluster 2021-03-10T14:38:13.111119+0000 mgr.gibba043.dnkmem (mgr.34373) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:15 gibba043 bash[24019]: cluster 2021-03-10T14:38:13.111119+0000 mgr.gibba043.dnkmem (mgr.34373) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:16.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: cephadm 2021-03-10T14:38:14.932961+0000 mgr.gibba043.dnkmem (mgr.34373) 2516 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:38:16.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: cephadm 2021-03-10T14:38:14.934483+0000 mgr.gibba043.dnkmem (mgr.34373) 2517 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:38:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.158150+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:38:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.161670+0000 mon.c (mon.1) 689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.162808+0000 mon.c (mon.1) 690 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.164104+0000 mon.c (mon.1) 691 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.165522+0000 mon.c (mon.1) 692 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.168342+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[32348]: audit 2021-03-10T14:38:15.169850+0000 mon.c (mon.1) 694 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: cephadm 2021-03-10T14:38:14.932961+0000 mgr.gibba043.dnkmem (mgr.34373) 2516 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:38:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: cephadm 2021-03-10T14:38:14.934483+0000 mgr.gibba043.dnkmem (mgr.34373) 2517 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:38:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.158150+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:38:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.161670+0000 mon.c (mon.1) 689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.162808+0000 mon.c (mon.1) 690 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.164104+0000 mon.c (mon.1) 691 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.165522+0000 mon.c (mon.1) 692 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.168342+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:16 gibba003 bash[31385]: audit 2021-03-10T14:38:15.169850+0000 mon.c (mon.1) 694 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: cephadm 2021-03-10T14:38:14.932961+0000 mgr.gibba043.dnkmem (mgr.34373) 2516 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:38:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: cephadm 2021-03-10T14:38:14.934483+0000 mgr.gibba043.dnkmem (mgr.34373) 2517 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:38:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.158150+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:38:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.161670+0000 mon.c (mon.1) 689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.162808+0000 mon.c (mon.1) 690 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.164104+0000 mon.c (mon.1) 691 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.165522+0000 mon.c (mon.1) 692 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.168342+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:16 gibba043 bash[24019]: audit 2021-03-10T14:38:15.169850+0000 mon.c (mon.1) 694 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cluster 2021-03-10T14:38:15.111652+0000 mgr.gibba043.dnkmem (mgr.34373) 2518 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.158237+0000 mgr.gibba043.dnkmem (mgr.34373) 2519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.159951+0000 mgr.gibba043.dnkmem (mgr.34373) 2520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.161021+0000 mgr.gibba043.dnkmem (mgr.34373) 2521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.161059+0000 mgr.gibba043.dnkmem (mgr.34373) 2522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.162465+0000 mgr.gibba043.dnkmem (mgr.34373) 2523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.162502+0000 mgr.gibba043.dnkmem (mgr.34373) 2524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.163612+0000 mgr.gibba043.dnkmem (mgr.34373) 2525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.165183+0000 mgr.gibba043.dnkmem (mgr.34373) 2526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.165222+0000 mgr.gibba043.dnkmem (mgr.34373) 2527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.166539+0000 mgr.gibba043.dnkmem (mgr.34373) 2528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.166873+0000 mgr.gibba043.dnkmem (mgr.34373) 2529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.168214+0000 mgr.gibba043.dnkmem (mgr.34373) 2530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.168253+0000 mgr.gibba043.dnkmem (mgr.34373) 2531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[31385]: cephadm 2021-03-10T14:38:15.168361+0000 mgr.gibba043.dnkmem (mgr.34373) 2532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cluster 2021-03-10T14:38:15.111652+0000 mgr.gibba043.dnkmem (mgr.34373) 2518 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.158237+0000 mgr.gibba043.dnkmem (mgr.34373) 2519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.159951+0000 mgr.gibba043.dnkmem (mgr.34373) 2520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.161021+0000 mgr.gibba043.dnkmem (mgr.34373) 2521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.161059+0000 mgr.gibba043.dnkmem (mgr.34373) 2522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.162465+0000 mgr.gibba043.dnkmem (mgr.34373) 2523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.162502+0000 mgr.gibba043.dnkmem (mgr.34373) 2524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.163612+0000 mgr.gibba043.dnkmem (mgr.34373) 2525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:17.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.165183+0000 mgr.gibba043.dnkmem (mgr.34373) 2526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.165222+0000 mgr.gibba043.dnkmem (mgr.34373) 2527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.166539+0000 mgr.gibba043.dnkmem (mgr.34373) 2528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.166873+0000 mgr.gibba043.dnkmem (mgr.34373) 2529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.168214+0000 mgr.gibba043.dnkmem (mgr.34373) 2530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.168253+0000 mgr.gibba043.dnkmem (mgr.34373) 2531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:17 gibba003 bash[32348]: cephadm 2021-03-10T14:38:15.168361+0000 mgr.gibba043.dnkmem (mgr.34373) 2532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cluster 2021-03-10T14:38:15.111652+0000 mgr.gibba043.dnkmem (mgr.34373) 2518 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.158237+0000 mgr.gibba043.dnkmem (mgr.34373) 2519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.159951+0000 mgr.gibba043.dnkmem (mgr.34373) 2520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.161021+0000 mgr.gibba043.dnkmem (mgr.34373) 2521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.161059+0000 mgr.gibba043.dnkmem (mgr.34373) 2522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.162465+0000 mgr.gibba043.dnkmem (mgr.34373) 2523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.162502+0000 mgr.gibba043.dnkmem (mgr.34373) 2524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.163612+0000 mgr.gibba043.dnkmem (mgr.34373) 2525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.165183+0000 mgr.gibba043.dnkmem (mgr.34373) 2526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.165222+0000 mgr.gibba043.dnkmem (mgr.34373) 2527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.166539+0000 mgr.gibba043.dnkmem (mgr.34373) 2528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.166873+0000 mgr.gibba043.dnkmem (mgr.34373) 2529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.168214+0000 mgr.gibba043.dnkmem (mgr.34373) 2530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.168253+0000 mgr.gibba043.dnkmem (mgr.34373) 2531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:17 gibba043 bash[24019]: cephadm 2021-03-10T14:38:15.168361+0000 mgr.gibba043.dnkmem (mgr.34373) 2532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:18 gibba043 bash[24019]: cluster 2021-03-10T14:38:17.113034+0000 mgr.gibba043.dnkmem (mgr.34373) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:18 gibba003 bash[31385]: cluster 2021-03-10T14:38:17.113034+0000 mgr.gibba043.dnkmem (mgr.34373) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:18 gibba003 bash[32348]: cluster 2021-03-10T14:38:17.113034+0000 mgr.gibba043.dnkmem (mgr.34373) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:20 gibba043 bash[24019]: cluster 2021-03-10T14:38:19.114533+0000 mgr.gibba043.dnkmem (mgr.34373) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:20 gibba003 bash[31385]: cluster 2021-03-10T14:38:19.114533+0000 mgr.gibba043.dnkmem (mgr.34373) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:20 gibba003 bash[32348]: cluster 2021-03-10T14:38:19.114533+0000 mgr.gibba043.dnkmem (mgr.34373) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:22 gibba043 bash[24019]: cluster 2021-03-10T14:38:21.116409+0000 mgr.gibba043.dnkmem (mgr.34373) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:22 gibba003 bash[31385]: cluster 2021-03-10T14:38:21.116409+0000 mgr.gibba043.dnkmem (mgr.34373) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:22 gibba003 bash[32348]: cluster 2021-03-10T14:38:21.116409+0000 mgr.gibba043.dnkmem (mgr.34373) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:24 gibba043 bash[24019]: cluster 2021-03-10T14:38:23.117885+0000 mgr.gibba043.dnkmem (mgr.34373) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:24 gibba003 bash[31385]: cluster 2021-03-10T14:38:23.117885+0000 mgr.gibba043.dnkmem (mgr.34373) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:24 gibba003 bash[32348]: cluster 2021-03-10T14:38:23.117885+0000 mgr.gibba043.dnkmem (mgr.34373) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:26 gibba043 bash[24019]: cluster 2021-03-10T14:38:25.119262+0000 mgr.gibba043.dnkmem (mgr.34373) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:26 gibba003 bash[31385]: cluster 2021-03-10T14:38:25.119262+0000 mgr.gibba043.dnkmem (mgr.34373) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:26 gibba003 bash[32348]: cluster 2021-03-10T14:38:25.119262+0000 mgr.gibba043.dnkmem (mgr.34373) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:29 gibba043 bash[24019]: cluster 2021-03-10T14:38:27.120816+0000 mgr.gibba043.dnkmem (mgr.34373) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:29 gibba003 bash[31385]: cluster 2021-03-10T14:38:27.120816+0000 mgr.gibba043.dnkmem (mgr.34373) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:29 gibba003 bash[32348]: cluster 2021-03-10T14:38:27.120816+0000 mgr.gibba043.dnkmem (mgr.34373) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:31.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:31 gibba043 bash[24019]: cluster 2021-03-10T14:38:29.122425+0000 mgr.gibba043.dnkmem (mgr.34373) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:31 gibba003 bash[31385]: cluster 2021-03-10T14:38:29.122425+0000 mgr.gibba043.dnkmem (mgr.34373) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:31 gibba003 bash[32348]: cluster 2021-03-10T14:38:29.122425+0000 mgr.gibba043.dnkmem (mgr.34373) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:32 gibba043 bash[24019]: cephadm 2021-03-10T14:38:30.184124+0000 mgr.gibba043.dnkmem (mgr.34373) 2540 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:32 gibba003 bash[31385]: cephadm 2021-03-10T14:38:30.184124+0000 mgr.gibba043.dnkmem (mgr.34373) 2540 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:32.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:32 gibba003 bash[32348]: cephadm 2021-03-10T14:38:30.184124+0000 mgr.gibba043.dnkmem (mgr.34373) 2540 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:33 gibba003 bash[31385]: cluster 2021-03-10T14:38:31.124302+0000 mgr.gibba043.dnkmem (mgr.34373) 2541 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:33 gibba003 bash[32348]: cluster 2021-03-10T14:38:31.124302+0000 mgr.gibba043.dnkmem (mgr.34373) 2541 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:33 gibba043 bash[24019]: cluster 2021-03-10T14:38:31.124302+0000 mgr.gibba043.dnkmem (mgr.34373) 2541 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:35 gibba003 bash[31385]: cluster 2021-03-10T14:38:33.125823+0000 mgr.gibba043.dnkmem (mgr.34373) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:35 gibba003 bash[32348]: cluster 2021-03-10T14:38:33.125823+0000 mgr.gibba043.dnkmem (mgr.34373) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:35 gibba043 bash[24019]: cluster 2021-03-10T14:38:33.125823+0000 mgr.gibba043.dnkmem (mgr.34373) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:37 gibba003 bash[31385]: cluster 2021-03-10T14:38:35.127283+0000 mgr.gibba043.dnkmem (mgr.34373) 2543 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:37 gibba003 bash[32348]: cluster 2021-03-10T14:38:35.127283+0000 mgr.gibba043.dnkmem (mgr.34373) 2543 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:37 gibba043 bash[24019]: cluster 2021-03-10T14:38:35.127283+0000 mgr.gibba043.dnkmem (mgr.34373) 2543 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:38.976 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:38:39.202 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:38:39.203 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (47m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:38:39.203 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (52m) 84s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:38:39.203 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (47m) 84s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:38:39.203 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (47m) 84s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:38:39.204 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:38:39.204 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:38:39.204 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (46m) 84s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:38:39.204 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:38:39.205 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (52m) 2m ago 52m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:38:39.205 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (52m) 84s ago 52m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:38:39.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:38:39.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:38:39.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:38:39.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:38:39.206 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (43m) 84s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:38:39.206 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (43m) 84s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:38:39.206 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (42m) 84s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:38:39.206 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (42m) 84s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:38:39.207 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (51m) 84s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:38:39.207 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:38:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:38 gibba043 bash[24019]: cluster 2021-03-10T14:38:37.128842+0000 mgr.gibba043.dnkmem (mgr.34373) 2544 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:39.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:38 gibba003 bash[31385]: cluster 2021-03-10T14:38:37.128842+0000 mgr.gibba043.dnkmem (mgr.34373) 2544 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:38 gibba003 bash[32348]: cluster 2021-03-10T14:38:37.128842+0000 mgr.gibba043.dnkmem (mgr.34373) 2544 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:39.448 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:38:39.449 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:38:39.449 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:39.449 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:38:39.449 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:38:39.450 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:39.450 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:38:39.450 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:38:39.450 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:38:39.451 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:38:39.451 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:38:39.451 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:38:39.451 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:38:39.451 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:38:39.452 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:38:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:39 gibba043 bash[24019]: audit 2021-03-10T14:38:38.964852+0000 mgr.gibba043.dnkmem (mgr.34373) 2545 : audit [DBG] from='client.45765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:39 gibba043 bash[24019]: audit 2021-03-10T14:38:39.449934+0000 mon.c (mon.1) 695 : audit [DBG] from='client.? 172.21.2.103:0/452295571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:40.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:39 gibba003 bash[31385]: audit 2021-03-10T14:38:38.964852+0000 mgr.gibba043.dnkmem (mgr.34373) 2545 : audit [DBG] from='client.45765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:40.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:39 gibba003 bash[31385]: audit 2021-03-10T14:38:39.449934+0000 mon.c (mon.1) 695 : audit [DBG] from='client.? 172.21.2.103:0/452295571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:40.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:39 gibba003 bash[32348]: audit 2021-03-10T14:38:38.964852+0000 mgr.gibba043.dnkmem (mgr.34373) 2545 : audit [DBG] from='client.45765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:40.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:39 gibba003 bash[32348]: audit 2021-03-10T14:38:39.449934+0000 mon.c (mon.1) 695 : audit [DBG] from='client.? 172.21.2.103:0/452295571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:40 gibba043 bash[24019]: cluster 2021-03-10T14:38:39.130423+0000 mgr.gibba043.dnkmem (mgr.34373) 2546 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:40 gibba043 bash[24019]: audit 2021-03-10T14:38:39.189050+0000 mgr.gibba043.dnkmem (mgr.34373) 2547 : audit [DBG] from='client.55756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:40 gibba003 bash[31385]: cluster 2021-03-10T14:38:39.130423+0000 mgr.gibba043.dnkmem (mgr.34373) 2546 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:40 gibba003 bash[31385]: audit 2021-03-10T14:38:39.189050+0000 mgr.gibba043.dnkmem (mgr.34373) 2547 : audit [DBG] from='client.55756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:40 gibba003 bash[32348]: cluster 2021-03-10T14:38:39.130423+0000 mgr.gibba043.dnkmem (mgr.34373) 2546 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:40 gibba003 bash[32348]: audit 2021-03-10T14:38:39.189050+0000 mgr.gibba043.dnkmem (mgr.34373) 2547 : audit [DBG] from='client.55756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:42 gibba043 bash[24019]: cluster 2021-03-10T14:38:41.132322+0000 mgr.gibba043.dnkmem (mgr.34373) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:42 gibba003 bash[31385]: cluster 2021-03-10T14:38:41.132322+0000 mgr.gibba043.dnkmem (mgr.34373) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:43.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:42 gibba003 bash[32348]: cluster 2021-03-10T14:38:41.132322+0000 mgr.gibba043.dnkmem (mgr.34373) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:45 gibba043 bash[24019]: cluster 2021-03-10T14:38:43.133966+0000 mgr.gibba043.dnkmem (mgr.34373) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:45 gibba003 bash[31385]: cluster 2021-03-10T14:38:43.133966+0000 mgr.gibba043.dnkmem (mgr.34373) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:45 gibba003 bash[32348]: cluster 2021-03-10T14:38:43.133966+0000 mgr.gibba043.dnkmem (mgr.34373) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:47 gibba043 bash[24019]: cluster 2021-03-10T14:38:45.135500+0000 mgr.gibba043.dnkmem (mgr.34373) 2550 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:47 gibba043 bash[24019]: cephadm 2021-03-10T14:38:45.196531+0000 mgr.gibba043.dnkmem (mgr.34373) 2551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:47 gibba003 bash[31385]: cluster 2021-03-10T14:38:45.135500+0000 mgr.gibba043.dnkmem (mgr.34373) 2550 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:47 gibba003 bash[31385]: cephadm 2021-03-10T14:38:45.196531+0000 mgr.gibba043.dnkmem (mgr.34373) 2551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:47 gibba003 bash[32348]: cluster 2021-03-10T14:38:45.135500+0000 mgr.gibba043.dnkmem (mgr.34373) 2550 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:47 gibba003 bash[32348]: cephadm 2021-03-10T14:38:45.196531+0000 mgr.gibba043.dnkmem (mgr.34373) 2551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:38:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:49 gibba003 bash[31385]: cluster 2021-03-10T14:38:47.136840+0000 mgr.gibba043.dnkmem (mgr.34373) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:49 gibba003 bash[32348]: cluster 2021-03-10T14:38:47.136840+0000 mgr.gibba043.dnkmem (mgr.34373) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:49 gibba043 bash[24019]: cluster 2021-03-10T14:38:47.136840+0000 mgr.gibba043.dnkmem (mgr.34373) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:51 gibba003 bash[31385]: cluster 2021-03-10T14:38:49.138494+0000 mgr.gibba043.dnkmem (mgr.34373) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:51 gibba003 bash[32348]: cluster 2021-03-10T14:38:49.138494+0000 mgr.gibba043.dnkmem (mgr.34373) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:51 gibba043 bash[24019]: cluster 2021-03-10T14:38:49.138494+0000 mgr.gibba043.dnkmem (mgr.34373) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:53 gibba003 bash[31385]: cluster 2021-03-10T14:38:51.140388+0000 mgr.gibba043.dnkmem (mgr.34373) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:53 gibba003 bash[32348]: cluster 2021-03-10T14:38:51.140388+0000 mgr.gibba043.dnkmem (mgr.34373) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:53 gibba043 bash[24019]: cluster 2021-03-10T14:38:51.140388+0000 mgr.gibba043.dnkmem (mgr.34373) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:55 gibba003 bash[32348]: cluster 2021-03-10T14:38:53.141973+0000 mgr.gibba043.dnkmem (mgr.34373) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:55 gibba003 bash[31385]: cluster 2021-03-10T14:38:53.141973+0000 mgr.gibba043.dnkmem (mgr.34373) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:55 gibba043 bash[24019]: cluster 2021-03-10T14:38:53.141973+0000 mgr.gibba043.dnkmem (mgr.34373) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:57 gibba003 bash[31385]: cluster 2021-03-10T14:38:55.143610+0000 mgr.gibba043.dnkmem (mgr.34373) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:57 gibba003 bash[32348]: cluster 2021-03-10T14:38:55.143610+0000 mgr.gibba043.dnkmem (mgr.34373) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:57 gibba043 bash[24019]: cluster 2021-03-10T14:38:55.143610+0000 mgr.gibba043.dnkmem (mgr.34373) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:38:58 gibba043 bash[24019]: cluster 2021-03-10T14:38:57.145088+0000 mgr.gibba043.dnkmem (mgr.34373) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:38:58 gibba003 bash[31385]: cluster 2021-03-10T14:38:57.145088+0000 mgr.gibba043.dnkmem (mgr.34373) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:38:58 gibba003 bash[32348]: cluster 2021-03-10T14:38:57.145088+0000 mgr.gibba043.dnkmem (mgr.34373) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:00 gibba043 bash[24019]: cluster 2021-03-10T14:38:59.146770+0000 mgr.gibba043.dnkmem (mgr.34373) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:00 gibba003 bash[31385]: cluster 2021-03-10T14:38:59.146770+0000 mgr.gibba043.dnkmem (mgr.34373) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:00 gibba003 bash[32348]: cluster 2021-03-10T14:38:59.146770+0000 mgr.gibba043.dnkmem (mgr.34373) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:01 gibba043 bash[24019]: cephadm 2021-03-10T14:39:00.212590+0000 mgr.gibba043.dnkmem (mgr.34373) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:02.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:01 gibba003 bash[31385]: cephadm 2021-03-10T14:39:00.212590+0000 mgr.gibba043.dnkmem (mgr.34373) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:02.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:01 gibba003 bash[32348]: cephadm 2021-03-10T14:39:00.212590+0000 mgr.gibba043.dnkmem (mgr.34373) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:03 gibba043 bash[24019]: cluster 2021-03-10T14:39:01.148470+0000 mgr.gibba043.dnkmem (mgr.34373) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:03 gibba003 bash[31385]: cluster 2021-03-10T14:39:01.148470+0000 mgr.gibba043.dnkmem (mgr.34373) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:03 gibba003 bash[32348]: cluster 2021-03-10T14:39:01.148470+0000 mgr.gibba043.dnkmem (mgr.34373) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:05 gibba043 bash[24019]: cluster 2021-03-10T14:39:03.149970+0000 mgr.gibba043.dnkmem (mgr.34373) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:05 gibba003 bash[31385]: cluster 2021-03-10T14:39:03.149970+0000 mgr.gibba043.dnkmem (mgr.34373) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:05 gibba003 bash[32348]: cluster 2021-03-10T14:39:03.149970+0000 mgr.gibba043.dnkmem (mgr.34373) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:07 gibba003 bash[31385]: cluster 2021-03-10T14:39:05.151511+0000 mgr.gibba043.dnkmem (mgr.34373) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:07.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:07 gibba003 bash[32348]: cluster 2021-03-10T14:39:05.151511+0000 mgr.gibba043.dnkmem (mgr.34373) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:07 gibba043 bash[24019]: cluster 2021-03-10T14:39:05.151511+0000 mgr.gibba043.dnkmem (mgr.34373) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:09 gibba003 bash[31385]: cluster 2021-03-10T14:39:07.152939+0000 mgr.gibba043.dnkmem (mgr.34373) 2563 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:09 gibba003 bash[32348]: cluster 2021-03-10T14:39:07.152939+0000 mgr.gibba043.dnkmem (mgr.34373) 2563 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:09 gibba043 bash[24019]: cluster 2021-03-10T14:39:07.152939+0000 mgr.gibba043.dnkmem (mgr.34373) 2563 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.688 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:39:09.915 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:39:09.915 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (47m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:39:09.916 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (52m) 115s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:39:09.916 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (47m) 115s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:39:09.916 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (48m) 115s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:39:09.916 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (47m) 2m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:39:09.916 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (47m) 2m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:39:09.917 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (46m) 115s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:39:09.917 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:39:09.917 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (52m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:39:09.917 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (52m) 115s ago 53m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:39:09.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (45m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:39:09.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:39:09.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:39:09.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:39:09.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (44m) 115s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:39:09.919 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (43m) 115s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:39:09.919 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (43m) 115s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:39:09.919 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (42m) 115s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:39:09.919 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (52m) 115s ago 53m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:39:09.919 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:39:10.166 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:39:10.166 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:39:10.167 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:10.167 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:39:10.167 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:39:10.167 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:10.168 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:39:10.168 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:39:10.168 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:39:10.168 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:39:10.169 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:39:10.169 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:39:10.169 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:39:10.169 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:39:10.169 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:39:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[31385]: cluster 2021-03-10T14:39:09.154558+0000 mgr.gibba043.dnkmem (mgr.34373) 2564 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[31385]: audit 2021-03-10T14:39:09.677909+0000 mgr.gibba043.dnkmem (mgr.34373) 2565 : audit [DBG] from='client.45783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[31385]: audit 2021-03-10T14:39:09.901193+0000 mgr.gibba043.dnkmem (mgr.34373) 2566 : audit [DBG] from='client.55774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[31385]: audit 2021-03-10T14:39:10.167164+0000 mon.c (mon.1) 696 : audit [DBG] from='client.? 172.21.2.103:0/2323009349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[32348]: cluster 2021-03-10T14:39:09.154558+0000 mgr.gibba043.dnkmem (mgr.34373) 2564 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[32348]: audit 2021-03-10T14:39:09.677909+0000 mgr.gibba043.dnkmem (mgr.34373) 2565 : audit [DBG] from='client.45783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[32348]: audit 2021-03-10T14:39:09.901193+0000 mgr.gibba043.dnkmem (mgr.34373) 2566 : audit [DBG] from='client.55774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:11 gibba003 bash[32348]: audit 2021-03-10T14:39:10.167164+0000 mon.c (mon.1) 696 : audit [DBG] from='client.? 172.21.2.103:0/2323009349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:11 gibba043 bash[24019]: cluster 2021-03-10T14:39:09.154558+0000 mgr.gibba043.dnkmem (mgr.34373) 2564 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:11 gibba043 bash[24019]: audit 2021-03-10T14:39:09.677909+0000 mgr.gibba043.dnkmem (mgr.34373) 2565 : audit [DBG] from='client.45783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:11 gibba043 bash[24019]: audit 2021-03-10T14:39:09.901193+0000 mgr.gibba043.dnkmem (mgr.34373) 2566 : audit [DBG] from='client.55774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:11 gibba043 bash[24019]: audit 2021-03-10T14:39:10.167164+0000 mon.c (mon.1) 696 : audit [DBG] from='client.? 172.21.2.103:0/2323009349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: cluster 2021-03-10T14:39:11.156253+0000 mgr.gibba043.dnkmem (mgr.34373) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.009721+0000 mon.c (mon.1) 697 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.010150+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.038932+0000 mon.c (mon.1) 698 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.039291+0000 mon.c (mon.1) 699 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.039522+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.039598+0000 mon.c (mon.1) 700 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.039846+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.039952+0000 mon.c (mon.1) 701 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:39:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.040131+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[31385]: audit 2021-03-10T14:39:13.040397+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:39:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: cluster 2021-03-10T14:39:11.156253+0000 mgr.gibba043.dnkmem (mgr.34373) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.009721+0000 mon.c (mon.1) 697 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.010150+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.038932+0000 mon.c (mon.1) 698 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.039291+0000 mon.c (mon.1) 699 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.039522+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.039598+0000 mon.c (mon.1) 700 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.039846+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.039952+0000 mon.c (mon.1) 701 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:39:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.040131+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:13 gibba003 bash[32348]: audit 2021-03-10T14:39:13.040397+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:39:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: cluster 2021-03-10T14:39:11.156253+0000 mgr.gibba043.dnkmem (mgr.34373) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.009721+0000 mon.c (mon.1) 697 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.010150+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.038932+0000 mon.c (mon.1) 698 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.039291+0000 mon.c (mon.1) 699 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.039522+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.039598+0000 mon.c (mon.1) 700 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.039846+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.039952+0000 mon.c (mon.1) 701 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:39:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.040131+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:13 gibba043 bash[24019]: audit 2021-03-10T14:39:13.040397+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:39:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:14 gibba003 bash[31385]: audit 2021-03-10T14:39:13.100785+0000 mon.c (mon.1) 702 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:14 gibba003 bash[31385]: audit 2021-03-10T14:39:13.101904+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:14 gibba003 bash[32348]: audit 2021-03-10T14:39:13.100785+0000 mon.c (mon.1) 702 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:14 gibba003 bash[32348]: audit 2021-03-10T14:39:13.101904+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:14 gibba043 bash[24019]: audit 2021-03-10T14:39:13.100785+0000 mon.c (mon.1) 702 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:14 gibba043 bash[24019]: audit 2021-03-10T14:39:13.101904+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:15 gibba003 bash[31385]: cluster 2021-03-10T14:39:13.157704+0000 mgr.gibba043.dnkmem (mgr.34373) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:15 gibba003 bash[32348]: cluster 2021-03-10T14:39:13.157704+0000 mgr.gibba043.dnkmem (mgr.34373) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:15.466 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:15 gibba043 bash[24019]: cluster 2021-03-10T14:39:13.157704+0000 mgr.gibba043.dnkmem (mgr.34373) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cluster 2021-03-10T14:39:15.159385+0000 mgr.gibba043.dnkmem (mgr.34373) 2569 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.229280+0000 mgr.gibba043.dnkmem (mgr.34373) 2570 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:39:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 2571 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:39:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.454292+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:39:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.454529+0000 mgr.gibba043.dnkmem (mgr.34373) 2572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.456185+0000 mgr.gibba043.dnkmem (mgr.34373) 2573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.457607+0000 mgr.gibba043.dnkmem (mgr.34373) 2574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.457646+0000 mgr.gibba043.dnkmem (mgr.34373) 2575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.457935+0000 mon.c (mon.1) 703 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.458732+0000 mgr.gibba043.dnkmem (mgr.34373) 2576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.458768+0000 mgr.gibba043.dnkmem (mgr.34373) 2577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.459255+0000 mon.c (mon.1) 704 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.459913+0000 mgr.gibba043.dnkmem (mgr.34373) 2578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.460671+0000 mon.c (mon.1) 705 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.461404+0000 mgr.gibba043.dnkmem (mgr.34373) 2579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.461443+0000 mgr.gibba043.dnkmem (mgr.34373) 2580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.461826+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.462750+0000 mgr.gibba043.dnkmem (mgr.34373) 2581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.463077+0000 mgr.gibba043.dnkmem (mgr.34373) 2582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.464457+0000 mon.c (mon.1) 707 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.464634+0000 mgr.gibba043.dnkmem (mgr.34373) 2583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.464678+0000 mgr.gibba043.dnkmem (mgr.34373) 2584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: cephadm 2021-03-10T14:39:15.464868+0000 mgr.gibba043.dnkmem (mgr.34373) 2585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:16 gibba043 bash[24019]: audit 2021-03-10T14:39:15.466130+0000 mon.c (mon.1) 708 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cluster 2021-03-10T14:39:15.159385+0000 mgr.gibba043.dnkmem (mgr.34373) 2569 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.229280+0000 mgr.gibba043.dnkmem (mgr.34373) 2570 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:39:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 2571 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:39:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.454292+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:39:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.454529+0000 mgr.gibba043.dnkmem (mgr.34373) 2572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.456185+0000 mgr.gibba043.dnkmem (mgr.34373) 2573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.457607+0000 mgr.gibba043.dnkmem (mgr.34373) 2574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.457646+0000 mgr.gibba043.dnkmem (mgr.34373) 2575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.457935+0000 mon.c (mon.1) 703 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.458732+0000 mgr.gibba043.dnkmem (mgr.34373) 2576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.458768+0000 mgr.gibba043.dnkmem (mgr.34373) 2577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.459255+0000 mon.c (mon.1) 704 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.459913+0000 mgr.gibba043.dnkmem (mgr.34373) 2578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.460671+0000 mon.c (mon.1) 705 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.461404+0000 mgr.gibba043.dnkmem (mgr.34373) 2579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.461443+0000 mgr.gibba043.dnkmem (mgr.34373) 2580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.461826+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.462750+0000 mgr.gibba043.dnkmem (mgr.34373) 2581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.463077+0000 mgr.gibba043.dnkmem (mgr.34373) 2582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.464457+0000 mon.c (mon.1) 707 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.464634+0000 mgr.gibba043.dnkmem (mgr.34373) 2583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cluster 2021-03-10T14:39:15.159385+0000 mgr.gibba043.dnkmem (mgr.34373) 2569 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.229280+0000 mgr.gibba043.dnkmem (mgr.34373) 2570 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:39:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 2571 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:39:16.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.454292+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:39:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.454529+0000 mgr.gibba043.dnkmem (mgr.34373) 2572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.456185+0000 mgr.gibba043.dnkmem (mgr.34373) 2573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.457607+0000 mgr.gibba043.dnkmem (mgr.34373) 2574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.457646+0000 mgr.gibba043.dnkmem (mgr.34373) 2575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:16.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.457935+0000 mon.c (mon.1) 703 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.458732+0000 mgr.gibba043.dnkmem (mgr.34373) 2576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.458768+0000 mgr.gibba043.dnkmem (mgr.34373) 2577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.459255+0000 mon.c (mon.1) 704 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.459913+0000 mgr.gibba043.dnkmem (mgr.34373) 2578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.460671+0000 mon.c (mon.1) 705 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.461404+0000 mgr.gibba043.dnkmem (mgr.34373) 2579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.461443+0000 mgr.gibba043.dnkmem (mgr.34373) 2580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.461826+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.462750+0000 mgr.gibba043.dnkmem (mgr.34373) 2581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.463077+0000 mgr.gibba043.dnkmem (mgr.34373) 2582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.464457+0000 mon.c (mon.1) 707 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.464634+0000 mgr.gibba043.dnkmem (mgr.34373) 2583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.464678+0000 mgr.gibba043.dnkmem (mgr.34373) 2584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: cephadm 2021-03-10T14:39:15.464868+0000 mgr.gibba043.dnkmem (mgr.34373) 2585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[32348]: audit 2021-03-10T14:39:15.466130+0000 mon.c (mon.1) 708 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:16.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.464678+0000 mgr.gibba043.dnkmem (mgr.34373) 2584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:16.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: cephadm 2021-03-10T14:39:15.464868+0000 mgr.gibba043.dnkmem (mgr.34373) 2585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:16.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:16 gibba003 bash[31385]: audit 2021-03-10T14:39:15.466130+0000 mon.c (mon.1) 708 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:18 gibba043 bash[24019]: cluster 2021-03-10T14:39:17.161166+0000 mgr.gibba043.dnkmem (mgr.34373) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:18 gibba003 bash[31385]: cluster 2021-03-10T14:39:17.161166+0000 mgr.gibba043.dnkmem (mgr.34373) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:18 gibba003 bash[32348]: cluster 2021-03-10T14:39:17.161166+0000 mgr.gibba043.dnkmem (mgr.34373) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:21 gibba043 bash[24019]: cluster 2021-03-10T14:39:19.163032+0000 mgr.gibba043.dnkmem (mgr.34373) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:21 gibba003 bash[31385]: cluster 2021-03-10T14:39:19.163032+0000 mgr.gibba043.dnkmem (mgr.34373) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:21 gibba003 bash[32348]: cluster 2021-03-10T14:39:19.163032+0000 mgr.gibba043.dnkmem (mgr.34373) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:23 gibba043 bash[24019]: cluster 2021-03-10T14:39:21.164844+0000 mgr.gibba043.dnkmem (mgr.34373) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:23 gibba003 bash[31385]: cluster 2021-03-10T14:39:21.164844+0000 mgr.gibba043.dnkmem (mgr.34373) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:23 gibba003 bash[32348]: cluster 2021-03-10T14:39:21.164844+0000 mgr.gibba043.dnkmem (mgr.34373) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:25 gibba043 bash[24019]: cluster 2021-03-10T14:39:23.166367+0000 mgr.gibba043.dnkmem (mgr.34373) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:25 gibba003 bash[31385]: cluster 2021-03-10T14:39:23.166367+0000 mgr.gibba043.dnkmem (mgr.34373) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:25 gibba003 bash[32348]: cluster 2021-03-10T14:39:23.166367+0000 mgr.gibba043.dnkmem (mgr.34373) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:27 gibba003 bash[31385]: cluster 2021-03-10T14:39:25.167841+0000 mgr.gibba043.dnkmem (mgr.34373) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:27 gibba003 bash[32348]: cluster 2021-03-10T14:39:25.167841+0000 mgr.gibba043.dnkmem (mgr.34373) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:27 gibba043 bash[24019]: cluster 2021-03-10T14:39:25.167841+0000 mgr.gibba043.dnkmem (mgr.34373) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:29 gibba003 bash[31385]: cluster 2021-03-10T14:39:27.169428+0000 mgr.gibba043.dnkmem (mgr.34373) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:29 gibba003 bash[32348]: cluster 2021-03-10T14:39:27.169428+0000 mgr.gibba043.dnkmem (mgr.34373) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:29 gibba043 bash[24019]: cluster 2021-03-10T14:39:27.169428+0000 mgr.gibba043.dnkmem (mgr.34373) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:31 gibba003 bash[31385]: cluster 2021-03-10T14:39:29.170951+0000 mgr.gibba043.dnkmem (mgr.34373) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:31 gibba003 bash[32348]: cluster 2021-03-10T14:39:29.170951+0000 mgr.gibba043.dnkmem (mgr.34373) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:31 gibba043 bash[24019]: cluster 2021-03-10T14:39:29.170951+0000 mgr.gibba043.dnkmem (mgr.34373) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:32 gibba003 bash[31385]: cephadm 2021-03-10T14:39:30.480848+0000 mgr.gibba043.dnkmem (mgr.34373) 2593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:32.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:32 gibba003 bash[32348]: cephadm 2021-03-10T14:39:30.480848+0000 mgr.gibba043.dnkmem (mgr.34373) 2593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:32 gibba043 bash[24019]: cephadm 2021-03-10T14:39:30.480848+0000 mgr.gibba043.dnkmem (mgr.34373) 2593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:33 gibba003 bash[31385]: cluster 2021-03-10T14:39:31.172823+0000 mgr.gibba043.dnkmem (mgr.34373) 2594 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:33 gibba003 bash[32348]: cluster 2021-03-10T14:39:31.172823+0000 mgr.gibba043.dnkmem (mgr.34373) 2594 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:33 gibba043 bash[24019]: cluster 2021-03-10T14:39:31.172823+0000 mgr.gibba043.dnkmem (mgr.34373) 2594 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:34.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:34 gibba003 bash[31385]: cluster 2021-03-10T14:39:33.174493+0000 mgr.gibba043.dnkmem (mgr.34373) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:34.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:34 gibba003 bash[32348]: cluster 2021-03-10T14:39:33.174493+0000 mgr.gibba043.dnkmem (mgr.34373) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:34 gibba043 bash[24019]: cluster 2021-03-10T14:39:33.174493+0000 mgr.gibba043.dnkmem (mgr.34373) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:36 gibba043 bash[24019]: cluster 2021-03-10T14:39:35.175985+0000 mgr.gibba043.dnkmem (mgr.34373) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:36 gibba003 bash[31385]: cluster 2021-03-10T14:39:35.175985+0000 mgr.gibba043.dnkmem (mgr.34373) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:36.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:36 gibba003 bash[32348]: cluster 2021-03-10T14:39:35.175985+0000 mgr.gibba043.dnkmem (mgr.34373) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:39 gibba043 bash[24019]: cluster 2021-03-10T14:39:37.177626+0000 mgr.gibba043.dnkmem (mgr.34373) 2597 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:39 gibba003 bash[31385]: cluster 2021-03-10T14:39:37.177626+0000 mgr.gibba043.dnkmem (mgr.34373) 2597 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:39 gibba003 bash[32348]: cluster 2021-03-10T14:39:37.177626+0000 mgr.gibba043.dnkmem (mgr.34373) 2597 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:40.409 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:39:40.634 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:39:40.635 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (48m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:39:40.635 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:39:40.635 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:39:40.635 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:39:40.636 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:39:40.636 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:39:40.636 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:39:40.636 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:39:40.636 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (53m) 3m ago 53m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:39:40.637 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:39:40.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:39:40.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:39:40.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:39:40.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:39:40.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:39:40.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:39:40.638 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:39:40.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (43m) 2m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:39:40.639 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (52m) 2m ago 53m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:39:40.639 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:39:40.881 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:39:40.881 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:39:40.881 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:40.882 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:39:40.882 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:39:40.882 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:40.883 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:39:40.883 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:39:40.883 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:39:40.883 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:39:40.884 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:39:40.884 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:39:40.884 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:39:40.884 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:39:40.884 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:39:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:41 gibba043 bash[24019]: cluster 2021-03-10T14:39:39.178969+0000 mgr.gibba043.dnkmem (mgr.34373) 2598 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:41 gibba043 bash[24019]: audit 2021-03-10T14:39:40.881760+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? 172.21.2.103:0/2453915756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:41 gibba003 bash[32348]: cluster 2021-03-10T14:39:39.178969+0000 mgr.gibba043.dnkmem (mgr.34373) 2598 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:41 gibba003 bash[32348]: audit 2021-03-10T14:39:40.881760+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? 172.21.2.103:0/2453915756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:41 gibba003 bash[31385]: cluster 2021-03-10T14:39:39.178969+0000 mgr.gibba043.dnkmem (mgr.34373) 2598 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:41 gibba003 bash[31385]: audit 2021-03-10T14:39:40.881760+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? 172.21.2.103:0/2453915756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:42.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:42 gibba043 bash[24019]: audit 2021-03-10T14:39:40.398687+0000 mgr.gibba043.dnkmem (mgr.34373) 2599 : audit [DBG] from='client.55786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:42.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:42 gibba043 bash[24019]: audit 2021-03-10T14:39:40.620724+0000 mgr.gibba043.dnkmem (mgr.34373) 2600 : audit [DBG] from='client.55792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:42 gibba003 bash[31385]: audit 2021-03-10T14:39:40.398687+0000 mgr.gibba043.dnkmem (mgr.34373) 2599 : audit [DBG] from='client.55786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:42 gibba003 bash[31385]: audit 2021-03-10T14:39:40.620724+0000 mgr.gibba043.dnkmem (mgr.34373) 2600 : audit [DBG] from='client.55792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:42 gibba003 bash[32348]: audit 2021-03-10T14:39:40.398687+0000 mgr.gibba043.dnkmem (mgr.34373) 2599 : audit [DBG] from='client.55786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:42 gibba003 bash[32348]: audit 2021-03-10T14:39:40.620724+0000 mgr.gibba043.dnkmem (mgr.34373) 2600 : audit [DBG] from='client.55792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:43 gibba003 bash[31385]: cluster 2021-03-10T14:39:41.180528+0000 mgr.gibba043.dnkmem (mgr.34373) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:43 gibba003 bash[32348]: cluster 2021-03-10T14:39:41.180528+0000 mgr.gibba043.dnkmem (mgr.34373) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:43 gibba043 bash[24019]: cluster 2021-03-10T14:39:41.180528+0000 mgr.gibba043.dnkmem (mgr.34373) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:45 gibba003 bash[31385]: cluster 2021-03-10T14:39:43.182113+0000 mgr.gibba043.dnkmem (mgr.34373) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:45 gibba003 bash[32348]: cluster 2021-03-10T14:39:43.182113+0000 mgr.gibba043.dnkmem (mgr.34373) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:45.499 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:45 gibba043 bash[24019]: cluster 2021-03-10T14:39:43.182113+0000 mgr.gibba043.dnkmem (mgr.34373) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:47 gibba003 bash[31385]: cluster 2021-03-10T14:39:45.183661+0000 mgr.gibba043.dnkmem (mgr.34373) 2603 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:47 gibba003 bash[31385]: cephadm 2021-03-10T14:39:45.496941+0000 mgr.gibba043.dnkmem (mgr.34373) 2604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:47 gibba003 bash[32348]: cluster 2021-03-10T14:39:45.183661+0000 mgr.gibba043.dnkmem (mgr.34373) 2603 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:47 gibba003 bash[32348]: cephadm 2021-03-10T14:39:45.496941+0000 mgr.gibba043.dnkmem (mgr.34373) 2604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:47 gibba043 bash[24019]: cluster 2021-03-10T14:39:45.183661+0000 mgr.gibba043.dnkmem (mgr.34373) 2603 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:47 gibba043 bash[24019]: cephadm 2021-03-10T14:39:45.496941+0000 mgr.gibba043.dnkmem (mgr.34373) 2604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:39:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:49 gibba003 bash[31385]: cluster 2021-03-10T14:39:47.185041+0000 mgr.gibba043.dnkmem (mgr.34373) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:49 gibba003 bash[32348]: cluster 2021-03-10T14:39:47.185041+0000 mgr.gibba043.dnkmem (mgr.34373) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:49 gibba043 bash[24019]: cluster 2021-03-10T14:39:47.185041+0000 mgr.gibba043.dnkmem (mgr.34373) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:51 gibba003 bash[31385]: cluster 2021-03-10T14:39:49.186634+0000 mgr.gibba043.dnkmem (mgr.34373) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:51 gibba003 bash[32348]: cluster 2021-03-10T14:39:49.186634+0000 mgr.gibba043.dnkmem (mgr.34373) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:51 gibba043 bash[24019]: cluster 2021-03-10T14:39:49.186634+0000 mgr.gibba043.dnkmem (mgr.34373) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:53 gibba003 bash[31385]: cluster 2021-03-10T14:39:51.188428+0000 mgr.gibba043.dnkmem (mgr.34373) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:53 gibba003 bash[32348]: cluster 2021-03-10T14:39:51.188428+0000 mgr.gibba043.dnkmem (mgr.34373) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:53 gibba043 bash[24019]: cluster 2021-03-10T14:39:51.188428+0000 mgr.gibba043.dnkmem (mgr.34373) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:54.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:54 gibba003 bash[31385]: cluster 2021-03-10T14:39:53.190079+0000 mgr.gibba043.dnkmem (mgr.34373) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:54.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:54 gibba003 bash[32348]: cluster 2021-03-10T14:39:53.190079+0000 mgr.gibba043.dnkmem (mgr.34373) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:54 gibba043 bash[24019]: cluster 2021-03-10T14:39:53.190079+0000 mgr.gibba043.dnkmem (mgr.34373) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:56 gibba043 bash[24019]: cluster 2021-03-10T14:39:55.191761+0000 mgr.gibba043.dnkmem (mgr.34373) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:56.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:56 gibba003 bash[31385]: cluster 2021-03-10T14:39:55.191761+0000 mgr.gibba043.dnkmem (mgr.34373) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:56.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:56 gibba003 bash[32348]: cluster 2021-03-10T14:39:55.191761+0000 mgr.gibba043.dnkmem (mgr.34373) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:39:59 gibba043 bash[24019]: cluster 2021-03-10T14:39:57.193140+0000 mgr.gibba043.dnkmem (mgr.34373) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:39:59 gibba003 bash[31385]: cluster 2021-03-10T14:39:57.193140+0000 mgr.gibba043.dnkmem (mgr.34373) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:39:59 gibba003 bash[32348]: cluster 2021-03-10T14:39:57.193140+0000 mgr.gibba043.dnkmem (mgr.34373) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:00 gibba043 bash[24019]: cluster 2021-03-10T14:40:00.000266+0000 mon.a (mon.0) 856 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:00 gibba003 bash[31385]: debug 2021-03-10T14:39:59.999+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:00.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:00 gibba003 bash[31385]: cluster 2021-03-10T14:40:00.000266+0000 mon.a (mon.0) 856 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:00.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:00 gibba003 bash[32348]: cluster 2021-03-10T14:40:00.000266+0000 mon.a (mon.0) 856 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:01 gibba003 bash[31385]: cluster 2021-03-10T14:39:59.194621+0000 mgr.gibba043.dnkmem (mgr.34373) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:01 gibba003 bash[32348]: cluster 2021-03-10T14:39:59.194621+0000 mgr.gibba043.dnkmem (mgr.34373) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:01 gibba043 bash[24019]: cluster 2021-03-10T14:39:59.194621+0000 mgr.gibba043.dnkmem (mgr.34373) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:02.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:02 gibba003 bash[31385]: cephadm 2021-03-10T14:40:00.512843+0000 mgr.gibba043.dnkmem (mgr.34373) 2612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:02.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:02 gibba003 bash[32348]: cephadm 2021-03-10T14:40:00.512843+0000 mgr.gibba043.dnkmem (mgr.34373) 2612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:02 gibba043 bash[24019]: cephadm 2021-03-10T14:40:00.512843+0000 mgr.gibba043.dnkmem (mgr.34373) 2612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:03 gibba003 bash[31385]: cluster 2021-03-10T14:40:01.196472+0000 mgr.gibba043.dnkmem (mgr.34373) 2613 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:03 gibba003 bash[32348]: cluster 2021-03-10T14:40:01.196472+0000 mgr.gibba043.dnkmem (mgr.34373) 2613 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:03 gibba043 bash[24019]: cluster 2021-03-10T14:40:01.196472+0000 mgr.gibba043.dnkmem (mgr.34373) 2613 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:05 gibba003 bash[31385]: cluster 2021-03-10T14:40:03.197772+0000 mgr.gibba043.dnkmem (mgr.34373) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:05 gibba003 bash[32348]: cluster 2021-03-10T14:40:03.197772+0000 mgr.gibba043.dnkmem (mgr.34373) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:05 gibba043 bash[24019]: cluster 2021-03-10T14:40:03.197772+0000 mgr.gibba043.dnkmem (mgr.34373) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:07 gibba003 bash[31385]: cluster 2021-03-10T14:40:05.199302+0000 mgr.gibba043.dnkmem (mgr.34373) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:07 gibba003 bash[32348]: cluster 2021-03-10T14:40:05.199302+0000 mgr.gibba043.dnkmem (mgr.34373) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:07 gibba043 bash[24019]: cluster 2021-03-10T14:40:05.199302+0000 mgr.gibba043.dnkmem (mgr.34373) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:09 gibba003 bash[31385]: cluster 2021-03-10T14:40:07.200845+0000 mgr.gibba043.dnkmem (mgr.34373) 2616 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:09 gibba003 bash[32348]: cluster 2021-03-10T14:40:07.200845+0000 mgr.gibba043.dnkmem (mgr.34373) 2616 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:09 gibba043 bash[24019]: cluster 2021-03-10T14:40:07.200845+0000 mgr.gibba043.dnkmem (mgr.34373) 2616 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.122 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:40:11.349 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:40:11.349 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (48m) 4m ago 53m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:40:11.350 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:40:11.350 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:40:11.350 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (49m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:40:11.350 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:40:11.351 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:40:11.351 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:40:11.351 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:40:11.351 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (53m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:40:11.351 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (54m) 2m ago 54m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:40:11.352 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:40:11.352 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:40:11.352 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:40:11.352 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:40:11.352 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:40:11.353 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:40:11.353 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:40:11.353 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:40:11.353 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (53m) 2m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:40:11.353 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:40:11.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:11 gibba003 bash[31385]: cluster 2021-03-10T14:40:09.202427+0000 mgr.gibba043.dnkmem (mgr.34373) 2617 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:11 gibba003 bash[32348]: cluster 2021-03-10T14:40:09.202427+0000 mgr.gibba043.dnkmem (mgr.34373) 2617 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:11 gibba043 bash[24019]: cluster 2021-03-10T14:40:09.202427+0000 mgr.gibba043.dnkmem (mgr.34373) 2617 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.604 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:40:11.604 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:40:11.604 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:11.604 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:40:11.605 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:40:11.605 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:11.605 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:40:11.605 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:40:11.606 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:40:11.606 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:40:11.606 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:40:11.606 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:40:11.607 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:40:11.607 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:40:11.607 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:40:12.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:12 gibba003 bash[31385]: audit 2021-03-10T14:40:11.604737+0000 mon.c (mon.1) 709 : audit [DBG] from='client.? 172.21.2.103:0/2823986974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:12.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:12 gibba003 bash[32348]: audit 2021-03-10T14:40:11.604737+0000 mon.c (mon.1) 709 : audit [DBG] from='client.? 172.21.2.103:0/2823986974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:12 gibba043 bash[24019]: audit 2021-03-10T14:40:11.604737+0000 mon.c (mon.1) 709 : audit [DBG] from='client.? 172.21.2.103:0/2823986974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:11.112478+0000 mgr.gibba043.dnkmem (mgr.34373) 2618 : audit [DBG] from='client.55804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: cluster 2021-03-10T14:40:11.204083+0000 mgr.gibba043.dnkmem (mgr.34373) 2619 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:11.335633+0000 mgr.gibba043.dnkmem (mgr.34373) 2620 : audit [DBG] from='client.45825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.013345+0000 mon.c (mon.1) 710 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.015609+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.043378+0000 mon.c (mon.1) 711 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:40:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.043553+0000 mon.c (mon.1) 712 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:40:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.043704+0000 mon.c (mon.1) 713 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.043873+0000 mon.c (mon.1) 714 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.043969+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:40:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.044403+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:40:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.044672+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[31385]: audit 2021-03-10T14:40:13.044934+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:11.112478+0000 mgr.gibba043.dnkmem (mgr.34373) 2618 : audit [DBG] from='client.55804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: cluster 2021-03-10T14:40:11.204083+0000 mgr.gibba043.dnkmem (mgr.34373) 2619 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:11.335633+0000 mgr.gibba043.dnkmem (mgr.34373) 2620 : audit [DBG] from='client.45825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.013345+0000 mon.c (mon.1) 710 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.015609+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.043378+0000 mon.c (mon.1) 711 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:40:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.043553+0000 mon.c (mon.1) 712 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:40:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.043704+0000 mon.c (mon.1) 713 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.043873+0000 mon.c (mon.1) 714 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.043969+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:40:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.044403+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:40:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.044672+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:13 gibba003 bash[32348]: audit 2021-03-10T14:40:13.044934+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:11.112478+0000 mgr.gibba043.dnkmem (mgr.34373) 2618 : audit [DBG] from='client.55804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: cluster 2021-03-10T14:40:11.204083+0000 mgr.gibba043.dnkmem (mgr.34373) 2619 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:11.335633+0000 mgr.gibba043.dnkmem (mgr.34373) 2620 : audit [DBG] from='client.45825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.013345+0000 mon.c (mon.1) 710 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.015609+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.043378+0000 mon.c (mon.1) 711 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:40:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.043553+0000 mon.c (mon.1) 712 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:40:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.043704+0000 mon.c (mon.1) 713 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.043873+0000 mon.c (mon.1) 714 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.043969+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:40:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.044403+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:40:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.044672+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:40:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:13 gibba043 bash[24019]: audit 2021-03-10T14:40:13.044934+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:14 gibba003 bash[31385]: audit 2021-03-10T14:40:13.108475+0000 mon.c (mon.1) 715 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:14 gibba003 bash[31385]: audit 2021-03-10T14:40:13.108792+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:14 gibba003 bash[31385]: cluster 2021-03-10T14:40:13.205941+0000 mgr.gibba043.dnkmem (mgr.34373) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:14 gibba003 bash[32348]: audit 2021-03-10T14:40:13.108475+0000 mon.c (mon.1) 715 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:14 gibba003 bash[32348]: audit 2021-03-10T14:40:13.108792+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:14 gibba003 bash[32348]: cluster 2021-03-10T14:40:13.205941+0000 mgr.gibba043.dnkmem (mgr.34373) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:14 gibba043 bash[24019]: audit 2021-03-10T14:40:13.108475+0000 mon.c (mon.1) 715 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:14 gibba043 bash[24019]: audit 2021-03-10T14:40:13.108792+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:14 gibba043 bash[24019]: cluster 2021-03-10T14:40:13.205941+0000 mgr.gibba043.dnkmem (mgr.34373) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cluster 2021-03-10T14:40:15.207257+0000 mgr.gibba043.dnkmem (mgr.34373) 2622 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.528277+0000 mgr.gibba043.dnkmem (mgr.34373) 2623 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:40:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.529839+0000 mgr.gibba043.dnkmem (mgr.34373) 2624 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:40:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.753355+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:40:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.753424+0000 mgr.gibba043.dnkmem (mgr.34373) 2625 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.755652+0000 mgr.gibba043.dnkmem (mgr.34373) 2626 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.757147+0000 mon.c (mon.1) 716 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:17.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.757232+0000 mgr.gibba043.dnkmem (mgr.34373) 2627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:17.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.757319+0000 mgr.gibba043.dnkmem (mgr.34373) 2628 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:17.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.758663+0000 mgr.gibba043.dnkmem (mgr.34373) 2629 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:17.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.758724+0000 mgr.gibba043.dnkmem (mgr.34373) 2630 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:17.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.758963+0000 mon.c (mon.1) 717 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.760014+0000 mgr.gibba043.dnkmem (mgr.34373) 2631 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:17.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.760548+0000 mon.c (mon.1) 718 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.761912+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.762047+0000 mgr.gibba043.dnkmem (mgr.34373) 2632 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:17.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.762124+0000 mgr.gibba043.dnkmem (mgr.34373) 2633 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:17.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.763504+0000 mgr.gibba043.dnkmem (mgr.34373) 2634 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:17.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.763895+0000 mgr.gibba043.dnkmem (mgr.34373) 2635 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:17.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.765200+0000 mgr.gibba043.dnkmem (mgr.34373) 2636 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:17.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.765260+0000 mgr.gibba043.dnkmem (mgr.34373) 2637 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:17.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.765363+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: cephadm 2021-03-10T14:40:15.765379+0000 mgr.gibba043.dnkmem (mgr.34373) 2638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:17.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:16 gibba043 bash[24019]: audit 2021-03-10T14:40:15.767080+0000 mon.c (mon.1) 721 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cluster 2021-03-10T14:40:15.207257+0000 mgr.gibba043.dnkmem (mgr.34373) 2622 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.528277+0000 mgr.gibba043.dnkmem (mgr.34373) 2623 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:40:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.529839+0000 mgr.gibba043.dnkmem (mgr.34373) 2624 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:40:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.753355+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:40:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.753424+0000 mgr.gibba043.dnkmem (mgr.34373) 2625 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.755652+0000 mgr.gibba043.dnkmem (mgr.34373) 2626 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.757147+0000 mon.c (mon.1) 716 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.757232+0000 mgr.gibba043.dnkmem (mgr.34373) 2627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.757319+0000 mgr.gibba043.dnkmem (mgr.34373) 2628 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.758663+0000 mgr.gibba043.dnkmem (mgr.34373) 2629 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.758724+0000 mgr.gibba043.dnkmem (mgr.34373) 2630 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.758963+0000 mon.c (mon.1) 717 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.760014+0000 mgr.gibba043.dnkmem (mgr.34373) 2631 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.760548+0000 mon.c (mon.1) 718 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.761912+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.762047+0000 mgr.gibba043.dnkmem (mgr.34373) 2632 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:17.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.762124+0000 mgr.gibba043.dnkmem (mgr.34373) 2633 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:17.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.763504+0000 mgr.gibba043.dnkmem (mgr.34373) 2634 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:17.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.763895+0000 mgr.gibba043.dnkmem (mgr.34373) 2635 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:17.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.765200+0000 mgr.gibba043.dnkmem (mgr.34373) 2636 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:17.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.765260+0000 mgr.gibba043.dnkmem (mgr.34373) 2637 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:17.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.765363+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: cephadm 2021-03-10T14:40:15.765379+0000 mgr.gibba043.dnkmem (mgr.34373) 2638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:17.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[31385]: audit 2021-03-10T14:40:15.767080+0000 mon.c (mon.1) 721 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cluster 2021-03-10T14:40:15.207257+0000 mgr.gibba043.dnkmem (mgr.34373) 2622 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.528277+0000 mgr.gibba043.dnkmem (mgr.34373) 2623 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:40:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.529839+0000 mgr.gibba043.dnkmem (mgr.34373) 2624 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:40:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.753355+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:40:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.753424+0000 mgr.gibba043.dnkmem (mgr.34373) 2625 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.755652+0000 mgr.gibba043.dnkmem (mgr.34373) 2626 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.757147+0000 mon.c (mon.1) 716 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.757232+0000 mgr.gibba043.dnkmem (mgr.34373) 2627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.757319+0000 mgr.gibba043.dnkmem (mgr.34373) 2628 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.758663+0000 mgr.gibba043.dnkmem (mgr.34373) 2629 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.758724+0000 mgr.gibba043.dnkmem (mgr.34373) 2630 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.758963+0000 mon.c (mon.1) 717 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.760014+0000 mgr.gibba043.dnkmem (mgr.34373) 2631 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.760548+0000 mon.c (mon.1) 718 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.761912+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.762047+0000 mgr.gibba043.dnkmem (mgr.34373) 2632 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:17.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.762124+0000 mgr.gibba043.dnkmem (mgr.34373) 2633 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:17.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.763504+0000 mgr.gibba043.dnkmem (mgr.34373) 2634 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:17.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.763895+0000 mgr.gibba043.dnkmem (mgr.34373) 2635 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:17.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.765200+0000 mgr.gibba043.dnkmem (mgr.34373) 2636 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:17.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.765260+0000 mgr.gibba043.dnkmem (mgr.34373) 2637 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:17.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.765363+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:17.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: cephadm 2021-03-10T14:40:15.765379+0000 mgr.gibba043.dnkmem (mgr.34373) 2638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:17.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:16 gibba003 bash[32348]: audit 2021-03-10T14:40:15.767080+0000 mon.c (mon.1) 721 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:19 gibba003 bash[31385]: cluster 2021-03-10T14:40:17.208816+0000 mgr.gibba043.dnkmem (mgr.34373) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:19 gibba003 bash[32348]: cluster 2021-03-10T14:40:17.208816+0000 mgr.gibba043.dnkmem (mgr.34373) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:19 gibba043 bash[24019]: cluster 2021-03-10T14:40:17.208816+0000 mgr.gibba043.dnkmem (mgr.34373) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:21 gibba003 bash[31385]: cluster 2021-03-10T14:40:19.210708+0000 mgr.gibba043.dnkmem (mgr.34373) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:21 gibba003 bash[32348]: cluster 2021-03-10T14:40:19.210708+0000 mgr.gibba043.dnkmem (mgr.34373) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:21 gibba043 bash[24019]: cluster 2021-03-10T14:40:19.210708+0000 mgr.gibba043.dnkmem (mgr.34373) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:23 gibba003 bash[31385]: cluster 2021-03-10T14:40:21.212578+0000 mgr.gibba043.dnkmem (mgr.34373) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:23 gibba003 bash[32348]: cluster 2021-03-10T14:40:21.212578+0000 mgr.gibba043.dnkmem (mgr.34373) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:23 gibba043 bash[24019]: cluster 2021-03-10T14:40:21.212578+0000 mgr.gibba043.dnkmem (mgr.34373) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:25 gibba003 bash[31385]: cluster 2021-03-10T14:40:23.214457+0000 mgr.gibba043.dnkmem (mgr.34373) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:25.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:25 gibba003 bash[32348]: cluster 2021-03-10T14:40:23.214457+0000 mgr.gibba043.dnkmem (mgr.34373) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:25 gibba043 bash[24019]: cluster 2021-03-10T14:40:23.214457+0000 mgr.gibba043.dnkmem (mgr.34373) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:27 gibba003 bash[31385]: cluster 2021-03-10T14:40:25.216185+0000 mgr.gibba043.dnkmem (mgr.34373) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:27 gibba003 bash[32348]: cluster 2021-03-10T14:40:25.216185+0000 mgr.gibba043.dnkmem (mgr.34373) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:27 gibba043 bash[24019]: cluster 2021-03-10T14:40:25.216185+0000 mgr.gibba043.dnkmem (mgr.34373) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:29 gibba003 bash[31385]: cluster 2021-03-10T14:40:27.217974+0000 mgr.gibba043.dnkmem (mgr.34373) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:29.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:29 gibba003 bash[32348]: cluster 2021-03-10T14:40:27.217974+0000 mgr.gibba043.dnkmem (mgr.34373) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:29 gibba043 bash[24019]: cluster 2021-03-10T14:40:27.217974+0000 mgr.gibba043.dnkmem (mgr.34373) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:31 gibba003 bash[31385]: cluster 2021-03-10T14:40:29.219647+0000 mgr.gibba043.dnkmem (mgr.34373) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:31 gibba003 bash[32348]: cluster 2021-03-10T14:40:29.219647+0000 mgr.gibba043.dnkmem (mgr.34373) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:31 gibba043 bash[24019]: cluster 2021-03-10T14:40:29.219647+0000 mgr.gibba043.dnkmem (mgr.34373) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:32 gibba003 bash[31385]: cephadm 2021-03-10T14:40:30.781327+0000 mgr.gibba043.dnkmem (mgr.34373) 2646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:32.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:32 gibba003 bash[32348]: cephadm 2021-03-10T14:40:30.781327+0000 mgr.gibba043.dnkmem (mgr.34373) 2646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:32 gibba043 bash[24019]: cephadm 2021-03-10T14:40:30.781327+0000 mgr.gibba043.dnkmem (mgr.34373) 2646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:33 gibba003 bash[31385]: cluster 2021-03-10T14:40:31.221546+0000 mgr.gibba043.dnkmem (mgr.34373) 2647 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:33.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:33 gibba003 bash[32348]: cluster 2021-03-10T14:40:31.221546+0000 mgr.gibba043.dnkmem (mgr.34373) 2647 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:33 gibba043 bash[24019]: cluster 2021-03-10T14:40:31.221546+0000 mgr.gibba043.dnkmem (mgr.34373) 2647 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:34.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:34 gibba003 bash[31385]: cluster 2021-03-10T14:40:33.223370+0000 mgr.gibba043.dnkmem (mgr.34373) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:34.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:34 gibba003 bash[32348]: cluster 2021-03-10T14:40:33.223370+0000 mgr.gibba043.dnkmem (mgr.34373) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:34 gibba043 bash[24019]: cluster 2021-03-10T14:40:33.223370+0000 mgr.gibba043.dnkmem (mgr.34373) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:36 gibba003 bash[31385]: cluster 2021-03-10T14:40:35.224785+0000 mgr.gibba043.dnkmem (mgr.34373) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:36.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:36 gibba003 bash[32348]: cluster 2021-03-10T14:40:35.224785+0000 mgr.gibba043.dnkmem (mgr.34373) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:36 gibba043 bash[24019]: cluster 2021-03-10T14:40:35.224785+0000 mgr.gibba043.dnkmem (mgr.34373) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:39 gibba003 bash[31385]: cluster 2021-03-10T14:40:37.226239+0000 mgr.gibba043.dnkmem (mgr.34373) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:39 gibba003 bash[32348]: cluster 2021-03-10T14:40:37.226239+0000 mgr.gibba043.dnkmem (mgr.34373) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:39 gibba043 bash[24019]: cluster 2021-03-10T14:40:37.226239+0000 mgr.gibba043.dnkmem (mgr.34373) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:41 gibba003 bash[31385]: cluster 2021-03-10T14:40:39.227905+0000 mgr.gibba043.dnkmem (mgr.34373) 2651 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:41 gibba003 bash[32348]: cluster 2021-03-10T14:40:39.227905+0000 mgr.gibba043.dnkmem (mgr.34373) 2651 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:41 gibba043 bash[24019]: cluster 2021-03-10T14:40:39.227905+0000 mgr.gibba043.dnkmem (mgr.34373) 2651 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.851 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:40:42.074 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:40:42.074 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (49m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:40:42.074 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:40:42.075 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:40:42.075 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:40:42.075 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:40:42.075 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:40:42.076 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:40:42.076 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:40:42.076 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (54m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:40:42.076 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:40:42.076 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:40:42.077 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:40:42.077 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:40:42.077 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:40:42.077 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:40:42.077 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:40:42.078 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:40:42.078 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (44m) 3m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:40:42.078 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (53m) 3m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:40:42.078 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:40:42.321 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:40:42.322 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:40:42.322 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:42.322 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:40:42.322 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:40:42.323 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:42.323 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:40:42.323 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:40:42.323 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:40:42.323 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:40:42.324 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:40:42.324 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:40:42.324 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:40:42.324 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:40:42.324 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:40:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[31385]: cluster 2021-03-10T14:40:41.229411+0000 mgr.gibba043.dnkmem (mgr.34373) 2652 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[31385]: audit 2021-03-10T14:40:41.840515+0000 mgr.gibba043.dnkmem (mgr.34373) 2653 : audit [DBG] from='client.45837 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[31385]: audit 2021-03-10T14:40:42.063615+0000 mgr.gibba043.dnkmem (mgr.34373) 2654 : audit [DBG] from='client.55828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[31385]: audit 2021-03-10T14:40:42.322485+0000 mon.c (mon.1) 722 : audit [DBG] from='client.? 172.21.2.103:0/2509074961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[32348]: cluster 2021-03-10T14:40:41.229411+0000 mgr.gibba043.dnkmem (mgr.34373) 2652 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[32348]: audit 2021-03-10T14:40:41.840515+0000 mgr.gibba043.dnkmem (mgr.34373) 2653 : audit [DBG] from='client.45837 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[32348]: audit 2021-03-10T14:40:42.063615+0000 mgr.gibba043.dnkmem (mgr.34373) 2654 : audit [DBG] from='client.55828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:43 gibba003 bash[32348]: audit 2021-03-10T14:40:42.322485+0000 mon.c (mon.1) 722 : audit [DBG] from='client.? 172.21.2.103:0/2509074961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:43 gibba043 bash[24019]: cluster 2021-03-10T14:40:41.229411+0000 mgr.gibba043.dnkmem (mgr.34373) 2652 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:43 gibba043 bash[24019]: audit 2021-03-10T14:40:41.840515+0000 mgr.gibba043.dnkmem (mgr.34373) 2653 : audit [DBG] from='client.45837 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:43 gibba043 bash[24019]: audit 2021-03-10T14:40:42.063615+0000 mgr.gibba043.dnkmem (mgr.34373) 2654 : audit [DBG] from='client.55828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:43 gibba043 bash[24019]: audit 2021-03-10T14:40:42.322485+0000 mon.c (mon.1) 722 : audit [DBG] from='client.? 172.21.2.103:0/2509074961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:45 gibba003 bash[31385]: cluster 2021-03-10T14:40:43.231195+0000 mgr.gibba043.dnkmem (mgr.34373) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:45 gibba003 bash[32348]: cluster 2021-03-10T14:40:43.231195+0000 mgr.gibba043.dnkmem (mgr.34373) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:45 gibba043 bash[24019]: cluster 2021-03-10T14:40:43.231195+0000 mgr.gibba043.dnkmem (mgr.34373) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:47 gibba003 bash[31385]: cluster 2021-03-10T14:40:45.232538+0000 mgr.gibba043.dnkmem (mgr.34373) 2656 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:47 gibba003 bash[31385]: cephadm 2021-03-10T14:40:45.797194+0000 mgr.gibba043.dnkmem (mgr.34373) 2657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:47 gibba003 bash[32348]: cluster 2021-03-10T14:40:45.232538+0000 mgr.gibba043.dnkmem (mgr.34373) 2656 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:47 gibba003 bash[32348]: cephadm 2021-03-10T14:40:45.797194+0000 mgr.gibba043.dnkmem (mgr.34373) 2657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:47 gibba043 bash[24019]: cluster 2021-03-10T14:40:45.232538+0000 mgr.gibba043.dnkmem (mgr.34373) 2656 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:47 gibba043 bash[24019]: cephadm 2021-03-10T14:40:45.797194+0000 mgr.gibba043.dnkmem (mgr.34373) 2657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:40:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:49 gibba003 bash[31385]: cluster 2021-03-10T14:40:47.233918+0000 mgr.gibba043.dnkmem (mgr.34373) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:49 gibba003 bash[32348]: cluster 2021-03-10T14:40:47.233918+0000 mgr.gibba043.dnkmem (mgr.34373) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:49 gibba043 bash[24019]: cluster 2021-03-10T14:40:47.233918+0000 mgr.gibba043.dnkmem (mgr.34373) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:51 gibba003 bash[31385]: cluster 2021-03-10T14:40:49.235572+0000 mgr.gibba043.dnkmem (mgr.34373) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:51 gibba003 bash[32348]: cluster 2021-03-10T14:40:49.235572+0000 mgr.gibba043.dnkmem (mgr.34373) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:51 gibba043 bash[24019]: cluster 2021-03-10T14:40:49.235572+0000 mgr.gibba043.dnkmem (mgr.34373) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:53 gibba003 bash[31385]: cluster 2021-03-10T14:40:51.237141+0000 mgr.gibba043.dnkmem (mgr.34373) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:53.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:53 gibba003 bash[32348]: cluster 2021-03-10T14:40:51.237141+0000 mgr.gibba043.dnkmem (mgr.34373) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:53 gibba043 bash[24019]: cluster 2021-03-10T14:40:51.237141+0000 mgr.gibba043.dnkmem (mgr.34373) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:54.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:54 gibba003 bash[31385]: cluster 2021-03-10T14:40:53.238578+0000 mgr.gibba043.dnkmem (mgr.34373) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:54.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:54 gibba003 bash[32348]: cluster 2021-03-10T14:40:53.238578+0000 mgr.gibba043.dnkmem (mgr.34373) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:54 gibba043 bash[24019]: cluster 2021-03-10T14:40:53.238578+0000 mgr.gibba043.dnkmem (mgr.34373) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:56 gibba003 bash[31385]: cluster 2021-03-10T14:40:55.240180+0000 mgr.gibba043.dnkmem (mgr.34373) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:56 gibba003 bash[32348]: cluster 2021-03-10T14:40:55.240180+0000 mgr.gibba043.dnkmem (mgr.34373) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:56 gibba043 bash[24019]: cluster 2021-03-10T14:40:55.240180+0000 mgr.gibba043.dnkmem (mgr.34373) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:40:59 gibba003 bash[31385]: cluster 2021-03-10T14:40:57.241815+0000 mgr.gibba043.dnkmem (mgr.34373) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:40:59 gibba003 bash[32348]: cluster 2021-03-10T14:40:57.241815+0000 mgr.gibba043.dnkmem (mgr.34373) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:40:59 gibba043 bash[24019]: cluster 2021-03-10T14:40:57.241815+0000 mgr.gibba043.dnkmem (mgr.34373) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:01 gibba003 bash[31385]: cluster 2021-03-10T14:40:59.243483+0000 mgr.gibba043.dnkmem (mgr.34373) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:01 gibba003 bash[32348]: cluster 2021-03-10T14:40:59.243483+0000 mgr.gibba043.dnkmem (mgr.34373) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:01 gibba043 bash[24019]: cluster 2021-03-10T14:40:59.243483+0000 mgr.gibba043.dnkmem (mgr.34373) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:02.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:02 gibba003 bash[31385]: cephadm 2021-03-10T14:41:00.812968+0000 mgr.gibba043.dnkmem (mgr.34373) 2665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:02.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:02 gibba003 bash[32348]: cephadm 2021-03-10T14:41:00.812968+0000 mgr.gibba043.dnkmem (mgr.34373) 2665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:02 gibba043 bash[24019]: cephadm 2021-03-10T14:41:00.812968+0000 mgr.gibba043.dnkmem (mgr.34373) 2665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:03 gibba003 bash[31385]: cluster 2021-03-10T14:41:01.245237+0000 mgr.gibba043.dnkmem (mgr.34373) 2666 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:03 gibba003 bash[32348]: cluster 2021-03-10T14:41:01.245237+0000 mgr.gibba043.dnkmem (mgr.34373) 2666 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:03 gibba043 bash[24019]: cluster 2021-03-10T14:41:01.245237+0000 mgr.gibba043.dnkmem (mgr.34373) 2666 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:05 gibba003 bash[31385]: cluster 2021-03-10T14:41:03.246817+0000 mgr.gibba043.dnkmem (mgr.34373) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:05 gibba003 bash[32348]: cluster 2021-03-10T14:41:03.246817+0000 mgr.gibba043.dnkmem (mgr.34373) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:05 gibba043 bash[24019]: cluster 2021-03-10T14:41:03.246817+0000 mgr.gibba043.dnkmem (mgr.34373) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:06.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:06 gibba003 bash[31385]: cluster 2021-03-10T14:41:05.248223+0000 mgr.gibba043.dnkmem (mgr.34373) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:06 gibba003 bash[32348]: cluster 2021-03-10T14:41:05.248223+0000 mgr.gibba043.dnkmem (mgr.34373) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:06 gibba043 bash[24019]: cluster 2021-03-10T14:41:05.248223+0000 mgr.gibba043.dnkmem (mgr.34373) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:09 gibba003 bash[31385]: cluster 2021-03-10T14:41:07.249781+0000 mgr.gibba043.dnkmem (mgr.34373) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:09 gibba003 bash[32348]: cluster 2021-03-10T14:41:07.249781+0000 mgr.gibba043.dnkmem (mgr.34373) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:09 gibba043 bash[24019]: cluster 2021-03-10T14:41:07.249781+0000 mgr.gibba043.dnkmem (mgr.34373) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:11 gibba003 bash[31385]: cluster 2021-03-10T14:41:09.251305+0000 mgr.gibba043.dnkmem (mgr.34373) 2670 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:11 gibba003 bash[32348]: cluster 2021-03-10T14:41:09.251305+0000 mgr.gibba043.dnkmem (mgr.34373) 2670 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:11 gibba043 bash[24019]: cluster 2021-03-10T14:41:09.251305+0000 mgr.gibba043.dnkmem (mgr.34373) 2670 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:12.565 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:41:12.793 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:41:12.793 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (49m) 5m ago 54m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:41:12.794 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:41:12.794 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (49m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:41:12.794 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (50m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:41:12.794 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:41:12.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:41:12.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:41:12.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:41:12.795 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:41:12.796 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (55m) 3m ago 55m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:41:12.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:41:12.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:41:12.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:41:12.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (46m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:41:12.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:41:12.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:41:12.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:41:12.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:41:12.797 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (54m) 3m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:41:12.798 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:41:13.044 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:41:13.045 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:41:13.045 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:13.046 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:41:13.046 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:41:13.046 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:13.047 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:41:13.047 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:41:13.047 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:41:13.048 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:41:13.048 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:41:13.048 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:41:13.049 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:41:13.049 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:41:13.049 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:41:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: cluster 2021-03-10T14:41:11.253309+0000 mgr.gibba043.dnkmem (mgr.34373) 2671 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.020319+0000 mon.c (mon.1) 723 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.020658+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.045547+0000 mon.c (mon.1) 724 : audit [DBG] from='client.? 172.21.2.103:0/3441538643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.052604+0000 mon.c (mon.1) 725 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:41:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.052795+0000 mon.c (mon.1) 726 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.053011+0000 mon.c (mon.1) 727 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:41:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.053144+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:41:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.053226+0000 mon.c (mon.1) 728 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.053693+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.053978+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:41:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[31385]: audit 2021-03-10T14:41:13.054235+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: cluster 2021-03-10T14:41:11.253309+0000 mgr.gibba043.dnkmem (mgr.34373) 2671 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.020319+0000 mon.c (mon.1) 723 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.020658+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.045547+0000 mon.c (mon.1) 724 : audit [DBG] from='client.? 172.21.2.103:0/3441538643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.052604+0000 mon.c (mon.1) 725 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:41:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.052795+0000 mon.c (mon.1) 726 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.053011+0000 mon.c (mon.1) 727 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:41:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.053144+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:41:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.053226+0000 mon.c (mon.1) 728 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.053693+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.053978+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:41:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:13 gibba003 bash[32348]: audit 2021-03-10T14:41:13.054235+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: cluster 2021-03-10T14:41:11.253309+0000 mgr.gibba043.dnkmem (mgr.34373) 2671 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.020319+0000 mon.c (mon.1) 723 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.020658+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.045547+0000 mon.c (mon.1) 724 : audit [DBG] from='client.? 172.21.2.103:0/3441538643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.052604+0000 mon.c (mon.1) 725 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:41:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.052795+0000 mon.c (mon.1) 726 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.053011+0000 mon.c (mon.1) 727 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:41:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.053144+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:41:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.053226+0000 mon.c (mon.1) 728 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.053693+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:41:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.053978+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:41:13.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:13 gibba043 bash[24019]: audit 2021-03-10T14:41:13.054235+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:41:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[31385]: audit 2021-03-10T14:41:12.553759+0000 mgr.gibba043.dnkmem (mgr.34373) 2672 : audit [DBG] from='client.45855 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[31385]: audit 2021-03-10T14:41:12.779270+0000 mgr.gibba043.dnkmem (mgr.34373) 2673 : audit [DBG] from='client.45861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[31385]: audit 2021-03-10T14:41:13.111478+0000 mon.c (mon.1) 729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[31385]: audit 2021-03-10T14:41:13.111959+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[32348]: audit 2021-03-10T14:41:12.553759+0000 mgr.gibba043.dnkmem (mgr.34373) 2672 : audit [DBG] from='client.45855 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[32348]: audit 2021-03-10T14:41:12.779270+0000 mgr.gibba043.dnkmem (mgr.34373) 2673 : audit [DBG] from='client.45861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[32348]: audit 2021-03-10T14:41:13.111478+0000 mon.c (mon.1) 729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:14 gibba003 bash[32348]: audit 2021-03-10T14:41:13.111959+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:14 gibba043 bash[24019]: audit 2021-03-10T14:41:12.553759+0000 mgr.gibba043.dnkmem (mgr.34373) 2672 : audit [DBG] from='client.45855 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:14 gibba043 bash[24019]: audit 2021-03-10T14:41:12.779270+0000 mgr.gibba043.dnkmem (mgr.34373) 2673 : audit [DBG] from='client.45861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:14 gibba043 bash[24019]: audit 2021-03-10T14:41:13.111478+0000 mon.c (mon.1) 729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:14 gibba043 bash[24019]: audit 2021-03-10T14:41:13.111959+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:15 gibba003 bash[31385]: cluster 2021-03-10T14:41:13.254943+0000 mgr.gibba043.dnkmem (mgr.34373) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:15 gibba003 bash[32348]: cluster 2021-03-10T14:41:13.254943+0000 mgr.gibba043.dnkmem (mgr.34373) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:15 gibba043 bash[24019]: cluster 2021-03-10T14:41:13.254943+0000 mgr.gibba043.dnkmem (mgr.34373) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cluster 2021-03-10T14:41:15.256155+0000 mgr.gibba043.dnkmem (mgr.34373) 2675 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:15.829730+0000 mgr.gibba043.dnkmem (mgr.34373) 2676 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:41:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:15.831312+0000 mgr.gibba043.dnkmem (mgr.34373) 2677 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:41:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.057146+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:41:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.057647+0000 mgr.gibba043.dnkmem (mgr.34373) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.059779+0000 mgr.gibba043.dnkmem (mgr.34373) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.061170+0000 mon.c (mon.1) 730 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.061236+0000 mgr.gibba043.dnkmem (mgr.34373) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.061294+0000 mgr.gibba043.dnkmem (mgr.34373) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.062841+0000 mgr.gibba043.dnkmem (mgr.34373) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.062894+0000 mgr.gibba043.dnkmem (mgr.34373) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.062968+0000 mon.c (mon.1) 731 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.064221+0000 mgr.gibba043.dnkmem (mgr.34373) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.064475+0000 mon.c (mon.1) 732 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.065851+0000 mon.c (mon.1) 733 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.066268+0000 mgr.gibba043.dnkmem (mgr.34373) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.066327+0000 mgr.gibba043.dnkmem (mgr.34373) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.067751+0000 mgr.gibba043.dnkmem (mgr.34373) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.068099+0000 mgr.gibba043.dnkmem (mgr.34373) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.069544+0000 mon.c (mon.1) 734 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.069779+0000 mgr.gibba043.dnkmem (mgr.34373) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cluster 2021-03-10T14:41:15.256155+0000 mgr.gibba043.dnkmem (mgr.34373) 2675 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:15.829730+0000 mgr.gibba043.dnkmem (mgr.34373) 2676 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:41:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:15.831312+0000 mgr.gibba043.dnkmem (mgr.34373) 2677 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:41:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.057146+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:41:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.057647+0000 mgr.gibba043.dnkmem (mgr.34373) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.059779+0000 mgr.gibba043.dnkmem (mgr.34373) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:17.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.061170+0000 mon.c (mon.1) 730 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:17.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.061236+0000 mgr.gibba043.dnkmem (mgr.34373) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:17.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.061294+0000 mgr.gibba043.dnkmem (mgr.34373) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:17.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.062841+0000 mgr.gibba043.dnkmem (mgr.34373) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:17.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.062894+0000 mgr.gibba043.dnkmem (mgr.34373) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.062968+0000 mon.c (mon.1) 731 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.064221+0000 mgr.gibba043.dnkmem (mgr.34373) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.064475+0000 mon.c (mon.1) 732 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.065851+0000 mon.c (mon.1) 733 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.066268+0000 mgr.gibba043.dnkmem (mgr.34373) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.066327+0000 mgr.gibba043.dnkmem (mgr.34373) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.067751+0000 mgr.gibba043.dnkmem (mgr.34373) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.068099+0000 mgr.gibba043.dnkmem (mgr.34373) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.069544+0000 mon.c (mon.1) 734 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.069779+0000 mgr.gibba043.dnkmem (mgr.34373) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:17.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.069840+0000 mgr.gibba043.dnkmem (mgr.34373) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:17.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: cephadm 2021-03-10T14:41:16.069966+0000 mgr.gibba043.dnkmem (mgr.34373) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:17.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[31385]: audit 2021-03-10T14:41:16.071179+0000 mon.c (mon.1) 735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.069840+0000 mgr.gibba043.dnkmem (mgr.34373) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: cephadm 2021-03-10T14:41:16.069966+0000 mgr.gibba043.dnkmem (mgr.34373) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:17 gibba003 bash[32348]: audit 2021-03-10T14:41:16.071179+0000 mon.c (mon.1) 735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cluster 2021-03-10T14:41:15.256155+0000 mgr.gibba043.dnkmem (mgr.34373) 2675 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:15.829730+0000 mgr.gibba043.dnkmem (mgr.34373) 2676 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:41:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:15.831312+0000 mgr.gibba043.dnkmem (mgr.34373) 2677 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:41:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.057146+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:41:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.057647+0000 mgr.gibba043.dnkmem (mgr.34373) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.059779+0000 mgr.gibba043.dnkmem (mgr.34373) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.061170+0000 mon.c (mon.1) 730 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.061236+0000 mgr.gibba043.dnkmem (mgr.34373) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.061294+0000 mgr.gibba043.dnkmem (mgr.34373) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.062841+0000 mgr.gibba043.dnkmem (mgr.34373) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.062894+0000 mgr.gibba043.dnkmem (mgr.34373) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.062968+0000 mon.c (mon.1) 731 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.064221+0000 mgr.gibba043.dnkmem (mgr.34373) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.064475+0000 mon.c (mon.1) 732 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.065851+0000 mon.c (mon.1) 733 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.066268+0000 mgr.gibba043.dnkmem (mgr.34373) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.066327+0000 mgr.gibba043.dnkmem (mgr.34373) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:17.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.067751+0000 mgr.gibba043.dnkmem (mgr.34373) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:17.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.068099+0000 mgr.gibba043.dnkmem (mgr.34373) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:17.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.069544+0000 mon.c (mon.1) 734 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:17.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.069779+0000 mgr.gibba043.dnkmem (mgr.34373) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:17.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.069840+0000 mgr.gibba043.dnkmem (mgr.34373) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:17.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: cephadm 2021-03-10T14:41:16.069966+0000 mgr.gibba043.dnkmem (mgr.34373) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:17.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:17 gibba043 bash[24019]: audit 2021-03-10T14:41:16.071179+0000 mon.c (mon.1) 735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:19 gibba003 bash[31385]: cluster 2021-03-10T14:41:17.257821+0000 mgr.gibba043.dnkmem (mgr.34373) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:19 gibba003 bash[32348]: cluster 2021-03-10T14:41:17.257821+0000 mgr.gibba043.dnkmem (mgr.34373) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:19 gibba043 bash[24019]: cluster 2021-03-10T14:41:17.257821+0000 mgr.gibba043.dnkmem (mgr.34373) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:21 gibba003 bash[31385]: cluster 2021-03-10T14:41:19.259420+0000 mgr.gibba043.dnkmem (mgr.34373) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:21 gibba003 bash[32348]: cluster 2021-03-10T14:41:19.259420+0000 mgr.gibba043.dnkmem (mgr.34373) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:21 gibba043 bash[24019]: cluster 2021-03-10T14:41:19.259420+0000 mgr.gibba043.dnkmem (mgr.34373) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:23 gibba003 bash[31385]: cluster 2021-03-10T14:41:21.261212+0000 mgr.gibba043.dnkmem (mgr.34373) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:23 gibba003 bash[32348]: cluster 2021-03-10T14:41:21.261212+0000 mgr.gibba043.dnkmem (mgr.34373) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:23 gibba043 bash[24019]: cluster 2021-03-10T14:41:21.261212+0000 mgr.gibba043.dnkmem (mgr.34373) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:25 gibba003 bash[31385]: cluster 2021-03-10T14:41:23.262712+0000 mgr.gibba043.dnkmem (mgr.34373) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:25 gibba003 bash[32348]: cluster 2021-03-10T14:41:23.262712+0000 mgr.gibba043.dnkmem (mgr.34373) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:25 gibba043 bash[24019]: cluster 2021-03-10T14:41:23.262712+0000 mgr.gibba043.dnkmem (mgr.34373) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:27 gibba003 bash[31385]: cluster 2021-03-10T14:41:25.264155+0000 mgr.gibba043.dnkmem (mgr.34373) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:27 gibba003 bash[32348]: cluster 2021-03-10T14:41:25.264155+0000 mgr.gibba043.dnkmem (mgr.34373) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:27 gibba043 bash[24019]: cluster 2021-03-10T14:41:25.264155+0000 mgr.gibba043.dnkmem (mgr.34373) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:29 gibba003 bash[31385]: cluster 2021-03-10T14:41:27.265781+0000 mgr.gibba043.dnkmem (mgr.34373) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:29 gibba003 bash[32348]: cluster 2021-03-10T14:41:27.265781+0000 mgr.gibba043.dnkmem (mgr.34373) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:29 gibba043 bash[24019]: cluster 2021-03-10T14:41:27.265781+0000 mgr.gibba043.dnkmem (mgr.34373) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:31 gibba003 bash[31385]: cluster 2021-03-10T14:41:29.267201+0000 mgr.gibba043.dnkmem (mgr.34373) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:31 gibba003 bash[32348]: cluster 2021-03-10T14:41:29.267201+0000 mgr.gibba043.dnkmem (mgr.34373) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:31 gibba043 bash[24019]: cluster 2021-03-10T14:41:29.267201+0000 mgr.gibba043.dnkmem (mgr.34373) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:32 gibba003 bash[31385]: cephadm 2021-03-10T14:41:31.083871+0000 mgr.gibba043.dnkmem (mgr.34373) 2699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:32.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:32 gibba003 bash[32348]: cephadm 2021-03-10T14:41:31.083871+0000 mgr.gibba043.dnkmem (mgr.34373) 2699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:32 gibba043 bash[24019]: cephadm 2021-03-10T14:41:31.083871+0000 mgr.gibba043.dnkmem (mgr.34373) 2699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:33 gibba003 bash[31385]: cluster 2021-03-10T14:41:31.267802+0000 mgr.gibba043.dnkmem (mgr.34373) 2700 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:33 gibba003 bash[32348]: cluster 2021-03-10T14:41:31.267802+0000 mgr.gibba043.dnkmem (mgr.34373) 2700 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:33 gibba043 bash[24019]: cluster 2021-03-10T14:41:31.267802+0000 mgr.gibba043.dnkmem (mgr.34373) 2700 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:35 gibba003 bash[31385]: cluster 2021-03-10T14:41:33.269320+0000 mgr.gibba043.dnkmem (mgr.34373) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:35 gibba003 bash[32348]: cluster 2021-03-10T14:41:33.269320+0000 mgr.gibba043.dnkmem (mgr.34373) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:35 gibba043 bash[24019]: cluster 2021-03-10T14:41:33.269320+0000 mgr.gibba043.dnkmem (mgr.34373) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:37 gibba003 bash[31385]: cluster 2021-03-10T14:41:35.270816+0000 mgr.gibba043.dnkmem (mgr.34373) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:37 gibba003 bash[32348]: cluster 2021-03-10T14:41:35.270816+0000 mgr.gibba043.dnkmem (mgr.34373) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:37 gibba043 bash[24019]: cluster 2021-03-10T14:41:35.270816+0000 mgr.gibba043.dnkmem (mgr.34373) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:39 gibba003 bash[31385]: cluster 2021-03-10T14:41:37.272305+0000 mgr.gibba043.dnkmem (mgr.34373) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:39 gibba003 bash[32348]: cluster 2021-03-10T14:41:37.272305+0000 mgr.gibba043.dnkmem (mgr.34373) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:39 gibba043 bash[24019]: cluster 2021-03-10T14:41:37.272305+0000 mgr.gibba043.dnkmem (mgr.34373) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:41 gibba003 bash[31385]: cluster 2021-03-10T14:41:39.272813+0000 mgr.gibba043.dnkmem (mgr.34373) 2704 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:41 gibba003 bash[32348]: cluster 2021-03-10T14:41:39.272813+0000 mgr.gibba043.dnkmem (mgr.34373) 2704 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:41 gibba043 bash[24019]: cluster 2021-03-10T14:41:39.272813+0000 mgr.gibba043.dnkmem (mgr.34373) 2704 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:43.293 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:41:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:43 gibba003 bash[31385]: cluster 2021-03-10T14:41:41.274558+0000 mgr.gibba043.dnkmem (mgr.34373) 2705 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:43.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:43 gibba003 bash[32348]: cluster 2021-03-10T14:41:41.274558+0000 mgr.gibba043.dnkmem (mgr.34373) 2705 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:43 gibba043 bash[24019]: cluster 2021-03-10T14:41:41.274558+0000 mgr.gibba043.dnkmem (mgr.34373) 2705 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:43.523 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:41:43.524 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (50m) 5m ago 55m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:41:43.524 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:41:43.524 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:41:43.524 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:41:43.525 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:41:43.525 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:41:43.525 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:41:43.525 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:41:43.525 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:41:43.526 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:41:43.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:41:43.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:41:43.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:41:43.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:41:43.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:41:43.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:41:43.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:41:43.528 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:41:43.528 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (54m) 4m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:41:43.528 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:41:43.773 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:41:43.774 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:41:43.774 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:43.774 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:41:43.774 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:41:43.775 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:43.775 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:41:43.775 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:41:43.775 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:41:43.775 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:41:43.776 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:41:43.776 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:41:43.776 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:41:43.776 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:41:43.776 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:41:44.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:44 gibba003 bash[31385]: audit 2021-03-10T14:41:43.773986+0000 mon.c (mon.1) 736 : audit [DBG] from='client.? 172.21.2.103:0/3443311352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:44 gibba003 bash[32348]: audit 2021-03-10T14:41:43.773986+0000 mon.c (mon.1) 736 : audit [DBG] from='client.? 172.21.2.103:0/3443311352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:44 gibba043 bash[24019]: audit 2021-03-10T14:41:43.773986+0000 mon.c (mon.1) 736 : audit [DBG] from='client.? 172.21.2.103:0/3443311352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:45 gibba003 bash[31385]: cluster 2021-03-10T14:41:43.276277+0000 mgr.gibba043.dnkmem (mgr.34373) 2706 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:45 gibba003 bash[31385]: audit 2021-03-10T14:41:43.282152+0000 mgr.gibba043.dnkmem (mgr.34373) 2707 : audit [DBG] from='client.55858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:45 gibba003 bash[31385]: audit 2021-03-10T14:41:43.509755+0000 mgr.gibba043.dnkmem (mgr.34373) 2708 : audit [DBG] from='client.55864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:45 gibba003 bash[32348]: cluster 2021-03-10T14:41:43.276277+0000 mgr.gibba043.dnkmem (mgr.34373) 2706 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:45 gibba003 bash[32348]: audit 2021-03-10T14:41:43.282152+0000 mgr.gibba043.dnkmem (mgr.34373) 2707 : audit [DBG] from='client.55858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:45.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:45 gibba003 bash[32348]: audit 2021-03-10T14:41:43.509755+0000 mgr.gibba043.dnkmem (mgr.34373) 2708 : audit [DBG] from='client.55864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:45 gibba043 bash[24019]: cluster 2021-03-10T14:41:43.276277+0000 mgr.gibba043.dnkmem (mgr.34373) 2706 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:45 gibba043 bash[24019]: audit 2021-03-10T14:41:43.282152+0000 mgr.gibba043.dnkmem (mgr.34373) 2707 : audit [DBG] from='client.55858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:45 gibba043 bash[24019]: audit 2021-03-10T14:41:43.509755+0000 mgr.gibba043.dnkmem (mgr.34373) 2708 : audit [DBG] from='client.55864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:47 gibba003 bash[31385]: cluster 2021-03-10T14:41:45.277591+0000 mgr.gibba043.dnkmem (mgr.34373) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:47 gibba003 bash[31385]: cephadm 2021-03-10T14:41:46.099735+0000 mgr.gibba043.dnkmem (mgr.34373) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:47 gibba003 bash[32348]: cluster 2021-03-10T14:41:45.277591+0000 mgr.gibba043.dnkmem (mgr.34373) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:47 gibba003 bash[32348]: cephadm 2021-03-10T14:41:46.099735+0000 mgr.gibba043.dnkmem (mgr.34373) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:47 gibba043 bash[24019]: cluster 2021-03-10T14:41:45.277591+0000 mgr.gibba043.dnkmem (mgr.34373) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:47 gibba043 bash[24019]: cephadm 2021-03-10T14:41:46.099735+0000 mgr.gibba043.dnkmem (mgr.34373) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:41:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:49 gibba003 bash[31385]: cluster 2021-03-10T14:41:47.278125+0000 mgr.gibba043.dnkmem (mgr.34373) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:49 gibba003 bash[32348]: cluster 2021-03-10T14:41:47.278125+0000 mgr.gibba043.dnkmem (mgr.34373) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:49 gibba043 bash[24019]: cluster 2021-03-10T14:41:47.278125+0000 mgr.gibba043.dnkmem (mgr.34373) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:51 gibba003 bash[31385]: cluster 2021-03-10T14:41:49.279616+0000 mgr.gibba043.dnkmem (mgr.34373) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:51 gibba003 bash[32348]: cluster 2021-03-10T14:41:49.279616+0000 mgr.gibba043.dnkmem (mgr.34373) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:51 gibba043 bash[24019]: cluster 2021-03-10T14:41:49.279616+0000 mgr.gibba043.dnkmem (mgr.34373) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:53 gibba003 bash[31385]: cluster 2021-03-10T14:41:51.281529+0000 mgr.gibba043.dnkmem (mgr.34373) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:53 gibba003 bash[32348]: cluster 2021-03-10T14:41:51.281529+0000 mgr.gibba043.dnkmem (mgr.34373) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:53 gibba043 bash[24019]: cluster 2021-03-10T14:41:51.281529+0000 mgr.gibba043.dnkmem (mgr.34373) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:55 gibba003 bash[31385]: cluster 2021-03-10T14:41:53.283101+0000 mgr.gibba043.dnkmem (mgr.34373) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:55 gibba003 bash[32348]: cluster 2021-03-10T14:41:53.283101+0000 mgr.gibba043.dnkmem (mgr.34373) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:55 gibba043 bash[24019]: cluster 2021-03-10T14:41:53.283101+0000 mgr.gibba043.dnkmem (mgr.34373) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:57 gibba003 bash[31385]: cluster 2021-03-10T14:41:55.283733+0000 mgr.gibba043.dnkmem (mgr.34373) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:57 gibba003 bash[32348]: cluster 2021-03-10T14:41:55.283733+0000 mgr.gibba043.dnkmem (mgr.34373) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:57 gibba043 bash[24019]: cluster 2021-03-10T14:41:55.283733+0000 mgr.gibba043.dnkmem (mgr.34373) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:41:59 gibba003 bash[31385]: cluster 2021-03-10T14:41:57.285076+0000 mgr.gibba043.dnkmem (mgr.34373) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:41:59 gibba003 bash[32348]: cluster 2021-03-10T14:41:57.285076+0000 mgr.gibba043.dnkmem (mgr.34373) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:41:59 gibba043 bash[24019]: cluster 2021-03-10T14:41:57.285076+0000 mgr.gibba043.dnkmem (mgr.34373) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:00 gibba003 bash[31385]: cluster 2021-03-10T14:41:59.286486+0000 mgr.gibba043.dnkmem (mgr.34373) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:00.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:00 gibba003 bash[32348]: cluster 2021-03-10T14:41:59.286486+0000 mgr.gibba043.dnkmem (mgr.34373) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:00.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:00 gibba043 bash[24019]: cluster 2021-03-10T14:41:59.286486+0000 mgr.gibba043.dnkmem (mgr.34373) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:02.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:02 gibba003 bash[31385]: cephadm 2021-03-10T14:42:01.113377+0000 mgr.gibba043.dnkmem (mgr.34373) 2718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:02.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:02 gibba003 bash[31385]: cluster 2021-03-10T14:42:01.288206+0000 mgr.gibba043.dnkmem (mgr.34373) 2719 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:02.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:02 gibba003 bash[32348]: cephadm 2021-03-10T14:42:01.113377+0000 mgr.gibba043.dnkmem (mgr.34373) 2718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:02.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:02 gibba003 bash[32348]: cluster 2021-03-10T14:42:01.288206+0000 mgr.gibba043.dnkmem (mgr.34373) 2719 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:02.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:02 gibba043 bash[24019]: cephadm 2021-03-10T14:42:01.113377+0000 mgr.gibba043.dnkmem (mgr.34373) 2718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:02.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:02 gibba043 bash[24019]: cluster 2021-03-10T14:42:01.288206+0000 mgr.gibba043.dnkmem (mgr.34373) 2719 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:05 gibba003 bash[32348]: cluster 2021-03-10T14:42:03.289771+0000 mgr.gibba043.dnkmem (mgr.34373) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:05 gibba003 bash[31385]: cluster 2021-03-10T14:42:03.289771+0000 mgr.gibba043.dnkmem (mgr.34373) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:05 gibba043 bash[24019]: cluster 2021-03-10T14:42:03.289771+0000 mgr.gibba043.dnkmem (mgr.34373) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:07 gibba003 bash[31385]: cluster 2021-03-10T14:42:05.291040+0000 mgr.gibba043.dnkmem (mgr.34373) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:07 gibba003 bash[32348]: cluster 2021-03-10T14:42:05.291040+0000 mgr.gibba043.dnkmem (mgr.34373) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:07 gibba043 bash[24019]: cluster 2021-03-10T14:42:05.291040+0000 mgr.gibba043.dnkmem (mgr.34373) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:09 gibba003 bash[31385]: cluster 2021-03-10T14:42:07.293766+0000 mgr.gibba043.dnkmem (mgr.34373) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:09.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:09 gibba003 bash[32348]: cluster 2021-03-10T14:42:07.293766+0000 mgr.gibba043.dnkmem (mgr.34373) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:09 gibba043 bash[24019]: cluster 2021-03-10T14:42:07.293766+0000 mgr.gibba043.dnkmem (mgr.34373) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:11 gibba003 bash[31385]: cluster 2021-03-10T14:42:09.295229+0000 mgr.gibba043.dnkmem (mgr.34373) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:11 gibba003 bash[32348]: cluster 2021-03-10T14:42:09.295229+0000 mgr.gibba043.dnkmem (mgr.34373) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:11 gibba043 bash[24019]: cluster 2021-03-10T14:42:09.295229+0000 mgr.gibba043.dnkmem (mgr.34373) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: cluster 2021-03-10T14:42:11.296228+0000 mgr.gibba043.dnkmem (mgr.34373) 2724 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.025058+0000 mon.c (mon.1) 737 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.026236+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.061293+0000 mon.c (mon.1) 738 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:42:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.062069+0000 mon.c (mon.1) 739 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.062633+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:42:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.062781+0000 mon.c (mon.1) 740 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.063525+0000 mon.c (mon.1) 741 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:42:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.064852+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.066418+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[31385]: audit 2021-03-10T14:42:13.067627+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:42:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: cluster 2021-03-10T14:42:11.296228+0000 mgr.gibba043.dnkmem (mgr.34373) 2724 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.025058+0000 mon.c (mon.1) 737 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.026236+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.061293+0000 mon.c (mon.1) 738 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:42:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.062069+0000 mon.c (mon.1) 739 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.062633+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:42:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.062781+0000 mon.c (mon.1) 740 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.063525+0000 mon.c (mon.1) 741 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:42:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.064852+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.066418+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:13 gibba003 bash[32348]: audit 2021-03-10T14:42:13.067627+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:42:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: cluster 2021-03-10T14:42:11.296228+0000 mgr.gibba043.dnkmem (mgr.34373) 2724 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.025058+0000 mon.c (mon.1) 737 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.026236+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.061293+0000 mon.c (mon.1) 738 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:42:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.062069+0000 mon.c (mon.1) 739 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.062633+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:42:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.062781+0000 mon.c (mon.1) 740 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.063525+0000 mon.c (mon.1) 741 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:42:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.064852+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.066418+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:13 gibba043 bash[24019]: audit 2021-03-10T14:42:13.067627+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:42:14.017 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:42:14.247 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:42:14.248 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (50m) 6m ago 55m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:42:14.248 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:42:14.248 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (50m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:42:14.248 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (51m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:42:14.248 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:42:14.249 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:42:14.249 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:42:14.249 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:42:14.249 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:42:14.249 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (56m) 4m ago 56m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:42:14.250 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:42:14.250 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:42:14.250 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:42:14.250 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:42:14.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:42:14.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:42:14.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:42:14.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:42:14.251 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (55m) 4m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:42:14.252 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:42:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:14 gibba003 bash[31385]: audit 2021-03-10T14:42:13.115204+0000 mon.c (mon.1) 742 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:14 gibba003 bash[31385]: audit 2021-03-10T14:42:13.118461+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:14.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:14 gibba003 bash[32348]: audit 2021-03-10T14:42:13.115204+0000 mon.c (mon.1) 742 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:14.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:14 gibba003 bash[32348]: audit 2021-03-10T14:42:13.118461+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:14.499 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:42:14.499 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:42:14.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:14.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:42:14.500 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:42:14.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:14.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:42:14.501 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:42:14.501 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:42:14.501 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:42:14.501 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:42:14.501 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:42:14.502 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:42:14.502 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:42:14.502 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:42:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:14 gibba043 bash[24019]: audit 2021-03-10T14:42:13.115204+0000 mon.c (mon.1) 742 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:14 gibba043 bash[24019]: audit 2021-03-10T14:42:13.118461+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[31385]: cluster 2021-03-10T14:42:13.297732+0000 mgr.gibba043.dnkmem (mgr.34373) 2725 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[31385]: audit 2021-03-10T14:42:14.006597+0000 mgr.gibba043.dnkmem (mgr.34373) 2726 : audit [DBG] from='client.45891 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[31385]: audit 2021-03-10T14:42:14.233460+0000 mgr.gibba043.dnkmem (mgr.34373) 2727 : audit [DBG] from='client.55882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[31385]: audit 2021-03-10T14:42:14.500212+0000 mon.c (mon.1) 743 : audit [DBG] from='client.? 172.21.2.103:0/2581534849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[32348]: cluster 2021-03-10T14:42:13.297732+0000 mgr.gibba043.dnkmem (mgr.34373) 2725 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[32348]: audit 2021-03-10T14:42:14.006597+0000 mgr.gibba043.dnkmem (mgr.34373) 2726 : audit [DBG] from='client.45891 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[32348]: audit 2021-03-10T14:42:14.233460+0000 mgr.gibba043.dnkmem (mgr.34373) 2727 : audit [DBG] from='client.55882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:15 gibba003 bash[32348]: audit 2021-03-10T14:42:14.500212+0000 mon.c (mon.1) 743 : audit [DBG] from='client.? 172.21.2.103:0/2581534849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:15 gibba043 bash[24019]: cluster 2021-03-10T14:42:13.297732+0000 mgr.gibba043.dnkmem (mgr.34373) 2725 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:15 gibba043 bash[24019]: audit 2021-03-10T14:42:14.006597+0000 mgr.gibba043.dnkmem (mgr.34373) 2726 : audit [DBG] from='client.45891 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:15 gibba043 bash[24019]: audit 2021-03-10T14:42:14.233460+0000 mgr.gibba043.dnkmem (mgr.34373) 2727 : audit [DBG] from='client.55882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:15 gibba043 bash[24019]: audit 2021-03-10T14:42:14.500212+0000 mon.c (mon.1) 743 : audit [DBG] from='client.? 172.21.2.103:0/2581534849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:16.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:16 gibba003 bash[31385]: cluster 2021-03-10T14:42:15.299187+0000 mgr.gibba043.dnkmem (mgr.34373) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:16.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:16 gibba003 bash[32348]: cluster 2021-03-10T14:42:15.299187+0000 mgr.gibba043.dnkmem (mgr.34373) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:16 gibba043 bash[24019]: cluster 2021-03-10T14:42:15.299187+0000 mgr.gibba043.dnkmem (mgr.34373) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.130207+0000 mgr.gibba043.dnkmem (mgr.34373) 2729 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:42:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.130964+0000 mgr.gibba043.dnkmem (mgr.34373) 2730 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:42:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.341100+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:42:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.341724+0000 mgr.gibba043.dnkmem (mgr.34373) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:42:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.343696+0000 mgr.gibba043.dnkmem (mgr.34373) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:42:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.345032+0000 mon.c (mon.1) 744 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.345279+0000 mgr.gibba043.dnkmem (mgr.34373) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:42:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.345344+0000 mgr.gibba043.dnkmem (mgr.34373) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:42:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.346711+0000 mon.c (mon.1) 745 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.346811+0000 mgr.gibba043.dnkmem (mgr.34373) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:42:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.346890+0000 mgr.gibba043.dnkmem (mgr.34373) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:42:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.348046+0000 mgr.gibba043.dnkmem (mgr.34373) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:42:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.348437+0000 mon.c (mon.1) 746 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.349619+0000 mgr.gibba043.dnkmem (mgr.34373) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:42:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.349655+0000 mgr.gibba043.dnkmem (mgr.34373) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:42:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.349791+0000 mon.c (mon.1) 747 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.350847+0000 mgr.gibba043.dnkmem (mgr.34373) 2740 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:42:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.351160+0000 mgr.gibba043.dnkmem (mgr.34373) 2741 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:42:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.352273+0000 mgr.gibba043.dnkmem (mgr.34373) 2742 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:42:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.352310+0000 mgr.gibba043.dnkmem (mgr.34373) 2743 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:42:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: cephadm 2021-03-10T14:42:16.352417+0000 mgr.gibba043.dnkmem (mgr.34373) 2744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.352658+0000 mon.c (mon.1) 748 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[32348]: audit 2021-03-10T14:42:16.353955+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.130207+0000 mgr.gibba043.dnkmem (mgr.34373) 2729 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:42:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.130964+0000 mgr.gibba043.dnkmem (mgr.34373) 2730 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:42:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.341100+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:42:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.341724+0000 mgr.gibba043.dnkmem (mgr.34373) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:42:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.343696+0000 mgr.gibba043.dnkmem (mgr.34373) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:42:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.345032+0000 mon.c (mon.1) 744 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.345279+0000 mgr.gibba043.dnkmem (mgr.34373) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:42:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.345344+0000 mgr.gibba043.dnkmem (mgr.34373) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:42:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.346711+0000 mon.c (mon.1) 745 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.346811+0000 mgr.gibba043.dnkmem (mgr.34373) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:42:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.346890+0000 mgr.gibba043.dnkmem (mgr.34373) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:42:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.348046+0000 mgr.gibba043.dnkmem (mgr.34373) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:42:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.348437+0000 mon.c (mon.1) 746 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.349619+0000 mgr.gibba043.dnkmem (mgr.34373) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:42:17.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.349655+0000 mgr.gibba043.dnkmem (mgr.34373) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:42:17.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.349791+0000 mon.c (mon.1) 747 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.350847+0000 mgr.gibba043.dnkmem (mgr.34373) 2740 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:42:17.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.351160+0000 mgr.gibba043.dnkmem (mgr.34373) 2741 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:42:17.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.352273+0000 mgr.gibba043.dnkmem (mgr.34373) 2742 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:42:17.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.352310+0000 mgr.gibba043.dnkmem (mgr.34373) 2743 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:42:17.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: cephadm 2021-03-10T14:42:16.352417+0000 mgr.gibba043.dnkmem (mgr.34373) 2744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:17.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.352658+0000 mon.c (mon.1) 748 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:17 gibba003 bash[31385]: audit 2021-03-10T14:42:16.353955+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.130207+0000 mgr.gibba043.dnkmem (mgr.34373) 2729 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:42:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.130964+0000 mgr.gibba043.dnkmem (mgr.34373) 2730 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:42:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.341100+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:42:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.341724+0000 mgr.gibba043.dnkmem (mgr.34373) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:42:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.343696+0000 mgr.gibba043.dnkmem (mgr.34373) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:42:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.345032+0000 mon.c (mon.1) 744 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.345279+0000 mgr.gibba043.dnkmem (mgr.34373) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:42:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.345344+0000 mgr.gibba043.dnkmem (mgr.34373) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:42:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.346711+0000 mon.c (mon.1) 745 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.346811+0000 mgr.gibba043.dnkmem (mgr.34373) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:42:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.346890+0000 mgr.gibba043.dnkmem (mgr.34373) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:42:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.348046+0000 mgr.gibba043.dnkmem (mgr.34373) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:42:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.348437+0000 mon.c (mon.1) 746 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.349619+0000 mgr.gibba043.dnkmem (mgr.34373) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:42:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.349655+0000 mgr.gibba043.dnkmem (mgr.34373) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:42:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.349791+0000 mon.c (mon.1) 747 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.350847+0000 mgr.gibba043.dnkmem (mgr.34373) 2740 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:42:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.351160+0000 mgr.gibba043.dnkmem (mgr.34373) 2741 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:42:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.352273+0000 mgr.gibba043.dnkmem (mgr.34373) 2742 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:42:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.352310+0000 mgr.gibba043.dnkmem (mgr.34373) 2743 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:42:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: cephadm 2021-03-10T14:42:16.352417+0000 mgr.gibba043.dnkmem (mgr.34373) 2744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.352658+0000 mon.c (mon.1) 748 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:17.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:17 gibba043 bash[24019]: audit 2021-03-10T14:42:16.353955+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:19 gibba003 bash[31385]: cluster 2021-03-10T14:42:17.299972+0000 mgr.gibba043.dnkmem (mgr.34373) 2745 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:19 gibba003 bash[32348]: cluster 2021-03-10T14:42:17.299972+0000 mgr.gibba043.dnkmem (mgr.34373) 2745 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:19 gibba043 bash[24019]: cluster 2021-03-10T14:42:17.299972+0000 mgr.gibba043.dnkmem (mgr.34373) 2745 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:21 gibba003 bash[31385]: cluster 2021-03-10T14:42:19.301162+0000 mgr.gibba043.dnkmem (mgr.34373) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:21 gibba003 bash[32348]: cluster 2021-03-10T14:42:19.301162+0000 mgr.gibba043.dnkmem (mgr.34373) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:21 gibba043 bash[24019]: cluster 2021-03-10T14:42:19.301162+0000 mgr.gibba043.dnkmem (mgr.34373) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:23 gibba003 bash[31385]: cluster 2021-03-10T14:42:21.302770+0000 mgr.gibba043.dnkmem (mgr.34373) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:23 gibba003 bash[32348]: cluster 2021-03-10T14:42:21.302770+0000 mgr.gibba043.dnkmem (mgr.34373) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:23 gibba043 bash[24019]: cluster 2021-03-10T14:42:21.302770+0000 mgr.gibba043.dnkmem (mgr.34373) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:25 gibba003 bash[31385]: cluster 2021-03-10T14:42:23.304310+0000 mgr.gibba043.dnkmem (mgr.34373) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:25 gibba003 bash[32348]: cluster 2021-03-10T14:42:23.304310+0000 mgr.gibba043.dnkmem (mgr.34373) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:25 gibba043 bash[24019]: cluster 2021-03-10T14:42:23.304310+0000 mgr.gibba043.dnkmem (mgr.34373) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:27 gibba003 bash[31385]: cluster 2021-03-10T14:42:25.305823+0000 mgr.gibba043.dnkmem (mgr.34373) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:27.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:27 gibba003 bash[32348]: cluster 2021-03-10T14:42:25.305823+0000 mgr.gibba043.dnkmem (mgr.34373) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:27 gibba043 bash[24019]: cluster 2021-03-10T14:42:25.305823+0000 mgr.gibba043.dnkmem (mgr.34373) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:29 gibba003 bash[31385]: cluster 2021-03-10T14:42:27.306554+0000 mgr.gibba043.dnkmem (mgr.34373) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:29 gibba003 bash[32348]: cluster 2021-03-10T14:42:27.306554+0000 mgr.gibba043.dnkmem (mgr.34373) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:29 gibba043 bash[24019]: cluster 2021-03-10T14:42:27.306554+0000 mgr.gibba043.dnkmem (mgr.34373) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:30 gibba003 bash[31385]: cluster 2021-03-10T14:42:29.308078+0000 mgr.gibba043.dnkmem (mgr.34373) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:30 gibba003 bash[32348]: cluster 2021-03-10T14:42:29.308078+0000 mgr.gibba043.dnkmem (mgr.34373) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:30 gibba043 bash[24019]: cluster 2021-03-10T14:42:29.308078+0000 mgr.gibba043.dnkmem (mgr.34373) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:32 gibba003 bash[31385]: cluster 2021-03-10T14:42:31.309717+0000 mgr.gibba043.dnkmem (mgr.34373) 2752 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:32 gibba003 bash[31385]: cephadm 2021-03-10T14:42:31.365412+0000 mgr.gibba043.dnkmem (mgr.34373) 2753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:32.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:32 gibba003 bash[32348]: cluster 2021-03-10T14:42:31.309717+0000 mgr.gibba043.dnkmem (mgr.34373) 2752 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:32 gibba003 bash[32348]: cephadm 2021-03-10T14:42:31.365412+0000 mgr.gibba043.dnkmem (mgr.34373) 2753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:32.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:32 gibba043 bash[24019]: cluster 2021-03-10T14:42:31.309717+0000 mgr.gibba043.dnkmem (mgr.34373) 2752 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:32 gibba043 bash[24019]: cephadm 2021-03-10T14:42:31.365412+0000 mgr.gibba043.dnkmem (mgr.34373) 2753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:35 gibba003 bash[31385]: cluster 2021-03-10T14:42:33.311052+0000 mgr.gibba043.dnkmem (mgr.34373) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:35 gibba003 bash[32348]: cluster 2021-03-10T14:42:33.311052+0000 mgr.gibba043.dnkmem (mgr.34373) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:35 gibba043 bash[24019]: cluster 2021-03-10T14:42:33.311052+0000 mgr.gibba043.dnkmem (mgr.34373) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:37 gibba003 bash[31385]: cluster 2021-03-10T14:42:35.311687+0000 mgr.gibba043.dnkmem (mgr.34373) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:37 gibba003 bash[32348]: cluster 2021-03-10T14:42:35.311687+0000 mgr.gibba043.dnkmem (mgr.34373) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:37 gibba043 bash[24019]: cluster 2021-03-10T14:42:35.311687+0000 mgr.gibba043.dnkmem (mgr.34373) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:39 gibba003 bash[31385]: cluster 2021-03-10T14:42:37.312978+0000 mgr.gibba043.dnkmem (mgr.34373) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:39 gibba003 bash[32348]: cluster 2021-03-10T14:42:37.312978+0000 mgr.gibba043.dnkmem (mgr.34373) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:39 gibba043 bash[24019]: cluster 2021-03-10T14:42:37.312978+0000 mgr.gibba043.dnkmem (mgr.34373) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:41 gibba003 bash[31385]: cluster 2021-03-10T14:42:39.314567+0000 mgr.gibba043.dnkmem (mgr.34373) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:41 gibba003 bash[32348]: cluster 2021-03-10T14:42:39.314567+0000 mgr.gibba043.dnkmem (mgr.34373) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:41 gibba043 bash[24019]: cluster 2021-03-10T14:42:39.314567+0000 mgr.gibba043.dnkmem (mgr.34373) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:43 gibba003 bash[31385]: cluster 2021-03-10T14:42:41.315957+0000 mgr.gibba043.dnkmem (mgr.34373) 2758 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:43 gibba003 bash[32348]: cluster 2021-03-10T14:42:41.315957+0000 mgr.gibba043.dnkmem (mgr.34373) 2758 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:43 gibba043 bash[24019]: cluster 2021-03-10T14:42:41.315957+0000 mgr.gibba043.dnkmem (mgr.34373) 2758 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:44 gibba003 bash[31385]: cluster 2021-03-10T14:42:43.316687+0000 mgr.gibba043.dnkmem (mgr.34373) 2759 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:44 gibba003 bash[32348]: cluster 2021-03-10T14:42:43.316687+0000 mgr.gibba043.dnkmem (mgr.34373) 2759 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:44 gibba043 bash[24019]: cluster 2021-03-10T14:42:43.316687+0000 mgr.gibba043.dnkmem (mgr.34373) 2759 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.741 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:42:44.997 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:42:44.997 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (51m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:42:44.997 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:42:44.998 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:42:44.998 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:42:44.998 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:42:44.998 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:42:44.999 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:42:44.999 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:42:44.999 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:42:44.999 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:42:44.999 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:42:45.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:42:45.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:42:45.000 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:42:45.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:42:45.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:42:45.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:42:45.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (46m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:42:45.002 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (55m) 5m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:42:45.002 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:42:45.250 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:42:45.251 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:42:45.251 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:45.251 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:42:45.252 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:42:45.252 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:45.252 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:42:45.252 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:42:45.253 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:42:45.253 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:42:45.253 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:42:45.253 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:42:45.254 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:42:45.254 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:42:45.254 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:42:45.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:45 gibba003 bash[31385]: audit 2021-03-10T14:42:44.729929+0000 mgr.gibba043.dnkmem (mgr.34373) 2760 : audit [DBG] from='client.45909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:45 gibba003 bash[31385]: audit 2021-03-10T14:42:44.956688+0000 mgr.gibba043.dnkmem (mgr.34373) 2761 : audit [DBG] from='client.55900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:45 gibba003 bash[32348]: audit 2021-03-10T14:42:44.729929+0000 mgr.gibba043.dnkmem (mgr.34373) 2760 : audit [DBG] from='client.45909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:45.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:45 gibba003 bash[32348]: audit 2021-03-10T14:42:44.956688+0000 mgr.gibba043.dnkmem (mgr.34373) 2761 : audit [DBG] from='client.55900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:45 gibba043 bash[24019]: audit 2021-03-10T14:42:44.729929+0000 mgr.gibba043.dnkmem (mgr.34373) 2760 : audit [DBG] from='client.45909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:45 gibba043 bash[24019]: audit 2021-03-10T14:42:44.956688+0000 mgr.gibba043.dnkmem (mgr.34373) 2761 : audit [DBG] from='client.55900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:46 gibba003 bash[31385]: audit 2021-03-10T14:42:45.251216+0000 mon.a (mon.0) 878 : audit [DBG] from='client.? 172.21.2.103:0/372494568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:46 gibba003 bash[31385]: cluster 2021-03-10T14:42:45.318137+0000 mgr.gibba043.dnkmem (mgr.34373) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:46.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:46 gibba003 bash[32348]: audit 2021-03-10T14:42:45.251216+0000 mon.a (mon.0) 878 : audit [DBG] from='client.? 172.21.2.103:0/372494568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:46.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:46 gibba003 bash[32348]: cluster 2021-03-10T14:42:45.318137+0000 mgr.gibba043.dnkmem (mgr.34373) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:46 gibba043 bash[24019]: audit 2021-03-10T14:42:45.251216+0000 mon.a (mon.0) 878 : audit [DBG] from='client.? 172.21.2.103:0/372494568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:46 gibba043 bash[24019]: cluster 2021-03-10T14:42:45.318137+0000 mgr.gibba043.dnkmem (mgr.34373) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:47 gibba003 bash[31385]: cephadm 2021-03-10T14:42:46.381313+0000 mgr.gibba043.dnkmem (mgr.34373) 2763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:47 gibba003 bash[32348]: cephadm 2021-03-10T14:42:46.381313+0000 mgr.gibba043.dnkmem (mgr.34373) 2763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:47 gibba043 bash[24019]: cephadm 2021-03-10T14:42:46.381313+0000 mgr.gibba043.dnkmem (mgr.34373) 2763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:42:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:49 gibba003 bash[31385]: cluster 2021-03-10T14:42:47.318733+0000 mgr.gibba043.dnkmem (mgr.34373) 2764 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:49 gibba003 bash[32348]: cluster 2021-03-10T14:42:47.318733+0000 mgr.gibba043.dnkmem (mgr.34373) 2764 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:49 gibba043 bash[24019]: cluster 2021-03-10T14:42:47.318733+0000 mgr.gibba043.dnkmem (mgr.34373) 2764 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:51 gibba003 bash[31385]: cluster 2021-03-10T14:42:49.320163+0000 mgr.gibba043.dnkmem (mgr.34373) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:51 gibba003 bash[32348]: cluster 2021-03-10T14:42:49.320163+0000 mgr.gibba043.dnkmem (mgr.34373) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:51 gibba043 bash[24019]: cluster 2021-03-10T14:42:49.320163+0000 mgr.gibba043.dnkmem (mgr.34373) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:53 gibba003 bash[31385]: cluster 2021-03-10T14:42:51.321761+0000 mgr.gibba043.dnkmem (mgr.34373) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:53 gibba003 bash[32348]: cluster 2021-03-10T14:42:51.321761+0000 mgr.gibba043.dnkmem (mgr.34373) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:53 gibba043 bash[24019]: cluster 2021-03-10T14:42:51.321761+0000 mgr.gibba043.dnkmem (mgr.34373) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:55.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:55 gibba003 bash[31385]: cluster 2021-03-10T14:42:53.323245+0000 mgr.gibba043.dnkmem (mgr.34373) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:55 gibba003 bash[32348]: cluster 2021-03-10T14:42:53.323245+0000 mgr.gibba043.dnkmem (mgr.34373) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:55 gibba043 bash[24019]: cluster 2021-03-10T14:42:53.323245+0000 mgr.gibba043.dnkmem (mgr.34373) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:57 gibba003 bash[31385]: cluster 2021-03-10T14:42:55.324782+0000 mgr.gibba043.dnkmem (mgr.34373) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:57 gibba003 bash[32348]: cluster 2021-03-10T14:42:55.324782+0000 mgr.gibba043.dnkmem (mgr.34373) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:57 gibba043 bash[24019]: cluster 2021-03-10T14:42:55.324782+0000 mgr.gibba043.dnkmem (mgr.34373) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:42:59 gibba003 bash[31385]: cluster 2021-03-10T14:42:57.326434+0000 mgr.gibba043.dnkmem (mgr.34373) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:42:59 gibba003 bash[32348]: cluster 2021-03-10T14:42:57.326434+0000 mgr.gibba043.dnkmem (mgr.34373) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:42:59 gibba043 bash[24019]: cluster 2021-03-10T14:42:57.326434+0000 mgr.gibba043.dnkmem (mgr.34373) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:01.399 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:01 gibba043 bash[24019]: cluster 2021-03-10T14:42:59.327997+0000 mgr.gibba043.dnkmem (mgr.34373) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:01 gibba003 bash[31385]: cluster 2021-03-10T14:42:59.327997+0000 mgr.gibba043.dnkmem (mgr.34373) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:01 gibba003 bash[32348]: cluster 2021-03-10T14:42:59.327997+0000 mgr.gibba043.dnkmem (mgr.34373) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:03 gibba003 bash[31385]: cluster 2021-03-10T14:43:01.329937+0000 mgr.gibba043.dnkmem (mgr.34373) 2771 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:03 gibba003 bash[31385]: cephadm 2021-03-10T14:43:01.397094+0000 mgr.gibba043.dnkmem (mgr.34373) 2772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:03 gibba003 bash[32348]: cluster 2021-03-10T14:43:01.329937+0000 mgr.gibba043.dnkmem (mgr.34373) 2771 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:03 gibba003 bash[32348]: cephadm 2021-03-10T14:43:01.397094+0000 mgr.gibba043.dnkmem (mgr.34373) 2772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:03 gibba043 bash[24019]: cluster 2021-03-10T14:43:01.329937+0000 mgr.gibba043.dnkmem (mgr.34373) 2771 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:03 gibba043 bash[24019]: cephadm 2021-03-10T14:43:01.397094+0000 mgr.gibba043.dnkmem (mgr.34373) 2772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:05 gibba003 bash[31385]: cluster 2021-03-10T14:43:03.331425+0000 mgr.gibba043.dnkmem (mgr.34373) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:05 gibba003 bash[32348]: cluster 2021-03-10T14:43:03.331425+0000 mgr.gibba043.dnkmem (mgr.34373) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:05 gibba043 bash[24019]: cluster 2021-03-10T14:43:03.331425+0000 mgr.gibba043.dnkmem (mgr.34373) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:07 gibba003 bash[31385]: cluster 2021-03-10T14:43:05.332631+0000 mgr.gibba043.dnkmem (mgr.34373) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:07 gibba003 bash[32348]: cluster 2021-03-10T14:43:05.332631+0000 mgr.gibba043.dnkmem (mgr.34373) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:07 gibba043 bash[24019]: cluster 2021-03-10T14:43:05.332631+0000 mgr.gibba043.dnkmem (mgr.34373) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:09 gibba003 bash[31385]: cluster 2021-03-10T14:43:07.333807+0000 mgr.gibba043.dnkmem (mgr.34373) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:09 gibba003 bash[32348]: cluster 2021-03-10T14:43:07.333807+0000 mgr.gibba043.dnkmem (mgr.34373) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:09 gibba043 bash[24019]: cluster 2021-03-10T14:43:07.333807+0000 mgr.gibba043.dnkmem (mgr.34373) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:11 gibba003 bash[32348]: cluster 2021-03-10T14:43:09.335203+0000 mgr.gibba043.dnkmem (mgr.34373) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:11 gibba003 bash[31385]: cluster 2021-03-10T14:43:09.335203+0000 mgr.gibba043.dnkmem (mgr.34373) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:11 gibba043 bash[24019]: cluster 2021-03-10T14:43:09.335203+0000 mgr.gibba043.dnkmem (mgr.34373) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: cluster 2021-03-10T14:43:11.337159+0000 mgr.gibba043.dnkmem (mgr.34373) 2777 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.032108+0000 mon.c (mon.1) 750 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.033170+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.071048+0000 mon.c (mon.1) 751 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:43:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.072008+0000 mon.c (mon.1) 752 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.072244+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:43:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.072869+0000 mon.c (mon.1) 753 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:43:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.073711+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.074045+0000 mon.c (mon.1) 754 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.075028+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:43:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.075364+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.120811+0000 mon.c (mon.1) 755 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:13.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[31385]: audit 2021-03-10T14:43:13.121133+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: cluster 2021-03-10T14:43:11.337159+0000 mgr.gibba043.dnkmem (mgr.34373) 2777 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.032108+0000 mon.c (mon.1) 750 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.033170+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.071048+0000 mon.c (mon.1) 751 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:43:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.072008+0000 mon.c (mon.1) 752 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.072244+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:43:13.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.072869+0000 mon.c (mon.1) 753 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:43:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.073711+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.074045+0000 mon.c (mon.1) 754 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.075028+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:43:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.075364+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.120811+0000 mon.c (mon.1) 755 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:13.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:13 gibba003 bash[32348]: audit 2021-03-10T14:43:13.121133+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: cluster 2021-03-10T14:43:11.337159+0000 mgr.gibba043.dnkmem (mgr.34373) 2777 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.032108+0000 mon.c (mon.1) 750 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.033170+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.071048+0000 mon.c (mon.1) 751 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:43:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.072008+0000 mon.c (mon.1) 752 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.072244+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:43:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.072869+0000 mon.c (mon.1) 753 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:43:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.073711+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.074045+0000 mon.c (mon.1) 754 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.075028+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:43:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.075364+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:43:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.120811+0000 mon.c (mon.1) 755 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:13 gibba043 bash[24019]: audit 2021-03-10T14:43:13.121133+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:15 gibba003 bash[31385]: cluster 2021-03-10T14:43:13.338754+0000 mgr.gibba043.dnkmem (mgr.34373) 2778 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:15 gibba003 bash[32348]: cluster 2021-03-10T14:43:13.338754+0000 mgr.gibba043.dnkmem (mgr.34373) 2778 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.497 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:43:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:15 gibba043 bash[24019]: cluster 2021-03-10T14:43:13.338754+0000 mgr.gibba043.dnkmem (mgr.34373) 2778 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.725 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:43:15.725 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (51m) 7m ago 56m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:43:15.725 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (56m) 6m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:43:15.726 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (51m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:43:15.726 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:43:15.726 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:43:15.726 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:43:15.727 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:43:15.727 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:43:15.727 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:43:15.727 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:43:15.727 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:43:15.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:43:15.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:43:15.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:43:15.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:43:15.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:43:15.729 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:43:15.729 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (46m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:43:15.729 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (56m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:43:15.729 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:43:15.974 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:43:15.974 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:43:15.974 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:15.975 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:43:15.975 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:43:15.975 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:15.975 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:43:15.976 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:43:15.976 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:43:15.976 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:43:15.976 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:43:15.976 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:43:15.977 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:43:15.977 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:43:15.977 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:43:16.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[31385]: cluster 2021-03-10T14:43:15.339660+0000 mgr.gibba043.dnkmem (mgr.34373) 2779 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:16.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[31385]: audit 2021-03-10T14:43:15.486531+0000 mgr.gibba043.dnkmem (mgr.34373) 2780 : audit [DBG] from='client.45927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[31385]: audit 2021-03-10T14:43:15.711235+0000 mgr.gibba043.dnkmem (mgr.34373) 2781 : audit [DBG] from='client.45933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[31385]: audit 2021-03-10T14:43:15.974622+0000 mon.a (mon.0) 885 : audit [DBG] from='client.? 172.21.2.103:0/962301605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[32348]: cluster 2021-03-10T14:43:15.339660+0000 mgr.gibba043.dnkmem (mgr.34373) 2779 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[32348]: audit 2021-03-10T14:43:15.486531+0000 mgr.gibba043.dnkmem (mgr.34373) 2780 : audit [DBG] from='client.45927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[32348]: audit 2021-03-10T14:43:15.711235+0000 mgr.gibba043.dnkmem (mgr.34373) 2781 : audit [DBG] from='client.45933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:16 gibba003 bash[32348]: audit 2021-03-10T14:43:15.974622+0000 mon.a (mon.0) 885 : audit [DBG] from='client.? 172.21.2.103:0/962301605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:16 gibba043 bash[24019]: cluster 2021-03-10T14:43:15.339660+0000 mgr.gibba043.dnkmem (mgr.34373) 2779 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:16 gibba043 bash[24019]: audit 2021-03-10T14:43:15.486531+0000 mgr.gibba043.dnkmem (mgr.34373) 2780 : audit [DBG] from='client.45927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:16 gibba043 bash[24019]: audit 2021-03-10T14:43:15.711235+0000 mgr.gibba043.dnkmem (mgr.34373) 2781 : audit [DBG] from='client.45933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:16 gibba043 bash[24019]: audit 2021-03-10T14:43:15.974622+0000 mon.a (mon.0) 885 : audit [DBG] from='client.? 172.21.2.103:0/962301605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.614368+0000 mgr.gibba043.dnkmem (mgr.34373) 2782 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:43:17.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.615822+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:17.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.620619+0000 mgr.gibba043.dnkmem (mgr.34373) 2783 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:43:17.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.622086+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:17.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.816686+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.817414+0000 mgr.gibba043.dnkmem (mgr.34373) 2784 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.819132+0000 mgr.gibba043.dnkmem (mgr.34373) 2785 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.820527+0000 mon.c (mon.1) 756 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.820621+0000 mgr.gibba043.dnkmem (mgr.34373) 2786 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.820657+0000 mgr.gibba043.dnkmem (mgr.34373) 2787 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.821956+0000 mon.c (mon.1) 757 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.821981+0000 mgr.gibba043.dnkmem (mgr.34373) 2788 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.822019+0000 mgr.gibba043.dnkmem (mgr.34373) 2789 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.823226+0000 mgr.gibba043.dnkmem (mgr.34373) 2790 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.823506+0000 mon.c (mon.1) 758 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.824739+0000 mgr.gibba043.dnkmem (mgr.34373) 2791 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.824775+0000 mgr.gibba043.dnkmem (mgr.34373) 2792 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.824792+0000 mon.c (mon.1) 759 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.826293+0000 mgr.gibba043.dnkmem (mgr.34373) 2793 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:17.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.826598+0000 mgr.gibba043.dnkmem (mgr.34373) 2794 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:17.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.827672+0000 mon.c (mon.1) 760 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.614368+0000 mgr.gibba043.dnkmem (mgr.34373) 2782 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:43:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.615822+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.620619+0000 mgr.gibba043.dnkmem (mgr.34373) 2783 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:43:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.622086+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.816686+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.817414+0000 mgr.gibba043.dnkmem (mgr.34373) 2784 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.819132+0000 mgr.gibba043.dnkmem (mgr.34373) 2785 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.820527+0000 mon.c (mon.1) 756 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.820621+0000 mgr.gibba043.dnkmem (mgr.34373) 2786 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.820657+0000 mgr.gibba043.dnkmem (mgr.34373) 2787 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.821956+0000 mon.c (mon.1) 757 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.821981+0000 mgr.gibba043.dnkmem (mgr.34373) 2788 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.822019+0000 mgr.gibba043.dnkmem (mgr.34373) 2789 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.823226+0000 mgr.gibba043.dnkmem (mgr.34373) 2790 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.823506+0000 mon.c (mon.1) 758 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.824739+0000 mgr.gibba043.dnkmem (mgr.34373) 2791 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:17.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.824775+0000 mgr.gibba043.dnkmem (mgr.34373) 2792 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:17.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.824792+0000 mon.c (mon.1) 759 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.826293+0000 mgr.gibba043.dnkmem (mgr.34373) 2793 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:17.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.826598+0000 mgr.gibba043.dnkmem (mgr.34373) 2794 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:17.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.827672+0000 mon.c (mon.1) 760 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.827985+0000 mgr.gibba043.dnkmem (mgr.34373) 2795 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:17.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.828019+0000 mgr.gibba043.dnkmem (mgr.34373) 2796 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:17.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: cephadm 2021-03-10T14:43:16.828118+0000 mgr.gibba043.dnkmem (mgr.34373) 2797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:17.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[31385]: audit 2021-03-10T14:43:16.829323+0000 mon.c (mon.1) 761 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:17.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.827985+0000 mgr.gibba043.dnkmem (mgr.34373) 2795 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:17.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.828019+0000 mgr.gibba043.dnkmem (mgr.34373) 2796 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:17.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: cephadm 2021-03-10T14:43:16.828118+0000 mgr.gibba043.dnkmem (mgr.34373) 2797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:17.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:17 gibba003 bash[32348]: audit 2021-03-10T14:43:16.829323+0000 mon.c (mon.1) 761 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.614368+0000 mgr.gibba043.dnkmem (mgr.34373) 2782 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:43:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.615822+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.620619+0000 mgr.gibba043.dnkmem (mgr.34373) 2783 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:43:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.622086+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.816686+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:43:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.817414+0000 mgr.gibba043.dnkmem (mgr.34373) 2784 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.819132+0000 mgr.gibba043.dnkmem (mgr.34373) 2785 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.820527+0000 mon.c (mon.1) 756 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.820621+0000 mgr.gibba043.dnkmem (mgr.34373) 2786 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.820657+0000 mgr.gibba043.dnkmem (mgr.34373) 2787 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:18.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.821956+0000 mon.c (mon.1) 757 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:18.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.821981+0000 mgr.gibba043.dnkmem (mgr.34373) 2788 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:18.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.822019+0000 mgr.gibba043.dnkmem (mgr.34373) 2789 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:18.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.823226+0000 mgr.gibba043.dnkmem (mgr.34373) 2790 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:18.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.823506+0000 mon.c (mon.1) 758 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:18.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.824739+0000 mgr.gibba043.dnkmem (mgr.34373) 2791 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:18.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.824775+0000 mgr.gibba043.dnkmem (mgr.34373) 2792 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:18.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.824792+0000 mon.c (mon.1) 759 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:18.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.826293+0000 mgr.gibba043.dnkmem (mgr.34373) 2793 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:18.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.826598+0000 mgr.gibba043.dnkmem (mgr.34373) 2794 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:18.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.827672+0000 mon.c (mon.1) 760 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:18.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.827985+0000 mgr.gibba043.dnkmem (mgr.34373) 2795 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:18.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.828019+0000 mgr.gibba043.dnkmem (mgr.34373) 2796 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:18.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: cephadm 2021-03-10T14:43:16.828118+0000 mgr.gibba043.dnkmem (mgr.34373) 2797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:18.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:17 gibba043 bash[24019]: audit 2021-03-10T14:43:16.829323+0000 mon.c (mon.1) 761 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:19 gibba003 bash[31385]: cluster 2021-03-10T14:43:17.340522+0000 mgr.gibba043.dnkmem (mgr.34373) 2798 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:19 gibba003 bash[32348]: cluster 2021-03-10T14:43:17.340522+0000 mgr.gibba043.dnkmem (mgr.34373) 2798 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:19 gibba043 bash[24019]: cluster 2021-03-10T14:43:17.340522+0000 mgr.gibba043.dnkmem (mgr.34373) 2798 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:21 gibba003 bash[31385]: cluster 2021-03-10T14:43:19.341873+0000 mgr.gibba043.dnkmem (mgr.34373) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:21 gibba003 bash[32348]: cluster 2021-03-10T14:43:19.341873+0000 mgr.gibba043.dnkmem (mgr.34373) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:21 gibba043 bash[24019]: cluster 2021-03-10T14:43:19.341873+0000 mgr.gibba043.dnkmem (mgr.34373) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:23 gibba003 bash[31385]: cluster 2021-03-10T14:43:21.343487+0000 mgr.gibba043.dnkmem (mgr.34373) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:23 gibba003 bash[32348]: cluster 2021-03-10T14:43:21.343487+0000 mgr.gibba043.dnkmem (mgr.34373) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:23 gibba043 bash[24019]: cluster 2021-03-10T14:43:21.343487+0000 mgr.gibba043.dnkmem (mgr.34373) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:25 gibba003 bash[31385]: cluster 2021-03-10T14:43:23.344610+0000 mgr.gibba043.dnkmem (mgr.34373) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:25 gibba003 bash[32348]: cluster 2021-03-10T14:43:23.344610+0000 mgr.gibba043.dnkmem (mgr.34373) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:25 gibba043 bash[24019]: cluster 2021-03-10T14:43:23.344610+0000 mgr.gibba043.dnkmem (mgr.34373) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:26 gibba003 bash[31385]: cluster 2021-03-10T14:43:25.345776+0000 mgr.gibba043.dnkmem (mgr.34373) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:26 gibba003 bash[32348]: cluster 2021-03-10T14:43:25.345776+0000 mgr.gibba043.dnkmem (mgr.34373) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:26 gibba043 bash[24019]: cluster 2021-03-10T14:43:25.345776+0000 mgr.gibba043.dnkmem (mgr.34373) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:29 gibba003 bash[31385]: cluster 2021-03-10T14:43:27.346380+0000 mgr.gibba043.dnkmem (mgr.34373) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:29 gibba003 bash[32348]: cluster 2021-03-10T14:43:27.346380+0000 mgr.gibba043.dnkmem (mgr.34373) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:29 gibba043 bash[24019]: cluster 2021-03-10T14:43:27.346380+0000 mgr.gibba043.dnkmem (mgr.34373) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:31 gibba003 bash[31385]: cluster 2021-03-10T14:43:29.347883+0000 mgr.gibba043.dnkmem (mgr.34373) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:31 gibba003 bash[32348]: cluster 2021-03-10T14:43:29.347883+0000 mgr.gibba043.dnkmem (mgr.34373) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:31 gibba043 bash[24019]: cluster 2021-03-10T14:43:29.347883+0000 mgr.gibba043.dnkmem (mgr.34373) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:33 gibba003 bash[31385]: cluster 2021-03-10T14:43:31.349231+0000 mgr.gibba043.dnkmem (mgr.34373) 2805 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:33 gibba003 bash[31385]: cephadm 2021-03-10T14:43:31.844219+0000 mgr.gibba043.dnkmem (mgr.34373) 2806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:33 gibba003 bash[32348]: cluster 2021-03-10T14:43:31.349231+0000 mgr.gibba043.dnkmem (mgr.34373) 2805 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:33 gibba003 bash[32348]: cephadm 2021-03-10T14:43:31.844219+0000 mgr.gibba043.dnkmem (mgr.34373) 2806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:33 gibba043 bash[24019]: cluster 2021-03-10T14:43:31.349231+0000 mgr.gibba043.dnkmem (mgr.34373) 2805 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:33 gibba043 bash[24019]: cephadm 2021-03-10T14:43:31.844219+0000 mgr.gibba043.dnkmem (mgr.34373) 2806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:35 gibba003 bash[31385]: cluster 2021-03-10T14:43:33.350663+0000 mgr.gibba043.dnkmem (mgr.34373) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:35 gibba003 bash[32348]: cluster 2021-03-10T14:43:33.350663+0000 mgr.gibba043.dnkmem (mgr.34373) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:35 gibba043 bash[24019]: cluster 2021-03-10T14:43:33.350663+0000 mgr.gibba043.dnkmem (mgr.34373) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:36 gibba043 bash[24019]: cluster 2021-03-10T14:43:35.352057+0000 mgr.gibba043.dnkmem (mgr.34373) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:36 gibba003 bash[31385]: cluster 2021-03-10T14:43:35.352057+0000 mgr.gibba043.dnkmem (mgr.34373) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:36.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:36 gibba003 bash[32348]: cluster 2021-03-10T14:43:35.352057+0000 mgr.gibba043.dnkmem (mgr.34373) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:39 gibba003 bash[31385]: cluster 2021-03-10T14:43:37.353029+0000 mgr.gibba043.dnkmem (mgr.34373) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:39 gibba003 bash[32348]: cluster 2021-03-10T14:43:37.353029+0000 mgr.gibba043.dnkmem (mgr.34373) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:39 gibba043 bash[24019]: cluster 2021-03-10T14:43:37.353029+0000 mgr.gibba043.dnkmem (mgr.34373) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:41 gibba003 bash[31385]: cluster 2021-03-10T14:43:39.354413+0000 mgr.gibba043.dnkmem (mgr.34373) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:41 gibba003 bash[32348]: cluster 2021-03-10T14:43:39.354413+0000 mgr.gibba043.dnkmem (mgr.34373) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:41 gibba043 bash[24019]: cluster 2021-03-10T14:43:39.354413+0000 mgr.gibba043.dnkmem (mgr.34373) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:43 gibba003 bash[31385]: cluster 2021-03-10T14:43:41.356209+0000 mgr.gibba043.dnkmem (mgr.34373) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:43 gibba003 bash[32348]: cluster 2021-03-10T14:43:41.356209+0000 mgr.gibba043.dnkmem (mgr.34373) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:43 gibba043 bash[24019]: cluster 2021-03-10T14:43:41.356209+0000 mgr.gibba043.dnkmem (mgr.34373) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:45 gibba003 bash[31385]: cluster 2021-03-10T14:43:43.357567+0000 mgr.gibba043.dnkmem (mgr.34373) 2812 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:45 gibba003 bash[32348]: cluster 2021-03-10T14:43:43.357567+0000 mgr.gibba043.dnkmem (mgr.34373) 2812 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:45 gibba043 bash[24019]: cluster 2021-03-10T14:43:43.357567+0000 mgr.gibba043.dnkmem (mgr.34373) 2812 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:46.218 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:43:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:46 gibba003 bash[31385]: cluster 2021-03-10T14:43:45.358960+0000 mgr.gibba043.dnkmem (mgr.34373) 2813 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:46.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:46 gibba003 bash[32348]: cluster 2021-03-10T14:43:45.358960+0000 mgr.gibba043.dnkmem (mgr.34373) 2813 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:46.445 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:43:46.445 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (52m) 7m ago 57m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:43:46.445 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:43:46.445 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:43:46.446 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:43:46.446 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:43:46.446 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:43:46.446 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:43:46.446 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:43:46.447 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:43:46.447 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:43:46.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:43:46.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:43:46.447 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:43:46.448 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:43:46.448 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:43:46.448 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:43:46.448 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:43:46.448 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:43:46.449 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (56m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:43:46.449 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:43:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:46 gibba043 bash[24019]: cluster 2021-03-10T14:43:45.358960+0000 mgr.gibba043.dnkmem (mgr.34373) 2813 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:46.699 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:43:46.700 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:43:46.700 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:46.700 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:43:46.700 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:43:46.701 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:46.701 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:43:46.701 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:43:46.701 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:43:46.702 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:43:46.702 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:43:46.702 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:43:46.702 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:43:46.703 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:43:46.703 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:43:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[31385]: audit 2021-03-10T14:43:46.207932+0000 mgr.gibba043.dnkmem (mgr.34373) 2814 : audit [DBG] from='client.55930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[31385]: audit 2021-03-10T14:43:46.432917+0000 mgr.gibba043.dnkmem (mgr.34373) 2815 : audit [DBG] from='client.45951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[31385]: audit 2021-03-10T14:43:46.700414+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.103:0/1479369638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[31385]: cephadm 2021-03-10T14:43:46.860364+0000 mgr.gibba043.dnkmem (mgr.34373) 2816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[32348]: audit 2021-03-10T14:43:46.207932+0000 mgr.gibba043.dnkmem (mgr.34373) 2814 : audit [DBG] from='client.55930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[32348]: audit 2021-03-10T14:43:46.432917+0000 mgr.gibba043.dnkmem (mgr.34373) 2815 : audit [DBG] from='client.45951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[32348]: audit 2021-03-10T14:43:46.700414+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.103:0/1479369638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:47 gibba003 bash[32348]: cephadm 2021-03-10T14:43:46.860364+0000 mgr.gibba043.dnkmem (mgr.34373) 2816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:47 gibba043 bash[24019]: audit 2021-03-10T14:43:46.207932+0000 mgr.gibba043.dnkmem (mgr.34373) 2814 : audit [DBG] from='client.55930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:47 gibba043 bash[24019]: audit 2021-03-10T14:43:46.432917+0000 mgr.gibba043.dnkmem (mgr.34373) 2815 : audit [DBG] from='client.45951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:47 gibba043 bash[24019]: audit 2021-03-10T14:43:46.700414+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.103:0/1479369638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:47 gibba043 bash[24019]: cephadm 2021-03-10T14:43:46.860364+0000 mgr.gibba043.dnkmem (mgr.34373) 2816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:43:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:49 gibba003 bash[31385]: cluster 2021-03-10T14:43:47.360114+0000 mgr.gibba043.dnkmem (mgr.34373) 2817 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:49 gibba003 bash[32348]: cluster 2021-03-10T14:43:47.360114+0000 mgr.gibba043.dnkmem (mgr.34373) 2817 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:49 gibba043 bash[24019]: cluster 2021-03-10T14:43:47.360114+0000 mgr.gibba043.dnkmem (mgr.34373) 2817 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:51 gibba003 bash[31385]: cluster 2021-03-10T14:43:49.361699+0000 mgr.gibba043.dnkmem (mgr.34373) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:51 gibba003 bash[32348]: cluster 2021-03-10T14:43:49.361699+0000 mgr.gibba043.dnkmem (mgr.34373) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:51 gibba043 bash[24019]: cluster 2021-03-10T14:43:49.361699+0000 mgr.gibba043.dnkmem (mgr.34373) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:53 gibba003 bash[31385]: cluster 2021-03-10T14:43:51.363444+0000 mgr.gibba043.dnkmem (mgr.34373) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:53.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:53 gibba003 bash[32348]: cluster 2021-03-10T14:43:51.363444+0000 mgr.gibba043.dnkmem (mgr.34373) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:53 gibba043 bash[24019]: cluster 2021-03-10T14:43:51.363444+0000 mgr.gibba043.dnkmem (mgr.34373) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:55 gibba003 bash[31385]: cluster 2021-03-10T14:43:53.365092+0000 mgr.gibba043.dnkmem (mgr.34373) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:55 gibba003 bash[32348]: cluster 2021-03-10T14:43:53.365092+0000 mgr.gibba043.dnkmem (mgr.34373) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:55 gibba043 bash[24019]: cluster 2021-03-10T14:43:53.365092+0000 mgr.gibba043.dnkmem (mgr.34373) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:56 gibba003 bash[31385]: cluster 2021-03-10T14:43:55.366570+0000 mgr.gibba043.dnkmem (mgr.34373) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:56 gibba003 bash[32348]: cluster 2021-03-10T14:43:55.366570+0000 mgr.gibba043.dnkmem (mgr.34373) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:56 gibba043 bash[24019]: cluster 2021-03-10T14:43:55.366570+0000 mgr.gibba043.dnkmem (mgr.34373) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:43:59 gibba003 bash[31385]: cluster 2021-03-10T14:43:57.367532+0000 mgr.gibba043.dnkmem (mgr.34373) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:43:59 gibba003 bash[32348]: cluster 2021-03-10T14:43:57.367532+0000 mgr.gibba043.dnkmem (mgr.34373) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:43:59 gibba043 bash[24019]: cluster 2021-03-10T14:43:57.367532+0000 mgr.gibba043.dnkmem (mgr.34373) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:01 gibba003 bash[31385]: cluster 2021-03-10T14:43:59.369036+0000 mgr.gibba043.dnkmem (mgr.34373) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:01 gibba003 bash[32348]: cluster 2021-03-10T14:43:59.369036+0000 mgr.gibba043.dnkmem (mgr.34373) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:01 gibba043 bash[24019]: cluster 2021-03-10T14:43:59.369036+0000 mgr.gibba043.dnkmem (mgr.34373) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:03 gibba003 bash[31385]: cluster 2021-03-10T14:44:01.370967+0000 mgr.gibba043.dnkmem (mgr.34373) 2824 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:03 gibba003 bash[31385]: cephadm 2021-03-10T14:44:01.872634+0000 mgr.gibba043.dnkmem (mgr.34373) 2825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:03 gibba003 bash[32348]: cluster 2021-03-10T14:44:01.370967+0000 mgr.gibba043.dnkmem (mgr.34373) 2824 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:03 gibba003 bash[32348]: cephadm 2021-03-10T14:44:01.872634+0000 mgr.gibba043.dnkmem (mgr.34373) 2825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:03 gibba043 bash[24019]: cluster 2021-03-10T14:44:01.370967+0000 mgr.gibba043.dnkmem (mgr.34373) 2824 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:03 gibba043 bash[24019]: cephadm 2021-03-10T14:44:01.872634+0000 mgr.gibba043.dnkmem (mgr.34373) 2825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:04 gibba003 bash[31385]: cluster 2021-03-10T14:44:03.372397+0000 mgr.gibba043.dnkmem (mgr.34373) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:04.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:04 gibba003 bash[32348]: cluster 2021-03-10T14:44:03.372397+0000 mgr.gibba043.dnkmem (mgr.34373) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:04 gibba043 bash[24019]: cluster 2021-03-10T14:44:03.372397+0000 mgr.gibba043.dnkmem (mgr.34373) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:06.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:06 gibba003 bash[31385]: cluster 2021-03-10T14:44:05.373909+0000 mgr.gibba043.dnkmem (mgr.34373) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:06.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:06 gibba003 bash[32348]: cluster 2021-03-10T14:44:05.373909+0000 mgr.gibba043.dnkmem (mgr.34373) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:06.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:06 gibba043 bash[24019]: cluster 2021-03-10T14:44:05.373909+0000 mgr.gibba043.dnkmem (mgr.34373) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:09 gibba003 bash[31385]: cluster 2021-03-10T14:44:07.374844+0000 mgr.gibba043.dnkmem (mgr.34373) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:09 gibba003 bash[32348]: cluster 2021-03-10T14:44:07.374844+0000 mgr.gibba043.dnkmem (mgr.34373) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:09 gibba043 bash[24019]: cluster 2021-03-10T14:44:07.374844+0000 mgr.gibba043.dnkmem (mgr.34373) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:10 gibba003 bash[31385]: cluster 2021-03-10T14:44:09.376430+0000 mgr.gibba043.dnkmem (mgr.34373) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:10 gibba003 bash[32348]: cluster 2021-03-10T14:44:09.376430+0000 mgr.gibba043.dnkmem (mgr.34373) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:10 gibba043 bash[24019]: cluster 2021-03-10T14:44:09.376430+0000 mgr.gibba043.dnkmem (mgr.34373) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:12 gibba043 bash[24019]: cluster 2021-03-10T14:44:11.378304+0000 mgr.gibba043.dnkmem (mgr.34373) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:12 gibba003 bash[31385]: cluster 2021-03-10T14:44:11.378304+0000 mgr.gibba043.dnkmem (mgr.34373) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:12 gibba003 bash[32348]: cluster 2021-03-10T14:44:11.378304+0000 mgr.gibba043.dnkmem (mgr.34373) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.039164+0000 mon.c (mon.1) 762 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.040427+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.081034+0000 mon.c (mon.1) 763 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:44:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.082159+0000 mon.c (mon.1) 764 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.082433+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:44:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.083296+0000 mon.c (mon.1) 765 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:44:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.083508+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.084589+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:44:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.084788+0000 mon.c (mon.1) 766 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.085929+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.125037+0000 mon.c (mon.1) 767 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:13 gibba043 bash[24019]: audit 2021-03-10T14:44:13.125539+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.039164+0000 mon.c (mon.1) 762 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.040427+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.081034+0000 mon.c (mon.1) 763 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:44:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.082159+0000 mon.c (mon.1) 764 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.082433+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:44:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.083296+0000 mon.c (mon.1) 765 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:44:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.083508+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.084589+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:44:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.084788+0000 mon.c (mon.1) 766 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.085929+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.125037+0000 mon.c (mon.1) 767 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[31385]: audit 2021-03-10T14:44:13.125539+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.039164+0000 mon.c (mon.1) 762 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.040427+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.081034+0000 mon.c (mon.1) 763 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:44:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.082159+0000 mon.c (mon.1) 764 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.082433+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:44:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.083296+0000 mon.c (mon.1) 765 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:44:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.083508+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.084589+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:44:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.084788+0000 mon.c (mon.1) 766 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.085929+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.125037+0000 mon.c (mon.1) 767 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:13 gibba003 bash[32348]: audit 2021-03-10T14:44:13.125539+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:15 gibba003 bash[31385]: cluster 2021-03-10T14:44:13.379850+0000 mgr.gibba043.dnkmem (mgr.34373) 2831 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:15 gibba003 bash[32348]: cluster 2021-03-10T14:44:13.379850+0000 mgr.gibba043.dnkmem (mgr.34373) 2831 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:15 gibba043 bash[24019]: cluster 2021-03-10T14:44:13.379850+0000 mgr.gibba043.dnkmem (mgr.34373) 2831 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.948 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:44:17.188 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:44:17.189 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (52m) 8m ago 57m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:44:17.189 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (57m) 7m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:44:17.190 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:44:17.190 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:44:17.191 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:44:17.191 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:44:17.191 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:44:17.192 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:44:17.192 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:44:17.193 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:44:17.193 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:44:17.194 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:44:17.194 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:44:17.194 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:44:17.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:44:17.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:44:17.196 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (48m) 7m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:44:17.196 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (47m) 7m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:44:17.196 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (57m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:44:17.197 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:44:17.439 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:44:17.439 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:44:17.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:17.440 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:44:17.440 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:44:17.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:17.441 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:44:17.441 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:44:17.441 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:44:17.441 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:44:17.441 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:44:17.442 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:44:17.442 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:44:17.442 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:44:17.442 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:44:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cluster 2021-03-10T14:44:15.381400+0000 mgr.gibba043.dnkmem (mgr.34373) 2832 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:16.889423+0000 mgr.gibba043.dnkmem (mgr.34373) 2833 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:44:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:16.890732+0000 mgr.gibba043.dnkmem (mgr.34373) 2834 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:44:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:16.938091+0000 mgr.gibba043.dnkmem (mgr.34373) 2835 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.104375+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:44:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.104934+0000 mgr.gibba043.dnkmem (mgr.34373) 2836 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.106552+0000 mgr.gibba043.dnkmem (mgr.34373) 2837 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.107752+0000 mgr.gibba043.dnkmem (mgr.34373) 2838 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.107812+0000 mgr.gibba043.dnkmem (mgr.34373) 2839 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.107890+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.109023+0000 mgr.gibba043.dnkmem (mgr.34373) 2840 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.109080+0000 mgr.gibba043.dnkmem (mgr.34373) 2841 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.109142+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.110174+0000 mgr.gibba043.dnkmem (mgr.34373) 2842 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.110458+0000 mon.c (mon.1) 770 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.111585+0000 mgr.gibba043.dnkmem (mgr.34373) 2843 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.111619+0000 mon.c (mon.1) 771 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.111656+0000 mgr.gibba043.dnkmem (mgr.34373) 2844 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.112851+0000 mgr.gibba043.dnkmem (mgr.34373) 2845 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.113172+0000 mgr.gibba043.dnkmem (mgr.34373) 2846 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:17.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.114201+0000 mgr.gibba043.dnkmem (mgr.34373) 2847 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cluster 2021-03-10T14:44:15.381400+0000 mgr.gibba043.dnkmem (mgr.34373) 2832 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:16.889423+0000 mgr.gibba043.dnkmem (mgr.34373) 2833 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:44:17.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:16.890732+0000 mgr.gibba043.dnkmem (mgr.34373) 2834 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:44:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:16.938091+0000 mgr.gibba043.dnkmem (mgr.34373) 2835 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.104375+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:44:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.104934+0000 mgr.gibba043.dnkmem (mgr.34373) 2836 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.106552+0000 mgr.gibba043.dnkmem (mgr.34373) 2837 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.107752+0000 mgr.gibba043.dnkmem (mgr.34373) 2838 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.107812+0000 mgr.gibba043.dnkmem (mgr.34373) 2839 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.107890+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.109023+0000 mgr.gibba043.dnkmem (mgr.34373) 2840 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.109080+0000 mgr.gibba043.dnkmem (mgr.34373) 2841 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.109142+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.110174+0000 mgr.gibba043.dnkmem (mgr.34373) 2842 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.110458+0000 mon.c (mon.1) 770 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.111585+0000 mgr.gibba043.dnkmem (mgr.34373) 2843 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.111619+0000 mon.c (mon.1) 771 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.111656+0000 mgr.gibba043.dnkmem (mgr.34373) 2844 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.112851+0000 mgr.gibba043.dnkmem (mgr.34373) 2845 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.113172+0000 mgr.gibba043.dnkmem (mgr.34373) 2846 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.114201+0000 mgr.gibba043.dnkmem (mgr.34373) 2847 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:17.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.114258+0000 mgr.gibba043.dnkmem (mgr.34373) 2848 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:17.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: cephadm 2021-03-10T14:44:17.114393+0000 mgr.gibba043.dnkmem (mgr.34373) 2849 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:17.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.114411+0000 mon.c (mon.1) 772 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[31385]: audit 2021-03-10T14:44:17.115712+0000 mon.c (mon.1) 773 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.114258+0000 mgr.gibba043.dnkmem (mgr.34373) 2848 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:17.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: cephadm 2021-03-10T14:44:17.114393+0000 mgr.gibba043.dnkmem (mgr.34373) 2849 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:17.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.114411+0000 mon.c (mon.1) 772 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:17 gibba003 bash[32348]: audit 2021-03-10T14:44:17.115712+0000 mon.c (mon.1) 773 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cluster 2021-03-10T14:44:15.381400+0000 mgr.gibba043.dnkmem (mgr.34373) 2832 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:16.889423+0000 mgr.gibba043.dnkmem (mgr.34373) 2833 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:44:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:16.890732+0000 mgr.gibba043.dnkmem (mgr.34373) 2834 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:44:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:16.938091+0000 mgr.gibba043.dnkmem (mgr.34373) 2835 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.104375+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:44:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.104934+0000 mgr.gibba043.dnkmem (mgr.34373) 2836 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.106552+0000 mgr.gibba043.dnkmem (mgr.34373) 2837 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.107752+0000 mgr.gibba043.dnkmem (mgr.34373) 2838 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.107812+0000 mgr.gibba043.dnkmem (mgr.34373) 2839 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.107890+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.109023+0000 mgr.gibba043.dnkmem (mgr.34373) 2840 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.109080+0000 mgr.gibba043.dnkmem (mgr.34373) 2841 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.109142+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.110174+0000 mgr.gibba043.dnkmem (mgr.34373) 2842 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.110458+0000 mon.c (mon.1) 770 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.111585+0000 mgr.gibba043.dnkmem (mgr.34373) 2843 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.111619+0000 mon.c (mon.1) 771 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.111656+0000 mgr.gibba043.dnkmem (mgr.34373) 2844 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.112851+0000 mgr.gibba043.dnkmem (mgr.34373) 2845 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.113172+0000 mgr.gibba043.dnkmem (mgr.34373) 2846 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.114201+0000 mgr.gibba043.dnkmem (mgr.34373) 2847 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.114258+0000 mgr.gibba043.dnkmem (mgr.34373) 2848 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: cephadm 2021-03-10T14:44:17.114393+0000 mgr.gibba043.dnkmem (mgr.34373) 2849 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.114411+0000 mon.c (mon.1) 772 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:17 gibba043 bash[24019]: audit 2021-03-10T14:44:17.115712+0000 mon.c (mon.1) 773 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:18 gibba003 bash[31385]: audit 2021-03-10T14:44:17.167918+0000 mgr.gibba043.dnkmem (mgr.34373) 2850 : audit [DBG] from='client.45969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:18 gibba003 bash[31385]: cluster 2021-03-10T14:44:17.382908+0000 mgr.gibba043.dnkmem (mgr.34373) 2851 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:18 gibba003 bash[31385]: audit 2021-03-10T14:44:17.439899+0000 mon.c (mon.1) 774 : audit [DBG] from='client.? 172.21.2.103:0/106307724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:18 gibba003 bash[32348]: audit 2021-03-10T14:44:17.167918+0000 mgr.gibba043.dnkmem (mgr.34373) 2850 : audit [DBG] from='client.45969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:18 gibba003 bash[32348]: cluster 2021-03-10T14:44:17.382908+0000 mgr.gibba043.dnkmem (mgr.34373) 2851 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:18 gibba003 bash[32348]: audit 2021-03-10T14:44:17.439899+0000 mon.c (mon.1) 774 : audit [DBG] from='client.? 172.21.2.103:0/106307724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:18 gibba043 bash[24019]: audit 2021-03-10T14:44:17.167918+0000 mgr.gibba043.dnkmem (mgr.34373) 2850 : audit [DBG] from='client.45969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:18 gibba043 bash[24019]: cluster 2021-03-10T14:44:17.382908+0000 mgr.gibba043.dnkmem (mgr.34373) 2851 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:18 gibba043 bash[24019]: audit 2021-03-10T14:44:17.439899+0000 mon.c (mon.1) 774 : audit [DBG] from='client.? 172.21.2.103:0/106307724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:20.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:20 gibba043 bash[24019]: cluster 2021-03-10T14:44:19.384580+0000 mgr.gibba043.dnkmem (mgr.34373) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:20 gibba003 bash[31385]: cluster 2021-03-10T14:44:19.384580+0000 mgr.gibba043.dnkmem (mgr.34373) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:20 gibba003 bash[32348]: cluster 2021-03-10T14:44:19.384580+0000 mgr.gibba043.dnkmem (mgr.34373) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:22 gibba043 bash[24019]: cluster 2021-03-10T14:44:21.386208+0000 mgr.gibba043.dnkmem (mgr.34373) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:22 gibba003 bash[31385]: cluster 2021-03-10T14:44:21.386208+0000 mgr.gibba043.dnkmem (mgr.34373) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:22 gibba003 bash[32348]: cluster 2021-03-10T14:44:21.386208+0000 mgr.gibba043.dnkmem (mgr.34373) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:25 gibba003 bash[31385]: cluster 2021-03-10T14:44:23.387739+0000 mgr.gibba043.dnkmem (mgr.34373) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:25 gibba003 bash[32348]: cluster 2021-03-10T14:44:23.387739+0000 mgr.gibba043.dnkmem (mgr.34373) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:25 gibba043 bash[24019]: cluster 2021-03-10T14:44:23.387739+0000 mgr.gibba043.dnkmem (mgr.34373) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:26 gibba003 bash[31385]: cluster 2021-03-10T14:44:25.389245+0000 mgr.gibba043.dnkmem (mgr.34373) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:26 gibba003 bash[32348]: cluster 2021-03-10T14:44:25.389245+0000 mgr.gibba043.dnkmem (mgr.34373) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:26 gibba043 bash[24019]: cluster 2021-03-10T14:44:25.389245+0000 mgr.gibba043.dnkmem (mgr.34373) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:29 gibba003 bash[31385]: cluster 2021-03-10T14:44:27.390846+0000 mgr.gibba043.dnkmem (mgr.34373) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:29 gibba003 bash[32348]: cluster 2021-03-10T14:44:27.390846+0000 mgr.gibba043.dnkmem (mgr.34373) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:29 gibba043 bash[24019]: cluster 2021-03-10T14:44:27.390846+0000 mgr.gibba043.dnkmem (mgr.34373) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:31 gibba003 bash[31385]: cluster 2021-03-10T14:44:29.392560+0000 mgr.gibba043.dnkmem (mgr.34373) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:31 gibba003 bash[32348]: cluster 2021-03-10T14:44:29.392560+0000 mgr.gibba043.dnkmem (mgr.34373) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:31 gibba043 bash[24019]: cluster 2021-03-10T14:44:29.392560+0000 mgr.gibba043.dnkmem (mgr.34373) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:32 gibba003 bash[31385]: cluster 2021-03-10T14:44:31.394385+0000 mgr.gibba043.dnkmem (mgr.34373) 2858 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:32 gibba003 bash[31385]: cephadm 2021-03-10T14:44:32.130404+0000 mgr.gibba043.dnkmem (mgr.34373) 2859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:32.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:32 gibba003 bash[32348]: cluster 2021-03-10T14:44:31.394385+0000 mgr.gibba043.dnkmem (mgr.34373) 2858 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:32 gibba003 bash[32348]: cephadm 2021-03-10T14:44:32.130404+0000 mgr.gibba043.dnkmem (mgr.34373) 2859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:32 gibba043 bash[24019]: cluster 2021-03-10T14:44:31.394385+0000 mgr.gibba043.dnkmem (mgr.34373) 2858 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:32 gibba043 bash[24019]: cephadm 2021-03-10T14:44:32.130404+0000 mgr.gibba043.dnkmem (mgr.34373) 2859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:35.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:35 gibba003 bash[31385]: cluster 2021-03-10T14:44:33.395938+0000 mgr.gibba043.dnkmem (mgr.34373) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:35.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:35 gibba003 bash[32348]: cluster 2021-03-10T14:44:33.395938+0000 mgr.gibba043.dnkmem (mgr.34373) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:35 gibba043 bash[24019]: cluster 2021-03-10T14:44:33.395938+0000 mgr.gibba043.dnkmem (mgr.34373) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:36 gibba003 bash[31385]: cluster 2021-03-10T14:44:35.397151+0000 mgr.gibba043.dnkmem (mgr.34373) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:36.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:36 gibba003 bash[32348]: cluster 2021-03-10T14:44:35.397151+0000 mgr.gibba043.dnkmem (mgr.34373) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:36 gibba043 bash[24019]: cluster 2021-03-10T14:44:35.397151+0000 mgr.gibba043.dnkmem (mgr.34373) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:39 gibba003 bash[31385]: cluster 2021-03-10T14:44:37.397972+0000 mgr.gibba043.dnkmem (mgr.34373) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:39 gibba003 bash[32348]: cluster 2021-03-10T14:44:37.397972+0000 mgr.gibba043.dnkmem (mgr.34373) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:39 gibba043 bash[24019]: cluster 2021-03-10T14:44:37.397972+0000 mgr.gibba043.dnkmem (mgr.34373) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:41 gibba003 bash[32348]: cluster 2021-03-10T14:44:39.399174+0000 mgr.gibba043.dnkmem (mgr.34373) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:41 gibba003 bash[31385]: cluster 2021-03-10T14:44:39.399174+0000 mgr.gibba043.dnkmem (mgr.34373) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:41 gibba043 bash[24019]: cluster 2021-03-10T14:44:39.399174+0000 mgr.gibba043.dnkmem (mgr.34373) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:42 gibba003 bash[31385]: cluster 2021-03-10T14:44:41.401013+0000 mgr.gibba043.dnkmem (mgr.34373) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:42 gibba003 bash[32348]: cluster 2021-03-10T14:44:41.401013+0000 mgr.gibba043.dnkmem (mgr.34373) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:42 gibba043 bash[24019]: cluster 2021-03-10T14:44:41.401013+0000 mgr.gibba043.dnkmem (mgr.34373) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:45 gibba003 bash[31385]: cluster 2021-03-10T14:44:43.402701+0000 mgr.gibba043.dnkmem (mgr.34373) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:45.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:45 gibba003 bash[32348]: cluster 2021-03-10T14:44:43.402701+0000 mgr.gibba043.dnkmem (mgr.34373) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:45 gibba043 bash[24019]: cluster 2021-03-10T14:44:43.402701+0000 mgr.gibba043.dnkmem (mgr.34373) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:46 gibba003 bash[31385]: cluster 2021-03-10T14:44:45.404140+0000 mgr.gibba043.dnkmem (mgr.34373) 2866 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:46 gibba003 bash[32348]: cluster 2021-03-10T14:44:45.404140+0000 mgr.gibba043.dnkmem (mgr.34373) 2866 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:46 gibba043 bash[24019]: cluster 2021-03-10T14:44:45.404140+0000 mgr.gibba043.dnkmem (mgr.34373) 2866 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:47 gibba003 bash[31385]: cephadm 2021-03-10T14:44:47.146462+0000 mgr.gibba043.dnkmem (mgr.34373) 2867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:47.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:47 gibba003 bash[32348]: cephadm 2021-03-10T14:44:47.146462+0000 mgr.gibba043.dnkmem (mgr.34373) 2867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:47 gibba043 bash[24019]: cephadm 2021-03-10T14:44:47.146462+0000 mgr.gibba043.dnkmem (mgr.34373) 2867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:44:47.683 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:44:47.909 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:44:47.909 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (53m) 8m ago 58m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:44:47.909 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (58m) 7m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:44:47.909 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:44:47.910 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (53m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:44:47.910 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:44:47.910 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:44:47.910 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (52m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:44:47.911 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:44:47.911 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:44:47.911 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:44:47.911 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:44:47.911 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:44:47.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:44:47.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:44:47.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:44:47.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:44:47.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:44:47.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:44:47.913 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (58m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:44:47.913 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:44:48.157 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:44:48.157 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:44:48.157 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:48.158 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:44:48.158 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:44:48.158 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:48.158 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:44:48.159 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:44:48.159 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:44:48.159 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:44:48.159 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:44:48.159 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:44:48.160 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:44:48.160 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:44:48.160 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:44:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[31385]: cluster 2021-03-10T14:44:47.405264+0000 mgr.gibba043.dnkmem (mgr.34373) 2868 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[31385]: audit 2021-03-10T14:44:47.672659+0000 mgr.gibba043.dnkmem (mgr.34373) 2869 : audit [DBG] from='client.55966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[31385]: audit 2021-03-10T14:44:47.894951+0000 mgr.gibba043.dnkmem (mgr.34373) 2870 : audit [DBG] from='client.45987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[31385]: audit 2021-03-10T14:44:48.157463+0000 mon.c (mon.1) 775 : audit [DBG] from='client.? 172.21.2.103:0/2039463909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[32348]: cluster 2021-03-10T14:44:47.405264+0000 mgr.gibba043.dnkmem (mgr.34373) 2868 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[32348]: audit 2021-03-10T14:44:47.672659+0000 mgr.gibba043.dnkmem (mgr.34373) 2869 : audit [DBG] from='client.55966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[32348]: audit 2021-03-10T14:44:47.894951+0000 mgr.gibba043.dnkmem (mgr.34373) 2870 : audit [DBG] from='client.45987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:48 gibba003 bash[32348]: audit 2021-03-10T14:44:48.157463+0000 mon.c (mon.1) 775 : audit [DBG] from='client.? 172.21.2.103:0/2039463909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:48.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:48 gibba043 bash[24019]: cluster 2021-03-10T14:44:47.405264+0000 mgr.gibba043.dnkmem (mgr.34373) 2868 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:48 gibba043 bash[24019]: audit 2021-03-10T14:44:47.672659+0000 mgr.gibba043.dnkmem (mgr.34373) 2869 : audit [DBG] from='client.55966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:48 gibba043 bash[24019]: audit 2021-03-10T14:44:47.894951+0000 mgr.gibba043.dnkmem (mgr.34373) 2870 : audit [DBG] from='client.45987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:48 gibba043 bash[24019]: audit 2021-03-10T14:44:48.157463+0000 mon.c (mon.1) 775 : audit [DBG] from='client.? 172.21.2.103:0/2039463909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:50.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:50 gibba043 bash[24019]: cluster 2021-03-10T14:44:49.406854+0000 mgr.gibba043.dnkmem (mgr.34373) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:50 gibba003 bash[31385]: cluster 2021-03-10T14:44:49.406854+0000 mgr.gibba043.dnkmem (mgr.34373) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:50 gibba003 bash[32348]: cluster 2021-03-10T14:44:49.406854+0000 mgr.gibba043.dnkmem (mgr.34373) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:52 gibba043 bash[24019]: cluster 2021-03-10T14:44:51.408517+0000 mgr.gibba043.dnkmem (mgr.34373) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:52 gibba003 bash[31385]: cluster 2021-03-10T14:44:51.408517+0000 mgr.gibba043.dnkmem (mgr.34373) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:52 gibba003 bash[32348]: cluster 2021-03-10T14:44:51.408517+0000 mgr.gibba043.dnkmem (mgr.34373) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:55 gibba003 bash[31385]: cluster 2021-03-10T14:44:53.410070+0000 mgr.gibba043.dnkmem (mgr.34373) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:55.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:55 gibba003 bash[32348]: cluster 2021-03-10T14:44:53.410070+0000 mgr.gibba043.dnkmem (mgr.34373) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:55 gibba043 bash[24019]: cluster 2021-03-10T14:44:53.410070+0000 mgr.gibba043.dnkmem (mgr.34373) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:56 gibba003 bash[32348]: cluster 2021-03-10T14:44:55.411415+0000 mgr.gibba043.dnkmem (mgr.34373) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:56 gibba003 bash[31385]: cluster 2021-03-10T14:44:55.411415+0000 mgr.gibba043.dnkmem (mgr.34373) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:56 gibba043 bash[24019]: cluster 2021-03-10T14:44:55.411415+0000 mgr.gibba043.dnkmem (mgr.34373) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:44:59 gibba003 bash[31385]: cluster 2021-03-10T14:44:57.412742+0000 mgr.gibba043.dnkmem (mgr.34373) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:44:59 gibba003 bash[32348]: cluster 2021-03-10T14:44:57.412742+0000 mgr.gibba043.dnkmem (mgr.34373) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:44:59 gibba043 bash[24019]: cluster 2021-03-10T14:44:57.412742+0000 mgr.gibba043.dnkmem (mgr.34373) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:00.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:00 gibba043 bash[24019]: cluster 2021-03-10T14:44:59.414358+0000 mgr.gibba043.dnkmem (mgr.34373) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:00.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:00 gibba003 bash[31385]: cluster 2021-03-10T14:44:59.414358+0000 mgr.gibba043.dnkmem (mgr.34373) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:00.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:00 gibba003 bash[32348]: cluster 2021-03-10T14:44:59.414358+0000 mgr.gibba043.dnkmem (mgr.34373) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:02 gibba043 bash[24019]: cluster 2021-03-10T14:45:01.415360+0000 mgr.gibba043.dnkmem (mgr.34373) 2877 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:02 gibba043 bash[24019]: cephadm 2021-03-10T14:45:02.162598+0000 mgr.gibba043.dnkmem (mgr.34373) 2878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:02 gibba003 bash[31385]: cluster 2021-03-10T14:45:01.415360+0000 mgr.gibba043.dnkmem (mgr.34373) 2877 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:02 gibba003 bash[31385]: cephadm 2021-03-10T14:45:02.162598+0000 mgr.gibba043.dnkmem (mgr.34373) 2878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:02 gibba003 bash[32348]: cluster 2021-03-10T14:45:01.415360+0000 mgr.gibba043.dnkmem (mgr.34373) 2877 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:02 gibba003 bash[32348]: cephadm 2021-03-10T14:45:02.162598+0000 mgr.gibba043.dnkmem (mgr.34373) 2878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:05 gibba003 bash[31385]: cluster 2021-03-10T14:45:03.416890+0000 mgr.gibba043.dnkmem (mgr.34373) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:05 gibba003 bash[32348]: cluster 2021-03-10T14:45:03.416890+0000 mgr.gibba043.dnkmem (mgr.34373) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:05 gibba043 bash[24019]: cluster 2021-03-10T14:45:03.416890+0000 mgr.gibba043.dnkmem (mgr.34373) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:06 gibba003 bash[31385]: cluster 2021-03-10T14:45:05.418397+0000 mgr.gibba043.dnkmem (mgr.34373) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:06 gibba003 bash[32348]: cluster 2021-03-10T14:45:05.418397+0000 mgr.gibba043.dnkmem (mgr.34373) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:06 gibba043 bash[24019]: cluster 2021-03-10T14:45:05.418397+0000 mgr.gibba043.dnkmem (mgr.34373) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:09 gibba003 bash[31385]: cluster 2021-03-10T14:45:07.420024+0000 mgr.gibba043.dnkmem (mgr.34373) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:09 gibba003 bash[32348]: cluster 2021-03-10T14:45:07.420024+0000 mgr.gibba043.dnkmem (mgr.34373) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:09 gibba043 bash[24019]: cluster 2021-03-10T14:45:07.420024+0000 mgr.gibba043.dnkmem (mgr.34373) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:10 gibba043 bash[24019]: cluster 2021-03-10T14:45:09.421374+0000 mgr.gibba043.dnkmem (mgr.34373) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:10 gibba003 bash[31385]: cluster 2021-03-10T14:45:09.421374+0000 mgr.gibba043.dnkmem (mgr.34373) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:10 gibba003 bash[32348]: cluster 2021-03-10T14:45:09.421374+0000 mgr.gibba043.dnkmem (mgr.34373) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:12.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:12 gibba043 bash[24019]: cluster 2021-03-10T14:45:11.423234+0000 mgr.gibba043.dnkmem (mgr.34373) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:12.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:12 gibba003 bash[31385]: cluster 2021-03-10T14:45:11.423234+0000 mgr.gibba043.dnkmem (mgr.34373) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:12 gibba003 bash[32348]: cluster 2021-03-10T14:45:11.423234+0000 mgr.gibba043.dnkmem (mgr.34373) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.045975+0000 mon.c (mon.1) 776 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.047255+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.093438+0000 mon.c (mon.1) 777 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:45:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.094222+0000 mon.c (mon.1) 778 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.094799+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:45:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.094872+0000 mon.c (mon.1) 779 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:45:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.095614+0000 mon.c (mon.1) 780 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.096801+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.097935+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:45:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.098709+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.131893+0000 mon.c (mon.1) 781 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:13 gibba043 bash[24019]: audit 2021-03-10T14:45:13.132988+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.045975+0000 mon.c (mon.1) 776 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.047255+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.093438+0000 mon.c (mon.1) 777 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:45:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.094222+0000 mon.c (mon.1) 778 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.094799+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:45:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.094872+0000 mon.c (mon.1) 779 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:45:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.095614+0000 mon.c (mon.1) 780 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.096801+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.097935+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:45:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.098709+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.131893+0000 mon.c (mon.1) 781 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[31385]: audit 2021-03-10T14:45:13.132988+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.045975+0000 mon.c (mon.1) 776 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.047255+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.093438+0000 mon.c (mon.1) 777 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:45:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.094222+0000 mon.c (mon.1) 778 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.094799+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:45:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.094872+0000 mon.c (mon.1) 779 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:45:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.095614+0000 mon.c (mon.1) 780 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.096801+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.097935+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T14:45:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.098709+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:45:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.131893+0000 mon.c (mon.1) 781 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:13 gibba003 bash[32348]: audit 2021-03-10T14:45:13.132988+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:15 gibba003 bash[31385]: cluster 2021-03-10T14:45:13.424758+0000 mgr.gibba043.dnkmem (mgr.34373) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:15 gibba003 bash[32348]: cluster 2021-03-10T14:45:13.424758+0000 mgr.gibba043.dnkmem (mgr.34373) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:15 gibba043 bash[24019]: cluster 2021-03-10T14:45:13.424758+0000 mgr.gibba043.dnkmem (mgr.34373) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:16 gibba003 bash[32348]: cluster 2021-03-10T14:45:15.426357+0000 mgr.gibba043.dnkmem (mgr.34373) 2885 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:16 gibba003 bash[31385]: cluster 2021-03-10T14:45:15.426357+0000 mgr.gibba043.dnkmem (mgr.34373) 2885 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:16 gibba043 bash[24019]: cluster 2021-03-10T14:45:15.426357+0000 mgr.gibba043.dnkmem (mgr.34373) 2885 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:17.482 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:17 gibba003 bash[31385]: audit 2021-03-10T14:45:17.181272+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:45:17.482 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:17 gibba003 bash[32348]: audit 2021-03-10T14:45:17.181272+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:45:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:17 gibba043 bash[24019]: audit 2021-03-10T14:45:17.181272+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:45:18.414 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:45:18.644 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:45:18.644 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (53m) 9m ago 58m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:45:18.645 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (58m) 8m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:45:18.645 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:45:18.645 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:45:18.646 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:45:18.646 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:45:18.647 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:45:18.647 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (52m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:45:18.647 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:45:18.647 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:45:18.647 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:45:18.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:45:18.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:45:18.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:45:18.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:45:18.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:45:18.649 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (49m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:45:18.649 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (48m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:45:18.649 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (58m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:45:18.649 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:45:18.892 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:45:18.892 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:45:18.892 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:18.892 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:45:18.892 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:45:18.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:18.893 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:45:18.893 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:45:18.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:45:18.893 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:45:18.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:45:18.894 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:45:18.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:45:18.894 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:45:18.894 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:45:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:19 gibba003 bash[31385]: cephadm 2021-03-10T14:45:17.178401+0000 mgr.gibba043.dnkmem (mgr.34373) 2886 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:45:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:19 gibba003 bash[31385]: cluster 2021-03-10T14:45:17.427233+0000 mgr.gibba043.dnkmem (mgr.34373) 2887 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:19 gibba003 bash[31385]: audit 2021-03-10T14:45:18.892060+0000 mon.a (mon.0) 903 : audit [DBG] from='client.? 172.21.2.103:0/2596457118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:19 gibba003 bash[32348]: cephadm 2021-03-10T14:45:17.178401+0000 mgr.gibba043.dnkmem (mgr.34373) 2886 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:45:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:19 gibba003 bash[32348]: cluster 2021-03-10T14:45:17.427233+0000 mgr.gibba043.dnkmem (mgr.34373) 2887 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:19 gibba003 bash[32348]: audit 2021-03-10T14:45:18.892060+0000 mon.a (mon.0) 903 : audit [DBG] from='client.? 172.21.2.103:0/2596457118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:19 gibba043 bash[24019]: cephadm 2021-03-10T14:45:17.178401+0000 mgr.gibba043.dnkmem (mgr.34373) 2886 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:19 gibba043 bash[24019]: cluster 2021-03-10T14:45:17.427233+0000 mgr.gibba043.dnkmem (mgr.34373) 2887 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:19 gibba043 bash[24019]: audit 2021-03-10T14:45:18.892060+0000 mon.a (mon.0) 903 : audit [DBG] from='client.? 172.21.2.103:0/2596457118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:20 gibba003 bash[31385]: audit 2021-03-10T14:45:18.404234+0000 mgr.gibba043.dnkmem (mgr.34373) 2888 : audit [DBG] from='client.45999 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:20 gibba003 bash[31385]: audit 2021-03-10T14:45:18.634174+0000 mgr.gibba043.dnkmem (mgr.34373) 2889 : audit [DBG] from='client.55990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:20.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:20 gibba003 bash[32348]: audit 2021-03-10T14:45:18.404234+0000 mgr.gibba043.dnkmem (mgr.34373) 2888 : audit [DBG] from='client.45999 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:20.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:20 gibba003 bash[32348]: audit 2021-03-10T14:45:18.634174+0000 mgr.gibba043.dnkmem (mgr.34373) 2889 : audit [DBG] from='client.55990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:20.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:20 gibba043 bash[24019]: audit 2021-03-10T14:45:18.404234+0000 mgr.gibba043.dnkmem (mgr.34373) 2888 : audit [DBG] from='client.45999 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:20.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:20 gibba043 bash[24019]: audit 2021-03-10T14:45:18.634174+0000 mgr.gibba043.dnkmem (mgr.34373) 2889 : audit [DBG] from='client.55990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:21 gibba003 bash[31385]: cluster 2021-03-10T14:45:19.428828+0000 mgr.gibba043.dnkmem (mgr.34373) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:21 gibba003 bash[32348]: cluster 2021-03-10T14:45:19.428828+0000 mgr.gibba043.dnkmem (mgr.34373) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:21 gibba043 bash[24019]: cluster 2021-03-10T14:45:19.428828+0000 mgr.gibba043.dnkmem (mgr.34373) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cluster 2021-03-10T14:45:21.430768+0000 mgr.gibba043.dnkmem (mgr.34373) 2891 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:21.617462+0000 mon.c (mon.1) 783 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:21.796802+0000 mgr.gibba043.dnkmem (mgr.34373) 2892 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:45:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:21.797044+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:45:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.003181+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:45:22.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.007261+0000 mgr.gibba043.dnkmem (mgr.34373) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.009942+0000 mgr.gibba043.dnkmem (mgr.34373) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.010379+0000 mon.c (mon.1) 784 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.011921+0000 mgr.gibba043.dnkmem (mgr.34373) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.011960+0000 mgr.gibba043.dnkmem (mgr.34373) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:22.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.012921+0000 mon.c (mon.1) 785 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.013327+0000 mgr.gibba043.dnkmem (mgr.34373) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:22.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.013365+0000 mgr.gibba043.dnkmem (mgr.34373) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:22.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.014738+0000 mon.c (mon.1) 786 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.014858+0000 mgr.gibba043.dnkmem (mgr.34373) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:22.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.015981+0000 mon.c (mon.1) 787 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.016793+0000 mgr.gibba043.dnkmem (mgr.34373) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:22.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.016837+0000 mgr.gibba043.dnkmem (mgr.34373) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:22.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.018489+0000 mgr.gibba043.dnkmem (mgr.34373) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:22.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.018932+0000 mgr.gibba043.dnkmem (mgr.34373) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:22.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.019668+0000 mon.c (mon.1) 788 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.020622+0000 mgr.gibba043.dnkmem (mgr.34373) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:22.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.020667+0000 mgr.gibba043.dnkmem (mgr.34373) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:22.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: cephadm 2021-03-10T14:45:22.020793+0000 mgr.gibba043.dnkmem (mgr.34373) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:22.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:22 gibba043 bash[24019]: audit 2021-03-10T14:45:22.021557+0000 mon.c (mon.1) 789 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cluster 2021-03-10T14:45:21.430768+0000 mgr.gibba043.dnkmem (mgr.34373) 2891 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:21.617462+0000 mon.c (mon.1) 783 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:22.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:21.796802+0000 mgr.gibba043.dnkmem (mgr.34373) 2892 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:45:22.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:21.797044+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:45:22.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.003181+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:45:22.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.007261+0000 mgr.gibba043.dnkmem (mgr.34373) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:22.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.009942+0000 mgr.gibba043.dnkmem (mgr.34373) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:22.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.010379+0000 mon.c (mon.1) 784 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:22.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.011921+0000 mgr.gibba043.dnkmem (mgr.34373) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:22.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.011960+0000 mgr.gibba043.dnkmem (mgr.34373) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:22.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.012921+0000 mon.c (mon.1) 785 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.013327+0000 mgr.gibba043.dnkmem (mgr.34373) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:22.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.013365+0000 mgr.gibba043.dnkmem (mgr.34373) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:22.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.014738+0000 mon.c (mon.1) 786 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.014858+0000 mgr.gibba043.dnkmem (mgr.34373) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:22.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.015981+0000 mon.c (mon.1) 787 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.016793+0000 mgr.gibba043.dnkmem (mgr.34373) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:22.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.016837+0000 mgr.gibba043.dnkmem (mgr.34373) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:22.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.018489+0000 mgr.gibba043.dnkmem (mgr.34373) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:22.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.018932+0000 mgr.gibba043.dnkmem (mgr.34373) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:22.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cluster 2021-03-10T14:45:21.430768+0000 mgr.gibba043.dnkmem (mgr.34373) 2891 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:21.617462+0000 mon.c (mon.1) 783 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:22.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:21.796802+0000 mgr.gibba043.dnkmem (mgr.34373) 2892 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:45:22.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:21.797044+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:45:22.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.003181+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:45:22.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.007261+0000 mgr.gibba043.dnkmem (mgr.34373) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:22.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.009942+0000 mgr.gibba043.dnkmem (mgr.34373) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:22.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.010379+0000 mon.c (mon.1) 784 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:22.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.011921+0000 mgr.gibba043.dnkmem (mgr.34373) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:22.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.011960+0000 mgr.gibba043.dnkmem (mgr.34373) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:22.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.012921+0000 mon.c (mon.1) 785 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.013327+0000 mgr.gibba043.dnkmem (mgr.34373) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:22.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.013365+0000 mgr.gibba043.dnkmem (mgr.34373) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:22.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.014738+0000 mon.c (mon.1) 786 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.014858+0000 mgr.gibba043.dnkmem (mgr.34373) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:22.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.015981+0000 mon.c (mon.1) 787 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.016793+0000 mgr.gibba043.dnkmem (mgr.34373) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:22.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.016837+0000 mgr.gibba043.dnkmem (mgr.34373) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:22.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.018489+0000 mgr.gibba043.dnkmem (mgr.34373) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:22.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.018932+0000 mgr.gibba043.dnkmem (mgr.34373) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:22.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.019668+0000 mon.c (mon.1) 788 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.020622+0000 mgr.gibba043.dnkmem (mgr.34373) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:22.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.020667+0000 mgr.gibba043.dnkmem (mgr.34373) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:22.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: cephadm 2021-03-10T14:45:22.020793+0000 mgr.gibba043.dnkmem (mgr.34373) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:22.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[31385]: audit 2021-03-10T14:45:22.021557+0000 mon.c (mon.1) 789 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.019668+0000 mon.c (mon.1) 788 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:22.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.020622+0000 mgr.gibba043.dnkmem (mgr.34373) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:22.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.020667+0000 mgr.gibba043.dnkmem (mgr.34373) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:22.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: cephadm 2021-03-10T14:45:22.020793+0000 mgr.gibba043.dnkmem (mgr.34373) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:22.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:22 gibba003 bash[32348]: audit 2021-03-10T14:45:22.021557+0000 mon.c (mon.1) 789 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:25 gibba003 bash[31385]: cluster 2021-03-10T14:45:23.432591+0000 mgr.gibba043.dnkmem (mgr.34373) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:25.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:25 gibba003 bash[32348]: cluster 2021-03-10T14:45:23.432591+0000 mgr.gibba043.dnkmem (mgr.34373) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:25 gibba043 bash[24019]: cluster 2021-03-10T14:45:23.432591+0000 mgr.gibba043.dnkmem (mgr.34373) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:26 gibba043 bash[24019]: cluster 2021-03-10T14:45:25.434020+0000 mgr.gibba043.dnkmem (mgr.34373) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:26 gibba003 bash[31385]: cluster 2021-03-10T14:45:25.434020+0000 mgr.gibba043.dnkmem (mgr.34373) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:26 gibba003 bash[32348]: cluster 2021-03-10T14:45:25.434020+0000 mgr.gibba043.dnkmem (mgr.34373) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:29 gibba003 bash[31385]: cluster 2021-03-10T14:45:27.435853+0000 mgr.gibba043.dnkmem (mgr.34373) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:29.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:29 gibba003 bash[32348]: cluster 2021-03-10T14:45:27.435853+0000 mgr.gibba043.dnkmem (mgr.34373) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:29 gibba043 bash[24019]: cluster 2021-03-10T14:45:27.435853+0000 mgr.gibba043.dnkmem (mgr.34373) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:30 gibba043 bash[24019]: cluster 2021-03-10T14:45:29.437424+0000 mgr.gibba043.dnkmem (mgr.34373) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:30 gibba003 bash[31385]: cluster 2021-03-10T14:45:29.437424+0000 mgr.gibba043.dnkmem (mgr.34373) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:30 gibba003 bash[32348]: cluster 2021-03-10T14:45:29.437424+0000 mgr.gibba043.dnkmem (mgr.34373) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:32 gibba043 bash[24019]: cluster 2021-03-10T14:45:31.439035+0000 mgr.gibba043.dnkmem (mgr.34373) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:32 gibba003 bash[31385]: cluster 2021-03-10T14:45:31.439035+0000 mgr.gibba043.dnkmem (mgr.34373) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:32 gibba003 bash[32348]: cluster 2021-03-10T14:45:31.439035+0000 mgr.gibba043.dnkmem (mgr.34373) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:35 gibba043 bash[24019]: cluster 2021-03-10T14:45:33.440588+0000 mgr.gibba043.dnkmem (mgr.34373) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:35 gibba003 bash[31385]: cluster 2021-03-10T14:45:33.440588+0000 mgr.gibba043.dnkmem (mgr.34373) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:35 gibba003 bash[32348]: cluster 2021-03-10T14:45:33.440588+0000 mgr.gibba043.dnkmem (mgr.34373) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:36 gibba043 bash[24019]: cluster 2021-03-10T14:45:35.441789+0000 mgr.gibba043.dnkmem (mgr.34373) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:36 gibba003 bash[31385]: cluster 2021-03-10T14:45:35.441789+0000 mgr.gibba043.dnkmem (mgr.34373) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:36 gibba003 bash[32348]: cluster 2021-03-10T14:45:35.441789+0000 mgr.gibba043.dnkmem (mgr.34373) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:37 gibba043 bash[24019]: cephadm 2021-03-10T14:45:37.036789+0000 mgr.gibba043.dnkmem (mgr.34373) 2914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:37 gibba003 bash[31385]: cephadm 2021-03-10T14:45:37.036789+0000 mgr.gibba043.dnkmem (mgr.34373) 2914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:37 gibba003 bash[32348]: cephadm 2021-03-10T14:45:37.036789+0000 mgr.gibba043.dnkmem (mgr.34373) 2914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:39 gibba003 bash[31385]: cluster 2021-03-10T14:45:37.443291+0000 mgr.gibba043.dnkmem (mgr.34373) 2915 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:39 gibba003 bash[32348]: cluster 2021-03-10T14:45:37.443291+0000 mgr.gibba043.dnkmem (mgr.34373) 2915 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:39 gibba043 bash[24019]: cluster 2021-03-10T14:45:37.443291+0000 mgr.gibba043.dnkmem (mgr.34373) 2915 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:40 gibba043 bash[24019]: cluster 2021-03-10T14:45:39.444890+0000 mgr.gibba043.dnkmem (mgr.34373) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:40.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:40 gibba003 bash[31385]: cluster 2021-03-10T14:45:39.444890+0000 mgr.gibba043.dnkmem (mgr.34373) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:40.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:40 gibba003 bash[32348]: cluster 2021-03-10T14:45:39.444890+0000 mgr.gibba043.dnkmem (mgr.34373) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:42 gibba043 bash[24019]: cluster 2021-03-10T14:45:41.446743+0000 mgr.gibba043.dnkmem (mgr.34373) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:42 gibba003 bash[31385]: cluster 2021-03-10T14:45:41.446743+0000 mgr.gibba043.dnkmem (mgr.34373) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:42 gibba003 bash[32348]: cluster 2021-03-10T14:45:41.446743+0000 mgr.gibba043.dnkmem (mgr.34373) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:45 gibba043 bash[24019]: cluster 2021-03-10T14:45:43.448394+0000 mgr.gibba043.dnkmem (mgr.34373) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:45.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:45 gibba003 bash[31385]: cluster 2021-03-10T14:45:43.448394+0000 mgr.gibba043.dnkmem (mgr.34373) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:45.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:45 gibba003 bash[32348]: cluster 2021-03-10T14:45:43.448394+0000 mgr.gibba043.dnkmem (mgr.34373) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:46 gibba043 bash[24019]: cluster 2021-03-10T14:45:45.449947+0000 mgr.gibba043.dnkmem (mgr.34373) 2919 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:46 gibba003 bash[31385]: cluster 2021-03-10T14:45:45.449947+0000 mgr.gibba043.dnkmem (mgr.34373) 2919 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:46 gibba003 bash[32348]: cluster 2021-03-10T14:45:45.449947+0000 mgr.gibba043.dnkmem (mgr.34373) 2919 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:49.136 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:45:49.366 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:45:49.366 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (54m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:45:49.366 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (59m) 8m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:45:49.366 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:45:49.367 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (54m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:45:49.367 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:45:49.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:45:49.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (53m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:45:49.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:45:49.368 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:45:49.368 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:45:49.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:45:49.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:45:49.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:45:49.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:45:49.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:45:49.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:45:49.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:45:49.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:45:49.370 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (59m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:45:49.370 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:45:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:49 gibba043 bash[24019]: cluster 2021-03-10T14:45:47.450717+0000 mgr.gibba043.dnkmem (mgr.34373) 2920 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:49.615 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:45:49.615 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:45:49.616 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:49.616 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:45:49.616 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:45:49.616 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:49.616 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:45:49.617 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:45:49.617 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:45:49.617 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:45:49.617 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:45:49.618 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:45:49.618 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:45:49.618 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:45:49.618 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:45:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:49 gibba003 bash[31385]: cluster 2021-03-10T14:45:47.450717+0000 mgr.gibba043.dnkmem (mgr.34373) 2920 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:49 gibba003 bash[32348]: cluster 2021-03-10T14:45:47.450717+0000 mgr.gibba043.dnkmem (mgr.34373) 2920 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:50 gibba043 bash[24019]: audit 2021-03-10T14:45:49.124841+0000 mgr.gibba043.dnkmem (mgr.34373) 2921 : audit [DBG] from='client.56002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:50.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:50 gibba043 bash[24019]: audit 2021-03-10T14:45:49.615649+0000 mon.a (mon.0) 906 : audit [DBG] from='client.? 172.21.2.103:0/3296025334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:50.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:50 gibba003 bash[31385]: audit 2021-03-10T14:45:49.124841+0000 mgr.gibba043.dnkmem (mgr.34373) 2921 : audit [DBG] from='client.56002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:50.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:50 gibba003 bash[31385]: audit 2021-03-10T14:45:49.615649+0000 mon.a (mon.0) 906 : audit [DBG] from='client.? 172.21.2.103:0/3296025334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:50.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:50 gibba003 bash[32348]: audit 2021-03-10T14:45:49.124841+0000 mgr.gibba043.dnkmem (mgr.34373) 2921 : audit [DBG] from='client.56002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:50.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:50 gibba003 bash[32348]: audit 2021-03-10T14:45:49.615649+0000 mon.a (mon.0) 906 : audit [DBG] from='client.? 172.21.2.103:0/3296025334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:51 gibba043 bash[24019]: audit 2021-03-10T14:45:49.351187+0000 mgr.gibba043.dnkmem (mgr.34373) 2922 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:51 gibba043 bash[24019]: cluster 2021-03-10T14:45:49.451969+0000 mgr.gibba043.dnkmem (mgr.34373) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:51 gibba003 bash[31385]: audit 2021-03-10T14:45:49.351187+0000 mgr.gibba043.dnkmem (mgr.34373) 2922 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:51 gibba003 bash[31385]: cluster 2021-03-10T14:45:49.451969+0000 mgr.gibba043.dnkmem (mgr.34373) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:51 gibba003 bash[32348]: audit 2021-03-10T14:45:49.351187+0000 mgr.gibba043.dnkmem (mgr.34373) 2922 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:51.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:51 gibba003 bash[32348]: cluster 2021-03-10T14:45:49.451969+0000 mgr.gibba043.dnkmem (mgr.34373) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:52 gibba043 bash[24019]: cluster 2021-03-10T14:45:51.453338+0000 mgr.gibba043.dnkmem (mgr.34373) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:52 gibba043 bash[24019]: cephadm 2021-03-10T14:45:52.052588+0000 mgr.gibba043.dnkmem (mgr.34373) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:52.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:52 gibba003 bash[31385]: cluster 2021-03-10T14:45:51.453338+0000 mgr.gibba043.dnkmem (mgr.34373) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:52 gibba003 bash[31385]: cephadm 2021-03-10T14:45:52.052588+0000 mgr.gibba043.dnkmem (mgr.34373) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:52.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:52 gibba003 bash[32348]: cluster 2021-03-10T14:45:51.453338+0000 mgr.gibba043.dnkmem (mgr.34373) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:52 gibba003 bash[32348]: cephadm 2021-03-10T14:45:52.052588+0000 mgr.gibba043.dnkmem (mgr.34373) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:45:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:55 gibba043 bash[24019]: cluster 2021-03-10T14:45:53.454902+0000 mgr.gibba043.dnkmem (mgr.34373) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:55 gibba003 bash[31385]: cluster 2021-03-10T14:45:53.454902+0000 mgr.gibba043.dnkmem (mgr.34373) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:55 gibba003 bash[32348]: cluster 2021-03-10T14:45:53.454902+0000 mgr.gibba043.dnkmem (mgr.34373) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:56 gibba043 bash[24019]: cluster 2021-03-10T14:45:55.456308+0000 mgr.gibba043.dnkmem (mgr.34373) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:56 gibba003 bash[31385]: cluster 2021-03-10T14:45:55.456308+0000 mgr.gibba043.dnkmem (mgr.34373) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:56 gibba003 bash[32348]: cluster 2021-03-10T14:45:55.456308+0000 mgr.gibba043.dnkmem (mgr.34373) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:45:59 gibba043 bash[24019]: cluster 2021-03-10T14:45:57.457991+0000 mgr.gibba043.dnkmem (mgr.34373) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:45:59 gibba003 bash[31385]: cluster 2021-03-10T14:45:57.457991+0000 mgr.gibba043.dnkmem (mgr.34373) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:45:59 gibba003 bash[32348]: cluster 2021-03-10T14:45:57.457991+0000 mgr.gibba043.dnkmem (mgr.34373) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:00.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:00 gibba043 bash[24019]: cluster 2021-03-10T14:45:59.459325+0000 mgr.gibba043.dnkmem (mgr.34373) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:00.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:00 gibba003 bash[31385]: cluster 2021-03-10T14:45:59.459325+0000 mgr.gibba043.dnkmem (mgr.34373) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:00.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:00 gibba003 bash[32348]: cluster 2021-03-10T14:45:59.459325+0000 mgr.gibba043.dnkmem (mgr.34373) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:02 gibba003 bash[31385]: cluster 2021-03-10T14:46:01.459883+0000 mgr.gibba043.dnkmem (mgr.34373) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:02 gibba003 bash[32348]: cluster 2021-03-10T14:46:01.459883+0000 mgr.gibba043.dnkmem (mgr.34373) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:02 gibba043 bash[24019]: cluster 2021-03-10T14:46:01.459883+0000 mgr.gibba043.dnkmem (mgr.34373) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:04 gibba043 bash[24019]: cluster 2021-03-10T14:46:03.461063+0000 mgr.gibba043.dnkmem (mgr.34373) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:04 gibba003 bash[31385]: cluster 2021-03-10T14:46:03.461063+0000 mgr.gibba043.dnkmem (mgr.34373) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:04 gibba003 bash[32348]: cluster 2021-03-10T14:46:03.461063+0000 mgr.gibba043.dnkmem (mgr.34373) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:06 gibba003 bash[31385]: cluster 2021-03-10T14:46:05.462583+0000 mgr.gibba043.dnkmem (mgr.34373) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:06 gibba003 bash[32348]: cluster 2021-03-10T14:46:05.462583+0000 mgr.gibba043.dnkmem (mgr.34373) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:07.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:06 gibba043 bash[24019]: cluster 2021-03-10T14:46:05.462583+0000 mgr.gibba043.dnkmem (mgr.34373) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:07 gibba003 bash[31385]: cephadm 2021-03-10T14:46:07.068529+0000 mgr.gibba043.dnkmem (mgr.34373) 2933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:07 gibba003 bash[32348]: cephadm 2021-03-10T14:46:07.068529+0000 mgr.gibba043.dnkmem (mgr.34373) 2933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:07 gibba043 bash[24019]: cephadm 2021-03-10T14:46:07.068529+0000 mgr.gibba043.dnkmem (mgr.34373) 2933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:09 gibba043 bash[24019]: cluster 2021-03-10T14:46:07.464123+0000 mgr.gibba043.dnkmem (mgr.34373) 2934 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:09 gibba003 bash[31385]: cluster 2021-03-10T14:46:07.464123+0000 mgr.gibba043.dnkmem (mgr.34373) 2934 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:09.713 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:09 gibba003 bash[32348]: cluster 2021-03-10T14:46:07.464123+0000 mgr.gibba043.dnkmem (mgr.34373) 2934 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:10 gibba043 bash[24019]: cluster 2021-03-10T14:46:09.465398+0000 mgr.gibba043.dnkmem (mgr.34373) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:10 gibba003 bash[31385]: cluster 2021-03-10T14:46:09.465398+0000 mgr.gibba043.dnkmem (mgr.34373) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:10 gibba003 bash[32348]: cluster 2021-03-10T14:46:09.465398+0000 mgr.gibba043.dnkmem (mgr.34373) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:12 gibba003 bash[31385]: cluster 2021-03-10T14:46:11.466300+0000 mgr.gibba043.dnkmem (mgr.34373) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:12 gibba003 bash[32348]: cluster 2021-03-10T14:46:11.466300+0000 mgr.gibba043.dnkmem (mgr.34373) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:12 gibba043 bash[24019]: cluster 2021-03-10T14:46:11.466300+0000 mgr.gibba043.dnkmem (mgr.34373) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.053169+0000 mon.c (mon.1) 790 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.054249+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.104002+0000 mon.c (mon.1) 791 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.104898+0000 mon.c (mon.1) 792 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:46:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.105170+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.105888+0000 mon.c (mon.1) 793 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.106384+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:46:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.107072+0000 mon.c (mon.1) 794 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.107218+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.108200+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.139447+0000 mon.c (mon.1) 795 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[31385]: audit 2021-03-10T14:46:13.140555+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.053169+0000 mon.c (mon.1) 790 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.054249+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.104002+0000 mon.c (mon.1) 791 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.104898+0000 mon.c (mon.1) 792 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:46:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.105170+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.105888+0000 mon.c (mon.1) 793 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.106384+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:46:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.107072+0000 mon.c (mon.1) 794 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.107218+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.108200+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:46:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.139447+0000 mon.c (mon.1) 795 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:13 gibba003 bash[32348]: audit 2021-03-10T14:46:13.140555+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.053169+0000 mon.c (mon.1) 790 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.054249+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.104002+0000 mon.c (mon.1) 791 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.104898+0000 mon.c (mon.1) 792 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:46:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.105170+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.105888+0000 mon.c (mon.1) 793 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:46:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.106384+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:46:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.107072+0000 mon.c (mon.1) 794 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:46:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.107218+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:46:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.108200+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:46:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.139447+0000 mon.c (mon.1) 795 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:13 gibba043 bash[24019]: audit 2021-03-10T14:46:13.140555+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:14 gibba003 bash[31385]: cluster 2021-03-10T14:46:13.467888+0000 mgr.gibba043.dnkmem (mgr.34373) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:14 gibba003 bash[32348]: cluster 2021-03-10T14:46:13.467888+0000 mgr.gibba043.dnkmem (mgr.34373) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:14 gibba043 bash[24019]: cluster 2021-03-10T14:46:13.467888+0000 mgr.gibba043.dnkmem (mgr.34373) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:16 gibba003 bash[31385]: cluster 2021-03-10T14:46:15.469153+0000 mgr.gibba043.dnkmem (mgr.34373) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:16.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:16 gibba003 bash[32348]: cluster 2021-03-10T14:46:15.469153+0000 mgr.gibba043.dnkmem (mgr.34373) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:17.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:16 gibba043 bash[24019]: cluster 2021-03-10T14:46:15.469153+0000 mgr.gibba043.dnkmem (mgr.34373) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:19 gibba043 bash[24019]: cluster 2021-03-10T14:46:17.470757+0000 mgr.gibba043.dnkmem (mgr.34373) 2939 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:19 gibba003 bash[31385]: cluster 2021-03-10T14:46:17.470757+0000 mgr.gibba043.dnkmem (mgr.34373) 2939 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:19 gibba003 bash[32348]: cluster 2021-03-10T14:46:17.470757+0000 mgr.gibba043.dnkmem (mgr.34373) 2939 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:19.858 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:46:20.084 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:46:20.085 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (54m) 10m ago 60m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:46:20.085 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (59m) 9m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:46:20.085 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:46:20.085 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:46:20.086 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:46:20.086 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:46:20.086 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:46:20.086 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (53m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:46:20.087 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (60m) 10m ago 60m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:46:20.087 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:46:20.087 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (53m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:46:20.087 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:46:20.087 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:46:20.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:46:20.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:46:20.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:46:20.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:46:20.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (49m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:46:20.089 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (59m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:46:20.089 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:46:20.340 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:46:20.341 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:46:20.341 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:20.341 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:46:20.342 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:46:20.342 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:20.342 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:46:20.342 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:46:20.342 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:46:20.343 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:46:20.343 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:46:20.343 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:46:20.343 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:46:20.344 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:46:20.344 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:46:20.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:20 gibba043 bash[24019]: cluster 2021-03-10T14:46:19.472365+0000 mgr.gibba043.dnkmem (mgr.34373) 2940 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:20 gibba043 bash[24019]: audit 2021-03-10T14:46:19.847717+0000 mgr.gibba043.dnkmem (mgr.34373) 2941 : audit [DBG] from='client.46032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:20.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:20 gibba043 bash[24019]: audit 2021-03-10T14:46:20.070571+0000 mgr.gibba043.dnkmem (mgr.34373) 2942 : audit [DBG] from='client.56026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:20.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:20 gibba003 bash[31385]: cluster 2021-03-10T14:46:19.472365+0000 mgr.gibba043.dnkmem (mgr.34373) 2940 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:20 gibba003 bash[31385]: audit 2021-03-10T14:46:19.847717+0000 mgr.gibba043.dnkmem (mgr.34373) 2941 : audit [DBG] from='client.46032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:20.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:20 gibba003 bash[31385]: audit 2021-03-10T14:46:20.070571+0000 mgr.gibba043.dnkmem (mgr.34373) 2942 : audit [DBG] from='client.56026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:20.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:20 gibba003 bash[32348]: cluster 2021-03-10T14:46:19.472365+0000 mgr.gibba043.dnkmem (mgr.34373) 2940 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:20 gibba003 bash[32348]: audit 2021-03-10T14:46:19.847717+0000 mgr.gibba043.dnkmem (mgr.34373) 2941 : audit [DBG] from='client.46032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:20.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:20 gibba003 bash[32348]: audit 2021-03-10T14:46:20.070571+0000 mgr.gibba043.dnkmem (mgr.34373) 2942 : audit [DBG] from='client.56026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:21 gibba043 bash[24019]: audit 2021-03-10T14:46:20.340666+0000 mon.c (mon.1) 796 : audit [DBG] from='client.? 172.21.2.103:0/1056242723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:21.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:21 gibba003 bash[31385]: audit 2021-03-10T14:46:20.340666+0000 mon.c (mon.1) 796 : audit [DBG] from='client.? 172.21.2.103:0/1056242723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:21 gibba003 bash[32348]: audit 2021-03-10T14:46:20.340666+0000 mon.c (mon.1) 796 : audit [DBG] from='client.? 172.21.2.103:0/1056242723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:22 gibba043 bash[24019]: cluster 2021-03-10T14:46:21.473279+0000 mgr.gibba043.dnkmem (mgr.34373) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:22 gibba043 bash[24019]: cephadm 2021-03-10T14:46:22.086118+0000 mgr.gibba043.dnkmem (mgr.34373) 2944 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:46:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:22 gibba043 bash[24019]: audit 2021-03-10T14:46:22.088700+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:46:22.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:22 gibba003 bash[31385]: cluster 2021-03-10T14:46:21.473279+0000 mgr.gibba043.dnkmem (mgr.34373) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:22 gibba003 bash[31385]: cephadm 2021-03-10T14:46:22.086118+0000 mgr.gibba043.dnkmem (mgr.34373) 2944 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:46:22.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:22 gibba003 bash[31385]: audit 2021-03-10T14:46:22.088700+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:46:22.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:22 gibba003 bash[32348]: cluster 2021-03-10T14:46:21.473279+0000 mgr.gibba043.dnkmem (mgr.34373) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:22 gibba003 bash[32348]: cephadm 2021-03-10T14:46:22.086118+0000 mgr.gibba043.dnkmem (mgr.34373) 2944 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:46:22.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:22 gibba003 bash[32348]: audit 2021-03-10T14:46:22.088700+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:46:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:24 gibba043 bash[24019]: cluster 2021-03-10T14:46:23.474795+0000 mgr.gibba043.dnkmem (mgr.34373) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:24 gibba003 bash[31385]: cluster 2021-03-10T14:46:23.474795+0000 mgr.gibba043.dnkmem (mgr.34373) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:24 gibba003 bash[32348]: cluster 2021-03-10T14:46:23.474795+0000 mgr.gibba043.dnkmem (mgr.34373) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cluster 2021-03-10T14:46:25.476526+0000 mgr.gibba043.dnkmem (mgr.34373) 2946 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.613297+0000 mgr.gibba043.dnkmem (mgr.34373) 2947 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:46:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.613570+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:46:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.822726+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:46:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.827234+0000 mgr.gibba043.dnkmem (mgr.34373) 2948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.829406+0000 mgr.gibba043.dnkmem (mgr.34373) 2949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.830494+0000 mon.c (mon.1) 798 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.830961+0000 mgr.gibba043.dnkmem (mgr.34373) 2950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.831000+0000 mgr.gibba043.dnkmem (mgr.34373) 2951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.832011+0000 mgr.gibba043.dnkmem (mgr.34373) 2952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.832058+0000 mgr.gibba043.dnkmem (mgr.34373) 2953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.832241+0000 mon.c (mon.1) 799 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.833222+0000 mgr.gibba043.dnkmem (mgr.34373) 2954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.833427+0000 mon.c (mon.1) 800 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.834614+0000 mon.c (mon.1) 801 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.834674+0000 mgr.gibba043.dnkmem (mgr.34373) 2955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.834735+0000 mgr.gibba043.dnkmem (mgr.34373) 2956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.836048+0000 mgr.gibba043.dnkmem (mgr.34373) 2957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.836395+0000 mgr.gibba043.dnkmem (mgr.34373) 2958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.837450+0000 mon.c (mon.1) 802 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.837648+0000 mgr.gibba043.dnkmem (mgr.34373) 2959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:26.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.837690+0000 mgr.gibba043.dnkmem (mgr.34373) 2960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:26.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: cephadm 2021-03-10T14:46:25.837806+0000 mgr.gibba043.dnkmem (mgr.34373) 2961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:26.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[31385]: audit 2021-03-10T14:46:25.838945+0000 mon.c (mon.1) 803 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cluster 2021-03-10T14:46:25.476526+0000 mgr.gibba043.dnkmem (mgr.34373) 2946 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.613297+0000 mgr.gibba043.dnkmem (mgr.34373) 2947 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:46:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.613570+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:46:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.822726+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:46:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.827234+0000 mgr.gibba043.dnkmem (mgr.34373) 2948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.829406+0000 mgr.gibba043.dnkmem (mgr.34373) 2949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.830494+0000 mon.c (mon.1) 798 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.830961+0000 mgr.gibba043.dnkmem (mgr.34373) 2950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.831000+0000 mgr.gibba043.dnkmem (mgr.34373) 2951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.832011+0000 mgr.gibba043.dnkmem (mgr.34373) 2952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.832058+0000 mgr.gibba043.dnkmem (mgr.34373) 2953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.832241+0000 mon.c (mon.1) 799 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.833222+0000 mgr.gibba043.dnkmem (mgr.34373) 2954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.833427+0000 mon.c (mon.1) 800 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.834614+0000 mon.c (mon.1) 801 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.834674+0000 mgr.gibba043.dnkmem (mgr.34373) 2955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.834735+0000 mgr.gibba043.dnkmem (mgr.34373) 2956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:26.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.836048+0000 mgr.gibba043.dnkmem (mgr.34373) 2957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:26.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.836395+0000 mgr.gibba043.dnkmem (mgr.34373) 2958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:26.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.837450+0000 mon.c (mon.1) 802 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:26.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.837648+0000 mgr.gibba043.dnkmem (mgr.34373) 2959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:26.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.837690+0000 mgr.gibba043.dnkmem (mgr.34373) 2960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:26.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: cephadm 2021-03-10T14:46:25.837806+0000 mgr.gibba043.dnkmem (mgr.34373) 2961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:26.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:26 gibba003 bash[32348]: audit 2021-03-10T14:46:25.838945+0000 mon.c (mon.1) 803 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cluster 2021-03-10T14:46:25.476526+0000 mgr.gibba043.dnkmem (mgr.34373) 2946 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.613297+0000 mgr.gibba043.dnkmem (mgr.34373) 2947 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:46:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.613570+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:46:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.822726+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:46:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.827234+0000 mgr.gibba043.dnkmem (mgr.34373) 2948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.829406+0000 mgr.gibba043.dnkmem (mgr.34373) 2949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.830494+0000 mon.c (mon.1) 798 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.830961+0000 mgr.gibba043.dnkmem (mgr.34373) 2950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.831000+0000 mgr.gibba043.dnkmem (mgr.34373) 2951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.832011+0000 mgr.gibba043.dnkmem (mgr.34373) 2952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.832058+0000 mgr.gibba043.dnkmem (mgr.34373) 2953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.832241+0000 mon.c (mon.1) 799 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.833222+0000 mgr.gibba043.dnkmem (mgr.34373) 2954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.833427+0000 mon.c (mon.1) 800 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.834614+0000 mon.c (mon.1) 801 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.834674+0000 mgr.gibba043.dnkmem (mgr.34373) 2955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.834735+0000 mgr.gibba043.dnkmem (mgr.34373) 2956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.836048+0000 mgr.gibba043.dnkmem (mgr.34373) 2957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.836395+0000 mgr.gibba043.dnkmem (mgr.34373) 2958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.837450+0000 mon.c (mon.1) 802 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.837648+0000 mgr.gibba043.dnkmem (mgr.34373) 2959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.837690+0000 mgr.gibba043.dnkmem (mgr.34373) 2960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:27.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: cephadm 2021-03-10T14:46:25.837806+0000 mgr.gibba043.dnkmem (mgr.34373) 2961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:27.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:26 gibba043 bash[24019]: audit 2021-03-10T14:46:25.838945+0000 mon.c (mon.1) 803 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:29 gibba043 bash[24019]: cluster 2021-03-10T14:46:27.478237+0000 mgr.gibba043.dnkmem (mgr.34373) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:29 gibba003 bash[31385]: cluster 2021-03-10T14:46:27.478237+0000 mgr.gibba043.dnkmem (mgr.34373) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:29 gibba003 bash[32348]: cluster 2021-03-10T14:46:27.478237+0000 mgr.gibba043.dnkmem (mgr.34373) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:30 gibba043 bash[24019]: cluster 2021-03-10T14:46:29.479909+0000 mgr.gibba043.dnkmem (mgr.34373) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:30 gibba003 bash[31385]: cluster 2021-03-10T14:46:29.479909+0000 mgr.gibba043.dnkmem (mgr.34373) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:30 gibba003 bash[32348]: cluster 2021-03-10T14:46:29.479909+0000 mgr.gibba043.dnkmem (mgr.34373) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:32 gibba003 bash[31385]: cluster 2021-03-10T14:46:31.480839+0000 mgr.gibba043.dnkmem (mgr.34373) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:32 gibba003 bash[32348]: cluster 2021-03-10T14:46:31.480839+0000 mgr.gibba043.dnkmem (mgr.34373) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:32 gibba043 bash[24019]: cluster 2021-03-10T14:46:31.480839+0000 mgr.gibba043.dnkmem (mgr.34373) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:34 gibba043 bash[24019]: cluster 2021-03-10T14:46:33.482269+0000 mgr.gibba043.dnkmem (mgr.34373) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:34 gibba003 bash[31385]: cluster 2021-03-10T14:46:33.482269+0000 mgr.gibba043.dnkmem (mgr.34373) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:34.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:34 gibba003 bash[32348]: cluster 2021-03-10T14:46:33.482269+0000 mgr.gibba043.dnkmem (mgr.34373) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:36 gibba003 bash[31385]: cluster 2021-03-10T14:46:35.483663+0000 mgr.gibba043.dnkmem (mgr.34373) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:36 gibba003 bash[32348]: cluster 2021-03-10T14:46:35.483663+0000 mgr.gibba043.dnkmem (mgr.34373) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:37.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:36 gibba043 bash[24019]: cluster 2021-03-10T14:46:35.483663+0000 mgr.gibba043.dnkmem (mgr.34373) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:39 gibba043 bash[24019]: cluster 2021-03-10T14:46:37.485004+0000 mgr.gibba043.dnkmem (mgr.34373) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:39 gibba003 bash[31385]: cluster 2021-03-10T14:46:37.485004+0000 mgr.gibba043.dnkmem (mgr.34373) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:39 gibba003 bash[32348]: cluster 2021-03-10T14:46:37.485004+0000 mgr.gibba043.dnkmem (mgr.34373) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:40 gibba043 bash[24019]: cluster 2021-03-10T14:46:39.486634+0000 mgr.gibba043.dnkmem (mgr.34373) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:40 gibba003 bash[31385]: cluster 2021-03-10T14:46:39.486634+0000 mgr.gibba043.dnkmem (mgr.34373) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:40 gibba003 bash[32348]: cluster 2021-03-10T14:46:39.486634+0000 mgr.gibba043.dnkmem (mgr.34373) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:41 gibba043 bash[24019]: cephadm 2021-03-10T14:46:40.853763+0000 mgr.gibba043.dnkmem (mgr.34373) 2969 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:41.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:41 gibba003 bash[31385]: cephadm 2021-03-10T14:46:40.853763+0000 mgr.gibba043.dnkmem (mgr.34373) 2969 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:41.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:41 gibba003 bash[32348]: cephadm 2021-03-10T14:46:40.853763+0000 mgr.gibba043.dnkmem (mgr.34373) 2969 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:42 gibba043 bash[24019]: cluster 2021-03-10T14:46:41.487543+0000 mgr.gibba043.dnkmem (mgr.34373) 2970 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:42 gibba003 bash[31385]: cluster 2021-03-10T14:46:41.487543+0000 mgr.gibba043.dnkmem (mgr.34373) 2970 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:42 gibba003 bash[32348]: cluster 2021-03-10T14:46:41.487543+0000 mgr.gibba043.dnkmem (mgr.34373) 2970 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:44 gibba043 bash[24019]: cluster 2021-03-10T14:46:43.488783+0000 mgr.gibba043.dnkmem (mgr.34373) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:44 gibba003 bash[31385]: cluster 2021-03-10T14:46:43.488783+0000 mgr.gibba043.dnkmem (mgr.34373) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:44 gibba003 bash[32348]: cluster 2021-03-10T14:46:43.488783+0000 mgr.gibba043.dnkmem (mgr.34373) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:46 gibba003 bash[31385]: cluster 2021-03-10T14:46:45.490256+0000 mgr.gibba043.dnkmem (mgr.34373) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:46 gibba003 bash[32348]: cluster 2021-03-10T14:46:45.490256+0000 mgr.gibba043.dnkmem (mgr.34373) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:46 gibba043 bash[24019]: cluster 2021-03-10T14:46:45.490256+0000 mgr.gibba043.dnkmem (mgr.34373) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:49 gibba043 bash[24019]: cluster 2021-03-10T14:46:47.491879+0000 mgr.gibba043.dnkmem (mgr.34373) 2973 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:49 gibba003 bash[31385]: cluster 2021-03-10T14:46:47.491879+0000 mgr.gibba043.dnkmem (mgr.34373) 2973 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:49 gibba003 bash[32348]: cluster 2021-03-10T14:46:47.491879+0000 mgr.gibba043.dnkmem (mgr.34373) 2973 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:50 gibba043 bash[24019]: cluster 2021-03-10T14:46:49.493558+0000 mgr.gibba043.dnkmem (mgr.34373) 2974 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.584 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:46:50.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:50 gibba003 bash[31385]: cluster 2021-03-10T14:46:49.493558+0000 mgr.gibba043.dnkmem (mgr.34373) 2974 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:50 gibba003 bash[32348]: cluster 2021-03-10T14:46:49.493558+0000 mgr.gibba043.dnkmem (mgr.34373) 2974 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.813 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:46:50.813 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (55m) 25s ago 60m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:46:50.813 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (60m) 9m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:46:50.813 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (55m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:46:50.814 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (55m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:46:50.814 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (54m) 25s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:46:50.814 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (54m) 25s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:46:50.814 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (54m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:46:50.815 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (54m) 25s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:46:50.815 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (60m) 25s ago 60m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:46:50.815 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:46:50.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (53m) 25s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:46:50.816 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (53m) 25s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:46:50.816 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (52m) 25s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:46:50.816 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (52m) 25s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:46:50.816 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:46:50.816 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:46:50.817 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:46:50.817 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:46:50.817 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (60m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:46:50.817 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 25s ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:46:51.060 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:46:51.060 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:46:51.060 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:51.060 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:46:51.061 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:46:51.061 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:51.061 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:46:51.061 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:46:51.061 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:46:51.062 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:46:51.062 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:46:51.062 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:46:51.062 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:46:51.062 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:46:51.063 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:46:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:51 gibba043 bash[24019]: audit 2021-03-10T14:46:50.572813+0000 mgr.gibba043.dnkmem (mgr.34373) 2975 : audit [DBG] from='client.56038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:51 gibba043 bash[24019]: audit 2021-03-10T14:46:50.798435+0000 mgr.gibba043.dnkmem (mgr.34373) 2976 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:51 gibba043 bash[24019]: audit 2021-03-10T14:46:51.059983+0000 mon.a (mon.0) 915 : audit [DBG] from='client.? 172.21.2.103:0/2632516943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:51 gibba003 bash[31385]: audit 2021-03-10T14:46:50.572813+0000 mgr.gibba043.dnkmem (mgr.34373) 2975 : audit [DBG] from='client.56038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:51 gibba003 bash[31385]: audit 2021-03-10T14:46:50.798435+0000 mgr.gibba043.dnkmem (mgr.34373) 2976 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:51 gibba003 bash[31385]: audit 2021-03-10T14:46:51.059983+0000 mon.a (mon.0) 915 : audit [DBG] from='client.? 172.21.2.103:0/2632516943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:51 gibba003 bash[32348]: audit 2021-03-10T14:46:50.572813+0000 mgr.gibba043.dnkmem (mgr.34373) 2975 : audit [DBG] from='client.56038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:51.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:51 gibba003 bash[32348]: audit 2021-03-10T14:46:50.798435+0000 mgr.gibba043.dnkmem (mgr.34373) 2976 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:51.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:51 gibba003 bash[32348]: audit 2021-03-10T14:46:51.059983+0000 mon.a (mon.0) 915 : audit [DBG] from='client.? 172.21.2.103:0/2632516943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:52.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:52 gibba043 bash[24019]: cluster 2021-03-10T14:46:51.494364+0000 mgr.gibba043.dnkmem (mgr.34373) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:52 gibba003 bash[31385]: cluster 2021-03-10T14:46:51.494364+0000 mgr.gibba043.dnkmem (mgr.34373) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:52 gibba003 bash[32348]: cluster 2021-03-10T14:46:51.494364+0000 mgr.gibba043.dnkmem (mgr.34373) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:54 gibba003 bash[31385]: cluster 2021-03-10T14:46:53.495949+0000 mgr.gibba043.dnkmem (mgr.34373) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:54 gibba003 bash[32348]: cluster 2021-03-10T14:46:53.495949+0000 mgr.gibba043.dnkmem (mgr.34373) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:54 gibba043 bash[24019]: cluster 2021-03-10T14:46:53.495949+0000 mgr.gibba043.dnkmem (mgr.34373) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:56 gibba003 bash[31385]: cluster 2021-03-10T14:46:55.497497+0000 mgr.gibba043.dnkmem (mgr.34373) 2979 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:56 gibba003 bash[31385]: cephadm 2021-03-10T14:46:55.866062+0000 mgr.gibba043.dnkmem (mgr.34373) 2980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:56.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:56 gibba003 bash[32348]: cluster 2021-03-10T14:46:55.497497+0000 mgr.gibba043.dnkmem (mgr.34373) 2979 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:56 gibba003 bash[32348]: cephadm 2021-03-10T14:46:55.866062+0000 mgr.gibba043.dnkmem (mgr.34373) 2980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:56 gibba043 bash[24019]: cluster 2021-03-10T14:46:55.497497+0000 mgr.gibba043.dnkmem (mgr.34373) 2979 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:56 gibba043 bash[24019]: cephadm 2021-03-10T14:46:55.866062+0000 mgr.gibba043.dnkmem (mgr.34373) 2980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:46:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:46:59 gibba043 bash[24019]: cluster 2021-03-10T14:46:57.499083+0000 mgr.gibba043.dnkmem (mgr.34373) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:46:59 gibba003 bash[31385]: cluster 2021-03-10T14:46:57.499083+0000 mgr.gibba043.dnkmem (mgr.34373) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:46:59 gibba003 bash[32348]: cluster 2021-03-10T14:46:57.499083+0000 mgr.gibba043.dnkmem (mgr.34373) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:00 gibba043 bash[24019]: cluster 2021-03-10T14:46:59.500649+0000 mgr.gibba043.dnkmem (mgr.34373) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:00 gibba003 bash[31385]: cluster 2021-03-10T14:46:59.500649+0000 mgr.gibba043.dnkmem (mgr.34373) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:00 gibba003 bash[32348]: cluster 2021-03-10T14:46:59.500649+0000 mgr.gibba043.dnkmem (mgr.34373) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:02 gibba003 bash[31385]: cluster 2021-03-10T14:47:01.502470+0000 mgr.gibba043.dnkmem (mgr.34373) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:02 gibba003 bash[32348]: cluster 2021-03-10T14:47:01.502470+0000 mgr.gibba043.dnkmem (mgr.34373) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:02 gibba043 bash[24019]: cluster 2021-03-10T14:47:01.502470+0000 mgr.gibba043.dnkmem (mgr.34373) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:04 gibba043 bash[24019]: cluster 2021-03-10T14:47:03.504037+0000 mgr.gibba043.dnkmem (mgr.34373) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:04 gibba003 bash[31385]: cluster 2021-03-10T14:47:03.504037+0000 mgr.gibba043.dnkmem (mgr.34373) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:04 gibba003 bash[32348]: cluster 2021-03-10T14:47:03.504037+0000 mgr.gibba043.dnkmem (mgr.34373) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:06 gibba003 bash[31385]: cluster 2021-03-10T14:47:05.505502+0000 mgr.gibba043.dnkmem (mgr.34373) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:06 gibba003 bash[32348]: cluster 2021-03-10T14:47:05.505502+0000 mgr.gibba043.dnkmem (mgr.34373) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:07.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:06 gibba043 bash[24019]: cluster 2021-03-10T14:47:05.505502+0000 mgr.gibba043.dnkmem (mgr.34373) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:08.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:08 gibba003 bash[31385]: cluster 2021-03-10T14:47:07.507092+0000 mgr.gibba043.dnkmem (mgr.34373) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:08.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:08 gibba003 bash[32348]: cluster 2021-03-10T14:47:07.507092+0000 mgr.gibba043.dnkmem (mgr.34373) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:08 gibba043 bash[24019]: cluster 2021-03-10T14:47:07.507092+0000 mgr.gibba043.dnkmem (mgr.34373) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:10.884 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:10 gibba043 bash[24019]: cluster 2021-03-10T14:47:09.508805+0000 mgr.gibba043.dnkmem (mgr.34373) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:10.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:10 gibba003 bash[31385]: cluster 2021-03-10T14:47:09.508805+0000 mgr.gibba043.dnkmem (mgr.34373) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:10.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:10 gibba003 bash[32348]: cluster 2021-03-10T14:47:09.508805+0000 mgr.gibba043.dnkmem (mgr.34373) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:11.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:11 gibba003 bash[31385]: cephadm 2021-03-10T14:47:10.882003+0000 mgr.gibba043.dnkmem (mgr.34373) 2988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:11 gibba003 bash[32348]: cephadm 2021-03-10T14:47:10.882003+0000 mgr.gibba043.dnkmem (mgr.34373) 2988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:11 gibba043 bash[24019]: cephadm 2021-03-10T14:47:10.882003+0000 mgr.gibba043.dnkmem (mgr.34373) 2988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:12 gibba003 bash[31385]: cluster 2021-03-10T14:47:11.509798+0000 mgr.gibba043.dnkmem (mgr.34373) 2989 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:12 gibba003 bash[32348]: cluster 2021-03-10T14:47:11.509798+0000 mgr.gibba043.dnkmem (mgr.34373) 2989 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:12 gibba043 bash[24019]: cluster 2021-03-10T14:47:11.509798+0000 mgr.gibba043.dnkmem (mgr.34373) 2989 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.059941+0000 mon.c (mon.1) 804 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.061082+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.113696+0000 mon.c (mon.1) 805 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:47:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.114437+0000 mon.c (mon.1) 806 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.115145+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:47:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.115205+0000 mon.c (mon.1) 807 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:47:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.115932+0000 mon.c (mon.1) 808 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.117251+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.118158+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:47:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.119121+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.144573+0000 mon.c (mon.1) 809 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[31385]: audit 2021-03-10T14:47:13.145799+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.059941+0000 mon.c (mon.1) 804 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.061082+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.113696+0000 mon.c (mon.1) 805 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:47:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.114437+0000 mon.c (mon.1) 806 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.115145+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:47:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.115205+0000 mon.c (mon.1) 807 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:47:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.115932+0000 mon.c (mon.1) 808 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.117251+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.118158+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:47:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.119121+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:47:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.144573+0000 mon.c (mon.1) 809 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:13 gibba003 bash[32348]: audit 2021-03-10T14:47:13.145799+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.059941+0000 mon.c (mon.1) 804 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.061082+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.113696+0000 mon.c (mon.1) 805 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:47:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.114437+0000 mon.c (mon.1) 806 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:47:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.115145+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:47:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.115205+0000 mon.c (mon.1) 807 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:47:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.115932+0000 mon.c (mon.1) 808 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:47:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.117251+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:47:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.118158+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:47:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.119121+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:47:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.144573+0000 mon.c (mon.1) 809 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:13 gibba043 bash[24019]: audit 2021-03-10T14:47:13.145799+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:14 gibba003 bash[31385]: cluster 2021-03-10T14:47:13.511352+0000 mgr.gibba043.dnkmem (mgr.34373) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:14 gibba003 bash[32348]: cluster 2021-03-10T14:47:13.511352+0000 mgr.gibba043.dnkmem (mgr.34373) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:14 gibba043 bash[24019]: cluster 2021-03-10T14:47:13.511352+0000 mgr.gibba043.dnkmem (mgr.34373) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:16 gibba003 bash[31385]: cluster 2021-03-10T14:47:15.512866+0000 mgr.gibba043.dnkmem (mgr.34373) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:16 gibba003 bash[32348]: cluster 2021-03-10T14:47:15.512866+0000 mgr.gibba043.dnkmem (mgr.34373) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:17.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:16 gibba043 bash[24019]: cluster 2021-03-10T14:47:15.512866+0000 mgr.gibba043.dnkmem (mgr.34373) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:18 gibba003 bash[31385]: cluster 2021-03-10T14:47:17.514362+0000 mgr.gibba043.dnkmem (mgr.34373) 2992 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:18 gibba003 bash[32348]: cluster 2021-03-10T14:47:17.514362+0000 mgr.gibba043.dnkmem (mgr.34373) 2992 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:18 gibba043 bash[24019]: cluster 2021-03-10T14:47:17.514362+0000 mgr.gibba043.dnkmem (mgr.34373) 2992 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:20 gibba003 bash[31385]: cluster 2021-03-10T14:47:19.516121+0000 mgr.gibba043.dnkmem (mgr.34373) 2993 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:20 gibba003 bash[32348]: cluster 2021-03-10T14:47:19.516121+0000 mgr.gibba043.dnkmem (mgr.34373) 2993 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:21.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:20 gibba043 bash[24019]: cluster 2021-03-10T14:47:19.516121+0000 mgr.gibba043.dnkmem (mgr.34373) 2993 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:21.301 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:47:21.532 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:47:21.533 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (55m) 55s ago 61m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:47:21.533 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (60m) 10m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:47:21.533 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:47:21.533 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:47:21.533 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (55m) 55s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:47:21.534 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (55m) 55s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:47:21.534 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (54m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:47:21.534 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (54m) 55s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:47:21.534 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (61m) 55s ago 61m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:47:21.535 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (61m) 10m ago 61m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:47:21.535 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (54m) 55s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:47:21.535 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (53m) 55s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:47:21.535 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (53m) 55s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:47:21.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (52m) 55s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:47:21.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:47:21.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:47:21.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:47:21.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (51m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:47:21.537 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (60m) 10m ago 61m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:47:21.537 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 55s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:47:21.786 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:47:21.786 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:47:21.786 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:21.787 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:47:21.787 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:47:21.787 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:21.787 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:47:21.787 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:47:21.788 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:47:21.788 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:47:21.788 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:47:21.788 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:47:21.789 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:47:21.789 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:47:21.789 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:47:22.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[31385]: audit 2021-03-10T14:47:21.289895+0000 mgr.gibba043.dnkmem (mgr.34373) 2994 : audit [DBG] from='client.46068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:22.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[31385]: cluster 2021-03-10T14:47:21.517272+0000 mgr.gibba043.dnkmem (mgr.34373) 2995 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[31385]: audit 2021-03-10T14:47:21.519527+0000 mgr.gibba043.dnkmem (mgr.34373) 2996 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[31385]: audit 2021-03-10T14:47:21.786114+0000 mon.a (mon.0) 922 : audit [DBG] from='client.? 172.21.2.103:0/1969492086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:22.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[32348]: audit 2021-03-10T14:47:21.289895+0000 mgr.gibba043.dnkmem (mgr.34373) 2994 : audit [DBG] from='client.46068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[32348]: cluster 2021-03-10T14:47:21.517272+0000 mgr.gibba043.dnkmem (mgr.34373) 2995 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[32348]: audit 2021-03-10T14:47:21.519527+0000 mgr.gibba043.dnkmem (mgr.34373) 2996 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:22 gibba003 bash[32348]: audit 2021-03-10T14:47:21.786114+0000 mon.a (mon.0) 922 : audit [DBG] from='client.? 172.21.2.103:0/1969492086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:23.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:22 gibba043 bash[24019]: audit 2021-03-10T14:47:21.289895+0000 mgr.gibba043.dnkmem (mgr.34373) 2994 : audit [DBG] from='client.46068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:23.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:22 gibba043 bash[24019]: cluster 2021-03-10T14:47:21.517272+0000 mgr.gibba043.dnkmem (mgr.34373) 2995 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:22 gibba043 bash[24019]: audit 2021-03-10T14:47:21.519527+0000 mgr.gibba043.dnkmem (mgr.34373) 2996 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:22 gibba043 bash[24019]: audit 2021-03-10T14:47:21.786114+0000 mon.a (mon.0) 922 : audit [DBG] from='client.? 172.21.2.103:0/1969492086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:24 gibba043 bash[24019]: cluster 2021-03-10T14:47:23.518859+0000 mgr.gibba043.dnkmem (mgr.34373) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:24 gibba003 bash[31385]: cluster 2021-03-10T14:47:23.518859+0000 mgr.gibba043.dnkmem (mgr.34373) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:24 gibba003 bash[32348]: cluster 2021-03-10T14:47:23.518859+0000 mgr.gibba043.dnkmem (mgr.34373) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:26 gibba003 bash[31385]: cluster 2021-03-10T14:47:25.520439+0000 mgr.gibba043.dnkmem (mgr.34373) 2998 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:26 gibba003 bash[31385]: cephadm 2021-03-10T14:47:25.898718+0000 mgr.gibba043.dnkmem (mgr.34373) 2999 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:47:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:26 gibba003 bash[31385]: audit 2021-03-10T14:47:25.902941+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:26.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:26 gibba003 bash[32348]: cluster 2021-03-10T14:47:25.520439+0000 mgr.gibba043.dnkmem (mgr.34373) 2998 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:26 gibba003 bash[32348]: cephadm 2021-03-10T14:47:25.898718+0000 mgr.gibba043.dnkmem (mgr.34373) 2999 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:47:26.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:26 gibba003 bash[32348]: audit 2021-03-10T14:47:25.902941+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:26 gibba043 bash[24019]: cluster 2021-03-10T14:47:25.520439+0000 mgr.gibba043.dnkmem (mgr.34373) 2998 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:26 gibba043 bash[24019]: cephadm 2021-03-10T14:47:25.898718+0000 mgr.gibba043.dnkmem (mgr.34373) 2999 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:47:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:26 gibba043 bash[24019]: audit 2021-03-10T14:47:25.902941+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:28 gibba003 bash[31385]: cluster 2021-03-10T14:47:27.521923+0000 mgr.gibba043.dnkmem (mgr.34373) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:28 gibba003 bash[32348]: cluster 2021-03-10T14:47:27.521923+0000 mgr.gibba043.dnkmem (mgr.34373) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:28 gibba043 bash[24019]: cluster 2021-03-10T14:47:27.521923+0000 mgr.gibba043.dnkmem (mgr.34373) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.908 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:30 gibba043 bash[24019]: cluster 2021-03-10T14:47:29.523462+0000 mgr.gibba043.dnkmem (mgr.34373) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.908 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:30 gibba043 bash[24019]: audit 2021-03-10T14:47:29.634471+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:30.908 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:30 gibba043 bash[24019]: audit 2021-03-10T14:47:29.636011+0000 mon.c (mon.1) 811 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:47:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:30 gibba003 bash[31385]: cluster 2021-03-10T14:47:29.523462+0000 mgr.gibba043.dnkmem (mgr.34373) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:30 gibba003 bash[31385]: audit 2021-03-10T14:47:29.634471+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:30 gibba003 bash[31385]: audit 2021-03-10T14:47:29.636011+0000 mon.c (mon.1) 811 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:47:30.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:30 gibba003 bash[32348]: cluster 2021-03-10T14:47:29.523462+0000 mgr.gibba043.dnkmem (mgr.34373) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:30 gibba003 bash[32348]: audit 2021-03-10T14:47:29.634471+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:30.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:30 gibba003 bash[32348]: audit 2021-03-10T14:47:29.636011+0000 mon.c (mon.1) 811 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:47:32.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:32 gibba003 bash[31385]: cluster 2021-03-10T14:47:31.525054+0000 mgr.gibba043.dnkmem (mgr.34373) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:32.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:32 gibba003 bash[32348]: cluster 2021-03-10T14:47:31.525054+0000 mgr.gibba043.dnkmem (mgr.34373) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:32 gibba043 bash[24019]: cluster 2021-03-10T14:47:31.525054+0000 mgr.gibba043.dnkmem (mgr.34373) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:34 gibba043 bash[24019]: cluster 2021-03-10T14:47:33.526435+0000 mgr.gibba043.dnkmem (mgr.34373) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:34 gibba043 bash[24019]: audit 2021-03-10T14:47:34.109830+0000 mon.c (mon.1) 812 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:34 gibba003 bash[31385]: cluster 2021-03-10T14:47:33.526435+0000 mgr.gibba043.dnkmem (mgr.34373) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:34 gibba003 bash[31385]: audit 2021-03-10T14:47:34.109830+0000 mon.c (mon.1) 812 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:34.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:34 gibba003 bash[32348]: cluster 2021-03-10T14:47:33.526435+0000 mgr.gibba043.dnkmem (mgr.34373) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:34 gibba003 bash[32348]: audit 2021-03-10T14:47:34.109830+0000 mon.c (mon.1) 812 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.270835+0000 mgr.gibba043.dnkmem (mgr.34373) 3004 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:47:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.271948+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.462687+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.463362+0000 mgr.gibba043.dnkmem (mgr.34373) 3005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.465665+0000 mgr.gibba043.dnkmem (mgr.34373) 3006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.466296+0000 mon.c (mon.1) 813 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.467247+0000 mgr.gibba043.dnkmem (mgr.34373) 3007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:35.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.467285+0000 mgr.gibba043.dnkmem (mgr.34373) 3008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:35.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.468416+0000 mon.c (mon.1) 814 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.469277+0000 mgr.gibba043.dnkmem (mgr.34373) 3009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:35.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.469315+0000 mgr.gibba043.dnkmem (mgr.34373) 3010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:35.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.470026+0000 mon.c (mon.1) 815 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.471052+0000 mgr.gibba043.dnkmem (mgr.34373) 3011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:35.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.471836+0000 mon.c (mon.1) 816 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.472950+0000 mgr.gibba043.dnkmem (mgr.34373) 3012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:35.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.472986+0000 mgr.gibba043.dnkmem (mgr.34373) 3013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:35.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.474360+0000 mgr.gibba043.dnkmem (mgr.34373) 3014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:35.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.474676+0000 mgr.gibba043.dnkmem (mgr.34373) 3015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:35.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.475620+0000 mon.c (mon.1) 817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.475860+0000 mgr.gibba043.dnkmem (mgr.34373) 3016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:35.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.475898+0000 mgr.gibba043.dnkmem (mgr.34373) 3017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:35.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: cephadm 2021-03-10T14:47:34.476002+0000 mgr.gibba043.dnkmem (mgr.34373) 3018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:35.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[31385]: audit 2021-03-10T14:47:34.477107+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.270835+0000 mgr.gibba043.dnkmem (mgr.34373) 3004 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:47:35.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.271948+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:35.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.462687+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:35.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.463362+0000 mgr.gibba043.dnkmem (mgr.34373) 3005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:35.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.465665+0000 mgr.gibba043.dnkmem (mgr.34373) 3006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:35.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.466296+0000 mon.c (mon.1) 813 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:35.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.467247+0000 mgr.gibba043.dnkmem (mgr.34373) 3007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:35.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.467285+0000 mgr.gibba043.dnkmem (mgr.34373) 3008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:35.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.468416+0000 mon.c (mon.1) 814 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.469277+0000 mgr.gibba043.dnkmem (mgr.34373) 3009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:35.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.469315+0000 mgr.gibba043.dnkmem (mgr.34373) 3010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:35.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.470026+0000 mon.c (mon.1) 815 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.471052+0000 mgr.gibba043.dnkmem (mgr.34373) 3011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:35.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.471836+0000 mon.c (mon.1) 816 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.472950+0000 mgr.gibba043.dnkmem (mgr.34373) 3012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:35.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.472986+0000 mgr.gibba043.dnkmem (mgr.34373) 3013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:35.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.474360+0000 mgr.gibba043.dnkmem (mgr.34373) 3014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:35.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.474676+0000 mgr.gibba043.dnkmem (mgr.34373) 3015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:35.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.475620+0000 mon.c (mon.1) 817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.475860+0000 mgr.gibba043.dnkmem (mgr.34373) 3016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:35.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.475898+0000 mgr.gibba043.dnkmem (mgr.34373) 3017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:35.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: cephadm 2021-03-10T14:47:34.476002+0000 mgr.gibba043.dnkmem (mgr.34373) 3018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:35.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:35 gibba003 bash[32348]: audit 2021-03-10T14:47:34.477107+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.270835+0000 mgr.gibba043.dnkmem (mgr.34373) 3004 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:47:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.271948+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.462687+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:47:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.463362+0000 mgr.gibba043.dnkmem (mgr.34373) 3005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:35.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.465665+0000 mgr.gibba043.dnkmem (mgr.34373) 3006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:35.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.466296+0000 mon.c (mon.1) 813 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:35.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.467247+0000 mgr.gibba043.dnkmem (mgr.34373) 3007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:35.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.467285+0000 mgr.gibba043.dnkmem (mgr.34373) 3008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:35.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.468416+0000 mon.c (mon.1) 814 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.469277+0000 mgr.gibba043.dnkmem (mgr.34373) 3009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:35.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.469315+0000 mgr.gibba043.dnkmem (mgr.34373) 3010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:35.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.470026+0000 mon.c (mon.1) 815 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.471052+0000 mgr.gibba043.dnkmem (mgr.34373) 3011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:35.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.471836+0000 mon.c (mon.1) 816 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.472950+0000 mgr.gibba043.dnkmem (mgr.34373) 3012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:35.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.472986+0000 mgr.gibba043.dnkmem (mgr.34373) 3013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:35.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.474360+0000 mgr.gibba043.dnkmem (mgr.34373) 3014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:35.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.474676+0000 mgr.gibba043.dnkmem (mgr.34373) 3015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:35.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.475620+0000 mon.c (mon.1) 817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:35.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.475860+0000 mgr.gibba043.dnkmem (mgr.34373) 3016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:35.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.475898+0000 mgr.gibba043.dnkmem (mgr.34373) 3017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:35.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: cephadm 2021-03-10T14:47:34.476002+0000 mgr.gibba043.dnkmem (mgr.34373) 3018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:35.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:35 gibba043 bash[24019]: audit 2021-03-10T14:47:34.477107+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:36 gibba003 bash[31385]: cluster 2021-03-10T14:47:35.527797+0000 mgr.gibba043.dnkmem (mgr.34373) 3019 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:36 gibba003 bash[32348]: cluster 2021-03-10T14:47:35.527797+0000 mgr.gibba043.dnkmem (mgr.34373) 3019 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:36 gibba043 bash[24019]: cluster 2021-03-10T14:47:35.527797+0000 mgr.gibba043.dnkmem (mgr.34373) 3019 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:38 gibba003 bash[31385]: cluster 2021-03-10T14:47:37.529106+0000 mgr.gibba043.dnkmem (mgr.34373) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:38.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:38 gibba003 bash[32348]: cluster 2021-03-10T14:47:37.529106+0000 mgr.gibba043.dnkmem (mgr.34373) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:38 gibba043 bash[24019]: cluster 2021-03-10T14:47:37.529106+0000 mgr.gibba043.dnkmem (mgr.34373) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:40.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:40 gibba003 bash[31385]: cluster 2021-03-10T14:47:39.530753+0000 mgr.gibba043.dnkmem (mgr.34373) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:40.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:40 gibba003 bash[32348]: cluster 2021-03-10T14:47:39.530753+0000 mgr.gibba043.dnkmem (mgr.34373) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:41.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:40 gibba043 bash[24019]: cluster 2021-03-10T14:47:39.530753+0000 mgr.gibba043.dnkmem (mgr.34373) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:42 gibba003 bash[31385]: cluster 2021-03-10T14:47:41.531767+0000 mgr.gibba043.dnkmem (mgr.34373) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:42 gibba003 bash[32348]: cluster 2021-03-10T14:47:41.531767+0000 mgr.gibba043.dnkmem (mgr.34373) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:42 gibba043 bash[24019]: cluster 2021-03-10T14:47:41.531767+0000 mgr.gibba043.dnkmem (mgr.34373) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:44 gibba043 bash[24019]: cluster 2021-03-10T14:47:43.533295+0000 mgr.gibba043.dnkmem (mgr.34373) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:44 gibba003 bash[31385]: cluster 2021-03-10T14:47:43.533295+0000 mgr.gibba043.dnkmem (mgr.34373) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:44 gibba003 bash[32348]: cluster 2021-03-10T14:47:43.533295+0000 mgr.gibba043.dnkmem (mgr.34373) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:46 gibba003 bash[31385]: cluster 2021-03-10T14:47:45.534680+0000 mgr.gibba043.dnkmem (mgr.34373) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:46 gibba003 bash[32348]: cluster 2021-03-10T14:47:45.534680+0000 mgr.gibba043.dnkmem (mgr.34373) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:46 gibba043 bash[24019]: cluster 2021-03-10T14:47:45.534680+0000 mgr.gibba043.dnkmem (mgr.34373) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:48 gibba003 bash[31385]: cluster 2021-03-10T14:47:47.536381+0000 mgr.gibba043.dnkmem (mgr.34373) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:48 gibba003 bash[32348]: cluster 2021-03-10T14:47:47.536381+0000 mgr.gibba043.dnkmem (mgr.34373) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:48 gibba043 bash[24019]: cluster 2021-03-10T14:47:47.536381+0000 mgr.gibba043.dnkmem (mgr.34373) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:50 gibba003 bash[31385]: cephadm 2021-03-10T14:47:49.492033+0000 mgr.gibba043.dnkmem (mgr.34373) 3026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:50.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:50 gibba003 bash[31385]: cluster 2021-03-10T14:47:49.538032+0000 mgr.gibba043.dnkmem (mgr.34373) 3027 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:50 gibba003 bash[32348]: cephadm 2021-03-10T14:47:49.492033+0000 mgr.gibba043.dnkmem (mgr.34373) 3026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:50.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:50 gibba003 bash[32348]: cluster 2021-03-10T14:47:49.538032+0000 mgr.gibba043.dnkmem (mgr.34373) 3027 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:50 gibba043 bash[24019]: cephadm 2021-03-10T14:47:49.492033+0000 mgr.gibba043.dnkmem (mgr.34373) 3026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:47:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:50 gibba043 bash[24019]: cluster 2021-03-10T14:47:49.538032+0000 mgr.gibba043.dnkmem (mgr.34373) 3027 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.028 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:47:52.256 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:47:52.256 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (56m) 86s ago 61m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:47:52.256 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (61m) 22s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:47:52.257 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (56m) 22s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:47:52.257 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (56m) 22s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:47:52.257 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (55m) 86s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:47:52.257 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (55m) 86s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:47:52.257 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (55m) 22s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:47:52.258 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (55m) 86s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:47:52.258 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (61m) 86s ago 61m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:47:52.258 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (61m) 22s ago 61m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:47:52.258 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (54m) 86s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:47:52.259 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (54m) 86s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:47:52.259 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (53m) 86s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:47:52.259 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (53m) 86s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:47:52.259 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (52m) 22s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:47:52.260 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (52m) 22s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:47:52.260 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (51m) 22s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:47:52.260 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (51m) 22s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:47:52.260 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (61m) 22s ago 61m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:47:52.260 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 86s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:47:52.504 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:47:52.504 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:47:52.505 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:52.505 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:47:52.505 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:47:52.505 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:52.505 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:47:52.506 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:47:52.506 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:47:52.506 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:47:52.506 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:47:52.506 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:47:52.507 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:47:52.507 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:47:52.507 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:47:52.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:52 gibba003 bash[31385]: cluster 2021-03-10T14:47:51.539284+0000 mgr.gibba043.dnkmem (mgr.34373) 3028 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:52 gibba003 bash[31385]: audit 2021-03-10T14:47:52.017622+0000 mgr.gibba043.dnkmem (mgr.34373) 3029 : audit [DBG] from='client.46086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:52 gibba003 bash[31385]: audit 2021-03-10T14:47:52.504321+0000 mon.c (mon.1) 819 : audit [DBG] from='client.? 172.21.2.103:0/4186388579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:52.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:52 gibba003 bash[32348]: cluster 2021-03-10T14:47:51.539284+0000 mgr.gibba043.dnkmem (mgr.34373) 3028 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:52 gibba003 bash[32348]: audit 2021-03-10T14:47:52.017622+0000 mgr.gibba043.dnkmem (mgr.34373) 3029 : audit [DBG] from='client.46086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:52.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:52 gibba003 bash[32348]: audit 2021-03-10T14:47:52.504321+0000 mon.c (mon.1) 819 : audit [DBG] from='client.? 172.21.2.103:0/4186388579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:53.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:52 gibba043 bash[24019]: cluster 2021-03-10T14:47:51.539284+0000 mgr.gibba043.dnkmem (mgr.34373) 3028 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:52 gibba043 bash[24019]: audit 2021-03-10T14:47:52.017622+0000 mgr.gibba043.dnkmem (mgr.34373) 3029 : audit [DBG] from='client.46086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:52 gibba043 bash[24019]: audit 2021-03-10T14:47:52.504321+0000 mon.c (mon.1) 819 : audit [DBG] from='client.? 172.21.2.103:0/4186388579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:53.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:53 gibba003 bash[31385]: audit 2021-03-10T14:47:52.241611+0000 mgr.gibba043.dnkmem (mgr.34373) 3030 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:53.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:53 gibba003 bash[32348]: audit 2021-03-10T14:47:52.241611+0000 mgr.gibba043.dnkmem (mgr.34373) 3030 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:53 gibba043 bash[24019]: audit 2021-03-10T14:47:52.241611+0000 mgr.gibba043.dnkmem (mgr.34373) 3030 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:54.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:54 gibba003 bash[31385]: cluster 2021-03-10T14:47:53.540889+0000 mgr.gibba043.dnkmem (mgr.34373) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:54 gibba003 bash[32348]: cluster 2021-03-10T14:47:53.540889+0000 mgr.gibba043.dnkmem (mgr.34373) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:54 gibba043 bash[24019]: cluster 2021-03-10T14:47:53.540889+0000 mgr.gibba043.dnkmem (mgr.34373) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:56 gibba003 bash[31385]: cluster 2021-03-10T14:47:55.542376+0000 mgr.gibba043.dnkmem (mgr.34373) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:56 gibba003 bash[32348]: cluster 2021-03-10T14:47:55.542376+0000 mgr.gibba043.dnkmem (mgr.34373) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:56 gibba043 bash[24019]: cluster 2021-03-10T14:47:55.542376+0000 mgr.gibba043.dnkmem (mgr.34373) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:47:58 gibba003 bash[31385]: cluster 2021-03-10T14:47:57.544032+0000 mgr.gibba043.dnkmem (mgr.34373) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:47:58 gibba003 bash[32348]: cluster 2021-03-10T14:47:57.544032+0000 mgr.gibba043.dnkmem (mgr.34373) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:47:58 gibba043 bash[24019]: cluster 2021-03-10T14:47:57.544032+0000 mgr.gibba043.dnkmem (mgr.34373) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:00 gibba003 bash[31385]: cluster 2021-03-10T14:47:59.545827+0000 mgr.gibba043.dnkmem (mgr.34373) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:00 gibba003 bash[32348]: cluster 2021-03-10T14:47:59.545827+0000 mgr.gibba043.dnkmem (mgr.34373) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:01.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:00 gibba043 bash[24019]: cluster 2021-03-10T14:47:59.545827+0000 mgr.gibba043.dnkmem (mgr.34373) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:02 gibba003 bash[31385]: cluster 2021-03-10T14:48:01.547011+0000 mgr.gibba043.dnkmem (mgr.34373) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:02 gibba003 bash[32348]: cluster 2021-03-10T14:48:01.547011+0000 mgr.gibba043.dnkmem (mgr.34373) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:02 gibba043 bash[24019]: cluster 2021-03-10T14:48:01.547011+0000 mgr.gibba043.dnkmem (mgr.34373) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:04 gibba043 bash[24019]: cluster 2021-03-10T14:48:03.548637+0000 mgr.gibba043.dnkmem (mgr.34373) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:04 gibba003 bash[31385]: cluster 2021-03-10T14:48:03.548637+0000 mgr.gibba043.dnkmem (mgr.34373) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:04 gibba003 bash[32348]: cluster 2021-03-10T14:48:03.548637+0000 mgr.gibba043.dnkmem (mgr.34373) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:05 gibba003 bash[31385]: cephadm 2021-03-10T14:48:04.508037+0000 mgr.gibba043.dnkmem (mgr.34373) 3037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:05 gibba003 bash[32348]: cephadm 2021-03-10T14:48:04.508037+0000 mgr.gibba043.dnkmem (mgr.34373) 3037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:05.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:05 gibba043 bash[24019]: cephadm 2021-03-10T14:48:04.508037+0000 mgr.gibba043.dnkmem (mgr.34373) 3037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:06.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:06 gibba003 bash[31385]: cluster 2021-03-10T14:48:05.550188+0000 mgr.gibba043.dnkmem (mgr.34373) 3038 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:06.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:06 gibba003 bash[32348]: cluster 2021-03-10T14:48:05.550188+0000 mgr.gibba043.dnkmem (mgr.34373) 3038 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:06.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:06 gibba043 bash[24019]: cluster 2021-03-10T14:48:05.550188+0000 mgr.gibba043.dnkmem (mgr.34373) 3038 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:08.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:08 gibba003 bash[31385]: cluster 2021-03-10T14:48:07.551818+0000 mgr.gibba043.dnkmem (mgr.34373) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:08.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:08 gibba003 bash[32348]: cluster 2021-03-10T14:48:07.551818+0000 mgr.gibba043.dnkmem (mgr.34373) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:08 gibba043 bash[24019]: cluster 2021-03-10T14:48:07.551818+0000 mgr.gibba043.dnkmem (mgr.34373) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:10 gibba003 bash[31385]: cluster 2021-03-10T14:48:09.553643+0000 mgr.gibba043.dnkmem (mgr.34373) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:10 gibba003 bash[32348]: cluster 2021-03-10T14:48:09.553643+0000 mgr.gibba043.dnkmem (mgr.34373) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:11.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:10 gibba043 bash[24019]: cluster 2021-03-10T14:48:09.553643+0000 mgr.gibba043.dnkmem (mgr.34373) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:12 gibba003 bash[31385]: cluster 2021-03-10T14:48:11.555317+0000 mgr.gibba043.dnkmem (mgr.34373) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:12 gibba003 bash[32348]: cluster 2021-03-10T14:48:11.555317+0000 mgr.gibba043.dnkmem (mgr.34373) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:12 gibba043 bash[24019]: cluster 2021-03-10T14:48:11.555317+0000 mgr.gibba043.dnkmem (mgr.34373) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.067107+0000 mon.c (mon.1) 820 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.068178+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.124407+0000 mon.c (mon.1) 821 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:48:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.125138+0000 mon.c (mon.1) 822 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.125596+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:48:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.125841+0000 mon.c (mon.1) 823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.126670+0000 mon.c (mon.1) 824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.126987+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.128024+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.128815+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.149716+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[31385]: audit 2021-03-10T14:48:13.150829+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:13.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.067107+0000 mon.c (mon.1) 820 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.068178+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.124407+0000 mon.c (mon.1) 821 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:48:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.125138+0000 mon.c (mon.1) 822 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.125596+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:48:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.125841+0000 mon.c (mon.1) 823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.126670+0000 mon.c (mon.1) 824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.126987+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.128024+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.128815+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:48:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.149716+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:13 gibba003 bash[32348]: audit 2021-03-10T14:48:13.150829+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.067107+0000 mon.c (mon.1) 820 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.068178+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.124407+0000 mon.c (mon.1) 821 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:48:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.125138+0000 mon.c (mon.1) 822 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:48:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.125596+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:48:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.125841+0000 mon.c (mon.1) 823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.126670+0000 mon.c (mon.1) 824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:48:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.126987+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:48:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.128024+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.128815+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:48:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.149716+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:13 gibba043 bash[24019]: audit 2021-03-10T14:48:13.150829+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:14 gibba003 bash[31385]: cluster 2021-03-10T14:48:13.556997+0000 mgr.gibba043.dnkmem (mgr.34373) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:14 gibba003 bash[32348]: cluster 2021-03-10T14:48:13.556997+0000 mgr.gibba043.dnkmem (mgr.34373) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:14 gibba043 bash[24019]: cluster 2021-03-10T14:48:13.556997+0000 mgr.gibba043.dnkmem (mgr.34373) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:16 gibba003 bash[31385]: cluster 2021-03-10T14:48:15.558392+0000 mgr.gibba043.dnkmem (mgr.34373) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:16 gibba003 bash[32348]: cluster 2021-03-10T14:48:15.558392+0000 mgr.gibba043.dnkmem (mgr.34373) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:17.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:16 gibba043 bash[24019]: cluster 2021-03-10T14:48:15.558392+0000 mgr.gibba043.dnkmem (mgr.34373) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:18.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:18 gibba003 bash[31385]: cluster 2021-03-10T14:48:17.560103+0000 mgr.gibba043.dnkmem (mgr.34373) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:18.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:18 gibba003 bash[32348]: cluster 2021-03-10T14:48:17.560103+0000 mgr.gibba043.dnkmem (mgr.34373) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:18 gibba043 bash[24019]: cluster 2021-03-10T14:48:17.560103+0000 mgr.gibba043.dnkmem (mgr.34373) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:20 gibba003 bash[31385]: cephadm 2021-03-10T14:48:19.524131+0000 mgr.gibba043.dnkmem (mgr.34373) 3045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:20 gibba003 bash[31385]: cluster 2021-03-10T14:48:19.561619+0000 mgr.gibba043.dnkmem (mgr.34373) 3046 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:20 gibba003 bash[32348]: cephadm 2021-03-10T14:48:19.524131+0000 mgr.gibba043.dnkmem (mgr.34373) 3045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:20.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:20 gibba003 bash[32348]: cluster 2021-03-10T14:48:19.561619+0000 mgr.gibba043.dnkmem (mgr.34373) 3046 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:21.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:20 gibba043 bash[24019]: cephadm 2021-03-10T14:48:19.524131+0000 mgr.gibba043.dnkmem (mgr.34373) 3045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:20 gibba043 bash[24019]: cluster 2021-03-10T14:48:19.561619+0000 mgr.gibba043.dnkmem (mgr.34373) 3046 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:22.750 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:48:22.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:22 gibba003 bash[31385]: cluster 2021-03-10T14:48:21.562977+0000 mgr.gibba043.dnkmem (mgr.34373) 3047 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:22.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:22 gibba003 bash[32348]: cluster 2021-03-10T14:48:21.562977+0000 mgr.gibba043.dnkmem (mgr.34373) 3047 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:22.982 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:48:22.982 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (56m) 117s ago 62m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:48:22.983 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (61m) 53s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:48:22.983 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (57m) 53s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:48:22.983 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (57m) 53s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:48:22.983 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (56m) 117s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:48:22.983 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (56m) 117s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:48:22.984 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (55m) 53s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:48:22.984 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (56m) 117s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:48:22.984 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (62m) 117s ago 62m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:48:22.984 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (62m) 53s ago 62m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:48:22.985 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (55m) 117s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:48:22.985 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (54m) 117s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:48:22.985 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (54m) 117s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:48:22.985 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (53m) 117s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:48:22.985 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (53m) 53s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:48:22.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (52m) 53s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:48:22.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (52m) 53s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:48:22.986 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (52m) 53s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:48:22.986 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (61m) 53s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:48:22.986 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 117s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:48:23.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:22 gibba043 bash[24019]: cluster 2021-03-10T14:48:21.562977+0000 mgr.gibba043.dnkmem (mgr.34373) 3047 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:23.233 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:48:23.234 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:48:23.234 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:23.234 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:48:23.234 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:48:23.234 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:23.235 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:48:23.235 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:48:23.235 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:48:23.235 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:48:23.236 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:48:23.236 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:48:23.236 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:48:23.236 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:48:23.236 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:48:23.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:23 gibba003 bash[31385]: audit 2021-03-10T14:48:22.740133+0000 mgr.gibba043.dnkmem (mgr.34373) 3048 : audit [DBG] from='client.46104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:23.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:23 gibba003 bash[31385]: audit 2021-03-10T14:48:22.968140+0000 mgr.gibba043.dnkmem (mgr.34373) 3049 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:23 gibba003 bash[31385]: audit 2021-03-10T14:48:23.233386+0000 mon.a (mon.0) 932 : audit [DBG] from='client.? 172.21.2.103:0/3185941297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:23.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:23 gibba003 bash[32348]: audit 2021-03-10T14:48:22.740133+0000 mgr.gibba043.dnkmem (mgr.34373) 3048 : audit [DBG] from='client.46104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:23.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:23 gibba003 bash[32348]: audit 2021-03-10T14:48:22.968140+0000 mgr.gibba043.dnkmem (mgr.34373) 3049 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:23.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:23 gibba003 bash[32348]: audit 2021-03-10T14:48:23.233386+0000 mon.a (mon.0) 932 : audit [DBG] from='client.? 172.21.2.103:0/3185941297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:24.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:23 gibba043 bash[24019]: audit 2021-03-10T14:48:22.740133+0000 mgr.gibba043.dnkmem (mgr.34373) 3048 : audit [DBG] from='client.46104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:23 gibba043 bash[24019]: audit 2021-03-10T14:48:22.968140+0000 mgr.gibba043.dnkmem (mgr.34373) 3049 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:23 gibba043 bash[24019]: audit 2021-03-10T14:48:23.233386+0000 mon.a (mon.0) 932 : audit [DBG] from='client.? 172.21.2.103:0/3185941297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:24.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:24 gibba003 bash[31385]: cluster 2021-03-10T14:48:23.564619+0000 mgr.gibba043.dnkmem (mgr.34373) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:24 gibba003 bash[32348]: cluster 2021-03-10T14:48:23.564619+0000 mgr.gibba043.dnkmem (mgr.34373) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:24 gibba043 bash[24019]: cluster 2021-03-10T14:48:23.564619+0000 mgr.gibba043.dnkmem (mgr.34373) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:26 gibba043 bash[24019]: cluster 2021-03-10T14:48:25.566122+0000 mgr.gibba043.dnkmem (mgr.34373) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:26 gibba003 bash[31385]: cluster 2021-03-10T14:48:25.566122+0000 mgr.gibba043.dnkmem (mgr.34373) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:26 gibba003 bash[32348]: cluster 2021-03-10T14:48:25.566122+0000 mgr.gibba043.dnkmem (mgr.34373) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:28 gibba043 bash[24019]: cluster 2021-03-10T14:48:27.567499+0000 mgr.gibba043.dnkmem (mgr.34373) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:28 gibba003 bash[31385]: cluster 2021-03-10T14:48:27.567499+0000 mgr.gibba043.dnkmem (mgr.34373) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:28 gibba003 bash[32348]: cluster 2021-03-10T14:48:27.567499+0000 mgr.gibba043.dnkmem (mgr.34373) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:30 gibba043 bash[24019]: cluster 2021-03-10T14:48:29.569298+0000 mgr.gibba043.dnkmem (mgr.34373) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:30 gibba003 bash[31385]: cluster 2021-03-10T14:48:29.569298+0000 mgr.gibba043.dnkmem (mgr.34373) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:30 gibba003 bash[32348]: cluster 2021-03-10T14:48:29.569298+0000 mgr.gibba043.dnkmem (mgr.34373) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:32 gibba043 bash[24019]: cluster 2021-03-10T14:48:31.570803+0000 mgr.gibba043.dnkmem (mgr.34373) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:32 gibba003 bash[31385]: cluster 2021-03-10T14:48:31.570803+0000 mgr.gibba043.dnkmem (mgr.34373) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:32 gibba003 bash[32348]: cluster 2021-03-10T14:48:31.570803+0000 mgr.gibba043.dnkmem (mgr.34373) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:34 gibba003 bash[31385]: cluster 2021-03-10T14:48:33.572468+0000 mgr.gibba043.dnkmem (mgr.34373) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:34 gibba003 bash[32348]: cluster 2021-03-10T14:48:33.572468+0000 mgr.gibba043.dnkmem (mgr.34373) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.766 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:34 gibba043 bash[24019]: cluster 2021-03-10T14:48:33.572468+0000 mgr.gibba043.dnkmem (mgr.34373) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.541037+0000 mgr.gibba043.dnkmem (mgr.34373) 3056 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:48:36.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.542602+0000 mgr.gibba043.dnkmem (mgr.34373) 3057 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:48:36.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.752556+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:48:36.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.753383+0000 mgr.gibba043.dnkmem (mgr.34373) 3058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:36.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.754971+0000 mgr.gibba043.dnkmem (mgr.34373) 3059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:36.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.756135+0000 mon.c (mon.1) 826 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:36.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.756643+0000 mgr.gibba043.dnkmem (mgr.34373) 3060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:36.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.756681+0000 mgr.gibba043.dnkmem (mgr.34373) 3061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:36.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.757545+0000 mon.c (mon.1) 827 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.758245+0000 mgr.gibba043.dnkmem (mgr.34373) 3062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:36.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.758285+0000 mgr.gibba043.dnkmem (mgr.34373) 3063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:36.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.759313+0000 mon.c (mon.1) 828 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.759744+0000 mgr.gibba043.dnkmem (mgr.34373) 3064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:36.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.760793+0000 mon.c (mon.1) 829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.761411+0000 mgr.gibba043.dnkmem (mgr.34373) 3065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:36.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.761447+0000 mgr.gibba043.dnkmem (mgr.34373) 3066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:36.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.762742+0000 mgr.gibba043.dnkmem (mgr.34373) 3067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:36.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.763068+0000 mgr.gibba043.dnkmem (mgr.34373) 3068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:36.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.763975+0000 mon.c (mon.1) 830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.764461+0000 mgr.gibba043.dnkmem (mgr.34373) 3069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:36.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.764501+0000 mgr.gibba043.dnkmem (mgr.34373) 3070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:36.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: cephadm 2021-03-10T14:48:34.764606+0000 mgr.gibba043.dnkmem (mgr.34373) 3071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:36.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:35 gibba043 bash[24019]: audit 2021-03-10T14:48:34.765532+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.541037+0000 mgr.gibba043.dnkmem (mgr.34373) 3056 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:48:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.542602+0000 mgr.gibba043.dnkmem (mgr.34373) 3057 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:48:36.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.752556+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:48:36.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.753383+0000 mgr.gibba043.dnkmem (mgr.34373) 3058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:36.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.754971+0000 mgr.gibba043.dnkmem (mgr.34373) 3059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:36.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.756135+0000 mon.c (mon.1) 826 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.756643+0000 mgr.gibba043.dnkmem (mgr.34373) 3060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.756681+0000 mgr.gibba043.dnkmem (mgr.34373) 3061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.757545+0000 mon.c (mon.1) 827 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.758245+0000 mgr.gibba043.dnkmem (mgr.34373) 3062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.758285+0000 mgr.gibba043.dnkmem (mgr.34373) 3063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.759313+0000 mon.c (mon.1) 828 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.759744+0000 mgr.gibba043.dnkmem (mgr.34373) 3064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.760793+0000 mon.c (mon.1) 829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.761411+0000 mgr.gibba043.dnkmem (mgr.34373) 3065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.761447+0000 mgr.gibba043.dnkmem (mgr.34373) 3066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.762742+0000 mgr.gibba043.dnkmem (mgr.34373) 3067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.763068+0000 mgr.gibba043.dnkmem (mgr.34373) 3068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.763975+0000 mon.c (mon.1) 830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.764461+0000 mgr.gibba043.dnkmem (mgr.34373) 3069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.764501+0000 mgr.gibba043.dnkmem (mgr.34373) 3070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: cephadm 2021-03-10T14:48:34.764606+0000 mgr.gibba043.dnkmem (mgr.34373) 3071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[31385]: audit 2021-03-10T14:48:34.765532+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.541037+0000 mgr.gibba043.dnkmem (mgr.34373) 3056 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:48:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.542602+0000 mgr.gibba043.dnkmem (mgr.34373) 3057 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:48:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.752556+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:48:36.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.753383+0000 mgr.gibba043.dnkmem (mgr.34373) 3058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.754971+0000 mgr.gibba043.dnkmem (mgr.34373) 3059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.756135+0000 mon.c (mon.1) 826 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.756643+0000 mgr.gibba043.dnkmem (mgr.34373) 3060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.756681+0000 mgr.gibba043.dnkmem (mgr.34373) 3061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:36.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.757545+0000 mon.c (mon.1) 827 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.758245+0000 mgr.gibba043.dnkmem (mgr.34373) 3062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.758285+0000 mgr.gibba043.dnkmem (mgr.34373) 3063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.759313+0000 mon.c (mon.1) 828 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.759744+0000 mgr.gibba043.dnkmem (mgr.34373) 3064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.760793+0000 mon.c (mon.1) 829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.761411+0000 mgr.gibba043.dnkmem (mgr.34373) 3065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.761447+0000 mgr.gibba043.dnkmem (mgr.34373) 3066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.762742+0000 mgr.gibba043.dnkmem (mgr.34373) 3067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.763068+0000 mgr.gibba043.dnkmem (mgr.34373) 3068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.763975+0000 mon.c (mon.1) 830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.764461+0000 mgr.gibba043.dnkmem (mgr.34373) 3069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.764501+0000 mgr.gibba043.dnkmem (mgr.34373) 3070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: cephadm 2021-03-10T14:48:34.764606+0000 mgr.gibba043.dnkmem (mgr.34373) 3071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:36.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:35 gibba003 bash[32348]: audit 2021-03-10T14:48:34.765532+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:37.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:36 gibba043 bash[24019]: cluster 2021-03-10T14:48:35.573937+0000 mgr.gibba043.dnkmem (mgr.34373) 3072 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:37.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:36 gibba003 bash[31385]: cluster 2021-03-10T14:48:35.573937+0000 mgr.gibba043.dnkmem (mgr.34373) 3072 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:36 gibba003 bash[32348]: cluster 2021-03-10T14:48:35.573937+0000 mgr.gibba043.dnkmem (mgr.34373) 3072 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:38 gibba003 bash[31385]: cluster 2021-03-10T14:48:37.575454+0000 mgr.gibba043.dnkmem (mgr.34373) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:38 gibba003 bash[32348]: cluster 2021-03-10T14:48:37.575454+0000 mgr.gibba043.dnkmem (mgr.34373) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:38 gibba043 bash[24019]: cluster 2021-03-10T14:48:37.575454+0000 mgr.gibba043.dnkmem (mgr.34373) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:40 gibba003 bash[31385]: cluster 2021-03-10T14:48:39.577169+0000 mgr.gibba043.dnkmem (mgr.34373) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:40 gibba003 bash[32348]: cluster 2021-03-10T14:48:39.577169+0000 mgr.gibba043.dnkmem (mgr.34373) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:40 gibba043 bash[24019]: cluster 2021-03-10T14:48:39.577169+0000 mgr.gibba043.dnkmem (mgr.34373) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:42 gibba003 bash[31385]: cluster 2021-03-10T14:48:41.578828+0000 mgr.gibba043.dnkmem (mgr.34373) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:43.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:42 gibba003 bash[32348]: cluster 2021-03-10T14:48:41.578828+0000 mgr.gibba043.dnkmem (mgr.34373) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:42 gibba043 bash[24019]: cluster 2021-03-10T14:48:41.578828+0000 mgr.gibba043.dnkmem (mgr.34373) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:44 gibba003 bash[31385]: cluster 2021-03-10T14:48:43.580470+0000 mgr.gibba043.dnkmem (mgr.34373) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:44 gibba003 bash[32348]: cluster 2021-03-10T14:48:43.580470+0000 mgr.gibba043.dnkmem (mgr.34373) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:44 gibba043 bash[24019]: cluster 2021-03-10T14:48:43.580470+0000 mgr.gibba043.dnkmem (mgr.34373) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:46 gibba003 bash[31385]: cluster 2021-03-10T14:48:45.582034+0000 mgr.gibba043.dnkmem (mgr.34373) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:46 gibba003 bash[32348]: cluster 2021-03-10T14:48:45.582034+0000 mgr.gibba043.dnkmem (mgr.34373) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:46 gibba043 bash[24019]: cluster 2021-03-10T14:48:45.582034+0000 mgr.gibba043.dnkmem (mgr.34373) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:48 gibba003 bash[31385]: cluster 2021-03-10T14:48:47.583736+0000 mgr.gibba043.dnkmem (mgr.34373) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:48 gibba003 bash[32348]: cluster 2021-03-10T14:48:47.583736+0000 mgr.gibba043.dnkmem (mgr.34373) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:48 gibba043 bash[24019]: cluster 2021-03-10T14:48:47.583736+0000 mgr.gibba043.dnkmem (mgr.34373) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:50 gibba003 bash[31385]: cluster 2021-03-10T14:48:49.585156+0000 mgr.gibba043.dnkmem (mgr.34373) 3079 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:50 gibba003 bash[31385]: cephadm 2021-03-10T14:48:49.771742+0000 mgr.gibba043.dnkmem (mgr.34373) 3080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:50.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:50 gibba003 bash[32348]: cluster 2021-03-10T14:48:49.585156+0000 mgr.gibba043.dnkmem (mgr.34373) 3079 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:50 gibba003 bash[32348]: cephadm 2021-03-10T14:48:49.771742+0000 mgr.gibba043.dnkmem (mgr.34373) 3080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:51.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:50 gibba043 bash[24019]: cluster 2021-03-10T14:48:49.585156+0000 mgr.gibba043.dnkmem (mgr.34373) 3079 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:50 gibba043 bash[24019]: cephadm 2021-03-10T14:48:49.771742+0000 mgr.gibba043.dnkmem (mgr.34373) 3080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:48:52.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:52 gibba003 bash[31385]: cluster 2021-03-10T14:48:51.586810+0000 mgr.gibba043.dnkmem (mgr.34373) 3081 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:52.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:52 gibba003 bash[32348]: cluster 2021-03-10T14:48:51.586810+0000 mgr.gibba043.dnkmem (mgr.34373) 3081 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:53.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:52 gibba043 bash[24019]: cluster 2021-03-10T14:48:51.586810+0000 mgr.gibba043.dnkmem (mgr.34373) 3081 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:53.477 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:48:53.705 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:48:53.705 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (57m) 2m ago 62m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:48:53.705 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (62m) 84s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:48:53.706 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (57m) 84s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:48:53.706 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (57m) 84s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:48:53.706 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:48:53.706 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:48:53.707 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (56m) 84s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:48:53.707 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:48:53.707 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (62m) 2m ago 62m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:48:53.707 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (62m) 84s ago 62m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:48:53.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:48:53.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:48:53.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:48:53.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:48:53.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (53m) 84s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:48:53.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (53m) 84s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:48:53.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (52m) 84s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:48:53.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (52m) 84s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:48:53.709 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (62m) 84s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:48:53.709 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:48:53.952 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:48:53.953 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:48:53.953 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:53.953 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:48:53.953 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:48:53.954 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:53.954 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:48:53.954 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:48:53.954 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:48:53.955 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:48:53.955 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:48:53.955 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:48:53.955 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:48:53.956 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:48:53.956 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:48:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[31385]: audit 2021-03-10T14:48:53.466087+0000 mgr.gibba043.dnkmem (mgr.34373) 3082 : audit [DBG] from='client.46122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[31385]: cluster 2021-03-10T14:48:53.588697+0000 mgr.gibba043.dnkmem (mgr.34373) 3083 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[31385]: audit 2021-03-10T14:48:53.690599+0000 mgr.gibba043.dnkmem (mgr.34373) 3084 : audit [DBG] from='client.56116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:54.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[31385]: audit 2021-03-10T14:48:53.952496+0000 mon.c (mon.1) 832 : audit [DBG] from='client.? 172.21.2.103:0/2644388629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[32348]: audit 2021-03-10T14:48:53.466087+0000 mgr.gibba043.dnkmem (mgr.34373) 3082 : audit [DBG] from='client.46122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[32348]: cluster 2021-03-10T14:48:53.588697+0000 mgr.gibba043.dnkmem (mgr.34373) 3083 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[32348]: audit 2021-03-10T14:48:53.690599+0000 mgr.gibba043.dnkmem (mgr.34373) 3084 : audit [DBG] from='client.56116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:54.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:54 gibba003 bash[32348]: audit 2021-03-10T14:48:53.952496+0000 mon.c (mon.1) 832 : audit [DBG] from='client.? 172.21.2.103:0/2644388629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:54 gibba043 bash[24019]: audit 2021-03-10T14:48:53.466087+0000 mgr.gibba043.dnkmem (mgr.34373) 3082 : audit [DBG] from='client.46122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:54 gibba043 bash[24019]: cluster 2021-03-10T14:48:53.588697+0000 mgr.gibba043.dnkmem (mgr.34373) 3083 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:54 gibba043 bash[24019]: audit 2021-03-10T14:48:53.690599+0000 mgr.gibba043.dnkmem (mgr.34373) 3084 : audit [DBG] from='client.56116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:54 gibba043 bash[24019]: audit 2021-03-10T14:48:53.952496+0000 mon.c (mon.1) 832 : audit [DBG] from='client.? 172.21.2.103:0/2644388629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:56 gibba003 bash[31385]: cluster 2021-03-10T14:48:55.590121+0000 mgr.gibba043.dnkmem (mgr.34373) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:56.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:56 gibba003 bash[32348]: cluster 2021-03-10T14:48:55.590121+0000 mgr.gibba043.dnkmem (mgr.34373) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:56 gibba043 bash[24019]: cluster 2021-03-10T14:48:55.590121+0000 mgr.gibba043.dnkmem (mgr.34373) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:48:58 gibba003 bash[31385]: cluster 2021-03-10T14:48:57.591487+0000 mgr.gibba043.dnkmem (mgr.34373) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:48:58 gibba003 bash[32348]: cluster 2021-03-10T14:48:57.591487+0000 mgr.gibba043.dnkmem (mgr.34373) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:48:58 gibba043 bash[24019]: cluster 2021-03-10T14:48:57.591487+0000 mgr.gibba043.dnkmem (mgr.34373) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:00 gibba003 bash[31385]: cluster 2021-03-10T14:48:59.591976+0000 mgr.gibba043.dnkmem (mgr.34373) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:00 gibba003 bash[32348]: cluster 2021-03-10T14:48:59.591976+0000 mgr.gibba043.dnkmem (mgr.34373) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:01.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:00 gibba043 bash[24019]: cluster 2021-03-10T14:48:59.591976+0000 mgr.gibba043.dnkmem (mgr.34373) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:02 gibba003 bash[31385]: cluster 2021-03-10T14:49:01.593670+0000 mgr.gibba043.dnkmem (mgr.34373) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:02.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:02 gibba003 bash[32348]: cluster 2021-03-10T14:49:01.593670+0000 mgr.gibba043.dnkmem (mgr.34373) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:02 gibba043 bash[24019]: cluster 2021-03-10T14:49:01.593670+0000 mgr.gibba043.dnkmem (mgr.34373) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:04 gibba003 bash[31385]: cluster 2021-03-10T14:49:03.595258+0000 mgr.gibba043.dnkmem (mgr.34373) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:04 gibba003 bash[32348]: cluster 2021-03-10T14:49:03.595258+0000 mgr.gibba043.dnkmem (mgr.34373) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:04 gibba043 bash[24019]: cluster 2021-03-10T14:49:03.595258+0000 mgr.gibba043.dnkmem (mgr.34373) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:05 gibba003 bash[31385]: cephadm 2021-03-10T14:49:04.784379+0000 mgr.gibba043.dnkmem (mgr.34373) 3090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:05 gibba003 bash[32348]: cephadm 2021-03-10T14:49:04.784379+0000 mgr.gibba043.dnkmem (mgr.34373) 3090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:05.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:05 gibba043 bash[24019]: cephadm 2021-03-10T14:49:04.784379+0000 mgr.gibba043.dnkmem (mgr.34373) 3090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:06.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:06 gibba003 bash[31385]: cluster 2021-03-10T14:49:05.596680+0000 mgr.gibba043.dnkmem (mgr.34373) 3091 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:06.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:06 gibba003 bash[32348]: cluster 2021-03-10T14:49:05.596680+0000 mgr.gibba043.dnkmem (mgr.34373) 3091 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:06.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:06 gibba043 bash[24019]: cluster 2021-03-10T14:49:05.596680+0000 mgr.gibba043.dnkmem (mgr.34373) 3091 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:08.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:08 gibba003 bash[31385]: cluster 2021-03-10T14:49:07.598069+0000 mgr.gibba043.dnkmem (mgr.34373) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:08.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:08 gibba003 bash[32348]: cluster 2021-03-10T14:49:07.598069+0000 mgr.gibba043.dnkmem (mgr.34373) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:08 gibba043 bash[24019]: cluster 2021-03-10T14:49:07.598069+0000 mgr.gibba043.dnkmem (mgr.34373) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:10 gibba003 bash[31385]: cluster 2021-03-10T14:49:09.598651+0000 mgr.gibba043.dnkmem (mgr.34373) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:10 gibba003 bash[32348]: cluster 2021-03-10T14:49:09.598651+0000 mgr.gibba043.dnkmem (mgr.34373) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:11.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:10 gibba043 bash[24019]: cluster 2021-03-10T14:49:09.598651+0000 mgr.gibba043.dnkmem (mgr.34373) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:12.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:12 gibba003 bash[31385]: cluster 2021-03-10T14:49:11.600396+0000 mgr.gibba043.dnkmem (mgr.34373) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:12.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:12 gibba003 bash[32348]: cluster 2021-03-10T14:49:11.600396+0000 mgr.gibba043.dnkmem (mgr.34373) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:12 gibba043 bash[24019]: cluster 2021-03-10T14:49:11.600396+0000 mgr.gibba043.dnkmem (mgr.34373) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.073987+0000 mon.c (mon.1) 833 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.075111+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.133340+0000 mon.c (mon.1) 834 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:49:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.134123+0000 mon.c (mon.1) 835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:49:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.134713+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:49:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.134831+0000 mon.c (mon.1) 836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.135533+0000 mon.c (mon.1) 837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.137331+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:49:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.138536+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.139590+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.154497+0000 mon.c (mon.1) 838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[31385]: audit 2021-03-10T14:49:13.154949+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.073987+0000 mon.c (mon.1) 833 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.075111+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.133340+0000 mon.c (mon.1) 834 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:49:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.134123+0000 mon.c (mon.1) 835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:49:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.134713+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:49:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.134831+0000 mon.c (mon.1) 836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.135533+0000 mon.c (mon.1) 837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.137331+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:49:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.138536+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.139590+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:49:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.154497+0000 mon.c (mon.1) 838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:13 gibba003 bash[32348]: audit 2021-03-10T14:49:13.154949+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.073987+0000 mon.c (mon.1) 833 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.075111+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.133340+0000 mon.c (mon.1) 834 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:49:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.134123+0000 mon.c (mon.1) 835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:49:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.134713+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:49:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.134831+0000 mon.c (mon.1) 836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.135533+0000 mon.c (mon.1) 837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:49:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.137331+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:49:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.138536+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.139590+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:49:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.154497+0000 mon.c (mon.1) 838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:13 gibba043 bash[24019]: audit 2021-03-10T14:49:13.154949+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:14 gibba003 bash[31385]: cluster 2021-03-10T14:49:13.601980+0000 mgr.gibba043.dnkmem (mgr.34373) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:14 gibba003 bash[32348]: cluster 2021-03-10T14:49:13.601980+0000 mgr.gibba043.dnkmem (mgr.34373) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:14 gibba043 bash[24019]: cluster 2021-03-10T14:49:13.601980+0000 mgr.gibba043.dnkmem (mgr.34373) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:17.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:16 gibba043 bash[24019]: cluster 2021-03-10T14:49:15.603527+0000 mgr.gibba043.dnkmem (mgr.34373) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:16 gibba003 bash[31385]: cluster 2021-03-10T14:49:15.603527+0000 mgr.gibba043.dnkmem (mgr.34373) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:17.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:16 gibba003 bash[32348]: cluster 2021-03-10T14:49:15.603527+0000 mgr.gibba043.dnkmem (mgr.34373) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:18 gibba043 bash[24019]: cluster 2021-03-10T14:49:17.604960+0000 mgr.gibba043.dnkmem (mgr.34373) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:18 gibba003 bash[31385]: cluster 2021-03-10T14:49:17.604960+0000 mgr.gibba043.dnkmem (mgr.34373) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:18 gibba003 bash[32348]: cluster 2021-03-10T14:49:17.604960+0000 mgr.gibba043.dnkmem (mgr.34373) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:20 gibba043 bash[24019]: cluster 2021-03-10T14:49:19.605503+0000 mgr.gibba043.dnkmem (mgr.34373) 3098 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:20 gibba043 bash[24019]: cephadm 2021-03-10T14:49:19.800223+0000 mgr.gibba043.dnkmem (mgr.34373) 3099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:20 gibba003 bash[31385]: cluster 2021-03-10T14:49:19.605503+0000 mgr.gibba043.dnkmem (mgr.34373) 3098 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:20 gibba003 bash[31385]: cephadm 2021-03-10T14:49:19.800223+0000 mgr.gibba043.dnkmem (mgr.34373) 3099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:20 gibba003 bash[32348]: cluster 2021-03-10T14:49:19.605503+0000 mgr.gibba043.dnkmem (mgr.34373) 3098 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:20 gibba003 bash[32348]: cephadm 2021-03-10T14:49:19.800223+0000 mgr.gibba043.dnkmem (mgr.34373) 3099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:23.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:22 gibba043 bash[24019]: cluster 2021-03-10T14:49:21.606887+0000 mgr.gibba043.dnkmem (mgr.34373) 3100 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:22 gibba003 bash[31385]: cluster 2021-03-10T14:49:21.606887+0000 mgr.gibba043.dnkmem (mgr.34373) 3100 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:22 gibba003 bash[32348]: cluster 2021-03-10T14:49:21.606887+0000 mgr.gibba043.dnkmem (mgr.34373) 3100 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.195 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:49:24.458 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:49:24.459 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (57m) 2m ago 63m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:49:24.459 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (62m) 114s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:49:24.459 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (58m) 114s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:49:24.460 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (58m) 114s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:49:24.460 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:49:24.460 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:49:24.460 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (56m) 114s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:49:24.460 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:49:24.461 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:49:24.461 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (63m) 114s ago 63m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:49:24.461 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:49:24.461 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:49:24.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:49:24.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:49:24.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (54m) 114s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:49:24.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (53m) 114s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:49:24.462 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (53m) 114s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:49:24.463 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (53m) 114s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:49:24.463 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (62m) 114s ago 63m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:49:24.463 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:49:24.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:24 gibba003 bash[31385]: cluster 2021-03-10T14:49:23.608610+0000 mgr.gibba043.dnkmem (mgr.34373) 3101 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:24 gibba003 bash[31385]: audit 2021-03-10T14:49:24.184473+0000 mgr.gibba043.dnkmem (mgr.34373) 3102 : audit [DBG] from='client.46140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:24 gibba003 bash[32348]: cluster 2021-03-10T14:49:23.608610+0000 mgr.gibba043.dnkmem (mgr.34373) 3101 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:24 gibba003 bash[32348]: audit 2021-03-10T14:49:24.184473+0000 mgr.gibba043.dnkmem (mgr.34373) 3102 : audit [DBG] from='client.46140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:24.711 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:49:24.711 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:49:24.712 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:24.712 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:49:24.712 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:49:24.712 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:24.712 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:49:24.713 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:49:24.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:49:24.713 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:49:24.713 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:49:24.713 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:49:24.714 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:49:24.714 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:49:24.714 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:49:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:24 gibba043 bash[24019]: cluster 2021-03-10T14:49:23.608610+0000 mgr.gibba043.dnkmem (mgr.34373) 3101 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:24 gibba043 bash[24019]: audit 2021-03-10T14:49:24.184473+0000 mgr.gibba043.dnkmem (mgr.34373) 3102 : audit [DBG] from='client.46140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:25.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:25 gibba003 bash[31385]: audit 2021-03-10T14:49:24.415579+0000 mgr.gibba043.dnkmem (mgr.34373) 3103 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:25.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:25 gibba003 bash[31385]: audit 2021-03-10T14:49:24.711335+0000 mon.a (mon.0) 940 : audit [DBG] from='client.? 172.21.2.103:0/1854972166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:25.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:25 gibba003 bash[32348]: audit 2021-03-10T14:49:24.415579+0000 mgr.gibba043.dnkmem (mgr.34373) 3103 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:25.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:25 gibba003 bash[32348]: audit 2021-03-10T14:49:24.711335+0000 mon.a (mon.0) 940 : audit [DBG] from='client.? 172.21.2.103:0/1854972166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:25.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:25 gibba043 bash[24019]: audit 2021-03-10T14:49:24.415579+0000 mgr.gibba043.dnkmem (mgr.34373) 3103 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:25.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:25 gibba043 bash[24019]: audit 2021-03-10T14:49:24.711335+0000 mon.a (mon.0) 940 : audit [DBG] from='client.? 172.21.2.103:0/1854972166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:26.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:26 gibba003 bash[31385]: cluster 2021-03-10T14:49:25.610152+0000 mgr.gibba043.dnkmem (mgr.34373) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:26 gibba003 bash[32348]: cluster 2021-03-10T14:49:25.610152+0000 mgr.gibba043.dnkmem (mgr.34373) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:26.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:26 gibba043 bash[24019]: cluster 2021-03-10T14:49:25.610152+0000 mgr.gibba043.dnkmem (mgr.34373) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:28 gibba003 bash[31385]: cluster 2021-03-10T14:49:27.611815+0000 mgr.gibba043.dnkmem (mgr.34373) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:28 gibba003 bash[32348]: cluster 2021-03-10T14:49:27.611815+0000 mgr.gibba043.dnkmem (mgr.34373) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:28 gibba043 bash[24019]: cluster 2021-03-10T14:49:27.611815+0000 mgr.gibba043.dnkmem (mgr.34373) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:30 gibba003 bash[31385]: cluster 2021-03-10T14:49:29.612414+0000 mgr.gibba043.dnkmem (mgr.34373) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:30 gibba003 bash[32348]: cluster 2021-03-10T14:49:29.612414+0000 mgr.gibba043.dnkmem (mgr.34373) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:30 gibba043 bash[24019]: cluster 2021-03-10T14:49:29.612414+0000 mgr.gibba043.dnkmem (mgr.34373) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:32 gibba043 bash[24019]: cluster 2021-03-10T14:49:31.613921+0000 mgr.gibba043.dnkmem (mgr.34373) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:32 gibba003 bash[31385]: cluster 2021-03-10T14:49:31.613921+0000 mgr.gibba043.dnkmem (mgr.34373) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:32 gibba003 bash[32348]: cluster 2021-03-10T14:49:31.613921+0000 mgr.gibba043.dnkmem (mgr.34373) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:34 gibba003 bash[31385]: cluster 2021-03-10T14:49:33.615551+0000 mgr.gibba043.dnkmem (mgr.34373) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:34 gibba003 bash[32348]: cluster 2021-03-10T14:49:33.615551+0000 mgr.gibba043.dnkmem (mgr.34373) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:34 gibba043 bash[24019]: cluster 2021-03-10T14:49:33.615551+0000 mgr.gibba043.dnkmem (mgr.34373) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:36.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:34.804171+0000 mgr.gibba043.dnkmem (mgr.34373) 3109 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:49:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:34.805741+0000 mgr.gibba043.dnkmem (mgr.34373) 3110 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:49:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.003669+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:49:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.004616+0000 mgr.gibba043.dnkmem (mgr.34373) 3111 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:36.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.006272+0000 mgr.gibba043.dnkmem (mgr.34373) 3112 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.007364+0000 mon.c (mon.1) 839 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.007786+0000 mgr.gibba043.dnkmem (mgr.34373) 3113 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.007825+0000 mgr.gibba043.dnkmem (mgr.34373) 3114 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.008854+0000 mon.c (mon.1) 840 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.009094+0000 mgr.gibba043.dnkmem (mgr.34373) 3115 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.009133+0000 mgr.gibba043.dnkmem (mgr.34373) 3116 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.010317+0000 mgr.gibba043.dnkmem (mgr.34373) 3117 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.010379+0000 mon.c (mon.1) 841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.011559+0000 mgr.gibba043.dnkmem (mgr.34373) 3118 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.011597+0000 mgr.gibba043.dnkmem (mgr.34373) 3119 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.011636+0000 mon.c (mon.1) 842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.013067+0000 mgr.gibba043.dnkmem (mgr.34373) 3120 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.013429+0000 mgr.gibba043.dnkmem (mgr.34373) 3121 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.014260+0000 mon.c (mon.1) 843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.014447+0000 mgr.gibba043.dnkmem (mgr.34373) 3122 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.014527+0000 mgr.gibba043.dnkmem (mgr.34373) 3123 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: cephadm 2021-03-10T14:49:35.014677+0000 mgr.gibba043.dnkmem (mgr.34373) 3124 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:36 gibba043 bash[24019]: audit 2021-03-10T14:49:35.015724+0000 mon.c (mon.1) 844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:34.804171+0000 mgr.gibba043.dnkmem (mgr.34373) 3109 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:49:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:34.805741+0000 mgr.gibba043.dnkmem (mgr.34373) 3110 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:49:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.003669+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:49:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.004616+0000 mgr.gibba043.dnkmem (mgr.34373) 3111 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.006272+0000 mgr.gibba043.dnkmem (mgr.34373) 3112 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.007364+0000 mon.c (mon.1) 839 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.007786+0000 mgr.gibba043.dnkmem (mgr.34373) 3113 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.007825+0000 mgr.gibba043.dnkmem (mgr.34373) 3114 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.008854+0000 mon.c (mon.1) 840 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.009094+0000 mgr.gibba043.dnkmem (mgr.34373) 3115 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.009133+0000 mgr.gibba043.dnkmem (mgr.34373) 3116 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.010317+0000 mgr.gibba043.dnkmem (mgr.34373) 3117 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:36.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.010379+0000 mon.c (mon.1) 841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.011559+0000 mgr.gibba043.dnkmem (mgr.34373) 3118 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:36.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.011597+0000 mgr.gibba043.dnkmem (mgr.34373) 3119 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:36.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.011636+0000 mon.c (mon.1) 842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.013067+0000 mgr.gibba043.dnkmem (mgr.34373) 3120 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:36.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.013429+0000 mgr.gibba043.dnkmem (mgr.34373) 3121 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:36.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.014260+0000 mon.c (mon.1) 843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.014447+0000 mgr.gibba043.dnkmem (mgr.34373) 3122 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:36.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.014527+0000 mgr.gibba043.dnkmem (mgr.34373) 3123 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:36.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: cephadm 2021-03-10T14:49:35.014677+0000 mgr.gibba043.dnkmem (mgr.34373) 3124 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:36.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[31385]: audit 2021-03-10T14:49:35.015724+0000 mon.c (mon.1) 844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:34.804171+0000 mgr.gibba043.dnkmem (mgr.34373) 3109 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:49:36.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:34.805741+0000 mgr.gibba043.dnkmem (mgr.34373) 3110 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:49:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.003669+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:49:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.004616+0000 mgr.gibba043.dnkmem (mgr.34373) 3111 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.006272+0000 mgr.gibba043.dnkmem (mgr.34373) 3112 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:36.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.007364+0000 mon.c (mon.1) 839 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:36.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.007786+0000 mgr.gibba043.dnkmem (mgr.34373) 3113 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:36.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.007825+0000 mgr.gibba043.dnkmem (mgr.34373) 3114 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:36.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.008854+0000 mon.c (mon.1) 840 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.009094+0000 mgr.gibba043.dnkmem (mgr.34373) 3115 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:36.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.009133+0000 mgr.gibba043.dnkmem (mgr.34373) 3116 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:36.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.010317+0000 mgr.gibba043.dnkmem (mgr.34373) 3117 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:36.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.010379+0000 mon.c (mon.1) 841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.011559+0000 mgr.gibba043.dnkmem (mgr.34373) 3118 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:36.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.011597+0000 mgr.gibba043.dnkmem (mgr.34373) 3119 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:36.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.011636+0000 mon.c (mon.1) 842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.013067+0000 mgr.gibba043.dnkmem (mgr.34373) 3120 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:36.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.013429+0000 mgr.gibba043.dnkmem (mgr.34373) 3121 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:36.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.014260+0000 mon.c (mon.1) 843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.014447+0000 mgr.gibba043.dnkmem (mgr.34373) 3122 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:36.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.014527+0000 mgr.gibba043.dnkmem (mgr.34373) 3123 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:36.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: cephadm 2021-03-10T14:49:35.014677+0000 mgr.gibba043.dnkmem (mgr.34373) 3124 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:36.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:36 gibba003 bash[32348]: audit 2021-03-10T14:49:35.015724+0000 mon.c (mon.1) 844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:37 gibba003 bash[31385]: cluster 2021-03-10T14:49:35.617040+0000 mgr.gibba043.dnkmem (mgr.34373) 3125 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:37 gibba003 bash[32348]: cluster 2021-03-10T14:49:35.617040+0000 mgr.gibba043.dnkmem (mgr.34373) 3125 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:37 gibba043 bash[24019]: cluster 2021-03-10T14:49:35.617040+0000 mgr.gibba043.dnkmem (mgr.34373) 3125 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:39 gibba003 bash[31385]: cluster 2021-03-10T14:49:37.618640+0000 mgr.gibba043.dnkmem (mgr.34373) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:39 gibba003 bash[32348]: cluster 2021-03-10T14:49:37.618640+0000 mgr.gibba043.dnkmem (mgr.34373) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:39 gibba043 bash[24019]: cluster 2021-03-10T14:49:37.618640+0000 mgr.gibba043.dnkmem (mgr.34373) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:41 gibba003 bash[32348]: cluster 2021-03-10T14:49:39.619336+0000 mgr.gibba043.dnkmem (mgr.34373) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:41 gibba003 bash[31385]: cluster 2021-03-10T14:49:39.619336+0000 mgr.gibba043.dnkmem (mgr.34373) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:41 gibba043 bash[24019]: cluster 2021-03-10T14:49:39.619336+0000 mgr.gibba043.dnkmem (mgr.34373) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:43 gibba003 bash[31385]: cluster 2021-03-10T14:49:41.620966+0000 mgr.gibba043.dnkmem (mgr.34373) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:43 gibba003 bash[32348]: cluster 2021-03-10T14:49:41.620966+0000 mgr.gibba043.dnkmem (mgr.34373) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:43 gibba043 bash[24019]: cluster 2021-03-10T14:49:41.620966+0000 mgr.gibba043.dnkmem (mgr.34373) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:44 gibba003 bash[31385]: cluster 2021-03-10T14:49:43.622277+0000 mgr.gibba043.dnkmem (mgr.34373) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:44 gibba003 bash[32348]: cluster 2021-03-10T14:49:43.622277+0000 mgr.gibba043.dnkmem (mgr.34373) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:44 gibba043 bash[24019]: cluster 2021-03-10T14:49:43.622277+0000 mgr.gibba043.dnkmem (mgr.34373) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:46 gibba003 bash[31385]: cluster 2021-03-10T14:49:45.623823+0000 mgr.gibba043.dnkmem (mgr.34373) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:46 gibba003 bash[32348]: cluster 2021-03-10T14:49:45.623823+0000 mgr.gibba043.dnkmem (mgr.34373) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:46 gibba043 bash[24019]: cluster 2021-03-10T14:49:45.623823+0000 mgr.gibba043.dnkmem (mgr.34373) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:48 gibba043 bash[24019]: cluster 2021-03-10T14:49:47.625380+0000 mgr.gibba043.dnkmem (mgr.34373) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:48 gibba003 bash[31385]: cluster 2021-03-10T14:49:47.625380+0000 mgr.gibba043.dnkmem (mgr.34373) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:48 gibba003 bash[32348]: cluster 2021-03-10T14:49:47.625380+0000 mgr.gibba043.dnkmem (mgr.34373) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:51.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:50 gibba043 bash[24019]: cluster 2021-03-10T14:49:49.626116+0000 mgr.gibba043.dnkmem (mgr.34373) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:50 gibba043 bash[24019]: cephadm 2021-03-10T14:49:50.029937+0000 mgr.gibba043.dnkmem (mgr.34373) 3133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:50 gibba003 bash[31385]: cluster 2021-03-10T14:49:49.626116+0000 mgr.gibba043.dnkmem (mgr.34373) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:50 gibba003 bash[31385]: cephadm 2021-03-10T14:49:50.029937+0000 mgr.gibba043.dnkmem (mgr.34373) 3133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:50 gibba003 bash[32348]: cluster 2021-03-10T14:49:49.626116+0000 mgr.gibba043.dnkmem (mgr.34373) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:51.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:50 gibba003 bash[32348]: cephadm 2021-03-10T14:49:50.029937+0000 mgr.gibba043.dnkmem (mgr.34373) 3133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:49:53.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:52 gibba043 bash[24019]: cluster 2021-03-10T14:49:51.627830+0000 mgr.gibba043.dnkmem (mgr.34373) 3134 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:53.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:52 gibba003 bash[31385]: cluster 2021-03-10T14:49:51.627830+0000 mgr.gibba043.dnkmem (mgr.34373) 3134 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:52 gibba003 bash[32348]: cluster 2021-03-10T14:49:51.627830+0000 mgr.gibba043.dnkmem (mgr.34373) 3134 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:54 gibba003 bash[31385]: cluster 2021-03-10T14:49:53.629178+0000 mgr.gibba043.dnkmem (mgr.34373) 3135 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:54 gibba003 bash[32348]: cluster 2021-03-10T14:49:53.629178+0000 mgr.gibba043.dnkmem (mgr.34373) 3135 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:54 gibba043 bash[24019]: cluster 2021-03-10T14:49:53.629178+0000 mgr.gibba043.dnkmem (mgr.34373) 3135 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.953 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:49:55.180 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:49:55.180 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (58m) 3m ago 63m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:49:55.180 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:49:55.180 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:49:55.181 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:49:55.181 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:49:55.181 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:49:55.181 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:49:55.181 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:49:55.182 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (63m) 3m ago 63m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:49:55.182 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:49:55.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:49:55.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:49:55.182 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:49:55.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:49:55.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:49:55.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:49:55.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:49:55.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:49:55.184 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (63m) 2m ago 63m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:49:55.184 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:49:55.437 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:49:55.437 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:49:55.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:55.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:49:55.438 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:49:55.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:55.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:49:55.439 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:49:55.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:49:55.439 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:49:55.439 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:49:55.439 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:49:55.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:49:55.440 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:49:55.440 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:49:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:55 gibba003 bash[31385]: audit 2021-03-10T14:49:54.942193+0000 mgr.gibba043.dnkmem (mgr.34373) 3136 : audit [DBG] from='client.56146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:55 gibba003 bash[31385]: audit 2021-03-10T14:49:55.165443+0000 mgr.gibba043.dnkmem (mgr.34373) 3137 : audit [DBG] from='client.56152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:55.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:55 gibba003 bash[32348]: audit 2021-03-10T14:49:54.942193+0000 mgr.gibba043.dnkmem (mgr.34373) 3136 : audit [DBG] from='client.56146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:55.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:55 gibba003 bash[32348]: audit 2021-03-10T14:49:55.165443+0000 mgr.gibba043.dnkmem (mgr.34373) 3137 : audit [DBG] from='client.56152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:55 gibba043 bash[24019]: audit 2021-03-10T14:49:54.942193+0000 mgr.gibba043.dnkmem (mgr.34373) 3136 : audit [DBG] from='client.56146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:55 gibba043 bash[24019]: audit 2021-03-10T14:49:55.165443+0000 mgr.gibba043.dnkmem (mgr.34373) 3137 : audit [DBG] from='client.56152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:56.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:56 gibba003 bash[31385]: audit 2021-03-10T14:49:55.437498+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.103:0/3549019736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:56.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:56 gibba003 bash[31385]: cluster 2021-03-10T14:49:55.630745+0000 mgr.gibba043.dnkmem (mgr.34373) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:56 gibba003 bash[32348]: audit 2021-03-10T14:49:55.437498+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.103:0/3549019736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:56.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:56 gibba003 bash[32348]: cluster 2021-03-10T14:49:55.630745+0000 mgr.gibba043.dnkmem (mgr.34373) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:56 gibba043 bash[24019]: audit 2021-03-10T14:49:55.437498+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.103:0/3549019736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:56 gibba043 bash[24019]: cluster 2021-03-10T14:49:55.630745+0000 mgr.gibba043.dnkmem (mgr.34373) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:49:58 gibba043 bash[24019]: cluster 2021-03-10T14:49:57.632161+0000 mgr.gibba043.dnkmem (mgr.34373) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:49:58 gibba003 bash[31385]: cluster 2021-03-10T14:49:57.632161+0000 mgr.gibba043.dnkmem (mgr.34373) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:49:58 gibba003 bash[32348]: cluster 2021-03-10T14:49:57.632161+0000 mgr.gibba043.dnkmem (mgr.34373) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:00 gibba003 bash[31385]: debug 2021-03-10T14:49:59.997+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:00 gibba043 bash[24019]: cluster 2021-03-10T14:49:59.633569+0000 mgr.gibba043.dnkmem (mgr.34373) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:00 gibba043 bash[24019]: cluster 2021-03-10T14:50:00.000308+0000 mon.a (mon.0) 942 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:00 gibba003 bash[31385]: cluster 2021-03-10T14:49:59.633569+0000 mgr.gibba043.dnkmem (mgr.34373) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:00 gibba003 bash[31385]: cluster 2021-03-10T14:50:00.000308+0000 mon.a (mon.0) 942 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:00 gibba003 bash[32348]: cluster 2021-03-10T14:49:59.633569+0000 mgr.gibba043.dnkmem (mgr.34373) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:00 gibba003 bash[32348]: cluster 2021-03-10T14:50:00.000308+0000 mon.a (mon.0) 942 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:02 gibba043 bash[24019]: cluster 2021-03-10T14:50:01.635217+0000 mgr.gibba043.dnkmem (mgr.34373) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:03.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:02 gibba003 bash[31385]: cluster 2021-03-10T14:50:01.635217+0000 mgr.gibba043.dnkmem (mgr.34373) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:03.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:02 gibba003 bash[32348]: cluster 2021-03-10T14:50:01.635217+0000 mgr.gibba043.dnkmem (mgr.34373) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:04 gibba003 bash[31385]: cluster 2021-03-10T14:50:03.636665+0000 mgr.gibba043.dnkmem (mgr.34373) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:04 gibba003 bash[32348]: cluster 2021-03-10T14:50:03.636665+0000 mgr.gibba043.dnkmem (mgr.34373) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:04 gibba043 bash[24019]: cluster 2021-03-10T14:50:03.636665+0000 mgr.gibba043.dnkmem (mgr.34373) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:05 gibba003 bash[31385]: cephadm 2021-03-10T14:50:05.044615+0000 mgr.gibba043.dnkmem (mgr.34373) 3143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:05 gibba003 bash[32348]: cephadm 2021-03-10T14:50:05.044615+0000 mgr.gibba043.dnkmem (mgr.34373) 3143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:05.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:05 gibba043 bash[24019]: cephadm 2021-03-10T14:50:05.044615+0000 mgr.gibba043.dnkmem (mgr.34373) 3143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:06.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:06 gibba003 bash[31385]: cluster 2021-03-10T14:50:05.637902+0000 mgr.gibba043.dnkmem (mgr.34373) 3144 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:06 gibba003 bash[32348]: cluster 2021-03-10T14:50:05.637902+0000 mgr.gibba043.dnkmem (mgr.34373) 3144 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:06 gibba043 bash[24019]: cluster 2021-03-10T14:50:05.637902+0000 mgr.gibba043.dnkmem (mgr.34373) 3144 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:08 gibba043 bash[24019]: cluster 2021-03-10T14:50:07.639619+0000 mgr.gibba043.dnkmem (mgr.34373) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:08 gibba003 bash[31385]: cluster 2021-03-10T14:50:07.639619+0000 mgr.gibba043.dnkmem (mgr.34373) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:08 gibba003 bash[32348]: cluster 2021-03-10T14:50:07.639619+0000 mgr.gibba043.dnkmem (mgr.34373) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:11.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:10 gibba043 bash[24019]: cluster 2021-03-10T14:50:09.640176+0000 mgr.gibba043.dnkmem (mgr.34373) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:11.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:10 gibba003 bash[31385]: cluster 2021-03-10T14:50:09.640176+0000 mgr.gibba043.dnkmem (mgr.34373) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:10 gibba003 bash[32348]: cluster 2021-03-10T14:50:09.640176+0000 mgr.gibba043.dnkmem (mgr.34373) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:12 gibba043 bash[24019]: cluster 2021-03-10T14:50:11.641801+0000 mgr.gibba043.dnkmem (mgr.34373) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:12 gibba003 bash[31385]: cluster 2021-03-10T14:50:11.641801+0000 mgr.gibba043.dnkmem (mgr.34373) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:13.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:12 gibba003 bash[32348]: cluster 2021-03-10T14:50:11.641801+0000 mgr.gibba043.dnkmem (mgr.34373) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.080527+0000 mon.c (mon.1) 846 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.081752+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.144518+0000 mon.c (mon.1) 847 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:50:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.145297+0000 mon.c (mon.1) 848 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.145885+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:50:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.145981+0000 mon.c (mon.1) 849 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.146740+0000 mon.c (mon.1) 850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.148523+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.149734+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.150962+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.157504+0000 mon.c (mon.1) 851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:13 gibba043 bash[24019]: audit 2021-03-10T14:50:13.157713+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.080527+0000 mon.c (mon.1) 846 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.081752+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.144518+0000 mon.c (mon.1) 847 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:50:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.145297+0000 mon.c (mon.1) 848 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.145885+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:50:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.145981+0000 mon.c (mon.1) 849 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.146740+0000 mon.c (mon.1) 850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.148523+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.149734+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.150962+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.157504+0000 mon.c (mon.1) 851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[31385]: audit 2021-03-10T14:50:13.157713+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.080527+0000 mon.c (mon.1) 846 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.081752+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.144518+0000 mon.c (mon.1) 847 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:50:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.145297+0000 mon.c (mon.1) 848 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.145885+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:50:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.145981+0000 mon.c (mon.1) 849 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.146740+0000 mon.c (mon.1) 850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.148523+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.149734+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.150962+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:50:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.157504+0000 mon.c (mon.1) 851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:13 gibba003 bash[32348]: audit 2021-03-10T14:50:13.157713+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:14 gibba043 bash[24019]: cluster 2021-03-10T14:50:13.643265+0000 mgr.gibba043.dnkmem (mgr.34373) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:14 gibba003 bash[31385]: cluster 2021-03-10T14:50:13.643265+0000 mgr.gibba043.dnkmem (mgr.34373) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:14 gibba003 bash[32348]: cluster 2021-03-10T14:50:13.643265+0000 mgr.gibba043.dnkmem (mgr.34373) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:17.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:16 gibba043 bash[24019]: cluster 2021-03-10T14:50:15.643802+0000 mgr.gibba043.dnkmem (mgr.34373) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:16 gibba003 bash[31385]: cluster 2021-03-10T14:50:15.643802+0000 mgr.gibba043.dnkmem (mgr.34373) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:17.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:16 gibba003 bash[32348]: cluster 2021-03-10T14:50:15.643802+0000 mgr.gibba043.dnkmem (mgr.34373) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:18 gibba043 bash[24019]: cluster 2021-03-10T14:50:17.645325+0000 mgr.gibba043.dnkmem (mgr.34373) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:18 gibba003 bash[31385]: cluster 2021-03-10T14:50:17.645325+0000 mgr.gibba043.dnkmem (mgr.34373) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:18 gibba003 bash[32348]: cluster 2021-03-10T14:50:17.645325+0000 mgr.gibba043.dnkmem (mgr.34373) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:21.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:20 gibba043 bash[24019]: cluster 2021-03-10T14:50:19.646702+0000 mgr.gibba043.dnkmem (mgr.34373) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:20 gibba043 bash[24019]: cephadm 2021-03-10T14:50:20.058929+0000 mgr.gibba043.dnkmem (mgr.34373) 3152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:20 gibba003 bash[31385]: cluster 2021-03-10T14:50:19.646702+0000 mgr.gibba043.dnkmem (mgr.34373) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:20 gibba003 bash[31385]: cephadm 2021-03-10T14:50:20.058929+0000 mgr.gibba043.dnkmem (mgr.34373) 3152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:20 gibba003 bash[32348]: cluster 2021-03-10T14:50:19.646702+0000 mgr.gibba043.dnkmem (mgr.34373) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:20 gibba003 bash[32348]: cephadm 2021-03-10T14:50:20.058929+0000 mgr.gibba043.dnkmem (mgr.34373) 3152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:22 gibba003 bash[31385]: cluster 2021-03-10T14:50:21.647481+0000 mgr.gibba043.dnkmem (mgr.34373) 3153 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:22 gibba003 bash[32348]: cluster 2021-03-10T14:50:21.647481+0000 mgr.gibba043.dnkmem (mgr.34373) 3153 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:22 gibba043 bash[24019]: cluster 2021-03-10T14:50:21.647481+0000 mgr.gibba043.dnkmem (mgr.34373) 3153 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:24 gibba003 bash[31385]: cluster 2021-03-10T14:50:23.648930+0000 mgr.gibba043.dnkmem (mgr.34373) 3154 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:24 gibba003 bash[32348]: cluster 2021-03-10T14:50:23.648930+0000 mgr.gibba043.dnkmem (mgr.34373) 3154 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:24 gibba043 bash[24019]: cluster 2021-03-10T14:50:23.648930+0000 mgr.gibba043.dnkmem (mgr.34373) 3154 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:25.682 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:50:25.913 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:50:25.914 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (58m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:50:25.914 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:50:25.914 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:50:25.915 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:50:25.915 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:50:25.915 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:50:25.915 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:50:25.916 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:50:25.916 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (64m) 4m ago 64m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:50:25.916 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (64m) 2m ago 64m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:50:25.916 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:50:25.916 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:50:25.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:50:25.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:50:25.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:50:25.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:50:25.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:50:25.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:50:25.918 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (63m) 2m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:50:25.918 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:50:26.162 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:50:26.162 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:50:26.163 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:26.163 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:50:26.163 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:50:26.163 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:26.164 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:50:26.164 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:50:26.164 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:50:26.164 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:50:26.164 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:50:26.165 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:50:26.165 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:50:26.165 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:50:26.165 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:50:27.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:26 gibba043 bash[24019]: cluster 2021-03-10T14:50:25.650200+0000 mgr.gibba043.dnkmem (mgr.34373) 3155 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:26 gibba043 bash[24019]: audit 2021-03-10T14:50:25.671817+0000 mgr.gibba043.dnkmem (mgr.34373) 3156 : audit [DBG] from='client.46176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:26 gibba043 bash[24019]: audit 2021-03-10T14:50:25.899588+0000 mgr.gibba043.dnkmem (mgr.34373) 3157 : audit [DBG] from='client.56170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:26 gibba043 bash[24019]: audit 2021-03-10T14:50:26.162035+0000 mon.a (mon.0) 949 : audit [DBG] from='client.? 172.21.2.103:0/3803001094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[31385]: cluster 2021-03-10T14:50:25.650200+0000 mgr.gibba043.dnkmem (mgr.34373) 3155 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[31385]: audit 2021-03-10T14:50:25.671817+0000 mgr.gibba043.dnkmem (mgr.34373) 3156 : audit [DBG] from='client.46176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[31385]: audit 2021-03-10T14:50:25.899588+0000 mgr.gibba043.dnkmem (mgr.34373) 3157 : audit [DBG] from='client.56170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[31385]: audit 2021-03-10T14:50:26.162035+0000 mon.a (mon.0) 949 : audit [DBG] from='client.? 172.21.2.103:0/3803001094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[32348]: cluster 2021-03-10T14:50:25.650200+0000 mgr.gibba043.dnkmem (mgr.34373) 3155 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[32348]: audit 2021-03-10T14:50:25.671817+0000 mgr.gibba043.dnkmem (mgr.34373) 3156 : audit [DBG] from='client.46176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[32348]: audit 2021-03-10T14:50:25.899588+0000 mgr.gibba043.dnkmem (mgr.34373) 3157 : audit [DBG] from='client.56170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:26 gibba003 bash[32348]: audit 2021-03-10T14:50:26.162035+0000 mon.a (mon.0) 949 : audit [DBG] from='client.? 172.21.2.103:0/3803001094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:28 gibba043 bash[24019]: cluster 2021-03-10T14:50:27.650956+0000 mgr.gibba043.dnkmem (mgr.34373) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:28 gibba003 bash[31385]: cluster 2021-03-10T14:50:27.650956+0000 mgr.gibba043.dnkmem (mgr.34373) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:28 gibba003 bash[32348]: cluster 2021-03-10T14:50:27.650956+0000 mgr.gibba043.dnkmem (mgr.34373) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:30 gibba043 bash[24019]: cluster 2021-03-10T14:50:29.652336+0000 mgr.gibba043.dnkmem (mgr.34373) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:30 gibba003 bash[31385]: cluster 2021-03-10T14:50:29.652336+0000 mgr.gibba043.dnkmem (mgr.34373) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:30 gibba003 bash[32348]: cluster 2021-03-10T14:50:29.652336+0000 mgr.gibba043.dnkmem (mgr.34373) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:32 gibba043 bash[24019]: cluster 2021-03-10T14:50:31.653823+0000 mgr.gibba043.dnkmem (mgr.34373) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:32 gibba003 bash[31385]: cluster 2021-03-10T14:50:31.653823+0000 mgr.gibba043.dnkmem (mgr.34373) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:32 gibba003 bash[32348]: cluster 2021-03-10T14:50:31.653823+0000 mgr.gibba043.dnkmem (mgr.34373) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:34 gibba003 bash[31385]: cluster 2021-03-10T14:50:33.654560+0000 mgr.gibba043.dnkmem (mgr.34373) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:34 gibba003 bash[32348]: cluster 2021-03-10T14:50:33.654560+0000 mgr.gibba043.dnkmem (mgr.34373) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:34 gibba043 bash[24019]: cluster 2021-03-10T14:50:33.654560+0000 mgr.gibba043.dnkmem (mgr.34373) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.075423+0000 mgr.gibba043.dnkmem (mgr.34373) 3162 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:50:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.077021+0000 mgr.gibba043.dnkmem (mgr.34373) 3163 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:50:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.297953+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:50:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.298624+0000 mgr.gibba043.dnkmem (mgr.34373) 3164 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.301690+0000 mon.c (mon.1) 852 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.302039+0000 mgr.gibba043.dnkmem (mgr.34373) 3165 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.304737+0000 mgr.gibba043.dnkmem (mgr.34373) 3166 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.304776+0000 mgr.gibba043.dnkmem (mgr.34373) 3167 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.304797+0000 mon.c (mon.1) 853 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.307128+0000 mgr.gibba043.dnkmem (mgr.34373) 3168 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:36.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.307166+0000 mgr.gibba043.dnkmem (mgr.34373) 3169 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:36.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.307513+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.309720+0000 mgr.gibba043.dnkmem (mgr.34373) 3170 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:36.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.309819+0000 mon.c (mon.1) 855 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.313585+0000 mgr.gibba043.dnkmem (mgr.34373) 3171 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:36.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.313663+0000 mgr.gibba043.dnkmem (mgr.34373) 3172 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:36.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.316019+0000 mgr.gibba043.dnkmem (mgr.34373) 3173 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:36.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.316446+0000 mgr.gibba043.dnkmem (mgr.34373) 3174 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:36.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.316503+0000 mon.c (mon.1) 856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[31385]: audit 2021-03-10T14:50:35.319146+0000 mon.c (mon.1) 857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.075423+0000 mgr.gibba043.dnkmem (mgr.34373) 3162 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:50:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.077021+0000 mgr.gibba043.dnkmem (mgr.34373) 3163 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:50:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.297953+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:50:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.298624+0000 mgr.gibba043.dnkmem (mgr.34373) 3164 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.301690+0000 mon.c (mon.1) 852 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.302039+0000 mgr.gibba043.dnkmem (mgr.34373) 3165 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:36.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.304737+0000 mgr.gibba043.dnkmem (mgr.34373) 3166 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:36.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.304776+0000 mgr.gibba043.dnkmem (mgr.34373) 3167 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:36.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.304797+0000 mon.c (mon.1) 853 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.307128+0000 mgr.gibba043.dnkmem (mgr.34373) 3168 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:36.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.307166+0000 mgr.gibba043.dnkmem (mgr.34373) 3169 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:36.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.307513+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.309720+0000 mgr.gibba043.dnkmem (mgr.34373) 3170 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:36.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.309819+0000 mon.c (mon.1) 855 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.313585+0000 mgr.gibba043.dnkmem (mgr.34373) 3171 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:36.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.313663+0000 mgr.gibba043.dnkmem (mgr.34373) 3172 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:36.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.316019+0000 mgr.gibba043.dnkmem (mgr.34373) 3173 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:36.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.316446+0000 mgr.gibba043.dnkmem (mgr.34373) 3174 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:36.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.316503+0000 mon.c (mon.1) 856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:36 gibba003 bash[32348]: audit 2021-03-10T14:50:35.319146+0000 mon.c (mon.1) 857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.075423+0000 mgr.gibba043.dnkmem (mgr.34373) 3162 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:50:36.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.077021+0000 mgr.gibba043.dnkmem (mgr.34373) 3163 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:50:36.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.297953+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:50:36.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.298624+0000 mgr.gibba043.dnkmem (mgr.34373) 3164 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:36.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.301690+0000 mon.c (mon.1) 852 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:36.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.302039+0000 mgr.gibba043.dnkmem (mgr.34373) 3165 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:36.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.304737+0000 mgr.gibba043.dnkmem (mgr.34373) 3166 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:36.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.304776+0000 mgr.gibba043.dnkmem (mgr.34373) 3167 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:36.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.304797+0000 mon.c (mon.1) 853 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.307128+0000 mgr.gibba043.dnkmem (mgr.34373) 3168 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:36.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.307166+0000 mgr.gibba043.dnkmem (mgr.34373) 3169 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:36.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.307513+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.309720+0000 mgr.gibba043.dnkmem (mgr.34373) 3170 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:36.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.309819+0000 mon.c (mon.1) 855 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.313585+0000 mgr.gibba043.dnkmem (mgr.34373) 3171 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:36.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.313663+0000 mgr.gibba043.dnkmem (mgr.34373) 3172 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:36.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.316019+0000 mgr.gibba043.dnkmem (mgr.34373) 3173 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:36.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.316446+0000 mgr.gibba043.dnkmem (mgr.34373) 3174 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:36.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.316503+0000 mon.c (mon.1) 856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:36 gibba043 bash[24019]: audit 2021-03-10T14:50:35.319146+0000 mon.c (mon.1) 857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.318577+0000 mgr.gibba043.dnkmem (mgr.34373) 3175 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.318617+0000 mgr.gibba043.dnkmem (mgr.34373) 3176 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[31385]: cephadm 2021-03-10T14:50:35.318731+0000 mgr.gibba043.dnkmem (mgr.34373) 3177 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[31385]: cluster 2021-03-10T14:50:35.655827+0000 mgr.gibba043.dnkmem (mgr.34373) 3178 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.318577+0000 mgr.gibba043.dnkmem (mgr.34373) 3175 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.318617+0000 mgr.gibba043.dnkmem (mgr.34373) 3176 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[32348]: cephadm 2021-03-10T14:50:35.318731+0000 mgr.gibba043.dnkmem (mgr.34373) 3177 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:37 gibba003 bash[32348]: cluster 2021-03-10T14:50:35.655827+0000 mgr.gibba043.dnkmem (mgr.34373) 3178 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:37 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.318577+0000 mgr.gibba043.dnkmem (mgr.34373) 3175 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:37 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.318617+0000 mgr.gibba043.dnkmem (mgr.34373) 3176 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:37 gibba043 bash[24019]: cephadm 2021-03-10T14:50:35.318731+0000 mgr.gibba043.dnkmem (mgr.34373) 3177 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:37 gibba043 bash[24019]: cluster 2021-03-10T14:50:35.655827+0000 mgr.gibba043.dnkmem (mgr.34373) 3178 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:39 gibba003 bash[31385]: cluster 2021-03-10T14:50:37.657175+0000 mgr.gibba043.dnkmem (mgr.34373) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:39 gibba003 bash[32348]: cluster 2021-03-10T14:50:37.657175+0000 mgr.gibba043.dnkmem (mgr.34373) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:39 gibba043 bash[24019]: cluster 2021-03-10T14:50:37.657175+0000 mgr.gibba043.dnkmem (mgr.34373) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:40 gibba003 bash[31385]: cluster 2021-03-10T14:50:39.658794+0000 mgr.gibba043.dnkmem (mgr.34373) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:40 gibba003 bash[32348]: cluster 2021-03-10T14:50:39.658794+0000 mgr.gibba043.dnkmem (mgr.34373) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:40 gibba043 bash[24019]: cluster 2021-03-10T14:50:39.658794+0000 mgr.gibba043.dnkmem (mgr.34373) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:43.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:42 gibba043 bash[24019]: cluster 2021-03-10T14:50:41.660584+0000 mgr.gibba043.dnkmem (mgr.34373) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:42 gibba003 bash[31385]: cluster 2021-03-10T14:50:41.660584+0000 mgr.gibba043.dnkmem (mgr.34373) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:43.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:42 gibba003 bash[32348]: cluster 2021-03-10T14:50:41.660584+0000 mgr.gibba043.dnkmem (mgr.34373) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:44 gibba003 bash[31385]: cluster 2021-03-10T14:50:43.662032+0000 mgr.gibba043.dnkmem (mgr.34373) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:44 gibba003 bash[32348]: cluster 2021-03-10T14:50:43.662032+0000 mgr.gibba043.dnkmem (mgr.34373) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:44 gibba043 bash[24019]: cluster 2021-03-10T14:50:43.662032+0000 mgr.gibba043.dnkmem (mgr.34373) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:46 gibba043 bash[24019]: cluster 2021-03-10T14:50:45.662885+0000 mgr.gibba043.dnkmem (mgr.34373) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:46 gibba003 bash[31385]: cluster 2021-03-10T14:50:45.662885+0000 mgr.gibba043.dnkmem (mgr.34373) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:47.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:46 gibba003 bash[32348]: cluster 2021-03-10T14:50:45.662885+0000 mgr.gibba043.dnkmem (mgr.34373) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:48 gibba043 bash[24019]: cluster 2021-03-10T14:50:47.664323+0000 mgr.gibba043.dnkmem (mgr.34373) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:48 gibba003 bash[31385]: cluster 2021-03-10T14:50:47.664323+0000 mgr.gibba043.dnkmem (mgr.34373) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:48 gibba003 bash[32348]: cluster 2021-03-10T14:50:47.664323+0000 mgr.gibba043.dnkmem (mgr.34373) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:50 gibba043 bash[24019]: cluster 2021-03-10T14:50:49.665836+0000 mgr.gibba043.dnkmem (mgr.34373) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:50 gibba003 bash[31385]: cluster 2021-03-10T14:50:49.665836+0000 mgr.gibba043.dnkmem (mgr.34373) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:50 gibba003 bash[32348]: cluster 2021-03-10T14:50:49.665836+0000 mgr.gibba043.dnkmem (mgr.34373) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:52.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:51 gibba043 bash[24019]: cephadm 2021-03-10T14:50:50.334779+0000 mgr.gibba043.dnkmem (mgr.34373) 3186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:51 gibba003 bash[31385]: cephadm 2021-03-10T14:50:50.334779+0000 mgr.gibba043.dnkmem (mgr.34373) 3186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:51 gibba003 bash[32348]: cephadm 2021-03-10T14:50:50.334779+0000 mgr.gibba043.dnkmem (mgr.34373) 3186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:50:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:52 gibba043 bash[24019]: cluster 2021-03-10T14:50:51.667270+0000 mgr.gibba043.dnkmem (mgr.34373) 3187 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:53.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:52 gibba003 bash[31385]: cluster 2021-03-10T14:50:51.667270+0000 mgr.gibba043.dnkmem (mgr.34373) 3187 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:52 gibba003 bash[32348]: cluster 2021-03-10T14:50:51.667270+0000 mgr.gibba043.dnkmem (mgr.34373) 3187 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:54 gibba003 bash[31385]: cluster 2021-03-10T14:50:53.668850+0000 mgr.gibba043.dnkmem (mgr.34373) 3188 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:54 gibba003 bash[32348]: cluster 2021-03-10T14:50:53.668850+0000 mgr.gibba043.dnkmem (mgr.34373) 3188 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:54 gibba043 bash[24019]: cluster 2021-03-10T14:50:53.668850+0000 mgr.gibba043.dnkmem (mgr.34373) 3188 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:56.403 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:50:56.668 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:50:56.668 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (59m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:50:56.668 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:50:56.668 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:50:56.669 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:50:56.669 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:50:56.669 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:50:56.669 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:50:56.670 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:50:56.670 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (64m) 4m ago 64m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:50:56.670 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:50:56.670 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:50:56.671 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:50:56.671 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:50:56.671 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:50:56.671 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:50:56.672 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:50:56.672 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:50:56.672 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:50:56.672 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (64m) 3m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:50:56.672 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:50:56.924 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:50:56.925 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:50:56.925 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:56.925 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:50:56.925 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:50:56.925 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:56.926 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:50:56.926 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:50:56.926 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:50:56.926 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:50:56.927 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:50:56.927 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:50:56.927 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:50:56.928 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:50:56.928 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:50:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:56 gibba043 bash[24019]: cluster 2021-03-10T14:50:55.670119+0000 mgr.gibba043.dnkmem (mgr.34373) 3189 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:56 gibba003 bash[31385]: cluster 2021-03-10T14:50:55.670119+0000 mgr.gibba043.dnkmem (mgr.34373) 3189 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:56 gibba003 bash[32348]: cluster 2021-03-10T14:50:55.670119+0000 mgr.gibba043.dnkmem (mgr.34373) 3189 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:57 gibba043 bash[24019]: audit 2021-03-10T14:50:56.391880+0000 mgr.gibba043.dnkmem (mgr.34373) 3190 : audit [DBG] from='client.56182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:57 gibba043 bash[24019]: audit 2021-03-10T14:50:56.625813+0000 mgr.gibba043.dnkmem (mgr.34373) 3191 : audit [DBG] from='client.56188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:57 gibba043 bash[24019]: audit 2021-03-10T14:50:56.923652+0000 mon.a (mon.0) 951 : audit [DBG] from='client.? 172.21.2.103:0/307767295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:57 gibba003 bash[31385]: audit 2021-03-10T14:50:56.391880+0000 mgr.gibba043.dnkmem (mgr.34373) 3190 : audit [DBG] from='client.56182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:57 gibba003 bash[31385]: audit 2021-03-10T14:50:56.625813+0000 mgr.gibba043.dnkmem (mgr.34373) 3191 : audit [DBG] from='client.56188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:57 gibba003 bash[31385]: audit 2021-03-10T14:50:56.923652+0000 mon.a (mon.0) 951 : audit [DBG] from='client.? 172.21.2.103:0/307767295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:58.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:57 gibba003 bash[32348]: audit 2021-03-10T14:50:56.391880+0000 mgr.gibba043.dnkmem (mgr.34373) 3190 : audit [DBG] from='client.56182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:58.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:57 gibba003 bash[32348]: audit 2021-03-10T14:50:56.625813+0000 mgr.gibba043.dnkmem (mgr.34373) 3191 : audit [DBG] from='client.56188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:58.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:57 gibba003 bash[32348]: audit 2021-03-10T14:50:56.923652+0000 mon.a (mon.0) 951 : audit [DBG] from='client.? 172.21.2.103:0/307767295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:50:58 gibba043 bash[24019]: cluster 2021-03-10T14:50:57.671062+0000 mgr.gibba043.dnkmem (mgr.34373) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:50:58 gibba003 bash[31385]: cluster 2021-03-10T14:50:57.671062+0000 mgr.gibba043.dnkmem (mgr.34373) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:50:58 gibba003 bash[32348]: cluster 2021-03-10T14:50:57.671062+0000 mgr.gibba043.dnkmem (mgr.34373) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:01.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:00 gibba043 bash[24019]: cluster 2021-03-10T14:50:59.672324+0000 mgr.gibba043.dnkmem (mgr.34373) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:00 gibba003 bash[31385]: cluster 2021-03-10T14:50:59.672324+0000 mgr.gibba043.dnkmem (mgr.34373) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:00 gibba003 bash[32348]: cluster 2021-03-10T14:50:59.672324+0000 mgr.gibba043.dnkmem (mgr.34373) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:02 gibba043 bash[24019]: cluster 2021-03-10T14:51:01.673980+0000 mgr.gibba043.dnkmem (mgr.34373) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:03.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:02 gibba003 bash[31385]: cluster 2021-03-10T14:51:01.673980+0000 mgr.gibba043.dnkmem (mgr.34373) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:03.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:02 gibba003 bash[32348]: cluster 2021-03-10T14:51:01.673980+0000 mgr.gibba043.dnkmem (mgr.34373) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:04 gibba003 bash[31385]: cluster 2021-03-10T14:51:03.674960+0000 mgr.gibba043.dnkmem (mgr.34373) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:04 gibba003 bash[32348]: cluster 2021-03-10T14:51:03.674960+0000 mgr.gibba043.dnkmem (mgr.34373) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:04 gibba043 bash[24019]: cluster 2021-03-10T14:51:03.674960+0000 mgr.gibba043.dnkmem (mgr.34373) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:06 gibba043 bash[24019]: cephadm 2021-03-10T14:51:05.348475+0000 mgr.gibba043.dnkmem (mgr.34373) 3196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:06 gibba043 bash[24019]: cluster 2021-03-10T14:51:05.676302+0000 mgr.gibba043.dnkmem (mgr.34373) 3197 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:06 gibba003 bash[31385]: cephadm 2021-03-10T14:51:05.348475+0000 mgr.gibba043.dnkmem (mgr.34373) 3196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:06 gibba003 bash[31385]: cluster 2021-03-10T14:51:05.676302+0000 mgr.gibba043.dnkmem (mgr.34373) 3197 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:06 gibba003 bash[32348]: cephadm 2021-03-10T14:51:05.348475+0000 mgr.gibba043.dnkmem (mgr.34373) 3196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:06 gibba003 bash[32348]: cluster 2021-03-10T14:51:05.676302+0000 mgr.gibba043.dnkmem (mgr.34373) 3197 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:08 gibba043 bash[24019]: cluster 2021-03-10T14:51:07.677902+0000 mgr.gibba043.dnkmem (mgr.34373) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:08 gibba003 bash[31385]: cluster 2021-03-10T14:51:07.677902+0000 mgr.gibba043.dnkmem (mgr.34373) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:09.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:08 gibba003 bash[32348]: cluster 2021-03-10T14:51:07.677902+0000 mgr.gibba043.dnkmem (mgr.34373) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:11.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:10 gibba043 bash[24019]: cluster 2021-03-10T14:51:09.679284+0000 mgr.gibba043.dnkmem (mgr.34373) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:11.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:10 gibba003 bash[31385]: cluster 2021-03-10T14:51:09.679284+0000 mgr.gibba043.dnkmem (mgr.34373) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:10 gibba003 bash[32348]: cluster 2021-03-10T14:51:09.679284+0000 mgr.gibba043.dnkmem (mgr.34373) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:12 gibba043 bash[24019]: cluster 2021-03-10T14:51:11.681034+0000 mgr.gibba043.dnkmem (mgr.34373) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:12 gibba003 bash[31385]: cluster 2021-03-10T14:51:11.681034+0000 mgr.gibba043.dnkmem (mgr.34373) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:12 gibba003 bash[32348]: cluster 2021-03-10T14:51:11.681034+0000 mgr.gibba043.dnkmem (mgr.34373) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.087709+0000 mon.c (mon.1) 858 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.088822+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.155125+0000 mon.c (mon.1) 859 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:51:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.155924+0000 mon.c (mon.1) 860 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.156381+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:51:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.156634+0000 mon.c (mon.1) 861 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:51:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.157469+0000 mon.c (mon.1) 862 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.157619+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.158596+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:51:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.159573+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.160024+0000 mon.c (mon.1) 863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[31385]: audit 2021-03-10T14:51:13.160924+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.087709+0000 mon.c (mon.1) 858 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.088822+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.155125+0000 mon.c (mon.1) 859 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:51:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.155924+0000 mon.c (mon.1) 860 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.156381+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:51:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.156634+0000 mon.c (mon.1) 861 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:51:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.157469+0000 mon.c (mon.1) 862 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.157619+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.158596+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:51:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.159573+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.160024+0000 mon.c (mon.1) 863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:13 gibba003 bash[32348]: audit 2021-03-10T14:51:13.160924+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.087709+0000 mon.c (mon.1) 858 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.088822+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.155125+0000 mon.c (mon.1) 859 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:51:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.155924+0000 mon.c (mon.1) 860 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.156381+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:51:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.156634+0000 mon.c (mon.1) 861 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:51:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.157469+0000 mon.c (mon.1) 862 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.157619+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.158596+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:51:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.159573+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:51:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.160024+0000 mon.c (mon.1) 863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:13 gibba043 bash[24019]: audit 2021-03-10T14:51:13.160924+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:14 gibba003 bash[31385]: cluster 2021-03-10T14:51:13.682487+0000 mgr.gibba043.dnkmem (mgr.34373) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:14 gibba003 bash[32348]: cluster 2021-03-10T14:51:13.682487+0000 mgr.gibba043.dnkmem (mgr.34373) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:14 gibba043 bash[24019]: cluster 2021-03-10T14:51:13.682487+0000 mgr.gibba043.dnkmem (mgr.34373) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:16 gibba003 bash[31385]: cluster 2021-03-10T14:51:15.683313+0000 mgr.gibba043.dnkmem (mgr.34373) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:16 gibba003 bash[32348]: cluster 2021-03-10T14:51:15.683313+0000 mgr.gibba043.dnkmem (mgr.34373) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:16 gibba043 bash[24019]: cluster 2021-03-10T14:51:15.683313+0000 mgr.gibba043.dnkmem (mgr.34373) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:18 gibba003 bash[31385]: cluster 2021-03-10T14:51:17.684888+0000 mgr.gibba043.dnkmem (mgr.34373) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:18 gibba003 bash[32348]: cluster 2021-03-10T14:51:17.684888+0000 mgr.gibba043.dnkmem (mgr.34373) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:18 gibba043 bash[24019]: cluster 2021-03-10T14:51:17.684888+0000 mgr.gibba043.dnkmem (mgr.34373) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:20 gibba003 bash[31385]: cluster 2021-03-10T14:51:19.686371+0000 mgr.gibba043.dnkmem (mgr.34373) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:20 gibba003 bash[32348]: cluster 2021-03-10T14:51:19.686371+0000 mgr.gibba043.dnkmem (mgr.34373) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:20 gibba043 bash[24019]: cluster 2021-03-10T14:51:19.686371+0000 mgr.gibba043.dnkmem (mgr.34373) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:21 gibba003 bash[31385]: cephadm 2021-03-10T14:51:20.364534+0000 mgr.gibba043.dnkmem (mgr.34373) 3205 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:21 gibba003 bash[32348]: cephadm 2021-03-10T14:51:20.364534+0000 mgr.gibba043.dnkmem (mgr.34373) 3205 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:21 gibba043 bash[24019]: cephadm 2021-03-10T14:51:20.364534+0000 mgr.gibba043.dnkmem (mgr.34373) 3205 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:22 gibba003 bash[31385]: cluster 2021-03-10T14:51:21.687473+0000 mgr.gibba043.dnkmem (mgr.34373) 3206 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:23.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:22 gibba003 bash[32348]: cluster 2021-03-10T14:51:21.687473+0000 mgr.gibba043.dnkmem (mgr.34373) 3206 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:22 gibba043 bash[24019]: cluster 2021-03-10T14:51:21.687473+0000 mgr.gibba043.dnkmem (mgr.34373) 3206 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:24 gibba003 bash[31385]: cluster 2021-03-10T14:51:23.688711+0000 mgr.gibba043.dnkmem (mgr.34373) 3207 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:24 gibba003 bash[32348]: cluster 2021-03-10T14:51:23.688711+0000 mgr.gibba043.dnkmem (mgr.34373) 3207 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:24 gibba043 bash[24019]: cluster 2021-03-10T14:51:23.688711+0000 mgr.gibba043.dnkmem (mgr.34373) 3207 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:26 gibba043 bash[24019]: cluster 2021-03-10T14:51:25.690020+0000 mgr.gibba043.dnkmem (mgr.34373) 3208 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:26 gibba003 bash[31385]: cluster 2021-03-10T14:51:25.690020+0000 mgr.gibba043.dnkmem (mgr.34373) 3208 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:26 gibba003 bash[32348]: cluster 2021-03-10T14:51:25.690020+0000 mgr.gibba043.dnkmem (mgr.34373) 3208 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.211 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:51:27.435 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:51:27.436 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (59m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:51:27.436 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:51:27.436 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:51:27.436 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:51:27.437 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:51:27.437 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:51:27.437 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:51:27.437 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:51:27.437 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (65m) 5m ago 65m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:51:27.438 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (65m) 3m ago 65m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:51:27.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:51:27.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:51:27.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:51:27.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:51:27.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:51:27.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:51:27.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:51:27.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:51:27.440 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (64m) 3m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:51:27.440 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:51:27.683 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:51:27.683 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:51:27.683 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:27.683 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:51:27.684 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:51:27.684 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:27.684 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:51:27.684 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:51:27.684 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:51:27.685 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:51:27.685 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:51:27.685 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:51:27.685 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:51:27.685 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:51:27.686 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:51:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:27 gibba043 bash[24019]: audit 2021-03-10T14:51:27.200567+0000 mgr.gibba043.dnkmem (mgr.34373) 3209 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:27 gibba043 bash[24019]: audit 2021-03-10T14:51:27.682817+0000 mon.c (mon.1) 864 : audit [DBG] from='client.? 172.21.2.103:0/332871222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:27 gibba003 bash[31385]: audit 2021-03-10T14:51:27.200567+0000 mgr.gibba043.dnkmem (mgr.34373) 3209 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:27 gibba003 bash[31385]: audit 2021-03-10T14:51:27.682817+0000 mon.c (mon.1) 864 : audit [DBG] from='client.? 172.21.2.103:0/332871222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:27 gibba003 bash[32348]: audit 2021-03-10T14:51:27.200567+0000 mgr.gibba043.dnkmem (mgr.34373) 3209 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:27 gibba003 bash[32348]: audit 2021-03-10T14:51:27.682817+0000 mon.c (mon.1) 864 : audit [DBG] from='client.? 172.21.2.103:0/332871222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:28 gibba043 bash[24019]: audit 2021-03-10T14:51:27.422039+0000 mgr.gibba043.dnkmem (mgr.34373) 3210 : audit [DBG] from='client.56206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:28 gibba043 bash[24019]: cluster 2021-03-10T14:51:27.690879+0000 mgr.gibba043.dnkmem (mgr.34373) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:28 gibba003 bash[31385]: audit 2021-03-10T14:51:27.422039+0000 mgr.gibba043.dnkmem (mgr.34373) 3210 : audit [DBG] from='client.56206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:28 gibba003 bash[31385]: cluster 2021-03-10T14:51:27.690879+0000 mgr.gibba043.dnkmem (mgr.34373) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:28 gibba003 bash[32348]: audit 2021-03-10T14:51:27.422039+0000 mgr.gibba043.dnkmem (mgr.34373) 3210 : audit [DBG] from='client.56206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:28 gibba003 bash[32348]: cluster 2021-03-10T14:51:27.690879+0000 mgr.gibba043.dnkmem (mgr.34373) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:30 gibba003 bash[31385]: cluster 2021-03-10T14:51:29.692352+0000 mgr.gibba043.dnkmem (mgr.34373) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:30 gibba003 bash[32348]: cluster 2021-03-10T14:51:29.692352+0000 mgr.gibba043.dnkmem (mgr.34373) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:31.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:30 gibba043 bash[24019]: cluster 2021-03-10T14:51:29.692352+0000 mgr.gibba043.dnkmem (mgr.34373) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:32 gibba003 bash[31385]: cluster 2021-03-10T14:51:31.694053+0000 mgr.gibba043.dnkmem (mgr.34373) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:32 gibba003 bash[32348]: cluster 2021-03-10T14:51:31.694053+0000 mgr.gibba043.dnkmem (mgr.34373) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:32 gibba043 bash[24019]: cluster 2021-03-10T14:51:31.694053+0000 mgr.gibba043.dnkmem (mgr.34373) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:34 gibba003 bash[31385]: cluster 2021-03-10T14:51:33.694967+0000 mgr.gibba043.dnkmem (mgr.34373) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:34.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:34 gibba003 bash[32348]: cluster 2021-03-10T14:51:33.694967+0000 mgr.gibba043.dnkmem (mgr.34373) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:34 gibba043 bash[24019]: cluster 2021-03-10T14:51:33.694967+0000 mgr.gibba043.dnkmem (mgr.34373) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.381620+0000 mgr.gibba043.dnkmem (mgr.34373) 3215 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:51:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.383178+0000 mgr.gibba043.dnkmem (mgr.34373) 3216 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:51:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.597674+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:51:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.598457+0000 mgr.gibba043.dnkmem (mgr.34373) 3217 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.600132+0000 mgr.gibba043.dnkmem (mgr.34373) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.601336+0000 mon.c (mon.1) 865 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.601434+0000 mgr.gibba043.dnkmem (mgr.34373) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.601472+0000 mgr.gibba043.dnkmem (mgr.34373) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:36.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.602723+0000 mgr.gibba043.dnkmem (mgr.34373) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:36.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.602734+0000 mon.c (mon.1) 866 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.602761+0000 mgr.gibba043.dnkmem (mgr.34373) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:36.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.604006+0000 mgr.gibba043.dnkmem (mgr.34373) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:36.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.604050+0000 mon.c (mon.1) 867 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.605334+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.605786+0000 mgr.gibba043.dnkmem (mgr.34373) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:36.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.605826+0000 mgr.gibba043.dnkmem (mgr.34373) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:36.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.607171+0000 mgr.gibba043.dnkmem (mgr.34373) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:36.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.607506+0000 mgr.gibba043.dnkmem (mgr.34373) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:36.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.608490+0000 mon.c (mon.1) 869 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.608865+0000 mgr.gibba043.dnkmem (mgr.34373) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:36.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.608909+0000 mgr.gibba043.dnkmem (mgr.34373) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:36.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cephadm 2021-03-10T14:51:35.609025+0000 mgr.gibba043.dnkmem (mgr.34373) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:36.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: audit 2021-03-10T14:51:35.610037+0000 mon.c (mon.1) 870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[31385]: cluster 2021-03-10T14:51:35.696193+0000 mgr.gibba043.dnkmem (mgr.34373) 3231 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.381620+0000 mgr.gibba043.dnkmem (mgr.34373) 3215 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:51:36.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.383178+0000 mgr.gibba043.dnkmem (mgr.34373) 3216 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:51:36.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.597674+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:51:36.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.598457+0000 mgr.gibba043.dnkmem (mgr.34373) 3217 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:36.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.600132+0000 mgr.gibba043.dnkmem (mgr.34373) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:36.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.601336+0000 mon.c (mon.1) 865 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:36.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.601434+0000 mgr.gibba043.dnkmem (mgr.34373) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:36.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.601472+0000 mgr.gibba043.dnkmem (mgr.34373) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:36.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.602723+0000 mgr.gibba043.dnkmem (mgr.34373) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:36.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.602734+0000 mon.c (mon.1) 866 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.602761+0000 mgr.gibba043.dnkmem (mgr.34373) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:36.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.604006+0000 mgr.gibba043.dnkmem (mgr.34373) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:36.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.604050+0000 mon.c (mon.1) 867 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.605334+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.605786+0000 mgr.gibba043.dnkmem (mgr.34373) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:36.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.605826+0000 mgr.gibba043.dnkmem (mgr.34373) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:36.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.607171+0000 mgr.gibba043.dnkmem (mgr.34373) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:36.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.607506+0000 mgr.gibba043.dnkmem (mgr.34373) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:36.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.608490+0000 mon.c (mon.1) 869 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.608865+0000 mgr.gibba043.dnkmem (mgr.34373) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:36.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.608909+0000 mgr.gibba043.dnkmem (mgr.34373) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:36.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cephadm 2021-03-10T14:51:35.609025+0000 mgr.gibba043.dnkmem (mgr.34373) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:36.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: audit 2021-03-10T14:51:35.610037+0000 mon.c (mon.1) 870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:36.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:36 gibba003 bash[32348]: cluster 2021-03-10T14:51:35.696193+0000 mgr.gibba043.dnkmem (mgr.34373) 3231 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.381620+0000 mgr.gibba043.dnkmem (mgr.34373) 3215 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:51:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.383178+0000 mgr.gibba043.dnkmem (mgr.34373) 3216 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:51:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.597674+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:51:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.598457+0000 mgr.gibba043.dnkmem (mgr.34373) 3217 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.600132+0000 mgr.gibba043.dnkmem (mgr.34373) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.601336+0000 mon.c (mon.1) 865 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.601434+0000 mgr.gibba043.dnkmem (mgr.34373) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:37.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.601472+0000 mgr.gibba043.dnkmem (mgr.34373) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:37.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.602723+0000 mgr.gibba043.dnkmem (mgr.34373) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:37.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.602734+0000 mon.c (mon.1) 866 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:37.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.602761+0000 mgr.gibba043.dnkmem (mgr.34373) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:37.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.604006+0000 mgr.gibba043.dnkmem (mgr.34373) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:37.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.604050+0000 mon.c (mon.1) 867 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:37.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.605334+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:37.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.605786+0000 mgr.gibba043.dnkmem (mgr.34373) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:37.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.605826+0000 mgr.gibba043.dnkmem (mgr.34373) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:37.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.607171+0000 mgr.gibba043.dnkmem (mgr.34373) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:37.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.607506+0000 mgr.gibba043.dnkmem (mgr.34373) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:37.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.608490+0000 mon.c (mon.1) 869 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:37.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.608865+0000 mgr.gibba043.dnkmem (mgr.34373) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:37.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.608909+0000 mgr.gibba043.dnkmem (mgr.34373) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:37.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cephadm 2021-03-10T14:51:35.609025+0000 mgr.gibba043.dnkmem (mgr.34373) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:37.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: audit 2021-03-10T14:51:35.610037+0000 mon.c (mon.1) 870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:37.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:36 gibba043 bash[24019]: cluster 2021-03-10T14:51:35.696193+0000 mgr.gibba043.dnkmem (mgr.34373) 3231 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:38 gibba043 bash[24019]: cluster 2021-03-10T14:51:37.697676+0000 mgr.gibba043.dnkmem (mgr.34373) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:38 gibba003 bash[31385]: cluster 2021-03-10T14:51:37.697676+0000 mgr.gibba043.dnkmem (mgr.34373) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:38 gibba003 bash[32348]: cluster 2021-03-10T14:51:37.697676+0000 mgr.gibba043.dnkmem (mgr.34373) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:40 gibba003 bash[31385]: cluster 2021-03-10T14:51:39.699049+0000 mgr.gibba043.dnkmem (mgr.34373) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:40 gibba003 bash[32348]: cluster 2021-03-10T14:51:39.699049+0000 mgr.gibba043.dnkmem (mgr.34373) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:40 gibba043 bash[24019]: cluster 2021-03-10T14:51:39.699049+0000 mgr.gibba043.dnkmem (mgr.34373) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:42 gibba003 bash[31385]: cluster 2021-03-10T14:51:41.700556+0000 mgr.gibba043.dnkmem (mgr.34373) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:42 gibba003 bash[32348]: cluster 2021-03-10T14:51:41.700556+0000 mgr.gibba043.dnkmem (mgr.34373) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:42 gibba043 bash[24019]: cluster 2021-03-10T14:51:41.700556+0000 mgr.gibba043.dnkmem (mgr.34373) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:44 gibba003 bash[31385]: cluster 2021-03-10T14:51:43.701920+0000 mgr.gibba043.dnkmem (mgr.34373) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:44 gibba003 bash[32348]: cluster 2021-03-10T14:51:43.701920+0000 mgr.gibba043.dnkmem (mgr.34373) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:44 gibba043 bash[24019]: cluster 2021-03-10T14:51:43.701920+0000 mgr.gibba043.dnkmem (mgr.34373) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:46 gibba043 bash[24019]: cluster 2021-03-10T14:51:45.702952+0000 mgr.gibba043.dnkmem (mgr.34373) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:46 gibba003 bash[31385]: cluster 2021-03-10T14:51:45.702952+0000 mgr.gibba043.dnkmem (mgr.34373) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:46 gibba003 bash[32348]: cluster 2021-03-10T14:51:45.702952+0000 mgr.gibba043.dnkmem (mgr.34373) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:48 gibba003 bash[31385]: cluster 2021-03-10T14:51:47.704507+0000 mgr.gibba043.dnkmem (mgr.34373) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:48 gibba003 bash[32348]: cluster 2021-03-10T14:51:47.704507+0000 mgr.gibba043.dnkmem (mgr.34373) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:48 gibba043 bash[24019]: cluster 2021-03-10T14:51:47.704507+0000 mgr.gibba043.dnkmem (mgr.34373) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:50 gibba043 bash[24019]: cluster 2021-03-10T14:51:49.705897+0000 mgr.gibba043.dnkmem (mgr.34373) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:50 gibba003 bash[31385]: cluster 2021-03-10T14:51:49.705897+0000 mgr.gibba043.dnkmem (mgr.34373) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:51.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:50 gibba003 bash[32348]: cluster 2021-03-10T14:51:49.705897+0000 mgr.gibba043.dnkmem (mgr.34373) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:51 gibba003 bash[31385]: cephadm 2021-03-10T14:51:50.612265+0000 mgr.gibba043.dnkmem (mgr.34373) 3239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:52.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:51 gibba003 bash[32348]: cephadm 2021-03-10T14:51:50.612265+0000 mgr.gibba043.dnkmem (mgr.34373) 3239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:51 gibba043 bash[24019]: cephadm 2021-03-10T14:51:50.612265+0000 mgr.gibba043.dnkmem (mgr.34373) 3239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:51:53.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:52 gibba003 bash[31385]: cluster 2021-03-10T14:51:51.707410+0000 mgr.gibba043.dnkmem (mgr.34373) 3240 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:52 gibba003 bash[32348]: cluster 2021-03-10T14:51:51.707410+0000 mgr.gibba043.dnkmem (mgr.34373) 3240 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:52 gibba043 bash[24019]: cluster 2021-03-10T14:51:51.707410+0000 mgr.gibba043.dnkmem (mgr.34373) 3240 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:54 gibba003 bash[31385]: cluster 2021-03-10T14:51:53.708897+0000 mgr.gibba043.dnkmem (mgr.34373) 3241 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:54 gibba003 bash[32348]: cluster 2021-03-10T14:51:53.708897+0000 mgr.gibba043.dnkmem (mgr.34373) 3241 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:54 gibba043 bash[24019]: cluster 2021-03-10T14:51:53.708897+0000 mgr.gibba043.dnkmem (mgr.34373) 3241 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:56 gibba003 bash[31385]: cluster 2021-03-10T14:51:55.710385+0000 mgr.gibba043.dnkmem (mgr.34373) 3242 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:56 gibba003 bash[32348]: cluster 2021-03-10T14:51:55.710385+0000 mgr.gibba043.dnkmem (mgr.34373) 3242 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:56 gibba043 bash[24019]: cluster 2021-03-10T14:51:55.710385+0000 mgr.gibba043.dnkmem (mgr.34373) 3242 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.927 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:51:58.151 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:51:58.151 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (60m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:51:58.152 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:51:58.152 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:51:58.152 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:51:58.152 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:51:58.152 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:51:58.153 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:51:58.153 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:51:58.153 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (65m) 5m ago 65m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:51:58.153 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:51:58.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:51:58.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:51:58.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:51:58.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:51:58.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:51:58.155 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:51:58.155 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:51:58.155 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:51:58.155 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (65m) 4m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:51:58.155 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:51:58.399 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:51:58.400 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:51:58.400 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:58.400 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:51:58.400 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:51:58.401 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:58.401 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:51:58.401 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:51:58.401 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:51:58.401 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:51:58.402 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:51:58.402 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:51:58.402 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:51:58.402 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:51:58.403 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:51:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[31385]: cluster 2021-03-10T14:51:57.711530+0000 mgr.gibba043.dnkmem (mgr.34373) 3243 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[31385]: audit 2021-03-10T14:51:57.916191+0000 mgr.gibba043.dnkmem (mgr.34373) 3244 : audit [DBG] from='client.46230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[31385]: audit 2021-03-10T14:51:58.138404+0000 mgr.gibba043.dnkmem (mgr.34373) 3245 : audit [DBG] from='client.56224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[31385]: audit 2021-03-10T14:51:58.399273+0000 mon.a (mon.0) 959 : audit [DBG] from='client.? 172.21.2.103:0/3397812865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[32348]: cluster 2021-03-10T14:51:57.711530+0000 mgr.gibba043.dnkmem (mgr.34373) 3243 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[32348]: audit 2021-03-10T14:51:57.916191+0000 mgr.gibba043.dnkmem (mgr.34373) 3244 : audit [DBG] from='client.46230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[32348]: audit 2021-03-10T14:51:58.138404+0000 mgr.gibba043.dnkmem (mgr.34373) 3245 : audit [DBG] from='client.56224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:51:58 gibba003 bash[32348]: audit 2021-03-10T14:51:58.399273+0000 mon.a (mon.0) 959 : audit [DBG] from='client.? 172.21.2.103:0/3397812865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:58 gibba043 bash[24019]: cluster 2021-03-10T14:51:57.711530+0000 mgr.gibba043.dnkmem (mgr.34373) 3243 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:58 gibba043 bash[24019]: audit 2021-03-10T14:51:57.916191+0000 mgr.gibba043.dnkmem (mgr.34373) 3244 : audit [DBG] from='client.46230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:58 gibba043 bash[24019]: audit 2021-03-10T14:51:58.138404+0000 mgr.gibba043.dnkmem (mgr.34373) 3245 : audit [DBG] from='client.56224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:51:58 gibba043 bash[24019]: audit 2021-03-10T14:51:58.399273+0000 mon.a (mon.0) 959 : audit [DBG] from='client.? 172.21.2.103:0/3397812865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:00 gibba003 bash[31385]: cluster 2021-03-10T14:51:59.712929+0000 mgr.gibba043.dnkmem (mgr.34373) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:00 gibba003 bash[32348]: cluster 2021-03-10T14:51:59.712929+0000 mgr.gibba043.dnkmem (mgr.34373) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:00 gibba043 bash[24019]: cluster 2021-03-10T14:51:59.712929+0000 mgr.gibba043.dnkmem (mgr.34373) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:03.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:02 gibba003 bash[31385]: cluster 2021-03-10T14:52:01.714740+0000 mgr.gibba043.dnkmem (mgr.34373) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:03.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:02 gibba003 bash[32348]: cluster 2021-03-10T14:52:01.714740+0000 mgr.gibba043.dnkmem (mgr.34373) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:02 gibba043 bash[24019]: cluster 2021-03-10T14:52:01.714740+0000 mgr.gibba043.dnkmem (mgr.34373) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:04 gibba003 bash[31385]: cluster 2021-03-10T14:52:03.715871+0000 mgr.gibba043.dnkmem (mgr.34373) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:04 gibba003 bash[32348]: cluster 2021-03-10T14:52:03.715871+0000 mgr.gibba043.dnkmem (mgr.34373) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:04 gibba043 bash[24019]: cluster 2021-03-10T14:52:03.715871+0000 mgr.gibba043.dnkmem (mgr.34373) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:06 gibba003 bash[31385]: cephadm 2021-03-10T14:52:05.628204+0000 mgr.gibba043.dnkmem (mgr.34373) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:06 gibba003 bash[31385]: cluster 2021-03-10T14:52:05.717377+0000 mgr.gibba043.dnkmem (mgr.34373) 3250 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:06 gibba003 bash[32348]: cephadm 2021-03-10T14:52:05.628204+0000 mgr.gibba043.dnkmem (mgr.34373) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:06 gibba003 bash[32348]: cluster 2021-03-10T14:52:05.717377+0000 mgr.gibba043.dnkmem (mgr.34373) 3250 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:06 gibba043 bash[24019]: cephadm 2021-03-10T14:52:05.628204+0000 mgr.gibba043.dnkmem (mgr.34373) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:06 gibba043 bash[24019]: cluster 2021-03-10T14:52:05.717377+0000 mgr.gibba043.dnkmem (mgr.34373) 3250 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:08 gibba003 bash[31385]: cluster 2021-03-10T14:52:07.718905+0000 mgr.gibba043.dnkmem (mgr.34373) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:09.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:08 gibba003 bash[32348]: cluster 2021-03-10T14:52:07.718905+0000 mgr.gibba043.dnkmem (mgr.34373) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:08 gibba043 bash[24019]: cluster 2021-03-10T14:52:07.718905+0000 mgr.gibba043.dnkmem (mgr.34373) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:11.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:10 gibba003 bash[31385]: cluster 2021-03-10T14:52:09.720411+0000 mgr.gibba043.dnkmem (mgr.34373) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:11.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:10 gibba003 bash[32348]: cluster 2021-03-10T14:52:09.720411+0000 mgr.gibba043.dnkmem (mgr.34373) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:10 gibba043 bash[24019]: cluster 2021-03-10T14:52:09.720411+0000 mgr.gibba043.dnkmem (mgr.34373) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:13.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:12 gibba003 bash[32348]: cluster 2021-03-10T14:52:11.721918+0000 mgr.gibba043.dnkmem (mgr.34373) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:13.222 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:12 gibba003 bash[31385]: cluster 2021-03-10T14:52:11.721918+0000 mgr.gibba043.dnkmem (mgr.34373) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:12 gibba043 bash[24019]: cluster 2021-03-10T14:52:11.721918+0000 mgr.gibba043.dnkmem (mgr.34373) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.094159+0000 mon.c (mon.1) 871 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.095571+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.163889+0000 mon.c (mon.1) 872 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.164953+0000 mon.c (mon.1) 873 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:52:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.165131+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.166095+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:52:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.166227+0000 mon.c (mon.1) 874 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.167491+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.167585+0000 mon.c (mon.1) 875 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.168893+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.168915+0000 mon.c (mon.1) 876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:52:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[31385]: audit 2021-03-10T14:52:13.169559+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:52:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.094159+0000 mon.c (mon.1) 871 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.095571+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.163889+0000 mon.c (mon.1) 872 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.164953+0000 mon.c (mon.1) 873 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:52:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.165131+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.166095+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:52:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.166227+0000 mon.c (mon.1) 874 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.167491+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.167585+0000 mon.c (mon.1) 875 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.168893+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.168915+0000 mon.c (mon.1) 876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:52:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:13 gibba003 bash[32348]: audit 2021-03-10T14:52:13.169559+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:52:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.094159+0000 mon.c (mon.1) 871 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.095571+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.163889+0000 mon.c (mon.1) 872 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.164953+0000 mon.c (mon.1) 873 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:52:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.165131+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.166095+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:52:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.166227+0000 mon.c (mon.1) 874 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.167491+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.167585+0000 mon.c (mon.1) 875 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.168893+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:52:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.168915+0000 mon.c (mon.1) 876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:52:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:13 gibba043 bash[24019]: audit 2021-03-10T14:52:13.169559+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:52:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:14 gibba003 bash[31385]: cluster 2021-03-10T14:52:13.723592+0000 mgr.gibba043.dnkmem (mgr.34373) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:14 gibba003 bash[32348]: cluster 2021-03-10T14:52:13.723592+0000 mgr.gibba043.dnkmem (mgr.34373) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:14 gibba043 bash[24019]: cluster 2021-03-10T14:52:13.723592+0000 mgr.gibba043.dnkmem (mgr.34373) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:16 gibba003 bash[31385]: cluster 2021-03-10T14:52:15.725201+0000 mgr.gibba043.dnkmem (mgr.34373) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:16 gibba003 bash[32348]: cluster 2021-03-10T14:52:15.725201+0000 mgr.gibba043.dnkmem (mgr.34373) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:16 gibba043 bash[24019]: cluster 2021-03-10T14:52:15.725201+0000 mgr.gibba043.dnkmem (mgr.34373) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:18 gibba003 bash[31385]: cluster 2021-03-10T14:52:17.726903+0000 mgr.gibba043.dnkmem (mgr.34373) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:18 gibba003 bash[32348]: cluster 2021-03-10T14:52:17.726903+0000 mgr.gibba043.dnkmem (mgr.34373) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:18 gibba043 bash[24019]: cluster 2021-03-10T14:52:17.726903+0000 mgr.gibba043.dnkmem (mgr.34373) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:20 gibba043 bash[24019]: cluster 2021-03-10T14:52:19.728440+0000 mgr.gibba043.dnkmem (mgr.34373) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:20 gibba003 bash[31385]: cluster 2021-03-10T14:52:19.728440+0000 mgr.gibba043.dnkmem (mgr.34373) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:20 gibba003 bash[32348]: cluster 2021-03-10T14:52:19.728440+0000 mgr.gibba043.dnkmem (mgr.34373) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:21 gibba003 bash[31385]: cephadm 2021-03-10T14:52:20.641217+0000 mgr.gibba043.dnkmem (mgr.34373) 3258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:21 gibba003 bash[32348]: cephadm 2021-03-10T14:52:20.641217+0000 mgr.gibba043.dnkmem (mgr.34373) 3258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:21 gibba043 bash[24019]: cephadm 2021-03-10T14:52:20.641217+0000 mgr.gibba043.dnkmem (mgr.34373) 3258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:22 gibba003 bash[31385]: cluster 2021-03-10T14:52:21.729961+0000 mgr.gibba043.dnkmem (mgr.34373) 3259 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:22 gibba003 bash[32348]: cluster 2021-03-10T14:52:21.729961+0000 mgr.gibba043.dnkmem (mgr.34373) 3259 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:22 gibba043 bash[24019]: cluster 2021-03-10T14:52:21.729961+0000 mgr.gibba043.dnkmem (mgr.34373) 3259 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:24 gibba003 bash[31385]: cluster 2021-03-10T14:52:23.731634+0000 mgr.gibba043.dnkmem (mgr.34373) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:24 gibba003 bash[32348]: cluster 2021-03-10T14:52:23.731634+0000 mgr.gibba043.dnkmem (mgr.34373) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:24 gibba043 bash[24019]: cluster 2021-03-10T14:52:23.731634+0000 mgr.gibba043.dnkmem (mgr.34373) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:26 gibba003 bash[31385]: cluster 2021-03-10T14:52:25.732875+0000 mgr.gibba043.dnkmem (mgr.34373) 3261 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:26 gibba003 bash[32348]: cluster 2021-03-10T14:52:25.732875+0000 mgr.gibba043.dnkmem (mgr.34373) 3261 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:26 gibba043 bash[24019]: cluster 2021-03-10T14:52:25.732875+0000 mgr.gibba043.dnkmem (mgr.34373) 3261 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:28.643 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:52:28.868 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:52:28.868 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (60m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:52:28.868 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:52:28.869 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:52:28.869 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:52:28.869 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:52:28.869 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:52:28.870 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:52:28.870 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:52:28.870 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (66m) 6m ago 66m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:52:28.870 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (66m) 4m ago 66m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:52:28.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:52:28.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:52:28.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:52:28.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:52:28.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:52:28.872 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:52:28.872 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:52:28.872 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:52:28.872 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (65m) 4m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:52:28.873 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:52:29.126 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:52:29.127 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:52:29.127 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:29.127 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:52:29.127 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:52:29.128 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:29.128 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:52:29.128 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:52:29.128 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:52:29.129 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:52:29.129 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:52:29.129 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:52:29.129 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:52:29.129 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:52:29.130 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:52:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:28 gibba003 bash[31385]: cluster 2021-03-10T14:52:27.734509+0000 mgr.gibba043.dnkmem (mgr.34373) 3262 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:28 gibba003 bash[32348]: cluster 2021-03-10T14:52:27.734509+0000 mgr.gibba043.dnkmem (mgr.34373) 3262 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:28 gibba043 bash[24019]: cluster 2021-03-10T14:52:27.734509+0000 mgr.gibba043.dnkmem (mgr.34373) 3262 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:29 gibba003 bash[32348]: audit 2021-03-10T14:52:28.631641+0000 mgr.gibba043.dnkmem (mgr.34373) 3263 : audit [DBG] from='client.46248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:30.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:29 gibba003 bash[32348]: audit 2021-03-10T14:52:28.854907+0000 mgr.gibba043.dnkmem (mgr.34373) 3264 : audit [DBG] from='client.56242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:30.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:29 gibba003 bash[32348]: audit 2021-03-10T14:52:29.126104+0000 mon.c (mon.1) 877 : audit [DBG] from='client.? 172.21.2.103:0/1213541467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:30.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:29 gibba003 bash[31385]: audit 2021-03-10T14:52:28.631641+0000 mgr.gibba043.dnkmem (mgr.34373) 3263 : audit [DBG] from='client.46248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:30.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:29 gibba003 bash[31385]: audit 2021-03-10T14:52:28.854907+0000 mgr.gibba043.dnkmem (mgr.34373) 3264 : audit [DBG] from='client.56242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:29 gibba003 bash[31385]: audit 2021-03-10T14:52:29.126104+0000 mon.c (mon.1) 877 : audit [DBG] from='client.? 172.21.2.103:0/1213541467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:30.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:29 gibba043 bash[24019]: audit 2021-03-10T14:52:28.631641+0000 mgr.gibba043.dnkmem (mgr.34373) 3263 : audit [DBG] from='client.46248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:29 gibba043 bash[24019]: audit 2021-03-10T14:52:28.854907+0000 mgr.gibba043.dnkmem (mgr.34373) 3264 : audit [DBG] from='client.56242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:29 gibba043 bash[24019]: audit 2021-03-10T14:52:29.126104+0000 mon.c (mon.1) 877 : audit [DBG] from='client.? 172.21.2.103:0/1213541467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:30 gibba003 bash[31385]: cluster 2021-03-10T14:52:29.735989+0000 mgr.gibba043.dnkmem (mgr.34373) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:31.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:30 gibba003 bash[32348]: cluster 2021-03-10T14:52:29.735989+0000 mgr.gibba043.dnkmem (mgr.34373) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:30 gibba043 bash[24019]: cluster 2021-03-10T14:52:29.735989+0000 mgr.gibba043.dnkmem (mgr.34373) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:32 gibba003 bash[31385]: cluster 2021-03-10T14:52:31.737615+0000 mgr.gibba043.dnkmem (mgr.34373) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:33.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:32 gibba003 bash[32348]: cluster 2021-03-10T14:52:31.737615+0000 mgr.gibba043.dnkmem (mgr.34373) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:32 gibba043 bash[24019]: cluster 2021-03-10T14:52:31.737615+0000 mgr.gibba043.dnkmem (mgr.34373) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:34 gibba003 bash[31385]: cluster 2021-03-10T14:52:33.739255+0000 mgr.gibba043.dnkmem (mgr.34373) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:34 gibba003 bash[32348]: cluster 2021-03-10T14:52:33.739255+0000 mgr.gibba043.dnkmem (mgr.34373) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:34 gibba043 bash[24019]: cluster 2021-03-10T14:52:33.739255+0000 mgr.gibba043.dnkmem (mgr.34373) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.656290+0000 mgr.gibba043.dnkmem (mgr.34373) 3268 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:52:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.657850+0000 mgr.gibba043.dnkmem (mgr.34373) 3269 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:52:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cluster 2021-03-10T14:52:35.739744+0000 mgr.gibba043.dnkmem (mgr.34373) 3270 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.890892+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:52:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.892042+0000 mgr.gibba043.dnkmem (mgr.34373) 3271 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.894132+0000 mgr.gibba043.dnkmem (mgr.34373) 3272 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.894694+0000 mon.c (mon.1) 878 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.895579+0000 mgr.gibba043.dnkmem (mgr.34373) 3273 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.895620+0000 mgr.gibba043.dnkmem (mgr.34373) 3274 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.896499+0000 mon.c (mon.1) 879 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.897281+0000 mgr.gibba043.dnkmem (mgr.34373) 3275 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.897320+0000 mgr.gibba043.dnkmem (mgr.34373) 3276 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.898146+0000 mon.c (mon.1) 880 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.898940+0000 mgr.gibba043.dnkmem (mgr.34373) 3277 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.899683+0000 mon.c (mon.1) 881 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.900864+0000 mgr.gibba043.dnkmem (mgr.34373) 3278 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.900906+0000 mgr.gibba043.dnkmem (mgr.34373) 3279 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.902419+0000 mgr.gibba043.dnkmem (mgr.34373) 3280 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.902880+0000 mgr.gibba043.dnkmem (mgr.34373) 3281 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.903431+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.904418+0000 mgr.gibba043.dnkmem (mgr.34373) 3282 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.656290+0000 mgr.gibba043.dnkmem (mgr.34373) 3268 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:52:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.657850+0000 mgr.gibba043.dnkmem (mgr.34373) 3269 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:52:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cluster 2021-03-10T14:52:35.739744+0000 mgr.gibba043.dnkmem (mgr.34373) 3270 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.890892+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:52:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.892042+0000 mgr.gibba043.dnkmem (mgr.34373) 3271 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.894132+0000 mgr.gibba043.dnkmem (mgr.34373) 3272 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.894694+0000 mon.c (mon.1) 878 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.895579+0000 mgr.gibba043.dnkmem (mgr.34373) 3273 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.895620+0000 mgr.gibba043.dnkmem (mgr.34373) 3274 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.896499+0000 mon.c (mon.1) 879 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.897281+0000 mgr.gibba043.dnkmem (mgr.34373) 3275 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.897320+0000 mgr.gibba043.dnkmem (mgr.34373) 3276 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.898146+0000 mon.c (mon.1) 880 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.898940+0000 mgr.gibba043.dnkmem (mgr.34373) 3277 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.899683+0000 mon.c (mon.1) 881 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.900864+0000 mgr.gibba043.dnkmem (mgr.34373) 3278 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.900906+0000 mgr.gibba043.dnkmem (mgr.34373) 3279 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.902419+0000 mgr.gibba043.dnkmem (mgr.34373) 3280 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.902880+0000 mgr.gibba043.dnkmem (mgr.34373) 3281 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.903431+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.904418+0000 mgr.gibba043.dnkmem (mgr.34373) 3282 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:37.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.904470+0000 mgr.gibba043.dnkmem (mgr.34373) 3283 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:37.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: cephadm 2021-03-10T14:52:35.904600+0000 mgr.gibba043.dnkmem (mgr.34373) 3284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:37.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[31385]: audit 2021-03-10T14:52:35.905180+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.904470+0000 mgr.gibba043.dnkmem (mgr.34373) 3283 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:37.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: cephadm 2021-03-10T14:52:35.904600+0000 mgr.gibba043.dnkmem (mgr.34373) 3284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:37.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:36 gibba003 bash[32348]: audit 2021-03-10T14:52:35.905180+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.656290+0000 mgr.gibba043.dnkmem (mgr.34373) 3268 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:52:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.657850+0000 mgr.gibba043.dnkmem (mgr.34373) 3269 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:52:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cluster 2021-03-10T14:52:35.739744+0000 mgr.gibba043.dnkmem (mgr.34373) 3270 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.890892+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:52:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.892042+0000 mgr.gibba043.dnkmem (mgr.34373) 3271 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.894132+0000 mgr.gibba043.dnkmem (mgr.34373) 3272 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.894694+0000 mon.c (mon.1) 878 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.895579+0000 mgr.gibba043.dnkmem (mgr.34373) 3273 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.895620+0000 mgr.gibba043.dnkmem (mgr.34373) 3274 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.896499+0000 mon.c (mon.1) 879 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.897281+0000 mgr.gibba043.dnkmem (mgr.34373) 3275 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.897320+0000 mgr.gibba043.dnkmem (mgr.34373) 3276 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.898146+0000 mon.c (mon.1) 880 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.898940+0000 mgr.gibba043.dnkmem (mgr.34373) 3277 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.899683+0000 mon.c (mon.1) 881 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.900864+0000 mgr.gibba043.dnkmem (mgr.34373) 3278 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.900906+0000 mgr.gibba043.dnkmem (mgr.34373) 3279 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.902419+0000 mgr.gibba043.dnkmem (mgr.34373) 3280 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.902880+0000 mgr.gibba043.dnkmem (mgr.34373) 3281 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.903431+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.904418+0000 mgr.gibba043.dnkmem (mgr.34373) 3282 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.904470+0000 mgr.gibba043.dnkmem (mgr.34373) 3283 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:37.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: cephadm 2021-03-10T14:52:35.904600+0000 mgr.gibba043.dnkmem (mgr.34373) 3284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:37.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:36 gibba043 bash[24019]: audit 2021-03-10T14:52:35.905180+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:38 gibba003 bash[31385]: cluster 2021-03-10T14:52:37.741151+0000 mgr.gibba043.dnkmem (mgr.34373) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:39.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:38 gibba003 bash[32348]: cluster 2021-03-10T14:52:37.741151+0000 mgr.gibba043.dnkmem (mgr.34373) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:38 gibba043 bash[24019]: cluster 2021-03-10T14:52:37.741151+0000 mgr.gibba043.dnkmem (mgr.34373) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:40 gibba003 bash[31385]: cluster 2021-03-10T14:52:39.742671+0000 mgr.gibba043.dnkmem (mgr.34373) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:40 gibba003 bash[32348]: cluster 2021-03-10T14:52:39.742671+0000 mgr.gibba043.dnkmem (mgr.34373) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:40 gibba043 bash[24019]: cluster 2021-03-10T14:52:39.742671+0000 mgr.gibba043.dnkmem (mgr.34373) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:42 gibba003 bash[31385]: cluster 2021-03-10T14:52:41.744384+0000 mgr.gibba043.dnkmem (mgr.34373) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:43.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:42 gibba003 bash[32348]: cluster 2021-03-10T14:52:41.744384+0000 mgr.gibba043.dnkmem (mgr.34373) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:42 gibba043 bash[24019]: cluster 2021-03-10T14:52:41.744384+0000 mgr.gibba043.dnkmem (mgr.34373) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:44 gibba003 bash[31385]: cluster 2021-03-10T14:52:43.745884+0000 mgr.gibba043.dnkmem (mgr.34373) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:44 gibba003 bash[32348]: cluster 2021-03-10T14:52:43.745884+0000 mgr.gibba043.dnkmem (mgr.34373) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:44 gibba043 bash[24019]: cluster 2021-03-10T14:52:43.745884+0000 mgr.gibba043.dnkmem (mgr.34373) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:47.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:46 gibba003 bash[31385]: cluster 2021-03-10T14:52:45.747280+0000 mgr.gibba043.dnkmem (mgr.34373) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:46 gibba003 bash[32348]: cluster 2021-03-10T14:52:45.747280+0000 mgr.gibba043.dnkmem (mgr.34373) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:46 gibba043 bash[24019]: cluster 2021-03-10T14:52:45.747280+0000 mgr.gibba043.dnkmem (mgr.34373) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:48 gibba003 bash[31385]: cluster 2021-03-10T14:52:47.748823+0000 mgr.gibba043.dnkmem (mgr.34373) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:48 gibba003 bash[32348]: cluster 2021-03-10T14:52:47.748823+0000 mgr.gibba043.dnkmem (mgr.34373) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:48 gibba043 bash[24019]: cluster 2021-03-10T14:52:47.748823+0000 mgr.gibba043.dnkmem (mgr.34373) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:50 gibba003 bash[31385]: cluster 2021-03-10T14:52:49.750281+0000 mgr.gibba043.dnkmem (mgr.34373) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:51.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:50 gibba003 bash[32348]: cluster 2021-03-10T14:52:49.750281+0000 mgr.gibba043.dnkmem (mgr.34373) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:50 gibba043 bash[24019]: cluster 2021-03-10T14:52:49.750281+0000 mgr.gibba043.dnkmem (mgr.34373) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:51 gibba003 bash[31385]: cephadm 2021-03-10T14:52:50.906137+0000 mgr.gibba043.dnkmem (mgr.34373) 3292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:51 gibba003 bash[32348]: cephadm 2021-03-10T14:52:50.906137+0000 mgr.gibba043.dnkmem (mgr.34373) 3292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:51 gibba043 bash[24019]: cephadm 2021-03-10T14:52:50.906137+0000 mgr.gibba043.dnkmem (mgr.34373) 3292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:52:53.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:52 gibba003 bash[31385]: cluster 2021-03-10T14:52:51.751945+0000 mgr.gibba043.dnkmem (mgr.34373) 3293 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:52 gibba003 bash[32348]: cluster 2021-03-10T14:52:51.751945+0000 mgr.gibba043.dnkmem (mgr.34373) 3293 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:52 gibba043 bash[24019]: cluster 2021-03-10T14:52:51.751945+0000 mgr.gibba043.dnkmem (mgr.34373) 3293 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:54 gibba003 bash[31385]: cluster 2021-03-10T14:52:53.753411+0000 mgr.gibba043.dnkmem (mgr.34373) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:54 gibba003 bash[32348]: cluster 2021-03-10T14:52:53.753411+0000 mgr.gibba043.dnkmem (mgr.34373) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:54 gibba043 bash[24019]: cluster 2021-03-10T14:52:53.753411+0000 mgr.gibba043.dnkmem (mgr.34373) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:56 gibba003 bash[31385]: cluster 2021-03-10T14:52:55.754989+0000 mgr.gibba043.dnkmem (mgr.34373) 3295 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:56 gibba003 bash[32348]: cluster 2021-03-10T14:52:55.754989+0000 mgr.gibba043.dnkmem (mgr.34373) 3295 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:56 gibba043 bash[24019]: cluster 2021-03-10T14:52:55.754989+0000 mgr.gibba043.dnkmem (mgr.34373) 3295 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:58 gibba003 bash[31385]: cluster 2021-03-10T14:52:57.756379+0000 mgr.gibba043.dnkmem (mgr.34373) 3296 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:58 gibba003 bash[32348]: cluster 2021-03-10T14:52:57.756379+0000 mgr.gibba043.dnkmem (mgr.34373) 3296 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:58 gibba043 bash[24019]: cluster 2021-03-10T14:52:57.756379+0000 mgr.gibba043.dnkmem (mgr.34373) 3296 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.368 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:52:59.593 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:52:59.593 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (61m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:52:59.594 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (66m) 5m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:52:59.594 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (61m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:52:59.594 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:52:59.594 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:52:59.595 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:52:59.595 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:52:59.595 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:52:59.595 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (66m) 6m ago 66m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:52:59.595 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:52:59.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:52:59.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:52:59.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:52:59.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:52:59.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:52:59.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:52:59.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:52:59.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:52:59.597 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (66m) 5m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:52:59.597 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:52:59.841 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:52:59.842 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:52:59.842 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:59.842 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:52:59.843 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:52:59.843 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:59.846 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:52:59.846 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:52:59.846 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:52:59.847 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:52:59.847 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:52:59.847 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:52:59.847 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:52:59.848 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:52:59.848 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:53:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:52:59 gibba003 bash[31385]: audit 2021-03-10T14:52:59.357785+0000 mgr.gibba043.dnkmem (mgr.34373) 3297 : audit [DBG] from='client.56254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:00.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:52:59 gibba003 bash[32348]: audit 2021-03-10T14:52:59.357785+0000 mgr.gibba043.dnkmem (mgr.34373) 3297 : audit [DBG] from='client.56254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:52:59 gibba043 bash[24019]: audit 2021-03-10T14:52:59.357785+0000 mgr.gibba043.dnkmem (mgr.34373) 3297 : audit [DBG] from='client.56254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:00 gibba003 bash[31385]: audit 2021-03-10T14:52:59.582274+0000 mgr.gibba043.dnkmem (mgr.34373) 3298 : audit [DBG] from='client.56260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:00 gibba003 bash[31385]: cluster 2021-03-10T14:52:59.757845+0000 mgr.gibba043.dnkmem (mgr.34373) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:00 gibba003 bash[31385]: audit 2021-03-10T14:52:59.841240+0000 mon.a (mon.0) 967 : audit [DBG] from='client.? 172.21.2.103:0/831559638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:00 gibba003 bash[32348]: audit 2021-03-10T14:52:59.582274+0000 mgr.gibba043.dnkmem (mgr.34373) 3298 : audit [DBG] from='client.56260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:00 gibba003 bash[32348]: cluster 2021-03-10T14:52:59.757845+0000 mgr.gibba043.dnkmem (mgr.34373) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:00 gibba003 bash[32348]: audit 2021-03-10T14:52:59.841240+0000 mon.a (mon.0) 967 : audit [DBG] from='client.? 172.21.2.103:0/831559638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:00 gibba043 bash[24019]: audit 2021-03-10T14:52:59.582274+0000 mgr.gibba043.dnkmem (mgr.34373) 3298 : audit [DBG] from='client.56260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:00 gibba043 bash[24019]: cluster 2021-03-10T14:52:59.757845+0000 mgr.gibba043.dnkmem (mgr.34373) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:00 gibba043 bash[24019]: audit 2021-03-10T14:52:59.841240+0000 mon.a (mon.0) 967 : audit [DBG] from='client.? 172.21.2.103:0/831559638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:03.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:02 gibba003 bash[31385]: cluster 2021-03-10T14:53:01.759643+0000 mgr.gibba043.dnkmem (mgr.34373) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:03.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:02 gibba003 bash[32348]: cluster 2021-03-10T14:53:01.759643+0000 mgr.gibba043.dnkmem (mgr.34373) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:02 gibba043 bash[24019]: cluster 2021-03-10T14:53:01.759643+0000 mgr.gibba043.dnkmem (mgr.34373) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:04 gibba003 bash[31385]: cluster 2021-03-10T14:53:03.761369+0000 mgr.gibba043.dnkmem (mgr.34373) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:04 gibba003 bash[32348]: cluster 2021-03-10T14:53:03.761369+0000 mgr.gibba043.dnkmem (mgr.34373) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:04 gibba043 bash[24019]: cluster 2021-03-10T14:53:03.761369+0000 mgr.gibba043.dnkmem (mgr.34373) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:06 gibba003 bash[31385]: cluster 2021-03-10T14:53:05.762787+0000 mgr.gibba043.dnkmem (mgr.34373) 3302 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:06 gibba003 bash[31385]: cephadm 2021-03-10T14:53:05.922236+0000 mgr.gibba043.dnkmem (mgr.34373) 3303 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:06 gibba003 bash[32348]: cluster 2021-03-10T14:53:05.762787+0000 mgr.gibba043.dnkmem (mgr.34373) 3302 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:06 gibba003 bash[32348]: cephadm 2021-03-10T14:53:05.922236+0000 mgr.gibba043.dnkmem (mgr.34373) 3303 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:06 gibba043 bash[24019]: cluster 2021-03-10T14:53:05.762787+0000 mgr.gibba043.dnkmem (mgr.34373) 3302 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:06 gibba043 bash[24019]: cephadm 2021-03-10T14:53:05.922236+0000 mgr.gibba043.dnkmem (mgr.34373) 3303 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:08 gibba003 bash[31385]: cluster 2021-03-10T14:53:07.764508+0000 mgr.gibba043.dnkmem (mgr.34373) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:09.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:08 gibba003 bash[32348]: cluster 2021-03-10T14:53:07.764508+0000 mgr.gibba043.dnkmem (mgr.34373) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:08 gibba043 bash[24019]: cluster 2021-03-10T14:53:07.764508+0000 mgr.gibba043.dnkmem (mgr.34373) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:10 gibba003 bash[31385]: cluster 2021-03-10T14:53:09.765911+0000 mgr.gibba043.dnkmem (mgr.34373) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:11.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:10 gibba003 bash[32348]: cluster 2021-03-10T14:53:09.765911+0000 mgr.gibba043.dnkmem (mgr.34373) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:10 gibba043 bash[24019]: cluster 2021-03-10T14:53:09.765911+0000 mgr.gibba043.dnkmem (mgr.34373) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:12 gibba003 bash[31385]: cluster 2021-03-10T14:53:11.767641+0000 mgr.gibba043.dnkmem (mgr.34373) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:13.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:12 gibba003 bash[32348]: cluster 2021-03-10T14:53:11.767641+0000 mgr.gibba043.dnkmem (mgr.34373) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:12 gibba043 bash[24019]: cluster 2021-03-10T14:53:11.767641+0000 mgr.gibba043.dnkmem (mgr.34373) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.101303+0000 mon.c (mon.1) 884 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.102419+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.168984+0000 mon.c (mon.1) 885 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.170092+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.186565+0000 mon.c (mon.1) 886 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:53:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.187352+0000 mon.c (mon.1) 887 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.187791+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:53:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.188100+0000 mon.c (mon.1) 888 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:53:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.188929+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.188957+0000 mon.c (mon.1) 889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.189902+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:53:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[31385]: audit 2021-03-10T14:53:13.190854+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.101303+0000 mon.c (mon.1) 884 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.102419+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.168984+0000 mon.c (mon.1) 885 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.170092+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.186565+0000 mon.c (mon.1) 886 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:53:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.187352+0000 mon.c (mon.1) 887 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.187791+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:53:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.188100+0000 mon.c (mon.1) 888 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:53:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.188929+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.188957+0000 mon.c (mon.1) 889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.189902+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:53:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:13 gibba003 bash[32348]: audit 2021-03-10T14:53:13.190854+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.101303+0000 mon.c (mon.1) 884 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.102419+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.168984+0000 mon.c (mon.1) 885 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.170092+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.186565+0000 mon.c (mon.1) 886 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:53:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.187352+0000 mon.c (mon.1) 887 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.187791+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:53:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.188100+0000 mon.c (mon.1) 888 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:53:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.188929+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.188957+0000 mon.c (mon.1) 889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:53:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.189902+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:53:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:13 gibba043 bash[24019]: audit 2021-03-10T14:53:13.190854+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:53:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:14 gibba003 bash[31385]: cluster 2021-03-10T14:53:13.769317+0000 mgr.gibba043.dnkmem (mgr.34373) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:14 gibba003 bash[32348]: cluster 2021-03-10T14:53:13.769317+0000 mgr.gibba043.dnkmem (mgr.34373) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:14 gibba043 bash[24019]: cluster 2021-03-10T14:53:13.769317+0000 mgr.gibba043.dnkmem (mgr.34373) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:16 gibba003 bash[31385]: cluster 2021-03-10T14:53:15.770852+0000 mgr.gibba043.dnkmem (mgr.34373) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:16 gibba003 bash[32348]: cluster 2021-03-10T14:53:15.770852+0000 mgr.gibba043.dnkmem (mgr.34373) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:16 gibba043 bash[24019]: cluster 2021-03-10T14:53:15.770852+0000 mgr.gibba043.dnkmem (mgr.34373) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:18 gibba003 bash[31385]: cluster 2021-03-10T14:53:17.772348+0000 mgr.gibba043.dnkmem (mgr.34373) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:18 gibba003 bash[32348]: cluster 2021-03-10T14:53:17.772348+0000 mgr.gibba043.dnkmem (mgr.34373) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:19.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:18 gibba043 bash[24019]: cluster 2021-03-10T14:53:17.772348+0000 mgr.gibba043.dnkmem (mgr.34373) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:20 gibba003 bash[31385]: cluster 2021-03-10T14:53:19.774277+0000 mgr.gibba043.dnkmem (mgr.34373) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:20 gibba003 bash[32348]: cluster 2021-03-10T14:53:19.774277+0000 mgr.gibba043.dnkmem (mgr.34373) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:20 gibba043 bash[24019]: cluster 2021-03-10T14:53:19.774277+0000 mgr.gibba043.dnkmem (mgr.34373) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:21 gibba003 bash[31385]: cephadm 2021-03-10T14:53:20.937899+0000 mgr.gibba043.dnkmem (mgr.34373) 3311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:21 gibba003 bash[32348]: cephadm 2021-03-10T14:53:20.937899+0000 mgr.gibba043.dnkmem (mgr.34373) 3311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:21 gibba043 bash[24019]: cephadm 2021-03-10T14:53:20.937899+0000 mgr.gibba043.dnkmem (mgr.34373) 3311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:23.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:22 gibba003 bash[31385]: cluster 2021-03-10T14:53:21.775937+0000 mgr.gibba043.dnkmem (mgr.34373) 3312 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:23.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:22 gibba003 bash[32348]: cluster 2021-03-10T14:53:21.775937+0000 mgr.gibba043.dnkmem (mgr.34373) 3312 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:22 gibba043 bash[24019]: cluster 2021-03-10T14:53:21.775937+0000 mgr.gibba043.dnkmem (mgr.34373) 3312 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:24 gibba003 bash[31385]: cluster 2021-03-10T14:53:23.777618+0000 mgr.gibba043.dnkmem (mgr.34373) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:24 gibba003 bash[32348]: cluster 2021-03-10T14:53:23.777618+0000 mgr.gibba043.dnkmem (mgr.34373) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:24 gibba043 bash[24019]: cluster 2021-03-10T14:53:23.777618+0000 mgr.gibba043.dnkmem (mgr.34373) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:26 gibba003 bash[31385]: cluster 2021-03-10T14:53:25.779293+0000 mgr.gibba043.dnkmem (mgr.34373) 3314 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:26 gibba003 bash[32348]: cluster 2021-03-10T14:53:25.779293+0000 mgr.gibba043.dnkmem (mgr.34373) 3314 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:26 gibba043 bash[24019]: cluster 2021-03-10T14:53:25.779293+0000 mgr.gibba043.dnkmem (mgr.34373) 3314 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:28 gibba003 bash[31385]: cluster 2021-03-10T14:53:27.780639+0000 mgr.gibba043.dnkmem (mgr.34373) 3315 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:28 gibba003 bash[32348]: cluster 2021-03-10T14:53:27.780639+0000 mgr.gibba043.dnkmem (mgr.34373) 3315 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:28 gibba043 bash[24019]: cluster 2021-03-10T14:53:27.780639+0000 mgr.gibba043.dnkmem (mgr.34373) 3315 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:30.088 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:53:30.313 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:53:30.313 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (61m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:53:30.313 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (66m) 6m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:53:30.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (62m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:53:30.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (62m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:53:30.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:53:30.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:53:30.315 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:53:30.315 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:53:30.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:53:30.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:53:30.315 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:53:30.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:53:30.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:53:30.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:53:30.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:53:30.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:53:30.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:53:30.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (57m) 6m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:53:30.317 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (66m) 6m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:53:30.317 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:53:30.560 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:53:30.561 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:53:30.561 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:30.561 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:53:30.561 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:53:30.561 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:30.562 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:53:30.562 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:53:30.562 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:53:30.562 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:53:30.563 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:53:30.563 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:53:30.563 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:53:30.564 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:53:30.564 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:53:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[31385]: cluster 2021-03-10T14:53:29.782255+0000 mgr.gibba043.dnkmem (mgr.34373) 3316 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[31385]: audit 2021-03-10T14:53:30.076796+0000 mgr.gibba043.dnkmem (mgr.34373) 3317 : audit [DBG] from='client.46284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[31385]: audit 2021-03-10T14:53:30.298263+0000 mgr.gibba043.dnkmem (mgr.34373) 3318 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[31385]: audit 2021-03-10T14:53:30.560030+0000 mon.a (mon.0) 974 : audit [DBG] from='client.? 172.21.2.103:0/2948005136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[32348]: cluster 2021-03-10T14:53:29.782255+0000 mgr.gibba043.dnkmem (mgr.34373) 3316 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[32348]: audit 2021-03-10T14:53:30.076796+0000 mgr.gibba043.dnkmem (mgr.34373) 3317 : audit [DBG] from='client.46284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[32348]: audit 2021-03-10T14:53:30.298263+0000 mgr.gibba043.dnkmem (mgr.34373) 3318 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:31.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:30 gibba003 bash[32348]: audit 2021-03-10T14:53:30.560030+0000 mon.a (mon.0) 974 : audit [DBG] from='client.? 172.21.2.103:0/2948005136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:30 gibba043 bash[24019]: cluster 2021-03-10T14:53:29.782255+0000 mgr.gibba043.dnkmem (mgr.34373) 3316 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:30 gibba043 bash[24019]: audit 2021-03-10T14:53:30.076796+0000 mgr.gibba043.dnkmem (mgr.34373) 3317 : audit [DBG] from='client.46284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:30 gibba043 bash[24019]: audit 2021-03-10T14:53:30.298263+0000 mgr.gibba043.dnkmem (mgr.34373) 3318 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:30 gibba043 bash[24019]: audit 2021-03-10T14:53:30.560030+0000 mon.a (mon.0) 974 : audit [DBG] from='client.? 172.21.2.103:0/2948005136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:33.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:32 gibba003 bash[31385]: cluster 2021-03-10T14:53:31.783841+0000 mgr.gibba043.dnkmem (mgr.34373) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:33.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:32 gibba003 bash[32348]: cluster 2021-03-10T14:53:31.783841+0000 mgr.gibba043.dnkmem (mgr.34373) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:32 gibba043 bash[24019]: cluster 2021-03-10T14:53:31.783841+0000 mgr.gibba043.dnkmem (mgr.34373) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:34 gibba003 bash[31385]: cluster 2021-03-10T14:53:33.785243+0000 mgr.gibba043.dnkmem (mgr.34373) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:34 gibba003 bash[32348]: cluster 2021-03-10T14:53:33.785243+0000 mgr.gibba043.dnkmem (mgr.34373) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:34 gibba043 bash[24019]: cluster 2021-03-10T14:53:33.785243+0000 mgr.gibba043.dnkmem (mgr.34373) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cluster 2021-03-10T14:53:35.786898+0000 mgr.gibba043.dnkmem (mgr.34373) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.150875+0000 mgr.gibba043.dnkmem (mgr.34373) 3322 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:53:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.151576+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.155185+0000 mgr.gibba043.dnkmem (mgr.34373) 3323 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:53:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.155928+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.357679+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.358813+0000 mgr.gibba043.dnkmem (mgr.34373) 3324 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.361628+0000 mon.c (mon.1) 890 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.362127+0000 mgr.gibba043.dnkmem (mgr.34373) 3325 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.364573+0000 mon.c (mon.1) 891 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.364616+0000 mgr.gibba043.dnkmem (mgr.34373) 3326 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.364652+0000 mgr.gibba043.dnkmem (mgr.34373) 3327 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.367171+0000 mgr.gibba043.dnkmem (mgr.34373) 3328 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.367217+0000 mon.c (mon.1) 892 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.367260+0000 mgr.gibba043.dnkmem (mgr.34373) 3329 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.369635+0000 mon.c (mon.1) 893 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.369746+0000 mgr.gibba043.dnkmem (mgr.34373) 3330 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.373738+0000 mgr.gibba043.dnkmem (mgr.34373) 3331 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.373780+0000 mgr.gibba043.dnkmem (mgr.34373) 3332 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.376544+0000 mon.c (mon.1) 894 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.376655+0000 mgr.gibba043.dnkmem (mgr.34373) 3333 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cluster 2021-03-10T14:53:35.786898+0000 mgr.gibba043.dnkmem (mgr.34373) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.150875+0000 mgr.gibba043.dnkmem (mgr.34373) 3322 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:53:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.151576+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.155185+0000 mgr.gibba043.dnkmem (mgr.34373) 3323 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:53:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.155928+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.357679+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.358813+0000 mgr.gibba043.dnkmem (mgr.34373) 3324 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.361628+0000 mon.c (mon.1) 890 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.362127+0000 mgr.gibba043.dnkmem (mgr.34373) 3325 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.364573+0000 mon.c (mon.1) 891 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.364616+0000 mgr.gibba043.dnkmem (mgr.34373) 3326 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.364652+0000 mgr.gibba043.dnkmem (mgr.34373) 3327 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.367171+0000 mgr.gibba043.dnkmem (mgr.34373) 3328 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.367217+0000 mon.c (mon.1) 892 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.367260+0000 mgr.gibba043.dnkmem (mgr.34373) 3329 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.369635+0000 mon.c (mon.1) 893 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.369746+0000 mgr.gibba043.dnkmem (mgr.34373) 3330 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.373738+0000 mgr.gibba043.dnkmem (mgr.34373) 3331 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.373780+0000 mgr.gibba043.dnkmem (mgr.34373) 3332 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.376544+0000 mon.c (mon.1) 894 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.376655+0000 mgr.gibba043.dnkmem (mgr.34373) 3333 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:37.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.377117+0000 mgr.gibba043.dnkmem (mgr.34373) 3334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:37.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: audit 2021-03-10T14:53:36.379473+0000 mon.c (mon.1) 895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.379729+0000 mgr.gibba043.dnkmem (mgr.34373) 3335 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:37.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.379772+0000 mgr.gibba043.dnkmem (mgr.34373) 3336 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:37.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[31385]: cephadm 2021-03-10T14:53:36.379896+0000 mgr.gibba043.dnkmem (mgr.34373) 3337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.377117+0000 mgr.gibba043.dnkmem (mgr.34373) 3334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:37.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: audit 2021-03-10T14:53:36.379473+0000 mon.c (mon.1) 895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.379729+0000 mgr.gibba043.dnkmem (mgr.34373) 3335 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:37.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.379772+0000 mgr.gibba043.dnkmem (mgr.34373) 3336 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:37.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:37 gibba003 bash[32348]: cephadm 2021-03-10T14:53:36.379896+0000 mgr.gibba043.dnkmem (mgr.34373) 3337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cluster 2021-03-10T14:53:35.786898+0000 mgr.gibba043.dnkmem (mgr.34373) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.150875+0000 mgr.gibba043.dnkmem (mgr.34373) 3322 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:53:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.151576+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.155185+0000 mgr.gibba043.dnkmem (mgr.34373) 3323 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:53:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.155928+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.357679+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:53:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.358813+0000 mgr.gibba043.dnkmem (mgr.34373) 3324 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.361628+0000 mon.c (mon.1) 890 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.362127+0000 mgr.gibba043.dnkmem (mgr.34373) 3325 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.364573+0000 mon.c (mon.1) 891 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.364616+0000 mgr.gibba043.dnkmem (mgr.34373) 3326 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.364652+0000 mgr.gibba043.dnkmem (mgr.34373) 3327 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.367171+0000 mgr.gibba043.dnkmem (mgr.34373) 3328 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.367217+0000 mon.c (mon.1) 892 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.367260+0000 mgr.gibba043.dnkmem (mgr.34373) 3329 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.369635+0000 mon.c (mon.1) 893 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.369746+0000 mgr.gibba043.dnkmem (mgr.34373) 3330 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.373738+0000 mgr.gibba043.dnkmem (mgr.34373) 3331 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.373780+0000 mgr.gibba043.dnkmem (mgr.34373) 3332 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.376544+0000 mon.c (mon.1) 894 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.376655+0000 mgr.gibba043.dnkmem (mgr.34373) 3333 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.377117+0000 mgr.gibba043.dnkmem (mgr.34373) 3334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: audit 2021-03-10T14:53:36.379473+0000 mon.c (mon.1) 895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:37.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.379729+0000 mgr.gibba043.dnkmem (mgr.34373) 3335 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:37.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.379772+0000 mgr.gibba043.dnkmem (mgr.34373) 3336 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:37.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:37 gibba043 bash[24019]: cephadm 2021-03-10T14:53:36.379896+0000 mgr.gibba043.dnkmem (mgr.34373) 3337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:39 gibba003 bash[31385]: cluster 2021-03-10T14:53:37.788379+0000 mgr.gibba043.dnkmem (mgr.34373) 3338 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:39 gibba003 bash[32348]: cluster 2021-03-10T14:53:37.788379+0000 mgr.gibba043.dnkmem (mgr.34373) 3338 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:39 gibba043 bash[24019]: cluster 2021-03-10T14:53:37.788379+0000 mgr.gibba043.dnkmem (mgr.34373) 3338 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:41 gibba003 bash[31385]: cluster 2021-03-10T14:53:39.790053+0000 mgr.gibba043.dnkmem (mgr.34373) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:41 gibba003 bash[32348]: cluster 2021-03-10T14:53:39.790053+0000 mgr.gibba043.dnkmem (mgr.34373) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:41 gibba043 bash[24019]: cluster 2021-03-10T14:53:39.790053+0000 mgr.gibba043.dnkmem (mgr.34373) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:43 gibba003 bash[31385]: cluster 2021-03-10T14:53:41.791731+0000 mgr.gibba043.dnkmem (mgr.34373) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:43 gibba003 bash[32348]: cluster 2021-03-10T14:53:41.791731+0000 mgr.gibba043.dnkmem (mgr.34373) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:43 gibba043 bash[24019]: cluster 2021-03-10T14:53:41.791731+0000 mgr.gibba043.dnkmem (mgr.34373) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:44 gibba003 bash[31385]: cluster 2021-03-10T14:53:43.793389+0000 mgr.gibba043.dnkmem (mgr.34373) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:44 gibba003 bash[32348]: cluster 2021-03-10T14:53:43.793389+0000 mgr.gibba043.dnkmem (mgr.34373) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:44 gibba043 bash[24019]: cluster 2021-03-10T14:53:43.793389+0000 mgr.gibba043.dnkmem (mgr.34373) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:47.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:46 gibba003 bash[31385]: cluster 2021-03-10T14:53:45.795057+0000 mgr.gibba043.dnkmem (mgr.34373) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:46 gibba003 bash[32348]: cluster 2021-03-10T14:53:45.795057+0000 mgr.gibba043.dnkmem (mgr.34373) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:47.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:46 gibba043 bash[24019]: cluster 2021-03-10T14:53:45.795057+0000 mgr.gibba043.dnkmem (mgr.34373) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:48 gibba003 bash[31385]: cluster 2021-03-10T14:53:47.796487+0000 mgr.gibba043.dnkmem (mgr.34373) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:48 gibba003 bash[32348]: cluster 2021-03-10T14:53:47.796487+0000 mgr.gibba043.dnkmem (mgr.34373) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:48 gibba043 bash[24019]: cluster 2021-03-10T14:53:47.796487+0000 mgr.gibba043.dnkmem (mgr.34373) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:51.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:50 gibba003 bash[31385]: cluster 2021-03-10T14:53:49.798116+0000 mgr.gibba043.dnkmem (mgr.34373) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:51.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:50 gibba003 bash[32348]: cluster 2021-03-10T14:53:49.798116+0000 mgr.gibba043.dnkmem (mgr.34373) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:50 gibba043 bash[24019]: cluster 2021-03-10T14:53:49.798116+0000 mgr.gibba043.dnkmem (mgr.34373) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:52.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:51 gibba003 bash[31385]: cephadm 2021-03-10T14:53:51.395653+0000 mgr.gibba043.dnkmem (mgr.34373) 3345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:52.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:51 gibba003 bash[32348]: cephadm 2021-03-10T14:53:51.395653+0000 mgr.gibba043.dnkmem (mgr.34373) 3345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:51 gibba043 bash[24019]: cephadm 2021-03-10T14:53:51.395653+0000 mgr.gibba043.dnkmem (mgr.34373) 3345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:53:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:52 gibba003 bash[31385]: cluster 2021-03-10T14:53:51.799610+0000 mgr.gibba043.dnkmem (mgr.34373) 3346 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:52 gibba003 bash[32348]: cluster 2021-03-10T14:53:51.799610+0000 mgr.gibba043.dnkmem (mgr.34373) 3346 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:52 gibba043 bash[24019]: cluster 2021-03-10T14:53:51.799610+0000 mgr.gibba043.dnkmem (mgr.34373) 3346 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:54 gibba043 bash[24019]: cluster 2021-03-10T14:53:53.801309+0000 mgr.gibba043.dnkmem (mgr.34373) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:54 gibba003 bash[31385]: cluster 2021-03-10T14:53:53.801309+0000 mgr.gibba043.dnkmem (mgr.34373) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:54 gibba003 bash[32348]: cluster 2021-03-10T14:53:53.801309+0000 mgr.gibba043.dnkmem (mgr.34373) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:56 gibba003 bash[31385]: cluster 2021-03-10T14:53:55.802707+0000 mgr.gibba043.dnkmem (mgr.34373) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:56 gibba003 bash[32348]: cluster 2021-03-10T14:53:55.802707+0000 mgr.gibba043.dnkmem (mgr.34373) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:56 gibba043 bash[24019]: cluster 2021-03-10T14:53:55.802707+0000 mgr.gibba043.dnkmem (mgr.34373) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:53:58 gibba003 bash[31385]: cluster 2021-03-10T14:53:57.804285+0000 mgr.gibba043.dnkmem (mgr.34373) 3349 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:53:58 gibba003 bash[32348]: cluster 2021-03-10T14:53:57.804285+0000 mgr.gibba043.dnkmem (mgr.34373) 3349 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:53:58 gibba043 bash[24019]: cluster 2021-03-10T14:53:57.804285+0000 mgr.gibba043.dnkmem (mgr.34373) 3349 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:00.801 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:54:01.028 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:54:01.029 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (62m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:54:01.029 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (67m) 6m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:54:01.029 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (62m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:54:01.029 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:54:01.030 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (62m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:54:01.030 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:54:01.030 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:54:01.030 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:54:01.030 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:54:01.031 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:54:01.031 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:54:01.031 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:54:01.031 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:54:01.031 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:54:01.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:54:01.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:54:01.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:54:01.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:54:01.032 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (67m) 6m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:54:01.033 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:54:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:00 gibba003 bash[31385]: cluster 2021-03-10T14:53:59.805964+0000 mgr.gibba043.dnkmem (mgr.34373) 3350 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:00 gibba003 bash[32348]: cluster 2021-03-10T14:53:59.805964+0000 mgr.gibba043.dnkmem (mgr.34373) 3350 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:00 gibba043 bash[24019]: cluster 2021-03-10T14:53:59.805964+0000 mgr.gibba043.dnkmem (mgr.34373) 3350 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:01.276 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:54:01.276 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:54:01.276 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:01.277 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:54:01.277 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:54:01.277 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:01.277 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:54:01.278 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:54:01.278 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:54:01.278 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:54:01.278 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:54:01.278 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:54:01.279 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:54:01.279 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:54:01.279 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:54:02.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:01 gibba003 bash[31385]: audit 2021-03-10T14:54:00.789547+0000 mgr.gibba043.dnkmem (mgr.34373) 3351 : audit [DBG] from='client.56290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:02.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:01 gibba003 bash[31385]: audit 2021-03-10T14:54:01.014250+0000 mgr.gibba043.dnkmem (mgr.34373) 3352 : audit [DBG] from='client.56296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:02.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:01 gibba003 bash[31385]: audit 2021-03-10T14:54:01.275914+0000 mon.a (mon.0) 978 : audit [DBG] from='client.? 172.21.2.103:0/2331036455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:01 gibba003 bash[32348]: audit 2021-03-10T14:54:00.789547+0000 mgr.gibba043.dnkmem (mgr.34373) 3351 : audit [DBG] from='client.56290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:01 gibba003 bash[32348]: audit 2021-03-10T14:54:01.014250+0000 mgr.gibba043.dnkmem (mgr.34373) 3352 : audit [DBG] from='client.56296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:01 gibba003 bash[32348]: audit 2021-03-10T14:54:01.275914+0000 mon.a (mon.0) 978 : audit [DBG] from='client.? 172.21.2.103:0/2331036455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:01 gibba043 bash[24019]: audit 2021-03-10T14:54:00.789547+0000 mgr.gibba043.dnkmem (mgr.34373) 3351 : audit [DBG] from='client.56290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:01 gibba043 bash[24019]: audit 2021-03-10T14:54:01.014250+0000 mgr.gibba043.dnkmem (mgr.34373) 3352 : audit [DBG] from='client.56296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:01 gibba043 bash[24019]: audit 2021-03-10T14:54:01.275914+0000 mon.a (mon.0) 978 : audit [DBG] from='client.? 172.21.2.103:0/2331036455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:03.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:02 gibba003 bash[31385]: cluster 2021-03-10T14:54:01.807643+0000 mgr.gibba043.dnkmem (mgr.34373) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:03.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:02 gibba003 bash[32348]: cluster 2021-03-10T14:54:01.807643+0000 mgr.gibba043.dnkmem (mgr.34373) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:02 gibba043 bash[24019]: cluster 2021-03-10T14:54:01.807643+0000 mgr.gibba043.dnkmem (mgr.34373) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:04 gibba043 bash[24019]: cluster 2021-03-10T14:54:03.809036+0000 mgr.gibba043.dnkmem (mgr.34373) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:04 gibba003 bash[31385]: cluster 2021-03-10T14:54:03.809036+0000 mgr.gibba043.dnkmem (mgr.34373) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:04 gibba003 bash[32348]: cluster 2021-03-10T14:54:03.809036+0000 mgr.gibba043.dnkmem (mgr.34373) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:06 gibba003 bash[31385]: cluster 2021-03-10T14:54:05.810734+0000 mgr.gibba043.dnkmem (mgr.34373) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:06 gibba003 bash[31385]: cephadm 2021-03-10T14:54:06.400736+0000 mgr.gibba043.dnkmem (mgr.34373) 3356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:06 gibba003 bash[32348]: cluster 2021-03-10T14:54:05.810734+0000 mgr.gibba043.dnkmem (mgr.34373) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:06 gibba003 bash[32348]: cephadm 2021-03-10T14:54:06.400736+0000 mgr.gibba043.dnkmem (mgr.34373) 3356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:06 gibba043 bash[24019]: cluster 2021-03-10T14:54:05.810734+0000 mgr.gibba043.dnkmem (mgr.34373) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:06 gibba043 bash[24019]: cephadm 2021-03-10T14:54:06.400736+0000 mgr.gibba043.dnkmem (mgr.34373) 3356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:08 gibba003 bash[31385]: cluster 2021-03-10T14:54:07.812274+0000 mgr.gibba043.dnkmem (mgr.34373) 3357 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:09.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:08 gibba003 bash[32348]: cluster 2021-03-10T14:54:07.812274+0000 mgr.gibba043.dnkmem (mgr.34373) 3357 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:08 gibba043 bash[24019]: cluster 2021-03-10T14:54:07.812274+0000 mgr.gibba043.dnkmem (mgr.34373) 3357 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:11.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:10 gibba003 bash[31385]: cluster 2021-03-10T14:54:09.813943+0000 mgr.gibba043.dnkmem (mgr.34373) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:11.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:10 gibba003 bash[32348]: cluster 2021-03-10T14:54:09.813943+0000 mgr.gibba043.dnkmem (mgr.34373) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:10 gibba043 bash[24019]: cluster 2021-03-10T14:54:09.813943+0000 mgr.gibba043.dnkmem (mgr.34373) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:12 gibba003 bash[31385]: cluster 2021-03-10T14:54:11.815582+0000 mgr.gibba043.dnkmem (mgr.34373) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:13.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:12 gibba003 bash[32348]: cluster 2021-03-10T14:54:11.815582+0000 mgr.gibba043.dnkmem (mgr.34373) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:12 gibba043 bash[24019]: cluster 2021-03-10T14:54:11.815582+0000 mgr.gibba043.dnkmem (mgr.34373) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.108269+0000 mon.c (mon.1) 896 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.109431+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.179245+0000 mon.c (mon.1) 897 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.180302+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.195153+0000 mon.c (mon.1) 898 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:54:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.195896+0000 mon.c (mon.1) 899 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:54:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.196369+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:54:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.196586+0000 mon.c (mon.1) 900 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.197395+0000 mon.c (mon.1) 901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.197586+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:54:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.198763+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[31385]: audit 2021-03-10T14:54:13.199596+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.108269+0000 mon.c (mon.1) 896 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.109431+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.179245+0000 mon.c (mon.1) 897 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.180302+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.195153+0000 mon.c (mon.1) 898 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:54:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.195896+0000 mon.c (mon.1) 899 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:54:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.196369+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:54:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.196586+0000 mon.c (mon.1) 900 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.197395+0000 mon.c (mon.1) 901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.197586+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:54:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.198763+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:13 gibba003 bash[32348]: audit 2021-03-10T14:54:13.199596+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.108269+0000 mon.c (mon.1) 896 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.109431+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.179245+0000 mon.c (mon.1) 897 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.180302+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.195153+0000 mon.c (mon.1) 898 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:54:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.195896+0000 mon.c (mon.1) 899 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:54:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.196369+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:54:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.196586+0000 mon.c (mon.1) 900 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.197395+0000 mon.c (mon.1) 901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.197586+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:54:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.198763+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:13 gibba043 bash[24019]: audit 2021-03-10T14:54:13.199596+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:54:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:14 gibba003 bash[31385]: cluster 2021-03-10T14:54:13.817071+0000 mgr.gibba043.dnkmem (mgr.34373) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:14 gibba003 bash[32348]: cluster 2021-03-10T14:54:13.817071+0000 mgr.gibba043.dnkmem (mgr.34373) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:14 gibba043 bash[24019]: cluster 2021-03-10T14:54:13.817071+0000 mgr.gibba043.dnkmem (mgr.34373) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:16 gibba003 bash[31385]: cluster 2021-03-10T14:54:15.818784+0000 mgr.gibba043.dnkmem (mgr.34373) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:16 gibba003 bash[32348]: cluster 2021-03-10T14:54:15.818784+0000 mgr.gibba043.dnkmem (mgr.34373) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:16 gibba043 bash[24019]: cluster 2021-03-10T14:54:15.818784+0000 mgr.gibba043.dnkmem (mgr.34373) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:18 gibba003 bash[31385]: cluster 2021-03-10T14:54:17.820313+0000 mgr.gibba043.dnkmem (mgr.34373) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:18 gibba003 bash[32348]: cluster 2021-03-10T14:54:17.820313+0000 mgr.gibba043.dnkmem (mgr.34373) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:19.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:18 gibba043 bash[24019]: cluster 2021-03-10T14:54:17.820313+0000 mgr.gibba043.dnkmem (mgr.34373) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:20 gibba003 bash[31385]: cluster 2021-03-10T14:54:19.821879+0000 mgr.gibba043.dnkmem (mgr.34373) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:20 gibba003 bash[32348]: cluster 2021-03-10T14:54:19.821879+0000 mgr.gibba043.dnkmem (mgr.34373) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:20 gibba043 bash[24019]: cluster 2021-03-10T14:54:19.821879+0000 mgr.gibba043.dnkmem (mgr.34373) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:21 gibba043 bash[24019]: cephadm 2021-03-10T14:54:21.416826+0000 mgr.gibba043.dnkmem (mgr.34373) 3364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:22.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:21 gibba003 bash[31385]: cephadm 2021-03-10T14:54:21.416826+0000 mgr.gibba043.dnkmem (mgr.34373) 3364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:22.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:21 gibba003 bash[32348]: cephadm 2021-03-10T14:54:21.416826+0000 mgr.gibba043.dnkmem (mgr.34373) 3364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:23.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:22 gibba043 bash[24019]: cluster 2021-03-10T14:54:21.823396+0000 mgr.gibba043.dnkmem (mgr.34373) 3365 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:22 gibba003 bash[31385]: cluster 2021-03-10T14:54:21.823396+0000 mgr.gibba043.dnkmem (mgr.34373) 3365 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:22 gibba003 bash[32348]: cluster 2021-03-10T14:54:21.823396+0000 mgr.gibba043.dnkmem (mgr.34373) 3365 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:24 gibba043 bash[24019]: cluster 2021-03-10T14:54:23.824941+0000 mgr.gibba043.dnkmem (mgr.34373) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:24 gibba003 bash[31385]: cluster 2021-03-10T14:54:23.824941+0000 mgr.gibba043.dnkmem (mgr.34373) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:24 gibba003 bash[32348]: cluster 2021-03-10T14:54:23.824941+0000 mgr.gibba043.dnkmem (mgr.34373) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:26 gibba003 bash[31385]: cluster 2021-03-10T14:54:25.826569+0000 mgr.gibba043.dnkmem (mgr.34373) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:26 gibba003 bash[32348]: cluster 2021-03-10T14:54:25.826569+0000 mgr.gibba043.dnkmem (mgr.34373) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:26 gibba043 bash[24019]: cluster 2021-03-10T14:54:25.826569+0000 mgr.gibba043.dnkmem (mgr.34373) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:28 gibba003 bash[31385]: cluster 2021-03-10T14:54:27.828287+0000 mgr.gibba043.dnkmem (mgr.34373) 3368 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:28 gibba003 bash[32348]: cluster 2021-03-10T14:54:27.828287+0000 mgr.gibba043.dnkmem (mgr.34373) 3368 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:28 gibba043 bash[24019]: cluster 2021-03-10T14:54:27.828287+0000 mgr.gibba043.dnkmem (mgr.34373) 3368 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:30 gibba003 bash[31385]: cluster 2021-03-10T14:54:29.829720+0000 mgr.gibba043.dnkmem (mgr.34373) 3369 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:30 gibba003 bash[32348]: cluster 2021-03-10T14:54:29.829720+0000 mgr.gibba043.dnkmem (mgr.34373) 3369 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:30 gibba043 bash[24019]: cluster 2021-03-10T14:54:29.829720+0000 mgr.gibba043.dnkmem (mgr.34373) 3369 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.518 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:54:31.744 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:54:31.744 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (62m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:54:31.745 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (67m) 7m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:54:31.745 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (63m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:54:31.745 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (63m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:54:31.745 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:54:31.745 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:54:31.746 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:54:31.746 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:54:31.746 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:54:31.746 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (68m) 7m ago 68m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:54:31.747 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:54:31.747 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:54:31.747 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:54:31.747 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:54:31.748 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:54:31.748 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:54:31.748 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:54:31.748 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (58m) 7m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:54:31.748 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (67m) 7m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:54:31.749 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:54:31.991 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:54:31.991 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:54:31.992 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:31.992 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:54:31.992 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:54:31.992 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:31.993 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:54:31.993 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:54:31.993 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:54:31.993 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:54:31.994 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:54:31.994 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:54:31.994 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:54:31.994 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:54:31.995 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:54:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[31385]: audit 2021-03-10T14:54:31.508895+0000 mgr.gibba043.dnkmem (mgr.34373) 3370 : audit [DBG] from='client.56308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[31385]: audit 2021-03-10T14:54:31.731488+0000 mgr.gibba043.dnkmem (mgr.34373) 3371 : audit [DBG] from='client.56314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[31385]: cluster 2021-03-10T14:54:31.831218+0000 mgr.gibba043.dnkmem (mgr.34373) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[31385]: audit 2021-03-10T14:54:31.990726+0000 mon.a (mon.0) 985 : audit [DBG] from='client.? 172.21.2.103:0/2507390807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[32348]: audit 2021-03-10T14:54:31.508895+0000 mgr.gibba043.dnkmem (mgr.34373) 3370 : audit [DBG] from='client.56308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[32348]: audit 2021-03-10T14:54:31.731488+0000 mgr.gibba043.dnkmem (mgr.34373) 3371 : audit [DBG] from='client.56314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[32348]: cluster 2021-03-10T14:54:31.831218+0000 mgr.gibba043.dnkmem (mgr.34373) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:32 gibba003 bash[32348]: audit 2021-03-10T14:54:31.990726+0000 mon.a (mon.0) 985 : audit [DBG] from='client.? 172.21.2.103:0/2507390807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:32 gibba043 bash[24019]: audit 2021-03-10T14:54:31.508895+0000 mgr.gibba043.dnkmem (mgr.34373) 3370 : audit [DBG] from='client.56308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:32 gibba043 bash[24019]: audit 2021-03-10T14:54:31.731488+0000 mgr.gibba043.dnkmem (mgr.34373) 3371 : audit [DBG] from='client.56314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:32 gibba043 bash[24019]: cluster 2021-03-10T14:54:31.831218+0000 mgr.gibba043.dnkmem (mgr.34373) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:32 gibba043 bash[24019]: audit 2021-03-10T14:54:31.990726+0000 mon.a (mon.0) 985 : audit [DBG] from='client.? 172.21.2.103:0/2507390807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:34 gibba043 bash[24019]: cluster 2021-03-10T14:54:33.832872+0000 mgr.gibba043.dnkmem (mgr.34373) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:34 gibba003 bash[31385]: cluster 2021-03-10T14:54:33.832872+0000 mgr.gibba043.dnkmem (mgr.34373) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:34 gibba003 bash[32348]: cluster 2021-03-10T14:54:33.832872+0000 mgr.gibba043.dnkmem (mgr.34373) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: cluster 2021-03-10T14:54:35.834400+0000 mgr.gibba043.dnkmem (mgr.34373) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.423286+0000 mgr.gibba043.dnkmem (mgr.34373) 3375 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:54:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.644003+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:54:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.647931+0000 mon.c (mon.1) 902 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.649626+0000 mon.c (mon.1) 903 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.651266+0000 mon.c (mon.1) 904 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.652984+0000 mon.c (mon.1) 905 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.656396+0000 mon.c (mon.1) 906 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:36 gibba043 bash[24019]: audit 2021-03-10T14:54:36.658003+0000 mon.c (mon.1) 907 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: cluster 2021-03-10T14:54:35.834400+0000 mgr.gibba043.dnkmem (mgr.34373) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.423286+0000 mgr.gibba043.dnkmem (mgr.34373) 3375 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:54:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.644003+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:54:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.647931+0000 mon.c (mon.1) 902 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.649626+0000 mon.c (mon.1) 903 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.651266+0000 mon.c (mon.1) 904 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.652984+0000 mon.c (mon.1) 905 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.656396+0000 mon.c (mon.1) 906 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[31385]: audit 2021-03-10T14:54:36.658003+0000 mon.c (mon.1) 907 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: cluster 2021-03-10T14:54:35.834400+0000 mgr.gibba043.dnkmem (mgr.34373) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.423286+0000 mgr.gibba043.dnkmem (mgr.34373) 3375 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:54:37.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.644003+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:54:37.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.647931+0000 mon.c (mon.1) 902 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:37.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.649626+0000 mon.c (mon.1) 903 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.651266+0000 mon.c (mon.1) 904 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.652984+0000 mon.c (mon.1) 905 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.656396+0000 mon.c (mon.1) 906 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:37.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:36 gibba003 bash[32348]: audit 2021-03-10T14:54:36.658003+0000 mon.c (mon.1) 907 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:38.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.424876+0000 mgr.gibba043.dnkmem (mgr.34373) 3376 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:54:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.645455+0000 mgr.gibba043.dnkmem (mgr.34373) 3377 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.647625+0000 mgr.gibba043.dnkmem (mgr.34373) 3378 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.649061+0000 mgr.gibba043.dnkmem (mgr.34373) 3379 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.649098+0000 mgr.gibba043.dnkmem (mgr.34373) 3380 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:38.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.650847+0000 mgr.gibba043.dnkmem (mgr.34373) 3381 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:38.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.650883+0000 mgr.gibba043.dnkmem (mgr.34373) 3382 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:38.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.652398+0000 mgr.gibba043.dnkmem (mgr.34373) 3383 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:38.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.654178+0000 mgr.gibba043.dnkmem (mgr.34373) 3384 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:38.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.654214+0000 mgr.gibba043.dnkmem (mgr.34373) 3385 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:38.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.655587+0000 mgr.gibba043.dnkmem (mgr.34373) 3386 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:38.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.655954+0000 mgr.gibba043.dnkmem (mgr.34373) 3387 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:38.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.657567+0000 mgr.gibba043.dnkmem (mgr.34373) 3388 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:38.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.657607+0000 mgr.gibba043.dnkmem (mgr.34373) 3389 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:38.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[31385]: cephadm 2021-03-10T14:54:36.657717+0000 mgr.gibba043.dnkmem (mgr.34373) 3390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:38.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.424876+0000 mgr.gibba043.dnkmem (mgr.34373) 3376 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:54:38.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.645455+0000 mgr.gibba043.dnkmem (mgr.34373) 3377 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:38.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.647625+0000 mgr.gibba043.dnkmem (mgr.34373) 3378 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:38.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.649061+0000 mgr.gibba043.dnkmem (mgr.34373) 3379 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:38.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.649098+0000 mgr.gibba043.dnkmem (mgr.34373) 3380 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:38.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.650847+0000 mgr.gibba043.dnkmem (mgr.34373) 3381 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:38.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.650883+0000 mgr.gibba043.dnkmem (mgr.34373) 3382 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:38.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.652398+0000 mgr.gibba043.dnkmem (mgr.34373) 3383 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:38.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.654178+0000 mgr.gibba043.dnkmem (mgr.34373) 3384 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:38.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.654214+0000 mgr.gibba043.dnkmem (mgr.34373) 3385 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:38.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.655587+0000 mgr.gibba043.dnkmem (mgr.34373) 3386 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:38.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.655954+0000 mgr.gibba043.dnkmem (mgr.34373) 3387 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:38.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.657567+0000 mgr.gibba043.dnkmem (mgr.34373) 3388 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:38.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.657607+0000 mgr.gibba043.dnkmem (mgr.34373) 3389 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:38.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:37 gibba003 bash[32348]: cephadm 2021-03-10T14:54:36.657717+0000 mgr.gibba043.dnkmem (mgr.34373) 3390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.424876+0000 mgr.gibba043.dnkmem (mgr.34373) 3376 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:54:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.645455+0000 mgr.gibba043.dnkmem (mgr.34373) 3377 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.647625+0000 mgr.gibba043.dnkmem (mgr.34373) 3378 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.649061+0000 mgr.gibba043.dnkmem (mgr.34373) 3379 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.649098+0000 mgr.gibba043.dnkmem (mgr.34373) 3380 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.650847+0000 mgr.gibba043.dnkmem (mgr.34373) 3381 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.650883+0000 mgr.gibba043.dnkmem (mgr.34373) 3382 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.652398+0000 mgr.gibba043.dnkmem (mgr.34373) 3383 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.654178+0000 mgr.gibba043.dnkmem (mgr.34373) 3384 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.654214+0000 mgr.gibba043.dnkmem (mgr.34373) 3385 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.655587+0000 mgr.gibba043.dnkmem (mgr.34373) 3386 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.655954+0000 mgr.gibba043.dnkmem (mgr.34373) 3387 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.657567+0000 mgr.gibba043.dnkmem (mgr.34373) 3388 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.657607+0000 mgr.gibba043.dnkmem (mgr.34373) 3389 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:37 gibba043 bash[24019]: cephadm 2021-03-10T14:54:36.657717+0000 mgr.gibba043.dnkmem (mgr.34373) 3390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:38 gibba003 bash[31385]: cluster 2021-03-10T14:54:37.835894+0000 mgr.gibba043.dnkmem (mgr.34373) 3391 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:39.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:38 gibba003 bash[32348]: cluster 2021-03-10T14:54:37.835894+0000 mgr.gibba043.dnkmem (mgr.34373) 3391 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:38 gibba043 bash[24019]: cluster 2021-03-10T14:54:37.835894+0000 mgr.gibba043.dnkmem (mgr.34373) 3391 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:40 gibba003 bash[31385]: cluster 2021-03-10T14:54:39.837474+0000 mgr.gibba043.dnkmem (mgr.34373) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:40 gibba003 bash[32348]: cluster 2021-03-10T14:54:39.837474+0000 mgr.gibba043.dnkmem (mgr.34373) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:40 gibba043 bash[24019]: cluster 2021-03-10T14:54:39.837474+0000 mgr.gibba043.dnkmem (mgr.34373) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:43.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:42 gibba003 bash[31385]: cluster 2021-03-10T14:54:41.839160+0000 mgr.gibba043.dnkmem (mgr.34373) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:43.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:42 gibba003 bash[32348]: cluster 2021-03-10T14:54:41.839160+0000 mgr.gibba043.dnkmem (mgr.34373) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:42 gibba043 bash[24019]: cluster 2021-03-10T14:54:41.839160+0000 mgr.gibba043.dnkmem (mgr.34373) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:44 gibba043 bash[24019]: cluster 2021-03-10T14:54:43.840705+0000 mgr.gibba043.dnkmem (mgr.34373) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:44 gibba003 bash[31385]: cluster 2021-03-10T14:54:43.840705+0000 mgr.gibba043.dnkmem (mgr.34373) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:44 gibba003 bash[32348]: cluster 2021-03-10T14:54:43.840705+0000 mgr.gibba043.dnkmem (mgr.34373) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:46 gibba003 bash[31385]: cluster 2021-03-10T14:54:45.842429+0000 mgr.gibba043.dnkmem (mgr.34373) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:46 gibba003 bash[32348]: cluster 2021-03-10T14:54:45.842429+0000 mgr.gibba043.dnkmem (mgr.34373) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:46 gibba043 bash[24019]: cluster 2021-03-10T14:54:45.842429+0000 mgr.gibba043.dnkmem (mgr.34373) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:48 gibba003 bash[31385]: cluster 2021-03-10T14:54:47.843982+0000 mgr.gibba043.dnkmem (mgr.34373) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:48 gibba003 bash[32348]: cluster 2021-03-10T14:54:47.843982+0000 mgr.gibba043.dnkmem (mgr.34373) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:48 gibba043 bash[24019]: cluster 2021-03-10T14:54:47.843982+0000 mgr.gibba043.dnkmem (mgr.34373) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:50 gibba003 bash[31385]: cluster 2021-03-10T14:54:49.845549+0000 mgr.gibba043.dnkmem (mgr.34373) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:51.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:50 gibba003 bash[32348]: cluster 2021-03-10T14:54:49.845549+0000 mgr.gibba043.dnkmem (mgr.34373) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:50 gibba043 bash[24019]: cluster 2021-03-10T14:54:49.845549+0000 mgr.gibba043.dnkmem (mgr.34373) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:52 gibba003 bash[31385]: cephadm 2021-03-10T14:54:51.673317+0000 mgr.gibba043.dnkmem (mgr.34373) 3398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:52 gibba003 bash[31385]: cluster 2021-03-10T14:54:51.847095+0000 mgr.gibba043.dnkmem (mgr.34373) 3399 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:52 gibba003 bash[32348]: cephadm 2021-03-10T14:54:51.673317+0000 mgr.gibba043.dnkmem (mgr.34373) 3398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:52 gibba003 bash[32348]: cluster 2021-03-10T14:54:51.847095+0000 mgr.gibba043.dnkmem (mgr.34373) 3399 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:53.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:52 gibba043 bash[24019]: cephadm 2021-03-10T14:54:51.673317+0000 mgr.gibba043.dnkmem (mgr.34373) 3398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:54:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:52 gibba043 bash[24019]: cluster 2021-03-10T14:54:51.847095+0000 mgr.gibba043.dnkmem (mgr.34373) 3399 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:54 gibba043 bash[24019]: cluster 2021-03-10T14:54:53.848794+0000 mgr.gibba043.dnkmem (mgr.34373) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:54 gibba003 bash[31385]: cluster 2021-03-10T14:54:53.848794+0000 mgr.gibba043.dnkmem (mgr.34373) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:54 gibba003 bash[32348]: cluster 2021-03-10T14:54:53.848794+0000 mgr.gibba043.dnkmem (mgr.34373) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:56 gibba003 bash[31385]: cluster 2021-03-10T14:54:55.850506+0000 mgr.gibba043.dnkmem (mgr.34373) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:56 gibba003 bash[32348]: cluster 2021-03-10T14:54:55.850506+0000 mgr.gibba043.dnkmem (mgr.34373) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:56 gibba043 bash[24019]: cluster 2021-03-10T14:54:55.850506+0000 mgr.gibba043.dnkmem (mgr.34373) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:54:58 gibba003 bash[31385]: cluster 2021-03-10T14:54:57.851955+0000 mgr.gibba043.dnkmem (mgr.34373) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:54:58 gibba003 bash[32348]: cluster 2021-03-10T14:54:57.851955+0000 mgr.gibba043.dnkmem (mgr.34373) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:54:58 gibba043 bash[24019]: cluster 2021-03-10T14:54:57.851955+0000 mgr.gibba043.dnkmem (mgr.34373) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:00 gibba003 bash[31385]: cluster 2021-03-10T14:54:59.853454+0000 mgr.gibba043.dnkmem (mgr.34373) 3403 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:00 gibba003 bash[32348]: cluster 2021-03-10T14:54:59.853454+0000 mgr.gibba043.dnkmem (mgr.34373) 3403 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:00 gibba043 bash[24019]: cluster 2021-03-10T14:54:59.853454+0000 mgr.gibba043.dnkmem (mgr.34373) 3403 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:02.234 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:55:02.463 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:55:02.463 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (63m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:55:02.463 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (68m) 7m ago 68m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:55:02.464 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (63m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:55:02.464 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:55:02.464 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:55:02.464 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:55:02.464 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (62m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:55:02.465 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:55:02.465 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:55:02.465 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (68m) 7m ago 68m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:55:02.465 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:55:02.465 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:55:02.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:55:02.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:55:02.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:55:02.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:55:02.467 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:55:02.467 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:55:02.467 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (68m) 7m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:55:02.467 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:55:02.712 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:55:02.712 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:55:02.712 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:02.712 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:55:02.713 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:55:02.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:02.713 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:55:02.713 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:55:02.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:55:02.714 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:55:02.714 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:55:02.714 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:55:02.714 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:55:02.715 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:55:02.715 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:55:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:02 gibba043 bash[24019]: cluster 2021-03-10T14:55:01.855178+0000 mgr.gibba043.dnkmem (mgr.34373) 3404 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:02 gibba043 bash[24019]: audit 2021-03-10T14:55:02.223002+0000 mgr.gibba043.dnkmem (mgr.34373) 3405 : audit [DBG] from='client.56326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:02 gibba043 bash[24019]: audit 2021-03-10T14:55:02.711174+0000 mon.a (mon.0) 987 : audit [DBG] from='client.? 172.21.2.103:0/2933387000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:02 gibba003 bash[31385]: cluster 2021-03-10T14:55:01.855178+0000 mgr.gibba043.dnkmem (mgr.34373) 3404 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:02 gibba003 bash[31385]: audit 2021-03-10T14:55:02.223002+0000 mgr.gibba043.dnkmem (mgr.34373) 3405 : audit [DBG] from='client.56326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:02 gibba003 bash[31385]: audit 2021-03-10T14:55:02.711174+0000 mon.a (mon.0) 987 : audit [DBG] from='client.? 172.21.2.103:0/2933387000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:02 gibba003 bash[32348]: cluster 2021-03-10T14:55:01.855178+0000 mgr.gibba043.dnkmem (mgr.34373) 3404 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:02 gibba003 bash[32348]: audit 2021-03-10T14:55:02.223002+0000 mgr.gibba043.dnkmem (mgr.34373) 3405 : audit [DBG] from='client.56326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:02 gibba003 bash[32348]: audit 2021-03-10T14:55:02.711174+0000 mon.a (mon.0) 987 : audit [DBG] from='client.? 172.21.2.103:0/2933387000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:03 gibba043 bash[24019]: audit 2021-03-10T14:55:02.447307+0000 mgr.gibba043.dnkmem (mgr.34373) 3406 : audit [DBG] from='client.56332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:03 gibba003 bash[31385]: audit 2021-03-10T14:55:02.447307+0000 mgr.gibba043.dnkmem (mgr.34373) 3406 : audit [DBG] from='client.56332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:04.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:03 gibba003 bash[32348]: audit 2021-03-10T14:55:02.447307+0000 mgr.gibba043.dnkmem (mgr.34373) 3406 : audit [DBG] from='client.56332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:04 gibba043 bash[24019]: cluster 2021-03-10T14:55:03.856733+0000 mgr.gibba043.dnkmem (mgr.34373) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:04 gibba003 bash[31385]: cluster 2021-03-10T14:55:03.856733+0000 mgr.gibba043.dnkmem (mgr.34373) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:04 gibba003 bash[32348]: cluster 2021-03-10T14:55:03.856733+0000 mgr.gibba043.dnkmem (mgr.34373) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:06 gibba043 bash[24019]: cluster 2021-03-10T14:55:05.858253+0000 mgr.gibba043.dnkmem (mgr.34373) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:06 gibba003 bash[31385]: cluster 2021-03-10T14:55:05.858253+0000 mgr.gibba043.dnkmem (mgr.34373) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:06 gibba003 bash[32348]: cluster 2021-03-10T14:55:05.858253+0000 mgr.gibba043.dnkmem (mgr.34373) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:07 gibba043 bash[24019]: cephadm 2021-03-10T14:55:06.688754+0000 mgr.gibba043.dnkmem (mgr.34373) 3409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:07 gibba003 bash[31385]: cephadm 2021-03-10T14:55:06.688754+0000 mgr.gibba043.dnkmem (mgr.34373) 3409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:07 gibba003 bash[32348]: cephadm 2021-03-10T14:55:06.688754+0000 mgr.gibba043.dnkmem (mgr.34373) 3409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:08 gibba043 bash[24019]: cluster 2021-03-10T14:55:07.859908+0000 mgr.gibba043.dnkmem (mgr.34373) 3410 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:08 gibba003 bash[31385]: cluster 2021-03-10T14:55:07.859908+0000 mgr.gibba043.dnkmem (mgr.34373) 3410 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:08 gibba003 bash[32348]: cluster 2021-03-10T14:55:07.859908+0000 mgr.gibba043.dnkmem (mgr.34373) 3410 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:10 gibba043 bash[24019]: cluster 2021-03-10T14:55:09.861428+0000 mgr.gibba043.dnkmem (mgr.34373) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:10 gibba003 bash[31385]: cluster 2021-03-10T14:55:09.861428+0000 mgr.gibba043.dnkmem (mgr.34373) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:10 gibba003 bash[32348]: cluster 2021-03-10T14:55:09.861428+0000 mgr.gibba043.dnkmem (mgr.34373) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:12 gibba043 bash[24019]: cluster 2021-03-10T14:55:11.863053+0000 mgr.gibba043.dnkmem (mgr.34373) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:12 gibba003 bash[31385]: cluster 2021-03-10T14:55:11.863053+0000 mgr.gibba043.dnkmem (mgr.34373) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:12 gibba003 bash[32348]: cluster 2021-03-10T14:55:11.863053+0000 mgr.gibba043.dnkmem (mgr.34373) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:13 gibba043 bash[24019]: audit 2021-03-10T14:55:13.115243+0000 mon.c (mon.1) 908 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:13 gibba043 bash[24019]: audit 2021-03-10T14:55:13.116299+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:13 gibba043 bash[24019]: audit 2021-03-10T14:55:13.187813+0000 mon.c (mon.1) 909 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:13 gibba043 bash[24019]: audit 2021-03-10T14:55:13.188930+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.203323+0000 mon.c (mon.1) 910 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:55:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.204178+0000 mon.c (mon.1) 911 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.204402+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:55:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.205094+0000 mon.c (mon.1) 912 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.205562+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.206209+0000 mon.c (mon.1) 913 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.206345+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:14 gibba043 bash[24019]: audit 2021-03-10T14:55:13.207338+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:13 gibba003 bash[31385]: audit 2021-03-10T14:55:13.115243+0000 mon.c (mon.1) 908 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:13 gibba003 bash[31385]: audit 2021-03-10T14:55:13.116299+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:13 gibba003 bash[31385]: audit 2021-03-10T14:55:13.187813+0000 mon.c (mon.1) 909 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:13 gibba003 bash[31385]: audit 2021-03-10T14:55:13.188930+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:13 gibba003 bash[31385]: audit 2021-03-10T14:55:13.203323+0000 mon.c (mon.1) 910 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:55:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.204178+0000 mon.c (mon.1) 911 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.204402+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:55:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.205094+0000 mon.c (mon.1) 912 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.205562+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.206209+0000 mon.c (mon.1) 913 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.206345+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[31385]: audit 2021-03-10T14:55:13.207338+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.115243+0000 mon.c (mon.1) 908 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.116299+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.187813+0000 mon.c (mon.1) 909 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.188930+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.203323+0000 mon.c (mon.1) 910 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:55:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.204178+0000 mon.c (mon.1) 911 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.204402+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:55:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.205094+0000 mon.c (mon.1) 912 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.205562+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.206209+0000 mon.c (mon.1) 913 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.206345+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:55:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:14 gibba003 bash[32348]: audit 2021-03-10T14:55:13.207338+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:15 gibba043 bash[24019]: cluster 2021-03-10T14:55:13.864620+0000 mgr.gibba043.dnkmem (mgr.34373) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:15 gibba003 bash[31385]: cluster 2021-03-10T14:55:13.864620+0000 mgr.gibba043.dnkmem (mgr.34373) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:15 gibba003 bash[32348]: cluster 2021-03-10T14:55:13.864620+0000 mgr.gibba043.dnkmem (mgr.34373) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:17 gibba043 bash[24019]: cluster 2021-03-10T14:55:15.866324+0000 mgr.gibba043.dnkmem (mgr.34373) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:17 gibba003 bash[31385]: cluster 2021-03-10T14:55:15.866324+0000 mgr.gibba043.dnkmem (mgr.34373) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:17 gibba003 bash[32348]: cluster 2021-03-10T14:55:15.866324+0000 mgr.gibba043.dnkmem (mgr.34373) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:19 gibba003 bash[31385]: cluster 2021-03-10T14:55:17.867919+0000 mgr.gibba043.dnkmem (mgr.34373) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:19 gibba003 bash[32348]: cluster 2021-03-10T14:55:17.867919+0000 mgr.gibba043.dnkmem (mgr.34373) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:19 gibba043 bash[24019]: cluster 2021-03-10T14:55:17.867919+0000 mgr.gibba043.dnkmem (mgr.34373) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:21 gibba003 bash[32348]: cluster 2021-03-10T14:55:19.868499+0000 mgr.gibba043.dnkmem (mgr.34373) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:21 gibba003 bash[31385]: cluster 2021-03-10T14:55:19.868499+0000 mgr.gibba043.dnkmem (mgr.34373) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:21 gibba043 bash[24019]: cluster 2021-03-10T14:55:19.868499+0000 mgr.gibba043.dnkmem (mgr.34373) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:23 gibba003 bash[31385]: cephadm 2021-03-10T14:55:21.704193+0000 mgr.gibba043.dnkmem (mgr.34373) 3417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:23 gibba003 bash[31385]: cluster 2021-03-10T14:55:21.870053+0000 mgr.gibba043.dnkmem (mgr.34373) 3418 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:23 gibba003 bash[32348]: cephadm 2021-03-10T14:55:21.704193+0000 mgr.gibba043.dnkmem (mgr.34373) 3417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:23 gibba003 bash[32348]: cluster 2021-03-10T14:55:21.870053+0000 mgr.gibba043.dnkmem (mgr.34373) 3418 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:23 gibba043 bash[24019]: cephadm 2021-03-10T14:55:21.704193+0000 mgr.gibba043.dnkmem (mgr.34373) 3417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:23 gibba043 bash[24019]: cluster 2021-03-10T14:55:21.870053+0000 mgr.gibba043.dnkmem (mgr.34373) 3418 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:24 gibba043 bash[24019]: cluster 2021-03-10T14:55:23.871715+0000 mgr.gibba043.dnkmem (mgr.34373) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:24.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:24 gibba003 bash[31385]: cluster 2021-03-10T14:55:23.871715+0000 mgr.gibba043.dnkmem (mgr.34373) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:24.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:24 gibba003 bash[32348]: cluster 2021-03-10T14:55:23.871715+0000 mgr.gibba043.dnkmem (mgr.34373) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:26 gibba003 bash[31385]: cluster 2021-03-10T14:55:25.873429+0000 mgr.gibba043.dnkmem (mgr.34373) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:26 gibba003 bash[32348]: cluster 2021-03-10T14:55:25.873429+0000 mgr.gibba043.dnkmem (mgr.34373) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:26 gibba043 bash[24019]: cluster 2021-03-10T14:55:25.873429+0000 mgr.gibba043.dnkmem (mgr.34373) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:28 gibba043 bash[24019]: cluster 2021-03-10T14:55:27.874961+0000 mgr.gibba043.dnkmem (mgr.34373) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:28 gibba003 bash[31385]: cluster 2021-03-10T14:55:27.874961+0000 mgr.gibba043.dnkmem (mgr.34373) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:28 gibba003 bash[32348]: cluster 2021-03-10T14:55:27.874961+0000 mgr.gibba043.dnkmem (mgr.34373) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:30 gibba043 bash[24019]: cluster 2021-03-10T14:55:29.876541+0000 mgr.gibba043.dnkmem (mgr.34373) 3422 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:30 gibba003 bash[31385]: cluster 2021-03-10T14:55:29.876541+0000 mgr.gibba043.dnkmem (mgr.34373) 3422 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:30 gibba003 bash[32348]: cluster 2021-03-10T14:55:29.876541+0000 mgr.gibba043.dnkmem (mgr.34373) 3422 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:32.954 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:55:33.216 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:55:33.217 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (63m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:55:33.217 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (69m) 8m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:55:33.217 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (64m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:55:33.218 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (64m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:55:33.218 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:55:33.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:55:33.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:55:33.219 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:55:33.219 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:55:33.219 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (69m) 8m ago 69m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:55:33.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:55:33.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:55:33.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:55:33.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:55:33.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:55:33.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:55:33.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:55:33.221 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (59m) 8m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:55:33.221 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (68m) 8m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:55:33.221 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:55:33.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:32 gibba043 bash[24019]: cluster 2021-03-10T14:55:31.877919+0000 mgr.gibba043.dnkmem (mgr.34373) 3423 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:32 gibba003 bash[31385]: cluster 2021-03-10T14:55:31.877919+0000 mgr.gibba043.dnkmem (mgr.34373) 3423 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:32 gibba003 bash[32348]: cluster 2021-03-10T14:55:31.877919+0000 mgr.gibba043.dnkmem (mgr.34373) 3423 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:33.471 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:55:33.471 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:55:33.472 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:33.472 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:55:33.472 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:55:33.472 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:33.473 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:55:33.473 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:55:33.473 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:55:33.473 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:55:33.473 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:55:33.474 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:55:33.474 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:55:33.474 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:55:33.474 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:55:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:33 gibba043 bash[24019]: audit 2021-03-10T14:55:32.943174+0000 mgr.gibba043.dnkmem (mgr.34373) 3424 : audit [DBG] from='client.56344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:33 gibba043 bash[24019]: audit 2021-03-10T14:55:33.173124+0000 mgr.gibba043.dnkmem (mgr.34373) 3425 : audit [DBG] from='client.46362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:33 gibba043 bash[24019]: audit 2021-03-10T14:55:33.470786+0000 mon.a (mon.0) 994 : audit [DBG] from='client.? 172.21.2.103:0/1184364286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:34.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:33 gibba003 bash[31385]: audit 2021-03-10T14:55:32.943174+0000 mgr.gibba043.dnkmem (mgr.34373) 3424 : audit [DBG] from='client.56344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:34.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:33 gibba003 bash[31385]: audit 2021-03-10T14:55:33.173124+0000 mgr.gibba043.dnkmem (mgr.34373) 3425 : audit [DBG] from='client.46362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:34.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:33 gibba003 bash[31385]: audit 2021-03-10T14:55:33.470786+0000 mon.a (mon.0) 994 : audit [DBG] from='client.? 172.21.2.103:0/1184364286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:34.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:33 gibba003 bash[32348]: audit 2021-03-10T14:55:32.943174+0000 mgr.gibba043.dnkmem (mgr.34373) 3424 : audit [DBG] from='client.56344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:34.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:33 gibba003 bash[32348]: audit 2021-03-10T14:55:33.173124+0000 mgr.gibba043.dnkmem (mgr.34373) 3425 : audit [DBG] from='client.46362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:34.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:33 gibba003 bash[32348]: audit 2021-03-10T14:55:33.470786+0000 mon.a (mon.0) 994 : audit [DBG] from='client.? 172.21.2.103:0/1184364286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:34 gibba043 bash[24019]: cluster 2021-03-10T14:55:33.879611+0000 mgr.gibba043.dnkmem (mgr.34373) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:34 gibba003 bash[31385]: cluster 2021-03-10T14:55:33.879611+0000 mgr.gibba043.dnkmem (mgr.34373) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:35.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:34 gibba003 bash[32348]: cluster 2021-03-10T14:55:33.879611+0000 mgr.gibba043.dnkmem (mgr.34373) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: cluster 2021-03-10T14:55:35.881278+0000 mgr.gibba043.dnkmem (mgr.34373) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.917090+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:55:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.920890+0000 mon.c (mon.1) 914 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.922680+0000 mon.c (mon.1) 915 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.924140+0000 mon.c (mon.1) 916 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.925702+0000 mon.c (mon.1) 917 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.928993+0000 mon.c (mon.1) 918 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:36 gibba043 bash[24019]: audit 2021-03-10T14:55:36.930668+0000 mon.c (mon.1) 919 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: cluster 2021-03-10T14:55:35.881278+0000 mgr.gibba043.dnkmem (mgr.34373) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.917090+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:55:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.920890+0000 mon.c (mon.1) 914 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.922680+0000 mon.c (mon.1) 915 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.924140+0000 mon.c (mon.1) 916 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.925702+0000 mon.c (mon.1) 917 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.928993+0000 mon.c (mon.1) 918 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[31385]: audit 2021-03-10T14:55:36.930668+0000 mon.c (mon.1) 919 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: cluster 2021-03-10T14:55:35.881278+0000 mgr.gibba043.dnkmem (mgr.34373) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.917090+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:55:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.920890+0000 mon.c (mon.1) 914 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.922680+0000 mon.c (mon.1) 915 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.924140+0000 mon.c (mon.1) 916 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.925702+0000 mon.c (mon.1) 917 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.928993+0000 mon.c (mon.1) 918 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:36 gibba003 bash[32348]: audit 2021-03-10T14:55:36.930668+0000 mon.c (mon.1) 919 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.720324+0000 mgr.gibba043.dnkmem (mgr.34373) 3428 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:55:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.721130+0000 mgr.gibba043.dnkmem (mgr.34373) 3429 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:55:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.918531+0000 mgr.gibba043.dnkmem (mgr.34373) 3430 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.920662+0000 mgr.gibba043.dnkmem (mgr.34373) 3431 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.922071+0000 mgr.gibba043.dnkmem (mgr.34373) 3432 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.922108+0000 mgr.gibba043.dnkmem (mgr.34373) 3433 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.923760+0000 mgr.gibba043.dnkmem (mgr.34373) 3434 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.923798+0000 mgr.gibba043.dnkmem (mgr.34373) 3435 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:38.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.925268+0000 mgr.gibba043.dnkmem (mgr.34373) 3436 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.927047+0000 mgr.gibba043.dnkmem (mgr.34373) 3437 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.927082+0000 mgr.gibba043.dnkmem (mgr.34373) 3438 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.928605+0000 mgr.gibba043.dnkmem (mgr.34373) 3439 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:38.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.928916+0000 mgr.gibba043.dnkmem (mgr.34373) 3440 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:38.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.930488+0000 mgr.gibba043.dnkmem (mgr.34373) 3441 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:38.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.930525+0000 mgr.gibba043.dnkmem (mgr.34373) 3442 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:38.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:37 gibba043 bash[24019]: cephadm 2021-03-10T14:55:36.930626+0000 mgr.gibba043.dnkmem (mgr.34373) 3443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.720324+0000 mgr.gibba043.dnkmem (mgr.34373) 3428 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:55:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.721130+0000 mgr.gibba043.dnkmem (mgr.34373) 3429 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:55:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.918531+0000 mgr.gibba043.dnkmem (mgr.34373) 3430 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.920662+0000 mgr.gibba043.dnkmem (mgr.34373) 3431 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.922071+0000 mgr.gibba043.dnkmem (mgr.34373) 3432 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.922108+0000 mgr.gibba043.dnkmem (mgr.34373) 3433 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.923760+0000 mgr.gibba043.dnkmem (mgr.34373) 3434 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.923798+0000 mgr.gibba043.dnkmem (mgr.34373) 3435 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.925268+0000 mgr.gibba043.dnkmem (mgr.34373) 3436 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.927047+0000 mgr.gibba043.dnkmem (mgr.34373) 3437 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.927082+0000 mgr.gibba043.dnkmem (mgr.34373) 3438 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.928605+0000 mgr.gibba043.dnkmem (mgr.34373) 3439 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.928916+0000 mgr.gibba043.dnkmem (mgr.34373) 3440 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.930488+0000 mgr.gibba043.dnkmem (mgr.34373) 3441 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.930525+0000 mgr.gibba043.dnkmem (mgr.34373) 3442 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[31385]: cephadm 2021-03-10T14:55:36.930626+0000 mgr.gibba043.dnkmem (mgr.34373) 3443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.720324+0000 mgr.gibba043.dnkmem (mgr.34373) 3428 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:55:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.721130+0000 mgr.gibba043.dnkmem (mgr.34373) 3429 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:55:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.918531+0000 mgr.gibba043.dnkmem (mgr.34373) 3430 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.920662+0000 mgr.gibba043.dnkmem (mgr.34373) 3431 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.922071+0000 mgr.gibba043.dnkmem (mgr.34373) 3432 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.922108+0000 mgr.gibba043.dnkmem (mgr.34373) 3433 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.923760+0000 mgr.gibba043.dnkmem (mgr.34373) 3434 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.923798+0000 mgr.gibba043.dnkmem (mgr.34373) 3435 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.925268+0000 mgr.gibba043.dnkmem (mgr.34373) 3436 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.927047+0000 mgr.gibba043.dnkmem (mgr.34373) 3437 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.927082+0000 mgr.gibba043.dnkmem (mgr.34373) 3438 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.928605+0000 mgr.gibba043.dnkmem (mgr.34373) 3439 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.928916+0000 mgr.gibba043.dnkmem (mgr.34373) 3440 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.930488+0000 mgr.gibba043.dnkmem (mgr.34373) 3441 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.930525+0000 mgr.gibba043.dnkmem (mgr.34373) 3442 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:38.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:37 gibba003 bash[32348]: cephadm 2021-03-10T14:55:36.930626+0000 mgr.gibba043.dnkmem (mgr.34373) 3443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:38 gibba043 bash[24019]: cluster 2021-03-10T14:55:37.882817+0000 mgr.gibba043.dnkmem (mgr.34373) 3444 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:38 gibba003 bash[31385]: cluster 2021-03-10T14:55:37.882817+0000 mgr.gibba043.dnkmem (mgr.34373) 3444 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:38 gibba003 bash[32348]: cluster 2021-03-10T14:55:37.882817+0000 mgr.gibba043.dnkmem (mgr.34373) 3444 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:41 gibba043 bash[24019]: cluster 2021-03-10T14:55:39.884299+0000 mgr.gibba043.dnkmem (mgr.34373) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:41 gibba003 bash[31385]: cluster 2021-03-10T14:55:39.884299+0000 mgr.gibba043.dnkmem (mgr.34373) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:41 gibba003 bash[32348]: cluster 2021-03-10T14:55:39.884299+0000 mgr.gibba043.dnkmem (mgr.34373) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:43 gibba043 bash[24019]: cluster 2021-03-10T14:55:41.885884+0000 mgr.gibba043.dnkmem (mgr.34373) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:43 gibba003 bash[31385]: cluster 2021-03-10T14:55:41.885884+0000 mgr.gibba043.dnkmem (mgr.34373) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:43 gibba003 bash[32348]: cluster 2021-03-10T14:55:41.885884+0000 mgr.gibba043.dnkmem (mgr.34373) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:44 gibba043 bash[24019]: cluster 2021-03-10T14:55:43.887518+0000 mgr.gibba043.dnkmem (mgr.34373) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:44 gibba003 bash[31385]: cluster 2021-03-10T14:55:43.887518+0000 mgr.gibba043.dnkmem (mgr.34373) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:44 gibba003 bash[32348]: cluster 2021-03-10T14:55:43.887518+0000 mgr.gibba043.dnkmem (mgr.34373) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:46 gibba043 bash[24019]: cluster 2021-03-10T14:55:45.889199+0000 mgr.gibba043.dnkmem (mgr.34373) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:46 gibba003 bash[31385]: cluster 2021-03-10T14:55:45.889199+0000 mgr.gibba043.dnkmem (mgr.34373) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:46 gibba003 bash[32348]: cluster 2021-03-10T14:55:45.889199+0000 mgr.gibba043.dnkmem (mgr.34373) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:48 gibba043 bash[24019]: cluster 2021-03-10T14:55:47.890805+0000 mgr.gibba043.dnkmem (mgr.34373) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:48 gibba003 bash[31385]: cluster 2021-03-10T14:55:47.890805+0000 mgr.gibba043.dnkmem (mgr.34373) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:48 gibba003 bash[32348]: cluster 2021-03-10T14:55:47.890805+0000 mgr.gibba043.dnkmem (mgr.34373) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:50 gibba043 bash[24019]: cluster 2021-03-10T14:55:49.892568+0000 mgr.gibba043.dnkmem (mgr.34373) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:50 gibba003 bash[31385]: cluster 2021-03-10T14:55:49.892568+0000 mgr.gibba043.dnkmem (mgr.34373) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:50 gibba003 bash[32348]: cluster 2021-03-10T14:55:49.892568+0000 mgr.gibba043.dnkmem (mgr.34373) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:52 gibba043 bash[24019]: cluster 2021-03-10T14:55:51.894201+0000 mgr.gibba043.dnkmem (mgr.34373) 3451 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:52 gibba043 bash[24019]: cephadm 2021-03-10T14:55:51.946717+0000 mgr.gibba043.dnkmem (mgr.34373) 3452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:52 gibba003 bash[31385]: cluster 2021-03-10T14:55:51.894201+0000 mgr.gibba043.dnkmem (mgr.34373) 3451 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:52 gibba003 bash[31385]: cephadm 2021-03-10T14:55:51.946717+0000 mgr.gibba043.dnkmem (mgr.34373) 3452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:53.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:52 gibba003 bash[32348]: cluster 2021-03-10T14:55:51.894201+0000 mgr.gibba043.dnkmem (mgr.34373) 3451 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:52 gibba003 bash[32348]: cephadm 2021-03-10T14:55:51.946717+0000 mgr.gibba043.dnkmem (mgr.34373) 3452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:55:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:54 gibba043 bash[24019]: cluster 2021-03-10T14:55:53.895872+0000 mgr.gibba043.dnkmem (mgr.34373) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:54 gibba003 bash[31385]: cluster 2021-03-10T14:55:53.895872+0000 mgr.gibba043.dnkmem (mgr.34373) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:54 gibba003 bash[32348]: cluster 2021-03-10T14:55:53.895872+0000 mgr.gibba043.dnkmem (mgr.34373) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:56 gibba043 bash[24019]: cluster 2021-03-10T14:55:55.897507+0000 mgr.gibba043.dnkmem (mgr.34373) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:56 gibba003 bash[31385]: cluster 2021-03-10T14:55:55.897507+0000 mgr.gibba043.dnkmem (mgr.34373) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:56 gibba003 bash[32348]: cluster 2021-03-10T14:55:55.897507+0000 mgr.gibba043.dnkmem (mgr.34373) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:55:58 gibba043 bash[24019]: cluster 2021-03-10T14:55:57.899113+0000 mgr.gibba043.dnkmem (mgr.34373) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:55:58 gibba003 bash[31385]: cluster 2021-03-10T14:55:57.899113+0000 mgr.gibba043.dnkmem (mgr.34373) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:55:58 gibba003 bash[32348]: cluster 2021-03-10T14:55:57.899113+0000 mgr.gibba043.dnkmem (mgr.34373) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:00 gibba043 bash[24019]: cluster 2021-03-10T14:55:59.900699+0000 mgr.gibba043.dnkmem (mgr.34373) 3456 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:00 gibba003 bash[31385]: cluster 2021-03-10T14:55:59.900699+0000 mgr.gibba043.dnkmem (mgr.34373) 3456 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:00 gibba003 bash[32348]: cluster 2021-03-10T14:55:59.900699+0000 mgr.gibba043.dnkmem (mgr.34373) 3456 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:02 gibba043 bash[24019]: cluster 2021-03-10T14:56:01.902280+0000 mgr.gibba043.dnkmem (mgr.34373) 3457 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:02 gibba003 bash[31385]: cluster 2021-03-10T14:56:01.902280+0000 mgr.gibba043.dnkmem (mgr.34373) 3457 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:02 gibba003 bash[32348]: cluster 2021-03-10T14:56:01.902280+0000 mgr.gibba043.dnkmem (mgr.34373) 3457 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.715 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:56:03.944 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:56:03.944 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (64m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:56:03.944 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (69m) 8m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:56:03.944 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (64m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:56:03.945 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (65m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:56:03.945 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:56:03.945 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (63m) 9m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:56:03.945 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:56:03.945 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:56:03.946 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:56:03.946 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (69m) 8m ago 69m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:56:03.946 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:56:03.946 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:56:03.947 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:56:03.947 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:56:03.947 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:56:03.947 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:56:03.947 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:56:03.948 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:56:03.948 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (69m) 8m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:56:03.948 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:56:04.193 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:56:04.193 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:56:04.193 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:04.194 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:56:04.194 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:56:04.194 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:04.194 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:56:04.195 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:56:04.195 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:56:04.195 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:56:04.195 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:56:04.195 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:56:04.196 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:56:04.196 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:56:04.196 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:56:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:04 gibba043 bash[24019]: audit 2021-03-10T14:56:03.704471+0000 mgr.gibba043.dnkmem (mgr.34373) 3458 : audit [DBG] from='client.56362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:04.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:04 gibba043 bash[24019]: cluster 2021-03-10T14:56:03.903918+0000 mgr.gibba043.dnkmem (mgr.34373) 3459 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:04 gibba043 bash[24019]: audit 2021-03-10T14:56:03.929780+0000 mgr.gibba043.dnkmem (mgr.34373) 3460 : audit [DBG] from='client.56368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:04.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:04 gibba043 bash[24019]: audit 2021-03-10T14:56:04.192635+0000 mon.c (mon.1) 920 : audit [DBG] from='client.? 172.21.2.103:0/1781674607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[31385]: audit 2021-03-10T14:56:03.704471+0000 mgr.gibba043.dnkmem (mgr.34373) 3458 : audit [DBG] from='client.56362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[31385]: cluster 2021-03-10T14:56:03.903918+0000 mgr.gibba043.dnkmem (mgr.34373) 3459 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[31385]: audit 2021-03-10T14:56:03.929780+0000 mgr.gibba043.dnkmem (mgr.34373) 3460 : audit [DBG] from='client.56368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:04.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[31385]: audit 2021-03-10T14:56:04.192635+0000 mon.c (mon.1) 920 : audit [DBG] from='client.? 172.21.2.103:0/1781674607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[32348]: audit 2021-03-10T14:56:03.704471+0000 mgr.gibba043.dnkmem (mgr.34373) 3458 : audit [DBG] from='client.56362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[32348]: cluster 2021-03-10T14:56:03.903918+0000 mgr.gibba043.dnkmem (mgr.34373) 3459 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[32348]: audit 2021-03-10T14:56:03.929780+0000 mgr.gibba043.dnkmem (mgr.34373) 3460 : audit [DBG] from='client.56368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:04.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:04 gibba003 bash[32348]: audit 2021-03-10T14:56:04.192635+0000 mon.c (mon.1) 920 : audit [DBG] from='client.? 172.21.2.103:0/1781674607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:06 gibba043 bash[24019]: cluster 2021-03-10T14:56:05.905638+0000 mgr.gibba043.dnkmem (mgr.34373) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:06 gibba003 bash[31385]: cluster 2021-03-10T14:56:05.905638+0000 mgr.gibba043.dnkmem (mgr.34373) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:06 gibba003 bash[32348]: cluster 2021-03-10T14:56:05.905638+0000 mgr.gibba043.dnkmem (mgr.34373) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:07 gibba043 bash[24019]: cephadm 2021-03-10T14:56:06.956768+0000 mgr.gibba043.dnkmem (mgr.34373) 3462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:07 gibba003 bash[31385]: cephadm 2021-03-10T14:56:06.956768+0000 mgr.gibba043.dnkmem (mgr.34373) 3462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:07 gibba003 bash[32348]: cephadm 2021-03-10T14:56:06.956768+0000 mgr.gibba043.dnkmem (mgr.34373) 3462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:08 gibba043 bash[24019]: cluster 2021-03-10T14:56:07.907254+0000 mgr.gibba043.dnkmem (mgr.34373) 3463 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:08 gibba003 bash[31385]: cluster 2021-03-10T14:56:07.907254+0000 mgr.gibba043.dnkmem (mgr.34373) 3463 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:08 gibba003 bash[32348]: cluster 2021-03-10T14:56:07.907254+0000 mgr.gibba043.dnkmem (mgr.34373) 3463 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:10 gibba043 bash[24019]: cluster 2021-03-10T14:56:09.909008+0000 mgr.gibba043.dnkmem (mgr.34373) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:10 gibba003 bash[31385]: cluster 2021-03-10T14:56:09.909008+0000 mgr.gibba043.dnkmem (mgr.34373) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:10 gibba003 bash[32348]: cluster 2021-03-10T14:56:09.909008+0000 mgr.gibba043.dnkmem (mgr.34373) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:13 gibba043 bash[24019]: cluster 2021-03-10T14:56:11.910640+0000 mgr.gibba043.dnkmem (mgr.34373) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:13 gibba003 bash[31385]: cluster 2021-03-10T14:56:11.910640+0000 mgr.gibba043.dnkmem (mgr.34373) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:13 gibba003 bash[32348]: cluster 2021-03-10T14:56:11.910640+0000 mgr.gibba043.dnkmem (mgr.34373) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.121947+0000 mon.c (mon.1) 921 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.123109+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.195962+0000 mon.c (mon.1) 922 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.197112+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.211827+0000 mon.c (mon.1) 923 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:56:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.212641+0000 mon.c (mon.1) 924 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.213063+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:56:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.213334+0000 mon.c (mon.1) 925 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:56:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.214268+0000 mon.c (mon.1) 926 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.214301+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.215357+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:56:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:14 gibba043 bash[24019]: audit 2021-03-10T14:56:13.216402+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.121947+0000 mon.c (mon.1) 921 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.123109+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.195962+0000 mon.c (mon.1) 922 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.197112+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.211827+0000 mon.c (mon.1) 923 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:56:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.212641+0000 mon.c (mon.1) 924 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.213063+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:56:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.213334+0000 mon.c (mon.1) 925 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:56:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.214268+0000 mon.c (mon.1) 926 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.214301+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.215357+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:56:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[31385]: audit 2021-03-10T14:56:13.216402+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.121947+0000 mon.c (mon.1) 921 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.123109+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.195962+0000 mon.c (mon.1) 922 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.197112+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.211827+0000 mon.c (mon.1) 923 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:56:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.212641+0000 mon.c (mon.1) 924 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.213063+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:56:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.213334+0000 mon.c (mon.1) 925 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:56:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.214268+0000 mon.c (mon.1) 926 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.214301+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:56:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.215357+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:56:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:14 gibba003 bash[32348]: audit 2021-03-10T14:56:13.216402+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:15 gibba043 bash[24019]: cluster 2021-03-10T14:56:13.912278+0000 mgr.gibba043.dnkmem (mgr.34373) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:15 gibba003 bash[31385]: cluster 2021-03-10T14:56:13.912278+0000 mgr.gibba043.dnkmem (mgr.34373) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:15 gibba003 bash[32348]: cluster 2021-03-10T14:56:13.912278+0000 mgr.gibba043.dnkmem (mgr.34373) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:17 gibba003 bash[31385]: cluster 2021-03-10T14:56:15.913920+0000 mgr.gibba043.dnkmem (mgr.34373) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:17 gibba003 bash[32348]: cluster 2021-03-10T14:56:15.913920+0000 mgr.gibba043.dnkmem (mgr.34373) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:17 gibba043 bash[24019]: cluster 2021-03-10T14:56:15.913920+0000 mgr.gibba043.dnkmem (mgr.34373) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:19 gibba003 bash[31385]: cluster 2021-03-10T14:56:17.915489+0000 mgr.gibba043.dnkmem (mgr.34373) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:19 gibba003 bash[32348]: cluster 2021-03-10T14:56:17.915489+0000 mgr.gibba043.dnkmem (mgr.34373) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:19 gibba043 bash[24019]: cluster 2021-03-10T14:56:17.915489+0000 mgr.gibba043.dnkmem (mgr.34373) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:21.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:21 gibba003 bash[31385]: cluster 2021-03-10T14:56:19.917049+0000 mgr.gibba043.dnkmem (mgr.34373) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:21.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:21 gibba003 bash[32348]: cluster 2021-03-10T14:56:19.917049+0000 mgr.gibba043.dnkmem (mgr.34373) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:21 gibba043 bash[24019]: cluster 2021-03-10T14:56:19.917049+0000 mgr.gibba043.dnkmem (mgr.34373) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:23 gibba003 bash[31385]: cluster 2021-03-10T14:56:21.918677+0000 mgr.gibba043.dnkmem (mgr.34373) 3470 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:23 gibba003 bash[31385]: cephadm 2021-03-10T14:56:21.972875+0000 mgr.gibba043.dnkmem (mgr.34373) 3471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:23 gibba003 bash[32348]: cluster 2021-03-10T14:56:21.918677+0000 mgr.gibba043.dnkmem (mgr.34373) 3470 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:23 gibba003 bash[32348]: cephadm 2021-03-10T14:56:21.972875+0000 mgr.gibba043.dnkmem (mgr.34373) 3471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:23 gibba043 bash[24019]: cluster 2021-03-10T14:56:21.918677+0000 mgr.gibba043.dnkmem (mgr.34373) 3470 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:23 gibba043 bash[24019]: cephadm 2021-03-10T14:56:21.972875+0000 mgr.gibba043.dnkmem (mgr.34373) 3471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:24 gibba043 bash[24019]: cluster 2021-03-10T14:56:23.920269+0000 mgr.gibba043.dnkmem (mgr.34373) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:24 gibba003 bash[31385]: cluster 2021-03-10T14:56:23.920269+0000 mgr.gibba043.dnkmem (mgr.34373) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:24 gibba003 bash[32348]: cluster 2021-03-10T14:56:23.920269+0000 mgr.gibba043.dnkmem (mgr.34373) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:26 gibba043 bash[24019]: cluster 2021-03-10T14:56:25.921804+0000 mgr.gibba043.dnkmem (mgr.34373) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:26 gibba003 bash[31385]: cluster 2021-03-10T14:56:25.921804+0000 mgr.gibba043.dnkmem (mgr.34373) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:26 gibba003 bash[32348]: cluster 2021-03-10T14:56:25.921804+0000 mgr.gibba043.dnkmem (mgr.34373) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:28 gibba043 bash[24019]: cluster 2021-03-10T14:56:27.923105+0000 mgr.gibba043.dnkmem (mgr.34373) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:28 gibba003 bash[31385]: cluster 2021-03-10T14:56:27.923105+0000 mgr.gibba043.dnkmem (mgr.34373) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:28 gibba003 bash[32348]: cluster 2021-03-10T14:56:27.923105+0000 mgr.gibba043.dnkmem (mgr.34373) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:31 gibba043 bash[24019]: cluster 2021-03-10T14:56:29.924738+0000 mgr.gibba043.dnkmem (mgr.34373) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:31 gibba003 bash[32348]: cluster 2021-03-10T14:56:29.924738+0000 mgr.gibba043.dnkmem (mgr.34373) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:31 gibba003 bash[31385]: cluster 2021-03-10T14:56:29.924738+0000 mgr.gibba043.dnkmem (mgr.34373) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:33 gibba043 bash[24019]: cluster 2021-03-10T14:56:31.926325+0000 mgr.gibba043.dnkmem (mgr.34373) 3476 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:33 gibba003 bash[31385]: cluster 2021-03-10T14:56:31.926325+0000 mgr.gibba043.dnkmem (mgr.34373) 3476 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:33 gibba003 bash[32348]: cluster 2021-03-10T14:56:31.926325+0000 mgr.gibba043.dnkmem (mgr.34373) 3476 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.437 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:56:34.662 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:56:34.663 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (64m) 10m ago 70m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:56:34.663 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (70m) 9m ago 70m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:56:34.663 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (65m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:56:34.663 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (65m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:56:34.664 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:56:34.664 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:56:34.664 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:56:34.664 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (64m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:56:34.664 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (70m) 10m ago 70m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:56:34.665 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (70m) 9m ago 70m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:56:34.665 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (63m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:56:34.665 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (62m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:56:34.665 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:56:34.666 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (61m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:56:34.666 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:56:34.666 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:56:34.666 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:56:34.666 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (60m) 9m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:56:34.667 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (69m) 9m ago 70m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:56:34.667 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 68m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:56:34.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:34 gibba043 bash[24019]: cluster 2021-03-10T14:56:33.927864+0000 mgr.gibba043.dnkmem (mgr.34373) 3477 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:34 gibba043 bash[24019]: audit 2021-03-10T14:56:34.426014+0000 mgr.gibba043.dnkmem (mgr.34373) 3478 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:34.908 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:56:34.909 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:56:34.909 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:34.909 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:56:34.910 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:56:34.910 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:34.910 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:56:34.910 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:56:34.910 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:56:34.911 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:56:34.911 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:56:34.911 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:56:34.911 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:56:34.912 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:56:34.912 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:56:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:34 gibba003 bash[31385]: cluster 2021-03-10T14:56:33.927864+0000 mgr.gibba043.dnkmem (mgr.34373) 3477 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:34 gibba003 bash[31385]: audit 2021-03-10T14:56:34.426014+0000 mgr.gibba043.dnkmem (mgr.34373) 3478 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:34 gibba003 bash[32348]: cluster 2021-03-10T14:56:33.927864+0000 mgr.gibba043.dnkmem (mgr.34373) 3477 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:34 gibba003 bash[32348]: audit 2021-03-10T14:56:34.426014+0000 mgr.gibba043.dnkmem (mgr.34373) 3478 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:35.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:35 gibba003 bash[31385]: audit 2021-03-10T14:56:34.648740+0000 mgr.gibba043.dnkmem (mgr.34373) 3479 : audit [DBG] from='client.46398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:35.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:35 gibba003 bash[31385]: audit 2021-03-10T14:56:34.907832+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.2.103:0/3865038302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:35 gibba003 bash[32348]: audit 2021-03-10T14:56:34.648740+0000 mgr.gibba043.dnkmem (mgr.34373) 3479 : audit [DBG] from='client.46398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:35 gibba003 bash[32348]: audit 2021-03-10T14:56:34.907832+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.2.103:0/3865038302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:36.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:35 gibba043 bash[24019]: audit 2021-03-10T14:56:34.648740+0000 mgr.gibba043.dnkmem (mgr.34373) 3479 : audit [DBG] from='client.46398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:36.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:35 gibba043 bash[24019]: audit 2021-03-10T14:56:34.907832+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.2.103:0/3865038302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:36 gibba003 bash[31385]: cluster 2021-03-10T14:56:35.929827+0000 mgr.gibba043.dnkmem (mgr.34373) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:36.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:36 gibba003 bash[32348]: cluster 2021-03-10T14:56:35.929827+0000 mgr.gibba043.dnkmem (mgr.34373) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:36 gibba043 bash[24019]: cluster 2021-03-10T14:56:35.929827+0000 mgr.gibba043.dnkmem (mgr.34373) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:37 gibba003 bash[31385]: cephadm 2021-03-10T14:56:36.990066+0000 mgr.gibba043.dnkmem (mgr.34373) 3481 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:56:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:37 gibba003 bash[31385]: audit 2021-03-10T14:56:36.992199+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:56:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:37 gibba003 bash[32348]: cephadm 2021-03-10T14:56:36.990066+0000 mgr.gibba043.dnkmem (mgr.34373) 3481 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:56:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:37 gibba003 bash[32348]: audit 2021-03-10T14:56:36.992199+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:56:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:37 gibba043 bash[24019]: cephadm 2021-03-10T14:56:36.990066+0000 mgr.gibba043.dnkmem (mgr.34373) 3481 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:56:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:37 gibba043 bash[24019]: audit 2021-03-10T14:56:36.992199+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:56:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:38 gibba003 bash[31385]: cluster 2021-03-10T14:56:37.930983+0000 mgr.gibba043.dnkmem (mgr.34373) 3482 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:38 gibba003 bash[32348]: cluster 2021-03-10T14:56:37.930983+0000 mgr.gibba043.dnkmem (mgr.34373) 3482 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:38 gibba043 bash[24019]: cluster 2021-03-10T14:56:37.930983+0000 mgr.gibba043.dnkmem (mgr.34373) 3482 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: cluster 2021-03-10T14:56:39.932902+0000 mgr.gibba043.dnkmem (mgr.34373) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.537974+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:56:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.779476+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:56:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.787359+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.790174+0000 mon.c (mon.1) 929 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.792813+0000 mon.c (mon.1) 930 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.795307+0000 mon.c (mon.1) 931 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.802156+0000 mon.c (mon.1) 932 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:40 gibba043 bash[24019]: audit 2021-03-10T14:56:40.805157+0000 mon.c (mon.1) 933 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: cluster 2021-03-10T14:56:39.932902+0000 mgr.gibba043.dnkmem (mgr.34373) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.537974+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:56:41.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.779476+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:56:41.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.787359+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:41.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.790174+0000 mon.c (mon.1) 929 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.792813+0000 mon.c (mon.1) 930 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.795307+0000 mon.c (mon.1) 931 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.802156+0000 mon.c (mon.1) 932 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[31385]: audit 2021-03-10T14:56:40.805157+0000 mon.c (mon.1) 933 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: cluster 2021-03-10T14:56:39.932902+0000 mgr.gibba043.dnkmem (mgr.34373) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.537974+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:56:41.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.779476+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:56:41.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.787359+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:41.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.790174+0000 mon.c (mon.1) 929 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.792813+0000 mon.c (mon.1) 930 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.795307+0000 mon.c (mon.1) 931 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.802156+0000 mon.c (mon.1) 932 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:41.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:40 gibba003 bash[32348]: audit 2021-03-10T14:56:40.805157+0000 mon.c (mon.1) 933 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:42.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.537763+0000 mgr.gibba043.dnkmem (mgr.34373) 3484 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:56:42.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.784884+0000 mgr.gibba043.dnkmem (mgr.34373) 3485 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:42.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.788167+0000 mgr.gibba043.dnkmem (mgr.34373) 3486 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:42.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.790745+0000 mgr.gibba043.dnkmem (mgr.34373) 3487 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:42.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.790799+0000 mgr.gibba043.dnkmem (mgr.34373) 3488 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:42.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.793301+0000 mgr.gibba043.dnkmem (mgr.34373) 3489 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:42.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.793365+0000 mgr.gibba043.dnkmem (mgr.34373) 3490 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:42.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.795894+0000 mgr.gibba043.dnkmem (mgr.34373) 3491 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:42.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.799895+0000 mgr.gibba043.dnkmem (mgr.34373) 3492 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:42.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.799965+0000 mgr.gibba043.dnkmem (mgr.34373) 3493 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:42.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.802793+0000 mgr.gibba043.dnkmem (mgr.34373) 3494 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:42.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.803227+0000 mgr.gibba043.dnkmem (mgr.34373) 3495 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:42.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.805912+0000 mgr.gibba043.dnkmem (mgr.34373) 3496 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:42.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.806063+0000 mgr.gibba043.dnkmem (mgr.34373) 3497 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:42.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:41 gibba043 bash[24019]: cephadm 2021-03-10T14:56:40.806216+0000 mgr.gibba043.dnkmem (mgr.34373) 3498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.537763+0000 mgr.gibba043.dnkmem (mgr.34373) 3484 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:56:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.784884+0000 mgr.gibba043.dnkmem (mgr.34373) 3485 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.788167+0000 mgr.gibba043.dnkmem (mgr.34373) 3486 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.790745+0000 mgr.gibba043.dnkmem (mgr.34373) 3487 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.790799+0000 mgr.gibba043.dnkmem (mgr.34373) 3488 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.793301+0000 mgr.gibba043.dnkmem (mgr.34373) 3489 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.793365+0000 mgr.gibba043.dnkmem (mgr.34373) 3490 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.795894+0000 mgr.gibba043.dnkmem (mgr.34373) 3491 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.799895+0000 mgr.gibba043.dnkmem (mgr.34373) 3492 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.799965+0000 mgr.gibba043.dnkmem (mgr.34373) 3493 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.802793+0000 mgr.gibba043.dnkmem (mgr.34373) 3494 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.803227+0000 mgr.gibba043.dnkmem (mgr.34373) 3495 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.805912+0000 mgr.gibba043.dnkmem (mgr.34373) 3496 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.806063+0000 mgr.gibba043.dnkmem (mgr.34373) 3497 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:42.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:42 gibba003 bash[31385]: cephadm 2021-03-10T14:56:40.806216+0000 mgr.gibba043.dnkmem (mgr.34373) 3498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:42.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.537763+0000 mgr.gibba043.dnkmem (mgr.34373) 3484 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:56:42.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.784884+0000 mgr.gibba043.dnkmem (mgr.34373) 3485 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:42.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.788167+0000 mgr.gibba043.dnkmem (mgr.34373) 3486 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:42.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.790745+0000 mgr.gibba043.dnkmem (mgr.34373) 3487 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:42.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.790799+0000 mgr.gibba043.dnkmem (mgr.34373) 3488 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:42.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.793301+0000 mgr.gibba043.dnkmem (mgr.34373) 3489 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:42.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.793365+0000 mgr.gibba043.dnkmem (mgr.34373) 3490 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:42.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.795894+0000 mgr.gibba043.dnkmem (mgr.34373) 3491 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:42.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.799895+0000 mgr.gibba043.dnkmem (mgr.34373) 3492 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:42.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.799965+0000 mgr.gibba043.dnkmem (mgr.34373) 3493 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:42.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.802793+0000 mgr.gibba043.dnkmem (mgr.34373) 3494 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:42.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.803227+0000 mgr.gibba043.dnkmem (mgr.34373) 3495 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:42.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.805912+0000 mgr.gibba043.dnkmem (mgr.34373) 3496 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:42.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.806063+0000 mgr.gibba043.dnkmem (mgr.34373) 3497 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:42.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:41 gibba003 bash[32348]: cephadm 2021-03-10T14:56:40.806216+0000 mgr.gibba043.dnkmem (mgr.34373) 3498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:43 gibba043 bash[24019]: cluster 2021-03-10T14:56:41.934573+0000 mgr.gibba043.dnkmem (mgr.34373) 3499 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:43 gibba003 bash[31385]: cluster 2021-03-10T14:56:41.934573+0000 mgr.gibba043.dnkmem (mgr.34373) 3499 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:43.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:43 gibba003 bash[32348]: cluster 2021-03-10T14:56:41.934573+0000 mgr.gibba043.dnkmem (mgr.34373) 3499 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:44 gibba003 bash[31385]: cluster 2021-03-10T14:56:43.936113+0000 mgr.gibba043.dnkmem (mgr.34373) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:44 gibba003 bash[32348]: cluster 2021-03-10T14:56:43.936113+0000 mgr.gibba043.dnkmem (mgr.34373) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:44 gibba043 bash[24019]: cluster 2021-03-10T14:56:43.936113+0000 mgr.gibba043.dnkmem (mgr.34373) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:47.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:47 gibba043 bash[24019]: cluster 2021-03-10T14:56:45.937727+0000 mgr.gibba043.dnkmem (mgr.34373) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:47 gibba003 bash[31385]: cluster 2021-03-10T14:56:45.937727+0000 mgr.gibba043.dnkmem (mgr.34373) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:47 gibba003 bash[32348]: cluster 2021-03-10T14:56:45.937727+0000 mgr.gibba043.dnkmem (mgr.34373) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:49 gibba043 bash[24019]: cluster 2021-03-10T14:56:47.939075+0000 mgr.gibba043.dnkmem (mgr.34373) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:49 gibba003 bash[31385]: cluster 2021-03-10T14:56:47.939075+0000 mgr.gibba043.dnkmem (mgr.34373) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:49 gibba003 bash[32348]: cluster 2021-03-10T14:56:47.939075+0000 mgr.gibba043.dnkmem (mgr.34373) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:51 gibba043 bash[24019]: cluster 2021-03-10T14:56:49.940659+0000 mgr.gibba043.dnkmem (mgr.34373) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:51 gibba003 bash[31385]: cluster 2021-03-10T14:56:49.940659+0000 mgr.gibba043.dnkmem (mgr.34373) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:51 gibba003 bash[32348]: cluster 2021-03-10T14:56:49.940659+0000 mgr.gibba043.dnkmem (mgr.34373) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:53 gibba003 bash[31385]: cluster 2021-03-10T14:56:51.942025+0000 mgr.gibba043.dnkmem (mgr.34373) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:53 gibba003 bash[32348]: cluster 2021-03-10T14:56:51.942025+0000 mgr.gibba043.dnkmem (mgr.34373) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:53 gibba043 bash[24019]: cluster 2021-03-10T14:56:51.942025+0000 mgr.gibba043.dnkmem (mgr.34373) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:54 gibba003 bash[31385]: cluster 2021-03-10T14:56:53.943642+0000 mgr.gibba043.dnkmem (mgr.34373) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:54 gibba003 bash[32348]: cluster 2021-03-10T14:56:53.943642+0000 mgr.gibba043.dnkmem (mgr.34373) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:54 gibba043 bash[24019]: cluster 2021-03-10T14:56:53.943642+0000 mgr.gibba043.dnkmem (mgr.34373) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:57 gibba043 bash[24019]: cephadm 2021-03-10T14:56:55.822308+0000 mgr.gibba043.dnkmem (mgr.34373) 3506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:57 gibba043 bash[24019]: cluster 2021-03-10T14:56:55.945181+0000 mgr.gibba043.dnkmem (mgr.34373) 3507 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:57 gibba003 bash[31385]: cephadm 2021-03-10T14:56:55.822308+0000 mgr.gibba043.dnkmem (mgr.34373) 3506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:57 gibba003 bash[31385]: cluster 2021-03-10T14:56:55.945181+0000 mgr.gibba043.dnkmem (mgr.34373) 3507 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:57 gibba003 bash[32348]: cephadm 2021-03-10T14:56:55.822308+0000 mgr.gibba043.dnkmem (mgr.34373) 3506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:56:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:57 gibba003 bash[32348]: cluster 2021-03-10T14:56:55.945181+0000 mgr.gibba043.dnkmem (mgr.34373) 3507 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:56:59 gibba043 bash[24019]: cluster 2021-03-10T14:56:57.946659+0000 mgr.gibba043.dnkmem (mgr.34373) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:56:59 gibba003 bash[31385]: cluster 2021-03-10T14:56:57.946659+0000 mgr.gibba043.dnkmem (mgr.34373) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:56:59 gibba003 bash[32348]: cluster 2021-03-10T14:56:57.946659+0000 mgr.gibba043.dnkmem (mgr.34373) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:01 gibba003 bash[32348]: cluster 2021-03-10T14:56:59.948285+0000 mgr.gibba043.dnkmem (mgr.34373) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:01 gibba003 bash[31385]: cluster 2021-03-10T14:56:59.948285+0000 mgr.gibba043.dnkmem (mgr.34373) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:01 gibba043 bash[24019]: cluster 2021-03-10T14:56:59.948285+0000 mgr.gibba043.dnkmem (mgr.34373) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:03 gibba003 bash[31385]: cluster 2021-03-10T14:57:01.949872+0000 mgr.gibba043.dnkmem (mgr.34373) 3510 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:03 gibba003 bash[32348]: cluster 2021-03-10T14:57:01.949872+0000 mgr.gibba043.dnkmem (mgr.34373) 3510 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:03 gibba043 bash[24019]: cluster 2021-03-10T14:57:01.949872+0000 mgr.gibba043.dnkmem (mgr.34373) 3510 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:04 gibba003 bash[31385]: cluster 2021-03-10T14:57:03.951472+0000 mgr.gibba043.dnkmem (mgr.34373) 3511 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:04 gibba003 bash[32348]: cluster 2021-03-10T14:57:03.951472+0000 mgr.gibba043.dnkmem (mgr.34373) 3511 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:05.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:04 gibba043 bash[24019]: cluster 2021-03-10T14:57:03.951472+0000 mgr.gibba043.dnkmem (mgr.34373) 3511 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:05.153 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:57:05.377 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:57:05.377 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (65m) 24s ago 70m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:57:05.378 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (70m) 9m ago 70m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:57:05.378 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (65m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:57:05.378 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (66m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:57:05.378 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (65m) 24s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:57:05.379 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (64m) 24s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:57:05.379 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:57:05.379 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (64m) 24s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:57:05.379 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (70m) 24s ago 70m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:57:05.379 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (70m) 9m ago 70m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:57:05.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (63m) 24s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:57:05.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (63m) 24s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:57:05.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (62m) 24s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:57:05.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (62m) 24s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:57:05.381 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:57:05.381 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:57:05.381 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:57:05.381 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:57:05.381 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (70m) 9m ago 70m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:57:05.382 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 24s ago 68m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:57:05.626 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:57:05.627 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:57:05.627 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:05.627 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:57:05.628 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:57:05.628 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:05.628 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:57:05.628 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:57:05.628 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:57:05.629 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:57:05.629 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:57:05.629 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:57:05.629 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:57:05.629 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:57:05.630 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:57:05.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:05 gibba003 bash[31385]: audit 2021-03-10T14:57:05.141691+0000 mgr.gibba043.dnkmem (mgr.34373) 3512 : audit [DBG] from='client.46410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:05.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:05 gibba003 bash[31385]: audit 2021-03-10T14:57:05.362620+0000 mgr.gibba043.dnkmem (mgr.34373) 3513 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:05.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:05 gibba003 bash[32348]: audit 2021-03-10T14:57:05.141691+0000 mgr.gibba043.dnkmem (mgr.34373) 3512 : audit [DBG] from='client.46410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:05.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:05 gibba003 bash[32348]: audit 2021-03-10T14:57:05.362620+0000 mgr.gibba043.dnkmem (mgr.34373) 3513 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:06.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:05 gibba043 bash[24019]: audit 2021-03-10T14:57:05.141691+0000 mgr.gibba043.dnkmem (mgr.34373) 3512 : audit [DBG] from='client.46410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:06.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:05 gibba043 bash[24019]: audit 2021-03-10T14:57:05.362620+0000 mgr.gibba043.dnkmem (mgr.34373) 3513 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:06 gibba003 bash[31385]: audit 2021-03-10T14:57:05.625644+0000 mon.c (mon.1) 934 : audit [DBG] from='client.? 172.21.2.103:0/2860707384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:06 gibba003 bash[31385]: cluster 2021-03-10T14:57:05.953188+0000 mgr.gibba043.dnkmem (mgr.34373) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:06 gibba003 bash[32348]: audit 2021-03-10T14:57:05.625644+0000 mon.c (mon.1) 934 : audit [DBG] from='client.? 172.21.2.103:0/2860707384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:06 gibba003 bash[32348]: cluster 2021-03-10T14:57:05.953188+0000 mgr.gibba043.dnkmem (mgr.34373) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:06 gibba043 bash[24019]: audit 2021-03-10T14:57:05.625644+0000 mon.c (mon.1) 934 : audit [DBG] from='client.? 172.21.2.103:0/2860707384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:06 gibba043 bash[24019]: cluster 2021-03-10T14:57:05.953188+0000 mgr.gibba043.dnkmem (mgr.34373) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:09 gibba043 bash[24019]: cluster 2021-03-10T14:57:07.954481+0000 mgr.gibba043.dnkmem (mgr.34373) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:09 gibba003 bash[31385]: cluster 2021-03-10T14:57:07.954481+0000 mgr.gibba043.dnkmem (mgr.34373) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:09 gibba003 bash[32348]: cluster 2021-03-10T14:57:07.954481+0000 mgr.gibba043.dnkmem (mgr.34373) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:11 gibba043 bash[24019]: cluster 2021-03-10T14:57:09.956073+0000 mgr.gibba043.dnkmem (mgr.34373) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:11 gibba003 bash[31385]: cluster 2021-03-10T14:57:09.956073+0000 mgr.gibba043.dnkmem (mgr.34373) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:11 gibba003 bash[32348]: cluster 2021-03-10T14:57:09.956073+0000 mgr.gibba043.dnkmem (mgr.34373) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:12.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:12 gibba003 bash[31385]: cephadm 2021-03-10T14:57:10.838433+0000 mgr.gibba043.dnkmem (mgr.34373) 3517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:12 gibba003 bash[32348]: cephadm 2021-03-10T14:57:10.838433+0000 mgr.gibba043.dnkmem (mgr.34373) 3517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:12 gibba043 bash[24019]: cephadm 2021-03-10T14:57:10.838433+0000 mgr.gibba043.dnkmem (mgr.34373) 3517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:13 gibba003 bash[31385]: cluster 2021-03-10T14:57:11.957432+0000 mgr.gibba043.dnkmem (mgr.34373) 3518 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:13 gibba003 bash[32348]: cluster 2021-03-10T14:57:11.957432+0000 mgr.gibba043.dnkmem (mgr.34373) 3518 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:13 gibba043 bash[24019]: cluster 2021-03-10T14:57:11.957432+0000 mgr.gibba043.dnkmem (mgr.34373) 3518 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.128319+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.129298+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.204228+0000 mon.c (mon.1) 936 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.205360+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.219502+0000 mon.c (mon.1) 937 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:57:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.220291+0000 mon.c (mon.1) 938 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:57:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.220742+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:57:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.220986+0000 mon.c (mon.1) 939 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.221849+0000 mon.c (mon.1) 940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.221960+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:57:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.222949+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[31385]: audit 2021-03-10T14:57:13.223940+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.128319+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.129298+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.204228+0000 mon.c (mon.1) 936 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.205360+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.219502+0000 mon.c (mon.1) 937 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:57:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.220291+0000 mon.c (mon.1) 938 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:57:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.220742+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:57:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.220986+0000 mon.c (mon.1) 939 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.221849+0000 mon.c (mon.1) 940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.221960+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:57:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.222949+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:14 gibba003 bash[32348]: audit 2021-03-10T14:57:13.223940+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.128319+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.129298+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.204228+0000 mon.c (mon.1) 936 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.205360+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.219502+0000 mon.c (mon.1) 937 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:57:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.220291+0000 mon.c (mon.1) 938 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:57:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.220742+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:57:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.220986+0000 mon.c (mon.1) 939 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.221849+0000 mon.c (mon.1) 940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.221960+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:57:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.222949+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:57:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:14 gibba043 bash[24019]: audit 2021-03-10T14:57:13.223940+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:57:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:15 gibba003 bash[31385]: cluster 2021-03-10T14:57:13.958812+0000 mgr.gibba043.dnkmem (mgr.34373) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:15 gibba003 bash[32348]: cluster 2021-03-10T14:57:13.958812+0000 mgr.gibba043.dnkmem (mgr.34373) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:15 gibba043 bash[24019]: cluster 2021-03-10T14:57:13.958812+0000 mgr.gibba043.dnkmem (mgr.34373) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:17 gibba003 bash[31385]: cluster 2021-03-10T14:57:15.960571+0000 mgr.gibba043.dnkmem (mgr.34373) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:17 gibba003 bash[32348]: cluster 2021-03-10T14:57:15.960571+0000 mgr.gibba043.dnkmem (mgr.34373) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:17 gibba043 bash[24019]: cluster 2021-03-10T14:57:15.960571+0000 mgr.gibba043.dnkmem (mgr.34373) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:19 gibba003 bash[31385]: cluster 2021-03-10T14:57:17.961738+0000 mgr.gibba043.dnkmem (mgr.34373) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:19 gibba003 bash[32348]: cluster 2021-03-10T14:57:17.961738+0000 mgr.gibba043.dnkmem (mgr.34373) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:19 gibba043 bash[24019]: cluster 2021-03-10T14:57:17.961738+0000 mgr.gibba043.dnkmem (mgr.34373) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:21 gibba003 bash[31385]: cluster 2021-03-10T14:57:19.963401+0000 mgr.gibba043.dnkmem (mgr.34373) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:21 gibba003 bash[32348]: cluster 2021-03-10T14:57:19.963401+0000 mgr.gibba043.dnkmem (mgr.34373) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:21 gibba043 bash[24019]: cluster 2021-03-10T14:57:19.963401+0000 mgr.gibba043.dnkmem (mgr.34373) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:23 gibba003 bash[31385]: cluster 2021-03-10T14:57:21.964930+0000 mgr.gibba043.dnkmem (mgr.34373) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:23 gibba003 bash[32348]: cluster 2021-03-10T14:57:21.964930+0000 mgr.gibba043.dnkmem (mgr.34373) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:23 gibba043 bash[24019]: cluster 2021-03-10T14:57:21.964930+0000 mgr.gibba043.dnkmem (mgr.34373) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:24 gibba003 bash[31385]: cluster 2021-03-10T14:57:23.966318+0000 mgr.gibba043.dnkmem (mgr.34373) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:24 gibba003 bash[32348]: cluster 2021-03-10T14:57:23.966318+0000 mgr.gibba043.dnkmem (mgr.34373) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:24 gibba043 bash[24019]: cluster 2021-03-10T14:57:23.966318+0000 mgr.gibba043.dnkmem (mgr.34373) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:27 gibba003 bash[31385]: cephadm 2021-03-10T14:57:25.854393+0000 mgr.gibba043.dnkmem (mgr.34373) 3525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:27 gibba003 bash[31385]: cluster 2021-03-10T14:57:25.967978+0000 mgr.gibba043.dnkmem (mgr.34373) 3526 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:27 gibba003 bash[32348]: cephadm 2021-03-10T14:57:25.854393+0000 mgr.gibba043.dnkmem (mgr.34373) 3525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:27 gibba003 bash[32348]: cluster 2021-03-10T14:57:25.967978+0000 mgr.gibba043.dnkmem (mgr.34373) 3526 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:27.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:27 gibba043 bash[24019]: cephadm 2021-03-10T14:57:25.854393+0000 mgr.gibba043.dnkmem (mgr.34373) 3525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:27.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:27 gibba043 bash[24019]: cluster 2021-03-10T14:57:25.967978+0000 mgr.gibba043.dnkmem (mgr.34373) 3526 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:29 gibba003 bash[31385]: cluster 2021-03-10T14:57:27.969183+0000 mgr.gibba043.dnkmem (mgr.34373) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:29 gibba003 bash[32348]: cluster 2021-03-10T14:57:27.969183+0000 mgr.gibba043.dnkmem (mgr.34373) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:29 gibba043 bash[24019]: cluster 2021-03-10T14:57:27.969183+0000 mgr.gibba043.dnkmem (mgr.34373) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:31 gibba003 bash[31385]: cluster 2021-03-10T14:57:29.970796+0000 mgr.gibba043.dnkmem (mgr.34373) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:31 gibba003 bash[32348]: cluster 2021-03-10T14:57:29.970796+0000 mgr.gibba043.dnkmem (mgr.34373) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:31 gibba043 bash[24019]: cluster 2021-03-10T14:57:29.970796+0000 mgr.gibba043.dnkmem (mgr.34373) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:33 gibba003 bash[31385]: cluster 2021-03-10T14:57:31.972435+0000 mgr.gibba043.dnkmem (mgr.34373) 3529 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:33 gibba003 bash[32348]: cluster 2021-03-10T14:57:31.972435+0000 mgr.gibba043.dnkmem (mgr.34373) 3529 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:33 gibba043 bash[24019]: cluster 2021-03-10T14:57:31.972435+0000 mgr.gibba043.dnkmem (mgr.34373) 3529 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:34 gibba003 bash[31385]: cluster 2021-03-10T14:57:33.973929+0000 mgr.gibba043.dnkmem (mgr.34373) 3530 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:34 gibba003 bash[32348]: cluster 2021-03-10T14:57:33.973929+0000 mgr.gibba043.dnkmem (mgr.34373) 3530 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:34 gibba043 bash[24019]: cluster 2021-03-10T14:57:33.973929+0000 mgr.gibba043.dnkmem (mgr.34373) 3530 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:35.870 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:57:36.095 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:57:36.095 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (65m) 55s ago 71m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:57:36.096 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (71m) 10m ago 71m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:57:36.096 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (66m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:57:36.096 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (66m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:57:36.096 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (65m) 55s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:57:36.097 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (65m) 55s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:57:36.097 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (65m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:57:36.097 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (65m) 55s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:57:36.097 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (71m) 55s ago 71m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:57:36.097 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (71m) 10m ago 71m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:57:36.098 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (64m) 55s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:57:36.098 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (63m) 55s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:57:36.098 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (63m) 55s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:57:36.098 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (62m) 55s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:57:36.099 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (62m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:57:36.099 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:57:36.099 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (61m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:57:36.099 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (61m) 10m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:57:36.099 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (70m) 10m ago 71m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:57:36.100 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 55s ago 69m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:57:36.344 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:57:36.344 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:57:36.345 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:36.345 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:57:36.345 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:57:36.345 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:36.346 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:57:36.346 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:57:36.346 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:57:36.346 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:57:36.347 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:57:36.347 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:57:36.347 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:57:36.347 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:57:36.347 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:57:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[31385]: audit 2021-03-10T14:57:35.859353+0000 mgr.gibba043.dnkmem (mgr.34373) 3531 : audit [DBG] from='client.46428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[31385]: cluster 2021-03-10T14:57:35.975821+0000 mgr.gibba043.dnkmem (mgr.34373) 3532 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[31385]: audit 2021-03-10T14:57:36.082881+0000 mgr.gibba043.dnkmem (mgr.34373) 3533 : audit [DBG] from='client.56422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[31385]: audit 2021-03-10T14:57:36.343138+0000 mon.c (mon.1) 941 : audit [DBG] from='client.? 172.21.2.103:0/3659593039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[32348]: audit 2021-03-10T14:57:35.859353+0000 mgr.gibba043.dnkmem (mgr.34373) 3531 : audit [DBG] from='client.46428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[32348]: cluster 2021-03-10T14:57:35.975821+0000 mgr.gibba043.dnkmem (mgr.34373) 3532 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[32348]: audit 2021-03-10T14:57:36.082881+0000 mgr.gibba043.dnkmem (mgr.34373) 3533 : audit [DBG] from='client.56422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:37 gibba003 bash[32348]: audit 2021-03-10T14:57:36.343138+0000 mon.c (mon.1) 941 : audit [DBG] from='client.? 172.21.2.103:0/3659593039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:37 gibba043 bash[24019]: audit 2021-03-10T14:57:35.859353+0000 mgr.gibba043.dnkmem (mgr.34373) 3531 : audit [DBG] from='client.46428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:37 gibba043 bash[24019]: cluster 2021-03-10T14:57:35.975821+0000 mgr.gibba043.dnkmem (mgr.34373) 3532 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:37 gibba043 bash[24019]: audit 2021-03-10T14:57:36.082881+0000 mgr.gibba043.dnkmem (mgr.34373) 3533 : audit [DBG] from='client.56422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:37 gibba043 bash[24019]: audit 2021-03-10T14:57:36.343138+0000 mon.c (mon.1) 941 : audit [DBG] from='client.? 172.21.2.103:0/3659593039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:39 gibba003 bash[31385]: cluster 2021-03-10T14:57:37.977234+0000 mgr.gibba043.dnkmem (mgr.34373) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:39 gibba003 bash[32348]: cluster 2021-03-10T14:57:37.977234+0000 mgr.gibba043.dnkmem (mgr.34373) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:39 gibba043 bash[24019]: cluster 2021-03-10T14:57:37.977234+0000 mgr.gibba043.dnkmem (mgr.34373) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:41 gibba003 bash[32348]: cluster 2021-03-10T14:57:39.978890+0000 mgr.gibba043.dnkmem (mgr.34373) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:41 gibba003 bash[32348]: audit 2021-03-10T14:57:40.874526+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:57:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:41 gibba003 bash[31385]: cluster 2021-03-10T14:57:39.978890+0000 mgr.gibba043.dnkmem (mgr.34373) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:41 gibba003 bash[31385]: audit 2021-03-10T14:57:40.874526+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:57:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:41 gibba043 bash[24019]: cluster 2021-03-10T14:57:39.978890+0000 mgr.gibba043.dnkmem (mgr.34373) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:41 gibba043 bash[24019]: audit 2021-03-10T14:57:40.874526+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:57:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:42 gibba003 bash[31385]: cephadm 2021-03-10T14:57:40.871170+0000 mgr.gibba043.dnkmem (mgr.34373) 3536 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:57:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:42 gibba003 bash[32348]: cephadm 2021-03-10T14:57:40.871170+0000 mgr.gibba043.dnkmem (mgr.34373) 3536 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:57:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:42 gibba043 bash[24019]: cephadm 2021-03-10T14:57:40.871170+0000 mgr.gibba043.dnkmem (mgr.34373) 3536 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:57:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:43 gibba003 bash[31385]: cluster 2021-03-10T14:57:41.980288+0000 mgr.gibba043.dnkmem (mgr.34373) 3537 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:43 gibba003 bash[32348]: cluster 2021-03-10T14:57:41.980288+0000 mgr.gibba043.dnkmem (mgr.34373) 3537 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:43 gibba043 bash[24019]: cluster 2021-03-10T14:57:41.980288+0000 mgr.gibba043.dnkmem (mgr.34373) 3537 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:44 gibba003 bash[31385]: cluster 2021-03-10T14:57:43.980784+0000 mgr.gibba043.dnkmem (mgr.34373) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:44 gibba003 bash[32348]: cluster 2021-03-10T14:57:43.980784+0000 mgr.gibba043.dnkmem (mgr.34373) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:45.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:44 gibba043 bash[24019]: cluster 2021-03-10T14:57:43.980784+0000 mgr.gibba043.dnkmem (mgr.34373) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:45.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.592766+0000 mgr.gibba043.dnkmem (mgr.34373) 3539 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:57:45.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.592986+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:57:45.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.788245+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:57:45.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.790157+0000 mgr.gibba043.dnkmem (mgr.34373) 3540 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:45.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.791949+0000 mgr.gibba043.dnkmem (mgr.34373) 3541 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:45.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.792124+0000 mon.c (mon.1) 943 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:45.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.793485+0000 mon.c (mon.1) 944 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.793577+0000 mgr.gibba043.dnkmem (mgr.34373) 3542 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:45.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.793619+0000 mgr.gibba043.dnkmem (mgr.34373) 3543 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:45.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.794774+0000 mgr.gibba043.dnkmem (mgr.34373) 3544 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:45.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.794814+0000 mgr.gibba043.dnkmem (mgr.34373) 3545 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:45.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.795187+0000 mon.c (mon.1) 945 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.796052+0000 mgr.gibba043.dnkmem (mgr.34373) 3546 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:45.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.796283+0000 mon.c (mon.1) 946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.797866+0000 mgr.gibba043.dnkmem (mgr.34373) 3547 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:45.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.797905+0000 mgr.gibba043.dnkmem (mgr.34373) 3548 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:45.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.799405+0000 mgr.gibba043.dnkmem (mgr.34373) 3549 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:45.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.799657+0000 mon.c (mon.1) 947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.799868+0000 mgr.gibba043.dnkmem (mgr.34373) 3550 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:45.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.801294+0000 mgr.gibba043.dnkmem (mgr.34373) 3551 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:45.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.801334+0000 mgr.gibba043.dnkmem (mgr.34373) 3552 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:45.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.592766+0000 mgr.gibba043.dnkmem (mgr.34373) 3539 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:57:45.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.592986+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:57:45.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.788245+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:57:45.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.790157+0000 mgr.gibba043.dnkmem (mgr.34373) 3540 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:45.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.791949+0000 mgr.gibba043.dnkmem (mgr.34373) 3541 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:45.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.792124+0000 mon.c (mon.1) 943 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:45.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.793485+0000 mon.c (mon.1) 944 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.793577+0000 mgr.gibba043.dnkmem (mgr.34373) 3542 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:45.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.793619+0000 mgr.gibba043.dnkmem (mgr.34373) 3543 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:45.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.794774+0000 mgr.gibba043.dnkmem (mgr.34373) 3544 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:45.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.794814+0000 mgr.gibba043.dnkmem (mgr.34373) 3545 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:45.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.795187+0000 mon.c (mon.1) 945 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.796052+0000 mgr.gibba043.dnkmem (mgr.34373) 3546 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:45.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.796283+0000 mon.c (mon.1) 946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.797866+0000 mgr.gibba043.dnkmem (mgr.34373) 3547 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:45.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.797905+0000 mgr.gibba043.dnkmem (mgr.34373) 3548 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:45.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.799405+0000 mgr.gibba043.dnkmem (mgr.34373) 3549 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:45.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.799657+0000 mon.c (mon.1) 947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.799868+0000 mgr.gibba043.dnkmem (mgr.34373) 3550 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:45.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.801294+0000 mgr.gibba043.dnkmem (mgr.34373) 3551 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:45.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.801334+0000 mgr.gibba043.dnkmem (mgr.34373) 3552 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:45.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: cephadm 2021-03-10T14:57:44.801449+0000 mgr.gibba043.dnkmem (mgr.34373) 3553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:45.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[31385]: audit 2021-03-10T14:57:44.801452+0000 mon.c (mon.1) 948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:45.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: cephadm 2021-03-10T14:57:44.801449+0000 mgr.gibba043.dnkmem (mgr.34373) 3553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:45.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:45 gibba003 bash[32348]: audit 2021-03-10T14:57:44.801452+0000 mon.c (mon.1) 948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.592766+0000 mgr.gibba043.dnkmem (mgr.34373) 3539 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:57:46.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.592986+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:57:46.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.788245+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:57:46.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.790157+0000 mgr.gibba043.dnkmem (mgr.34373) 3540 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:46.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.791949+0000 mgr.gibba043.dnkmem (mgr.34373) 3541 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:46.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.792124+0000 mon.c (mon.1) 943 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:46.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.793485+0000 mon.c (mon.1) 944 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.793577+0000 mgr.gibba043.dnkmem (mgr.34373) 3542 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:46.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.793619+0000 mgr.gibba043.dnkmem (mgr.34373) 3543 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:46.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.794774+0000 mgr.gibba043.dnkmem (mgr.34373) 3544 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:46.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.794814+0000 mgr.gibba043.dnkmem (mgr.34373) 3545 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:46.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.795187+0000 mon.c (mon.1) 945 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.796052+0000 mgr.gibba043.dnkmem (mgr.34373) 3546 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:46.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.796283+0000 mon.c (mon.1) 946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.797866+0000 mgr.gibba043.dnkmem (mgr.34373) 3547 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:46.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.797905+0000 mgr.gibba043.dnkmem (mgr.34373) 3548 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:46.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.799405+0000 mgr.gibba043.dnkmem (mgr.34373) 3549 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:46.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.799657+0000 mon.c (mon.1) 947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.799868+0000 mgr.gibba043.dnkmem (mgr.34373) 3550 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:46.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.801294+0000 mgr.gibba043.dnkmem (mgr.34373) 3551 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:46.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.801334+0000 mgr.gibba043.dnkmem (mgr.34373) 3552 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:46.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: cephadm 2021-03-10T14:57:44.801449+0000 mgr.gibba043.dnkmem (mgr.34373) 3553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:57:46.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:45 gibba043 bash[24019]: audit 2021-03-10T14:57:44.801452+0000 mon.c (mon.1) 948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:46 gibba003 bash[31385]: cluster 2021-03-10T14:57:45.982327+0000 mgr.gibba043.dnkmem (mgr.34373) 3554 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:46.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:46 gibba003 bash[32348]: cluster 2021-03-10T14:57:45.982327+0000 mgr.gibba043.dnkmem (mgr.34373) 3554 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:46 gibba043 bash[24019]: cluster 2021-03-10T14:57:45.982327+0000 mgr.gibba043.dnkmem (mgr.34373) 3554 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:49 gibba003 bash[31385]: cluster 2021-03-10T14:57:47.983554+0000 mgr.gibba043.dnkmem (mgr.34373) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:49 gibba003 bash[32348]: cluster 2021-03-10T14:57:47.983554+0000 mgr.gibba043.dnkmem (mgr.34373) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:49 gibba043 bash[24019]: cluster 2021-03-10T14:57:47.983554+0000 mgr.gibba043.dnkmem (mgr.34373) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:51 gibba003 bash[31385]: cluster 2021-03-10T14:57:49.985125+0000 mgr.gibba043.dnkmem (mgr.34373) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:51 gibba003 bash[32348]: cluster 2021-03-10T14:57:49.985125+0000 mgr.gibba043.dnkmem (mgr.34373) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:51 gibba043 bash[24019]: cluster 2021-03-10T14:57:49.985125+0000 mgr.gibba043.dnkmem (mgr.34373) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:53 gibba003 bash[31385]: cluster 2021-03-10T14:57:51.986772+0000 mgr.gibba043.dnkmem (mgr.34373) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:53 gibba003 bash[32348]: cluster 2021-03-10T14:57:51.986772+0000 mgr.gibba043.dnkmem (mgr.34373) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:53 gibba043 bash[24019]: cluster 2021-03-10T14:57:51.986772+0000 mgr.gibba043.dnkmem (mgr.34373) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:54 gibba003 bash[31385]: cluster 2021-03-10T14:57:53.988397+0000 mgr.gibba043.dnkmem (mgr.34373) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:54 gibba003 bash[32348]: cluster 2021-03-10T14:57:53.988397+0000 mgr.gibba043.dnkmem (mgr.34373) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:54 gibba043 bash[24019]: cluster 2021-03-10T14:57:53.988397+0000 mgr.gibba043.dnkmem (mgr.34373) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:57 gibba003 bash[31385]: cluster 2021-03-10T14:57:55.989881+0000 mgr.gibba043.dnkmem (mgr.34373) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:57 gibba003 bash[32348]: cluster 2021-03-10T14:57:55.989881+0000 mgr.gibba043.dnkmem (mgr.34373) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:57 gibba043 bash[24019]: cluster 2021-03-10T14:57:55.989881+0000 mgr.gibba043.dnkmem (mgr.34373) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:57:59 gibba003 bash[31385]: cluster 2021-03-10T14:57:57.991171+0000 mgr.gibba043.dnkmem (mgr.34373) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:57:59 gibba003 bash[32348]: cluster 2021-03-10T14:57:57.991171+0000 mgr.gibba043.dnkmem (mgr.34373) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:57:59 gibba043 bash[24019]: cluster 2021-03-10T14:57:57.991171+0000 mgr.gibba043.dnkmem (mgr.34373) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:01 gibba003 bash[31385]: cephadm 2021-03-10T14:57:59.814099+0000 mgr.gibba043.dnkmem (mgr.34373) 3561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:01 gibba003 bash[31385]: cluster 2021-03-10T14:57:59.992883+0000 mgr.gibba043.dnkmem (mgr.34373) 3562 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:01 gibba003 bash[32348]: cephadm 2021-03-10T14:57:59.814099+0000 mgr.gibba043.dnkmem (mgr.34373) 3561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:01 gibba003 bash[32348]: cluster 2021-03-10T14:57:59.992883+0000 mgr.gibba043.dnkmem (mgr.34373) 3562 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:01 gibba043 bash[24019]: cephadm 2021-03-10T14:57:59.814099+0000 mgr.gibba043.dnkmem (mgr.34373) 3561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:01 gibba043 bash[24019]: cluster 2021-03-10T14:57:59.992883+0000 mgr.gibba043.dnkmem (mgr.34373) 3562 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:03 gibba003 bash[31385]: cluster 2021-03-10T14:58:01.994500+0000 mgr.gibba043.dnkmem (mgr.34373) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:03 gibba003 bash[32348]: cluster 2021-03-10T14:58:01.994500+0000 mgr.gibba043.dnkmem (mgr.34373) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:03 gibba043 bash[24019]: cluster 2021-03-10T14:58:01.994500+0000 mgr.gibba043.dnkmem (mgr.34373) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:04 gibba003 bash[31385]: cluster 2021-03-10T14:58:03.996153+0000 mgr.gibba043.dnkmem (mgr.34373) 3564 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:04 gibba003 bash[32348]: cluster 2021-03-10T14:58:03.996153+0000 mgr.gibba043.dnkmem (mgr.34373) 3564 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:04 gibba043 bash[24019]: cluster 2021-03-10T14:58:03.996153+0000 mgr.gibba043.dnkmem (mgr.34373) 3564 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:06.594 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:58:06.822 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:58:06.822 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (66m) 86s ago 71m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:58:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (71m) 22s ago 71m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:58:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (66m) 22s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:58:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (67m) 22s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:58:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (66m) 86s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:58:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (66m) 86s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:58:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (65m) 22s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:58:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (65m) 86s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:58:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (71m) 86s ago 71m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:58:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (71m) 22s ago 71m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:58:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (64m) 86s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:58:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (64m) 86s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:58:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (63m) 86s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:58:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (63m) 86s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:58:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (63m) 22s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:58:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (62m) 22s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:58:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (62m) 22s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:58:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (61m) 22s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:58:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (71m) 22s ago 71m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:58:06.827 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 86s ago 69m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:58:07.069 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:58:07.070 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:58:07.070 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:07.070 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:58:07.070 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:58:07.070 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:07.071 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:58:07.071 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:58:07.071 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:58:07.071 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:58:07.072 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:58:07.072 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:58:07.072 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:58:07.072 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:58:07.072 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:58:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:07 gibba003 bash[31385]: cluster 2021-03-10T14:58:05.998026+0000 mgr.gibba043.dnkmem (mgr.34373) 3565 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:07 gibba003 bash[32348]: cluster 2021-03-10T14:58:05.998026+0000 mgr.gibba043.dnkmem (mgr.34373) 3565 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:07 gibba043 bash[24019]: cluster 2021-03-10T14:58:05.998026+0000 mgr.gibba043.dnkmem (mgr.34373) 3565 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:08 gibba003 bash[31385]: audit 2021-03-10T14:58:06.582789+0000 mgr.gibba043.dnkmem (mgr.34373) 3566 : audit [DBG] from='client.56434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:08 gibba003 bash[31385]: audit 2021-03-10T14:58:06.809298+0000 mgr.gibba043.dnkmem (mgr.34373) 3567 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:08 gibba003 bash[31385]: audit 2021-03-10T14:58:07.068151+0000 mon.c (mon.1) 949 : audit [DBG] from='client.? 172.21.2.103:0/791397938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:08 gibba003 bash[32348]: audit 2021-03-10T14:58:06.582789+0000 mgr.gibba043.dnkmem (mgr.34373) 3566 : audit [DBG] from='client.56434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:08 gibba003 bash[32348]: audit 2021-03-10T14:58:06.809298+0000 mgr.gibba043.dnkmem (mgr.34373) 3567 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:08 gibba003 bash[32348]: audit 2021-03-10T14:58:07.068151+0000 mon.c (mon.1) 949 : audit [DBG] from='client.? 172.21.2.103:0/791397938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:08 gibba043 bash[24019]: audit 2021-03-10T14:58:06.582789+0000 mgr.gibba043.dnkmem (mgr.34373) 3566 : audit [DBG] from='client.56434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:08 gibba043 bash[24019]: audit 2021-03-10T14:58:06.809298+0000 mgr.gibba043.dnkmem (mgr.34373) 3567 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:08 gibba043 bash[24019]: audit 2021-03-10T14:58:07.068151+0000 mon.c (mon.1) 949 : audit [DBG] from='client.? 172.21.2.103:0/791397938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:09 gibba003 bash[31385]: cluster 2021-03-10T14:58:07.999532+0000 mgr.gibba043.dnkmem (mgr.34373) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:09 gibba003 bash[32348]: cluster 2021-03-10T14:58:07.999532+0000 mgr.gibba043.dnkmem (mgr.34373) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:09 gibba043 bash[24019]: cluster 2021-03-10T14:58:07.999532+0000 mgr.gibba043.dnkmem (mgr.34373) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:11 gibba003 bash[31385]: cluster 2021-03-10T14:58:10.000998+0000 mgr.gibba043.dnkmem (mgr.34373) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:11 gibba003 bash[32348]: cluster 2021-03-10T14:58:10.000998+0000 mgr.gibba043.dnkmem (mgr.34373) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:11 gibba043 bash[24019]: cluster 2021-03-10T14:58:10.000998+0000 mgr.gibba043.dnkmem (mgr.34373) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:13 gibba003 bash[31385]: cluster 2021-03-10T14:58:12.002599+0000 mgr.gibba043.dnkmem (mgr.34373) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:13 gibba003 bash[32348]: cluster 2021-03-10T14:58:12.002599+0000 mgr.gibba043.dnkmem (mgr.34373) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:13 gibba043 bash[24019]: cluster 2021-03-10T14:58:12.002599+0000 mgr.gibba043.dnkmem (mgr.34373) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.133605+0000 mon.c (mon.1) 950 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.134104+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.212297+0000 mon.c (mon.1) 951 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.213431+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.241114+0000 mon.c (mon.1) 952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:58:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.241836+0000 mon.c (mon.1) 953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.242338+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:58:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.242516+0000 mon.c (mon.1) 954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:58:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.243409+0000 mon.c (mon.1) 955 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.243631+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.244841+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:58:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[32348]: audit 2021-03-10T14:58:13.245627+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.133605+0000 mon.c (mon.1) 950 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.134104+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.212297+0000 mon.c (mon.1) 951 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.213431+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.241114+0000 mon.c (mon.1) 952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:58:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.241836+0000 mon.c (mon.1) 953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.242338+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:58:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.242516+0000 mon.c (mon.1) 954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:58:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.243409+0000 mon.c (mon.1) 955 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.243631+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.244841+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:58:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:14 gibba003 bash[31385]: audit 2021-03-10T14:58:13.245627+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.133605+0000 mon.c (mon.1) 950 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.134104+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.212297+0000 mon.c (mon.1) 951 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.213431+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.241114+0000 mon.c (mon.1) 952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:58:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.241836+0000 mon.c (mon.1) 953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.242338+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:58:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.242516+0000 mon.c (mon.1) 954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:58:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.243409+0000 mon.c (mon.1) 955 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.243631+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:58:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.244841+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:58:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:14 gibba043 bash[24019]: audit 2021-03-10T14:58:13.245627+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:58:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:15 gibba003 bash[31385]: cluster 2021-03-10T14:58:14.004244+0000 mgr.gibba043.dnkmem (mgr.34373) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:15 gibba003 bash[32348]: cluster 2021-03-10T14:58:14.004244+0000 mgr.gibba043.dnkmem (mgr.34373) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:15 gibba043 bash[24019]: cluster 2021-03-10T14:58:14.004244+0000 mgr.gibba043.dnkmem (mgr.34373) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:16 gibba003 bash[31385]: cephadm 2021-03-10T14:58:14.830062+0000 mgr.gibba043.dnkmem (mgr.34373) 3572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:16 gibba003 bash[32348]: cephadm 2021-03-10T14:58:14.830062+0000 mgr.gibba043.dnkmem (mgr.34373) 3572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:16 gibba043 bash[24019]: cephadm 2021-03-10T14:58:14.830062+0000 mgr.gibba043.dnkmem (mgr.34373) 3572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:17 gibba003 bash[31385]: cluster 2021-03-10T14:58:16.005789+0000 mgr.gibba043.dnkmem (mgr.34373) 3573 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:17 gibba003 bash[32348]: cluster 2021-03-10T14:58:16.005789+0000 mgr.gibba043.dnkmem (mgr.34373) 3573 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:17 gibba043 bash[24019]: cluster 2021-03-10T14:58:16.005789+0000 mgr.gibba043.dnkmem (mgr.34373) 3573 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:19 gibba003 bash[31385]: cluster 2021-03-10T14:58:18.007320+0000 mgr.gibba043.dnkmem (mgr.34373) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:19 gibba003 bash[32348]: cluster 2021-03-10T14:58:18.007320+0000 mgr.gibba043.dnkmem (mgr.34373) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:19 gibba043 bash[24019]: cluster 2021-03-10T14:58:18.007320+0000 mgr.gibba043.dnkmem (mgr.34373) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:21 gibba003 bash[32348]: cluster 2021-03-10T14:58:20.007940+0000 mgr.gibba043.dnkmem (mgr.34373) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:21 gibba003 bash[31385]: cluster 2021-03-10T14:58:20.007940+0000 mgr.gibba043.dnkmem (mgr.34373) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:21 gibba043 bash[24019]: cluster 2021-03-10T14:58:20.007940+0000 mgr.gibba043.dnkmem (mgr.34373) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:23 gibba003 bash[31385]: cluster 2021-03-10T14:58:22.009232+0000 mgr.gibba043.dnkmem (mgr.34373) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:23 gibba003 bash[32348]: cluster 2021-03-10T14:58:22.009232+0000 mgr.gibba043.dnkmem (mgr.34373) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:23 gibba043 bash[24019]: cluster 2021-03-10T14:58:22.009232+0000 mgr.gibba043.dnkmem (mgr.34373) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:24 gibba003 bash[31385]: cluster 2021-03-10T14:58:24.010787+0000 mgr.gibba043.dnkmem (mgr.34373) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:24 gibba003 bash[32348]: cluster 2021-03-10T14:58:24.010787+0000 mgr.gibba043.dnkmem (mgr.34373) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:24 gibba043 bash[24019]: cluster 2021-03-10T14:58:24.010787+0000 mgr.gibba043.dnkmem (mgr.34373) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:27 gibba003 bash[31385]: cluster 2021-03-10T14:58:26.012354+0000 mgr.gibba043.dnkmem (mgr.34373) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:27.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:27 gibba003 bash[32348]: cluster 2021-03-10T14:58:26.012354+0000 mgr.gibba043.dnkmem (mgr.34373) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:27 gibba043 bash[24019]: cluster 2021-03-10T14:58:26.012354+0000 mgr.gibba043.dnkmem (mgr.34373) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:29 gibba003 bash[31385]: cluster 2021-03-10T14:58:28.013829+0000 mgr.gibba043.dnkmem (mgr.34373) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:29 gibba003 bash[32348]: cluster 2021-03-10T14:58:28.013829+0000 mgr.gibba043.dnkmem (mgr.34373) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:29 gibba043 bash[24019]: cluster 2021-03-10T14:58:28.013829+0000 mgr.gibba043.dnkmem (mgr.34373) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:31 gibba003 bash[31385]: cephadm 2021-03-10T14:58:29.844444+0000 mgr.gibba043.dnkmem (mgr.34373) 3580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:31 gibba003 bash[31385]: cluster 2021-03-10T14:58:30.014356+0000 mgr.gibba043.dnkmem (mgr.34373) 3581 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:31 gibba003 bash[32348]: cephadm 2021-03-10T14:58:29.844444+0000 mgr.gibba043.dnkmem (mgr.34373) 3580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:31 gibba003 bash[32348]: cluster 2021-03-10T14:58:30.014356+0000 mgr.gibba043.dnkmem (mgr.34373) 3581 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:31 gibba043 bash[24019]: cephadm 2021-03-10T14:58:29.844444+0000 mgr.gibba043.dnkmem (mgr.34373) 3580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:31 gibba043 bash[24019]: cluster 2021-03-10T14:58:30.014356+0000 mgr.gibba043.dnkmem (mgr.34373) 3581 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:33 gibba003 bash[31385]: cluster 2021-03-10T14:58:32.015789+0000 mgr.gibba043.dnkmem (mgr.34373) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:33 gibba003 bash[32348]: cluster 2021-03-10T14:58:32.015789+0000 mgr.gibba043.dnkmem (mgr.34373) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:33 gibba043 bash[24019]: cluster 2021-03-10T14:58:32.015789+0000 mgr.gibba043.dnkmem (mgr.34373) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:34 gibba003 bash[31385]: cluster 2021-03-10T14:58:34.017410+0000 mgr.gibba043.dnkmem (mgr.34373) 3583 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:34 gibba003 bash[32348]: cluster 2021-03-10T14:58:34.017410+0000 mgr.gibba043.dnkmem (mgr.34373) 3583 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:34 gibba043 bash[24019]: cluster 2021-03-10T14:58:34.017410+0000 mgr.gibba043.dnkmem (mgr.34373) 3583 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.314 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:58:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:37 gibba003 bash[31385]: cluster 2021-03-10T14:58:36.018863+0000 mgr.gibba043.dnkmem (mgr.34373) 3584 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:37 gibba003 bash[32348]: cluster 2021-03-10T14:58:36.018863+0000 mgr.gibba043.dnkmem (mgr.34373) 3584 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:37 gibba043 bash[24019]: cluster 2021-03-10T14:58:36.018863+0000 mgr.gibba043.dnkmem (mgr.34373) 3584 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.559 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:58:37.560 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (66m) 117s ago 72m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:58:37.560 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (72m) 52s ago 72m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:58:37.560 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (67m) 52s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:58:37.560 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (67m) 52s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:58:37.560 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (66m) 117s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:58:37.561 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (66m) 117s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:58:37.561 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (66m) 52s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:58:37.561 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (66m) 117s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:58:37.561 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (72m) 117s ago 72m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:58:37.561 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (72m) 52s ago 72m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:58:37.562 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (65m) 117s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:58:37.562 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (64m) 117s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:58:37.562 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (64m) 117s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:58:37.563 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (64m) 117s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:58:37.563 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (63m) 52s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:58:37.563 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (63m) 52s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:58:37.563 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (62m) 52s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:58:37.563 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (62m) 52s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:58:37.564 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (71m) 52s ago 72m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:58:37.564 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 117s ago 70m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:58:37.808 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:58:37.808 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:58:37.809 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:37.809 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:58:37.809 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:58:37.809 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:37.810 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:58:37.810 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:58:37.810 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:58:37.810 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:58:37.810 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:58:37.811 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:58:37.811 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:58:37.811 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:58:37.811 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:58:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:38 gibba003 bash[32348]: audit 2021-03-10T14:58:37.302567+0000 mgr.gibba043.dnkmem (mgr.34373) 3585 : audit [DBG] from='client.56452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:38 gibba003 bash[32348]: audit 2021-03-10T14:58:37.525818+0000 mgr.gibba043.dnkmem (mgr.34373) 3586 : audit [DBG] from='client.46470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:38 gibba003 bash[32348]: audit 2021-03-10T14:58:37.807116+0000 mon.c (mon.1) 956 : audit [DBG] from='client.? 172.21.2.103:0/210703283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:38 gibba003 bash[31385]: audit 2021-03-10T14:58:37.302567+0000 mgr.gibba043.dnkmem (mgr.34373) 3585 : audit [DBG] from='client.56452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:38 gibba003 bash[31385]: audit 2021-03-10T14:58:37.525818+0000 mgr.gibba043.dnkmem (mgr.34373) 3586 : audit [DBG] from='client.46470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:38 gibba003 bash[31385]: audit 2021-03-10T14:58:37.807116+0000 mon.c (mon.1) 956 : audit [DBG] from='client.? 172.21.2.103:0/210703283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:38 gibba043 bash[24019]: audit 2021-03-10T14:58:37.302567+0000 mgr.gibba043.dnkmem (mgr.34373) 3585 : audit [DBG] from='client.56452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:38 gibba043 bash[24019]: audit 2021-03-10T14:58:37.525818+0000 mgr.gibba043.dnkmem (mgr.34373) 3586 : audit [DBG] from='client.46470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:38 gibba043 bash[24019]: audit 2021-03-10T14:58:37.807116+0000 mon.c (mon.1) 956 : audit [DBG] from='client.? 172.21.2.103:0/210703283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:39 gibba003 bash[31385]: cluster 2021-03-10T14:58:38.020380+0000 mgr.gibba043.dnkmem (mgr.34373) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:39 gibba003 bash[32348]: cluster 2021-03-10T14:58:38.020380+0000 mgr.gibba043.dnkmem (mgr.34373) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:39 gibba043 bash[24019]: cluster 2021-03-10T14:58:38.020380+0000 mgr.gibba043.dnkmem (mgr.34373) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:41 gibba003 bash[32348]: cluster 2021-03-10T14:58:40.020931+0000 mgr.gibba043.dnkmem (mgr.34373) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:41 gibba003 bash[31385]: cluster 2021-03-10T14:58:40.020931+0000 mgr.gibba043.dnkmem (mgr.34373) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:41 gibba043 bash[24019]: cluster 2021-03-10T14:58:40.020931+0000 mgr.gibba043.dnkmem (mgr.34373) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:43 gibba003 bash[31385]: cluster 2021-03-10T14:58:42.022333+0000 mgr.gibba043.dnkmem (mgr.34373) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:43 gibba003 bash[32348]: cluster 2021-03-10T14:58:42.022333+0000 mgr.gibba043.dnkmem (mgr.34373) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:43 gibba043 bash[24019]: cluster 2021-03-10T14:58:42.022333+0000 mgr.gibba043.dnkmem (mgr.34373) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:44 gibba003 bash[31385]: cluster 2021-03-10T14:58:44.023916+0000 mgr.gibba043.dnkmem (mgr.34373) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:44 gibba003 bash[32348]: cluster 2021-03-10T14:58:44.023916+0000 mgr.gibba043.dnkmem (mgr.34373) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:45.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:44 gibba043 bash[24019]: cluster 2021-03-10T14:58:44.023916+0000 mgr.gibba043.dnkmem (mgr.34373) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:46.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:44.857246+0000 mgr.gibba043.dnkmem (mgr.34373) 3591 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:58:46.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:44.858793+0000 mgr.gibba043.dnkmem (mgr.34373) 3592 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:58:46.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.113492+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:58:46.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.115416+0000 mgr.gibba043.dnkmem (mgr.34373) 3593 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:46.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.117446+0000 mon.c (mon.1) 957 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:46.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.117497+0000 mgr.gibba043.dnkmem (mgr.34373) 3594 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.119067+0000 mgr.gibba043.dnkmem (mgr.34373) 3595 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.119105+0000 mgr.gibba043.dnkmem (mgr.34373) 3596 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.119123+0000 mon.c (mon.1) 958 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.120680+0000 mgr.gibba043.dnkmem (mgr.34373) 3597 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:46.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.120714+0000 mon.c (mon.1) 959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.120717+0000 mgr.gibba043.dnkmem (mgr.34373) 3598 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:46.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.122121+0000 mgr.gibba043.dnkmem (mgr.34373) 3599 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:46.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.122286+0000 mon.c (mon.1) 960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.123601+0000 mgr.gibba043.dnkmem (mgr.34373) 3600 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:46.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.123652+0000 mgr.gibba043.dnkmem (mgr.34373) 3601 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:46.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.124915+0000 mgr.gibba043.dnkmem (mgr.34373) 3602 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:46.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.125253+0000 mgr.gibba043.dnkmem (mgr.34373) 3603 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:46.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.125308+0000 mon.c (mon.1) 961 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.126237+0000 mgr.gibba043.dnkmem (mgr.34373) 3604 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:46.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.126278+0000 mgr.gibba043.dnkmem (mgr.34373) 3605 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:46.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: cephadm 2021-03-10T14:58:45.126389+0000 mgr.gibba043.dnkmem (mgr.34373) 3606 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:46.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[31385]: audit 2021-03-10T14:58:45.126718+0000 mon.c (mon.1) 962 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:44.857246+0000 mgr.gibba043.dnkmem (mgr.34373) 3591 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:58:46.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:44.858793+0000 mgr.gibba043.dnkmem (mgr.34373) 3592 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:58:46.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.113492+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:58:46.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.115416+0000 mgr.gibba043.dnkmem (mgr.34373) 3593 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.117446+0000 mon.c (mon.1) 957 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.117497+0000 mgr.gibba043.dnkmem (mgr.34373) 3594 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.119067+0000 mgr.gibba043.dnkmem (mgr.34373) 3595 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:46.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.119105+0000 mgr.gibba043.dnkmem (mgr.34373) 3596 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.119123+0000 mon.c (mon.1) 958 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.120680+0000 mgr.gibba043.dnkmem (mgr.34373) 3597 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.120714+0000 mon.c (mon.1) 959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.120717+0000 mgr.gibba043.dnkmem (mgr.34373) 3598 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:46.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.122121+0000 mgr.gibba043.dnkmem (mgr.34373) 3599 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.122286+0000 mon.c (mon.1) 960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.123601+0000 mgr.gibba043.dnkmem (mgr.34373) 3600 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.123652+0000 mgr.gibba043.dnkmem (mgr.34373) 3601 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.124915+0000 mgr.gibba043.dnkmem (mgr.34373) 3602 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:46.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.125253+0000 mgr.gibba043.dnkmem (mgr.34373) 3603 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:46.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.125308+0000 mon.c (mon.1) 961 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.126237+0000 mgr.gibba043.dnkmem (mgr.34373) 3604 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:46.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.126278+0000 mgr.gibba043.dnkmem (mgr.34373) 3605 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:46.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: cephadm 2021-03-10T14:58:45.126389+0000 mgr.gibba043.dnkmem (mgr.34373) 3606 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:46.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:46 gibba003 bash[32348]: audit 2021-03-10T14:58:45.126718+0000 mon.c (mon.1) 962 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:44.857246+0000 mgr.gibba043.dnkmem (mgr.34373) 3591 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:58:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:44.858793+0000 mgr.gibba043.dnkmem (mgr.34373) 3592 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:58:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.113492+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:58:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.115416+0000 mgr.gibba043.dnkmem (mgr.34373) 3593 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:46.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.117446+0000 mon.c (mon.1) 957 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:46.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.117497+0000 mgr.gibba043.dnkmem (mgr.34373) 3594 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:46.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.119067+0000 mgr.gibba043.dnkmem (mgr.34373) 3595 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:46.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.119105+0000 mgr.gibba043.dnkmem (mgr.34373) 3596 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:46.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.119123+0000 mon.c (mon.1) 958 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.120680+0000 mgr.gibba043.dnkmem (mgr.34373) 3597 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:46.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.120714+0000 mon.c (mon.1) 959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.120717+0000 mgr.gibba043.dnkmem (mgr.34373) 3598 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:46.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.122121+0000 mgr.gibba043.dnkmem (mgr.34373) 3599 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:46.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.122286+0000 mon.c (mon.1) 960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.123601+0000 mgr.gibba043.dnkmem (mgr.34373) 3600 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:46.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.123652+0000 mgr.gibba043.dnkmem (mgr.34373) 3601 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:46.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.124915+0000 mgr.gibba043.dnkmem (mgr.34373) 3602 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:46.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.125253+0000 mgr.gibba043.dnkmem (mgr.34373) 3603 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:46.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.125308+0000 mon.c (mon.1) 961 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:46.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.126237+0000 mgr.gibba043.dnkmem (mgr.34373) 3604 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:46.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.126278+0000 mgr.gibba043.dnkmem (mgr.34373) 3605 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:46.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: cephadm 2021-03-10T14:58:45.126389+0000 mgr.gibba043.dnkmem (mgr.34373) 3606 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:58:46.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:46 gibba043 bash[24019]: audit 2021-03-10T14:58:45.126718+0000 mon.c (mon.1) 962 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:47 gibba003 bash[31385]: cluster 2021-03-10T14:58:46.025453+0000 mgr.gibba043.dnkmem (mgr.34373) 3607 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:47 gibba003 bash[32348]: cluster 2021-03-10T14:58:46.025453+0000 mgr.gibba043.dnkmem (mgr.34373) 3607 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:47 gibba043 bash[24019]: cluster 2021-03-10T14:58:46.025453+0000 mgr.gibba043.dnkmem (mgr.34373) 3607 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:49 gibba003 bash[31385]: cluster 2021-03-10T14:58:48.027121+0000 mgr.gibba043.dnkmem (mgr.34373) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:49 gibba003 bash[32348]: cluster 2021-03-10T14:58:48.027121+0000 mgr.gibba043.dnkmem (mgr.34373) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:49 gibba043 bash[24019]: cluster 2021-03-10T14:58:48.027121+0000 mgr.gibba043.dnkmem (mgr.34373) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:51.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:51 gibba003 bash[32348]: cluster 2021-03-10T14:58:50.027645+0000 mgr.gibba043.dnkmem (mgr.34373) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:51 gibba003 bash[31385]: cluster 2021-03-10T14:58:50.027645+0000 mgr.gibba043.dnkmem (mgr.34373) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:51 gibba043 bash[24019]: cluster 2021-03-10T14:58:50.027645+0000 mgr.gibba043.dnkmem (mgr.34373) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:53 gibba003 bash[31385]: cluster 2021-03-10T14:58:52.029037+0000 mgr.gibba043.dnkmem (mgr.34373) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:53 gibba003 bash[32348]: cluster 2021-03-10T14:58:52.029037+0000 mgr.gibba043.dnkmem (mgr.34373) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:53 gibba043 bash[24019]: cluster 2021-03-10T14:58:52.029037+0000 mgr.gibba043.dnkmem (mgr.34373) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:54 gibba003 bash[31385]: cluster 2021-03-10T14:58:54.030660+0000 mgr.gibba043.dnkmem (mgr.34373) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:54 gibba003 bash[32348]: cluster 2021-03-10T14:58:54.030660+0000 mgr.gibba043.dnkmem (mgr.34373) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:54 gibba043 bash[24019]: cluster 2021-03-10T14:58:54.030660+0000 mgr.gibba043.dnkmem (mgr.34373) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:57 gibba003 bash[31385]: cluster 2021-03-10T14:58:56.032461+0000 mgr.gibba043.dnkmem (mgr.34373) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:57 gibba003 bash[32348]: cluster 2021-03-10T14:58:56.032461+0000 mgr.gibba043.dnkmem (mgr.34373) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:57 gibba043 bash[24019]: cluster 2021-03-10T14:58:56.032461+0000 mgr.gibba043.dnkmem (mgr.34373) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:58:59 gibba003 bash[31385]: cluster 2021-03-10T14:58:58.033808+0000 mgr.gibba043.dnkmem (mgr.34373) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:58:59 gibba003 bash[32348]: cluster 2021-03-10T14:58:58.033808+0000 mgr.gibba043.dnkmem (mgr.34373) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:58:59 gibba043 bash[24019]: cluster 2021-03-10T14:58:58.033808+0000 mgr.gibba043.dnkmem (mgr.34373) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:01 gibba003 bash[31385]: cluster 2021-03-10T14:59:00.034495+0000 mgr.gibba043.dnkmem (mgr.34373) 3614 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:01 gibba003 bash[31385]: cephadm 2021-03-10T14:59:00.137280+0000 mgr.gibba043.dnkmem (mgr.34373) 3615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:01 gibba003 bash[32348]: cluster 2021-03-10T14:59:00.034495+0000 mgr.gibba043.dnkmem (mgr.34373) 3614 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:01 gibba003 bash[32348]: cephadm 2021-03-10T14:59:00.137280+0000 mgr.gibba043.dnkmem (mgr.34373) 3615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:01 gibba043 bash[24019]: cluster 2021-03-10T14:59:00.034495+0000 mgr.gibba043.dnkmem (mgr.34373) 3614 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:01 gibba043 bash[24019]: cephadm 2021-03-10T14:59:00.137280+0000 mgr.gibba043.dnkmem (mgr.34373) 3615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:03 gibba003 bash[31385]: cluster 2021-03-10T14:59:02.036134+0000 mgr.gibba043.dnkmem (mgr.34373) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:03 gibba003 bash[32348]: cluster 2021-03-10T14:59:02.036134+0000 mgr.gibba043.dnkmem (mgr.34373) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:03 gibba043 bash[24019]: cluster 2021-03-10T14:59:02.036134+0000 mgr.gibba043.dnkmem (mgr.34373) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:04 gibba003 bash[31385]: cluster 2021-03-10T14:59:04.037738+0000 mgr.gibba043.dnkmem (mgr.34373) 3617 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:04 gibba003 bash[32348]: cluster 2021-03-10T14:59:04.037738+0000 mgr.gibba043.dnkmem (mgr.34373) 3617 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:05.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:04 gibba043 bash[24019]: cluster 2021-03-10T14:59:04.037738+0000 mgr.gibba043.dnkmem (mgr.34373) 3617 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:07 gibba003 bash[31385]: cluster 2021-03-10T14:59:06.039538+0000 mgr.gibba043.dnkmem (mgr.34373) 3618 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:07 gibba003 bash[32348]: cluster 2021-03-10T14:59:06.039538+0000 mgr.gibba043.dnkmem (mgr.34373) 3618 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:07 gibba043 bash[24019]: cluster 2021-03-10T14:59:06.039538+0000 mgr.gibba043.dnkmem (mgr.34373) 3618 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:08.050 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:59:08.299 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:59:08.299 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (67m) 2m ago 72m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:59:08.299 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (72m) 83s ago 72m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:59:08.299 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (67m) 83s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:59:08.299 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (68m) 83s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:59:08.300 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:59:08.300 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:59:08.300 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (66m) 83s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:59:08.300 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (66m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:59:08.300 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (72m) 2m ago 72m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:59:08.301 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (72m) 83s ago 72m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:59:08.301 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:59:08.301 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:59:08.301 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:59:08.301 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:59:08.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (64m) 83s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:59:08.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (63m) 83s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:59:08.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (63m) 83s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:59:08.302 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (62m) 83s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:59:08.303 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (72m) 83s ago 73m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:59:08.303 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 70m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:59:08.549 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:59:08.549 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:59:08.549 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:08.550 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:59:08.550 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:59:08.550 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:08.550 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:59:08.550 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:59:08.551 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:59:08.551 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:59:08.551 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:59:08.551 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:59:08.552 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:59:08.552 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:59:08.552 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:59:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[31385]: audit 2021-03-10T14:59:08.038051+0000 mgr.gibba043.dnkmem (mgr.34373) 3619 : audit [DBG] from='client.56470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[31385]: cluster 2021-03-10T14:59:08.040849+0000 mgr.gibba043.dnkmem (mgr.34373) 3620 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[31385]: audit 2021-03-10T14:59:08.266875+0000 mgr.gibba043.dnkmem (mgr.34373) 3621 : audit [DBG] from='client.46488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[31385]: audit 2021-03-10T14:59:08.547705+0000 mon.a (mon.0) 1020 : audit [DBG] from='client.? 172.21.2.103:0/2814317477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[32348]: audit 2021-03-10T14:59:08.038051+0000 mgr.gibba043.dnkmem (mgr.34373) 3619 : audit [DBG] from='client.56470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[32348]: cluster 2021-03-10T14:59:08.040849+0000 mgr.gibba043.dnkmem (mgr.34373) 3620 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[32348]: audit 2021-03-10T14:59:08.266875+0000 mgr.gibba043.dnkmem (mgr.34373) 3621 : audit [DBG] from='client.46488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:09 gibba003 bash[32348]: audit 2021-03-10T14:59:08.547705+0000 mon.a (mon.0) 1020 : audit [DBG] from='client.? 172.21.2.103:0/2814317477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:09 gibba043 bash[24019]: audit 2021-03-10T14:59:08.038051+0000 mgr.gibba043.dnkmem (mgr.34373) 3619 : audit [DBG] from='client.56470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:09 gibba043 bash[24019]: cluster 2021-03-10T14:59:08.040849+0000 mgr.gibba043.dnkmem (mgr.34373) 3620 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:09 gibba043 bash[24019]: audit 2021-03-10T14:59:08.266875+0000 mgr.gibba043.dnkmem (mgr.34373) 3621 : audit [DBG] from='client.46488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:09 gibba043 bash[24019]: audit 2021-03-10T14:59:08.547705+0000 mon.a (mon.0) 1020 : audit [DBG] from='client.? 172.21.2.103:0/2814317477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:11 gibba003 bash[32348]: cluster 2021-03-10T14:59:10.041531+0000 mgr.gibba043.dnkmem (mgr.34373) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:11 gibba003 bash[31385]: cluster 2021-03-10T14:59:10.041531+0000 mgr.gibba043.dnkmem (mgr.34373) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:11 gibba043 bash[24019]: cluster 2021-03-10T14:59:10.041531+0000 mgr.gibba043.dnkmem (mgr.34373) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:13 gibba003 bash[31385]: cluster 2021-03-10T14:59:12.043080+0000 mgr.gibba043.dnkmem (mgr.34373) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:13 gibba003 bash[32348]: cluster 2021-03-10T14:59:12.043080+0000 mgr.gibba043.dnkmem (mgr.34373) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:13 gibba043 bash[24019]: cluster 2021-03-10T14:59:12.043080+0000 mgr.gibba043.dnkmem (mgr.34373) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.136392+0000 mon.c (mon.1) 963 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.136673+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.220400+0000 mon.c (mon.1) 964 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.221474+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.246834+0000 mon.c (mon.1) 965 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:59:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.247825+0000 mon.c (mon.1) 966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.248266+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:59:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.248770+0000 mon.c (mon.1) 967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.250025+0000 mon.c (mon.1) 968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:59:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.250111+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.251616+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[31385]: audit 2021-03-10T14:59:13.252480+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:59:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.136392+0000 mon.c (mon.1) 963 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.136673+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.220400+0000 mon.c (mon.1) 964 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.221474+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.246834+0000 mon.c (mon.1) 965 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:59:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.247825+0000 mon.c (mon.1) 966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.248266+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:59:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.248770+0000 mon.c (mon.1) 967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.250025+0000 mon.c (mon.1) 968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:59:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.250111+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.251616+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:14 gibba003 bash[32348]: audit 2021-03-10T14:59:13.252480+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:59:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.136392+0000 mon.c (mon.1) 963 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.136673+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.220400+0000 mon.c (mon.1) 964 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.221474+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.246834+0000 mon.c (mon.1) 965 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:59:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.247825+0000 mon.c (mon.1) 966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.248266+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:59:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.248770+0000 mon.c (mon.1) 967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.250025+0000 mon.c (mon.1) 968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:59:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.250111+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.251616+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:59:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:14 gibba043 bash[24019]: audit 2021-03-10T14:59:13.252480+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:59:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:15 gibba003 bash[31385]: cluster 2021-03-10T14:59:14.044494+0000 mgr.gibba043.dnkmem (mgr.34373) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:15 gibba003 bash[32348]: cluster 2021-03-10T14:59:14.044494+0000 mgr.gibba043.dnkmem (mgr.34373) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:15 gibba043 bash[24019]: cluster 2021-03-10T14:59:14.044494+0000 mgr.gibba043.dnkmem (mgr.34373) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:16 gibba003 bash[31385]: cephadm 2021-03-10T14:59:15.151899+0000 mgr.gibba043.dnkmem (mgr.34373) 3625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:16 gibba003 bash[32348]: cephadm 2021-03-10T14:59:15.151899+0000 mgr.gibba043.dnkmem (mgr.34373) 3625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:16 gibba043 bash[24019]: cephadm 2021-03-10T14:59:15.151899+0000 mgr.gibba043.dnkmem (mgr.34373) 3625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:17 gibba003 bash[31385]: cluster 2021-03-10T14:59:16.046177+0000 mgr.gibba043.dnkmem (mgr.34373) 3626 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:17 gibba003 bash[32348]: cluster 2021-03-10T14:59:16.046177+0000 mgr.gibba043.dnkmem (mgr.34373) 3626 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:17 gibba043 bash[24019]: cluster 2021-03-10T14:59:16.046177+0000 mgr.gibba043.dnkmem (mgr.34373) 3626 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:19 gibba003 bash[31385]: cluster 2021-03-10T14:59:18.047814+0000 mgr.gibba043.dnkmem (mgr.34373) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:19 gibba003 bash[32348]: cluster 2021-03-10T14:59:18.047814+0000 mgr.gibba043.dnkmem (mgr.34373) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:19 gibba043 bash[24019]: cluster 2021-03-10T14:59:18.047814+0000 mgr.gibba043.dnkmem (mgr.34373) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:21 gibba003 bash[31385]: cluster 2021-03-10T14:59:20.048571+0000 mgr.gibba043.dnkmem (mgr.34373) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:21 gibba003 bash[32348]: cluster 2021-03-10T14:59:20.048571+0000 mgr.gibba043.dnkmem (mgr.34373) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:21 gibba043 bash[24019]: cluster 2021-03-10T14:59:20.048571+0000 mgr.gibba043.dnkmem (mgr.34373) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:23 gibba003 bash[31385]: cluster 2021-03-10T14:59:22.050086+0000 mgr.gibba043.dnkmem (mgr.34373) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:23 gibba003 bash[32348]: cluster 2021-03-10T14:59:22.050086+0000 mgr.gibba043.dnkmem (mgr.34373) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:23 gibba043 bash[24019]: cluster 2021-03-10T14:59:22.050086+0000 mgr.gibba043.dnkmem (mgr.34373) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:24 gibba003 bash[31385]: cluster 2021-03-10T14:59:24.051705+0000 mgr.gibba043.dnkmem (mgr.34373) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:24 gibba003 bash[32348]: cluster 2021-03-10T14:59:24.051705+0000 mgr.gibba043.dnkmem (mgr.34373) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:24 gibba043 bash[24019]: cluster 2021-03-10T14:59:24.051705+0000 mgr.gibba043.dnkmem (mgr.34373) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:27 gibba003 bash[31385]: cluster 2021-03-10T14:59:26.053243+0000 mgr.gibba043.dnkmem (mgr.34373) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:27 gibba003 bash[32348]: cluster 2021-03-10T14:59:26.053243+0000 mgr.gibba043.dnkmem (mgr.34373) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:27 gibba043 bash[24019]: cluster 2021-03-10T14:59:26.053243+0000 mgr.gibba043.dnkmem (mgr.34373) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:29 gibba003 bash[31385]: cluster 2021-03-10T14:59:28.054858+0000 mgr.gibba043.dnkmem (mgr.34373) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:29 gibba003 bash[32348]: cluster 2021-03-10T14:59:28.054858+0000 mgr.gibba043.dnkmem (mgr.34373) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:29 gibba043 bash[24019]: cluster 2021-03-10T14:59:28.054858+0000 mgr.gibba043.dnkmem (mgr.34373) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:31 gibba003 bash[31385]: cluster 2021-03-10T14:59:30.056179+0000 mgr.gibba043.dnkmem (mgr.34373) 3633 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:31 gibba003 bash[31385]: cephadm 2021-03-10T14:59:30.163940+0000 mgr.gibba043.dnkmem (mgr.34373) 3634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:31 gibba003 bash[32348]: cluster 2021-03-10T14:59:30.056179+0000 mgr.gibba043.dnkmem (mgr.34373) 3633 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:31 gibba003 bash[32348]: cephadm 2021-03-10T14:59:30.163940+0000 mgr.gibba043.dnkmem (mgr.34373) 3634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:31 gibba043 bash[24019]: cluster 2021-03-10T14:59:30.056179+0000 mgr.gibba043.dnkmem (mgr.34373) 3633 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:31 gibba043 bash[24019]: cephadm 2021-03-10T14:59:30.163940+0000 mgr.gibba043.dnkmem (mgr.34373) 3634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:33 gibba003 bash[31385]: cluster 2021-03-10T14:59:32.057738+0000 mgr.gibba043.dnkmem (mgr.34373) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:33 gibba003 bash[32348]: cluster 2021-03-10T14:59:32.057738+0000 mgr.gibba043.dnkmem (mgr.34373) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:33 gibba043 bash[24019]: cluster 2021-03-10T14:59:32.057738+0000 mgr.gibba043.dnkmem (mgr.34373) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:34 gibba003 bash[31385]: cluster 2021-03-10T14:59:34.059446+0000 mgr.gibba043.dnkmem (mgr.34373) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:34 gibba003 bash[32348]: cluster 2021-03-10T14:59:34.059446+0000 mgr.gibba043.dnkmem (mgr.34373) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:34 gibba043 bash[24019]: cluster 2021-03-10T14:59:34.059446+0000 mgr.gibba043.dnkmem (mgr.34373) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:37 gibba003 bash[31385]: cluster 2021-03-10T14:59:36.061256+0000 mgr.gibba043.dnkmem (mgr.34373) 3637 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:37 gibba003 bash[32348]: cluster 2021-03-10T14:59:36.061256+0000 mgr.gibba043.dnkmem (mgr.34373) 3637 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:37 gibba043 bash[24019]: cluster 2021-03-10T14:59:36.061256+0000 mgr.gibba043.dnkmem (mgr.34373) 3637 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:38.793 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T14:59:39.021 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:59:39.022 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (68m) 2m ago 73m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T14:59:39.022 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (73m) 114s ago 73m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T14:59:39.022 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (68m) 114s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T14:59:39.022 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (68m) 114s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T14:59:39.023 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T14:59:39.023 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T14:59:39.023 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (67m) 114s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T14:59:39.023 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T14:59:39.024 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (73m) 2m ago 73m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T14:59:39.024 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (73m) 114s ago 73m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T14:59:39.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (66m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T14:59:39.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T14:59:39.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T14:59:39.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T14:59:39.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (64m) 114s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T14:59:39.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (64m) 114s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T14:59:39.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (63m) 114s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T14:59:39.026 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (63m) 114s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T14:59:39.026 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (72m) 114s ago 73m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T14:59:39.026 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 71m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:59:39.269 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T14:59:39.269 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T14:59:39.269 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:39.269 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:59:39.270 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T14:59:39.270 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:39.270 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:59:39.270 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T14:59:39.271 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:59:39.271 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T14:59:39.271 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T14:59:39.271 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T14:59:39.271 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:59:39.272 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T14:59:39.272 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T14:59:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:39 gibba003 bash[31385]: cluster 2021-03-10T14:59:38.062697+0000 mgr.gibba043.dnkmem (mgr.34373) 3638 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:39 gibba003 bash[32348]: cluster 2021-03-10T14:59:38.062697+0000 mgr.gibba043.dnkmem (mgr.34373) 3638 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:39 gibba043 bash[24019]: cluster 2021-03-10T14:59:38.062697+0000 mgr.gibba043.dnkmem (mgr.34373) 3638 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:40 gibba003 bash[31385]: audit 2021-03-10T14:59:38.781320+0000 mgr.gibba043.dnkmem (mgr.34373) 3639 : audit [DBG] from='client.46500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:40 gibba003 bash[31385]: audit 2021-03-10T14:59:39.006620+0000 mgr.gibba043.dnkmem (mgr.34373) 3640 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:40 gibba003 bash[31385]: audit 2021-03-10T14:59:39.267497+0000 mon.c (mon.1) 969 : audit [DBG] from='client.? 172.21.2.103:0/1370356379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:40 gibba003 bash[32348]: audit 2021-03-10T14:59:38.781320+0000 mgr.gibba043.dnkmem (mgr.34373) 3639 : audit [DBG] from='client.46500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:40.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:40 gibba003 bash[32348]: audit 2021-03-10T14:59:39.006620+0000 mgr.gibba043.dnkmem (mgr.34373) 3640 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:40.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:40 gibba003 bash[32348]: audit 2021-03-10T14:59:39.267497+0000 mon.c (mon.1) 969 : audit [DBG] from='client.? 172.21.2.103:0/1370356379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:40 gibba043 bash[24019]: audit 2021-03-10T14:59:38.781320+0000 mgr.gibba043.dnkmem (mgr.34373) 3639 : audit [DBG] from='client.46500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:40 gibba043 bash[24019]: audit 2021-03-10T14:59:39.006620+0000 mgr.gibba043.dnkmem (mgr.34373) 3640 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:40 gibba043 bash[24019]: audit 2021-03-10T14:59:39.267497+0000 mon.c (mon.1) 969 : audit [DBG] from='client.? 172.21.2.103:0/1370356379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:41 gibba003 bash[31385]: cluster 2021-03-10T14:59:40.064277+0000 mgr.gibba043.dnkmem (mgr.34373) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:41 gibba003 bash[32348]: cluster 2021-03-10T14:59:40.064277+0000 mgr.gibba043.dnkmem (mgr.34373) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:41 gibba043 bash[24019]: cluster 2021-03-10T14:59:40.064277+0000 mgr.gibba043.dnkmem (mgr.34373) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:43 gibba003 bash[31385]: cluster 2021-03-10T14:59:42.065890+0000 mgr.gibba043.dnkmem (mgr.34373) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:43 gibba003 bash[32348]: cluster 2021-03-10T14:59:42.065890+0000 mgr.gibba043.dnkmem (mgr.34373) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:43 gibba043 bash[24019]: cluster 2021-03-10T14:59:42.065890+0000 mgr.gibba043.dnkmem (mgr.34373) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:44 gibba003 bash[31385]: cluster 2021-03-10T14:59:44.067507+0000 mgr.gibba043.dnkmem (mgr.34373) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:44 gibba003 bash[32348]: cluster 2021-03-10T14:59:44.067507+0000 mgr.gibba043.dnkmem (mgr.34373) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:45.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:44 gibba043 bash[24019]: cluster 2021-03-10T14:59:44.067507+0000 mgr.gibba043.dnkmem (mgr.34373) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.180778+0000 mgr.gibba043.dnkmem (mgr.34373) 3644 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:59:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.182341+0000 mgr.gibba043.dnkmem (mgr.34373) 3645 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:59:46.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.402207+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:59:46.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.404192+0000 mgr.gibba043.dnkmem (mgr.34373) 3646 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:46.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.406266+0000 mon.c (mon.1) 970 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:46.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.407399+0000 mgr.gibba043.dnkmem (mgr.34373) 3647 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:46.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.409128+0000 mon.c (mon.1) 971 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.410042+0000 mgr.gibba043.dnkmem (mgr.34373) 3648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:46.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.410083+0000 mgr.gibba043.dnkmem (mgr.34373) 3649 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:46.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.411726+0000 mon.c (mon.1) 972 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.412499+0000 mgr.gibba043.dnkmem (mgr.34373) 3650 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:46.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.412546+0000 mgr.gibba043.dnkmem (mgr.34373) 3651 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:46.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.414127+0000 mon.c (mon.1) 973 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.414943+0000 mgr.gibba043.dnkmem (mgr.34373) 3652 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:46.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.418735+0000 mgr.gibba043.dnkmem (mgr.34373) 3653 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:46.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.418784+0000 mgr.gibba043.dnkmem (mgr.34373) 3654 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:46.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.420575+0000 mon.c (mon.1) 974 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.421579+0000 mgr.gibba043.dnkmem (mgr.34373) 3655 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:46.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.422035+0000 mgr.gibba043.dnkmem (mgr.34373) 3656 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:46.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: audit 2021-03-10T14:59:45.423630+0000 mon.c (mon.1) 975 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.424589+0000 mgr.gibba043.dnkmem (mgr.34373) 3657 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:46.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.180778+0000 mgr.gibba043.dnkmem (mgr.34373) 3644 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:59:46.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.182341+0000 mgr.gibba043.dnkmem (mgr.34373) 3645 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:59:46.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.402207+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:59:46.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.404192+0000 mgr.gibba043.dnkmem (mgr.34373) 3646 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:46.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.406266+0000 mon.c (mon.1) 970 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:46.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.407399+0000 mgr.gibba043.dnkmem (mgr.34373) 3647 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:46.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.409128+0000 mon.c (mon.1) 971 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.410042+0000 mgr.gibba043.dnkmem (mgr.34373) 3648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:46.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.410083+0000 mgr.gibba043.dnkmem (mgr.34373) 3649 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:46.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.411726+0000 mon.c (mon.1) 972 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.412499+0000 mgr.gibba043.dnkmem (mgr.34373) 3650 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:46.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.412546+0000 mgr.gibba043.dnkmem (mgr.34373) 3651 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:46.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.414127+0000 mon.c (mon.1) 973 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.414943+0000 mgr.gibba043.dnkmem (mgr.34373) 3652 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:46.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.418735+0000 mgr.gibba043.dnkmem (mgr.34373) 3653 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:46.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.418784+0000 mgr.gibba043.dnkmem (mgr.34373) 3654 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:46.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.420575+0000 mon.c (mon.1) 974 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.421579+0000 mgr.gibba043.dnkmem (mgr.34373) 3655 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:46.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.422035+0000 mgr.gibba043.dnkmem (mgr.34373) 3656 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:46.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: audit 2021-03-10T14:59:45.423630+0000 mon.c (mon.1) 975 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.424589+0000 mgr.gibba043.dnkmem (mgr.34373) 3657 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:46.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.424645+0000 mgr.gibba043.dnkmem (mgr.34373) 3658 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:46.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[32348]: cephadm 2021-03-10T14:59:45.424795+0000 mgr.gibba043.dnkmem (mgr.34373) 3659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:46.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.424645+0000 mgr.gibba043.dnkmem (mgr.34373) 3658 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:46.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:46 gibba003 bash[31385]: cephadm 2021-03-10T14:59:45.424795+0000 mgr.gibba043.dnkmem (mgr.34373) 3659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:46.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.180778+0000 mgr.gibba043.dnkmem (mgr.34373) 3644 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T14:59:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.182341+0000 mgr.gibba043.dnkmem (mgr.34373) 3645 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T14:59:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.402207+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T14:59:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.404192+0000 mgr.gibba043.dnkmem (mgr.34373) 3646 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.406266+0000 mon.c (mon.1) 970 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:46.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.407399+0000 mgr.gibba043.dnkmem (mgr.34373) 3647 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:46.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.409128+0000 mon.c (mon.1) 971 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.410042+0000 mgr.gibba043.dnkmem (mgr.34373) 3648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:46.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.410083+0000 mgr.gibba043.dnkmem (mgr.34373) 3649 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:46.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.411726+0000 mon.c (mon.1) 972 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.412499+0000 mgr.gibba043.dnkmem (mgr.34373) 3650 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:46.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.412546+0000 mgr.gibba043.dnkmem (mgr.34373) 3651 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:46.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.414127+0000 mon.c (mon.1) 973 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.414943+0000 mgr.gibba043.dnkmem (mgr.34373) 3652 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:46.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.418735+0000 mgr.gibba043.dnkmem (mgr.34373) 3653 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:46.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.418784+0000 mgr.gibba043.dnkmem (mgr.34373) 3654 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:46.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.420575+0000 mon.c (mon.1) 974 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.421579+0000 mgr.gibba043.dnkmem (mgr.34373) 3655 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:46.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.422035+0000 mgr.gibba043.dnkmem (mgr.34373) 3656 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:46.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: audit 2021-03-10T14:59:45.423630+0000 mon.c (mon.1) 975 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:46.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.424589+0000 mgr.gibba043.dnkmem (mgr.34373) 3657 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:46.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.424645+0000 mgr.gibba043.dnkmem (mgr.34373) 3658 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:46.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:46 gibba043 bash[24019]: cephadm 2021-03-10T14:59:45.424795+0000 mgr.gibba043.dnkmem (mgr.34373) 3659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T14:59:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:47 gibba003 bash[31385]: cluster 2021-03-10T14:59:46.069307+0000 mgr.gibba043.dnkmem (mgr.34373) 3660 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:47 gibba003 bash[32348]: cluster 2021-03-10T14:59:46.069307+0000 mgr.gibba043.dnkmem (mgr.34373) 3660 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:47 gibba043 bash[24019]: cluster 2021-03-10T14:59:46.069307+0000 mgr.gibba043.dnkmem (mgr.34373) 3660 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:49 gibba003 bash[31385]: cluster 2021-03-10T14:59:48.070689+0000 mgr.gibba043.dnkmem (mgr.34373) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:49 gibba003 bash[32348]: cluster 2021-03-10T14:59:48.070689+0000 mgr.gibba043.dnkmem (mgr.34373) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:49 gibba043 bash[24019]: cluster 2021-03-10T14:59:48.070689+0000 mgr.gibba043.dnkmem (mgr.34373) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:51.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:51 gibba043 bash[24019]: cluster 2021-03-10T14:59:50.071203+0000 mgr.gibba043.dnkmem (mgr.34373) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:51.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:51 gibba003 bash[31385]: cluster 2021-03-10T14:59:50.071203+0000 mgr.gibba043.dnkmem (mgr.34373) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:51.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:51 gibba003 bash[32348]: cluster 2021-03-10T14:59:50.071203+0000 mgr.gibba043.dnkmem (mgr.34373) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:53 gibba043 bash[24019]: cluster 2021-03-10T14:59:52.072708+0000 mgr.gibba043.dnkmem (mgr.34373) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:53 gibba003 bash[31385]: cluster 2021-03-10T14:59:52.072708+0000 mgr.gibba043.dnkmem (mgr.34373) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:53 gibba003 bash[32348]: cluster 2021-03-10T14:59:52.072708+0000 mgr.gibba043.dnkmem (mgr.34373) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:54 gibba003 bash[31385]: cluster 2021-03-10T14:59:54.074325+0000 mgr.gibba043.dnkmem (mgr.34373) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:54 gibba003 bash[32348]: cluster 2021-03-10T14:59:54.074325+0000 mgr.gibba043.dnkmem (mgr.34373) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:54 gibba043 bash[24019]: cluster 2021-03-10T14:59:54.074325+0000 mgr.gibba043.dnkmem (mgr.34373) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:57 gibba003 bash[31385]: cluster 2021-03-10T14:59:56.076233+0000 mgr.gibba043.dnkmem (mgr.34373) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:57 gibba003 bash[32348]: cluster 2021-03-10T14:59:56.076233+0000 mgr.gibba043.dnkmem (mgr.34373) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:57 gibba043 bash[24019]: cluster 2021-03-10T14:59:56.076233+0000 mgr.gibba043.dnkmem (mgr.34373) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 14:59:59 gibba003 bash[31385]: cluster 2021-03-10T14:59:58.077437+0000 mgr.gibba043.dnkmem (mgr.34373) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 14:59:59 gibba003 bash[32348]: cluster 2021-03-10T14:59:58.077437+0000 mgr.gibba043.dnkmem (mgr.34373) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 14:59:59 gibba043 bash[24019]: cluster 2021-03-10T14:59:58.077437+0000 mgr.gibba043.dnkmem (mgr.34373) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:00 gibba003 bash[31385]: debug 2021-03-10T14:59:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:00 gibba003 bash[31385]: cluster 2021-03-10T15:00:00.000436+0000 mon.a (mon.0) 1028 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:00 gibba003 bash[32348]: cluster 2021-03-10T15:00:00.000436+0000 mon.a (mon.0) 1028 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.444 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:00 gibba043 bash[24019]: cluster 2021-03-10T15:00:00.000436+0000 mon.a (mon.0) 1028 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:01 gibba003 bash[31385]: cluster 2021-03-10T15:00:00.078877+0000 mgr.gibba043.dnkmem (mgr.34373) 3667 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:01 gibba003 bash[31385]: cephadm 2021-03-10T15:00:00.440875+0000 mgr.gibba043.dnkmem (mgr.34373) 3668 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:01 gibba003 bash[32348]: cluster 2021-03-10T15:00:00.078877+0000 mgr.gibba043.dnkmem (mgr.34373) 3667 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:01 gibba003 bash[32348]: cephadm 2021-03-10T15:00:00.440875+0000 mgr.gibba043.dnkmem (mgr.34373) 3668 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:01 gibba043 bash[24019]: cluster 2021-03-10T15:00:00.078877+0000 mgr.gibba043.dnkmem (mgr.34373) 3667 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:01 gibba043 bash[24019]: cephadm 2021-03-10T15:00:00.440875+0000 mgr.gibba043.dnkmem (mgr.34373) 3668 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:03 gibba003 bash[31385]: cluster 2021-03-10T15:00:02.080537+0000 mgr.gibba043.dnkmem (mgr.34373) 3669 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:03 gibba003 bash[32348]: cluster 2021-03-10T15:00:02.080537+0000 mgr.gibba043.dnkmem (mgr.34373) 3669 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:03 gibba043 bash[24019]: cluster 2021-03-10T15:00:02.080537+0000 mgr.gibba043.dnkmem (mgr.34373) 3669 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:04 gibba003 bash[31385]: cluster 2021-03-10T15:00:04.082215+0000 mgr.gibba043.dnkmem (mgr.34373) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:04 gibba003 bash[32348]: cluster 2021-03-10T15:00:04.082215+0000 mgr.gibba043.dnkmem (mgr.34373) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:05.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:04 gibba043 bash[24019]: cluster 2021-03-10T15:00:04.082215+0000 mgr.gibba043.dnkmem (mgr.34373) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:07 gibba003 bash[31385]: cluster 2021-03-10T15:00:06.084052+0000 mgr.gibba043.dnkmem (mgr.34373) 3671 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:07 gibba003 bash[32348]: cluster 2021-03-10T15:00:06.084052+0000 mgr.gibba043.dnkmem (mgr.34373) 3671 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:07 gibba043 bash[24019]: cluster 2021-03-10T15:00:06.084052+0000 mgr.gibba043.dnkmem (mgr.34373) 3671 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:09 gibba003 bash[31385]: cluster 2021-03-10T15:00:08.085503+0000 mgr.gibba043.dnkmem (mgr.34373) 3672 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:09 gibba003 bash[32348]: cluster 2021-03-10T15:00:08.085503+0000 mgr.gibba043.dnkmem (mgr.34373) 3672 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.510 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:00:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:09 gibba043 bash[24019]: cluster 2021-03-10T15:00:08.085503+0000 mgr.gibba043.dnkmem (mgr.34373) 3672 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.735 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:00:09.736 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (68m) 3m ago 73m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:00:09.736 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (73m) 2m ago 73m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:00:09.736 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (68m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:00:09.737 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:00:09.737 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:00:09.737 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:00:09.738 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:00:09.738 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (67m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:00:09.739 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (73m) 3m ago 74m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:00:09.739 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (73m) 2m ago 74m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:00:09.739 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:00:09.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:00:09.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:00:09.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:00:09.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:00:09.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:00:09.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:00:09.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (63m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:00:09.742 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (73m) 2m ago 74m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:00:09.742 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 71m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:00:09.983 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:00:09.983 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:00:09.983 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:09.984 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:00:09.984 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:00:09.984 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:09.984 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:00:09.985 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:00:09.985 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:00:09.985 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:00:09.985 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:00:09.985 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:00:09.986 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:00:09.986 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:00:09.986 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:00:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:10 gibba003 bash[31385]: audit 2021-03-10T15:00:09.498944+0000 mgr.gibba043.dnkmem (mgr.34373) 3673 : audit [DBG] from='client.56506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:10 gibba003 bash[31385]: audit 2021-03-10T15:00:09.981266+0000 mon.a (mon.0) 1029 : audit [DBG] from='client.? 172.21.2.103:0/1331931741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:10 gibba003 bash[32348]: audit 2021-03-10T15:00:09.498944+0000 mgr.gibba043.dnkmem (mgr.34373) 3673 : audit [DBG] from='client.56506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:10.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:10 gibba003 bash[32348]: audit 2021-03-10T15:00:09.981266+0000 mon.a (mon.0) 1029 : audit [DBG] from='client.? 172.21.2.103:0/1331931741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:10 gibba043 bash[24019]: audit 2021-03-10T15:00:09.498944+0000 mgr.gibba043.dnkmem (mgr.34373) 3673 : audit [DBG] from='client.56506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:10 gibba043 bash[24019]: audit 2021-03-10T15:00:09.981266+0000 mon.a (mon.0) 1029 : audit [DBG] from='client.? 172.21.2.103:0/1331931741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:11 gibba003 bash[31385]: audit 2021-03-10T15:00:09.720855+0000 mgr.gibba043.dnkmem (mgr.34373) 3674 : audit [DBG] from='client.56512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:11.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:11 gibba003 bash[31385]: cluster 2021-03-10T15:00:10.087218+0000 mgr.gibba043.dnkmem (mgr.34373) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:11 gibba003 bash[32348]: audit 2021-03-10T15:00:09.720855+0000 mgr.gibba043.dnkmem (mgr.34373) 3674 : audit [DBG] from='client.56512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:11.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:11 gibba003 bash[32348]: cluster 2021-03-10T15:00:10.087218+0000 mgr.gibba043.dnkmem (mgr.34373) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:11 gibba043 bash[24019]: audit 2021-03-10T15:00:09.720855+0000 mgr.gibba043.dnkmem (mgr.34373) 3674 : audit [DBG] from='client.56512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:11 gibba043 bash[24019]: cluster 2021-03-10T15:00:10.087218+0000 mgr.gibba043.dnkmem (mgr.34373) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:13 gibba003 bash[31385]: cluster 2021-03-10T15:00:12.088812+0000 mgr.gibba043.dnkmem (mgr.34373) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:13 gibba003 bash[31385]: audit 2021-03-10T15:00:13.139493+0000 mon.c (mon.1) 976 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:13 gibba003 bash[31385]: audit 2021-03-10T15:00:13.140580+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:13 gibba003 bash[32348]: cluster 2021-03-10T15:00:12.088812+0000 mgr.gibba043.dnkmem (mgr.34373) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:13 gibba003 bash[32348]: audit 2021-03-10T15:00:13.139493+0000 mon.c (mon.1) 976 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:13 gibba003 bash[32348]: audit 2021-03-10T15:00:13.140580+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:13 gibba043 bash[24019]: cluster 2021-03-10T15:00:12.088812+0000 mgr.gibba043.dnkmem (mgr.34373) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:13 gibba043 bash[24019]: audit 2021-03-10T15:00:13.139493+0000 mon.c (mon.1) 976 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:13 gibba043 bash[24019]: audit 2021-03-10T15:00:13.140580+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.227749+0000 mon.c (mon.1) 977 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.228270+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.255172+0000 mon.c (mon.1) 978 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:00:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.255601+0000 mon.c (mon.1) 979 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.256068+0000 mon.c (mon.1) 980 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.256127+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:00:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.256506+0000 mon.c (mon.1) 981 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:00:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.256930+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.257752+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[31385]: audit 2021-03-10T15:00:13.258377+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:00:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.227749+0000 mon.c (mon.1) 977 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.228270+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.255172+0000 mon.c (mon.1) 978 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:00:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.255601+0000 mon.c (mon.1) 979 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.256068+0000 mon.c (mon.1) 980 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.256127+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:00:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.256506+0000 mon.c (mon.1) 981 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:00:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.256930+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.257752+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:14 gibba003 bash[32348]: audit 2021-03-10T15:00:13.258377+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:00:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.227749+0000 mon.c (mon.1) 977 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.228270+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.255172+0000 mon.c (mon.1) 978 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:00:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.255601+0000 mon.c (mon.1) 979 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.256068+0000 mon.c (mon.1) 980 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.256127+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:00:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.256506+0000 mon.c (mon.1) 981 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:00:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.256930+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.257752+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:00:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:14 gibba043 bash[24019]: audit 2021-03-10T15:00:13.258377+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:00:15.459 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:15 gibba043 bash[24019]: cluster 2021-03-10T15:00:14.090321+0000 mgr.gibba043.dnkmem (mgr.34373) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:15 gibba003 bash[31385]: cluster 2021-03-10T15:00:14.090321+0000 mgr.gibba043.dnkmem (mgr.34373) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:15 gibba003 bash[32348]: cluster 2021-03-10T15:00:14.090321+0000 mgr.gibba043.dnkmem (mgr.34373) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:16 gibba043 bash[24019]: cephadm 2021-03-10T15:00:15.456751+0000 mgr.gibba043.dnkmem (mgr.34373) 3678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:16.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:16 gibba003 bash[31385]: cephadm 2021-03-10T15:00:15.456751+0000 mgr.gibba043.dnkmem (mgr.34373) 3678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:16.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:16 gibba003 bash[32348]: cephadm 2021-03-10T15:00:15.456751+0000 mgr.gibba043.dnkmem (mgr.34373) 3678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:17 gibba043 bash[24019]: cluster 2021-03-10T15:00:16.092337+0000 mgr.gibba043.dnkmem (mgr.34373) 3679 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:17 gibba003 bash[31385]: cluster 2021-03-10T15:00:16.092337+0000 mgr.gibba043.dnkmem (mgr.34373) 3679 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:17 gibba003 bash[32348]: cluster 2021-03-10T15:00:16.092337+0000 mgr.gibba043.dnkmem (mgr.34373) 3679 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:19 gibba043 bash[24019]: cluster 2021-03-10T15:00:18.093583+0000 mgr.gibba043.dnkmem (mgr.34373) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:19 gibba003 bash[31385]: cluster 2021-03-10T15:00:18.093583+0000 mgr.gibba043.dnkmem (mgr.34373) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:19 gibba003 bash[32348]: cluster 2021-03-10T15:00:18.093583+0000 mgr.gibba043.dnkmem (mgr.34373) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:21 gibba043 bash[24019]: cluster 2021-03-10T15:00:20.094873+0000 mgr.gibba043.dnkmem (mgr.34373) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:21 gibba003 bash[31385]: cluster 2021-03-10T15:00:20.094873+0000 mgr.gibba043.dnkmem (mgr.34373) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:21 gibba003 bash[32348]: cluster 2021-03-10T15:00:20.094873+0000 mgr.gibba043.dnkmem (mgr.34373) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:23 gibba043 bash[24019]: cluster 2021-03-10T15:00:22.096499+0000 mgr.gibba043.dnkmem (mgr.34373) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:23 gibba003 bash[31385]: cluster 2021-03-10T15:00:22.096499+0000 mgr.gibba043.dnkmem (mgr.34373) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:23 gibba003 bash[32348]: cluster 2021-03-10T15:00:22.096499+0000 mgr.gibba043.dnkmem (mgr.34373) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:24 gibba003 bash[31385]: cluster 2021-03-10T15:00:24.098107+0000 mgr.gibba043.dnkmem (mgr.34373) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:24 gibba003 bash[32348]: cluster 2021-03-10T15:00:24.098107+0000 mgr.gibba043.dnkmem (mgr.34373) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:24 gibba043 bash[24019]: cluster 2021-03-10T15:00:24.098107+0000 mgr.gibba043.dnkmem (mgr.34373) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:27 gibba003 bash[31385]: cluster 2021-03-10T15:00:26.100011+0000 mgr.gibba043.dnkmem (mgr.34373) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:27 gibba003 bash[32348]: cluster 2021-03-10T15:00:26.100011+0000 mgr.gibba043.dnkmem (mgr.34373) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:27 gibba043 bash[24019]: cluster 2021-03-10T15:00:26.100011+0000 mgr.gibba043.dnkmem (mgr.34373) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:29 gibba003 bash[31385]: cluster 2021-03-10T15:00:28.101234+0000 mgr.gibba043.dnkmem (mgr.34373) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:29 gibba003 bash[32348]: cluster 2021-03-10T15:00:28.101234+0000 mgr.gibba043.dnkmem (mgr.34373) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:29 gibba043 bash[24019]: cluster 2021-03-10T15:00:28.101234+0000 mgr.gibba043.dnkmem (mgr.34373) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:31 gibba003 bash[31385]: cluster 2021-03-10T15:00:30.102863+0000 mgr.gibba043.dnkmem (mgr.34373) 3686 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:31 gibba003 bash[31385]: cephadm 2021-03-10T15:00:30.472589+0000 mgr.gibba043.dnkmem (mgr.34373) 3687 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:31 gibba003 bash[32348]: cluster 2021-03-10T15:00:30.102863+0000 mgr.gibba043.dnkmem (mgr.34373) 3686 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:31 gibba003 bash[32348]: cephadm 2021-03-10T15:00:30.472589+0000 mgr.gibba043.dnkmem (mgr.34373) 3687 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:31 gibba043 bash[24019]: cluster 2021-03-10T15:00:30.102863+0000 mgr.gibba043.dnkmem (mgr.34373) 3686 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:31 gibba043 bash[24019]: cephadm 2021-03-10T15:00:30.472589+0000 mgr.gibba043.dnkmem (mgr.34373) 3687 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:33.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:33 gibba003 bash[31385]: cluster 2021-03-10T15:00:32.104615+0000 mgr.gibba043.dnkmem (mgr.34373) 3688 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:33.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:33 gibba003 bash[32348]: cluster 2021-03-10T15:00:32.104615+0000 mgr.gibba043.dnkmem (mgr.34373) 3688 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:33 gibba043 bash[24019]: cluster 2021-03-10T15:00:32.104615+0000 mgr.gibba043.dnkmem (mgr.34373) 3688 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:34 gibba003 bash[31385]: cluster 2021-03-10T15:00:34.106100+0000 mgr.gibba043.dnkmem (mgr.34373) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:34 gibba003 bash[32348]: cluster 2021-03-10T15:00:34.106100+0000 mgr.gibba043.dnkmem (mgr.34373) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:34 gibba043 bash[24019]: cluster 2021-03-10T15:00:34.106100+0000 mgr.gibba043.dnkmem (mgr.34373) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:37 gibba003 bash[31385]: cluster 2021-03-10T15:00:36.108057+0000 mgr.gibba043.dnkmem (mgr.34373) 3690 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:37 gibba003 bash[32348]: cluster 2021-03-10T15:00:36.108057+0000 mgr.gibba043.dnkmem (mgr.34373) 3690 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:37 gibba043 bash[24019]: cluster 2021-03-10T15:00:36.108057+0000 mgr.gibba043.dnkmem (mgr.34373) 3690 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:39 gibba003 bash[31385]: cluster 2021-03-10T15:00:38.109618+0000 mgr.gibba043.dnkmem (mgr.34373) 3691 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:39 gibba003 bash[32348]: cluster 2021-03-10T15:00:38.109618+0000 mgr.gibba043.dnkmem (mgr.34373) 3691 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:39 gibba043 bash[24019]: cluster 2021-03-10T15:00:38.109618+0000 mgr.gibba043.dnkmem (mgr.34373) 3691 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:40.222 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:00:40.450 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:00:40.451 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (69m) 3m ago 74m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:00:40.451 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (74m) 2m ago 74m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:00:40.451 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:00:40.452 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:00:40.452 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:00:40.452 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:00:40.452 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (68m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:00:40.453 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:00:40.453 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (74m) 3m ago 74m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:00:40.453 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (74m) 2m ago 74m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:00:40.453 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (67m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:00:40.454 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:00:40.454 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:00:40.454 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:00:40.454 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:00:40.455 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:00:40.455 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:00:40.455 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:00:40.456 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (73m) 2m ago 74m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:00:40.456 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 72m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:00:40.697 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:00:40.698 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:00:40.698 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:40.699 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:00:40.699 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:00:40.699 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:40.700 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:00:40.700 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:00:40.701 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:00:40.701 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:00:40.701 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:00:40.702 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:00:40.702 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:00:40.702 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:00:40.703 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:00:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[31385]: cluster 2021-03-10T15:00:40.111124+0000 mgr.gibba043.dnkmem (mgr.34373) 3692 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[31385]: audit 2021-03-10T15:00:40.211909+0000 mgr.gibba043.dnkmem (mgr.34373) 3693 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[31385]: audit 2021-03-10T15:00:40.435714+0000 mgr.gibba043.dnkmem (mgr.34373) 3694 : audit [DBG] from='client.46542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[31385]: audit 2021-03-10T15:00:40.695632+0000 mon.c (mon.1) 982 : audit [DBG] from='client.? 172.21.2.103:0/1457771375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[32348]: cluster 2021-03-10T15:00:40.111124+0000 mgr.gibba043.dnkmem (mgr.34373) 3692 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[32348]: audit 2021-03-10T15:00:40.211909+0000 mgr.gibba043.dnkmem (mgr.34373) 3693 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[32348]: audit 2021-03-10T15:00:40.435714+0000 mgr.gibba043.dnkmem (mgr.34373) 3694 : audit [DBG] from='client.46542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:41 gibba003 bash[32348]: audit 2021-03-10T15:00:40.695632+0000 mon.c (mon.1) 982 : audit [DBG] from='client.? 172.21.2.103:0/1457771375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:41 gibba043 bash[24019]: cluster 2021-03-10T15:00:40.111124+0000 mgr.gibba043.dnkmem (mgr.34373) 3692 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:41 gibba043 bash[24019]: audit 2021-03-10T15:00:40.211909+0000 mgr.gibba043.dnkmem (mgr.34373) 3693 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:41 gibba043 bash[24019]: audit 2021-03-10T15:00:40.435714+0000 mgr.gibba043.dnkmem (mgr.34373) 3694 : audit [DBG] from='client.46542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:41.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:41 gibba043 bash[24019]: audit 2021-03-10T15:00:40.695632+0000 mon.c (mon.1) 982 : audit [DBG] from='client.? 172.21.2.103:0/1457771375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:43 gibba043 bash[24019]: cluster 2021-03-10T15:00:42.112940+0000 mgr.gibba043.dnkmem (mgr.34373) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:43 gibba003 bash[31385]: cluster 2021-03-10T15:00:42.112940+0000 mgr.gibba043.dnkmem (mgr.34373) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:43 gibba003 bash[32348]: cluster 2021-03-10T15:00:42.112940+0000 mgr.gibba043.dnkmem (mgr.34373) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:44 gibba003 bash[31385]: cluster 2021-03-10T15:00:44.114036+0000 mgr.gibba043.dnkmem (mgr.34373) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:44 gibba003 bash[32348]: cluster 2021-03-10T15:00:44.114036+0000 mgr.gibba043.dnkmem (mgr.34373) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:44 gibba043 bash[24019]: cluster 2021-03-10T15:00:44.114036+0000 mgr.gibba043.dnkmem (mgr.34373) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:45.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:45 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.489454+0000 mgr.gibba043.dnkmem (mgr.34373) 3697 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:00:45.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:45 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.490996+0000 mgr.gibba043.dnkmem (mgr.34373) 3698 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:00:45.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:45 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.489454+0000 mgr.gibba043.dnkmem (mgr.34373) 3697 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:00:45.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:45 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.490996+0000 mgr.gibba043.dnkmem (mgr.34373) 3698 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:00:46.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:45 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.489454+0000 mgr.gibba043.dnkmem (mgr.34373) 3697 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:00:46.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:45 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.490996+0000 mgr.gibba043.dnkmem (mgr.34373) 3698 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:00:47.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.721600+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:00:47.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.723728+0000 mgr.gibba043.dnkmem (mgr.34373) 3699 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:47.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.725566+0000 mon.c (mon.1) 983 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:47.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.725725+0000 mgr.gibba043.dnkmem (mgr.34373) 3700 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:47.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.727102+0000 mgr.gibba043.dnkmem (mgr.34373) 3701 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:47.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.727145+0000 mgr.gibba043.dnkmem (mgr.34373) 3702 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:47.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.727207+0000 mon.c (mon.1) 984 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.728435+0000 mgr.gibba043.dnkmem (mgr.34373) 3703 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:47.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.728480+0000 mgr.gibba043.dnkmem (mgr.34373) 3704 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:47.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.728556+0000 mon.c (mon.1) 985 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.729626+0000 mgr.gibba043.dnkmem (mgr.34373) 3705 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:47.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.729790+0000 mon.c (mon.1) 986 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.731336+0000 mgr.gibba043.dnkmem (mgr.34373) 3706 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:47.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.731381+0000 mgr.gibba043.dnkmem (mgr.34373) 3707 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:47.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.732756+0000 mgr.gibba043.dnkmem (mgr.34373) 3708 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:47.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.732899+0000 mon.c (mon.1) 987 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.733168+0000 mgr.gibba043.dnkmem (mgr.34373) 3709 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:47.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.734231+0000 mgr.gibba043.dnkmem (mgr.34373) 3710 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:47.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.734270+0000 mgr.gibba043.dnkmem (mgr.34373) 3711 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:47.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cephadm 2021-03-10T15:00:45.734374+0000 mgr.gibba043.dnkmem (mgr.34373) 3712 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:47.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: audit 2021-03-10T15:00:45.734449+0000 mon.c (mon.1) 988 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:46 gibba043 bash[24019]: cluster 2021-03-10T15:00:46.116051+0000 mgr.gibba043.dnkmem (mgr.34373) 3713 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:47.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.721600+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:00:47.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.723728+0000 mgr.gibba043.dnkmem (mgr.34373) 3699 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:47.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.725566+0000 mon.c (mon.1) 983 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:47.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.725725+0000 mgr.gibba043.dnkmem (mgr.34373) 3700 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:47.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.727102+0000 mgr.gibba043.dnkmem (mgr.34373) 3701 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:47.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.727145+0000 mgr.gibba043.dnkmem (mgr.34373) 3702 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:47.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.727207+0000 mon.c (mon.1) 984 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.728435+0000 mgr.gibba043.dnkmem (mgr.34373) 3703 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:47.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.728480+0000 mgr.gibba043.dnkmem (mgr.34373) 3704 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:47.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.728556+0000 mon.c (mon.1) 985 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.729626+0000 mgr.gibba043.dnkmem (mgr.34373) 3705 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:47.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.729790+0000 mon.c (mon.1) 986 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.731336+0000 mgr.gibba043.dnkmem (mgr.34373) 3706 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:47.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.731381+0000 mgr.gibba043.dnkmem (mgr.34373) 3707 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:47.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.732756+0000 mgr.gibba043.dnkmem (mgr.34373) 3708 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:47.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.732899+0000 mon.c (mon.1) 987 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.733168+0000 mgr.gibba043.dnkmem (mgr.34373) 3709 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:47.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.734231+0000 mgr.gibba043.dnkmem (mgr.34373) 3710 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:47.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.734270+0000 mgr.gibba043.dnkmem (mgr.34373) 3711 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:47.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cephadm 2021-03-10T15:00:45.734374+0000 mgr.gibba043.dnkmem (mgr.34373) 3712 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:47.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.721600+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:00:47.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.723728+0000 mgr.gibba043.dnkmem (mgr.34373) 3699 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:47.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.725566+0000 mon.c (mon.1) 983 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:47.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.725725+0000 mgr.gibba043.dnkmem (mgr.34373) 3700 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:47.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.727102+0000 mgr.gibba043.dnkmem (mgr.34373) 3701 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:47.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.727145+0000 mgr.gibba043.dnkmem (mgr.34373) 3702 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:47.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.727207+0000 mon.c (mon.1) 984 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.728435+0000 mgr.gibba043.dnkmem (mgr.34373) 3703 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:47.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.728480+0000 mgr.gibba043.dnkmem (mgr.34373) 3704 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:47.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.728556+0000 mon.c (mon.1) 985 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.729626+0000 mgr.gibba043.dnkmem (mgr.34373) 3705 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:47.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.729790+0000 mon.c (mon.1) 986 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.731336+0000 mgr.gibba043.dnkmem (mgr.34373) 3706 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:47.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.731381+0000 mgr.gibba043.dnkmem (mgr.34373) 3707 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:47.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.732756+0000 mgr.gibba043.dnkmem (mgr.34373) 3708 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:47.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.732899+0000 mon.c (mon.1) 987 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.733168+0000 mgr.gibba043.dnkmem (mgr.34373) 3709 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:47.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.734231+0000 mgr.gibba043.dnkmem (mgr.34373) 3710 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:47.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.734270+0000 mgr.gibba043.dnkmem (mgr.34373) 3711 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:47.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cephadm 2021-03-10T15:00:45.734374+0000 mgr.gibba043.dnkmem (mgr.34373) 3712 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:00:47.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: audit 2021-03-10T15:00:45.734449+0000 mon.c (mon.1) 988 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[31385]: cluster 2021-03-10T15:00:46.116051+0000 mgr.gibba043.dnkmem (mgr.34373) 3713 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:47.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: audit 2021-03-10T15:00:45.734449+0000 mon.c (mon.1) 988 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:47.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:46 gibba003 bash[32348]: cluster 2021-03-10T15:00:46.116051+0000 mgr.gibba043.dnkmem (mgr.34373) 3713 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:49 gibba003 bash[31385]: cluster 2021-03-10T15:00:48.117440+0000 mgr.gibba043.dnkmem (mgr.34373) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:49 gibba003 bash[32348]: cluster 2021-03-10T15:00:48.117440+0000 mgr.gibba043.dnkmem (mgr.34373) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:49 gibba043 bash[24019]: cluster 2021-03-10T15:00:48.117440+0000 mgr.gibba043.dnkmem (mgr.34373) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:51 gibba043 bash[24019]: cluster 2021-03-10T15:00:50.118372+0000 mgr.gibba043.dnkmem (mgr.34373) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:51 gibba003 bash[31385]: cluster 2021-03-10T15:00:50.118372+0000 mgr.gibba043.dnkmem (mgr.34373) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:51 gibba003 bash[32348]: cluster 2021-03-10T15:00:50.118372+0000 mgr.gibba043.dnkmem (mgr.34373) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:53 gibba043 bash[24019]: cluster 2021-03-10T15:00:52.119762+0000 mgr.gibba043.dnkmem (mgr.34373) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:53 gibba003 bash[31385]: cluster 2021-03-10T15:00:52.119762+0000 mgr.gibba043.dnkmem (mgr.34373) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:53.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:53 gibba003 bash[32348]: cluster 2021-03-10T15:00:52.119762+0000 mgr.gibba043.dnkmem (mgr.34373) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:54 gibba003 bash[31385]: cluster 2021-03-10T15:00:54.121236+0000 mgr.gibba043.dnkmem (mgr.34373) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:54 gibba003 bash[32348]: cluster 2021-03-10T15:00:54.121236+0000 mgr.gibba043.dnkmem (mgr.34373) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:54 gibba043 bash[24019]: cluster 2021-03-10T15:00:54.121236+0000 mgr.gibba043.dnkmem (mgr.34373) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:57 gibba003 bash[31385]: cluster 2021-03-10T15:00:56.122890+0000 mgr.gibba043.dnkmem (mgr.34373) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:57 gibba003 bash[32348]: cluster 2021-03-10T15:00:56.122890+0000 mgr.gibba043.dnkmem (mgr.34373) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:57 gibba043 bash[24019]: cluster 2021-03-10T15:00:56.122890+0000 mgr.gibba043.dnkmem (mgr.34373) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:00:59 gibba043 bash[24019]: cluster 2021-03-10T15:00:58.124220+0000 mgr.gibba043.dnkmem (mgr.34373) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:00:59 gibba003 bash[31385]: cluster 2021-03-10T15:00:58.124220+0000 mgr.gibba043.dnkmem (mgr.34373) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:00:59 gibba003 bash[32348]: cluster 2021-03-10T15:00:58.124220+0000 mgr.gibba043.dnkmem (mgr.34373) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:01 gibba043 bash[24019]: cluster 2021-03-10T15:01:00.125916+0000 mgr.gibba043.dnkmem (mgr.34373) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:01 gibba003 bash[31385]: cluster 2021-03-10T15:01:00.125916+0000 mgr.gibba043.dnkmem (mgr.34373) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:01 gibba003 bash[32348]: cluster 2021-03-10T15:01:00.125916+0000 mgr.gibba043.dnkmem (mgr.34373) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:02 gibba043 bash[24019]: cephadm 2021-03-10T15:01:00.750377+0000 mgr.gibba043.dnkmem (mgr.34373) 3721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:02 gibba003 bash[31385]: cephadm 2021-03-10T15:01:00.750377+0000 mgr.gibba043.dnkmem (mgr.34373) 3721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:02 gibba003 bash[32348]: cephadm 2021-03-10T15:01:00.750377+0000 mgr.gibba043.dnkmem (mgr.34373) 3721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:03 gibba043 bash[24019]: cluster 2021-03-10T15:01:02.127595+0000 mgr.gibba043.dnkmem (mgr.34373) 3722 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:03.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:03 gibba003 bash[31385]: cluster 2021-03-10T15:01:02.127595+0000 mgr.gibba043.dnkmem (mgr.34373) 3722 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:03 gibba003 bash[32348]: cluster 2021-03-10T15:01:02.127595+0000 mgr.gibba043.dnkmem (mgr.34373) 3722 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:04 gibba003 bash[31385]: cluster 2021-03-10T15:01:04.129213+0000 mgr.gibba043.dnkmem (mgr.34373) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:04 gibba003 bash[32348]: cluster 2021-03-10T15:01:04.129213+0000 mgr.gibba043.dnkmem (mgr.34373) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:05.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:04 gibba043 bash[24019]: cluster 2021-03-10T15:01:04.129213+0000 mgr.gibba043.dnkmem (mgr.34373) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:07 gibba043 bash[24019]: cluster 2021-03-10T15:01:06.131136+0000 mgr.gibba043.dnkmem (mgr.34373) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:07 gibba003 bash[31385]: cluster 2021-03-10T15:01:06.131136+0000 mgr.gibba043.dnkmem (mgr.34373) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:07 gibba003 bash[32348]: cluster 2021-03-10T15:01:06.131136+0000 mgr.gibba043.dnkmem (mgr.34373) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:09 gibba043 bash[24019]: cluster 2021-03-10T15:01:08.132584+0000 mgr.gibba043.dnkmem (mgr.34373) 3725 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:09 gibba003 bash[31385]: cluster 2021-03-10T15:01:08.132584+0000 mgr.gibba043.dnkmem (mgr.34373) 3725 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:09 gibba003 bash[32348]: cluster 2021-03-10T15:01:08.132584+0000 mgr.gibba043.dnkmem (mgr.34373) 3725 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:10.940 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:01:11.165 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:01:11.165 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (69m) 4m ago 74m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:01:11.166 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (74m) 3m ago 74m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:01:11.166 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (69m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:01:11.166 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:01:11.166 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:01:11.167 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:01:11.167 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:01:11.167 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (68m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:01:11.167 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (74m) 4m ago 75m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:01:11.168 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (75m) 3m ago 75m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:01:11.168 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:01:11.168 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:01:11.168 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:01:11.169 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:01:11.169 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:01:11.169 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:01:11.169 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:01:11.169 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (64m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:01:11.170 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (74m) 3m ago 75m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:01:11.170 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 73m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:01:11.416 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:01:11.417 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:01:11.417 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:11.417 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:01:11.418 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:01:11.418 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:11.418 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:01:11.418 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:01:11.419 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:01:11.419 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:01:11.419 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:01:11.419 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:01:11.420 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:01:11.420 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:01:11.420 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:01:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:11 gibba043 bash[24019]: cluster 2021-03-10T15:01:10.134302+0000 mgr.gibba043.dnkmem (mgr.34373) 3726 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:11 gibba003 bash[31385]: cluster 2021-03-10T15:01:10.134302+0000 mgr.gibba043.dnkmem (mgr.34373) 3726 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:11.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:11 gibba003 bash[32348]: cluster 2021-03-10T15:01:10.134302+0000 mgr.gibba043.dnkmem (mgr.34373) 3726 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:12 gibba043 bash[24019]: audit 2021-03-10T15:01:10.927948+0000 mgr.gibba043.dnkmem (mgr.34373) 3727 : audit [DBG] from='client.46554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:12.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:12 gibba043 bash[24019]: audit 2021-03-10T15:01:11.150790+0000 mgr.gibba043.dnkmem (mgr.34373) 3728 : audit [DBG] from='client.56548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:12.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:12 gibba043 bash[24019]: audit 2021-03-10T15:01:11.415112+0000 mon.a (mon.0) 1037 : audit [DBG] from='client.? 172.21.2.103:0/1798269244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:12.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:12 gibba003 bash[31385]: audit 2021-03-10T15:01:10.927948+0000 mgr.gibba043.dnkmem (mgr.34373) 3727 : audit [DBG] from='client.46554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:12.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:12 gibba003 bash[31385]: audit 2021-03-10T15:01:11.150790+0000 mgr.gibba043.dnkmem (mgr.34373) 3728 : audit [DBG] from='client.56548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:12.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:12 gibba003 bash[31385]: audit 2021-03-10T15:01:11.415112+0000 mon.a (mon.0) 1037 : audit [DBG] from='client.? 172.21.2.103:0/1798269244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:12.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:12 gibba003 bash[32348]: audit 2021-03-10T15:01:10.927948+0000 mgr.gibba043.dnkmem (mgr.34373) 3727 : audit [DBG] from='client.46554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:12.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:12 gibba003 bash[32348]: audit 2021-03-10T15:01:11.150790+0000 mgr.gibba043.dnkmem (mgr.34373) 3728 : audit [DBG] from='client.56548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:12.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:12 gibba003 bash[32348]: audit 2021-03-10T15:01:11.415112+0000 mon.a (mon.0) 1037 : audit [DBG] from='client.? 172.21.2.103:0/1798269244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:13 gibba043 bash[24019]: cluster 2021-03-10T15:01:12.135709+0000 mgr.gibba043.dnkmem (mgr.34373) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:13 gibba043 bash[24019]: audit 2021-03-10T15:01:13.145825+0000 mon.c (mon.1) 989 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:13 gibba043 bash[24019]: audit 2021-03-10T15:01:13.147120+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:13 gibba003 bash[31385]: cluster 2021-03-10T15:01:12.135709+0000 mgr.gibba043.dnkmem (mgr.34373) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:13 gibba003 bash[31385]: audit 2021-03-10T15:01:13.145825+0000 mon.c (mon.1) 989 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:13 gibba003 bash[31385]: audit 2021-03-10T15:01:13.147120+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:13 gibba003 bash[32348]: cluster 2021-03-10T15:01:12.135709+0000 mgr.gibba043.dnkmem (mgr.34373) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:13 gibba003 bash[32348]: audit 2021-03-10T15:01:13.145825+0000 mon.c (mon.1) 989 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:13 gibba003 bash[32348]: audit 2021-03-10T15:01:13.147120+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.235199+0000 mon.c (mon.1) 990 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.235494+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.260148+0000 mon.c (mon.1) 991 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:01:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.260351+0000 mon.c (mon.1) 992 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.260520+0000 mon.c (mon.1) 993 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.260624+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:01:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.260694+0000 mon.c (mon.1) 994 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:01:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.260961+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.261218+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:14 gibba043 bash[24019]: audit 2021-03-10T15:01:13.261416+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:01:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.235199+0000 mon.c (mon.1) 990 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.235494+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.260148+0000 mon.c (mon.1) 991 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:01:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.260351+0000 mon.c (mon.1) 992 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.260520+0000 mon.c (mon.1) 993 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.260624+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:01:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.260694+0000 mon.c (mon.1) 994 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:01:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.260961+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.261218+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[31385]: audit 2021-03-10T15:01:13.261416+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:01:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.235199+0000 mon.c (mon.1) 990 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.235494+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.260148+0000 mon.c (mon.1) 991 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:01:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.260351+0000 mon.c (mon.1) 992 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.260520+0000 mon.c (mon.1) 993 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.260624+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:01:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.260694+0000 mon.c (mon.1) 994 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:01:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.260961+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.261218+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:01:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:14 gibba003 bash[32348]: audit 2021-03-10T15:01:13.261416+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:01:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:15 gibba043 bash[24019]: cluster 2021-03-10T15:01:14.137051+0000 mgr.gibba043.dnkmem (mgr.34373) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:15 gibba003 bash[31385]: cluster 2021-03-10T15:01:14.137051+0000 mgr.gibba043.dnkmem (mgr.34373) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:15 gibba003 bash[32348]: cluster 2021-03-10T15:01:14.137051+0000 mgr.gibba043.dnkmem (mgr.34373) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:17 gibba043 bash[24019]: cephadm 2021-03-10T15:01:15.766439+0000 mgr.gibba043.dnkmem (mgr.34373) 3731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:17 gibba043 bash[24019]: cluster 2021-03-10T15:01:16.138980+0000 mgr.gibba043.dnkmem (mgr.34373) 3732 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:17 gibba003 bash[31385]: cephadm 2021-03-10T15:01:15.766439+0000 mgr.gibba043.dnkmem (mgr.34373) 3731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:17 gibba003 bash[31385]: cluster 2021-03-10T15:01:16.138980+0000 mgr.gibba043.dnkmem (mgr.34373) 3732 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:17 gibba003 bash[32348]: cephadm 2021-03-10T15:01:15.766439+0000 mgr.gibba043.dnkmem (mgr.34373) 3731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:17 gibba003 bash[32348]: cluster 2021-03-10T15:01:16.138980+0000 mgr.gibba043.dnkmem (mgr.34373) 3732 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:19 gibba043 bash[24019]: cluster 2021-03-10T15:01:18.140519+0000 mgr.gibba043.dnkmem (mgr.34373) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:19 gibba003 bash[31385]: cluster 2021-03-10T15:01:18.140519+0000 mgr.gibba043.dnkmem (mgr.34373) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:19 gibba003 bash[32348]: cluster 2021-03-10T15:01:18.140519+0000 mgr.gibba043.dnkmem (mgr.34373) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:21 gibba043 bash[24019]: cluster 2021-03-10T15:01:20.142020+0000 mgr.gibba043.dnkmem (mgr.34373) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:21 gibba003 bash[31385]: cluster 2021-03-10T15:01:20.142020+0000 mgr.gibba043.dnkmem (mgr.34373) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:21 gibba003 bash[32348]: cluster 2021-03-10T15:01:20.142020+0000 mgr.gibba043.dnkmem (mgr.34373) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:23 gibba003 bash[31385]: cluster 2021-03-10T15:01:22.143779+0000 mgr.gibba043.dnkmem (mgr.34373) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:23 gibba003 bash[32348]: cluster 2021-03-10T15:01:22.143779+0000 mgr.gibba043.dnkmem (mgr.34373) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:23.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:23 gibba043 bash[24019]: cluster 2021-03-10T15:01:22.143779+0000 mgr.gibba043.dnkmem (mgr.34373) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:24 gibba003 bash[31385]: cluster 2021-03-10T15:01:24.145646+0000 mgr.gibba043.dnkmem (mgr.34373) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:24 gibba003 bash[32348]: cluster 2021-03-10T15:01:24.145646+0000 mgr.gibba043.dnkmem (mgr.34373) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:24 gibba043 bash[24019]: cluster 2021-03-10T15:01:24.145646+0000 mgr.gibba043.dnkmem (mgr.34373) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:27 gibba043 bash[24019]: cluster 2021-03-10T15:01:26.147756+0000 mgr.gibba043.dnkmem (mgr.34373) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:27 gibba003 bash[31385]: cluster 2021-03-10T15:01:26.147756+0000 mgr.gibba043.dnkmem (mgr.34373) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:27 gibba003 bash[32348]: cluster 2021-03-10T15:01:26.147756+0000 mgr.gibba043.dnkmem (mgr.34373) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:29 gibba043 bash[24019]: cluster 2021-03-10T15:01:28.149093+0000 mgr.gibba043.dnkmem (mgr.34373) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:29 gibba003 bash[31385]: cluster 2021-03-10T15:01:28.149093+0000 mgr.gibba043.dnkmem (mgr.34373) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:29 gibba003 bash[32348]: cluster 2021-03-10T15:01:28.149093+0000 mgr.gibba043.dnkmem (mgr.34373) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:31 gibba043 bash[24019]: cluster 2021-03-10T15:01:30.150840+0000 mgr.gibba043.dnkmem (mgr.34373) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:31 gibba003 bash[31385]: cluster 2021-03-10T15:01:30.150840+0000 mgr.gibba043.dnkmem (mgr.34373) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:31 gibba003 bash[32348]: cluster 2021-03-10T15:01:30.150840+0000 mgr.gibba043.dnkmem (mgr.34373) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:32 gibba043 bash[24019]: cephadm 2021-03-10T15:01:30.782391+0000 mgr.gibba043.dnkmem (mgr.34373) 3740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:32 gibba003 bash[31385]: cephadm 2021-03-10T15:01:30.782391+0000 mgr.gibba043.dnkmem (mgr.34373) 3740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:32.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:32 gibba003 bash[32348]: cephadm 2021-03-10T15:01:30.782391+0000 mgr.gibba043.dnkmem (mgr.34373) 3740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:33 gibba043 bash[24019]: cluster 2021-03-10T15:01:32.152781+0000 mgr.gibba043.dnkmem (mgr.34373) 3741 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:33.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:33 gibba003 bash[31385]: cluster 2021-03-10T15:01:32.152781+0000 mgr.gibba043.dnkmem (mgr.34373) 3741 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:33 gibba003 bash[32348]: cluster 2021-03-10T15:01:32.152781+0000 mgr.gibba043.dnkmem (mgr.34373) 3741 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:34 gibba003 bash[31385]: cluster 2021-03-10T15:01:34.154199+0000 mgr.gibba043.dnkmem (mgr.34373) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:34 gibba003 bash[32348]: cluster 2021-03-10T15:01:34.154199+0000 mgr.gibba043.dnkmem (mgr.34373) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:34 gibba043 bash[24019]: cluster 2021-03-10T15:01:34.154199+0000 mgr.gibba043.dnkmem (mgr.34373) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:37 gibba043 bash[24019]: cluster 2021-03-10T15:01:36.156217+0000 mgr.gibba043.dnkmem (mgr.34373) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:37 gibba003 bash[31385]: cluster 2021-03-10T15:01:36.156217+0000 mgr.gibba043.dnkmem (mgr.34373) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:37 gibba003 bash[32348]: cluster 2021-03-10T15:01:36.156217+0000 mgr.gibba043.dnkmem (mgr.34373) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:39 gibba043 bash[24019]: cluster 2021-03-10T15:01:38.157702+0000 mgr.gibba043.dnkmem (mgr.34373) 3744 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:39 gibba003 bash[31385]: cluster 2021-03-10T15:01:38.157702+0000 mgr.gibba043.dnkmem (mgr.34373) 3744 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:39 gibba003 bash[32348]: cluster 2021-03-10T15:01:38.157702+0000 mgr.gibba043.dnkmem (mgr.34373) 3744 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:41 gibba043 bash[24019]: cluster 2021-03-10T15:01:40.159427+0000 mgr.gibba043.dnkmem (mgr.34373) 3745 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.667 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:01:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:41 gibba003 bash[31385]: cluster 2021-03-10T15:01:40.159427+0000 mgr.gibba043.dnkmem (mgr.34373) 3745 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:41 gibba003 bash[32348]: cluster 2021-03-10T15:01:40.159427+0000 mgr.gibba043.dnkmem (mgr.34373) 3745 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.892 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:01:41.892 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (70m) 5m ago 75m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:01:41.893 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (75m) 3m ago 75m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:01:41.893 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:01:41.893 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:01:41.893 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (69m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:01:41.894 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (69m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:01:41.894 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (69m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:01:41.894 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (69m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:01:41.894 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (75m) 5m ago 75m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:01:41.894 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (75m) 3m ago 75m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:01:41.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:01:41.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:01:41.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:01:41.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:01:41.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:01:41.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:01:41.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:01:41.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:01:41.896 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (74m) 3m ago 75m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:01:41.897 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 73m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:01:42.140 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:01:42.140 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:01:42.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:42.141 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:01:42.141 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:01:42.141 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:42.141 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:01:42.141 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:01:42.142 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:01:42.142 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:01:42.142 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:01:42.143 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:01:42.143 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:01:42.143 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:01:42.144 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:01:42.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:42 gibba043 bash[24019]: audit 2021-03-10T15:01:42.138131+0000 mon.c (mon.1) 995 : audit [DBG] from='client.? 172.21.2.103:0/4086435170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:42.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:42 gibba003 bash[31385]: audit 2021-03-10T15:01:42.138131+0000 mon.c (mon.1) 995 : audit [DBG] from='client.? 172.21.2.103:0/4086435170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:42.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:42 gibba003 bash[32348]: audit 2021-03-10T15:01:42.138131+0000 mon.c (mon.1) 995 : audit [DBG] from='client.? 172.21.2.103:0/4086435170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:43 gibba043 bash[24019]: audit 2021-03-10T15:01:41.655664+0000 mgr.gibba043.dnkmem (mgr.34373) 3746 : audit [DBG] from='client.46572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:43 gibba043 bash[24019]: audit 2021-03-10T15:01:41.877936+0000 mgr.gibba043.dnkmem (mgr.34373) 3747 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:43 gibba043 bash[24019]: cluster 2021-03-10T15:01:42.161006+0000 mgr.gibba043.dnkmem (mgr.34373) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:43 gibba003 bash[31385]: audit 2021-03-10T15:01:41.655664+0000 mgr.gibba043.dnkmem (mgr.34373) 3746 : audit [DBG] from='client.46572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:43 gibba003 bash[31385]: audit 2021-03-10T15:01:41.877936+0000 mgr.gibba043.dnkmem (mgr.34373) 3747 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:43 gibba003 bash[31385]: cluster 2021-03-10T15:01:42.161006+0000 mgr.gibba043.dnkmem (mgr.34373) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:43 gibba003 bash[32348]: audit 2021-03-10T15:01:41.655664+0000 mgr.gibba043.dnkmem (mgr.34373) 3746 : audit [DBG] from='client.46572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:43.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:43 gibba003 bash[32348]: audit 2021-03-10T15:01:41.877936+0000 mgr.gibba043.dnkmem (mgr.34373) 3747 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:43.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:43 gibba003 bash[32348]: cluster 2021-03-10T15:01:42.161006+0000 mgr.gibba043.dnkmem (mgr.34373) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:44 gibba003 bash[31385]: cluster 2021-03-10T15:01:44.162632+0000 mgr.gibba043.dnkmem (mgr.34373) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:44 gibba003 bash[32348]: cluster 2021-03-10T15:01:44.162632+0000 mgr.gibba043.dnkmem (mgr.34373) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:44 gibba043 bash[24019]: cluster 2021-03-10T15:01:44.162632+0000 mgr.gibba043.dnkmem (mgr.34373) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:45.798957+0000 mgr.gibba043.dnkmem (mgr.34373) 3750 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:01:47.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:45.800610+0000 mgr.gibba043.dnkmem (mgr.34373) 3751 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:01:47.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.021495+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:01:47.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.023340+0000 mgr.gibba043.dnkmem (mgr.34373) 3752 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:47.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.025005+0000 mon.c (mon.1) 996 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:47.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.025073+0000 mgr.gibba043.dnkmem (mgr.34373) 3753 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:47.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.026317+0000 mon.c (mon.1) 997 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.026409+0000 mgr.gibba043.dnkmem (mgr.34373) 3754 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:47.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.026445+0000 mgr.gibba043.dnkmem (mgr.34373) 3755 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:47.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.027804+0000 mgr.gibba043.dnkmem (mgr.34373) 3756 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:47.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.027843+0000 mgr.gibba043.dnkmem (mgr.34373) 3757 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:47.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.027852+0000 mon.c (mon.1) 998 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.029131+0000 mgr.gibba043.dnkmem (mgr.34373) 3758 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:47.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.029177+0000 mon.c (mon.1) 999 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.030560+0000 mgr.gibba043.dnkmem (mgr.34373) 3759 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:47.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.030598+0000 mgr.gibba043.dnkmem (mgr.34373) 3760 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:47.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.031883+0000 mgr.gibba043.dnkmem (mgr.34373) 3761 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:47.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.032037+0000 mon.c (mon.1) 1000 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.032211+0000 mgr.gibba043.dnkmem (mgr.34373) 3762 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:47.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: audit 2021-03-10T15:01:46.033504+0000 mon.c (mon.1) 1001 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.033666+0000 mgr.gibba043.dnkmem (mgr.34373) 3763 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:47.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:45.798957+0000 mgr.gibba043.dnkmem (mgr.34373) 3750 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:01:47.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:45.800610+0000 mgr.gibba043.dnkmem (mgr.34373) 3751 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:01:47.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.021495+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:01:47.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.023340+0000 mgr.gibba043.dnkmem (mgr.34373) 3752 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:47.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.025005+0000 mon.c (mon.1) 996 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:47.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.025073+0000 mgr.gibba043.dnkmem (mgr.34373) 3753 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:47.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.026317+0000 mon.c (mon.1) 997 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.026409+0000 mgr.gibba043.dnkmem (mgr.34373) 3754 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:47.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.026445+0000 mgr.gibba043.dnkmem (mgr.34373) 3755 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:47.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.027804+0000 mgr.gibba043.dnkmem (mgr.34373) 3756 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:47.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.027843+0000 mgr.gibba043.dnkmem (mgr.34373) 3757 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:47.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.027852+0000 mon.c (mon.1) 998 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.029131+0000 mgr.gibba043.dnkmem (mgr.34373) 3758 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:47.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.029177+0000 mon.c (mon.1) 999 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.030560+0000 mgr.gibba043.dnkmem (mgr.34373) 3759 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:47.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.030598+0000 mgr.gibba043.dnkmem (mgr.34373) 3760 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:47.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.031883+0000 mgr.gibba043.dnkmem (mgr.34373) 3761 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:47.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.032037+0000 mon.c (mon.1) 1000 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.032211+0000 mgr.gibba043.dnkmem (mgr.34373) 3762 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:47.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: audit 2021-03-10T15:01:46.033504+0000 mon.c (mon.1) 1001 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.033666+0000 mgr.gibba043.dnkmem (mgr.34373) 3763 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:47.456 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.033706+0000 mgr.gibba043.dnkmem (mgr.34373) 3764 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:47.457 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cephadm 2021-03-10T15:01:46.033815+0000 mgr.gibba043.dnkmem (mgr.34373) 3765 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:47.457 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[31385]: cluster 2021-03-10T15:01:46.164479+0000 mgr.gibba043.dnkmem (mgr.34373) 3766 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.033706+0000 mgr.gibba043.dnkmem (mgr.34373) 3764 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:47.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cephadm 2021-03-10T15:01:46.033815+0000 mgr.gibba043.dnkmem (mgr.34373) 3765 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:47.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:47 gibba003 bash[32348]: cluster 2021-03-10T15:01:46.164479+0000 mgr.gibba043.dnkmem (mgr.34373) 3766 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:45.798957+0000 mgr.gibba043.dnkmem (mgr.34373) 3750 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:01:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:45.800610+0000 mgr.gibba043.dnkmem (mgr.34373) 3751 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:01:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.021495+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:01:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.023340+0000 mgr.gibba043.dnkmem (mgr.34373) 3752 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.025005+0000 mon.c (mon.1) 996 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.025073+0000 mgr.gibba043.dnkmem (mgr.34373) 3753 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.026317+0000 mon.c (mon.1) 997 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.026409+0000 mgr.gibba043.dnkmem (mgr.34373) 3754 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.026445+0000 mgr.gibba043.dnkmem (mgr.34373) 3755 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.027804+0000 mgr.gibba043.dnkmem (mgr.34373) 3756 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.027843+0000 mgr.gibba043.dnkmem (mgr.34373) 3757 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.027852+0000 mon.c (mon.1) 998 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.029131+0000 mgr.gibba043.dnkmem (mgr.34373) 3758 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.029177+0000 mon.c (mon.1) 999 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.030560+0000 mgr.gibba043.dnkmem (mgr.34373) 3759 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.030598+0000 mgr.gibba043.dnkmem (mgr.34373) 3760 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.031883+0000 mgr.gibba043.dnkmem (mgr.34373) 3761 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.032037+0000 mon.c (mon.1) 1000 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.032211+0000 mgr.gibba043.dnkmem (mgr.34373) 3762 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:47.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: audit 2021-03-10T15:01:46.033504+0000 mon.c (mon.1) 1001 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:47.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.033666+0000 mgr.gibba043.dnkmem (mgr.34373) 3763 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:47.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.033706+0000 mgr.gibba043.dnkmem (mgr.34373) 3764 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:47.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cephadm 2021-03-10T15:01:46.033815+0000 mgr.gibba043.dnkmem (mgr.34373) 3765 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:01:47.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:47 gibba043 bash[24019]: cluster 2021-03-10T15:01:46.164479+0000 mgr.gibba043.dnkmem (mgr.34373) 3766 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:49 gibba043 bash[24019]: cluster 2021-03-10T15:01:48.165721+0000 mgr.gibba043.dnkmem (mgr.34373) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:49 gibba003 bash[31385]: cluster 2021-03-10T15:01:48.165721+0000 mgr.gibba043.dnkmem (mgr.34373) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:49 gibba003 bash[32348]: cluster 2021-03-10T15:01:48.165721+0000 mgr.gibba043.dnkmem (mgr.34373) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:51 gibba043 bash[24019]: cluster 2021-03-10T15:01:50.167333+0000 mgr.gibba043.dnkmem (mgr.34373) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:51 gibba003 bash[31385]: cluster 2021-03-10T15:01:50.167333+0000 mgr.gibba043.dnkmem (mgr.34373) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:51 gibba003 bash[32348]: cluster 2021-03-10T15:01:50.167333+0000 mgr.gibba043.dnkmem (mgr.34373) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:53 gibba043 bash[24019]: cluster 2021-03-10T15:01:52.168922+0000 mgr.gibba043.dnkmem (mgr.34373) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:53 gibba003 bash[31385]: cluster 2021-03-10T15:01:52.168922+0000 mgr.gibba043.dnkmem (mgr.34373) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:53.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:53 gibba003 bash[32348]: cluster 2021-03-10T15:01:52.168922+0000 mgr.gibba043.dnkmem (mgr.34373) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:54 gibba003 bash[31385]: cluster 2021-03-10T15:01:54.170307+0000 mgr.gibba043.dnkmem (mgr.34373) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:54 gibba003 bash[32348]: cluster 2021-03-10T15:01:54.170307+0000 mgr.gibba043.dnkmem (mgr.34373) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:54 gibba043 bash[24019]: cluster 2021-03-10T15:01:54.170307+0000 mgr.gibba043.dnkmem (mgr.34373) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:57 gibba043 bash[24019]: cluster 2021-03-10T15:01:56.172213+0000 mgr.gibba043.dnkmem (mgr.34373) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:57 gibba003 bash[31385]: cluster 2021-03-10T15:01:56.172213+0000 mgr.gibba043.dnkmem (mgr.34373) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:57 gibba003 bash[32348]: cluster 2021-03-10T15:01:56.172213+0000 mgr.gibba043.dnkmem (mgr.34373) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:01:59 gibba043 bash[24019]: cluster 2021-03-10T15:01:58.173419+0000 mgr.gibba043.dnkmem (mgr.34373) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:01:59 gibba003 bash[31385]: cluster 2021-03-10T15:01:58.173419+0000 mgr.gibba043.dnkmem (mgr.34373) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:01:59 gibba003 bash[32348]: cluster 2021-03-10T15:01:58.173419+0000 mgr.gibba043.dnkmem (mgr.34373) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:01 gibba043 bash[24019]: cluster 2021-03-10T15:02:00.174753+0000 mgr.gibba043.dnkmem (mgr.34373) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:01 gibba003 bash[31385]: cluster 2021-03-10T15:02:00.174753+0000 mgr.gibba043.dnkmem (mgr.34373) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:01 gibba003 bash[32348]: cluster 2021-03-10T15:02:00.174753+0000 mgr.gibba043.dnkmem (mgr.34373) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:02 gibba043 bash[24019]: cephadm 2021-03-10T15:02:01.049844+0000 mgr.gibba043.dnkmem (mgr.34373) 3774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:02 gibba003 bash[31385]: cephadm 2021-03-10T15:02:01.049844+0000 mgr.gibba043.dnkmem (mgr.34373) 3774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:02.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:02 gibba003 bash[32348]: cephadm 2021-03-10T15:02:01.049844+0000 mgr.gibba043.dnkmem (mgr.34373) 3774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:03 gibba043 bash[24019]: cluster 2021-03-10T15:02:02.176419+0000 mgr.gibba043.dnkmem (mgr.34373) 3775 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:03.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:03 gibba003 bash[31385]: cluster 2021-03-10T15:02:02.176419+0000 mgr.gibba043.dnkmem (mgr.34373) 3775 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:03 gibba003 bash[32348]: cluster 2021-03-10T15:02:02.176419+0000 mgr.gibba043.dnkmem (mgr.34373) 3775 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:04 gibba043 bash[24019]: cluster 2021-03-10T15:02:04.178082+0000 mgr.gibba043.dnkmem (mgr.34373) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:04 gibba003 bash[31385]: cluster 2021-03-10T15:02:04.178082+0000 mgr.gibba043.dnkmem (mgr.34373) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:04 gibba003 bash[32348]: cluster 2021-03-10T15:02:04.178082+0000 mgr.gibba043.dnkmem (mgr.34373) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:07 gibba043 bash[24019]: cluster 2021-03-10T15:02:06.180002+0000 mgr.gibba043.dnkmem (mgr.34373) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:07 gibba003 bash[31385]: cluster 2021-03-10T15:02:06.180002+0000 mgr.gibba043.dnkmem (mgr.34373) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:07 gibba003 bash[32348]: cluster 2021-03-10T15:02:06.180002+0000 mgr.gibba043.dnkmem (mgr.34373) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:09 gibba043 bash[24019]: cluster 2021-03-10T15:02:08.181323+0000 mgr.gibba043.dnkmem (mgr.34373) 3778 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:09 gibba003 bash[31385]: cluster 2021-03-10T15:02:08.181323+0000 mgr.gibba043.dnkmem (mgr.34373) 3778 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:09 gibba003 bash[32348]: cluster 2021-03-10T15:02:08.181323+0000 mgr.gibba043.dnkmem (mgr.34373) 3778 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:11 gibba043 bash[24019]: cluster 2021-03-10T15:02:10.182913+0000 mgr.gibba043.dnkmem (mgr.34373) 3779 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:11 gibba003 bash[31385]: cluster 2021-03-10T15:02:10.182913+0000 mgr.gibba043.dnkmem (mgr.34373) 3779 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:11 gibba003 bash[32348]: cluster 2021-03-10T15:02:10.182913+0000 mgr.gibba043.dnkmem (mgr.34373) 3779 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:12.386 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:02:12.638 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:02:12.638 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (70m) 5m ago 75m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:02:12.638 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (75m) 4m ago 75m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:02:12.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (70m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:02:12.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:02:12.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:02:12.639 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:02:12.640 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:02:12.640 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (69m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:02:12.640 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (76m) 5m ago 76m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:02:12.640 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (76m) 4m ago 76m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:02:12.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (68m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:02:12.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:02:12.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:02:12.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:02:12.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:02:12.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:02:12.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:02:12.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (65m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:02:12.643 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (75m) 4m ago 76m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:02:12.643 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 74m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:02:12.893 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:02:12.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:02:12.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:12.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:02:12.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:02:12.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:12.895 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:02:12.895 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:02:12.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:02:12.896 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:02:12.896 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:02:12.896 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:02:12.896 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:02:12.897 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:02:12.897 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:02:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: cluster 2021-03-10T15:02:12.184672+0000 mgr.gibba043.dnkmem (mgr.34373) 3780 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:12.374652+0000 mgr.gibba043.dnkmem (mgr.34373) 3781 : audit [DBG] from='client.46590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:12.599390+0000 mgr.gibba043.dnkmem (mgr.34373) 3782 : audit [DBG] from='client.46596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:12.891552+0000 mon.c (mon.1) 1002 : audit [DBG] from='client.? 172.21.2.103:0/2546692840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:13.152825+0000 mon.c (mon.1) 1003 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:13.153923+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:13.239354+0000 mon.c (mon.1) 1004 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:13.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:13 gibba043 bash[24019]: audit 2021-03-10T15:02:13.240449+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: cluster 2021-03-10T15:02:12.184672+0000 mgr.gibba043.dnkmem (mgr.34373) 3780 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:12.374652+0000 mgr.gibba043.dnkmem (mgr.34373) 3781 : audit [DBG] from='client.46590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:12.599390+0000 mgr.gibba043.dnkmem (mgr.34373) 3782 : audit [DBG] from='client.46596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:12.891552+0000 mon.c (mon.1) 1002 : audit [DBG] from='client.? 172.21.2.103:0/2546692840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:13.152825+0000 mon.c (mon.1) 1003 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:13.153923+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:13.239354+0000 mon.c (mon.1) 1004 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[31385]: audit 2021-03-10T15:02:13.240449+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: cluster 2021-03-10T15:02:12.184672+0000 mgr.gibba043.dnkmem (mgr.34373) 3780 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:12.374652+0000 mgr.gibba043.dnkmem (mgr.34373) 3781 : audit [DBG] from='client.46590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:12.599390+0000 mgr.gibba043.dnkmem (mgr.34373) 3782 : audit [DBG] from='client.46596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:12.891552+0000 mon.c (mon.1) 1002 : audit [DBG] from='client.? 172.21.2.103:0/2546692840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:13.152825+0000 mon.c (mon.1) 1003 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:13.153923+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:13.239354+0000 mon.c (mon.1) 1004 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:13 gibba003 bash[32348]: audit 2021-03-10T15:02:13.240449+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.264175+0000 mon.c (mon.1) 1005 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:02:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.264927+0000 mon.c (mon.1) 1006 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.265591+0000 mon.c (mon.1) 1007 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:02:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.265640+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:02:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.266726+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.267279+0000 mon.c (mon.1) 1008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.267670+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:02:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[31385]: audit 2021-03-10T15:02:13.274372+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.264175+0000 mon.c (mon.1) 1005 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:02:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.264927+0000 mon.c (mon.1) 1006 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.265591+0000 mon.c (mon.1) 1007 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:02:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.265640+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:02:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.266726+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.267279+0000 mon.c (mon.1) 1008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.267670+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:02:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:14 gibba003 bash[32348]: audit 2021-03-10T15:02:13.274372+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.264175+0000 mon.c (mon.1) 1005 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:02:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.264927+0000 mon.c (mon.1) 1006 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.265591+0000 mon.c (mon.1) 1007 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:02:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.265640+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:02:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.266726+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.267279+0000 mon.c (mon.1) 1008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.267670+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:02:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:14 gibba043 bash[24019]: audit 2021-03-10T15:02:13.274372+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:15 gibba003 bash[31385]: cluster 2021-03-10T15:02:14.186279+0000 mgr.gibba043.dnkmem (mgr.34373) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:15 gibba003 bash[32348]: cluster 2021-03-10T15:02:14.186279+0000 mgr.gibba043.dnkmem (mgr.34373) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:15 gibba043 bash[24019]: cluster 2021-03-10T15:02:14.186279+0000 mgr.gibba043.dnkmem (mgr.34373) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:17 gibba003 bash[31385]: cephadm 2021-03-10T15:02:16.065921+0000 mgr.gibba043.dnkmem (mgr.34373) 3784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:17 gibba003 bash[31385]: cluster 2021-03-10T15:02:16.188207+0000 mgr.gibba043.dnkmem (mgr.34373) 3785 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:17 gibba003 bash[32348]: cephadm 2021-03-10T15:02:16.065921+0000 mgr.gibba043.dnkmem (mgr.34373) 3784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:17 gibba003 bash[32348]: cluster 2021-03-10T15:02:16.188207+0000 mgr.gibba043.dnkmem (mgr.34373) 3785 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:17 gibba043 bash[24019]: cephadm 2021-03-10T15:02:16.065921+0000 mgr.gibba043.dnkmem (mgr.34373) 3784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:17 gibba043 bash[24019]: cluster 2021-03-10T15:02:16.188207+0000 mgr.gibba043.dnkmem (mgr.34373) 3785 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:19 gibba003 bash[31385]: cluster 2021-03-10T15:02:18.189754+0000 mgr.gibba043.dnkmem (mgr.34373) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:19 gibba003 bash[32348]: cluster 2021-03-10T15:02:18.189754+0000 mgr.gibba043.dnkmem (mgr.34373) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:19 gibba043 bash[24019]: cluster 2021-03-10T15:02:18.189754+0000 mgr.gibba043.dnkmem (mgr.34373) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:21 gibba003 bash[31385]: cluster 2021-03-10T15:02:20.191406+0000 mgr.gibba043.dnkmem (mgr.34373) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:21 gibba003 bash[32348]: cluster 2021-03-10T15:02:20.191406+0000 mgr.gibba043.dnkmem (mgr.34373) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:21 gibba043 bash[24019]: cluster 2021-03-10T15:02:20.191406+0000 mgr.gibba043.dnkmem (mgr.34373) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:23 gibba003 bash[31385]: cluster 2021-03-10T15:02:22.193100+0000 mgr.gibba043.dnkmem (mgr.34373) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:23 gibba003 bash[32348]: cluster 2021-03-10T15:02:22.193100+0000 mgr.gibba043.dnkmem (mgr.34373) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:23.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:23 gibba043 bash[24019]: cluster 2021-03-10T15:02:22.193100+0000 mgr.gibba043.dnkmem (mgr.34373) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:24 gibba043 bash[24019]: cluster 2021-03-10T15:02:24.194576+0000 mgr.gibba043.dnkmem (mgr.34373) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:24 gibba003 bash[31385]: cluster 2021-03-10T15:02:24.194576+0000 mgr.gibba043.dnkmem (mgr.34373) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:24 gibba003 bash[32348]: cluster 2021-03-10T15:02:24.194576+0000 mgr.gibba043.dnkmem (mgr.34373) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:27 gibba043 bash[24019]: cluster 2021-03-10T15:02:26.196396+0000 mgr.gibba043.dnkmem (mgr.34373) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:27 gibba003 bash[31385]: cluster 2021-03-10T15:02:26.196396+0000 mgr.gibba043.dnkmem (mgr.34373) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:27 gibba003 bash[32348]: cluster 2021-03-10T15:02:26.196396+0000 mgr.gibba043.dnkmem (mgr.34373) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:29 gibba043 bash[24019]: cluster 2021-03-10T15:02:28.197783+0000 mgr.gibba043.dnkmem (mgr.34373) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:29 gibba003 bash[31385]: cluster 2021-03-10T15:02:28.197783+0000 mgr.gibba043.dnkmem (mgr.34373) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:29 gibba003 bash[32348]: cluster 2021-03-10T15:02:28.197783+0000 mgr.gibba043.dnkmem (mgr.34373) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:31 gibba043 bash[24019]: cluster 2021-03-10T15:02:30.199550+0000 mgr.gibba043.dnkmem (mgr.34373) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:31 gibba003 bash[31385]: cluster 2021-03-10T15:02:30.199550+0000 mgr.gibba043.dnkmem (mgr.34373) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:31 gibba003 bash[32348]: cluster 2021-03-10T15:02:30.199550+0000 mgr.gibba043.dnkmem (mgr.34373) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:32 gibba003 bash[31385]: cephadm 2021-03-10T15:02:31.076820+0000 mgr.gibba043.dnkmem (mgr.34373) 3793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:32.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:32 gibba003 bash[32348]: cephadm 2021-03-10T15:02:31.076820+0000 mgr.gibba043.dnkmem (mgr.34373) 3793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:32.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:32 gibba043 bash[24019]: cephadm 2021-03-10T15:02:31.076820+0000 mgr.gibba043.dnkmem (mgr.34373) 3793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:33 gibba003 bash[31385]: cluster 2021-03-10T15:02:32.201209+0000 mgr.gibba043.dnkmem (mgr.34373) 3794 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:33 gibba003 bash[32348]: cluster 2021-03-10T15:02:32.201209+0000 mgr.gibba043.dnkmem (mgr.34373) 3794 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:33 gibba043 bash[24019]: cluster 2021-03-10T15:02:32.201209+0000 mgr.gibba043.dnkmem (mgr.34373) 3794 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:34 gibba043 bash[24019]: cluster 2021-03-10T15:02:34.202789+0000 mgr.gibba043.dnkmem (mgr.34373) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:34 gibba003 bash[31385]: cluster 2021-03-10T15:02:34.202789+0000 mgr.gibba043.dnkmem (mgr.34373) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:34 gibba003 bash[32348]: cluster 2021-03-10T15:02:34.202789+0000 mgr.gibba043.dnkmem (mgr.34373) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:37 gibba043 bash[24019]: cluster 2021-03-10T15:02:36.204663+0000 mgr.gibba043.dnkmem (mgr.34373) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:37 gibba003 bash[31385]: cluster 2021-03-10T15:02:36.204663+0000 mgr.gibba043.dnkmem (mgr.34373) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:37 gibba003 bash[32348]: cluster 2021-03-10T15:02:36.204663+0000 mgr.gibba043.dnkmem (mgr.34373) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:39 gibba003 bash[31385]: cluster 2021-03-10T15:02:38.206372+0000 mgr.gibba043.dnkmem (mgr.34373) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:39.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:39 gibba003 bash[32348]: cluster 2021-03-10T15:02:38.206372+0000 mgr.gibba043.dnkmem (mgr.34373) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:39 gibba043 bash[24019]: cluster 2021-03-10T15:02:38.206372+0000 mgr.gibba043.dnkmem (mgr.34373) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:41 gibba003 bash[31385]: cluster 2021-03-10T15:02:40.207601+0000 mgr.gibba043.dnkmem (mgr.34373) 3798 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:41 gibba003 bash[32348]: cluster 2021-03-10T15:02:40.207601+0000 mgr.gibba043.dnkmem (mgr.34373) 3798 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:41 gibba043 bash[24019]: cluster 2021-03-10T15:02:40.207601+0000 mgr.gibba043.dnkmem (mgr.34373) 3798 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:43.135 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:02:43.360 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:02:43.361 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (71m) 6m ago 76m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:02:43.361 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (76m) 4m ago 76m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:02:43.361 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:02:43.361 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:02:43.362 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (70m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:02:43.362 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (70m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:02:43.362 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (70m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:02:43.362 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (70m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:02:43.363 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (76m) 6m ago 76m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:02:43.363 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (76m) 4m ago 76m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:02:43.363 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:02:43.363 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:02:43.364 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:02:43.364 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:02:43.364 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:02:43.364 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:02:43.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:02:43.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:02:43.365 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (75m) 4m ago 76m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:02:43.365 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 74m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:02:43.616 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:02:43.616 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:02:43.617 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:43.617 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:02:43.617 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:02:43.617 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:43.618 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:02:43.618 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:02:43.618 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:02:43.618 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:02:43.619 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:02:43.619 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:02:43.619 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:02:43.619 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:02:43.620 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:02:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:43 gibba003 bash[31385]: cluster 2021-03-10T15:02:42.208993+0000 mgr.gibba043.dnkmem (mgr.34373) 3799 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:43 gibba003 bash[32348]: cluster 2021-03-10T15:02:42.208993+0000 mgr.gibba043.dnkmem (mgr.34373) 3799 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:43 gibba043 bash[24019]: cluster 2021-03-10T15:02:42.208993+0000 mgr.gibba043.dnkmem (mgr.34373) 3799 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:44.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:44 gibba003 bash[31385]: audit 2021-03-10T15:02:43.123166+0000 mgr.gibba043.dnkmem (mgr.34373) 3800 : audit [DBG] from='client.56596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:44.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:44 gibba003 bash[31385]: audit 2021-03-10T15:02:43.347896+0000 mgr.gibba043.dnkmem (mgr.34373) 3801 : audit [DBG] from='client.46614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:44.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:44 gibba003 bash[31385]: audit 2021-03-10T15:02:43.614614+0000 mon.c (mon.1) 1009 : audit [DBG] from='client.? 172.21.2.103:0/1554130561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:44 gibba003 bash[32348]: audit 2021-03-10T15:02:43.123166+0000 mgr.gibba043.dnkmem (mgr.34373) 3800 : audit [DBG] from='client.56596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:44.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:44 gibba003 bash[32348]: audit 2021-03-10T15:02:43.347896+0000 mgr.gibba043.dnkmem (mgr.34373) 3801 : audit [DBG] from='client.46614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:44.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:44 gibba003 bash[32348]: audit 2021-03-10T15:02:43.614614+0000 mon.c (mon.1) 1009 : audit [DBG] from='client.? 172.21.2.103:0/1554130561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:44 gibba043 bash[24019]: audit 2021-03-10T15:02:43.123166+0000 mgr.gibba043.dnkmem (mgr.34373) 3800 : audit [DBG] from='client.56596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:44.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:44 gibba043 bash[24019]: audit 2021-03-10T15:02:43.347896+0000 mgr.gibba043.dnkmem (mgr.34373) 3801 : audit [DBG] from='client.46614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:44.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:44 gibba043 bash[24019]: audit 2021-03-10T15:02:43.614614+0000 mon.c (mon.1) 1009 : audit [DBG] from='client.? 172.21.2.103:0/1554130561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:45 gibba003 bash[31385]: cluster 2021-03-10T15:02:44.210658+0000 mgr.gibba043.dnkmem (mgr.34373) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:45 gibba003 bash[32348]: cluster 2021-03-10T15:02:44.210658+0000 mgr.gibba043.dnkmem (mgr.34373) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:45.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:45 gibba043 bash[24019]: cluster 2021-03-10T15:02:44.210658+0000 mgr.gibba043.dnkmem (mgr.34373) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.093348+0000 mgr.gibba043.dnkmem (mgr.34373) 3803 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:02:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.094901+0000 mgr.gibba043.dnkmem (mgr.34373) 3804 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:02:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cluster 2021-03-10T15:02:46.211212+0000 mgr.gibba043.dnkmem (mgr.34373) 3805 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.322544+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:02:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.324487+0000 mgr.gibba043.dnkmem (mgr.34373) 3806 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.326183+0000 mon.c (mon.1) 1010 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.326199+0000 mgr.gibba043.dnkmem (mgr.34373) 3807 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.327393+0000 mgr.gibba043.dnkmem (mgr.34373) 3808 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.327430+0000 mgr.gibba043.dnkmem (mgr.34373) 3809 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.327533+0000 mon.c (mon.1) 1011 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.328686+0000 mgr.gibba043.dnkmem (mgr.34373) 3810 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.328710+0000 mon.c (mon.1) 1012 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.328724+0000 mgr.gibba043.dnkmem (mgr.34373) 3811 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.329678+0000 mgr.gibba043.dnkmem (mgr.34373) 3812 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.329837+0000 mon.c (mon.1) 1013 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.331252+0000 mgr.gibba043.dnkmem (mgr.34373) 3813 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.331287+0000 mgr.gibba043.dnkmem (mgr.34373) 3814 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.332487+0000 mgr.gibba043.dnkmem (mgr.34373) 3815 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.332618+0000 mon.c (mon.1) 1014 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.332906+0000 mgr.gibba043.dnkmem (mgr.34373) 3816 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: audit 2021-03-10T15:02:46.334363+0000 mon.c (mon.1) 1015 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.093348+0000 mgr.gibba043.dnkmem (mgr.34373) 3803 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:02:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.094901+0000 mgr.gibba043.dnkmem (mgr.34373) 3804 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:02:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cluster 2021-03-10T15:02:46.211212+0000 mgr.gibba043.dnkmem (mgr.34373) 3805 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.322544+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:02:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.324487+0000 mgr.gibba043.dnkmem (mgr.34373) 3806 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:47.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.326183+0000 mon.c (mon.1) 1010 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:47.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.326199+0000 mgr.gibba043.dnkmem (mgr.34373) 3807 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:47.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.327393+0000 mgr.gibba043.dnkmem (mgr.34373) 3808 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:47.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.327430+0000 mgr.gibba043.dnkmem (mgr.34373) 3809 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:47.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.327533+0000 mon.c (mon.1) 1011 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.328686+0000 mgr.gibba043.dnkmem (mgr.34373) 3810 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:47.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.328710+0000 mon.c (mon.1) 1012 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.328724+0000 mgr.gibba043.dnkmem (mgr.34373) 3811 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:47.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.329678+0000 mgr.gibba043.dnkmem (mgr.34373) 3812 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:47.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.329837+0000 mon.c (mon.1) 1013 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.331252+0000 mgr.gibba043.dnkmem (mgr.34373) 3813 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:47.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.331287+0000 mgr.gibba043.dnkmem (mgr.34373) 3814 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:47.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.332487+0000 mgr.gibba043.dnkmem (mgr.34373) 3815 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:47.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.332618+0000 mon.c (mon.1) 1014 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.332906+0000 mgr.gibba043.dnkmem (mgr.34373) 3816 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:47.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: audit 2021-03-10T15:02:46.334363+0000 mon.c (mon.1) 1015 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.335166+0000 mgr.gibba043.dnkmem (mgr.34373) 3817 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:47.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.335202+0000 mgr.gibba043.dnkmem (mgr.34373) 3818 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:47.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[31385]: cephadm 2021-03-10T15:02:46.335305+0000 mgr.gibba043.dnkmem (mgr.34373) 3819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:47.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.335166+0000 mgr.gibba043.dnkmem (mgr.34373) 3817 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:47.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.335202+0000 mgr.gibba043.dnkmem (mgr.34373) 3818 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:47.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:47 gibba003 bash[32348]: cephadm 2021-03-10T15:02:46.335305+0000 mgr.gibba043.dnkmem (mgr.34373) 3819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.093348+0000 mgr.gibba043.dnkmem (mgr.34373) 3803 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:02:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.094901+0000 mgr.gibba043.dnkmem (mgr.34373) 3804 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:02:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cluster 2021-03-10T15:02:46.211212+0000 mgr.gibba043.dnkmem (mgr.34373) 3805 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.322544+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:02:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.324487+0000 mgr.gibba043.dnkmem (mgr.34373) 3806 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.326183+0000 mon.c (mon.1) 1010 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.326199+0000 mgr.gibba043.dnkmem (mgr.34373) 3807 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.327393+0000 mgr.gibba043.dnkmem (mgr.34373) 3808 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.327430+0000 mgr.gibba043.dnkmem (mgr.34373) 3809 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.327533+0000 mon.c (mon.1) 1011 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.328686+0000 mgr.gibba043.dnkmem (mgr.34373) 3810 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.328710+0000 mon.c (mon.1) 1012 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.328724+0000 mgr.gibba043.dnkmem (mgr.34373) 3811 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.329678+0000 mgr.gibba043.dnkmem (mgr.34373) 3812 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:47.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.329837+0000 mon.c (mon.1) 1013 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.331252+0000 mgr.gibba043.dnkmem (mgr.34373) 3813 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:47.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.331287+0000 mgr.gibba043.dnkmem (mgr.34373) 3814 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:47.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.332487+0000 mgr.gibba043.dnkmem (mgr.34373) 3815 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:47.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.332618+0000 mon.c (mon.1) 1014 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.332906+0000 mgr.gibba043.dnkmem (mgr.34373) 3816 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:47.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: audit 2021-03-10T15:02:46.334363+0000 mon.c (mon.1) 1015 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:47.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.335166+0000 mgr.gibba043.dnkmem (mgr.34373) 3817 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:47.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.335202+0000 mgr.gibba043.dnkmem (mgr.34373) 3818 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:47.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:47 gibba043 bash[24019]: cephadm 2021-03-10T15:02:46.335305+0000 mgr.gibba043.dnkmem (mgr.34373) 3819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:02:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:49 gibba003 bash[31385]: cluster 2021-03-10T15:02:48.212488+0000 mgr.gibba043.dnkmem (mgr.34373) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:49 gibba003 bash[32348]: cluster 2021-03-10T15:02:48.212488+0000 mgr.gibba043.dnkmem (mgr.34373) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:49 gibba043 bash[24019]: cluster 2021-03-10T15:02:48.212488+0000 mgr.gibba043.dnkmem (mgr.34373) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:51 gibba003 bash[31385]: cluster 2021-03-10T15:02:50.214036+0000 mgr.gibba043.dnkmem (mgr.34373) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:51 gibba003 bash[32348]: cluster 2021-03-10T15:02:50.214036+0000 mgr.gibba043.dnkmem (mgr.34373) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:51.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:51 gibba043 bash[24019]: cluster 2021-03-10T15:02:50.214036+0000 mgr.gibba043.dnkmem (mgr.34373) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:53 gibba003 bash[31385]: cluster 2021-03-10T15:02:52.215744+0000 mgr.gibba043.dnkmem (mgr.34373) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:53.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:53 gibba003 bash[32348]: cluster 2021-03-10T15:02:52.215744+0000 mgr.gibba043.dnkmem (mgr.34373) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:53 gibba043 bash[24019]: cluster 2021-03-10T15:02:52.215744+0000 mgr.gibba043.dnkmem (mgr.34373) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:54 gibba043 bash[24019]: cluster 2021-03-10T15:02:54.217476+0000 mgr.gibba043.dnkmem (mgr.34373) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:55.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:54 gibba003 bash[31385]: cluster 2021-03-10T15:02:54.217476+0000 mgr.gibba043.dnkmem (mgr.34373) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:54 gibba003 bash[32348]: cluster 2021-03-10T15:02:54.217476+0000 mgr.gibba043.dnkmem (mgr.34373) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:57 gibba003 bash[31385]: cluster 2021-03-10T15:02:56.219419+0000 mgr.gibba043.dnkmem (mgr.34373) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:57 gibba003 bash[32348]: cluster 2021-03-10T15:02:56.219419+0000 mgr.gibba043.dnkmem (mgr.34373) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:57 gibba043 bash[24019]: cluster 2021-03-10T15:02:56.219419+0000 mgr.gibba043.dnkmem (mgr.34373) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:02:59 gibba003 bash[31385]: cluster 2021-03-10T15:02:58.221091+0000 mgr.gibba043.dnkmem (mgr.34373) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:02:59 gibba003 bash[32348]: cluster 2021-03-10T15:02:58.221091+0000 mgr.gibba043.dnkmem (mgr.34373) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:02:59 gibba043 bash[24019]: cluster 2021-03-10T15:02:58.221091+0000 mgr.gibba043.dnkmem (mgr.34373) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:01 gibba003 bash[31385]: cluster 2021-03-10T15:03:00.222471+0000 mgr.gibba043.dnkmem (mgr.34373) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:01 gibba003 bash[32348]: cluster 2021-03-10T15:03:00.222471+0000 mgr.gibba043.dnkmem (mgr.34373) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:01.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:01 gibba043 bash[24019]: cluster 2021-03-10T15:03:00.222471+0000 mgr.gibba043.dnkmem (mgr.34373) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:02 gibba003 bash[31385]: cephadm 2021-03-10T15:03:01.347917+0000 mgr.gibba043.dnkmem (mgr.34373) 3827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:02.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:02 gibba003 bash[32348]: cephadm 2021-03-10T15:03:01.347917+0000 mgr.gibba043.dnkmem (mgr.34373) 3827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:02.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:02 gibba043 bash[24019]: cephadm 2021-03-10T15:03:01.347917+0000 mgr.gibba043.dnkmem (mgr.34373) 3827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:03 gibba003 bash[31385]: cluster 2021-03-10T15:03:02.224205+0000 mgr.gibba043.dnkmem (mgr.34373) 3828 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:03 gibba003 bash[32348]: cluster 2021-03-10T15:03:02.224205+0000 mgr.gibba043.dnkmem (mgr.34373) 3828 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:03 gibba043 bash[24019]: cluster 2021-03-10T15:03:02.224205+0000 mgr.gibba043.dnkmem (mgr.34373) 3828 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:04 gibba043 bash[24019]: cluster 2021-03-10T15:03:04.225749+0000 mgr.gibba043.dnkmem (mgr.34373) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:04 gibba003 bash[31385]: cluster 2021-03-10T15:03:04.225749+0000 mgr.gibba043.dnkmem (mgr.34373) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:04 gibba003 bash[32348]: cluster 2021-03-10T15:03:04.225749+0000 mgr.gibba043.dnkmem (mgr.34373) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:07 gibba003 bash[31385]: cluster 2021-03-10T15:03:06.227649+0000 mgr.gibba043.dnkmem (mgr.34373) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:07 gibba003 bash[32348]: cluster 2021-03-10T15:03:06.227649+0000 mgr.gibba043.dnkmem (mgr.34373) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:07 gibba043 bash[24019]: cluster 2021-03-10T15:03:06.227649+0000 mgr.gibba043.dnkmem (mgr.34373) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:09 gibba003 bash[31385]: cluster 2021-03-10T15:03:08.230695+0000 mgr.gibba043.dnkmem (mgr.34373) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:09 gibba003 bash[32348]: cluster 2021-03-10T15:03:08.230695+0000 mgr.gibba043.dnkmem (mgr.34373) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:09.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:09 gibba043 bash[24019]: cluster 2021-03-10T15:03:08.230695+0000 mgr.gibba043.dnkmem (mgr.34373) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:11 gibba003 bash[31385]: cluster 2021-03-10T15:03:10.232307+0000 mgr.gibba043.dnkmem (mgr.34373) 3832 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:11 gibba003 bash[32348]: cluster 2021-03-10T15:03:10.232307+0000 mgr.gibba043.dnkmem (mgr.34373) 3832 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:11 gibba043 bash[24019]: cluster 2021-03-10T15:03:10.232307+0000 mgr.gibba043.dnkmem (mgr.34373) 3832 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: cluster 2021-03-10T15:03:12.233954+0000 mgr.gibba043.dnkmem (mgr.34373) 3833 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.159685+0000 mon.c (mon.1) 1016 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.160821+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.247532+0000 mon.c (mon.1) 1017 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.248687+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.280671+0000 mon.c (mon.1) 1018 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:03:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.281423+0000 mon.c (mon.1) 1019 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.281926+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:03:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.282169+0000 mon.c (mon.1) 1020 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.283001+0000 mon.c (mon.1) 1021 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:03:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.283174+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.284432+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[32348]: audit 2021-03-10T15:03:13.285237+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:03:13.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: cluster 2021-03-10T15:03:12.233954+0000 mgr.gibba043.dnkmem (mgr.34373) 3833 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.159685+0000 mon.c (mon.1) 1016 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:13.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.160821+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:13.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.247532+0000 mon.c (mon.1) 1017 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:13.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.248687+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:13.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.280671+0000 mon.c (mon.1) 1018 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:03:13.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.281423+0000 mon.c (mon.1) 1019 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.281926+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:03:13.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.282169+0000 mon.c (mon.1) 1020 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.283001+0000 mon.c (mon.1) 1021 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:03:13.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.283174+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.284432+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:13 gibba003 bash[31385]: audit 2021-03-10T15:03:13.285237+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:03:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: cluster 2021-03-10T15:03:12.233954+0000 mgr.gibba043.dnkmem (mgr.34373) 3833 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.159685+0000 mon.c (mon.1) 1016 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.160821+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.247532+0000 mon.c (mon.1) 1017 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.248687+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.280671+0000 mon.c (mon.1) 1018 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:03:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.281423+0000 mon.c (mon.1) 1019 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.281926+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:03:13.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.282169+0000 mon.c (mon.1) 1020 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.283001+0000 mon.c (mon.1) 1021 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:03:13.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.283174+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.284432+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:03:13.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:13 gibba043 bash[24019]: audit 2021-03-10T15:03:13.285237+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:03:13.859 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:03:14.085 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:03:14.086 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (71m) 6m ago 76m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:03:14.086 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (76m) 5m ago 76m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:03:14.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (71m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:03:14.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:03:14.088 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (71m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:03:14.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (71m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:03:14.089 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:03:14.089 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (70m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:03:14.089 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (77m) 6m ago 77m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:03:14.090 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (77m) 5m ago 77m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:03:14.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (69m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:03:14.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:03:14.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:03:14.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:03:14.092 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:03:14.092 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:03:14.093 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:03:14.093 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (66m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:03:14.094 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (76m) 5m ago 77m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:03:14.094 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 75m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:03:14.334 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:03:14.335 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:03:14.335 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:14.335 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:03:14.335 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:03:14.336 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:14.336 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:03:14.336 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:03:14.336 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:03:14.336 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:03:14.337 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:03:14.337 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:03:14.337 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:03:14.337 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:03:14.338 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:03:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:14 gibba043 bash[24019]: audit 2021-03-10T15:03:13.847930+0000 mgr.gibba043.dnkmem (mgr.34373) 3834 : audit [DBG] from='client.56614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:14 gibba043 bash[24019]: audit 2021-03-10T15:03:14.070754+0000 mgr.gibba043.dnkmem (mgr.34373) 3835 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:14 gibba043 bash[24019]: cluster 2021-03-10T15:03:14.235262+0000 mgr.gibba043.dnkmem (mgr.34373) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:14 gibba043 bash[24019]: audit 2021-03-10T15:03:14.332693+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.2.103:0/193450614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[31385]: audit 2021-03-10T15:03:13.847930+0000 mgr.gibba043.dnkmem (mgr.34373) 3834 : audit [DBG] from='client.56614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[31385]: audit 2021-03-10T15:03:14.070754+0000 mgr.gibba043.dnkmem (mgr.34373) 3835 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[31385]: cluster 2021-03-10T15:03:14.235262+0000 mgr.gibba043.dnkmem (mgr.34373) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[31385]: audit 2021-03-10T15:03:14.332693+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.2.103:0/193450614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[32348]: audit 2021-03-10T15:03:13.847930+0000 mgr.gibba043.dnkmem (mgr.34373) 3834 : audit [DBG] from='client.56614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[32348]: audit 2021-03-10T15:03:14.070754+0000 mgr.gibba043.dnkmem (mgr.34373) 3835 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[32348]: cluster 2021-03-10T15:03:14.235262+0000 mgr.gibba043.dnkmem (mgr.34373) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:14 gibba003 bash[32348]: audit 2021-03-10T15:03:14.332693+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.2.103:0/193450614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:17 gibba003 bash[31385]: cluster 2021-03-10T15:03:16.235816+0000 mgr.gibba043.dnkmem (mgr.34373) 3837 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:17 gibba003 bash[31385]: cephadm 2021-03-10T15:03:16.363942+0000 mgr.gibba043.dnkmem (mgr.34373) 3838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:17 gibba003 bash[32348]: cluster 2021-03-10T15:03:16.235816+0000 mgr.gibba043.dnkmem (mgr.34373) 3837 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:17 gibba003 bash[32348]: cephadm 2021-03-10T15:03:16.363942+0000 mgr.gibba043.dnkmem (mgr.34373) 3838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:17 gibba043 bash[24019]: cluster 2021-03-10T15:03:16.235816+0000 mgr.gibba043.dnkmem (mgr.34373) 3837 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:17 gibba043 bash[24019]: cephadm 2021-03-10T15:03:16.363942+0000 mgr.gibba043.dnkmem (mgr.34373) 3838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:19 gibba003 bash[31385]: cluster 2021-03-10T15:03:18.237138+0000 mgr.gibba043.dnkmem (mgr.34373) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:19 gibba003 bash[32348]: cluster 2021-03-10T15:03:18.237138+0000 mgr.gibba043.dnkmem (mgr.34373) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:19 gibba043 bash[24019]: cluster 2021-03-10T15:03:18.237138+0000 mgr.gibba043.dnkmem (mgr.34373) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:21 gibba003 bash[31385]: cluster 2021-03-10T15:03:20.238686+0000 mgr.gibba043.dnkmem (mgr.34373) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:21 gibba003 bash[32348]: cluster 2021-03-10T15:03:20.238686+0000 mgr.gibba043.dnkmem (mgr.34373) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:21 gibba043 bash[24019]: cluster 2021-03-10T15:03:20.238686+0000 mgr.gibba043.dnkmem (mgr.34373) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:23 gibba003 bash[31385]: cluster 2021-03-10T15:03:22.240259+0000 mgr.gibba043.dnkmem (mgr.34373) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:23 gibba003 bash[32348]: cluster 2021-03-10T15:03:22.240259+0000 mgr.gibba043.dnkmem (mgr.34373) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:23 gibba043 bash[24019]: cluster 2021-03-10T15:03:22.240259+0000 mgr.gibba043.dnkmem (mgr.34373) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:24 gibba043 bash[24019]: cluster 2021-03-10T15:03:24.240773+0000 mgr.gibba043.dnkmem (mgr.34373) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:24 gibba003 bash[31385]: cluster 2021-03-10T15:03:24.240773+0000 mgr.gibba043.dnkmem (mgr.34373) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:24 gibba003 bash[32348]: cluster 2021-03-10T15:03:24.240773+0000 mgr.gibba043.dnkmem (mgr.34373) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:27 gibba003 bash[31385]: cluster 2021-03-10T15:03:26.242491+0000 mgr.gibba043.dnkmem (mgr.34373) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:27 gibba003 bash[32348]: cluster 2021-03-10T15:03:26.242491+0000 mgr.gibba043.dnkmem (mgr.34373) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:27 gibba043 bash[24019]: cluster 2021-03-10T15:03:26.242491+0000 mgr.gibba043.dnkmem (mgr.34373) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:29 gibba003 bash[31385]: cluster 2021-03-10T15:03:28.244124+0000 mgr.gibba043.dnkmem (mgr.34373) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:29 gibba003 bash[32348]: cluster 2021-03-10T15:03:28.244124+0000 mgr.gibba043.dnkmem (mgr.34373) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:29 gibba043 bash[24019]: cluster 2021-03-10T15:03:28.244124+0000 mgr.gibba043.dnkmem (mgr.34373) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:31 gibba003 bash[31385]: cluster 2021-03-10T15:03:30.245477+0000 mgr.gibba043.dnkmem (mgr.34373) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:31 gibba003 bash[32348]: cluster 2021-03-10T15:03:30.245477+0000 mgr.gibba043.dnkmem (mgr.34373) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:31 gibba043 bash[24019]: cluster 2021-03-10T15:03:30.245477+0000 mgr.gibba043.dnkmem (mgr.34373) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:32 gibba003 bash[31385]: cephadm 2021-03-10T15:03:31.379326+0000 mgr.gibba043.dnkmem (mgr.34373) 3846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:32.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:32 gibba003 bash[32348]: cephadm 2021-03-10T15:03:31.379326+0000 mgr.gibba043.dnkmem (mgr.34373) 3846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:32.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:32 gibba043 bash[24019]: cephadm 2021-03-10T15:03:31.379326+0000 mgr.gibba043.dnkmem (mgr.34373) 3846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:33 gibba003 bash[31385]: cluster 2021-03-10T15:03:32.245993+0000 mgr.gibba043.dnkmem (mgr.34373) 3847 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:33 gibba003 bash[32348]: cluster 2021-03-10T15:03:32.245993+0000 mgr.gibba043.dnkmem (mgr.34373) 3847 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:33.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:33 gibba043 bash[24019]: cluster 2021-03-10T15:03:32.245993+0000 mgr.gibba043.dnkmem (mgr.34373) 3847 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:34 gibba043 bash[24019]: cluster 2021-03-10T15:03:34.247386+0000 mgr.gibba043.dnkmem (mgr.34373) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:35.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:34 gibba003 bash[31385]: cluster 2021-03-10T15:03:34.247386+0000 mgr.gibba043.dnkmem (mgr.34373) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:34 gibba003 bash[32348]: cluster 2021-03-10T15:03:34.247386+0000 mgr.gibba043.dnkmem (mgr.34373) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:37 gibba003 bash[31385]: cluster 2021-03-10T15:03:36.249281+0000 mgr.gibba043.dnkmem (mgr.34373) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:37 gibba003 bash[32348]: cluster 2021-03-10T15:03:36.249281+0000 mgr.gibba043.dnkmem (mgr.34373) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:37 gibba043 bash[24019]: cluster 2021-03-10T15:03:36.249281+0000 mgr.gibba043.dnkmem (mgr.34373) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:39 gibba003 bash[31385]: cluster 2021-03-10T15:03:38.250908+0000 mgr.gibba043.dnkmem (mgr.34373) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:39 gibba003 bash[32348]: cluster 2021-03-10T15:03:38.250908+0000 mgr.gibba043.dnkmem (mgr.34373) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:39 gibba043 bash[24019]: cluster 2021-03-10T15:03:38.250908+0000 mgr.gibba043.dnkmem (mgr.34373) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:41 gibba003 bash[31385]: cluster 2021-03-10T15:03:40.251535+0000 mgr.gibba043.dnkmem (mgr.34373) 3851 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:41 gibba003 bash[32348]: cluster 2021-03-10T15:03:40.251535+0000 mgr.gibba043.dnkmem (mgr.34373) 3851 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:41 gibba043 bash[24019]: cluster 2021-03-10T15:03:40.251535+0000 mgr.gibba043.dnkmem (mgr.34373) 3851 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:43 gibba003 bash[31385]: cluster 2021-03-10T15:03:42.253077+0000 mgr.gibba043.dnkmem (mgr.34373) 3852 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:43 gibba003 bash[32348]: cluster 2021-03-10T15:03:42.253077+0000 mgr.gibba043.dnkmem (mgr.34373) 3852 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:43 gibba043 bash[24019]: cluster 2021-03-10T15:03:42.253077+0000 mgr.gibba043.dnkmem (mgr.34373) 3852 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:44.578 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:03:44.811 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:03:44.811 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (72m) 7m ago 77m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:03:44.812 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (77m) 6m ago 77m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:03:44.812 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (72m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:03:44.812 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (72m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:03:44.812 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (71m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:03:44.813 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (71m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:03:44.813 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:03:44.813 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (71m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:03:44.813 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (77m) 7m ago 77m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:03:44.814 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (77m) 6m ago 77m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:03:44.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:03:44.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:03:44.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:03:44.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:03:44.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:03:44.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:03:44.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (67m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:03:44.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (67m) 6m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:03:44.816 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (76m) 6m ago 77m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:03:44.816 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 75m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:03:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:44 gibba043 bash[24019]: cluster 2021-03-10T15:03:44.254758+0000 mgr.gibba043.dnkmem (mgr.34373) 3853 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:45.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:44 gibba043 bash[24019]: audit 2021-03-10T15:03:44.566760+0000 mgr.gibba043.dnkmem (mgr.34373) 3854 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:45.063 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:03:45.063 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:03:45.064 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:45.064 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:03:45.065 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:03:45.065 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:45.065 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:03:45.066 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:03:45.066 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:03:45.067 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:03:45.067 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:03:45.068 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:03:45.068 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:03:45.068 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:03:45.069 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:03:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:44 gibba003 bash[31385]: cluster 2021-03-10T15:03:44.254758+0000 mgr.gibba043.dnkmem (mgr.34373) 3853 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:44 gibba003 bash[31385]: audit 2021-03-10T15:03:44.566760+0000 mgr.gibba043.dnkmem (mgr.34373) 3854 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:45.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:44 gibba003 bash[32348]: cluster 2021-03-10T15:03:44.254758+0000 mgr.gibba043.dnkmem (mgr.34373) 3853 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:45.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:44 gibba003 bash[32348]: audit 2021-03-10T15:03:44.566760+0000 mgr.gibba043.dnkmem (mgr.34373) 3854 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:46.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:45 gibba043 bash[24019]: audit 2021-03-10T15:03:44.796100+0000 mgr.gibba043.dnkmem (mgr.34373) 3855 : audit [DBG] from='client.46650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:46.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:45 gibba043 bash[24019]: audit 2021-03-10T15:03:45.061045+0000 mon.c (mon.1) 1022 : audit [DBG] from='client.? 172.21.2.103:0/1785746532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:45 gibba003 bash[31385]: audit 2021-03-10T15:03:44.796100+0000 mgr.gibba043.dnkmem (mgr.34373) 3855 : audit [DBG] from='client.46650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:45 gibba003 bash[31385]: audit 2021-03-10T15:03:45.061045+0000 mon.c (mon.1) 1022 : audit [DBG] from='client.? 172.21.2.103:0/1785746532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:46.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:45 gibba003 bash[32348]: audit 2021-03-10T15:03:44.796100+0000 mgr.gibba043.dnkmem (mgr.34373) 3855 : audit [DBG] from='client.46650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:46.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:45 gibba003 bash[32348]: audit 2021-03-10T15:03:45.061045+0000 mon.c (mon.1) 1022 : audit [DBG] from='client.? 172.21.2.103:0/1785746532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: cluster 2021-03-10T15:03:46.256655+0000 mgr.gibba043.dnkmem (mgr.34373) 3856 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.592525+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.592544+0000 mgr.gibba043.dnkmem (mgr.34373) 3857 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:03:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.596423+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:47.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.596446+0000 mgr.gibba043.dnkmem (mgr.34373) 3858 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:03:47.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.782411+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:47.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.785965+0000 mon.c (mon.1) 1023 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:47.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.787536+0000 mon.c (mon.1) 1024 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.789178+0000 mon.c (mon.1) 1025 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.790527+0000 mon.c (mon.1) 1026 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.793571+0000 mon.c (mon.1) 1027 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[31385]: audit 2021-03-10T15:03:46.795200+0000 mon.c (mon.1) 1028 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: cluster 2021-03-10T15:03:46.256655+0000 mgr.gibba043.dnkmem (mgr.34373) 3856 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.592525+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.592544+0000 mgr.gibba043.dnkmem (mgr.34373) 3857 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:03:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.596423+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.596446+0000 mgr.gibba043.dnkmem (mgr.34373) 3858 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:03:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.782411+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.785965+0000 mon.c (mon.1) 1023 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.787536+0000 mon.c (mon.1) 1024 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.789178+0000 mon.c (mon.1) 1025 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.790527+0000 mon.c (mon.1) 1026 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.793571+0000 mon.c (mon.1) 1027 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:47.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:47 gibba003 bash[32348]: audit 2021-03-10T15:03:46.795200+0000 mon.c (mon.1) 1028 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: cluster 2021-03-10T15:03:46.256655+0000 mgr.gibba043.dnkmem (mgr.34373) 3856 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.592525+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.592544+0000 mgr.gibba043.dnkmem (mgr.34373) 3857 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:03:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.596423+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.596446+0000 mgr.gibba043.dnkmem (mgr.34373) 3858 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:03:48.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.782411+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:03:48.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.785965+0000 mon.c (mon.1) 1023 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:48.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.787536+0000 mon.c (mon.1) 1024 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:48.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.789178+0000 mon.c (mon.1) 1025 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:48.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.790527+0000 mon.c (mon.1) 1026 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:48.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.793571+0000 mon.c (mon.1) 1027 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:48.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:47 gibba043 bash[24019]: audit 2021-03-10T15:03:46.795200+0000 mon.c (mon.1) 1028 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.784360+0000 mgr.gibba043.dnkmem (mgr.34373) 3859 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:48.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.786225+0000 mgr.gibba043.dnkmem (mgr.34373) 3860 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:48.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.787750+0000 mgr.gibba043.dnkmem (mgr.34373) 3861 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:48.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.787788+0000 mgr.gibba043.dnkmem (mgr.34373) 3862 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:48.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.789318+0000 mgr.gibba043.dnkmem (mgr.34373) 3863 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:48.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.789360+0000 mgr.gibba043.dnkmem (mgr.34373) 3864 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:48.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.790416+0000 mgr.gibba043.dnkmem (mgr.34373) 3865 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:48.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.792077+0000 mgr.gibba043.dnkmem (mgr.34373) 3866 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:48.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.792113+0000 mgr.gibba043.dnkmem (mgr.34373) 3867 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:48.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.793436+0000 mgr.gibba043.dnkmem (mgr.34373) 3868 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:48.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.793845+0000 mgr.gibba043.dnkmem (mgr.34373) 3869 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:48.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.795208+0000 mgr.gibba043.dnkmem (mgr.34373) 3870 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:48.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.795246+0000 mgr.gibba043.dnkmem (mgr.34373) 3871 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:48.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[31385]: cephadm 2021-03-10T15:03:46.795410+0000 mgr.gibba043.dnkmem (mgr.34373) 3872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:48.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.784360+0000 mgr.gibba043.dnkmem (mgr.34373) 3859 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:48.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.786225+0000 mgr.gibba043.dnkmem (mgr.34373) 3860 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:48.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.787750+0000 mgr.gibba043.dnkmem (mgr.34373) 3861 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:48.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.787788+0000 mgr.gibba043.dnkmem (mgr.34373) 3862 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:48.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.789318+0000 mgr.gibba043.dnkmem (mgr.34373) 3863 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:48.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.789360+0000 mgr.gibba043.dnkmem (mgr.34373) 3864 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:48.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.790416+0000 mgr.gibba043.dnkmem (mgr.34373) 3865 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:48.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.792077+0000 mgr.gibba043.dnkmem (mgr.34373) 3866 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:48.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.792113+0000 mgr.gibba043.dnkmem (mgr.34373) 3867 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:48.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.793436+0000 mgr.gibba043.dnkmem (mgr.34373) 3868 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:48.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.793845+0000 mgr.gibba043.dnkmem (mgr.34373) 3869 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:48.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.795208+0000 mgr.gibba043.dnkmem (mgr.34373) 3870 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:48.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.795246+0000 mgr.gibba043.dnkmem (mgr.34373) 3871 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:48.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:48 gibba003 bash[32348]: cephadm 2021-03-10T15:03:46.795410+0000 mgr.gibba043.dnkmem (mgr.34373) 3872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.784360+0000 mgr.gibba043.dnkmem (mgr.34373) 3859 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.786225+0000 mgr.gibba043.dnkmem (mgr.34373) 3860 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.787750+0000 mgr.gibba043.dnkmem (mgr.34373) 3861 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.787788+0000 mgr.gibba043.dnkmem (mgr.34373) 3862 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:49.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.789318+0000 mgr.gibba043.dnkmem (mgr.34373) 3863 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:49.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.789360+0000 mgr.gibba043.dnkmem (mgr.34373) 3864 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:49.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.790416+0000 mgr.gibba043.dnkmem (mgr.34373) 3865 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:49.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.792077+0000 mgr.gibba043.dnkmem (mgr.34373) 3866 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:49.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.792113+0000 mgr.gibba043.dnkmem (mgr.34373) 3867 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:49.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.793436+0000 mgr.gibba043.dnkmem (mgr.34373) 3868 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:49.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.793845+0000 mgr.gibba043.dnkmem (mgr.34373) 3869 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:49.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.795208+0000 mgr.gibba043.dnkmem (mgr.34373) 3870 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:49.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.795246+0000 mgr.gibba043.dnkmem (mgr.34373) 3871 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:49.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:48 gibba043 bash[24019]: cephadm 2021-03-10T15:03:46.795410+0000 mgr.gibba043.dnkmem (mgr.34373) 3872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:03:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:49 gibba003 bash[31385]: cluster 2021-03-10T15:03:48.257312+0000 mgr.gibba043.dnkmem (mgr.34373) 3873 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:49 gibba003 bash[32348]: cluster 2021-03-10T15:03:48.257312+0000 mgr.gibba043.dnkmem (mgr.34373) 3873 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:49 gibba043 bash[24019]: cluster 2021-03-10T15:03:48.257312+0000 mgr.gibba043.dnkmem (mgr.34373) 3873 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:51.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:51 gibba003 bash[31385]: cluster 2021-03-10T15:03:50.258597+0000 mgr.gibba043.dnkmem (mgr.34373) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:51 gibba003 bash[32348]: cluster 2021-03-10T15:03:50.258597+0000 mgr.gibba043.dnkmem (mgr.34373) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:52.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:51 gibba043 bash[24019]: cluster 2021-03-10T15:03:50.258597+0000 mgr.gibba043.dnkmem (mgr.34373) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:53 gibba003 bash[31385]: cluster 2021-03-10T15:03:52.260242+0000 mgr.gibba043.dnkmem (mgr.34373) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:53 gibba003 bash[32348]: cluster 2021-03-10T15:03:52.260242+0000 mgr.gibba043.dnkmem (mgr.34373) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:53 gibba043 bash[24019]: cluster 2021-03-10T15:03:52.260242+0000 mgr.gibba043.dnkmem (mgr.34373) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:54 gibba043 bash[24019]: cluster 2021-03-10T15:03:54.261984+0000 mgr.gibba043.dnkmem (mgr.34373) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:54 gibba003 bash[31385]: cluster 2021-03-10T15:03:54.261984+0000 mgr.gibba043.dnkmem (mgr.34373) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:54 gibba003 bash[32348]: cluster 2021-03-10T15:03:54.261984+0000 mgr.gibba043.dnkmem (mgr.34373) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:57 gibba003 bash[31385]: cluster 2021-03-10T15:03:56.263621+0000 mgr.gibba043.dnkmem (mgr.34373) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:57.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:57 gibba003 bash[32348]: cluster 2021-03-10T15:03:56.263621+0000 mgr.gibba043.dnkmem (mgr.34373) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:57 gibba043 bash[24019]: cluster 2021-03-10T15:03:56.263621+0000 mgr.gibba043.dnkmem (mgr.34373) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:03:59 gibba003 bash[31385]: cluster 2021-03-10T15:03:58.265017+0000 mgr.gibba043.dnkmem (mgr.34373) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:59.733 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:03:59 gibba003 bash[32348]: cluster 2021-03-10T15:03:58.265017+0000 mgr.gibba043.dnkmem (mgr.34373) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:03:59 gibba043 bash[24019]: cluster 2021-03-10T15:03:58.265017+0000 mgr.gibba043.dnkmem (mgr.34373) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:01 gibba003 bash[31385]: cluster 2021-03-10T15:04:00.266395+0000 mgr.gibba043.dnkmem (mgr.34373) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:01 gibba003 bash[32348]: cluster 2021-03-10T15:04:00.266395+0000 mgr.gibba043.dnkmem (mgr.34373) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:01 gibba043 bash[24019]: cluster 2021-03-10T15:04:00.266395+0000 mgr.gibba043.dnkmem (mgr.34373) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:03 gibba003 bash[31385]: cephadm 2021-03-10T15:04:01.808634+0000 mgr.gibba043.dnkmem (mgr.34373) 3880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:03 gibba003 bash[31385]: cluster 2021-03-10T15:04:02.268119+0000 mgr.gibba043.dnkmem (mgr.34373) 3881 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:03 gibba003 bash[32348]: cephadm 2021-03-10T15:04:01.808634+0000 mgr.gibba043.dnkmem (mgr.34373) 3880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:03.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:03 gibba003 bash[32348]: cluster 2021-03-10T15:04:02.268119+0000 mgr.gibba043.dnkmem (mgr.34373) 3881 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:03 gibba043 bash[24019]: cephadm 2021-03-10T15:04:01.808634+0000 mgr.gibba043.dnkmem (mgr.34373) 3880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:03 gibba043 bash[24019]: cluster 2021-03-10T15:04:02.268119+0000 mgr.gibba043.dnkmem (mgr.34373) 3881 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:04 gibba043 bash[24019]: cluster 2021-03-10T15:04:04.268854+0000 mgr.gibba043.dnkmem (mgr.34373) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:04 gibba003 bash[31385]: cluster 2021-03-10T15:04:04.268854+0000 mgr.gibba043.dnkmem (mgr.34373) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:04 gibba003 bash[32348]: cluster 2021-03-10T15:04:04.268854+0000 mgr.gibba043.dnkmem (mgr.34373) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:07 gibba003 bash[31385]: cluster 2021-03-10T15:04:06.270643+0000 mgr.gibba043.dnkmem (mgr.34373) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:07 gibba003 bash[32348]: cluster 2021-03-10T15:04:06.270643+0000 mgr.gibba043.dnkmem (mgr.34373) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:07 gibba043 bash[24019]: cluster 2021-03-10T15:04:06.270643+0000 mgr.gibba043.dnkmem (mgr.34373) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:09 gibba003 bash[31385]: cluster 2021-03-10T15:04:08.272242+0000 mgr.gibba043.dnkmem (mgr.34373) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:09 gibba003 bash[32348]: cluster 2021-03-10T15:04:08.272242+0000 mgr.gibba043.dnkmem (mgr.34373) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:09.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:09 gibba043 bash[24019]: cluster 2021-03-10T15:04:08.272242+0000 mgr.gibba043.dnkmem (mgr.34373) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:11 gibba003 bash[31385]: cluster 2021-03-10T15:04:10.273805+0000 mgr.gibba043.dnkmem (mgr.34373) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:11 gibba003 bash[32348]: cluster 2021-03-10T15:04:10.273805+0000 mgr.gibba043.dnkmem (mgr.34373) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:11 gibba043 bash[24019]: cluster 2021-03-10T15:04:10.273805+0000 mgr.gibba043.dnkmem (mgr.34373) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: cluster 2021-03-10T15:04:12.274802+0000 mgr.gibba043.dnkmem (mgr.34373) 3886 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.166733+0000 mon.c (mon.1) 1029 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.167895+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.256120+0000 mon.c (mon.1) 1030 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.257246+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.291451+0000 mon.c (mon.1) 1031 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.292166+0000 mon.c (mon.1) 1032 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.292655+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.293172+0000 mon.c (mon.1) 1033 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.293837+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.294578+0000 mon.c (mon.1) 1034 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:04:13.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.294769+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[31385]: audit 2021-03-10T15:04:13.295831+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:04:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: cluster 2021-03-10T15:04:12.274802+0000 mgr.gibba043.dnkmem (mgr.34373) 3886 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.166733+0000 mon.c (mon.1) 1029 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.167895+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.256120+0000 mon.c (mon.1) 1030 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.257246+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.291451+0000 mon.c (mon.1) 1031 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.292166+0000 mon.c (mon.1) 1032 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.292655+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.293172+0000 mon.c (mon.1) 1033 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.293837+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.294578+0000 mon.c (mon.1) 1034 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:04:13.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.294769+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:13 gibba003 bash[32348]: audit 2021-03-10T15:04:13.295831+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:04:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: cluster 2021-03-10T15:04:12.274802+0000 mgr.gibba043.dnkmem (mgr.34373) 3886 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.166733+0000 mon.c (mon.1) 1029 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.167895+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.256120+0000 mon.c (mon.1) 1030 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.257246+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.291451+0000 mon.c (mon.1) 1031 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.292166+0000 mon.c (mon.1) 1032 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.292655+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.293172+0000 mon.c (mon.1) 1033 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.293837+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.294578+0000 mon.c (mon.1) 1034 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:04:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.294769+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:04:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:13 gibba043 bash[24019]: audit 2021-03-10T15:04:13.295831+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:04:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:14 gibba043 bash[24019]: cluster 2021-03-10T15:04:14.276359+0000 mgr.gibba043.dnkmem (mgr.34373) 3887 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:14 gibba003 bash[31385]: cluster 2021-03-10T15:04:14.276359+0000 mgr.gibba043.dnkmem (mgr.34373) 3887 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:14 gibba003 bash[32348]: cluster 2021-03-10T15:04:14.276359+0000 mgr.gibba043.dnkmem (mgr.34373) 3887 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:15.305 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:04:15.533 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:04:15.533 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (72m) 7m ago 77m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:04:15.533 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (77m) 6m ago 77m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:04:15.533 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (72m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:04:15.534 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:04:15.534 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:04:15.534 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:04:15.534 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:04:15.535 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (71m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:04:15.535 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (78m) 7m ago 78m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:04:15.535 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (78m) 6m ago 78m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:04:15.535 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (70m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:04:15.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:04:15.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:04:15.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:04:15.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:04:15.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:04:15.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:04:15.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (67m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:04:15.537 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (77m) 6m ago 78m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:04:15.537 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 76m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:04:15.782 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:04:15.783 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:04:15.783 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:15.783 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:04:15.783 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:04:15.783 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:15.784 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:04:15.784 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:04:15.784 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:04:15.784 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:04:15.785 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:04:15.785 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:04:15.785 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:04:15.785 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:04:15.786 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:04:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:15 gibba043 bash[24019]: audit 2021-03-10T15:04:15.293793+0000 mgr.gibba043.dnkmem (mgr.34373) 3888 : audit [DBG] from='client.56650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:15 gibba043 bash[24019]: audit 2021-03-10T15:04:15.517916+0000 mgr.gibba043.dnkmem (mgr.34373) 3889 : audit [DBG] from='client.56656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:15 gibba003 bash[31385]: audit 2021-03-10T15:04:15.293793+0000 mgr.gibba043.dnkmem (mgr.34373) 3888 : audit [DBG] from='client.56650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:15 gibba003 bash[31385]: audit 2021-03-10T15:04:15.517916+0000 mgr.gibba043.dnkmem (mgr.34373) 3889 : audit [DBG] from='client.56656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:16.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:15 gibba003 bash[32348]: audit 2021-03-10T15:04:15.293793+0000 mgr.gibba043.dnkmem (mgr.34373) 3888 : audit [DBG] from='client.56650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:16.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:15 gibba003 bash[32348]: audit 2021-03-10T15:04:15.517916+0000 mgr.gibba043.dnkmem (mgr.34373) 3889 : audit [DBG] from='client.56656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:16 gibba043 bash[24019]: audit 2021-03-10T15:04:15.780554+0000 mon.c (mon.1) 1035 : audit [DBG] from='client.? 172.21.2.103:0/2802651551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:16 gibba043 bash[24019]: cluster 2021-03-10T15:04:16.278115+0000 mgr.gibba043.dnkmem (mgr.34373) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:16 gibba003 bash[31385]: audit 2021-03-10T15:04:15.780554+0000 mon.c (mon.1) 1035 : audit [DBG] from='client.? 172.21.2.103:0/2802651551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:16 gibba003 bash[31385]: cluster 2021-03-10T15:04:16.278115+0000 mgr.gibba043.dnkmem (mgr.34373) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:17.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:16 gibba003 bash[32348]: audit 2021-03-10T15:04:15.780554+0000 mon.c (mon.1) 1035 : audit [DBG] from='client.? 172.21.2.103:0/2802651551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:17.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:16 gibba003 bash[32348]: cluster 2021-03-10T15:04:16.278115+0000 mgr.gibba043.dnkmem (mgr.34373) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:17 gibba003 bash[31385]: cephadm 2021-03-10T15:04:16.821834+0000 mgr.gibba043.dnkmem (mgr.34373) 3891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:18.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:17 gibba003 bash[32348]: cephadm 2021-03-10T15:04:16.821834+0000 mgr.gibba043.dnkmem (mgr.34373) 3891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:17 gibba043 bash[24019]: cephadm 2021-03-10T15:04:16.821834+0000 mgr.gibba043.dnkmem (mgr.34373) 3891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:18 gibba003 bash[31385]: cluster 2021-03-10T15:04:18.279651+0000 mgr.gibba043.dnkmem (mgr.34373) 3892 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:18 gibba003 bash[32348]: cluster 2021-03-10T15:04:18.279651+0000 mgr.gibba043.dnkmem (mgr.34373) 3892 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:18 gibba043 bash[24019]: cluster 2021-03-10T15:04:18.279651+0000 mgr.gibba043.dnkmem (mgr.34373) 3892 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:21.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:21 gibba003 bash[31385]: cluster 2021-03-10T15:04:20.280948+0000 mgr.gibba043.dnkmem (mgr.34373) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:21 gibba003 bash[32348]: cluster 2021-03-10T15:04:20.280948+0000 mgr.gibba043.dnkmem (mgr.34373) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:21 gibba043 bash[24019]: cluster 2021-03-10T15:04:20.280948+0000 mgr.gibba043.dnkmem (mgr.34373) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:23.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:23 gibba003 bash[31385]: cluster 2021-03-10T15:04:22.282477+0000 mgr.gibba043.dnkmem (mgr.34373) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:23.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:23 gibba003 bash[32348]: cluster 2021-03-10T15:04:22.282477+0000 mgr.gibba043.dnkmem (mgr.34373) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:23 gibba043 bash[24019]: cluster 2021-03-10T15:04:22.282477+0000 mgr.gibba043.dnkmem (mgr.34373) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:24 gibba043 bash[24019]: cluster 2021-03-10T15:04:24.284163+0000 mgr.gibba043.dnkmem (mgr.34373) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:24 gibba003 bash[31385]: cluster 2021-03-10T15:04:24.284163+0000 mgr.gibba043.dnkmem (mgr.34373) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:24 gibba003 bash[32348]: cluster 2021-03-10T15:04:24.284163+0000 mgr.gibba043.dnkmem (mgr.34373) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:27 gibba003 bash[31385]: cluster 2021-03-10T15:04:26.286144+0000 mgr.gibba043.dnkmem (mgr.34373) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:27.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:27 gibba003 bash[32348]: cluster 2021-03-10T15:04:26.286144+0000 mgr.gibba043.dnkmem (mgr.34373) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:27 gibba043 bash[24019]: cluster 2021-03-10T15:04:26.286144+0000 mgr.gibba043.dnkmem (mgr.34373) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:29 gibba003 bash[31385]: cluster 2021-03-10T15:04:28.287039+0000 mgr.gibba043.dnkmem (mgr.34373) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:29 gibba003 bash[32348]: cluster 2021-03-10T15:04:28.287039+0000 mgr.gibba043.dnkmem (mgr.34373) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:29 gibba043 bash[24019]: cluster 2021-03-10T15:04:28.287039+0000 mgr.gibba043.dnkmem (mgr.34373) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:31 gibba003 bash[31385]: cluster 2021-03-10T15:04:30.288254+0000 mgr.gibba043.dnkmem (mgr.34373) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:31 gibba003 bash[32348]: cluster 2021-03-10T15:04:30.288254+0000 mgr.gibba043.dnkmem (mgr.34373) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:31 gibba043 bash[24019]: cluster 2021-03-10T15:04:30.288254+0000 mgr.gibba043.dnkmem (mgr.34373) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:33 gibba003 bash[31385]: cephadm 2021-03-10T15:04:31.837888+0000 mgr.gibba043.dnkmem (mgr.34373) 3899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:33 gibba003 bash[31385]: cluster 2021-03-10T15:04:32.289629+0000 mgr.gibba043.dnkmem (mgr.34373) 3900 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:33 gibba003 bash[32348]: cephadm 2021-03-10T15:04:31.837888+0000 mgr.gibba043.dnkmem (mgr.34373) 3899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:33 gibba003 bash[32348]: cluster 2021-03-10T15:04:32.289629+0000 mgr.gibba043.dnkmem (mgr.34373) 3900 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:33 gibba043 bash[24019]: cephadm 2021-03-10T15:04:31.837888+0000 mgr.gibba043.dnkmem (mgr.34373) 3899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:33 gibba043 bash[24019]: cluster 2021-03-10T15:04:32.289629+0000 mgr.gibba043.dnkmem (mgr.34373) 3900 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:34 gibba043 bash[24019]: cluster 2021-03-10T15:04:34.291095+0000 mgr.gibba043.dnkmem (mgr.34373) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:34 gibba003 bash[31385]: cluster 2021-03-10T15:04:34.291095+0000 mgr.gibba043.dnkmem (mgr.34373) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:34 gibba003 bash[32348]: cluster 2021-03-10T15:04:34.291095+0000 mgr.gibba043.dnkmem (mgr.34373) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:37 gibba003 bash[31385]: cluster 2021-03-10T15:04:36.292034+0000 mgr.gibba043.dnkmem (mgr.34373) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:37 gibba003 bash[32348]: cluster 2021-03-10T15:04:36.292034+0000 mgr.gibba043.dnkmem (mgr.34373) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:37 gibba043 bash[24019]: cluster 2021-03-10T15:04:36.292034+0000 mgr.gibba043.dnkmem (mgr.34373) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:39 gibba003 bash[31385]: cluster 2021-03-10T15:04:38.293607+0000 mgr.gibba043.dnkmem (mgr.34373) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:39 gibba003 bash[32348]: cluster 2021-03-10T15:04:38.293607+0000 mgr.gibba043.dnkmem (mgr.34373) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:39 gibba043 bash[24019]: cluster 2021-03-10T15:04:38.293607+0000 mgr.gibba043.dnkmem (mgr.34373) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:41 gibba003 bash[31385]: cluster 2021-03-10T15:04:40.295245+0000 mgr.gibba043.dnkmem (mgr.34373) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:41 gibba003 bash[32348]: cluster 2021-03-10T15:04:40.295245+0000 mgr.gibba043.dnkmem (mgr.34373) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:41 gibba043 bash[24019]: cluster 2021-03-10T15:04:40.295245+0000 mgr.gibba043.dnkmem (mgr.34373) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:43 gibba003 bash[31385]: cluster 2021-03-10T15:04:42.296937+0000 mgr.gibba043.dnkmem (mgr.34373) 3905 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:43 gibba003 bash[32348]: cluster 2021-03-10T15:04:42.296937+0000 mgr.gibba043.dnkmem (mgr.34373) 3905 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:43 gibba043 bash[24019]: cluster 2021-03-10T15:04:42.296937+0000 mgr.gibba043.dnkmem (mgr.34373) 3905 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:44 gibba003 bash[31385]: cluster 2021-03-10T15:04:44.298197+0000 mgr.gibba043.dnkmem (mgr.34373) 3906 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:44 gibba003 bash[32348]: cluster 2021-03-10T15:04:44.298197+0000 mgr.gibba043.dnkmem (mgr.34373) 3906 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:44 gibba043 bash[24019]: cluster 2021-03-10T15:04:44.298197+0000 mgr.gibba043.dnkmem (mgr.34373) 3906 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:46.026 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:04:46.251 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:04:46.252 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (73m) 8m ago 78m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:04:46.252 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (78m) 7m ago 78m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:04:46.252 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (73m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:04:46.253 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (73m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:04:46.253 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (72m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:04:46.253 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (72m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:04:46.253 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (72m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:04:46.254 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (72m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:04:46.254 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (78m) 8m ago 78m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:04:46.254 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (78m) 7m ago 78m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:04:46.254 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:04:46.254 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:04:46.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:04:46.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:04:46.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:04:46.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:04:46.256 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (68m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:04:46.256 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (68m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:04:46.256 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (77m) 7m ago 78m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:04:46.256 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 76m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:04:46.506 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:04:46.507 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:04:46.507 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:46.507 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:04:46.508 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:04:46.508 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:46.508 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:04:46.508 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:04:46.509 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:04:46.509 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:04:46.509 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:04:46.509 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:04:46.510 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:04:46.510 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:04:46.510 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:04:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:46.014528+0000 mgr.gibba043.dnkmem (mgr.34373) 3907 : audit [DBG] from='client.46680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:46.237267+0000 mgr.gibba043.dnkmem (mgr.34373) 3908 : audit [DBG] from='client.56674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: cluster 2021-03-10T15:04:46.299253+0000 mgr.gibba043.dnkmem (mgr.34373) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:46.504937+0000 mon.c (mon.1) 1036 : audit [DBG] from='client.? 172.21.2.103:0/3707920144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.059257+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:04:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.063319+0000 mon.c (mon.1) 1037 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.064965+0000 mon.c (mon.1) 1038 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.066162+0000 mon.c (mon.1) 1039 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.067333+0000 mon.c (mon.1) 1040 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.070468+0000 mon.c (mon.1) 1041 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[31385]: audit 2021-03-10T15:04:47.072099+0000 mon.c (mon.1) 1042 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:46.014528+0000 mgr.gibba043.dnkmem (mgr.34373) 3907 : audit [DBG] from='client.46680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:47.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:46.237267+0000 mgr.gibba043.dnkmem (mgr.34373) 3908 : audit [DBG] from='client.56674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:47.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: cluster 2021-03-10T15:04:46.299253+0000 mgr.gibba043.dnkmem (mgr.34373) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:47.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:46.504937+0000 mon.c (mon.1) 1036 : audit [DBG] from='client.? 172.21.2.103:0/3707920144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.059257+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:04:47.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.063319+0000 mon.c (mon.1) 1037 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:47.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.064965+0000 mon.c (mon.1) 1038 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.066162+0000 mon.c (mon.1) 1039 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.067333+0000 mon.c (mon.1) 1040 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.070468+0000 mon.c (mon.1) 1041 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:47 gibba003 bash[32348]: audit 2021-03-10T15:04:47.072099+0000 mon.c (mon.1) 1042 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:46.014528+0000 mgr.gibba043.dnkmem (mgr.34373) 3907 : audit [DBG] from='client.46680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:46.237267+0000 mgr.gibba043.dnkmem (mgr.34373) 3908 : audit [DBG] from='client.56674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: cluster 2021-03-10T15:04:46.299253+0000 mgr.gibba043.dnkmem (mgr.34373) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:46.504937+0000 mon.c (mon.1) 1036 : audit [DBG] from='client.? 172.21.2.103:0/3707920144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.059257+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:04:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.063319+0000 mon.c (mon.1) 1037 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.064965+0000 mon.c (mon.1) 1038 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.066162+0000 mon.c (mon.1) 1039 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.067333+0000 mon.c (mon.1) 1040 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.070468+0000 mon.c (mon.1) 1041 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:47.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:47 gibba043 bash[24019]: audit 2021-03-10T15:04:47.072099+0000 mon.c (mon.1) 1042 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:48.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:46.854679+0000 mgr.gibba043.dnkmem (mgr.34373) 3910 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:04:48.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:46.856261+0000 mgr.gibba043.dnkmem (mgr.34373) 3911 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:04:48.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.061566+0000 mgr.gibba043.dnkmem (mgr.34373) 3912 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:48.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.063557+0000 mgr.gibba043.dnkmem (mgr.34373) 3913 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.064906+0000 mgr.gibba043.dnkmem (mgr.34373) 3914 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.064944+0000 mgr.gibba043.dnkmem (mgr.34373) 3915 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.066088+0000 mgr.gibba043.dnkmem (mgr.34373) 3916 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.066126+0000 mgr.gibba043.dnkmem (mgr.34373) 3917 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.067438+0000 mgr.gibba043.dnkmem (mgr.34373) 3918 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.069105+0000 mgr.gibba043.dnkmem (mgr.34373) 3919 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.069145+0000 mgr.gibba043.dnkmem (mgr.34373) 3920 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.070505+0000 mgr.gibba043.dnkmem (mgr.34373) 3921 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.070914+0000 mgr.gibba043.dnkmem (mgr.34373) 3922 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.071998+0000 mgr.gibba043.dnkmem (mgr.34373) 3923 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.072034+0000 mgr.gibba043.dnkmem (mgr.34373) 3924 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[31385]: cephadm 2021-03-10T15:04:47.072142+0000 mgr.gibba043.dnkmem (mgr.34373) 3925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:48.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:46.854679+0000 mgr.gibba043.dnkmem (mgr.34373) 3910 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:04:48.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:46.856261+0000 mgr.gibba043.dnkmem (mgr.34373) 3911 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:04:48.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.061566+0000 mgr.gibba043.dnkmem (mgr.34373) 3912 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:48.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.063557+0000 mgr.gibba043.dnkmem (mgr.34373) 3913 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.064906+0000 mgr.gibba043.dnkmem (mgr.34373) 3914 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.064944+0000 mgr.gibba043.dnkmem (mgr.34373) 3915 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.066088+0000 mgr.gibba043.dnkmem (mgr.34373) 3916 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.066126+0000 mgr.gibba043.dnkmem (mgr.34373) 3917 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.067438+0000 mgr.gibba043.dnkmem (mgr.34373) 3918 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.069105+0000 mgr.gibba043.dnkmem (mgr.34373) 3919 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.069145+0000 mgr.gibba043.dnkmem (mgr.34373) 3920 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.070505+0000 mgr.gibba043.dnkmem (mgr.34373) 3921 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.070914+0000 mgr.gibba043.dnkmem (mgr.34373) 3922 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.071998+0000 mgr.gibba043.dnkmem (mgr.34373) 3923 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.072034+0000 mgr.gibba043.dnkmem (mgr.34373) 3924 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:48 gibba003 bash[32348]: cephadm 2021-03-10T15:04:47.072142+0000 mgr.gibba043.dnkmem (mgr.34373) 3925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:48.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:46.854679+0000 mgr.gibba043.dnkmem (mgr.34373) 3910 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:04:48.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:46.856261+0000 mgr.gibba043.dnkmem (mgr.34373) 3911 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:04:48.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.061566+0000 mgr.gibba043.dnkmem (mgr.34373) 3912 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:48.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.063557+0000 mgr.gibba043.dnkmem (mgr.34373) 3913 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:48.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.064906+0000 mgr.gibba043.dnkmem (mgr.34373) 3914 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.064944+0000 mgr.gibba043.dnkmem (mgr.34373) 3915 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.066088+0000 mgr.gibba043.dnkmem (mgr.34373) 3916 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.066126+0000 mgr.gibba043.dnkmem (mgr.34373) 3917 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.067438+0000 mgr.gibba043.dnkmem (mgr.34373) 3918 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.069105+0000 mgr.gibba043.dnkmem (mgr.34373) 3919 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.069145+0000 mgr.gibba043.dnkmem (mgr.34373) 3920 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.070505+0000 mgr.gibba043.dnkmem (mgr.34373) 3921 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.070914+0000 mgr.gibba043.dnkmem (mgr.34373) 3922 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.071998+0000 mgr.gibba043.dnkmem (mgr.34373) 3923 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.072034+0000 mgr.gibba043.dnkmem (mgr.34373) 3924 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:48 gibba043 bash[24019]: cephadm 2021-03-10T15:04:47.072142+0000 mgr.gibba043.dnkmem (mgr.34373) 3925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:04:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:49 gibba003 bash[31385]: cluster 2021-03-10T15:04:48.300945+0000 mgr.gibba043.dnkmem (mgr.34373) 3926 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:49 gibba003 bash[32348]: cluster 2021-03-10T15:04:48.300945+0000 mgr.gibba043.dnkmem (mgr.34373) 3926 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:49 gibba043 bash[24019]: cluster 2021-03-10T15:04:48.300945+0000 mgr.gibba043.dnkmem (mgr.34373) 3926 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:51.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:51 gibba003 bash[31385]: cluster 2021-03-10T15:04:50.302569+0000 mgr.gibba043.dnkmem (mgr.34373) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:51 gibba003 bash[32348]: cluster 2021-03-10T15:04:50.302569+0000 mgr.gibba043.dnkmem (mgr.34373) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:51.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:51 gibba043 bash[24019]: cluster 2021-03-10T15:04:50.302569+0000 mgr.gibba043.dnkmem (mgr.34373) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:53 gibba003 bash[31385]: cluster 2021-03-10T15:04:52.303431+0000 mgr.gibba043.dnkmem (mgr.34373) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:53 gibba003 bash[32348]: cluster 2021-03-10T15:04:52.303431+0000 mgr.gibba043.dnkmem (mgr.34373) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:53 gibba043 bash[24019]: cluster 2021-03-10T15:04:52.303431+0000 mgr.gibba043.dnkmem (mgr.34373) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:54 gibba003 bash[31385]: cluster 2021-03-10T15:04:54.304945+0000 mgr.gibba043.dnkmem (mgr.34373) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:54 gibba003 bash[32348]: cluster 2021-03-10T15:04:54.304945+0000 mgr.gibba043.dnkmem (mgr.34373) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:54 gibba043 bash[24019]: cluster 2021-03-10T15:04:54.304945+0000 mgr.gibba043.dnkmem (mgr.34373) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:57 gibba003 bash[31385]: cluster 2021-03-10T15:04:56.306818+0000 mgr.gibba043.dnkmem (mgr.34373) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:57.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:57 gibba003 bash[32348]: cluster 2021-03-10T15:04:56.306818+0000 mgr.gibba043.dnkmem (mgr.34373) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:57 gibba043 bash[24019]: cluster 2021-03-10T15:04:56.306818+0000 mgr.gibba043.dnkmem (mgr.34373) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:04:59 gibba003 bash[31385]: cluster 2021-03-10T15:04:58.308484+0000 mgr.gibba043.dnkmem (mgr.34373) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:04:59 gibba003 bash[32348]: cluster 2021-03-10T15:04:58.308484+0000 mgr.gibba043.dnkmem (mgr.34373) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:04:59 gibba043 bash[24019]: cluster 2021-03-10T15:04:58.308484+0000 mgr.gibba043.dnkmem (mgr.34373) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:01 gibba003 bash[31385]: cluster 2021-03-10T15:05:00.309682+0000 mgr.gibba043.dnkmem (mgr.34373) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:01 gibba003 bash[32348]: cluster 2021-03-10T15:05:00.309682+0000 mgr.gibba043.dnkmem (mgr.34373) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:01.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:01 gibba043 bash[24019]: cluster 2021-03-10T15:05:00.309682+0000 mgr.gibba043.dnkmem (mgr.34373) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:03 gibba003 bash[31385]: cephadm 2021-03-10T15:05:02.088284+0000 mgr.gibba043.dnkmem (mgr.34373) 3933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:03 gibba003 bash[31385]: cluster 2021-03-10T15:05:02.311281+0000 mgr.gibba043.dnkmem (mgr.34373) 3934 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:03.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:03 gibba003 bash[32348]: cephadm 2021-03-10T15:05:02.088284+0000 mgr.gibba043.dnkmem (mgr.34373) 3933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:03.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:03 gibba003 bash[32348]: cluster 2021-03-10T15:05:02.311281+0000 mgr.gibba043.dnkmem (mgr.34373) 3934 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:03 gibba043 bash[24019]: cephadm 2021-03-10T15:05:02.088284+0000 mgr.gibba043.dnkmem (mgr.34373) 3933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:03 gibba043 bash[24019]: cluster 2021-03-10T15:05:02.311281+0000 mgr.gibba043.dnkmem (mgr.34373) 3934 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:04 gibba003 bash[31385]: cluster 2021-03-10T15:05:04.312980+0000 mgr.gibba043.dnkmem (mgr.34373) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:05.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:04 gibba003 bash[32348]: cluster 2021-03-10T15:05:04.312980+0000 mgr.gibba043.dnkmem (mgr.34373) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:04 gibba043 bash[24019]: cluster 2021-03-10T15:05:04.312980+0000 mgr.gibba043.dnkmem (mgr.34373) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:07 gibba003 bash[31385]: cluster 2021-03-10T15:05:06.314945+0000 mgr.gibba043.dnkmem (mgr.34373) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:07 gibba003 bash[32348]: cluster 2021-03-10T15:05:06.314945+0000 mgr.gibba043.dnkmem (mgr.34373) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:07 gibba043 bash[24019]: cluster 2021-03-10T15:05:06.314945+0000 mgr.gibba043.dnkmem (mgr.34373) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:09 gibba003 bash[31385]: cluster 2021-03-10T15:05:08.316323+0000 mgr.gibba043.dnkmem (mgr.34373) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:09 gibba003 bash[32348]: cluster 2021-03-10T15:05:08.316323+0000 mgr.gibba043.dnkmem (mgr.34373) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:09.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:09 gibba043 bash[24019]: cluster 2021-03-10T15:05:08.316323+0000 mgr.gibba043.dnkmem (mgr.34373) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:11 gibba003 bash[31385]: cluster 2021-03-10T15:05:10.317797+0000 mgr.gibba043.dnkmem (mgr.34373) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:11 gibba003 bash[32348]: cluster 2021-03-10T15:05:10.317797+0000 mgr.gibba043.dnkmem (mgr.34373) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:11 gibba043 bash[24019]: cluster 2021-03-10T15:05:10.317797+0000 mgr.gibba043.dnkmem (mgr.34373) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: cluster 2021-03-10T15:05:12.319404+0000 mgr.gibba043.dnkmem (mgr.34373) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.173543+0000 mon.c (mon.1) 1043 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.174661+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.264507+0000 mon.c (mon.1) 1044 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.265616+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.301266+0000 mon.c (mon.1) 1045 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:05:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.302036+0000 mon.c (mon.1) 1046 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.302469+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:05:13.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.302727+0000 mon.c (mon.1) 1047 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.303640+0000 mon.c (mon.1) 1048 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:05:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.303768+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.304973+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[31385]: audit 2021-03-10T15:05:13.305754+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:05:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: cluster 2021-03-10T15:05:12.319404+0000 mgr.gibba043.dnkmem (mgr.34373) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.173543+0000 mon.c (mon.1) 1043 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.174661+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:13.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.264507+0000 mon.c (mon.1) 1044 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.265616+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.301266+0000 mon.c (mon.1) 1045 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:05:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.302036+0000 mon.c (mon.1) 1046 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.302469+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:05:13.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.302727+0000 mon.c (mon.1) 1047 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.303640+0000 mon.c (mon.1) 1048 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:05:13.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.303768+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.304973+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:13 gibba003 bash[32348]: audit 2021-03-10T15:05:13.305754+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:05:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: cluster 2021-03-10T15:05:12.319404+0000 mgr.gibba043.dnkmem (mgr.34373) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.173543+0000 mon.c (mon.1) 1043 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.174661+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.264507+0000 mon.c (mon.1) 1044 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.265616+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.301266+0000 mon.c (mon.1) 1045 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:05:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.302036+0000 mon.c (mon.1) 1046 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.302469+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:05:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.302727+0000 mon.c (mon.1) 1047 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.303640+0000 mon.c (mon.1) 1048 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:05:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.303768+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.304973+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:05:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:13 gibba043 bash[24019]: audit 2021-03-10T15:05:13.305754+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:05:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:14 gibba003 bash[31385]: cluster 2021-03-10T15:05:14.321090+0000 mgr.gibba043.dnkmem (mgr.34373) 3940 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:14 gibba003 bash[32348]: cluster 2021-03-10T15:05:14.321090+0000 mgr.gibba043.dnkmem (mgr.34373) 3940 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:14 gibba043 bash[24019]: cluster 2021-03-10T15:05:14.321090+0000 mgr.gibba043.dnkmem (mgr.34373) 3940 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:16.792 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:05:17.020 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:05:17.021 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (73m) 8m ago 78m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:05:17.021 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (78m) 7m ago 78m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:05:17.021 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (73m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:05:17.021 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:05:17.022 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (73m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:05:17.022 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (73m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:05:17.022 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (72m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:05:17.022 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (72m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:05:17.023 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (79m) 8m ago 79m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:05:17.023 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (79m) 7m ago 79m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:05:17.023 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (71m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:05:17.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:05:17.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:05:17.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:05:17.024 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:05:17.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:05:17.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:05:17.025 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (68m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:05:17.025 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (78m) 7m ago 79m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:05:17.025 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 77m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:05:17.267 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:05:17.267 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:05:17.267 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:05:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:05:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:05:17.269 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:05:17.269 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:05:17.269 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:05:17.269 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:05:17.269 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:05:17.270 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:05:17.270 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:05:17.270 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:05:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:17 gibba003 bash[31385]: cluster 2021-03-10T15:05:16.322537+0000 mgr.gibba043.dnkmem (mgr.34373) 3941 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:17 gibba003 bash[31385]: audit 2021-03-10T15:05:17.265407+0000 mon.c (mon.1) 1049 : audit [DBG] from='client.? 172.21.2.103:0/332436108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:17 gibba003 bash[32348]: cluster 2021-03-10T15:05:16.322537+0000 mgr.gibba043.dnkmem (mgr.34373) 3941 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:17 gibba003 bash[32348]: audit 2021-03-10T15:05:17.265407+0000 mon.c (mon.1) 1049 : audit [DBG] from='client.? 172.21.2.103:0/332436108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:17 gibba043 bash[24019]: cluster 2021-03-10T15:05:16.322537+0000 mgr.gibba043.dnkmem (mgr.34373) 3941 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:17 gibba043 bash[24019]: audit 2021-03-10T15:05:17.265407+0000 mon.c (mon.1) 1049 : audit [DBG] from='client.? 172.21.2.103:0/332436108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:18 gibba003 bash[31385]: audit 2021-03-10T15:05:16.780297+0000 mgr.gibba043.dnkmem (mgr.34373) 3942 : audit [DBG] from='client.46698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:18 gibba003 bash[31385]: audit 2021-03-10T15:05:17.006249+0000 mgr.gibba043.dnkmem (mgr.34373) 3943 : audit [DBG] from='client.56692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:18.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:18 gibba003 bash[31385]: cephadm 2021-03-10T15:05:17.100251+0000 mgr.gibba043.dnkmem (mgr.34373) 3944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:18.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:18 gibba003 bash[32348]: audit 2021-03-10T15:05:16.780297+0000 mgr.gibba043.dnkmem (mgr.34373) 3942 : audit [DBG] from='client.46698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:18.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:18 gibba003 bash[32348]: audit 2021-03-10T15:05:17.006249+0000 mgr.gibba043.dnkmem (mgr.34373) 3943 : audit [DBG] from='client.56692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:18.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:18 gibba003 bash[32348]: cephadm 2021-03-10T15:05:17.100251+0000 mgr.gibba043.dnkmem (mgr.34373) 3944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:18 gibba043 bash[24019]: audit 2021-03-10T15:05:16.780297+0000 mgr.gibba043.dnkmem (mgr.34373) 3942 : audit [DBG] from='client.46698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:18 gibba043 bash[24019]: audit 2021-03-10T15:05:17.006249+0000 mgr.gibba043.dnkmem (mgr.34373) 3943 : audit [DBG] from='client.56692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:18 gibba043 bash[24019]: cephadm 2021-03-10T15:05:17.100251+0000 mgr.gibba043.dnkmem (mgr.34373) 3944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:19 gibba003 bash[31385]: cluster 2021-03-10T15:05:18.324254+0000 mgr.gibba043.dnkmem (mgr.34373) 3945 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:19 gibba003 bash[32348]: cluster 2021-03-10T15:05:18.324254+0000 mgr.gibba043.dnkmem (mgr.34373) 3945 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:19 gibba043 bash[24019]: cluster 2021-03-10T15:05:18.324254+0000 mgr.gibba043.dnkmem (mgr.34373) 3945 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:21.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:21 gibba003 bash[31385]: cluster 2021-03-10T15:05:20.325710+0000 mgr.gibba043.dnkmem (mgr.34373) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:21 gibba003 bash[32348]: cluster 2021-03-10T15:05:20.325710+0000 mgr.gibba043.dnkmem (mgr.34373) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:21 gibba043 bash[24019]: cluster 2021-03-10T15:05:20.325710+0000 mgr.gibba043.dnkmem (mgr.34373) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:23.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:23 gibba003 bash[31385]: cluster 2021-03-10T15:05:22.327354+0000 mgr.gibba043.dnkmem (mgr.34373) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:23.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:23 gibba003 bash[32348]: cluster 2021-03-10T15:05:22.327354+0000 mgr.gibba043.dnkmem (mgr.34373) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:23.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:23 gibba043 bash[24019]: cluster 2021-03-10T15:05:22.327354+0000 mgr.gibba043.dnkmem (mgr.34373) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:25.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:24 gibba003 bash[31385]: cluster 2021-03-10T15:05:24.328856+0000 mgr.gibba043.dnkmem (mgr.34373) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:25.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:24 gibba003 bash[32348]: cluster 2021-03-10T15:05:24.328856+0000 mgr.gibba043.dnkmem (mgr.34373) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:24 gibba043 bash[24019]: cluster 2021-03-10T15:05:24.328856+0000 mgr.gibba043.dnkmem (mgr.34373) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:27 gibba003 bash[31385]: cluster 2021-03-10T15:05:26.330729+0000 mgr.gibba043.dnkmem (mgr.34373) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:27 gibba003 bash[32348]: cluster 2021-03-10T15:05:26.330729+0000 mgr.gibba043.dnkmem (mgr.34373) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:27 gibba043 bash[24019]: cluster 2021-03-10T15:05:26.330729+0000 mgr.gibba043.dnkmem (mgr.34373) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:29 gibba003 bash[31385]: cluster 2021-03-10T15:05:28.332466+0000 mgr.gibba043.dnkmem (mgr.34373) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:29 gibba003 bash[32348]: cluster 2021-03-10T15:05:28.332466+0000 mgr.gibba043.dnkmem (mgr.34373) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:29 gibba043 bash[24019]: cluster 2021-03-10T15:05:28.332466+0000 mgr.gibba043.dnkmem (mgr.34373) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:31 gibba003 bash[31385]: cluster 2021-03-10T15:05:30.333733+0000 mgr.gibba043.dnkmem (mgr.34373) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:31 gibba003 bash[32348]: cluster 2021-03-10T15:05:30.333733+0000 mgr.gibba043.dnkmem (mgr.34373) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:31 gibba043 bash[24019]: cluster 2021-03-10T15:05:30.333733+0000 mgr.gibba043.dnkmem (mgr.34373) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:33 gibba003 bash[31385]: cephadm 2021-03-10T15:05:32.116217+0000 mgr.gibba043.dnkmem (mgr.34373) 3952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:33 gibba003 bash[31385]: cluster 2021-03-10T15:05:32.335256+0000 mgr.gibba043.dnkmem (mgr.34373) 3953 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:33 gibba003 bash[32348]: cephadm 2021-03-10T15:05:32.116217+0000 mgr.gibba043.dnkmem (mgr.34373) 3952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:33 gibba003 bash[32348]: cluster 2021-03-10T15:05:32.335256+0000 mgr.gibba043.dnkmem (mgr.34373) 3953 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:33 gibba043 bash[24019]: cephadm 2021-03-10T15:05:32.116217+0000 mgr.gibba043.dnkmem (mgr.34373) 3952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:33 gibba043 bash[24019]: cluster 2021-03-10T15:05:32.335256+0000 mgr.gibba043.dnkmem (mgr.34373) 3953 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:34 gibba003 bash[31385]: cluster 2021-03-10T15:05:34.337086+0000 mgr.gibba043.dnkmem (mgr.34373) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:34 gibba003 bash[32348]: cluster 2021-03-10T15:05:34.337086+0000 mgr.gibba043.dnkmem (mgr.34373) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:34 gibba043 bash[24019]: cluster 2021-03-10T15:05:34.337086+0000 mgr.gibba043.dnkmem (mgr.34373) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:37 gibba003 bash[31385]: cluster 2021-03-10T15:05:36.339101+0000 mgr.gibba043.dnkmem (mgr.34373) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:37 gibba003 bash[32348]: cluster 2021-03-10T15:05:36.339101+0000 mgr.gibba043.dnkmem (mgr.34373) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:37 gibba043 bash[24019]: cluster 2021-03-10T15:05:36.339101+0000 mgr.gibba043.dnkmem (mgr.34373) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:39 gibba003 bash[31385]: cluster 2021-03-10T15:05:38.340923+0000 mgr.gibba043.dnkmem (mgr.34373) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:39 gibba003 bash[32348]: cluster 2021-03-10T15:05:38.340923+0000 mgr.gibba043.dnkmem (mgr.34373) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:39 gibba043 bash[24019]: cluster 2021-03-10T15:05:38.340923+0000 mgr.gibba043.dnkmem (mgr.34373) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:41 gibba003 bash[31385]: cluster 2021-03-10T15:05:40.342502+0000 mgr.gibba043.dnkmem (mgr.34373) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:41 gibba003 bash[32348]: cluster 2021-03-10T15:05:40.342502+0000 mgr.gibba043.dnkmem (mgr.34373) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:41 gibba043 bash[24019]: cluster 2021-03-10T15:05:40.342502+0000 mgr.gibba043.dnkmem (mgr.34373) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:43 gibba003 bash[31385]: cluster 2021-03-10T15:05:42.344055+0000 mgr.gibba043.dnkmem (mgr.34373) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:43 gibba003 bash[32348]: cluster 2021-03-10T15:05:42.344055+0000 mgr.gibba043.dnkmem (mgr.34373) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:43 gibba043 bash[24019]: cluster 2021-03-10T15:05:42.344055+0000 mgr.gibba043.dnkmem (mgr.34373) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:45.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:44 gibba003 bash[31385]: cluster 2021-03-10T15:05:44.345924+0000 mgr.gibba043.dnkmem (mgr.34373) 3959 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:45.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:44 gibba003 bash[32348]: cluster 2021-03-10T15:05:44.345924+0000 mgr.gibba043.dnkmem (mgr.34373) 3959 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:44 gibba043 bash[24019]: cluster 2021-03-10T15:05:44.345924+0000 mgr.gibba043.dnkmem (mgr.34373) 3959 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.512 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:05:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: cluster 2021-03-10T15:05:46.347900+0000 mgr.gibba043.dnkmem (mgr.34373) 3960 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.341457+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:05:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.345028+0000 mon.c (mon.1) 1050 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.346415+0000 mon.c (mon.1) 1051 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.347517+0000 mon.c (mon.1) 1052 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.348548+0000 mon.c (mon.1) 1053 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.350913+0000 mon.c (mon.1) 1054 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[31385]: audit 2021-03-10T15:05:47.352311+0000 mon.c (mon.1) 1055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: cluster 2021-03-10T15:05:46.347900+0000 mgr.gibba043.dnkmem (mgr.34373) 3960 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.341457+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:05:47.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.345028+0000 mon.c (mon.1) 1050 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:47.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.346415+0000 mon.c (mon.1) 1051 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.347517+0000 mon.c (mon.1) 1052 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.348548+0000 mon.c (mon.1) 1053 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.350913+0000 mon.c (mon.1) 1054 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:47 gibba003 bash[32348]: audit 2021-03-10T15:05:47.352311+0000 mon.c (mon.1) 1055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.772 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:05:47.773 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (74m) 9m ago 79m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:05:47.773 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (79m) 8m ago 79m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:05:47.774 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (74m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:05:47.774 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (74m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:05:47.775 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:05:47.775 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:05:47.776 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (73m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:05:47.776 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (73m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:05:47.777 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (79m) 9m ago 79m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:05:47.777 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (79m) 8m ago 79m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:05:47.777 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:05:47.778 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:05:47.778 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:05:47.779 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:05:47.779 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:05:47.780 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:05:47.780 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (69m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:05:47.781 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (69m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:05:47.781 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (79m) 8m ago 79m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:05:47.782 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 77m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:05:47.783 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: cluster 2021-03-10T15:05:46.347900+0000 mgr.gibba043.dnkmem (mgr.34373) 3960 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.783 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.341457+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:05:47.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.345028+0000 mon.c (mon.1) 1050 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:47.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.346415+0000 mon.c (mon.1) 1051 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.347517+0000 mon.c (mon.1) 1052 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.348548+0000 mon.c (mon.1) 1053 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.350913+0000 mon.c (mon.1) 1054 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:47.786 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:47 gibba043 bash[24019]: audit 2021-03-10T15:05:47.352311+0000 mon.c (mon.1) 1055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:48.022 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:05:48.023 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:05:48.023 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:48.024 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:05:48.024 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:05:48.025 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:48.025 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:05:48.026 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:05:48.026 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:05:48.027 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:05:48.027 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:05:48.027 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:05:48.028 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:05:48.028 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:05:48.029 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:05:48.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.133207+0000 mgr.gibba043.dnkmem (mgr.34373) 3961 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:05:48.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.134864+0000 mgr.gibba043.dnkmem (mgr.34373) 3962 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:05:48.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.343345+0000 mgr.gibba043.dnkmem (mgr.34373) 3963 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.345162+0000 mgr.gibba043.dnkmem (mgr.34373) 3964 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.346234+0000 mgr.gibba043.dnkmem (mgr.34373) 3965 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.346270+0000 mgr.gibba043.dnkmem (mgr.34373) 3966 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:48.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.347327+0000 mgr.gibba043.dnkmem (mgr.34373) 3967 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.347365+0000 mgr.gibba043.dnkmem (mgr.34373) 3968 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.348344+0000 mgr.gibba043.dnkmem (mgr.34373) 3969 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.349577+0000 mgr.gibba043.dnkmem (mgr.34373) 3970 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:48.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.349614+0000 mgr.gibba043.dnkmem (mgr.34373) 3971 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.350771+0000 mgr.gibba043.dnkmem (mgr.34373) 3972 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.351169+0000 mgr.gibba043.dnkmem (mgr.34373) 3973 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.352084+0000 mgr.gibba043.dnkmem (mgr.34373) 3974 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:48.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.352123+0000 mgr.gibba043.dnkmem (mgr.34373) 3975 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:48.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: cephadm 2021-03-10T15:05:47.352227+0000 mgr.gibba043.dnkmem (mgr.34373) 3976 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:48.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: audit 2021-03-10T15:05:47.500441+0000 mgr.gibba043.dnkmem (mgr.34373) 3977 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:48.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[31385]: audit 2021-03-10T15:05:48.020294+0000 mon.c (mon.1) 1056 : audit [DBG] from='client.? 172.21.2.103:0/2922808164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:48.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.133207+0000 mgr.gibba043.dnkmem (mgr.34373) 3961 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:05:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.134864+0000 mgr.gibba043.dnkmem (mgr.34373) 3962 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:05:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.343345+0000 mgr.gibba043.dnkmem (mgr.34373) 3963 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.345162+0000 mgr.gibba043.dnkmem (mgr.34373) 3964 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.346234+0000 mgr.gibba043.dnkmem (mgr.34373) 3965 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:48.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.346270+0000 mgr.gibba043.dnkmem (mgr.34373) 3966 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.347327+0000 mgr.gibba043.dnkmem (mgr.34373) 3967 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.347365+0000 mgr.gibba043.dnkmem (mgr.34373) 3968 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.348344+0000 mgr.gibba043.dnkmem (mgr.34373) 3969 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:48.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.349577+0000 mgr.gibba043.dnkmem (mgr.34373) 3970 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.349614+0000 mgr.gibba043.dnkmem (mgr.34373) 3971 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.350771+0000 mgr.gibba043.dnkmem (mgr.34373) 3972 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.351169+0000 mgr.gibba043.dnkmem (mgr.34373) 3973 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.352084+0000 mgr.gibba043.dnkmem (mgr.34373) 3974 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:48.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.352123+0000 mgr.gibba043.dnkmem (mgr.34373) 3975 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:48.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: cephadm 2021-03-10T15:05:47.352227+0000 mgr.gibba043.dnkmem (mgr.34373) 3976 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:48.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: audit 2021-03-10T15:05:47.500441+0000 mgr.gibba043.dnkmem (mgr.34373) 3977 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:48.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:48 gibba003 bash[32348]: audit 2021-03-10T15:05:48.020294+0000 mon.c (mon.1) 1056 : audit [DBG] from='client.? 172.21.2.103:0/2922808164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.133207+0000 mgr.gibba043.dnkmem (mgr.34373) 3961 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:05:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.134864+0000 mgr.gibba043.dnkmem (mgr.34373) 3962 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:05:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.343345+0000 mgr.gibba043.dnkmem (mgr.34373) 3963 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.345162+0000 mgr.gibba043.dnkmem (mgr.34373) 3964 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.346234+0000 mgr.gibba043.dnkmem (mgr.34373) 3965 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.346270+0000 mgr.gibba043.dnkmem (mgr.34373) 3966 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.347327+0000 mgr.gibba043.dnkmem (mgr.34373) 3967 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:48.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.347365+0000 mgr.gibba043.dnkmem (mgr.34373) 3968 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:48.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.348344+0000 mgr.gibba043.dnkmem (mgr.34373) 3969 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:48.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.349577+0000 mgr.gibba043.dnkmem (mgr.34373) 3970 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:48.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.349614+0000 mgr.gibba043.dnkmem (mgr.34373) 3971 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:48.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.350771+0000 mgr.gibba043.dnkmem (mgr.34373) 3972 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:48.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.351169+0000 mgr.gibba043.dnkmem (mgr.34373) 3973 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:48.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.352084+0000 mgr.gibba043.dnkmem (mgr.34373) 3974 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:48.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.352123+0000 mgr.gibba043.dnkmem (mgr.34373) 3975 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:48.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: cephadm 2021-03-10T15:05:47.352227+0000 mgr.gibba043.dnkmem (mgr.34373) 3976 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:05:48.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: audit 2021-03-10T15:05:47.500441+0000 mgr.gibba043.dnkmem (mgr.34373) 3977 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:48.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:48 gibba043 bash[24019]: audit 2021-03-10T15:05:48.020294+0000 mon.c (mon.1) 1056 : audit [DBG] from='client.? 172.21.2.103:0/2922808164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:49 gibba003 bash[31385]: audit 2021-03-10T15:05:47.728854+0000 mgr.gibba043.dnkmem (mgr.34373) 3978 : audit [DBG] from='client.56710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:49 gibba003 bash[31385]: cluster 2021-03-10T15:05:48.349240+0000 mgr.gibba043.dnkmem (mgr.34373) 3979 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:49.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:49 gibba003 bash[32348]: audit 2021-03-10T15:05:47.728854+0000 mgr.gibba043.dnkmem (mgr.34373) 3978 : audit [DBG] from='client.56710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:49.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:49 gibba003 bash[32348]: cluster 2021-03-10T15:05:48.349240+0000 mgr.gibba043.dnkmem (mgr.34373) 3979 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:49 gibba043 bash[24019]: audit 2021-03-10T15:05:47.728854+0000 mgr.gibba043.dnkmem (mgr.34373) 3978 : audit [DBG] from='client.56710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:49 gibba043 bash[24019]: cluster 2021-03-10T15:05:48.349240+0000 mgr.gibba043.dnkmem (mgr.34373) 3979 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:51.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:51 gibba043 bash[24019]: cluster 2021-03-10T15:05:50.350733+0000 mgr.gibba043.dnkmem (mgr.34373) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:51 gibba003 bash[31385]: cluster 2021-03-10T15:05:50.350733+0000 mgr.gibba043.dnkmem (mgr.34373) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:51 gibba003 bash[32348]: cluster 2021-03-10T15:05:50.350733+0000 mgr.gibba043.dnkmem (mgr.34373) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:53 gibba043 bash[24019]: cluster 2021-03-10T15:05:52.352476+0000 mgr.gibba043.dnkmem (mgr.34373) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:53 gibba003 bash[31385]: cluster 2021-03-10T15:05:52.352476+0000 mgr.gibba043.dnkmem (mgr.34373) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:53 gibba003 bash[32348]: cluster 2021-03-10T15:05:52.352476+0000 mgr.gibba043.dnkmem (mgr.34373) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:54 gibba003 bash[31385]: cluster 2021-03-10T15:05:54.354205+0000 mgr.gibba043.dnkmem (mgr.34373) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:54 gibba003 bash[32348]: cluster 2021-03-10T15:05:54.354205+0000 mgr.gibba043.dnkmem (mgr.34373) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:54 gibba043 bash[24019]: cluster 2021-03-10T15:05:54.354205+0000 mgr.gibba043.dnkmem (mgr.34373) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:57 gibba003 bash[31385]: cluster 2021-03-10T15:05:56.356104+0000 mgr.gibba043.dnkmem (mgr.34373) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:57.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:57 gibba003 bash[32348]: cluster 2021-03-10T15:05:56.356104+0000 mgr.gibba043.dnkmem (mgr.34373) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:57 gibba043 bash[24019]: cluster 2021-03-10T15:05:56.356104+0000 mgr.gibba043.dnkmem (mgr.34373) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:05:59 gibba003 bash[31385]: cluster 2021-03-10T15:05:58.357708+0000 mgr.gibba043.dnkmem (mgr.34373) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:05:59 gibba003 bash[32348]: cluster 2021-03-10T15:05:58.357708+0000 mgr.gibba043.dnkmem (mgr.34373) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:05:59 gibba043 bash[24019]: cluster 2021-03-10T15:05:58.357708+0000 mgr.gibba043.dnkmem (mgr.34373) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:01 gibba003 bash[31385]: cluster 2021-03-10T15:06:00.359298+0000 mgr.gibba043.dnkmem (mgr.34373) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:01 gibba003 bash[32348]: cluster 2021-03-10T15:06:00.359298+0000 mgr.gibba043.dnkmem (mgr.34373) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:01.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:01 gibba043 bash[24019]: cluster 2021-03-10T15:06:00.359298+0000 mgr.gibba043.dnkmem (mgr.34373) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:03 gibba043 bash[24019]: cluster 2021-03-10T15:06:02.361140+0000 mgr.gibba043.dnkmem (mgr.34373) 3986 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:03 gibba043 bash[24019]: cephadm 2021-03-10T15:06:02.368369+0000 mgr.gibba043.dnkmem (mgr.34373) 3987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:03 gibba003 bash[31385]: cluster 2021-03-10T15:06:02.361140+0000 mgr.gibba043.dnkmem (mgr.34373) 3986 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:03 gibba003 bash[31385]: cephadm 2021-03-10T15:06:02.368369+0000 mgr.gibba043.dnkmem (mgr.34373) 3987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:03.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:03 gibba003 bash[32348]: cluster 2021-03-10T15:06:02.361140+0000 mgr.gibba043.dnkmem (mgr.34373) 3986 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:03 gibba003 bash[32348]: cephadm 2021-03-10T15:06:02.368369+0000 mgr.gibba043.dnkmem (mgr.34373) 3987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:04 gibba003 bash[31385]: cluster 2021-03-10T15:06:04.362878+0000 mgr.gibba043.dnkmem (mgr.34373) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:04 gibba003 bash[32348]: cluster 2021-03-10T15:06:04.362878+0000 mgr.gibba043.dnkmem (mgr.34373) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:04 gibba043 bash[24019]: cluster 2021-03-10T15:06:04.362878+0000 mgr.gibba043.dnkmem (mgr.34373) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:07 gibba003 bash[31385]: cluster 2021-03-10T15:06:06.364825+0000 mgr.gibba043.dnkmem (mgr.34373) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:07.789 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:07 gibba003 bash[32348]: cluster 2021-03-10T15:06:06.364825+0000 mgr.gibba043.dnkmem (mgr.34373) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:07.790 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:07 gibba043 bash[24019]: cluster 2021-03-10T15:06:06.364825+0000 mgr.gibba043.dnkmem (mgr.34373) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:09 gibba003 bash[31385]: cluster 2021-03-10T15:06:08.366500+0000 mgr.gibba043.dnkmem (mgr.34373) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:09 gibba003 bash[32348]: cluster 2021-03-10T15:06:08.366500+0000 mgr.gibba043.dnkmem (mgr.34373) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:09.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:09 gibba043 bash[24019]: cluster 2021-03-10T15:06:08.366500+0000 mgr.gibba043.dnkmem (mgr.34373) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:11 gibba043 bash[24019]: cluster 2021-03-10T15:06:10.367949+0000 mgr.gibba043.dnkmem (mgr.34373) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:11.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:11 gibba003 bash[31385]: cluster 2021-03-10T15:06:10.367949+0000 mgr.gibba043.dnkmem (mgr.34373) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:11.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:11 gibba003 bash[32348]: cluster 2021-03-10T15:06:10.367949+0000 mgr.gibba043.dnkmem (mgr.34373) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: cluster 2021-03-10T15:06:12.369677+0000 mgr.gibba043.dnkmem (mgr.34373) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.180587+0000 mon.c (mon.1) 1057 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.181670+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.272874+0000 mon.c (mon.1) 1058 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.273980+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.311934+0000 mon.c (mon.1) 1059 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:06:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.312680+0000 mon.c (mon.1) 1060 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:06:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.313150+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:06:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.313391+0000 mon.c (mon.1) 1061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.314217+0000 mon.c (mon.1) 1062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.314346+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:06:13.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.315653+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:13 gibba043 bash[24019]: audit 2021-03-10T15:06:13.316917+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: cluster 2021-03-10T15:06:12.369677+0000 mgr.gibba043.dnkmem (mgr.34373) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.180587+0000 mon.c (mon.1) 1057 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.181670+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.272874+0000 mon.c (mon.1) 1058 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.273980+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.311934+0000 mon.c (mon.1) 1059 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:06:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.312680+0000 mon.c (mon.1) 1060 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:06:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.313150+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:06:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.313391+0000 mon.c (mon.1) 1061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.314217+0000 mon.c (mon.1) 1062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.314346+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:06:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.315653+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[31385]: audit 2021-03-10T15:06:13.316917+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: cluster 2021-03-10T15:06:12.369677+0000 mgr.gibba043.dnkmem (mgr.34373) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.180587+0000 mon.c (mon.1) 1057 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.181670+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.272874+0000 mon.c (mon.1) 1058 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.273980+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.311934+0000 mon.c (mon.1) 1059 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:06:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.312680+0000 mon.c (mon.1) 1060 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:06:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.313150+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:06:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.313391+0000 mon.c (mon.1) 1061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.314217+0000 mon.c (mon.1) 1062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.314346+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:06:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.315653+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:06:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:13 gibba003 bash[32348]: audit 2021-03-10T15:06:13.316917+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:06:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:14 gibba003 bash[31385]: cluster 2021-03-10T15:06:14.371431+0000 mgr.gibba043.dnkmem (mgr.34373) 3993 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:14 gibba003 bash[32348]: cluster 2021-03-10T15:06:14.371431+0000 mgr.gibba043.dnkmem (mgr.34373) 3993 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:14 gibba043 bash[24019]: cluster 2021-03-10T15:06:14.371431+0000 mgr.gibba043.dnkmem (mgr.34373) 3993 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:17 gibba043 bash[24019]: cluster 2021-03-10T15:06:16.373574+0000 mgr.gibba043.dnkmem (mgr.34373) 3994 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:17 gibba003 bash[31385]: cluster 2021-03-10T15:06:16.373574+0000 mgr.gibba043.dnkmem (mgr.34373) 3994 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:17 gibba003 bash[32348]: cluster 2021-03-10T15:06:16.373574+0000 mgr.gibba043.dnkmem (mgr.34373) 3994 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:18.266 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:06:18.493 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:06:18.493 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (74m) 9m ago 79m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:06:18.493 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (79m) 8m ago 79m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:06:18.494 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:06:18.494 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:06:18.494 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (74m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:06:18.494 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (74m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:06:18.495 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (73m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:06:18.495 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:06:18.495 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (80m) 9m ago 80m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:06:18.496 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (80m) 8m ago 80m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:06:18.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (72m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:06:18.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:06:18.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:06:18.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:06:18.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:06:18.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:06:18.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:06:18.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (69m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:06:18.498 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (79m) 8m ago 80m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:06:18.498 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 78m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:06:18.742 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:06:18.742 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:06:18.743 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:18.743 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:06:18.743 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:06:18.743 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:18.744 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:06:18.744 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:06:18.744 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:06:18.744 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:06:18.744 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:06:18.745 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:06:18.745 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:06:18.745 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:06:18.745 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:06:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:18 gibba043 bash[24019]: cephadm 2021-03-10T15:06:17.384480+0000 mgr.gibba043.dnkmem (mgr.34373) 3995 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:18.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:18 gibba003 bash[31385]: cephadm 2021-03-10T15:06:17.384480+0000 mgr.gibba043.dnkmem (mgr.34373) 3995 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:18.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:18 gibba003 bash[32348]: cephadm 2021-03-10T15:06:17.384480+0000 mgr.gibba043.dnkmem (mgr.34373) 3995 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:19 gibba043 bash[24019]: audit 2021-03-10T15:06:18.254942+0000 mgr.gibba043.dnkmem (mgr.34373) 3996 : audit [DBG] from='client.56722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:19 gibba043 bash[24019]: cluster 2021-03-10T15:06:18.375248+0000 mgr.gibba043.dnkmem (mgr.34373) 3997 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:19 gibba043 bash[24019]: audit 2021-03-10T15:06:18.481007+0000 mgr.gibba043.dnkmem (mgr.34373) 3998 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:19.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:19 gibba043 bash[24019]: audit 2021-03-10T15:06:18.740379+0000 mon.c (mon.1) 1063 : audit [DBG] from='client.? 172.21.2.103:0/2717797950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[31385]: audit 2021-03-10T15:06:18.254942+0000 mgr.gibba043.dnkmem (mgr.34373) 3996 : audit [DBG] from='client.56722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[31385]: cluster 2021-03-10T15:06:18.375248+0000 mgr.gibba043.dnkmem (mgr.34373) 3997 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:19.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[31385]: audit 2021-03-10T15:06:18.481007+0000 mgr.gibba043.dnkmem (mgr.34373) 3998 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:19.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[31385]: audit 2021-03-10T15:06:18.740379+0000 mon.c (mon.1) 1063 : audit [DBG] from='client.? 172.21.2.103:0/2717797950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[32348]: audit 2021-03-10T15:06:18.254942+0000 mgr.gibba043.dnkmem (mgr.34373) 3996 : audit [DBG] from='client.56722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[32348]: cluster 2021-03-10T15:06:18.375248+0000 mgr.gibba043.dnkmem (mgr.34373) 3997 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:19.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[32348]: audit 2021-03-10T15:06:18.481007+0000 mgr.gibba043.dnkmem (mgr.34373) 3998 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:19.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:19 gibba003 bash[32348]: audit 2021-03-10T15:06:18.740379+0000 mon.c (mon.1) 1063 : audit [DBG] from='client.? 172.21.2.103:0/2717797950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:21 gibba043 bash[24019]: cluster 2021-03-10T15:06:20.376850+0000 mgr.gibba043.dnkmem (mgr.34373) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:21.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:21 gibba003 bash[31385]: cluster 2021-03-10T15:06:20.376850+0000 mgr.gibba043.dnkmem (mgr.34373) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:21 gibba003 bash[32348]: cluster 2021-03-10T15:06:20.376850+0000 mgr.gibba043.dnkmem (mgr.34373) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:23.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:23 gibba043 bash[24019]: cluster 2021-03-10T15:06:22.378333+0000 mgr.gibba043.dnkmem (mgr.34373) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:23 gibba003 bash[31385]: cluster 2021-03-10T15:06:22.378333+0000 mgr.gibba043.dnkmem (mgr.34373) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:23.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:23 gibba003 bash[32348]: cluster 2021-03-10T15:06:22.378333+0000 mgr.gibba043.dnkmem (mgr.34373) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:24 gibba003 bash[31385]: cluster 2021-03-10T15:06:24.380046+0000 mgr.gibba043.dnkmem (mgr.34373) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:24 gibba003 bash[32348]: cluster 2021-03-10T15:06:24.380046+0000 mgr.gibba043.dnkmem (mgr.34373) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:24 gibba043 bash[24019]: cluster 2021-03-10T15:06:24.380046+0000 mgr.gibba043.dnkmem (mgr.34373) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:27 gibba043 bash[24019]: cluster 2021-03-10T15:06:26.381921+0000 mgr.gibba043.dnkmem (mgr.34373) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:27 gibba003 bash[31385]: cluster 2021-03-10T15:06:26.381921+0000 mgr.gibba043.dnkmem (mgr.34373) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:27 gibba003 bash[32348]: cluster 2021-03-10T15:06:26.381921+0000 mgr.gibba043.dnkmem (mgr.34373) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:29 gibba043 bash[24019]: cluster 2021-03-10T15:06:28.383315+0000 mgr.gibba043.dnkmem (mgr.34373) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:29 gibba003 bash[31385]: cluster 2021-03-10T15:06:28.383315+0000 mgr.gibba043.dnkmem (mgr.34373) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:29 gibba003 bash[32348]: cluster 2021-03-10T15:06:28.383315+0000 mgr.gibba043.dnkmem (mgr.34373) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:31.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:31 gibba043 bash[24019]: cluster 2021-03-10T15:06:30.384599+0000 mgr.gibba043.dnkmem (mgr.34373) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:31.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:31 gibba003 bash[31385]: cluster 2021-03-10T15:06:30.384599+0000 mgr.gibba043.dnkmem (mgr.34373) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:31.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:31 gibba003 bash[32348]: cluster 2021-03-10T15:06:30.384599+0000 mgr.gibba043.dnkmem (mgr.34373) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:33 gibba043 bash[24019]: cluster 2021-03-10T15:06:32.386187+0000 mgr.gibba043.dnkmem (mgr.34373) 4005 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:33 gibba043 bash[24019]: cephadm 2021-03-10T15:06:32.397670+0000 mgr.gibba043.dnkmem (mgr.34373) 4006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:33 gibba003 bash[31385]: cluster 2021-03-10T15:06:32.386187+0000 mgr.gibba043.dnkmem (mgr.34373) 4005 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:33 gibba003 bash[31385]: cephadm 2021-03-10T15:06:32.397670+0000 mgr.gibba043.dnkmem (mgr.34373) 4006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:33.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:33 gibba003 bash[32348]: cluster 2021-03-10T15:06:32.386187+0000 mgr.gibba043.dnkmem (mgr.34373) 4005 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:33 gibba003 bash[32348]: cephadm 2021-03-10T15:06:32.397670+0000 mgr.gibba043.dnkmem (mgr.34373) 4006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:34 gibba003 bash[31385]: cluster 2021-03-10T15:06:34.387848+0000 mgr.gibba043.dnkmem (mgr.34373) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:34 gibba003 bash[32348]: cluster 2021-03-10T15:06:34.387848+0000 mgr.gibba043.dnkmem (mgr.34373) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:34 gibba043 bash[24019]: cluster 2021-03-10T15:06:34.387848+0000 mgr.gibba043.dnkmem (mgr.34373) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:37 gibba043 bash[24019]: cluster 2021-03-10T15:06:36.389387+0000 mgr.gibba043.dnkmem (mgr.34373) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:37 gibba003 bash[31385]: cluster 2021-03-10T15:06:36.389387+0000 mgr.gibba043.dnkmem (mgr.34373) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:37 gibba003 bash[32348]: cluster 2021-03-10T15:06:36.389387+0000 mgr.gibba043.dnkmem (mgr.34373) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:39 gibba043 bash[24019]: cluster 2021-03-10T15:06:38.390874+0000 mgr.gibba043.dnkmem (mgr.34373) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:39 gibba003 bash[31385]: cluster 2021-03-10T15:06:38.390874+0000 mgr.gibba043.dnkmem (mgr.34373) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:39 gibba003 bash[32348]: cluster 2021-03-10T15:06:38.390874+0000 mgr.gibba043.dnkmem (mgr.34373) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:41 gibba043 bash[24019]: cluster 2021-03-10T15:06:40.392489+0000 mgr.gibba043.dnkmem (mgr.34373) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:41 gibba003 bash[31385]: cluster 2021-03-10T15:06:40.392489+0000 mgr.gibba043.dnkmem (mgr.34373) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:41 gibba003 bash[32348]: cluster 2021-03-10T15:06:40.392489+0000 mgr.gibba043.dnkmem (mgr.34373) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:43 gibba043 bash[24019]: cluster 2021-03-10T15:06:42.393887+0000 mgr.gibba043.dnkmem (mgr.34373) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:43 gibba003 bash[31385]: cluster 2021-03-10T15:06:42.393887+0000 mgr.gibba043.dnkmem (mgr.34373) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:43 gibba003 bash[32348]: cluster 2021-03-10T15:06:42.393887+0000 mgr.gibba043.dnkmem (mgr.34373) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:44 gibba003 bash[31385]: cluster 2021-03-10T15:06:44.395557+0000 mgr.gibba043.dnkmem (mgr.34373) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:44 gibba003 bash[32348]: cluster 2021-03-10T15:06:44.395557+0000 mgr.gibba043.dnkmem (mgr.34373) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:44 gibba043 bash[24019]: cluster 2021-03-10T15:06:44.395557+0000 mgr.gibba043.dnkmem (mgr.34373) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:47 gibba043 bash[24019]: cluster 2021-03-10T15:06:46.397174+0000 mgr.gibba043.dnkmem (mgr.34373) 4013 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:47 gibba043 bash[24019]: audit 2021-03-10T15:06:47.406496+0000 mon.c (mon.1) 1064 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:06:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:47 gibba003 bash[31385]: cluster 2021-03-10T15:06:46.397174+0000 mgr.gibba043.dnkmem (mgr.34373) 4013 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:47 gibba003 bash[31385]: audit 2021-03-10T15:06:47.406496+0000 mon.c (mon.1) 1064 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:06:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:47 gibba003 bash[32348]: cluster 2021-03-10T15:06:46.397174+0000 mgr.gibba043.dnkmem (mgr.34373) 4013 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:47 gibba003 bash[32348]: audit 2021-03-10T15:06:47.406496+0000 mon.c (mon.1) 1064 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:06:48.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:48 gibba043 bash[24019]: cephadm 2021-03-10T15:06:47.404870+0000 mgr.gibba043.dnkmem (mgr.34373) 4014 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:06:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:48 gibba003 bash[31385]: cephadm 2021-03-10T15:06:47.404870+0000 mgr.gibba043.dnkmem (mgr.34373) 4014 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:06:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:48 gibba003 bash[32348]: cephadm 2021-03-10T15:06:47.404870+0000 mgr.gibba043.dnkmem (mgr.34373) 4014 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:06:48.989 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:06:49.216 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:06:49.216 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (75m) 10m ago 80m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:06:49.217 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (80m) 9m ago 80m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:06:49.217 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (75m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:06:49.217 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (75m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:06:49.217 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (74m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:06:49.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (74m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:06:49.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (74m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:06:49.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (74m) 10m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:06:49.218 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (80m) 10m ago 80m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:06:49.219 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (80m) 9m ago 80m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:06:49.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (73m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:06:49.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (73m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:06:49.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:06:49.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:06:49.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:06:49.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:06:49.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:06:49.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:06:49.221 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (80m) 9m ago 80m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:06:49.221 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 78m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:06:49.463 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:06:49.463 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:06:49.463 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:49.463 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:06:49.464 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:06:49.464 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:49.464 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:06:49.464 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:06:49.465 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:06:49.465 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:06:49.465 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:06:49.465 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:06:49.466 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:06:49.466 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:06:49.466 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:06:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:49 gibba043 bash[24019]: cluster 2021-03-10T15:06:48.398710+0000 mgr.gibba043.dnkmem (mgr.34373) 4015 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:49 gibba043 bash[24019]: audit 2021-03-10T15:06:49.460832+0000 mon.c (mon.1) 1065 : audit [DBG] from='client.? 172.21.2.103:0/3983610852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:49 gibba003 bash[31385]: cluster 2021-03-10T15:06:48.398710+0000 mgr.gibba043.dnkmem (mgr.34373) 4015 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:49.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:49 gibba003 bash[31385]: audit 2021-03-10T15:06:49.460832+0000 mon.c (mon.1) 1065 : audit [DBG] from='client.? 172.21.2.103:0/3983610852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:49 gibba003 bash[32348]: cluster 2021-03-10T15:06:48.398710+0000 mgr.gibba043.dnkmem (mgr.34373) 4015 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:49 gibba003 bash[32348]: audit 2021-03-10T15:06:49.460832+0000 mon.c (mon.1) 1065 : audit [DBG] from='client.? 172.21.2.103:0/3983610852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:50.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:50 gibba043 bash[24019]: audit 2021-03-10T15:06:48.977684+0000 mgr.gibba043.dnkmem (mgr.34373) 4016 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:50.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:50 gibba043 bash[24019]: audit 2021-03-10T15:06:49.201088+0000 mgr.gibba043.dnkmem (mgr.34373) 4017 : audit [DBG] from='client.56746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:50.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:50 gibba003 bash[31385]: audit 2021-03-10T15:06:48.977684+0000 mgr.gibba043.dnkmem (mgr.34373) 4016 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:50.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:50 gibba003 bash[31385]: audit 2021-03-10T15:06:49.201088+0000 mgr.gibba043.dnkmem (mgr.34373) 4017 : audit [DBG] from='client.56746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:50.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:50 gibba003 bash[32348]: audit 2021-03-10T15:06:48.977684+0000 mgr.gibba043.dnkmem (mgr.34373) 4016 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:50.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:50 gibba003 bash[32348]: audit 2021-03-10T15:06:49.201088+0000 mgr.gibba043.dnkmem (mgr.34373) 4017 : audit [DBG] from='client.56746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:51.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: cluster 2021-03-10T15:06:50.400168+0000 mgr.gibba043.dnkmem (mgr.34373) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.043634+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:06:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.272224+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:06:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.280801+0000 mon.c (mon.1) 1066 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:51.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.283494+0000 mon.c (mon.1) 1067 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.286446+0000 mon.c (mon.1) 1068 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.289157+0000 mon.c (mon.1) 1069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.296257+0000 mon.c (mon.1) 1070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:51 gibba043 bash[24019]: audit 2021-03-10T15:06:51.299667+0000 mon.c (mon.1) 1071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: cluster 2021-03-10T15:06:50.400168+0000 mgr.gibba043.dnkmem (mgr.34373) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.043634+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:06:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.272224+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:06:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.280801+0000 mon.c (mon.1) 1066 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.283494+0000 mon.c (mon.1) 1067 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.286446+0000 mon.c (mon.1) 1068 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.289157+0000 mon.c (mon.1) 1069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.296257+0000 mon.c (mon.1) 1070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[31385]: audit 2021-03-10T15:06:51.299667+0000 mon.c (mon.1) 1071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: cluster 2021-03-10T15:06:50.400168+0000 mgr.gibba043.dnkmem (mgr.34373) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.043634+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:06:51.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.272224+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:06:51.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.280801+0000 mon.c (mon.1) 1066 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:51.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.283494+0000 mon.c (mon.1) 1067 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.286446+0000 mon.c (mon.1) 1068 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.289157+0000 mon.c (mon.1) 1069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.296257+0000 mon.c (mon.1) 1070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:51.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:51 gibba003 bash[32348]: audit 2021-03-10T15:06:51.299667+0000 mon.c (mon.1) 1071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:52.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.043972+0000 mgr.gibba043.dnkmem (mgr.34373) 4019 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:06:52.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.278582+0000 mgr.gibba043.dnkmem (mgr.34373) 4020 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:52.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.281999+0000 mgr.gibba043.dnkmem (mgr.34373) 4021 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:52.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.284776+0000 mgr.gibba043.dnkmem (mgr.34373) 4022 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:52.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.284820+0000 mgr.gibba043.dnkmem (mgr.34373) 4023 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:52.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.287385+0000 mgr.gibba043.dnkmem (mgr.34373) 4024 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:52.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.287426+0000 mgr.gibba043.dnkmem (mgr.34373) 4025 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:52.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.290162+0000 mgr.gibba043.dnkmem (mgr.34373) 4026 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:52.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.294295+0000 mgr.gibba043.dnkmem (mgr.34373) 4027 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:52.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.294337+0000 mgr.gibba043.dnkmem (mgr.34373) 4028 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:52.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.297599+0000 mgr.gibba043.dnkmem (mgr.34373) 4029 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:52.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.298120+0000 mgr.gibba043.dnkmem (mgr.34373) 4030 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:52.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.302174+0000 mgr.gibba043.dnkmem (mgr.34373) 4031 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:52.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.302444+0000 mgr.gibba043.dnkmem (mgr.34373) 4032 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:52.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:52 gibba043 bash[24019]: cephadm 2021-03-10T15:06:51.303065+0000 mgr.gibba043.dnkmem (mgr.34373) 4033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.043972+0000 mgr.gibba043.dnkmem (mgr.34373) 4019 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:06:52.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.278582+0000 mgr.gibba043.dnkmem (mgr.34373) 4020 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:52.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.281999+0000 mgr.gibba043.dnkmem (mgr.34373) 4021 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:52.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.284776+0000 mgr.gibba043.dnkmem (mgr.34373) 4022 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:52.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.284820+0000 mgr.gibba043.dnkmem (mgr.34373) 4023 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:52.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.287385+0000 mgr.gibba043.dnkmem (mgr.34373) 4024 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:52.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.287426+0000 mgr.gibba043.dnkmem (mgr.34373) 4025 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:52.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.290162+0000 mgr.gibba043.dnkmem (mgr.34373) 4026 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:52.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.294295+0000 mgr.gibba043.dnkmem (mgr.34373) 4027 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:52.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.294337+0000 mgr.gibba043.dnkmem (mgr.34373) 4028 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:52.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.297599+0000 mgr.gibba043.dnkmem (mgr.34373) 4029 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:52.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.298120+0000 mgr.gibba043.dnkmem (mgr.34373) 4030 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:52.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.302174+0000 mgr.gibba043.dnkmem (mgr.34373) 4031 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:52.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.302444+0000 mgr.gibba043.dnkmem (mgr.34373) 4032 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:52.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[31385]: cephadm 2021-03-10T15:06:51.303065+0000 mgr.gibba043.dnkmem (mgr.34373) 4033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:52.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.043972+0000 mgr.gibba043.dnkmem (mgr.34373) 4019 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:06:52.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.278582+0000 mgr.gibba043.dnkmem (mgr.34373) 4020 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:52.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.281999+0000 mgr.gibba043.dnkmem (mgr.34373) 4021 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:52.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.284776+0000 mgr.gibba043.dnkmem (mgr.34373) 4022 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:52.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.284820+0000 mgr.gibba043.dnkmem (mgr.34373) 4023 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:52.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.287385+0000 mgr.gibba043.dnkmem (mgr.34373) 4024 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:52.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.287426+0000 mgr.gibba043.dnkmem (mgr.34373) 4025 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:52.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.290162+0000 mgr.gibba043.dnkmem (mgr.34373) 4026 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:52.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.294295+0000 mgr.gibba043.dnkmem (mgr.34373) 4027 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:52.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.294337+0000 mgr.gibba043.dnkmem (mgr.34373) 4028 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:52.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.297599+0000 mgr.gibba043.dnkmem (mgr.34373) 4029 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:52.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.298120+0000 mgr.gibba043.dnkmem (mgr.34373) 4030 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:52.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.302174+0000 mgr.gibba043.dnkmem (mgr.34373) 4031 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:52.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.302444+0000 mgr.gibba043.dnkmem (mgr.34373) 4032 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:52.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:52 gibba003 bash[32348]: cephadm 2021-03-10T15:06:51.303065+0000 mgr.gibba043.dnkmem (mgr.34373) 4033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:06:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:53 gibba043 bash[24019]: cluster 2021-03-10T15:06:52.401545+0000 mgr.gibba043.dnkmem (mgr.34373) 4034 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:53 gibba003 bash[31385]: cluster 2021-03-10T15:06:52.401545+0000 mgr.gibba043.dnkmem (mgr.34373) 4034 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:53 gibba003 bash[32348]: cluster 2021-03-10T15:06:52.401545+0000 mgr.gibba043.dnkmem (mgr.34373) 4034 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:54 gibba003 bash[31385]: cluster 2021-03-10T15:06:54.403220+0000 mgr.gibba043.dnkmem (mgr.34373) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:54 gibba003 bash[32348]: cluster 2021-03-10T15:06:54.403220+0000 mgr.gibba043.dnkmem (mgr.34373) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:54 gibba043 bash[24019]: cluster 2021-03-10T15:06:54.403220+0000 mgr.gibba043.dnkmem (mgr.34373) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:57 gibba043 bash[24019]: cluster 2021-03-10T15:06:56.404921+0000 mgr.gibba043.dnkmem (mgr.34373) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:57 gibba003 bash[31385]: cluster 2021-03-10T15:06:56.404921+0000 mgr.gibba043.dnkmem (mgr.34373) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:57 gibba003 bash[32348]: cluster 2021-03-10T15:06:56.404921+0000 mgr.gibba043.dnkmem (mgr.34373) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:06:59 gibba043 bash[24019]: cluster 2021-03-10T15:06:58.406478+0000 mgr.gibba043.dnkmem (mgr.34373) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:06:59 gibba003 bash[31385]: cluster 2021-03-10T15:06:58.406478+0000 mgr.gibba043.dnkmem (mgr.34373) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:59.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:06:59 gibba003 bash[32348]: cluster 2021-03-10T15:06:58.406478+0000 mgr.gibba043.dnkmem (mgr.34373) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:01 gibba043 bash[24019]: cluster 2021-03-10T15:07:00.408004+0000 mgr.gibba043.dnkmem (mgr.34373) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:01 gibba003 bash[31385]: cluster 2021-03-10T15:07:00.408004+0000 mgr.gibba043.dnkmem (mgr.34373) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:01 gibba003 bash[32348]: cluster 2021-03-10T15:07:00.408004+0000 mgr.gibba043.dnkmem (mgr.34373) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:03 gibba043 bash[24019]: cluster 2021-03-10T15:07:02.409452+0000 mgr.gibba043.dnkmem (mgr.34373) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:03 gibba003 bash[31385]: cluster 2021-03-10T15:07:02.409452+0000 mgr.gibba043.dnkmem (mgr.34373) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:03 gibba003 bash[32348]: cluster 2021-03-10T15:07:02.409452+0000 mgr.gibba043.dnkmem (mgr.34373) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:04 gibba003 bash[31385]: cluster 2021-03-10T15:07:04.410966+0000 mgr.gibba043.dnkmem (mgr.34373) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:04 gibba003 bash[32348]: cluster 2021-03-10T15:07:04.410966+0000 mgr.gibba043.dnkmem (mgr.34373) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:04 gibba043 bash[24019]: cluster 2021-03-10T15:07:04.410966+0000 mgr.gibba043.dnkmem (mgr.34373) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:07 gibba043 bash[24019]: cephadm 2021-03-10T15:07:06.319337+0000 mgr.gibba043.dnkmem (mgr.34373) 4041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:07.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:07 gibba043 bash[24019]: cluster 2021-03-10T15:07:06.412688+0000 mgr.gibba043.dnkmem (mgr.34373) 4042 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:07 gibba003 bash[31385]: cephadm 2021-03-10T15:07:06.319337+0000 mgr.gibba043.dnkmem (mgr.34373) 4041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:07 gibba003 bash[31385]: cluster 2021-03-10T15:07:06.412688+0000 mgr.gibba043.dnkmem (mgr.34373) 4042 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:07.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:07 gibba003 bash[32348]: cephadm 2021-03-10T15:07:06.319337+0000 mgr.gibba043.dnkmem (mgr.34373) 4041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:07.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:07 gibba003 bash[32348]: cluster 2021-03-10T15:07:06.412688+0000 mgr.gibba043.dnkmem (mgr.34373) 4042 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:09 gibba043 bash[24019]: cluster 2021-03-10T15:07:08.414210+0000 mgr.gibba043.dnkmem (mgr.34373) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:09 gibba003 bash[31385]: cluster 2021-03-10T15:07:08.414210+0000 mgr.gibba043.dnkmem (mgr.34373) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:09 gibba003 bash[32348]: cluster 2021-03-10T15:07:08.414210+0000 mgr.gibba043.dnkmem (mgr.34373) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:11 gibba043 bash[24019]: cluster 2021-03-10T15:07:10.415819+0000 mgr.gibba043.dnkmem (mgr.34373) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:11 gibba003 bash[31385]: cluster 2021-03-10T15:07:10.415819+0000 mgr.gibba043.dnkmem (mgr.34373) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:11 gibba003 bash[32348]: cluster 2021-03-10T15:07:10.415819+0000 mgr.gibba043.dnkmem (mgr.34373) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: cluster 2021-03-10T15:07:12.417541+0000 mgr.gibba043.dnkmem (mgr.34373) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.187532+0000 mon.c (mon.1) 1072 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.188642+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.281398+0000 mon.c (mon.1) 1073 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.282506+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.317900+0000 mon.c (mon.1) 1074 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:07:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.318668+0000 mon.c (mon.1) 1075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.319270+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:07:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.319819+0000 mon.c (mon.1) 1076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.321293+0000 mon.c (mon.1) 1077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.321372+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.322529+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:13.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:13 gibba043 bash[24019]: audit 2021-03-10T15:07:13.322726+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: cluster 2021-03-10T15:07:12.417541+0000 mgr.gibba043.dnkmem (mgr.34373) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.187532+0000 mon.c (mon.1) 1072 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.188642+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.281398+0000 mon.c (mon.1) 1073 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.282506+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.317900+0000 mon.c (mon.1) 1074 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:07:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.318668+0000 mon.c (mon.1) 1075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.319270+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:07:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.319819+0000 mon.c (mon.1) 1076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.321293+0000 mon.c (mon.1) 1077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.321372+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.322529+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[31385]: audit 2021-03-10T15:07:13.322726+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: cluster 2021-03-10T15:07:12.417541+0000 mgr.gibba043.dnkmem (mgr.34373) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.187532+0000 mon.c (mon.1) 1072 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.188642+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.281398+0000 mon.c (mon.1) 1073 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.282506+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.317900+0000 mon.c (mon.1) 1074 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:07:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.318668+0000 mon.c (mon.1) 1075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.319270+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:07:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.319819+0000 mon.c (mon.1) 1076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.321293+0000 mon.c (mon.1) 1077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.321372+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:07:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.322529+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:13 gibba003 bash[32348]: audit 2021-03-10T15:07:13.322726+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:14 gibba003 bash[31385]: cluster 2021-03-10T15:07:14.419203+0000 mgr.gibba043.dnkmem (mgr.34373) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:14 gibba003 bash[32348]: cluster 2021-03-10T15:07:14.419203+0000 mgr.gibba043.dnkmem (mgr.34373) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:14 gibba043 bash[24019]: cluster 2021-03-10T15:07:14.419203+0000 mgr.gibba043.dnkmem (mgr.34373) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:17 gibba043 bash[24019]: cluster 2021-03-10T15:07:16.421042+0000 mgr.gibba043.dnkmem (mgr.34373) 4047 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:17 gibba003 bash[31385]: cluster 2021-03-10T15:07:16.421042+0000 mgr.gibba043.dnkmem (mgr.34373) 4047 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:17 gibba003 bash[32348]: cluster 2021-03-10T15:07:16.421042+0000 mgr.gibba043.dnkmem (mgr.34373) 4047 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.708 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:07:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:19 gibba043 bash[24019]: cluster 2021-03-10T15:07:18.422737+0000 mgr.gibba043.dnkmem (mgr.34373) 4048 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:19 gibba003 bash[31385]: cluster 2021-03-10T15:07:18.422737+0000 mgr.gibba043.dnkmem (mgr.34373) 4048 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:19 gibba003 bash[32348]: cluster 2021-03-10T15:07:18.422737+0000 mgr.gibba043.dnkmem (mgr.34373) 4048 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.960 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:07:19.960 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (75m) 28s ago 81m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:07:19.961 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (80m) 9m ago 80m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:07:19.961 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (76m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:07:19.961 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (76m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:07:19.962 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (75m) 28s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:07:19.962 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (75m) 28s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:07:19.962 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (74m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:07:19.962 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (74m) 28s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:07:19.963 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (81m) 28s ago 81m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:07:19.963 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (81m) 9m ago 81m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:07:19.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (74m) 28s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:07:19.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (73m) 28s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:07:19.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (73m) 28s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:07:19.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (72m) 28s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:07:19.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:07:19.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:07:19.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:07:19.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:07:19.965 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (80m) 9m ago 81m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:07:19.965 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 28s ago 79m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:07:20.210 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:07:20.210 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:07:20.211 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:20.211 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:07:20.211 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:07:20.212 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:20.212 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:07:20.212 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:07:20.212 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:07:20.213 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:07:20.213 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:07:20.213 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:07:20.213 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:07:20.214 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:07:20.214 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:07:20.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:20 gibba043 bash[24019]: audit 2021-03-10T15:07:19.696586+0000 mgr.gibba043.dnkmem (mgr.34373) 4049 : audit [DBG] from='client.46770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:20.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:20 gibba043 bash[24019]: audit 2021-03-10T15:07:20.208616+0000 mon.a (mon.0) 1090 : audit [DBG] from='client.? 172.21.2.103:0/25412651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:20 gibba003 bash[31385]: audit 2021-03-10T15:07:19.696586+0000 mgr.gibba043.dnkmem (mgr.34373) 4049 : audit [DBG] from='client.46770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:20 gibba003 bash[31385]: audit 2021-03-10T15:07:20.208616+0000 mon.a (mon.0) 1090 : audit [DBG] from='client.? 172.21.2.103:0/25412651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:20.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:20 gibba003 bash[32348]: audit 2021-03-10T15:07:19.696586+0000 mgr.gibba043.dnkmem (mgr.34373) 4049 : audit [DBG] from='client.46770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:20.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:20 gibba003 bash[32348]: audit 2021-03-10T15:07:20.208616+0000 mon.a (mon.0) 1090 : audit [DBG] from='client.? 172.21.2.103:0/25412651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:21 gibba043 bash[24019]: audit 2021-03-10T15:07:19.919066+0000 mgr.gibba043.dnkmem (mgr.34373) 4050 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:21 gibba043 bash[24019]: cluster 2021-03-10T15:07:20.424200+0000 mgr.gibba043.dnkmem (mgr.34373) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:21 gibba003 bash[31385]: audit 2021-03-10T15:07:19.919066+0000 mgr.gibba043.dnkmem (mgr.34373) 4050 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:21 gibba003 bash[31385]: cluster 2021-03-10T15:07:20.424200+0000 mgr.gibba043.dnkmem (mgr.34373) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:21 gibba003 bash[32348]: audit 2021-03-10T15:07:19.919066+0000 mgr.gibba043.dnkmem (mgr.34373) 4050 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:21 gibba003 bash[32348]: cluster 2021-03-10T15:07:20.424200+0000 mgr.gibba043.dnkmem (mgr.34373) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:22 gibba003 bash[31385]: cephadm 2021-03-10T15:07:21.335374+0000 mgr.gibba043.dnkmem (mgr.34373) 4052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:22 gibba003 bash[32348]: cephadm 2021-03-10T15:07:21.335374+0000 mgr.gibba043.dnkmem (mgr.34373) 4052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:22 gibba043 bash[24019]: cephadm 2021-03-10T15:07:21.335374+0000 mgr.gibba043.dnkmem (mgr.34373) 4052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:23 gibba003 bash[31385]: cluster 2021-03-10T15:07:22.425926+0000 mgr.gibba043.dnkmem (mgr.34373) 4053 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:23.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:23 gibba003 bash[32348]: cluster 2021-03-10T15:07:22.425926+0000 mgr.gibba043.dnkmem (mgr.34373) 4053 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:23 gibba043 bash[24019]: cluster 2021-03-10T15:07:22.425926+0000 mgr.gibba043.dnkmem (mgr.34373) 4053 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:24 gibba003 bash[31385]: cluster 2021-03-10T15:07:24.427555+0000 mgr.gibba043.dnkmem (mgr.34373) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:24 gibba003 bash[32348]: cluster 2021-03-10T15:07:24.427555+0000 mgr.gibba043.dnkmem (mgr.34373) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:24 gibba043 bash[24019]: cluster 2021-03-10T15:07:24.427555+0000 mgr.gibba043.dnkmem (mgr.34373) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:27 gibba043 bash[24019]: cluster 2021-03-10T15:07:26.429141+0000 mgr.gibba043.dnkmem (mgr.34373) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:27 gibba003 bash[31385]: cluster 2021-03-10T15:07:26.429141+0000 mgr.gibba043.dnkmem (mgr.34373) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:27 gibba003 bash[32348]: cluster 2021-03-10T15:07:26.429141+0000 mgr.gibba043.dnkmem (mgr.34373) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:29 gibba043 bash[24019]: cluster 2021-03-10T15:07:28.430830+0000 mgr.gibba043.dnkmem (mgr.34373) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:29 gibba003 bash[31385]: cluster 2021-03-10T15:07:28.430830+0000 mgr.gibba043.dnkmem (mgr.34373) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:29 gibba003 bash[32348]: cluster 2021-03-10T15:07:28.430830+0000 mgr.gibba043.dnkmem (mgr.34373) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:31 gibba043 bash[24019]: cluster 2021-03-10T15:07:30.432300+0000 mgr.gibba043.dnkmem (mgr.34373) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:31 gibba003 bash[31385]: cluster 2021-03-10T15:07:30.432300+0000 mgr.gibba043.dnkmem (mgr.34373) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:31 gibba003 bash[32348]: cluster 2021-03-10T15:07:30.432300+0000 mgr.gibba043.dnkmem (mgr.34373) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:33 gibba043 bash[24019]: cluster 2021-03-10T15:07:32.433683+0000 mgr.gibba043.dnkmem (mgr.34373) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:33 gibba003 bash[31385]: cluster 2021-03-10T15:07:32.433683+0000 mgr.gibba043.dnkmem (mgr.34373) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:33 gibba003 bash[32348]: cluster 2021-03-10T15:07:32.433683+0000 mgr.gibba043.dnkmem (mgr.34373) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:34 gibba003 bash[31385]: cluster 2021-03-10T15:07:34.435203+0000 mgr.gibba043.dnkmem (mgr.34373) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:34 gibba003 bash[32348]: cluster 2021-03-10T15:07:34.435203+0000 mgr.gibba043.dnkmem (mgr.34373) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:34 gibba043 bash[24019]: cluster 2021-03-10T15:07:34.435203+0000 mgr.gibba043.dnkmem (mgr.34373) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:37 gibba043 bash[24019]: cephadm 2021-03-10T15:07:36.351433+0000 mgr.gibba043.dnkmem (mgr.34373) 4060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:37 gibba043 bash[24019]: cluster 2021-03-10T15:07:36.436972+0000 mgr.gibba043.dnkmem (mgr.34373) 4061 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:37 gibba003 bash[31385]: cephadm 2021-03-10T15:07:36.351433+0000 mgr.gibba043.dnkmem (mgr.34373) 4060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:37 gibba003 bash[31385]: cluster 2021-03-10T15:07:36.436972+0000 mgr.gibba043.dnkmem (mgr.34373) 4061 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:37 gibba003 bash[32348]: cephadm 2021-03-10T15:07:36.351433+0000 mgr.gibba043.dnkmem (mgr.34373) 4060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:37 gibba003 bash[32348]: cluster 2021-03-10T15:07:36.436972+0000 mgr.gibba043.dnkmem (mgr.34373) 4061 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:39 gibba043 bash[24019]: cluster 2021-03-10T15:07:38.438707+0000 mgr.gibba043.dnkmem (mgr.34373) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:39 gibba003 bash[31385]: cluster 2021-03-10T15:07:38.438707+0000 mgr.gibba043.dnkmem (mgr.34373) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:39 gibba003 bash[32348]: cluster 2021-03-10T15:07:38.438707+0000 mgr.gibba043.dnkmem (mgr.34373) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:41 gibba043 bash[24019]: cluster 2021-03-10T15:07:40.440217+0000 mgr.gibba043.dnkmem (mgr.34373) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:41 gibba003 bash[31385]: cluster 2021-03-10T15:07:40.440217+0000 mgr.gibba043.dnkmem (mgr.34373) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:41 gibba003 bash[32348]: cluster 2021-03-10T15:07:40.440217+0000 mgr.gibba043.dnkmem (mgr.34373) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:43 gibba003 bash[31385]: cluster 2021-03-10T15:07:42.441868+0000 mgr.gibba043.dnkmem (mgr.34373) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:43 gibba003 bash[32348]: cluster 2021-03-10T15:07:42.441868+0000 mgr.gibba043.dnkmem (mgr.34373) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:44.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:43 gibba043 bash[24019]: cluster 2021-03-10T15:07:42.441868+0000 mgr.gibba043.dnkmem (mgr.34373) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:44 gibba003 bash[31385]: cluster 2021-03-10T15:07:44.443696+0000 mgr.gibba043.dnkmem (mgr.34373) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:44 gibba003 bash[32348]: cluster 2021-03-10T15:07:44.443696+0000 mgr.gibba043.dnkmem (mgr.34373) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:44 gibba043 bash[24019]: cluster 2021-03-10T15:07:44.443696+0000 mgr.gibba043.dnkmem (mgr.34373) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:47 gibba043 bash[24019]: cluster 2021-03-10T15:07:46.445542+0000 mgr.gibba043.dnkmem (mgr.34373) 4066 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:47 gibba003 bash[31385]: cluster 2021-03-10T15:07:46.445542+0000 mgr.gibba043.dnkmem (mgr.34373) 4066 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:47 gibba003 bash[32348]: cluster 2021-03-10T15:07:46.445542+0000 mgr.gibba043.dnkmem (mgr.34373) 4066 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:49 gibba043 bash[24019]: cluster 2021-03-10T15:07:48.447096+0000 mgr.gibba043.dnkmem (mgr.34373) 4067 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:49 gibba003 bash[31385]: cluster 2021-03-10T15:07:48.447096+0000 mgr.gibba043.dnkmem (mgr.34373) 4067 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:49 gibba003 bash[32348]: cluster 2021-03-10T15:07:48.447096+0000 mgr.gibba043.dnkmem (mgr.34373) 4067 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:50.456 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:07:50.687 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:07:50.688 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (76m) 59s ago 81m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:07:50.688 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (81m) 10m ago 81m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:07:50.688 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (76m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:07:50.688 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (76m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:07:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (75m) 59s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:07:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (75m) 59s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:07:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (75m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:07:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (75m) 59s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:07:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (81m) 59s ago 81m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:07:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (81m) 10m ago 81m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:07:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (74m) 59s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:07:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (74m) 59s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:07:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (73m) 59s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:07:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (73m) 59s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:07:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (72m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:07:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:07:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (71m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:07:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (71m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:07:50.692 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (81m) 10m ago 81m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:07:50.692 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 59s ago 79m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:07:50.940 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:07:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:07:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:07:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:07:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:07:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:07:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:07:50.943 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:07:50.943 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:07:50.943 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:07:50.943 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:07:50.943 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:07:50.944 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:07:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[31385]: audit 2021-03-10T15:07:50.444016+0000 mgr.gibba043.dnkmem (mgr.34373) 4068 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[31385]: cluster 2021-03-10T15:07:50.448431+0000 mgr.gibba043.dnkmem (mgr.34373) 4069 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[31385]: audit 2021-03-10T15:07:50.672773+0000 mgr.gibba043.dnkmem (mgr.34373) 4070 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[31385]: audit 2021-03-10T15:07:50.938532+0000 mon.a (mon.0) 1091 : audit [DBG] from='client.? 172.21.2.103:0/286616330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:51.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[31385]: audit 2021-03-10T15:07:51.364313+0000 mon.c (mon.1) 1078 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:07:51.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[32348]: audit 2021-03-10T15:07:50.444016+0000 mgr.gibba043.dnkmem (mgr.34373) 4068 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:51.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[32348]: cluster 2021-03-10T15:07:50.448431+0000 mgr.gibba043.dnkmem (mgr.34373) 4069 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[32348]: audit 2021-03-10T15:07:50.672773+0000 mgr.gibba043.dnkmem (mgr.34373) 4070 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:51.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[32348]: audit 2021-03-10T15:07:50.938532+0000 mon.a (mon.0) 1091 : audit [DBG] from='client.? 172.21.2.103:0/286616330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:51.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:51 gibba003 bash[32348]: audit 2021-03-10T15:07:51.364313+0000 mon.c (mon.1) 1078 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:07:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:51 gibba043 bash[24019]: audit 2021-03-10T15:07:50.444016+0000 mgr.gibba043.dnkmem (mgr.34373) 4068 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:51 gibba043 bash[24019]: cluster 2021-03-10T15:07:50.448431+0000 mgr.gibba043.dnkmem (mgr.34373) 4069 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:51 gibba043 bash[24019]: audit 2021-03-10T15:07:50.672773+0000 mgr.gibba043.dnkmem (mgr.34373) 4070 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:52.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:51 gibba043 bash[24019]: audit 2021-03-10T15:07:50.938532+0000 mon.a (mon.0) 1091 : audit [DBG] from='client.? 172.21.2.103:0/286616330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:52.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:51 gibba043 bash[24019]: audit 2021-03-10T15:07:51.364313+0000 mon.c (mon.1) 1078 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:07:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:52 gibba003 bash[31385]: cephadm 2021-03-10T15:07:51.361390+0000 mgr.gibba043.dnkmem (mgr.34373) 4071 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:07:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:52 gibba003 bash[32348]: cephadm 2021-03-10T15:07:51.361390+0000 mgr.gibba043.dnkmem (mgr.34373) 4071 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:07:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:52 gibba043 bash[24019]: cephadm 2021-03-10T15:07:51.361390+0000 mgr.gibba043.dnkmem (mgr.34373) 4071 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:07:53.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:53 gibba003 bash[31385]: cluster 2021-03-10T15:07:52.450073+0000 mgr.gibba043.dnkmem (mgr.34373) 4072 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:53 gibba003 bash[32348]: cluster 2021-03-10T15:07:52.450073+0000 mgr.gibba043.dnkmem (mgr.34373) 4072 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:53 gibba043 bash[24019]: cluster 2021-03-10T15:07:52.450073+0000 mgr.gibba043.dnkmem (mgr.34373) 4072 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:54 gibba003 bash[31385]: cluster 2021-03-10T15:07:54.450639+0000 mgr.gibba043.dnkmem (mgr.34373) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:54 gibba003 bash[32348]: cluster 2021-03-10T15:07:54.450639+0000 mgr.gibba043.dnkmem (mgr.34373) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.223 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:54 gibba043 bash[24019]: cluster 2021-03-10T15:07:54.450639+0000 mgr.gibba043.dnkmem (mgr.34373) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.015680+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:07:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.015940+0000 mgr.gibba043.dnkmem (mgr.34373) 4074 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:07:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.207621+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:07:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.209673+0000 mgr.gibba043.dnkmem (mgr.34373) 4075 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:56.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.211325+0000 mon.c (mon.1) 1079 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:56.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.211664+0000 mgr.gibba043.dnkmem (mgr.34373) 4076 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:56.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.213130+0000 mon.c (mon.1) 1080 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.213254+0000 mgr.gibba043.dnkmem (mgr.34373) 4077 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:56.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.213291+0000 mgr.gibba043.dnkmem (mgr.34373) 4078 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:56.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.214638+0000 mon.c (mon.1) 1081 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.214701+0000 mgr.gibba043.dnkmem (mgr.34373) 4079 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:56.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.214737+0000 mgr.gibba043.dnkmem (mgr.34373) 4080 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:56.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.215912+0000 mgr.gibba043.dnkmem (mgr.34373) 4081 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:56.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.216077+0000 mon.c (mon.1) 1082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.217548+0000 mgr.gibba043.dnkmem (mgr.34373) 4082 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:56.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.217583+0000 mgr.gibba043.dnkmem (mgr.34373) 4083 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:56.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.218912+0000 mgr.gibba043.dnkmem (mgr.34373) 4084 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:56.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.219000+0000 mon.c (mon.1) 1083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.219234+0000 mgr.gibba043.dnkmem (mgr.34373) 4085 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:56.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.220294+0000 mgr.gibba043.dnkmem (mgr.34373) 4086 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:56.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.220330+0000 mgr.gibba043.dnkmem (mgr.34373) 4087 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:56.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: cephadm 2021-03-10T15:07:55.220444+0000 mgr.gibba043.dnkmem (mgr.34373) 4088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:56.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:56 gibba043 bash[24019]: audit 2021-03-10T15:07:55.220499+0000 mon.c (mon.1) 1084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.015680+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:07:56.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.015940+0000 mgr.gibba043.dnkmem (mgr.34373) 4074 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:07:56.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.207621+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:07:56.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.209673+0000 mgr.gibba043.dnkmem (mgr.34373) 4075 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:56.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.211325+0000 mon.c (mon.1) 1079 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:56.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.211664+0000 mgr.gibba043.dnkmem (mgr.34373) 4076 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:56.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.213130+0000 mon.c (mon.1) 1080 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.213254+0000 mgr.gibba043.dnkmem (mgr.34373) 4077 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:56.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.213291+0000 mgr.gibba043.dnkmem (mgr.34373) 4078 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:56.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.214638+0000 mon.c (mon.1) 1081 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.214701+0000 mgr.gibba043.dnkmem (mgr.34373) 4079 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:56.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.214737+0000 mgr.gibba043.dnkmem (mgr.34373) 4080 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:56.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.215912+0000 mgr.gibba043.dnkmem (mgr.34373) 4081 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:56.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.216077+0000 mon.c (mon.1) 1082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.217548+0000 mgr.gibba043.dnkmem (mgr.34373) 4082 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:56.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.217583+0000 mgr.gibba043.dnkmem (mgr.34373) 4083 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:56.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.218912+0000 mgr.gibba043.dnkmem (mgr.34373) 4084 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:56.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.219000+0000 mon.c (mon.1) 1083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.219234+0000 mgr.gibba043.dnkmem (mgr.34373) 4085 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:56.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.220294+0000 mgr.gibba043.dnkmem (mgr.34373) 4086 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:56.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.220330+0000 mgr.gibba043.dnkmem (mgr.34373) 4087 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:56.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: cephadm 2021-03-10T15:07:55.220444+0000 mgr.gibba043.dnkmem (mgr.34373) 4088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:56.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[32348]: audit 2021-03-10T15:07:55.220499+0000 mon.c (mon.1) 1084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.015680+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:07:56.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.015940+0000 mgr.gibba043.dnkmem (mgr.34373) 4074 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:07:56.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.207621+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:07:56.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.209673+0000 mgr.gibba043.dnkmem (mgr.34373) 4075 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:56.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.211325+0000 mon.c (mon.1) 1079 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:56.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.211664+0000 mgr.gibba043.dnkmem (mgr.34373) 4076 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:56.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.213130+0000 mon.c (mon.1) 1080 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.213254+0000 mgr.gibba043.dnkmem (mgr.34373) 4077 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:56.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.213291+0000 mgr.gibba043.dnkmem (mgr.34373) 4078 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:56.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.214638+0000 mon.c (mon.1) 1081 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.214701+0000 mgr.gibba043.dnkmem (mgr.34373) 4079 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:56.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.214737+0000 mgr.gibba043.dnkmem (mgr.34373) 4080 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:56.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.215912+0000 mgr.gibba043.dnkmem (mgr.34373) 4081 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:56.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.216077+0000 mon.c (mon.1) 1082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.217548+0000 mgr.gibba043.dnkmem (mgr.34373) 4082 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:56.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.217583+0000 mgr.gibba043.dnkmem (mgr.34373) 4083 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:56.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.218912+0000 mgr.gibba043.dnkmem (mgr.34373) 4084 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:56.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.219000+0000 mon.c (mon.1) 1083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:56.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.219234+0000 mgr.gibba043.dnkmem (mgr.34373) 4085 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:56.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.220294+0000 mgr.gibba043.dnkmem (mgr.34373) 4086 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:56.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.220330+0000 mgr.gibba043.dnkmem (mgr.34373) 4087 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:56.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: cephadm 2021-03-10T15:07:55.220444+0000 mgr.gibba043.dnkmem (mgr.34373) 4088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:07:56.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:56 gibba003 bash[31385]: audit 2021-03-10T15:07:55.220499+0000 mon.c (mon.1) 1084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:57 gibba003 bash[31385]: cluster 2021-03-10T15:07:56.452050+0000 mgr.gibba043.dnkmem (mgr.34373) 4089 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:57 gibba003 bash[32348]: cluster 2021-03-10T15:07:56.452050+0000 mgr.gibba043.dnkmem (mgr.34373) 4089 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:57 gibba043 bash[24019]: cluster 2021-03-10T15:07:56.452050+0000 mgr.gibba043.dnkmem (mgr.34373) 4089 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:07:59 gibba043 bash[24019]: cluster 2021-03-10T15:07:58.453461+0000 mgr.gibba043.dnkmem (mgr.34373) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:07:59 gibba003 bash[31385]: cluster 2021-03-10T15:07:58.453461+0000 mgr.gibba043.dnkmem (mgr.34373) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:07:59 gibba003 bash[32348]: cluster 2021-03-10T15:07:58.453461+0000 mgr.gibba043.dnkmem (mgr.34373) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:01 gibba003 bash[31385]: cluster 2021-03-10T15:08:00.455050+0000 mgr.gibba043.dnkmem (mgr.34373) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:01 gibba003 bash[32348]: cluster 2021-03-10T15:08:00.455050+0000 mgr.gibba043.dnkmem (mgr.34373) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:02.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:01 gibba043 bash[24019]: cluster 2021-03-10T15:08:00.455050+0000 mgr.gibba043.dnkmem (mgr.34373) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:03 gibba003 bash[31385]: cluster 2021-03-10T15:08:02.456796+0000 mgr.gibba043.dnkmem (mgr.34373) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:03 gibba003 bash[32348]: cluster 2021-03-10T15:08:02.456796+0000 mgr.gibba043.dnkmem (mgr.34373) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:03 gibba043 bash[24019]: cluster 2021-03-10T15:08:02.456796+0000 mgr.gibba043.dnkmem (mgr.34373) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:04 gibba003 bash[31385]: cluster 2021-03-10T15:08:04.458641+0000 mgr.gibba043.dnkmem (mgr.34373) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:04 gibba003 bash[32348]: cluster 2021-03-10T15:08:04.458641+0000 mgr.gibba043.dnkmem (mgr.34373) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:04 gibba043 bash[24019]: cluster 2021-03-10T15:08:04.458641+0000 mgr.gibba043.dnkmem (mgr.34373) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:07 gibba003 bash[31385]: cluster 2021-03-10T15:08:06.460183+0000 mgr.gibba043.dnkmem (mgr.34373) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:07 gibba003 bash[32348]: cluster 2021-03-10T15:08:06.460183+0000 mgr.gibba043.dnkmem (mgr.34373) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:07 gibba043 bash[24019]: cluster 2021-03-10T15:08:06.460183+0000 mgr.gibba043.dnkmem (mgr.34373) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:09 gibba003 bash[31385]: cluster 2021-03-10T15:08:08.461579+0000 mgr.gibba043.dnkmem (mgr.34373) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:09.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:09 gibba003 bash[32348]: cluster 2021-03-10T15:08:08.461579+0000 mgr.gibba043.dnkmem (mgr.34373) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:10.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:09 gibba043 bash[24019]: cluster 2021-03-10T15:08:08.461579+0000 mgr.gibba043.dnkmem (mgr.34373) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:11 gibba003 bash[31385]: cephadm 2021-03-10T15:08:10.226217+0000 mgr.gibba043.dnkmem (mgr.34373) 4096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:11.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:11 gibba003 bash[31385]: cluster 2021-03-10T15:08:10.462986+0000 mgr.gibba043.dnkmem (mgr.34373) 4097 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:11 gibba003 bash[32348]: cephadm 2021-03-10T15:08:10.226217+0000 mgr.gibba043.dnkmem (mgr.34373) 4096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:11.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:11 gibba003 bash[32348]: cluster 2021-03-10T15:08:10.462986+0000 mgr.gibba043.dnkmem (mgr.34373) 4097 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:11 gibba043 bash[24019]: cephadm 2021-03-10T15:08:10.226217+0000 mgr.gibba043.dnkmem (mgr.34373) 4096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:11 gibba043 bash[24019]: cluster 2021-03-10T15:08:10.462986+0000 mgr.gibba043.dnkmem (mgr.34373) 4097 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: cluster 2021-03-10T15:08:12.464681+0000 mgr.gibba043.dnkmem (mgr.34373) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.194514+0000 mon.c (mon.1) 1085 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.195629+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.289388+0000 mon.c (mon.1) 1086 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.290506+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.326023+0000 mon.c (mon.1) 1087 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:08:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.326737+0000 mon.c (mon.1) 1088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.327455+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:08:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.327860+0000 mon.c (mon.1) 1089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:08:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.329209+0000 mon.c (mon.1) 1090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.330036+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.330591+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:08:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[31385]: audit 2021-03-10T15:08:13.330833+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: cluster 2021-03-10T15:08:12.464681+0000 mgr.gibba043.dnkmem (mgr.34373) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.194514+0000 mon.c (mon.1) 1085 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.195629+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.289388+0000 mon.c (mon.1) 1086 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.290506+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.326023+0000 mon.c (mon.1) 1087 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:08:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.326737+0000 mon.c (mon.1) 1088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.327455+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:08:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.327860+0000 mon.c (mon.1) 1089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:08:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.329209+0000 mon.c (mon.1) 1090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.330036+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:08:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.330591+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:08:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:13 gibba003 bash[32348]: audit 2021-03-10T15:08:13.330833+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:08:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: cluster 2021-03-10T15:08:12.464681+0000 mgr.gibba043.dnkmem (mgr.34373) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.194514+0000 mon.c (mon.1) 1085 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.195629+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.289388+0000 mon.c (mon.1) 1086 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.290506+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.326023+0000 mon.c (mon.1) 1087 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:08:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.326737+0000 mon.c (mon.1) 1088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:08:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.327455+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:08:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.327860+0000 mon.c (mon.1) 1089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:08:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.329209+0000 mon.c (mon.1) 1090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:08:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.330036+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:08:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.330591+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:08:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:13 gibba043 bash[24019]: audit 2021-03-10T15:08:13.330833+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:08:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:14 gibba003 bash[31385]: cluster 2021-03-10T15:08:14.466564+0000 mgr.gibba043.dnkmem (mgr.34373) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:14 gibba003 bash[32348]: cluster 2021-03-10T15:08:14.466564+0000 mgr.gibba043.dnkmem (mgr.34373) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:14 gibba043 bash[24019]: cluster 2021-03-10T15:08:14.466564+0000 mgr.gibba043.dnkmem (mgr.34373) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:17 gibba003 bash[31385]: cluster 2021-03-10T15:08:16.467472+0000 mgr.gibba043.dnkmem (mgr.34373) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:17 gibba003 bash[32348]: cluster 2021-03-10T15:08:16.467472+0000 mgr.gibba043.dnkmem (mgr.34373) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:17 gibba043 bash[24019]: cluster 2021-03-10T15:08:16.467472+0000 mgr.gibba043.dnkmem (mgr.34373) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:19 gibba003 bash[31385]: cluster 2021-03-10T15:08:18.468904+0000 mgr.gibba043.dnkmem (mgr.34373) 4101 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:19.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:19 gibba003 bash[32348]: cluster 2021-03-10T15:08:18.468904+0000 mgr.gibba043.dnkmem (mgr.34373) 4101 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:19 gibba043 bash[24019]: cluster 2021-03-10T15:08:18.468904+0000 mgr.gibba043.dnkmem (mgr.34373) 4101 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.185 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:08:21.412 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:08:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (76m) 90s ago 82m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:08:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (81m) 26s ago 81m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:08:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (77m) 26s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:08:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (77m) 26s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:08:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (76m) 90s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:08:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (76m) 90s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:08:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (75m) 26s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:08:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (75m) 90s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:08:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (82m) 90s ago 82m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:08:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (82m) 26s ago 82m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:08:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (75m) 90s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:08:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (74m) 90s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:08:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (74m) 90s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:08:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (73m) 90s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:08:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (73m) 26s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:08:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (72m) 26s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:08:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (72m) 26s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:08:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (72m) 26s ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:08:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (81m) 26s ago 82m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:08:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 90s ago 80m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:08:21.673 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:08:21.673 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:08:21.673 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:21.674 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:08:21.674 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:08:21.674 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:21.674 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:08:21.675 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:08:21.675 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:08:21.675 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:08:21.675 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:08:21.676 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:08:21.676 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:08:21.676 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:08:21.676 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:08:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:21 gibba003 bash[31385]: cluster 2021-03-10T15:08:20.470316+0000 mgr.gibba043.dnkmem (mgr.34373) 4102 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:21 gibba003 bash[32348]: cluster 2021-03-10T15:08:20.470316+0000 mgr.gibba043.dnkmem (mgr.34373) 4102 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:21 gibba043 bash[24019]: cluster 2021-03-10T15:08:20.470316+0000 mgr.gibba043.dnkmem (mgr.34373) 4102 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:22 gibba003 bash[31385]: audit 2021-03-10T15:08:21.173608+0000 mgr.gibba043.dnkmem (mgr.34373) 4103 : audit [DBG] from='client.56794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:22 gibba003 bash[31385]: audit 2021-03-10T15:08:21.399944+0000 mgr.gibba043.dnkmem (mgr.34373) 4104 : audit [DBG] from='client.56800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:22.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:22 gibba003 bash[31385]: audit 2021-03-10T15:08:21.671294+0000 mon.c (mon.1) 1091 : audit [DBG] from='client.? 172.21.2.103:0/3971499701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:22 gibba003 bash[32348]: audit 2021-03-10T15:08:21.173608+0000 mgr.gibba043.dnkmem (mgr.34373) 4103 : audit [DBG] from='client.56794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:22 gibba003 bash[32348]: audit 2021-03-10T15:08:21.399944+0000 mgr.gibba043.dnkmem (mgr.34373) 4104 : audit [DBG] from='client.56800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:22 gibba003 bash[32348]: audit 2021-03-10T15:08:21.671294+0000 mon.c (mon.1) 1091 : audit [DBG] from='client.? 172.21.2.103:0/3971499701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:22 gibba043 bash[24019]: audit 2021-03-10T15:08:21.173608+0000 mgr.gibba043.dnkmem (mgr.34373) 4103 : audit [DBG] from='client.56794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:22 gibba043 bash[24019]: audit 2021-03-10T15:08:21.399944+0000 mgr.gibba043.dnkmem (mgr.34373) 4104 : audit [DBG] from='client.56800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:22 gibba043 bash[24019]: audit 2021-03-10T15:08:21.671294+0000 mon.c (mon.1) 1091 : audit [DBG] from='client.? 172.21.2.103:0/3971499701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:23 gibba003 bash[31385]: cluster 2021-03-10T15:08:22.471960+0000 mgr.gibba043.dnkmem (mgr.34373) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:23.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:23 gibba003 bash[32348]: cluster 2021-03-10T15:08:22.471960+0000 mgr.gibba043.dnkmem (mgr.34373) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:23 gibba043 bash[24019]: cluster 2021-03-10T15:08:22.471960+0000 mgr.gibba043.dnkmem (mgr.34373) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:24 gibba003 bash[31385]: cluster 2021-03-10T15:08:24.473836+0000 mgr.gibba043.dnkmem (mgr.34373) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:24 gibba003 bash[32348]: cluster 2021-03-10T15:08:24.473836+0000 mgr.gibba043.dnkmem (mgr.34373) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.243 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:24 gibba043 bash[24019]: cluster 2021-03-10T15:08:24.473836+0000 mgr.gibba043.dnkmem (mgr.34373) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:26.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:25 gibba003 bash[31385]: cephadm 2021-03-10T15:08:25.240666+0000 mgr.gibba043.dnkmem (mgr.34373) 4107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:26.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:25 gibba003 bash[32348]: cephadm 2021-03-10T15:08:25.240666+0000 mgr.gibba043.dnkmem (mgr.34373) 4107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:25 gibba043 bash[24019]: cephadm 2021-03-10T15:08:25.240666+0000 mgr.gibba043.dnkmem (mgr.34373) 4107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:26 gibba003 bash[31385]: cluster 2021-03-10T15:08:26.474823+0000 mgr.gibba043.dnkmem (mgr.34373) 4108 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:26 gibba003 bash[32348]: cluster 2021-03-10T15:08:26.474823+0000 mgr.gibba043.dnkmem (mgr.34373) 4108 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:26 gibba043 bash[24019]: cluster 2021-03-10T15:08:26.474823+0000 mgr.gibba043.dnkmem (mgr.34373) 4108 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:29 gibba003 bash[31385]: cluster 2021-03-10T15:08:28.476126+0000 mgr.gibba043.dnkmem (mgr.34373) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:29 gibba003 bash[32348]: cluster 2021-03-10T15:08:28.476126+0000 mgr.gibba043.dnkmem (mgr.34373) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:29 gibba043 bash[24019]: cluster 2021-03-10T15:08:28.476126+0000 mgr.gibba043.dnkmem (mgr.34373) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:31 gibba003 bash[31385]: cluster 2021-03-10T15:08:30.477703+0000 mgr.gibba043.dnkmem (mgr.34373) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:31 gibba003 bash[32348]: cluster 2021-03-10T15:08:30.477703+0000 mgr.gibba043.dnkmem (mgr.34373) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:31 gibba043 bash[24019]: cluster 2021-03-10T15:08:30.477703+0000 mgr.gibba043.dnkmem (mgr.34373) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:33 gibba003 bash[31385]: cluster 2021-03-10T15:08:32.479408+0000 mgr.gibba043.dnkmem (mgr.34373) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:33 gibba003 bash[32348]: cluster 2021-03-10T15:08:32.479408+0000 mgr.gibba043.dnkmem (mgr.34373) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:33 gibba043 bash[24019]: cluster 2021-03-10T15:08:32.479408+0000 mgr.gibba043.dnkmem (mgr.34373) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:34 gibba003 bash[31385]: cluster 2021-03-10T15:08:34.481236+0000 mgr.gibba043.dnkmem (mgr.34373) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:34 gibba003 bash[32348]: cluster 2021-03-10T15:08:34.481236+0000 mgr.gibba043.dnkmem (mgr.34373) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:34 gibba043 bash[24019]: cluster 2021-03-10T15:08:34.481236+0000 mgr.gibba043.dnkmem (mgr.34373) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:37 gibba003 bash[31385]: cluster 2021-03-10T15:08:36.482895+0000 mgr.gibba043.dnkmem (mgr.34373) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:37 gibba003 bash[32348]: cluster 2021-03-10T15:08:36.482895+0000 mgr.gibba043.dnkmem (mgr.34373) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:37 gibba043 bash[24019]: cluster 2021-03-10T15:08:36.482895+0000 mgr.gibba043.dnkmem (mgr.34373) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:39 gibba003 bash[31385]: cluster 2021-03-10T15:08:38.484609+0000 mgr.gibba043.dnkmem (mgr.34373) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:39 gibba003 bash[32348]: cluster 2021-03-10T15:08:38.484609+0000 mgr.gibba043.dnkmem (mgr.34373) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:39 gibba043 bash[24019]: cluster 2021-03-10T15:08:38.484609+0000 mgr.gibba043.dnkmem (mgr.34373) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:41 gibba003 bash[31385]: cephadm 2021-03-10T15:08:40.256787+0000 mgr.gibba043.dnkmem (mgr.34373) 4115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:41 gibba003 bash[31385]: cluster 2021-03-10T15:08:40.486168+0000 mgr.gibba043.dnkmem (mgr.34373) 4116 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:41.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:41 gibba003 bash[32348]: cephadm 2021-03-10T15:08:40.256787+0000 mgr.gibba043.dnkmem (mgr.34373) 4115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:41.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:41 gibba003 bash[32348]: cluster 2021-03-10T15:08:40.486168+0000 mgr.gibba043.dnkmem (mgr.34373) 4116 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:41 gibba043 bash[24019]: cephadm 2021-03-10T15:08:40.256787+0000 mgr.gibba043.dnkmem (mgr.34373) 4115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:41 gibba043 bash[24019]: cluster 2021-03-10T15:08:40.486168+0000 mgr.gibba043.dnkmem (mgr.34373) 4116 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:43 gibba003 bash[31385]: cluster 2021-03-10T15:08:42.487932+0000 mgr.gibba043.dnkmem (mgr.34373) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:43 gibba003 bash[32348]: cluster 2021-03-10T15:08:42.487932+0000 mgr.gibba043.dnkmem (mgr.34373) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:44.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:43 gibba043 bash[24019]: cluster 2021-03-10T15:08:42.487932+0000 mgr.gibba043.dnkmem (mgr.34373) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:44 gibba003 bash[31385]: cluster 2021-03-10T15:08:44.489481+0000 mgr.gibba043.dnkmem (mgr.34373) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:44 gibba003 bash[32348]: cluster 2021-03-10T15:08:44.489481+0000 mgr.gibba043.dnkmem (mgr.34373) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:44 gibba043 bash[24019]: cluster 2021-03-10T15:08:44.489481+0000 mgr.gibba043.dnkmem (mgr.34373) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:47 gibba003 bash[31385]: cluster 2021-03-10T15:08:46.490153+0000 mgr.gibba043.dnkmem (mgr.34373) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:47 gibba003 bash[32348]: cluster 2021-03-10T15:08:46.490153+0000 mgr.gibba043.dnkmem (mgr.34373) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:47 gibba043 bash[24019]: cluster 2021-03-10T15:08:46.490153+0000 mgr.gibba043.dnkmem (mgr.34373) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:49 gibba003 bash[31385]: cluster 2021-03-10T15:08:48.491721+0000 mgr.gibba043.dnkmem (mgr.34373) 4120 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:49 gibba003 bash[32348]: cluster 2021-03-10T15:08:48.491721+0000 mgr.gibba043.dnkmem (mgr.34373) 4120 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:49 gibba043 bash[24019]: cluster 2021-03-10T15:08:48.491721+0000 mgr.gibba043.dnkmem (mgr.34373) 4120 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.919 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:08:51.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:51 gibba003 bash[31385]: cluster 2021-03-10T15:08:50.493099+0000 mgr.gibba043.dnkmem (mgr.34373) 4121 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:51 gibba003 bash[32348]: cluster 2021-03-10T15:08:50.493099+0000 mgr.gibba043.dnkmem (mgr.34373) 4121 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:51 gibba043 bash[24019]: cluster 2021-03-10T15:08:50.493099+0000 mgr.gibba043.dnkmem (mgr.34373) 4121 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:52.151 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:08:52.151 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (77m) 2m ago 82m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:08:52.151 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (82m) 57s ago 82m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:08:52.152 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (77m) 57s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:08:52.152 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (77m) 57s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:08:52.152 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (76m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:08:52.152 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (76m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:08:52.153 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (76m) 57s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:08:52.153 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:08:52.153 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (82m) 2m ago 82m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:08:52.153 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (82m) 57s ago 82m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:08:52.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:08:52.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:08:52.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:08:52.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (74m) 2m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:08:52.154 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (73m) 57s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:08:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (73m) 57s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:08:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (72m) 57s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:08:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (72m) 57s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:08:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (82m) 57s ago 82m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:08:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 80m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:08:52.405 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:08:52.406 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:08:52.406 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:08:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:08:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:08:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:08:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:08:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:08:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:08:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:08:52.409 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:08:52.409 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:08:52.409 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:08:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:52 gibba003 bash[31385]: audit 2021-03-10T15:08:52.403729+0000 mon.a (mon.0) 1100 : audit [DBG] from='client.? 172.21.2.103:0/3800042812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:52 gibba003 bash[32348]: audit 2021-03-10T15:08:52.403729+0000 mon.a (mon.0) 1100 : audit [DBG] from='client.? 172.21.2.103:0/3800042812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:52 gibba043 bash[24019]: audit 2021-03-10T15:08:52.403729+0000 mon.a (mon.0) 1100 : audit [DBG] from='client.? 172.21.2.103:0/3800042812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:53 gibba003 bash[31385]: audit 2021-03-10T15:08:51.907893+0000 mgr.gibba043.dnkmem (mgr.34373) 4122 : audit [DBG] from='client.46824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:53 gibba003 bash[31385]: audit 2021-03-10T15:08:52.136115+0000 mgr.gibba043.dnkmem (mgr.34373) 4123 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:53 gibba003 bash[31385]: cluster 2021-03-10T15:08:52.494931+0000 mgr.gibba043.dnkmem (mgr.34373) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:53 gibba003 bash[32348]: audit 2021-03-10T15:08:51.907893+0000 mgr.gibba043.dnkmem (mgr.34373) 4122 : audit [DBG] from='client.46824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:53.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:53 gibba003 bash[32348]: audit 2021-03-10T15:08:52.136115+0000 mgr.gibba043.dnkmem (mgr.34373) 4123 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:53.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:53 gibba003 bash[32348]: cluster 2021-03-10T15:08:52.494931+0000 mgr.gibba043.dnkmem (mgr.34373) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:53 gibba043 bash[24019]: audit 2021-03-10T15:08:51.907893+0000 mgr.gibba043.dnkmem (mgr.34373) 4122 : audit [DBG] from='client.46824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:53 gibba043 bash[24019]: audit 2021-03-10T15:08:52.136115+0000 mgr.gibba043.dnkmem (mgr.34373) 4123 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:54.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:53 gibba043 bash[24019]: cluster 2021-03-10T15:08:52.494931+0000 mgr.gibba043.dnkmem (mgr.34373) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:54 gibba003 bash[31385]: cluster 2021-03-10T15:08:54.496561+0000 mgr.gibba043.dnkmem (mgr.34373) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:54 gibba003 bash[32348]: cluster 2021-03-10T15:08:54.496561+0000 mgr.gibba043.dnkmem (mgr.34373) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:54 gibba043 bash[24019]: cluster 2021-03-10T15:08:54.496561+0000 mgr.gibba043.dnkmem (mgr.34373) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.273258+0000 mgr.gibba043.dnkmem (mgr.34373) 4126 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:08:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.274871+0000 mgr.gibba043.dnkmem (mgr.34373) 4127 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:08:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.497851+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:08:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.500271+0000 mgr.gibba043.dnkmem (mgr.34373) 4128 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:56.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.502012+0000 mon.c (mon.1) 1092 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:56.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.502348+0000 mgr.gibba043.dnkmem (mgr.34373) 4129 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:56.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.503950+0000 mon.c (mon.1) 1093 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.504019+0000 mgr.gibba043.dnkmem (mgr.34373) 4130 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:56.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.504061+0000 mgr.gibba043.dnkmem (mgr.34373) 4131 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:56.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.505438+0000 mon.c (mon.1) 1094 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.506005+0000 mgr.gibba043.dnkmem (mgr.34373) 4132 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:56.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.506047+0000 mgr.gibba043.dnkmem (mgr.34373) 4133 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:56.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.507302+0000 mon.c (mon.1) 1095 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.507519+0000 mgr.gibba043.dnkmem (mgr.34373) 4134 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:56.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.509523+0000 mgr.gibba043.dnkmem (mgr.34373) 4135 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:56.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.509564+0000 mgr.gibba043.dnkmem (mgr.34373) 4136 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:56.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.511153+0000 mon.c (mon.1) 1096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.511536+0000 mgr.gibba043.dnkmem (mgr.34373) 4137 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:56.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.512010+0000 mgr.gibba043.dnkmem (mgr.34373) 4138 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:56.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.513037+0000 mgr.gibba043.dnkmem (mgr.34373) 4139 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:56.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.513084+0000 mgr.gibba043.dnkmem (mgr.34373) 4140 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:56.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: audit 2021-03-10T15:08:55.513183+0000 mon.c (mon.1) 1097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:56 gibba043 bash[24019]: cephadm 2021-03-10T15:08:55.513214+0000 mgr.gibba043.dnkmem (mgr.34373) 4141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.273258+0000 mgr.gibba043.dnkmem (mgr.34373) 4126 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:08:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.274871+0000 mgr.gibba043.dnkmem (mgr.34373) 4127 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:08:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.497851+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:08:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.500271+0000 mgr.gibba043.dnkmem (mgr.34373) 4128 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.502012+0000 mon.c (mon.1) 1092 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.502348+0000 mgr.gibba043.dnkmem (mgr.34373) 4129 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.503950+0000 mon.c (mon.1) 1093 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.504019+0000 mgr.gibba043.dnkmem (mgr.34373) 4130 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.504061+0000 mgr.gibba043.dnkmem (mgr.34373) 4131 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:56.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.505438+0000 mon.c (mon.1) 1094 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.506005+0000 mgr.gibba043.dnkmem (mgr.34373) 4132 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:56.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.506047+0000 mgr.gibba043.dnkmem (mgr.34373) 4133 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:56.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.507302+0000 mon.c (mon.1) 1095 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.507519+0000 mgr.gibba043.dnkmem (mgr.34373) 4134 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:56.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.509523+0000 mgr.gibba043.dnkmem (mgr.34373) 4135 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:56.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.509564+0000 mgr.gibba043.dnkmem (mgr.34373) 4136 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:56.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.511153+0000 mon.c (mon.1) 1096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.511536+0000 mgr.gibba043.dnkmem (mgr.34373) 4137 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:56.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.512010+0000 mgr.gibba043.dnkmem (mgr.34373) 4138 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:56.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.513037+0000 mgr.gibba043.dnkmem (mgr.34373) 4139 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:56.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.513084+0000 mgr.gibba043.dnkmem (mgr.34373) 4140 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:56.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: audit 2021-03-10T15:08:55.513183+0000 mon.c (mon.1) 1097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[31385]: cephadm 2021-03-10T15:08:55.513214+0000 mgr.gibba043.dnkmem (mgr.34373) 4141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:56.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.273258+0000 mgr.gibba043.dnkmem (mgr.34373) 4126 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:08:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.274871+0000 mgr.gibba043.dnkmem (mgr.34373) 4127 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:08:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.497851+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:08:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.500271+0000 mgr.gibba043.dnkmem (mgr.34373) 4128 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:56.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.502012+0000 mon.c (mon.1) 1092 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:56.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.502348+0000 mgr.gibba043.dnkmem (mgr.34373) 4129 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:56.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.503950+0000 mon.c (mon.1) 1093 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.504019+0000 mgr.gibba043.dnkmem (mgr.34373) 4130 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:56.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.504061+0000 mgr.gibba043.dnkmem (mgr.34373) 4131 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:56.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.505438+0000 mon.c (mon.1) 1094 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.506005+0000 mgr.gibba043.dnkmem (mgr.34373) 4132 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:56.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.506047+0000 mgr.gibba043.dnkmem (mgr.34373) 4133 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:56.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.507302+0000 mon.c (mon.1) 1095 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.507519+0000 mgr.gibba043.dnkmem (mgr.34373) 4134 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:56.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.509523+0000 mgr.gibba043.dnkmem (mgr.34373) 4135 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:56.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.509564+0000 mgr.gibba043.dnkmem (mgr.34373) 4136 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:56.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.511153+0000 mon.c (mon.1) 1096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.511536+0000 mgr.gibba043.dnkmem (mgr.34373) 4137 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:56.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.512010+0000 mgr.gibba043.dnkmem (mgr.34373) 4138 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:56.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.513037+0000 mgr.gibba043.dnkmem (mgr.34373) 4139 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:56.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.513084+0000 mgr.gibba043.dnkmem (mgr.34373) 4140 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:56.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: audit 2021-03-10T15:08:55.513183+0000 mon.c (mon.1) 1097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:56.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:56 gibba003 bash[32348]: cephadm 2021-03-10T15:08:55.513214+0000 mgr.gibba043.dnkmem (mgr.34373) 4141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:08:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:57 gibba043 bash[24019]: cluster 2021-03-10T15:08:56.497563+0000 mgr.gibba043.dnkmem (mgr.34373) 4142 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:57 gibba003 bash[31385]: cluster 2021-03-10T15:08:56.497563+0000 mgr.gibba043.dnkmem (mgr.34373) 4142 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:57 gibba003 bash[32348]: cluster 2021-03-10T15:08:56.497563+0000 mgr.gibba043.dnkmem (mgr.34373) 4142 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:08:59 gibba003 bash[31385]: cluster 2021-03-10T15:08:58.499044+0000 mgr.gibba043.dnkmem (mgr.34373) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:59.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:08:59 gibba003 bash[32348]: cluster 2021-03-10T15:08:58.499044+0000 mgr.gibba043.dnkmem (mgr.34373) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:08:59 gibba043 bash[24019]: cluster 2021-03-10T15:08:58.499044+0000 mgr.gibba043.dnkmem (mgr.34373) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:01 gibba003 bash[31385]: cluster 2021-03-10T15:09:00.500620+0000 mgr.gibba043.dnkmem (mgr.34373) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:01 gibba003 bash[32348]: cluster 2021-03-10T15:09:00.500620+0000 mgr.gibba043.dnkmem (mgr.34373) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:02.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:01 gibba043 bash[24019]: cluster 2021-03-10T15:09:00.500620+0000 mgr.gibba043.dnkmem (mgr.34373) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:03 gibba003 bash[31385]: cluster 2021-03-10T15:09:02.501995+0000 mgr.gibba043.dnkmem (mgr.34373) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:03 gibba003 bash[32348]: cluster 2021-03-10T15:09:02.501995+0000 mgr.gibba043.dnkmem (mgr.34373) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:03 gibba043 bash[24019]: cluster 2021-03-10T15:09:02.501995+0000 mgr.gibba043.dnkmem (mgr.34373) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:04 gibba003 bash[31385]: cluster 2021-03-10T15:09:04.503773+0000 mgr.gibba043.dnkmem (mgr.34373) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:04 gibba003 bash[32348]: cluster 2021-03-10T15:09:04.503773+0000 mgr.gibba043.dnkmem (mgr.34373) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:04 gibba043 bash[24019]: cluster 2021-03-10T15:09:04.503773+0000 mgr.gibba043.dnkmem (mgr.34373) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:07 gibba003 bash[31385]: cluster 2021-03-10T15:09:06.504724+0000 mgr.gibba043.dnkmem (mgr.34373) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:07 gibba003 bash[32348]: cluster 2021-03-10T15:09:06.504724+0000 mgr.gibba043.dnkmem (mgr.34373) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:07 gibba043 bash[24019]: cluster 2021-03-10T15:09:06.504724+0000 mgr.gibba043.dnkmem (mgr.34373) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:09 gibba003 bash[31385]: cluster 2021-03-10T15:09:08.506203+0000 mgr.gibba043.dnkmem (mgr.34373) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:09.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:09 gibba003 bash[32348]: cluster 2021-03-10T15:09:08.506203+0000 mgr.gibba043.dnkmem (mgr.34373) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:09 gibba043 bash[24019]: cluster 2021-03-10T15:09:08.506203+0000 mgr.gibba043.dnkmem (mgr.34373) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:11 gibba003 bash[31385]: cluster 2021-03-10T15:09:10.507654+0000 mgr.gibba043.dnkmem (mgr.34373) 4149 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:11 gibba003 bash[31385]: cephadm 2021-03-10T15:09:10.529007+0000 mgr.gibba043.dnkmem (mgr.34373) 4150 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:11.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:11 gibba003 bash[32348]: cluster 2021-03-10T15:09:10.507654+0000 mgr.gibba043.dnkmem (mgr.34373) 4149 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:11.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:11 gibba003 bash[32348]: cephadm 2021-03-10T15:09:10.529007+0000 mgr.gibba043.dnkmem (mgr.34373) 4150 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:11 gibba043 bash[24019]: cluster 2021-03-10T15:09:10.507654+0000 mgr.gibba043.dnkmem (mgr.34373) 4149 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:11 gibba043 bash[24019]: cephadm 2021-03-10T15:09:10.529007+0000 mgr.gibba043.dnkmem (mgr.34373) 4150 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: cluster 2021-03-10T15:09:12.509054+0000 mgr.gibba043.dnkmem (mgr.34373) 4151 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.201498+0000 mon.c (mon.1) 1098 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.202633+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.295339+0000 mon.c (mon.1) 1099 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.296450+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.337655+0000 mon.c (mon.1) 1100 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.338388+0000 mon.c (mon.1) 1101 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.338840+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.339107+0000 mon.c (mon.1) 1102 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:09:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.339778+0000 mon.c (mon.1) 1103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.340141+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.341566+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:09:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[31385]: audit 2021-03-10T15:09:13.342523+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: cluster 2021-03-10T15:09:12.509054+0000 mgr.gibba043.dnkmem (mgr.34373) 4151 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.201498+0000 mon.c (mon.1) 1098 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.202633+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.295339+0000 mon.c (mon.1) 1099 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.296450+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.337655+0000 mon.c (mon.1) 1100 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.338388+0000 mon.c (mon.1) 1101 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.338840+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.339107+0000 mon.c (mon.1) 1102 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:09:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.339778+0000 mon.c (mon.1) 1103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.340141+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:09:13.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.341566+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:09:13.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:13 gibba003 bash[32348]: audit 2021-03-10T15:09:13.342523+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:09:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: cluster 2021-03-10T15:09:12.509054+0000 mgr.gibba043.dnkmem (mgr.34373) 4151 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.201498+0000 mon.c (mon.1) 1098 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.202633+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.295339+0000 mon.c (mon.1) 1099 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.296450+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.337655+0000 mon.c (mon.1) 1100 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.338388+0000 mon.c (mon.1) 1101 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:09:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.338840+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.339107+0000 mon.c (mon.1) 1102 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:09:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.339778+0000 mon.c (mon.1) 1103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:09:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.340141+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:09:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.341566+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:09:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:13 gibba043 bash[24019]: audit 2021-03-10T15:09:13.342523+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:09:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:14 gibba003 bash[31385]: cluster 2021-03-10T15:09:14.510770+0000 mgr.gibba043.dnkmem (mgr.34373) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:14 gibba003 bash[32348]: cluster 2021-03-10T15:09:14.510770+0000 mgr.gibba043.dnkmem (mgr.34373) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:14 gibba043 bash[24019]: cluster 2021-03-10T15:09:14.510770+0000 mgr.gibba043.dnkmem (mgr.34373) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:17 gibba003 bash[31385]: cluster 2021-03-10T15:09:16.512526+0000 mgr.gibba043.dnkmem (mgr.34373) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:17 gibba003 bash[32348]: cluster 2021-03-10T15:09:16.512526+0000 mgr.gibba043.dnkmem (mgr.34373) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:17 gibba043 bash[24019]: cluster 2021-03-10T15:09:16.512526+0000 mgr.gibba043.dnkmem (mgr.34373) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:19 gibba003 bash[31385]: cluster 2021-03-10T15:09:18.514013+0000 mgr.gibba043.dnkmem (mgr.34373) 4154 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:19 gibba003 bash[32348]: cluster 2021-03-10T15:09:18.514013+0000 mgr.gibba043.dnkmem (mgr.34373) 4154 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:19 gibba043 bash[24019]: cluster 2021-03-10T15:09:18.514013+0000 mgr.gibba043.dnkmem (mgr.34373) 4154 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:21 gibba003 bash[31385]: cluster 2021-03-10T15:09:20.515393+0000 mgr.gibba043.dnkmem (mgr.34373) 4155 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:21 gibba003 bash[32348]: cluster 2021-03-10T15:09:20.515393+0000 mgr.gibba043.dnkmem (mgr.34373) 4155 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:21 gibba043 bash[24019]: cluster 2021-03-10T15:09:20.515393+0000 mgr.gibba043.dnkmem (mgr.34373) 4155 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:22.651 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:09:22.905 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:09:22.906 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (77m) 2m ago 83m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:09:22.906 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (82m) 87s ago 82m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:09:22.906 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (78m) 87s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:09:22.907 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (78m) 87s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:09:22.907 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:09:22.907 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:09:22.907 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (76m) 87s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:09:22.908 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (77m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:09:22.908 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (83m) 2m ago 83m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:09:22.908 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (83m) 87s ago 83m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:09:22.908 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:09:22.909 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:09:22.909 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:09:22.909 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:09:22.909 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (74m) 87s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:09:22.910 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (73m) 87s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:09:22.910 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (73m) 87s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:09:22.910 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (73m) 87s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:09:22.910 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (82m) 87s ago 83m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:09:22.911 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 81m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:09:23.182 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:09:23.182 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:09:23.183 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:23.183 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:09:23.183 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:09:23.183 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:23.184 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:09:23.184 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:09:23.184 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:09:23.184 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:09:23.184 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:09:23.185 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:09:23.185 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:09:23.185 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:09:23.185 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:09:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:23 gibba003 bash[31385]: cluster 2021-03-10T15:09:22.517062+0000 mgr.gibba043.dnkmem (mgr.34373) 4156 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:23 gibba003 bash[31385]: audit 2021-03-10T15:09:22.639363+0000 mgr.gibba043.dnkmem (mgr.34373) 4157 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:23.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:23 gibba003 bash[31385]: audit 2021-03-10T15:09:23.180209+0000 mon.c (mon.1) 1104 : audit [DBG] from='client.? 172.21.2.103:0/3544900360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:23.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:23 gibba003 bash[32348]: cluster 2021-03-10T15:09:22.517062+0000 mgr.gibba043.dnkmem (mgr.34373) 4156 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:23 gibba003 bash[32348]: audit 2021-03-10T15:09:22.639363+0000 mgr.gibba043.dnkmem (mgr.34373) 4157 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:23.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:23 gibba003 bash[32348]: audit 2021-03-10T15:09:23.180209+0000 mon.c (mon.1) 1104 : audit [DBG] from='client.? 172.21.2.103:0/3544900360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:23 gibba043 bash[24019]: cluster 2021-03-10T15:09:22.517062+0000 mgr.gibba043.dnkmem (mgr.34373) 4156 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:23 gibba043 bash[24019]: audit 2021-03-10T15:09:22.639363+0000 mgr.gibba043.dnkmem (mgr.34373) 4157 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:24.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:23 gibba043 bash[24019]: audit 2021-03-10T15:09:23.180209+0000 mon.c (mon.1) 1104 : audit [DBG] from='client.? 172.21.2.103:0/3544900360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:24.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:24 gibba003 bash[31385]: audit 2021-03-10T15:09:22.861892+0000 mgr.gibba043.dnkmem (mgr.34373) 4158 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:24 gibba003 bash[32348]: audit 2021-03-10T15:09:22.861892+0000 mgr.gibba043.dnkmem (mgr.34373) 4158 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:24 gibba043 bash[24019]: audit 2021-03-10T15:09:22.861892+0000 mgr.gibba043.dnkmem (mgr.34373) 4158 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:25.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:25 gibba003 bash[31385]: cluster 2021-03-10T15:09:24.518881+0000 mgr.gibba043.dnkmem (mgr.34373) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:25 gibba003 bash[32348]: cluster 2021-03-10T15:09:24.518881+0000 mgr.gibba043.dnkmem (mgr.34373) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:26.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:25 gibba043 bash[24019]: cluster 2021-03-10T15:09:24.518881+0000 mgr.gibba043.dnkmem (mgr.34373) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:26 gibba003 bash[31385]: cephadm 2021-03-10T15:09:25.535350+0000 mgr.gibba043.dnkmem (mgr.34373) 4160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:26.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:26 gibba003 bash[32348]: cephadm 2021-03-10T15:09:25.535350+0000 mgr.gibba043.dnkmem (mgr.34373) 4160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:26 gibba043 bash[24019]: cephadm 2021-03-10T15:09:25.535350+0000 mgr.gibba043.dnkmem (mgr.34373) 4160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:27.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:27 gibba003 bash[31385]: cluster 2021-03-10T15:09:26.519975+0000 mgr.gibba043.dnkmem (mgr.34373) 4161 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:27 gibba003 bash[32348]: cluster 2021-03-10T15:09:26.519975+0000 mgr.gibba043.dnkmem (mgr.34373) 4161 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:27 gibba043 bash[24019]: cluster 2021-03-10T15:09:26.519975+0000 mgr.gibba043.dnkmem (mgr.34373) 4161 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:29 gibba003 bash[31385]: cluster 2021-03-10T15:09:28.521516+0000 mgr.gibba043.dnkmem (mgr.34373) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:29 gibba003 bash[32348]: cluster 2021-03-10T15:09:28.521516+0000 mgr.gibba043.dnkmem (mgr.34373) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:29 gibba043 bash[24019]: cluster 2021-03-10T15:09:28.521516+0000 mgr.gibba043.dnkmem (mgr.34373) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:31 gibba003 bash[31385]: cluster 2021-03-10T15:09:30.522993+0000 mgr.gibba043.dnkmem (mgr.34373) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:31 gibba003 bash[32348]: cluster 2021-03-10T15:09:30.522993+0000 mgr.gibba043.dnkmem (mgr.34373) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:31 gibba043 bash[24019]: cluster 2021-03-10T15:09:30.522993+0000 mgr.gibba043.dnkmem (mgr.34373) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:33 gibba003 bash[31385]: cluster 2021-03-10T15:09:32.524735+0000 mgr.gibba043.dnkmem (mgr.34373) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:33 gibba003 bash[32348]: cluster 2021-03-10T15:09:32.524735+0000 mgr.gibba043.dnkmem (mgr.34373) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:33 gibba043 bash[24019]: cluster 2021-03-10T15:09:32.524735+0000 mgr.gibba043.dnkmem (mgr.34373) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:34 gibba003 bash[31385]: cluster 2021-03-10T15:09:34.526246+0000 mgr.gibba043.dnkmem (mgr.34373) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:34 gibba003 bash[32348]: cluster 2021-03-10T15:09:34.526246+0000 mgr.gibba043.dnkmem (mgr.34373) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:34 gibba043 bash[24019]: cluster 2021-03-10T15:09:34.526246+0000 mgr.gibba043.dnkmem (mgr.34373) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:37 gibba003 bash[31385]: cluster 2021-03-10T15:09:36.527221+0000 mgr.gibba043.dnkmem (mgr.34373) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:37 gibba003 bash[32348]: cluster 2021-03-10T15:09:36.527221+0000 mgr.gibba043.dnkmem (mgr.34373) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:37 gibba043 bash[24019]: cluster 2021-03-10T15:09:36.527221+0000 mgr.gibba043.dnkmem (mgr.34373) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:39 gibba003 bash[31385]: cluster 2021-03-10T15:09:38.528862+0000 mgr.gibba043.dnkmem (mgr.34373) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:39 gibba003 bash[32348]: cluster 2021-03-10T15:09:38.528862+0000 mgr.gibba043.dnkmem (mgr.34373) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:39 gibba043 bash[24019]: cluster 2021-03-10T15:09:38.528862+0000 mgr.gibba043.dnkmem (mgr.34373) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:41 gibba003 bash[31385]: cluster 2021-03-10T15:09:40.530558+0000 mgr.gibba043.dnkmem (mgr.34373) 4168 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:41 gibba003 bash[31385]: cephadm 2021-03-10T15:09:40.540778+0000 mgr.gibba043.dnkmem (mgr.34373) 4169 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:41.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:41 gibba003 bash[32348]: cluster 2021-03-10T15:09:40.530558+0000 mgr.gibba043.dnkmem (mgr.34373) 4168 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:41 gibba003 bash[32348]: cephadm 2021-03-10T15:09:40.540778+0000 mgr.gibba043.dnkmem (mgr.34373) 4169 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:41 gibba043 bash[24019]: cluster 2021-03-10T15:09:40.530558+0000 mgr.gibba043.dnkmem (mgr.34373) 4168 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:41 gibba043 bash[24019]: cephadm 2021-03-10T15:09:40.540778+0000 mgr.gibba043.dnkmem (mgr.34373) 4169 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:43.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:43 gibba003 bash[32348]: cluster 2021-03-10T15:09:42.532295+0000 mgr.gibba043.dnkmem (mgr.34373) 4170 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:43 gibba003 bash[31385]: cluster 2021-03-10T15:09:42.532295+0000 mgr.gibba043.dnkmem (mgr.34373) 4170 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:44.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:43 gibba043 bash[24019]: cluster 2021-03-10T15:09:42.532295+0000 mgr.gibba043.dnkmem (mgr.34373) 4170 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:44 gibba003 bash[31385]: cluster 2021-03-10T15:09:44.534161+0000 mgr.gibba043.dnkmem (mgr.34373) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:44 gibba003 bash[32348]: cluster 2021-03-10T15:09:44.534161+0000 mgr.gibba043.dnkmem (mgr.34373) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:44 gibba043 bash[24019]: cluster 2021-03-10T15:09:44.534161+0000 mgr.gibba043.dnkmem (mgr.34373) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:47 gibba003 bash[31385]: cluster 2021-03-10T15:09:46.535253+0000 mgr.gibba043.dnkmem (mgr.34373) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:47 gibba003 bash[32348]: cluster 2021-03-10T15:09:46.535253+0000 mgr.gibba043.dnkmem (mgr.34373) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:47 gibba043 bash[24019]: cluster 2021-03-10T15:09:46.535253+0000 mgr.gibba043.dnkmem (mgr.34373) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:49 gibba003 bash[31385]: cluster 2021-03-10T15:09:48.536785+0000 mgr.gibba043.dnkmem (mgr.34373) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:49 gibba003 bash[32348]: cluster 2021-03-10T15:09:48.536785+0000 mgr.gibba043.dnkmem (mgr.34373) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:49 gibba043 bash[24019]: cluster 2021-03-10T15:09:48.536785+0000 mgr.gibba043.dnkmem (mgr.34373) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:51 gibba003 bash[31385]: cluster 2021-03-10T15:09:50.538030+0000 mgr.gibba043.dnkmem (mgr.34373) 4174 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:51 gibba003 bash[32348]: cluster 2021-03-10T15:09:50.538030+0000 mgr.gibba043.dnkmem (mgr.34373) 4174 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:51 gibba043 bash[24019]: cluster 2021-03-10T15:09:50.538030+0000 mgr.gibba043.dnkmem (mgr.34373) 4174 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.427 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:09:53.650 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:09:53.650 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (78m) 3m ago 83m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:09:53.651 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (83m) 118s ago 83m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:09:53.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (78m) 118s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:09:53.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (78m) 118s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:09:53.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (77m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:09:53.651 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (77m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:09:53.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (77m) 118s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:09:53.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:09:53.652 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (83m) 3m ago 83m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:09:53.652 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (83m) 118s ago 83m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:09:53.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:09:53.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:09:53.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:09:53.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (75m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:09:53.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (74m) 118s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:09:53.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (74m) 118s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:09:53.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (73m) 118s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:09:53.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (73m) 118s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:09:53.654 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (83m) 118s ago 83m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:09:53.655 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 81m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:09:53.902 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:09:53.903 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:09:53.903 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:53.903 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:09:53.903 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:09:53.903 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:53.904 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:09:53.904 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:09:53.904 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:09:53.904 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:09:53.905 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:09:53.905 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:09:53.905 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:09:53.905 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:09:53.905 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:09:53.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:53 gibba003 bash[31385]: cluster 2021-03-10T15:09:52.539867+0000 mgr.gibba043.dnkmem (mgr.34373) 4175 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:53 gibba003 bash[32348]: cluster 2021-03-10T15:09:52.539867+0000 mgr.gibba043.dnkmem (mgr.34373) 4175 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:53 gibba043 bash[24019]: cluster 2021-03-10T15:09:52.539867+0000 mgr.gibba043.dnkmem (mgr.34373) 4175 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:54 gibba003 bash[31385]: audit 2021-03-10T15:09:53.414985+0000 mgr.gibba043.dnkmem (mgr.34373) 4176 : audit [DBG] from='client.46860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:54 gibba003 bash[31385]: audit 2021-03-10T15:09:53.639166+0000 mgr.gibba043.dnkmem (mgr.34373) 4177 : audit [DBG] from='client.56854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:54 gibba003 bash[31385]: audit 2021-03-10T15:09:53.900582+0000 mon.c (mon.1) 1105 : audit [DBG] from='client.? 172.21.2.103:0/1366597921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:54 gibba003 bash[32348]: audit 2021-03-10T15:09:53.414985+0000 mgr.gibba043.dnkmem (mgr.34373) 4176 : audit [DBG] from='client.46860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:54 gibba003 bash[32348]: audit 2021-03-10T15:09:53.639166+0000 mgr.gibba043.dnkmem (mgr.34373) 4177 : audit [DBG] from='client.56854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:54.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:54 gibba003 bash[32348]: audit 2021-03-10T15:09:53.900582+0000 mon.c (mon.1) 1105 : audit [DBG] from='client.? 172.21.2.103:0/1366597921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:54 gibba043 bash[24019]: audit 2021-03-10T15:09:53.414985+0000 mgr.gibba043.dnkmem (mgr.34373) 4176 : audit [DBG] from='client.46860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:54 gibba043 bash[24019]: audit 2021-03-10T15:09:53.639166+0000 mgr.gibba043.dnkmem (mgr.34373) 4177 : audit [DBG] from='client.56854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:54 gibba043 bash[24019]: audit 2021-03-10T15:09:53.900582+0000 mon.c (mon.1) 1105 : audit [DBG] from='client.? 172.21.2.103:0/1366597921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:55 gibba003 bash[31385]: cluster 2021-03-10T15:09:54.541352+0000 mgr.gibba043.dnkmem (mgr.34373) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:55 gibba003 bash[32348]: cluster 2021-03-10T15:09:54.541352+0000 mgr.gibba043.dnkmem (mgr.34373) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:56.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:55 gibba043 bash[24019]: cluster 2021-03-10T15:09:54.541352+0000 mgr.gibba043.dnkmem (mgr.34373) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.557597+0000 mgr.gibba043.dnkmem (mgr.34373) 4179 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:09:57.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.559147+0000 mgr.gibba043.dnkmem (mgr.34373) 4180 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:09:57.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.786763+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:09:57.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.788920+0000 mgr.gibba043.dnkmem (mgr.34373) 4181 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:57.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.790702+0000 mgr.gibba043.dnkmem (mgr.34373) 4182 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:57.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.790706+0000 mon.c (mon.1) 1106 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:57.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.792073+0000 mgr.gibba043.dnkmem (mgr.34373) 4183 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:57.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.792114+0000 mgr.gibba043.dnkmem (mgr.34373) 4184 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:57.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.792233+0000 mon.c (mon.1) 1107 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.793660+0000 mgr.gibba043.dnkmem (mgr.34373) 4185 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:57.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.793699+0000 mgr.gibba043.dnkmem (mgr.34373) 4186 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.793761+0000 mon.c (mon.1) 1108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.794994+0000 mon.c (mon.1) 1109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.794997+0000 mgr.gibba043.dnkmem (mgr.34373) 4187 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.796868+0000 mgr.gibba043.dnkmem (mgr.34373) 4188 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:57.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.796904+0000 mgr.gibba043.dnkmem (mgr.34373) 4189 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:57.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.798186+0000 mgr.gibba043.dnkmem (mgr.34373) 4190 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:57.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.798362+0000 mon.c (mon.1) 1110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.798553+0000 mgr.gibba043.dnkmem (mgr.34373) 4191 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:57.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: audit 2021-03-10T15:09:55.800054+0000 mon.c (mon.1) 1111 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.800062+0000 mgr.gibba043.dnkmem (mgr.34373) 4192 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:57.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.800128+0000 mgr.gibba043.dnkmem (mgr.34373) 4193 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:57.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[31385]: cephadm 2021-03-10T15:09:55.800231+0000 mgr.gibba043.dnkmem (mgr.34373) 4194 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:57.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.557597+0000 mgr.gibba043.dnkmem (mgr.34373) 4179 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:09:57.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.559147+0000 mgr.gibba043.dnkmem (mgr.34373) 4180 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:09:57.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.786763+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:09:57.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.788920+0000 mgr.gibba043.dnkmem (mgr.34373) 4181 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:57.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.790702+0000 mgr.gibba043.dnkmem (mgr.34373) 4182 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:57.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.790706+0000 mon.c (mon.1) 1106 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:57.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.792073+0000 mgr.gibba043.dnkmem (mgr.34373) 4183 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:57.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.792114+0000 mgr.gibba043.dnkmem (mgr.34373) 4184 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:57.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.792233+0000 mon.c (mon.1) 1107 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.793660+0000 mgr.gibba043.dnkmem (mgr.34373) 4185 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:57.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.793699+0000 mgr.gibba043.dnkmem (mgr.34373) 4186 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:57.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.793761+0000 mon.c (mon.1) 1108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.794994+0000 mon.c (mon.1) 1109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.794997+0000 mgr.gibba043.dnkmem (mgr.34373) 4187 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:57.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.796868+0000 mgr.gibba043.dnkmem (mgr.34373) 4188 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:57.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.796904+0000 mgr.gibba043.dnkmem (mgr.34373) 4189 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:57.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.798186+0000 mgr.gibba043.dnkmem (mgr.34373) 4190 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:57.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.798362+0000 mon.c (mon.1) 1110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.798553+0000 mgr.gibba043.dnkmem (mgr.34373) 4191 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:57.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: audit 2021-03-10T15:09:55.800054+0000 mon.c (mon.1) 1111 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.800062+0000 mgr.gibba043.dnkmem (mgr.34373) 4192 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:57.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.800128+0000 mgr.gibba043.dnkmem (mgr.34373) 4193 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:57.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:56 gibba003 bash[32348]: cephadm 2021-03-10T15:09:55.800231+0000 mgr.gibba043.dnkmem (mgr.34373) 4194 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.557597+0000 mgr.gibba043.dnkmem (mgr.34373) 4179 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:09:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.559147+0000 mgr.gibba043.dnkmem (mgr.34373) 4180 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:09:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.786763+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:09:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.788920+0000 mgr.gibba043.dnkmem (mgr.34373) 4181 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:57.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.790702+0000 mgr.gibba043.dnkmem (mgr.34373) 4182 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:57.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.790706+0000 mon.c (mon.1) 1106 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:57.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.792073+0000 mgr.gibba043.dnkmem (mgr.34373) 4183 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:57.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.792114+0000 mgr.gibba043.dnkmem (mgr.34373) 4184 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:57.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.792233+0000 mon.c (mon.1) 1107 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.793660+0000 mgr.gibba043.dnkmem (mgr.34373) 4185 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:57.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.793699+0000 mgr.gibba043.dnkmem (mgr.34373) 4186 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:57.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.793761+0000 mon.c (mon.1) 1108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.794994+0000 mon.c (mon.1) 1109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.794997+0000 mgr.gibba043.dnkmem (mgr.34373) 4187 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:57.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.796868+0000 mgr.gibba043.dnkmem (mgr.34373) 4188 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:57.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.796904+0000 mgr.gibba043.dnkmem (mgr.34373) 4189 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:57.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.798186+0000 mgr.gibba043.dnkmem (mgr.34373) 4190 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:57.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.798362+0000 mon.c (mon.1) 1110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.798553+0000 mgr.gibba043.dnkmem (mgr.34373) 4191 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:57.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: audit 2021-03-10T15:09:55.800054+0000 mon.c (mon.1) 1111 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:57.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.800062+0000 mgr.gibba043.dnkmem (mgr.34373) 4192 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:57.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.800128+0000 mgr.gibba043.dnkmem (mgr.34373) 4193 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:57.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:56 gibba043 bash[24019]: cephadm 2021-03-10T15:09:55.800231+0000 mgr.gibba043.dnkmem (mgr.34373) 4194 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:09:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:57 gibba003 bash[31385]: cluster 2021-03-10T15:09:56.543170+0000 mgr.gibba043.dnkmem (mgr.34373) 4195 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:58.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:57 gibba003 bash[32348]: cluster 2021-03-10T15:09:56.543170+0000 mgr.gibba043.dnkmem (mgr.34373) 4195 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:57 gibba043 bash[24019]: cluster 2021-03-10T15:09:56.543170+0000 mgr.gibba043.dnkmem (mgr.34373) 4195 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:09:59 gibba003 bash[31385]: cluster 2021-03-10T15:09:58.544596+0000 mgr.gibba043.dnkmem (mgr.34373) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:00 gibba003 bash[31385]: debug 2021-03-10T15:09:59.995+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:09:59 gibba003 bash[32348]: cluster 2021-03-10T15:09:58.544596+0000 mgr.gibba043.dnkmem (mgr.34373) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:09:59 gibba043 bash[24019]: cluster 2021-03-10T15:09:58.544596+0000 mgr.gibba043.dnkmem (mgr.34373) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:00 gibba003 bash[31385]: cluster 2021-03-10T15:10:00.000213+0000 mon.a (mon.0) 1109 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:00 gibba003 bash[32348]: cluster 2021-03-10T15:10:00.000213+0000 mon.a (mon.0) 1109 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:00 gibba043 bash[24019]: cluster 2021-03-10T15:10:00.000213+0000 mon.a (mon.0) 1109 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:01 gibba003 bash[31385]: cluster 2021-03-10T15:10:00.546071+0000 mgr.gibba043.dnkmem (mgr.34373) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:01 gibba003 bash[32348]: cluster 2021-03-10T15:10:00.546071+0000 mgr.gibba043.dnkmem (mgr.34373) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:01 gibba043 bash[24019]: cluster 2021-03-10T15:10:00.546071+0000 mgr.gibba043.dnkmem (mgr.34373) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:02 gibba003 bash[31385]: cluster 2021-03-10T15:10:02.547763+0000 mgr.gibba043.dnkmem (mgr.34373) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:02 gibba003 bash[32348]: cluster 2021-03-10T15:10:02.547763+0000 mgr.gibba043.dnkmem (mgr.34373) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:02 gibba043 bash[24019]: cluster 2021-03-10T15:10:02.547763+0000 mgr.gibba043.dnkmem (mgr.34373) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:04 gibba003 bash[31385]: cluster 2021-03-10T15:10:04.549196+0000 mgr.gibba043.dnkmem (mgr.34373) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:04 gibba003 bash[32348]: cluster 2021-03-10T15:10:04.549196+0000 mgr.gibba043.dnkmem (mgr.34373) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:04 gibba043 bash[24019]: cluster 2021-03-10T15:10:04.549196+0000 mgr.gibba043.dnkmem (mgr.34373) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:07 gibba003 bash[31385]: cluster 2021-03-10T15:10:06.550330+0000 mgr.gibba043.dnkmem (mgr.34373) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:07 gibba003 bash[32348]: cluster 2021-03-10T15:10:06.550330+0000 mgr.gibba043.dnkmem (mgr.34373) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:07 gibba043 bash[24019]: cluster 2021-03-10T15:10:06.550330+0000 mgr.gibba043.dnkmem (mgr.34373) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:09 gibba003 bash[31385]: cluster 2021-03-10T15:10:08.551873+0000 mgr.gibba043.dnkmem (mgr.34373) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:09.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:09 gibba003 bash[32348]: cluster 2021-03-10T15:10:08.551873+0000 mgr.gibba043.dnkmem (mgr.34373) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:10.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:09 gibba043 bash[24019]: cluster 2021-03-10T15:10:08.551873+0000 mgr.gibba043.dnkmem (mgr.34373) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:11 gibba003 bash[31385]: cluster 2021-03-10T15:10:10.553374+0000 mgr.gibba043.dnkmem (mgr.34373) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:11 gibba003 bash[31385]: cephadm 2021-03-10T15:10:10.816376+0000 mgr.gibba043.dnkmem (mgr.34373) 4203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:11.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:11 gibba003 bash[32348]: cluster 2021-03-10T15:10:10.553374+0000 mgr.gibba043.dnkmem (mgr.34373) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:11 gibba003 bash[32348]: cephadm 2021-03-10T15:10:10.816376+0000 mgr.gibba043.dnkmem (mgr.34373) 4203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:11 gibba043 bash[24019]: cluster 2021-03-10T15:10:10.553374+0000 mgr.gibba043.dnkmem (mgr.34373) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:12.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:11 gibba043 bash[24019]: cephadm 2021-03-10T15:10:10.816376+0000 mgr.gibba043.dnkmem (mgr.34373) 4203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: cluster 2021-03-10T15:10:12.571847+0000 mgr.gibba043.dnkmem (mgr.34373) 4204 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.208502+0000 mon.c (mon.1) 1112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.209571+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.303806+0000 mon.c (mon.1) 1113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.304897+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.346574+0000 mon.c (mon.1) 1114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:10:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.347304+0000 mon.c (mon.1) 1115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.347773+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:10:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.348020+0000 mon.c (mon.1) 1116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.348821+0000 mon.c (mon.1) 1117 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:10:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.348980+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.350114+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[31385]: audit 2021-03-10T15:10:13.350872+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:10:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: cluster 2021-03-10T15:10:12.571847+0000 mgr.gibba043.dnkmem (mgr.34373) 4204 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.208502+0000 mon.c (mon.1) 1112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.209571+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.303806+0000 mon.c (mon.1) 1113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.304897+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.346574+0000 mon.c (mon.1) 1114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:10:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.347304+0000 mon.c (mon.1) 1115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.347773+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:10:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.348020+0000 mon.c (mon.1) 1116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.348821+0000 mon.c (mon.1) 1117 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:10:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.348980+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.350114+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:10:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:13 gibba003 bash[32348]: audit 2021-03-10T15:10:13.350872+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:10:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: cluster 2021-03-10T15:10:12.571847+0000 mgr.gibba043.dnkmem (mgr.34373) 4204 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.208502+0000 mon.c (mon.1) 1112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.209571+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.303806+0000 mon.c (mon.1) 1113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.304897+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.346574+0000 mon.c (mon.1) 1114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:10:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.347304+0000 mon.c (mon.1) 1115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.347773+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:10:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.348020+0000 mon.c (mon.1) 1116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:10:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.348821+0000 mon.c (mon.1) 1117 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:10:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.348980+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.350114+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:10:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:13 gibba043 bash[24019]: audit 2021-03-10T15:10:13.350872+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:10:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:14 gibba043 bash[24019]: cluster 2021-03-10T15:10:14.573648+0000 mgr.gibba043.dnkmem (mgr.34373) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:14 gibba003 bash[31385]: cluster 2021-03-10T15:10:14.573648+0000 mgr.gibba043.dnkmem (mgr.34373) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:14 gibba003 bash[32348]: cluster 2021-03-10T15:10:14.573648+0000 mgr.gibba043.dnkmem (mgr.34373) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:17 gibba003 bash[31385]: cluster 2021-03-10T15:10:16.575298+0000 mgr.gibba043.dnkmem (mgr.34373) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:17 gibba003 bash[32348]: cluster 2021-03-10T15:10:16.575298+0000 mgr.gibba043.dnkmem (mgr.34373) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:17 gibba043 bash[24019]: cluster 2021-03-10T15:10:16.575298+0000 mgr.gibba043.dnkmem (mgr.34373) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:19 gibba003 bash[31385]: cluster 2021-03-10T15:10:18.576837+0000 mgr.gibba043.dnkmem (mgr.34373) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:19.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:19 gibba003 bash[32348]: cluster 2021-03-10T15:10:18.576837+0000 mgr.gibba043.dnkmem (mgr.34373) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:19 gibba043 bash[24019]: cluster 2021-03-10T15:10:18.576837+0000 mgr.gibba043.dnkmem (mgr.34373) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:21 gibba003 bash[31385]: cluster 2021-03-10T15:10:20.578323+0000 mgr.gibba043.dnkmem (mgr.34373) 4208 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:21 gibba003 bash[32348]: cluster 2021-03-10T15:10:20.578323+0000 mgr.gibba043.dnkmem (mgr.34373) 4208 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:21 gibba043 bash[24019]: cluster 2021-03-10T15:10:20.578323+0000 mgr.gibba043.dnkmem (mgr.34373) 4208 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:23 gibba003 bash[31385]: cluster 2021-03-10T15:10:22.579080+0000 mgr.gibba043.dnkmem (mgr.34373) 4209 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:23.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:23 gibba003 bash[32348]: cluster 2021-03-10T15:10:22.579080+0000 mgr.gibba043.dnkmem (mgr.34373) 4209 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:23 gibba043 bash[24019]: cluster 2021-03-10T15:10:22.579080+0000 mgr.gibba043.dnkmem (mgr.34373) 4209 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:24.149 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:10:24.376 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:10:24.377 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (78m) 3m ago 84m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:10:24.377 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (83m) 2m ago 83m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:10:24.377 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:10:24.377 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:10:24.378 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:10:24.378 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:10:24.378 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (77m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:10:24.378 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (78m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:10:24.378 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (84m) 3m ago 84m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:10:24.379 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (84m) 2m ago 84m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:10:24.379 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:10:24.379 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:10:24.379 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:10:24.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:10:24.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:10:24.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:10:24.380 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:10:24.381 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (74m) 2m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:10:24.381 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (83m) 2m ago 84m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:10:24.381 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 82m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:10:24.626 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:10:24.627 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:10:24.627 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:24.627 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:10:24.628 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:10:24.628 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:24.628 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:10:24.628 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:10:24.629 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:10:24.629 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:10:24.629 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:10:24.629 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:10:24.629 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:10:24.630 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:10:24.630 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:10:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:24 gibba043 bash[24019]: audit 2021-03-10T15:10:24.137693+0000 mgr.gibba043.dnkmem (mgr.34373) 4210 : audit [DBG] from='client.56866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:24 gibba043 bash[24019]: audit 2021-03-10T15:10:24.361110+0000 mgr.gibba043.dnkmem (mgr.34373) 4211 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:24 gibba043 bash[24019]: cluster 2021-03-10T15:10:24.580773+0000 mgr.gibba043.dnkmem (mgr.34373) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:24 gibba043 bash[24019]: audit 2021-03-10T15:10:24.624675+0000 mon.c (mon.1) 1118 : audit [DBG] from='client.? 172.21.2.103:0/2162056276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[31385]: audit 2021-03-10T15:10:24.137693+0000 mgr.gibba043.dnkmem (mgr.34373) 4210 : audit [DBG] from='client.56866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[31385]: audit 2021-03-10T15:10:24.361110+0000 mgr.gibba043.dnkmem (mgr.34373) 4211 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[31385]: cluster 2021-03-10T15:10:24.580773+0000 mgr.gibba043.dnkmem (mgr.34373) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[31385]: audit 2021-03-10T15:10:24.624675+0000 mon.c (mon.1) 1118 : audit [DBG] from='client.? 172.21.2.103:0/2162056276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[32348]: audit 2021-03-10T15:10:24.137693+0000 mgr.gibba043.dnkmem (mgr.34373) 4210 : audit [DBG] from='client.56866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[32348]: audit 2021-03-10T15:10:24.361110+0000 mgr.gibba043.dnkmem (mgr.34373) 4211 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[32348]: cluster 2021-03-10T15:10:24.580773+0000 mgr.gibba043.dnkmem (mgr.34373) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:24 gibba003 bash[32348]: audit 2021-03-10T15:10:24.624675+0000 mon.c (mon.1) 1118 : audit [DBG] from='client.? 172.21.2.103:0/2162056276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:25 gibba043 bash[24019]: cephadm 2021-03-10T15:10:25.826126+0000 mgr.gibba043.dnkmem (mgr.34373) 4213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:25 gibba003 bash[31385]: cephadm 2021-03-10T15:10:25.826126+0000 mgr.gibba043.dnkmem (mgr.34373) 4213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:25 gibba003 bash[32348]: cephadm 2021-03-10T15:10:25.826126+0000 mgr.gibba043.dnkmem (mgr.34373) 4213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:26 gibba043 bash[24019]: cluster 2021-03-10T15:10:26.582506+0000 mgr.gibba043.dnkmem (mgr.34373) 4214 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:26 gibba003 bash[31385]: cluster 2021-03-10T15:10:26.582506+0000 mgr.gibba043.dnkmem (mgr.34373) 4214 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:26 gibba003 bash[32348]: cluster 2021-03-10T15:10:26.582506+0000 mgr.gibba043.dnkmem (mgr.34373) 4214 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:29 gibba003 bash[31385]: cluster 2021-03-10T15:10:28.584155+0000 mgr.gibba043.dnkmem (mgr.34373) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:29 gibba003 bash[32348]: cluster 2021-03-10T15:10:28.584155+0000 mgr.gibba043.dnkmem (mgr.34373) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:29 gibba043 bash[24019]: cluster 2021-03-10T15:10:28.584155+0000 mgr.gibba043.dnkmem (mgr.34373) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:31 gibba003 bash[31385]: cluster 2021-03-10T15:10:30.585368+0000 mgr.gibba043.dnkmem (mgr.34373) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:31 gibba003 bash[32348]: cluster 2021-03-10T15:10:30.585368+0000 mgr.gibba043.dnkmem (mgr.34373) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:31 gibba043 bash[24019]: cluster 2021-03-10T15:10:30.585368+0000 mgr.gibba043.dnkmem (mgr.34373) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:33 gibba003 bash[31385]: cluster 2021-03-10T15:10:32.586106+0000 mgr.gibba043.dnkmem (mgr.34373) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:33 gibba003 bash[32348]: cluster 2021-03-10T15:10:32.586106+0000 mgr.gibba043.dnkmem (mgr.34373) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:33 gibba043 bash[24019]: cluster 2021-03-10T15:10:32.586106+0000 mgr.gibba043.dnkmem (mgr.34373) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:34 gibba043 bash[24019]: cluster 2021-03-10T15:10:34.586481+0000 mgr.gibba043.dnkmem (mgr.34373) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:34 gibba003 bash[31385]: cluster 2021-03-10T15:10:34.586481+0000 mgr.gibba043.dnkmem (mgr.34373) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:34 gibba003 bash[32348]: cluster 2021-03-10T15:10:34.586481+0000 mgr.gibba043.dnkmem (mgr.34373) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:37 gibba003 bash[31385]: cluster 2021-03-10T15:10:36.587921+0000 mgr.gibba043.dnkmem (mgr.34373) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:37 gibba003 bash[32348]: cluster 2021-03-10T15:10:36.587921+0000 mgr.gibba043.dnkmem (mgr.34373) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:37 gibba043 bash[24019]: cluster 2021-03-10T15:10:36.587921+0000 mgr.gibba043.dnkmem (mgr.34373) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:39 gibba003 bash[31385]: cluster 2021-03-10T15:10:38.589636+0000 mgr.gibba043.dnkmem (mgr.34373) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:39.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:39 gibba003 bash[32348]: cluster 2021-03-10T15:10:38.589636+0000 mgr.gibba043.dnkmem (mgr.34373) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:39 gibba043 bash[24019]: cluster 2021-03-10T15:10:38.589636+0000 mgr.gibba043.dnkmem (mgr.34373) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:41 gibba003 bash[31385]: cluster 2021-03-10T15:10:40.590910+0000 mgr.gibba043.dnkmem (mgr.34373) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:41 gibba003 bash[31385]: cephadm 2021-03-10T15:10:40.831961+0000 mgr.gibba043.dnkmem (mgr.34373) 4222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:41.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:41 gibba003 bash[32348]: cluster 2021-03-10T15:10:40.590910+0000 mgr.gibba043.dnkmem (mgr.34373) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:41 gibba003 bash[32348]: cephadm 2021-03-10T15:10:40.831961+0000 mgr.gibba043.dnkmem (mgr.34373) 4222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:41 gibba043 bash[24019]: cluster 2021-03-10T15:10:40.590910+0000 mgr.gibba043.dnkmem (mgr.34373) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:41 gibba043 bash[24019]: cephadm 2021-03-10T15:10:40.831961+0000 mgr.gibba043.dnkmem (mgr.34373) 4222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:43 gibba003 bash[31385]: cluster 2021-03-10T15:10:42.591706+0000 mgr.gibba043.dnkmem (mgr.34373) 4223 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:43.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:43 gibba003 bash[32348]: cluster 2021-03-10T15:10:42.591706+0000 mgr.gibba043.dnkmem (mgr.34373) 4223 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:44.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:43 gibba043 bash[24019]: cluster 2021-03-10T15:10:42.591706+0000 mgr.gibba043.dnkmem (mgr.34373) 4223 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:44 gibba043 bash[24019]: cluster 2021-03-10T15:10:44.592255+0000 mgr.gibba043.dnkmem (mgr.34373) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:44 gibba003 bash[31385]: cluster 2021-03-10T15:10:44.592255+0000 mgr.gibba043.dnkmem (mgr.34373) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:44 gibba003 bash[32348]: cluster 2021-03-10T15:10:44.592255+0000 mgr.gibba043.dnkmem (mgr.34373) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:47 gibba003 bash[31385]: cluster 2021-03-10T15:10:46.593825+0000 mgr.gibba043.dnkmem (mgr.34373) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:47 gibba003 bash[32348]: cluster 2021-03-10T15:10:46.593825+0000 mgr.gibba043.dnkmem (mgr.34373) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:47 gibba043 bash[24019]: cluster 2021-03-10T15:10:46.593825+0000 mgr.gibba043.dnkmem (mgr.34373) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:49 gibba003 bash[31385]: cluster 2021-03-10T15:10:48.595494+0000 mgr.gibba043.dnkmem (mgr.34373) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:49 gibba003 bash[32348]: cluster 2021-03-10T15:10:48.595494+0000 mgr.gibba043.dnkmem (mgr.34373) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:49 gibba043 bash[24019]: cluster 2021-03-10T15:10:48.595494+0000 mgr.gibba043.dnkmem (mgr.34373) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:51 gibba003 bash[31385]: cluster 2021-03-10T15:10:50.596988+0000 mgr.gibba043.dnkmem (mgr.34373) 4227 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:51 gibba003 bash[32348]: cluster 2021-03-10T15:10:50.596988+0000 mgr.gibba043.dnkmem (mgr.34373) 4227 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:51 gibba043 bash[24019]: cluster 2021-03-10T15:10:50.596988+0000 mgr.gibba043.dnkmem (mgr.34373) 4227 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:53.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:53 gibba003 bash[31385]: cluster 2021-03-10T15:10:52.597946+0000 mgr.gibba043.dnkmem (mgr.34373) 4228 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:53.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:53 gibba003 bash[32348]: cluster 2021-03-10T15:10:52.597946+0000 mgr.gibba043.dnkmem (mgr.34373) 4228 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:53 gibba043 bash[24019]: cluster 2021-03-10T15:10:52.597946+0000 mgr.gibba043.dnkmem (mgr.34373) 4228 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:54.870 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:10:55.131 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:10:55.131 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (79m) 4m ago 84m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:10:55.131 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (84m) 3m ago 84m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:10:55.131 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (79m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:10:55.132 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (79m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:10:55.132 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (78m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:10:55.132 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (78m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:10:55.133 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (78m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:10:55.133 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:10:55.133 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (84m) 4m ago 84m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:10:55.133 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (84m) 3m ago 84m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:10:55.134 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:10:55.134 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:10:55.134 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:10:55.134 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:10:55.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:10:55.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (75m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:10:55.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (74m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:10:55.135 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (74m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:10:55.135 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (84m) 3m ago 84m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:10:55.136 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 82m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:10:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:54 gibba043 bash[24019]: cluster 2021-03-10T15:10:54.598416+0000 mgr.gibba043.dnkmem (mgr.34373) 4229 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.390 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:10:55.390 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:10:55.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:55.391 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:10:55.391 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:10:55.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:55.392 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:10:55.392 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:10:55.392 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:10:55.392 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:10:55.393 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:10:55.393 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:10:55.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:10:55.393 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:10:55.394 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:10:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:54 gibba003 bash[31385]: cluster 2021-03-10T15:10:54.598416+0000 mgr.gibba043.dnkmem (mgr.34373) 4229 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:54 gibba003 bash[32348]: cluster 2021-03-10T15:10:54.598416+0000 mgr.gibba043.dnkmem (mgr.34373) 4229 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:55 gibba043 bash[24019]: audit 2021-03-10T15:10:54.858288+0000 mgr.gibba043.dnkmem (mgr.34373) 4230 : audit [DBG] from='client.56884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:56.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:55 gibba043 bash[24019]: audit 2021-03-10T15:10:55.087577+0000 mgr.gibba043.dnkmem (mgr.34373) 4231 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:56.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:55 gibba043 bash[24019]: audit 2021-03-10T15:10:55.388451+0000 mon.c (mon.1) 1119 : audit [DBG] from='client.? 172.21.2.103:0/2509486290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:56.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:55 gibba003 bash[31385]: audit 2021-03-10T15:10:54.858288+0000 mgr.gibba043.dnkmem (mgr.34373) 4230 : audit [DBG] from='client.56884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:56.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:55 gibba003 bash[31385]: audit 2021-03-10T15:10:55.087577+0000 mgr.gibba043.dnkmem (mgr.34373) 4231 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:56.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:55 gibba003 bash[31385]: audit 2021-03-10T15:10:55.388451+0000 mon.c (mon.1) 1119 : audit [DBG] from='client.? 172.21.2.103:0/2509486290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:56.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:55 gibba003 bash[32348]: audit 2021-03-10T15:10:54.858288+0000 mgr.gibba043.dnkmem (mgr.34373) 4230 : audit [DBG] from='client.56884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:56.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:55 gibba003 bash[32348]: audit 2021-03-10T15:10:55.087577+0000 mgr.gibba043.dnkmem (mgr.34373) 4231 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:56.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:55 gibba003 bash[32348]: audit 2021-03-10T15:10:55.388451+0000 mon.c (mon.1) 1119 : audit [DBG] from='client.? 172.21.2.103:0/2509486290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:55.848797+0000 mgr.gibba043.dnkmem (mgr.34373) 4232 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:10:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:55.850332+0000 mgr.gibba043.dnkmem (mgr.34373) 4233 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:10:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.069003+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:10:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.070883+0000 mgr.gibba043.dnkmem (mgr.34373) 4234 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.072616+0000 mon.c (mon.1) 1120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.072852+0000 mgr.gibba043.dnkmem (mgr.34373) 4235 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.074180+0000 mgr.gibba043.dnkmem (mgr.34373) 4236 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.074216+0000 mgr.gibba043.dnkmem (mgr.34373) 4237 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.074254+0000 mon.c (mon.1) 1121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.075617+0000 mon.c (mon.1) 1122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.075781+0000 mgr.gibba043.dnkmem (mgr.34373) 4238 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.075819+0000 mgr.gibba043.dnkmem (mgr.34373) 4239 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.077213+0000 mon.c (mon.1) 1123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.077849+0000 mgr.gibba043.dnkmem (mgr.34373) 4240 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:57.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.079616+0000 mgr.gibba043.dnkmem (mgr.34373) 4241 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:57.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.079674+0000 mgr.gibba043.dnkmem (mgr.34373) 4242 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:57.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.081046+0000 mgr.gibba043.dnkmem (mgr.34373) 4243 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:57.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.081188+0000 mon.c (mon.1) 1124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.081465+0000 mgr.gibba043.dnkmem (mgr.34373) 4244 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:57.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: audit 2021-03-10T15:10:56.082765+0000 mon.c (mon.1) 1125 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.082919+0000 mgr.gibba043.dnkmem (mgr.34373) 4245 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:55.848797+0000 mgr.gibba043.dnkmem (mgr.34373) 4232 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:10:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:55.850332+0000 mgr.gibba043.dnkmem (mgr.34373) 4233 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:10:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.069003+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:10:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.070883+0000 mgr.gibba043.dnkmem (mgr.34373) 4234 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.072616+0000 mon.c (mon.1) 1120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.072852+0000 mgr.gibba043.dnkmem (mgr.34373) 4235 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.074180+0000 mgr.gibba043.dnkmem (mgr.34373) 4236 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.074216+0000 mgr.gibba043.dnkmem (mgr.34373) 4237 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.074254+0000 mon.c (mon.1) 1121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.075617+0000 mon.c (mon.1) 1122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.075781+0000 mgr.gibba043.dnkmem (mgr.34373) 4238 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:57.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.075819+0000 mgr.gibba043.dnkmem (mgr.34373) 4239 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:57.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.077213+0000 mon.c (mon.1) 1123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.077849+0000 mgr.gibba043.dnkmem (mgr.34373) 4240 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:57.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.079616+0000 mgr.gibba043.dnkmem (mgr.34373) 4241 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:57.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.079674+0000 mgr.gibba043.dnkmem (mgr.34373) 4242 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:57.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.081046+0000 mgr.gibba043.dnkmem (mgr.34373) 4243 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:57.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.081188+0000 mon.c (mon.1) 1124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.081465+0000 mgr.gibba043.dnkmem (mgr.34373) 4244 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:57.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: audit 2021-03-10T15:10:56.082765+0000 mon.c (mon.1) 1125 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.082919+0000 mgr.gibba043.dnkmem (mgr.34373) 4245 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:57.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.082956+0000 mgr.gibba043.dnkmem (mgr.34373) 4246 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:57.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cephadm 2021-03-10T15:10:56.083067+0000 mgr.gibba043.dnkmem (mgr.34373) 4247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:57.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[32348]: cluster 2021-03-10T15:10:56.599976+0000 mgr.gibba043.dnkmem (mgr.34373) 4248 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.082956+0000 mgr.gibba043.dnkmem (mgr.34373) 4246 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:57.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cephadm 2021-03-10T15:10:56.083067+0000 mgr.gibba043.dnkmem (mgr.34373) 4247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:57.456 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:57 gibba003 bash[31385]: cluster 2021-03-10T15:10:56.599976+0000 mgr.gibba043.dnkmem (mgr.34373) 4248 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:55.848797+0000 mgr.gibba043.dnkmem (mgr.34373) 4232 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:10:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:55.850332+0000 mgr.gibba043.dnkmem (mgr.34373) 4233 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:10:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.069003+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:10:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.070883+0000 mgr.gibba043.dnkmem (mgr.34373) 4234 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.072616+0000 mon.c (mon.1) 1120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.072852+0000 mgr.gibba043.dnkmem (mgr.34373) 4235 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.074180+0000 mgr.gibba043.dnkmem (mgr.34373) 4236 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.074216+0000 mgr.gibba043.dnkmem (mgr.34373) 4237 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.074254+0000 mon.c (mon.1) 1121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.075617+0000 mon.c (mon.1) 1122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.075781+0000 mgr.gibba043.dnkmem (mgr.34373) 4238 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.075819+0000 mgr.gibba043.dnkmem (mgr.34373) 4239 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.077213+0000 mon.c (mon.1) 1123 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.077849+0000 mgr.gibba043.dnkmem (mgr.34373) 4240 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.079616+0000 mgr.gibba043.dnkmem (mgr.34373) 4241 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:57.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.079674+0000 mgr.gibba043.dnkmem (mgr.34373) 4242 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:57.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.081046+0000 mgr.gibba043.dnkmem (mgr.34373) 4243 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:57.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.081188+0000 mon.c (mon.1) 1124 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.081465+0000 mgr.gibba043.dnkmem (mgr.34373) 4244 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:57.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: audit 2021-03-10T15:10:56.082765+0000 mon.c (mon.1) 1125 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:57.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.082919+0000 mgr.gibba043.dnkmem (mgr.34373) 4245 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:57.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.082956+0000 mgr.gibba043.dnkmem (mgr.34373) 4246 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:57.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cephadm 2021-03-10T15:10:56.083067+0000 mgr.gibba043.dnkmem (mgr.34373) 4247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:10:57.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:57 gibba043 bash[24019]: cluster 2021-03-10T15:10:56.599976+0000 mgr.gibba043.dnkmem (mgr.34373) 4248 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:10:59 gibba003 bash[31385]: cluster 2021-03-10T15:10:58.601692+0000 mgr.gibba043.dnkmem (mgr.34373) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:59.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:10:59 gibba003 bash[32348]: cluster 2021-03-10T15:10:58.601692+0000 mgr.gibba043.dnkmem (mgr.34373) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:10:59 gibba043 bash[24019]: cluster 2021-03-10T15:10:58.601692+0000 mgr.gibba043.dnkmem (mgr.34373) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:01 gibba003 bash[31385]: cluster 2021-03-10T15:11:00.603199+0000 mgr.gibba043.dnkmem (mgr.34373) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:01 gibba003 bash[32348]: cluster 2021-03-10T15:11:00.603199+0000 mgr.gibba043.dnkmem (mgr.34373) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:02.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:01 gibba043 bash[24019]: cluster 2021-03-10T15:11:00.603199+0000 mgr.gibba043.dnkmem (mgr.34373) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:03 gibba003 bash[31385]: cluster 2021-03-10T15:11:02.604073+0000 mgr.gibba043.dnkmem (mgr.34373) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:03 gibba003 bash[32348]: cluster 2021-03-10T15:11:02.604073+0000 mgr.gibba043.dnkmem (mgr.34373) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:03 gibba043 bash[24019]: cluster 2021-03-10T15:11:02.604073+0000 mgr.gibba043.dnkmem (mgr.34373) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:04 gibba043 bash[24019]: cluster 2021-03-10T15:11:04.604542+0000 mgr.gibba043.dnkmem (mgr.34373) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:04 gibba003 bash[31385]: cluster 2021-03-10T15:11:04.604542+0000 mgr.gibba043.dnkmem (mgr.34373) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:04 gibba003 bash[32348]: cluster 2021-03-10T15:11:04.604542+0000 mgr.gibba043.dnkmem (mgr.34373) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:07 gibba003 bash[31385]: cluster 2021-03-10T15:11:06.606242+0000 mgr.gibba043.dnkmem (mgr.34373) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:07 gibba003 bash[32348]: cluster 2021-03-10T15:11:06.606242+0000 mgr.gibba043.dnkmem (mgr.34373) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:07 gibba043 bash[24019]: cluster 2021-03-10T15:11:06.606242+0000 mgr.gibba043.dnkmem (mgr.34373) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:09 gibba003 bash[31385]: cluster 2021-03-10T15:11:08.608000+0000 mgr.gibba043.dnkmem (mgr.34373) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:09.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:09 gibba003 bash[32348]: cluster 2021-03-10T15:11:08.608000+0000 mgr.gibba043.dnkmem (mgr.34373) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:09 gibba043 bash[24019]: cluster 2021-03-10T15:11:08.608000+0000 mgr.gibba043.dnkmem (mgr.34373) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:11 gibba003 bash[31385]: cluster 2021-03-10T15:11:10.609574+0000 mgr.gibba043.dnkmem (mgr.34373) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:11 gibba003 bash[32348]: cluster 2021-03-10T15:11:10.609574+0000 mgr.gibba043.dnkmem (mgr.34373) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:11 gibba043 bash[24019]: cluster 2021-03-10T15:11:10.609574+0000 mgr.gibba043.dnkmem (mgr.34373) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:12 gibba043 bash[24019]: cephadm 2021-03-10T15:11:11.087720+0000 mgr.gibba043.dnkmem (mgr.34373) 4256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:12 gibba003 bash[31385]: cephadm 2021-03-10T15:11:11.087720+0000 mgr.gibba043.dnkmem (mgr.34373) 4256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:12 gibba003 bash[32348]: cephadm 2021-03-10T15:11:11.087720+0000 mgr.gibba043.dnkmem (mgr.34373) 4256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: cluster 2021-03-10T15:11:12.610359+0000 mgr.gibba043.dnkmem (mgr.34373) 4257 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.215597+0000 mon.c (mon.1) 1126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.216738+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.311814+0000 mon.c (mon.1) 1127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.312863+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.357000+0000 mon.c (mon.1) 1128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:11:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.357743+0000 mon.c (mon.1) 1129 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.358210+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:11:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.358432+0000 mon.c (mon.1) 1130 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.359322+0000 mon.c (mon.1) 1131 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.359437+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.360400+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:13 gibba043 bash[24019]: audit 2021-03-10T15:11:13.361346+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: cluster 2021-03-10T15:11:12.610359+0000 mgr.gibba043.dnkmem (mgr.34373) 4257 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.215597+0000 mon.c (mon.1) 1126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.216738+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.311814+0000 mon.c (mon.1) 1127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.312863+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.357000+0000 mon.c (mon.1) 1128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:11:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.357743+0000 mon.c (mon.1) 1129 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.358210+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:11:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.358432+0000 mon.c (mon.1) 1130 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.359322+0000 mon.c (mon.1) 1131 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.359437+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.360400+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[31385]: audit 2021-03-10T15:11:13.361346+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: cluster 2021-03-10T15:11:12.610359+0000 mgr.gibba043.dnkmem (mgr.34373) 4257 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.215597+0000 mon.c (mon.1) 1126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.216738+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.311814+0000 mon.c (mon.1) 1127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.312863+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.357000+0000 mon.c (mon.1) 1128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:11:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.357743+0000 mon.c (mon.1) 1129 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.358210+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:11:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.358432+0000 mon.c (mon.1) 1130 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.359322+0000 mon.c (mon.1) 1131 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.359437+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.360400+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:11:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:13 gibba003 bash[32348]: audit 2021-03-10T15:11:13.361346+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:14 gibba043 bash[24019]: cluster 2021-03-10T15:11:14.610936+0000 mgr.gibba043.dnkmem (mgr.34373) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:14 gibba003 bash[31385]: cluster 2021-03-10T15:11:14.610936+0000 mgr.gibba043.dnkmem (mgr.34373) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:14 gibba003 bash[32348]: cluster 2021-03-10T15:11:14.610936+0000 mgr.gibba043.dnkmem (mgr.34373) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:17 gibba003 bash[31385]: cluster 2021-03-10T15:11:16.612647+0000 mgr.gibba043.dnkmem (mgr.34373) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:17 gibba003 bash[32348]: cluster 2021-03-10T15:11:16.612647+0000 mgr.gibba043.dnkmem (mgr.34373) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:17 gibba043 bash[24019]: cluster 2021-03-10T15:11:16.612647+0000 mgr.gibba043.dnkmem (mgr.34373) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:19 gibba003 bash[31385]: cluster 2021-03-10T15:11:18.614346+0000 mgr.gibba043.dnkmem (mgr.34373) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:19.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:19 gibba003 bash[32348]: cluster 2021-03-10T15:11:18.614346+0000 mgr.gibba043.dnkmem (mgr.34373) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:19 gibba043 bash[24019]: cluster 2021-03-10T15:11:18.614346+0000 mgr.gibba043.dnkmem (mgr.34373) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:21 gibba043 bash[24019]: cluster 2021-03-10T15:11:20.615763+0000 mgr.gibba043.dnkmem (mgr.34373) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:21 gibba003 bash[31385]: cluster 2021-03-10T15:11:20.615763+0000 mgr.gibba043.dnkmem (mgr.34373) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:22.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:21 gibba003 bash[32348]: cluster 2021-03-10T15:11:20.615763+0000 mgr.gibba043.dnkmem (mgr.34373) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:23 gibba043 bash[24019]: cluster 2021-03-10T15:11:22.616737+0000 mgr.gibba043.dnkmem (mgr.34373) 4262 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:23 gibba003 bash[31385]: cluster 2021-03-10T15:11:22.616737+0000 mgr.gibba043.dnkmem (mgr.34373) 4262 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:23 gibba003 bash[32348]: cluster 2021-03-10T15:11:22.616737+0000 mgr.gibba043.dnkmem (mgr.34373) 4262 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:24 gibba043 bash[24019]: cluster 2021-03-10T15:11:24.617277+0000 mgr.gibba043.dnkmem (mgr.34373) 4263 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:24 gibba003 bash[31385]: cluster 2021-03-10T15:11:24.617277+0000 mgr.gibba043.dnkmem (mgr.34373) 4263 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:24 gibba003 bash[32348]: cluster 2021-03-10T15:11:24.617277+0000 mgr.gibba043.dnkmem (mgr.34373) 4263 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.633 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:11:25.862 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:11:25.862 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (79m) 4m ago 85m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:11:25.863 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (84m) 3m ago 84m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:11:25.863 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:11:25.863 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:11:25.864 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:11:25.864 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:11:25.864 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (78m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:11:25.865 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (79m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:11:25.865 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (85m) 4m ago 85m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:11:25.865 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (85m) 3m ago 85m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:11:25.865 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:11:25.866 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (77m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:11:25.866 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:11:25.866 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:11:25.867 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:11:25.867 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:11:25.867 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:11:25.868 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (75m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:11:25.868 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (84m) 3m ago 85m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:11:25.869 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 83m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:11:26.117 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:11:26.117 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:11:26.118 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:26.118 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:11:26.118 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:11:26.119 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:26.119 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:11:26.119 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:11:26.119 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:11:26.119 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:11:26.120 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:11:26.120 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:11:26.120 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:11:26.120 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:11:26.121 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:11:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:25 gibba043 bash[24019]: audit 2021-03-10T15:11:25.621197+0000 mgr.gibba043.dnkmem (mgr.34373) 4264 : audit [DBG] from='client.46914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:26.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:25 gibba043 bash[24019]: audit 2021-03-10T15:11:25.846865+0000 mgr.gibba043.dnkmem (mgr.34373) 4265 : audit [DBG] from='client.56908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:25 gibba003 bash[31385]: audit 2021-03-10T15:11:25.621197+0000 mgr.gibba043.dnkmem (mgr.34373) 4264 : audit [DBG] from='client.46914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:25 gibba003 bash[31385]: audit 2021-03-10T15:11:25.846865+0000 mgr.gibba043.dnkmem (mgr.34373) 4265 : audit [DBG] from='client.56908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:25 gibba003 bash[32348]: audit 2021-03-10T15:11:25.621197+0000 mgr.gibba043.dnkmem (mgr.34373) 4264 : audit [DBG] from='client.46914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:25 gibba003 bash[32348]: audit 2021-03-10T15:11:25.846865+0000 mgr.gibba043.dnkmem (mgr.34373) 4265 : audit [DBG] from='client.56908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:26 gibba043 bash[24019]: cephadm 2021-03-10T15:11:26.103839+0000 mgr.gibba043.dnkmem (mgr.34373) 4266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:26 gibba043 bash[24019]: audit 2021-03-10T15:11:26.115273+0000 mon.a (mon.0) 1123 : audit [DBG] from='client.? 172.21.2.103:0/3186936719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:26 gibba043 bash[24019]: cluster 2021-03-10T15:11:26.618883+0000 mgr.gibba043.dnkmem (mgr.34373) 4267 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:26 gibba003 bash[31385]: cephadm 2021-03-10T15:11:26.103839+0000 mgr.gibba043.dnkmem (mgr.34373) 4266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:26 gibba003 bash[31385]: audit 2021-03-10T15:11:26.115273+0000 mon.a (mon.0) 1123 : audit [DBG] from='client.? 172.21.2.103:0/3186936719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:26 gibba003 bash[31385]: cluster 2021-03-10T15:11:26.618883+0000 mgr.gibba043.dnkmem (mgr.34373) 4267 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:26 gibba003 bash[32348]: cephadm 2021-03-10T15:11:26.103839+0000 mgr.gibba043.dnkmem (mgr.34373) 4266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:26 gibba003 bash[32348]: audit 2021-03-10T15:11:26.115273+0000 mon.a (mon.0) 1123 : audit [DBG] from='client.? 172.21.2.103:0/3186936719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:26 gibba003 bash[32348]: cluster 2021-03-10T15:11:26.618883+0000 mgr.gibba043.dnkmem (mgr.34373) 4267 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:29 gibba003 bash[31385]: cluster 2021-03-10T15:11:28.620418+0000 mgr.gibba043.dnkmem (mgr.34373) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:29 gibba003 bash[32348]: cluster 2021-03-10T15:11:28.620418+0000 mgr.gibba043.dnkmem (mgr.34373) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:29 gibba043 bash[24019]: cluster 2021-03-10T15:11:28.620418+0000 mgr.gibba043.dnkmem (mgr.34373) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:31 gibba043 bash[24019]: cluster 2021-03-10T15:11:30.621671+0000 mgr.gibba043.dnkmem (mgr.34373) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:31 gibba003 bash[31385]: cluster 2021-03-10T15:11:30.621671+0000 mgr.gibba043.dnkmem (mgr.34373) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:32.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:31 gibba003 bash[32348]: cluster 2021-03-10T15:11:30.621671+0000 mgr.gibba043.dnkmem (mgr.34373) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:33 gibba043 bash[24019]: cluster 2021-03-10T15:11:32.623313+0000 mgr.gibba043.dnkmem (mgr.34373) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:33 gibba003 bash[31385]: cluster 2021-03-10T15:11:32.623313+0000 mgr.gibba043.dnkmem (mgr.34373) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:34.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:33 gibba003 bash[32348]: cluster 2021-03-10T15:11:32.623313+0000 mgr.gibba043.dnkmem (mgr.34373) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:34 gibba043 bash[24019]: cluster 2021-03-10T15:11:34.623917+0000 mgr.gibba043.dnkmem (mgr.34373) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:34 gibba003 bash[31385]: cluster 2021-03-10T15:11:34.623917+0000 mgr.gibba043.dnkmem (mgr.34373) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:34 gibba003 bash[32348]: cluster 2021-03-10T15:11:34.623917+0000 mgr.gibba043.dnkmem (mgr.34373) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:37 gibba003 bash[31385]: cluster 2021-03-10T15:11:36.625641+0000 mgr.gibba043.dnkmem (mgr.34373) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:37 gibba003 bash[32348]: cluster 2021-03-10T15:11:36.625641+0000 mgr.gibba043.dnkmem (mgr.34373) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:37 gibba043 bash[24019]: cluster 2021-03-10T15:11:36.625641+0000 mgr.gibba043.dnkmem (mgr.34373) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:39 gibba043 bash[24019]: cluster 2021-03-10T15:11:38.627033+0000 mgr.gibba043.dnkmem (mgr.34373) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:39 gibba003 bash[31385]: cluster 2021-03-10T15:11:38.627033+0000 mgr.gibba043.dnkmem (mgr.34373) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:39 gibba003 bash[32348]: cluster 2021-03-10T15:11:38.627033+0000 mgr.gibba043.dnkmem (mgr.34373) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:41 gibba043 bash[24019]: cluster 2021-03-10T15:11:40.628629+0000 mgr.gibba043.dnkmem (mgr.34373) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:41 gibba003 bash[31385]: cluster 2021-03-10T15:11:40.628629+0000 mgr.gibba043.dnkmem (mgr.34373) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:41 gibba003 bash[32348]: cluster 2021-03-10T15:11:40.628629+0000 mgr.gibba043.dnkmem (mgr.34373) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:42 gibba043 bash[24019]: cephadm 2021-03-10T15:11:41.104737+0000 mgr.gibba043.dnkmem (mgr.34373) 4275 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:42 gibba003 bash[31385]: cephadm 2021-03-10T15:11:41.104737+0000 mgr.gibba043.dnkmem (mgr.34373) 4275 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:42 gibba003 bash[32348]: cephadm 2021-03-10T15:11:41.104737+0000 mgr.gibba043.dnkmem (mgr.34373) 4275 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:44.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:43 gibba043 bash[24019]: cluster 2021-03-10T15:11:42.629265+0000 mgr.gibba043.dnkmem (mgr.34373) 4276 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:44.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:43 gibba003 bash[31385]: cluster 2021-03-10T15:11:42.629265+0000 mgr.gibba043.dnkmem (mgr.34373) 4276 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:44.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:43 gibba003 bash[32348]: cluster 2021-03-10T15:11:42.629265+0000 mgr.gibba043.dnkmem (mgr.34373) 4276 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:44 gibba043 bash[24019]: cluster 2021-03-10T15:11:44.630022+0000 mgr.gibba043.dnkmem (mgr.34373) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:44 gibba003 bash[31385]: cluster 2021-03-10T15:11:44.630022+0000 mgr.gibba043.dnkmem (mgr.34373) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:44 gibba003 bash[32348]: cluster 2021-03-10T15:11:44.630022+0000 mgr.gibba043.dnkmem (mgr.34373) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:47 gibba043 bash[24019]: cluster 2021-03-10T15:11:46.631592+0000 mgr.gibba043.dnkmem (mgr.34373) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:47 gibba003 bash[31385]: cluster 2021-03-10T15:11:46.631592+0000 mgr.gibba043.dnkmem (mgr.34373) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:47 gibba003 bash[32348]: cluster 2021-03-10T15:11:46.631592+0000 mgr.gibba043.dnkmem (mgr.34373) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:49 gibba043 bash[24019]: cluster 2021-03-10T15:11:48.632950+0000 mgr.gibba043.dnkmem (mgr.34373) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:49 gibba003 bash[31385]: cluster 2021-03-10T15:11:48.632950+0000 mgr.gibba043.dnkmem (mgr.34373) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:50.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:49 gibba003 bash[32348]: cluster 2021-03-10T15:11:48.632950+0000 mgr.gibba043.dnkmem (mgr.34373) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:51 gibba043 bash[24019]: cluster 2021-03-10T15:11:50.634226+0000 mgr.gibba043.dnkmem (mgr.34373) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:51 gibba003 bash[31385]: cluster 2021-03-10T15:11:50.634226+0000 mgr.gibba043.dnkmem (mgr.34373) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:52.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:51 gibba003 bash[32348]: cluster 2021-03-10T15:11:50.634226+0000 mgr.gibba043.dnkmem (mgr.34373) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:53 gibba043 bash[24019]: cluster 2021-03-10T15:11:52.635072+0000 mgr.gibba043.dnkmem (mgr.34373) 4281 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:54.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:53 gibba003 bash[31385]: cluster 2021-03-10T15:11:52.635072+0000 mgr.gibba043.dnkmem (mgr.34373) 4281 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:54.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:53 gibba003 bash[32348]: cluster 2021-03-10T15:11:52.635072+0000 mgr.gibba043.dnkmem (mgr.34373) 4281 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:54 gibba043 bash[24019]: cluster 2021-03-10T15:11:54.635533+0000 mgr.gibba043.dnkmem (mgr.34373) 4282 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:54 gibba003 bash[31385]: cluster 2021-03-10T15:11:54.635533+0000 mgr.gibba043.dnkmem (mgr.34373) 4282 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:54 gibba003 bash[32348]: cluster 2021-03-10T15:11:54.635533+0000 mgr.gibba043.dnkmem (mgr.34373) 4282 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:56.364 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:11:56.593 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:11:56.594 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (80m) 5m ago 85m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:11:56.594 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (85m) 4m ago 85m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:11:56.594 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (80m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:11:56.595 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (80m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:11:56.595 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (79m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:11:56.595 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (79m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:11:56.595 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (79m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:11:56.596 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (79m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:11:56.596 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (85m) 5m ago 85m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:11:56.596 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (85m) 4m ago 85m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:11:56.596 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:11:56.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:11:56.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:11:56.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:11:56.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:11:56.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:11:56.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:11:56.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (75m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:11:56.599 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (85m) 4m ago 85m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:11:56.599 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 83m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:11:56.843 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:11:56.843 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:11:56.843 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:56.843 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:11:56.844 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:11:56.844 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:56.844 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:11:56.845 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:11:56.845 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:11:56.845 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:11:56.845 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:11:56.846 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:11:56.846 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:11:56.846 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:11:56.846 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:11:57.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.121471+0000 mgr.gibba043.dnkmem (mgr.34373) 4283 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:11:57.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.123073+0000 mgr.gibba043.dnkmem (mgr.34373) 4284 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:11:57.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.336021+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:11:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.338309+0000 mgr.gibba043.dnkmem (mgr.34373) 4285 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.339901+0000 mgr.gibba043.dnkmem (mgr.34373) 4286 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.339972+0000 mon.c (mon.1) 1132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.340978+0000 mgr.gibba043.dnkmem (mgr.34373) 4287 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.341014+0000 mgr.gibba043.dnkmem (mgr.34373) 4288 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.341126+0000 mon.c (mon.1) 1133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.342220+0000 mgr.gibba043.dnkmem (mgr.34373) 4289 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.342232+0000 mon.c (mon.1) 1134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.342256+0000 mgr.gibba043.dnkmem (mgr.34373) 4290 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:57.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.343272+0000 mgr.gibba043.dnkmem (mgr.34373) 4291 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:57.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.343439+0000 mon.c (mon.1) 1135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.344744+0000 mgr.gibba043.dnkmem (mgr.34373) 4292 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:57.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.344780+0000 mgr.gibba043.dnkmem (mgr.34373) 4293 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:57.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.345895+0000 mgr.gibba043.dnkmem (mgr.34373) 4294 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:57.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.346072+0000 mon.c (mon.1) 1136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.346257+0000 mgr.gibba043.dnkmem (mgr.34373) 4295 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:57.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.347278+0000 mgr.gibba043.dnkmem (mgr.34373) 4296 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:57.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.347355+0000 mgr.gibba043.dnkmem (mgr.34373) 4297 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:57.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.121471+0000 mgr.gibba043.dnkmem (mgr.34373) 4283 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:11:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.123073+0000 mgr.gibba043.dnkmem (mgr.34373) 4284 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:11:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.336021+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:11:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.338309+0000 mgr.gibba043.dnkmem (mgr.34373) 4285 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.339901+0000 mgr.gibba043.dnkmem (mgr.34373) 4286 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.339972+0000 mon.c (mon.1) 1132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.340978+0000 mgr.gibba043.dnkmem (mgr.34373) 4287 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.341014+0000 mgr.gibba043.dnkmem (mgr.34373) 4288 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.341126+0000 mon.c (mon.1) 1133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.342220+0000 mgr.gibba043.dnkmem (mgr.34373) 4289 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.342232+0000 mon.c (mon.1) 1134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.342256+0000 mgr.gibba043.dnkmem (mgr.34373) 4290 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.343272+0000 mgr.gibba043.dnkmem (mgr.34373) 4291 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.343439+0000 mon.c (mon.1) 1135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.344744+0000 mgr.gibba043.dnkmem (mgr.34373) 4292 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.344780+0000 mgr.gibba043.dnkmem (mgr.34373) 4293 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.345895+0000 mgr.gibba043.dnkmem (mgr.34373) 4294 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.346072+0000 mon.c (mon.1) 1136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.346257+0000 mgr.gibba043.dnkmem (mgr.34373) 4295 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:57.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.347278+0000 mgr.gibba043.dnkmem (mgr.34373) 4296 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:57.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.347355+0000 mgr.gibba043.dnkmem (mgr.34373) 4297 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:57.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.347464+0000 mon.c (mon.1) 1137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cephadm 2021-03-10T15:11:56.347488+0000 mgr.gibba043.dnkmem (mgr.34373) 4298 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:57.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.353190+0000 mgr.gibba043.dnkmem (mgr.34373) 4299 : audit [DBG] from='client.56920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:57.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.578540+0000 mgr.gibba043.dnkmem (mgr.34373) 4300 : audit [DBG] from='client.56926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:57.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: cluster 2021-03-10T15:11:56.636443+0000 mgr.gibba043.dnkmem (mgr.34373) 4301 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[31385]: audit 2021-03-10T15:11:56.840842+0000 mon.a (mon.0) 1125 : audit [DBG] from='client.? 172.21.2.103:0/747020520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.347464+0000 mon.c (mon.1) 1137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cephadm 2021-03-10T15:11:56.347488+0000 mgr.gibba043.dnkmem (mgr.34373) 4298 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:57.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.353190+0000 mgr.gibba043.dnkmem (mgr.34373) 4299 : audit [DBG] from='client.56920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:57.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.578540+0000 mgr.gibba043.dnkmem (mgr.34373) 4300 : audit [DBG] from='client.56926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:57.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: cluster 2021-03-10T15:11:56.636443+0000 mgr.gibba043.dnkmem (mgr.34373) 4301 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:57 gibba003 bash[32348]: audit 2021-03-10T15:11:56.840842+0000 mon.a (mon.0) 1125 : audit [DBG] from='client.? 172.21.2.103:0/747020520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.121471+0000 mgr.gibba043.dnkmem (mgr.34373) 4283 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:11:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.123073+0000 mgr.gibba043.dnkmem (mgr.34373) 4284 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:11:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.336021+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:11:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.338309+0000 mgr.gibba043.dnkmem (mgr.34373) 4285 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.339901+0000 mgr.gibba043.dnkmem (mgr.34373) 4286 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.339972+0000 mon.c (mon.1) 1132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.340978+0000 mgr.gibba043.dnkmem (mgr.34373) 4287 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.341014+0000 mgr.gibba043.dnkmem (mgr.34373) 4288 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.341126+0000 mon.c (mon.1) 1133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.342220+0000 mgr.gibba043.dnkmem (mgr.34373) 4289 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.342232+0000 mon.c (mon.1) 1134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.342256+0000 mgr.gibba043.dnkmem (mgr.34373) 4290 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.343272+0000 mgr.gibba043.dnkmem (mgr.34373) 4291 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:57.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.343439+0000 mon.c (mon.1) 1135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.344744+0000 mgr.gibba043.dnkmem (mgr.34373) 4292 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:57.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.344780+0000 mgr.gibba043.dnkmem (mgr.34373) 4293 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:57.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.345895+0000 mgr.gibba043.dnkmem (mgr.34373) 4294 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:57.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.346072+0000 mon.c (mon.1) 1136 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.346257+0000 mgr.gibba043.dnkmem (mgr.34373) 4295 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:57.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.347278+0000 mgr.gibba043.dnkmem (mgr.34373) 4296 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:57.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.347355+0000 mgr.gibba043.dnkmem (mgr.34373) 4297 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:57.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.347464+0000 mon.c (mon.1) 1137 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:57.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cephadm 2021-03-10T15:11:56.347488+0000 mgr.gibba043.dnkmem (mgr.34373) 4298 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:11:57.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.353190+0000 mgr.gibba043.dnkmem (mgr.34373) 4299 : audit [DBG] from='client.56920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:57.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.578540+0000 mgr.gibba043.dnkmem (mgr.34373) 4300 : audit [DBG] from='client.56926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:57.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: cluster 2021-03-10T15:11:56.636443+0000 mgr.gibba043.dnkmem (mgr.34373) 4301 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:57 gibba043 bash[24019]: audit 2021-03-10T15:11:56.840842+0000 mon.a (mon.0) 1125 : audit [DBG] from='client.? 172.21.2.103:0/747020520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:11:59 gibba043 bash[24019]: cluster 2021-03-10T15:11:58.637640+0000 mgr.gibba043.dnkmem (mgr.34373) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:11:59 gibba003 bash[31385]: cluster 2021-03-10T15:11:58.637640+0000 mgr.gibba043.dnkmem (mgr.34373) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:00.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:11:59 gibba003 bash[32348]: cluster 2021-03-10T15:11:58.637640+0000 mgr.gibba043.dnkmem (mgr.34373) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:02.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:01 gibba043 bash[24019]: cluster 2021-03-10T15:12:00.638375+0000 mgr.gibba043.dnkmem (mgr.34373) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:01 gibba003 bash[31385]: cluster 2021-03-10T15:12:00.638375+0000 mgr.gibba043.dnkmem (mgr.34373) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:01 gibba003 bash[32348]: cluster 2021-03-10T15:12:00.638375+0000 mgr.gibba043.dnkmem (mgr.34373) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:03 gibba043 bash[24019]: cluster 2021-03-10T15:12:02.639420+0000 mgr.gibba043.dnkmem (mgr.34373) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:03 gibba003 bash[31385]: cluster 2021-03-10T15:12:02.639420+0000 mgr.gibba043.dnkmem (mgr.34373) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:04.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:03 gibba003 bash[32348]: cluster 2021-03-10T15:12:02.639420+0000 mgr.gibba043.dnkmem (mgr.34373) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:04 gibba043 bash[24019]: cluster 2021-03-10T15:12:04.639952+0000 mgr.gibba043.dnkmem (mgr.34373) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:04 gibba003 bash[31385]: cluster 2021-03-10T15:12:04.639952+0000 mgr.gibba043.dnkmem (mgr.34373) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:05 gibba003 bash[32348]: cluster 2021-03-10T15:12:04.639952+0000 mgr.gibba043.dnkmem (mgr.34373) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:07 gibba043 bash[24019]: cluster 2021-03-10T15:12:06.640476+0000 mgr.gibba043.dnkmem (mgr.34373) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:07 gibba003 bash[31385]: cluster 2021-03-10T15:12:06.640476+0000 mgr.gibba043.dnkmem (mgr.34373) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:08.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:07 gibba003 bash[32348]: cluster 2021-03-10T15:12:06.640476+0000 mgr.gibba043.dnkmem (mgr.34373) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:09 gibba043 bash[24019]: cluster 2021-03-10T15:12:08.641846+0000 mgr.gibba043.dnkmem (mgr.34373) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:09 gibba003 bash[31385]: cluster 2021-03-10T15:12:08.641846+0000 mgr.gibba043.dnkmem (mgr.34373) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:10.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:09 gibba003 bash[32348]: cluster 2021-03-10T15:12:08.641846+0000 mgr.gibba043.dnkmem (mgr.34373) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:11 gibba043 bash[24019]: cluster 2021-03-10T15:12:10.643446+0000 mgr.gibba043.dnkmem (mgr.34373) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:11 gibba003 bash[31385]: cluster 2021-03-10T15:12:10.643446+0000 mgr.gibba043.dnkmem (mgr.34373) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:11 gibba003 bash[32348]: cluster 2021-03-10T15:12:10.643446+0000 mgr.gibba043.dnkmem (mgr.34373) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:12 gibba043 bash[24019]: cephadm 2021-03-10T15:12:11.363652+0000 mgr.gibba043.dnkmem (mgr.34373) 4309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:12 gibba003 bash[31385]: cephadm 2021-03-10T15:12:11.363652+0000 mgr.gibba043.dnkmem (mgr.34373) 4309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:12 gibba003 bash[32348]: cephadm 2021-03-10T15:12:11.363652+0000 mgr.gibba043.dnkmem (mgr.34373) 4309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: cluster 2021-03-10T15:12:12.644802+0000 mgr.gibba043.dnkmem (mgr.34373) 4310 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:14.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.222553+0000 mon.c (mon.1) 1138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.223649+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.319755+0000 mon.c (mon.1) 1139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.320857+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.367265+0000 mon.c (mon.1) 1140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:12:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.368058+0000 mon.c (mon.1) 1141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.368479+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:12:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.368754+0000 mon.c (mon.1) 1142 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:12:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.369634+0000 mon.c (mon.1) 1143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.369995+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.370953+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:12:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:13 gibba043 bash[24019]: audit 2021-03-10T15:12:13.371797+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: cluster 2021-03-10T15:12:12.644802+0000 mgr.gibba043.dnkmem (mgr.34373) 4310 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.222553+0000 mon.c (mon.1) 1138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.223649+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.319755+0000 mon.c (mon.1) 1139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.320857+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.367265+0000 mon.c (mon.1) 1140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:12:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.368058+0000 mon.c (mon.1) 1141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.368479+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:12:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.368754+0000 mon.c (mon.1) 1142 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:12:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.369634+0000 mon.c (mon.1) 1143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.369995+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.370953+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:12:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[32348]: audit 2021-03-10T15:12:13.371797+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: cluster 2021-03-10T15:12:12.644802+0000 mgr.gibba043.dnkmem (mgr.34373) 4310 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.222553+0000 mon.c (mon.1) 1138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.223649+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.319755+0000 mon.c (mon.1) 1139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:14.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.320857+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:14.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.367265+0000 mon.c (mon.1) 1140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:12:14.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.368058+0000 mon.c (mon.1) 1141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.368479+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:12:14.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.368754+0000 mon.c (mon.1) 1142 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:12:14.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.369634+0000 mon.c (mon.1) 1143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.369995+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:12:14.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.370953+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:12:14.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:13 gibba003 bash[31385]: audit 2021-03-10T15:12:13.371797+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:15 gibba043 bash[24019]: cluster 2021-03-10T15:12:14.646264+0000 mgr.gibba043.dnkmem (mgr.34373) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:15 gibba003 bash[31385]: cluster 2021-03-10T15:12:14.646264+0000 mgr.gibba043.dnkmem (mgr.34373) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:15 gibba003 bash[32348]: cluster 2021-03-10T15:12:14.646264+0000 mgr.gibba043.dnkmem (mgr.34373) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:17 gibba043 bash[24019]: cluster 2021-03-10T15:12:16.648132+0000 mgr.gibba043.dnkmem (mgr.34373) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:17 gibba003 bash[31385]: cluster 2021-03-10T15:12:16.648132+0000 mgr.gibba043.dnkmem (mgr.34373) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:17 gibba003 bash[32348]: cluster 2021-03-10T15:12:16.648132+0000 mgr.gibba043.dnkmem (mgr.34373) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:19 gibba043 bash[24019]: cluster 2021-03-10T15:12:18.648850+0000 mgr.gibba043.dnkmem (mgr.34373) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:19 gibba003 bash[31385]: cluster 2021-03-10T15:12:18.648850+0000 mgr.gibba043.dnkmem (mgr.34373) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:19 gibba003 bash[32348]: cluster 2021-03-10T15:12:18.648850+0000 mgr.gibba043.dnkmem (mgr.34373) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:21 gibba043 bash[24019]: cluster 2021-03-10T15:12:20.650321+0000 mgr.gibba043.dnkmem (mgr.34373) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:21 gibba003 bash[31385]: cluster 2021-03-10T15:12:20.650321+0000 mgr.gibba043.dnkmem (mgr.34373) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:22.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:21 gibba003 bash[32348]: cluster 2021-03-10T15:12:20.650321+0000 mgr.gibba043.dnkmem (mgr.34373) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:24.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:23 gibba043 bash[24019]: cluster 2021-03-10T15:12:22.651378+0000 mgr.gibba043.dnkmem (mgr.34373) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:23 gibba003 bash[31385]: cluster 2021-03-10T15:12:22.651378+0000 mgr.gibba043.dnkmem (mgr.34373) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:23 gibba003 bash[32348]: cluster 2021-03-10T15:12:22.651378+0000 mgr.gibba043.dnkmem (mgr.34373) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:25 gibba043 bash[24019]: cluster 2021-03-10T15:12:24.651981+0000 mgr.gibba043.dnkmem (mgr.34373) 4316 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:25 gibba003 bash[31385]: cluster 2021-03-10T15:12:24.651981+0000 mgr.gibba043.dnkmem (mgr.34373) 4316 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:25 gibba003 bash[32348]: cluster 2021-03-10T15:12:24.651981+0000 mgr.gibba043.dnkmem (mgr.34373) 4316 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:27.086 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:12:27.312 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:12:27.313 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (80m) 5m ago 86m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:12:27.313 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (85m) 4m ago 85m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:12:27.313 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:12:27.313 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:12:27.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (80m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:12:27.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (80m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:12:27.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (79m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:12:27.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (80m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:12:27.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (86m) 5m ago 86m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:12:27.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (86m) 4m ago 86m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:12:27.315 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (79m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:12:27.315 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (78m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:12:27.315 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:12:27.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:12:27.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:12:27.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:12:27.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:12:27.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:12:27.317 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (85m) 4m ago 86m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:12:27.317 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 84m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:12:27.564 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:12:27.565 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:12:27.565 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:27.565 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:12:27.565 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:12:27.565 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:27.566 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:12:27.566 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:12:27.566 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:12:27.566 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:12:27.567 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:12:27.567 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:12:27.567 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:12:27.567 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:12:27.567 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:12:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:27 gibba043 bash[24019]: cephadm 2021-03-10T15:12:26.372757+0000 mgr.gibba043.dnkmem (mgr.34373) 4317 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:27 gibba043 bash[24019]: cluster 2021-03-10T15:12:26.653431+0000 mgr.gibba043.dnkmem (mgr.34373) 4318 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:27 gibba043 bash[24019]: audit 2021-03-10T15:12:27.562607+0000 mon.a (mon.0) 1132 : audit [DBG] from='client.? 172.21.2.103:0/458174875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:27 gibba003 bash[31385]: cephadm 2021-03-10T15:12:26.372757+0000 mgr.gibba043.dnkmem (mgr.34373) 4317 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:27 gibba003 bash[31385]: cluster 2021-03-10T15:12:26.653431+0000 mgr.gibba043.dnkmem (mgr.34373) 4318 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:27 gibba003 bash[31385]: audit 2021-03-10T15:12:27.562607+0000 mon.a (mon.0) 1132 : audit [DBG] from='client.? 172.21.2.103:0/458174875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:28.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:27 gibba003 bash[32348]: cephadm 2021-03-10T15:12:26.372757+0000 mgr.gibba043.dnkmem (mgr.34373) 4317 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:28.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:27 gibba003 bash[32348]: cluster 2021-03-10T15:12:26.653431+0000 mgr.gibba043.dnkmem (mgr.34373) 4318 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:27 gibba003 bash[32348]: audit 2021-03-10T15:12:27.562607+0000 mon.a (mon.0) 1132 : audit [DBG] from='client.? 172.21.2.103:0/458174875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:28 gibba043 bash[24019]: audit 2021-03-10T15:12:27.074721+0000 mgr.gibba043.dnkmem (mgr.34373) 4319 : audit [DBG] from='client.56938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:29.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:28 gibba043 bash[24019]: audit 2021-03-10T15:12:27.297962+0000 mgr.gibba043.dnkmem (mgr.34373) 4320 : audit [DBG] from='client.56944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:28 gibba003 bash[31385]: audit 2021-03-10T15:12:27.074721+0000 mgr.gibba043.dnkmem (mgr.34373) 4319 : audit [DBG] from='client.56938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:29.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:28 gibba003 bash[31385]: audit 2021-03-10T15:12:27.297962+0000 mgr.gibba043.dnkmem (mgr.34373) 4320 : audit [DBG] from='client.56944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:29.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:28 gibba003 bash[32348]: audit 2021-03-10T15:12:27.074721+0000 mgr.gibba043.dnkmem (mgr.34373) 4319 : audit [DBG] from='client.56938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:29.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:28 gibba003 bash[32348]: audit 2021-03-10T15:12:27.297962+0000 mgr.gibba043.dnkmem (mgr.34373) 4320 : audit [DBG] from='client.56944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:29 gibba043 bash[24019]: cluster 2021-03-10T15:12:28.655132+0000 mgr.gibba043.dnkmem (mgr.34373) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:29 gibba003 bash[31385]: cluster 2021-03-10T15:12:28.655132+0000 mgr.gibba043.dnkmem (mgr.34373) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:30.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:29 gibba003 bash[32348]: cluster 2021-03-10T15:12:28.655132+0000 mgr.gibba043.dnkmem (mgr.34373) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:31 gibba043 bash[24019]: cluster 2021-03-10T15:12:30.655916+0000 mgr.gibba043.dnkmem (mgr.34373) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:31 gibba003 bash[31385]: cluster 2021-03-10T15:12:30.655916+0000 mgr.gibba043.dnkmem (mgr.34373) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:32.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:31 gibba003 bash[32348]: cluster 2021-03-10T15:12:30.655916+0000 mgr.gibba043.dnkmem (mgr.34373) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:33 gibba043 bash[24019]: cluster 2021-03-10T15:12:32.656691+0000 mgr.gibba043.dnkmem (mgr.34373) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:33 gibba003 bash[31385]: cluster 2021-03-10T15:12:32.656691+0000 mgr.gibba043.dnkmem (mgr.34373) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:34.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:33 gibba003 bash[32348]: cluster 2021-03-10T15:12:32.656691+0000 mgr.gibba043.dnkmem (mgr.34373) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:35 gibba043 bash[24019]: cluster 2021-03-10T15:12:34.657717+0000 mgr.gibba043.dnkmem (mgr.34373) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:35 gibba003 bash[31385]: cluster 2021-03-10T15:12:34.657717+0000 mgr.gibba043.dnkmem (mgr.34373) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:35 gibba003 bash[32348]: cluster 2021-03-10T15:12:34.657717+0000 mgr.gibba043.dnkmem (mgr.34373) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:37 gibba043 bash[24019]: cluster 2021-03-10T15:12:36.658287+0000 mgr.gibba043.dnkmem (mgr.34373) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:37 gibba003 bash[31385]: cluster 2021-03-10T15:12:36.658287+0000 mgr.gibba043.dnkmem (mgr.34373) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:38.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:37 gibba003 bash[32348]: cluster 2021-03-10T15:12:36.658287+0000 mgr.gibba043.dnkmem (mgr.34373) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:39 gibba043 bash[24019]: cluster 2021-03-10T15:12:38.659610+0000 mgr.gibba043.dnkmem (mgr.34373) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:39 gibba003 bash[31385]: cluster 2021-03-10T15:12:38.659610+0000 mgr.gibba043.dnkmem (mgr.34373) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:39 gibba003 bash[32348]: cluster 2021-03-10T15:12:38.659610+0000 mgr.gibba043.dnkmem (mgr.34373) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:41 gibba043 bash[24019]: cluster 2021-03-10T15:12:40.660914+0000 mgr.gibba043.dnkmem (mgr.34373) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:41 gibba003 bash[31385]: cluster 2021-03-10T15:12:40.660914+0000 mgr.gibba043.dnkmem (mgr.34373) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:41 gibba003 bash[32348]: cluster 2021-03-10T15:12:40.660914+0000 mgr.gibba043.dnkmem (mgr.34373) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:42 gibba043 bash[24019]: cephadm 2021-03-10T15:12:41.388627+0000 mgr.gibba043.dnkmem (mgr.34373) 4328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:42 gibba003 bash[31385]: cephadm 2021-03-10T15:12:41.388627+0000 mgr.gibba043.dnkmem (mgr.34373) 4328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:42 gibba003 bash[32348]: cephadm 2021-03-10T15:12:41.388627+0000 mgr.gibba043.dnkmem (mgr.34373) 4328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:44.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:43 gibba043 bash[24019]: cluster 2021-03-10T15:12:42.661716+0000 mgr.gibba043.dnkmem (mgr.34373) 4329 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:44.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:43 gibba003 bash[31385]: cluster 2021-03-10T15:12:42.661716+0000 mgr.gibba043.dnkmem (mgr.34373) 4329 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:44.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:43 gibba003 bash[32348]: cluster 2021-03-10T15:12:42.661716+0000 mgr.gibba043.dnkmem (mgr.34373) 4329 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:45 gibba043 bash[24019]: cluster 2021-03-10T15:12:44.663118+0000 mgr.gibba043.dnkmem (mgr.34373) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:45 gibba003 bash[31385]: cluster 2021-03-10T15:12:44.663118+0000 mgr.gibba043.dnkmem (mgr.34373) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:45 gibba003 bash[32348]: cluster 2021-03-10T15:12:44.663118+0000 mgr.gibba043.dnkmem (mgr.34373) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:47 gibba043 bash[24019]: cluster 2021-03-10T15:12:46.664878+0000 mgr.gibba043.dnkmem (mgr.34373) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:47 gibba003 bash[31385]: cluster 2021-03-10T15:12:46.664878+0000 mgr.gibba043.dnkmem (mgr.34373) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:47 gibba003 bash[32348]: cluster 2021-03-10T15:12:46.664878+0000 mgr.gibba043.dnkmem (mgr.34373) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:49 gibba043 bash[24019]: cluster 2021-03-10T15:12:48.665655+0000 mgr.gibba043.dnkmem (mgr.34373) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:49 gibba003 bash[31385]: cluster 2021-03-10T15:12:48.665655+0000 mgr.gibba043.dnkmem (mgr.34373) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:50.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:49 gibba003 bash[32348]: cluster 2021-03-10T15:12:48.665655+0000 mgr.gibba043.dnkmem (mgr.34373) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:52.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:51 gibba043 bash[24019]: cluster 2021-03-10T15:12:50.667112+0000 mgr.gibba043.dnkmem (mgr.34373) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:51 gibba003 bash[31385]: cluster 2021-03-10T15:12:50.667112+0000 mgr.gibba043.dnkmem (mgr.34373) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:52.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:51 gibba003 bash[32348]: cluster 2021-03-10T15:12:50.667112+0000 mgr.gibba043.dnkmem (mgr.34373) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:53 gibba043 bash[24019]: cluster 2021-03-10T15:12:52.668804+0000 mgr.gibba043.dnkmem (mgr.34373) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:54.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:53 gibba003 bash[31385]: cluster 2021-03-10T15:12:52.668804+0000 mgr.gibba043.dnkmem (mgr.34373) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:54.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:53 gibba003 bash[32348]: cluster 2021-03-10T15:12:52.668804+0000 mgr.gibba043.dnkmem (mgr.34373) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:55 gibba003 bash[31385]: cluster 2021-03-10T15:12:54.670360+0000 mgr.gibba043.dnkmem (mgr.34373) 4335 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:55 gibba003 bash[32348]: cluster 2021-03-10T15:12:54.670360+0000 mgr.gibba043.dnkmem (mgr.34373) 4335 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:55 gibba043 bash[24019]: cluster 2021-03-10T15:12:54.670360+0000 mgr.gibba043.dnkmem (mgr.34373) 4335 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:57.814 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:12:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.390667+0000 mgr.gibba043.dnkmem (mgr.34373) 4336 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:12:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.392195+0000 mgr.gibba043.dnkmem (mgr.34373) 4337 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:12:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.630651+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:12:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.632894+0000 mgr.gibba043.dnkmem (mgr.34373) 4338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.634880+0000 mon.c (mon.1) 1144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.636233+0000 mgr.gibba043.dnkmem (mgr.34373) 4339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.637820+0000 mon.c (mon.1) 1145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.638834+0000 mgr.gibba043.dnkmem (mgr.34373) 4340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.638869+0000 mgr.gibba043.dnkmem (mgr.34373) 4341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.640490+0000 mon.c (mon.1) 1146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.641519+0000 mgr.gibba043.dnkmem (mgr.34373) 4342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:57.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.641555+0000 mgr.gibba043.dnkmem (mgr.34373) 4343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:57.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.643118+0000 mon.c (mon.1) 1147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.644039+0000 mgr.gibba043.dnkmem (mgr.34373) 4344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:57.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.648714+0000 mgr.gibba043.dnkmem (mgr.34373) 4345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:57.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.648752+0000 mgr.gibba043.dnkmem (mgr.34373) 4346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:57.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.650444+0000 mon.c (mon.1) 1148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.651398+0000 mgr.gibba043.dnkmem (mgr.34373) 4347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:57.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.651882+0000 mgr.gibba043.dnkmem (mgr.34373) 4348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:57.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: audit 2021-03-10T15:12:56.653405+0000 mon.c (mon.1) 1149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.654625+0000 mgr.gibba043.dnkmem (mgr.34373) 4349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:57.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.654669+0000 mgr.gibba043.dnkmem (mgr.34373) 4350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:57.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cephadm 2021-03-10T15:12:56.654797+0000 mgr.gibba043.dnkmem (mgr.34373) 4351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:57.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[31385]: cluster 2021-03-10T15:12:56.671087+0000 mgr.gibba043.dnkmem (mgr.34373) 4352 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.390667+0000 mgr.gibba043.dnkmem (mgr.34373) 4336 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:12:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.392195+0000 mgr.gibba043.dnkmem (mgr.34373) 4337 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:12:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.630651+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:12:57.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.632894+0000 mgr.gibba043.dnkmem (mgr.34373) 4338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:57.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.634880+0000 mon.c (mon.1) 1144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:57.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.636233+0000 mgr.gibba043.dnkmem (mgr.34373) 4339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:57.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.637820+0000 mon.c (mon.1) 1145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.638834+0000 mgr.gibba043.dnkmem (mgr.34373) 4340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.638869+0000 mgr.gibba043.dnkmem (mgr.34373) 4341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.640490+0000 mon.c (mon.1) 1146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.641519+0000 mgr.gibba043.dnkmem (mgr.34373) 4342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:57.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.641555+0000 mgr.gibba043.dnkmem (mgr.34373) 4343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:57.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.643118+0000 mon.c (mon.1) 1147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.644039+0000 mgr.gibba043.dnkmem (mgr.34373) 4344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:57.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.648714+0000 mgr.gibba043.dnkmem (mgr.34373) 4345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:57.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.648752+0000 mgr.gibba043.dnkmem (mgr.34373) 4346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:57.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.650444+0000 mon.c (mon.1) 1148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.651398+0000 mgr.gibba043.dnkmem (mgr.34373) 4347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:57.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.651882+0000 mgr.gibba043.dnkmem (mgr.34373) 4348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:57.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: audit 2021-03-10T15:12:56.653405+0000 mon.c (mon.1) 1149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:57.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.654625+0000 mgr.gibba043.dnkmem (mgr.34373) 4349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:57.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.654669+0000 mgr.gibba043.dnkmem (mgr.34373) 4350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:57.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cephadm 2021-03-10T15:12:56.654797+0000 mgr.gibba043.dnkmem (mgr.34373) 4351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:57.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:57 gibba003 bash[32348]: cluster 2021-03-10T15:12:56.671087+0000 mgr.gibba043.dnkmem (mgr.34373) 4352 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.390667+0000 mgr.gibba043.dnkmem (mgr.34373) 4336 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:12:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.392195+0000 mgr.gibba043.dnkmem (mgr.34373) 4337 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:12:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.630651+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:12:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.632894+0000 mgr.gibba043.dnkmem (mgr.34373) 4338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.634880+0000 mon.c (mon.1) 1144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.636233+0000 mgr.gibba043.dnkmem (mgr.34373) 4339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.637820+0000 mon.c (mon.1) 1145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.638834+0000 mgr.gibba043.dnkmem (mgr.34373) 4340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.638869+0000 mgr.gibba043.dnkmem (mgr.34373) 4341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.640490+0000 mon.c (mon.1) 1146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.641519+0000 mgr.gibba043.dnkmem (mgr.34373) 4342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.641555+0000 mgr.gibba043.dnkmem (mgr.34373) 4343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.643118+0000 mon.c (mon.1) 1147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.644039+0000 mgr.gibba043.dnkmem (mgr.34373) 4344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.648714+0000 mgr.gibba043.dnkmem (mgr.34373) 4345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:58.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.648752+0000 mgr.gibba043.dnkmem (mgr.34373) 4346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:58.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.650444+0000 mon.c (mon.1) 1148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:58.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.651398+0000 mgr.gibba043.dnkmem (mgr.34373) 4347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:58.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.651882+0000 mgr.gibba043.dnkmem (mgr.34373) 4348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:58.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: audit 2021-03-10T15:12:56.653405+0000 mon.c (mon.1) 1149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:58.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.654625+0000 mgr.gibba043.dnkmem (mgr.34373) 4349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:58.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.654669+0000 mgr.gibba043.dnkmem (mgr.34373) 4350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:58.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cephadm 2021-03-10T15:12:56.654797+0000 mgr.gibba043.dnkmem (mgr.34373) 4351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:12:58.030 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:57 gibba043 bash[24019]: cluster 2021-03-10T15:12:56.671087+0000 mgr.gibba043.dnkmem (mgr.34373) 4352 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:58.042 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:12:58.042 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (81m) 6m ago 86m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:12:58.043 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (86m) 5m ago 86m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:12:58.043 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (81m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:12:58.043 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (81m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:12:58.043 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:12:58.044 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (80m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:12:58.044 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (80m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:12:58.044 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (80m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:12:58.044 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (86m) 6m ago 86m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:12:58.045 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (86m) 5m ago 86m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:12:58.045 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:12:58.045 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:12:58.045 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:12:58.045 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:12:58.046 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:12:58.046 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:12:58.046 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:12:58.046 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (76m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:12:58.047 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (86m) 5m ago 86m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:12:58.047 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 84m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:12:58.290 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:12:58.290 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:12:58.290 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:58.291 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:12:58.291 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:12:58.291 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:58.291 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:12:58.291 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:12:58.292 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:12:58.292 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:12:58.292 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:12:58.292 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:12:58.293 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:12:58.293 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:12:58.293 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:12:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:58 gibba003 bash[31385]: audit 2021-03-10T15:12:57.801688+0000 mgr.gibba043.dnkmem (mgr.34373) 4353 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:58 gibba003 bash[31385]: audit 2021-03-10T15:12:58.287938+0000 mon.c (mon.1) 1150 : audit [DBG] from='client.? 172.21.2.103:0/3493566445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:58 gibba003 bash[32348]: audit 2021-03-10T15:12:57.801688+0000 mgr.gibba043.dnkmem (mgr.34373) 4353 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:58 gibba003 bash[32348]: audit 2021-03-10T15:12:58.287938+0000 mon.c (mon.1) 1150 : audit [DBG] from='client.? 172.21.2.103:0/3493566445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:58 gibba043 bash[24019]: audit 2021-03-10T15:12:57.801688+0000 mgr.gibba043.dnkmem (mgr.34373) 4353 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:58 gibba043 bash[24019]: audit 2021-03-10T15:12:58.287938+0000 mon.c (mon.1) 1150 : audit [DBG] from='client.? 172.21.2.103:0/3493566445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:59 gibba003 bash[31385]: audit 2021-03-10T15:12:58.027508+0000 mgr.gibba043.dnkmem (mgr.34373) 4354 : audit [DBG] from='client.46974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:12:59 gibba003 bash[31385]: cluster 2021-03-10T15:12:58.671922+0000 mgr.gibba043.dnkmem (mgr.34373) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:59.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:59 gibba003 bash[32348]: audit 2021-03-10T15:12:58.027508+0000 mgr.gibba043.dnkmem (mgr.34373) 4354 : audit [DBG] from='client.46974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:59.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:12:59 gibba003 bash[32348]: cluster 2021-03-10T15:12:58.671922+0000 mgr.gibba043.dnkmem (mgr.34373) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:00.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:59 gibba043 bash[24019]: audit 2021-03-10T15:12:58.027508+0000 mgr.gibba043.dnkmem (mgr.34373) 4354 : audit [DBG] from='client.46974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:12:59 gibba043 bash[24019]: cluster 2021-03-10T15:12:58.671922+0000 mgr.gibba043.dnkmem (mgr.34373) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:02.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:01 gibba043 bash[24019]: cluster 2021-03-10T15:13:00.672467+0000 mgr.gibba043.dnkmem (mgr.34373) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:01 gibba003 bash[31385]: cluster 2021-03-10T15:13:00.672467+0000 mgr.gibba043.dnkmem (mgr.34373) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:01 gibba003 bash[32348]: cluster 2021-03-10T15:13:00.672467+0000 mgr.gibba043.dnkmem (mgr.34373) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:03 gibba043 bash[24019]: cluster 2021-03-10T15:13:02.673366+0000 mgr.gibba043.dnkmem (mgr.34373) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:03 gibba003 bash[31385]: cluster 2021-03-10T15:13:02.673366+0000 mgr.gibba043.dnkmem (mgr.34373) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:04.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:03 gibba003 bash[32348]: cluster 2021-03-10T15:13:02.673366+0000 mgr.gibba043.dnkmem (mgr.34373) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:05 gibba003 bash[31385]: cluster 2021-03-10T15:13:04.674688+0000 mgr.gibba043.dnkmem (mgr.34373) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:05 gibba003 bash[32348]: cluster 2021-03-10T15:13:04.674688+0000 mgr.gibba043.dnkmem (mgr.34373) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:05 gibba043 bash[24019]: cluster 2021-03-10T15:13:04.674688+0000 mgr.gibba043.dnkmem (mgr.34373) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:07 gibba043 bash[24019]: cluster 2021-03-10T15:13:06.675629+0000 mgr.gibba043.dnkmem (mgr.34373) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:07 gibba003 bash[31385]: cluster 2021-03-10T15:13:06.675629+0000 mgr.gibba043.dnkmem (mgr.34373) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:07 gibba003 bash[32348]: cluster 2021-03-10T15:13:06.675629+0000 mgr.gibba043.dnkmem (mgr.34373) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:09 gibba043 bash[24019]: cluster 2021-03-10T15:13:08.677015+0000 mgr.gibba043.dnkmem (mgr.34373) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:09 gibba003 bash[31385]: cluster 2021-03-10T15:13:08.677015+0000 mgr.gibba043.dnkmem (mgr.34373) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:10.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:09 gibba003 bash[32348]: cluster 2021-03-10T15:13:08.677015+0000 mgr.gibba043.dnkmem (mgr.34373) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:11 gibba043 bash[24019]: cluster 2021-03-10T15:13:10.678559+0000 mgr.gibba043.dnkmem (mgr.34373) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:11 gibba003 bash[31385]: cluster 2021-03-10T15:13:10.678559+0000 mgr.gibba043.dnkmem (mgr.34373) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:12.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:11 gibba003 bash[32348]: cluster 2021-03-10T15:13:10.678559+0000 mgr.gibba043.dnkmem (mgr.34373) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:12 gibba043 bash[24019]: cephadm 2021-03-10T15:13:11.670886+0000 mgr.gibba043.dnkmem (mgr.34373) 4362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:12 gibba003 bash[31385]: cephadm 2021-03-10T15:13:11.670886+0000 mgr.gibba043.dnkmem (mgr.34373) 4362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:12 gibba003 bash[32348]: cephadm 2021-03-10T15:13:11.670886+0000 mgr.gibba043.dnkmem (mgr.34373) 4362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: cluster 2021-03-10T15:13:12.679788+0000 mgr.gibba043.dnkmem (mgr.34373) 4363 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.229290+0000 mon.c (mon.1) 1151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.230446+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.327781+0000 mon.c (mon.1) 1152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.328910+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.377625+0000 mon.c (mon.1) 1153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:13:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.378419+0000 mon.c (mon.1) 1154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.378987+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:13:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.379605+0000 mon.c (mon.1) 1155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.381041+0000 mon.c (mon.1) 1156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.381157+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.382894+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[31385]: audit 2021-03-10T15:13:13.383921+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: cluster 2021-03-10T15:13:12.679788+0000 mgr.gibba043.dnkmem (mgr.34373) 4363 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.229290+0000 mon.c (mon.1) 1151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.230446+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.327781+0000 mon.c (mon.1) 1152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.328910+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.377625+0000 mon.c (mon.1) 1153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:13:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.378419+0000 mon.c (mon.1) 1154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.378987+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:13:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.379605+0000 mon.c (mon.1) 1155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.381041+0000 mon.c (mon.1) 1156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.381157+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.382894+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:13 gibba003 bash[32348]: audit 2021-03-10T15:13:13.383921+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: cluster 2021-03-10T15:13:12.679788+0000 mgr.gibba043.dnkmem (mgr.34373) 4363 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.229290+0000 mon.c (mon.1) 1151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.230446+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.327781+0000 mon.c (mon.1) 1152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.328910+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.377625+0000 mon.c (mon.1) 1153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:13:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.378419+0000 mon.c (mon.1) 1154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.378987+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:13:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.379605+0000 mon.c (mon.1) 1155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.381041+0000 mon.c (mon.1) 1156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.381157+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.382894+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:13:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:13 gibba043 bash[24019]: audit 2021-03-10T15:13:13.383921+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:13:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:15 gibba003 bash[31385]: cluster 2021-03-10T15:13:14.681097+0000 mgr.gibba043.dnkmem (mgr.34373) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:15 gibba003 bash[32348]: cluster 2021-03-10T15:13:14.681097+0000 mgr.gibba043.dnkmem (mgr.34373) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:15 gibba043 bash[24019]: cluster 2021-03-10T15:13:14.681097+0000 mgr.gibba043.dnkmem (mgr.34373) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:17 gibba043 bash[24019]: cluster 2021-03-10T15:13:16.682837+0000 mgr.gibba043.dnkmem (mgr.34373) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:17 gibba003 bash[31385]: cluster 2021-03-10T15:13:16.682837+0000 mgr.gibba043.dnkmem (mgr.34373) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:17 gibba003 bash[32348]: cluster 2021-03-10T15:13:16.682837+0000 mgr.gibba043.dnkmem (mgr.34373) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:19 gibba043 bash[24019]: cluster 2021-03-10T15:13:18.683723+0000 mgr.gibba043.dnkmem (mgr.34373) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:19 gibba003 bash[31385]: cluster 2021-03-10T15:13:18.683723+0000 mgr.gibba043.dnkmem (mgr.34373) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:20.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:19 gibba003 bash[32348]: cluster 2021-03-10T15:13:18.683723+0000 mgr.gibba043.dnkmem (mgr.34373) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:21 gibba043 bash[24019]: cluster 2021-03-10T15:13:20.685302+0000 mgr.gibba043.dnkmem (mgr.34373) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:21 gibba003 bash[31385]: cluster 2021-03-10T15:13:20.685302+0000 mgr.gibba043.dnkmem (mgr.34373) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:22.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:21 gibba003 bash[32348]: cluster 2021-03-10T15:13:20.685302+0000 mgr.gibba043.dnkmem (mgr.34373) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:23 gibba003 bash[31385]: cluster 2021-03-10T15:13:22.686336+0000 mgr.gibba043.dnkmem (mgr.34373) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:23 gibba003 bash[32348]: cluster 2021-03-10T15:13:22.686336+0000 mgr.gibba043.dnkmem (mgr.34373) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:23 gibba043 bash[24019]: cluster 2021-03-10T15:13:22.686336+0000 mgr.gibba043.dnkmem (mgr.34373) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:25 gibba003 bash[31385]: cluster 2021-03-10T15:13:24.687870+0000 mgr.gibba043.dnkmem (mgr.34373) 4369 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:25 gibba003 bash[32348]: cluster 2021-03-10T15:13:24.687870+0000 mgr.gibba043.dnkmem (mgr.34373) 4369 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:25 gibba043 bash[24019]: cluster 2021-03-10T15:13:24.687870+0000 mgr.gibba043.dnkmem (mgr.34373) 4369 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:27 gibba043 bash[24019]: cephadm 2021-03-10T15:13:26.686946+0000 mgr.gibba043.dnkmem (mgr.34373) 4370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:27 gibba043 bash[24019]: cluster 2021-03-10T15:13:26.689401+0000 mgr.gibba043.dnkmem (mgr.34373) 4371 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:27 gibba003 bash[31385]: cephadm 2021-03-10T15:13:26.686946+0000 mgr.gibba043.dnkmem (mgr.34373) 4370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:27 gibba003 bash[31385]: cluster 2021-03-10T15:13:26.689401+0000 mgr.gibba043.dnkmem (mgr.34373) 4371 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:27 gibba003 bash[32348]: cephadm 2021-03-10T15:13:26.686946+0000 mgr.gibba043.dnkmem (mgr.34373) 4370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:28.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:27 gibba003 bash[32348]: cluster 2021-03-10T15:13:26.689401+0000 mgr.gibba043.dnkmem (mgr.34373) 4371 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.534 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:13:28.764 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:13:28.764 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (81m) 6m ago 87m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:13:28.765 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (86m) 5m ago 86m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:13:28.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (82m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:13:28.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (82m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:13:28.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (81m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:13:28.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (81m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:13:28.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (80m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:13:28.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:13:28.766 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (87m) 6m ago 87m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:13:28.767 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (87m) 5m ago 87m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:13:28.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (80m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:13:28.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (79m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:13:28.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:13:28.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:13:28.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:13:28.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:13:28.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:13:28.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:13:28.768 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (86m) 5m ago 87m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:13:28.769 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 85m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:13:29.024 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:13:29.025 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:13:29.025 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:29.025 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:13:29.025 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:13:29.026 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:29.026 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:13:29.026 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:13:29.026 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:13:29.026 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:13:29.027 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:13:29.027 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:13:29.027 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:13:29.027 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:13:29.028 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:13:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:29 gibba043 bash[24019]: audit 2021-03-10T15:13:28.522384+0000 mgr.gibba043.dnkmem (mgr.34373) 4372 : audit [DBG] from='client.46986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:29 gibba043 bash[24019]: cluster 2021-03-10T15:13:28.690961+0000 mgr.gibba043.dnkmem (mgr.34373) 4373 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:29 gibba043 bash[24019]: audit 2021-03-10T15:13:28.748968+0000 mgr.gibba043.dnkmem (mgr.34373) 4374 : audit [DBG] from='client.56980 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:30.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:29 gibba043 bash[24019]: audit 2021-03-10T15:13:29.022672+0000 mon.c (mon.1) 1157 : audit [DBG] from='client.? 172.21.2.103:0/1182557008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[31385]: audit 2021-03-10T15:13:28.522384+0000 mgr.gibba043.dnkmem (mgr.34373) 4372 : audit [DBG] from='client.46986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[31385]: cluster 2021-03-10T15:13:28.690961+0000 mgr.gibba043.dnkmem (mgr.34373) 4373 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:30.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[31385]: audit 2021-03-10T15:13:28.748968+0000 mgr.gibba043.dnkmem (mgr.34373) 4374 : audit [DBG] from='client.56980 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:30.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[31385]: audit 2021-03-10T15:13:29.022672+0000 mon.c (mon.1) 1157 : audit [DBG] from='client.? 172.21.2.103:0/1182557008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:30.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[32348]: audit 2021-03-10T15:13:28.522384+0000 mgr.gibba043.dnkmem (mgr.34373) 4372 : audit [DBG] from='client.46986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:30.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[32348]: cluster 2021-03-10T15:13:28.690961+0000 mgr.gibba043.dnkmem (mgr.34373) 4373 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:30.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[32348]: audit 2021-03-10T15:13:28.748968+0000 mgr.gibba043.dnkmem (mgr.34373) 4374 : audit [DBG] from='client.56980 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:30.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:29 gibba003 bash[32348]: audit 2021-03-10T15:13:29.022672+0000 mon.c (mon.1) 1157 : audit [DBG] from='client.? 172.21.2.103:0/1182557008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:31 gibba043 bash[24019]: cluster 2021-03-10T15:13:30.691862+0000 mgr.gibba043.dnkmem (mgr.34373) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:31 gibba003 bash[31385]: cluster 2021-03-10T15:13:30.691862+0000 mgr.gibba043.dnkmem (mgr.34373) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:32.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:31 gibba003 bash[32348]: cluster 2021-03-10T15:13:30.691862+0000 mgr.gibba043.dnkmem (mgr.34373) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:33 gibba003 bash[31385]: cluster 2021-03-10T15:13:32.693253+0000 mgr.gibba043.dnkmem (mgr.34373) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:34.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:33 gibba003 bash[32348]: cluster 2021-03-10T15:13:32.693253+0000 mgr.gibba043.dnkmem (mgr.34373) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:33 gibba043 bash[24019]: cluster 2021-03-10T15:13:32.693253+0000 mgr.gibba043.dnkmem (mgr.34373) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:35 gibba003 bash[31385]: cluster 2021-03-10T15:13:34.694664+0000 mgr.gibba043.dnkmem (mgr.34373) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:35 gibba003 bash[32348]: cluster 2021-03-10T15:13:34.694664+0000 mgr.gibba043.dnkmem (mgr.34373) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:35 gibba043 bash[24019]: cluster 2021-03-10T15:13:34.694664+0000 mgr.gibba043.dnkmem (mgr.34373) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:37 gibba043 bash[24019]: cluster 2021-03-10T15:13:36.695832+0000 mgr.gibba043.dnkmem (mgr.34373) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:37 gibba003 bash[31385]: cluster 2021-03-10T15:13:36.695832+0000 mgr.gibba043.dnkmem (mgr.34373) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:38.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:37 gibba003 bash[32348]: cluster 2021-03-10T15:13:36.695832+0000 mgr.gibba043.dnkmem (mgr.34373) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:39 gibba043 bash[24019]: cluster 2021-03-10T15:13:38.697432+0000 mgr.gibba043.dnkmem (mgr.34373) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:39 gibba003 bash[31385]: cluster 2021-03-10T15:13:38.697432+0000 mgr.gibba043.dnkmem (mgr.34373) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:39 gibba003 bash[32348]: cluster 2021-03-10T15:13:38.697432+0000 mgr.gibba043.dnkmem (mgr.34373) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:41 gibba043 bash[24019]: cluster 2021-03-10T15:13:40.699186+0000 mgr.gibba043.dnkmem (mgr.34373) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:41 gibba003 bash[31385]: cluster 2021-03-10T15:13:40.699186+0000 mgr.gibba043.dnkmem (mgr.34373) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:41 gibba003 bash[32348]: cluster 2021-03-10T15:13:40.699186+0000 mgr.gibba043.dnkmem (mgr.34373) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:42 gibba003 bash[31385]: cephadm 2021-03-10T15:13:41.692482+0000 mgr.gibba043.dnkmem (mgr.34373) 4381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:42 gibba003 bash[32348]: cephadm 2021-03-10T15:13:41.692482+0000 mgr.gibba043.dnkmem (mgr.34373) 4381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:42 gibba043 bash[24019]: cephadm 2021-03-10T15:13:41.692482+0000 mgr.gibba043.dnkmem (mgr.34373) 4381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:44.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:43 gibba003 bash[31385]: cluster 2021-03-10T15:13:42.700308+0000 mgr.gibba043.dnkmem (mgr.34373) 4382 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:44.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:43 gibba003 bash[32348]: cluster 2021-03-10T15:13:42.700308+0000 mgr.gibba043.dnkmem (mgr.34373) 4382 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:43 gibba043 bash[24019]: cluster 2021-03-10T15:13:42.700308+0000 mgr.gibba043.dnkmem (mgr.34373) 4382 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:45 gibba003 bash[31385]: cluster 2021-03-10T15:13:44.701822+0000 mgr.gibba043.dnkmem (mgr.34373) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:45 gibba003 bash[32348]: cluster 2021-03-10T15:13:44.701822+0000 mgr.gibba043.dnkmem (mgr.34373) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:45 gibba043 bash[24019]: cluster 2021-03-10T15:13:44.701822+0000 mgr.gibba043.dnkmem (mgr.34373) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:47 gibba043 bash[24019]: cluster 2021-03-10T15:13:46.703320+0000 mgr.gibba043.dnkmem (mgr.34373) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:47 gibba003 bash[31385]: cluster 2021-03-10T15:13:46.703320+0000 mgr.gibba043.dnkmem (mgr.34373) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:47 gibba003 bash[32348]: cluster 2021-03-10T15:13:46.703320+0000 mgr.gibba043.dnkmem (mgr.34373) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:49 gibba003 bash[31385]: cluster 2021-03-10T15:13:48.704669+0000 mgr.gibba043.dnkmem (mgr.34373) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:49 gibba003 bash[32348]: cluster 2021-03-10T15:13:48.704669+0000 mgr.gibba043.dnkmem (mgr.34373) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:49 gibba043 bash[24019]: cluster 2021-03-10T15:13:48.704669+0000 mgr.gibba043.dnkmem (mgr.34373) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:51 gibba003 bash[31385]: cluster 2021-03-10T15:13:50.705966+0000 mgr.gibba043.dnkmem (mgr.34373) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:52.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:51 gibba003 bash[32348]: cluster 2021-03-10T15:13:50.705966+0000 mgr.gibba043.dnkmem (mgr.34373) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:51 gibba043 bash[24019]: cluster 2021-03-10T15:13:50.705966+0000 mgr.gibba043.dnkmem (mgr.34373) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:54.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:53 gibba003 bash[31385]: cluster 2021-03-10T15:13:52.707376+0000 mgr.gibba043.dnkmem (mgr.34373) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:54.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:53 gibba003 bash[32348]: cluster 2021-03-10T15:13:52.707376+0000 mgr.gibba043.dnkmem (mgr.34373) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:53 gibba043 bash[24019]: cluster 2021-03-10T15:13:52.707376+0000 mgr.gibba043.dnkmem (mgr.34373) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:55 gibba003 bash[31385]: cluster 2021-03-10T15:13:54.709096+0000 mgr.gibba043.dnkmem (mgr.34373) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:55 gibba003 bash[32348]: cluster 2021-03-10T15:13:54.709096+0000 mgr.gibba043.dnkmem (mgr.34373) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:55 gibba043 bash[24019]: cluster 2021-03-10T15:13:54.709096+0000 mgr.gibba043.dnkmem (mgr.34373) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: cluster 2021-03-10T15:13:56.710615+0000 mgr.gibba043.dnkmem (mgr.34373) 4389 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:56.897089+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: cephadm 2021-03-10T15:13:56.897167+0000 mgr.gibba043.dnkmem (mgr.34373) 4390 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:13:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: cephadm 2021-03-10T15:13:56.904925+0000 mgr.gibba043.dnkmem (mgr.34373) 4391 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:13:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:56.904983+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.099759+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.103329+0000 mon.c (mon.1) 1158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.105186+0000 mon.c (mon.1) 1159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.106592+0000 mon.c (mon.1) 1160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.108014+0000 mon.c (mon.1) 1161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.110793+0000 mon.c (mon.1) 1162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[31385]: audit 2021-03-10T15:13:57.112206+0000 mon.c (mon.1) 1163 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: cluster 2021-03-10T15:13:56.710615+0000 mgr.gibba043.dnkmem (mgr.34373) 4389 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:56.897089+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: cephadm 2021-03-10T15:13:56.897167+0000 mgr.gibba043.dnkmem (mgr.34373) 4390 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:13:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: cephadm 2021-03-10T15:13:56.904925+0000 mgr.gibba043.dnkmem (mgr.34373) 4391 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:13:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:56.904983+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.099759+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.103329+0000 mon.c (mon.1) 1158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.105186+0000 mon.c (mon.1) 1159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.106592+0000 mon.c (mon.1) 1160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.108014+0000 mon.c (mon.1) 1161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.110793+0000 mon.c (mon.1) 1162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:57 gibba003 bash[32348]: audit 2021-03-10T15:13:57.112206+0000 mon.c (mon.1) 1163 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: cluster 2021-03-10T15:13:56.710615+0000 mgr.gibba043.dnkmem (mgr.34373) 4389 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:56.897089+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: cephadm 2021-03-10T15:13:56.897167+0000 mgr.gibba043.dnkmem (mgr.34373) 4390 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:13:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: cephadm 2021-03-10T15:13:56.904925+0000 mgr.gibba043.dnkmem (mgr.34373) 4391 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:13:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:56.904983+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.099759+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:13:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.103329+0000 mon.c (mon.1) 1158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.105186+0000 mon.c (mon.1) 1159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.106592+0000 mon.c (mon.1) 1160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.108014+0000 mon.c (mon.1) 1161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.110793+0000 mon.c (mon.1) 1162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:58.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:57 gibba043 bash[24019]: audit 2021-03-10T15:13:57.112206+0000 mon.c (mon.1) 1163 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.101699+0000 mgr.gibba043.dnkmem (mgr.34373) 4392 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.103568+0000 mgr.gibba043.dnkmem (mgr.34373) 4393 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.105100+0000 mgr.gibba043.dnkmem (mgr.34373) 4394 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.105136+0000 mgr.gibba043.dnkmem (mgr.34373) 4395 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.106451+0000 mgr.gibba043.dnkmem (mgr.34373) 4396 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.106486+0000 mgr.gibba043.dnkmem (mgr.34373) 4397 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.107852+0000 mgr.gibba043.dnkmem (mgr.34373) 4398 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.109295+0000 mgr.gibba043.dnkmem (mgr.34373) 4399 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.109326+0000 mgr.gibba043.dnkmem (mgr.34373) 4400 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.110538+0000 mgr.gibba043.dnkmem (mgr.34373) 4401 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.110846+0000 mgr.gibba043.dnkmem (mgr.34373) 4402 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.112169+0000 mgr.gibba043.dnkmem (mgr.34373) 4403 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.112202+0000 mgr.gibba043.dnkmem (mgr.34373) 4404 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[31385]: cephadm 2021-03-10T15:13:57.112322+0000 mgr.gibba043.dnkmem (mgr.34373) 4405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.101699+0000 mgr.gibba043.dnkmem (mgr.34373) 4392 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.103568+0000 mgr.gibba043.dnkmem (mgr.34373) 4393 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.105100+0000 mgr.gibba043.dnkmem (mgr.34373) 4394 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.105136+0000 mgr.gibba043.dnkmem (mgr.34373) 4395 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.106451+0000 mgr.gibba043.dnkmem (mgr.34373) 4396 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.106486+0000 mgr.gibba043.dnkmem (mgr.34373) 4397 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.107852+0000 mgr.gibba043.dnkmem (mgr.34373) 4398 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.109295+0000 mgr.gibba043.dnkmem (mgr.34373) 4399 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.109326+0000 mgr.gibba043.dnkmem (mgr.34373) 4400 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.110538+0000 mgr.gibba043.dnkmem (mgr.34373) 4401 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.110846+0000 mgr.gibba043.dnkmem (mgr.34373) 4402 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.112169+0000 mgr.gibba043.dnkmem (mgr.34373) 4403 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.112202+0000 mgr.gibba043.dnkmem (mgr.34373) 4404 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:58 gibba003 bash[32348]: cephadm 2021-03-10T15:13:57.112322+0000 mgr.gibba043.dnkmem (mgr.34373) 4405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:59.270 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:13:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.101699+0000 mgr.gibba043.dnkmem (mgr.34373) 4392 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.103568+0000 mgr.gibba043.dnkmem (mgr.34373) 4393 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.105100+0000 mgr.gibba043.dnkmem (mgr.34373) 4394 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.105136+0000 mgr.gibba043.dnkmem (mgr.34373) 4395 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.106451+0000 mgr.gibba043.dnkmem (mgr.34373) 4396 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.106486+0000 mgr.gibba043.dnkmem (mgr.34373) 4397 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.107852+0000 mgr.gibba043.dnkmem (mgr.34373) 4398 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.109295+0000 mgr.gibba043.dnkmem (mgr.34373) 4399 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.109326+0000 mgr.gibba043.dnkmem (mgr.34373) 4400 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.110538+0000 mgr.gibba043.dnkmem (mgr.34373) 4401 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.110846+0000 mgr.gibba043.dnkmem (mgr.34373) 4402 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.112169+0000 mgr.gibba043.dnkmem (mgr.34373) 4403 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.112202+0000 mgr.gibba043.dnkmem (mgr.34373) 4404 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:58 gibba043 bash[24019]: cephadm 2021-03-10T15:13:57.112322+0000 mgr.gibba043.dnkmem (mgr.34373) 4405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:13:59.499 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:13:59.499 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (82m) 7m ago 87m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:13:59.500 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (87m) 6m ago 87m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:13:59.500 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (82m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:13:59.500 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:13:59.500 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:13:59.501 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (81m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:13:59.501 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:13:59.501 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (81m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:13:59.501 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (87m) 7m ago 87m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:13:59.501 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (87m) 6m ago 87m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:13:59.502 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:13:59.502 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:13:59.502 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:13:59.502 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:13:59.503 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:13:59.503 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:13:59.503 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:13:59.504 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (77m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:13:59.504 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (87m) 6m ago 87m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:13:59.504 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 85m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:13:59.748 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:13:59.748 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:13:59.748 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:59.749 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:13:59.749 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:13:59.749 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:59.749 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:13:59.750 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:13:59.750 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:13:59.750 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:13:59.750 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:13:59.750 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:13:59.751 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:13:59.751 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:13:59.751 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:14:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:59 gibba003 bash[31385]: cluster 2021-03-10T15:13:58.712388+0000 mgr.gibba043.dnkmem (mgr.34373) 4406 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:13:59 gibba003 bash[31385]: audit 2021-03-10T15:13:59.746012+0000 mon.a (mon.0) 1143 : audit [DBG] from='client.? 172.21.2.103:0/1411721465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:59 gibba003 bash[32348]: cluster 2021-03-10T15:13:58.712388+0000 mgr.gibba043.dnkmem (mgr.34373) 4406 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:13:59 gibba003 bash[32348]: audit 2021-03-10T15:13:59.746012+0000 mon.a (mon.0) 1143 : audit [DBG] from='client.? 172.21.2.103:0/1411721465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:59 gibba043 bash[24019]: cluster 2021-03-10T15:13:58.712388+0000 mgr.gibba043.dnkmem (mgr.34373) 4406 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:13:59 gibba043 bash[24019]: audit 2021-03-10T15:13:59.746012+0000 mon.a (mon.0) 1143 : audit [DBG] from='client.? 172.21.2.103:0/1411721465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:00 gibba003 bash[31385]: audit 2021-03-10T15:13:59.258734+0000 mgr.gibba043.dnkmem (mgr.34373) 4407 : audit [DBG] from='client.47004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:01.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:00 gibba003 bash[31385]: audit 2021-03-10T15:13:59.483979+0000 mgr.gibba043.dnkmem (mgr.34373) 4408 : audit [DBG] from='client.47010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:00 gibba003 bash[32348]: audit 2021-03-10T15:13:59.258734+0000 mgr.gibba043.dnkmem (mgr.34373) 4407 : audit [DBG] from='client.47004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:00 gibba003 bash[32348]: audit 2021-03-10T15:13:59.483979+0000 mgr.gibba043.dnkmem (mgr.34373) 4408 : audit [DBG] from='client.47010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:00 gibba043 bash[24019]: audit 2021-03-10T15:13:59.258734+0000 mgr.gibba043.dnkmem (mgr.34373) 4407 : audit [DBG] from='client.47004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:00 gibba043 bash[24019]: audit 2021-03-10T15:13:59.483979+0000 mgr.gibba043.dnkmem (mgr.34373) 4408 : audit [DBG] from='client.47010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:01 gibba003 bash[31385]: cluster 2021-03-10T15:14:00.713717+0000 mgr.gibba043.dnkmem (mgr.34373) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:01 gibba003 bash[32348]: cluster 2021-03-10T15:14:00.713717+0000 mgr.gibba043.dnkmem (mgr.34373) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:01 gibba043 bash[24019]: cluster 2021-03-10T15:14:00.713717+0000 mgr.gibba043.dnkmem (mgr.34373) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:02 gibba043 bash[24019]: cluster 2021-03-10T15:14:02.715205+0000 mgr.gibba043.dnkmem (mgr.34373) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:02 gibba003 bash[31385]: cluster 2021-03-10T15:14:02.715205+0000 mgr.gibba043.dnkmem (mgr.34373) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:02 gibba003 bash[32348]: cluster 2021-03-10T15:14:02.715205+0000 mgr.gibba043.dnkmem (mgr.34373) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:05 gibba003 bash[31385]: cluster 2021-03-10T15:14:04.716884+0000 mgr.gibba043.dnkmem (mgr.34373) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:05 gibba003 bash[32348]: cluster 2021-03-10T15:14:04.716884+0000 mgr.gibba043.dnkmem (mgr.34373) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:05 gibba043 bash[24019]: cluster 2021-03-10T15:14:04.716884+0000 mgr.gibba043.dnkmem (mgr.34373) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:07 gibba003 bash[31385]: cluster 2021-03-10T15:14:06.718216+0000 mgr.gibba043.dnkmem (mgr.34373) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:07 gibba003 bash[32348]: cluster 2021-03-10T15:14:06.718216+0000 mgr.gibba043.dnkmem (mgr.34373) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:07 gibba043 bash[24019]: cluster 2021-03-10T15:14:06.718216+0000 mgr.gibba043.dnkmem (mgr.34373) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:09 gibba003 bash[31385]: cluster 2021-03-10T15:14:08.719931+0000 mgr.gibba043.dnkmem (mgr.34373) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:09 gibba003 bash[32348]: cluster 2021-03-10T15:14:08.719931+0000 mgr.gibba043.dnkmem (mgr.34373) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:09 gibba043 bash[24019]: cluster 2021-03-10T15:14:08.719931+0000 mgr.gibba043.dnkmem (mgr.34373) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.121 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:11 gibba043 bash[24019]: cluster 2021-03-10T15:14:10.721348+0000 mgr.gibba043.dnkmem (mgr.34373) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:11 gibba003 bash[31385]: cluster 2021-03-10T15:14:10.721348+0000 mgr.gibba043.dnkmem (mgr.34373) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:11 gibba003 bash[32348]: cluster 2021-03-10T15:14:10.721348+0000 mgr.gibba043.dnkmem (mgr.34373) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: cephadm 2021-03-10T15:14:12.118449+0000 mgr.gibba043.dnkmem (mgr.34373) 4415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: cluster 2021-03-10T15:14:12.722856+0000 mgr.gibba043.dnkmem (mgr.34373) 4416 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.236054+0000 mon.c (mon.1) 1164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.237262+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.335794+0000 mon.c (mon.1) 1165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.337027+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.389760+0000 mon.c (mon.1) 1166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:14:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.390541+0000 mon.c (mon.1) 1167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.391119+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:14:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.391285+0000 mon.c (mon.1) 1168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.391980+0000 mon.c (mon.1) 1169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.393274+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.394785+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:14.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[31385]: audit 2021-03-10T15:14:13.396089+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: cephadm 2021-03-10T15:14:12.118449+0000 mgr.gibba043.dnkmem (mgr.34373) 4415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: cluster 2021-03-10T15:14:12.722856+0000 mgr.gibba043.dnkmem (mgr.34373) 4416 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.236054+0000 mon.c (mon.1) 1164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.237262+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.335794+0000 mon.c (mon.1) 1165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.337027+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.389760+0000 mon.c (mon.1) 1166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:14:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.390541+0000 mon.c (mon.1) 1167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.391119+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:14:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.391285+0000 mon.c (mon.1) 1168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.391980+0000 mon.c (mon.1) 1169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.393274+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.394785+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:14.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:13 gibba003 bash[32348]: audit 2021-03-10T15:14:13.396089+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: cephadm 2021-03-10T15:14:12.118449+0000 mgr.gibba043.dnkmem (mgr.34373) 4415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: cluster 2021-03-10T15:14:12.722856+0000 mgr.gibba043.dnkmem (mgr.34373) 4416 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.236054+0000 mon.c (mon.1) 1164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.237262+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.335794+0000 mon.c (mon.1) 1165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.337027+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.389760+0000 mon.c (mon.1) 1166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:14:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.390541+0000 mon.c (mon.1) 1167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.391119+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:14:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.391285+0000 mon.c (mon.1) 1168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.391980+0000 mon.c (mon.1) 1169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.393274+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:14:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.394785+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:14.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:13 gibba043 bash[24019]: audit 2021-03-10T15:14:13.396089+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:14:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:15 gibba003 bash[31385]: cluster 2021-03-10T15:14:14.724485+0000 mgr.gibba043.dnkmem (mgr.34373) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:15 gibba003 bash[32348]: cluster 2021-03-10T15:14:14.724485+0000 mgr.gibba043.dnkmem (mgr.34373) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:15 gibba043 bash[24019]: cluster 2021-03-10T15:14:14.724485+0000 mgr.gibba043.dnkmem (mgr.34373) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:17 gibba003 bash[31385]: cluster 2021-03-10T15:14:16.726113+0000 mgr.gibba043.dnkmem (mgr.34373) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:18.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:17 gibba003 bash[32348]: cluster 2021-03-10T15:14:16.726113+0000 mgr.gibba043.dnkmem (mgr.34373) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:17 gibba043 bash[24019]: cluster 2021-03-10T15:14:16.726113+0000 mgr.gibba043.dnkmem (mgr.34373) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:19 gibba003 bash[31385]: cluster 2021-03-10T15:14:18.727439+0000 mgr.gibba043.dnkmem (mgr.34373) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:19 gibba003 bash[32348]: cluster 2021-03-10T15:14:18.727439+0000 mgr.gibba043.dnkmem (mgr.34373) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:20.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:19 gibba043 bash[24019]: cluster 2021-03-10T15:14:18.727439+0000 mgr.gibba043.dnkmem (mgr.34373) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:21 gibba003 bash[31385]: cluster 2021-03-10T15:14:20.729096+0000 mgr.gibba043.dnkmem (mgr.34373) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:21 gibba003 bash[32348]: cluster 2021-03-10T15:14:20.729096+0000 mgr.gibba043.dnkmem (mgr.34373) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:21 gibba043 bash[24019]: cluster 2021-03-10T15:14:20.729096+0000 mgr.gibba043.dnkmem (mgr.34373) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:23 gibba003 bash[31385]: cluster 2021-03-10T15:14:22.730479+0000 mgr.gibba043.dnkmem (mgr.34373) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:24.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:23 gibba003 bash[32348]: cluster 2021-03-10T15:14:22.730479+0000 mgr.gibba043.dnkmem (mgr.34373) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:23 gibba043 bash[24019]: cluster 2021-03-10T15:14:22.730479+0000 mgr.gibba043.dnkmem (mgr.34373) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:25 gibba003 bash[31385]: cluster 2021-03-10T15:14:24.732137+0000 mgr.gibba043.dnkmem (mgr.34373) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:25 gibba003 bash[32348]: cluster 2021-03-10T15:14:24.732137+0000 mgr.gibba043.dnkmem (mgr.34373) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:25 gibba043 bash[24019]: cluster 2021-03-10T15:14:24.732137+0000 mgr.gibba043.dnkmem (mgr.34373) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:27 gibba003 bash[31385]: cluster 2021-03-10T15:14:26.733666+0000 mgr.gibba043.dnkmem (mgr.34373) 4423 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:27 gibba003 bash[32348]: cluster 2021-03-10T15:14:26.733666+0000 mgr.gibba043.dnkmem (mgr.34373) 4423 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:27 gibba043 bash[24019]: cluster 2021-03-10T15:14:26.733666+0000 mgr.gibba043.dnkmem (mgr.34373) 4423 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:28 gibba003 bash[31385]: cephadm 2021-03-10T15:14:27.134495+0000 mgr.gibba043.dnkmem (mgr.34373) 4424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:28 gibba003 bash[32348]: cephadm 2021-03-10T15:14:27.134495+0000 mgr.gibba043.dnkmem (mgr.34373) 4424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:28 gibba043 bash[24019]: cephadm 2021-03-10T15:14:27.134495+0000 mgr.gibba043.dnkmem (mgr.34373) 4424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:29.993 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:14:30.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:29 gibba003 bash[31385]: cluster 2021-03-10T15:14:28.735334+0000 mgr.gibba043.dnkmem (mgr.34373) 4425 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:30.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:29 gibba003 bash[32348]: cluster 2021-03-10T15:14:28.735334+0000 mgr.gibba043.dnkmem (mgr.34373) 4425 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:30.227 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:14:30.228 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (82m) 7m ago 88m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:14:30.228 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (87m) 6m ago 87m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:14:30.228 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:14:30.228 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:14:30.229 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:14:30.229 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:14:30.229 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:14:30.229 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:14:30.230 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (88m) 7m ago 88m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:14:30.230 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (88m) 6m ago 88m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:14:30.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (81m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:14:30.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (80m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:14:30.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:14:30.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:14:30.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:14:30.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:14:30.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:14:30.232 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:14:30.232 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (87m) 6m ago 88m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:14:30.232 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 86m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:14:30.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:29 gibba043 bash[24019]: cluster 2021-03-10T15:14:28.735334+0000 mgr.gibba043.dnkmem (mgr.34373) 4425 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:30.477 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:14:30.477 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:14:30.478 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:30.478 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:14:30.478 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:14:30.478 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:30.479 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:14:30.479 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:14:30.479 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:14:30.479 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:14:30.480 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:14:30.480 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:14:30.480 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:14:30.480 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:14:30.480 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:14:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:30 gibba003 bash[31385]: audit 2021-03-10T15:14:30.475087+0000 mon.a (mon.0) 1150 : audit [DBG] from='client.? 172.21.2.103:0/2551919319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:31.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:30 gibba003 bash[32348]: audit 2021-03-10T15:14:30.475087+0000 mon.a (mon.0) 1150 : audit [DBG] from='client.? 172.21.2.103:0/2551919319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:30 gibba043 bash[24019]: audit 2021-03-10T15:14:30.475087+0000 mon.a (mon.0) 1150 : audit [DBG] from='client.? 172.21.2.103:0/2551919319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:31 gibba003 bash[31385]: audit 2021-03-10T15:14:29.982436+0000 mgr.gibba043.dnkmem (mgr.34373) 4426 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:31 gibba003 bash[31385]: audit 2021-03-10T15:14:30.212538+0000 mgr.gibba043.dnkmem (mgr.34373) 4427 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:31 gibba003 bash[31385]: cluster 2021-03-10T15:14:30.736877+0000 mgr.gibba043.dnkmem (mgr.34373) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:32.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:31 gibba003 bash[32348]: audit 2021-03-10T15:14:29.982436+0000 mgr.gibba043.dnkmem (mgr.34373) 4426 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:32.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:31 gibba003 bash[32348]: audit 2021-03-10T15:14:30.212538+0000 mgr.gibba043.dnkmem (mgr.34373) 4427 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:32.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:31 gibba003 bash[32348]: cluster 2021-03-10T15:14:30.736877+0000 mgr.gibba043.dnkmem (mgr.34373) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:31 gibba043 bash[24019]: audit 2021-03-10T15:14:29.982436+0000 mgr.gibba043.dnkmem (mgr.34373) 4426 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:31 gibba043 bash[24019]: audit 2021-03-10T15:14:30.212538+0000 mgr.gibba043.dnkmem (mgr.34373) 4427 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:31 gibba043 bash[24019]: cluster 2021-03-10T15:14:30.736877+0000 mgr.gibba043.dnkmem (mgr.34373) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:33 gibba003 bash[31385]: cluster 2021-03-10T15:14:32.738080+0000 mgr.gibba043.dnkmem (mgr.34373) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:34.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:33 gibba003 bash[32348]: cluster 2021-03-10T15:14:32.738080+0000 mgr.gibba043.dnkmem (mgr.34373) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:33 gibba043 bash[24019]: cluster 2021-03-10T15:14:32.738080+0000 mgr.gibba043.dnkmem (mgr.34373) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:35 gibba003 bash[31385]: cluster 2021-03-10T15:14:34.739714+0000 mgr.gibba043.dnkmem (mgr.34373) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:35 gibba003 bash[32348]: cluster 2021-03-10T15:14:34.739714+0000 mgr.gibba043.dnkmem (mgr.34373) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:35 gibba043 bash[24019]: cluster 2021-03-10T15:14:34.739714+0000 mgr.gibba043.dnkmem (mgr.34373) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:37 gibba003 bash[31385]: cluster 2021-03-10T15:14:36.741336+0000 mgr.gibba043.dnkmem (mgr.34373) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:37 gibba003 bash[32348]: cluster 2021-03-10T15:14:36.741336+0000 mgr.gibba043.dnkmem (mgr.34373) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:37 gibba043 bash[24019]: cluster 2021-03-10T15:14:36.741336+0000 mgr.gibba043.dnkmem (mgr.34373) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:39 gibba003 bash[31385]: cluster 2021-03-10T15:14:38.743004+0000 mgr.gibba043.dnkmem (mgr.34373) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:39 gibba003 bash[32348]: cluster 2021-03-10T15:14:38.743004+0000 mgr.gibba043.dnkmem (mgr.34373) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:39 gibba043 bash[24019]: cluster 2021-03-10T15:14:38.743004+0000 mgr.gibba043.dnkmem (mgr.34373) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.154 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:41 gibba043 bash[24019]: cluster 2021-03-10T15:14:40.744725+0000 mgr.gibba043.dnkmem (mgr.34373) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:41 gibba003 bash[31385]: cluster 2021-03-10T15:14:40.744725+0000 mgr.gibba043.dnkmem (mgr.34373) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:41 gibba003 bash[32348]: cluster 2021-03-10T15:14:40.744725+0000 mgr.gibba043.dnkmem (mgr.34373) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:44.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:43 gibba003 bash[31385]: cephadm 2021-03-10T15:14:42.150599+0000 mgr.gibba043.dnkmem (mgr.34373) 4434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:44.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:43 gibba003 bash[31385]: cluster 2021-03-10T15:14:42.746190+0000 mgr.gibba043.dnkmem (mgr.34373) 4435 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:44.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:43 gibba003 bash[32348]: cephadm 2021-03-10T15:14:42.150599+0000 mgr.gibba043.dnkmem (mgr.34373) 4434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:44.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:43 gibba003 bash[32348]: cluster 2021-03-10T15:14:42.746190+0000 mgr.gibba043.dnkmem (mgr.34373) 4435 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:43 gibba043 bash[24019]: cephadm 2021-03-10T15:14:42.150599+0000 mgr.gibba043.dnkmem (mgr.34373) 4434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:43 gibba043 bash[24019]: cluster 2021-03-10T15:14:42.746190+0000 mgr.gibba043.dnkmem (mgr.34373) 4435 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:45 gibba003 bash[31385]: cluster 2021-03-10T15:14:44.747874+0000 mgr.gibba043.dnkmem (mgr.34373) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:45.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:45 gibba003 bash[32348]: cluster 2021-03-10T15:14:44.747874+0000 mgr.gibba043.dnkmem (mgr.34373) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:45 gibba043 bash[24019]: cluster 2021-03-10T15:14:44.747874+0000 mgr.gibba043.dnkmem (mgr.34373) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:47 gibba003 bash[31385]: cluster 2021-03-10T15:14:46.749539+0000 mgr.gibba043.dnkmem (mgr.34373) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:48.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:47 gibba003 bash[32348]: cluster 2021-03-10T15:14:46.749539+0000 mgr.gibba043.dnkmem (mgr.34373) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:47 gibba043 bash[24019]: cluster 2021-03-10T15:14:46.749539+0000 mgr.gibba043.dnkmem (mgr.34373) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:49 gibba003 bash[31385]: cluster 2021-03-10T15:14:48.751118+0000 mgr.gibba043.dnkmem (mgr.34373) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:50.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:49 gibba003 bash[32348]: cluster 2021-03-10T15:14:48.751118+0000 mgr.gibba043.dnkmem (mgr.34373) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:49 gibba043 bash[24019]: cluster 2021-03-10T15:14:48.751118+0000 mgr.gibba043.dnkmem (mgr.34373) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:51 gibba003 bash[31385]: cluster 2021-03-10T15:14:50.752808+0000 mgr.gibba043.dnkmem (mgr.34373) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:52.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:51 gibba003 bash[32348]: cluster 2021-03-10T15:14:50.752808+0000 mgr.gibba043.dnkmem (mgr.34373) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:51 gibba043 bash[24019]: cluster 2021-03-10T15:14:50.752808+0000 mgr.gibba043.dnkmem (mgr.34373) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:53 gibba003 bash[31385]: cluster 2021-03-10T15:14:52.754244+0000 mgr.gibba043.dnkmem (mgr.34373) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:53 gibba003 bash[32348]: cluster 2021-03-10T15:14:52.754244+0000 mgr.gibba043.dnkmem (mgr.34373) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:53 gibba043 bash[24019]: cluster 2021-03-10T15:14:52.754244+0000 mgr.gibba043.dnkmem (mgr.34373) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:55 gibba003 bash[31385]: cluster 2021-03-10T15:14:54.755914+0000 mgr.gibba043.dnkmem (mgr.34373) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:55 gibba003 bash[32348]: cluster 2021-03-10T15:14:54.755914+0000 mgr.gibba043.dnkmem (mgr.34373) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:55 gibba043 bash[24019]: cluster 2021-03-10T15:14:54.755914+0000 mgr.gibba043.dnkmem (mgr.34373) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: cluster 2021-03-10T15:14:56.757306+0000 mgr.gibba043.dnkmem (mgr.34373) 4442 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.356687+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:14:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.360262+0000 mon.c (mon.1) 1170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.361631+0000 mon.c (mon.1) 1171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.362935+0000 mon.c (mon.1) 1172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.364705+0000 mon.c (mon.1) 1173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.367979+0000 mon.c (mon.1) 1174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[31385]: audit 2021-03-10T15:14:57.369561+0000 mon.c (mon.1) 1175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: cluster 2021-03-10T15:14:56.757306+0000 mgr.gibba043.dnkmem (mgr.34373) 4442 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.356687+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:14:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.360262+0000 mon.c (mon.1) 1170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.361631+0000 mon.c (mon.1) 1171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.362935+0000 mon.c (mon.1) 1172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.364705+0000 mon.c (mon.1) 1173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.367979+0000 mon.c (mon.1) 1174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:57 gibba003 bash[32348]: audit 2021-03-10T15:14:57.369561+0000 mon.c (mon.1) 1175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: cluster 2021-03-10T15:14:56.757306+0000 mgr.gibba043.dnkmem (mgr.34373) 4442 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.356687+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:14:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.360262+0000 mon.c (mon.1) 1170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.361631+0000 mon.c (mon.1) 1171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.362935+0000 mon.c (mon.1) 1172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.364705+0000 mon.c (mon.1) 1173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.367979+0000 mon.c (mon.1) 1174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:57 gibba043 bash[24019]: audit 2021-03-10T15:14:57.369561+0000 mon.c (mon.1) 1175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.161701+0000 mgr.gibba043.dnkmem (mgr.34373) 4443 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:14:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.163177+0000 mgr.gibba043.dnkmem (mgr.34373) 4444 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:14:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.358619+0000 mgr.gibba043.dnkmem (mgr.34373) 4445 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.360186+0000 mgr.gibba043.dnkmem (mgr.34373) 4446 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.361452+0000 mgr.gibba043.dnkmem (mgr.34373) 4447 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.361490+0000 mgr.gibba043.dnkmem (mgr.34373) 4448 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.363235+0000 mgr.gibba043.dnkmem (mgr.34373) 4449 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.363273+0000 mgr.gibba043.dnkmem (mgr.34373) 4450 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.364606+0000 mgr.gibba043.dnkmem (mgr.34373) 4451 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.366280+0000 mgr.gibba043.dnkmem (mgr.34373) 4452 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.366318+0000 mgr.gibba043.dnkmem (mgr.34373) 4453 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.367880+0000 mgr.gibba043.dnkmem (mgr.34373) 4454 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.368198+0000 mgr.gibba043.dnkmem (mgr.34373) 4455 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.369686+0000 mgr.gibba043.dnkmem (mgr.34373) 4456 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.369725+0000 mgr.gibba043.dnkmem (mgr.34373) 4457 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[31385]: cephadm 2021-03-10T15:14:57.369830+0000 mgr.gibba043.dnkmem (mgr.34373) 4458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.161701+0000 mgr.gibba043.dnkmem (mgr.34373) 4443 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:14:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.163177+0000 mgr.gibba043.dnkmem (mgr.34373) 4444 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:14:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.358619+0000 mgr.gibba043.dnkmem (mgr.34373) 4445 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.360186+0000 mgr.gibba043.dnkmem (mgr.34373) 4446 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.361452+0000 mgr.gibba043.dnkmem (mgr.34373) 4447 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.361490+0000 mgr.gibba043.dnkmem (mgr.34373) 4448 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.363235+0000 mgr.gibba043.dnkmem (mgr.34373) 4449 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.363273+0000 mgr.gibba043.dnkmem (mgr.34373) 4450 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.364606+0000 mgr.gibba043.dnkmem (mgr.34373) 4451 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.366280+0000 mgr.gibba043.dnkmem (mgr.34373) 4452 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.366318+0000 mgr.gibba043.dnkmem (mgr.34373) 4453 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.367880+0000 mgr.gibba043.dnkmem (mgr.34373) 4454 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.368198+0000 mgr.gibba043.dnkmem (mgr.34373) 4455 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.369686+0000 mgr.gibba043.dnkmem (mgr.34373) 4456 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.369725+0000 mgr.gibba043.dnkmem (mgr.34373) 4457 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:58 gibba003 bash[32348]: cephadm 2021-03-10T15:14:57.369830+0000 mgr.gibba043.dnkmem (mgr.34373) 4458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:14:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.161701+0000 mgr.gibba043.dnkmem (mgr.34373) 4443 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:14:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.163177+0000 mgr.gibba043.dnkmem (mgr.34373) 4444 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:14:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.358619+0000 mgr.gibba043.dnkmem (mgr.34373) 4445 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.360186+0000 mgr.gibba043.dnkmem (mgr.34373) 4446 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.361452+0000 mgr.gibba043.dnkmem (mgr.34373) 4447 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.361490+0000 mgr.gibba043.dnkmem (mgr.34373) 4448 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.363235+0000 mgr.gibba043.dnkmem (mgr.34373) 4449 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.363273+0000 mgr.gibba043.dnkmem (mgr.34373) 4450 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.364606+0000 mgr.gibba043.dnkmem (mgr.34373) 4451 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.366280+0000 mgr.gibba043.dnkmem (mgr.34373) 4452 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.366318+0000 mgr.gibba043.dnkmem (mgr.34373) 4453 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.367880+0000 mgr.gibba043.dnkmem (mgr.34373) 4454 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.368198+0000 mgr.gibba043.dnkmem (mgr.34373) 4455 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.369686+0000 mgr.gibba043.dnkmem (mgr.34373) 4456 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.369725+0000 mgr.gibba043.dnkmem (mgr.34373) 4457 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:58 gibba043 bash[24019]: cephadm 2021-03-10T15:14:57.369830+0000 mgr.gibba043.dnkmem (mgr.34373) 4458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:14:59 gibba003 bash[31385]: cluster 2021-03-10T15:14:58.758805+0000 mgr.gibba043.dnkmem (mgr.34373) 4459 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:00.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:14:59 gibba003 bash[32348]: cluster 2021-03-10T15:14:58.758805+0000 mgr.gibba043.dnkmem (mgr.34373) 4459 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:14:59 gibba043 bash[24019]: cluster 2021-03-10T15:14:58.758805+0000 mgr.gibba043.dnkmem (mgr.34373) 4459 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:00.725 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:15:00.953 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:15:00.954 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (83m) 8m ago 88m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:15:00.954 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (88m) 7m ago 88m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:15:00.954 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (83m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:15:00.955 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:15:00.955 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:15:00.955 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (82m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:15:00.955 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:15:00.955 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (82m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:15:00.956 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (88m) 8m ago 88m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:15:00.956 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (88m) 7m ago 88m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:15:00.956 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:15:00.956 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:15:00.957 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:15:00.957 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:15:00.957 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:15:00.957 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:15:00.957 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:15:00.958 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (78m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:15:00.958 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (88m) 7m ago 88m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:15:00.958 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 86m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:15:01.202 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:15:01.203 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:15:01.203 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:01.204 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:15:01.204 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:15:01.205 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:01.205 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:15:01.206 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:15:01.206 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:15:01.207 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:15:01.207 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:15:01.207 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:15:01.208 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:15:01.208 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:15:01.209 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:15:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[31385]: audit 2021-03-10T15:15:00.713326+0000 mgr.gibba043.dnkmem (mgr.34373) 4460 : audit [DBG] from='client.47040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[31385]: cluster 2021-03-10T15:15:00.760363+0000 mgr.gibba043.dnkmem (mgr.34373) 4461 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[31385]: audit 2021-03-10T15:15:00.938901+0000 mgr.gibba043.dnkmem (mgr.34373) 4462 : audit [DBG] from='client.57034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:02.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[31385]: audit 2021-03-10T15:15:01.200255+0000 mon.c (mon.1) 1176 : audit [DBG] from='client.? 172.21.2.103:0/3075930946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:02.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[32348]: audit 2021-03-10T15:15:00.713326+0000 mgr.gibba043.dnkmem (mgr.34373) 4460 : audit [DBG] from='client.47040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:02.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[32348]: cluster 2021-03-10T15:15:00.760363+0000 mgr.gibba043.dnkmem (mgr.34373) 4461 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[32348]: audit 2021-03-10T15:15:00.938901+0000 mgr.gibba043.dnkmem (mgr.34373) 4462 : audit [DBG] from='client.57034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:02.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:01 gibba003 bash[32348]: audit 2021-03-10T15:15:01.200255+0000 mon.c (mon.1) 1176 : audit [DBG] from='client.? 172.21.2.103:0/3075930946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:01 gibba043 bash[24019]: audit 2021-03-10T15:15:00.713326+0000 mgr.gibba043.dnkmem (mgr.34373) 4460 : audit [DBG] from='client.47040 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:02.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:01 gibba043 bash[24019]: cluster 2021-03-10T15:15:00.760363+0000 mgr.gibba043.dnkmem (mgr.34373) 4461 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:01 gibba043 bash[24019]: audit 2021-03-10T15:15:00.938901+0000 mgr.gibba043.dnkmem (mgr.34373) 4462 : audit [DBG] from='client.57034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:02.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:01 gibba043 bash[24019]: audit 2021-03-10T15:15:01.200255+0000 mon.c (mon.1) 1176 : audit [DBG] from='client.? 172.21.2.103:0/3075930946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:04.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:03 gibba003 bash[31385]: cluster 2021-03-10T15:15:02.761577+0000 mgr.gibba043.dnkmem (mgr.34373) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:04.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:03 gibba003 bash[32348]: cluster 2021-03-10T15:15:02.761577+0000 mgr.gibba043.dnkmem (mgr.34373) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:03 gibba043 bash[24019]: cluster 2021-03-10T15:15:02.761577+0000 mgr.gibba043.dnkmem (mgr.34373) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:05 gibba003 bash[31385]: cluster 2021-03-10T15:15:04.763253+0000 mgr.gibba043.dnkmem (mgr.34373) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:05.528 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:05 gibba003 bash[32348]: cluster 2021-03-10T15:15:04.763253+0000 mgr.gibba043.dnkmem (mgr.34373) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:05.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:05 gibba043 bash[24019]: cluster 2021-03-10T15:15:04.763253+0000 mgr.gibba043.dnkmem (mgr.34373) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:07 gibba003 bash[31385]: cluster 2021-03-10T15:15:06.764929+0000 mgr.gibba043.dnkmem (mgr.34373) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:08.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:07 gibba003 bash[32348]: cluster 2021-03-10T15:15:06.764929+0000 mgr.gibba043.dnkmem (mgr.34373) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:07 gibba043 bash[24019]: cluster 2021-03-10T15:15:06.764929+0000 mgr.gibba043.dnkmem (mgr.34373) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:09 gibba003 bash[31385]: cluster 2021-03-10T15:15:08.766562+0000 mgr.gibba043.dnkmem (mgr.34373) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:09 gibba003 bash[32348]: cluster 2021-03-10T15:15:08.766562+0000 mgr.gibba043.dnkmem (mgr.34373) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:09 gibba043 bash[24019]: cluster 2021-03-10T15:15:08.766562+0000 mgr.gibba043.dnkmem (mgr.34373) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:11 gibba003 bash[31385]: cluster 2021-03-10T15:15:10.768201+0000 mgr.gibba043.dnkmem (mgr.34373) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:12.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:11 gibba003 bash[32348]: cluster 2021-03-10T15:15:10.768201+0000 mgr.gibba043.dnkmem (mgr.34373) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:11 gibba043 bash[24019]: cluster 2021-03-10T15:15:10.768201+0000 mgr.gibba043.dnkmem (mgr.34373) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: cephadm 2021-03-10T15:15:12.385946+0000 mgr.gibba043.dnkmem (mgr.34373) 4468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: cluster 2021-03-10T15:15:12.769415+0000 mgr.gibba043.dnkmem (mgr.34373) 4469 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.243553+0000 mon.c (mon.1) 1177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.244724+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.344415+0000 mon.c (mon.1) 1178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.345595+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.397394+0000 mon.c (mon.1) 1179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:15:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.398130+0000 mon.c (mon.1) 1180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.398778+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:15:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.398832+0000 mon.c (mon.1) 1181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.399587+0000 mon.c (mon.1) 1182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.400904+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.401802+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[31385]: audit 2021-03-10T15:15:13.402694+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: cephadm 2021-03-10T15:15:12.385946+0000 mgr.gibba043.dnkmem (mgr.34373) 4468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: cluster 2021-03-10T15:15:12.769415+0000 mgr.gibba043.dnkmem (mgr.34373) 4469 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.243553+0000 mon.c (mon.1) 1177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.244724+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.344415+0000 mon.c (mon.1) 1178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.345595+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.397394+0000 mon.c (mon.1) 1179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:15:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.398130+0000 mon.c (mon.1) 1180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.398778+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:15:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.398832+0000 mon.c (mon.1) 1181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.399587+0000 mon.c (mon.1) 1182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.400904+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.401802+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:13 gibba003 bash[32348]: audit 2021-03-10T15:15:13.402694+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: cephadm 2021-03-10T15:15:12.385946+0000 mgr.gibba043.dnkmem (mgr.34373) 4468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: cluster 2021-03-10T15:15:12.769415+0000 mgr.gibba043.dnkmem (mgr.34373) 4469 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.243553+0000 mon.c (mon.1) 1177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.244724+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.344415+0000 mon.c (mon.1) 1178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.345595+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.397394+0000 mon.c (mon.1) 1179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:15:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.398130+0000 mon.c (mon.1) 1180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.398778+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:15:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.398832+0000 mon.c (mon.1) 1181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.399587+0000 mon.c (mon.1) 1182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.400904+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.401802+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:15:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:13 gibba043 bash[24019]: audit 2021-03-10T15:15:13.402694+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:15 gibba003 bash[31385]: cluster 2021-03-10T15:15:14.771127+0000 mgr.gibba043.dnkmem (mgr.34373) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:15 gibba003 bash[32348]: cluster 2021-03-10T15:15:14.771127+0000 mgr.gibba043.dnkmem (mgr.34373) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:15 gibba043 bash[24019]: cluster 2021-03-10T15:15:14.771127+0000 mgr.gibba043.dnkmem (mgr.34373) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:17 gibba003 bash[31385]: cluster 2021-03-10T15:15:16.772726+0000 mgr.gibba043.dnkmem (mgr.34373) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:18.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:17 gibba003 bash[32348]: cluster 2021-03-10T15:15:16.772726+0000 mgr.gibba043.dnkmem (mgr.34373) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:17 gibba043 bash[24019]: cluster 2021-03-10T15:15:16.772726+0000 mgr.gibba043.dnkmem (mgr.34373) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:19 gibba003 bash[31385]: cluster 2021-03-10T15:15:18.774318+0000 mgr.gibba043.dnkmem (mgr.34373) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:19 gibba003 bash[32348]: cluster 2021-03-10T15:15:18.774318+0000 mgr.gibba043.dnkmem (mgr.34373) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:20.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:19 gibba043 bash[24019]: cluster 2021-03-10T15:15:18.774318+0000 mgr.gibba043.dnkmem (mgr.34373) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:21 gibba003 bash[31385]: cluster 2021-03-10T15:15:20.776024+0000 mgr.gibba043.dnkmem (mgr.34373) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:22.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:21 gibba003 bash[32348]: cluster 2021-03-10T15:15:20.776024+0000 mgr.gibba043.dnkmem (mgr.34373) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:21 gibba043 bash[24019]: cluster 2021-03-10T15:15:20.776024+0000 mgr.gibba043.dnkmem (mgr.34373) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:23 gibba003 bash[31385]: cluster 2021-03-10T15:15:22.777548+0000 mgr.gibba043.dnkmem (mgr.34373) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:23 gibba003 bash[32348]: cluster 2021-03-10T15:15:22.777548+0000 mgr.gibba043.dnkmem (mgr.34373) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:23 gibba043 bash[24019]: cluster 2021-03-10T15:15:22.777548+0000 mgr.gibba043.dnkmem (mgr.34373) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:25 gibba003 bash[31385]: cluster 2021-03-10T15:15:24.779271+0000 mgr.gibba043.dnkmem (mgr.34373) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:25 gibba003 bash[32348]: cluster 2021-03-10T15:15:24.779271+0000 mgr.gibba043.dnkmem (mgr.34373) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:25 gibba043 bash[24019]: cluster 2021-03-10T15:15:24.779271+0000 mgr.gibba043.dnkmem (mgr.34373) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:27 gibba003 bash[31385]: cluster 2021-03-10T15:15:26.780955+0000 mgr.gibba043.dnkmem (mgr.34373) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:28.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:27 gibba003 bash[32348]: cluster 2021-03-10T15:15:26.780955+0000 mgr.gibba043.dnkmem (mgr.34373) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:27 gibba043 bash[24019]: cluster 2021-03-10T15:15:26.780955+0000 mgr.gibba043.dnkmem (mgr.34373) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:28 gibba003 bash[31385]: cephadm 2021-03-10T15:15:27.386784+0000 mgr.gibba043.dnkmem (mgr.34373) 4477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:28 gibba003 bash[32348]: cephadm 2021-03-10T15:15:27.386784+0000 mgr.gibba043.dnkmem (mgr.34373) 4477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:28 gibba043 bash[24019]: cephadm 2021-03-10T15:15:27.386784+0000 mgr.gibba043.dnkmem (mgr.34373) 4477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:29 gibba003 bash[31385]: cluster 2021-03-10T15:15:28.782396+0000 mgr.gibba043.dnkmem (mgr.34373) 4478 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:30.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:29 gibba003 bash[32348]: cluster 2021-03-10T15:15:28.782396+0000 mgr.gibba043.dnkmem (mgr.34373) 4478 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:29 gibba043 bash[24019]: cluster 2021-03-10T15:15:28.782396+0000 mgr.gibba043.dnkmem (mgr.34373) 4478 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:31.444 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:15:31.678 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:15:31.679 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (83m) 8m ago 89m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:15:31.679 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (88m) 7m ago 88m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:15:31.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:15:31.680 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:15:31.680 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:15:31.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:15:31.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:15:31.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:15:31.681 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (89m) 8m ago 89m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:15:31.681 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (89m) 7m ago 89m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:15:31.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (82m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:15:31.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (81m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:15:31.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:15:31.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:15:31.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:15:31.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:15:31.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:15:31.683 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:15:31.683 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (88m) 7m ago 89m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:15:31.683 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 87m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:15:31.931 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:15:31.931 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:15:31.931 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:31.932 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:15:31.932 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:15:31.932 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:31.932 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:15:31.933 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:15:31.933 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:15:31.933 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:15:31.933 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:15:31.933 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:15:31.934 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:15:31.934 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:15:31.934 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:15:32.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:31 gibba003 bash[31385]: cluster 2021-03-10T15:15:30.784027+0000 mgr.gibba043.dnkmem (mgr.34373) 4479 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:32.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:31 gibba003 bash[32348]: cluster 2021-03-10T15:15:30.784027+0000 mgr.gibba043.dnkmem (mgr.34373) 4479 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:31 gibba043 bash[24019]: cluster 2021-03-10T15:15:30.784027+0000 mgr.gibba043.dnkmem (mgr.34373) 4479 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:32 gibba003 bash[31385]: audit 2021-03-10T15:15:31.431106+0000 mgr.gibba043.dnkmem (mgr.34373) 4480 : audit [DBG] from='client.57046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:32 gibba003 bash[31385]: audit 2021-03-10T15:15:31.663958+0000 mgr.gibba043.dnkmem (mgr.34373) 4481 : audit [DBG] from='client.47064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:33.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:32 gibba003 bash[31385]: audit 2021-03-10T15:15:31.929335+0000 mon.a (mon.0) 1158 : audit [DBG] from='client.? 172.21.2.103:0/1838777837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:32 gibba003 bash[32348]: audit 2021-03-10T15:15:31.431106+0000 mgr.gibba043.dnkmem (mgr.34373) 4480 : audit [DBG] from='client.57046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:32 gibba003 bash[32348]: audit 2021-03-10T15:15:31.663958+0000 mgr.gibba043.dnkmem (mgr.34373) 4481 : audit [DBG] from='client.47064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:32 gibba003 bash[32348]: audit 2021-03-10T15:15:31.929335+0000 mon.a (mon.0) 1158 : audit [DBG] from='client.? 172.21.2.103:0/1838777837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:32 gibba043 bash[24019]: audit 2021-03-10T15:15:31.431106+0000 mgr.gibba043.dnkmem (mgr.34373) 4480 : audit [DBG] from='client.57046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:32 gibba043 bash[24019]: audit 2021-03-10T15:15:31.663958+0000 mgr.gibba043.dnkmem (mgr.34373) 4481 : audit [DBG] from='client.47064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:32 gibba043 bash[24019]: audit 2021-03-10T15:15:31.929335+0000 mon.a (mon.0) 1158 : audit [DBG] from='client.? 172.21.2.103:0/1838777837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:33 gibba003 bash[31385]: cluster 2021-03-10T15:15:32.785239+0000 mgr.gibba043.dnkmem (mgr.34373) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:34.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:33 gibba003 bash[32348]: cluster 2021-03-10T15:15:32.785239+0000 mgr.gibba043.dnkmem (mgr.34373) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:33 gibba043 bash[24019]: cluster 2021-03-10T15:15:32.785239+0000 mgr.gibba043.dnkmem (mgr.34373) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:35 gibba003 bash[31385]: cluster 2021-03-10T15:15:34.786972+0000 mgr.gibba043.dnkmem (mgr.34373) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:35.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:35 gibba003 bash[32348]: cluster 2021-03-10T15:15:34.786972+0000 mgr.gibba043.dnkmem (mgr.34373) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:35 gibba043 bash[24019]: cluster 2021-03-10T15:15:34.786972+0000 mgr.gibba043.dnkmem (mgr.34373) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:37 gibba003 bash[31385]: cluster 2021-03-10T15:15:36.788693+0000 mgr.gibba043.dnkmem (mgr.34373) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:38.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:37 gibba003 bash[32348]: cluster 2021-03-10T15:15:36.788693+0000 mgr.gibba043.dnkmem (mgr.34373) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:37 gibba043 bash[24019]: cluster 2021-03-10T15:15:36.788693+0000 mgr.gibba043.dnkmem (mgr.34373) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:40.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:39 gibba003 bash[31385]: cluster 2021-03-10T15:15:38.790241+0000 mgr.gibba043.dnkmem (mgr.34373) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:39 gibba003 bash[32348]: cluster 2021-03-10T15:15:38.790241+0000 mgr.gibba043.dnkmem (mgr.34373) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:39 gibba043 bash[24019]: cluster 2021-03-10T15:15:38.790241+0000 mgr.gibba043.dnkmem (mgr.34373) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:41 gibba003 bash[31385]: cluster 2021-03-10T15:15:40.791951+0000 mgr.gibba043.dnkmem (mgr.34373) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:42.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:41 gibba003 bash[32348]: cluster 2021-03-10T15:15:40.791951+0000 mgr.gibba043.dnkmem (mgr.34373) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:41 gibba043 bash[24019]: cluster 2021-03-10T15:15:40.791951+0000 mgr.gibba043.dnkmem (mgr.34373) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:44.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:43 gibba003 bash[31385]: cephadm 2021-03-10T15:15:42.402821+0000 mgr.gibba043.dnkmem (mgr.34373) 4487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:44.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:43 gibba003 bash[31385]: cluster 2021-03-10T15:15:42.793132+0000 mgr.gibba043.dnkmem (mgr.34373) 4488 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:44.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:43 gibba003 bash[32348]: cephadm 2021-03-10T15:15:42.402821+0000 mgr.gibba043.dnkmem (mgr.34373) 4487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:44.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:43 gibba003 bash[32348]: cluster 2021-03-10T15:15:42.793132+0000 mgr.gibba043.dnkmem (mgr.34373) 4488 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:43 gibba043 bash[24019]: cephadm 2021-03-10T15:15:42.402821+0000 mgr.gibba043.dnkmem (mgr.34373) 4487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:15:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:43 gibba043 bash[24019]: cluster 2021-03-10T15:15:42.793132+0000 mgr.gibba043.dnkmem (mgr.34373) 4488 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:45 gibba003 bash[31385]: cluster 2021-03-10T15:15:44.794599+0000 mgr.gibba043.dnkmem (mgr.34373) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:45.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:45 gibba003 bash[32348]: cluster 2021-03-10T15:15:44.794599+0000 mgr.gibba043.dnkmem (mgr.34373) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:45 gibba043 bash[24019]: cluster 2021-03-10T15:15:44.794599+0000 mgr.gibba043.dnkmem (mgr.34373) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:47 gibba003 bash[31385]: cluster 2021-03-10T15:15:46.796137+0000 mgr.gibba043.dnkmem (mgr.34373) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:47 gibba003 bash[32348]: cluster 2021-03-10T15:15:46.796137+0000 mgr.gibba043.dnkmem (mgr.34373) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:47 gibba043 bash[24019]: cluster 2021-03-10T15:15:46.796137+0000 mgr.gibba043.dnkmem (mgr.34373) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:49 gibba003 bash[31385]: cluster 2021-03-10T15:15:48.797597+0000 mgr.gibba043.dnkmem (mgr.34373) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:50.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:49 gibba003 bash[32348]: cluster 2021-03-10T15:15:48.797597+0000 mgr.gibba043.dnkmem (mgr.34373) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:49 gibba043 bash[24019]: cluster 2021-03-10T15:15:48.797597+0000 mgr.gibba043.dnkmem (mgr.34373) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:51 gibba003 bash[31385]: cluster 2021-03-10T15:15:50.799139+0000 mgr.gibba043.dnkmem (mgr.34373) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:52.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:51 gibba003 bash[32348]: cluster 2021-03-10T15:15:50.799139+0000 mgr.gibba043.dnkmem (mgr.34373) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:51 gibba043 bash[24019]: cluster 2021-03-10T15:15:50.799139+0000 mgr.gibba043.dnkmem (mgr.34373) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:54.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:53 gibba003 bash[31385]: cluster 2021-03-10T15:15:52.800650+0000 mgr.gibba043.dnkmem (mgr.34373) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:54.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:53 gibba003 bash[32348]: cluster 2021-03-10T15:15:52.800650+0000 mgr.gibba043.dnkmem (mgr.34373) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:53 gibba043 bash[24019]: cluster 2021-03-10T15:15:52.800650+0000 mgr.gibba043.dnkmem (mgr.34373) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:55 gibba003 bash[31385]: cluster 2021-03-10T15:15:54.802276+0000 mgr.gibba043.dnkmem (mgr.34373) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:55.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:55 gibba003 bash[32348]: cluster 2021-03-10T15:15:54.802276+0000 mgr.gibba043.dnkmem (mgr.34373) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:55 gibba043 bash[24019]: cluster 2021-03-10T15:15:54.802276+0000 mgr.gibba043.dnkmem (mgr.34373) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:57 gibba003 bash[31385]: cluster 2021-03-10T15:15:56.803963+0000 mgr.gibba043.dnkmem (mgr.34373) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:57 gibba003 bash[31385]: audit 2021-03-10T15:15:57.422187+0000 mon.c (mon.1) 1183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:15:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:57 gibba003 bash[32348]: cluster 2021-03-10T15:15:56.803963+0000 mgr.gibba043.dnkmem (mgr.34373) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:57 gibba003 bash[32348]: audit 2021-03-10T15:15:57.422187+0000 mon.c (mon.1) 1183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:15:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:57 gibba043 bash[24019]: cluster 2021-03-10T15:15:56.803963+0000 mgr.gibba043.dnkmem (mgr.34373) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:57 gibba043 bash[24019]: audit 2021-03-10T15:15:57.422187+0000 mon.c (mon.1) 1183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:15:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:58 gibba003 bash[31385]: cephadm 2021-03-10T15:15:57.420455+0000 mgr.gibba043.dnkmem (mgr.34373) 4496 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:15:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:58 gibba003 bash[32348]: cephadm 2021-03-10T15:15:57.420455+0000 mgr.gibba043.dnkmem (mgr.34373) 4496 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:15:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:58 gibba043 bash[24019]: cephadm 2021-03-10T15:15:57.420455+0000 mgr.gibba043.dnkmem (mgr.34373) 4496 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:16:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:15:59 gibba003 bash[31385]: cluster 2021-03-10T15:15:58.805280+0000 mgr.gibba043.dnkmem (mgr.34373) 4497 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:00.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:15:59 gibba003 bash[32348]: cluster 2021-03-10T15:15:58.805280+0000 mgr.gibba043.dnkmem (mgr.34373) 4497 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:15:59 gibba043 bash[24019]: cluster 2021-03-10T15:15:58.805280+0000 mgr.gibba043.dnkmem (mgr.34373) 4497 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.175 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:16:02.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:01 gibba003 bash[31385]: cluster 2021-03-10T15:16:00.806975+0000 mgr.gibba043.dnkmem (mgr.34373) 4498 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:01 gibba003 bash[31385]: audit 2021-03-10T15:16:01.848745+0000 mon.c (mon.1) 1184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:16:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:01 gibba003 bash[32348]: cluster 2021-03-10T15:16:00.806975+0000 mgr.gibba043.dnkmem (mgr.34373) 4498 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:01 gibba003 bash[32348]: audit 2021-03-10T15:16:01.848745+0000 mon.c (mon.1) 1184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:16:02.244 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:01 gibba043 bash[24019]: cluster 2021-03-10T15:16:00.806975+0000 mgr.gibba043.dnkmem (mgr.34373) 4498 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.244 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:01 gibba043 bash[24019]: audit 2021-03-10T15:16:01.848745+0000 mon.c (mon.1) 1184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:16:02.434 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:16:02.435 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (84m) 9m ago 89m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:16:02.435 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (89m) 8m ago 89m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:16:02.435 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (84m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:16:02.435 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:16:02.436 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:16:02.436 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (83m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:16:02.436 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:16:02.436 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (83m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:16:02.436 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (89m) 9m ago 89m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:16:02.437 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (89m) 8m ago 89m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:16:02.437 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:16:02.437 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:16:02.437 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:16:02.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:16:02.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:16:02.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:16:02.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:16:02.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (79m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:16:02.439 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (89m) 8m ago 89m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:16:02.439 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 87m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:16:02.686 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:16:02.686 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:16:02.686 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:02.687 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:16:02.687 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:16:02.687 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:02.687 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:16:02.687 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:16:02.688 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:16:02.688 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:16:02.688 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:16:02.688 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:16:02.689 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:16:02.689 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:16:02.689 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:16:03.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.029263+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:16:03.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.030235+0000 mgr.gibba043.dnkmem (mgr.34373) 4499 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:16:03.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.162970+0000 mgr.gibba043.dnkmem (mgr.34373) 4500 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.224537+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:16:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.230071+0000 mgr.gibba043.dnkmem (mgr.34373) 4501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.231859+0000 mon.c (mon.1) 1185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:03.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.232108+0000 mgr.gibba043.dnkmem (mgr.34373) 4502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:03.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.233493+0000 mgr.gibba043.dnkmem (mgr.34373) 4503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:03.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.233530+0000 mon.c (mon.1) 1186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.233558+0000 mgr.gibba043.dnkmem (mgr.34373) 4504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:03.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.234537+0000 mgr.gibba043.dnkmem (mgr.34373) 4505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:03.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.234602+0000 mgr.gibba043.dnkmem (mgr.34373) 4506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:03.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.234843+0000 mon.c (mon.1) 1187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.235710+0000 mgr.gibba043.dnkmem (mgr.34373) 4507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:03.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.235900+0000 mon.c (mon.1) 1188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.238640+0000 mgr.gibba043.dnkmem (mgr.34373) 4508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:03.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.238700+0000 mgr.gibba043.dnkmem (mgr.34373) 4509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:03.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.239905+0000 mgr.gibba043.dnkmem (mgr.34373) 4510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:03.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.240140+0000 mon.c (mon.1) 1189 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.240268+0000 mgr.gibba043.dnkmem (mgr.34373) 4511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:03.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.241241+0000 mgr.gibba043.dnkmem (mgr.34373) 4512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:03.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.029263+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:16:03.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.030235+0000 mgr.gibba043.dnkmem (mgr.34373) 4499 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:16:03.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.162970+0000 mgr.gibba043.dnkmem (mgr.34373) 4500 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:03.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.224537+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:16:03.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.230071+0000 mgr.gibba043.dnkmem (mgr.34373) 4501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.231859+0000 mon.c (mon.1) 1185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.232108+0000 mgr.gibba043.dnkmem (mgr.34373) 4502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.233493+0000 mgr.gibba043.dnkmem (mgr.34373) 4503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:03.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.233530+0000 mon.c (mon.1) 1186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.233558+0000 mgr.gibba043.dnkmem (mgr.34373) 4504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:03.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.234537+0000 mgr.gibba043.dnkmem (mgr.34373) 4505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:03.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.234602+0000 mgr.gibba043.dnkmem (mgr.34373) 4506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:03.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.234843+0000 mon.c (mon.1) 1187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.235710+0000 mgr.gibba043.dnkmem (mgr.34373) 4507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:03.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.235900+0000 mon.c (mon.1) 1188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.238640+0000 mgr.gibba043.dnkmem (mgr.34373) 4508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:03.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.238700+0000 mgr.gibba043.dnkmem (mgr.34373) 4509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:03.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.239905+0000 mgr.gibba043.dnkmem (mgr.34373) 4510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:03.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.240140+0000 mon.c (mon.1) 1189 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.240268+0000 mgr.gibba043.dnkmem (mgr.34373) 4511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:03.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.241241+0000 mgr.gibba043.dnkmem (mgr.34373) 4512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:03.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.241298+0000 mgr.gibba043.dnkmem (mgr.34373) 4513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:03.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cephadm 2021-03-10T15:16:02.241436+0000 mgr.gibba043.dnkmem (mgr.34373) 4514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:03.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.241540+0000 mon.c (mon.1) 1190 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.456 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.392606+0000 mgr.gibba043.dnkmem (mgr.34373) 4515 : audit [DBG] from='client.47082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:03.456 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: audit 2021-03-10T15:16:02.683973+0000 mon.a (mon.0) 1161 : audit [DBG] from='client.? 172.21.2.103:0/1663356116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.456 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[31385]: cluster 2021-03-10T15:16:02.808512+0000 mgr.gibba043.dnkmem (mgr.34373) 4516 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:03.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.241298+0000 mgr.gibba043.dnkmem (mgr.34373) 4513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:03.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cephadm 2021-03-10T15:16:02.241436+0000 mgr.gibba043.dnkmem (mgr.34373) 4514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:03.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.241540+0000 mon.c (mon.1) 1190 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.392606+0000 mgr.gibba043.dnkmem (mgr.34373) 4515 : audit [DBG] from='client.47082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:03.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: audit 2021-03-10T15:16:02.683973+0000 mon.a (mon.0) 1161 : audit [DBG] from='client.? 172.21.2.103:0/1663356116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:03 gibba003 bash[32348]: cluster 2021-03-10T15:16:02.808512+0000 mgr.gibba043.dnkmem (mgr.34373) 4516 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.029263+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:16:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.030235+0000 mgr.gibba043.dnkmem (mgr.34373) 4499 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:16:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.162970+0000 mgr.gibba043.dnkmem (mgr.34373) 4500 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.224537+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:16:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.230071+0000 mgr.gibba043.dnkmem (mgr.34373) 4501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.231859+0000 mon.c (mon.1) 1185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:03.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.232108+0000 mgr.gibba043.dnkmem (mgr.34373) 4502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:03.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.233493+0000 mgr.gibba043.dnkmem (mgr.34373) 4503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:03.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.233530+0000 mon.c (mon.1) 1186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.233558+0000 mgr.gibba043.dnkmem (mgr.34373) 4504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:03.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.234537+0000 mgr.gibba043.dnkmem (mgr.34373) 4505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:03.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.234602+0000 mgr.gibba043.dnkmem (mgr.34373) 4506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:03.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.234843+0000 mon.c (mon.1) 1187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.235710+0000 mgr.gibba043.dnkmem (mgr.34373) 4507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:03.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.235900+0000 mon.c (mon.1) 1188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.238640+0000 mgr.gibba043.dnkmem (mgr.34373) 4508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:03.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.238700+0000 mgr.gibba043.dnkmem (mgr.34373) 4509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:03.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.239905+0000 mgr.gibba043.dnkmem (mgr.34373) 4510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:03.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.240140+0000 mon.c (mon.1) 1189 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.240268+0000 mgr.gibba043.dnkmem (mgr.34373) 4511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:03.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.241241+0000 mgr.gibba043.dnkmem (mgr.34373) 4512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:03.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.241298+0000 mgr.gibba043.dnkmem (mgr.34373) 4513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:03.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cephadm 2021-03-10T15:16:02.241436+0000 mgr.gibba043.dnkmem (mgr.34373) 4514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:03.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.241540+0000 mon.c (mon.1) 1190 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.392606+0000 mgr.gibba043.dnkmem (mgr.34373) 4515 : audit [DBG] from='client.47082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:03.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: audit 2021-03-10T15:16:02.683973+0000 mon.a (mon.0) 1161 : audit [DBG] from='client.? 172.21.2.103:0/1663356116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:03.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:03 gibba043 bash[24019]: cluster 2021-03-10T15:16:02.808512+0000 mgr.gibba043.dnkmem (mgr.34373) 4516 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:05 gibba003 bash[31385]: cluster 2021-03-10T15:16:04.810135+0000 mgr.gibba043.dnkmem (mgr.34373) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:05 gibba003 bash[32348]: cluster 2021-03-10T15:16:04.810135+0000 mgr.gibba043.dnkmem (mgr.34373) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:05 gibba043 bash[24019]: cluster 2021-03-10T15:16:04.810135+0000 mgr.gibba043.dnkmem (mgr.34373) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:07 gibba003 bash[31385]: cluster 2021-03-10T15:16:06.811657+0000 mgr.gibba043.dnkmem (mgr.34373) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:08.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:07 gibba003 bash[32348]: cluster 2021-03-10T15:16:06.811657+0000 mgr.gibba043.dnkmem (mgr.34373) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:07 gibba043 bash[24019]: cluster 2021-03-10T15:16:06.811657+0000 mgr.gibba043.dnkmem (mgr.34373) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:09 gibba003 bash[31385]: cluster 2021-03-10T15:16:08.813024+0000 mgr.gibba043.dnkmem (mgr.34373) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:10.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:09 gibba003 bash[32348]: cluster 2021-03-10T15:16:08.813024+0000 mgr.gibba043.dnkmem (mgr.34373) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:09 gibba043 bash[24019]: cluster 2021-03-10T15:16:08.813024+0000 mgr.gibba043.dnkmem (mgr.34373) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:11 gibba003 bash[31385]: cluster 2021-03-10T15:16:10.814660+0000 mgr.gibba043.dnkmem (mgr.34373) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:12.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:11 gibba003 bash[32348]: cluster 2021-03-10T15:16:10.814660+0000 mgr.gibba043.dnkmem (mgr.34373) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:11 gibba043 bash[24019]: cluster 2021-03-10T15:16:10.814660+0000 mgr.gibba043.dnkmem (mgr.34373) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: cluster 2021-03-10T15:16:12.815886+0000 mgr.gibba043.dnkmem (mgr.34373) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.250162+0000 mon.c (mon.1) 1191 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.251256+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.353120+0000 mon.c (mon.1) 1192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.354230+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.408138+0000 mon.c (mon.1) 1193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:16:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.408902+0000 mon.c (mon.1) 1194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:16:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.409362+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:16:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.409579+0000 mon.c (mon.1) 1195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.410249+0000 mon.c (mon.1) 1196 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.410779+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:16:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.411916+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[31385]: audit 2021-03-10T15:16:13.412724+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: cluster 2021-03-10T15:16:12.815886+0000 mgr.gibba043.dnkmem (mgr.34373) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.250162+0000 mon.c (mon.1) 1191 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.251256+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.353120+0000 mon.c (mon.1) 1192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.354230+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.408138+0000 mon.c (mon.1) 1193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:16:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.408902+0000 mon.c (mon.1) 1194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:16:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.409362+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:16:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.409579+0000 mon.c (mon.1) 1195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.410249+0000 mon.c (mon.1) 1196 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.410779+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:16:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.411916+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:13 gibba003 bash[32348]: audit 2021-03-10T15:16:13.412724+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: cluster 2021-03-10T15:16:12.815886+0000 mgr.gibba043.dnkmem (mgr.34373) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.250162+0000 mon.c (mon.1) 1191 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.251256+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.353120+0000 mon.c (mon.1) 1192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.354230+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.408138+0000 mon.c (mon.1) 1193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:16:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.408902+0000 mon.c (mon.1) 1194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:16:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.409362+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:16:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.409579+0000 mon.c (mon.1) 1195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.410249+0000 mon.c (mon.1) 1196 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.410779+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:16:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.411916+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:16:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:13 gibba043 bash[24019]: audit 2021-03-10T15:16:13.412724+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:16:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:15 gibba003 bash[31385]: cluster 2021-03-10T15:16:14.817496+0000 mgr.gibba043.dnkmem (mgr.34373) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:15 gibba003 bash[32348]: cluster 2021-03-10T15:16:14.817496+0000 mgr.gibba043.dnkmem (mgr.34373) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:15 gibba043 bash[24019]: cluster 2021-03-10T15:16:14.817496+0000 mgr.gibba043.dnkmem (mgr.34373) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:17 gibba003 bash[31385]: cluster 2021-03-10T15:16:16.819034+0000 mgr.gibba043.dnkmem (mgr.34373) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:17 gibba003 bash[32348]: cluster 2021-03-10T15:16:16.819034+0000 mgr.gibba043.dnkmem (mgr.34373) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:17 gibba043 bash[24019]: cluster 2021-03-10T15:16:16.819034+0000 mgr.gibba043.dnkmem (mgr.34373) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:18 gibba003 bash[31385]: cephadm 2021-03-10T15:16:17.257524+0000 mgr.gibba043.dnkmem (mgr.34373) 4524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:18 gibba003 bash[32348]: cephadm 2021-03-10T15:16:17.257524+0000 mgr.gibba043.dnkmem (mgr.34373) 4524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:19.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:18 gibba043 bash[24019]: cephadm 2021-03-10T15:16:17.257524+0000 mgr.gibba043.dnkmem (mgr.34373) 4524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:19 gibba003 bash[31385]: cluster 2021-03-10T15:16:18.820726+0000 mgr.gibba043.dnkmem (mgr.34373) 4525 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:19 gibba003 bash[32348]: cluster 2021-03-10T15:16:18.820726+0000 mgr.gibba043.dnkmem (mgr.34373) 4525 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:20.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:19 gibba043 bash[24019]: cluster 2021-03-10T15:16:18.820726+0000 mgr.gibba043.dnkmem (mgr.34373) 4525 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:21 gibba003 bash[31385]: cluster 2021-03-10T15:16:20.822253+0000 mgr.gibba043.dnkmem (mgr.34373) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:22.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:21 gibba003 bash[32348]: cluster 2021-03-10T15:16:20.822253+0000 mgr.gibba043.dnkmem (mgr.34373) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:21 gibba043 bash[24019]: cluster 2021-03-10T15:16:20.822253+0000 mgr.gibba043.dnkmem (mgr.34373) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:24.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:23 gibba003 bash[31385]: cluster 2021-03-10T15:16:22.823861+0000 mgr.gibba043.dnkmem (mgr.34373) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:23 gibba003 bash[32348]: cluster 2021-03-10T15:16:22.823861+0000 mgr.gibba043.dnkmem (mgr.34373) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:23 gibba043 bash[24019]: cluster 2021-03-10T15:16:22.823861+0000 mgr.gibba043.dnkmem (mgr.34373) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:25 gibba003 bash[31385]: cluster 2021-03-10T15:16:24.825363+0000 mgr.gibba043.dnkmem (mgr.34373) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:25 gibba003 bash[32348]: cluster 2021-03-10T15:16:24.825363+0000 mgr.gibba043.dnkmem (mgr.34373) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:25 gibba043 bash[24019]: cluster 2021-03-10T15:16:24.825363+0000 mgr.gibba043.dnkmem (mgr.34373) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:27 gibba003 bash[31385]: cluster 2021-03-10T15:16:26.826848+0000 mgr.gibba043.dnkmem (mgr.34373) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:28.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:27 gibba003 bash[32348]: cluster 2021-03-10T15:16:26.826848+0000 mgr.gibba043.dnkmem (mgr.34373) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:27 gibba043 bash[24019]: cluster 2021-03-10T15:16:26.826848+0000 mgr.gibba043.dnkmem (mgr.34373) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:29 gibba003 bash[31385]: cluster 2021-03-10T15:16:28.828565+0000 mgr.gibba043.dnkmem (mgr.34373) 4530 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:30.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:29 gibba003 bash[32348]: cluster 2021-03-10T15:16:28.828565+0000 mgr.gibba043.dnkmem (mgr.34373) 4530 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:29 gibba043 bash[24019]: cluster 2021-03-10T15:16:28.828565+0000 mgr.gibba043.dnkmem (mgr.34373) 4530 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:32.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:31 gibba003 bash[31385]: cluster 2021-03-10T15:16:30.829959+0000 mgr.gibba043.dnkmem (mgr.34373) 4531 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:32.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:31 gibba003 bash[32348]: cluster 2021-03-10T15:16:30.829959+0000 mgr.gibba043.dnkmem (mgr.34373) 4531 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:32.266 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:31 gibba043 bash[24019]: cluster 2021-03-10T15:16:30.829959+0000 mgr.gibba043.dnkmem (mgr.34373) 4531 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:32.928 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:16:33.162 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:16:33.163 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (84m) 9m ago 90m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:16:33.163 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (90m) 8m ago 90m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:16:33.163 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:16:33.163 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:16:33.163 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:16:33.164 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:16:33.164 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (84m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:16:33.164 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:16:33.164 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (90m) 9m ago 90m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:16:33.165 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (90m) 8m ago 90m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:16:33.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (83m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:16:33.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (82m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:16:33.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:16:33.166 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:16:33.166 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:16:33.166 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:16:33.166 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:16:33.167 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:16:33.167 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (89m) 8m ago 90m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:16:33.167 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 88m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:16:33.414 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:16:33.415 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:16:33.415 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:33.415 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:16:33.415 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:16:33.416 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:33.416 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:16:33.416 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:16:33.416 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:16:33.417 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:16:33.417 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:16:33.417 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:16:33.417 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:16:33.417 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:16:33.418 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:16:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[31385]: cephadm 2021-03-10T15:16:32.262936+0000 mgr.gibba043.dnkmem (mgr.34373) 4532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[31385]: cluster 2021-03-10T15:16:32.831490+0000 mgr.gibba043.dnkmem (mgr.34373) 4533 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[31385]: audit 2021-03-10T15:16:32.917276+0000 mgr.gibba043.dnkmem (mgr.34373) 4534 : audit [DBG] from='client.57082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:34.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[31385]: audit 2021-03-10T15:16:33.412371+0000 mon.c (mon.1) 1197 : audit [DBG] from='client.? 172.21.2.103:0/3875728290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:34.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[32348]: cephadm 2021-03-10T15:16:32.262936+0000 mgr.gibba043.dnkmem (mgr.34373) 4532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:34.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[32348]: cluster 2021-03-10T15:16:32.831490+0000 mgr.gibba043.dnkmem (mgr.34373) 4533 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:34.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[32348]: audit 2021-03-10T15:16:32.917276+0000 mgr.gibba043.dnkmem (mgr.34373) 4534 : audit [DBG] from='client.57082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:34.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:33 gibba003 bash[32348]: audit 2021-03-10T15:16:33.412371+0000 mon.c (mon.1) 1197 : audit [DBG] from='client.? 172.21.2.103:0/3875728290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:33 gibba043 bash[24019]: cephadm 2021-03-10T15:16:32.262936+0000 mgr.gibba043.dnkmem (mgr.34373) 4532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:33 gibba043 bash[24019]: cluster 2021-03-10T15:16:32.831490+0000 mgr.gibba043.dnkmem (mgr.34373) 4533 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:34.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:33 gibba043 bash[24019]: audit 2021-03-10T15:16:32.917276+0000 mgr.gibba043.dnkmem (mgr.34373) 4534 : audit [DBG] from='client.57082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:34.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:33 gibba043 bash[24019]: audit 2021-03-10T15:16:33.412371+0000 mon.c (mon.1) 1197 : audit [DBG] from='client.? 172.21.2.103:0/3875728290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:34 gibba003 bash[31385]: audit 2021-03-10T15:16:33.147275+0000 mgr.gibba043.dnkmem (mgr.34373) 4535 : audit [DBG] from='client.57088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:34 gibba003 bash[32348]: audit 2021-03-10T15:16:33.147275+0000 mgr.gibba043.dnkmem (mgr.34373) 4535 : audit [DBG] from='client.57088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:34 gibba043 bash[24019]: audit 2021-03-10T15:16:33.147275+0000 mgr.gibba043.dnkmem (mgr.34373) 4535 : audit [DBG] from='client.57088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:35 gibba003 bash[31385]: cluster 2021-03-10T15:16:34.833260+0000 mgr.gibba043.dnkmem (mgr.34373) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:36.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:35 gibba003 bash[32348]: cluster 2021-03-10T15:16:34.833260+0000 mgr.gibba043.dnkmem (mgr.34373) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:36.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:35 gibba043 bash[24019]: cluster 2021-03-10T15:16:34.833260+0000 mgr.gibba043.dnkmem (mgr.34373) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:38.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:37 gibba003 bash[31385]: cluster 2021-03-10T15:16:36.834789+0000 mgr.gibba043.dnkmem (mgr.34373) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:38.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:37 gibba003 bash[32348]: cluster 2021-03-10T15:16:36.834789+0000 mgr.gibba043.dnkmem (mgr.34373) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:37 gibba043 bash[24019]: cluster 2021-03-10T15:16:36.834789+0000 mgr.gibba043.dnkmem (mgr.34373) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:39 gibba043 bash[24019]: cluster 2021-03-10T15:16:38.836485+0000 mgr.gibba043.dnkmem (mgr.34373) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:39 gibba003 bash[31385]: cluster 2021-03-10T15:16:38.836485+0000 mgr.gibba043.dnkmem (mgr.34373) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:40.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:39 gibba003 bash[32348]: cluster 2021-03-10T15:16:38.836485+0000 mgr.gibba043.dnkmem (mgr.34373) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:41 gibba043 bash[24019]: cluster 2021-03-10T15:16:40.838185+0000 mgr.gibba043.dnkmem (mgr.34373) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:41 gibba003 bash[31385]: cluster 2021-03-10T15:16:40.838185+0000 mgr.gibba043.dnkmem (mgr.34373) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:41 gibba003 bash[32348]: cluster 2021-03-10T15:16:40.838185+0000 mgr.gibba043.dnkmem (mgr.34373) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:43 gibba043 bash[24019]: cluster 2021-03-10T15:16:42.839539+0000 mgr.gibba043.dnkmem (mgr.34373) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:44.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:43 gibba003 bash[31385]: cluster 2021-03-10T15:16:42.839539+0000 mgr.gibba043.dnkmem (mgr.34373) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:44.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:43 gibba003 bash[32348]: cluster 2021-03-10T15:16:42.839539+0000 mgr.gibba043.dnkmem (mgr.34373) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:45 gibba003 bash[31385]: cluster 2021-03-10T15:16:44.841171+0000 mgr.gibba043.dnkmem (mgr.34373) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:45 gibba003 bash[32348]: cluster 2021-03-10T15:16:44.841171+0000 mgr.gibba043.dnkmem (mgr.34373) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:45 gibba043 bash[24019]: cluster 2021-03-10T15:16:44.841171+0000 mgr.gibba043.dnkmem (mgr.34373) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:47 gibba003 bash[31385]: cluster 2021-03-10T15:16:46.842780+0000 mgr.gibba043.dnkmem (mgr.34373) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:48.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:47 gibba003 bash[32348]: cluster 2021-03-10T15:16:46.842780+0000 mgr.gibba043.dnkmem (mgr.34373) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:47 gibba043 bash[24019]: cluster 2021-03-10T15:16:46.842780+0000 mgr.gibba043.dnkmem (mgr.34373) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:48 gibba003 bash[32348]: cephadm 2021-03-10T15:16:47.278875+0000 mgr.gibba043.dnkmem (mgr.34373) 4543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:48 gibba003 bash[31385]: cephadm 2021-03-10T15:16:47.278875+0000 mgr.gibba043.dnkmem (mgr.34373) 4543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:48 gibba043 bash[24019]: cephadm 2021-03-10T15:16:47.278875+0000 mgr.gibba043.dnkmem (mgr.34373) 4543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:16:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:49 gibba003 bash[31385]: cluster 2021-03-10T15:16:48.844467+0000 mgr.gibba043.dnkmem (mgr.34373) 4544 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:50.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:49 gibba003 bash[32348]: cluster 2021-03-10T15:16:48.844467+0000 mgr.gibba043.dnkmem (mgr.34373) 4544 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:49 gibba043 bash[24019]: cluster 2021-03-10T15:16:48.844467+0000 mgr.gibba043.dnkmem (mgr.34373) 4544 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:51 gibba003 bash[31385]: cluster 2021-03-10T15:16:50.846131+0000 mgr.gibba043.dnkmem (mgr.34373) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:52.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:51 gibba003 bash[32348]: cluster 2021-03-10T15:16:50.846131+0000 mgr.gibba043.dnkmem (mgr.34373) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:51 gibba043 bash[24019]: cluster 2021-03-10T15:16:50.846131+0000 mgr.gibba043.dnkmem (mgr.34373) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:53 gibba043 bash[24019]: cluster 2021-03-10T15:16:52.847513+0000 mgr.gibba043.dnkmem (mgr.34373) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:54.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:53 gibba003 bash[31385]: cluster 2021-03-10T15:16:52.847513+0000 mgr.gibba043.dnkmem (mgr.34373) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:53 gibba003 bash[32348]: cluster 2021-03-10T15:16:52.847513+0000 mgr.gibba043.dnkmem (mgr.34373) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:55 gibba003 bash[31385]: cluster 2021-03-10T15:16:54.849242+0000 mgr.gibba043.dnkmem (mgr.34373) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:55 gibba003 bash[32348]: cluster 2021-03-10T15:16:54.849242+0000 mgr.gibba043.dnkmem (mgr.34373) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:55 gibba043 bash[24019]: cluster 2021-03-10T15:16:54.849242+0000 mgr.gibba043.dnkmem (mgr.34373) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:57 gibba003 bash[31385]: cluster 2021-03-10T15:16:56.850942+0000 mgr.gibba043.dnkmem (mgr.34373) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:58.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:57 gibba003 bash[32348]: cluster 2021-03-10T15:16:56.850942+0000 mgr.gibba043.dnkmem (mgr.34373) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:57 gibba043 bash[24019]: cluster 2021-03-10T15:16:56.850942+0000 mgr.gibba043.dnkmem (mgr.34373) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:16:59 gibba003 bash[31385]: cluster 2021-03-10T15:16:58.852493+0000 mgr.gibba043.dnkmem (mgr.34373) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:00.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:16:59 gibba003 bash[32348]: cluster 2021-03-10T15:16:58.852493+0000 mgr.gibba043.dnkmem (mgr.34373) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:16:59 gibba043 bash[24019]: cluster 2021-03-10T15:16:58.852493+0000 mgr.gibba043.dnkmem (mgr.34373) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:01 gibba003 bash[31385]: cluster 2021-03-10T15:17:00.854068+0000 mgr.gibba043.dnkmem (mgr.34373) 4550 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:02.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:01 gibba003 bash[32348]: cluster 2021-03-10T15:17:00.854068+0000 mgr.gibba043.dnkmem (mgr.34373) 4550 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:01 gibba043 bash[24019]: cluster 2021-03-10T15:17:00.854068+0000 mgr.gibba043.dnkmem (mgr.34373) 4550 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:02 gibba043 bash[24019]: audit 2021-03-10T15:17:02.298144+0000 mon.c (mon.1) 1198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:17:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:02 gibba003 bash[32348]: audit 2021-03-10T15:17:02.298144+0000 mon.c (mon.1) 1198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:17:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:02 gibba003 bash[31385]: audit 2021-03-10T15:17:02.298144+0000 mon.c (mon.1) 1198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:17:03.656 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:17:03.884 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:17:03.884 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (85m) 10m ago 90m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:17:03.884 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (90m) 9m ago 90m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:17:03.884 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (85m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:17:03.885 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:17:03.885 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (85m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:17:03.885 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (84m) 10m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:17:03.885 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:17:03.886 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (84m) 10m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:17:03.886 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (90m) 10m ago 90m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:17:03.886 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (90m) 9m ago 90m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:17:03.886 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:17:03.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:17:03.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:17:03.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (82m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:17:03.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:17:03.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:17:03.888 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:17:03.888 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (80m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:17:03.888 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (90m) 9m ago 90m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:17:03.888 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 88m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:17:04.138 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:17:04.138 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:17:04.138 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:04.138 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:17:04.139 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:17:04.139 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:04.139 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:17:04.139 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:17:04.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:17:04.140 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:17:04.140 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:17:04.140 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:17:04.141 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:17:04.141 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:17:04.141 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:17:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:03 gibba043 bash[24019]: cephadm 2021-03-10T15:17:02.296460+0000 mgr.gibba043.dnkmem (mgr.34373) 4551 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:17:04.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:03 gibba043 bash[24019]: cluster 2021-03-10T15:17:02.855514+0000 mgr.gibba043.dnkmem (mgr.34373) 4552 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:03 gibba003 bash[31385]: cephadm 2021-03-10T15:17:02.296460+0000 mgr.gibba043.dnkmem (mgr.34373) 4551 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:17:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:03 gibba003 bash[31385]: cluster 2021-03-10T15:17:02.855514+0000 mgr.gibba043.dnkmem (mgr.34373) 4552 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:03 gibba003 bash[32348]: cephadm 2021-03-10T15:17:02.296460+0000 mgr.gibba043.dnkmem (mgr.34373) 4551 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:17:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:03 gibba003 bash[32348]: cluster 2021-03-10T15:17:02.855514+0000 mgr.gibba043.dnkmem (mgr.34373) 4552 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:04 gibba043 bash[24019]: audit 2021-03-10T15:17:03.645433+0000 mgr.gibba043.dnkmem (mgr.34373) 4553 : audit [DBG] from='client.47112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:04 gibba043 bash[24019]: audit 2021-03-10T15:17:03.868881+0000 mgr.gibba043.dnkmem (mgr.34373) 4554 : audit [DBG] from='client.57106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:04 gibba043 bash[24019]: audit 2021-03-10T15:17:04.135911+0000 mon.c (mon.1) 1199 : audit [DBG] from='client.? 172.21.2.103:0/3272447164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:04 gibba003 bash[32348]: audit 2021-03-10T15:17:03.645433+0000 mgr.gibba043.dnkmem (mgr.34373) 4553 : audit [DBG] from='client.47112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:04 gibba003 bash[32348]: audit 2021-03-10T15:17:03.868881+0000 mgr.gibba043.dnkmem (mgr.34373) 4554 : audit [DBG] from='client.57106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:04 gibba003 bash[32348]: audit 2021-03-10T15:17:04.135911+0000 mon.c (mon.1) 1199 : audit [DBG] from='client.? 172.21.2.103:0/3272447164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:04 gibba003 bash[31385]: audit 2021-03-10T15:17:03.645433+0000 mgr.gibba043.dnkmem (mgr.34373) 4553 : audit [DBG] from='client.47112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:05.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:04 gibba003 bash[31385]: audit 2021-03-10T15:17:03.868881+0000 mgr.gibba043.dnkmem (mgr.34373) 4554 : audit [DBG] from='client.57106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:05.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:04 gibba003 bash[31385]: audit 2021-03-10T15:17:04.135911+0000 mon.c (mon.1) 1199 : audit [DBG] from='client.? 172.21.2.103:0/3272447164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:05 gibba043 bash[24019]: cluster 2021-03-10T15:17:04.857113+0000 mgr.gibba043.dnkmem (mgr.34373) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:06.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:05 gibba043 bash[24019]: audit 2021-03-10T15:17:05.886126+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:17:06.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:05 gibba003 bash[31385]: cluster 2021-03-10T15:17:04.857113+0000 mgr.gibba043.dnkmem (mgr.34373) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:06.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:05 gibba003 bash[31385]: audit 2021-03-10T15:17:05.886126+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:17:06.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:05 gibba003 bash[32348]: cluster 2021-03-10T15:17:04.857113+0000 mgr.gibba043.dnkmem (mgr.34373) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:05 gibba003 bash[32348]: audit 2021-03-10T15:17:05.886126+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:17:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: cephadm 2021-03-10T15:17:05.886008+0000 mgr.gibba043.dnkmem (mgr.34373) 4556 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:17:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.089013+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:17:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.105462+0000 mon.c (mon.1) 1200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.110140+0000 mon.c (mon.1) 1201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.114803+0000 mon.c (mon.1) 1202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.118246+0000 mon.c (mon.1) 1203 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.125617+0000 mon.c (mon.1) 1204 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:06 gibba043 bash[24019]: audit 2021-03-10T15:17:06.130766+0000 mon.c (mon.1) 1205 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: cephadm 2021-03-10T15:17:05.886008+0000 mgr.gibba043.dnkmem (mgr.34373) 4556 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:17:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.089013+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:17:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.105462+0000 mon.c (mon.1) 1200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.110140+0000 mon.c (mon.1) 1201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.114803+0000 mon.c (mon.1) 1202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.118246+0000 mon.c (mon.1) 1203 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.125617+0000 mon.c (mon.1) 1204 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[31385]: audit 2021-03-10T15:17:06.130766+0000 mon.c (mon.1) 1205 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: cephadm 2021-03-10T15:17:05.886008+0000 mgr.gibba043.dnkmem (mgr.34373) 4556 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:17:07.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.089013+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:17:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.105462+0000 mon.c (mon.1) 1200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.110140+0000 mon.c (mon.1) 1201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.114803+0000 mon.c (mon.1) 1202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.118246+0000 mon.c (mon.1) 1203 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.125617+0000 mon.c (mon.1) 1204 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:07.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:06 gibba003 bash[32348]: audit 2021-03-10T15:17:06.130766+0000 mon.c (mon.1) 1205 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.101542+0000 mgr.gibba043.dnkmem (mgr.34373) 4557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.107833+0000 mgr.gibba043.dnkmem (mgr.34373) 4558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.111904+0000 mgr.gibba043.dnkmem (mgr.34373) 4559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.112517+0000 mgr.gibba043.dnkmem (mgr.34373) 4560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.116068+0000 mgr.gibba043.dnkmem (mgr.34373) 4561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.116568+0000 mgr.gibba043.dnkmem (mgr.34373) 4562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.119087+0000 mgr.gibba043.dnkmem (mgr.34373) 4563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.122398+0000 mgr.gibba043.dnkmem (mgr.34373) 4564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.122894+0000 mgr.gibba043.dnkmem (mgr.34373) 4565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.126718+0000 mgr.gibba043.dnkmem (mgr.34373) 4566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.128883+0000 mgr.gibba043.dnkmem (mgr.34373) 4567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.131995+0000 mgr.gibba043.dnkmem (mgr.34373) 4568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.132455+0000 mgr.gibba043.dnkmem (mgr.34373) 4569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cephadm 2021-03-10T15:17:06.133038+0000 mgr.gibba043.dnkmem (mgr.34373) 4570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:07 gibba043 bash[24019]: cluster 2021-03-10T15:17:06.858782+0000 mgr.gibba043.dnkmem (mgr.34373) 4571 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.101542+0000 mgr.gibba043.dnkmem (mgr.34373) 4557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.107833+0000 mgr.gibba043.dnkmem (mgr.34373) 4558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.111904+0000 mgr.gibba043.dnkmem (mgr.34373) 4559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.112517+0000 mgr.gibba043.dnkmem (mgr.34373) 4560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.116068+0000 mgr.gibba043.dnkmem (mgr.34373) 4561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.116568+0000 mgr.gibba043.dnkmem (mgr.34373) 4562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.119087+0000 mgr.gibba043.dnkmem (mgr.34373) 4563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.122398+0000 mgr.gibba043.dnkmem (mgr.34373) 4564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.122894+0000 mgr.gibba043.dnkmem (mgr.34373) 4565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:08.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.126718+0000 mgr.gibba043.dnkmem (mgr.34373) 4566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:08.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.128883+0000 mgr.gibba043.dnkmem (mgr.34373) 4567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:08.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.131995+0000 mgr.gibba043.dnkmem (mgr.34373) 4568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:08.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.132455+0000 mgr.gibba043.dnkmem (mgr.34373) 4569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:08.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cephadm 2021-03-10T15:17:06.133038+0000 mgr.gibba043.dnkmem (mgr.34373) 4570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:08.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[31385]: cluster 2021-03-10T15:17:06.858782+0000 mgr.gibba043.dnkmem (mgr.34373) 4571 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.101542+0000 mgr.gibba043.dnkmem (mgr.34373) 4557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.107833+0000 mgr.gibba043.dnkmem (mgr.34373) 4558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.111904+0000 mgr.gibba043.dnkmem (mgr.34373) 4559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.112517+0000 mgr.gibba043.dnkmem (mgr.34373) 4560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.116068+0000 mgr.gibba043.dnkmem (mgr.34373) 4561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.116568+0000 mgr.gibba043.dnkmem (mgr.34373) 4562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.119087+0000 mgr.gibba043.dnkmem (mgr.34373) 4563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.122398+0000 mgr.gibba043.dnkmem (mgr.34373) 4564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.122894+0000 mgr.gibba043.dnkmem (mgr.34373) 4565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.126718+0000 mgr.gibba043.dnkmem (mgr.34373) 4566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.128883+0000 mgr.gibba043.dnkmem (mgr.34373) 4567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.131995+0000 mgr.gibba043.dnkmem (mgr.34373) 4568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.132455+0000 mgr.gibba043.dnkmem (mgr.34373) 4569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cephadm 2021-03-10T15:17:06.133038+0000 mgr.gibba043.dnkmem (mgr.34373) 4570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:07 gibba003 bash[32348]: cluster 2021-03-10T15:17:06.858782+0000 mgr.gibba043.dnkmem (mgr.34373) 4571 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:09 gibba043 bash[24019]: cluster 2021-03-10T15:17:08.860173+0000 mgr.gibba043.dnkmem (mgr.34373) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:09 gibba003 bash[31385]: cluster 2021-03-10T15:17:08.860173+0000 mgr.gibba043.dnkmem (mgr.34373) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:09 gibba003 bash[32348]: cluster 2021-03-10T15:17:08.860173+0000 mgr.gibba043.dnkmem (mgr.34373) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:11 gibba043 bash[24019]: cluster 2021-03-10T15:17:10.861832+0000 mgr.gibba043.dnkmem (mgr.34373) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:12.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:11 gibba003 bash[31385]: cluster 2021-03-10T15:17:10.861832+0000 mgr.gibba043.dnkmem (mgr.34373) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:11 gibba003 bash[32348]: cluster 2021-03-10T15:17:10.861832+0000 mgr.gibba043.dnkmem (mgr.34373) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: cluster 2021-03-10T15:17:12.863339+0000 mgr.gibba043.dnkmem (mgr.34373) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.257433+0000 mon.c (mon.1) 1206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.258588+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.361935+0000 mon.c (mon.1) 1207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.363135+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.416481+0000 mon.c (mon.1) 1208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:17:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.417208+0000 mon.c (mon.1) 1209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:17:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.417820+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:17:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.417956+0000 mon.c (mon.1) 1210 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.418700+0000 mon.c (mon.1) 1211 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.419950+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:17:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.421068+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:13 gibba043 bash[24019]: audit 2021-03-10T15:17:13.421988+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: cluster 2021-03-10T15:17:12.863339+0000 mgr.gibba043.dnkmem (mgr.34373) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.257433+0000 mon.c (mon.1) 1206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.258588+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.361935+0000 mon.c (mon.1) 1207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.363135+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.416481+0000 mon.c (mon.1) 1208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:17:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.417208+0000 mon.c (mon.1) 1209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:17:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.417820+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:17:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.417956+0000 mon.c (mon.1) 1210 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.418700+0000 mon.c (mon.1) 1211 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.419950+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:17:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.421068+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[31385]: audit 2021-03-10T15:17:13.421988+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: cluster 2021-03-10T15:17:12.863339+0000 mgr.gibba043.dnkmem (mgr.34373) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.257433+0000 mon.c (mon.1) 1206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.258588+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.361935+0000 mon.c (mon.1) 1207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.363135+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.416481+0000 mon.c (mon.1) 1208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:17:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.417208+0000 mon.c (mon.1) 1209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:17:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.417820+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:17:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.417956+0000 mon.c (mon.1) 1210 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.418700+0000 mon.c (mon.1) 1211 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.419950+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:17:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.421068+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:17:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:13 gibba003 bash[32348]: audit 2021-03-10T15:17:13.421988+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:15 gibba003 bash[31385]: cluster 2021-03-10T15:17:14.864995+0000 mgr.gibba043.dnkmem (mgr.34373) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:15 gibba003 bash[32348]: cluster 2021-03-10T15:17:14.864995+0000 mgr.gibba043.dnkmem (mgr.34373) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:15 gibba043 bash[24019]: cluster 2021-03-10T15:17:14.864995+0000 mgr.gibba043.dnkmem (mgr.34373) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:17 gibba003 bash[31385]: cluster 2021-03-10T15:17:16.866616+0000 mgr.gibba043.dnkmem (mgr.34373) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:18.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:17 gibba003 bash[32348]: cluster 2021-03-10T15:17:16.866616+0000 mgr.gibba043.dnkmem (mgr.34373) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:17 gibba043 bash[24019]: cluster 2021-03-10T15:17:16.866616+0000 mgr.gibba043.dnkmem (mgr.34373) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:19 gibba003 bash[31385]: cluster 2021-03-10T15:17:18.868308+0000 mgr.gibba043.dnkmem (mgr.34373) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:19 gibba003 bash[32348]: cluster 2021-03-10T15:17:18.868308+0000 mgr.gibba043.dnkmem (mgr.34373) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:19 gibba043 bash[24019]: cluster 2021-03-10T15:17:18.868308+0000 mgr.gibba043.dnkmem (mgr.34373) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:21 gibba043 bash[24019]: cluster 2021-03-10T15:17:20.869700+0000 mgr.gibba043.dnkmem (mgr.34373) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:21 gibba003 bash[31385]: cluster 2021-03-10T15:17:20.869700+0000 mgr.gibba043.dnkmem (mgr.34373) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:21 gibba003 bash[32348]: cluster 2021-03-10T15:17:20.869700+0000 mgr.gibba043.dnkmem (mgr.34373) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:22 gibba043 bash[24019]: cephadm 2021-03-10T15:17:21.140573+0000 mgr.gibba043.dnkmem (mgr.34373) 4579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:22 gibba003 bash[31385]: cephadm 2021-03-10T15:17:21.140573+0000 mgr.gibba043.dnkmem (mgr.34373) 4579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:22 gibba003 bash[32348]: cephadm 2021-03-10T15:17:21.140573+0000 mgr.gibba043.dnkmem (mgr.34373) 4579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:23 gibba043 bash[24019]: cluster 2021-03-10T15:17:22.871216+0000 mgr.gibba043.dnkmem (mgr.34373) 4580 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:23 gibba003 bash[31385]: cluster 2021-03-10T15:17:22.871216+0000 mgr.gibba043.dnkmem (mgr.34373) 4580 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:23 gibba003 bash[32348]: cluster 2021-03-10T15:17:22.871216+0000 mgr.gibba043.dnkmem (mgr.34373) 4580 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:25 gibba003 bash[31385]: cluster 2021-03-10T15:17:24.872790+0000 mgr.gibba043.dnkmem (mgr.34373) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:25 gibba003 bash[32348]: cluster 2021-03-10T15:17:24.872790+0000 mgr.gibba043.dnkmem (mgr.34373) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:25 gibba043 bash[24019]: cluster 2021-03-10T15:17:24.872790+0000 mgr.gibba043.dnkmem (mgr.34373) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:27 gibba003 bash[31385]: cluster 2021-03-10T15:17:26.874463+0000 mgr.gibba043.dnkmem (mgr.34373) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:28.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:27 gibba003 bash[32348]: cluster 2021-03-10T15:17:26.874463+0000 mgr.gibba043.dnkmem (mgr.34373) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:27 gibba043 bash[24019]: cluster 2021-03-10T15:17:26.874463+0000 mgr.gibba043.dnkmem (mgr.34373) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:29 gibba043 bash[24019]: cluster 2021-03-10T15:17:28.876208+0000 mgr.gibba043.dnkmem (mgr.34373) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:30.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:29 gibba003 bash[31385]: cluster 2021-03-10T15:17:28.876208+0000 mgr.gibba043.dnkmem (mgr.34373) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:30.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:29 gibba003 bash[32348]: cluster 2021-03-10T15:17:28.876208+0000 mgr.gibba043.dnkmem (mgr.34373) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:31 gibba043 bash[24019]: cluster 2021-03-10T15:17:30.877575+0000 mgr.gibba043.dnkmem (mgr.34373) 4584 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:31 gibba003 bash[31385]: cluster 2021-03-10T15:17:30.877575+0000 mgr.gibba043.dnkmem (mgr.34373) 4584 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:32.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:31 gibba003 bash[32348]: cluster 2021-03-10T15:17:30.877575+0000 mgr.gibba043.dnkmem (mgr.34373) 4584 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:33 gibba043 bash[24019]: cluster 2021-03-10T15:17:32.878931+0000 mgr.gibba043.dnkmem (mgr.34373) 4585 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.382 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:17:34.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:33 gibba003 bash[31385]: cluster 2021-03-10T15:17:32.878931+0000 mgr.gibba043.dnkmem (mgr.34373) 4585 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:34 gibba003 bash[32348]: cluster 2021-03-10T15:17:32.878931+0000 mgr.gibba043.dnkmem (mgr.34373) 4585 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.615 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:17:34.615 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (85m) 28s ago 91m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:17:34.615 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (91m) 9m ago 91m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:17:34.615 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:17:34.616 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:17:34.616 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (85m) 28s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:17:34.616 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (85m) 28s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:17:34.616 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (85m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:17:34.617 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (85m) 28s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:17:34.617 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (91m) 28s ago 91m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:17:34.617 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (91m) 9m ago 91m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:17:34.617 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (84m) 28s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:17:34.618 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (83m) 28s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:17:34.618 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (83m) 28s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:17:34.618 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (82m) 28s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:17:34.618 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:17:34.618 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:17:34.619 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:17:34.619 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:17:34.619 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (90m) 9m ago 91m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:17:34.619 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 28s ago 89m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:17:34.864 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:17:34.864 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:17:34.865 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:34.865 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:17:34.865 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:17:34.865 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:34.866 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:17:34.866 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:17:34.866 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:17:34.866 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:17:34.867 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:17:34.867 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:17:34.867 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:17:34.867 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:17:34.867 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:17:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[31385]: audit 2021-03-10T15:17:34.370217+0000 mgr.gibba043.dnkmem (mgr.34373) 4586 : audit [DBG] from='client.47130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:35.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[31385]: audit 2021-03-10T15:17:34.599159+0000 mgr.gibba043.dnkmem (mgr.34373) 4587 : audit [DBG] from='client.57124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:35.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[31385]: audit 2021-03-10T15:17:34.862249+0000 mon.c (mon.1) 1212 : audit [DBG] from='client.? 172.21.2.103:0/4135474608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:35.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[31385]: cluster 2021-03-10T15:17:34.880612+0000 mgr.gibba043.dnkmem (mgr.34373) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[32348]: audit 2021-03-10T15:17:34.370217+0000 mgr.gibba043.dnkmem (mgr.34373) 4586 : audit [DBG] from='client.47130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[32348]: audit 2021-03-10T15:17:34.599159+0000 mgr.gibba043.dnkmem (mgr.34373) 4587 : audit [DBG] from='client.57124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[32348]: audit 2021-03-10T15:17:34.862249+0000 mon.c (mon.1) 1212 : audit [DBG] from='client.? 172.21.2.103:0/4135474608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:35.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:35 gibba003 bash[32348]: cluster 2021-03-10T15:17:34.880612+0000 mgr.gibba043.dnkmem (mgr.34373) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:35 gibba043 bash[24019]: audit 2021-03-10T15:17:34.370217+0000 mgr.gibba043.dnkmem (mgr.34373) 4586 : audit [DBG] from='client.47130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:35 gibba043 bash[24019]: audit 2021-03-10T15:17:34.599159+0000 mgr.gibba043.dnkmem (mgr.34373) 4587 : audit [DBG] from='client.57124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:35 gibba043 bash[24019]: audit 2021-03-10T15:17:34.862249+0000 mon.c (mon.1) 1212 : audit [DBG] from='client.? 172.21.2.103:0/4135474608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:35 gibba043 bash[24019]: cluster 2021-03-10T15:17:34.880612+0000 mgr.gibba043.dnkmem (mgr.34373) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:37 gibba043 bash[24019]: cephadm 2021-03-10T15:17:36.154089+0000 mgr.gibba043.dnkmem (mgr.34373) 4589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:38.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:37 gibba043 bash[24019]: cluster 2021-03-10T15:17:36.882279+0000 mgr.gibba043.dnkmem (mgr.34373) 4590 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:37 gibba003 bash[31385]: cephadm 2021-03-10T15:17:36.154089+0000 mgr.gibba043.dnkmem (mgr.34373) 4589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:37 gibba003 bash[31385]: cluster 2021-03-10T15:17:36.882279+0000 mgr.gibba043.dnkmem (mgr.34373) 4590 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:37 gibba003 bash[32348]: cephadm 2021-03-10T15:17:36.154089+0000 mgr.gibba043.dnkmem (mgr.34373) 4589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:37 gibba003 bash[32348]: cluster 2021-03-10T15:17:36.882279+0000 mgr.gibba043.dnkmem (mgr.34373) 4590 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:39 gibba043 bash[24019]: cluster 2021-03-10T15:17:38.883945+0000 mgr.gibba043.dnkmem (mgr.34373) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:39 gibba003 bash[31385]: cluster 2021-03-10T15:17:38.883945+0000 mgr.gibba043.dnkmem (mgr.34373) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:40.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:39 gibba003 bash[32348]: cluster 2021-03-10T15:17:38.883945+0000 mgr.gibba043.dnkmem (mgr.34373) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:41 gibba043 bash[24019]: cluster 2021-03-10T15:17:40.885661+0000 mgr.gibba043.dnkmem (mgr.34373) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:41 gibba003 bash[31385]: cluster 2021-03-10T15:17:40.885661+0000 mgr.gibba043.dnkmem (mgr.34373) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:41 gibba003 bash[32348]: cluster 2021-03-10T15:17:40.885661+0000 mgr.gibba043.dnkmem (mgr.34373) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:43 gibba043 bash[24019]: cluster 2021-03-10T15:17:42.887191+0000 mgr.gibba043.dnkmem (mgr.34373) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:44.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:43 gibba003 bash[31385]: cluster 2021-03-10T15:17:42.887191+0000 mgr.gibba043.dnkmem (mgr.34373) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:44.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:43 gibba003 bash[32348]: cluster 2021-03-10T15:17:42.887191+0000 mgr.gibba043.dnkmem (mgr.34373) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:45 gibba003 bash[31385]: cluster 2021-03-10T15:17:44.889118+0000 mgr.gibba043.dnkmem (mgr.34373) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:45 gibba003 bash[32348]: cluster 2021-03-10T15:17:44.889118+0000 mgr.gibba043.dnkmem (mgr.34373) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:45 gibba043 bash[24019]: cluster 2021-03-10T15:17:44.889118+0000 mgr.gibba043.dnkmem (mgr.34373) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:47 gibba043 bash[24019]: cluster 2021-03-10T15:17:46.890768+0000 mgr.gibba043.dnkmem (mgr.34373) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:48.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:47 gibba003 bash[31385]: cluster 2021-03-10T15:17:46.890768+0000 mgr.gibba043.dnkmem (mgr.34373) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:47 gibba003 bash[32348]: cluster 2021-03-10T15:17:46.890768+0000 mgr.gibba043.dnkmem (mgr.34373) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:49 gibba043 bash[24019]: cluster 2021-03-10T15:17:48.892297+0000 mgr.gibba043.dnkmem (mgr.34373) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:50.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:49 gibba003 bash[31385]: cluster 2021-03-10T15:17:48.892297+0000 mgr.gibba043.dnkmem (mgr.34373) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:50.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:49 gibba003 bash[32348]: cluster 2021-03-10T15:17:48.892297+0000 mgr.gibba043.dnkmem (mgr.34373) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:51 gibba043 bash[24019]: cluster 2021-03-10T15:17:50.893998+0000 mgr.gibba043.dnkmem (mgr.34373) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:51 gibba003 bash[31385]: cluster 2021-03-10T15:17:50.893998+0000 mgr.gibba043.dnkmem (mgr.34373) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:51 gibba003 bash[32348]: cluster 2021-03-10T15:17:50.893998+0000 mgr.gibba043.dnkmem (mgr.34373) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:52 gibba043 bash[24019]: cephadm 2021-03-10T15:17:51.156802+0000 mgr.gibba043.dnkmem (mgr.34373) 4598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:53.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:52 gibba003 bash[31385]: cephadm 2021-03-10T15:17:51.156802+0000 mgr.gibba043.dnkmem (mgr.34373) 4598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:52 gibba003 bash[32348]: cephadm 2021-03-10T15:17:51.156802+0000 mgr.gibba043.dnkmem (mgr.34373) 4598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:17:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:53 gibba043 bash[24019]: cluster 2021-03-10T15:17:52.895523+0000 mgr.gibba043.dnkmem (mgr.34373) 4599 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:54.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:53 gibba003 bash[31385]: cluster 2021-03-10T15:17:52.895523+0000 mgr.gibba043.dnkmem (mgr.34373) 4599 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:53 gibba003 bash[32348]: cluster 2021-03-10T15:17:52.895523+0000 mgr.gibba043.dnkmem (mgr.34373) 4599 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:55 gibba003 bash[31385]: cluster 2021-03-10T15:17:54.897251+0000 mgr.gibba043.dnkmem (mgr.34373) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:55.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:55 gibba003 bash[32348]: cluster 2021-03-10T15:17:54.897251+0000 mgr.gibba043.dnkmem (mgr.34373) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:55 gibba043 bash[24019]: cluster 2021-03-10T15:17:54.897251+0000 mgr.gibba043.dnkmem (mgr.34373) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:57 gibba043 bash[24019]: cluster 2021-03-10T15:17:56.898870+0000 mgr.gibba043.dnkmem (mgr.34373) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:58.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:57 gibba003 bash[31385]: cluster 2021-03-10T15:17:56.898870+0000 mgr.gibba043.dnkmem (mgr.34373) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:57 gibba003 bash[32348]: cluster 2021-03-10T15:17:56.898870+0000 mgr.gibba043.dnkmem (mgr.34373) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:17:59 gibba043 bash[24019]: cluster 2021-03-10T15:17:58.900525+0000 mgr.gibba043.dnkmem (mgr.34373) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:17:59 gibba003 bash[31385]: cluster 2021-03-10T15:17:58.900525+0000 mgr.gibba043.dnkmem (mgr.34373) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:17:59 gibba003 bash[32348]: cluster 2021-03-10T15:17:58.900525+0000 mgr.gibba043.dnkmem (mgr.34373) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:01 gibba043 bash[24019]: cluster 2021-03-10T15:18:00.902222+0000 mgr.gibba043.dnkmem (mgr.34373) 4603 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:01 gibba003 bash[32348]: cluster 2021-03-10T15:18:00.902222+0000 mgr.gibba043.dnkmem (mgr.34373) 4603 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:01 gibba003 bash[31385]: cluster 2021-03-10T15:18:00.902222+0000 mgr.gibba043.dnkmem (mgr.34373) 4603 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:03 gibba043 bash[24019]: cluster 2021-03-10T15:18:02.903785+0000 mgr.gibba043.dnkmem (mgr.34373) 4604 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:03 gibba003 bash[32348]: cluster 2021-03-10T15:18:02.903785+0000 mgr.gibba043.dnkmem (mgr.34373) 4604 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:03 gibba003 bash[31385]: cluster 2021-03-10T15:18:02.903785+0000 mgr.gibba043.dnkmem (mgr.34373) 4604 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:05.107 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:18:05.341 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:18:05.341 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (86m) 59s ago 91m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:18:05.342 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (91m) 10m ago 91m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:18:05.342 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (86m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:18:05.342 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (87m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:18:05.342 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (86m) 59s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:18:05.343 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (85m) 59s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:18:05.343 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (85m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:18:05.343 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (85m) 59s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:18:05.343 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (91m) 59s ago 91m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:18:05.344 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (91m) 10m ago 91m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:18:05.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (84m) 59s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:18:05.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (84m) 59s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:18:05.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (83m) 59s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:18:05.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (83m) 59s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:18:05.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:18:05.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:18:05.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (82m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:18:05.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (81m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:18:05.346 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (91m) 10m ago 91m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:18:05.346 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 59s ago 89m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:18:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:05 gibba003 bash[31385]: cluster 2021-03-10T15:18:04.905532+0000 mgr.gibba043.dnkmem (mgr.34373) 4605 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:05 gibba003 bash[32348]: cluster 2021-03-10T15:18:04.905532+0000 mgr.gibba043.dnkmem (mgr.34373) 4605 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:05 gibba043 bash[24019]: cluster 2021-03-10T15:18:04.905532+0000 mgr.gibba043.dnkmem (mgr.34373) 4605 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:05.590 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:18:05.590 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:18:05.591 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:05.591 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:18:05.591 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:18:05.591 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:05.592 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:18:05.592 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:18:05.592 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:18:05.592 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:18:05.592 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:18:05.593 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:18:05.593 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:18:05.593 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:18:05.593 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:18:06.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[31385]: audit 2021-03-10T15:18:05.095422+0000 mgr.gibba043.dnkmem (mgr.34373) 4606 : audit [DBG] from='client.57136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:06.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[31385]: audit 2021-03-10T15:18:05.326499+0000 mgr.gibba043.dnkmem (mgr.34373) 4607 : audit [DBG] from='client.57142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:06.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[31385]: audit 2021-03-10T15:18:05.588357+0000 mon.c (mon.1) 1213 : audit [DBG] from='client.? 172.21.2.103:0/1535069709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:06.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[31385]: audit 2021-03-10T15:18:06.176618+0000 mon.c (mon.1) 1214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[32348]: audit 2021-03-10T15:18:05.095422+0000 mgr.gibba043.dnkmem (mgr.34373) 4606 : audit [DBG] from='client.57136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[32348]: audit 2021-03-10T15:18:05.326499+0000 mgr.gibba043.dnkmem (mgr.34373) 4607 : audit [DBG] from='client.57142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[32348]: audit 2021-03-10T15:18:05.588357+0000 mon.c (mon.1) 1213 : audit [DBG] from='client.? 172.21.2.103:0/1535069709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:06.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:06 gibba003 bash[32348]: audit 2021-03-10T15:18:06.176618+0000 mon.c (mon.1) 1214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:06.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:06 gibba043 bash[24019]: audit 2021-03-10T15:18:05.095422+0000 mgr.gibba043.dnkmem (mgr.34373) 4606 : audit [DBG] from='client.57136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:06.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:06 gibba043 bash[24019]: audit 2021-03-10T15:18:05.326499+0000 mgr.gibba043.dnkmem (mgr.34373) 4607 : audit [DBG] from='client.57142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:06.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:06 gibba043 bash[24019]: audit 2021-03-10T15:18:05.588357+0000 mon.c (mon.1) 1213 : audit [DBG] from='client.? 172.21.2.103:0/1535069709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:06.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:06 gibba043 bash[24019]: audit 2021-03-10T15:18:06.176618+0000 mon.c (mon.1) 1214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:07 gibba043 bash[24019]: cephadm 2021-03-10T15:18:06.173425+0000 mgr.gibba043.dnkmem (mgr.34373) 4608 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:18:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:07 gibba043 bash[24019]: cluster 2021-03-10T15:18:06.907260+0000 mgr.gibba043.dnkmem (mgr.34373) 4609 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:07 gibba003 bash[31385]: cephadm 2021-03-10T15:18:06.173425+0000 mgr.gibba043.dnkmem (mgr.34373) 4608 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:18:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:07 gibba003 bash[31385]: cluster 2021-03-10T15:18:06.907260+0000 mgr.gibba043.dnkmem (mgr.34373) 4609 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:07.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:07 gibba003 bash[32348]: cephadm 2021-03-10T15:18:06.173425+0000 mgr.gibba043.dnkmem (mgr.34373) 4608 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:18:07.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:07 gibba003 bash[32348]: cluster 2021-03-10T15:18:06.907260+0000 mgr.gibba043.dnkmem (mgr.34373) 4609 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:09 gibba043 bash[24019]: cluster 2021-03-10T15:18:08.908840+0000 mgr.gibba043.dnkmem (mgr.34373) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:09 gibba043 bash[24019]: audit 2021-03-10T15:18:09.957460+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:10.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:09 gibba043 bash[24019]: audit 2021-03-10T15:18:09.959022+0000 mon.c (mon.1) 1215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:18:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:09 gibba003 bash[31385]: cluster 2021-03-10T15:18:08.908840+0000 mgr.gibba043.dnkmem (mgr.34373) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:09 gibba003 bash[31385]: audit 2021-03-10T15:18:09.957460+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:09 gibba003 bash[31385]: audit 2021-03-10T15:18:09.959022+0000 mon.c (mon.1) 1215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:18:10.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:09 gibba003 bash[32348]: cluster 2021-03-10T15:18:08.908840+0000 mgr.gibba043.dnkmem (mgr.34373) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:09 gibba003 bash[32348]: audit 2021-03-10T15:18:09.957460+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:10.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:09 gibba003 bash[32348]: audit 2021-03-10T15:18:09.959022+0000 mon.c (mon.1) 1215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:18:12.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:11 gibba043 bash[24019]: cluster 2021-03-10T15:18:10.910160+0000 mgr.gibba043.dnkmem (mgr.34373) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:11 gibba003 bash[32348]: cluster 2021-03-10T15:18:10.910160+0000 mgr.gibba043.dnkmem (mgr.34373) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:11 gibba003 bash[31385]: cluster 2021-03-10T15:18:10.910160+0000 mgr.gibba043.dnkmem (mgr.34373) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: cluster 2021-03-10T15:18:12.910625+0000 mgr.gibba043.dnkmem (mgr.34373) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.264286+0000 mon.c (mon.1) 1216 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.265387+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.369822+0000 mon.c (mon.1) 1217 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.370955+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.426565+0000 mon.c (mon.1) 1218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:18:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.427342+0000 mon.c (mon.1) 1219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.427822+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:18:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.428028+0000 mon.c (mon.1) 1220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.428691+0000 mon.c (mon.1) 1221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.429043+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.430209+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:13 gibba043 bash[24019]: audit 2021-03-10T15:18:13.431044+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: cluster 2021-03-10T15:18:12.910625+0000 mgr.gibba043.dnkmem (mgr.34373) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.264286+0000 mon.c (mon.1) 1216 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.265387+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.369822+0000 mon.c (mon.1) 1217 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.370955+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.426565+0000 mon.c (mon.1) 1218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:18:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.427342+0000 mon.c (mon.1) 1219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.427822+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:18:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.428028+0000 mon.c (mon.1) 1220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.428691+0000 mon.c (mon.1) 1221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.429043+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.430209+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[31385]: audit 2021-03-10T15:18:13.431044+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: cluster 2021-03-10T15:18:12.910625+0000 mgr.gibba043.dnkmem (mgr.34373) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.264286+0000 mon.c (mon.1) 1216 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.265387+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.369822+0000 mon.c (mon.1) 1217 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.370955+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.426565+0000 mon.c (mon.1) 1218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:18:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.427342+0000 mon.c (mon.1) 1219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.427822+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:18:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.428028+0000 mon.c (mon.1) 1220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.428691+0000 mon.c (mon.1) 1221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.429043+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.430209+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:18:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:13 gibba003 bash[32348]: audit 2021-03-10T15:18:13.431044+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.512518+0000 mon.c (mon.1) 1222 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.691539+0000 mgr.gibba043.dnkmem (mgr.34373) 4613 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:18:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.691631+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.881693+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.883460+0000 mgr.gibba043.dnkmem (mgr.34373) 4614 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:18:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.885470+0000 mgr.gibba043.dnkmem (mgr.34373) 4615 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:18:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.885563+0000 mon.c (mon.1) 1223 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.886616+0000 mgr.gibba043.dnkmem (mgr.34373) 4616 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:18:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.886653+0000 mgr.gibba043.dnkmem (mgr.34373) 4617 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:18:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.886951+0000 mon.c (mon.1) 1224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.888028+0000 mgr.gibba043.dnkmem (mgr.34373) 4618 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:18:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.888065+0000 mgr.gibba043.dnkmem (mgr.34373) 4619 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:18:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.888305+0000 mon.c (mon.1) 1225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.889246+0000 mgr.gibba043.dnkmem (mgr.34373) 4620 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:18:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.889535+0000 mon.c (mon.1) 1226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.890793+0000 mgr.gibba043.dnkmem (mgr.34373) 4621 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:18:15.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.890830+0000 mgr.gibba043.dnkmem (mgr.34373) 4622 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:18:15.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.892067+0000 mgr.gibba043.dnkmem (mgr.34373) 4623 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:18:15.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.892380+0000 mgr.gibba043.dnkmem (mgr.34373) 4624 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:18:15.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.892386+0000 mon.c (mon.1) 1227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.893788+0000 mgr.gibba043.dnkmem (mgr.34373) 4625 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:18:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.512518+0000 mon.c (mon.1) 1222 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.691539+0000 mgr.gibba043.dnkmem (mgr.34373) 4613 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:18:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.691631+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.881693+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.883460+0000 mgr.gibba043.dnkmem (mgr.34373) 4614 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:18:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.885470+0000 mgr.gibba043.dnkmem (mgr.34373) 4615 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:18:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.885563+0000 mon.c (mon.1) 1223 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.886616+0000 mgr.gibba043.dnkmem (mgr.34373) 4616 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:18:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.886653+0000 mgr.gibba043.dnkmem (mgr.34373) 4617 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:18:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.886951+0000 mon.c (mon.1) 1224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.888028+0000 mgr.gibba043.dnkmem (mgr.34373) 4618 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:18:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.888065+0000 mgr.gibba043.dnkmem (mgr.34373) 4619 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:18:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.888305+0000 mon.c (mon.1) 1225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.889246+0000 mgr.gibba043.dnkmem (mgr.34373) 4620 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:18:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.889535+0000 mon.c (mon.1) 1226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.890793+0000 mgr.gibba043.dnkmem (mgr.34373) 4621 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:18:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.890830+0000 mgr.gibba043.dnkmem (mgr.34373) 4622 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:18:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.892067+0000 mgr.gibba043.dnkmem (mgr.34373) 4623 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:18:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.892380+0000 mgr.gibba043.dnkmem (mgr.34373) 4624 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:18:15.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.892386+0000 mon.c (mon.1) 1227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.893788+0000 mgr.gibba043.dnkmem (mgr.34373) 4625 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:18:15.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.893826+0000 mgr.gibba043.dnkmem (mgr.34373) 4626 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:18:15.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: audit 2021-03-10T15:18:14.893853+0000 mon.c (mon.1) 1228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cephadm 2021-03-10T15:18:14.893931+0000 mgr.gibba043.dnkmem (mgr.34373) 4627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:15.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[31385]: cluster 2021-03-10T15:18:14.911197+0000 mgr.gibba043.dnkmem (mgr.34373) 4628 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:15.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.893826+0000 mgr.gibba043.dnkmem (mgr.34373) 4626 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:18:15.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: audit 2021-03-10T15:18:14.893853+0000 mon.c (mon.1) 1228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cephadm 2021-03-10T15:18:14.893931+0000 mgr.gibba043.dnkmem (mgr.34373) 4627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:15.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:15 gibba003 bash[32348]: cluster 2021-03-10T15:18:14.911197+0000 mgr.gibba043.dnkmem (mgr.34373) 4628 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.512518+0000 mon.c (mon.1) 1222 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.691539+0000 mgr.gibba043.dnkmem (mgr.34373) 4613 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:18:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.691631+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.881693+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:18:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.883460+0000 mgr.gibba043.dnkmem (mgr.34373) 4614 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:18:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.885470+0000 mgr.gibba043.dnkmem (mgr.34373) 4615 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:18:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.885563+0000 mon.c (mon.1) 1223 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.886616+0000 mgr.gibba043.dnkmem (mgr.34373) 4616 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:18:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.886653+0000 mgr.gibba043.dnkmem (mgr.34373) 4617 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:18:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.886951+0000 mon.c (mon.1) 1224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.888028+0000 mgr.gibba043.dnkmem (mgr.34373) 4618 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:18:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.888065+0000 mgr.gibba043.dnkmem (mgr.34373) 4619 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:18:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.888305+0000 mon.c (mon.1) 1225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.889246+0000 mgr.gibba043.dnkmem (mgr.34373) 4620 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:18:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.889535+0000 mon.c (mon.1) 1226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.890793+0000 mgr.gibba043.dnkmem (mgr.34373) 4621 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:18:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.890830+0000 mgr.gibba043.dnkmem (mgr.34373) 4622 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:18:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.892067+0000 mgr.gibba043.dnkmem (mgr.34373) 4623 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:18:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.892380+0000 mgr.gibba043.dnkmem (mgr.34373) 4624 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:18:15.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.892386+0000 mon.c (mon.1) 1227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.893788+0000 mgr.gibba043.dnkmem (mgr.34373) 4625 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:18:15.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.893826+0000 mgr.gibba043.dnkmem (mgr.34373) 4626 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:18:15.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: audit 2021-03-10T15:18:14.893853+0000 mon.c (mon.1) 1228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cephadm 2021-03-10T15:18:14.893931+0000 mgr.gibba043.dnkmem (mgr.34373) 4627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:15.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:15 gibba043 bash[24019]: cluster 2021-03-10T15:18:14.911197+0000 mgr.gibba043.dnkmem (mgr.34373) 4628 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:17 gibba043 bash[24019]: cluster 2021-03-10T15:18:16.912722+0000 mgr.gibba043.dnkmem (mgr.34373) 4629 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:17 gibba003 bash[31385]: cluster 2021-03-10T15:18:16.912722+0000 mgr.gibba043.dnkmem (mgr.34373) 4629 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:17 gibba003 bash[32348]: cluster 2021-03-10T15:18:16.912722+0000 mgr.gibba043.dnkmem (mgr.34373) 4629 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:19 gibba043 bash[24019]: cluster 2021-03-10T15:18:18.914232+0000 mgr.gibba043.dnkmem (mgr.34373) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:19 gibba003 bash[31385]: cluster 2021-03-10T15:18:18.914232+0000 mgr.gibba043.dnkmem (mgr.34373) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:19 gibba003 bash[32348]: cluster 2021-03-10T15:18:18.914232+0000 mgr.gibba043.dnkmem (mgr.34373) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:21 gibba043 bash[24019]: cluster 2021-03-10T15:18:20.915930+0000 mgr.gibba043.dnkmem (mgr.34373) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:21 gibba003 bash[31385]: cluster 2021-03-10T15:18:20.915930+0000 mgr.gibba043.dnkmem (mgr.34373) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:21 gibba003 bash[32348]: cluster 2021-03-10T15:18:20.915930+0000 mgr.gibba043.dnkmem (mgr.34373) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:24 gibba043 bash[24019]: cluster 2021-03-10T15:18:22.917503+0000 mgr.gibba043.dnkmem (mgr.34373) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:24 gibba003 bash[31385]: cluster 2021-03-10T15:18:22.917503+0000 mgr.gibba043.dnkmem (mgr.34373) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:24 gibba003 bash[32348]: cluster 2021-03-10T15:18:22.917503+0000 mgr.gibba043.dnkmem (mgr.34373) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:25 gibba043 bash[24019]: cluster 2021-03-10T15:18:24.919301+0000 mgr.gibba043.dnkmem (mgr.34373) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:25.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:25 gibba003 bash[31385]: cluster 2021-03-10T15:18:24.919301+0000 mgr.gibba043.dnkmem (mgr.34373) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:25 gibba003 bash[32348]: cluster 2021-03-10T15:18:24.919301+0000 mgr.gibba043.dnkmem (mgr.34373) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:27 gibba043 bash[24019]: cluster 2021-03-10T15:18:26.920918+0000 mgr.gibba043.dnkmem (mgr.34373) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:27 gibba003 bash[31385]: cluster 2021-03-10T15:18:26.920918+0000 mgr.gibba043.dnkmem (mgr.34373) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:27 gibba003 bash[32348]: cluster 2021-03-10T15:18:26.920918+0000 mgr.gibba043.dnkmem (mgr.34373) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:29 gibba043 bash[24019]: cluster 2021-03-10T15:18:28.922532+0000 mgr.gibba043.dnkmem (mgr.34373) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:29 gibba003 bash[31385]: cluster 2021-03-10T15:18:28.922532+0000 mgr.gibba043.dnkmem (mgr.34373) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:29 gibba003 bash[32348]: cluster 2021-03-10T15:18:28.922532+0000 mgr.gibba043.dnkmem (mgr.34373) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:30 gibba043 bash[24019]: cephadm 2021-03-10T15:18:29.908476+0000 mgr.gibba043.dnkmem (mgr.34373) 4636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:30 gibba003 bash[31385]: cephadm 2021-03-10T15:18:29.908476+0000 mgr.gibba043.dnkmem (mgr.34373) 4636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:30 gibba003 bash[32348]: cephadm 2021-03-10T15:18:29.908476+0000 mgr.gibba043.dnkmem (mgr.34373) 4636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:32 gibba043 bash[24019]: cluster 2021-03-10T15:18:30.924333+0000 mgr.gibba043.dnkmem (mgr.34373) 4637 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:32 gibba003 bash[31385]: cluster 2021-03-10T15:18:30.924333+0000 mgr.gibba043.dnkmem (mgr.34373) 4637 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:32 gibba003 bash[32348]: cluster 2021-03-10T15:18:30.924333+0000 mgr.gibba043.dnkmem (mgr.34373) 4637 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:34 gibba003 bash[31385]: cluster 2021-03-10T15:18:32.925767+0000 mgr.gibba043.dnkmem (mgr.34373) 4638 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:34 gibba003 bash[32348]: cluster 2021-03-10T15:18:32.925767+0000 mgr.gibba043.dnkmem (mgr.34373) 4638 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:34 gibba043 bash[24019]: cluster 2021-03-10T15:18:32.925767+0000 mgr.gibba043.dnkmem (mgr.34373) 4638 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:35 gibba043 bash[24019]: cluster 2021-03-10T15:18:34.927615+0000 mgr.gibba043.dnkmem (mgr.34373) 4639 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:35 gibba003 bash[31385]: cluster 2021-03-10T15:18:34.927615+0000 mgr.gibba043.dnkmem (mgr.34373) 4639 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:35 gibba003 bash[32348]: cluster 2021-03-10T15:18:34.927615+0000 mgr.gibba043.dnkmem (mgr.34373) 4639 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.835 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:18:36.061 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:18:36.062 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (86m) 90s ago 92m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:18:36.062 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (92m) 26s ago 92m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:18:36.062 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (87m) 26s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:18:36.063 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (87m) 26s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:18:36.063 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (86m) 90s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:18:36.063 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (86m) 90s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:18:36.063 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (86m) 26s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:18:36.064 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (86m) 90s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:18:36.064 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (92m) 90s ago 92m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:18:36.064 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (92m) 26s ago 92m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:18:36.065 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (85m) 90s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:18:36.065 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (84m) 90s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:18:36.065 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (84m) 90s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:18:36.065 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (83m) 90s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:18:36.066 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (83m) 26s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:18:36.066 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (83m) 26s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:18:36.066 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (82m) 26s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:18:36.066 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (82m) 26s ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:18:36.067 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (91m) 26s ago 92m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:18:36.067 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 90s ago 90m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:18:36.317 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:18:36.317 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:18:36.317 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:36.317 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:18:36.318 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:18:36.318 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:36.318 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:18:36.318 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:18:36.319 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:18:36.319 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:18:36.319 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:18:36.319 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:18:36.319 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:18:36.320 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:18:36.320 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:18:36.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:36 gibba043 bash[24019]: audit 2021-03-10T15:18:35.822863+0000 mgr.gibba043.dnkmem (mgr.34373) 4640 : audit [DBG] from='client.57154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:36.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:36 gibba003 bash[31385]: audit 2021-03-10T15:18:35.822863+0000 mgr.gibba043.dnkmem (mgr.34373) 4640 : audit [DBG] from='client.57154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:36 gibba003 bash[32348]: audit 2021-03-10T15:18:35.822863+0000 mgr.gibba043.dnkmem (mgr.34373) 4640 : audit [DBG] from='client.57154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:37 gibba043 bash[24019]: audit 2021-03-10T15:18:36.046606+0000 mgr.gibba043.dnkmem (mgr.34373) 4641 : audit [DBG] from='client.57160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:37 gibba043 bash[24019]: audit 2021-03-10T15:18:36.315106+0000 mon.a (mon.0) 1185 : audit [DBG] from='client.? 172.21.2.103:0/769898962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:37 gibba043 bash[24019]: cluster 2021-03-10T15:18:36.928971+0000 mgr.gibba043.dnkmem (mgr.34373) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:37 gibba003 bash[31385]: audit 2021-03-10T15:18:36.046606+0000 mgr.gibba043.dnkmem (mgr.34373) 4641 : audit [DBG] from='client.57160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:37.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:37 gibba003 bash[31385]: audit 2021-03-10T15:18:36.315106+0000 mon.a (mon.0) 1185 : audit [DBG] from='client.? 172.21.2.103:0/769898962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:37.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:37 gibba003 bash[31385]: cluster 2021-03-10T15:18:36.928971+0000 mgr.gibba043.dnkmem (mgr.34373) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:37 gibba003 bash[32348]: audit 2021-03-10T15:18:36.046606+0000 mgr.gibba043.dnkmem (mgr.34373) 4641 : audit [DBG] from='client.57160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:37 gibba003 bash[32348]: audit 2021-03-10T15:18:36.315106+0000 mon.a (mon.0) 1185 : audit [DBG] from='client.? 172.21.2.103:0/769898962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:37 gibba003 bash[32348]: cluster 2021-03-10T15:18:36.928971+0000 mgr.gibba043.dnkmem (mgr.34373) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:39 gibba043 bash[24019]: cluster 2021-03-10T15:18:38.930454+0000 mgr.gibba043.dnkmem (mgr.34373) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:39 gibba003 bash[31385]: cluster 2021-03-10T15:18:38.930454+0000 mgr.gibba043.dnkmem (mgr.34373) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:40.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:39 gibba003 bash[32348]: cluster 2021-03-10T15:18:38.930454+0000 mgr.gibba043.dnkmem (mgr.34373) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:42 gibba043 bash[24019]: cluster 2021-03-10T15:18:40.932127+0000 mgr.gibba043.dnkmem (mgr.34373) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:42 gibba003 bash[31385]: cluster 2021-03-10T15:18:40.932127+0000 mgr.gibba043.dnkmem (mgr.34373) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:42 gibba003 bash[32348]: cluster 2021-03-10T15:18:40.932127+0000 mgr.gibba043.dnkmem (mgr.34373) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:44 gibba043 bash[24019]: cluster 2021-03-10T15:18:42.933612+0000 mgr.gibba043.dnkmem (mgr.34373) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:44.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:44 gibba003 bash[31385]: cluster 2021-03-10T15:18:42.933612+0000 mgr.gibba043.dnkmem (mgr.34373) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:44.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:44 gibba003 bash[32348]: cluster 2021-03-10T15:18:42.933612+0000 mgr.gibba043.dnkmem (mgr.34373) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:45 gibba043 bash[24019]: cephadm 2021-03-10T15:18:44.924287+0000 mgr.gibba043.dnkmem (mgr.34373) 4646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:45 gibba043 bash[24019]: cluster 2021-03-10T15:18:44.935217+0000 mgr.gibba043.dnkmem (mgr.34373) 4647 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:45 gibba003 bash[31385]: cephadm 2021-03-10T15:18:44.924287+0000 mgr.gibba043.dnkmem (mgr.34373) 4646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:45.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:45 gibba003 bash[31385]: cluster 2021-03-10T15:18:44.935217+0000 mgr.gibba043.dnkmem (mgr.34373) 4647 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:45 gibba003 bash[32348]: cephadm 2021-03-10T15:18:44.924287+0000 mgr.gibba043.dnkmem (mgr.34373) 4646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:18:45.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:45 gibba003 bash[32348]: cluster 2021-03-10T15:18:44.935217+0000 mgr.gibba043.dnkmem (mgr.34373) 4647 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:48 gibba043 bash[24019]: cluster 2021-03-10T15:18:46.936906+0000 mgr.gibba043.dnkmem (mgr.34373) 4648 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:48.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:48 gibba003 bash[31385]: cluster 2021-03-10T15:18:46.936906+0000 mgr.gibba043.dnkmem (mgr.34373) 4648 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:48.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:48 gibba003 bash[32348]: cluster 2021-03-10T15:18:46.936906+0000 mgr.gibba043.dnkmem (mgr.34373) 4648 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:50 gibba043 bash[24019]: cluster 2021-03-10T15:18:48.938553+0000 mgr.gibba043.dnkmem (mgr.34373) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:50.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:50 gibba003 bash[31385]: cluster 2021-03-10T15:18:48.938553+0000 mgr.gibba043.dnkmem (mgr.34373) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:50.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:50 gibba003 bash[32348]: cluster 2021-03-10T15:18:48.938553+0000 mgr.gibba043.dnkmem (mgr.34373) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:52.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:52 gibba043 bash[24019]: cluster 2021-03-10T15:18:50.940276+0000 mgr.gibba043.dnkmem (mgr.34373) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:52.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:52 gibba003 bash[31385]: cluster 2021-03-10T15:18:50.940276+0000 mgr.gibba043.dnkmem (mgr.34373) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:52.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:52 gibba003 bash[32348]: cluster 2021-03-10T15:18:50.940276+0000 mgr.gibba043.dnkmem (mgr.34373) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:54.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:54 gibba003 bash[31385]: cluster 2021-03-10T15:18:52.941799+0000 mgr.gibba043.dnkmem (mgr.34373) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:54.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:54 gibba003 bash[32348]: cluster 2021-03-10T15:18:52.941799+0000 mgr.gibba043.dnkmem (mgr.34373) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:54 gibba043 bash[24019]: cluster 2021-03-10T15:18:52.941799+0000 mgr.gibba043.dnkmem (mgr.34373) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:55 gibba043 bash[24019]: cluster 2021-03-10T15:18:54.943383+0000 mgr.gibba043.dnkmem (mgr.34373) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:55 gibba003 bash[31385]: cluster 2021-03-10T15:18:54.943383+0000 mgr.gibba043.dnkmem (mgr.34373) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:55 gibba003 bash[32348]: cluster 2021-03-10T15:18:54.943383+0000 mgr.gibba043.dnkmem (mgr.34373) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:18:58 gibba043 bash[24019]: cluster 2021-03-10T15:18:56.944980+0000 mgr.gibba043.dnkmem (mgr.34373) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:58.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:18:58 gibba003 bash[31385]: cluster 2021-03-10T15:18:56.944980+0000 mgr.gibba043.dnkmem (mgr.34373) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:18:58 gibba003 bash[32348]: cluster 2021-03-10T15:18:56.944980+0000 mgr.gibba043.dnkmem (mgr.34373) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:00 gibba043 bash[24019]: cluster 2021-03-10T15:18:58.946494+0000 mgr.gibba043.dnkmem (mgr.34373) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:00 gibba003 bash[31385]: cluster 2021-03-10T15:18:58.946494+0000 mgr.gibba043.dnkmem (mgr.34373) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:00.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:00 gibba003 bash[32348]: cluster 2021-03-10T15:18:58.946494+0000 mgr.gibba043.dnkmem (mgr.34373) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:01 gibba003 bash[32348]: cephadm 2021-03-10T15:18:59.936516+0000 mgr.gibba043.dnkmem (mgr.34373) 4655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:01 gibba003 bash[31385]: cephadm 2021-03-10T15:18:59.936516+0000 mgr.gibba043.dnkmem (mgr.34373) 4655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:01 gibba043 bash[24019]: cephadm 2021-03-10T15:18:59.936516+0000 mgr.gibba043.dnkmem (mgr.34373) 4655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:02 gibba003 bash[31385]: cluster 2021-03-10T15:19:00.947994+0000 mgr.gibba043.dnkmem (mgr.34373) 4656 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:02 gibba003 bash[32348]: cluster 2021-03-10T15:19:00.947994+0000 mgr.gibba043.dnkmem (mgr.34373) 4656 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:02 gibba043 bash[24019]: cluster 2021-03-10T15:19:00.947994+0000 mgr.gibba043.dnkmem (mgr.34373) 4656 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:04 gibba003 bash[31385]: cluster 2021-03-10T15:19:02.949356+0000 mgr.gibba043.dnkmem (mgr.34373) 4657 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:04 gibba003 bash[32348]: cluster 2021-03-10T15:19:02.949356+0000 mgr.gibba043.dnkmem (mgr.34373) 4657 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:04.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:04 gibba043 bash[24019]: cluster 2021-03-10T15:19:02.949356+0000 mgr.gibba043.dnkmem (mgr.34373) 4657 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:05 gibba043 bash[24019]: cluster 2021-03-10T15:19:04.951157+0000 mgr.gibba043.dnkmem (mgr.34373) 4658 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:05 gibba003 bash[31385]: cluster 2021-03-10T15:19:04.951157+0000 mgr.gibba043.dnkmem (mgr.34373) 4658 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:05 gibba003 bash[32348]: cluster 2021-03-10T15:19:04.951157+0000 mgr.gibba043.dnkmem (mgr.34373) 4658 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:06.563 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:19:06.822 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:19:06.822 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (87m) 2m ago 92m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:19:06.822 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (92m) 56s ago 92m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:19:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (87m) 56s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:19:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (88m) 56s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:19:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (87m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:19:06.823 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:19:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (86m) 56s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:19:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:19:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (92m) 2m ago 92m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:19:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (92m) 56s ago 92m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:19:06.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:19:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:19:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:19:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (84m) 2m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:19:06.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (84m) 56s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:19:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (83m) 56s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:19:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (83m) 56s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:19:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (82m) 56s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:19:06.826 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (92m) 56s ago 92m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:19:06.827 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 90m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:19:07.073 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:19:07.073 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:19:07.074 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:07.074 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:19:07.075 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:19:07.075 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:07.076 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:19:07.076 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:19:07.076 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:19:07.077 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:19:07.077 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:19:07.078 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:19:07.078 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:19:07.079 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:19:07.079 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:19:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:08 gibba043 bash[24019]: audit 2021-03-10T15:19:06.552318+0000 mgr.gibba043.dnkmem (mgr.34373) 4659 : audit [DBG] from='client.57172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:08 gibba043 bash[24019]: audit 2021-03-10T15:19:06.777527+0000 mgr.gibba043.dnkmem (mgr.34373) 4660 : audit [DBG] from='client.47190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:08 gibba043 bash[24019]: cluster 2021-03-10T15:19:06.952791+0000 mgr.gibba043.dnkmem (mgr.34373) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:08 gibba043 bash[24019]: audit 2021-03-10T15:19:07.071171+0000 mon.c (mon.1) 1229 : audit [DBG] from='client.? 172.21.2.103:0/3627469257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[31385]: audit 2021-03-10T15:19:06.552318+0000 mgr.gibba043.dnkmem (mgr.34373) 4659 : audit [DBG] from='client.57172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[31385]: audit 2021-03-10T15:19:06.777527+0000 mgr.gibba043.dnkmem (mgr.34373) 4660 : audit [DBG] from='client.47190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[31385]: cluster 2021-03-10T15:19:06.952791+0000 mgr.gibba043.dnkmem (mgr.34373) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[31385]: audit 2021-03-10T15:19:07.071171+0000 mon.c (mon.1) 1229 : audit [DBG] from='client.? 172.21.2.103:0/3627469257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[32348]: audit 2021-03-10T15:19:06.552318+0000 mgr.gibba043.dnkmem (mgr.34373) 4659 : audit [DBG] from='client.57172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[32348]: audit 2021-03-10T15:19:06.777527+0000 mgr.gibba043.dnkmem (mgr.34373) 4660 : audit [DBG] from='client.47190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[32348]: cluster 2021-03-10T15:19:06.952791+0000 mgr.gibba043.dnkmem (mgr.34373) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:08 gibba003 bash[32348]: audit 2021-03-10T15:19:07.071171+0000 mon.c (mon.1) 1229 : audit [DBG] from='client.? 172.21.2.103:0/3627469257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:10 gibba003 bash[31385]: cluster 2021-03-10T15:19:08.954281+0000 mgr.gibba043.dnkmem (mgr.34373) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:10 gibba003 bash[32348]: cluster 2021-03-10T15:19:08.954281+0000 mgr.gibba043.dnkmem (mgr.34373) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:10 gibba043 bash[24019]: cluster 2021-03-10T15:19:08.954281+0000 mgr.gibba043.dnkmem (mgr.34373) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:12 gibba003 bash[31385]: cluster 2021-03-10T15:19:10.955897+0000 mgr.gibba043.dnkmem (mgr.34373) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:12 gibba003 bash[32348]: cluster 2021-03-10T15:19:10.955897+0000 mgr.gibba043.dnkmem (mgr.34373) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:12 gibba043 bash[24019]: cluster 2021-03-10T15:19:10.955897+0000 mgr.gibba043.dnkmem (mgr.34373) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: cluster 2021-03-10T15:19:12.957123+0000 mgr.gibba043.dnkmem (mgr.34373) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.269135+0000 mon.c (mon.1) 1230 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.270458+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.376526+0000 mon.c (mon.1) 1231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.377842+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.434341+0000 mon.c (mon.1) 1232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:19:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.435535+0000 mon.c (mon.1) 1233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.435794+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:19:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.436577+0000 mon.c (mon.1) 1234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:19:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.437019+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.437897+0000 mon.c (mon.1) 1235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.438042+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:19:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[31385]: audit 2021-03-10T15:19:13.439153+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: cluster 2021-03-10T15:19:12.957123+0000 mgr.gibba043.dnkmem (mgr.34373) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.269135+0000 mon.c (mon.1) 1230 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.270458+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.376526+0000 mon.c (mon.1) 1231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.377842+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.434341+0000 mon.c (mon.1) 1232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:19:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.435535+0000 mon.c (mon.1) 1233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.435794+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:19:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.436577+0000 mon.c (mon.1) 1234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:19:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.437019+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.437897+0000 mon.c (mon.1) 1235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.438042+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:19:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:14 gibba003 bash[32348]: audit 2021-03-10T15:19:13.439153+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: cluster 2021-03-10T15:19:12.957123+0000 mgr.gibba043.dnkmem (mgr.34373) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.269135+0000 mon.c (mon.1) 1230 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.270458+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.376526+0000 mon.c (mon.1) 1231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.377842+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.434341+0000 mon.c (mon.1) 1232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:19:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.435535+0000 mon.c (mon.1) 1233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.435794+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:19:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.436577+0000 mon.c (mon.1) 1234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:19:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.437019+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.437897+0000 mon.c (mon.1) 1235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:19:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.438042+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:19:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:14 gibba043 bash[24019]: audit 2021-03-10T15:19:13.439153+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:19:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: cephadm 2021-03-10T15:19:14.953236+0000 mgr.gibba043.dnkmem (mgr.34373) 4665 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:19:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: cephadm 2021-03-10T15:19:14.954823+0000 mgr.gibba043.dnkmem (mgr.34373) 4666 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:19:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: cluster 2021-03-10T15:19:14.958701+0000 mgr.gibba043.dnkmem (mgr.34373) 4667 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.174737+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:19:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.178298+0000 mon.c (mon.1) 1236 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.179597+0000 mon.c (mon.1) 1237 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.181004+0000 mon.c (mon.1) 1238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.182514+0000 mon.c (mon.1) 1239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.185529+0000 mon.c (mon.1) 1240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:15 gibba043 bash[24019]: audit 2021-03-10T15:19:15.186881+0000 mon.c (mon.1) 1241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: cephadm 2021-03-10T15:19:14.953236+0000 mgr.gibba043.dnkmem (mgr.34373) 4665 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:19:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: cephadm 2021-03-10T15:19:14.954823+0000 mgr.gibba043.dnkmem (mgr.34373) 4666 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:19:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: cluster 2021-03-10T15:19:14.958701+0000 mgr.gibba043.dnkmem (mgr.34373) 4667 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.174737+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:19:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.178298+0000 mon.c (mon.1) 1236 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.179597+0000 mon.c (mon.1) 1237 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.181004+0000 mon.c (mon.1) 1238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.182514+0000 mon.c (mon.1) 1239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.185529+0000 mon.c (mon.1) 1240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[31385]: audit 2021-03-10T15:19:15.186881+0000 mon.c (mon.1) 1241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: cephadm 2021-03-10T15:19:14.953236+0000 mgr.gibba043.dnkmem (mgr.34373) 4665 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:19:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: cephadm 2021-03-10T15:19:14.954823+0000 mgr.gibba043.dnkmem (mgr.34373) 4666 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:19:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: cluster 2021-03-10T15:19:14.958701+0000 mgr.gibba043.dnkmem (mgr.34373) 4667 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.174737+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:19:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.178298+0000 mon.c (mon.1) 1236 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.179597+0000 mon.c (mon.1) 1237 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.181004+0000 mon.c (mon.1) 1238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.182514+0000 mon.c (mon.1) 1239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.185529+0000 mon.c (mon.1) 1240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:15 gibba003 bash[32348]: audit 2021-03-10T15:19:15.186881+0000 mon.c (mon.1) 1241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:16.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.176585+0000 mgr.gibba043.dnkmem (mgr.34373) 4668 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:16.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.178071+0000 mgr.gibba043.dnkmem (mgr.34373) 4669 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:16.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.179568+0000 mgr.gibba043.dnkmem (mgr.34373) 4670 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:16.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.179608+0000 mgr.gibba043.dnkmem (mgr.34373) 4671 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:16.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.180967+0000 mgr.gibba043.dnkmem (mgr.34373) 4672 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:16.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.181006+0000 mgr.gibba043.dnkmem (mgr.34373) 4673 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:16.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.182308+0000 mgr.gibba043.dnkmem (mgr.34373) 4674 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:16.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.184020+0000 mgr.gibba043.dnkmem (mgr.34373) 4675 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:16.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.184063+0000 mgr.gibba043.dnkmem (mgr.34373) 4676 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:16.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.185217+0000 mgr.gibba043.dnkmem (mgr.34373) 4677 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:16.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.185583+0000 mgr.gibba043.dnkmem (mgr.34373) 4678 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:16.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.186678+0000 mgr.gibba043.dnkmem (mgr.34373) 4679 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:16.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.186721+0000 mgr.gibba043.dnkmem (mgr.34373) 4680 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:16.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:16 gibba043 bash[24019]: cephadm 2021-03-10T15:19:15.186840+0000 mgr.gibba043.dnkmem (mgr.34373) 4681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:16.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.176585+0000 mgr.gibba043.dnkmem (mgr.34373) 4668 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.178071+0000 mgr.gibba043.dnkmem (mgr.34373) 4669 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.179568+0000 mgr.gibba043.dnkmem (mgr.34373) 4670 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.179608+0000 mgr.gibba043.dnkmem (mgr.34373) 4671 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.180967+0000 mgr.gibba043.dnkmem (mgr.34373) 4672 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.181006+0000 mgr.gibba043.dnkmem (mgr.34373) 4673 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.182308+0000 mgr.gibba043.dnkmem (mgr.34373) 4674 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.184020+0000 mgr.gibba043.dnkmem (mgr.34373) 4675 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.184063+0000 mgr.gibba043.dnkmem (mgr.34373) 4676 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:16.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.185217+0000 mgr.gibba043.dnkmem (mgr.34373) 4677 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:16.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.185583+0000 mgr.gibba043.dnkmem (mgr.34373) 4678 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:16.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.186678+0000 mgr.gibba043.dnkmem (mgr.34373) 4679 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:16.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.186721+0000 mgr.gibba043.dnkmem (mgr.34373) 4680 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:16.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[31385]: cephadm 2021-03-10T15:19:15.186840+0000 mgr.gibba043.dnkmem (mgr.34373) 4681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.176585+0000 mgr.gibba043.dnkmem (mgr.34373) 4668 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.178071+0000 mgr.gibba043.dnkmem (mgr.34373) 4669 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.179568+0000 mgr.gibba043.dnkmem (mgr.34373) 4670 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:16.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.179608+0000 mgr.gibba043.dnkmem (mgr.34373) 4671 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:16.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.180967+0000 mgr.gibba043.dnkmem (mgr.34373) 4672 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:16.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.181006+0000 mgr.gibba043.dnkmem (mgr.34373) 4673 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:16.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.182308+0000 mgr.gibba043.dnkmem (mgr.34373) 4674 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:16.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.184020+0000 mgr.gibba043.dnkmem (mgr.34373) 4675 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:16.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.184063+0000 mgr.gibba043.dnkmem (mgr.34373) 4676 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:16.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.185217+0000 mgr.gibba043.dnkmem (mgr.34373) 4677 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:16.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.185583+0000 mgr.gibba043.dnkmem (mgr.34373) 4678 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:16.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.186678+0000 mgr.gibba043.dnkmem (mgr.34373) 4679 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:16.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.186721+0000 mgr.gibba043.dnkmem (mgr.34373) 4680 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:16.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:16 gibba003 bash[32348]: cephadm 2021-03-10T15:19:15.186840+0000 mgr.gibba043.dnkmem (mgr.34373) 4681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:17 gibba043 bash[24019]: cluster 2021-03-10T15:19:16.960422+0000 mgr.gibba043.dnkmem (mgr.34373) 4682 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:17 gibba003 bash[31385]: cluster 2021-03-10T15:19:16.960422+0000 mgr.gibba043.dnkmem (mgr.34373) 4682 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:17 gibba003 bash[32348]: cluster 2021-03-10T15:19:16.960422+0000 mgr.gibba043.dnkmem (mgr.34373) 4682 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:20 gibba003 bash[31385]: cluster 2021-03-10T15:19:18.962114+0000 mgr.gibba043.dnkmem (mgr.34373) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:20 gibba003 bash[32348]: cluster 2021-03-10T15:19:18.962114+0000 mgr.gibba043.dnkmem (mgr.34373) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:20 gibba043 bash[24019]: cluster 2021-03-10T15:19:18.962114+0000 mgr.gibba043.dnkmem (mgr.34373) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:22 gibba003 bash[31385]: cluster 2021-03-10T15:19:20.963489+0000 mgr.gibba043.dnkmem (mgr.34373) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:22 gibba003 bash[32348]: cluster 2021-03-10T15:19:20.963489+0000 mgr.gibba043.dnkmem (mgr.34373) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:22 gibba043 bash[24019]: cluster 2021-03-10T15:19:20.963489+0000 mgr.gibba043.dnkmem (mgr.34373) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:24 gibba003 bash[31385]: cluster 2021-03-10T15:19:22.965026+0000 mgr.gibba043.dnkmem (mgr.34373) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:24 gibba003 bash[32348]: cluster 2021-03-10T15:19:22.965026+0000 mgr.gibba043.dnkmem (mgr.34373) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:24 gibba043 bash[24019]: cluster 2021-03-10T15:19:22.965026+0000 mgr.gibba043.dnkmem (mgr.34373) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:25 gibba043 bash[24019]: cluster 2021-03-10T15:19:24.966671+0000 mgr.gibba043.dnkmem (mgr.34373) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:25.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:25 gibba003 bash[31385]: cluster 2021-03-10T15:19:24.966671+0000 mgr.gibba043.dnkmem (mgr.34373) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:25 gibba003 bash[32348]: cluster 2021-03-10T15:19:24.966671+0000 mgr.gibba043.dnkmem (mgr.34373) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:28 gibba003 bash[31385]: cluster 2021-03-10T15:19:26.968415+0000 mgr.gibba043.dnkmem (mgr.34373) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:28 gibba003 bash[32348]: cluster 2021-03-10T15:19:26.968415+0000 mgr.gibba043.dnkmem (mgr.34373) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:28 gibba043 bash[24019]: cluster 2021-03-10T15:19:26.968415+0000 mgr.gibba043.dnkmem (mgr.34373) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:30 gibba003 bash[31385]: cluster 2021-03-10T15:19:28.970040+0000 mgr.gibba043.dnkmem (mgr.34373) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:30 gibba003 bash[32348]: cluster 2021-03-10T15:19:28.970040+0000 mgr.gibba043.dnkmem (mgr.34373) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:30 gibba043 bash[24019]: cluster 2021-03-10T15:19:28.970040+0000 mgr.gibba043.dnkmem (mgr.34373) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:32 gibba003 bash[31385]: cephadm 2021-03-10T15:19:30.198838+0000 mgr.gibba043.dnkmem (mgr.34373) 4689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:32 gibba003 bash[31385]: cluster 2021-03-10T15:19:30.971785+0000 mgr.gibba043.dnkmem (mgr.34373) 4690 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:32 gibba003 bash[32348]: cephadm 2021-03-10T15:19:30.198838+0000 mgr.gibba043.dnkmem (mgr.34373) 4689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:32.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:32 gibba003 bash[32348]: cluster 2021-03-10T15:19:30.971785+0000 mgr.gibba043.dnkmem (mgr.34373) 4690 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:32 gibba043 bash[24019]: cephadm 2021-03-10T15:19:30.198838+0000 mgr.gibba043.dnkmem (mgr.34373) 4689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:32.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:32 gibba043 bash[24019]: cluster 2021-03-10T15:19:30.971785+0000 mgr.gibba043.dnkmem (mgr.34373) 4690 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:34 gibba003 bash[31385]: cluster 2021-03-10T15:19:32.973010+0000 mgr.gibba043.dnkmem (mgr.34373) 4691 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:34 gibba003 bash[32348]: cluster 2021-03-10T15:19:32.973010+0000 mgr.gibba043.dnkmem (mgr.34373) 4691 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:34 gibba043 bash[24019]: cluster 2021-03-10T15:19:32.973010+0000 mgr.gibba043.dnkmem (mgr.34373) 4691 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:35 gibba043 bash[24019]: cluster 2021-03-10T15:19:34.974677+0000 mgr.gibba043.dnkmem (mgr.34373) 4692 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:35 gibba003 bash[31385]: cluster 2021-03-10T15:19:34.974677+0000 mgr.gibba043.dnkmem (mgr.34373) 4692 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:35.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:35 gibba003 bash[32348]: cluster 2021-03-10T15:19:34.974677+0000 mgr.gibba043.dnkmem (mgr.34373) 4692 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:37.317 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:19:37.545 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:19:37.545 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (87m) 2m ago 93m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:19:37.546 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (93m) 87s ago 93m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:19:37.546 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (88m) 87s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:19:37.546 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (88m) 87s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:19:37.546 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:19:37.547 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:19:37.547 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (87m) 87s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:19:37.547 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (87m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:19:37.547 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (93m) 2m ago 93m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:19:37.548 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (93m) 87s ago 93m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:19:37.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:19:37.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:19:37.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:19:37.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:19:37.549 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (84m) 87s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:19:37.549 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (84m) 87s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:19:37.549 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (83m) 87s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:19:37.549 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (83m) 87s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:19:37.550 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (92m) 87s ago 93m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:19:37.550 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 91m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:19:37.794 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:19:37.795 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:19:37.795 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:37.795 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:19:37.795 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:19:37.796 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:37.796 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:19:37.796 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:19:37.796 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:19:37.797 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:19:37.797 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:19:37.797 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:19:37.797 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:19:37.797 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:19:37.798 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:19:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:38 gibba003 bash[31385]: cluster 2021-03-10T15:19:36.976406+0000 mgr.gibba043.dnkmem (mgr.34373) 4693 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:38 gibba003 bash[31385]: audit 2021-03-10T15:19:37.792427+0000 mon.a (mon.0) 1193 : audit [DBG] from='client.? 172.21.2.103:0/504814609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:38 gibba003 bash[32348]: cluster 2021-03-10T15:19:36.976406+0000 mgr.gibba043.dnkmem (mgr.34373) 4693 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:38 gibba003 bash[32348]: audit 2021-03-10T15:19:37.792427+0000 mon.a (mon.0) 1193 : audit [DBG] from='client.? 172.21.2.103:0/504814609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:38 gibba043 bash[24019]: cluster 2021-03-10T15:19:36.976406+0000 mgr.gibba043.dnkmem (mgr.34373) 4693 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:38 gibba043 bash[24019]: audit 2021-03-10T15:19:37.792427+0000 mon.a (mon.0) 1193 : audit [DBG] from='client.? 172.21.2.103:0/504814609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:39 gibba003 bash[31385]: audit 2021-03-10T15:19:37.305303+0000 mgr.gibba043.dnkmem (mgr.34373) 4694 : audit [DBG] from='client.57190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:39 gibba003 bash[31385]: audit 2021-03-10T15:19:37.529551+0000 mgr.gibba043.dnkmem (mgr.34373) 4695 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:39.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:39 gibba003 bash[32348]: audit 2021-03-10T15:19:37.305303+0000 mgr.gibba043.dnkmem (mgr.34373) 4694 : audit [DBG] from='client.57190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:39.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:39 gibba003 bash[32348]: audit 2021-03-10T15:19:37.529551+0000 mgr.gibba043.dnkmem (mgr.34373) 4695 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:39 gibba043 bash[24019]: audit 2021-03-10T15:19:37.305303+0000 mgr.gibba043.dnkmem (mgr.34373) 4694 : audit [DBG] from='client.57190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:39 gibba043 bash[24019]: audit 2021-03-10T15:19:37.529551+0000 mgr.gibba043.dnkmem (mgr.34373) 4695 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:40 gibba003 bash[31385]: cluster 2021-03-10T15:19:38.977752+0000 mgr.gibba043.dnkmem (mgr.34373) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:40 gibba003 bash[32348]: cluster 2021-03-10T15:19:38.977752+0000 mgr.gibba043.dnkmem (mgr.34373) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:40 gibba043 bash[24019]: cluster 2021-03-10T15:19:38.977752+0000 mgr.gibba043.dnkmem (mgr.34373) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:41 gibba003 bash[31385]: cluster 2021-03-10T15:19:40.979323+0000 mgr.gibba043.dnkmem (mgr.34373) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:41 gibba003 bash[32348]: cluster 2021-03-10T15:19:40.979323+0000 mgr.gibba043.dnkmem (mgr.34373) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:41 gibba043 bash[24019]: cluster 2021-03-10T15:19:40.979323+0000 mgr.gibba043.dnkmem (mgr.34373) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:44 gibba003 bash[31385]: cluster 2021-03-10T15:19:42.980577+0000 mgr.gibba043.dnkmem (mgr.34373) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:44 gibba003 bash[32348]: cluster 2021-03-10T15:19:42.980577+0000 mgr.gibba043.dnkmem (mgr.34373) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:44 gibba043 bash[24019]: cluster 2021-03-10T15:19:42.980577+0000 mgr.gibba043.dnkmem (mgr.34373) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:45 gibba043 bash[24019]: cluster 2021-03-10T15:19:44.982338+0000 mgr.gibba043.dnkmem (mgr.34373) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:45 gibba003 bash[31385]: cluster 2021-03-10T15:19:44.982338+0000 mgr.gibba043.dnkmem (mgr.34373) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:45 gibba003 bash[32348]: cluster 2021-03-10T15:19:44.982338+0000 mgr.gibba043.dnkmem (mgr.34373) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:46 gibba043 bash[24019]: cephadm 2021-03-10T15:19:45.214593+0000 mgr.gibba043.dnkmem (mgr.34373) 4700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:46 gibba003 bash[31385]: cephadm 2021-03-10T15:19:45.214593+0000 mgr.gibba043.dnkmem (mgr.34373) 4700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:46 gibba003 bash[32348]: cephadm 2021-03-10T15:19:45.214593+0000 mgr.gibba043.dnkmem (mgr.34373) 4700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:19:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:47 gibba043 bash[24019]: cluster 2021-03-10T15:19:46.983908+0000 mgr.gibba043.dnkmem (mgr.34373) 4701 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:47 gibba003 bash[31385]: cluster 2021-03-10T15:19:46.983908+0000 mgr.gibba043.dnkmem (mgr.34373) 4701 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:47 gibba003 bash[32348]: cluster 2021-03-10T15:19:46.983908+0000 mgr.gibba043.dnkmem (mgr.34373) 4701 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:50 gibba003 bash[31385]: cluster 2021-03-10T15:19:48.985261+0000 mgr.gibba043.dnkmem (mgr.34373) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:50 gibba003 bash[32348]: cluster 2021-03-10T15:19:48.985261+0000 mgr.gibba043.dnkmem (mgr.34373) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:50 gibba043 bash[24019]: cluster 2021-03-10T15:19:48.985261+0000 mgr.gibba043.dnkmem (mgr.34373) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:52 gibba003 bash[31385]: cluster 2021-03-10T15:19:50.986955+0000 mgr.gibba043.dnkmem (mgr.34373) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:52 gibba003 bash[32348]: cluster 2021-03-10T15:19:50.986955+0000 mgr.gibba043.dnkmem (mgr.34373) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:52 gibba043 bash[24019]: cluster 2021-03-10T15:19:50.986955+0000 mgr.gibba043.dnkmem (mgr.34373) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:54 gibba003 bash[31385]: cluster 2021-03-10T15:19:52.988331+0000 mgr.gibba043.dnkmem (mgr.34373) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:54 gibba003 bash[32348]: cluster 2021-03-10T15:19:52.988331+0000 mgr.gibba043.dnkmem (mgr.34373) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:54 gibba043 bash[24019]: cluster 2021-03-10T15:19:52.988331+0000 mgr.gibba043.dnkmem (mgr.34373) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:55 gibba043 bash[24019]: cluster 2021-03-10T15:19:54.990248+0000 mgr.gibba043.dnkmem (mgr.34373) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:55 gibba003 bash[31385]: cluster 2021-03-10T15:19:54.990248+0000 mgr.gibba043.dnkmem (mgr.34373) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:55 gibba003 bash[32348]: cluster 2021-03-10T15:19:54.990248+0000 mgr.gibba043.dnkmem (mgr.34373) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:19:58 gibba003 bash[31385]: cluster 2021-03-10T15:19:56.991817+0000 mgr.gibba043.dnkmem (mgr.34373) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:19:58 gibba003 bash[32348]: cluster 2021-03-10T15:19:56.991817+0000 mgr.gibba043.dnkmem (mgr.34373) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:19:58 gibba043 bash[24019]: cluster 2021-03-10T15:19:56.991817+0000 mgr.gibba043.dnkmem (mgr.34373) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:00 gibba003 bash[31385]: debug 2021-03-10T15:19:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:00 gibba003 bash[31385]: cluster 2021-03-10T15:19:58.993450+0000 mgr.gibba043.dnkmem (mgr.34373) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:00 gibba003 bash[31385]: cluster 2021-03-10T15:20:00.000302+0000 mon.a (mon.0) 1194 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:00 gibba003 bash[32348]: cluster 2021-03-10T15:19:58.993450+0000 mgr.gibba043.dnkmem (mgr.34373) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:00 gibba003 bash[32348]: cluster 2021-03-10T15:20:00.000302+0000 mon.a (mon.0) 1194 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:00 gibba043 bash[24019]: cluster 2021-03-10T15:19:58.993450+0000 mgr.gibba043.dnkmem (mgr.34373) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:00 gibba043 bash[24019]: cluster 2021-03-10T15:20:00.000302+0000 mon.a (mon.0) 1194 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:01 gibba003 bash[31385]: cephadm 2021-03-10T15:20:00.230356+0000 mgr.gibba043.dnkmem (mgr.34373) 4708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:01 gibba003 bash[31385]: cluster 2021-03-10T15:20:00.995134+0000 mgr.gibba043.dnkmem (mgr.34373) 4709 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:01 gibba003 bash[32348]: cephadm 2021-03-10T15:20:00.230356+0000 mgr.gibba043.dnkmem (mgr.34373) 4708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:01 gibba003 bash[32348]: cluster 2021-03-10T15:20:00.995134+0000 mgr.gibba043.dnkmem (mgr.34373) 4709 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:01 gibba043 bash[24019]: cephadm 2021-03-10T15:20:00.230356+0000 mgr.gibba043.dnkmem (mgr.34373) 4708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:01 gibba043 bash[24019]: cluster 2021-03-10T15:20:00.995134+0000 mgr.gibba043.dnkmem (mgr.34373) 4709 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:04 gibba003 bash[31385]: cluster 2021-03-10T15:20:02.996531+0000 mgr.gibba043.dnkmem (mgr.34373) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:04 gibba003 bash[32348]: cluster 2021-03-10T15:20:02.996531+0000 mgr.gibba043.dnkmem (mgr.34373) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:04.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:04 gibba043 bash[24019]: cluster 2021-03-10T15:20:02.996531+0000 mgr.gibba043.dnkmem (mgr.34373) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:05 gibba043 bash[24019]: cluster 2021-03-10T15:20:04.998190+0000 mgr.gibba043.dnkmem (mgr.34373) 4711 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:05 gibba003 bash[31385]: cluster 2021-03-10T15:20:04.998190+0000 mgr.gibba043.dnkmem (mgr.34373) 4711 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:05 gibba003 bash[32348]: cluster 2021-03-10T15:20:04.998190+0000 mgr.gibba043.dnkmem (mgr.34373) 4711 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.038 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:20:08.269 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:20:08.269 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (88m) 3m ago 93m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:20:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (93m) 118s ago 93m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:20:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (88m) 118s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:20:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (89m) 118s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:20:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (88m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:20:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:20:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (87m) 118s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:20:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:20:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (93m) 3m ago 93m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:20:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (93m) 118s ago 93m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:20:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:20:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:20:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:20:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (85m) 3m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:20:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (85m) 118s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:20:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (84m) 118s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:20:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (84m) 118s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:20:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (83m) 118s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:20:08.274 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (93m) 118s ago 94m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:20:08.274 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 91m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:20:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:08 gibba003 bash[31385]: cluster 2021-03-10T15:20:06.999648+0000 mgr.gibba043.dnkmem (mgr.34373) 4712 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:08 gibba003 bash[32348]: cluster 2021-03-10T15:20:06.999648+0000 mgr.gibba043.dnkmem (mgr.34373) 4712 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.518 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:20:08.519 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:20:08.519 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:08.519 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:20:08.520 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:20:08.520 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:08.520 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:20:08.520 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:20:08.521 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:20:08.521 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:20:08.521 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:20:08.521 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:20:08.522 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:20:08.522 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:20:08.522 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:20:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:08 gibba043 bash[24019]: cluster 2021-03-10T15:20:06.999648+0000 mgr.gibba043.dnkmem (mgr.34373) 4712 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:09 gibba003 bash[31385]: audit 2021-03-10T15:20:08.025422+0000 mgr.gibba043.dnkmem (mgr.34373) 4713 : audit [DBG] from='client.57208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:09 gibba003 bash[31385]: audit 2021-03-10T15:20:08.516736+0000 mon.c (mon.1) 1242 : audit [DBG] from='client.? 172.21.2.103:0/1313791375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:09 gibba003 bash[32348]: audit 2021-03-10T15:20:08.025422+0000 mgr.gibba043.dnkmem (mgr.34373) 4713 : audit [DBG] from='client.57208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:09 gibba003 bash[32348]: audit 2021-03-10T15:20:08.516736+0000 mon.c (mon.1) 1242 : audit [DBG] from='client.? 172.21.2.103:0/1313791375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:09 gibba043 bash[24019]: audit 2021-03-10T15:20:08.025422+0000 mgr.gibba043.dnkmem (mgr.34373) 4713 : audit [DBG] from='client.57208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:09 gibba043 bash[24019]: audit 2021-03-10T15:20:08.516736+0000 mon.c (mon.1) 1242 : audit [DBG] from='client.? 172.21.2.103:0/1313791375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:10 gibba003 bash[31385]: audit 2021-03-10T15:20:08.254024+0000 mgr.gibba043.dnkmem (mgr.34373) 4714 : audit [DBG] from='client.57214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:10 gibba003 bash[31385]: cluster 2021-03-10T15:20:09.001389+0000 mgr.gibba043.dnkmem (mgr.34373) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:10 gibba003 bash[32348]: audit 2021-03-10T15:20:08.254024+0000 mgr.gibba043.dnkmem (mgr.34373) 4714 : audit [DBG] from='client.57214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:10.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:10 gibba003 bash[32348]: cluster 2021-03-10T15:20:09.001389+0000 mgr.gibba043.dnkmem (mgr.34373) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:10 gibba043 bash[24019]: audit 2021-03-10T15:20:08.254024+0000 mgr.gibba043.dnkmem (mgr.34373) 4714 : audit [DBG] from='client.57214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:10 gibba043 bash[24019]: cluster 2021-03-10T15:20:09.001389+0000 mgr.gibba043.dnkmem (mgr.34373) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:11 gibba003 bash[31385]: cluster 2021-03-10T15:20:11.003073+0000 mgr.gibba043.dnkmem (mgr.34373) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:11 gibba003 bash[32348]: cluster 2021-03-10T15:20:11.003073+0000 mgr.gibba043.dnkmem (mgr.34373) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:11 gibba043 bash[24019]: cluster 2021-03-10T15:20:11.003073+0000 mgr.gibba043.dnkmem (mgr.34373) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: cluster 2021-03-10T15:20:13.004408+0000 mgr.gibba043.dnkmem (mgr.34373) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.276379+0000 mon.c (mon.1) 1243 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.277690+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.385556+0000 mon.c (mon.1) 1244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.386873+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.447001+0000 mon.c (mon.1) 1245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:20:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.448234+0000 mon.c (mon.1) 1246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:20:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.448483+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:20:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.449298+0000 mon.c (mon.1) 1247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.449532+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:20:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.450598+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.450849+0000 mon.c (mon.1) 1248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[31385]: audit 2021-03-10T15:20:13.452132+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: cluster 2021-03-10T15:20:13.004408+0000 mgr.gibba043.dnkmem (mgr.34373) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.276379+0000 mon.c (mon.1) 1243 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.277690+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.385556+0000 mon.c (mon.1) 1244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.386873+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.447001+0000 mon.c (mon.1) 1245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:20:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.448234+0000 mon.c (mon.1) 1246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:20:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.448483+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:20:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.449298+0000 mon.c (mon.1) 1247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.449532+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:20:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.450598+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.450849+0000 mon.c (mon.1) 1248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:14 gibba003 bash[32348]: audit 2021-03-10T15:20:13.452132+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: cluster 2021-03-10T15:20:13.004408+0000 mgr.gibba043.dnkmem (mgr.34373) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.276379+0000 mon.c (mon.1) 1243 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.277690+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.385556+0000 mon.c (mon.1) 1244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.386873+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.447001+0000 mon.c (mon.1) 1245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:20:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.448234+0000 mon.c (mon.1) 1246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:20:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.448483+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:20:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.449298+0000 mon.c (mon.1) 1247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.449532+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:20:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.450598+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.450849+0000 mon.c (mon.1) 1248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:14 gibba043 bash[24019]: audit 2021-03-10T15:20:13.452132+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:15 gibba043 bash[24019]: cluster 2021-03-10T15:20:15.006157+0000 mgr.gibba043.dnkmem (mgr.34373) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:15 gibba003 bash[31385]: cluster 2021-03-10T15:20:15.006157+0000 mgr.gibba043.dnkmem (mgr.34373) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:15 gibba003 bash[32348]: cluster 2021-03-10T15:20:15.006157+0000 mgr.gibba043.dnkmem (mgr.34373) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.247065+0000 mgr.gibba043.dnkmem (mgr.34373) 4719 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:20:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.247611+0000 mgr.gibba043.dnkmem (mgr.34373) 4720 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:20:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.465793+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:20:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.467780+0000 mgr.gibba043.dnkmem (mgr.34373) 4721 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.469803+0000 mon.c (mon.1) 1249 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.471545+0000 mgr.gibba043.dnkmem (mgr.34373) 4722 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.474065+0000 mon.c (mon.1) 1250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.475311+0000 mgr.gibba043.dnkmem (mgr.34373) 4723 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.475982+0000 mgr.gibba043.dnkmem (mgr.34373) 4724 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.478004+0000 mon.c (mon.1) 1251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.478947+0000 mgr.gibba043.dnkmem (mgr.34373) 4725 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.479202+0000 mgr.gibba043.dnkmem (mgr.34373) 4726 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:16.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.480886+0000 mon.c (mon.1) 1252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.481799+0000 mgr.gibba043.dnkmem (mgr.34373) 4727 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.484805+0000 mgr.gibba043.dnkmem (mgr.34373) 4728 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.485096+0000 mgr.gibba043.dnkmem (mgr.34373) 4729 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:16.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.487978+0000 mon.c (mon.1) 1253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.488661+0000 mgr.gibba043.dnkmem (mgr.34373) 4730 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:16.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.490400+0000 mgr.gibba043.dnkmem (mgr.34373) 4731 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:16.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: audit 2021-03-10T15:20:15.492423+0000 mon.c (mon.1) 1254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.493731+0000 mgr.gibba043.dnkmem (mgr.34373) 4732 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:16.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.494206+0000 mgr.gibba043.dnkmem (mgr.34373) 4733 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:16.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:16 gibba043 bash[24019]: cephadm 2021-03-10T15:20:15.495010+0000 mgr.gibba043.dnkmem (mgr.34373) 4734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.247065+0000 mgr.gibba043.dnkmem (mgr.34373) 4719 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:20:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.247611+0000 mgr.gibba043.dnkmem (mgr.34373) 4720 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:20:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.465793+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:20:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.467780+0000 mgr.gibba043.dnkmem (mgr.34373) 4721 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.469803+0000 mon.c (mon.1) 1249 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.471545+0000 mgr.gibba043.dnkmem (mgr.34373) 4722 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.474065+0000 mon.c (mon.1) 1250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.475311+0000 mgr.gibba043.dnkmem (mgr.34373) 4723 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:16.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.475982+0000 mgr.gibba043.dnkmem (mgr.34373) 4724 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:16.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.478004+0000 mon.c (mon.1) 1251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.478947+0000 mgr.gibba043.dnkmem (mgr.34373) 4725 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:16.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.479202+0000 mgr.gibba043.dnkmem (mgr.34373) 4726 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:16.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.480886+0000 mon.c (mon.1) 1252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.481799+0000 mgr.gibba043.dnkmem (mgr.34373) 4727 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:16.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.484805+0000 mgr.gibba043.dnkmem (mgr.34373) 4728 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:16.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.485096+0000 mgr.gibba043.dnkmem (mgr.34373) 4729 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:16.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.487978+0000 mon.c (mon.1) 1253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.488661+0000 mgr.gibba043.dnkmem (mgr.34373) 4730 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:16.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.490400+0000 mgr.gibba043.dnkmem (mgr.34373) 4731 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:16.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: audit 2021-03-10T15:20:15.492423+0000 mon.c (mon.1) 1254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.493731+0000 mgr.gibba043.dnkmem (mgr.34373) 4732 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.247065+0000 mgr.gibba043.dnkmem (mgr.34373) 4719 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:20:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.247611+0000 mgr.gibba043.dnkmem (mgr.34373) 4720 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:20:16.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.465793+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:20:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.467780+0000 mgr.gibba043.dnkmem (mgr.34373) 4721 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.469803+0000 mon.c (mon.1) 1249 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.471545+0000 mgr.gibba043.dnkmem (mgr.34373) 4722 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:16.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.474065+0000 mon.c (mon.1) 1250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.475311+0000 mgr.gibba043.dnkmem (mgr.34373) 4723 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:16.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.475982+0000 mgr.gibba043.dnkmem (mgr.34373) 4724 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:16.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.478004+0000 mon.c (mon.1) 1251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.478947+0000 mgr.gibba043.dnkmem (mgr.34373) 4725 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:16.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.479202+0000 mgr.gibba043.dnkmem (mgr.34373) 4726 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:16.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.480886+0000 mon.c (mon.1) 1252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.481799+0000 mgr.gibba043.dnkmem (mgr.34373) 4727 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:16.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.484805+0000 mgr.gibba043.dnkmem (mgr.34373) 4728 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:16.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.485096+0000 mgr.gibba043.dnkmem (mgr.34373) 4729 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:16.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.487978+0000 mon.c (mon.1) 1253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.488661+0000 mgr.gibba043.dnkmem (mgr.34373) 4730 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:16.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.490400+0000 mgr.gibba043.dnkmem (mgr.34373) 4731 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:16.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: audit 2021-03-10T15:20:15.492423+0000 mon.c (mon.1) 1254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:16.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.493731+0000 mgr.gibba043.dnkmem (mgr.34373) 4732 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:16.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.494206+0000 mgr.gibba043.dnkmem (mgr.34373) 4733 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:16.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[32348]: cephadm 2021-03-10T15:20:15.495010+0000 mgr.gibba043.dnkmem (mgr.34373) 4734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:16.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.494206+0000 mgr.gibba043.dnkmem (mgr.34373) 4733 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:16.955 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:16 gibba003 bash[31385]: cephadm 2021-03-10T15:20:15.495010+0000 mgr.gibba043.dnkmem (mgr.34373) 4734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:17 gibba043 bash[24019]: cluster 2021-03-10T15:20:17.007760+0000 mgr.gibba043.dnkmem (mgr.34373) 4735 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:17 gibba003 bash[31385]: cluster 2021-03-10T15:20:17.007760+0000 mgr.gibba043.dnkmem (mgr.34373) 4735 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:17.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:17 gibba003 bash[32348]: cluster 2021-03-10T15:20:17.007760+0000 mgr.gibba043.dnkmem (mgr.34373) 4735 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:20 gibba003 bash[31385]: cluster 2021-03-10T15:20:19.009351+0000 mgr.gibba043.dnkmem (mgr.34373) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:20 gibba003 bash[32348]: cluster 2021-03-10T15:20:19.009351+0000 mgr.gibba043.dnkmem (mgr.34373) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:20 gibba043 bash[24019]: cluster 2021-03-10T15:20:19.009351+0000 mgr.gibba043.dnkmem (mgr.34373) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:21 gibba003 bash[31385]: cluster 2021-03-10T15:20:21.010982+0000 mgr.gibba043.dnkmem (mgr.34373) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:21 gibba003 bash[32348]: cluster 2021-03-10T15:20:21.010982+0000 mgr.gibba043.dnkmem (mgr.34373) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:21 gibba043 bash[24019]: cluster 2021-03-10T15:20:21.010982+0000 mgr.gibba043.dnkmem (mgr.34373) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:24 gibba003 bash[31385]: cluster 2021-03-10T15:20:23.012298+0000 mgr.gibba043.dnkmem (mgr.34373) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:24 gibba003 bash[32348]: cluster 2021-03-10T15:20:23.012298+0000 mgr.gibba043.dnkmem (mgr.34373) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:24 gibba043 bash[24019]: cluster 2021-03-10T15:20:23.012298+0000 mgr.gibba043.dnkmem (mgr.34373) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:25 gibba043 bash[24019]: cluster 2021-03-10T15:20:25.013962+0000 mgr.gibba043.dnkmem (mgr.34373) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:25.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:25 gibba003 bash[31385]: cluster 2021-03-10T15:20:25.013962+0000 mgr.gibba043.dnkmem (mgr.34373) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:25 gibba003 bash[32348]: cluster 2021-03-10T15:20:25.013962+0000 mgr.gibba043.dnkmem (mgr.34373) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:28 gibba003 bash[31385]: cluster 2021-03-10T15:20:27.015468+0000 mgr.gibba043.dnkmem (mgr.34373) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:28 gibba003 bash[32348]: cluster 2021-03-10T15:20:27.015468+0000 mgr.gibba043.dnkmem (mgr.34373) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:28 gibba043 bash[24019]: cluster 2021-03-10T15:20:27.015468+0000 mgr.gibba043.dnkmem (mgr.34373) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:29 gibba003 bash[31385]: cluster 2021-03-10T15:20:29.016828+0000 mgr.gibba043.dnkmem (mgr.34373) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:29 gibba003 bash[32348]: cluster 2021-03-10T15:20:29.016828+0000 mgr.gibba043.dnkmem (mgr.34373) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:29 gibba043 bash[24019]: cluster 2021-03-10T15:20:29.016828+0000 mgr.gibba043.dnkmem (mgr.34373) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:31 gibba003 bash[31385]: cephadm 2021-03-10T15:20:30.501053+0000 mgr.gibba043.dnkmem (mgr.34373) 4742 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:31 gibba003 bash[31385]: cluster 2021-03-10T15:20:31.018685+0000 mgr.gibba043.dnkmem (mgr.34373) 4743 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:31 gibba003 bash[32348]: cephadm 2021-03-10T15:20:30.501053+0000 mgr.gibba043.dnkmem (mgr.34373) 4742 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:31 gibba003 bash[32348]: cluster 2021-03-10T15:20:31.018685+0000 mgr.gibba043.dnkmem (mgr.34373) 4743 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:31 gibba043 bash[24019]: cephadm 2021-03-10T15:20:30.501053+0000 mgr.gibba043.dnkmem (mgr.34373) 4742 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:31.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:31 gibba043 bash[24019]: cluster 2021-03-10T15:20:31.018685+0000 mgr.gibba043.dnkmem (mgr.34373) 4743 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:33 gibba003 bash[31385]: cluster 2021-03-10T15:20:33.020205+0000 mgr.gibba043.dnkmem (mgr.34373) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:33 gibba003 bash[32348]: cluster 2021-03-10T15:20:33.020205+0000 mgr.gibba043.dnkmem (mgr.34373) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:33 gibba043 bash[24019]: cluster 2021-03-10T15:20:33.020205+0000 mgr.gibba043.dnkmem (mgr.34373) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:35 gibba043 bash[24019]: cluster 2021-03-10T15:20:35.021745+0000 mgr.gibba043.dnkmem (mgr.34373) 4745 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:35 gibba003 bash[31385]: cluster 2021-03-10T15:20:35.021745+0000 mgr.gibba043.dnkmem (mgr.34373) 4745 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:35.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:35 gibba003 bash[32348]: cluster 2021-03-10T15:20:35.021745+0000 mgr.gibba043.dnkmem (mgr.34373) 4745 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:37 gibba003 bash[31385]: cluster 2021-03-10T15:20:37.023420+0000 mgr.gibba043.dnkmem (mgr.34373) 4746 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:37 gibba003 bash[32348]: cluster 2021-03-10T15:20:37.023420+0000 mgr.gibba043.dnkmem (mgr.34373) 4746 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:37 gibba043 bash[24019]: cluster 2021-03-10T15:20:37.023420+0000 mgr.gibba043.dnkmem (mgr.34373) 4746 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.764 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:20:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:20:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (89m) 3m ago 94m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:20:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (94m) 2m ago 94m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:20:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (89m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:20:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (89m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:20:38.995 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:20:38.995 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:20:38.995 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:20:38.995 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (88m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:20:38.996 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (94m) 3m ago 94m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:20:38.996 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (94m) 2m ago 94m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:20:38.996 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:20:38.997 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:20:38.997 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:20:38.997 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:20:38.997 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:20:38.998 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:20:38.998 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:20:38.998 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (84m) 2m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:20:38.998 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (93m) 2m ago 94m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:20:38.999 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 92m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:20:39.244 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:20:39.245 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:20:39.245 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:39.245 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:20:39.246 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:20:39.246 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:39.246 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:20:39.247 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:20:39.247 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:20:39.247 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:20:39.247 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:20:39.248 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:20:39.248 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:20:39.248 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:20:39.248 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:20:40.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[31385]: audit 2021-03-10T15:20:38.751405+0000 mgr.gibba043.dnkmem (mgr.34373) 4747 : audit [DBG] from='client.57226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:40.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[31385]: audit 2021-03-10T15:20:38.978194+0000 mgr.gibba043.dnkmem (mgr.34373) 4748 : audit [DBG] from='client.57232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:40.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[31385]: cluster 2021-03-10T15:20:39.024324+0000 mgr.gibba043.dnkmem (mgr.34373) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[31385]: audit 2021-03-10T15:20:39.241788+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.2.103:0/833365983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:40.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[32348]: audit 2021-03-10T15:20:38.751405+0000 mgr.gibba043.dnkmem (mgr.34373) 4747 : audit [DBG] from='client.57226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:40.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[32348]: audit 2021-03-10T15:20:38.978194+0000 mgr.gibba043.dnkmem (mgr.34373) 4748 : audit [DBG] from='client.57232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:40.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[32348]: cluster 2021-03-10T15:20:39.024324+0000 mgr.gibba043.dnkmem (mgr.34373) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:40 gibba003 bash[32348]: audit 2021-03-10T15:20:39.241788+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.2.103:0/833365983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:40.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:40 gibba043 bash[24019]: audit 2021-03-10T15:20:38.751405+0000 mgr.gibba043.dnkmem (mgr.34373) 4747 : audit [DBG] from='client.57226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:40.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:40 gibba043 bash[24019]: audit 2021-03-10T15:20:38.978194+0000 mgr.gibba043.dnkmem (mgr.34373) 4748 : audit [DBG] from='client.57232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:40.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:40 gibba043 bash[24019]: cluster 2021-03-10T15:20:39.024324+0000 mgr.gibba043.dnkmem (mgr.34373) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:40 gibba043 bash[24019]: audit 2021-03-10T15:20:39.241788+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.2.103:0/833365983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:41 gibba003 bash[31385]: cluster 2021-03-10T15:20:41.026056+0000 mgr.gibba043.dnkmem (mgr.34373) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:41 gibba003 bash[32348]: cluster 2021-03-10T15:20:41.026056+0000 mgr.gibba043.dnkmem (mgr.34373) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:41.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:41 gibba043 bash[24019]: cluster 2021-03-10T15:20:41.026056+0000 mgr.gibba043.dnkmem (mgr.34373) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:43 gibba003 bash[31385]: cluster 2021-03-10T15:20:43.027393+0000 mgr.gibba043.dnkmem (mgr.34373) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:43 gibba003 bash[32348]: cluster 2021-03-10T15:20:43.027393+0000 mgr.gibba043.dnkmem (mgr.34373) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:43 gibba043 bash[24019]: cluster 2021-03-10T15:20:43.027393+0000 mgr.gibba043.dnkmem (mgr.34373) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:45.515 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:45 gibba043 bash[24019]: cluster 2021-03-10T15:20:45.029094+0000 mgr.gibba043.dnkmem (mgr.34373) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:45 gibba003 bash[31385]: cluster 2021-03-10T15:20:45.029094+0000 mgr.gibba043.dnkmem (mgr.34373) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:45.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:45 gibba003 bash[32348]: cluster 2021-03-10T15:20:45.029094+0000 mgr.gibba043.dnkmem (mgr.34373) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:46 gibba043 bash[24019]: cephadm 2021-03-10T15:20:45.512200+0000 mgr.gibba043.dnkmem (mgr.34373) 4753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:46 gibba003 bash[31385]: cephadm 2021-03-10T15:20:45.512200+0000 mgr.gibba043.dnkmem (mgr.34373) 4753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:46 gibba003 bash[32348]: cephadm 2021-03-10T15:20:45.512200+0000 mgr.gibba043.dnkmem (mgr.34373) 4753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:20:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:47 gibba003 bash[31385]: cluster 2021-03-10T15:20:47.030783+0000 mgr.gibba043.dnkmem (mgr.34373) 4754 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:47 gibba003 bash[32348]: cluster 2021-03-10T15:20:47.030783+0000 mgr.gibba043.dnkmem (mgr.34373) 4754 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:47 gibba043 bash[24019]: cluster 2021-03-10T15:20:47.030783+0000 mgr.gibba043.dnkmem (mgr.34373) 4754 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:49 gibba003 bash[31385]: cluster 2021-03-10T15:20:49.032468+0000 mgr.gibba043.dnkmem (mgr.34373) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:49.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:49 gibba003 bash[32348]: cluster 2021-03-10T15:20:49.032468+0000 mgr.gibba043.dnkmem (mgr.34373) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:49 gibba043 bash[24019]: cluster 2021-03-10T15:20:49.032468+0000 mgr.gibba043.dnkmem (mgr.34373) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:51 gibba003 bash[31385]: cluster 2021-03-10T15:20:51.034381+0000 mgr.gibba043.dnkmem (mgr.34373) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:51 gibba003 bash[32348]: cluster 2021-03-10T15:20:51.034381+0000 mgr.gibba043.dnkmem (mgr.34373) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:51 gibba043 bash[24019]: cluster 2021-03-10T15:20:51.034381+0000 mgr.gibba043.dnkmem (mgr.34373) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:53.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:53 gibba003 bash[31385]: cluster 2021-03-10T15:20:53.035880+0000 mgr.gibba043.dnkmem (mgr.34373) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:53 gibba003 bash[32348]: cluster 2021-03-10T15:20:53.035880+0000 mgr.gibba043.dnkmem (mgr.34373) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:53 gibba043 bash[24019]: cluster 2021-03-10T15:20:53.035880+0000 mgr.gibba043.dnkmem (mgr.34373) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:55 gibba043 bash[24019]: cluster 2021-03-10T15:20:55.037463+0000 mgr.gibba043.dnkmem (mgr.34373) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:55 gibba003 bash[31385]: cluster 2021-03-10T15:20:55.037463+0000 mgr.gibba043.dnkmem (mgr.34373) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:55 gibba003 bash[32348]: cluster 2021-03-10T15:20:55.037463+0000 mgr.gibba043.dnkmem (mgr.34373) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:57 gibba003 bash[31385]: cluster 2021-03-10T15:20:57.038963+0000 mgr.gibba043.dnkmem (mgr.34373) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:57.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:57 gibba003 bash[32348]: cluster 2021-03-10T15:20:57.038963+0000 mgr.gibba043.dnkmem (mgr.34373) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:57 gibba043 bash[24019]: cluster 2021-03-10T15:20:57.038963+0000 mgr.gibba043.dnkmem (mgr.34373) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:20:59 gibba003 bash[31385]: cluster 2021-03-10T15:20:59.040577+0000 mgr.gibba043.dnkmem (mgr.34373) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:20:59 gibba003 bash[32348]: cluster 2021-03-10T15:20:59.040577+0000 mgr.gibba043.dnkmem (mgr.34373) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:20:59 gibba043 bash[24019]: cluster 2021-03-10T15:20:59.040577+0000 mgr.gibba043.dnkmem (mgr.34373) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:01 gibba003 bash[31385]: cephadm 2021-03-10T15:21:00.523447+0000 mgr.gibba043.dnkmem (mgr.34373) 4761 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:01 gibba003 bash[31385]: cluster 2021-03-10T15:21:01.042125+0000 mgr.gibba043.dnkmem (mgr.34373) 4762 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:01 gibba003 bash[32348]: cephadm 2021-03-10T15:21:00.523447+0000 mgr.gibba043.dnkmem (mgr.34373) 4761 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:01 gibba003 bash[32348]: cluster 2021-03-10T15:21:01.042125+0000 mgr.gibba043.dnkmem (mgr.34373) 4762 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:01 gibba043 bash[24019]: cephadm 2021-03-10T15:21:00.523447+0000 mgr.gibba043.dnkmem (mgr.34373) 4761 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:01 gibba043 bash[24019]: cluster 2021-03-10T15:21:01.042125+0000 mgr.gibba043.dnkmem (mgr.34373) 4762 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:03 gibba003 bash[31385]: cluster 2021-03-10T15:21:03.043523+0000 mgr.gibba043.dnkmem (mgr.34373) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:03 gibba003 bash[32348]: cluster 2021-03-10T15:21:03.043523+0000 mgr.gibba043.dnkmem (mgr.34373) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:03 gibba043 bash[24019]: cluster 2021-03-10T15:21:03.043523+0000 mgr.gibba043.dnkmem (mgr.34373) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:05 gibba003 bash[31385]: cluster 2021-03-10T15:21:05.045447+0000 mgr.gibba043.dnkmem (mgr.34373) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:05 gibba003 bash[32348]: cluster 2021-03-10T15:21:05.045447+0000 mgr.gibba043.dnkmem (mgr.34373) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:05.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:05 gibba043 bash[24019]: cluster 2021-03-10T15:21:05.045447+0000 mgr.gibba043.dnkmem (mgr.34373) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:07 gibba003 bash[31385]: cluster 2021-03-10T15:21:07.046968+0000 mgr.gibba043.dnkmem (mgr.34373) 4765 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:07 gibba003 bash[32348]: cluster 2021-03-10T15:21:07.046968+0000 mgr.gibba043.dnkmem (mgr.34373) 4765 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:07 gibba043 bash[24019]: cluster 2021-03-10T15:21:07.046968+0000 mgr.gibba043.dnkmem (mgr.34373) 4765 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:09 gibba003 bash[31385]: cluster 2021-03-10T15:21:09.048665+0000 mgr.gibba043.dnkmem (mgr.34373) 4766 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:09 gibba003 bash[32348]: cluster 2021-03-10T15:21:09.048665+0000 mgr.gibba043.dnkmem (mgr.34373) 4766 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:09.492 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:21:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:09 gibba043 bash[24019]: cluster 2021-03-10T15:21:09.048665+0000 mgr.gibba043.dnkmem (mgr.34373) 4766 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:09.747 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:21:09.747 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (89m) 4m ago 94m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:21:09.748 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (94m) 2m ago 94m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:21:09.748 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (89m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:21:09.748 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (90m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:21:09.748 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (89m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:21:09.748 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:21:09.749 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:21:09.749 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:21:09.749 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (94m) 4m ago 95m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:21:09.749 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (94m) 2m ago 95m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:21:09.750 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:21:09.750 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:21:09.750 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:21:09.750 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (86m) 4m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:21:09.751 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:21:09.751 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:21:09.751 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:21:09.751 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:21:09.752 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (94m) 2m ago 95m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:21:09.752 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 92m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:21:10.004 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:21:10.005 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:21:10.005 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:10.005 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:21:10.006 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:21:10.006 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:10.006 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:21:10.006 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:21:10.007 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:21:10.007 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:21:10.007 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:21:10.007 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:21:10.008 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:21:10.008 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:21:10.008 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:21:10.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:10 gibba003 bash[31385]: audit 2021-03-10T15:21:09.479607+0000 mgr.gibba043.dnkmem (mgr.34373) 4767 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:10.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:10 gibba003 bash[31385]: audit 2021-03-10T15:21:09.703294+0000 mgr.gibba043.dnkmem (mgr.34373) 4768 : audit [DBG] from='client.47262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:10.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:10 gibba003 bash[31385]: audit 2021-03-10T15:21:10.002849+0000 mon.c (mon.1) 1255 : audit [DBG] from='client.? 172.21.2.103:0/940986026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:10.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:10 gibba003 bash[32348]: audit 2021-03-10T15:21:09.479607+0000 mgr.gibba043.dnkmem (mgr.34373) 4767 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:10.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:10 gibba003 bash[32348]: audit 2021-03-10T15:21:09.703294+0000 mgr.gibba043.dnkmem (mgr.34373) 4768 : audit [DBG] from='client.47262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:10.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:10 gibba003 bash[32348]: audit 2021-03-10T15:21:10.002849+0000 mon.c (mon.1) 1255 : audit [DBG] from='client.? 172.21.2.103:0/940986026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:10.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:10 gibba043 bash[24019]: audit 2021-03-10T15:21:09.479607+0000 mgr.gibba043.dnkmem (mgr.34373) 4767 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:10 gibba043 bash[24019]: audit 2021-03-10T15:21:09.703294+0000 mgr.gibba043.dnkmem (mgr.34373) 4768 : audit [DBG] from='client.47262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:10 gibba043 bash[24019]: audit 2021-03-10T15:21:10.002849+0000 mon.c (mon.1) 1255 : audit [DBG] from='client.? 172.21.2.103:0/940986026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:11 gibba003 bash[31385]: cluster 2021-03-10T15:21:11.050496+0000 mgr.gibba043.dnkmem (mgr.34373) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:11 gibba003 bash[32348]: cluster 2021-03-10T15:21:11.050496+0000 mgr.gibba043.dnkmem (mgr.34373) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:11 gibba043 bash[24019]: cluster 2021-03-10T15:21:11.050496+0000 mgr.gibba043.dnkmem (mgr.34373) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:13 gibba003 bash[31385]: cluster 2021-03-10T15:21:13.051792+0000 mgr.gibba043.dnkmem (mgr.34373) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:13 gibba003 bash[32348]: cluster 2021-03-10T15:21:13.051792+0000 mgr.gibba043.dnkmem (mgr.34373) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:13 gibba043 bash[24019]: cluster 2021-03-10T15:21:13.051792+0000 mgr.gibba043.dnkmem (mgr.34373) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.283363+0000 mon.c (mon.1) 1256 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.284528+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.394304+0000 mon.c (mon.1) 1257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.395533+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.459866+0000 mon.c (mon.1) 1258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:21:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.460653+0000 mon.c (mon.1) 1259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.461086+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:21:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.461343+0000 mon.c (mon.1) 1260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.462323+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.462474+0000 mon.c (mon.1) 1261 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:21:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.463353+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[31385]: audit 2021-03-10T15:21:13.464290+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:21:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.283363+0000 mon.c (mon.1) 1256 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.284528+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.394304+0000 mon.c (mon.1) 1257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.395533+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.459866+0000 mon.c (mon.1) 1258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:21:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.460653+0000 mon.c (mon.1) 1259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.461086+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:21:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.461343+0000 mon.c (mon.1) 1260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.462323+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.462474+0000 mon.c (mon.1) 1261 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:21:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.463353+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:14 gibba003 bash[32348]: audit 2021-03-10T15:21:13.464290+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:21:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.283363+0000 mon.c (mon.1) 1256 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.284528+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.394304+0000 mon.c (mon.1) 1257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.395533+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.459866+0000 mon.c (mon.1) 1258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:21:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.460653+0000 mon.c (mon.1) 1259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.461086+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:21:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.461343+0000 mon.c (mon.1) 1260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.462323+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.462474+0000 mon.c (mon.1) 1261 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:21:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.463353+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:21:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:14 gibba043 bash[24019]: audit 2021-03-10T15:21:13.464290+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:21:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:15 gibba003 bash[31385]: cluster 2021-03-10T15:21:15.053382+0000 mgr.gibba043.dnkmem (mgr.34373) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:15 gibba003 bash[32348]: cluster 2021-03-10T15:21:15.053382+0000 mgr.gibba043.dnkmem (mgr.34373) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:15 gibba043 bash[24019]: cluster 2021-03-10T15:21:15.053382+0000 mgr.gibba043.dnkmem (mgr.34373) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:17.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.540365+0000 mgr.gibba043.dnkmem (mgr.34373) 4772 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:21:17.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.542007+0000 mgr.gibba043.dnkmem (mgr.34373) 4773 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:21:17.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.766332+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:21:17.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.768173+0000 mgr.gibba043.dnkmem (mgr.34373) 4774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:17.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.769917+0000 mgr.gibba043.dnkmem (mgr.34373) 4775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.769983+0000 mon.c (mon.1) 1262 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.771546+0000 mgr.gibba043.dnkmem (mgr.34373) 4776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.771551+0000 mon.c (mon.1) 1263 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.771599+0000 mgr.gibba043.dnkmem (mgr.34373) 4777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.773172+0000 mgr.gibba043.dnkmem (mgr.34373) 4778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.773246+0000 mgr.gibba043.dnkmem (mgr.34373) 4779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.773311+0000 mon.c (mon.1) 1264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.774546+0000 mgr.gibba043.dnkmem (mgr.34373) 4780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.774850+0000 mon.c (mon.1) 1265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.775991+0000 mgr.gibba043.dnkmem (mgr.34373) 4781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.776026+0000 mgr.gibba043.dnkmem (mgr.34373) 4782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.777587+0000 mgr.gibba043.dnkmem (mgr.34373) 4783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.777748+0000 mon.c (mon.1) 1266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.777904+0000 mgr.gibba043.dnkmem (mgr.34373) 4784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.779199+0000 mgr.gibba043.dnkmem (mgr.34373) 4785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.779237+0000 mgr.gibba043.dnkmem (mgr.34373) 4786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: cephadm 2021-03-10T15:21:15.779340+0000 mgr.gibba043.dnkmem (mgr.34373) 4787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[32348]: audit 2021-03-10T15:21:15.779353+0000 mon.c (mon.1) 1267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.540365+0000 mgr.gibba043.dnkmem (mgr.34373) 4772 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:21:17.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.542007+0000 mgr.gibba043.dnkmem (mgr.34373) 4773 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:21:17.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.766332+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:21:17.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.768173+0000 mgr.gibba043.dnkmem (mgr.34373) 4774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:17.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.769917+0000 mgr.gibba043.dnkmem (mgr.34373) 4775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:17.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.769983+0000 mon.c (mon.1) 1262 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:17.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.771546+0000 mgr.gibba043.dnkmem (mgr.34373) 4776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:17.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.771551+0000 mon.c (mon.1) 1263 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.771599+0000 mgr.gibba043.dnkmem (mgr.34373) 4777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:17.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.773172+0000 mgr.gibba043.dnkmem (mgr.34373) 4778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:17.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.773246+0000 mgr.gibba043.dnkmem (mgr.34373) 4779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:17.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.773311+0000 mon.c (mon.1) 1264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.774546+0000 mgr.gibba043.dnkmem (mgr.34373) 4780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:17.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.774850+0000 mon.c (mon.1) 1265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.775991+0000 mgr.gibba043.dnkmem (mgr.34373) 4781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:17.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.776026+0000 mgr.gibba043.dnkmem (mgr.34373) 4782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:17.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.777587+0000 mgr.gibba043.dnkmem (mgr.34373) 4783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:17.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.777748+0000 mon.c (mon.1) 1266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.207 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.777904+0000 mgr.gibba043.dnkmem (mgr.34373) 4784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:17.207 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.779199+0000 mgr.gibba043.dnkmem (mgr.34373) 4785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:17.207 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.779237+0000 mgr.gibba043.dnkmem (mgr.34373) 4786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:17.207 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: cephadm 2021-03-10T15:21:15.779340+0000 mgr.gibba043.dnkmem (mgr.34373) 4787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:17.208 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:16 gibba003 bash[31385]: audit 2021-03-10T15:21:15.779353+0000 mon.c (mon.1) 1267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.540365+0000 mgr.gibba043.dnkmem (mgr.34373) 4772 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:21:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.542007+0000 mgr.gibba043.dnkmem (mgr.34373) 4773 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:21:17.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.766332+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:21:17.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.768173+0000 mgr.gibba043.dnkmem (mgr.34373) 4774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:17.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.769917+0000 mgr.gibba043.dnkmem (mgr.34373) 4775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:17.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.769983+0000 mon.c (mon.1) 1262 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:17.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.771546+0000 mgr.gibba043.dnkmem (mgr.34373) 4776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:17.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.771551+0000 mon.c (mon.1) 1263 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.771599+0000 mgr.gibba043.dnkmem (mgr.34373) 4777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:17.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.773172+0000 mgr.gibba043.dnkmem (mgr.34373) 4778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:17.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.773246+0000 mgr.gibba043.dnkmem (mgr.34373) 4779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:17.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.773311+0000 mon.c (mon.1) 1264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.774546+0000 mgr.gibba043.dnkmem (mgr.34373) 4780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:17.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.774850+0000 mon.c (mon.1) 1265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.775991+0000 mgr.gibba043.dnkmem (mgr.34373) 4781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:17.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.776026+0000 mgr.gibba043.dnkmem (mgr.34373) 4782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:17.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.777587+0000 mgr.gibba043.dnkmem (mgr.34373) 4783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:17.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.777748+0000 mon.c (mon.1) 1266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:17.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.777904+0000 mgr.gibba043.dnkmem (mgr.34373) 4784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:17.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.779199+0000 mgr.gibba043.dnkmem (mgr.34373) 4785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:17.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.779237+0000 mgr.gibba043.dnkmem (mgr.34373) 4786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:17.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: cephadm 2021-03-10T15:21:15.779340+0000 mgr.gibba043.dnkmem (mgr.34373) 4787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:17.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:16 gibba043 bash[24019]: audit 2021-03-10T15:21:15.779353+0000 mon.c (mon.1) 1267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:17 gibba003 bash[31385]: cluster 2021-03-10T15:21:17.054975+0000 mgr.gibba043.dnkmem (mgr.34373) 4788 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:17 gibba003 bash[32348]: cluster 2021-03-10T15:21:17.054975+0000 mgr.gibba043.dnkmem (mgr.34373) 4788 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:17 gibba043 bash[24019]: cluster 2021-03-10T15:21:17.054975+0000 mgr.gibba043.dnkmem (mgr.34373) 4788 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:19 gibba003 bash[31385]: cluster 2021-03-10T15:21:19.056561+0000 mgr.gibba043.dnkmem (mgr.34373) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:19 gibba003 bash[32348]: cluster 2021-03-10T15:21:19.056561+0000 mgr.gibba043.dnkmem (mgr.34373) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:19 gibba043 bash[24019]: cluster 2021-03-10T15:21:19.056561+0000 mgr.gibba043.dnkmem (mgr.34373) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:21.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:21 gibba003 bash[31385]: cluster 2021-03-10T15:21:21.058090+0000 mgr.gibba043.dnkmem (mgr.34373) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:21 gibba003 bash[32348]: cluster 2021-03-10T15:21:21.058090+0000 mgr.gibba043.dnkmem (mgr.34373) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:21 gibba043 bash[24019]: cluster 2021-03-10T15:21:21.058090+0000 mgr.gibba043.dnkmem (mgr.34373) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:23 gibba003 bash[31385]: cluster 2021-03-10T15:21:23.059394+0000 mgr.gibba043.dnkmem (mgr.34373) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:23.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:23 gibba003 bash[32348]: cluster 2021-03-10T15:21:23.059394+0000 mgr.gibba043.dnkmem (mgr.34373) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:23.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:23 gibba043 bash[24019]: cluster 2021-03-10T15:21:23.059394+0000 mgr.gibba043.dnkmem (mgr.34373) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:25.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:25 gibba003 bash[31385]: cluster 2021-03-10T15:21:25.061199+0000 mgr.gibba043.dnkmem (mgr.34373) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:25 gibba003 bash[32348]: cluster 2021-03-10T15:21:25.061199+0000 mgr.gibba043.dnkmem (mgr.34373) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:25.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:25 gibba043 bash[24019]: cluster 2021-03-10T15:21:25.061199+0000 mgr.gibba043.dnkmem (mgr.34373) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:27 gibba003 bash[31385]: cluster 2021-03-10T15:21:27.062879+0000 mgr.gibba043.dnkmem (mgr.34373) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:27 gibba003 bash[32348]: cluster 2021-03-10T15:21:27.062879+0000 mgr.gibba043.dnkmem (mgr.34373) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:27 gibba043 bash[24019]: cluster 2021-03-10T15:21:27.062879+0000 mgr.gibba043.dnkmem (mgr.34373) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:29 gibba003 bash[31385]: cluster 2021-03-10T15:21:29.064617+0000 mgr.gibba043.dnkmem (mgr.34373) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:29 gibba003 bash[32348]: cluster 2021-03-10T15:21:29.064617+0000 mgr.gibba043.dnkmem (mgr.34373) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:29 gibba043 bash[24019]: cluster 2021-03-10T15:21:29.064617+0000 mgr.gibba043.dnkmem (mgr.34373) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:31 gibba003 bash[31385]: cephadm 2021-03-10T15:21:30.792589+0000 mgr.gibba043.dnkmem (mgr.34373) 4795 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:31 gibba003 bash[31385]: cluster 2021-03-10T15:21:31.066456+0000 mgr.gibba043.dnkmem (mgr.34373) 4796 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:31 gibba003 bash[32348]: cephadm 2021-03-10T15:21:30.792589+0000 mgr.gibba043.dnkmem (mgr.34373) 4795 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:31 gibba003 bash[32348]: cluster 2021-03-10T15:21:31.066456+0000 mgr.gibba043.dnkmem (mgr.34373) 4796 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:31 gibba043 bash[24019]: cephadm 2021-03-10T15:21:30.792589+0000 mgr.gibba043.dnkmem (mgr.34373) 4795 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:31 gibba043 bash[24019]: cluster 2021-03-10T15:21:31.066456+0000 mgr.gibba043.dnkmem (mgr.34373) 4796 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:33 gibba003 bash[31385]: cluster 2021-03-10T15:21:33.067610+0000 mgr.gibba043.dnkmem (mgr.34373) 4797 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:33 gibba003 bash[32348]: cluster 2021-03-10T15:21:33.067610+0000 mgr.gibba043.dnkmem (mgr.34373) 4797 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:33 gibba043 bash[24019]: cluster 2021-03-10T15:21:33.067610+0000 mgr.gibba043.dnkmem (mgr.34373) 4797 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:35 gibba003 bash[31385]: cluster 2021-03-10T15:21:35.069191+0000 mgr.gibba043.dnkmem (mgr.34373) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:35 gibba003 bash[32348]: cluster 2021-03-10T15:21:35.069191+0000 mgr.gibba043.dnkmem (mgr.34373) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:35 gibba043 bash[24019]: cluster 2021-03-10T15:21:35.069191+0000 mgr.gibba043.dnkmem (mgr.34373) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:37 gibba003 bash[31385]: cluster 2021-03-10T15:21:37.070859+0000 mgr.gibba043.dnkmem (mgr.34373) 4799 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:37 gibba003 bash[32348]: cluster 2021-03-10T15:21:37.070859+0000 mgr.gibba043.dnkmem (mgr.34373) 4799 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:37 gibba043 bash[24019]: cluster 2021-03-10T15:21:37.070859+0000 mgr.gibba043.dnkmem (mgr.34373) 4799 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:39 gibba003 bash[31385]: cluster 2021-03-10T15:21:39.072459+0000 mgr.gibba043.dnkmem (mgr.34373) 4800 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:39 gibba003 bash[32348]: cluster 2021-03-10T15:21:39.072459+0000 mgr.gibba043.dnkmem (mgr.34373) 4800 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:39 gibba043 bash[24019]: cluster 2021-03-10T15:21:39.072459+0000 mgr.gibba043.dnkmem (mgr.34373) 4800 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.246 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:21:40.477 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:21:40.478 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (90m) 4m ago 95m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:21:40.478 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (95m) 3m ago 95m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:21:40.478 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (90m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:21:40.478 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (90m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:21:40.479 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:21:40.479 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:21:40.479 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:21:40.479 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (89m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:21:40.480 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (95m) 4m ago 95m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:21:40.480 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (95m) 3m ago 95m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:21:40.480 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:21:40.480 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:21:40.481 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:21:40.481 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:21:40.481 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:21:40.481 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:21:40.482 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:21:40.482 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (85m) 3m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:21:40.482 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (94m) 3m ago 95m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:21:40.482 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 93m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:21:40.729 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:21:40.729 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:21:40.729 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:40.730 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:21:40.730 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:21:40.730 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:40.730 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:21:40.731 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:21:40.731 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:21:40.731 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:21:40.731 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:21:40.732 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:21:40.732 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:21:40.732 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:21:40.732 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:21:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:40 gibba003 bash[31385]: audit 2021-03-10T15:21:40.727090+0000 mon.a (mon.0) 1210 : audit [DBG] from='client.? 172.21.2.103:0/1873762587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:40 gibba003 bash[32348]: audit 2021-03-10T15:21:40.727090+0000 mon.a (mon.0) 1210 : audit [DBG] from='client.? 172.21.2.103:0/1873762587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:40 gibba043 bash[24019]: audit 2021-03-10T15:21:40.727090+0000 mon.a (mon.0) 1210 : audit [DBG] from='client.? 172.21.2.103:0/1873762587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:41 gibba003 bash[31385]: audit 2021-03-10T15:21:40.234213+0000 mgr.gibba043.dnkmem (mgr.34373) 4801 : audit [DBG] from='client.57262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:42.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:41 gibba003 bash[31385]: audit 2021-03-10T15:21:40.462515+0000 mgr.gibba043.dnkmem (mgr.34373) 4802 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:42.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:41 gibba003 bash[31385]: cluster 2021-03-10T15:21:41.074236+0000 mgr.gibba043.dnkmem (mgr.34373) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:41 gibba003 bash[32348]: audit 2021-03-10T15:21:40.234213+0000 mgr.gibba043.dnkmem (mgr.34373) 4801 : audit [DBG] from='client.57262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:42.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:41 gibba003 bash[32348]: audit 2021-03-10T15:21:40.462515+0000 mgr.gibba043.dnkmem (mgr.34373) 4802 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:42.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:41 gibba003 bash[32348]: cluster 2021-03-10T15:21:41.074236+0000 mgr.gibba043.dnkmem (mgr.34373) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:41 gibba043 bash[24019]: audit 2021-03-10T15:21:40.234213+0000 mgr.gibba043.dnkmem (mgr.34373) 4801 : audit [DBG] from='client.57262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:42.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:41 gibba043 bash[24019]: audit 2021-03-10T15:21:40.462515+0000 mgr.gibba043.dnkmem (mgr.34373) 4802 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:42.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:41 gibba043 bash[24019]: cluster 2021-03-10T15:21:41.074236+0000 mgr.gibba043.dnkmem (mgr.34373) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:43 gibba003 bash[31385]: cluster 2021-03-10T15:21:43.075661+0000 mgr.gibba043.dnkmem (mgr.34373) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:43 gibba003 bash[32348]: cluster 2021-03-10T15:21:43.075661+0000 mgr.gibba043.dnkmem (mgr.34373) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:43 gibba043 bash[24019]: cluster 2021-03-10T15:21:43.075661+0000 mgr.gibba043.dnkmem (mgr.34373) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:45 gibba003 bash[31385]: cluster 2021-03-10T15:21:45.077272+0000 mgr.gibba043.dnkmem (mgr.34373) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:45.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:45 gibba003 bash[32348]: cluster 2021-03-10T15:21:45.077272+0000 mgr.gibba043.dnkmem (mgr.34373) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:45.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:45 gibba043 bash[24019]: cluster 2021-03-10T15:21:45.077272+0000 mgr.gibba043.dnkmem (mgr.34373) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:46 gibba003 bash[31385]: cephadm 2021-03-10T15:21:45.795562+0000 mgr.gibba043.dnkmem (mgr.34373) 4806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:46 gibba003 bash[32348]: cephadm 2021-03-10T15:21:45.795562+0000 mgr.gibba043.dnkmem (mgr.34373) 4806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:46.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:46 gibba043 bash[24019]: cephadm 2021-03-10T15:21:45.795562+0000 mgr.gibba043.dnkmem (mgr.34373) 4806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:21:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:47 gibba003 bash[31385]: cluster 2021-03-10T15:21:47.078899+0000 mgr.gibba043.dnkmem (mgr.34373) 4807 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:47 gibba003 bash[32348]: cluster 2021-03-10T15:21:47.078899+0000 mgr.gibba043.dnkmem (mgr.34373) 4807 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:47 gibba043 bash[24019]: cluster 2021-03-10T15:21:47.078899+0000 mgr.gibba043.dnkmem (mgr.34373) 4807 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:49 gibba003 bash[31385]: cluster 2021-03-10T15:21:49.080548+0000 mgr.gibba043.dnkmem (mgr.34373) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:49 gibba003 bash[32348]: cluster 2021-03-10T15:21:49.080548+0000 mgr.gibba043.dnkmem (mgr.34373) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:49 gibba043 bash[24019]: cluster 2021-03-10T15:21:49.080548+0000 mgr.gibba043.dnkmem (mgr.34373) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:51 gibba003 bash[31385]: cluster 2021-03-10T15:21:51.082384+0000 mgr.gibba043.dnkmem (mgr.34373) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:51 gibba003 bash[32348]: cluster 2021-03-10T15:21:51.082384+0000 mgr.gibba043.dnkmem (mgr.34373) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:51 gibba043 bash[24019]: cluster 2021-03-10T15:21:51.082384+0000 mgr.gibba043.dnkmem (mgr.34373) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:53 gibba003 bash[31385]: cluster 2021-03-10T15:21:53.083548+0000 mgr.gibba043.dnkmem (mgr.34373) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:53 gibba003 bash[32348]: cluster 2021-03-10T15:21:53.083548+0000 mgr.gibba043.dnkmem (mgr.34373) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:53 gibba043 bash[24019]: cluster 2021-03-10T15:21:53.083548+0000 mgr.gibba043.dnkmem (mgr.34373) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:55 gibba003 bash[31385]: cluster 2021-03-10T15:21:55.085154+0000 mgr.gibba043.dnkmem (mgr.34373) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:55 gibba003 bash[32348]: cluster 2021-03-10T15:21:55.085154+0000 mgr.gibba043.dnkmem (mgr.34373) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:55 gibba043 bash[24019]: cluster 2021-03-10T15:21:55.085154+0000 mgr.gibba043.dnkmem (mgr.34373) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:57 gibba003 bash[31385]: cluster 2021-03-10T15:21:57.086764+0000 mgr.gibba043.dnkmem (mgr.34373) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:57 gibba003 bash[32348]: cluster 2021-03-10T15:21:57.086764+0000 mgr.gibba043.dnkmem (mgr.34373) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:57 gibba043 bash[24019]: cluster 2021-03-10T15:21:57.086764+0000 mgr.gibba043.dnkmem (mgr.34373) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:21:59 gibba003 bash[31385]: cluster 2021-03-10T15:21:59.088316+0000 mgr.gibba043.dnkmem (mgr.34373) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:21:59 gibba003 bash[32348]: cluster 2021-03-10T15:21:59.088316+0000 mgr.gibba043.dnkmem (mgr.34373) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:21:59 gibba043 bash[24019]: cluster 2021-03-10T15:21:59.088316+0000 mgr.gibba043.dnkmem (mgr.34373) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:01 gibba003 bash[31385]: cephadm 2021-03-10T15:22:00.811753+0000 mgr.gibba043.dnkmem (mgr.34373) 4814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:01 gibba003 bash[31385]: cluster 2021-03-10T15:22:01.090096+0000 mgr.gibba043.dnkmem (mgr.34373) 4815 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:01 gibba003 bash[32348]: cephadm 2021-03-10T15:22:00.811753+0000 mgr.gibba043.dnkmem (mgr.34373) 4814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:01 gibba003 bash[32348]: cluster 2021-03-10T15:22:01.090096+0000 mgr.gibba043.dnkmem (mgr.34373) 4815 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:01 gibba043 bash[24019]: cephadm 2021-03-10T15:22:00.811753+0000 mgr.gibba043.dnkmem (mgr.34373) 4814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:01 gibba043 bash[24019]: cluster 2021-03-10T15:22:01.090096+0000 mgr.gibba043.dnkmem (mgr.34373) 4815 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:03 gibba003 bash[31385]: cluster 2021-03-10T15:22:03.091742+0000 mgr.gibba043.dnkmem (mgr.34373) 4816 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:03 gibba003 bash[32348]: cluster 2021-03-10T15:22:03.091742+0000 mgr.gibba043.dnkmem (mgr.34373) 4816 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:03 gibba043 bash[24019]: cluster 2021-03-10T15:22:03.091742+0000 mgr.gibba043.dnkmem (mgr.34373) 4816 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:05 gibba003 bash[31385]: cluster 2021-03-10T15:22:05.093108+0000 mgr.gibba043.dnkmem (mgr.34373) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:05 gibba003 bash[32348]: cluster 2021-03-10T15:22:05.093108+0000 mgr.gibba043.dnkmem (mgr.34373) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:05 gibba043 bash[24019]: cluster 2021-03-10T15:22:05.093108+0000 mgr.gibba043.dnkmem (mgr.34373) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:07 gibba003 bash[31385]: cluster 2021-03-10T15:22:07.094792+0000 mgr.gibba043.dnkmem (mgr.34373) 4818 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:07 gibba003 bash[32348]: cluster 2021-03-10T15:22:07.094792+0000 mgr.gibba043.dnkmem (mgr.34373) 4818 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:07 gibba043 bash[24019]: cluster 2021-03-10T15:22:07.094792+0000 mgr.gibba043.dnkmem (mgr.34373) 4818 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:09 gibba003 bash[31385]: cluster 2021-03-10T15:22:09.096107+0000 mgr.gibba043.dnkmem (mgr.34373) 4819 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:09 gibba003 bash[32348]: cluster 2021-03-10T15:22:09.096107+0000 mgr.gibba043.dnkmem (mgr.34373) 4819 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:09 gibba043 bash[24019]: cluster 2021-03-10T15:22:09.096107+0000 mgr.gibba043.dnkmem (mgr.34373) 4819 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:10.974 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:22:11.200 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:22:11.200 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (90m) 5m ago 95m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:22:11.200 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (95m) 4m ago 95m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:22:11.201 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (90m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:22:11.201 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:22:11.201 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:22:11.201 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:22:11.202 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (89m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:22:11.202 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:22:11.202 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (95m) 5m ago 96m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:22:11.202 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (96m) 4m ago 96m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:22:11.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:22:11.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:22:11.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:22:11.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (87m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:22:11.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:22:11.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:22:11.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (86m) 4m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:22:11.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (85m) 4m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:22:11.204 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (95m) 4m ago 96m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:22:11.205 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 94m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:22:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:11 gibba003 bash[31385]: audit 2021-03-10T15:22:10.961532+0000 mgr.gibba043.dnkmem (mgr.34373) 4820 : audit [DBG] from='client.57280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:11.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:11 gibba003 bash[31385]: cluster 2021-03-10T15:22:11.097891+0000 mgr.gibba043.dnkmem (mgr.34373) 4821 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:11 gibba003 bash[32348]: audit 2021-03-10T15:22:10.961532+0000 mgr.gibba043.dnkmem (mgr.34373) 4820 : audit [DBG] from='client.57280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:11 gibba003 bash[32348]: cluster 2021-03-10T15:22:11.097891+0000 mgr.gibba043.dnkmem (mgr.34373) 4821 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.449 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:22:11.450 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:22:11.450 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:11.450 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:22:11.451 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:22:11.451 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:11.451 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:22:11.451 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:22:11.452 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:22:11.452 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:22:11.452 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:22:11.452 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:22:11.453 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:22:11.453 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:22:11.453 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:22:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:11 gibba043 bash[24019]: audit 2021-03-10T15:22:10.961532+0000 mgr.gibba043.dnkmem (mgr.34373) 4820 : audit [DBG] from='client.57280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:11 gibba043 bash[24019]: cluster 2021-03-10T15:22:11.097891+0000 mgr.gibba043.dnkmem (mgr.34373) 4821 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:12.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:12 gibba003 bash[31385]: audit 2021-03-10T15:22:11.187444+0000 mgr.gibba043.dnkmem (mgr.34373) 4822 : audit [DBG] from='client.57286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:12.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:12 gibba003 bash[31385]: audit 2021-03-10T15:22:11.448065+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.2.103:0/3286215446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:12.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:12 gibba003 bash[32348]: audit 2021-03-10T15:22:11.187444+0000 mgr.gibba043.dnkmem (mgr.34373) 4822 : audit [DBG] from='client.57286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:12.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:12 gibba003 bash[32348]: audit 2021-03-10T15:22:11.448065+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.2.103:0/3286215446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:12.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:12 gibba043 bash[24019]: audit 2021-03-10T15:22:11.187444+0000 mgr.gibba043.dnkmem (mgr.34373) 4822 : audit [DBG] from='client.57286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:12.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:12 gibba043 bash[24019]: audit 2021-03-10T15:22:11.448065+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.2.103:0/3286215446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:13 gibba003 bash[31385]: cluster 2021-03-10T15:22:13.099470+0000 mgr.gibba043.dnkmem (mgr.34373) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:13 gibba003 bash[32348]: cluster 2021-03-10T15:22:13.099470+0000 mgr.gibba043.dnkmem (mgr.34373) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:13 gibba043 bash[24019]: cluster 2021-03-10T15:22:13.099470+0000 mgr.gibba043.dnkmem (mgr.34373) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.290222+0000 mon.c (mon.1) 1268 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.291462+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.402452+0000 mon.c (mon.1) 1269 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.403570+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.467729+0000 mon.c (mon.1) 1270 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:22:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.468449+0000 mon.c (mon.1) 1271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.469094+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:22:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.469547+0000 mon.c (mon.1) 1272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:22:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.470938+0000 mon.c (mon.1) 1273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.471596+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.473125+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:22:14.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[31385]: audit 2021-03-10T15:22:13.473491+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.290222+0000 mon.c (mon.1) 1268 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.291462+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.402452+0000 mon.c (mon.1) 1269 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:14.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.403570+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:14.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.467729+0000 mon.c (mon.1) 1270 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:22:14.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.468449+0000 mon.c (mon.1) 1271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.469094+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:22:14.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.469547+0000 mon.c (mon.1) 1272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:22:14.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.470938+0000 mon.c (mon.1) 1273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.471596+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.473125+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:22:14.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:14 gibba003 bash[32348]: audit 2021-03-10T15:22:13.473491+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.290222+0000 mon.c (mon.1) 1268 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.291462+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.402452+0000 mon.c (mon.1) 1269 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.403570+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.467729+0000 mon.c (mon.1) 1270 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:22:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.468449+0000 mon.c (mon.1) 1271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.469094+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:22:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.469547+0000 mon.c (mon.1) 1272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:22:14.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.470938+0000 mon.c (mon.1) 1273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.471596+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:22:14.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.473125+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:22:14.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:14 gibba043 bash[24019]: audit 2021-03-10T15:22:13.473491+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:22:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:15 gibba003 bash[31385]: cluster 2021-03-10T15:22:15.100914+0000 mgr.gibba043.dnkmem (mgr.34373) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:15 gibba003 bash[32348]: cluster 2021-03-10T15:22:15.100914+0000 mgr.gibba043.dnkmem (mgr.34373) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:15 gibba043 bash[24019]: cluster 2021-03-10T15:22:15.100914+0000 mgr.gibba043.dnkmem (mgr.34373) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:15.828681+0000 mgr.gibba043.dnkmem (mgr.34373) 4825 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:22:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:15.830259+0000 mgr.gibba043.dnkmem (mgr.34373) 4826 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:22:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.050462+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:22:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.052255+0000 mgr.gibba043.dnkmem (mgr.34373) 4827 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.053824+0000 mgr.gibba043.dnkmem (mgr.34373) 4828 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.054096+0000 mon.c (mon.1) 1274 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.055032+0000 mgr.gibba043.dnkmem (mgr.34373) 4829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.055072+0000 mgr.gibba043.dnkmem (mgr.34373) 4830 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.055363+0000 mon.c (mon.1) 1275 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.056570+0000 mgr.gibba043.dnkmem (mgr.34373) 4831 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:17.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.056607+0000 mgr.gibba043.dnkmem (mgr.34373) 4832 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.056713+0000 mon.c (mon.1) 1276 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.057796+0000 mgr.gibba043.dnkmem (mgr.34373) 4833 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.058189+0000 mon.c (mon.1) 1277 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.059519+0000 mgr.gibba043.dnkmem (mgr.34373) 4834 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:17.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.059558+0000 mgr.gibba043.dnkmem (mgr.34373) 4835 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.060636+0000 mgr.gibba043.dnkmem (mgr.34373) 4836 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.060961+0000 mgr.gibba043.dnkmem (mgr.34373) 4837 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.061120+0000 mon.c (mon.1) 1278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.061967+0000 mgr.gibba043.dnkmem (mgr.34373) 4838 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:17.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.062007+0000 mgr.gibba043.dnkmem (mgr.34373) 4839 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:17.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: cephadm 2021-03-10T15:22:16.062117+0000 mgr.gibba043.dnkmem (mgr.34373) 4840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:17.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[31385]: audit 2021-03-10T15:22:16.062472+0000 mon.c (mon.1) 1279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:15.828681+0000 mgr.gibba043.dnkmem (mgr.34373) 4825 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:22:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:15.830259+0000 mgr.gibba043.dnkmem (mgr.34373) 4826 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:22:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.050462+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:22:17.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.052255+0000 mgr.gibba043.dnkmem (mgr.34373) 4827 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.053824+0000 mgr.gibba043.dnkmem (mgr.34373) 4828 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.054096+0000 mon.c (mon.1) 1274 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.055032+0000 mgr.gibba043.dnkmem (mgr.34373) 4829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.055072+0000 mgr.gibba043.dnkmem (mgr.34373) 4830 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:17.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.055363+0000 mon.c (mon.1) 1275 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.056570+0000 mgr.gibba043.dnkmem (mgr.34373) 4831 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.056607+0000 mgr.gibba043.dnkmem (mgr.34373) 4832 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.056713+0000 mon.c (mon.1) 1276 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.057796+0000 mgr.gibba043.dnkmem (mgr.34373) 4833 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.058189+0000 mon.c (mon.1) 1277 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.059519+0000 mgr.gibba043.dnkmem (mgr.34373) 4834 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.059558+0000 mgr.gibba043.dnkmem (mgr.34373) 4835 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:17.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.060636+0000 mgr.gibba043.dnkmem (mgr.34373) 4836 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:17.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.060961+0000 mgr.gibba043.dnkmem (mgr.34373) 4837 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:17.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.061120+0000 mon.c (mon.1) 1278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.061967+0000 mgr.gibba043.dnkmem (mgr.34373) 4838 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:17.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.062007+0000 mgr.gibba043.dnkmem (mgr.34373) 4839 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:17.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: cephadm 2021-03-10T15:22:16.062117+0000 mgr.gibba043.dnkmem (mgr.34373) 4840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:17.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:17 gibba003 bash[32348]: audit 2021-03-10T15:22:16.062472+0000 mon.c (mon.1) 1279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:15.828681+0000 mgr.gibba043.dnkmem (mgr.34373) 4825 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:22:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:15.830259+0000 mgr.gibba043.dnkmem (mgr.34373) 4826 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:22:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.050462+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:22:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.052255+0000 mgr.gibba043.dnkmem (mgr.34373) 4827 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.053824+0000 mgr.gibba043.dnkmem (mgr.34373) 4828 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.054096+0000 mon.c (mon.1) 1274 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.055032+0000 mgr.gibba043.dnkmem (mgr.34373) 4829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.055072+0000 mgr.gibba043.dnkmem (mgr.34373) 4830 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.055363+0000 mon.c (mon.1) 1275 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.056570+0000 mgr.gibba043.dnkmem (mgr.34373) 4831 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.056607+0000 mgr.gibba043.dnkmem (mgr.34373) 4832 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.056713+0000 mon.c (mon.1) 1276 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.057796+0000 mgr.gibba043.dnkmem (mgr.34373) 4833 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.058189+0000 mon.c (mon.1) 1277 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.059519+0000 mgr.gibba043.dnkmem (mgr.34373) 4834 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.059558+0000 mgr.gibba043.dnkmem (mgr.34373) 4835 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.060636+0000 mgr.gibba043.dnkmem (mgr.34373) 4836 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.060961+0000 mgr.gibba043.dnkmem (mgr.34373) 4837 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:17.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.061120+0000 mon.c (mon.1) 1278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.061967+0000 mgr.gibba043.dnkmem (mgr.34373) 4838 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.062007+0000 mgr.gibba043.dnkmem (mgr.34373) 4839 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: cephadm 2021-03-10T15:22:16.062117+0000 mgr.gibba043.dnkmem (mgr.34373) 4840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:17.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:17 gibba043 bash[24019]: audit 2021-03-10T15:22:16.062472+0000 mon.c (mon.1) 1279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:18 gibba003 bash[31385]: cluster 2021-03-10T15:22:17.101850+0000 mgr.gibba043.dnkmem (mgr.34373) 4841 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:18 gibba003 bash[32348]: cluster 2021-03-10T15:22:17.101850+0000 mgr.gibba043.dnkmem (mgr.34373) 4841 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:18 gibba043 bash[24019]: cluster 2021-03-10T15:22:17.101850+0000 mgr.gibba043.dnkmem (mgr.34373) 4841 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:19 gibba003 bash[31385]: cluster 2021-03-10T15:22:19.103417+0000 mgr.gibba043.dnkmem (mgr.34373) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:19 gibba003 bash[32348]: cluster 2021-03-10T15:22:19.103417+0000 mgr.gibba043.dnkmem (mgr.34373) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:19 gibba043 bash[24019]: cluster 2021-03-10T15:22:19.103417+0000 mgr.gibba043.dnkmem (mgr.34373) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:21 gibba003 bash[31385]: cluster 2021-03-10T15:22:21.104926+0000 mgr.gibba043.dnkmem (mgr.34373) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:21 gibba003 bash[32348]: cluster 2021-03-10T15:22:21.104926+0000 mgr.gibba043.dnkmem (mgr.34373) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:21 gibba043 bash[24019]: cluster 2021-03-10T15:22:21.104926+0000 mgr.gibba043.dnkmem (mgr.34373) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:23 gibba003 bash[31385]: cluster 2021-03-10T15:22:23.106386+0000 mgr.gibba043.dnkmem (mgr.34373) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:23 gibba003 bash[32348]: cluster 2021-03-10T15:22:23.106386+0000 mgr.gibba043.dnkmem (mgr.34373) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:23 gibba043 bash[24019]: cluster 2021-03-10T15:22:23.106386+0000 mgr.gibba043.dnkmem (mgr.34373) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:25.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:25 gibba003 bash[31385]: cluster 2021-03-10T15:22:25.107893+0000 mgr.gibba043.dnkmem (mgr.34373) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:25 gibba003 bash[32348]: cluster 2021-03-10T15:22:25.107893+0000 mgr.gibba043.dnkmem (mgr.34373) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:25.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:25 gibba043 bash[24019]: cluster 2021-03-10T15:22:25.107893+0000 mgr.gibba043.dnkmem (mgr.34373) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:27 gibba003 bash[31385]: cluster 2021-03-10T15:22:27.109421+0000 mgr.gibba043.dnkmem (mgr.34373) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:27 gibba003 bash[32348]: cluster 2021-03-10T15:22:27.109421+0000 mgr.gibba043.dnkmem (mgr.34373) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:27 gibba043 bash[24019]: cluster 2021-03-10T15:22:27.109421+0000 mgr.gibba043.dnkmem (mgr.34373) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:29 gibba003 bash[31385]: cluster 2021-03-10T15:22:29.111280+0000 mgr.gibba043.dnkmem (mgr.34373) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:29 gibba003 bash[32348]: cluster 2021-03-10T15:22:29.111280+0000 mgr.gibba043.dnkmem (mgr.34373) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:29 gibba043 bash[24019]: cluster 2021-03-10T15:22:29.111280+0000 mgr.gibba043.dnkmem (mgr.34373) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:31 gibba003 bash[31385]: cephadm 2021-03-10T15:22:31.078166+0000 mgr.gibba043.dnkmem (mgr.34373) 4848 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:31 gibba003 bash[31385]: cluster 2021-03-10T15:22:31.113295+0000 mgr.gibba043.dnkmem (mgr.34373) 4849 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:31 gibba003 bash[32348]: cephadm 2021-03-10T15:22:31.078166+0000 mgr.gibba043.dnkmem (mgr.34373) 4848 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:31 gibba003 bash[32348]: cluster 2021-03-10T15:22:31.113295+0000 mgr.gibba043.dnkmem (mgr.34373) 4849 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:31 gibba043 bash[24019]: cephadm 2021-03-10T15:22:31.078166+0000 mgr.gibba043.dnkmem (mgr.34373) 4848 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:31 gibba043 bash[24019]: cluster 2021-03-10T15:22:31.113295+0000 mgr.gibba043.dnkmem (mgr.34373) 4849 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:33 gibba003 bash[31385]: cluster 2021-03-10T15:22:33.114854+0000 mgr.gibba043.dnkmem (mgr.34373) 4850 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:33 gibba003 bash[32348]: cluster 2021-03-10T15:22:33.114854+0000 mgr.gibba043.dnkmem (mgr.34373) 4850 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:33 gibba043 bash[24019]: cluster 2021-03-10T15:22:33.114854+0000 mgr.gibba043.dnkmem (mgr.34373) 4850 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:35 gibba003 bash[31385]: cluster 2021-03-10T15:22:35.116448+0000 mgr.gibba043.dnkmem (mgr.34373) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:35 gibba003 bash[32348]: cluster 2021-03-10T15:22:35.116448+0000 mgr.gibba043.dnkmem (mgr.34373) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:35 gibba043 bash[24019]: cluster 2021-03-10T15:22:35.116448+0000 mgr.gibba043.dnkmem (mgr.34373) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:37 gibba003 bash[31385]: cluster 2021-03-10T15:22:37.118039+0000 mgr.gibba043.dnkmem (mgr.34373) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:37 gibba003 bash[32348]: cluster 2021-03-10T15:22:37.118039+0000 mgr.gibba043.dnkmem (mgr.34373) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:37 gibba043 bash[24019]: cluster 2021-03-10T15:22:37.118039+0000 mgr.gibba043.dnkmem (mgr.34373) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:39 gibba003 bash[31385]: cluster 2021-03-10T15:22:39.119551+0000 mgr.gibba043.dnkmem (mgr.34373) 4853 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:39.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:39 gibba003 bash[32348]: cluster 2021-03-10T15:22:39.119551+0000 mgr.gibba043.dnkmem (mgr.34373) 4853 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:39 gibba043 bash[24019]: cluster 2021-03-10T15:22:39.119551+0000 mgr.gibba043.dnkmem (mgr.34373) 4853 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:41 gibba003 bash[31385]: cluster 2021-03-10T15:22:41.121177+0000 mgr.gibba043.dnkmem (mgr.34373) 4854 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:41 gibba003 bash[32348]: cluster 2021-03-10T15:22:41.121177+0000 mgr.gibba043.dnkmem (mgr.34373) 4854 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:41 gibba043 bash[24019]: cluster 2021-03-10T15:22:41.121177+0000 mgr.gibba043.dnkmem (mgr.34373) 4854 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.696 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:22:41.924 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:22:41.924 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (91m) 5m ago 96m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:22:41.925 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (96m) 4m ago 96m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:22:41.925 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:22:41.925 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:22:41.925 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:22:41.926 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:22:41.926 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (90m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:22:41.926 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:22:41.926 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (96m) 5m ago 96m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:22:41.926 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (96m) 4m ago 96m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:22:41.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:22:41.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:22:41.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:22:41.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:22:41.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:22:41.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:22:41.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:22:41.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (86m) 4m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:22:41.928 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (95m) 4m ago 96m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:22:41.929 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 94m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:22:42.174 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:22:42.174 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:22:42.174 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:42.175 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:22:42.175 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:22:42.175 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:42.175 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:22:42.176 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:22:42.176 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:22:42.176 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:22:42.176 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:22:42.176 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:22:42.177 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:22:42.177 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:22:42.177 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:22:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:42 gibba003 bash[31385]: audit 2021-03-10T15:22:41.683757+0000 mgr.gibba043.dnkmem (mgr.34373) 4855 : audit [DBG] from='client.57298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:42 gibba003 bash[31385]: audit 2021-03-10T15:22:41.909857+0000 mgr.gibba043.dnkmem (mgr.34373) 4856 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:42.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:42 gibba003 bash[31385]: audit 2021-03-10T15:22:42.172119+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.103:0/2608233860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:42.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:42 gibba003 bash[32348]: audit 2021-03-10T15:22:41.683757+0000 mgr.gibba043.dnkmem (mgr.34373) 4855 : audit [DBG] from='client.57298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:42.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:42 gibba003 bash[32348]: audit 2021-03-10T15:22:41.909857+0000 mgr.gibba043.dnkmem (mgr.34373) 4856 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:42.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:42 gibba003 bash[32348]: audit 2021-03-10T15:22:42.172119+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.103:0/2608233860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:42.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:42 gibba043 bash[24019]: audit 2021-03-10T15:22:41.683757+0000 mgr.gibba043.dnkmem (mgr.34373) 4855 : audit [DBG] from='client.57298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:42.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:42 gibba043 bash[24019]: audit 2021-03-10T15:22:41.909857+0000 mgr.gibba043.dnkmem (mgr.34373) 4856 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:42.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:42 gibba043 bash[24019]: audit 2021-03-10T15:22:42.172119+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.103:0/2608233860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:43 gibba043 bash[24019]: cluster 2021-03-10T15:22:43.122540+0000 mgr.gibba043.dnkmem (mgr.34373) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:43 gibba003 bash[31385]: cluster 2021-03-10T15:22:43.122540+0000 mgr.gibba043.dnkmem (mgr.34373) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:43 gibba003 bash[32348]: cluster 2021-03-10T15:22:43.122540+0000 mgr.gibba043.dnkmem (mgr.34373) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:45 gibba003 bash[31385]: cluster 2021-03-10T15:22:45.123984+0000 mgr.gibba043.dnkmem (mgr.34373) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:45 gibba003 bash[32348]: cluster 2021-03-10T15:22:45.123984+0000 mgr.gibba043.dnkmem (mgr.34373) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:45.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:45 gibba043 bash[24019]: cluster 2021-03-10T15:22:45.123984+0000 mgr.gibba043.dnkmem (mgr.34373) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:46 gibba043 bash[24019]: cephadm 2021-03-10T15:22:46.094274+0000 mgr.gibba043.dnkmem (mgr.34373) 4859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:46 gibba003 bash[31385]: cephadm 2021-03-10T15:22:46.094274+0000 mgr.gibba043.dnkmem (mgr.34373) 4859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:46 gibba003 bash[32348]: cephadm 2021-03-10T15:22:46.094274+0000 mgr.gibba043.dnkmem (mgr.34373) 4859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:22:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:47 gibba003 bash[31385]: cluster 2021-03-10T15:22:47.125674+0000 mgr.gibba043.dnkmem (mgr.34373) 4860 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:47 gibba003 bash[32348]: cluster 2021-03-10T15:22:47.125674+0000 mgr.gibba043.dnkmem (mgr.34373) 4860 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:47 gibba043 bash[24019]: cluster 2021-03-10T15:22:47.125674+0000 mgr.gibba043.dnkmem (mgr.34373) 4860 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:49 gibba043 bash[24019]: cluster 2021-03-10T15:22:49.127387+0000 mgr.gibba043.dnkmem (mgr.34373) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:49 gibba003 bash[31385]: cluster 2021-03-10T15:22:49.127387+0000 mgr.gibba043.dnkmem (mgr.34373) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:49.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:49 gibba003 bash[32348]: cluster 2021-03-10T15:22:49.127387+0000 mgr.gibba043.dnkmem (mgr.34373) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:51 gibba043 bash[24019]: cluster 2021-03-10T15:22:51.129193+0000 mgr.gibba043.dnkmem (mgr.34373) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:51 gibba003 bash[31385]: cluster 2021-03-10T15:22:51.129193+0000 mgr.gibba043.dnkmem (mgr.34373) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:51 gibba003 bash[32348]: cluster 2021-03-10T15:22:51.129193+0000 mgr.gibba043.dnkmem (mgr.34373) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:53 gibba043 bash[24019]: cluster 2021-03-10T15:22:53.130698+0000 mgr.gibba043.dnkmem (mgr.34373) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:53 gibba003 bash[31385]: cluster 2021-03-10T15:22:53.130698+0000 mgr.gibba043.dnkmem (mgr.34373) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:53.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:53 gibba003 bash[32348]: cluster 2021-03-10T15:22:53.130698+0000 mgr.gibba043.dnkmem (mgr.34373) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:55 gibba003 bash[31385]: cluster 2021-03-10T15:22:55.132404+0000 mgr.gibba043.dnkmem (mgr.34373) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:55 gibba003 bash[32348]: cluster 2021-03-10T15:22:55.132404+0000 mgr.gibba043.dnkmem (mgr.34373) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:55 gibba043 bash[24019]: cluster 2021-03-10T15:22:55.132404+0000 mgr.gibba043.dnkmem (mgr.34373) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:57 gibba043 bash[24019]: cluster 2021-03-10T15:22:57.134149+0000 mgr.gibba043.dnkmem (mgr.34373) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:57 gibba003 bash[31385]: cluster 2021-03-10T15:22:57.134149+0000 mgr.gibba043.dnkmem (mgr.34373) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:57 gibba003 bash[32348]: cluster 2021-03-10T15:22:57.134149+0000 mgr.gibba043.dnkmem (mgr.34373) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:22:59 gibba043 bash[24019]: cluster 2021-03-10T15:22:59.135891+0000 mgr.gibba043.dnkmem (mgr.34373) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:22:59 gibba003 bash[31385]: cluster 2021-03-10T15:22:59.135891+0000 mgr.gibba043.dnkmem (mgr.34373) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:22:59 gibba003 bash[32348]: cluster 2021-03-10T15:22:59.135891+0000 mgr.gibba043.dnkmem (mgr.34373) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:01 gibba043 bash[24019]: cephadm 2021-03-10T15:23:01.110372+0000 mgr.gibba043.dnkmem (mgr.34373) 4867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:01.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:01 gibba003 bash[31385]: cephadm 2021-03-10T15:23:01.110372+0000 mgr.gibba043.dnkmem (mgr.34373) 4867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:01 gibba003 bash[32348]: cephadm 2021-03-10T15:23:01.110372+0000 mgr.gibba043.dnkmem (mgr.34373) 4867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:02 gibba043 bash[24019]: cluster 2021-03-10T15:23:01.137438+0000 mgr.gibba043.dnkmem (mgr.34373) 4868 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:02 gibba003 bash[31385]: cluster 2021-03-10T15:23:01.137438+0000 mgr.gibba043.dnkmem (mgr.34373) 4868 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:02.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:02 gibba003 bash[32348]: cluster 2021-03-10T15:23:01.137438+0000 mgr.gibba043.dnkmem (mgr.34373) 4868 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:04.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:04 gibba043 bash[24019]: cluster 2021-03-10T15:23:03.138860+0000 mgr.gibba043.dnkmem (mgr.34373) 4869 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:04.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:04 gibba003 bash[31385]: cluster 2021-03-10T15:23:03.138860+0000 mgr.gibba043.dnkmem (mgr.34373) 4869 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:04.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:04 gibba003 bash[32348]: cluster 2021-03-10T15:23:03.138860+0000 mgr.gibba043.dnkmem (mgr.34373) 4869 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:06.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:06 gibba003 bash[31385]: cluster 2021-03-10T15:23:05.140416+0000 mgr.gibba043.dnkmem (mgr.34373) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:06.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:06 gibba003 bash[32348]: cluster 2021-03-10T15:23:05.140416+0000 mgr.gibba043.dnkmem (mgr.34373) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:06.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:06 gibba043 bash[24019]: cluster 2021-03-10T15:23:05.140416+0000 mgr.gibba043.dnkmem (mgr.34373) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:08.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:08 gibba003 bash[31385]: cluster 2021-03-10T15:23:07.142026+0000 mgr.gibba043.dnkmem (mgr.34373) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:08.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:08 gibba003 bash[32348]: cluster 2021-03-10T15:23:07.142026+0000 mgr.gibba043.dnkmem (mgr.34373) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:08.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:08 gibba043 bash[24019]: cluster 2021-03-10T15:23:07.142026+0000 mgr.gibba043.dnkmem (mgr.34373) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:10.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:10 gibba003 bash[31385]: cluster 2021-03-10T15:23:09.143527+0000 mgr.gibba043.dnkmem (mgr.34373) 4872 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:10.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:10 gibba003 bash[32348]: cluster 2021-03-10T15:23:09.143527+0000 mgr.gibba043.dnkmem (mgr.34373) 4872 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:10.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:10 gibba043 bash[24019]: cluster 2021-03-10T15:23:09.143527+0000 mgr.gibba043.dnkmem (mgr.34373) 4872 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.421 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:23:12.650 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:23:12.650 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (91m) 6m ago 96m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:23:12.651 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (96m) 5m ago 96m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:23:12.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (91m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:23:12.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:23:12.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:23:12.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:23:12.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:23:12.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (90m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:23:12.652 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (97m) 6m ago 97m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:23:12.653 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (97m) 5m ago 97m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:23:12.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:23:12.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:23:12.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:23:12.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (88m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:23:12.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:23:12.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:23:12.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (87m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:23:12.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (86m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:23:12.655 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (96m) 5m ago 97m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:23:12.655 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 95m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:23:12.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:12 gibba003 bash[31385]: cluster 2021-03-10T15:23:11.145166+0000 mgr.gibba043.dnkmem (mgr.34373) 4873 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:12 gibba003 bash[32348]: cluster 2021-03-10T15:23:11.145166+0000 mgr.gibba043.dnkmem (mgr.34373) 4873 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:12 gibba043 bash[24019]: cluster 2021-03-10T15:23:11.145166+0000 mgr.gibba043.dnkmem (mgr.34373) 4873 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.900 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:23:12.900 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:23:12.901 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:12.901 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:23:12.901 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:23:12.901 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:12.902 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:23:12.902 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:23:12.902 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:23:12.902 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:23:12.902 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:23:12.903 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:23:12.903 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:23:12.903 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:23:12.903 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:23:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[31385]: audit 2021-03-10T15:23:12.409300+0000 mgr.gibba043.dnkmem (mgr.34373) 4874 : audit [DBG] from='client.47328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[31385]: audit 2021-03-10T15:23:12.635301+0000 mgr.gibba043.dnkmem (mgr.34373) 4875 : audit [DBG] from='client.57322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[31385]: audit 2021-03-10T15:23:12.898289+0000 mon.a (mon.0) 1220 : audit [DBG] from='client.? 172.21.2.103:0/3989630294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[31385]: audit 2021-03-10T15:23:13.297301+0000 mon.c (mon.1) 1280 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[31385]: audit 2021-03-10T15:23:13.298432+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[32348]: audit 2021-03-10T15:23:12.409300+0000 mgr.gibba043.dnkmem (mgr.34373) 4874 : audit [DBG] from='client.47328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[32348]: audit 2021-03-10T15:23:12.635301+0000 mgr.gibba043.dnkmem (mgr.34373) 4875 : audit [DBG] from='client.57322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[32348]: audit 2021-03-10T15:23:12.898289+0000 mon.a (mon.0) 1220 : audit [DBG] from='client.? 172.21.2.103:0/3989630294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[32348]: audit 2021-03-10T15:23:13.297301+0000 mon.c (mon.1) 1280 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:13.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:13 gibba003 bash[32348]: audit 2021-03-10T15:23:13.298432+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:13 gibba043 bash[24019]: audit 2021-03-10T15:23:12.409300+0000 mgr.gibba043.dnkmem (mgr.34373) 4874 : audit [DBG] from='client.47328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:13 gibba043 bash[24019]: audit 2021-03-10T15:23:12.635301+0000 mgr.gibba043.dnkmem (mgr.34373) 4875 : audit [DBG] from='client.57322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:13 gibba043 bash[24019]: audit 2021-03-10T15:23:12.898289+0000 mon.a (mon.0) 1220 : audit [DBG] from='client.? 172.21.2.103:0/3989630294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:13 gibba043 bash[24019]: audit 2021-03-10T15:23:13.297301+0000 mon.c (mon.1) 1280 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:13 gibba043 bash[24019]: audit 2021-03-10T15:23:13.298432+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: cluster 2021-03-10T15:23:13.146642+0000 mgr.gibba043.dnkmem (mgr.34373) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.410092+0000 mon.c (mon.1) 1281 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.410606+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.476430+0000 mon.c (mon.1) 1282 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:23:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.477188+0000 mon.c (mon.1) 1283 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:23:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.477678+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:23:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.477929+0000 mon.c (mon.1) 1284 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.478831+0000 mon.c (mon.1) 1285 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.478877+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:23:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.479878+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[31385]: audit 2021-03-10T15:23:13.480889+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: cluster 2021-03-10T15:23:13.146642+0000 mgr.gibba043.dnkmem (mgr.34373) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.410092+0000 mon.c (mon.1) 1281 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.410606+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.476430+0000 mon.c (mon.1) 1282 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:23:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.477188+0000 mon.c (mon.1) 1283 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:23:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.477678+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:23:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.477929+0000 mon.c (mon.1) 1284 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.478831+0000 mon.c (mon.1) 1285 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.478877+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:23:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.479878+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:14 gibba003 bash[32348]: audit 2021-03-10T15:23:13.480889+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: cluster 2021-03-10T15:23:13.146642+0000 mgr.gibba043.dnkmem (mgr.34373) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.410092+0000 mon.c (mon.1) 1281 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.410606+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.476430+0000 mon.c (mon.1) 1282 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:23:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.477188+0000 mon.c (mon.1) 1283 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:23:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.477678+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:23:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.477929+0000 mon.c (mon.1) 1284 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.478831+0000 mon.c (mon.1) 1285 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.478877+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:23:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.479878+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:14 gibba043 bash[24019]: audit 2021-03-10T15:23:13.480889+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:23:16.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: cluster 2021-03-10T15:23:15.148099+0000 mgr.gibba043.dnkmem (mgr.34373) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:16.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.119644+0000 mgr.gibba043.dnkmem (mgr.34373) 4878 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:23:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.121219+0000 mgr.gibba043.dnkmem (mgr.34373) 4879 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:23:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.344894+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:23:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.348028+0000 mon.c (mon.1) 1286 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:16.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.349124+0000 mon.c (mon.1) 1287 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.350316+0000 mon.c (mon.1) 1288 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.351523+0000 mon.c (mon.1) 1289 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.354279+0000 mon.c (mon.1) 1290 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[31385]: audit 2021-03-10T15:23:16.355521+0000 mon.c (mon.1) 1291 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: cluster 2021-03-10T15:23:15.148099+0000 mgr.gibba043.dnkmem (mgr.34373) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:16.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.119644+0000 mgr.gibba043.dnkmem (mgr.34373) 4878 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:23:16.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.121219+0000 mgr.gibba043.dnkmem (mgr.34373) 4879 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:23:16.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.344894+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:23:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.348028+0000 mon.c (mon.1) 1286 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.349124+0000 mon.c (mon.1) 1287 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.350316+0000 mon.c (mon.1) 1288 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.351523+0000 mon.c (mon.1) 1289 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.354279+0000 mon.c (mon.1) 1290 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:16 gibba003 bash[32348]: audit 2021-03-10T15:23:16.355521+0000 mon.c (mon.1) 1291 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: cluster 2021-03-10T15:23:15.148099+0000 mgr.gibba043.dnkmem (mgr.34373) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:16.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.119644+0000 mgr.gibba043.dnkmem (mgr.34373) 4878 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:23:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.121219+0000 mgr.gibba043.dnkmem (mgr.34373) 4879 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:23:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.344894+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:23:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.348028+0000 mon.c (mon.1) 1286 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.349124+0000 mon.c (mon.1) 1287 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.350316+0000 mon.c (mon.1) 1288 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.351523+0000 mon.c (mon.1) 1289 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.354279+0000 mon.c (mon.1) 1290 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:16.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:16 gibba043 bash[24019]: audit 2021-03-10T15:23:16.355521+0000 mon.c (mon.1) 1291 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:17.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.346150+0000 mgr.gibba043.dnkmem (mgr.34373) 4880 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:17.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.347587+0000 mgr.gibba043.dnkmem (mgr.34373) 4881 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:17.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.348739+0000 mgr.gibba043.dnkmem (mgr.34373) 4882 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:17.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.348778+0000 mgr.gibba043.dnkmem (mgr.34373) 4883 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.349830+0000 mgr.gibba043.dnkmem (mgr.34373) 4884 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.349870+0000 mgr.gibba043.dnkmem (mgr.34373) 4885 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:17.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.351073+0000 mgr.gibba043.dnkmem (mgr.34373) 4886 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.352570+0000 mgr.gibba043.dnkmem (mgr.34373) 4887 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:17.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.352609+0000 mgr.gibba043.dnkmem (mgr.34373) 4888 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.353779+0000 mgr.gibba043.dnkmem (mgr.34373) 4889 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:17.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.354108+0000 mgr.gibba043.dnkmem (mgr.34373) 4890 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.355010+0000 mgr.gibba043.dnkmem (mgr.34373) 4891 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.355051+0000 mgr.gibba043.dnkmem (mgr.34373) 4892 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[31385]: cephadm 2021-03-10T15:23:16.355159+0000 mgr.gibba043.dnkmem (mgr.34373) 4893 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:17.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.346150+0000 mgr.gibba043.dnkmem (mgr.34373) 4880 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:17.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.347587+0000 mgr.gibba043.dnkmem (mgr.34373) 4881 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:17.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.348739+0000 mgr.gibba043.dnkmem (mgr.34373) 4882 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:17.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.348778+0000 mgr.gibba043.dnkmem (mgr.34373) 4883 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:17.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.349830+0000 mgr.gibba043.dnkmem (mgr.34373) 4884 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:17.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.349870+0000 mgr.gibba043.dnkmem (mgr.34373) 4885 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:17.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.351073+0000 mgr.gibba043.dnkmem (mgr.34373) 4886 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:17.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.352570+0000 mgr.gibba043.dnkmem (mgr.34373) 4887 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:17.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.352609+0000 mgr.gibba043.dnkmem (mgr.34373) 4888 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:17.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.353779+0000 mgr.gibba043.dnkmem (mgr.34373) 4889 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:17.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.354108+0000 mgr.gibba043.dnkmem (mgr.34373) 4890 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:17.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.355010+0000 mgr.gibba043.dnkmem (mgr.34373) 4891 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:17.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.355051+0000 mgr.gibba043.dnkmem (mgr.34373) 4892 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:17.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:17 gibba003 bash[32348]: cephadm 2021-03-10T15:23:16.355159+0000 mgr.gibba043.dnkmem (mgr.34373) 4893 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.346150+0000 mgr.gibba043.dnkmem (mgr.34373) 4880 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.347587+0000 mgr.gibba043.dnkmem (mgr.34373) 4881 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.348739+0000 mgr.gibba043.dnkmem (mgr.34373) 4882 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.348778+0000 mgr.gibba043.dnkmem (mgr.34373) 4883 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.349830+0000 mgr.gibba043.dnkmem (mgr.34373) 4884 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.349870+0000 mgr.gibba043.dnkmem (mgr.34373) 4885 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.351073+0000 mgr.gibba043.dnkmem (mgr.34373) 4886 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.352570+0000 mgr.gibba043.dnkmem (mgr.34373) 4887 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:17.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.352609+0000 mgr.gibba043.dnkmem (mgr.34373) 4888 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:17.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.353779+0000 mgr.gibba043.dnkmem (mgr.34373) 4889 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:17.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.354108+0000 mgr.gibba043.dnkmem (mgr.34373) 4890 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:17.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.355010+0000 mgr.gibba043.dnkmem (mgr.34373) 4891 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:17.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.355051+0000 mgr.gibba043.dnkmem (mgr.34373) 4892 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:17.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:17 gibba043 bash[24019]: cephadm 2021-03-10T15:23:16.355159+0000 mgr.gibba043.dnkmem (mgr.34373) 4893 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:18 gibba003 bash[31385]: cluster 2021-03-10T15:23:17.149433+0000 mgr.gibba043.dnkmem (mgr.34373) 4894 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:18.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:18 gibba003 bash[32348]: cluster 2021-03-10T15:23:17.149433+0000 mgr.gibba043.dnkmem (mgr.34373) 4894 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:18 gibba043 bash[24019]: cluster 2021-03-10T15:23:17.149433+0000 mgr.gibba043.dnkmem (mgr.34373) 4894 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:20.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:20 gibba003 bash[31385]: cluster 2021-03-10T15:23:19.151046+0000 mgr.gibba043.dnkmem (mgr.34373) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:20.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:20 gibba003 bash[32348]: cluster 2021-03-10T15:23:19.151046+0000 mgr.gibba043.dnkmem (mgr.34373) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:20.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:20 gibba043 bash[24019]: cluster 2021-03-10T15:23:19.151046+0000 mgr.gibba043.dnkmem (mgr.34373) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:22.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:22 gibba003 bash[31385]: cluster 2021-03-10T15:23:21.152734+0000 mgr.gibba043.dnkmem (mgr.34373) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:22.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:22 gibba003 bash[32348]: cluster 2021-03-10T15:23:21.152734+0000 mgr.gibba043.dnkmem (mgr.34373) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:22.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:22 gibba043 bash[24019]: cluster 2021-03-10T15:23:21.152734+0000 mgr.gibba043.dnkmem (mgr.34373) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:24.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:24 gibba003 bash[31385]: cluster 2021-03-10T15:23:23.154344+0000 mgr.gibba043.dnkmem (mgr.34373) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:24.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:24 gibba003 bash[32348]: cluster 2021-03-10T15:23:23.154344+0000 mgr.gibba043.dnkmem (mgr.34373) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:24 gibba043 bash[24019]: cluster 2021-03-10T15:23:23.154344+0000 mgr.gibba043.dnkmem (mgr.34373) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:26.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:26 gibba003 bash[31385]: cluster 2021-03-10T15:23:25.155905+0000 mgr.gibba043.dnkmem (mgr.34373) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:26.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:26 gibba003 bash[32348]: cluster 2021-03-10T15:23:25.155905+0000 mgr.gibba043.dnkmem (mgr.34373) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:26.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:26 gibba043 bash[24019]: cluster 2021-03-10T15:23:25.155905+0000 mgr.gibba043.dnkmem (mgr.34373) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:28 gibba003 bash[31385]: cluster 2021-03-10T15:23:27.157511+0000 mgr.gibba043.dnkmem (mgr.34373) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:28 gibba003 bash[32348]: cluster 2021-03-10T15:23:27.157511+0000 mgr.gibba043.dnkmem (mgr.34373) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:28 gibba043 bash[24019]: cluster 2021-03-10T15:23:27.157511+0000 mgr.gibba043.dnkmem (mgr.34373) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:30.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:30 gibba043 bash[24019]: cluster 2021-03-10T15:23:29.159131+0000 mgr.gibba043.dnkmem (mgr.34373) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:30 gibba003 bash[31385]: cluster 2021-03-10T15:23:29.159131+0000 mgr.gibba043.dnkmem (mgr.34373) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:30.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:30 gibba003 bash[32348]: cluster 2021-03-10T15:23:29.159131+0000 mgr.gibba043.dnkmem (mgr.34373) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:32 gibba043 bash[24019]: cluster 2021-03-10T15:23:31.160927+0000 mgr.gibba043.dnkmem (mgr.34373) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:32 gibba043 bash[24019]: cephadm 2021-03-10T15:23:31.370954+0000 mgr.gibba043.dnkmem (mgr.34373) 4902 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:32 gibba003 bash[31385]: cluster 2021-03-10T15:23:31.160927+0000 mgr.gibba043.dnkmem (mgr.34373) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:32 gibba003 bash[31385]: cephadm 2021-03-10T15:23:31.370954+0000 mgr.gibba043.dnkmem (mgr.34373) 4902 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:32.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:32 gibba003 bash[32348]: cluster 2021-03-10T15:23:31.160927+0000 mgr.gibba043.dnkmem (mgr.34373) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:32 gibba003 bash[32348]: cephadm 2021-03-10T15:23:31.370954+0000 mgr.gibba043.dnkmem (mgr.34373) 4902 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:34.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:34 gibba043 bash[24019]: cluster 2021-03-10T15:23:33.162379+0000 mgr.gibba043.dnkmem (mgr.34373) 4903 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:34 gibba003 bash[31385]: cluster 2021-03-10T15:23:33.162379+0000 mgr.gibba043.dnkmem (mgr.34373) 4903 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:34 gibba003 bash[32348]: cluster 2021-03-10T15:23:33.162379+0000 mgr.gibba043.dnkmem (mgr.34373) 4903 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:36.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:36 gibba043 bash[24019]: cluster 2021-03-10T15:23:35.163993+0000 mgr.gibba043.dnkmem (mgr.34373) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:36 gibba003 bash[32348]: cluster 2021-03-10T15:23:35.163993+0000 mgr.gibba043.dnkmem (mgr.34373) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:36 gibba003 bash[31385]: cluster 2021-03-10T15:23:35.163993+0000 mgr.gibba043.dnkmem (mgr.34373) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:38 gibba043 bash[24019]: cluster 2021-03-10T15:23:37.165580+0000 mgr.gibba043.dnkmem (mgr.34373) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:38 gibba003 bash[31385]: cluster 2021-03-10T15:23:37.165580+0000 mgr.gibba043.dnkmem (mgr.34373) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:38 gibba003 bash[32348]: cluster 2021-03-10T15:23:37.165580+0000 mgr.gibba043.dnkmem (mgr.34373) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:40.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:40 gibba043 bash[24019]: cluster 2021-03-10T15:23:39.167213+0000 mgr.gibba043.dnkmem (mgr.34373) 4906 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:40 gibba003 bash[31385]: cluster 2021-03-10T15:23:39.167213+0000 mgr.gibba043.dnkmem (mgr.34373) 4906 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:40.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:40 gibba003 bash[32348]: cluster 2021-03-10T15:23:39.167213+0000 mgr.gibba043.dnkmem (mgr.34373) 4906 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:42 gibba043 bash[24019]: cluster 2021-03-10T15:23:41.169051+0000 mgr.gibba043.dnkmem (mgr.34373) 4907 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:42 gibba003 bash[31385]: cluster 2021-03-10T15:23:41.169051+0000 mgr.gibba043.dnkmem (mgr.34373) 4907 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:42 gibba003 bash[32348]: cluster 2021-03-10T15:23:41.169051+0000 mgr.gibba043.dnkmem (mgr.34373) 4907 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:43.143 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:23:43.371 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:23:43.371 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (92m) 6m ago 97m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:23:43.372 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (97m) 5m ago 97m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:23:43.372 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:23:43.372 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:23:43.372 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:23:43.373 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:23:43.373 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (91m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:23:43.373 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:23:43.373 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (97m) 6m ago 97m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:23:43.374 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (97m) 5m ago 97m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:23:43.374 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (90m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:23:43.374 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:23:43.374 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:23:43.375 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:23:43.375 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:23:43.375 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:23:43.375 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:23:43.376 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (87m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:23:43.376 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (96m) 5m ago 97m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:23:43.376 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 95m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:23:43.625 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:23:43.626 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:23:43.626 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:43.626 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:23:43.626 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:23:43.627 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:43.627 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:23:43.627 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:23:43.627 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:23:43.627 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:23:43.628 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:23:43.628 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:23:43.628 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:23:43.628 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:23:43.629 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:23:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:43 gibba043 bash[24019]: audit 2021-03-10T15:23:43.130892+0000 mgr.gibba043.dnkmem (mgr.34373) 4908 : audit [DBG] from='client.47346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:43 gibba003 bash[31385]: audit 2021-03-10T15:23:43.130892+0000 mgr.gibba043.dnkmem (mgr.34373) 4908 : audit [DBG] from='client.47346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:43.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:43 gibba003 bash[32348]: audit 2021-03-10T15:23:43.130892+0000 mgr.gibba043.dnkmem (mgr.34373) 4908 : audit [DBG] from='client.47346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:44.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:44 gibba043 bash[24019]: cluster 2021-03-10T15:23:43.170506+0000 mgr.gibba043.dnkmem (mgr.34373) 4909 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:44.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:44 gibba043 bash[24019]: audit 2021-03-10T15:23:43.355924+0000 mgr.gibba043.dnkmem (mgr.34373) 4910 : audit [DBG] from='client.47352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:44.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:44 gibba043 bash[24019]: audit 2021-03-10T15:23:43.623594+0000 mon.c (mon.1) 1292 : audit [DBG] from='client.? 172.21.2.103:0/3395155675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:44.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:44 gibba003 bash[31385]: cluster 2021-03-10T15:23:43.170506+0000 mgr.gibba043.dnkmem (mgr.34373) 4909 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:44.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:44 gibba003 bash[31385]: audit 2021-03-10T15:23:43.355924+0000 mgr.gibba043.dnkmem (mgr.34373) 4910 : audit [DBG] from='client.47352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:44.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:44 gibba003 bash[31385]: audit 2021-03-10T15:23:43.623594+0000 mon.c (mon.1) 1292 : audit [DBG] from='client.? 172.21.2.103:0/3395155675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:44.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:44 gibba003 bash[32348]: cluster 2021-03-10T15:23:43.170506+0000 mgr.gibba043.dnkmem (mgr.34373) 4909 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:44.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:44 gibba003 bash[32348]: audit 2021-03-10T15:23:43.355924+0000 mgr.gibba043.dnkmem (mgr.34373) 4910 : audit [DBG] from='client.47352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:44.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:44 gibba003 bash[32348]: audit 2021-03-10T15:23:43.623594+0000 mon.c (mon.1) 1292 : audit [DBG] from='client.? 172.21.2.103:0/3395155675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:46.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:46 gibba043 bash[24019]: cluster 2021-03-10T15:23:45.171931+0000 mgr.gibba043.dnkmem (mgr.34373) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:46.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:46 gibba003 bash[31385]: cluster 2021-03-10T15:23:45.171931+0000 mgr.gibba043.dnkmem (mgr.34373) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:46 gibba003 bash[32348]: cluster 2021-03-10T15:23:45.171931+0000 mgr.gibba043.dnkmem (mgr.34373) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:47.965 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:47 gibba003 bash[31385]: cephadm 2021-03-10T15:23:46.379127+0000 mgr.gibba043.dnkmem (mgr.34373) 4912 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:47.965 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:47 gibba003 bash[32348]: cephadm 2021-03-10T15:23:46.379127+0000 mgr.gibba043.dnkmem (mgr.34373) 4912 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:47 gibba043 bash[24019]: cephadm 2021-03-10T15:23:46.379127+0000 mgr.gibba043.dnkmem (mgr.34373) 4912 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:23:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:48 gibba003 bash[31385]: cluster 2021-03-10T15:23:47.173533+0000 mgr.gibba043.dnkmem (mgr.34373) 4913 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:48 gibba003 bash[32348]: cluster 2021-03-10T15:23:47.173533+0000 mgr.gibba043.dnkmem (mgr.34373) 4913 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:48 gibba043 bash[24019]: cluster 2021-03-10T15:23:47.173533+0000 mgr.gibba043.dnkmem (mgr.34373) 4913 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:50.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:50 gibba003 bash[31385]: cluster 2021-03-10T15:23:49.175017+0000 mgr.gibba043.dnkmem (mgr.34373) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:50.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:50 gibba003 bash[32348]: cluster 2021-03-10T15:23:49.175017+0000 mgr.gibba043.dnkmem (mgr.34373) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:50 gibba043 bash[24019]: cluster 2021-03-10T15:23:49.175017+0000 mgr.gibba043.dnkmem (mgr.34373) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:52 gibba003 bash[31385]: cluster 2021-03-10T15:23:51.176930+0000 mgr.gibba043.dnkmem (mgr.34373) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:52 gibba003 bash[32348]: cluster 2021-03-10T15:23:51.176930+0000 mgr.gibba043.dnkmem (mgr.34373) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:52 gibba043 bash[24019]: cluster 2021-03-10T15:23:51.176930+0000 mgr.gibba043.dnkmem (mgr.34373) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:54 gibba003 bash[31385]: cluster 2021-03-10T15:23:53.178437+0000 mgr.gibba043.dnkmem (mgr.34373) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:54 gibba003 bash[32348]: cluster 2021-03-10T15:23:53.178437+0000 mgr.gibba043.dnkmem (mgr.34373) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:54 gibba043 bash[24019]: cluster 2021-03-10T15:23:53.178437+0000 mgr.gibba043.dnkmem (mgr.34373) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:56 gibba003 bash[31385]: cluster 2021-03-10T15:23:55.180145+0000 mgr.gibba043.dnkmem (mgr.34373) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:56 gibba003 bash[32348]: cluster 2021-03-10T15:23:55.180145+0000 mgr.gibba043.dnkmem (mgr.34373) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:56 gibba043 bash[24019]: cluster 2021-03-10T15:23:55.180145+0000 mgr.gibba043.dnkmem (mgr.34373) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:23:58 gibba003 bash[31385]: cluster 2021-03-10T15:23:57.181835+0000 mgr.gibba043.dnkmem (mgr.34373) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:23:58 gibba003 bash[32348]: cluster 2021-03-10T15:23:57.181835+0000 mgr.gibba043.dnkmem (mgr.34373) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:23:58 gibba043 bash[24019]: cluster 2021-03-10T15:23:57.181835+0000 mgr.gibba043.dnkmem (mgr.34373) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:00 gibba003 bash[31385]: cluster 2021-03-10T15:23:59.183317+0000 mgr.gibba043.dnkmem (mgr.34373) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:00.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:00 gibba003 bash[32348]: cluster 2021-03-10T15:23:59.183317+0000 mgr.gibba043.dnkmem (mgr.34373) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:00 gibba043 bash[24019]: cluster 2021-03-10T15:23:59.183317+0000 mgr.gibba043.dnkmem (mgr.34373) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:02 gibba003 bash[31385]: cluster 2021-03-10T15:24:01.185193+0000 mgr.gibba043.dnkmem (mgr.34373) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:02 gibba003 bash[31385]: cephadm 2021-03-10T15:24:01.394993+0000 mgr.gibba043.dnkmem (mgr.34373) 4921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:02.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:02 gibba003 bash[32348]: cluster 2021-03-10T15:24:01.185193+0000 mgr.gibba043.dnkmem (mgr.34373) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:02.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:02 gibba003 bash[32348]: cephadm 2021-03-10T15:24:01.394993+0000 mgr.gibba043.dnkmem (mgr.34373) 4921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:02 gibba043 bash[24019]: cluster 2021-03-10T15:24:01.185193+0000 mgr.gibba043.dnkmem (mgr.34373) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:02 gibba043 bash[24019]: cephadm 2021-03-10T15:24:01.394993+0000 mgr.gibba043.dnkmem (mgr.34373) 4921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:04.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:04 gibba003 bash[31385]: cluster 2021-03-10T15:24:03.186353+0000 mgr.gibba043.dnkmem (mgr.34373) 4922 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:04.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:04 gibba003 bash[32348]: cluster 2021-03-10T15:24:03.186353+0000 mgr.gibba043.dnkmem (mgr.34373) 4922 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:04 gibba043 bash[24019]: cluster 2021-03-10T15:24:03.186353+0000 mgr.gibba043.dnkmem (mgr.34373) 4922 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:06 gibba003 bash[31385]: cluster 2021-03-10T15:24:05.187770+0000 mgr.gibba043.dnkmem (mgr.34373) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:06 gibba003 bash[32348]: cluster 2021-03-10T15:24:05.187770+0000 mgr.gibba043.dnkmem (mgr.34373) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:06 gibba043 bash[24019]: cluster 2021-03-10T15:24:05.187770+0000 mgr.gibba043.dnkmem (mgr.34373) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:08 gibba003 bash[31385]: cluster 2021-03-10T15:24:07.189388+0000 mgr.gibba043.dnkmem (mgr.34373) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:08.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:08 gibba003 bash[32348]: cluster 2021-03-10T15:24:07.189388+0000 mgr.gibba043.dnkmem (mgr.34373) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:08 gibba043 bash[24019]: cluster 2021-03-10T15:24:07.189388+0000 mgr.gibba043.dnkmem (mgr.34373) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:10 gibba003 bash[31385]: cluster 2021-03-10T15:24:09.190831+0000 mgr.gibba043.dnkmem (mgr.34373) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:10.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:10 gibba003 bash[32348]: cluster 2021-03-10T15:24:09.190831+0000 mgr.gibba043.dnkmem (mgr.34373) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:11.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:10 gibba043 bash[24019]: cluster 2021-03-10T15:24:09.190831+0000 mgr.gibba043.dnkmem (mgr.34373) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:12 gibba003 bash[31385]: cluster 2021-03-10T15:24:11.192762+0000 mgr.gibba043.dnkmem (mgr.34373) 4926 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:12.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:12 gibba003 bash[32348]: cluster 2021-03-10T15:24:11.192762+0000 mgr.gibba043.dnkmem (mgr.34373) 4926 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:12 gibba043 bash[24019]: cluster 2021-03-10T15:24:11.192762+0000 mgr.gibba043.dnkmem (mgr.34373) 4926 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:13.873 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:24:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.303889+0000 mon.c (mon.1) 1293 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.304995+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.414452+0000 mon.c (mon.1) 1294 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.415940+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.484229+0000 mon.c (mon.1) 1295 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:24:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.484940+0000 mon.c (mon.1) 1296 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.485458+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:24:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.485897+0000 mon.c (mon.1) 1297 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:24:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.486750+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.487307+0000 mon.c (mon.1) 1298 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.487944+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:24:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[31385]: audit 2021-03-10T15:24:13.488887+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.303889+0000 mon.c (mon.1) 1293 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.304995+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.414452+0000 mon.c (mon.1) 1294 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.415940+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.484229+0000 mon.c (mon.1) 1295 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:24:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.484940+0000 mon.c (mon.1) 1296 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.485458+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:24:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.485897+0000 mon.c (mon.1) 1297 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:24:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.486750+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.487307+0000 mon.c (mon.1) 1298 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:24:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.487944+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:24:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:13 gibba003 bash[32348]: audit 2021-03-10T15:24:13.488887+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.303889+0000 mon.c (mon.1) 1293 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.304995+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.414452+0000 mon.c (mon.1) 1294 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.415940+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.484229+0000 mon.c (mon.1) 1295 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:24:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.484940+0000 mon.c (mon.1) 1296 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:24:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.485458+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:24:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.485897+0000 mon.c (mon.1) 1297 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:24:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.486750+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:24:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.487307+0000 mon.c (mon.1) 1298 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:24:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.487944+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:24:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:13 gibba043 bash[24019]: audit 2021-03-10T15:24:13.488887+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:24:14.099 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:24:14.100 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (92m) 7m ago 97m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:24:14.100 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (97m) 6m ago 97m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:24:14.100 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (92m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:24:14.100 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:24:14.101 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:24:14.101 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:24:14.101 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:24:14.101 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (91m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:24:14.102 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (98m) 7m ago 98m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:24:14.102 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (98m) 6m ago 98m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:24:14.102 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:24:14.102 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:24:14.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:24:14.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (89m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:24:14.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:24:14.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:24:14.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (88m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:24:14.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (87m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:24:14.104 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (97m) 6m ago 98m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:24:14.104 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 96m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:24:14.347 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:24:14.348 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:24:14.348 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:14.348 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:24:14.349 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:24:14.349 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:14.349 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:24:14.349 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:24:14.350 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:24:14.350 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:24:14.350 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:24:14.350 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:24:14.350 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:24:14.351 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:24:14.351 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:24:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[31385]: cluster 2021-03-10T15:24:13.194298+0000 mgr.gibba043.dnkmem (mgr.34373) 4927 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[31385]: audit 2021-03-10T15:24:13.861698+0000 mgr.gibba043.dnkmem (mgr.34373) 4928 : audit [DBG] from='client.57352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[31385]: audit 2021-03-10T15:24:14.085058+0000 mgr.gibba043.dnkmem (mgr.34373) 4929 : audit [DBG] from='client.57358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[31385]: audit 2021-03-10T15:24:14.345718+0000 mon.c (mon.1) 1299 : audit [DBG] from='client.? 172.21.2.103:0/539539604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[32348]: cluster 2021-03-10T15:24:13.194298+0000 mgr.gibba043.dnkmem (mgr.34373) 4927 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[32348]: audit 2021-03-10T15:24:13.861698+0000 mgr.gibba043.dnkmem (mgr.34373) 4928 : audit [DBG] from='client.57352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[32348]: audit 2021-03-10T15:24:14.085058+0000 mgr.gibba043.dnkmem (mgr.34373) 4929 : audit [DBG] from='client.57358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:14 gibba003 bash[32348]: audit 2021-03-10T15:24:14.345718+0000 mon.c (mon.1) 1299 : audit [DBG] from='client.? 172.21.2.103:0/539539604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:14 gibba043 bash[24019]: cluster 2021-03-10T15:24:13.194298+0000 mgr.gibba043.dnkmem (mgr.34373) 4927 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:14 gibba043 bash[24019]: audit 2021-03-10T15:24:13.861698+0000 mgr.gibba043.dnkmem (mgr.34373) 4928 : audit [DBG] from='client.57352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:14 gibba043 bash[24019]: audit 2021-03-10T15:24:14.085058+0000 mgr.gibba043.dnkmem (mgr.34373) 4929 : audit [DBG] from='client.57358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:14 gibba043 bash[24019]: audit 2021-03-10T15:24:14.345718+0000 mon.c (mon.1) 1299 : audit [DBG] from='client.? 172.21.2.103:0/539539604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:16 gibba003 bash[31385]: cluster 2021-03-10T15:24:15.195779+0000 mgr.gibba043.dnkmem (mgr.34373) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:16 gibba003 bash[31385]: audit 2021-03-10T15:24:16.615954+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:16.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:16 gibba003 bash[31385]: audit 2021-03-10T15:24:16.621843+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:16.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:16 gibba003 bash[32348]: cluster 2021-03-10T15:24:15.195779+0000 mgr.gibba043.dnkmem (mgr.34373) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:16.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:16 gibba003 bash[32348]: audit 2021-03-10T15:24:16.615954+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:16.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:16 gibba003 bash[32348]: audit 2021-03-10T15:24:16.621843+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:16 gibba043 bash[24019]: cluster 2021-03-10T15:24:15.195779+0000 mgr.gibba043.dnkmem (mgr.34373) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:16 gibba043 bash[24019]: audit 2021-03-10T15:24:16.615954+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:16 gibba043 bash[24019]: audit 2021-03-10T15:24:16.621843+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.615618+0000 mgr.gibba043.dnkmem (mgr.34373) 4931 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:24:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.621629+0000 mgr.gibba043.dnkmem (mgr.34373) 4932 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:24:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.810160+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.811720+0000 mgr.gibba043.dnkmem (mgr.34373) 4933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:24:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.814077+0000 mon.c (mon.1) 1300 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.814251+0000 mgr.gibba043.dnkmem (mgr.34373) 4934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:24:18.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.815815+0000 mgr.gibba043.dnkmem (mgr.34373) 4935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:24:18.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.815856+0000 mgr.gibba043.dnkmem (mgr.34373) 4936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:24:18.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.816174+0000 mon.c (mon.1) 1301 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.817183+0000 mgr.gibba043.dnkmem (mgr.34373) 4937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:24:18.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.817224+0000 mgr.gibba043.dnkmem (mgr.34373) 4938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:24:18.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.817549+0000 mon.c (mon.1) 1302 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.818685+0000 mgr.gibba043.dnkmem (mgr.34373) 4939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:24:18.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.818998+0000 mon.c (mon.1) 1303 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.820457+0000 mgr.gibba043.dnkmem (mgr.34373) 4940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:24:18.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.820493+0000 mgr.gibba043.dnkmem (mgr.34373) 4941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:24:18.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.821850+0000 mgr.gibba043.dnkmem (mgr.34373) 4942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:24:18.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.822167+0000 mgr.gibba043.dnkmem (mgr.34373) 4943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:24:18.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.822331+0000 mon.c (mon.1) 1304 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: audit 2021-03-10T15:24:16.823864+0000 mon.c (mon.1) 1305 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.823871+0000 mgr.gibba043.dnkmem (mgr.34373) 4944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:24:18.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.823908+0000 mgr.gibba043.dnkmem (mgr.34373) 4945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:24:18.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[31385]: cephadm 2021-03-10T15:24:16.824011+0000 mgr.gibba043.dnkmem (mgr.34373) 4946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.615618+0000 mgr.gibba043.dnkmem (mgr.34373) 4931 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:24:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.621629+0000 mgr.gibba043.dnkmem (mgr.34373) 4932 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:24:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.810160+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:18.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.811720+0000 mgr.gibba043.dnkmem (mgr.34373) 4933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:24:18.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.814077+0000 mon.c (mon.1) 1300 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:18.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.814251+0000 mgr.gibba043.dnkmem (mgr.34373) 4934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:24:18.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.815815+0000 mgr.gibba043.dnkmem (mgr.34373) 4935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:24:18.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.815856+0000 mgr.gibba043.dnkmem (mgr.34373) 4936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:24:18.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.816174+0000 mon.c (mon.1) 1301 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.817183+0000 mgr.gibba043.dnkmem (mgr.34373) 4937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:24:18.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.817224+0000 mgr.gibba043.dnkmem (mgr.34373) 4938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:24:18.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.817549+0000 mon.c (mon.1) 1302 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.818685+0000 mgr.gibba043.dnkmem (mgr.34373) 4939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:24:18.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.818998+0000 mon.c (mon.1) 1303 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.820457+0000 mgr.gibba043.dnkmem (mgr.34373) 4940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:24:18.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.820493+0000 mgr.gibba043.dnkmem (mgr.34373) 4941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:24:18.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.821850+0000 mgr.gibba043.dnkmem (mgr.34373) 4942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:24:18.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.822167+0000 mgr.gibba043.dnkmem (mgr.34373) 4943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:24:18.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.822331+0000 mon.c (mon.1) 1304 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: audit 2021-03-10T15:24:16.823864+0000 mon.c (mon.1) 1305 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.823871+0000 mgr.gibba043.dnkmem (mgr.34373) 4944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:24:18.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.823908+0000 mgr.gibba043.dnkmem (mgr.34373) 4945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:24:18.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:17 gibba003 bash[32348]: cephadm 2021-03-10T15:24:16.824011+0000 mgr.gibba043.dnkmem (mgr.34373) 4946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.615618+0000 mgr.gibba043.dnkmem (mgr.34373) 4931 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:24:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.621629+0000 mgr.gibba043.dnkmem (mgr.34373) 4932 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:24:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.810160+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:24:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.811720+0000 mgr.gibba043.dnkmem (mgr.34373) 4933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:24:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.814077+0000 mon.c (mon.1) 1300 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.814251+0000 mgr.gibba043.dnkmem (mgr.34373) 4934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:24:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.815815+0000 mgr.gibba043.dnkmem (mgr.34373) 4935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:24:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.815856+0000 mgr.gibba043.dnkmem (mgr.34373) 4936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:24:18.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.816174+0000 mon.c (mon.1) 1301 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.817183+0000 mgr.gibba043.dnkmem (mgr.34373) 4937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:24:18.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.817224+0000 mgr.gibba043.dnkmem (mgr.34373) 4938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:24:18.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.817549+0000 mon.c (mon.1) 1302 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.818685+0000 mgr.gibba043.dnkmem (mgr.34373) 4939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:24:18.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.818998+0000 mon.c (mon.1) 1303 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.820457+0000 mgr.gibba043.dnkmem (mgr.34373) 4940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:24:18.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.820493+0000 mgr.gibba043.dnkmem (mgr.34373) 4941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:24:18.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.821850+0000 mgr.gibba043.dnkmem (mgr.34373) 4942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:24:18.283 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.822167+0000 mgr.gibba043.dnkmem (mgr.34373) 4943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:24:18.283 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.822331+0000 mon.c (mon.1) 1304 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.283 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: audit 2021-03-10T15:24:16.823864+0000 mon.c (mon.1) 1305 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:18.283 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.823871+0000 mgr.gibba043.dnkmem (mgr.34373) 4944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:24:18.284 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.823908+0000 mgr.gibba043.dnkmem (mgr.34373) 4945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:24:18.284 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:17 gibba043 bash[24019]: cephadm 2021-03-10T15:24:16.824011+0000 mgr.gibba043.dnkmem (mgr.34373) 4946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:18 gibba003 bash[31385]: cluster 2021-03-10T15:24:17.197407+0000 mgr.gibba043.dnkmem (mgr.34373) 4947 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:18 gibba003 bash[32348]: cluster 2021-03-10T15:24:17.197407+0000 mgr.gibba043.dnkmem (mgr.34373) 4947 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:18 gibba043 bash[24019]: cluster 2021-03-10T15:24:17.197407+0000 mgr.gibba043.dnkmem (mgr.34373) 4947 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:20 gibba003 bash[31385]: cluster 2021-03-10T15:24:19.199242+0000 mgr.gibba043.dnkmem (mgr.34373) 4948 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:20 gibba003 bash[32348]: cluster 2021-03-10T15:24:19.199242+0000 mgr.gibba043.dnkmem (mgr.34373) 4948 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:20 gibba043 bash[24019]: cluster 2021-03-10T15:24:19.199242+0000 mgr.gibba043.dnkmem (mgr.34373) 4948 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:22 gibba003 bash[31385]: cluster 2021-03-10T15:24:21.201302+0000 mgr.gibba043.dnkmem (mgr.34373) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:22 gibba003 bash[32348]: cluster 2021-03-10T15:24:21.201302+0000 mgr.gibba043.dnkmem (mgr.34373) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:22 gibba043 bash[24019]: cluster 2021-03-10T15:24:21.201302+0000 mgr.gibba043.dnkmem (mgr.34373) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:24 gibba003 bash[31385]: cluster 2021-03-10T15:24:23.202951+0000 mgr.gibba043.dnkmem (mgr.34373) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:24 gibba003 bash[32348]: cluster 2021-03-10T15:24:23.202951+0000 mgr.gibba043.dnkmem (mgr.34373) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:24 gibba043 bash[24019]: cluster 2021-03-10T15:24:23.202951+0000 mgr.gibba043.dnkmem (mgr.34373) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:26 gibba003 bash[31385]: cluster 2021-03-10T15:24:25.204798+0000 mgr.gibba043.dnkmem (mgr.34373) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:26 gibba003 bash[32348]: cluster 2021-03-10T15:24:25.204798+0000 mgr.gibba043.dnkmem (mgr.34373) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:26 gibba043 bash[24019]: cluster 2021-03-10T15:24:25.204798+0000 mgr.gibba043.dnkmem (mgr.34373) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:28 gibba003 bash[31385]: cluster 2021-03-10T15:24:27.206629+0000 mgr.gibba043.dnkmem (mgr.34373) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:28 gibba003 bash[32348]: cluster 2021-03-10T15:24:27.206629+0000 mgr.gibba043.dnkmem (mgr.34373) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:28 gibba043 bash[24019]: cluster 2021-03-10T15:24:27.206629+0000 mgr.gibba043.dnkmem (mgr.34373) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:30 gibba003 bash[31385]: cluster 2021-03-10T15:24:29.208481+0000 mgr.gibba043.dnkmem (mgr.34373) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:30 gibba003 bash[32348]: cluster 2021-03-10T15:24:29.208481+0000 mgr.gibba043.dnkmem (mgr.34373) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:30 gibba043 bash[24019]: cluster 2021-03-10T15:24:29.208481+0000 mgr.gibba043.dnkmem (mgr.34373) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:32 gibba003 bash[31385]: cluster 2021-03-10T15:24:31.210378+0000 mgr.gibba043.dnkmem (mgr.34373) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:32 gibba003 bash[31385]: cephadm 2021-03-10T15:24:31.839960+0000 mgr.gibba043.dnkmem (mgr.34373) 4955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:32 gibba003 bash[32348]: cluster 2021-03-10T15:24:31.210378+0000 mgr.gibba043.dnkmem (mgr.34373) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:32 gibba003 bash[32348]: cephadm 2021-03-10T15:24:31.839960+0000 mgr.gibba043.dnkmem (mgr.34373) 4955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:32 gibba043 bash[24019]: cluster 2021-03-10T15:24:31.210378+0000 mgr.gibba043.dnkmem (mgr.34373) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:32 gibba043 bash[24019]: cephadm 2021-03-10T15:24:31.839960+0000 mgr.gibba043.dnkmem (mgr.34373) 4955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:34 gibba003 bash[31385]: cluster 2021-03-10T15:24:33.211606+0000 mgr.gibba043.dnkmem (mgr.34373) 4956 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:34 gibba003 bash[32348]: cluster 2021-03-10T15:24:33.211606+0000 mgr.gibba043.dnkmem (mgr.34373) 4956 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:34 gibba043 bash[24019]: cluster 2021-03-10T15:24:33.211606+0000 mgr.gibba043.dnkmem (mgr.34373) 4956 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:36 gibba003 bash[31385]: cluster 2021-03-10T15:24:35.213308+0000 mgr.gibba043.dnkmem (mgr.34373) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:36 gibba003 bash[32348]: cluster 2021-03-10T15:24:35.213308+0000 mgr.gibba043.dnkmem (mgr.34373) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:36 gibba043 bash[24019]: cluster 2021-03-10T15:24:35.213308+0000 mgr.gibba043.dnkmem (mgr.34373) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:38 gibba003 bash[31385]: cluster 2021-03-10T15:24:37.214928+0000 mgr.gibba043.dnkmem (mgr.34373) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:38 gibba003 bash[32348]: cluster 2021-03-10T15:24:37.214928+0000 mgr.gibba043.dnkmem (mgr.34373) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:38 gibba043 bash[24019]: cluster 2021-03-10T15:24:37.214928+0000 mgr.gibba043.dnkmem (mgr.34373) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:40 gibba003 bash[31385]: cluster 2021-03-10T15:24:39.216653+0000 mgr.gibba043.dnkmem (mgr.34373) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:40 gibba003 bash[32348]: cluster 2021-03-10T15:24:39.216653+0000 mgr.gibba043.dnkmem (mgr.34373) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:40 gibba043 bash[24019]: cluster 2021-03-10T15:24:39.216653+0000 mgr.gibba043.dnkmem (mgr.34373) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:42 gibba003 bash[31385]: cluster 2021-03-10T15:24:41.218227+0000 mgr.gibba043.dnkmem (mgr.34373) 4960 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:42 gibba003 bash[32348]: cluster 2021-03-10T15:24:41.218227+0000 mgr.gibba043.dnkmem (mgr.34373) 4960 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:42 gibba043 bash[24019]: cluster 2021-03-10T15:24:41.218227+0000 mgr.gibba043.dnkmem (mgr.34373) 4960 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:44.587 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:24:44.841 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:24:44.841 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (93m) 7m ago 98m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:24:44.842 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (98m) 6m ago 98m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:24:44.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:24:44.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:24:44.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:24:44.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:24:44.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (92m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:24:44.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:24:44.843 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (98m) 7m ago 98m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:24:44.843 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (98m) 6m ago 98m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:24:44.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (91m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:24:44.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:24:44.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:24:44.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:24:44.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:24:44.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:24:44.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:24:44.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (88m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:24:44.845 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (97m) 6m ago 98m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:24:44.846 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 96m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:24:45.097 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:24:45.097 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:24:45.098 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:45.098 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:24:45.098 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:24:45.098 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:45.098 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:24:45.099 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:24:45.099 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:24:45.099 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:24:45.099 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:24:45.100 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:24:45.100 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:24:45.100 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:24:45.100 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:24:45.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:44 gibba043 bash[24019]: cluster 2021-03-10T15:24:43.219742+0000 mgr.gibba043.dnkmem (mgr.34373) 4961 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:44 gibba003 bash[31385]: cluster 2021-03-10T15:24:43.219742+0000 mgr.gibba043.dnkmem (mgr.34373) 4961 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:44 gibba003 bash[32348]: cluster 2021-03-10T15:24:43.219742+0000 mgr.gibba043.dnkmem (mgr.34373) 4961 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:45 gibba043 bash[24019]: audit 2021-03-10T15:24:44.575337+0000 mgr.gibba043.dnkmem (mgr.34373) 4962 : audit [DBG] from='client.47382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:45 gibba043 bash[24019]: audit 2021-03-10T15:24:44.800820+0000 mgr.gibba043.dnkmem (mgr.34373) 4963 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:45 gibba043 bash[24019]: audit 2021-03-10T15:24:45.095291+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.103:0/1452933952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:46.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:45 gibba003 bash[31385]: audit 2021-03-10T15:24:44.575337+0000 mgr.gibba043.dnkmem (mgr.34373) 4962 : audit [DBG] from='client.47382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:46.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:45 gibba003 bash[31385]: audit 2021-03-10T15:24:44.800820+0000 mgr.gibba043.dnkmem (mgr.34373) 4963 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:46.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:45 gibba003 bash[31385]: audit 2021-03-10T15:24:45.095291+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.103:0/1452933952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:46.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:45 gibba003 bash[32348]: audit 2021-03-10T15:24:44.575337+0000 mgr.gibba043.dnkmem (mgr.34373) 4962 : audit [DBG] from='client.47382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:46.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:45 gibba003 bash[32348]: audit 2021-03-10T15:24:44.800820+0000 mgr.gibba043.dnkmem (mgr.34373) 4963 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:46.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:45 gibba003 bash[32348]: audit 2021-03-10T15:24:45.095291+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.103:0/1452933952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:46 gibba043 bash[24019]: cluster 2021-03-10T15:24:45.221527+0000 mgr.gibba043.dnkmem (mgr.34373) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:46 gibba003 bash[31385]: cluster 2021-03-10T15:24:45.221527+0000 mgr.gibba043.dnkmem (mgr.34373) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:46 gibba003 bash[32348]: cluster 2021-03-10T15:24:45.221527+0000 mgr.gibba043.dnkmem (mgr.34373) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:47 gibba043 bash[24019]: cephadm 2021-03-10T15:24:46.856158+0000 mgr.gibba043.dnkmem (mgr.34373) 4965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:48.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:47 gibba003 bash[31385]: cephadm 2021-03-10T15:24:46.856158+0000 mgr.gibba043.dnkmem (mgr.34373) 4965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:47 gibba003 bash[32348]: cephadm 2021-03-10T15:24:46.856158+0000 mgr.gibba043.dnkmem (mgr.34373) 4965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:24:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:48 gibba043 bash[24019]: cluster 2021-03-10T15:24:47.223076+0000 mgr.gibba043.dnkmem (mgr.34373) 4966 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:48 gibba003 bash[31385]: cluster 2021-03-10T15:24:47.223076+0000 mgr.gibba043.dnkmem (mgr.34373) 4966 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:48 gibba003 bash[32348]: cluster 2021-03-10T15:24:47.223076+0000 mgr.gibba043.dnkmem (mgr.34373) 4966 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:50 gibba043 bash[24019]: cluster 2021-03-10T15:24:49.224454+0000 mgr.gibba043.dnkmem (mgr.34373) 4967 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:50 gibba003 bash[31385]: cluster 2021-03-10T15:24:49.224454+0000 mgr.gibba043.dnkmem (mgr.34373) 4967 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:50 gibba003 bash[32348]: cluster 2021-03-10T15:24:49.224454+0000 mgr.gibba043.dnkmem (mgr.34373) 4967 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:52 gibba043 bash[24019]: cluster 2021-03-10T15:24:51.226424+0000 mgr.gibba043.dnkmem (mgr.34373) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:52 gibba003 bash[31385]: cluster 2021-03-10T15:24:51.226424+0000 mgr.gibba043.dnkmem (mgr.34373) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:52 gibba003 bash[32348]: cluster 2021-03-10T15:24:51.226424+0000 mgr.gibba043.dnkmem (mgr.34373) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:55 gibba043 bash[24019]: cluster 2021-03-10T15:24:53.227950+0000 mgr.gibba043.dnkmem (mgr.34373) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:55 gibba003 bash[31385]: cluster 2021-03-10T15:24:53.227950+0000 mgr.gibba043.dnkmem (mgr.34373) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:55 gibba003 bash[32348]: cluster 2021-03-10T15:24:53.227950+0000 mgr.gibba043.dnkmem (mgr.34373) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:57 gibba043 bash[24019]: cluster 2021-03-10T15:24:55.229617+0000 mgr.gibba043.dnkmem (mgr.34373) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:57 gibba003 bash[31385]: cluster 2021-03-10T15:24:55.229617+0000 mgr.gibba043.dnkmem (mgr.34373) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:57 gibba003 bash[32348]: cluster 2021-03-10T15:24:55.229617+0000 mgr.gibba043.dnkmem (mgr.34373) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:24:59 gibba003 bash[31385]: cluster 2021-03-10T15:24:57.231133+0000 mgr.gibba043.dnkmem (mgr.34373) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:24:59 gibba003 bash[32348]: cluster 2021-03-10T15:24:57.231133+0000 mgr.gibba043.dnkmem (mgr.34373) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:24:59 gibba043 bash[24019]: cluster 2021-03-10T15:24:57.231133+0000 mgr.gibba043.dnkmem (mgr.34373) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:01.407 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:01 gibba043 bash[24019]: cluster 2021-03-10T15:24:59.232769+0000 mgr.gibba043.dnkmem (mgr.34373) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:01 gibba003 bash[31385]: cluster 2021-03-10T15:24:59.232769+0000 mgr.gibba043.dnkmem (mgr.34373) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:01 gibba003 bash[32348]: cluster 2021-03-10T15:24:59.232769+0000 mgr.gibba043.dnkmem (mgr.34373) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:03 gibba003 bash[31385]: cluster 2021-03-10T15:25:01.234524+0000 mgr.gibba043.dnkmem (mgr.34373) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:03 gibba003 bash[31385]: cephadm 2021-03-10T15:25:01.872308+0000 mgr.gibba043.dnkmem (mgr.34373) 4974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:03 gibba003 bash[32348]: cluster 2021-03-10T15:25:01.234524+0000 mgr.gibba043.dnkmem (mgr.34373) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:03 gibba003 bash[32348]: cephadm 2021-03-10T15:25:01.872308+0000 mgr.gibba043.dnkmem (mgr.34373) 4974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:03.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:03 gibba043 bash[24019]: cluster 2021-03-10T15:25:01.234524+0000 mgr.gibba043.dnkmem (mgr.34373) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:03 gibba043 bash[24019]: cephadm 2021-03-10T15:25:01.872308+0000 mgr.gibba043.dnkmem (mgr.34373) 4974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:05 gibba003 bash[31385]: cluster 2021-03-10T15:25:03.236190+0000 mgr.gibba043.dnkmem (mgr.34373) 4975 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:05 gibba003 bash[32348]: cluster 2021-03-10T15:25:03.236190+0000 mgr.gibba043.dnkmem (mgr.34373) 4975 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:05 gibba043 bash[24019]: cluster 2021-03-10T15:25:03.236190+0000 mgr.gibba043.dnkmem (mgr.34373) 4975 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:07 gibba003 bash[31385]: cluster 2021-03-10T15:25:05.237879+0000 mgr.gibba043.dnkmem (mgr.34373) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:07 gibba003 bash[32348]: cluster 2021-03-10T15:25:05.237879+0000 mgr.gibba043.dnkmem (mgr.34373) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:07 gibba043 bash[24019]: cluster 2021-03-10T15:25:05.237879+0000 mgr.gibba043.dnkmem (mgr.34373) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:09 gibba003 bash[31385]: cluster 2021-03-10T15:25:07.239554+0000 mgr.gibba043.dnkmem (mgr.34373) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:09 gibba003 bash[32348]: cluster 2021-03-10T15:25:07.239554+0000 mgr.gibba043.dnkmem (mgr.34373) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:09 gibba043 bash[24019]: cluster 2021-03-10T15:25:07.239554+0000 mgr.gibba043.dnkmem (mgr.34373) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:11.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:11 gibba003 bash[31385]: cluster 2021-03-10T15:25:09.241012+0000 mgr.gibba043.dnkmem (mgr.34373) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:11 gibba003 bash[32348]: cluster 2021-03-10T15:25:09.241012+0000 mgr.gibba043.dnkmem (mgr.34373) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:11 gibba043 bash[24019]: cluster 2021-03-10T15:25:09.241012+0000 mgr.gibba043.dnkmem (mgr.34373) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:13 gibba003 bash[31385]: cluster 2021-03-10T15:25:11.242914+0000 mgr.gibba043.dnkmem (mgr.34373) 4979 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:13 gibba003 bash[32348]: cluster 2021-03-10T15:25:11.242914+0000 mgr.gibba043.dnkmem (mgr.34373) 4979 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:13 gibba043 bash[24019]: cluster 2021-03-10T15:25:11.242914+0000 mgr.gibba043.dnkmem (mgr.34373) 4979 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.310866+0000 mon.c (mon.1) 1306 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.312050+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.423409+0000 mon.c (mon.1) 1307 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.424550+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.496607+0000 mon.c (mon.1) 1308 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.497358+0000 mon.c (mon.1) 1309 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.497865+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.498048+0000 mon.c (mon.1) 1310 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:25:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.498876+0000 mon.c (mon.1) 1311 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.499286+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.500245+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:25:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[31385]: audit 2021-03-10T15:25:13.501001+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.310866+0000 mon.c (mon.1) 1306 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.312050+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.423409+0000 mon.c (mon.1) 1307 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.424550+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.496607+0000 mon.c (mon.1) 1308 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.497358+0000 mon.c (mon.1) 1309 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.497865+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.498048+0000 mon.c (mon.1) 1310 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:25:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.498876+0000 mon.c (mon.1) 1311 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.499286+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.500245+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:25:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:14 gibba003 bash[32348]: audit 2021-03-10T15:25:13.501001+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.310866+0000 mon.c (mon.1) 1306 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.312050+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.423409+0000 mon.c (mon.1) 1307 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.424550+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.496607+0000 mon.c (mon.1) 1308 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.497358+0000 mon.c (mon.1) 1309 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.497865+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.498048+0000 mon.c (mon.1) 1310 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:25:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.498876+0000 mon.c (mon.1) 1311 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.499286+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:25:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.500245+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:25:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:14 gibba043 bash[24019]: audit 2021-03-10T15:25:13.501001+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:15.336 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:25:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:15 gibba003 bash[31385]: cluster 2021-03-10T15:25:13.244506+0000 mgr.gibba043.dnkmem (mgr.34373) 4980 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:15 gibba003 bash[32348]: cluster 2021-03-10T15:25:13.244506+0000 mgr.gibba043.dnkmem (mgr.34373) 4980 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:15 gibba043 bash[24019]: cluster 2021-03-10T15:25:13.244506+0000 mgr.gibba043.dnkmem (mgr.34373) 4980 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:15.564 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:25:15.565 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (93m) 8m ago 98m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:25:15.565 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (98m) 7m ago 98m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:25:15.565 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (93m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:25:15.566 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:25:15.566 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:25:15.566 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:25:15.566 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:25:15.567 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:25:15.567 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (99m) 8m ago 99m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:25:15.567 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (99m) 7m ago 99m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:25:15.567 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:25:15.568 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:25:15.568 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:25:15.568 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:25:15.568 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:25:15.569 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:25:15.569 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (89m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:25:15.569 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (88m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:25:15.569 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (98m) 7m ago 99m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:25:15.569 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 97m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:25:15.812 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:25:15.813 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:25:15.813 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:15.813 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:25:15.814 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:25:15.814 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:15.814 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:25:15.814 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:25:15.815 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:25:15.815 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:25:15.815 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:25:15.815 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:25:15.815 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:25:15.816 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:25:15.816 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:25:16.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:16 gibba003 bash[31385]: audit 2021-03-10T15:25:15.810654+0000 mon.c (mon.1) 1312 : audit [DBG] from='client.? 172.21.2.103:0/4272779887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:16.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:16 gibba003 bash[32348]: audit 2021-03-10T15:25:15.810654+0000 mon.c (mon.1) 1312 : audit [DBG] from='client.? 172.21.2.103:0/4272779887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:16 gibba043 bash[24019]: audit 2021-03-10T15:25:15.810654+0000 mon.c (mon.1) 1312 : audit [DBG] from='client.? 172.21.2.103:0/4272779887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: cluster 2021-03-10T15:25:15.245969+0000 mgr.gibba043.dnkmem (mgr.34373) 4981 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:15.323359+0000 mgr.gibba043.dnkmem (mgr.34373) 4982 : audit [DBG] from='client.57388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:15.550336+0000 mgr.gibba043.dnkmem (mgr.34373) 4983 : audit [DBG] from='client.57394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.092616+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:25:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.096132+0000 mon.c (mon.1) 1313 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:17.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.097728+0000 mon.c (mon.1) 1314 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.099352+0000 mon.c (mon.1) 1315 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.100819+0000 mon.c (mon.1) 1316 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.104643+0000 mon.c (mon.1) 1317 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[31385]: audit 2021-03-10T15:25:17.106537+0000 mon.c (mon.1) 1318 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: cluster 2021-03-10T15:25:15.245969+0000 mgr.gibba043.dnkmem (mgr.34373) 4981 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:15.323359+0000 mgr.gibba043.dnkmem (mgr.34373) 4982 : audit [DBG] from='client.57388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:15.550336+0000 mgr.gibba043.dnkmem (mgr.34373) 4983 : audit [DBG] from='client.57394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:17.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.092616+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:25:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.096132+0000 mon.c (mon.1) 1313 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.097728+0000 mon.c (mon.1) 1314 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.099352+0000 mon.c (mon.1) 1315 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.100819+0000 mon.c (mon.1) 1316 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.104643+0000 mon.c (mon.1) 1317 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:17 gibba003 bash[32348]: audit 2021-03-10T15:25:17.106537+0000 mon.c (mon.1) 1318 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: cluster 2021-03-10T15:25:15.245969+0000 mgr.gibba043.dnkmem (mgr.34373) 4981 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:15.323359+0000 mgr.gibba043.dnkmem (mgr.34373) 4982 : audit [DBG] from='client.57388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:15.550336+0000 mgr.gibba043.dnkmem (mgr.34373) 4983 : audit [DBG] from='client.57394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.092616+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:25:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.096132+0000 mon.c (mon.1) 1313 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.097728+0000 mon.c (mon.1) 1314 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.099352+0000 mon.c (mon.1) 1315 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.100819+0000 mon.c (mon.1) 1316 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.104643+0000 mon.c (mon.1) 1317 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:17.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:17 gibba043 bash[24019]: audit 2021-03-10T15:25:17.106537+0000 mon.c (mon.1) 1318 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:16.885410+0000 mgr.gibba043.dnkmem (mgr.34373) 4984 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:25:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:16.886965+0000 mgr.gibba043.dnkmem (mgr.34373) 4985 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:25:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.094124+0000 mgr.gibba043.dnkmem (mgr.34373) 4986 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.095978+0000 mgr.gibba043.dnkmem (mgr.34373) 4987 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:18.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.097538+0000 mgr.gibba043.dnkmem (mgr.34373) 4988 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:18.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.097576+0000 mgr.gibba043.dnkmem (mgr.34373) 4989 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:18.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.099068+0000 mgr.gibba043.dnkmem (mgr.34373) 4990 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:18.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.099105+0000 mgr.gibba043.dnkmem (mgr.34373) 4991 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:18.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.100773+0000 mgr.gibba043.dnkmem (mgr.34373) 4992 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:18.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.102609+0000 mgr.gibba043.dnkmem (mgr.34373) 4993 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:18.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.102647+0000 mgr.gibba043.dnkmem (mgr.34373) 4994 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:18.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.104459+0000 mgr.gibba043.dnkmem (mgr.34373) 4995 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:18.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.104810+0000 mgr.gibba043.dnkmem (mgr.34373) 4996 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:18.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.106244+0000 mgr.gibba043.dnkmem (mgr.34373) 4997 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:18.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.106281+0000 mgr.gibba043.dnkmem (mgr.34373) 4998 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:18.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[31385]: cephadm 2021-03-10T15:25:17.106386+0000 mgr.gibba043.dnkmem (mgr.34373) 4999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:16.885410+0000 mgr.gibba043.dnkmem (mgr.34373) 4984 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:25:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:16.886965+0000 mgr.gibba043.dnkmem (mgr.34373) 4985 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:25:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.094124+0000 mgr.gibba043.dnkmem (mgr.34373) 4986 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.095978+0000 mgr.gibba043.dnkmem (mgr.34373) 4987 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.097538+0000 mgr.gibba043.dnkmem (mgr.34373) 4988 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.097576+0000 mgr.gibba043.dnkmem (mgr.34373) 4989 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.099068+0000 mgr.gibba043.dnkmem (mgr.34373) 4990 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.099105+0000 mgr.gibba043.dnkmem (mgr.34373) 4991 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.100773+0000 mgr.gibba043.dnkmem (mgr.34373) 4992 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.102609+0000 mgr.gibba043.dnkmem (mgr.34373) 4993 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.102647+0000 mgr.gibba043.dnkmem (mgr.34373) 4994 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.104459+0000 mgr.gibba043.dnkmem (mgr.34373) 4995 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.104810+0000 mgr.gibba043.dnkmem (mgr.34373) 4996 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:18.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.106244+0000 mgr.gibba043.dnkmem (mgr.34373) 4997 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:18.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.106281+0000 mgr.gibba043.dnkmem (mgr.34373) 4998 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:18.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:18 gibba003 bash[32348]: cephadm 2021-03-10T15:25:17.106386+0000 mgr.gibba043.dnkmem (mgr.34373) 4999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:16.885410+0000 mgr.gibba043.dnkmem (mgr.34373) 4984 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:25:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:16.886965+0000 mgr.gibba043.dnkmem (mgr.34373) 4985 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:25:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.094124+0000 mgr.gibba043.dnkmem (mgr.34373) 4986 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.095978+0000 mgr.gibba043.dnkmem (mgr.34373) 4987 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.097538+0000 mgr.gibba043.dnkmem (mgr.34373) 4988 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.097576+0000 mgr.gibba043.dnkmem (mgr.34373) 4989 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.099068+0000 mgr.gibba043.dnkmem (mgr.34373) 4990 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:18.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.099105+0000 mgr.gibba043.dnkmem (mgr.34373) 4991 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:18.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.100773+0000 mgr.gibba043.dnkmem (mgr.34373) 4992 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:18.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.102609+0000 mgr.gibba043.dnkmem (mgr.34373) 4993 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:18.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.102647+0000 mgr.gibba043.dnkmem (mgr.34373) 4994 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:18.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.104459+0000 mgr.gibba043.dnkmem (mgr.34373) 4995 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:18.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.104810+0000 mgr.gibba043.dnkmem (mgr.34373) 4996 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:18.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.106244+0000 mgr.gibba043.dnkmem (mgr.34373) 4997 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:18.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.106281+0000 mgr.gibba043.dnkmem (mgr.34373) 4998 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:18.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:18 gibba043 bash[24019]: cephadm 2021-03-10T15:25:17.106386+0000 mgr.gibba043.dnkmem (mgr.34373) 4999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:19 gibba003 bash[31385]: cluster 2021-03-10T15:25:17.247644+0000 mgr.gibba043.dnkmem (mgr.34373) 5000 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:19 gibba003 bash[32348]: cluster 2021-03-10T15:25:17.247644+0000 mgr.gibba043.dnkmem (mgr.34373) 5000 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:19 gibba043 bash[24019]: cluster 2021-03-10T15:25:17.247644+0000 mgr.gibba043.dnkmem (mgr.34373) 5000 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:21 gibba003 bash[32348]: cluster 2021-03-10T15:25:19.249364+0000 mgr.gibba043.dnkmem (mgr.34373) 5001 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:21.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:21 gibba003 bash[31385]: cluster 2021-03-10T15:25:19.249364+0000 mgr.gibba043.dnkmem (mgr.34373) 5001 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:21 gibba043 bash[24019]: cluster 2021-03-10T15:25:19.249364+0000 mgr.gibba043.dnkmem (mgr.34373) 5001 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:23 gibba003 bash[31385]: cluster 2021-03-10T15:25:21.251148+0000 mgr.gibba043.dnkmem (mgr.34373) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:23 gibba003 bash[32348]: cluster 2021-03-10T15:25:21.251148+0000 mgr.gibba043.dnkmem (mgr.34373) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:23 gibba043 bash[24019]: cluster 2021-03-10T15:25:21.251148+0000 mgr.gibba043.dnkmem (mgr.34373) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:25 gibba003 bash[31385]: cluster 2021-03-10T15:25:23.252613+0000 mgr.gibba043.dnkmem (mgr.34373) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:25 gibba003 bash[32348]: cluster 2021-03-10T15:25:23.252613+0000 mgr.gibba043.dnkmem (mgr.34373) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:25 gibba043 bash[24019]: cluster 2021-03-10T15:25:23.252613+0000 mgr.gibba043.dnkmem (mgr.34373) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:27 gibba003 bash[32348]: cluster 2021-03-10T15:25:25.253921+0000 mgr.gibba043.dnkmem (mgr.34373) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:27 gibba003 bash[31385]: cluster 2021-03-10T15:25:25.253921+0000 mgr.gibba043.dnkmem (mgr.34373) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:27 gibba043 bash[24019]: cluster 2021-03-10T15:25:25.253921+0000 mgr.gibba043.dnkmem (mgr.34373) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:29 gibba003 bash[31385]: cluster 2021-03-10T15:25:27.255182+0000 mgr.gibba043.dnkmem (mgr.34373) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:29 gibba003 bash[32348]: cluster 2021-03-10T15:25:27.255182+0000 mgr.gibba043.dnkmem (mgr.34373) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:29 gibba043 bash[24019]: cluster 2021-03-10T15:25:27.255182+0000 mgr.gibba043.dnkmem (mgr.34373) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:31 gibba003 bash[31385]: cluster 2021-03-10T15:25:29.256386+0000 mgr.gibba043.dnkmem (mgr.34373) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:31 gibba003 bash[32348]: cluster 2021-03-10T15:25:29.256386+0000 mgr.gibba043.dnkmem (mgr.34373) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:31 gibba043 bash[24019]: cluster 2021-03-10T15:25:29.256386+0000 mgr.gibba043.dnkmem (mgr.34373) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:33 gibba043 bash[24019]: cluster 2021-03-10T15:25:31.257372+0000 mgr.gibba043.dnkmem (mgr.34373) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:33 gibba043 bash[24019]: cephadm 2021-03-10T15:25:32.120634+0000 mgr.gibba043.dnkmem (mgr.34373) 5008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:33 gibba003 bash[31385]: cluster 2021-03-10T15:25:31.257372+0000 mgr.gibba043.dnkmem (mgr.34373) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:33 gibba003 bash[31385]: cephadm 2021-03-10T15:25:32.120634+0000 mgr.gibba043.dnkmem (mgr.34373) 5008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:33 gibba003 bash[32348]: cluster 2021-03-10T15:25:31.257372+0000 mgr.gibba043.dnkmem (mgr.34373) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:33 gibba003 bash[32348]: cephadm 2021-03-10T15:25:32.120634+0000 mgr.gibba043.dnkmem (mgr.34373) 5008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:35 gibba043 bash[24019]: cluster 2021-03-10T15:25:33.258340+0000 mgr.gibba043.dnkmem (mgr.34373) 5009 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:35 gibba003 bash[31385]: cluster 2021-03-10T15:25:33.258340+0000 mgr.gibba043.dnkmem (mgr.34373) 5009 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:35 gibba003 bash[32348]: cluster 2021-03-10T15:25:33.258340+0000 mgr.gibba043.dnkmem (mgr.34373) 5009 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:37 gibba043 bash[24019]: cluster 2021-03-10T15:25:35.259868+0000 mgr.gibba043.dnkmem (mgr.34373) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:37 gibba003 bash[31385]: cluster 2021-03-10T15:25:35.259868+0000 mgr.gibba043.dnkmem (mgr.34373) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:37 gibba003 bash[32348]: cluster 2021-03-10T15:25:35.259868+0000 mgr.gibba043.dnkmem (mgr.34373) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:38 gibba043 bash[24019]: cluster 2021-03-10T15:25:37.260359+0000 mgr.gibba043.dnkmem (mgr.34373) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:38 gibba003 bash[31385]: cluster 2021-03-10T15:25:37.260359+0000 mgr.gibba043.dnkmem (mgr.34373) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:38 gibba003 bash[32348]: cluster 2021-03-10T15:25:37.260359+0000 mgr.gibba043.dnkmem (mgr.34373) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:40.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:40 gibba003 bash[31385]: cluster 2021-03-10T15:25:39.261590+0000 mgr.gibba043.dnkmem (mgr.34373) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:40.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:40 gibba003 bash[32348]: cluster 2021-03-10T15:25:39.261590+0000 mgr.gibba043.dnkmem (mgr.34373) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:40.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:40 gibba043 bash[24019]: cluster 2021-03-10T15:25:39.261590+0000 mgr.gibba043.dnkmem (mgr.34373) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:42 gibba003 bash[31385]: cluster 2021-03-10T15:25:41.263455+0000 mgr.gibba043.dnkmem (mgr.34373) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:42 gibba003 bash[32348]: cluster 2021-03-10T15:25:41.263455+0000 mgr.gibba043.dnkmem (mgr.34373) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:42 gibba043 bash[24019]: cluster 2021-03-10T15:25:41.263455+0000 mgr.gibba043.dnkmem (mgr.34373) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:44.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:44 gibba003 bash[31385]: cluster 2021-03-10T15:25:43.264947+0000 mgr.gibba043.dnkmem (mgr.34373) 5014 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:44.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:44 gibba003 bash[32348]: cluster 2021-03-10T15:25:43.264947+0000 mgr.gibba043.dnkmem (mgr.34373) 5014 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:44.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:44 gibba043 bash[24019]: cluster 2021-03-10T15:25:43.264947+0000 mgr.gibba043.dnkmem (mgr.34373) 5014 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.056 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:25:46.283 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:25:46.283 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (94m) 8m ago 99m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:25:46.283 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (99m) 7m ago 99m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:25:46.284 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:25:46.284 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:25:46.284 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:25:46.284 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:25:46.285 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (93m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:25:46.285 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:25:46.285 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (99m) 8m ago 99m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:25:46.285 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (99m) 7m ago 99m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:25:46.286 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:25:46.286 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:25:46.286 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:25:46.286 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:25:46.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:25:46.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:25:46.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:25:46.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:25:46.287 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (98m) 7m ago 99m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:25:46.288 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 97m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:25:46.537 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:25:46.537 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:25:46.537 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:46.537 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:25:46.538 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:25:46.538 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:46.538 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:25:46.538 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:25:46.539 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:25:46.539 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:25:46.539 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:25:46.539 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:25:46.539 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:25:46.540 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:25:46.540 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:25:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:46 gibba003 bash[31385]: cluster 2021-03-10T15:25:45.266472+0000 mgr.gibba043.dnkmem (mgr.34373) 5015 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:46 gibba003 bash[31385]: audit 2021-03-10T15:25:46.044412+0000 mgr.gibba043.dnkmem (mgr.34373) 5016 : audit [DBG] from='client.57406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:46 gibba003 bash[32348]: cluster 2021-03-10T15:25:45.266472+0000 mgr.gibba043.dnkmem (mgr.34373) 5015 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:46 gibba003 bash[32348]: audit 2021-03-10T15:25:46.044412+0000 mgr.gibba043.dnkmem (mgr.34373) 5016 : audit [DBG] from='client.57406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:46.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:46 gibba043 bash[24019]: cluster 2021-03-10T15:25:45.266472+0000 mgr.gibba043.dnkmem (mgr.34373) 5015 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:46 gibba043 bash[24019]: audit 2021-03-10T15:25:46.044412+0000 mgr.gibba043.dnkmem (mgr.34373) 5016 : audit [DBG] from='client.57406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:47 gibba003 bash[31385]: audit 2021-03-10T15:25:46.268067+0000 mgr.gibba043.dnkmem (mgr.34373) 5017 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:47 gibba003 bash[31385]: audit 2021-03-10T15:25:46.535225+0000 mon.a (mon.0) 1245 : audit [DBG] from='client.? 172.21.2.103:0/1736022490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:47.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:47 gibba003 bash[31385]: cephadm 2021-03-10T15:25:47.136703+0000 mgr.gibba043.dnkmem (mgr.34373) 5018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:47 gibba003 bash[32348]: audit 2021-03-10T15:25:46.268067+0000 mgr.gibba043.dnkmem (mgr.34373) 5017 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:47 gibba003 bash[32348]: audit 2021-03-10T15:25:46.535225+0000 mon.a (mon.0) 1245 : audit [DBG] from='client.? 172.21.2.103:0/1736022490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:47.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:47 gibba003 bash[32348]: cephadm 2021-03-10T15:25:47.136703+0000 mgr.gibba043.dnkmem (mgr.34373) 5018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:47 gibba043 bash[24019]: audit 2021-03-10T15:25:46.268067+0000 mgr.gibba043.dnkmem (mgr.34373) 5017 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:47 gibba043 bash[24019]: audit 2021-03-10T15:25:46.535225+0000 mon.a (mon.0) 1245 : audit [DBG] from='client.? 172.21.2.103:0/1736022490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:47 gibba043 bash[24019]: cephadm 2021-03-10T15:25:47.136703+0000 mgr.gibba043.dnkmem (mgr.34373) 5018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:25:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:48 gibba043 bash[24019]: cluster 2021-03-10T15:25:47.268025+0000 mgr.gibba043.dnkmem (mgr.34373) 5019 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:48 gibba003 bash[31385]: cluster 2021-03-10T15:25:47.268025+0000 mgr.gibba043.dnkmem (mgr.34373) 5019 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:48 gibba003 bash[32348]: cluster 2021-03-10T15:25:47.268025+0000 mgr.gibba043.dnkmem (mgr.34373) 5019 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:50.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:50 gibba043 bash[24019]: cluster 2021-03-10T15:25:49.269337+0000 mgr.gibba043.dnkmem (mgr.34373) 5020 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:50.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:50 gibba003 bash[31385]: cluster 2021-03-10T15:25:49.269337+0000 mgr.gibba043.dnkmem (mgr.34373) 5020 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:50.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:50 gibba003 bash[32348]: cluster 2021-03-10T15:25:49.269337+0000 mgr.gibba043.dnkmem (mgr.34373) 5020 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:52.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:52 gibba043 bash[24019]: cluster 2021-03-10T15:25:51.271065+0000 mgr.gibba043.dnkmem (mgr.34373) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:52 gibba003 bash[31385]: cluster 2021-03-10T15:25:51.271065+0000 mgr.gibba043.dnkmem (mgr.34373) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:52 gibba003 bash[32348]: cluster 2021-03-10T15:25:51.271065+0000 mgr.gibba043.dnkmem (mgr.34373) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:54 gibba043 bash[24019]: cluster 2021-03-10T15:25:53.272463+0000 mgr.gibba043.dnkmem (mgr.34373) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:54 gibba003 bash[31385]: cluster 2021-03-10T15:25:53.272463+0000 mgr.gibba043.dnkmem (mgr.34373) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:54 gibba003 bash[32348]: cluster 2021-03-10T15:25:53.272463+0000 mgr.gibba043.dnkmem (mgr.34373) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:56 gibba043 bash[24019]: cluster 2021-03-10T15:25:55.273873+0000 mgr.gibba043.dnkmem (mgr.34373) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:56 gibba003 bash[31385]: cluster 2021-03-10T15:25:55.273873+0000 mgr.gibba043.dnkmem (mgr.34373) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:56 gibba003 bash[32348]: cluster 2021-03-10T15:25:55.273873+0000 mgr.gibba043.dnkmem (mgr.34373) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:58.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:25:58 gibba043 bash[24019]: cluster 2021-03-10T15:25:57.275215+0000 mgr.gibba043.dnkmem (mgr.34373) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:25:58 gibba003 bash[31385]: cluster 2021-03-10T15:25:57.275215+0000 mgr.gibba043.dnkmem (mgr.34373) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:25:58 gibba003 bash[32348]: cluster 2021-03-10T15:25:57.275215+0000 mgr.gibba043.dnkmem (mgr.34373) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:00.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:00 gibba043 bash[24019]: cluster 2021-03-10T15:25:59.276716+0000 mgr.gibba043.dnkmem (mgr.34373) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:00 gibba003 bash[31385]: cluster 2021-03-10T15:25:59.276716+0000 mgr.gibba043.dnkmem (mgr.34373) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:00.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:00 gibba003 bash[32348]: cluster 2021-03-10T15:25:59.276716+0000 mgr.gibba043.dnkmem (mgr.34373) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:02 gibba043 bash[24019]: cluster 2021-03-10T15:26:01.278352+0000 mgr.gibba043.dnkmem (mgr.34373) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:02 gibba043 bash[24019]: cephadm 2021-03-10T15:26:02.152479+0000 mgr.gibba043.dnkmem (mgr.34373) 5027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:02 gibba003 bash[31385]: cluster 2021-03-10T15:26:01.278352+0000 mgr.gibba043.dnkmem (mgr.34373) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:02 gibba003 bash[31385]: cephadm 2021-03-10T15:26:02.152479+0000 mgr.gibba043.dnkmem (mgr.34373) 5027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:02.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:02 gibba003 bash[32348]: cluster 2021-03-10T15:26:01.278352+0000 mgr.gibba043.dnkmem (mgr.34373) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:02 gibba003 bash[32348]: cephadm 2021-03-10T15:26:02.152479+0000 mgr.gibba043.dnkmem (mgr.34373) 5027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:04.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:04 gibba043 bash[24019]: cluster 2021-03-10T15:26:03.279563+0000 mgr.gibba043.dnkmem (mgr.34373) 5028 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:04.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:04 gibba003 bash[31385]: cluster 2021-03-10T15:26:03.279563+0000 mgr.gibba043.dnkmem (mgr.34373) 5028 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:04 gibba003 bash[32348]: cluster 2021-03-10T15:26:03.279563+0000 mgr.gibba043.dnkmem (mgr.34373) 5028 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:06.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:06 gibba043 bash[24019]: cluster 2021-03-10T15:26:05.280979+0000 mgr.gibba043.dnkmem (mgr.34373) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:06 gibba003 bash[31385]: cluster 2021-03-10T15:26:05.280979+0000 mgr.gibba043.dnkmem (mgr.34373) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:06 gibba003 bash[32348]: cluster 2021-03-10T15:26:05.280979+0000 mgr.gibba043.dnkmem (mgr.34373) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:08.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:08 gibba043 bash[24019]: cluster 2021-03-10T15:26:07.282402+0000 mgr.gibba043.dnkmem (mgr.34373) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:08 gibba003 bash[31385]: cluster 2021-03-10T15:26:07.282402+0000 mgr.gibba043.dnkmem (mgr.34373) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:08.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:08 gibba003 bash[32348]: cluster 2021-03-10T15:26:07.282402+0000 mgr.gibba043.dnkmem (mgr.34373) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:10 gibba003 bash[31385]: cluster 2021-03-10T15:26:09.283908+0000 mgr.gibba043.dnkmem (mgr.34373) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.018 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:10 gibba003 bash[32348]: cluster 2021-03-10T15:26:09.283908+0000 mgr.gibba043.dnkmem (mgr.34373) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:10 gibba043 bash[24019]: cluster 2021-03-10T15:26:09.283908+0000 mgr.gibba043.dnkmem (mgr.34373) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:12 gibba003 bash[31385]: cluster 2021-03-10T15:26:11.285411+0000 mgr.gibba043.dnkmem (mgr.34373) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:12.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:12 gibba003 bash[32348]: cluster 2021-03-10T15:26:11.285411+0000 mgr.gibba043.dnkmem (mgr.34373) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:12 gibba043 bash[24019]: cluster 2021-03-10T15:26:11.285411+0000 mgr.gibba043.dnkmem (mgr.34373) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.317852+0000 mon.c (mon.1) 1319 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.319084+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.431817+0000 mon.c (mon.1) 1320 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.432988+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.503491+0000 mon.c (mon.1) 1321 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.504200+0000 mon.c (mon.1) 1322 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.504868+0000 mon.c (mon.1) 1323 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:26:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.504888+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.505566+0000 mon.c (mon.1) 1324 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.506914+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.507893+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:26:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[31385]: audit 2021-03-10T15:26:13.508792+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.317852+0000 mon.c (mon.1) 1319 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.319084+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.431817+0000 mon.c (mon.1) 1320 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.432988+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.503491+0000 mon.c (mon.1) 1321 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.504200+0000 mon.c (mon.1) 1322 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.504868+0000 mon.c (mon.1) 1323 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:26:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.504888+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.505566+0000 mon.c (mon.1) 1324 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.506914+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:26:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.507893+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:26:13.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:13 gibba003 bash[32348]: audit 2021-03-10T15:26:13.508792+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.317852+0000 mon.c (mon.1) 1319 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.319084+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.431817+0000 mon.c (mon.1) 1320 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.432988+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.503491+0000 mon.c (mon.1) 1321 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.504200+0000 mon.c (mon.1) 1322 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:26:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.504868+0000 mon.c (mon.1) 1323 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:26:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.504888+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.505566+0000 mon.c (mon.1) 1324 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.506914+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:26:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.507893+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:26:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:13 gibba043 bash[24019]: audit 2021-03-10T15:26:13.508792+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:14 gibba003 bash[31385]: cluster 2021-03-10T15:26:13.286635+0000 mgr.gibba043.dnkmem (mgr.34373) 5033 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:14 gibba003 bash[32348]: cluster 2021-03-10T15:26:13.286635+0000 mgr.gibba043.dnkmem (mgr.34373) 5033 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:14 gibba043 bash[24019]: cluster 2021-03-10T15:26:13.286635+0000 mgr.gibba043.dnkmem (mgr.34373) 5033 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:16.782 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:26:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:16 gibba003 bash[31385]: cluster 2021-03-10T15:26:15.288247+0000 mgr.gibba043.dnkmem (mgr.34373) 5034 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:16.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:16 gibba003 bash[32348]: cluster 2021-03-10T15:26:15.288247+0000 mgr.gibba043.dnkmem (mgr.34373) 5034 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.012 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:26:17.012 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (94m) 9m ago 99m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:26:17.012 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (99m) 8m ago 99m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:26:17.013 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (94m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:26:17.013 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:26:17.013 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:26:17.014 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:26:17.014 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:26:17.014 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (93m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:26:17.015 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (100m) 9m ago 100m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:26:17.015 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (100m) 8m ago 100m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:26:17.015 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:26:17.015 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:26:17.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:26:17.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:26:17.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:26:17.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:26:17.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (90m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:26:17.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (89m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:26:17.017 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (99m) 8m ago 100m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:26:17.017 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 98m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:26:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:16 gibba043 bash[24019]: cluster 2021-03-10T15:26:15.288247+0000 mgr.gibba043.dnkmem (mgr.34373) 5034 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.265 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:26:17.265 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:26:17.265 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:17.266 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:26:17.266 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:26:17.267 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:17.267 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:26:17.267 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:26:17.267 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:26:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:26:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:26:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:26:17.268 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:26:17.269 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:26:17.269 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:26:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:16.770029+0000 mgr.gibba043.dnkmem (mgr.34373) 5035 : audit [DBG] from='client.57424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:16.996325+0000 mgr.gibba043.dnkmem (mgr.34373) 5036 : audit [DBG] from='client.57430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.169269+0000 mgr.gibba043.dnkmem (mgr.34373) 5037 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:26:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.170871+0000 mgr.gibba043.dnkmem (mgr.34373) 5038 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:26:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.262991+0000 mon.c (mon.1) 1325 : audit [DBG] from='client.? 172.21.2.103:0/221743864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.375066+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:26:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.378718+0000 mon.c (mon.1) 1326 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.380119+0000 mon.c (mon.1) 1327 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.381804+0000 mon.c (mon.1) 1328 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.383210+0000 mon.c (mon.1) 1329 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.386477+0000 mon.c (mon.1) 1330 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:17 gibba043 bash[24019]: audit 2021-03-10T15:26:17.387927+0000 mon.c (mon.1) 1331 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:16.770029+0000 mgr.gibba043.dnkmem (mgr.34373) 5035 : audit [DBG] from='client.57424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:16.996325+0000 mgr.gibba043.dnkmem (mgr.34373) 5036 : audit [DBG] from='client.57430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.169269+0000 mgr.gibba043.dnkmem (mgr.34373) 5037 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:26:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.170871+0000 mgr.gibba043.dnkmem (mgr.34373) 5038 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:26:17.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.262991+0000 mon.c (mon.1) 1325 : audit [DBG] from='client.? 172.21.2.103:0/221743864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.375066+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:26:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.378718+0000 mon.c (mon.1) 1326 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.380119+0000 mon.c (mon.1) 1327 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.381804+0000 mon.c (mon.1) 1328 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.383210+0000 mon.c (mon.1) 1329 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.386477+0000 mon.c (mon.1) 1330 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[31385]: audit 2021-03-10T15:26:17.387927+0000 mon.c (mon.1) 1331 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:16.770029+0000 mgr.gibba043.dnkmem (mgr.34373) 5035 : audit [DBG] from='client.57424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:16.996325+0000 mgr.gibba043.dnkmem (mgr.34373) 5036 : audit [DBG] from='client.57430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:17.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.169269+0000 mgr.gibba043.dnkmem (mgr.34373) 5037 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:26:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.170871+0000 mgr.gibba043.dnkmem (mgr.34373) 5038 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:26:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.262991+0000 mon.c (mon.1) 1325 : audit [DBG] from='client.? 172.21.2.103:0/221743864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.375066+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:26:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.378718+0000 mon.c (mon.1) 1326 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:17.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.380119+0000 mon.c (mon.1) 1327 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.381804+0000 mon.c (mon.1) 1328 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.383210+0000 mon.c (mon.1) 1329 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.386477+0000 mon.c (mon.1) 1330 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:17.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:17 gibba003 bash[32348]: audit 2021-03-10T15:26:17.387927+0000 mon.c (mon.1) 1331 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:18.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cluster 2021-03-10T15:26:17.288755+0000 mgr.gibba043.dnkmem (mgr.34373) 5039 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:18.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.376636+0000 mgr.gibba043.dnkmem (mgr.34373) 5040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:18.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.378413+0000 mgr.gibba043.dnkmem (mgr.34373) 5041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:18.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.379899+0000 mgr.gibba043.dnkmem (mgr.34373) 5042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:18.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.379937+0000 mgr.gibba043.dnkmem (mgr.34373) 5043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:18.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.381332+0000 mgr.gibba043.dnkmem (mgr.34373) 5044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:18.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.381370+0000 mgr.gibba043.dnkmem (mgr.34373) 5045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:18.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.382923+0000 mgr.gibba043.dnkmem (mgr.34373) 5046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:18.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.384543+0000 mgr.gibba043.dnkmem (mgr.34373) 5047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:18.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.384580+0000 mgr.gibba043.dnkmem (mgr.34373) 5048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:18.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.385872+0000 mgr.gibba043.dnkmem (mgr.34373) 5049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:18.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.386196+0000 mgr.gibba043.dnkmem (mgr.34373) 5050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:18.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.387301+0000 mgr.gibba043.dnkmem (mgr.34373) 5051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:18.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.387340+0000 mgr.gibba043.dnkmem (mgr.34373) 5052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:18.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[31385]: cephadm 2021-03-10T15:26:17.387445+0000 mgr.gibba043.dnkmem (mgr.34373) 5053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:18.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cluster 2021-03-10T15:26:17.288755+0000 mgr.gibba043.dnkmem (mgr.34373) 5039 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:18.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.376636+0000 mgr.gibba043.dnkmem (mgr.34373) 5040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:18.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.378413+0000 mgr.gibba043.dnkmem (mgr.34373) 5041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:18.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.379899+0000 mgr.gibba043.dnkmem (mgr.34373) 5042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:18.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.379937+0000 mgr.gibba043.dnkmem (mgr.34373) 5043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:18.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.381332+0000 mgr.gibba043.dnkmem (mgr.34373) 5044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:18.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.381370+0000 mgr.gibba043.dnkmem (mgr.34373) 5045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:18.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.382923+0000 mgr.gibba043.dnkmem (mgr.34373) 5046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:18.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.384543+0000 mgr.gibba043.dnkmem (mgr.34373) 5047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:18.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.384580+0000 mgr.gibba043.dnkmem (mgr.34373) 5048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:18.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.385872+0000 mgr.gibba043.dnkmem (mgr.34373) 5049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:18.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.386196+0000 mgr.gibba043.dnkmem (mgr.34373) 5050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:18.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.387301+0000 mgr.gibba043.dnkmem (mgr.34373) 5051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:18.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.387340+0000 mgr.gibba043.dnkmem (mgr.34373) 5052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:18.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:18 gibba003 bash[32348]: cephadm 2021-03-10T15:26:17.387445+0000 mgr.gibba043.dnkmem (mgr.34373) 5053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cluster 2021-03-10T15:26:17.288755+0000 mgr.gibba043.dnkmem (mgr.34373) 5039 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.376636+0000 mgr.gibba043.dnkmem (mgr.34373) 5040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.378413+0000 mgr.gibba043.dnkmem (mgr.34373) 5041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.379899+0000 mgr.gibba043.dnkmem (mgr.34373) 5042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.379937+0000 mgr.gibba043.dnkmem (mgr.34373) 5043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.381332+0000 mgr.gibba043.dnkmem (mgr.34373) 5044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.381370+0000 mgr.gibba043.dnkmem (mgr.34373) 5045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.382923+0000 mgr.gibba043.dnkmem (mgr.34373) 5046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.384543+0000 mgr.gibba043.dnkmem (mgr.34373) 5047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.384580+0000 mgr.gibba043.dnkmem (mgr.34373) 5048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.385872+0000 mgr.gibba043.dnkmem (mgr.34373) 5049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:19.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.386196+0000 mgr.gibba043.dnkmem (mgr.34373) 5050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:19.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.387301+0000 mgr.gibba043.dnkmem (mgr.34373) 5051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:19.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.387340+0000 mgr.gibba043.dnkmem (mgr.34373) 5052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:19.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:18 gibba043 bash[24019]: cephadm 2021-03-10T15:26:17.387445+0000 mgr.gibba043.dnkmem (mgr.34373) 5053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:20 gibba003 bash[31385]: cluster 2021-03-10T15:26:19.290140+0000 mgr.gibba043.dnkmem (mgr.34373) 5054 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:20.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:20 gibba003 bash[32348]: cluster 2021-03-10T15:26:19.290140+0000 mgr.gibba043.dnkmem (mgr.34373) 5054 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:20 gibba043 bash[24019]: cluster 2021-03-10T15:26:19.290140+0000 mgr.gibba043.dnkmem (mgr.34373) 5054 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:22 gibba003 bash[31385]: cluster 2021-03-10T15:26:21.291840+0000 mgr.gibba043.dnkmem (mgr.34373) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:22.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:22 gibba003 bash[32348]: cluster 2021-03-10T15:26:21.291840+0000 mgr.gibba043.dnkmem (mgr.34373) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:22 gibba043 bash[24019]: cluster 2021-03-10T15:26:21.291840+0000 mgr.gibba043.dnkmem (mgr.34373) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:24.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:24 gibba003 bash[31385]: cluster 2021-03-10T15:26:23.293068+0000 mgr.gibba043.dnkmem (mgr.34373) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:24 gibba003 bash[32348]: cluster 2021-03-10T15:26:23.293068+0000 mgr.gibba043.dnkmem (mgr.34373) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:24 gibba043 bash[24019]: cluster 2021-03-10T15:26:23.293068+0000 mgr.gibba043.dnkmem (mgr.34373) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:26 gibba003 bash[31385]: cluster 2021-03-10T15:26:25.294596+0000 mgr.gibba043.dnkmem (mgr.34373) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:26.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:26 gibba003 bash[32348]: cluster 2021-03-10T15:26:25.294596+0000 mgr.gibba043.dnkmem (mgr.34373) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:26 gibba043 bash[24019]: cluster 2021-03-10T15:26:25.294596+0000 mgr.gibba043.dnkmem (mgr.34373) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:28 gibba003 bash[31385]: cluster 2021-03-10T15:26:27.296173+0000 mgr.gibba043.dnkmem (mgr.34373) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:28 gibba003 bash[32348]: cluster 2021-03-10T15:26:27.296173+0000 mgr.gibba043.dnkmem (mgr.34373) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:28 gibba043 bash[24019]: cluster 2021-03-10T15:26:27.296173+0000 mgr.gibba043.dnkmem (mgr.34373) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:30 gibba003 bash[31385]: cluster 2021-03-10T15:26:29.297760+0000 mgr.gibba043.dnkmem (mgr.34373) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:30.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:30 gibba003 bash[32348]: cluster 2021-03-10T15:26:29.297760+0000 mgr.gibba043.dnkmem (mgr.34373) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:30 gibba043 bash[24019]: cluster 2021-03-10T15:26:29.297760+0000 mgr.gibba043.dnkmem (mgr.34373) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:32.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:32 gibba043 bash[24019]: cluster 2021-03-10T15:26:31.299416+0000 mgr.gibba043.dnkmem (mgr.34373) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:32.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:32 gibba003 bash[31385]: cluster 2021-03-10T15:26:31.299416+0000 mgr.gibba043.dnkmem (mgr.34373) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:32.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:32 gibba003 bash[32348]: cluster 2021-03-10T15:26:31.299416+0000 mgr.gibba043.dnkmem (mgr.34373) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:33 gibba003 bash[31385]: cephadm 2021-03-10T15:26:32.403425+0000 mgr.gibba043.dnkmem (mgr.34373) 5061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:33.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:33 gibba003 bash[32348]: cephadm 2021-03-10T15:26:32.403425+0000 mgr.gibba043.dnkmem (mgr.34373) 5061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:33 gibba043 bash[24019]: cephadm 2021-03-10T15:26:32.403425+0000 mgr.gibba043.dnkmem (mgr.34373) 5061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:34 gibba003 bash[31385]: cluster 2021-03-10T15:26:33.300776+0000 mgr.gibba043.dnkmem (mgr.34373) 5062 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:34 gibba003 bash[32348]: cluster 2021-03-10T15:26:33.300776+0000 mgr.gibba043.dnkmem (mgr.34373) 5062 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:34 gibba043 bash[24019]: cluster 2021-03-10T15:26:33.300776+0000 mgr.gibba043.dnkmem (mgr.34373) 5062 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:36 gibba003 bash[31385]: cluster 2021-03-10T15:26:35.302292+0000 mgr.gibba043.dnkmem (mgr.34373) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:36 gibba003 bash[32348]: cluster 2021-03-10T15:26:35.302292+0000 mgr.gibba043.dnkmem (mgr.34373) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:36 gibba043 bash[24019]: cluster 2021-03-10T15:26:35.302292+0000 mgr.gibba043.dnkmem (mgr.34373) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:38 gibba003 bash[31385]: cluster 2021-03-10T15:26:37.303998+0000 mgr.gibba043.dnkmem (mgr.34373) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:38 gibba003 bash[32348]: cluster 2021-03-10T15:26:37.303998+0000 mgr.gibba043.dnkmem (mgr.34373) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:38 gibba043 bash[24019]: cluster 2021-03-10T15:26:37.303998+0000 mgr.gibba043.dnkmem (mgr.34373) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:40 gibba003 bash[31385]: cluster 2021-03-10T15:26:39.305488+0000 mgr.gibba043.dnkmem (mgr.34373) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:40.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:40 gibba003 bash[32348]: cluster 2021-03-10T15:26:39.305488+0000 mgr.gibba043.dnkmem (mgr.34373) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:41.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:40 gibba043 bash[24019]: cluster 2021-03-10T15:26:39.305488+0000 mgr.gibba043.dnkmem (mgr.34373) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:42 gibba003 bash[31385]: cluster 2021-03-10T15:26:41.307229+0000 mgr.gibba043.dnkmem (mgr.34373) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:42.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:42 gibba003 bash[32348]: cluster 2021-03-10T15:26:41.307229+0000 mgr.gibba043.dnkmem (mgr.34373) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:42 gibba043 bash[24019]: cluster 2021-03-10T15:26:41.307229+0000 mgr.gibba043.dnkmem (mgr.34373) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:44.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:44 gibba003 bash[31385]: cluster 2021-03-10T15:26:43.308626+0000 mgr.gibba043.dnkmem (mgr.34373) 5067 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:44 gibba003 bash[32348]: cluster 2021-03-10T15:26:43.308626+0000 mgr.gibba043.dnkmem (mgr.34373) 5067 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:44 gibba043 bash[24019]: cluster 2021-03-10T15:26:43.308626+0000 mgr.gibba043.dnkmem (mgr.34373) 5067 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:46 gibba043 bash[24019]: cluster 2021-03-10T15:26:45.310048+0000 mgr.gibba043.dnkmem (mgr.34373) 5068 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:46 gibba003 bash[31385]: cluster 2021-03-10T15:26:45.310048+0000 mgr.gibba043.dnkmem (mgr.34373) 5068 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:46 gibba003 bash[32348]: cluster 2021-03-10T15:26:45.310048+0000 mgr.gibba043.dnkmem (mgr.34373) 5068 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.510 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:26:47.764 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:26:47.765 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (95m) 9m ago 100m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:26:47.765 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (100m) 8m ago 100m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:26:47.765 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:26:47.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (95m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:26:47.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:26:47.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:26:47.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (94m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:26:47.767 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:26:47.767 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (100m) 9m ago 100m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:26:47.767 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (100m) 8m ago 100m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:26:47.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (93m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:26:47.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (93m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:26:47.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:26:47.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:26:47.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:26:47.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:26:47.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:26:47.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:26:47.770 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (100m) 8m ago 100m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:26:47.770 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 98m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:26:48.013 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:26:48.013 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:26:48.013 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:48.014 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:26:48.014 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:26:48.014 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:48.014 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:26:48.015 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:26:48.015 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:26:48.015 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:26:48.015 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:26:48.016 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:26:48.016 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:26:48.016 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:26:48.016 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:26:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:48 gibba043 bash[24019]: cluster 2021-03-10T15:26:47.311780+0000 mgr.gibba043.dnkmem (mgr.34373) 5069 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:48 gibba043 bash[24019]: cephadm 2021-03-10T15:26:47.419381+0000 mgr.gibba043.dnkmem (mgr.34373) 5070 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:48 gibba043 bash[24019]: audit 2021-03-10T15:26:47.498051+0000 mgr.gibba043.dnkmem (mgr.34373) 5071 : audit [DBG] from='client.47454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:49.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:48 gibba043 bash[24019]: audit 2021-03-10T15:26:47.723418+0000 mgr.gibba043.dnkmem (mgr.34373) 5072 : audit [DBG] from='client.57448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:49.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:48 gibba043 bash[24019]: audit 2021-03-10T15:26:48.010913+0000 mon.a (mon.0) 1253 : audit [DBG] from='client.? 172.21.2.103:0/3976586258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:49.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[31385]: cluster 2021-03-10T15:26:47.311780+0000 mgr.gibba043.dnkmem (mgr.34373) 5069 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[31385]: cephadm 2021-03-10T15:26:47.419381+0000 mgr.gibba043.dnkmem (mgr.34373) 5070 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[31385]: audit 2021-03-10T15:26:47.498051+0000 mgr.gibba043.dnkmem (mgr.34373) 5071 : audit [DBG] from='client.47454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[31385]: audit 2021-03-10T15:26:47.723418+0000 mgr.gibba043.dnkmem (mgr.34373) 5072 : audit [DBG] from='client.57448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:49.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[31385]: audit 2021-03-10T15:26:48.010913+0000 mon.a (mon.0) 1253 : audit [DBG] from='client.? 172.21.2.103:0/3976586258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[32348]: cluster 2021-03-10T15:26:47.311780+0000 mgr.gibba043.dnkmem (mgr.34373) 5069 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[32348]: cephadm 2021-03-10T15:26:47.419381+0000 mgr.gibba043.dnkmem (mgr.34373) 5070 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:26:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[32348]: audit 2021-03-10T15:26:47.498051+0000 mgr.gibba043.dnkmem (mgr.34373) 5071 : audit [DBG] from='client.47454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[32348]: audit 2021-03-10T15:26:47.723418+0000 mgr.gibba043.dnkmem (mgr.34373) 5072 : audit [DBG] from='client.57448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:49.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:48 gibba003 bash[32348]: audit 2021-03-10T15:26:48.010913+0000 mon.a (mon.0) 1253 : audit [DBG] from='client.? 172.21.2.103:0/3976586258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:51.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:50 gibba043 bash[24019]: cluster 2021-03-10T15:26:49.313297+0000 mgr.gibba043.dnkmem (mgr.34373) 5073 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:50 gibba003 bash[31385]: cluster 2021-03-10T15:26:49.313297+0000 mgr.gibba043.dnkmem (mgr.34373) 5073 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:50 gibba003 bash[32348]: cluster 2021-03-10T15:26:49.313297+0000 mgr.gibba043.dnkmem (mgr.34373) 5073 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:52 gibba043 bash[24019]: cluster 2021-03-10T15:26:51.314922+0000 mgr.gibba043.dnkmem (mgr.34373) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:52 gibba003 bash[31385]: cluster 2021-03-10T15:26:51.314922+0000 mgr.gibba043.dnkmem (mgr.34373) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:52 gibba003 bash[32348]: cluster 2021-03-10T15:26:51.314922+0000 mgr.gibba043.dnkmem (mgr.34373) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:55.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:54 gibba043 bash[24019]: cluster 2021-03-10T15:26:53.316328+0000 mgr.gibba043.dnkmem (mgr.34373) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:54 gibba003 bash[31385]: cluster 2021-03-10T15:26:53.316328+0000 mgr.gibba043.dnkmem (mgr.34373) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:54 gibba003 bash[32348]: cluster 2021-03-10T15:26:53.316328+0000 mgr.gibba043.dnkmem (mgr.34373) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:56 gibba043 bash[24019]: cluster 2021-03-10T15:26:55.317543+0000 mgr.gibba043.dnkmem (mgr.34373) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:56 gibba003 bash[31385]: cluster 2021-03-10T15:26:55.317543+0000 mgr.gibba043.dnkmem (mgr.34373) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:56 gibba003 bash[32348]: cluster 2021-03-10T15:26:55.317543+0000 mgr.gibba043.dnkmem (mgr.34373) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:26:58 gibba043 bash[24019]: cluster 2021-03-10T15:26:57.318934+0000 mgr.gibba043.dnkmem (mgr.34373) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:26:58 gibba003 bash[31385]: cluster 2021-03-10T15:26:57.318934+0000 mgr.gibba043.dnkmem (mgr.34373) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:26:58 gibba003 bash[32348]: cluster 2021-03-10T15:26:57.318934+0000 mgr.gibba043.dnkmem (mgr.34373) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:00 gibba043 bash[24019]: cluster 2021-03-10T15:26:59.320615+0000 mgr.gibba043.dnkmem (mgr.34373) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:00 gibba003 bash[31385]: cluster 2021-03-10T15:26:59.320615+0000 mgr.gibba043.dnkmem (mgr.34373) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:00 gibba003 bash[32348]: cluster 2021-03-10T15:26:59.320615+0000 mgr.gibba043.dnkmem (mgr.34373) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:02 gibba043 bash[24019]: cluster 2021-03-10T15:27:01.322399+0000 mgr.gibba043.dnkmem (mgr.34373) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:02 gibba003 bash[31385]: cluster 2021-03-10T15:27:01.322399+0000 mgr.gibba043.dnkmem (mgr.34373) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:02 gibba003 bash[32348]: cluster 2021-03-10T15:27:01.322399+0000 mgr.gibba043.dnkmem (mgr.34373) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:03 gibba003 bash[31385]: cephadm 2021-03-10T15:27:02.428673+0000 mgr.gibba043.dnkmem (mgr.34373) 5080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:04.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:03 gibba003 bash[32348]: cephadm 2021-03-10T15:27:02.428673+0000 mgr.gibba043.dnkmem (mgr.34373) 5080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:04.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:03 gibba043 bash[24019]: cephadm 2021-03-10T15:27:02.428673+0000 mgr.gibba043.dnkmem (mgr.34373) 5080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:04 gibba003 bash[31385]: cluster 2021-03-10T15:27:03.323894+0000 mgr.gibba043.dnkmem (mgr.34373) 5081 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:04 gibba003 bash[32348]: cluster 2021-03-10T15:27:03.323894+0000 mgr.gibba043.dnkmem (mgr.34373) 5081 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:04 gibba043 bash[24019]: cluster 2021-03-10T15:27:03.323894+0000 mgr.gibba043.dnkmem (mgr.34373) 5081 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:06 gibba003 bash[31385]: cluster 2021-03-10T15:27:05.325128+0000 mgr.gibba043.dnkmem (mgr.34373) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:06 gibba003 bash[32348]: cluster 2021-03-10T15:27:05.325128+0000 mgr.gibba043.dnkmem (mgr.34373) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:06 gibba043 bash[24019]: cluster 2021-03-10T15:27:05.325128+0000 mgr.gibba043.dnkmem (mgr.34373) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:08 gibba003 bash[31385]: cluster 2021-03-10T15:27:07.326484+0000 mgr.gibba043.dnkmem (mgr.34373) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:08 gibba003 bash[32348]: cluster 2021-03-10T15:27:07.326484+0000 mgr.gibba043.dnkmem (mgr.34373) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:08 gibba043 bash[24019]: cluster 2021-03-10T15:27:07.326484+0000 mgr.gibba043.dnkmem (mgr.34373) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:10 gibba003 bash[31385]: cluster 2021-03-10T15:27:09.328010+0000 mgr.gibba043.dnkmem (mgr.34373) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:10 gibba003 bash[32348]: cluster 2021-03-10T15:27:09.328010+0000 mgr.gibba043.dnkmem (mgr.34373) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:10 gibba043 bash[24019]: cluster 2021-03-10T15:27:09.328010+0000 mgr.gibba043.dnkmem (mgr.34373) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:12 gibba003 bash[31385]: cluster 2021-03-10T15:27:11.329518+0000 mgr.gibba043.dnkmem (mgr.34373) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:12 gibba003 bash[32348]: cluster 2021-03-10T15:27:11.329518+0000 mgr.gibba043.dnkmem (mgr.34373) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:12 gibba043 bash[24019]: cluster 2021-03-10T15:27:11.329518+0000 mgr.gibba043.dnkmem (mgr.34373) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.324787+0000 mon.c (mon.1) 1332 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.325867+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.440359+0000 mon.c (mon.1) 1333 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.441448+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.514919+0000 mon.c (mon.1) 1334 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:27:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.515872+0000 mon.c (mon.1) 1335 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.516176+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:27:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.516818+0000 mon.c (mon.1) 1336 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:27:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.517376+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.517969+0000 mon.c (mon.1) 1337 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.518142+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:27:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[31385]: audit 2021-03-10T15:27:13.519174+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.324787+0000 mon.c (mon.1) 1332 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.325867+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.440359+0000 mon.c (mon.1) 1333 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.441448+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.514919+0000 mon.c (mon.1) 1334 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:27:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.515872+0000 mon.c (mon.1) 1335 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.516176+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:27:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.516818+0000 mon.c (mon.1) 1336 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:27:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.517376+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.517969+0000 mon.c (mon.1) 1337 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.518142+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:27:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:13 gibba003 bash[32348]: audit 2021-03-10T15:27:13.519174+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.324787+0000 mon.c (mon.1) 1332 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.325867+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.440359+0000 mon.c (mon.1) 1333 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.441448+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.514919+0000 mon.c (mon.1) 1334 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:27:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.515872+0000 mon.c (mon.1) 1335 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.516176+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:27:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.516818+0000 mon.c (mon.1) 1336 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:27:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.517376+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.517969+0000 mon.c (mon.1) 1337 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.518142+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:27:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:13 gibba043 bash[24019]: audit 2021-03-10T15:27:13.519174+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:14 gibba003 bash[31385]: cluster 2021-03-10T15:27:13.331026+0000 mgr.gibba043.dnkmem (mgr.34373) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:14 gibba003 bash[32348]: cluster 2021-03-10T15:27:13.331026+0000 mgr.gibba043.dnkmem (mgr.34373) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:14 gibba043 bash[24019]: cluster 2021-03-10T15:27:13.331026+0000 mgr.gibba043.dnkmem (mgr.34373) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:16 gibba003 bash[31385]: cluster 2021-03-10T15:27:15.332476+0000 mgr.gibba043.dnkmem (mgr.34373) 5087 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:16 gibba003 bash[32348]: cluster 2021-03-10T15:27:15.332476+0000 mgr.gibba043.dnkmem (mgr.34373) 5087 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:16 gibba043 bash[24019]: cluster 2021-03-10T15:27:15.332476+0000 mgr.gibba043.dnkmem (mgr.34373) 5087 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:17 gibba003 bash[31385]: audit 2021-03-10T15:27:17.448392+0000 mon.c (mon.1) 1338 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:27:18.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:17 gibba003 bash[32348]: audit 2021-03-10T15:27:17.448392+0000 mon.c (mon.1) 1338 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:27:18.255 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:27:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:17 gibba043 bash[24019]: audit 2021-03-10T15:27:17.448392+0000 mon.c (mon.1) 1338 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:27:18.481 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:27:18.481 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (95m) 10m ago 100m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:27:18.482 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (100m) 9m ago 100m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:27:18.482 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:27:18.482 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:27:18.482 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (95m) 10m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:27:18.483 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (95m) 10m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:27:18.483 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:27:18.483 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (94m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:27:18.483 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (101m) 10m ago 101m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:27:18.484 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (101m) 9m ago 101m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:27:18.484 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (93m) 10m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:27:18.484 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:27:18.484 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:27:18.484 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (92m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:27:18.485 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:27:18.485 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:27:18.485 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (91m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:27:18.485 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (90m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:27:18.486 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (100m) 9m ago 101m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:27:18.486 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10m ago 99m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:27:18.737 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:27:18.738 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:27:18.738 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:18.739 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:27:18.739 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:27:18.739 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:18.739 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:27:18.740 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:27:18.740 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:27:18.740 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:27:18.740 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:27:18.741 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:27:18.741 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:27:18.741 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:27:18.741 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:27:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[31385]: cluster 2021-03-10T15:27:17.334139+0000 mgr.gibba043.dnkmem (mgr.34373) 5088 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[31385]: cephadm 2021-03-10T15:27:17.446219+0000 mgr.gibba043.dnkmem (mgr.34373) 5089 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:27:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[31385]: audit 2021-03-10T15:27:18.243200+0000 mgr.gibba043.dnkmem (mgr.34373) 5090 : audit [DBG] from='client.57460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[31385]: audit 2021-03-10T15:27:18.735633+0000 mon.a (mon.0) 1260 : audit [DBG] from='client.? 172.21.2.103:0/4217379169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:19.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[32348]: cluster 2021-03-10T15:27:17.334139+0000 mgr.gibba043.dnkmem (mgr.34373) 5088 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:19.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[32348]: cephadm 2021-03-10T15:27:17.446219+0000 mgr.gibba043.dnkmem (mgr.34373) 5089 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:27:19.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[32348]: audit 2021-03-10T15:27:18.243200+0000 mgr.gibba043.dnkmem (mgr.34373) 5090 : audit [DBG] from='client.57460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:19.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:18 gibba003 bash[32348]: audit 2021-03-10T15:27:18.735633+0000 mon.a (mon.0) 1260 : audit [DBG] from='client.? 172.21.2.103:0/4217379169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:18 gibba043 bash[24019]: cluster 2021-03-10T15:27:17.334139+0000 mgr.gibba043.dnkmem (mgr.34373) 5088 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:18 gibba043 bash[24019]: cephadm 2021-03-10T15:27:17.446219+0000 mgr.gibba043.dnkmem (mgr.34373) 5089 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:27:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:18 gibba043 bash[24019]: audit 2021-03-10T15:27:18.243200+0000 mgr.gibba043.dnkmem (mgr.34373) 5090 : audit [DBG] from='client.57460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:18 gibba043 bash[24019]: audit 2021-03-10T15:27:18.735633+0000 mon.a (mon.0) 1260 : audit [DBG] from='client.? 172.21.2.103:0/4217379169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:19.873 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:19 gibba043 bash[24019]: audit 2021-03-10T15:27:18.466084+0000 mgr.gibba043.dnkmem (mgr.34373) 5091 : audit [DBG] from='client.47478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:19 gibba003 bash[31385]: audit 2021-03-10T15:27:18.466084+0000 mgr.gibba043.dnkmem (mgr.34373) 5091 : audit [DBG] from='client.47478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:20.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:19 gibba003 bash[32348]: audit 2021-03-10T15:27:18.466084+0000 mgr.gibba043.dnkmem (mgr.34373) 5091 : audit [DBG] from='client.47478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:21.185 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:20 gibba043 bash[24019]: cluster 2021-03-10T15:27:19.335694+0000 mgr.gibba043.dnkmem (mgr.34373) 5092 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:20 gibba003 bash[32348]: cluster 2021-03-10T15:27:19.335694+0000 mgr.gibba043.dnkmem (mgr.34373) 5092 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:21.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:20 gibba003 bash[31385]: cluster 2021-03-10T15:27:19.335694+0000 mgr.gibba043.dnkmem (mgr.34373) 5092 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:20.938915+0000 mgr.gibba043.dnkmem (mgr.34373) 5093 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:27:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:20.939200+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:27:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.162916+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:27:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.169416+0000 mgr.gibba043.dnkmem (mgr.34373) 5094 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.171410+0000 mgr.gibba043.dnkmem (mgr.34373) 5095 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:22.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.171587+0000 mon.c (mon.1) 1339 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:22.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.172952+0000 mgr.gibba043.dnkmem (mgr.34373) 5096 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:22.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.173051+0000 mgr.gibba043.dnkmem (mgr.34373) 5097 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:22.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.173221+0000 mon.c (mon.1) 1340 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.174658+0000 mgr.gibba043.dnkmem (mgr.34373) 5098 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:22.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.174784+0000 mgr.gibba043.dnkmem (mgr.34373) 5099 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:22.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.175064+0000 mon.c (mon.1) 1341 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.176461+0000 mgr.gibba043.dnkmem (mgr.34373) 5100 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:22.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.176653+0000 mon.c (mon.1) 1342 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.178658+0000 mgr.gibba043.dnkmem (mgr.34373) 5101 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:22.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.178778+0000 mgr.gibba043.dnkmem (mgr.34373) 5102 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:22.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.180448+0000 mgr.gibba043.dnkmem (mgr.34373) 5103 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:22.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.180785+0000 mon.c (mon.1) 1343 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.180904+0000 mgr.gibba043.dnkmem (mgr.34373) 5104 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:22.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.182216+0000 mgr.gibba043.dnkmem (mgr.34373) 5105 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:22.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.182302+0000 mgr.gibba043.dnkmem (mgr.34373) 5106 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:22.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: cephadm 2021-03-10T15:27:21.182439+0000 mgr.gibba043.dnkmem (mgr.34373) 5107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:22.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:21 gibba043 bash[24019]: audit 2021-03-10T15:27:21.182654+0000 mon.c (mon.1) 1344 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:20.938915+0000 mgr.gibba043.dnkmem (mgr.34373) 5093 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:27:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:20.939200+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:27:22.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.162916+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:27:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.169416+0000 mgr.gibba043.dnkmem (mgr.34373) 5094 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.171410+0000 mgr.gibba043.dnkmem (mgr.34373) 5095 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.171587+0000 mon.c (mon.1) 1339 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.172952+0000 mgr.gibba043.dnkmem (mgr.34373) 5096 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:22.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.173051+0000 mgr.gibba043.dnkmem (mgr.34373) 5097 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.173221+0000 mon.c (mon.1) 1340 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.174658+0000 mgr.gibba043.dnkmem (mgr.34373) 5098 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.174784+0000 mgr.gibba043.dnkmem (mgr.34373) 5099 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:22.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.175064+0000 mon.c (mon.1) 1341 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.176461+0000 mgr.gibba043.dnkmem (mgr.34373) 5100 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:22.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.176653+0000 mon.c (mon.1) 1342 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.178658+0000 mgr.gibba043.dnkmem (mgr.34373) 5101 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:22.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.178778+0000 mgr.gibba043.dnkmem (mgr.34373) 5102 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.180448+0000 mgr.gibba043.dnkmem (mgr.34373) 5103 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.180785+0000 mon.c (mon.1) 1343 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.180904+0000 mgr.gibba043.dnkmem (mgr.34373) 5104 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.182216+0000 mgr.gibba043.dnkmem (mgr.34373) 5105 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:22.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.182302+0000 mgr.gibba043.dnkmem (mgr.34373) 5106 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:22.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: cephadm 2021-03-10T15:27:21.182439+0000 mgr.gibba043.dnkmem (mgr.34373) 5107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:22.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[31385]: audit 2021-03-10T15:27:21.182654+0000 mon.c (mon.1) 1344 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:20.938915+0000 mgr.gibba043.dnkmem (mgr.34373) 5093 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:27:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:20.939200+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:27:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.162916+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:27:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.169416+0000 mgr.gibba043.dnkmem (mgr.34373) 5094 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.171410+0000 mgr.gibba043.dnkmem (mgr.34373) 5095 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:22.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.171587+0000 mon.c (mon.1) 1339 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:22.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.172952+0000 mgr.gibba043.dnkmem (mgr.34373) 5096 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:22.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.173051+0000 mgr.gibba043.dnkmem (mgr.34373) 5097 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:22.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.173221+0000 mon.c (mon.1) 1340 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.174658+0000 mgr.gibba043.dnkmem (mgr.34373) 5098 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:22.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.174784+0000 mgr.gibba043.dnkmem (mgr.34373) 5099 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:22.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.175064+0000 mon.c (mon.1) 1341 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.176461+0000 mgr.gibba043.dnkmem (mgr.34373) 5100 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:22.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.176653+0000 mon.c (mon.1) 1342 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.178658+0000 mgr.gibba043.dnkmem (mgr.34373) 5101 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:22.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.178778+0000 mgr.gibba043.dnkmem (mgr.34373) 5102 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:22.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.180448+0000 mgr.gibba043.dnkmem (mgr.34373) 5103 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:22.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.180785+0000 mon.c (mon.1) 1343 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:22.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.180904+0000 mgr.gibba043.dnkmem (mgr.34373) 5104 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:22.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.182216+0000 mgr.gibba043.dnkmem (mgr.34373) 5105 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:22.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.182302+0000 mgr.gibba043.dnkmem (mgr.34373) 5106 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:22.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: cephadm 2021-03-10T15:27:21.182439+0000 mgr.gibba043.dnkmem (mgr.34373) 5107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:22.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:21 gibba003 bash[32348]: audit 2021-03-10T15:27:21.182654+0000 mon.c (mon.1) 1344 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:23 gibba003 bash[31385]: cluster 2021-03-10T15:27:21.337280+0000 mgr.gibba043.dnkmem (mgr.34373) 5108 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:23 gibba003 bash[32348]: cluster 2021-03-10T15:27:21.337280+0000 mgr.gibba043.dnkmem (mgr.34373) 5108 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:23 gibba043 bash[24019]: cluster 2021-03-10T15:27:21.337280+0000 mgr.gibba043.dnkmem (mgr.34373) 5108 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:25 gibba003 bash[31385]: cluster 2021-03-10T15:27:23.338649+0000 mgr.gibba043.dnkmem (mgr.34373) 5109 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:25 gibba003 bash[32348]: cluster 2021-03-10T15:27:23.338649+0000 mgr.gibba043.dnkmem (mgr.34373) 5109 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:25 gibba043 bash[24019]: cluster 2021-03-10T15:27:23.338649+0000 mgr.gibba043.dnkmem (mgr.34373) 5109 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:27 gibba003 bash[31385]: cluster 2021-03-10T15:27:25.339930+0000 mgr.gibba043.dnkmem (mgr.34373) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:27 gibba003 bash[32348]: cluster 2021-03-10T15:27:25.339930+0000 mgr.gibba043.dnkmem (mgr.34373) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:27 gibba043 bash[24019]: cluster 2021-03-10T15:27:25.339930+0000 mgr.gibba043.dnkmem (mgr.34373) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:29 gibba043 bash[24019]: cluster 2021-03-10T15:27:27.341401+0000 mgr.gibba043.dnkmem (mgr.34373) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:29 gibba003 bash[31385]: cluster 2021-03-10T15:27:27.341401+0000 mgr.gibba043.dnkmem (mgr.34373) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:29 gibba003 bash[32348]: cluster 2021-03-10T15:27:27.341401+0000 mgr.gibba043.dnkmem (mgr.34373) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:31 gibba043 bash[24019]: cluster 2021-03-10T15:27:29.343021+0000 mgr.gibba043.dnkmem (mgr.34373) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:31 gibba003 bash[31385]: cluster 2021-03-10T15:27:29.343021+0000 mgr.gibba043.dnkmem (mgr.34373) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:31 gibba003 bash[32348]: cluster 2021-03-10T15:27:29.343021+0000 mgr.gibba043.dnkmem (mgr.34373) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:33 gibba043 bash[24019]: cluster 2021-03-10T15:27:31.344527+0000 mgr.gibba043.dnkmem (mgr.34373) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:33 gibba003 bash[31385]: cluster 2021-03-10T15:27:31.344527+0000 mgr.gibba043.dnkmem (mgr.34373) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:33 gibba003 bash[32348]: cluster 2021-03-10T15:27:31.344527+0000 mgr.gibba043.dnkmem (mgr.34373) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:35 gibba043 bash[24019]: cluster 2021-03-10T15:27:33.345916+0000 mgr.gibba043.dnkmem (mgr.34373) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:35 gibba003 bash[31385]: cluster 2021-03-10T15:27:33.345916+0000 mgr.gibba043.dnkmem (mgr.34373) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:35 gibba003 bash[32348]: cluster 2021-03-10T15:27:33.345916+0000 mgr.gibba043.dnkmem (mgr.34373) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:37 gibba043 bash[24019]: cluster 2021-03-10T15:27:35.347308+0000 mgr.gibba043.dnkmem (mgr.34373) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:37 gibba043 bash[24019]: cephadm 2021-03-10T15:27:36.198521+0000 mgr.gibba043.dnkmem (mgr.34373) 5116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:37 gibba003 bash[31385]: cluster 2021-03-10T15:27:35.347308+0000 mgr.gibba043.dnkmem (mgr.34373) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:37 gibba003 bash[31385]: cephadm 2021-03-10T15:27:36.198521+0000 mgr.gibba043.dnkmem (mgr.34373) 5116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:37 gibba003 bash[32348]: cluster 2021-03-10T15:27:35.347308+0000 mgr.gibba043.dnkmem (mgr.34373) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:37 gibba003 bash[32348]: cephadm 2021-03-10T15:27:36.198521+0000 mgr.gibba043.dnkmem (mgr.34373) 5116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:39 gibba043 bash[24019]: cluster 2021-03-10T15:27:37.348884+0000 mgr.gibba043.dnkmem (mgr.34373) 5117 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:39 gibba003 bash[31385]: cluster 2021-03-10T15:27:37.348884+0000 mgr.gibba043.dnkmem (mgr.34373) 5117 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:39 gibba003 bash[32348]: cluster 2021-03-10T15:27:37.348884+0000 mgr.gibba043.dnkmem (mgr.34373) 5117 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:41 gibba043 bash[24019]: cluster 2021-03-10T15:27:39.350360+0000 mgr.gibba043.dnkmem (mgr.34373) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:41 gibba003 bash[31385]: cluster 2021-03-10T15:27:39.350360+0000 mgr.gibba043.dnkmem (mgr.34373) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:41 gibba003 bash[32348]: cluster 2021-03-10T15:27:39.350360+0000 mgr.gibba043.dnkmem (mgr.34373) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:43 gibba043 bash[24019]: cluster 2021-03-10T15:27:41.352215+0000 mgr.gibba043.dnkmem (mgr.34373) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:43 gibba003 bash[31385]: cluster 2021-03-10T15:27:41.352215+0000 mgr.gibba043.dnkmem (mgr.34373) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:43 gibba003 bash[32348]: cluster 2021-03-10T15:27:41.352215+0000 mgr.gibba043.dnkmem (mgr.34373) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:45 gibba043 bash[24019]: cluster 2021-03-10T15:27:43.353479+0000 mgr.gibba043.dnkmem (mgr.34373) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:45 gibba003 bash[31385]: cluster 2021-03-10T15:27:43.353479+0000 mgr.gibba043.dnkmem (mgr.34373) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:45 gibba003 bash[32348]: cluster 2021-03-10T15:27:43.353479+0000 mgr.gibba043.dnkmem (mgr.34373) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:46.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:46 gibba003 bash[31385]: cluster 2021-03-10T15:27:45.354968+0000 mgr.gibba043.dnkmem (mgr.34373) 5121 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:46 gibba003 bash[32348]: cluster 2021-03-10T15:27:45.354968+0000 mgr.gibba043.dnkmem (mgr.34373) 5121 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:46 gibba043 bash[24019]: cluster 2021-03-10T15:27:45.354968+0000 mgr.gibba043.dnkmem (mgr.34373) 5121 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:48.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:48 gibba003 bash[31385]: cluster 2021-03-10T15:27:47.356521+0000 mgr.gibba043.dnkmem (mgr.34373) 5122 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:48.902 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:48 gibba003 bash[32348]: cluster 2021-03-10T15:27:47.356521+0000 mgr.gibba043.dnkmem (mgr.34373) 5122 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:48.903 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:48 gibba043 bash[24019]: cluster 2021-03-10T15:27:47.356521+0000 mgr.gibba043.dnkmem (mgr.34373) 5122 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:48.980 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:27:49.207 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:27:49.207 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (96m) 28s ago 101m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:27:49.207 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (101m) 9m ago 101m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:27:49.208 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:27:49.208 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (96m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:27:49.208 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (95m) 28s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:27:49.208 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (95m) 28s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:27:49.208 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (95m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:27:49.209 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (95m) 28s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:27:49.209 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (101m) 28s ago 101m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:27:49.209 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (101m) 9m ago 101m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:27:49.209 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (94m) 28s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:27:49.210 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (94m) 28s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:27:49.210 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (93m) 28s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:27:49.210 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (93m) 28s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:27:49.210 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:27:49.211 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:27:49.211 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:27:49.211 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:27:49.211 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (101m) 9m ago 101m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:27:49.212 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 28s ago 99m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:27:49.459 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:27:49.459 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:27:49.460 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:49.460 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:27:49.460 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:27:49.460 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:49.461 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:27:49.461 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:27:49.461 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:27:49.461 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:27:49.461 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:27:49.462 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:27:49.462 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:27:49.462 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:27:49.462 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:27:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:49 gibba003 bash[31385]: audit 2021-03-10T15:27:48.968090+0000 mgr.gibba043.dnkmem (mgr.34373) 5123 : audit [DBG] from='client.47490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:49 gibba003 bash[31385]: audit 2021-03-10T15:27:49.191440+0000 mgr.gibba043.dnkmem (mgr.34373) 5124 : audit [DBG] from='client.57484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:49.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:49 gibba003 bash[32348]: audit 2021-03-10T15:27:48.968090+0000 mgr.gibba043.dnkmem (mgr.34373) 5123 : audit [DBG] from='client.47490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:49.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:49 gibba003 bash[32348]: audit 2021-03-10T15:27:49.191440+0000 mgr.gibba043.dnkmem (mgr.34373) 5124 : audit [DBG] from='client.57484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:49 gibba043 bash[24019]: audit 2021-03-10T15:27:48.968090+0000 mgr.gibba043.dnkmem (mgr.34373) 5123 : audit [DBG] from='client.47490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:49.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:49 gibba043 bash[24019]: audit 2021-03-10T15:27:49.191440+0000 mgr.gibba043.dnkmem (mgr.34373) 5124 : audit [DBG] from='client.57484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:50.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:50 gibba003 bash[31385]: cluster 2021-03-10T15:27:49.358029+0000 mgr.gibba043.dnkmem (mgr.34373) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:50.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:50 gibba003 bash[31385]: audit 2021-03-10T15:27:49.457335+0000 mon.a (mon.0) 1263 : audit [DBG] from='client.? 172.21.2.103:0/732134660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:50.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:50 gibba003 bash[32348]: cluster 2021-03-10T15:27:49.358029+0000 mgr.gibba043.dnkmem (mgr.34373) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:50.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:50 gibba003 bash[32348]: audit 2021-03-10T15:27:49.457335+0000 mon.a (mon.0) 1263 : audit [DBG] from='client.? 172.21.2.103:0/732134660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:50.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:50 gibba043 bash[24019]: cluster 2021-03-10T15:27:49.358029+0000 mgr.gibba043.dnkmem (mgr.34373) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:50.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:50 gibba043 bash[24019]: audit 2021-03-10T15:27:49.457335+0000 mon.a (mon.0) 1263 : audit [DBG] from='client.? 172.21.2.103:0/732134660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:51 gibba043 bash[24019]: cephadm 2021-03-10T15:27:51.199372+0000 mgr.gibba043.dnkmem (mgr.34373) 5126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:51 gibba003 bash[31385]: cephadm 2021-03-10T15:27:51.199372+0000 mgr.gibba043.dnkmem (mgr.34373) 5126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:51.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:51 gibba003 bash[32348]: cephadm 2021-03-10T15:27:51.199372+0000 mgr.gibba043.dnkmem (mgr.34373) 5126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:27:52.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:52 gibba043 bash[24019]: cluster 2021-03-10T15:27:51.359617+0000 mgr.gibba043.dnkmem (mgr.34373) 5127 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:52 gibba003 bash[31385]: cluster 2021-03-10T15:27:51.359617+0000 mgr.gibba043.dnkmem (mgr.34373) 5127 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:52 gibba003 bash[32348]: cluster 2021-03-10T15:27:51.359617+0000 mgr.gibba043.dnkmem (mgr.34373) 5127 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:54 gibba043 bash[24019]: cluster 2021-03-10T15:27:53.361232+0000 mgr.gibba043.dnkmem (mgr.34373) 5128 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:54 gibba003 bash[31385]: cluster 2021-03-10T15:27:53.361232+0000 mgr.gibba043.dnkmem (mgr.34373) 5128 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:54 gibba003 bash[32348]: cluster 2021-03-10T15:27:53.361232+0000 mgr.gibba043.dnkmem (mgr.34373) 5128 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:56 gibba043 bash[24019]: cluster 2021-03-10T15:27:55.362631+0000 mgr.gibba043.dnkmem (mgr.34373) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:56 gibba003 bash[31385]: cluster 2021-03-10T15:27:55.362631+0000 mgr.gibba043.dnkmem (mgr.34373) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:56 gibba003 bash[32348]: cluster 2021-03-10T15:27:55.362631+0000 mgr.gibba043.dnkmem (mgr.34373) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:58.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:27:58 gibba043 bash[24019]: cluster 2021-03-10T15:27:57.364350+0000 mgr.gibba043.dnkmem (mgr.34373) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:27:58 gibba003 bash[31385]: cluster 2021-03-10T15:27:57.364350+0000 mgr.gibba043.dnkmem (mgr.34373) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:27:58 gibba003 bash[32348]: cluster 2021-03-10T15:27:57.364350+0000 mgr.gibba043.dnkmem (mgr.34373) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:00.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:00 gibba043 bash[24019]: cluster 2021-03-10T15:27:59.365834+0000 mgr.gibba043.dnkmem (mgr.34373) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:00 gibba003 bash[31385]: cluster 2021-03-10T15:27:59.365834+0000 mgr.gibba043.dnkmem (mgr.34373) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:00.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:00 gibba003 bash[32348]: cluster 2021-03-10T15:27:59.365834+0000 mgr.gibba043.dnkmem (mgr.34373) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:02.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:02 gibba043 bash[24019]: cluster 2021-03-10T15:28:01.367638+0000 mgr.gibba043.dnkmem (mgr.34373) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:02 gibba003 bash[31385]: cluster 2021-03-10T15:28:01.367638+0000 mgr.gibba043.dnkmem (mgr.34373) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:02.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:02 gibba003 bash[32348]: cluster 2021-03-10T15:28:01.367638+0000 mgr.gibba043.dnkmem (mgr.34373) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:04.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:04 gibba043 bash[24019]: cluster 2021-03-10T15:28:03.369150+0000 mgr.gibba043.dnkmem (mgr.34373) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:04.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:04 gibba003 bash[31385]: cluster 2021-03-10T15:28:03.369150+0000 mgr.gibba043.dnkmem (mgr.34373) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:04 gibba003 bash[32348]: cluster 2021-03-10T15:28:03.369150+0000 mgr.gibba043.dnkmem (mgr.34373) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:06.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:06 gibba043 bash[24019]: cluster 2021-03-10T15:28:05.370789+0000 mgr.gibba043.dnkmem (mgr.34373) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:06.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:06 gibba043 bash[24019]: cephadm 2021-03-10T15:28:06.215119+0000 mgr.gibba043.dnkmem (mgr.34373) 5135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:06 gibba003 bash[31385]: cluster 2021-03-10T15:28:05.370789+0000 mgr.gibba043.dnkmem (mgr.34373) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:06 gibba003 bash[31385]: cephadm 2021-03-10T15:28:06.215119+0000 mgr.gibba043.dnkmem (mgr.34373) 5135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:06.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:06 gibba003 bash[32348]: cluster 2021-03-10T15:28:05.370789+0000 mgr.gibba043.dnkmem (mgr.34373) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:06.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:06 gibba003 bash[32348]: cephadm 2021-03-10T15:28:06.215119+0000 mgr.gibba043.dnkmem (mgr.34373) 5135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:08 gibba003 bash[31385]: cluster 2021-03-10T15:28:07.372404+0000 mgr.gibba043.dnkmem (mgr.34373) 5136 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:08.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:08 gibba003 bash[32348]: cluster 2021-03-10T15:28:07.372404+0000 mgr.gibba043.dnkmem (mgr.34373) 5136 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:08 gibba043 bash[24019]: cluster 2021-03-10T15:28:07.372404+0000 mgr.gibba043.dnkmem (mgr.34373) 5136 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:10 gibba003 bash[31385]: cluster 2021-03-10T15:28:09.374083+0000 mgr.gibba043.dnkmem (mgr.34373) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:10.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:10 gibba003 bash[32348]: cluster 2021-03-10T15:28:09.374083+0000 mgr.gibba043.dnkmem (mgr.34373) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:10 gibba043 bash[24019]: cluster 2021-03-10T15:28:09.374083+0000 mgr.gibba043.dnkmem (mgr.34373) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:12 gibba003 bash[31385]: cluster 2021-03-10T15:28:11.375781+0000 mgr.gibba043.dnkmem (mgr.34373) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:12.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:12 gibba003 bash[32348]: cluster 2021-03-10T15:28:11.375781+0000 mgr.gibba043.dnkmem (mgr.34373) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:12 gibba043 bash[24019]: cluster 2021-03-10T15:28:11.375781+0000 mgr.gibba043.dnkmem (mgr.34373) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.331885+0000 mon.c (mon.1) 1345 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.333028+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.448482+0000 mon.c (mon.1) 1346 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.449541+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.524615+0000 mon.c (mon.1) 1347 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:28:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.525343+0000 mon.c (mon.1) 1348 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.525998+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:28:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.526007+0000 mon.c (mon.1) 1349 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.526664+0000 mon.c (mon.1) 1350 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.528292+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.529095+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[31385]: audit 2021-03-10T15:28:13.530009+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.331885+0000 mon.c (mon.1) 1345 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.333028+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.448482+0000 mon.c (mon.1) 1346 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.449541+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.524615+0000 mon.c (mon.1) 1347 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:28:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.525343+0000 mon.c (mon.1) 1348 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.525998+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:28:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.526007+0000 mon.c (mon.1) 1349 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.526664+0000 mon.c (mon.1) 1350 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.528292+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.529095+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:28:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:13 gibba003 bash[32348]: audit 2021-03-10T15:28:13.530009+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.331885+0000 mon.c (mon.1) 1345 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.333028+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.448482+0000 mon.c (mon.1) 1346 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.449541+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.524615+0000 mon.c (mon.1) 1347 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:28:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.525343+0000 mon.c (mon.1) 1348 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.525998+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:28:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.526007+0000 mon.c (mon.1) 1349 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:28:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.526664+0000 mon.c (mon.1) 1350 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.528292+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:14.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.529095+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:28:14.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:13 gibba043 bash[24019]: audit 2021-03-10T15:28:13.530009+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:14 gibba003 bash[31385]: cluster 2021-03-10T15:28:13.377136+0000 mgr.gibba043.dnkmem (mgr.34373) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:14 gibba003 bash[32348]: cluster 2021-03-10T15:28:13.377136+0000 mgr.gibba043.dnkmem (mgr.34373) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:14 gibba043 bash[24019]: cluster 2021-03-10T15:28:13.377136+0000 mgr.gibba043.dnkmem (mgr.34373) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:16.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:16 gibba003 bash[31385]: cluster 2021-03-10T15:28:15.378690+0000 mgr.gibba043.dnkmem (mgr.34373) 5140 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:16.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:16 gibba003 bash[32348]: cluster 2021-03-10T15:28:15.378690+0000 mgr.gibba043.dnkmem (mgr.34373) 5140 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:16 gibba043 bash[24019]: cluster 2021-03-10T15:28:15.378690+0000 mgr.gibba043.dnkmem (mgr.34373) 5140 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:18.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:18 gibba003 bash[31385]: cluster 2021-03-10T15:28:17.380260+0000 mgr.gibba043.dnkmem (mgr.34373) 5141 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:18.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:18 gibba003 bash[32348]: cluster 2021-03-10T15:28:17.380260+0000 mgr.gibba043.dnkmem (mgr.34373) 5141 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:18 gibba043 bash[24019]: cluster 2021-03-10T15:28:17.380260+0000 mgr.gibba043.dnkmem (mgr.34373) 5141 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.708 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:28:19.937 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:28:19.937 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (96m) 58s ago 102m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:28:19.938 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (101m) 10m ago 101m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:28:19.938 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (97m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:28:19.938 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (97m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:28:19.938 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (96m) 58s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:28:19.939 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (96m) 58s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:28:19.939 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (95m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:28:19.939 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (95m) 58s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:28:19.939 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (102m) 58s ago 102m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:28:19.940 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (102m) 10m ago 102m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:28:19.940 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (95m) 58s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:28:19.940 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (94m) 58s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:28:19.940 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (94m) 58s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:28:19.940 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (93m) 58s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:28:19.941 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:28:19.941 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (92m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:28:19.941 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (92m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:28:19.941 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (91m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:28:19.941 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (101m) 10m ago 102m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:28:19.942 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 58s ago 100m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:28:20.184 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:28:20.185 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:28:20.185 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:20.185 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:28:20.185 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:28:20.186 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:20.186 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:28:20.186 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:28:20.186 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:28:20.186 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:28:20.187 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:28:20.187 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:28:20.187 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:28:20.187 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:28:20.187 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:28:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[31385]: cluster 2021-03-10T15:28:19.382045+0000 mgr.gibba043.dnkmem (mgr.34373) 5142 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[31385]: audit 2021-03-10T15:28:19.695991+0000 mgr.gibba043.dnkmem (mgr.34373) 5143 : audit [DBG] from='client.57496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[31385]: audit 2021-03-10T15:28:19.920029+0000 mgr.gibba043.dnkmem (mgr.34373) 5144 : audit [DBG] from='client.57502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:20.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[31385]: audit 2021-03-10T15:28:20.182728+0000 mon.c (mon.1) 1351 : audit [DBG] from='client.? 172.21.2.103:0/4044419903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:20.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[32348]: cluster 2021-03-10T15:28:19.382045+0000 mgr.gibba043.dnkmem (mgr.34373) 5142 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:20.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[32348]: audit 2021-03-10T15:28:19.695991+0000 mgr.gibba043.dnkmem (mgr.34373) 5143 : audit [DBG] from='client.57496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:20.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[32348]: audit 2021-03-10T15:28:19.920029+0000 mgr.gibba043.dnkmem (mgr.34373) 5144 : audit [DBG] from='client.57502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:20.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:20 gibba003 bash[32348]: audit 2021-03-10T15:28:20.182728+0000 mon.c (mon.1) 1351 : audit [DBG] from='client.? 172.21.2.103:0/4044419903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:21.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:20 gibba043 bash[24019]: cluster 2021-03-10T15:28:19.382045+0000 mgr.gibba043.dnkmem (mgr.34373) 5142 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:20 gibba043 bash[24019]: audit 2021-03-10T15:28:19.695991+0000 mgr.gibba043.dnkmem (mgr.34373) 5143 : audit [DBG] from='client.57496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:21.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:20 gibba043 bash[24019]: audit 2021-03-10T15:28:19.920029+0000 mgr.gibba043.dnkmem (mgr.34373) 5144 : audit [DBG] from='client.57502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:21.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:20 gibba043 bash[24019]: audit 2021-03-10T15:28:20.182728+0000 mon.c (mon.1) 1351 : audit [DBG] from='client.? 172.21.2.103:0/4044419903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:21 gibba003 bash[31385]: cephadm 2021-03-10T15:28:21.231973+0000 mgr.gibba043.dnkmem (mgr.34373) 5145 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:28:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:21 gibba003 bash[31385]: audit 2021-03-10T15:28:21.235642+0000 mon.c (mon.1) 1352 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:28:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:21 gibba003 bash[32348]: cephadm 2021-03-10T15:28:21.231973+0000 mgr.gibba043.dnkmem (mgr.34373) 5145 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:28:21.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:21 gibba003 bash[32348]: audit 2021-03-10T15:28:21.235642+0000 mon.c (mon.1) 1352 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:28:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:21 gibba043 bash[24019]: cephadm 2021-03-10T15:28:21.231973+0000 mgr.gibba043.dnkmem (mgr.34373) 5145 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:28:22.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:21 gibba043 bash[24019]: audit 2021-03-10T15:28:21.235642+0000 mon.c (mon.1) 1352 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:28:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:22 gibba003 bash[31385]: cluster 2021-03-10T15:28:21.382584+0000 mgr.gibba043.dnkmem (mgr.34373) 5146 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:22 gibba003 bash[32348]: cluster 2021-03-10T15:28:21.382584+0000 mgr.gibba043.dnkmem (mgr.34373) 5146 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:22 gibba043 bash[24019]: cluster 2021-03-10T15:28:21.382584+0000 mgr.gibba043.dnkmem (mgr.34373) 5146 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:24 gibba003 bash[31385]: cluster 2021-03-10T15:28:23.384100+0000 mgr.gibba043.dnkmem (mgr.34373) 5147 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.048 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:24 gibba003 bash[32348]: cluster 2021-03-10T15:28:23.384100+0000 mgr.gibba043.dnkmem (mgr.34373) 5147 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.049 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:24 gibba043 bash[24019]: cluster 2021-03-10T15:28:23.384100+0000 mgr.gibba043.dnkmem (mgr.34373) 5147 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:26.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:24.950239+0000 mgr.gibba043.dnkmem (mgr.34373) 5148 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:28:26.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:24.950587+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:28:26.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.189133+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:28:26.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.190366+0000 mgr.gibba043.dnkmem (mgr.34373) 5149 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:26.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.192260+0000 mgr.gibba043.dnkmem (mgr.34373) 5150 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:26.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.192674+0000 mon.c (mon.1) 1353 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:26.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.193859+0000 mgr.gibba043.dnkmem (mgr.34373) 5151 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:26.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.193906+0000 mgr.gibba043.dnkmem (mgr.34373) 5152 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:26.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.194441+0000 mon.c (mon.1) 1354 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.195189+0000 mgr.gibba043.dnkmem (mgr.34373) 5153 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:26.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.195236+0000 mgr.gibba043.dnkmem (mgr.34373) 5154 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:26.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.195821+0000 mon.c (mon.1) 1355 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.196839+0000 mgr.gibba043.dnkmem (mgr.34373) 5155 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:26.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.197115+0000 mon.c (mon.1) 1356 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.198451+0000 mgr.gibba043.dnkmem (mgr.34373) 5156 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:26.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.198496+0000 mgr.gibba043.dnkmem (mgr.34373) 5157 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:26.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.200147+0000 mgr.gibba043.dnkmem (mgr.34373) 5158 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:26.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.200403+0000 mon.c (mon.1) 1357 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.200471+0000 mgr.gibba043.dnkmem (mgr.34373) 5159 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:26.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.201770+0000 mgr.gibba043.dnkmem (mgr.34373) 5160 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:26.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.201816+0000 mgr.gibba043.dnkmem (mgr.34373) 5161 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:26.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: cephadm 2021-03-10T15:28:25.201932+0000 mgr.gibba043.dnkmem (mgr.34373) 5162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:26.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:25 gibba043 bash[24019]: audit 2021-03-10T15:28:25.202305+0000 mon.c (mon.1) 1358 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:24.950239+0000 mgr.gibba043.dnkmem (mgr.34373) 5148 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:28:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:24.950587+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:28:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.189133+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:28:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.190366+0000 mgr.gibba043.dnkmem (mgr.34373) 5149 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.192260+0000 mgr.gibba043.dnkmem (mgr.34373) 5150 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.192674+0000 mon.c (mon.1) 1353 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.193859+0000 mgr.gibba043.dnkmem (mgr.34373) 5151 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.193906+0000 mgr.gibba043.dnkmem (mgr.34373) 5152 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.194441+0000 mon.c (mon.1) 1354 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.195189+0000 mgr.gibba043.dnkmem (mgr.34373) 5153 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:26.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.195236+0000 mgr.gibba043.dnkmem (mgr.34373) 5154 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.195821+0000 mon.c (mon.1) 1355 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.196839+0000 mgr.gibba043.dnkmem (mgr.34373) 5155 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.197115+0000 mon.c (mon.1) 1356 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.198451+0000 mgr.gibba043.dnkmem (mgr.34373) 5156 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:26.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.198496+0000 mgr.gibba043.dnkmem (mgr.34373) 5157 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.200147+0000 mgr.gibba043.dnkmem (mgr.34373) 5158 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.200403+0000 mon.c (mon.1) 1357 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.200471+0000 mgr.gibba043.dnkmem (mgr.34373) 5159 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:26.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.201770+0000 mgr.gibba043.dnkmem (mgr.34373) 5160 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:26.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.201816+0000 mgr.gibba043.dnkmem (mgr.34373) 5161 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:26.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: cephadm 2021-03-10T15:28:25.201932+0000 mgr.gibba043.dnkmem (mgr.34373) 5162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:26.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[32348]: audit 2021-03-10T15:28:25.202305+0000 mon.c (mon.1) 1358 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:24.950239+0000 mgr.gibba043.dnkmem (mgr.34373) 5148 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:28:26.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:24.950587+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:28:26.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.189133+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:28:26.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.190366+0000 mgr.gibba043.dnkmem (mgr.34373) 5149 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:26.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.192260+0000 mgr.gibba043.dnkmem (mgr.34373) 5150 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:26.450 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.192674+0000 mon.c (mon.1) 1353 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:26.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.193859+0000 mgr.gibba043.dnkmem (mgr.34373) 5151 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:26.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.193906+0000 mgr.gibba043.dnkmem (mgr.34373) 5152 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:26.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.194441+0000 mon.c (mon.1) 1354 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.195189+0000 mgr.gibba043.dnkmem (mgr.34373) 5153 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:26.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.195236+0000 mgr.gibba043.dnkmem (mgr.34373) 5154 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:26.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.195821+0000 mon.c (mon.1) 1355 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.196839+0000 mgr.gibba043.dnkmem (mgr.34373) 5155 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:26.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.197115+0000 mon.c (mon.1) 1356 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.198451+0000 mgr.gibba043.dnkmem (mgr.34373) 5156 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:26.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.198496+0000 mgr.gibba043.dnkmem (mgr.34373) 5157 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:26.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.200147+0000 mgr.gibba043.dnkmem (mgr.34373) 5158 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:26.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.200403+0000 mon.c (mon.1) 1357 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:26.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.200471+0000 mgr.gibba043.dnkmem (mgr.34373) 5159 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:26.453 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.201770+0000 mgr.gibba043.dnkmem (mgr.34373) 5160 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:26.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.201816+0000 mgr.gibba043.dnkmem (mgr.34373) 5161 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:26.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: cephadm 2021-03-10T15:28:25.201932+0000 mgr.gibba043.dnkmem (mgr.34373) 5162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:26.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:25 gibba003 bash[31385]: audit 2021-03-10T15:28:25.202305+0000 mon.c (mon.1) 1358 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:27 gibba043 bash[24019]: cluster 2021-03-10T15:28:25.385464+0000 mgr.gibba043.dnkmem (mgr.34373) 5163 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:27 gibba003 bash[31385]: cluster 2021-03-10T15:28:25.385464+0000 mgr.gibba043.dnkmem (mgr.34373) 5163 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:27 gibba003 bash[32348]: cluster 2021-03-10T15:28:25.385464+0000 mgr.gibba043.dnkmem (mgr.34373) 5163 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:29 gibba043 bash[24019]: cluster 2021-03-10T15:28:27.386831+0000 mgr.gibba043.dnkmem (mgr.34373) 5164 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:29 gibba003 bash[31385]: cluster 2021-03-10T15:28:27.386831+0000 mgr.gibba043.dnkmem (mgr.34373) 5164 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:29 gibba003 bash[32348]: cluster 2021-03-10T15:28:27.386831+0000 mgr.gibba043.dnkmem (mgr.34373) 5164 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:31 gibba043 bash[24019]: cluster 2021-03-10T15:28:29.388616+0000 mgr.gibba043.dnkmem (mgr.34373) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:31 gibba003 bash[31385]: cluster 2021-03-10T15:28:29.388616+0000 mgr.gibba043.dnkmem (mgr.34373) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:31 gibba003 bash[32348]: cluster 2021-03-10T15:28:29.388616+0000 mgr.gibba043.dnkmem (mgr.34373) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:33 gibba043 bash[24019]: cluster 2021-03-10T15:28:31.390428+0000 mgr.gibba043.dnkmem (mgr.34373) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:33 gibba003 bash[31385]: cluster 2021-03-10T15:28:31.390428+0000 mgr.gibba043.dnkmem (mgr.34373) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:33 gibba003 bash[32348]: cluster 2021-03-10T15:28:31.390428+0000 mgr.gibba043.dnkmem (mgr.34373) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:35 gibba043 bash[24019]: cluster 2021-03-10T15:28:33.392053+0000 mgr.gibba043.dnkmem (mgr.34373) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:35 gibba003 bash[31385]: cluster 2021-03-10T15:28:33.392053+0000 mgr.gibba043.dnkmem (mgr.34373) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:35 gibba003 bash[32348]: cluster 2021-03-10T15:28:33.392053+0000 mgr.gibba043.dnkmem (mgr.34373) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:37 gibba043 bash[24019]: cluster 2021-03-10T15:28:35.393424+0000 mgr.gibba043.dnkmem (mgr.34373) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:37 gibba003 bash[31385]: cluster 2021-03-10T15:28:35.393424+0000 mgr.gibba043.dnkmem (mgr.34373) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:37 gibba003 bash[32348]: cluster 2021-03-10T15:28:35.393424+0000 mgr.gibba043.dnkmem (mgr.34373) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:39 gibba043 bash[24019]: cluster 2021-03-10T15:28:37.395071+0000 mgr.gibba043.dnkmem (mgr.34373) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:39 gibba003 bash[31385]: cluster 2021-03-10T15:28:37.395071+0000 mgr.gibba043.dnkmem (mgr.34373) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:39 gibba003 bash[32348]: cluster 2021-03-10T15:28:37.395071+0000 mgr.gibba043.dnkmem (mgr.34373) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:41 gibba043 bash[24019]: cluster 2021-03-10T15:28:39.396837+0000 mgr.gibba043.dnkmem (mgr.34373) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:41 gibba043 bash[24019]: cephadm 2021-03-10T15:28:40.216485+0000 mgr.gibba043.dnkmem (mgr.34373) 5171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:41.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:41 gibba003 bash[31385]: cluster 2021-03-10T15:28:39.396837+0000 mgr.gibba043.dnkmem (mgr.34373) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:41 gibba003 bash[31385]: cephadm 2021-03-10T15:28:40.216485+0000 mgr.gibba043.dnkmem (mgr.34373) 5171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:41 gibba003 bash[32348]: cluster 2021-03-10T15:28:39.396837+0000 mgr.gibba043.dnkmem (mgr.34373) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:41 gibba003 bash[32348]: cephadm 2021-03-10T15:28:40.216485+0000 mgr.gibba043.dnkmem (mgr.34373) 5171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:43 gibba043 bash[24019]: cluster 2021-03-10T15:28:41.398588+0000 mgr.gibba043.dnkmem (mgr.34373) 5172 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:43 gibba003 bash[31385]: cluster 2021-03-10T15:28:41.398588+0000 mgr.gibba043.dnkmem (mgr.34373) 5172 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:43 gibba003 bash[32348]: cluster 2021-03-10T15:28:41.398588+0000 mgr.gibba043.dnkmem (mgr.34373) 5172 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:45 gibba043 bash[24019]: cluster 2021-03-10T15:28:43.400121+0000 mgr.gibba043.dnkmem (mgr.34373) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:45.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:45 gibba003 bash[31385]: cluster 2021-03-10T15:28:43.400121+0000 mgr.gibba043.dnkmem (mgr.34373) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:45 gibba003 bash[32348]: cluster 2021-03-10T15:28:43.400121+0000 mgr.gibba043.dnkmem (mgr.34373) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:47.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:47 gibba003 bash[31385]: cluster 2021-03-10T15:28:45.401384+0000 mgr.gibba043.dnkmem (mgr.34373) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:47 gibba003 bash[32348]: cluster 2021-03-10T15:28:45.401384+0000 mgr.gibba043.dnkmem (mgr.34373) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:47 gibba043 bash[24019]: cluster 2021-03-10T15:28:45.401384+0000 mgr.gibba043.dnkmem (mgr.34373) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:49 gibba003 bash[31385]: cluster 2021-03-10T15:28:47.403077+0000 mgr.gibba043.dnkmem (mgr.34373) 5175 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:49 gibba003 bash[32348]: cluster 2021-03-10T15:28:47.403077+0000 mgr.gibba043.dnkmem (mgr.34373) 5175 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:49 gibba043 bash[24019]: cluster 2021-03-10T15:28:47.403077+0000 mgr.gibba043.dnkmem (mgr.34373) 5175 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:50.432 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:28:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:28:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (97m) 89s ago 102m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:28:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (102m) 25s ago 102m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:28:50.689 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (97m) 25s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:28:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (97m) 25s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:28:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (96m) 89s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:28:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (96m) 89s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:28:50.690 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (96m) 25s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:28:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (96m) 89s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:28:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (102m) 89s ago 102m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:28:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (102m) 25s ago 102m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:28:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (95m) 89s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:28:50.691 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (95m) 89s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:28:50.692 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (94m) 89s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:28:50.692 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (94m) 89s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:28:50.692 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (93m) 25s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:28:50.692 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (93m) 25s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:28:50.693 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (92m) 25s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:28:50.693 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (92m) 25s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:28:50.693 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (102m) 25s ago 102m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:28:50.693 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 89s ago 100m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:28:50.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:50 gibba043 bash[24019]: cluster 2021-03-10T15:28:49.404864+0000 mgr.gibba043.dnkmem (mgr.34373) 5176 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:50.939 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:28:50.939 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:28:50.939 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:50.940 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:28:50.940 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:28:50.940 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:50.940 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:28:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:28:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:28:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:28:50.941 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:28:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:28:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:28:50.942 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:28:50.942 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:28:50.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:50 gibba003 bash[31385]: cluster 2021-03-10T15:28:49.404864+0000 mgr.gibba043.dnkmem (mgr.34373) 5176 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:50.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:50 gibba003 bash[32348]: cluster 2021-03-10T15:28:49.404864+0000 mgr.gibba043.dnkmem (mgr.34373) 5176 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:51 gibba043 bash[24019]: audit 2021-03-10T15:28:50.419598+0000 mgr.gibba043.dnkmem (mgr.34373) 5177 : audit [DBG] from='client.57514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:51 gibba043 bash[24019]: audit 2021-03-10T15:28:50.646126+0000 mgr.gibba043.dnkmem (mgr.34373) 5178 : audit [DBG] from='client.57520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:51 gibba043 bash[24019]: audit 2021-03-10T15:28:50.937169+0000 mon.c (mon.1) 1359 : audit [DBG] from='client.? 172.21.2.103:0/4040743128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:51 gibba003 bash[31385]: audit 2021-03-10T15:28:50.419598+0000 mgr.gibba043.dnkmem (mgr.34373) 5177 : audit [DBG] from='client.57514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:51 gibba003 bash[31385]: audit 2021-03-10T15:28:50.646126+0000 mgr.gibba043.dnkmem (mgr.34373) 5178 : audit [DBG] from='client.57520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:51.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:51 gibba003 bash[31385]: audit 2021-03-10T15:28:50.937169+0000 mon.c (mon.1) 1359 : audit [DBG] from='client.? 172.21.2.103:0/4040743128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:51.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:51 gibba003 bash[32348]: audit 2021-03-10T15:28:50.419598+0000 mgr.gibba043.dnkmem (mgr.34373) 5177 : audit [DBG] from='client.57514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:51.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:51 gibba003 bash[32348]: audit 2021-03-10T15:28:50.646126+0000 mgr.gibba043.dnkmem (mgr.34373) 5178 : audit [DBG] from='client.57520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:51.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:51 gibba003 bash[32348]: audit 2021-03-10T15:28:50.937169+0000 mon.c (mon.1) 1359 : audit [DBG] from='client.? 172.21.2.103:0/4040743128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:52.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:52 gibba043 bash[24019]: cluster 2021-03-10T15:28:51.406684+0000 mgr.gibba043.dnkmem (mgr.34373) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:52.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:52 gibba003 bash[31385]: cluster 2021-03-10T15:28:51.406684+0000 mgr.gibba043.dnkmem (mgr.34373) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:52 gibba003 bash[32348]: cluster 2021-03-10T15:28:51.406684+0000 mgr.gibba043.dnkmem (mgr.34373) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:54.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:54 gibba003 bash[31385]: cluster 2021-03-10T15:28:53.408363+0000 mgr.gibba043.dnkmem (mgr.34373) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:54 gibba003 bash[32348]: cluster 2021-03-10T15:28:53.408363+0000 mgr.gibba043.dnkmem (mgr.34373) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:54 gibba043 bash[24019]: cluster 2021-03-10T15:28:53.408363+0000 mgr.gibba043.dnkmem (mgr.34373) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:55.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:55 gibba003 bash[31385]: cephadm 2021-03-10T15:28:55.232457+0000 mgr.gibba043.dnkmem (mgr.34373) 5181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:55.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:55 gibba003 bash[32348]: cephadm 2021-03-10T15:28:55.232457+0000 mgr.gibba043.dnkmem (mgr.34373) 5181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:56.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:55 gibba043 bash[24019]: cephadm 2021-03-10T15:28:55.232457+0000 mgr.gibba043.dnkmem (mgr.34373) 5181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:28:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:56 gibba003 bash[31385]: cluster 2021-03-10T15:28:55.409625+0000 mgr.gibba043.dnkmem (mgr.34373) 5182 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:56 gibba003 bash[32348]: cluster 2021-03-10T15:28:55.409625+0000 mgr.gibba043.dnkmem (mgr.34373) 5182 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:56 gibba043 bash[24019]: cluster 2021-03-10T15:28:55.409625+0000 mgr.gibba043.dnkmem (mgr.34373) 5182 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:28:58 gibba003 bash[31385]: cluster 2021-03-10T15:28:57.411143+0000 mgr.gibba043.dnkmem (mgr.34373) 5183 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:28:58 gibba003 bash[32348]: cluster 2021-03-10T15:28:57.411143+0000 mgr.gibba043.dnkmem (mgr.34373) 5183 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:28:58 gibba043 bash[24019]: cluster 2021-03-10T15:28:57.411143+0000 mgr.gibba043.dnkmem (mgr.34373) 5183 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:00 gibba003 bash[31385]: cluster 2021-03-10T15:28:59.412887+0000 mgr.gibba043.dnkmem (mgr.34373) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:00 gibba003 bash[32348]: cluster 2021-03-10T15:28:59.412887+0000 mgr.gibba043.dnkmem (mgr.34373) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:01.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:00 gibba043 bash[24019]: cluster 2021-03-10T15:28:59.412887+0000 mgr.gibba043.dnkmem (mgr.34373) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:02 gibba003 bash[31385]: cluster 2021-03-10T15:29:01.414524+0000 mgr.gibba043.dnkmem (mgr.34373) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:02.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:02 gibba003 bash[32348]: cluster 2021-03-10T15:29:01.414524+0000 mgr.gibba043.dnkmem (mgr.34373) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:02 gibba043 bash[24019]: cluster 2021-03-10T15:29:01.414524+0000 mgr.gibba043.dnkmem (mgr.34373) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:04.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:04 gibba003 bash[31385]: cluster 2021-03-10T15:29:03.416088+0000 mgr.gibba043.dnkmem (mgr.34373) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:04 gibba003 bash[32348]: cluster 2021-03-10T15:29:03.416088+0000 mgr.gibba043.dnkmem (mgr.34373) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:04 gibba043 bash[24019]: cluster 2021-03-10T15:29:03.416088+0000 mgr.gibba043.dnkmem (mgr.34373) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:06 gibba003 bash[31385]: cluster 2021-03-10T15:29:05.417563+0000 mgr.gibba043.dnkmem (mgr.34373) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:06 gibba003 bash[32348]: cluster 2021-03-10T15:29:05.417563+0000 mgr.gibba043.dnkmem (mgr.34373) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:06 gibba043 bash[24019]: cluster 2021-03-10T15:29:05.417563+0000 mgr.gibba043.dnkmem (mgr.34373) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:08.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:08 gibba003 bash[31385]: cluster 2021-03-10T15:29:07.419091+0000 mgr.gibba043.dnkmem (mgr.34373) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:08.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:08 gibba003 bash[32348]: cluster 2021-03-10T15:29:07.419091+0000 mgr.gibba043.dnkmem (mgr.34373) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:09.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:08 gibba043 bash[24019]: cluster 2021-03-10T15:29:07.419091+0000 mgr.gibba043.dnkmem (mgr.34373) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:10 gibba003 bash[31385]: cluster 2021-03-10T15:29:09.420868+0000 mgr.gibba043.dnkmem (mgr.34373) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:10 gibba003 bash[31385]: cephadm 2021-03-10T15:29:10.248548+0000 mgr.gibba043.dnkmem (mgr.34373) 5190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:10.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:10 gibba003 bash[32348]: cluster 2021-03-10T15:29:09.420868+0000 mgr.gibba043.dnkmem (mgr.34373) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:10 gibba003 bash[32348]: cephadm 2021-03-10T15:29:10.248548+0000 mgr.gibba043.dnkmem (mgr.34373) 5190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:10 gibba043 bash[24019]: cluster 2021-03-10T15:29:09.420868+0000 mgr.gibba043.dnkmem (mgr.34373) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:10 gibba043 bash[24019]: cephadm 2021-03-10T15:29:10.248548+0000 mgr.gibba043.dnkmem (mgr.34373) 5190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:12.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:12 gibba003 bash[31385]: cluster 2021-03-10T15:29:11.422609+0000 mgr.gibba043.dnkmem (mgr.34373) 5191 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:12.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:12 gibba003 bash[32348]: cluster 2021-03-10T15:29:11.422609+0000 mgr.gibba043.dnkmem (mgr.34373) 5191 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:13.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:12 gibba043 bash[24019]: cluster 2021-03-10T15:29:11.422609+0000 mgr.gibba043.dnkmem (mgr.34373) 5191 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:13.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.339095+0000 mon.c (mon.1) 1360 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.340176+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.457051+0000 mon.c (mon.1) 1361 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.458166+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:13.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.534307+0000 mon.c (mon.1) 1362 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:29:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.535109+0000 mon.c (mon.1) 1363 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.535670+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:29:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.535849+0000 mon.c (mon.1) 1364 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.536543+0000 mon.c (mon.1) 1365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.537899+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.538733+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[31385]: audit 2021-03-10T15:29:13.539652+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:13.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.339095+0000 mon.c (mon.1) 1360 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.340176+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.457051+0000 mon.c (mon.1) 1361 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.458166+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:13.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.534307+0000 mon.c (mon.1) 1362 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:29:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.535109+0000 mon.c (mon.1) 1363 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.535670+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:29:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.535849+0000 mon.c (mon.1) 1364 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.536543+0000 mon.c (mon.1) 1365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.537899+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.538733+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:13.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:13 gibba003 bash[32348]: audit 2021-03-10T15:29:13.539652+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.339095+0000 mon.c (mon.1) 1360 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.340176+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:14.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.457051+0000 mon.c (mon.1) 1361 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.458166+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.534307+0000 mon.c (mon.1) 1362 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:29:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.535109+0000 mon.c (mon.1) 1363 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:29:14.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.535670+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:29:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.535849+0000 mon.c (mon.1) 1364 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.536543+0000 mon.c (mon.1) 1365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.537899+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:29:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.538733+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:14.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:13 gibba043 bash[24019]: audit 2021-03-10T15:29:13.539652+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:14 gibba003 bash[31385]: cluster 2021-03-10T15:29:13.424339+0000 mgr.gibba043.dnkmem (mgr.34373) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:14 gibba003 bash[32348]: cluster 2021-03-10T15:29:13.424339+0000 mgr.gibba043.dnkmem (mgr.34373) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:14 gibba043 bash[24019]: cluster 2021-03-10T15:29:13.424339+0000 mgr.gibba043.dnkmem (mgr.34373) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:16 gibba003 bash[31385]: cluster 2021-03-10T15:29:15.425733+0000 mgr.gibba043.dnkmem (mgr.34373) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:16.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:16 gibba003 bash[32348]: cluster 2021-03-10T15:29:15.425733+0000 mgr.gibba043.dnkmem (mgr.34373) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:17.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:16 gibba043 bash[24019]: cluster 2021-03-10T15:29:15.425733+0000 mgr.gibba043.dnkmem (mgr.34373) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:18 gibba003 bash[31385]: cluster 2021-03-10T15:29:17.427266+0000 mgr.gibba043.dnkmem (mgr.34373) 5194 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:18 gibba003 bash[32348]: cluster 2021-03-10T15:29:17.427266+0000 mgr.gibba043.dnkmem (mgr.34373) 5194 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:18 gibba043 bash[24019]: cluster 2021-03-10T15:29:17.427266+0000 mgr.gibba043.dnkmem (mgr.34373) 5194 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:20 gibba003 bash[31385]: cluster 2021-03-10T15:29:19.429081+0000 mgr.gibba043.dnkmem (mgr.34373) 5195 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:20 gibba003 bash[32348]: cluster 2021-03-10T15:29:19.429081+0000 mgr.gibba043.dnkmem (mgr.34373) 5195 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:20 gibba043 bash[24019]: cluster 2021-03-10T15:29:19.429081+0000 mgr.gibba043.dnkmem (mgr.34373) 5195 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:21.184 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:29:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:29:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (97m) 2m ago 103m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:29:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (102m) 56s ago 102m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:29:21.413 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (98m) 56s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:29:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (98m) 56s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:29:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:29:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:29:21.414 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (96m) 56s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:29:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (96m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:29:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (103m) 2m ago 103m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:29:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (103m) 56s ago 103m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:29:21.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:29:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:29:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:29:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:29:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (94m) 56s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:29:21.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (93m) 56s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:29:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (93m) 56s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:29:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (93m) 56s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:29:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (102m) 56s ago 103m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:29:21.417 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 101m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:29:21.668 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:29:21.669 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:29:21.669 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:21.669 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:29:21.669 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:29:21.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:21.670 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:29:21.670 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:29:21.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:29:21.670 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:29:21.671 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:29:21.671 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:29:21.671 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:29:21.671 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:29:21.672 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:29:21.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:21 gibba003 bash[31385]: audit 2021-03-10T15:29:21.171476+0000 mgr.gibba043.dnkmem (mgr.34373) 5196 : audit [DBG] from='client.47544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:21 gibba003 bash[32348]: audit 2021-03-10T15:29:21.171476+0000 mgr.gibba043.dnkmem (mgr.34373) 5196 : audit [DBG] from='client.47544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:22.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:21 gibba043 bash[24019]: audit 2021-03-10T15:29:21.171476+0000 mgr.gibba043.dnkmem (mgr.34373) 5196 : audit [DBG] from='client.47544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:22 gibba003 bash[31385]: audit 2021-03-10T15:29:21.397541+0000 mgr.gibba043.dnkmem (mgr.34373) 5197 : audit [DBG] from='client.47550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:22 gibba003 bash[31385]: cluster 2021-03-10T15:29:21.429987+0000 mgr.gibba043.dnkmem (mgr.34373) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:22.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:22 gibba003 bash[31385]: audit 2021-03-10T15:29:21.666786+0000 mon.c (mon.1) 1366 : audit [DBG] from='client.? 172.21.2.103:0/3687664599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:22 gibba003 bash[32348]: audit 2021-03-10T15:29:21.397541+0000 mgr.gibba043.dnkmem (mgr.34373) 5197 : audit [DBG] from='client.47550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:22 gibba003 bash[32348]: cluster 2021-03-10T15:29:21.429987+0000 mgr.gibba043.dnkmem (mgr.34373) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:22.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:22 gibba003 bash[32348]: audit 2021-03-10T15:29:21.666786+0000 mon.c (mon.1) 1366 : audit [DBG] from='client.? 172.21.2.103:0/3687664599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:23.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:22 gibba043 bash[24019]: audit 2021-03-10T15:29:21.397541+0000 mgr.gibba043.dnkmem (mgr.34373) 5197 : audit [DBG] from='client.47550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:23.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:22 gibba043 bash[24019]: cluster 2021-03-10T15:29:21.429987+0000 mgr.gibba043.dnkmem (mgr.34373) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:23.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:22 gibba043 bash[24019]: audit 2021-03-10T15:29:21.666786+0000 mon.c (mon.1) 1366 : audit [DBG] from='client.? 172.21.2.103:0/3687664599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:24.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:24 gibba003 bash[31385]: cluster 2021-03-10T15:29:23.431377+0000 mgr.gibba043.dnkmem (mgr.34373) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:24 gibba003 bash[32348]: cluster 2021-03-10T15:29:23.431377+0000 mgr.gibba043.dnkmem (mgr.34373) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:24 gibba043 bash[24019]: cluster 2021-03-10T15:29:23.431377+0000 mgr.gibba043.dnkmem (mgr.34373) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:25.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.265340+0000 mgr.gibba043.dnkmem (mgr.34373) 5200 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:29:25.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.266885+0000 mgr.gibba043.dnkmem (mgr.34373) 5201 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:29:25.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.498139+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:29:25.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.501912+0000 mon.c (mon.1) 1367 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:25.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.503510+0000 mon.c (mon.1) 1368 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.504760+0000 mon.c (mon.1) 1369 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.506191+0000 mon.c (mon.1) 1370 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.509844+0000 mon.c (mon.1) 1371 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:25 gibba043 bash[24019]: audit 2021-03-10T15:29:25.511671+0000 mon.c (mon.1) 1372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.265340+0000 mgr.gibba043.dnkmem (mgr.34373) 5200 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:29:25.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.266885+0000 mgr.gibba043.dnkmem (mgr.34373) 5201 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:29:25.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.498139+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:29:25.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.501912+0000 mon.c (mon.1) 1367 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:25.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.503510+0000 mon.c (mon.1) 1368 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.504760+0000 mon.c (mon.1) 1369 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.506191+0000 mon.c (mon.1) 1370 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.509844+0000 mon.c (mon.1) 1371 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[31385]: audit 2021-03-10T15:29:25.511671+0000 mon.c (mon.1) 1372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.265340+0000 mgr.gibba043.dnkmem (mgr.34373) 5200 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:29:25.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.266885+0000 mgr.gibba043.dnkmem (mgr.34373) 5201 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:29:25.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.498139+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:29:25.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.501912+0000 mon.c (mon.1) 1367 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:25.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.503510+0000 mon.c (mon.1) 1368 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.504760+0000 mon.c (mon.1) 1369 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.506191+0000 mon.c (mon.1) 1370 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.509844+0000 mon.c (mon.1) 1371 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:25.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:25 gibba003 bash[32348]: audit 2021-03-10T15:29:25.511671+0000 mon.c (mon.1) 1372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cluster 2021-03-10T15:29:25.431895+0000 mgr.gibba043.dnkmem (mgr.34373) 5202 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:26.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.499674+0000 mgr.gibba043.dnkmem (mgr.34373) 5203 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.501614+0000 mgr.gibba043.dnkmem (mgr.34373) 5204 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.502863+0000 mgr.gibba043.dnkmem (mgr.34373) 5205 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.502901+0000 mgr.gibba043.dnkmem (mgr.34373) 5206 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:26.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.504356+0000 mgr.gibba043.dnkmem (mgr.34373) 5207 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.504393+0000 mgr.gibba043.dnkmem (mgr.34373) 5208 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.505874+0000 mgr.gibba043.dnkmem (mgr.34373) 5209 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.507657+0000 mgr.gibba043.dnkmem (mgr.34373) 5210 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.507744+0000 mgr.gibba043.dnkmem (mgr.34373) 5211 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:26.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.509381+0000 mgr.gibba043.dnkmem (mgr.34373) 5212 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.509729+0000 mgr.gibba043.dnkmem (mgr.34373) 5213 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.511377+0000 mgr.gibba043.dnkmem (mgr.34373) 5214 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.511420+0000 mgr.gibba043.dnkmem (mgr.34373) 5215 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:26.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[31385]: cephadm 2021-03-10T15:29:25.511535+0000 mgr.gibba043.dnkmem (mgr.34373) 5216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cluster 2021-03-10T15:29:25.431895+0000 mgr.gibba043.dnkmem (mgr.34373) 5202 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.499674+0000 mgr.gibba043.dnkmem (mgr.34373) 5203 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.501614+0000 mgr.gibba043.dnkmem (mgr.34373) 5204 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:26.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.502863+0000 mgr.gibba043.dnkmem (mgr.34373) 5205 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.502901+0000 mgr.gibba043.dnkmem (mgr.34373) 5206 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.504356+0000 mgr.gibba043.dnkmem (mgr.34373) 5207 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.504393+0000 mgr.gibba043.dnkmem (mgr.34373) 5208 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:26.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.505874+0000 mgr.gibba043.dnkmem (mgr.34373) 5209 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.507657+0000 mgr.gibba043.dnkmem (mgr.34373) 5210 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.507744+0000 mgr.gibba043.dnkmem (mgr.34373) 5211 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.509381+0000 mgr.gibba043.dnkmem (mgr.34373) 5212 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:26.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.509729+0000 mgr.gibba043.dnkmem (mgr.34373) 5213 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.511377+0000 mgr.gibba043.dnkmem (mgr.34373) 5214 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.511420+0000 mgr.gibba043.dnkmem (mgr.34373) 5215 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:26.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:26 gibba003 bash[32348]: cephadm 2021-03-10T15:29:25.511535+0000 mgr.gibba043.dnkmem (mgr.34373) 5216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cluster 2021-03-10T15:29:25.431895+0000 mgr.gibba043.dnkmem (mgr.34373) 5202 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.499674+0000 mgr.gibba043.dnkmem (mgr.34373) 5203 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.501614+0000 mgr.gibba043.dnkmem (mgr.34373) 5204 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.502863+0000 mgr.gibba043.dnkmem (mgr.34373) 5205 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.502901+0000 mgr.gibba043.dnkmem (mgr.34373) 5206 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.504356+0000 mgr.gibba043.dnkmem (mgr.34373) 5207 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.504393+0000 mgr.gibba043.dnkmem (mgr.34373) 5208 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.505874+0000 mgr.gibba043.dnkmem (mgr.34373) 5209 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.507657+0000 mgr.gibba043.dnkmem (mgr.34373) 5210 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.507744+0000 mgr.gibba043.dnkmem (mgr.34373) 5211 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.509381+0000 mgr.gibba043.dnkmem (mgr.34373) 5212 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.509729+0000 mgr.gibba043.dnkmem (mgr.34373) 5213 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.511377+0000 mgr.gibba043.dnkmem (mgr.34373) 5214 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.511420+0000 mgr.gibba043.dnkmem (mgr.34373) 5215 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:27.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:26 gibba043 bash[24019]: cephadm 2021-03-10T15:29:25.511535+0000 mgr.gibba043.dnkmem (mgr.34373) 5216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:29.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:28 gibba043 bash[24019]: cluster 2021-03-10T15:29:27.433112+0000 mgr.gibba043.dnkmem (mgr.34373) 5217 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:28 gibba003 bash[31385]: cluster 2021-03-10T15:29:27.433112+0000 mgr.gibba043.dnkmem (mgr.34373) 5217 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:28 gibba003 bash[32348]: cluster 2021-03-10T15:29:27.433112+0000 mgr.gibba043.dnkmem (mgr.34373) 5217 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:30 gibba043 bash[24019]: cluster 2021-03-10T15:29:29.434916+0000 mgr.gibba043.dnkmem (mgr.34373) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:30 gibba003 bash[31385]: cluster 2021-03-10T15:29:29.434916+0000 mgr.gibba043.dnkmem (mgr.34373) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:30 gibba003 bash[32348]: cluster 2021-03-10T15:29:29.434916+0000 mgr.gibba043.dnkmem (mgr.34373) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:33.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:32 gibba043 bash[24019]: cluster 2021-03-10T15:29:31.436614+0000 mgr.gibba043.dnkmem (mgr.34373) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:32 gibba003 bash[31385]: cluster 2021-03-10T15:29:31.436614+0000 mgr.gibba043.dnkmem (mgr.34373) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:32 gibba003 bash[32348]: cluster 2021-03-10T15:29:31.436614+0000 mgr.gibba043.dnkmem (mgr.34373) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:34 gibba043 bash[24019]: cluster 2021-03-10T15:29:33.438237+0000 mgr.gibba043.dnkmem (mgr.34373) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:34 gibba003 bash[31385]: cluster 2021-03-10T15:29:33.438237+0000 mgr.gibba043.dnkmem (mgr.34373) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:34 gibba003 bash[32348]: cluster 2021-03-10T15:29:33.438237+0000 mgr.gibba043.dnkmem (mgr.34373) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:36 gibba043 bash[24019]: cluster 2021-03-10T15:29:35.439464+0000 mgr.gibba043.dnkmem (mgr.34373) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:36 gibba003 bash[31385]: cluster 2021-03-10T15:29:35.439464+0000 mgr.gibba043.dnkmem (mgr.34373) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:37.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:36 gibba003 bash[32348]: cluster 2021-03-10T15:29:35.439464+0000 mgr.gibba043.dnkmem (mgr.34373) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:38 gibba043 bash[24019]: cluster 2021-03-10T15:29:37.441058+0000 mgr.gibba043.dnkmem (mgr.34373) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:38 gibba003 bash[31385]: cluster 2021-03-10T15:29:37.441058+0000 mgr.gibba043.dnkmem (mgr.34373) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:38 gibba003 bash[32348]: cluster 2021-03-10T15:29:37.441058+0000 mgr.gibba043.dnkmem (mgr.34373) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:41.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:40 gibba043 bash[24019]: cluster 2021-03-10T15:29:39.442587+0000 mgr.gibba043.dnkmem (mgr.34373) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:40 gibba003 bash[31385]: cluster 2021-03-10T15:29:39.442587+0000 mgr.gibba043.dnkmem (mgr.34373) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:40 gibba003 bash[32348]: cluster 2021-03-10T15:29:39.442587+0000 mgr.gibba043.dnkmem (mgr.34373) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:42.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:41 gibba043 bash[24019]: cephadm 2021-03-10T15:29:40.527636+0000 mgr.gibba043.dnkmem (mgr.34373) 5224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:41 gibba003 bash[31385]: cephadm 2021-03-10T15:29:40.527636+0000 mgr.gibba043.dnkmem (mgr.34373) 5224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:41 gibba003 bash[32348]: cephadm 2021-03-10T15:29:40.527636+0000 mgr.gibba043.dnkmem (mgr.34373) 5224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:42 gibba043 bash[24019]: cluster 2021-03-10T15:29:41.444448+0000 mgr.gibba043.dnkmem (mgr.34373) 5225 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:42 gibba003 bash[31385]: cluster 2021-03-10T15:29:41.444448+0000 mgr.gibba043.dnkmem (mgr.34373) 5225 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:42 gibba003 bash[32348]: cluster 2021-03-10T15:29:41.444448+0000 mgr.gibba043.dnkmem (mgr.34373) 5225 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:44 gibba003 bash[31385]: cluster 2021-03-10T15:29:43.445926+0000 mgr.gibba043.dnkmem (mgr.34373) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:44 gibba003 bash[32348]: cluster 2021-03-10T15:29:43.445926+0000 mgr.gibba043.dnkmem (mgr.34373) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:44 gibba043 bash[24019]: cluster 2021-03-10T15:29:43.445926+0000 mgr.gibba043.dnkmem (mgr.34373) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:47.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:46 gibba003 bash[31385]: cluster 2021-03-10T15:29:45.447452+0000 mgr.gibba043.dnkmem (mgr.34373) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:47.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:46 gibba003 bash[32348]: cluster 2021-03-10T15:29:45.447452+0000 mgr.gibba043.dnkmem (mgr.34373) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:47.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:46 gibba043 bash[24019]: cluster 2021-03-10T15:29:45.447452+0000 mgr.gibba043.dnkmem (mgr.34373) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:49.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:48 gibba003 bash[31385]: cluster 2021-03-10T15:29:47.449106+0000 mgr.gibba043.dnkmem (mgr.34373) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:48 gibba003 bash[32348]: cluster 2021-03-10T15:29:47.449106+0000 mgr.gibba043.dnkmem (mgr.34373) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:48 gibba043 bash[24019]: cluster 2021-03-10T15:29:47.449106+0000 mgr.gibba043.dnkmem (mgr.34373) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:50 gibba003 bash[31385]: cluster 2021-03-10T15:29:49.450621+0000 mgr.gibba043.dnkmem (mgr.34373) 5229 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:50 gibba003 bash[32348]: cluster 2021-03-10T15:29:49.450621+0000 mgr.gibba043.dnkmem (mgr.34373) 5229 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:50 gibba043 bash[24019]: cluster 2021-03-10T15:29:49.450621+0000 mgr.gibba043.dnkmem (mgr.34373) 5229 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.915 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:29:52.144 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:29:52.144 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (98m) 2m ago 103m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:29:52.144 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (103m) 87s ago 103m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:29:52.145 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (98m) 87s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:29:52.145 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (98m) 87s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:29:52.145 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:29:52.145 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:29:52.145 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (97m) 87s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:29:52.146 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (97m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:29:52.146 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (103m) 2m ago 103m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:29:52.146 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (103m) 87s ago 103m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:29:52.146 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:29:52.146 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:29:52.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:29:52.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:29:52.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (94m) 87s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:29:52.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (94m) 87s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:29:52.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (93m) 87s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:29:52.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (93m) 87s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:29:52.148 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (103m) 87s ago 103m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:29:52.148 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 101m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:29:52.392 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:29:52.393 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:29:52.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:52.393 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:29:52.393 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:29:52.394 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:52.394 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:29:52.394 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:29:52.394 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:29:52.394 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:29:52.395 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:29:52.395 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:29:52.395 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:29:52.395 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:29:52.395 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:29:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[31385]: cluster 2021-03-10T15:29:51.452313+0000 mgr.gibba043.dnkmem (mgr.34373) 5230 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[31385]: audit 2021-03-10T15:29:51.903270+0000 mgr.gibba043.dnkmem (mgr.34373) 5231 : audit [DBG] from='client.47562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:53.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[31385]: audit 2021-03-10T15:29:52.128078+0000 mgr.gibba043.dnkmem (mgr.34373) 5232 : audit [DBG] from='client.57556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:53.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[31385]: audit 2021-03-10T15:29:52.390849+0000 mon.a (mon.0) 1279 : audit [DBG] from='client.? 172.21.2.103:0/2505344789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:53.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[32348]: cluster 2021-03-10T15:29:51.452313+0000 mgr.gibba043.dnkmem (mgr.34373) 5230 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[32348]: audit 2021-03-10T15:29:51.903270+0000 mgr.gibba043.dnkmem (mgr.34373) 5231 : audit [DBG] from='client.47562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:53.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[32348]: audit 2021-03-10T15:29:52.128078+0000 mgr.gibba043.dnkmem (mgr.34373) 5232 : audit [DBG] from='client.57556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:53.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:52 gibba003 bash[32348]: audit 2021-03-10T15:29:52.390849+0000 mon.a (mon.0) 1279 : audit [DBG] from='client.? 172.21.2.103:0/2505344789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:52 gibba043 bash[24019]: cluster 2021-03-10T15:29:51.452313+0000 mgr.gibba043.dnkmem (mgr.34373) 5230 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:52 gibba043 bash[24019]: audit 2021-03-10T15:29:51.903270+0000 mgr.gibba043.dnkmem (mgr.34373) 5231 : audit [DBG] from='client.47562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:52 gibba043 bash[24019]: audit 2021-03-10T15:29:52.128078+0000 mgr.gibba043.dnkmem (mgr.34373) 5232 : audit [DBG] from='client.57556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:52 gibba043 bash[24019]: audit 2021-03-10T15:29:52.390849+0000 mon.a (mon.0) 1279 : audit [DBG] from='client.? 172.21.2.103:0/2505344789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:54 gibba003 bash[31385]: cluster 2021-03-10T15:29:53.453784+0000 mgr.gibba043.dnkmem (mgr.34373) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:54 gibba003 bash[32348]: cluster 2021-03-10T15:29:53.453784+0000 mgr.gibba043.dnkmem (mgr.34373) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:54 gibba043 bash[24019]: cluster 2021-03-10T15:29:53.453784+0000 mgr.gibba043.dnkmem (mgr.34373) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:56 gibba003 bash[31385]: cluster 2021-03-10T15:29:55.455306+0000 mgr.gibba043.dnkmem (mgr.34373) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:56 gibba003 bash[31385]: cephadm 2021-03-10T15:29:55.543417+0000 mgr.gibba043.dnkmem (mgr.34373) 5235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:56 gibba003 bash[32348]: cluster 2021-03-10T15:29:55.455306+0000 mgr.gibba043.dnkmem (mgr.34373) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:56 gibba003 bash[32348]: cephadm 2021-03-10T15:29:55.543417+0000 mgr.gibba043.dnkmem (mgr.34373) 5235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:56 gibba043 bash[24019]: cluster 2021-03-10T15:29:55.455306+0000 mgr.gibba043.dnkmem (mgr.34373) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:56 gibba043 bash[24019]: cephadm 2021-03-10T15:29:55.543417+0000 mgr.gibba043.dnkmem (mgr.34373) 5235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:29:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:29:58 gibba003 bash[31385]: cluster 2021-03-10T15:29:57.456957+0000 mgr.gibba043.dnkmem (mgr.34373) 5236 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:29:58 gibba003 bash[32348]: cluster 2021-03-10T15:29:57.456957+0000 mgr.gibba043.dnkmem (mgr.34373) 5236 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:29:58 gibba043 bash[24019]: cluster 2021-03-10T15:29:57.456957+0000 mgr.gibba043.dnkmem (mgr.34373) 5236 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:00 gibba003 bash[31385]: debug 2021-03-10T15:29:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:00 gibba003 bash[31385]: cluster 2021-03-10T15:29:59.458564+0000 mgr.gibba043.dnkmem (mgr.34373) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:00 gibba003 bash[31385]: cluster 2021-03-10T15:30:00.000250+0000 mon.a (mon.0) 1280 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:00 gibba003 bash[32348]: cluster 2021-03-10T15:29:59.458564+0000 mgr.gibba043.dnkmem (mgr.34373) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:00 gibba003 bash[32348]: cluster 2021-03-10T15:30:00.000250+0000 mon.a (mon.0) 1280 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:00 gibba043 bash[24019]: cluster 2021-03-10T15:29:59.458564+0000 mgr.gibba043.dnkmem (mgr.34373) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:00 gibba043 bash[24019]: cluster 2021-03-10T15:30:00.000250+0000 mon.a (mon.0) 1280 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:02 gibba003 bash[31385]: cluster 2021-03-10T15:30:01.460240+0000 mgr.gibba043.dnkmem (mgr.34373) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:02 gibba003 bash[32348]: cluster 2021-03-10T15:30:01.460240+0000 mgr.gibba043.dnkmem (mgr.34373) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:02 gibba043 bash[24019]: cluster 2021-03-10T15:30:01.460240+0000 mgr.gibba043.dnkmem (mgr.34373) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:04 gibba003 bash[31385]: cluster 2021-03-10T15:30:03.461799+0000 mgr.gibba043.dnkmem (mgr.34373) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:04 gibba003 bash[32348]: cluster 2021-03-10T15:30:03.461799+0000 mgr.gibba043.dnkmem (mgr.34373) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:04 gibba043 bash[24019]: cluster 2021-03-10T15:30:03.461799+0000 mgr.gibba043.dnkmem (mgr.34373) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:06 gibba003 bash[31385]: cluster 2021-03-10T15:30:05.463081+0000 mgr.gibba043.dnkmem (mgr.34373) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:06 gibba003 bash[32348]: cluster 2021-03-10T15:30:05.463081+0000 mgr.gibba043.dnkmem (mgr.34373) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:06 gibba043 bash[24019]: cluster 2021-03-10T15:30:05.463081+0000 mgr.gibba043.dnkmem (mgr.34373) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:08 gibba003 bash[31385]: cluster 2021-03-10T15:30:07.464716+0000 mgr.gibba043.dnkmem (mgr.34373) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:08 gibba003 bash[32348]: cluster 2021-03-10T15:30:07.464716+0000 mgr.gibba043.dnkmem (mgr.34373) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:08 gibba043 bash[24019]: cluster 2021-03-10T15:30:07.464716+0000 mgr.gibba043.dnkmem (mgr.34373) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:10 gibba003 bash[31385]: cluster 2021-03-10T15:30:09.466601+0000 mgr.gibba043.dnkmem (mgr.34373) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:10 gibba003 bash[32348]: cluster 2021-03-10T15:30:09.466601+0000 mgr.gibba043.dnkmem (mgr.34373) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:10 gibba043 bash[24019]: cluster 2021-03-10T15:30:09.466601+0000 mgr.gibba043.dnkmem (mgr.34373) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:11 gibba003 bash[31385]: cephadm 2021-03-10T15:30:10.559420+0000 mgr.gibba043.dnkmem (mgr.34373) 5243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:12.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:11 gibba003 bash[32348]: cephadm 2021-03-10T15:30:10.559420+0000 mgr.gibba043.dnkmem (mgr.34373) 5243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:11 gibba043 bash[24019]: cephadm 2021-03-10T15:30:10.559420+0000 mgr.gibba043.dnkmem (mgr.34373) 5243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:12 gibba003 bash[31385]: cluster 2021-03-10T15:30:11.468599+0000 mgr.gibba043.dnkmem (mgr.34373) 5244 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:12 gibba003 bash[32348]: cluster 2021-03-10T15:30:11.468599+0000 mgr.gibba043.dnkmem (mgr.34373) 5244 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:12 gibba043 bash[24019]: cluster 2021-03-10T15:30:11.468599+0000 mgr.gibba043.dnkmem (mgr.34373) 5244 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.345858+0000 mon.c (mon.1) 1373 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.347106+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.465757+0000 mon.c (mon.1) 1374 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.466925+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.544147+0000 mon.c (mon.1) 1375 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:30:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.544909+0000 mon.c (mon.1) 1376 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.545578+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:30:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.545603+0000 mon.c (mon.1) 1377 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:30:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.546295+0000 mon.c (mon.1) 1378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.547702+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.548613+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:30:14.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[31385]: audit 2021-03-10T15:30:13.549505+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.345858+0000 mon.c (mon.1) 1373 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.347106+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.465757+0000 mon.c (mon.1) 1374 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.466925+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.544147+0000 mon.c (mon.1) 1375 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:30:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.544909+0000 mon.c (mon.1) 1376 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.545578+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:30:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.545603+0000 mon.c (mon.1) 1377 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:30:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.546295+0000 mon.c (mon.1) 1378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.547702+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.548613+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:30:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:13 gibba003 bash[32348]: audit 2021-03-10T15:30:13.549505+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.345858+0000 mon.c (mon.1) 1373 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.347106+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.465757+0000 mon.c (mon.1) 1374 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.466925+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.544147+0000 mon.c (mon.1) 1375 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:30:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.544909+0000 mon.c (mon.1) 1376 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.545578+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:30:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.545603+0000 mon.c (mon.1) 1377 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:30:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.546295+0000 mon.c (mon.1) 1378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.547702+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:30:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.548613+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:30:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:13 gibba043 bash[24019]: audit 2021-03-10T15:30:13.549505+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:14 gibba003 bash[31385]: cluster 2021-03-10T15:30:13.469969+0000 mgr.gibba043.dnkmem (mgr.34373) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:14 gibba003 bash[32348]: cluster 2021-03-10T15:30:13.469969+0000 mgr.gibba043.dnkmem (mgr.34373) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:14 gibba043 bash[24019]: cluster 2021-03-10T15:30:13.469969+0000 mgr.gibba043.dnkmem (mgr.34373) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:16 gibba003 bash[31385]: cluster 2021-03-10T15:30:15.471349+0000 mgr.gibba043.dnkmem (mgr.34373) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:16 gibba003 bash[32348]: cluster 2021-03-10T15:30:15.471349+0000 mgr.gibba043.dnkmem (mgr.34373) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:16 gibba043 bash[24019]: cluster 2021-03-10T15:30:15.471349+0000 mgr.gibba043.dnkmem (mgr.34373) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:18 gibba043 bash[24019]: cluster 2021-03-10T15:30:17.473021+0000 mgr.gibba043.dnkmem (mgr.34373) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:18 gibba003 bash[31385]: cluster 2021-03-10T15:30:17.473021+0000 mgr.gibba043.dnkmem (mgr.34373) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:18 gibba003 bash[32348]: cluster 2021-03-10T15:30:17.473021+0000 mgr.gibba043.dnkmem (mgr.34373) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:20 gibba043 bash[24019]: cluster 2021-03-10T15:30:19.474529+0000 mgr.gibba043.dnkmem (mgr.34373) 5248 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:21.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:20 gibba003 bash[32348]: cluster 2021-03-10T15:30:19.474529+0000 mgr.gibba043.dnkmem (mgr.34373) 5248 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:21.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:20 gibba003 bash[31385]: cluster 2021-03-10T15:30:19.474529+0000 mgr.gibba043.dnkmem (mgr.34373) 5248 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:22.637 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:30:22.893 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:30:22.893 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (98m) 3m ago 104m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:30:22.893 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (103m) 117s ago 103m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:30:22.893 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (99m) 117s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:30:22.894 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (99m) 117s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:30:22.894 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:30:22.894 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:30:22.894 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (97m) 117s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:30:22.895 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:30:22.895 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (104m) 3m ago 104m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:30:22.895 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (104m) 117s ago 104m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:30:22.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:30:22.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:30:22.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:30:22.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:30:22.896 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (95m) 117s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:30:22.897 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (94m) 117s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:30:22.897 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (94m) 117s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:30:22.897 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (94m) 117s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:30:22.897 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (103m) 117s ago 104m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:30:22.898 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 102m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:30:23.150 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:30:23.151 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:30:23.151 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:23.151 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:30:23.152 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:30:23.152 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:23.152 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:30:23.152 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:30:23.152 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:30:23.153 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:30:23.153 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:30:23.153 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:30:23.153 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:30:23.154 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:30:23.154 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:30:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:22 gibba043 bash[24019]: cluster 2021-03-10T15:30:21.476255+0000 mgr.gibba043.dnkmem (mgr.34373) 5249 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:22 gibba003 bash[31385]: cluster 2021-03-10T15:30:21.476255+0000 mgr.gibba043.dnkmem (mgr.34373) 5249 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:22 gibba003 bash[32348]: cluster 2021-03-10T15:30:21.476255+0000 mgr.gibba043.dnkmem (mgr.34373) 5249 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:23 gibba043 bash[24019]: audit 2021-03-10T15:30:22.625387+0000 mgr.gibba043.dnkmem (mgr.34373) 5250 : audit [DBG] from='client.57568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:23 gibba043 bash[24019]: audit 2021-03-10T15:30:22.848539+0000 mgr.gibba043.dnkmem (mgr.34373) 5251 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:23 gibba043 bash[24019]: audit 2021-03-10T15:30:23.148857+0000 mon.a (mon.0) 1287 : audit [DBG] from='client.? 172.21.2.103:0/3870985094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:23 gibba003 bash[31385]: audit 2021-03-10T15:30:22.625387+0000 mgr.gibba043.dnkmem (mgr.34373) 5250 : audit [DBG] from='client.57568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:23 gibba003 bash[31385]: audit 2021-03-10T15:30:22.848539+0000 mgr.gibba043.dnkmem (mgr.34373) 5251 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:23 gibba003 bash[31385]: audit 2021-03-10T15:30:23.148857+0000 mon.a (mon.0) 1287 : audit [DBG] from='client.? 172.21.2.103:0/3870985094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:24.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:23 gibba003 bash[32348]: audit 2021-03-10T15:30:22.625387+0000 mgr.gibba043.dnkmem (mgr.34373) 5250 : audit [DBG] from='client.57568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:24.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:23 gibba003 bash[32348]: audit 2021-03-10T15:30:22.848539+0000 mgr.gibba043.dnkmem (mgr.34373) 5251 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:24.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:23 gibba003 bash[32348]: audit 2021-03-10T15:30:23.148857+0000 mon.a (mon.0) 1287 : audit [DBG] from='client.? 172.21.2.103:0/3870985094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:24 gibba043 bash[24019]: cluster 2021-03-10T15:30:23.477824+0000 mgr.gibba043.dnkmem (mgr.34373) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:24 gibba003 bash[31385]: cluster 2021-03-10T15:30:23.477824+0000 mgr.gibba043.dnkmem (mgr.34373) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:24 gibba003 bash[32348]: cluster 2021-03-10T15:30:23.477824+0000 mgr.gibba043.dnkmem (mgr.34373) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cluster 2021-03-10T15:30:25.479310+0000 mgr.gibba043.dnkmem (mgr.34373) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.568287+0000 mgr.gibba043.dnkmem (mgr.34373) 5254 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:30:27.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.569878+0000 mgr.gibba043.dnkmem (mgr.34373) 5255 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:30:27.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.782106+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:30:27.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.783686+0000 mgr.gibba043.dnkmem (mgr.34373) 5256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:27.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.785852+0000 mgr.gibba043.dnkmem (mgr.34373) 5257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:27.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.786049+0000 mon.c (mon.1) 1379 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:27.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.787501+0000 mgr.gibba043.dnkmem (mgr.34373) 5258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:27.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.787540+0000 mgr.gibba043.dnkmem (mgr.34373) 5259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:27.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.787812+0000 mon.c (mon.1) 1380 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.789265+0000 mgr.gibba043.dnkmem (mgr.34373) 5260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:27.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.789303+0000 mgr.gibba043.dnkmem (mgr.34373) 5261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:27.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.789601+0000 mon.c (mon.1) 1381 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.790876+0000 mgr.gibba043.dnkmem (mgr.34373) 5262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:27.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.791338+0000 mon.c (mon.1) 1382 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.793078+0000 mgr.gibba043.dnkmem (mgr.34373) 5263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:27.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.793119+0000 mgr.gibba043.dnkmem (mgr.34373) 5264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:27.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.794728+0000 mgr.gibba043.dnkmem (mgr.34373) 5265 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:27.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.795086+0000 mgr.gibba043.dnkmem (mgr.34373) 5266 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:27.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.795223+0000 mon.c (mon.1) 1383 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.796735+0000 mgr.gibba043.dnkmem (mgr.34373) 5267 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:27.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cluster 2021-03-10T15:30:25.479310+0000 mgr.gibba043.dnkmem (mgr.34373) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.568287+0000 mgr.gibba043.dnkmem (mgr.34373) 5254 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:30:27.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.569878+0000 mgr.gibba043.dnkmem (mgr.34373) 5255 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:30:27.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.782106+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:30:27.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.783686+0000 mgr.gibba043.dnkmem (mgr.34373) 5256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:27.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.785852+0000 mgr.gibba043.dnkmem (mgr.34373) 5257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:27.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.786049+0000 mon.c (mon.1) 1379 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:27.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.787501+0000 mgr.gibba043.dnkmem (mgr.34373) 5258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:27.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.787540+0000 mgr.gibba043.dnkmem (mgr.34373) 5259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:27.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.787812+0000 mon.c (mon.1) 1380 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.789265+0000 mgr.gibba043.dnkmem (mgr.34373) 5260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:27.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.789303+0000 mgr.gibba043.dnkmem (mgr.34373) 5261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:27.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.789601+0000 mon.c (mon.1) 1381 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.790876+0000 mgr.gibba043.dnkmem (mgr.34373) 5262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:27.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.791338+0000 mon.c (mon.1) 1382 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.793078+0000 mgr.gibba043.dnkmem (mgr.34373) 5263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:27.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.793119+0000 mgr.gibba043.dnkmem (mgr.34373) 5264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:27.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.794728+0000 mgr.gibba043.dnkmem (mgr.34373) 5265 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:27.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.795086+0000 mgr.gibba043.dnkmem (mgr.34373) 5266 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:27.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.795223+0000 mon.c (mon.1) 1383 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.796735+0000 mgr.gibba043.dnkmem (mgr.34373) 5267 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:27.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.796781+0000 mgr.gibba043.dnkmem (mgr.34373) 5268 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:27.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: cephadm 2021-03-10T15:30:25.796905+0000 mgr.gibba043.dnkmem (mgr.34373) 5269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:27.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[31385]: audit 2021-03-10T15:30:25.797100+0000 mon.c (mon.1) 1384 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.796781+0000 mgr.gibba043.dnkmem (mgr.34373) 5268 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:27.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: cephadm 2021-03-10T15:30:25.796905+0000 mgr.gibba043.dnkmem (mgr.34373) 5269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:27.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:26 gibba003 bash[32348]: audit 2021-03-10T15:30:25.797100+0000 mon.c (mon.1) 1384 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cluster 2021-03-10T15:30:25.479310+0000 mgr.gibba043.dnkmem (mgr.34373) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.568287+0000 mgr.gibba043.dnkmem (mgr.34373) 5254 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:30:27.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.569878+0000 mgr.gibba043.dnkmem (mgr.34373) 5255 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:30:27.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.782106+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:30:27.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.783686+0000 mgr.gibba043.dnkmem (mgr.34373) 5256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:27.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.785852+0000 mgr.gibba043.dnkmem (mgr.34373) 5257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:27.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.786049+0000 mon.c (mon.1) 1379 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:27.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.787501+0000 mgr.gibba043.dnkmem (mgr.34373) 5258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:27.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.787540+0000 mgr.gibba043.dnkmem (mgr.34373) 5259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:27.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.787812+0000 mon.c (mon.1) 1380 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.789265+0000 mgr.gibba043.dnkmem (mgr.34373) 5260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:27.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.789303+0000 mgr.gibba043.dnkmem (mgr.34373) 5261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:27.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.789601+0000 mon.c (mon.1) 1381 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.790876+0000 mgr.gibba043.dnkmem (mgr.34373) 5262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:27.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.791338+0000 mon.c (mon.1) 1382 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.793078+0000 mgr.gibba043.dnkmem (mgr.34373) 5263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:27.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.793119+0000 mgr.gibba043.dnkmem (mgr.34373) 5264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:27.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.794728+0000 mgr.gibba043.dnkmem (mgr.34373) 5265 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:27.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.795086+0000 mgr.gibba043.dnkmem (mgr.34373) 5266 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:27.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.795223+0000 mon.c (mon.1) 1383 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:27.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.796735+0000 mgr.gibba043.dnkmem (mgr.34373) 5267 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:27.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.796781+0000 mgr.gibba043.dnkmem (mgr.34373) 5268 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:27.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: cephadm 2021-03-10T15:30:25.796905+0000 mgr.gibba043.dnkmem (mgr.34373) 5269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:27.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:26 gibba043 bash[24019]: audit 2021-03-10T15:30:25.797100+0000 mon.c (mon.1) 1384 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:28 gibba003 bash[31385]: cluster 2021-03-10T15:30:27.480773+0000 mgr.gibba043.dnkmem (mgr.34373) 5270 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:28 gibba003 bash[32348]: cluster 2021-03-10T15:30:27.480773+0000 mgr.gibba043.dnkmem (mgr.34373) 5270 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:28 gibba043 bash[24019]: cluster 2021-03-10T15:30:27.480773+0000 mgr.gibba043.dnkmem (mgr.34373) 5270 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:30 gibba003 bash[31385]: cluster 2021-03-10T15:30:29.482586+0000 mgr.gibba043.dnkmem (mgr.34373) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:30 gibba003 bash[32348]: cluster 2021-03-10T15:30:29.482586+0000 mgr.gibba043.dnkmem (mgr.34373) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:30 gibba043 bash[24019]: cluster 2021-03-10T15:30:29.482586+0000 mgr.gibba043.dnkmem (mgr.34373) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:32 gibba003 bash[31385]: cluster 2021-03-10T15:30:31.484278+0000 mgr.gibba043.dnkmem (mgr.34373) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:32 gibba003 bash[32348]: cluster 2021-03-10T15:30:31.484278+0000 mgr.gibba043.dnkmem (mgr.34373) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:32 gibba043 bash[24019]: cluster 2021-03-10T15:30:31.484278+0000 mgr.gibba043.dnkmem (mgr.34373) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:34 gibba003 bash[31385]: cluster 2021-03-10T15:30:33.485906+0000 mgr.gibba043.dnkmem (mgr.34373) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:35.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:34 gibba003 bash[32348]: cluster 2021-03-10T15:30:33.485906+0000 mgr.gibba043.dnkmem (mgr.34373) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:34 gibba043 bash[24019]: cluster 2021-03-10T15:30:33.485906+0000 mgr.gibba043.dnkmem (mgr.34373) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:36 gibba003 bash[31385]: cluster 2021-03-10T15:30:35.487129+0000 mgr.gibba043.dnkmem (mgr.34373) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:36 gibba003 bash[32348]: cluster 2021-03-10T15:30:35.487129+0000 mgr.gibba043.dnkmem (mgr.34373) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:36 gibba043 bash[24019]: cluster 2021-03-10T15:30:35.487129+0000 mgr.gibba043.dnkmem (mgr.34373) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:38 gibba003 bash[31385]: cluster 2021-03-10T15:30:37.488748+0000 mgr.gibba043.dnkmem (mgr.34373) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:38 gibba003 bash[32348]: cluster 2021-03-10T15:30:37.488748+0000 mgr.gibba043.dnkmem (mgr.34373) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:38 gibba043 bash[24019]: cluster 2021-03-10T15:30:37.488748+0000 mgr.gibba043.dnkmem (mgr.34373) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:40 gibba003 bash[31385]: cluster 2021-03-10T15:30:39.490496+0000 mgr.gibba043.dnkmem (mgr.34373) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:40 gibba003 bash[32348]: cluster 2021-03-10T15:30:39.490496+0000 mgr.gibba043.dnkmem (mgr.34373) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:40 gibba043 bash[24019]: cluster 2021-03-10T15:30:39.490496+0000 mgr.gibba043.dnkmem (mgr.34373) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:42.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:41 gibba003 bash[31385]: cephadm 2021-03-10T15:30:40.812575+0000 mgr.gibba043.dnkmem (mgr.34373) 5277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:41 gibba003 bash[32348]: cephadm 2021-03-10T15:30:40.812575+0000 mgr.gibba043.dnkmem (mgr.34373) 5277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:41 gibba043 bash[24019]: cephadm 2021-03-10T15:30:40.812575+0000 mgr.gibba043.dnkmem (mgr.34373) 5277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:42 gibba003 bash[31385]: cluster 2021-03-10T15:30:41.491278+0000 mgr.gibba043.dnkmem (mgr.34373) 5278 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:42 gibba003 bash[32348]: cluster 2021-03-10T15:30:41.491278+0000 mgr.gibba043.dnkmem (mgr.34373) 5278 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:42 gibba043 bash[24019]: cluster 2021-03-10T15:30:41.491278+0000 mgr.gibba043.dnkmem (mgr.34373) 5278 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:44 gibba003 bash[31385]: cluster 2021-03-10T15:30:43.492837+0000 mgr.gibba043.dnkmem (mgr.34373) 5279 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:44 gibba003 bash[32348]: cluster 2021-03-10T15:30:43.492837+0000 mgr.gibba043.dnkmem (mgr.34373) 5279 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:44 gibba043 bash[24019]: cluster 2021-03-10T15:30:43.492837+0000 mgr.gibba043.dnkmem (mgr.34373) 5279 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:47.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:46 gibba003 bash[31385]: cluster 2021-03-10T15:30:45.494404+0000 mgr.gibba043.dnkmem (mgr.34373) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:47.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:46 gibba003 bash[32348]: cluster 2021-03-10T15:30:45.494404+0000 mgr.gibba043.dnkmem (mgr.34373) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:46 gibba043 bash[24019]: cluster 2021-03-10T15:30:45.494404+0000 mgr.gibba043.dnkmem (mgr.34373) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:49.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:48 gibba003 bash[31385]: cluster 2021-03-10T15:30:47.495891+0000 mgr.gibba043.dnkmem (mgr.34373) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:48 gibba003 bash[32348]: cluster 2021-03-10T15:30:47.495891+0000 mgr.gibba043.dnkmem (mgr.34373) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:48 gibba043 bash[24019]: cluster 2021-03-10T15:30:47.495891+0000 mgr.gibba043.dnkmem (mgr.34373) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:50 gibba003 bash[31385]: cluster 2021-03-10T15:30:49.497563+0000 mgr.gibba043.dnkmem (mgr.34373) 5282 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:51.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:50 gibba003 bash[32348]: cluster 2021-03-10T15:30:49.497563+0000 mgr.gibba043.dnkmem (mgr.34373) 5282 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:50 gibba043 bash[24019]: cluster 2021-03-10T15:30:49.497563+0000 mgr.gibba043.dnkmem (mgr.34373) 5282 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:52 gibba003 bash[31385]: cluster 2021-03-10T15:30:51.498405+0000 mgr.gibba043.dnkmem (mgr.34373) 5283 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:52 gibba003 bash[32348]: cluster 2021-03-10T15:30:51.498405+0000 mgr.gibba043.dnkmem (mgr.34373) 5283 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:52 gibba043 bash[24019]: cluster 2021-03-10T15:30:51.498405+0000 mgr.gibba043.dnkmem (mgr.34373) 5283 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.393 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:30:53.620 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:30:53.620 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (99m) 3m ago 104m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:30:53.621 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (104m) 2m ago 104m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:30:53.621 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (99m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:30:53.621 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (99m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:30:53.621 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:30:53.622 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:30:53.622 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (98m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:30:53.622 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:30:53.622 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (104m) 3m ago 104m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:30:53.623 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (104m) 2m ago 104m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:30:53.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:30:53.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:30:53.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:30:53.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:30:53.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:30:53.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:30:53.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:30:53.625 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:30:53.625 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (104m) 2m ago 104m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:30:53.625 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 102m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:30:53.870 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:30:53.871 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:30:53.871 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:53.871 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:30:53.871 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:30:53.872 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:53.872 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:30:53.872 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:30:53.872 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:30:53.873 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:30:53.873 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:30:53.873 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:30:53.873 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:30:53.873 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:30:53.874 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:30:54.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:53 gibba003 bash[31385]: audit 2021-03-10T15:30:53.868830+0000 mon.c (mon.1) 1385 : audit [DBG] from='client.? 172.21.2.103:0/2126798069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:54.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:53 gibba003 bash[32348]: audit 2021-03-10T15:30:53.868830+0000 mon.c (mon.1) 1385 : audit [DBG] from='client.? 172.21.2.103:0/2126798069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:54.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:53 gibba043 bash[24019]: audit 2021-03-10T15:30:53.868830+0000 mon.c (mon.1) 1385 : audit [DBG] from='client.? 172.21.2.103:0/2126798069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:54 gibba003 bash[31385]: audit 2021-03-10T15:30:53.381709+0000 mgr.gibba043.dnkmem (mgr.34373) 5284 : audit [DBG] from='client.57586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:54 gibba003 bash[31385]: cluster 2021-03-10T15:30:53.499848+0000 mgr.gibba043.dnkmem (mgr.34373) 5285 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:55.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:54 gibba003 bash[31385]: audit 2021-03-10T15:30:53.604156+0000 mgr.gibba043.dnkmem (mgr.34373) 5286 : audit [DBG] from='client.57592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:55.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:54 gibba003 bash[32348]: audit 2021-03-10T15:30:53.381709+0000 mgr.gibba043.dnkmem (mgr.34373) 5284 : audit [DBG] from='client.57586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:55.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:54 gibba003 bash[32348]: cluster 2021-03-10T15:30:53.499848+0000 mgr.gibba043.dnkmem (mgr.34373) 5285 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:55.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:54 gibba003 bash[32348]: audit 2021-03-10T15:30:53.604156+0000 mgr.gibba043.dnkmem (mgr.34373) 5286 : audit [DBG] from='client.57592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:54 gibba043 bash[24019]: audit 2021-03-10T15:30:53.381709+0000 mgr.gibba043.dnkmem (mgr.34373) 5284 : audit [DBG] from='client.57586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:54 gibba043 bash[24019]: cluster 2021-03-10T15:30:53.499848+0000 mgr.gibba043.dnkmem (mgr.34373) 5285 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:54 gibba043 bash[24019]: audit 2021-03-10T15:30:53.604156+0000 mgr.gibba043.dnkmem (mgr.34373) 5286 : audit [DBG] from='client.57592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:56 gibba003 bash[31385]: cluster 2021-03-10T15:30:55.501350+0000 mgr.gibba043.dnkmem (mgr.34373) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:56 gibba003 bash[31385]: cephadm 2021-03-10T15:30:55.828755+0000 mgr.gibba043.dnkmem (mgr.34373) 5288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:57.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:56 gibba003 bash[32348]: cluster 2021-03-10T15:30:55.501350+0000 mgr.gibba043.dnkmem (mgr.34373) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:56 gibba003 bash[32348]: cephadm 2021-03-10T15:30:55.828755+0000 mgr.gibba043.dnkmem (mgr.34373) 5288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:56 gibba043 bash[24019]: cluster 2021-03-10T15:30:55.501350+0000 mgr.gibba043.dnkmem (mgr.34373) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:56 gibba043 bash[24019]: cephadm 2021-03-10T15:30:55.828755+0000 mgr.gibba043.dnkmem (mgr.34373) 5288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:30:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:30:58 gibba003 bash[31385]: cluster 2021-03-10T15:30:57.502942+0000 mgr.gibba043.dnkmem (mgr.34373) 5289 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:30:58 gibba003 bash[32348]: cluster 2021-03-10T15:30:57.502942+0000 mgr.gibba043.dnkmem (mgr.34373) 5289 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:30:58 gibba043 bash[24019]: cluster 2021-03-10T15:30:57.502942+0000 mgr.gibba043.dnkmem (mgr.34373) 5289 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:00 gibba043 bash[24019]: cluster 2021-03-10T15:30:59.504465+0000 mgr.gibba043.dnkmem (mgr.34373) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:01.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:00 gibba003 bash[31385]: cluster 2021-03-10T15:30:59.504465+0000 mgr.gibba043.dnkmem (mgr.34373) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:01.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:00 gibba003 bash[32348]: cluster 2021-03-10T15:30:59.504465+0000 mgr.gibba043.dnkmem (mgr.34373) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:02 gibba043 bash[24019]: cluster 2021-03-10T15:31:01.505378+0000 mgr.gibba043.dnkmem (mgr.34373) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:02 gibba003 bash[31385]: cluster 2021-03-10T15:31:01.505378+0000 mgr.gibba043.dnkmem (mgr.34373) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:02 gibba003 bash[32348]: cluster 2021-03-10T15:31:01.505378+0000 mgr.gibba043.dnkmem (mgr.34373) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:04 gibba043 bash[24019]: cluster 2021-03-10T15:31:03.506572+0000 mgr.gibba043.dnkmem (mgr.34373) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:04 gibba003 bash[31385]: cluster 2021-03-10T15:31:03.506572+0000 mgr.gibba043.dnkmem (mgr.34373) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:04 gibba003 bash[32348]: cluster 2021-03-10T15:31:03.506572+0000 mgr.gibba043.dnkmem (mgr.34373) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:06 gibba043 bash[24019]: cluster 2021-03-10T15:31:05.508163+0000 mgr.gibba043.dnkmem (mgr.34373) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:06 gibba003 bash[31385]: cluster 2021-03-10T15:31:05.508163+0000 mgr.gibba043.dnkmem (mgr.34373) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:06 gibba003 bash[32348]: cluster 2021-03-10T15:31:05.508163+0000 mgr.gibba043.dnkmem (mgr.34373) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:08 gibba043 bash[24019]: cluster 2021-03-10T15:31:07.509526+0000 mgr.gibba043.dnkmem (mgr.34373) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:08 gibba003 bash[31385]: cluster 2021-03-10T15:31:07.509526+0000 mgr.gibba043.dnkmem (mgr.34373) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:08 gibba003 bash[32348]: cluster 2021-03-10T15:31:07.509526+0000 mgr.gibba043.dnkmem (mgr.34373) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:10 gibba043 bash[24019]: cluster 2021-03-10T15:31:09.511311+0000 mgr.gibba043.dnkmem (mgr.34373) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:10 gibba003 bash[32348]: cluster 2021-03-10T15:31:09.511311+0000 mgr.gibba043.dnkmem (mgr.34373) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:11.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:10 gibba003 bash[31385]: cluster 2021-03-10T15:31:09.511311+0000 mgr.gibba043.dnkmem (mgr.34373) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:12 gibba043 bash[24019]: cephadm 2021-03-10T15:31:10.844527+0000 mgr.gibba043.dnkmem (mgr.34373) 5296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:12.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:12 gibba003 bash[31385]: cephadm 2021-03-10T15:31:10.844527+0000 mgr.gibba043.dnkmem (mgr.34373) 5296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:12 gibba003 bash[32348]: cephadm 2021-03-10T15:31:10.844527+0000 mgr.gibba043.dnkmem (mgr.34373) 5296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:13 gibba043 bash[24019]: cluster 2021-03-10T15:31:11.512122+0000 mgr.gibba043.dnkmem (mgr.34373) 5297 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:13 gibba003 bash[31385]: cluster 2021-03-10T15:31:11.512122+0000 mgr.gibba043.dnkmem (mgr.34373) 5297 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:13 gibba003 bash[32348]: cluster 2021-03-10T15:31:11.512122+0000 mgr.gibba043.dnkmem (mgr.34373) 5297 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.352868+0000 mon.c (mon.1) 1386 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.353998+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.474647+0000 mon.c (mon.1) 1387 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.475793+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.552854+0000 mon.c (mon.1) 1388 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:31:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.553743+0000 mon.c (mon.1) 1389 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:31:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.554106+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:31:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.554679+0000 mon.c (mon.1) 1390 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.555905+0000 mon.c (mon.1) 1391 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.555957+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:31:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.557379+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:14 gibba043 bash[24019]: audit 2021-03-10T15:31:13.558274+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.352868+0000 mon.c (mon.1) 1386 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.353998+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.474647+0000 mon.c (mon.1) 1387 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.475793+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.552854+0000 mon.c (mon.1) 1388 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:31:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.553743+0000 mon.c (mon.1) 1389 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:31:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.554106+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:31:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.554679+0000 mon.c (mon.1) 1390 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.555905+0000 mon.c (mon.1) 1391 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.555957+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:31:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.557379+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[31385]: audit 2021-03-10T15:31:13.558274+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.352868+0000 mon.c (mon.1) 1386 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.353998+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.474647+0000 mon.c (mon.1) 1387 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.475793+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.552854+0000 mon.c (mon.1) 1388 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:31:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.553743+0000 mon.c (mon.1) 1389 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:31:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.554106+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:31:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.554679+0000 mon.c (mon.1) 1390 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.555905+0000 mon.c (mon.1) 1391 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.555957+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:31:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.557379+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:31:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:14 gibba003 bash[32348]: audit 2021-03-10T15:31:13.558274+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:31:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:15 gibba003 bash[31385]: cluster 2021-03-10T15:31:13.512756+0000 mgr.gibba043.dnkmem (mgr.34373) 5298 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:15 gibba003 bash[32348]: cluster 2021-03-10T15:31:13.512756+0000 mgr.gibba043.dnkmem (mgr.34373) 5298 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:15 gibba043 bash[24019]: cluster 2021-03-10T15:31:13.512756+0000 mgr.gibba043.dnkmem (mgr.34373) 5298 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:17 gibba003 bash[31385]: cluster 2021-03-10T15:31:15.514078+0000 mgr.gibba043.dnkmem (mgr.34373) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:17 gibba003 bash[32348]: cluster 2021-03-10T15:31:15.514078+0000 mgr.gibba043.dnkmem (mgr.34373) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:17 gibba043 bash[24019]: cluster 2021-03-10T15:31:15.514078+0000 mgr.gibba043.dnkmem (mgr.34373) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:19 gibba003 bash[31385]: cluster 2021-03-10T15:31:17.515742+0000 mgr.gibba043.dnkmem (mgr.34373) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:19 gibba003 bash[32348]: cluster 2021-03-10T15:31:17.515742+0000 mgr.gibba043.dnkmem (mgr.34373) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:19 gibba043 bash[24019]: cluster 2021-03-10T15:31:17.515742+0000 mgr.gibba043.dnkmem (mgr.34373) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:21.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:21 gibba003 bash[31385]: cluster 2021-03-10T15:31:19.517548+0000 mgr.gibba043.dnkmem (mgr.34373) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:21 gibba003 bash[32348]: cluster 2021-03-10T15:31:19.517548+0000 mgr.gibba043.dnkmem (mgr.34373) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:21 gibba043 bash[24019]: cluster 2021-03-10T15:31:19.517548+0000 mgr.gibba043.dnkmem (mgr.34373) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:23 gibba003 bash[31385]: cluster 2021-03-10T15:31:21.518329+0000 mgr.gibba043.dnkmem (mgr.34373) 5302 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:23 gibba003 bash[32348]: cluster 2021-03-10T15:31:21.518329+0000 mgr.gibba043.dnkmem (mgr.34373) 5302 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:23 gibba043 bash[24019]: cluster 2021-03-10T15:31:21.518329+0000 mgr.gibba043.dnkmem (mgr.34373) 5302 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:24.112 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:31:24.341 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:31:24.341 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (99m) 4m ago 105m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:31:24.341 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (104m) 2m ago 104m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:31:24.341 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (100m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:31:24.342 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (100m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:31:24.342 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:31:24.342 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:31:24.343 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (98m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:31:24.343 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (99m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:31:24.343 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (105m) 4m ago 105m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:31:24.343 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (105m) 2m ago 105m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:31:24.343 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:31:24.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:31:24.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:31:24.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:31:24.344 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:31:24.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:31:24.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:31:24.345 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:31:24.345 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (104m) 2m ago 105m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:31:24.345 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 103m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:31:24.593 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:31:24.594 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:31:24.594 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:24.595 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:31:24.595 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:31:24.595 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:24.595 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:31:24.596 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:31:24.596 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:31:24.596 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:31:24.596 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:31:24.597 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:31:24.597 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:31:24.597 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:31:24.597 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:31:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[31385]: cluster 2021-03-10T15:31:23.519815+0000 mgr.gibba043.dnkmem (mgr.34373) 5303 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[31385]: audit 2021-03-10T15:31:24.099486+0000 mgr.gibba043.dnkmem (mgr.34373) 5304 : audit [DBG] from='client.57604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:25.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[31385]: audit 2021-03-10T15:31:24.325162+0000 mgr.gibba043.dnkmem (mgr.34373) 5305 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:25.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[31385]: audit 2021-03-10T15:31:24.591996+0000 mon.a (mon.0) 1295 : audit [DBG] from='client.? 172.21.2.103:0/987432929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:25.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[32348]: cluster 2021-03-10T15:31:23.519815+0000 mgr.gibba043.dnkmem (mgr.34373) 5303 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[32348]: audit 2021-03-10T15:31:24.099486+0000 mgr.gibba043.dnkmem (mgr.34373) 5304 : audit [DBG] from='client.57604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[32348]: audit 2021-03-10T15:31:24.325162+0000 mgr.gibba043.dnkmem (mgr.34373) 5305 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:25.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:25 gibba003 bash[32348]: audit 2021-03-10T15:31:24.591996+0000 mon.a (mon.0) 1295 : audit [DBG] from='client.? 172.21.2.103:0/987432929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:25.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:25 gibba043 bash[24019]: cluster 2021-03-10T15:31:23.519815+0000 mgr.gibba043.dnkmem (mgr.34373) 5303 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:25.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:25 gibba043 bash[24019]: audit 2021-03-10T15:31:24.099486+0000 mgr.gibba043.dnkmem (mgr.34373) 5304 : audit [DBG] from='client.57604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:25.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:25 gibba043 bash[24019]: audit 2021-03-10T15:31:24.325162+0000 mgr.gibba043.dnkmem (mgr.34373) 5305 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:25.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:25 gibba043 bash[24019]: audit 2021-03-10T15:31:24.591996+0000 mon.a (mon.0) 1295 : audit [DBG] from='client.? 172.21.2.103:0/987432929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cluster 2021-03-10T15:31:25.521181+0000 mgr.gibba043.dnkmem (mgr.34373) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:25.861439+0000 mgr.gibba043.dnkmem (mgr.34373) 5307 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:31:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:25.862991+0000 mgr.gibba043.dnkmem (mgr.34373) 5308 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:31:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.087280+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:31:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.088615+0000 mgr.gibba043.dnkmem (mgr.34373) 5309 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.090717+0000 mgr.gibba043.dnkmem (mgr.34373) 5310 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.091198+0000 mon.c (mon.1) 1392 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:27.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.092404+0000 mgr.gibba043.dnkmem (mgr.34373) 5311 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:27.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.092440+0000 mgr.gibba043.dnkmem (mgr.34373) 5312 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:27.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.092812+0000 mon.c (mon.1) 1393 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.093943+0000 mgr.gibba043.dnkmem (mgr.34373) 5313 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:27.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.093979+0000 mgr.gibba043.dnkmem (mgr.34373) 5314 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:27.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.094638+0000 mon.c (mon.1) 1394 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.095510+0000 mgr.gibba043.dnkmem (mgr.34373) 5315 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:27.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.096167+0000 mon.c (mon.1) 1395 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.097701+0000 mgr.gibba043.dnkmem (mgr.34373) 5316 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:27.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.097737+0000 mgr.gibba043.dnkmem (mgr.34373) 5317 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:27.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.099392+0000 mgr.gibba043.dnkmem (mgr.34373) 5318 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:27.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.099756+0000 mgr.gibba043.dnkmem (mgr.34373) 5319 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:27.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.100090+0000 mon.c (mon.1) 1396 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.101700+0000 mgr.gibba043.dnkmem (mgr.34373) 5320 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:27.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.101736+0000 mgr.gibba043.dnkmem (mgr.34373) 5321 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:27.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: cephadm 2021-03-10T15:31:26.101841+0000 mgr.gibba043.dnkmem (mgr.34373) 5322 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:27.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[31385]: audit 2021-03-10T15:31:26.102008+0000 mon.c (mon.1) 1397 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cluster 2021-03-10T15:31:25.521181+0000 mgr.gibba043.dnkmem (mgr.34373) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:27.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:25.861439+0000 mgr.gibba043.dnkmem (mgr.34373) 5307 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:31:27.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:25.862991+0000 mgr.gibba043.dnkmem (mgr.34373) 5308 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:31:27.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.087280+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:31:27.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.088615+0000 mgr.gibba043.dnkmem (mgr.34373) 5309 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:27.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.090717+0000 mgr.gibba043.dnkmem (mgr.34373) 5310 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:27.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.091198+0000 mon.c (mon.1) 1392 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:27.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.092404+0000 mgr.gibba043.dnkmem (mgr.34373) 5311 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:27.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.092440+0000 mgr.gibba043.dnkmem (mgr.34373) 5312 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:27.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.092812+0000 mon.c (mon.1) 1393 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.093943+0000 mgr.gibba043.dnkmem (mgr.34373) 5313 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:27.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.093979+0000 mgr.gibba043.dnkmem (mgr.34373) 5314 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:27.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.094638+0000 mon.c (mon.1) 1394 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.095510+0000 mgr.gibba043.dnkmem (mgr.34373) 5315 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:27.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.096167+0000 mon.c (mon.1) 1395 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.097701+0000 mgr.gibba043.dnkmem (mgr.34373) 5316 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:27.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.097737+0000 mgr.gibba043.dnkmem (mgr.34373) 5317 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:27.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.099392+0000 mgr.gibba043.dnkmem (mgr.34373) 5318 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:27.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.099756+0000 mgr.gibba043.dnkmem (mgr.34373) 5319 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:27.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.100090+0000 mon.c (mon.1) 1396 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.101700+0000 mgr.gibba043.dnkmem (mgr.34373) 5320 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:27.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.101736+0000 mgr.gibba043.dnkmem (mgr.34373) 5321 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:27.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: cephadm 2021-03-10T15:31:26.101841+0000 mgr.gibba043.dnkmem (mgr.34373) 5322 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:27.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:27 gibba003 bash[32348]: audit 2021-03-10T15:31:26.102008+0000 mon.c (mon.1) 1397 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cluster 2021-03-10T15:31:25.521181+0000 mgr.gibba043.dnkmem (mgr.34373) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:25.861439+0000 mgr.gibba043.dnkmem (mgr.34373) 5307 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:31:27.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:25.862991+0000 mgr.gibba043.dnkmem (mgr.34373) 5308 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:31:27.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.087280+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:31:27.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.088615+0000 mgr.gibba043.dnkmem (mgr.34373) 5309 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:27.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.090717+0000 mgr.gibba043.dnkmem (mgr.34373) 5310 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:27.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.091198+0000 mon.c (mon.1) 1392 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:27.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.092404+0000 mgr.gibba043.dnkmem (mgr.34373) 5311 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:27.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.092440+0000 mgr.gibba043.dnkmem (mgr.34373) 5312 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:27.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.092812+0000 mon.c (mon.1) 1393 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.093943+0000 mgr.gibba043.dnkmem (mgr.34373) 5313 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:27.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.093979+0000 mgr.gibba043.dnkmem (mgr.34373) 5314 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:27.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.094638+0000 mon.c (mon.1) 1394 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.095510+0000 mgr.gibba043.dnkmem (mgr.34373) 5315 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:27.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.096167+0000 mon.c (mon.1) 1395 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.097701+0000 mgr.gibba043.dnkmem (mgr.34373) 5316 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:27.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.097737+0000 mgr.gibba043.dnkmem (mgr.34373) 5317 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:27.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.099392+0000 mgr.gibba043.dnkmem (mgr.34373) 5318 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:27.530 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.099756+0000 mgr.gibba043.dnkmem (mgr.34373) 5319 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:27.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.100090+0000 mon.c (mon.1) 1396 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:27.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.101700+0000 mgr.gibba043.dnkmem (mgr.34373) 5320 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:27.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.101736+0000 mgr.gibba043.dnkmem (mgr.34373) 5321 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:27.531 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: cephadm 2021-03-10T15:31:26.101841+0000 mgr.gibba043.dnkmem (mgr.34373) 5322 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:27.532 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:27 gibba043 bash[24019]: audit 2021-03-10T15:31:26.102008+0000 mon.c (mon.1) 1397 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:29 gibba003 bash[31385]: cluster 2021-03-10T15:31:27.522629+0000 mgr.gibba043.dnkmem (mgr.34373) 5323 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:29 gibba003 bash[32348]: cluster 2021-03-10T15:31:27.522629+0000 mgr.gibba043.dnkmem (mgr.34373) 5323 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:29 gibba043 bash[24019]: cluster 2021-03-10T15:31:27.522629+0000 mgr.gibba043.dnkmem (mgr.34373) 5323 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:31 gibba003 bash[31385]: cluster 2021-03-10T15:31:29.524319+0000 mgr.gibba043.dnkmem (mgr.34373) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:31.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:31 gibba003 bash[32348]: cluster 2021-03-10T15:31:29.524319+0000 mgr.gibba043.dnkmem (mgr.34373) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:31 gibba043 bash[24019]: cluster 2021-03-10T15:31:29.524319+0000 mgr.gibba043.dnkmem (mgr.34373) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:33 gibba003 bash[31385]: cluster 2021-03-10T15:31:31.525577+0000 mgr.gibba043.dnkmem (mgr.34373) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:33 gibba003 bash[32348]: cluster 2021-03-10T15:31:31.525577+0000 mgr.gibba043.dnkmem (mgr.34373) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:33 gibba043 bash[24019]: cluster 2021-03-10T15:31:31.525577+0000 mgr.gibba043.dnkmem (mgr.34373) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:35 gibba003 bash[31385]: cluster 2021-03-10T15:31:33.527052+0000 mgr.gibba043.dnkmem (mgr.34373) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:35 gibba003 bash[32348]: cluster 2021-03-10T15:31:33.527052+0000 mgr.gibba043.dnkmem (mgr.34373) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:35 gibba043 bash[24019]: cluster 2021-03-10T15:31:33.527052+0000 mgr.gibba043.dnkmem (mgr.34373) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:37 gibba003 bash[31385]: cluster 2021-03-10T15:31:35.528494+0000 mgr.gibba043.dnkmem (mgr.34373) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:37 gibba003 bash[32348]: cluster 2021-03-10T15:31:35.528494+0000 mgr.gibba043.dnkmem (mgr.34373) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:37 gibba043 bash[24019]: cluster 2021-03-10T15:31:35.528494+0000 mgr.gibba043.dnkmem (mgr.34373) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:39 gibba003 bash[31385]: cluster 2021-03-10T15:31:37.529869+0000 mgr.gibba043.dnkmem (mgr.34373) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:39 gibba003 bash[32348]: cluster 2021-03-10T15:31:37.529869+0000 mgr.gibba043.dnkmem (mgr.34373) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:39 gibba043 bash[24019]: cluster 2021-03-10T15:31:37.529869+0000 mgr.gibba043.dnkmem (mgr.34373) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:41 gibba003 bash[31385]: cluster 2021-03-10T15:31:39.531836+0000 mgr.gibba043.dnkmem (mgr.34373) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:41 gibba003 bash[32348]: cluster 2021-03-10T15:31:39.531836+0000 mgr.gibba043.dnkmem (mgr.34373) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:41 gibba043 bash[24019]: cluster 2021-03-10T15:31:39.531836+0000 mgr.gibba043.dnkmem (mgr.34373) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:42.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:42 gibba003 bash[31385]: cephadm 2021-03-10T15:31:41.117952+0000 mgr.gibba043.dnkmem (mgr.34373) 5330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:42 gibba003 bash[32348]: cephadm 2021-03-10T15:31:41.117952+0000 mgr.gibba043.dnkmem (mgr.34373) 5330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:42.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:42 gibba043 bash[24019]: cephadm 2021-03-10T15:31:41.117952+0000 mgr.gibba043.dnkmem (mgr.34373) 5330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:43 gibba003 bash[31385]: cluster 2021-03-10T15:31:41.532853+0000 mgr.gibba043.dnkmem (mgr.34373) 5331 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:43 gibba003 bash[32348]: cluster 2021-03-10T15:31:41.532853+0000 mgr.gibba043.dnkmem (mgr.34373) 5331 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:43 gibba043 bash[24019]: cluster 2021-03-10T15:31:41.532853+0000 mgr.gibba043.dnkmem (mgr.34373) 5331 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:45 gibba003 bash[31385]: cluster 2021-03-10T15:31:43.534273+0000 mgr.gibba043.dnkmem (mgr.34373) 5332 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:45 gibba003 bash[32348]: cluster 2021-03-10T15:31:43.534273+0000 mgr.gibba043.dnkmem (mgr.34373) 5332 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:45 gibba043 bash[24019]: cluster 2021-03-10T15:31:43.534273+0000 mgr.gibba043.dnkmem (mgr.34373) 5332 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:47 gibba003 bash[31385]: cluster 2021-03-10T15:31:45.535712+0000 mgr.gibba043.dnkmem (mgr.34373) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:47 gibba003 bash[32348]: cluster 2021-03-10T15:31:45.535712+0000 mgr.gibba043.dnkmem (mgr.34373) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:47 gibba043 bash[24019]: cluster 2021-03-10T15:31:45.535712+0000 mgr.gibba043.dnkmem (mgr.34373) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:49.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:49 gibba043 bash[24019]: cluster 2021-03-10T15:31:47.536195+0000 mgr.gibba043.dnkmem (mgr.34373) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:49 gibba003 bash[31385]: cluster 2021-03-10T15:31:47.536195+0000 mgr.gibba043.dnkmem (mgr.34373) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:49 gibba003 bash[32348]: cluster 2021-03-10T15:31:47.536195+0000 mgr.gibba043.dnkmem (mgr.34373) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:51 gibba043 bash[24019]: cluster 2021-03-10T15:31:49.537551+0000 mgr.gibba043.dnkmem (mgr.34373) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:51.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:51 gibba003 bash[31385]: cluster 2021-03-10T15:31:49.537551+0000 mgr.gibba043.dnkmem (mgr.34373) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:51.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:51 gibba003 bash[32348]: cluster 2021-03-10T15:31:49.537551+0000 mgr.gibba043.dnkmem (mgr.34373) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:53 gibba043 bash[24019]: cluster 2021-03-10T15:31:51.538740+0000 mgr.gibba043.dnkmem (mgr.34373) 5336 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:53 gibba003 bash[31385]: cluster 2021-03-10T15:31:51.538740+0000 mgr.gibba043.dnkmem (mgr.34373) 5336 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:53 gibba003 bash[32348]: cluster 2021-03-10T15:31:51.538740+0000 mgr.gibba043.dnkmem (mgr.34373) 5336 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:54.832 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:31:55.087 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:31:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (100m) 4m ago 105m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:31:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (105m) 3m ago 105m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:31:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (100m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:31:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (100m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:31:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:31:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:31:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (99m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:31:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (99m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:31:55.090 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (105m) 4m ago 105m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:31:55.090 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (105m) 3m ago 105m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:31:55.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:31:55.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:31:55.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:31:55.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:31:55.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:31:55.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:31:55.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:31:55.092 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:31:55.092 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (105m) 3m ago 105m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:31:55.092 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 103m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:31:55.346 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:31:55.346 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:31:55.346 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:55.346 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:31:55.347 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:31:55.347 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:55.347 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:31:55.347 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:31:55.348 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:31:55.348 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:31:55.348 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:31:55.348 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:31:55.349 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:31:55.349 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:31:55.349 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:31:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:55 gibba043 bash[24019]: cluster 2021-03-10T15:31:53.540229+0000 mgr.gibba043.dnkmem (mgr.34373) 5337 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:55 gibba003 bash[31385]: cluster 2021-03-10T15:31:53.540229+0000 mgr.gibba043.dnkmem (mgr.34373) 5337 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:55 gibba003 bash[32348]: cluster 2021-03-10T15:31:53.540229+0000 mgr.gibba043.dnkmem (mgr.34373) 5337 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:56.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:56 gibba043 bash[24019]: audit 2021-03-10T15:31:54.819544+0000 mgr.gibba043.dnkmem (mgr.34373) 5338 : audit [DBG] from='client.57622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:56.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:56 gibba043 bash[24019]: audit 2021-03-10T15:31:55.043956+0000 mgr.gibba043.dnkmem (mgr.34373) 5339 : audit [DBG] from='client.57628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:56.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:56 gibba043 bash[24019]: audit 2021-03-10T15:31:55.344075+0000 mon.c (mon.1) 1398 : audit [DBG] from='client.? 172.21.2.103:0/3567645730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:56 gibba003 bash[31385]: audit 2021-03-10T15:31:54.819544+0000 mgr.gibba043.dnkmem (mgr.34373) 5338 : audit [DBG] from='client.57622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:56 gibba003 bash[31385]: audit 2021-03-10T15:31:55.043956+0000 mgr.gibba043.dnkmem (mgr.34373) 5339 : audit [DBG] from='client.57628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:56 gibba003 bash[31385]: audit 2021-03-10T15:31:55.344075+0000 mon.c (mon.1) 1398 : audit [DBG] from='client.? 172.21.2.103:0/3567645730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:56.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:56 gibba003 bash[32348]: audit 2021-03-10T15:31:54.819544+0000 mgr.gibba043.dnkmem (mgr.34373) 5338 : audit [DBG] from='client.57622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:56.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:56 gibba003 bash[32348]: audit 2021-03-10T15:31:55.043956+0000 mgr.gibba043.dnkmem (mgr.34373) 5339 : audit [DBG] from='client.57628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:56.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:56 gibba003 bash[32348]: audit 2021-03-10T15:31:55.344075+0000 mon.c (mon.1) 1398 : audit [DBG] from='client.? 172.21.2.103:0/3567645730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:57 gibba043 bash[24019]: cluster 2021-03-10T15:31:55.540722+0000 mgr.gibba043.dnkmem (mgr.34373) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:57 gibba043 bash[24019]: cephadm 2021-03-10T15:31:56.128845+0000 mgr.gibba043.dnkmem (mgr.34373) 5341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:57 gibba003 bash[31385]: cluster 2021-03-10T15:31:55.540722+0000 mgr.gibba043.dnkmem (mgr.34373) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:57 gibba003 bash[31385]: cephadm 2021-03-10T15:31:56.128845+0000 mgr.gibba043.dnkmem (mgr.34373) 5341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:57.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:57 gibba003 bash[32348]: cluster 2021-03-10T15:31:55.540722+0000 mgr.gibba043.dnkmem (mgr.34373) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:57.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:57 gibba003 bash[32348]: cephadm 2021-03-10T15:31:56.128845+0000 mgr.gibba043.dnkmem (mgr.34373) 5341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:31:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:31:59 gibba043 bash[24019]: cluster 2021-03-10T15:31:57.542089+0000 mgr.gibba043.dnkmem (mgr.34373) 5342 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:31:59 gibba003 bash[31385]: cluster 2021-03-10T15:31:57.542089+0000 mgr.gibba043.dnkmem (mgr.34373) 5342 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:31:59 gibba003 bash[32348]: cluster 2021-03-10T15:31:57.542089+0000 mgr.gibba043.dnkmem (mgr.34373) 5342 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:01 gibba043 bash[24019]: cluster 2021-03-10T15:31:59.543795+0000 mgr.gibba043.dnkmem (mgr.34373) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:01 gibba003 bash[31385]: cluster 2021-03-10T15:31:59.543795+0000 mgr.gibba043.dnkmem (mgr.34373) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:01 gibba003 bash[32348]: cluster 2021-03-10T15:31:59.543795+0000 mgr.gibba043.dnkmem (mgr.34373) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:03 gibba003 bash[31385]: cluster 2021-03-10T15:32:01.545238+0000 mgr.gibba043.dnkmem (mgr.34373) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:03 gibba003 bash[32348]: cluster 2021-03-10T15:32:01.545238+0000 mgr.gibba043.dnkmem (mgr.34373) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:03 gibba043 bash[24019]: cluster 2021-03-10T15:32:01.545238+0000 mgr.gibba043.dnkmem (mgr.34373) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:05 gibba003 bash[31385]: cluster 2021-03-10T15:32:03.545759+0000 mgr.gibba043.dnkmem (mgr.34373) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:05 gibba003 bash[32348]: cluster 2021-03-10T15:32:03.545759+0000 mgr.gibba043.dnkmem (mgr.34373) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:05.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:05 gibba043 bash[24019]: cluster 2021-03-10T15:32:03.545759+0000 mgr.gibba043.dnkmem (mgr.34373) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:07 gibba003 bash[31385]: cluster 2021-03-10T15:32:05.547055+0000 mgr.gibba043.dnkmem (mgr.34373) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:07 gibba003 bash[32348]: cluster 2021-03-10T15:32:05.547055+0000 mgr.gibba043.dnkmem (mgr.34373) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:07 gibba043 bash[24019]: cluster 2021-03-10T15:32:05.547055+0000 mgr.gibba043.dnkmem (mgr.34373) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:09 gibba003 bash[31385]: cluster 2021-03-10T15:32:07.548686+0000 mgr.gibba043.dnkmem (mgr.34373) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:09 gibba003 bash[32348]: cluster 2021-03-10T15:32:07.548686+0000 mgr.gibba043.dnkmem (mgr.34373) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:09.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:09 gibba043 bash[24019]: cluster 2021-03-10T15:32:07.548686+0000 mgr.gibba043.dnkmem (mgr.34373) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:11 gibba043 bash[24019]: cluster 2021-03-10T15:32:09.550462+0000 mgr.gibba043.dnkmem (mgr.34373) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:11 gibba003 bash[31385]: cluster 2021-03-10T15:32:09.550462+0000 mgr.gibba043.dnkmem (mgr.34373) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:11 gibba003 bash[32348]: cluster 2021-03-10T15:32:09.550462+0000 mgr.gibba043.dnkmem (mgr.34373) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:12.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:12 gibba003 bash[31385]: cephadm 2021-03-10T15:32:11.144914+0000 mgr.gibba043.dnkmem (mgr.34373) 5349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:12.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:12 gibba003 bash[32348]: cephadm 2021-03-10T15:32:11.144914+0000 mgr.gibba043.dnkmem (mgr.34373) 5349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:12.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:12 gibba043 bash[24019]: cephadm 2021-03-10T15:32:11.144914+0000 mgr.gibba043.dnkmem (mgr.34373) 5349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:13 gibba003 bash[31385]: cluster 2021-03-10T15:32:11.552005+0000 mgr.gibba043.dnkmem (mgr.34373) 5350 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:13 gibba003 bash[32348]: cluster 2021-03-10T15:32:11.552005+0000 mgr.gibba043.dnkmem (mgr.34373) 5350 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:13 gibba043 bash[24019]: cluster 2021-03-10T15:32:11.552005+0000 mgr.gibba043.dnkmem (mgr.34373) 5350 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.358580+0000 mon.c (mon.1) 1399 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.359023+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.483318+0000 mon.c (mon.1) 1400 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.484470+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.565277+0000 mon.c (mon.1) 1401 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:32:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.566125+0000 mon.c (mon.1) 1402 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.566431+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:32:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.567075+0000 mon.c (mon.1) 1403 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:32:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.567741+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.568220+0000 mon.c (mon.1) 1404 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.568735+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:32:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[31385]: audit 2021-03-10T15:32:13.569688+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.358580+0000 mon.c (mon.1) 1399 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.359023+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.483318+0000 mon.c (mon.1) 1400 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.484470+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.565277+0000 mon.c (mon.1) 1401 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:32:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.566125+0000 mon.c (mon.1) 1402 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.566431+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:32:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.567075+0000 mon.c (mon.1) 1403 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:32:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.567741+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.568220+0000 mon.c (mon.1) 1404 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.568735+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:32:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:14 gibba003 bash[32348]: audit 2021-03-10T15:32:13.569688+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.358580+0000 mon.c (mon.1) 1399 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.359023+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.483318+0000 mon.c (mon.1) 1400 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.484470+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.565277+0000 mon.c (mon.1) 1401 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:32:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.566125+0000 mon.c (mon.1) 1402 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.566431+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:32:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.567075+0000 mon.c (mon.1) 1403 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:32:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.567741+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.568220+0000 mon.c (mon.1) 1404 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.568735+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:32:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:14 gibba043 bash[24019]: audit 2021-03-10T15:32:13.569688+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:15 gibba003 bash[31385]: cluster 2021-03-10T15:32:13.553585+0000 mgr.gibba043.dnkmem (mgr.34373) 5351 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:15.774 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:15 gibba003 bash[32348]: cluster 2021-03-10T15:32:13.553585+0000 mgr.gibba043.dnkmem (mgr.34373) 5351 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:15 gibba043 bash[24019]: cluster 2021-03-10T15:32:13.553585+0000 mgr.gibba043.dnkmem (mgr.34373) 5351 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:17 gibba003 bash[31385]: cluster 2021-03-10T15:32:15.555105+0000 mgr.gibba043.dnkmem (mgr.34373) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:17 gibba003 bash[32348]: cluster 2021-03-10T15:32:15.555105+0000 mgr.gibba043.dnkmem (mgr.34373) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:17 gibba043 bash[24019]: cluster 2021-03-10T15:32:15.555105+0000 mgr.gibba043.dnkmem (mgr.34373) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:19 gibba003 bash[31385]: cluster 2021-03-10T15:32:17.556787+0000 mgr.gibba043.dnkmem (mgr.34373) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:19 gibba003 bash[32348]: cluster 2021-03-10T15:32:17.556787+0000 mgr.gibba043.dnkmem (mgr.34373) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:19 gibba043 bash[24019]: cluster 2021-03-10T15:32:17.556787+0000 mgr.gibba043.dnkmem (mgr.34373) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:21.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:21 gibba003 bash[31385]: cluster 2021-03-10T15:32:19.557441+0000 mgr.gibba043.dnkmem (mgr.34373) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:21 gibba003 bash[32348]: cluster 2021-03-10T15:32:19.557441+0000 mgr.gibba043.dnkmem (mgr.34373) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:21.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:21 gibba043 bash[24019]: cluster 2021-03-10T15:32:19.557441+0000 mgr.gibba043.dnkmem (mgr.34373) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:23 gibba003 bash[31385]: cluster 2021-03-10T15:32:21.558737+0000 mgr.gibba043.dnkmem (mgr.34373) 5355 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:23 gibba003 bash[32348]: cluster 2021-03-10T15:32:21.558737+0000 mgr.gibba043.dnkmem (mgr.34373) 5355 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:23 gibba043 bash[24019]: cluster 2021-03-10T15:32:21.558737+0000 mgr.gibba043.dnkmem (mgr.34373) 5355 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:25.590 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:32:25.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:25 gibba003 bash[31385]: cluster 2021-03-10T15:32:23.560150+0000 mgr.gibba043.dnkmem (mgr.34373) 5356 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:25 gibba003 bash[32348]: cluster 2021-03-10T15:32:23.560150+0000 mgr.gibba043.dnkmem (mgr.34373) 5356 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:25.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:25 gibba043 bash[24019]: cluster 2021-03-10T15:32:23.560150+0000 mgr.gibba043.dnkmem (mgr.34373) 5356 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:25.819 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:32:25.820 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (100m) 5m ago 106m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:32:25.820 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (105m) 4m ago 105m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:32:25.820 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (101m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:32:25.820 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (101m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:32:25.821 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:32:25.821 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:32:25.821 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (99m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:32:25.821 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (100m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:32:25.822 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (106m) 5m ago 106m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:32:25.822 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (106m) 4m ago 106m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:32:25.822 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:32:25.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:32:25.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:32:25.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:32:25.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:32:25.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:32:25.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:32:25.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (96m) 4m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:32:25.824 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (105m) 4m ago 106m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:32:25.824 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 104m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:32:26.068 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:32:26.068 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:32:26.068 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:26.068 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:32:26.069 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:32:26.069 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:26.069 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:32:26.069 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:32:26.070 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:32:26.070 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:32:26.070 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:32:26.070 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:32:26.071 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:32:26.071 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:32:26.071 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:32:26.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.065897+0000 mon.c (mon.1) 1405 : audit [DBG] from='client.? 172.21.2.103:0/2218532088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.362750+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:32:26.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.366642+0000 mon.c (mon.1) 1406 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:26.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.368335+0000 mon.c (mon.1) 1407 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.369960+0000 mon.c (mon.1) 1408 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.371355+0000 mon.c (mon.1) 1409 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.374878+0000 mon.c (mon.1) 1410 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[31385]: audit 2021-03-10T15:32:26.376366+0000 mon.c (mon.1) 1411 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.065897+0000 mon.c (mon.1) 1405 : audit [DBG] from='client.? 172.21.2.103:0/2218532088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.362750+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:32:26.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.366642+0000 mon.c (mon.1) 1406 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:26.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.368335+0000 mon.c (mon.1) 1407 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.369960+0000 mon.c (mon.1) 1408 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.371355+0000 mon.c (mon.1) 1409 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.374878+0000 mon.c (mon.1) 1410 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:26 gibba003 bash[32348]: audit 2021-03-10T15:32:26.376366+0000 mon.c (mon.1) 1411 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.065897+0000 mon.c (mon.1) 1405 : audit [DBG] from='client.? 172.21.2.103:0/2218532088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.362750+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:32:26.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.366642+0000 mon.c (mon.1) 1406 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:26.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.368335+0000 mon.c (mon.1) 1407 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.369960+0000 mon.c (mon.1) 1408 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.371355+0000 mon.c (mon.1) 1409 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.374878+0000 mon.c (mon.1) 1410 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:26.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:26 gibba043 bash[24019]: audit 2021-03-10T15:32:26.376366+0000 mon.c (mon.1) 1411 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cluster 2021-03-10T15:32:25.561659+0000 mgr.gibba043.dnkmem (mgr.34373) 5357 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: audit 2021-03-10T15:32:25.578044+0000 mgr.gibba043.dnkmem (mgr.34373) 5358 : audit [DBG] from='client.57640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: audit 2021-03-10T15:32:25.803797+0000 mgr.gibba043.dnkmem (mgr.34373) 5359 : audit [DBG] from='client.57646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.156939+0000 mgr.gibba043.dnkmem (mgr.34373) 5360 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:32:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.158527+0000 mgr.gibba043.dnkmem (mgr.34373) 5361 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:32:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.364108+0000 mgr.gibba043.dnkmem (mgr.34373) 5362 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.366189+0000 mgr.gibba043.dnkmem (mgr.34373) 5363 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.367752+0000 mgr.gibba043.dnkmem (mgr.34373) 5364 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:27.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.367789+0000 mgr.gibba043.dnkmem (mgr.34373) 5365 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.369309+0000 mgr.gibba043.dnkmem (mgr.34373) 5366 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.369361+0000 mgr.gibba043.dnkmem (mgr.34373) 5367 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.370752+0000 mgr.gibba043.dnkmem (mgr.34373) 5368 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:27.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.372523+0000 mgr.gibba043.dnkmem (mgr.34373) 5369 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:27.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.372559+0000 mgr.gibba043.dnkmem (mgr.34373) 5370 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:27.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.374078+0000 mgr.gibba043.dnkmem (mgr.34373) 5371 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:27.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.374396+0000 mgr.gibba043.dnkmem (mgr.34373) 5372 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:27.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.375504+0000 mgr.gibba043.dnkmem (mgr.34373) 5373 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:27.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.375541+0000 mgr.gibba043.dnkmem (mgr.34373) 5374 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:27.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[31385]: cephadm 2021-03-10T15:32:26.375676+0000 mgr.gibba043.dnkmem (mgr.34373) 5375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cluster 2021-03-10T15:32:25.561659+0000 mgr.gibba043.dnkmem (mgr.34373) 5357 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: audit 2021-03-10T15:32:25.578044+0000 mgr.gibba043.dnkmem (mgr.34373) 5358 : audit [DBG] from='client.57640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: audit 2021-03-10T15:32:25.803797+0000 mgr.gibba043.dnkmem (mgr.34373) 5359 : audit [DBG] from='client.57646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.156939+0000 mgr.gibba043.dnkmem (mgr.34373) 5360 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:32:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.158527+0000 mgr.gibba043.dnkmem (mgr.34373) 5361 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:32:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.364108+0000 mgr.gibba043.dnkmem (mgr.34373) 5362 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.366189+0000 mgr.gibba043.dnkmem (mgr.34373) 5363 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.367752+0000 mgr.gibba043.dnkmem (mgr.34373) 5364 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.367789+0000 mgr.gibba043.dnkmem (mgr.34373) 5365 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.369309+0000 mgr.gibba043.dnkmem (mgr.34373) 5366 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.369361+0000 mgr.gibba043.dnkmem (mgr.34373) 5367 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.370752+0000 mgr.gibba043.dnkmem (mgr.34373) 5368 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.372523+0000 mgr.gibba043.dnkmem (mgr.34373) 5369 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.372559+0000 mgr.gibba043.dnkmem (mgr.34373) 5370 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.374078+0000 mgr.gibba043.dnkmem (mgr.34373) 5371 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:27.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.374396+0000 mgr.gibba043.dnkmem (mgr.34373) 5372 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:27.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.375504+0000 mgr.gibba043.dnkmem (mgr.34373) 5373 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:27.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.375541+0000 mgr.gibba043.dnkmem (mgr.34373) 5374 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:27.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:27 gibba003 bash[32348]: cephadm 2021-03-10T15:32:26.375676+0000 mgr.gibba043.dnkmem (mgr.34373) 5375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cluster 2021-03-10T15:32:25.561659+0000 mgr.gibba043.dnkmem (mgr.34373) 5357 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: audit 2021-03-10T15:32:25.578044+0000 mgr.gibba043.dnkmem (mgr.34373) 5358 : audit [DBG] from='client.57640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: audit 2021-03-10T15:32:25.803797+0000 mgr.gibba043.dnkmem (mgr.34373) 5359 : audit [DBG] from='client.57646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.156939+0000 mgr.gibba043.dnkmem (mgr.34373) 5360 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:32:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.158527+0000 mgr.gibba043.dnkmem (mgr.34373) 5361 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:32:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.364108+0000 mgr.gibba043.dnkmem (mgr.34373) 5362 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.366189+0000 mgr.gibba043.dnkmem (mgr.34373) 5363 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.367752+0000 mgr.gibba043.dnkmem (mgr.34373) 5364 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:27.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.367789+0000 mgr.gibba043.dnkmem (mgr.34373) 5365 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:27.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.369309+0000 mgr.gibba043.dnkmem (mgr.34373) 5366 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:27.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.369361+0000 mgr.gibba043.dnkmem (mgr.34373) 5367 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:27.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.370752+0000 mgr.gibba043.dnkmem (mgr.34373) 5368 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:27.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.372523+0000 mgr.gibba043.dnkmem (mgr.34373) 5369 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:27.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.372559+0000 mgr.gibba043.dnkmem (mgr.34373) 5370 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:27.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.374078+0000 mgr.gibba043.dnkmem (mgr.34373) 5371 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:27.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.374396+0000 mgr.gibba043.dnkmem (mgr.34373) 5372 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:27.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.375504+0000 mgr.gibba043.dnkmem (mgr.34373) 5373 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:27.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.375541+0000 mgr.gibba043.dnkmem (mgr.34373) 5374 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:27.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:27 gibba043 bash[24019]: cephadm 2021-03-10T15:32:26.375676+0000 mgr.gibba043.dnkmem (mgr.34373) 5375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:28.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:28 gibba003 bash[31385]: cluster 2021-03-10T15:32:27.562234+0000 mgr.gibba043.dnkmem (mgr.34373) 5376 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:28.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:28 gibba003 bash[32348]: cluster 2021-03-10T15:32:27.562234+0000 mgr.gibba043.dnkmem (mgr.34373) 5376 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:28.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:28 gibba043 bash[24019]: cluster 2021-03-10T15:32:27.562234+0000 mgr.gibba043.dnkmem (mgr.34373) 5376 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:30 gibba003 bash[31385]: cluster 2021-03-10T15:32:29.563897+0000 mgr.gibba043.dnkmem (mgr.34373) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:30 gibba003 bash[32348]: cluster 2021-03-10T15:32:29.563897+0000 mgr.gibba043.dnkmem (mgr.34373) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:30 gibba043 bash[24019]: cluster 2021-03-10T15:32:29.563897+0000 mgr.gibba043.dnkmem (mgr.34373) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:32.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:32 gibba003 bash[31385]: cluster 2021-03-10T15:32:31.565396+0000 mgr.gibba043.dnkmem (mgr.34373) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:32.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:32 gibba003 bash[32348]: cluster 2021-03-10T15:32:31.565396+0000 mgr.gibba043.dnkmem (mgr.34373) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:32 gibba043 bash[24019]: cluster 2021-03-10T15:32:31.565396+0000 mgr.gibba043.dnkmem (mgr.34373) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:34 gibba003 bash[31385]: cluster 2021-03-10T15:32:33.566905+0000 mgr.gibba043.dnkmem (mgr.34373) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:34 gibba003 bash[32348]: cluster 2021-03-10T15:32:33.566905+0000 mgr.gibba043.dnkmem (mgr.34373) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:35.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:34 gibba043 bash[24019]: cluster 2021-03-10T15:32:33.566905+0000 mgr.gibba043.dnkmem (mgr.34373) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:36 gibba003 bash[31385]: cluster 2021-03-10T15:32:35.568359+0000 mgr.gibba043.dnkmem (mgr.34373) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:36 gibba003 bash[32348]: cluster 2021-03-10T15:32:35.568359+0000 mgr.gibba043.dnkmem (mgr.34373) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:37.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:36 gibba043 bash[24019]: cluster 2021-03-10T15:32:35.568359+0000 mgr.gibba043.dnkmem (mgr.34373) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:38 gibba003 bash[31385]: cluster 2021-03-10T15:32:37.569912+0000 mgr.gibba043.dnkmem (mgr.34373) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:38 gibba003 bash[32348]: cluster 2021-03-10T15:32:37.569912+0000 mgr.gibba043.dnkmem (mgr.34373) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:38 gibba043 bash[24019]: cluster 2021-03-10T15:32:37.569912+0000 mgr.gibba043.dnkmem (mgr.34373) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:40 gibba003 bash[31385]: cluster 2021-03-10T15:32:39.571757+0000 mgr.gibba043.dnkmem (mgr.34373) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:40 gibba003 bash[32348]: cluster 2021-03-10T15:32:39.571757+0000 mgr.gibba043.dnkmem (mgr.34373) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:41.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:40 gibba043 bash[24019]: cluster 2021-03-10T15:32:39.571757+0000 mgr.gibba043.dnkmem (mgr.34373) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:42 gibba003 bash[31385]: cephadm 2021-03-10T15:32:41.391770+0000 mgr.gibba043.dnkmem (mgr.34373) 5383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:42.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:42 gibba003 bash[31385]: cluster 2021-03-10T15:32:41.573411+0000 mgr.gibba043.dnkmem (mgr.34373) 5384 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:42 gibba003 bash[32348]: cephadm 2021-03-10T15:32:41.391770+0000 mgr.gibba043.dnkmem (mgr.34373) 5383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:42.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:42 gibba003 bash[32348]: cluster 2021-03-10T15:32:41.573411+0000 mgr.gibba043.dnkmem (mgr.34373) 5384 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:42 gibba043 bash[24019]: cephadm 2021-03-10T15:32:41.391770+0000 mgr.gibba043.dnkmem (mgr.34373) 5383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:43.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:42 gibba043 bash[24019]: cluster 2021-03-10T15:32:41.573411+0000 mgr.gibba043.dnkmem (mgr.34373) 5384 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:44 gibba003 bash[31385]: cluster 2021-03-10T15:32:43.575034+0000 mgr.gibba043.dnkmem (mgr.34373) 5385 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:44 gibba003 bash[32348]: cluster 2021-03-10T15:32:43.575034+0000 mgr.gibba043.dnkmem (mgr.34373) 5385 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:45.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:44 gibba043 bash[24019]: cluster 2021-03-10T15:32:43.575034+0000 mgr.gibba043.dnkmem (mgr.34373) 5385 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:46 gibba003 bash[31385]: cluster 2021-03-10T15:32:45.576480+0000 mgr.gibba043.dnkmem (mgr.34373) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:46 gibba003 bash[32348]: cluster 2021-03-10T15:32:45.576480+0000 mgr.gibba043.dnkmem (mgr.34373) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:47.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:46 gibba043 bash[24019]: cluster 2021-03-10T15:32:45.576480+0000 mgr.gibba043.dnkmem (mgr.34373) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:48 gibba043 bash[24019]: cluster 2021-03-10T15:32:47.577887+0000 mgr.gibba043.dnkmem (mgr.34373) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:49.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:48 gibba003 bash[31385]: cluster 2021-03-10T15:32:47.577887+0000 mgr.gibba043.dnkmem (mgr.34373) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:48 gibba003 bash[32348]: cluster 2021-03-10T15:32:47.577887+0000 mgr.gibba043.dnkmem (mgr.34373) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:50 gibba043 bash[24019]: cluster 2021-03-10T15:32:49.579607+0000 mgr.gibba043.dnkmem (mgr.34373) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:50 gibba003 bash[31385]: cluster 2021-03-10T15:32:49.579607+0000 mgr.gibba043.dnkmem (mgr.34373) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:50 gibba003 bash[32348]: cluster 2021-03-10T15:32:49.579607+0000 mgr.gibba043.dnkmem (mgr.34373) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:53.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:52 gibba043 bash[24019]: cluster 2021-03-10T15:32:51.581145+0000 mgr.gibba043.dnkmem (mgr.34373) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:52 gibba003 bash[31385]: cluster 2021-03-10T15:32:51.581145+0000 mgr.gibba043.dnkmem (mgr.34373) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:52 gibba003 bash[32348]: cluster 2021-03-10T15:32:51.581145+0000 mgr.gibba043.dnkmem (mgr.34373) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:55.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:54 gibba043 bash[24019]: cluster 2021-03-10T15:32:53.582499+0000 mgr.gibba043.dnkmem (mgr.34373) 5390 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:54 gibba003 bash[31385]: cluster 2021-03-10T15:32:53.582499+0000 mgr.gibba043.dnkmem (mgr.34373) 5390 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:54 gibba003 bash[32348]: cluster 2021-03-10T15:32:53.582499+0000 mgr.gibba043.dnkmem (mgr.34373) 5390 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:56.313 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:32:56.544 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:32:56.544 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (101m) 5m ago 106m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:32:56.545 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (106m) 4m ago 106m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:32:56.545 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (101m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:32:56.545 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (101m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:32:56.545 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:32:56.545 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:32:56.546 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (100m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:32:56.546 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (100m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:32:56.546 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (106m) 5m ago 106m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:32:56.546 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (106m) 4m ago 106m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:32:56.547 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:32:56.547 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:32:56.547 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:32:56.547 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:32:56.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:32:56.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:32:56.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:32:56.548 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:32:56.549 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (106m) 4m ago 106m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:32:56.549 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 104m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:32:56.794 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:32:56.794 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:32:56.794 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:56.794 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:32:56.795 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:32:56.795 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:56.795 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:32:56.795 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:32:56.796 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:32:56.796 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:32:56.796 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:32:56.796 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:32:56.796 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:32:56.797 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:32:56.797 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:32:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:56 gibba043 bash[24019]: cluster 2021-03-10T15:32:55.583911+0000 mgr.gibba043.dnkmem (mgr.34373) 5391 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:56 gibba043 bash[24019]: audit 2021-03-10T15:32:56.300103+0000 mgr.gibba043.dnkmem (mgr.34373) 5392 : audit [DBG] from='client.57658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:56 gibba003 bash[31385]: cluster 2021-03-10T15:32:55.583911+0000 mgr.gibba043.dnkmem (mgr.34373) 5391 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:56 gibba003 bash[31385]: audit 2021-03-10T15:32:56.300103+0000 mgr.gibba043.dnkmem (mgr.34373) 5392 : audit [DBG] from='client.57658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:56 gibba003 bash[32348]: cluster 2021-03-10T15:32:55.583911+0000 mgr.gibba043.dnkmem (mgr.34373) 5391 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:56 gibba003 bash[32348]: audit 2021-03-10T15:32:56.300103+0000 mgr.gibba043.dnkmem (mgr.34373) 5392 : audit [DBG] from='client.57658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:57 gibba043 bash[24019]: cephadm 2021-03-10T15:32:56.407912+0000 mgr.gibba043.dnkmem (mgr.34373) 5393 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:57 gibba043 bash[24019]: audit 2021-03-10T15:32:56.528994+0000 mgr.gibba043.dnkmem (mgr.34373) 5394 : audit [DBG] from='client.57664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:57 gibba043 bash[24019]: audit 2021-03-10T15:32:56.792045+0000 mon.c (mon.1) 1412 : audit [DBG] from='client.? 172.21.2.103:0/2584468292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:57 gibba003 bash[31385]: cephadm 2021-03-10T15:32:56.407912+0000 mgr.gibba043.dnkmem (mgr.34373) 5393 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:57 gibba003 bash[31385]: audit 2021-03-10T15:32:56.528994+0000 mgr.gibba043.dnkmem (mgr.34373) 5394 : audit [DBG] from='client.57664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:57 gibba003 bash[31385]: audit 2021-03-10T15:32:56.792045+0000 mon.c (mon.1) 1412 : audit [DBG] from='client.? 172.21.2.103:0/2584468292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:58.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:57 gibba003 bash[32348]: cephadm 2021-03-10T15:32:56.407912+0000 mgr.gibba043.dnkmem (mgr.34373) 5393 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:32:58.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:57 gibba003 bash[32348]: audit 2021-03-10T15:32:56.528994+0000 mgr.gibba043.dnkmem (mgr.34373) 5394 : audit [DBG] from='client.57664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:57 gibba003 bash[32348]: audit 2021-03-10T15:32:56.792045+0000 mon.c (mon.1) 1412 : audit [DBG] from='client.? 172.21.2.103:0/2584468292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:32:58 gibba043 bash[24019]: cluster 2021-03-10T15:32:57.585382+0000 mgr.gibba043.dnkmem (mgr.34373) 5395 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:32:58 gibba003 bash[31385]: cluster 2021-03-10T15:32:57.585382+0000 mgr.gibba043.dnkmem (mgr.34373) 5395 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:32:58 gibba003 bash[32348]: cluster 2021-03-10T15:32:57.585382+0000 mgr.gibba043.dnkmem (mgr.34373) 5395 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:01.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:00 gibba043 bash[24019]: cluster 2021-03-10T15:32:59.586044+0000 mgr.gibba043.dnkmem (mgr.34373) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:00 gibba003 bash[31385]: cluster 2021-03-10T15:32:59.586044+0000 mgr.gibba043.dnkmem (mgr.34373) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:00 gibba003 bash[32348]: cluster 2021-03-10T15:32:59.586044+0000 mgr.gibba043.dnkmem (mgr.34373) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:02 gibba043 bash[24019]: cluster 2021-03-10T15:33:01.587406+0000 mgr.gibba043.dnkmem (mgr.34373) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:02 gibba003 bash[31385]: cluster 2021-03-10T15:33:01.587406+0000 mgr.gibba043.dnkmem (mgr.34373) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:02 gibba003 bash[32348]: cluster 2021-03-10T15:33:01.587406+0000 mgr.gibba043.dnkmem (mgr.34373) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:04 gibba003 bash[31385]: cluster 2021-03-10T15:33:03.588791+0000 mgr.gibba043.dnkmem (mgr.34373) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:04 gibba003 bash[32348]: cluster 2021-03-10T15:33:03.588791+0000 mgr.gibba043.dnkmem (mgr.34373) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:04 gibba043 bash[24019]: cluster 2021-03-10T15:33:03.588791+0000 mgr.gibba043.dnkmem (mgr.34373) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:06 gibba003 bash[31385]: cluster 2021-03-10T15:33:05.590177+0000 mgr.gibba043.dnkmem (mgr.34373) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:06 gibba003 bash[32348]: cluster 2021-03-10T15:33:05.590177+0000 mgr.gibba043.dnkmem (mgr.34373) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:06 gibba043 bash[24019]: cluster 2021-03-10T15:33:05.590177+0000 mgr.gibba043.dnkmem (mgr.34373) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:08 gibba003 bash[31385]: cluster 2021-03-10T15:33:07.591386+0000 mgr.gibba043.dnkmem (mgr.34373) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:08 gibba003 bash[32348]: cluster 2021-03-10T15:33:07.591386+0000 mgr.gibba043.dnkmem (mgr.34373) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:08 gibba043 bash[24019]: cluster 2021-03-10T15:33:07.591386+0000 mgr.gibba043.dnkmem (mgr.34373) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:10 gibba003 bash[31385]: cluster 2021-03-10T15:33:09.592779+0000 mgr.gibba043.dnkmem (mgr.34373) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:11.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:10 gibba003 bash[32348]: cluster 2021-03-10T15:33:09.592779+0000 mgr.gibba043.dnkmem (mgr.34373) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:10 gibba043 bash[24019]: cluster 2021-03-10T15:33:09.592779+0000 mgr.gibba043.dnkmem (mgr.34373) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:12 gibba003 bash[31385]: cephadm 2021-03-10T15:33:11.424002+0000 mgr.gibba043.dnkmem (mgr.34373) 5402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:12 gibba003 bash[31385]: cluster 2021-03-10T15:33:11.594491+0000 mgr.gibba043.dnkmem (mgr.34373) 5403 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:12 gibba003 bash[32348]: cephadm 2021-03-10T15:33:11.424002+0000 mgr.gibba043.dnkmem (mgr.34373) 5402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:13.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:12 gibba003 bash[32348]: cluster 2021-03-10T15:33:11.594491+0000 mgr.gibba043.dnkmem (mgr.34373) 5403 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:12 gibba043 bash[24019]: cephadm 2021-03-10T15:33:11.424002+0000 mgr.gibba043.dnkmem (mgr.34373) 5402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:12 gibba043 bash[24019]: cluster 2021-03-10T15:33:11.594491+0000 mgr.gibba043.dnkmem (mgr.34373) 5403 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.362676+0000 mon.c (mon.1) 1413 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.363808+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.491982+0000 mon.c (mon.1) 1414 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.493091+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.577087+0000 mon.c (mon.1) 1415 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:33:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.577798+0000 mon.c (mon.1) 1416 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.578327+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:33:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.578491+0000 mon.c (mon.1) 1417 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.579204+0000 mon.c (mon.1) 1418 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.579785+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.580783+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[31385]: audit 2021-03-10T15:33:13.581578+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.362676+0000 mon.c (mon.1) 1413 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.363808+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.491982+0000 mon.c (mon.1) 1414 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.493091+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.577087+0000 mon.c (mon.1) 1415 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:33:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.577798+0000 mon.c (mon.1) 1416 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.578327+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:33:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.578491+0000 mon.c (mon.1) 1417 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.579204+0000 mon.c (mon.1) 1418 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.579785+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.580783+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:13 gibba003 bash[32348]: audit 2021-03-10T15:33:13.581578+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.362676+0000 mon.c (mon.1) 1413 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.363808+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.491982+0000 mon.c (mon.1) 1414 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.493091+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.577087+0000 mon.c (mon.1) 1415 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:33:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.577798+0000 mon.c (mon.1) 1416 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.578327+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:33:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.578491+0000 mon.c (mon.1) 1417 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.579204+0000 mon.c (mon.1) 1418 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.579785+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:33:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.580783+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:13 gibba043 bash[24019]: audit 2021-03-10T15:33:13.581578+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:14 gibba003 bash[31385]: cluster 2021-03-10T15:33:13.596126+0000 mgr.gibba043.dnkmem (mgr.34373) 5404 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:14 gibba003 bash[32348]: cluster 2021-03-10T15:33:13.596126+0000 mgr.gibba043.dnkmem (mgr.34373) 5404 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:14 gibba043 bash[24019]: cluster 2021-03-10T15:33:13.596126+0000 mgr.gibba043.dnkmem (mgr.34373) 5404 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:16 gibba003 bash[31385]: cluster 2021-03-10T15:33:15.597858+0000 mgr.gibba043.dnkmem (mgr.34373) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:16 gibba003 bash[32348]: cluster 2021-03-10T15:33:15.597858+0000 mgr.gibba043.dnkmem (mgr.34373) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:16 gibba043 bash[24019]: cluster 2021-03-10T15:33:15.597858+0000 mgr.gibba043.dnkmem (mgr.34373) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:18 gibba003 bash[31385]: cluster 2021-03-10T15:33:17.599747+0000 mgr.gibba043.dnkmem (mgr.34373) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:18 gibba003 bash[32348]: cluster 2021-03-10T15:33:17.599747+0000 mgr.gibba043.dnkmem (mgr.34373) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:18 gibba043 bash[24019]: cluster 2021-03-10T15:33:17.599747+0000 mgr.gibba043.dnkmem (mgr.34373) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:20 gibba003 bash[31385]: cluster 2021-03-10T15:33:19.600349+0000 mgr.gibba043.dnkmem (mgr.34373) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:20 gibba003 bash[32348]: cluster 2021-03-10T15:33:19.600349+0000 mgr.gibba043.dnkmem (mgr.34373) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:20 gibba043 bash[24019]: cluster 2021-03-10T15:33:19.600349+0000 mgr.gibba043.dnkmem (mgr.34373) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:23.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:22 gibba003 bash[31385]: cluster 2021-03-10T15:33:21.601919+0000 mgr.gibba043.dnkmem (mgr.34373) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:22 gibba003 bash[32348]: cluster 2021-03-10T15:33:21.601919+0000 mgr.gibba043.dnkmem (mgr.34373) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:22 gibba043 bash[24019]: cluster 2021-03-10T15:33:21.601919+0000 mgr.gibba043.dnkmem (mgr.34373) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:24 gibba003 bash[31385]: cluster 2021-03-10T15:33:23.603523+0000 mgr.gibba043.dnkmem (mgr.34373) 5409 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:24 gibba003 bash[32348]: cluster 2021-03-10T15:33:23.603523+0000 mgr.gibba043.dnkmem (mgr.34373) 5409 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:24 gibba043 bash[24019]: cluster 2021-03-10T15:33:23.603523+0000 mgr.gibba043.dnkmem (mgr.34373) 5409 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: cluster 2021-03-10T15:33:25.605136+0000 mgr.gibba043.dnkmem (mgr.34373) 5410 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.641073+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:33:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.644843+0000 mon.c (mon.1) 1419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.646409+0000 mon.c (mon.1) 1420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.647630+0000 mon.c (mon.1) 1421 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.648876+0000 mon.c (mon.1) 1422 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.651818+0000 mon.c (mon.1) 1423 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:26 gibba043 bash[24019]: audit 2021-03-10T15:33:26.653178+0000 mon.c (mon.1) 1424 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.038 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:33:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: cluster 2021-03-10T15:33:25.605136+0000 mgr.gibba043.dnkmem (mgr.34373) 5410 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.641073+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:33:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.644843+0000 mon.c (mon.1) 1419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.646409+0000 mon.c (mon.1) 1420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.647630+0000 mon.c (mon.1) 1421 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.648876+0000 mon.c (mon.1) 1422 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.651818+0000 mon.c (mon.1) 1423 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[31385]: audit 2021-03-10T15:33:26.653178+0000 mon.c (mon.1) 1424 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: cluster 2021-03-10T15:33:25.605136+0000 mgr.gibba043.dnkmem (mgr.34373) 5410 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.641073+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:33:27.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.644843+0000 mon.c (mon.1) 1419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:27.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.646409+0000 mon.c (mon.1) 1420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.647630+0000 mon.c (mon.1) 1421 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.648876+0000 mon.c (mon.1) 1422 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.651818+0000 mon.c (mon.1) 1423 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:26 gibba003 bash[32348]: audit 2021-03-10T15:33:26.653178+0000 mon.c (mon.1) 1424 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:27.265 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:33:27.266 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (101m) 6m ago 107m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:33:27.266 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (106m) 5m ago 106m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:33:27.266 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (102m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:33:27.267 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (102m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:33:27.267 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:33:27.267 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:33:27.268 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (100m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:33:27.268 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (101m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:33:27.268 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (107m) 6m ago 107m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:33:27.269 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (107m) 5m ago 107m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:33:27.269 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:33:27.269 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:33:27.270 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:33:27.270 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:33:27.271 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:33:27.271 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:33:27.271 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:33:27.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (97m) 5m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:33:27.272 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (106m) 5m ago 107m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:33:27.273 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 105m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:33:27.514 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:33:27.515 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:33:27.515 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:27.515 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:33:27.515 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:33:27.515 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:27.516 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:33:27.516 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:33:27.516 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:33:27.516 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:33:27.517 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:33:27.517 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:33:27.517 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:33:27.517 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:33:27.518 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:33:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.440831+0000 mgr.gibba043.dnkmem (mgr.34373) 5411 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:33:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.442396+0000 mgr.gibba043.dnkmem (mgr.34373) 5412 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:33:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.642447+0000 mgr.gibba043.dnkmem (mgr.34373) 5413 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.644226+0000 mgr.gibba043.dnkmem (mgr.34373) 5414 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.645448+0000 mgr.gibba043.dnkmem (mgr.34373) 5415 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.645487+0000 mgr.gibba043.dnkmem (mgr.34373) 5416 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.646726+0000 mgr.gibba043.dnkmem (mgr.34373) 5417 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.646766+0000 mgr.gibba043.dnkmem (mgr.34373) 5418 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.647857+0000 mgr.gibba043.dnkmem (mgr.34373) 5419 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.649510+0000 mgr.gibba043.dnkmem (mgr.34373) 5420 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.649552+0000 mgr.gibba043.dnkmem (mgr.34373) 5421 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.650875+0000 mgr.gibba043.dnkmem (mgr.34373) 5422 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.651223+0000 mgr.gibba043.dnkmem (mgr.34373) 5423 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.652291+0000 mgr.gibba043.dnkmem (mgr.34373) 5424 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.652333+0000 mgr.gibba043.dnkmem (mgr.34373) 5425 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: cephadm 2021-03-10T15:33:26.652460+0000 mgr.gibba043.dnkmem (mgr.34373) 5426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: audit 2021-03-10T15:33:27.026557+0000 mgr.gibba043.dnkmem (mgr.34373) 5427 : audit [DBG] from='client.57676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:28.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: audit 2021-03-10T15:33:27.249881+0000 mgr.gibba043.dnkmem (mgr.34373) 5428 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:28.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[31385]: audit 2021-03-10T15:33:27.512648+0000 mon.a (mon.0) 1311 : audit [DBG] from='client.? 172.21.2.103:0/3329557799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:28.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.440831+0000 mgr.gibba043.dnkmem (mgr.34373) 5411 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:33:28.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.442396+0000 mgr.gibba043.dnkmem (mgr.34373) 5412 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:33:28.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.642447+0000 mgr.gibba043.dnkmem (mgr.34373) 5413 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:28.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.644226+0000 mgr.gibba043.dnkmem (mgr.34373) 5414 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:28.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.645448+0000 mgr.gibba043.dnkmem (mgr.34373) 5415 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:28.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.645487+0000 mgr.gibba043.dnkmem (mgr.34373) 5416 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.646726+0000 mgr.gibba043.dnkmem (mgr.34373) 5417 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.646766+0000 mgr.gibba043.dnkmem (mgr.34373) 5418 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.647857+0000 mgr.gibba043.dnkmem (mgr.34373) 5419 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.649510+0000 mgr.gibba043.dnkmem (mgr.34373) 5420 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.649552+0000 mgr.gibba043.dnkmem (mgr.34373) 5421 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.650875+0000 mgr.gibba043.dnkmem (mgr.34373) 5422 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.651223+0000 mgr.gibba043.dnkmem (mgr.34373) 5423 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.652291+0000 mgr.gibba043.dnkmem (mgr.34373) 5424 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.652333+0000 mgr.gibba043.dnkmem (mgr.34373) 5425 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: cephadm 2021-03-10T15:33:26.652460+0000 mgr.gibba043.dnkmem (mgr.34373) 5426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: audit 2021-03-10T15:33:27.026557+0000 mgr.gibba043.dnkmem (mgr.34373) 5427 : audit [DBG] from='client.57676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: audit 2021-03-10T15:33:27.249881+0000 mgr.gibba043.dnkmem (mgr.34373) 5428 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:27 gibba003 bash[32348]: audit 2021-03-10T15:33:27.512648+0000 mon.a (mon.0) 1311 : audit [DBG] from='client.? 172.21.2.103:0/3329557799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.440831+0000 mgr.gibba043.dnkmem (mgr.34373) 5411 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:33:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.442396+0000 mgr.gibba043.dnkmem (mgr.34373) 5412 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:33:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.642447+0000 mgr.gibba043.dnkmem (mgr.34373) 5413 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.644226+0000 mgr.gibba043.dnkmem (mgr.34373) 5414 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.645448+0000 mgr.gibba043.dnkmem (mgr.34373) 5415 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.645487+0000 mgr.gibba043.dnkmem (mgr.34373) 5416 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.646726+0000 mgr.gibba043.dnkmem (mgr.34373) 5417 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.646766+0000 mgr.gibba043.dnkmem (mgr.34373) 5418 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.647857+0000 mgr.gibba043.dnkmem (mgr.34373) 5419 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.649510+0000 mgr.gibba043.dnkmem (mgr.34373) 5420 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:28.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.649552+0000 mgr.gibba043.dnkmem (mgr.34373) 5421 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:28.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.650875+0000 mgr.gibba043.dnkmem (mgr.34373) 5422 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:28.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.651223+0000 mgr.gibba043.dnkmem (mgr.34373) 5423 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:28.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.652291+0000 mgr.gibba043.dnkmem (mgr.34373) 5424 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:28.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.652333+0000 mgr.gibba043.dnkmem (mgr.34373) 5425 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:28.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: cephadm 2021-03-10T15:33:26.652460+0000 mgr.gibba043.dnkmem (mgr.34373) 5426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:28.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: audit 2021-03-10T15:33:27.026557+0000 mgr.gibba043.dnkmem (mgr.34373) 5427 : audit [DBG] from='client.57676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:28.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: audit 2021-03-10T15:33:27.249881+0000 mgr.gibba043.dnkmem (mgr.34373) 5428 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:28.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:27 gibba043 bash[24019]: audit 2021-03-10T15:33:27.512648+0000 mon.a (mon.0) 1311 : audit [DBG] from='client.? 172.21.2.103:0/3329557799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:28 gibba003 bash[31385]: cluster 2021-03-10T15:33:27.606641+0000 mgr.gibba043.dnkmem (mgr.34373) 5429 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:28 gibba003 bash[32348]: cluster 2021-03-10T15:33:27.606641+0000 mgr.gibba043.dnkmem (mgr.34373) 5429 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:28 gibba043 bash[24019]: cluster 2021-03-10T15:33:27.606641+0000 mgr.gibba043.dnkmem (mgr.34373) 5429 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:30 gibba003 bash[31385]: cluster 2021-03-10T15:33:29.607183+0000 mgr.gibba043.dnkmem (mgr.34373) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:30 gibba003 bash[32348]: cluster 2021-03-10T15:33:29.607183+0000 mgr.gibba043.dnkmem (mgr.34373) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:30 gibba043 bash[24019]: cluster 2021-03-10T15:33:29.607183+0000 mgr.gibba043.dnkmem (mgr.34373) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:32 gibba003 bash[31385]: cluster 2021-03-10T15:33:31.608900+0000 mgr.gibba043.dnkmem (mgr.34373) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:32 gibba003 bash[32348]: cluster 2021-03-10T15:33:31.608900+0000 mgr.gibba043.dnkmem (mgr.34373) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:32 gibba043 bash[24019]: cluster 2021-03-10T15:33:31.608900+0000 mgr.gibba043.dnkmem (mgr.34373) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:34 gibba003 bash[31385]: cluster 2021-03-10T15:33:33.610578+0000 mgr.gibba043.dnkmem (mgr.34373) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:34 gibba003 bash[32348]: cluster 2021-03-10T15:33:33.610578+0000 mgr.gibba043.dnkmem (mgr.34373) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:34 gibba043 bash[24019]: cluster 2021-03-10T15:33:33.610578+0000 mgr.gibba043.dnkmem (mgr.34373) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:36 gibba003 bash[31385]: cluster 2021-03-10T15:33:35.612196+0000 mgr.gibba043.dnkmem (mgr.34373) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:37.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:36 gibba003 bash[32348]: cluster 2021-03-10T15:33:35.612196+0000 mgr.gibba043.dnkmem (mgr.34373) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:36 gibba043 bash[24019]: cluster 2021-03-10T15:33:35.612196+0000 mgr.gibba043.dnkmem (mgr.34373) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:38 gibba003 bash[31385]: cluster 2021-03-10T15:33:37.613897+0000 mgr.gibba043.dnkmem (mgr.34373) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:38 gibba003 bash[32348]: cluster 2021-03-10T15:33:37.613897+0000 mgr.gibba043.dnkmem (mgr.34373) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:38 gibba043 bash[24019]: cluster 2021-03-10T15:33:37.613897+0000 mgr.gibba043.dnkmem (mgr.34373) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:40 gibba043 bash[24019]: cluster 2021-03-10T15:33:39.615264+0000 mgr.gibba043.dnkmem (mgr.34373) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:40 gibba003 bash[31385]: cluster 2021-03-10T15:33:39.615264+0000 mgr.gibba043.dnkmem (mgr.34373) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:40 gibba003 bash[32348]: cluster 2021-03-10T15:33:39.615264+0000 mgr.gibba043.dnkmem (mgr.34373) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:42 gibba043 bash[24019]: cluster 2021-03-10T15:33:41.616956+0000 mgr.gibba043.dnkmem (mgr.34373) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:42 gibba043 bash[24019]: cephadm 2021-03-10T15:33:41.656791+0000 mgr.gibba043.dnkmem (mgr.34373) 5437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:42 gibba003 bash[31385]: cluster 2021-03-10T15:33:41.616956+0000 mgr.gibba043.dnkmem (mgr.34373) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:42 gibba003 bash[31385]: cephadm 2021-03-10T15:33:41.656791+0000 mgr.gibba043.dnkmem (mgr.34373) 5437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:42 gibba003 bash[32348]: cluster 2021-03-10T15:33:41.616956+0000 mgr.gibba043.dnkmem (mgr.34373) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:42 gibba003 bash[32348]: cephadm 2021-03-10T15:33:41.656791+0000 mgr.gibba043.dnkmem (mgr.34373) 5437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:45.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:44 gibba043 bash[24019]: cluster 2021-03-10T15:33:43.618575+0000 mgr.gibba043.dnkmem (mgr.34373) 5438 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:44 gibba003 bash[31385]: cluster 2021-03-10T15:33:43.618575+0000 mgr.gibba043.dnkmem (mgr.34373) 5438 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:44 gibba003 bash[32348]: cluster 2021-03-10T15:33:43.618575+0000 mgr.gibba043.dnkmem (mgr.34373) 5438 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:46 gibba043 bash[24019]: cluster 2021-03-10T15:33:45.620042+0000 mgr.gibba043.dnkmem (mgr.34373) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:46 gibba003 bash[31385]: cluster 2021-03-10T15:33:45.620042+0000 mgr.gibba043.dnkmem (mgr.34373) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:46 gibba003 bash[32348]: cluster 2021-03-10T15:33:45.620042+0000 mgr.gibba043.dnkmem (mgr.34373) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:48 gibba043 bash[24019]: cluster 2021-03-10T15:33:47.621639+0000 mgr.gibba043.dnkmem (mgr.34373) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:48 gibba003 bash[31385]: cluster 2021-03-10T15:33:47.621639+0000 mgr.gibba043.dnkmem (mgr.34373) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:48 gibba003 bash[32348]: cluster 2021-03-10T15:33:47.621639+0000 mgr.gibba043.dnkmem (mgr.34373) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:50 gibba043 bash[24019]: cluster 2021-03-10T15:33:49.623135+0000 mgr.gibba043.dnkmem (mgr.34373) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:50 gibba003 bash[31385]: cluster 2021-03-10T15:33:49.623135+0000 mgr.gibba043.dnkmem (mgr.34373) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:50 gibba003 bash[32348]: cluster 2021-03-10T15:33:49.623135+0000 mgr.gibba043.dnkmem (mgr.34373) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:53 gibba043 bash[24019]: cluster 2021-03-10T15:33:51.624837+0000 mgr.gibba043.dnkmem (mgr.34373) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:53.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:53 gibba003 bash[31385]: cluster 2021-03-10T15:33:51.624837+0000 mgr.gibba043.dnkmem (mgr.34373) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:53 gibba003 bash[32348]: cluster 2021-03-10T15:33:51.624837+0000 mgr.gibba043.dnkmem (mgr.34373) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:55 gibba043 bash[24019]: cluster 2021-03-10T15:33:53.626326+0000 mgr.gibba043.dnkmem (mgr.34373) 5443 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:55 gibba003 bash[31385]: cluster 2021-03-10T15:33:53.626326+0000 mgr.gibba043.dnkmem (mgr.34373) 5443 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:55 gibba003 bash[32348]: cluster 2021-03-10T15:33:53.626326+0000 mgr.gibba043.dnkmem (mgr.34373) 5443 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:57 gibba043 bash[24019]: cluster 2021-03-10T15:33:55.627927+0000 mgr.gibba043.dnkmem (mgr.34373) 5444 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:57 gibba003 bash[31385]: cluster 2021-03-10T15:33:55.627927+0000 mgr.gibba043.dnkmem (mgr.34373) 5444 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:57 gibba003 bash[32348]: cluster 2021-03-10T15:33:55.627927+0000 mgr.gibba043.dnkmem (mgr.34373) 5444 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:57.756 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:33:58.010 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:33:58.010 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (102m) 6m ago 107m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:33:58.010 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (107m) 5m ago 107m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:33:58.010 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (102m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:33:58.011 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (102m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:33:58.011 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (102m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:33:58.011 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:33:58.011 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (101m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:33:58.012 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (101m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:33:58.012 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (107m) 6m ago 107m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:33:58.012 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (107m) 5m ago 107m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:33:58.012 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:33:58.012 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:33:58.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:33:58.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:33:58.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:33:58.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:33:58.014 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:33:58.014 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:33:58.014 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (107m) 5m ago 107m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:33:58.014 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 105m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:33:58.264 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:33:58.264 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:33:58.264 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:58.264 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:33:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:33:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:33:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:33:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:33:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:33:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:33:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:33:58.267 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:33:58.267 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:33:58.267 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:33:58.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:58 gibba003 bash[31385]: cephadm 2021-03-10T15:33:56.672762+0000 mgr.gibba043.dnkmem (mgr.34373) 5445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:58 gibba003 bash[32348]: cephadm 2021-03-10T15:33:56.672762+0000 mgr.gibba043.dnkmem (mgr.34373) 5445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:58.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:58 gibba043 bash[24019]: cephadm 2021-03-10T15:33:56.672762+0000 mgr.gibba043.dnkmem (mgr.34373) 5445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:33:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[31385]: cluster 2021-03-10T15:33:57.629407+0000 mgr.gibba043.dnkmem (mgr.34373) 5446 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[31385]: audit 2021-03-10T15:33:57.743445+0000 mgr.gibba043.dnkmem (mgr.34373) 5447 : audit [DBG] from='client.57694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[31385]: audit 2021-03-10T15:33:57.967624+0000 mgr.gibba043.dnkmem (mgr.34373) 5448 : audit [DBG] from='client.57700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[31385]: audit 2021-03-10T15:33:58.262072+0000 mon.a (mon.0) 1312 : audit [DBG] from='client.? 172.21.2.103:0/3633397391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[32348]: cluster 2021-03-10T15:33:57.629407+0000 mgr.gibba043.dnkmem (mgr.34373) 5446 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[32348]: audit 2021-03-10T15:33:57.743445+0000 mgr.gibba043.dnkmem (mgr.34373) 5447 : audit [DBG] from='client.57694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[32348]: audit 2021-03-10T15:33:57.967624+0000 mgr.gibba043.dnkmem (mgr.34373) 5448 : audit [DBG] from='client.57700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:33:59 gibba003 bash[32348]: audit 2021-03-10T15:33:58.262072+0000 mon.a (mon.0) 1312 : audit [DBG] from='client.? 172.21.2.103:0/3633397391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:59 gibba043 bash[24019]: cluster 2021-03-10T15:33:57.629407+0000 mgr.gibba043.dnkmem (mgr.34373) 5446 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:59 gibba043 bash[24019]: audit 2021-03-10T15:33:57.743445+0000 mgr.gibba043.dnkmem (mgr.34373) 5447 : audit [DBG] from='client.57694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:59 gibba043 bash[24019]: audit 2021-03-10T15:33:57.967624+0000 mgr.gibba043.dnkmem (mgr.34373) 5448 : audit [DBG] from='client.57700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:33:59 gibba043 bash[24019]: audit 2021-03-10T15:33:58.262072+0000 mon.a (mon.0) 1312 : audit [DBG] from='client.? 172.21.2.103:0/3633397391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:01 gibba003 bash[31385]: cluster 2021-03-10T15:33:59.630100+0000 mgr.gibba043.dnkmem (mgr.34373) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:01 gibba003 bash[32348]: cluster 2021-03-10T15:33:59.630100+0000 mgr.gibba043.dnkmem (mgr.34373) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:01 gibba043 bash[24019]: cluster 2021-03-10T15:33:59.630100+0000 mgr.gibba043.dnkmem (mgr.34373) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:03 gibba003 bash[31385]: cluster 2021-03-10T15:34:01.631847+0000 mgr.gibba043.dnkmem (mgr.34373) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:03 gibba003 bash[32348]: cluster 2021-03-10T15:34:01.631847+0000 mgr.gibba043.dnkmem (mgr.34373) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:03 gibba043 bash[24019]: cluster 2021-03-10T15:34:01.631847+0000 mgr.gibba043.dnkmem (mgr.34373) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:05 gibba003 bash[31385]: cluster 2021-03-10T15:34:03.633160+0000 mgr.gibba043.dnkmem (mgr.34373) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:05 gibba003 bash[32348]: cluster 2021-03-10T15:34:03.633160+0000 mgr.gibba043.dnkmem (mgr.34373) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:05 gibba043 bash[24019]: cluster 2021-03-10T15:34:03.633160+0000 mgr.gibba043.dnkmem (mgr.34373) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:07 gibba003 bash[31385]: cluster 2021-03-10T15:34:05.634528+0000 mgr.gibba043.dnkmem (mgr.34373) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:07 gibba003 bash[32348]: cluster 2021-03-10T15:34:05.634528+0000 mgr.gibba043.dnkmem (mgr.34373) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:07 gibba043 bash[24019]: cluster 2021-03-10T15:34:05.634528+0000 mgr.gibba043.dnkmem (mgr.34373) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:09 gibba003 bash[31385]: cluster 2021-03-10T15:34:07.636209+0000 mgr.gibba043.dnkmem (mgr.34373) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:09 gibba003 bash[32348]: cluster 2021-03-10T15:34:07.636209+0000 mgr.gibba043.dnkmem (mgr.34373) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:09 gibba043 bash[24019]: cluster 2021-03-10T15:34:07.636209+0000 mgr.gibba043.dnkmem (mgr.34373) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:11 gibba003 bash[31385]: cluster 2021-03-10T15:34:09.636712+0000 mgr.gibba043.dnkmem (mgr.34373) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:11 gibba003 bash[32348]: cluster 2021-03-10T15:34:09.636712+0000 mgr.gibba043.dnkmem (mgr.34373) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:11 gibba043 bash[24019]: cluster 2021-03-10T15:34:09.636712+0000 mgr.gibba043.dnkmem (mgr.34373) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:13 gibba003 bash[31385]: cluster 2021-03-10T15:34:11.638377+0000 mgr.gibba043.dnkmem (mgr.34373) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:13 gibba003 bash[31385]: cephadm 2021-03-10T15:34:11.688874+0000 mgr.gibba043.dnkmem (mgr.34373) 5456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:13 gibba003 bash[32348]: cluster 2021-03-10T15:34:11.638377+0000 mgr.gibba043.dnkmem (mgr.34373) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:13 gibba003 bash[32348]: cephadm 2021-03-10T15:34:11.688874+0000 mgr.gibba043.dnkmem (mgr.34373) 5456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:13 gibba043 bash[24019]: cluster 2021-03-10T15:34:11.638377+0000 mgr.gibba043.dnkmem (mgr.34373) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.604 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:13 gibba043 bash[24019]: cephadm 2021-03-10T15:34:11.688874+0000 mgr.gibba043.dnkmem (mgr.34373) 5456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.369764+0000 mon.c (mon.1) 1425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.370838+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.500624+0000 mon.c (mon.1) 1426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.501717+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.588120+0000 mon.c (mon.1) 1427 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:34:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.588881+0000 mon.c (mon.1) 1428 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.589363+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:34:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.589544+0000 mon.c (mon.1) 1429 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.590383+0000 mon.c (mon.1) 1430 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:34:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.590689+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.592041+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[31385]: audit 2021-03-10T15:34:13.592934+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:34:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.369764+0000 mon.c (mon.1) 1425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.370838+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.500624+0000 mon.c (mon.1) 1426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.501717+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.588120+0000 mon.c (mon.1) 1427 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:34:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.588881+0000 mon.c (mon.1) 1428 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.589363+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:34:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.589544+0000 mon.c (mon.1) 1429 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.590383+0000 mon.c (mon.1) 1430 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:34:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.590689+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.592041+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:14 gibba003 bash[32348]: audit 2021-03-10T15:34:13.592934+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:34:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.369764+0000 mon.c (mon.1) 1425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.370838+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.500624+0000 mon.c (mon.1) 1426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.501717+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.588120+0000 mon.c (mon.1) 1427 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:34:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.588881+0000 mon.c (mon.1) 1428 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.589363+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:34:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.589544+0000 mon.c (mon.1) 1429 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.590383+0000 mon.c (mon.1) 1430 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:34:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.590689+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.592041+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:34:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:14 gibba043 bash[24019]: audit 2021-03-10T15:34:13.592934+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:34:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:15 gibba003 bash[31385]: cluster 2021-03-10T15:34:13.639407+0000 mgr.gibba043.dnkmem (mgr.34373) 5457 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:15 gibba003 bash[32348]: cluster 2021-03-10T15:34:13.639407+0000 mgr.gibba043.dnkmem (mgr.34373) 5457 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:15 gibba043 bash[24019]: cluster 2021-03-10T15:34:13.639407+0000 mgr.gibba043.dnkmem (mgr.34373) 5457 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:17 gibba003 bash[31385]: cluster 2021-03-10T15:34:15.640114+0000 mgr.gibba043.dnkmem (mgr.34373) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:17 gibba003 bash[32348]: cluster 2021-03-10T15:34:15.640114+0000 mgr.gibba043.dnkmem (mgr.34373) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:17 gibba043 bash[24019]: cluster 2021-03-10T15:34:15.640114+0000 mgr.gibba043.dnkmem (mgr.34373) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:19 gibba003 bash[31385]: cluster 2021-03-10T15:34:17.641639+0000 mgr.gibba043.dnkmem (mgr.34373) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:19 gibba003 bash[32348]: cluster 2021-03-10T15:34:17.641639+0000 mgr.gibba043.dnkmem (mgr.34373) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:19 gibba043 bash[24019]: cluster 2021-03-10T15:34:17.641639+0000 mgr.gibba043.dnkmem (mgr.34373) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:21 gibba003 bash[31385]: cluster 2021-03-10T15:34:19.643256+0000 mgr.gibba043.dnkmem (mgr.34373) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:21 gibba003 bash[32348]: cluster 2021-03-10T15:34:19.643256+0000 mgr.gibba043.dnkmem (mgr.34373) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:21 gibba043 bash[24019]: cluster 2021-03-10T15:34:19.643256+0000 mgr.gibba043.dnkmem (mgr.34373) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:23 gibba003 bash[31385]: cluster 2021-03-10T15:34:21.644080+0000 mgr.gibba043.dnkmem (mgr.34373) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:23 gibba003 bash[32348]: cluster 2021-03-10T15:34:21.644080+0000 mgr.gibba043.dnkmem (mgr.34373) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:23.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:23 gibba043 bash[24019]: cluster 2021-03-10T15:34:21.644080+0000 mgr.gibba043.dnkmem (mgr.34373) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:25.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:25 gibba003 bash[31385]: cluster 2021-03-10T15:34:23.645521+0000 mgr.gibba043.dnkmem (mgr.34373) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:25 gibba003 bash[32348]: cluster 2021-03-10T15:34:23.645521+0000 mgr.gibba043.dnkmem (mgr.34373) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:25 gibba043 bash[24019]: cluster 2021-03-10T15:34:23.645521+0000 mgr.gibba043.dnkmem (mgr.34373) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: cluster 2021-03-10T15:34:25.647004+0000 mgr.gibba043.dnkmem (mgr.34373) 5463 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:27.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:26.906769+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:26.910384+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.103053+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.106767+0000 mon.c (mon.1) 1431 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:27.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.108008+0000 mon.c (mon.1) 1432 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.109366+0000 mon.c (mon.1) 1433 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.110835+0000 mon.c (mon.1) 1434 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.113829+0000 mon.c (mon.1) 1435 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[31385]: audit 2021-03-10T15:34:27.115653+0000 mon.c (mon.1) 1436 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: cluster 2021-03-10T15:34:25.647004+0000 mgr.gibba043.dnkmem (mgr.34373) 5463 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:26.906769+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:26.910384+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.103053+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.106767+0000 mon.c (mon.1) 1431 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.108008+0000 mon.c (mon.1) 1432 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.109366+0000 mon.c (mon.1) 1433 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.110835+0000 mon.c (mon.1) 1434 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.113829+0000 mon.c (mon.1) 1435 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:27 gibba003 bash[32348]: audit 2021-03-10T15:34:27.115653+0000 mon.c (mon.1) 1436 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: cluster 2021-03-10T15:34:25.647004+0000 mgr.gibba043.dnkmem (mgr.34373) 5463 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:26.906769+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:26.910384+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.103053+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:34:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.106767+0000 mon.c (mon.1) 1431 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.108008+0000 mon.c (mon.1) 1432 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.109366+0000 mon.c (mon.1) 1433 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.110835+0000 mon.c (mon.1) 1434 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.113829+0000 mon.c (mon.1) 1435 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:27.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:27 gibba043 bash[24019]: audit 2021-03-10T15:34:27.115653+0000 mon.c (mon.1) 1436 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:26.906348+0000 mgr.gibba043.dnkmem (mgr.34373) 5464 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:34:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:26.909824+0000 mgr.gibba043.dnkmem (mgr.34373) 5465 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:34:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.104310+0000 mgr.gibba043.dnkmem (mgr.34373) 5466 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.105887+0000 mgr.gibba043.dnkmem (mgr.34373) 5467 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.107048+0000 mgr.gibba043.dnkmem (mgr.34373) 5468 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.107085+0000 mgr.gibba043.dnkmem (mgr.34373) 5469 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.108587+0000 mgr.gibba043.dnkmem (mgr.34373) 5470 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.108624+0000 mgr.gibba043.dnkmem (mgr.34373) 5471 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.109889+0000 mgr.gibba043.dnkmem (mgr.34373) 5472 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.111433+0000 mgr.gibba043.dnkmem (mgr.34373) 5473 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.111470+0000 mgr.gibba043.dnkmem (mgr.34373) 5474 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.113053+0000 mgr.gibba043.dnkmem (mgr.34373) 5475 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.113359+0000 mgr.gibba043.dnkmem (mgr.34373) 5476 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.115149+0000 mgr.gibba043.dnkmem (mgr.34373) 5477 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.115188+0000 mgr.gibba043.dnkmem (mgr.34373) 5478 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:28.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[31385]: cephadm 2021-03-10T15:34:27.115304+0000 mgr.gibba043.dnkmem (mgr.34373) 5479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:26.906348+0000 mgr.gibba043.dnkmem (mgr.34373) 5464 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:34:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:26.909824+0000 mgr.gibba043.dnkmem (mgr.34373) 5465 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:34:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.104310+0000 mgr.gibba043.dnkmem (mgr.34373) 5466 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.105887+0000 mgr.gibba043.dnkmem (mgr.34373) 5467 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.107048+0000 mgr.gibba043.dnkmem (mgr.34373) 5468 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.107085+0000 mgr.gibba043.dnkmem (mgr.34373) 5469 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.108587+0000 mgr.gibba043.dnkmem (mgr.34373) 5470 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.108624+0000 mgr.gibba043.dnkmem (mgr.34373) 5471 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:28.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.109889+0000 mgr.gibba043.dnkmem (mgr.34373) 5472 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.111433+0000 mgr.gibba043.dnkmem (mgr.34373) 5473 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.111470+0000 mgr.gibba043.dnkmem (mgr.34373) 5474 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.113053+0000 mgr.gibba043.dnkmem (mgr.34373) 5475 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.113359+0000 mgr.gibba043.dnkmem (mgr.34373) 5476 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.115149+0000 mgr.gibba043.dnkmem (mgr.34373) 5477 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:28.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.115188+0000 mgr.gibba043.dnkmem (mgr.34373) 5478 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:28.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:28 gibba003 bash[32348]: cephadm 2021-03-10T15:34:27.115304+0000 mgr.gibba043.dnkmem (mgr.34373) 5479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:28.508 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:34:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:26.906348+0000 mgr.gibba043.dnkmem (mgr.34373) 5464 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:34:28.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:26.909824+0000 mgr.gibba043.dnkmem (mgr.34373) 5465 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:34:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.104310+0000 mgr.gibba043.dnkmem (mgr.34373) 5466 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.105887+0000 mgr.gibba043.dnkmem (mgr.34373) 5467 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.107048+0000 mgr.gibba043.dnkmem (mgr.34373) 5468 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.107085+0000 mgr.gibba043.dnkmem (mgr.34373) 5469 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:28.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.108587+0000 mgr.gibba043.dnkmem (mgr.34373) 5470 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:28.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.108624+0000 mgr.gibba043.dnkmem (mgr.34373) 5471 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:28.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.109889+0000 mgr.gibba043.dnkmem (mgr.34373) 5472 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:28.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.111433+0000 mgr.gibba043.dnkmem (mgr.34373) 5473 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:28.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.111470+0000 mgr.gibba043.dnkmem (mgr.34373) 5474 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:28.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.113053+0000 mgr.gibba043.dnkmem (mgr.34373) 5475 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:28.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.113359+0000 mgr.gibba043.dnkmem (mgr.34373) 5476 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:28.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.115149+0000 mgr.gibba043.dnkmem (mgr.34373) 5477 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:28.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.115188+0000 mgr.gibba043.dnkmem (mgr.34373) 5478 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:28.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:28 gibba043 bash[24019]: cephadm 2021-03-10T15:34:27.115304+0000 mgr.gibba043.dnkmem (mgr.34373) 5479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:28.738 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:34:28.738 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (102m) 7m ago 108m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:34:28.739 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (107m) 6m ago 107m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:34:28.739 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (103m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:34:28.740 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (103m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:34:28.740 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:34:28.741 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:34:28.741 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (101m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:34:28.741 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:34:28.742 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (108m) 7m ago 108m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:34:28.742 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (108m) 6m ago 108m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:34:28.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:34:28.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:34:28.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:34:28.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:34:28.744 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:34:28.745 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:34:28.745 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:34:28.746 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (98m) 6m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:34:28.746 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (107m) 6m ago 108m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:34:28.747 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 106m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:34:28.983 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:34:28.984 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:34:28.984 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:28.984 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:34:28.984 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:34:28.985 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:28.985 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:34:28.985 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:34:28.985 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:34:28.985 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:34:28.986 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:34:28.986 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:34:28.986 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:34:28.986 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:34:28.987 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:34:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:29 gibba003 bash[31385]: cluster 2021-03-10T15:34:27.647537+0000 mgr.gibba043.dnkmem (mgr.34373) 5480 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:29 gibba003 bash[31385]: audit 2021-03-10T15:34:28.981974+0000 mon.a (mon.0) 1322 : audit [DBG] from='client.? 172.21.2.103:0/1693230889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:29 gibba003 bash[32348]: cluster 2021-03-10T15:34:27.647537+0000 mgr.gibba043.dnkmem (mgr.34373) 5480 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:29.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:29 gibba003 bash[32348]: audit 2021-03-10T15:34:28.981974+0000 mon.a (mon.0) 1322 : audit [DBG] from='client.? 172.21.2.103:0/1693230889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:29 gibba043 bash[24019]: cluster 2021-03-10T15:34:27.647537+0000 mgr.gibba043.dnkmem (mgr.34373) 5480 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:29 gibba043 bash[24019]: audit 2021-03-10T15:34:28.981974+0000 mon.a (mon.0) 1322 : audit [DBG] from='client.? 172.21.2.103:0/1693230889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:30.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:30 gibba003 bash[31385]: audit 2021-03-10T15:34:28.495901+0000 mgr.gibba043.dnkmem (mgr.34373) 5481 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:30.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:30 gibba003 bash[31385]: audit 2021-03-10T15:34:28.722337+0000 mgr.gibba043.dnkmem (mgr.34373) 5482 : audit [DBG] from='client.57718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:30.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:30 gibba003 bash[32348]: audit 2021-03-10T15:34:28.495901+0000 mgr.gibba043.dnkmem (mgr.34373) 5481 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:30.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:30 gibba003 bash[32348]: audit 2021-03-10T15:34:28.722337+0000 mgr.gibba043.dnkmem (mgr.34373) 5482 : audit [DBG] from='client.57718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:30.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:30 gibba043 bash[24019]: audit 2021-03-10T15:34:28.495901+0000 mgr.gibba043.dnkmem (mgr.34373) 5481 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:30.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:30 gibba043 bash[24019]: audit 2021-03-10T15:34:28.722337+0000 mgr.gibba043.dnkmem (mgr.34373) 5482 : audit [DBG] from='client.57718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:31.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:31 gibba043 bash[24019]: cluster 2021-03-10T15:34:29.648928+0000 mgr.gibba043.dnkmem (mgr.34373) 5483 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:31 gibba003 bash[31385]: cluster 2021-03-10T15:34:29.648928+0000 mgr.gibba043.dnkmem (mgr.34373) 5483 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:31 gibba003 bash[32348]: cluster 2021-03-10T15:34:29.648928+0000 mgr.gibba043.dnkmem (mgr.34373) 5483 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:33 gibba043 bash[24019]: cluster 2021-03-10T15:34:31.650477+0000 mgr.gibba043.dnkmem (mgr.34373) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:33 gibba003 bash[31385]: cluster 2021-03-10T15:34:31.650477+0000 mgr.gibba043.dnkmem (mgr.34373) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:33.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:33 gibba003 bash[32348]: cluster 2021-03-10T15:34:31.650477+0000 mgr.gibba043.dnkmem (mgr.34373) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:35 gibba043 bash[24019]: cluster 2021-03-10T15:34:33.651236+0000 mgr.gibba043.dnkmem (mgr.34373) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:35 gibba003 bash[31385]: cluster 2021-03-10T15:34:33.651236+0000 mgr.gibba043.dnkmem (mgr.34373) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:35 gibba003 bash[32348]: cluster 2021-03-10T15:34:33.651236+0000 mgr.gibba043.dnkmem (mgr.34373) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:37 gibba043 bash[24019]: cluster 2021-03-10T15:34:35.652641+0000 mgr.gibba043.dnkmem (mgr.34373) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:37 gibba003 bash[31385]: cluster 2021-03-10T15:34:35.652641+0000 mgr.gibba043.dnkmem (mgr.34373) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:37 gibba003 bash[32348]: cluster 2021-03-10T15:34:35.652641+0000 mgr.gibba043.dnkmem (mgr.34373) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:39 gibba043 bash[24019]: cluster 2021-03-10T15:34:37.654024+0000 mgr.gibba043.dnkmem (mgr.34373) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:39 gibba003 bash[31385]: cluster 2021-03-10T15:34:37.654024+0000 mgr.gibba043.dnkmem (mgr.34373) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:39 gibba003 bash[32348]: cluster 2021-03-10T15:34:37.654024+0000 mgr.gibba043.dnkmem (mgr.34373) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:41.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:41 gibba043 bash[24019]: cluster 2021-03-10T15:34:39.655397+0000 mgr.gibba043.dnkmem (mgr.34373) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:41 gibba003 bash[31385]: cluster 2021-03-10T15:34:39.655397+0000 mgr.gibba043.dnkmem (mgr.34373) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:41 gibba003 bash[32348]: cluster 2021-03-10T15:34:39.655397+0000 mgr.gibba043.dnkmem (mgr.34373) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:43 gibba043 bash[24019]: cluster 2021-03-10T15:34:41.657064+0000 mgr.gibba043.dnkmem (mgr.34373) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:43 gibba043 bash[24019]: cephadm 2021-03-10T15:34:42.131391+0000 mgr.gibba043.dnkmem (mgr.34373) 5490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:43 gibba003 bash[31385]: cluster 2021-03-10T15:34:41.657064+0000 mgr.gibba043.dnkmem (mgr.34373) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:43 gibba003 bash[31385]: cephadm 2021-03-10T15:34:42.131391+0000 mgr.gibba043.dnkmem (mgr.34373) 5490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:43 gibba003 bash[32348]: cluster 2021-03-10T15:34:41.657064+0000 mgr.gibba043.dnkmem (mgr.34373) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:43.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:43 gibba003 bash[32348]: cephadm 2021-03-10T15:34:42.131391+0000 mgr.gibba043.dnkmem (mgr.34373) 5490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:45 gibba043 bash[24019]: cluster 2021-03-10T15:34:43.658693+0000 mgr.gibba043.dnkmem (mgr.34373) 5491 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:45 gibba003 bash[31385]: cluster 2021-03-10T15:34:43.658693+0000 mgr.gibba043.dnkmem (mgr.34373) 5491 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:45 gibba003 bash[32348]: cluster 2021-03-10T15:34:43.658693+0000 mgr.gibba043.dnkmem (mgr.34373) 5491 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:47 gibba043 bash[24019]: cluster 2021-03-10T15:34:45.659323+0000 mgr.gibba043.dnkmem (mgr.34373) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:47 gibba003 bash[31385]: cluster 2021-03-10T15:34:45.659323+0000 mgr.gibba043.dnkmem (mgr.34373) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:47 gibba003 bash[32348]: cluster 2021-03-10T15:34:45.659323+0000 mgr.gibba043.dnkmem (mgr.34373) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:49 gibba003 bash[31385]: cluster 2021-03-10T15:34:47.660751+0000 mgr.gibba043.dnkmem (mgr.34373) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:49 gibba003 bash[32348]: cluster 2021-03-10T15:34:47.660751+0000 mgr.gibba043.dnkmem (mgr.34373) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:49 gibba043 bash[24019]: cluster 2021-03-10T15:34:47.660751+0000 mgr.gibba043.dnkmem (mgr.34373) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:51 gibba003 bash[31385]: cluster 2021-03-10T15:34:49.662313+0000 mgr.gibba043.dnkmem (mgr.34373) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:51 gibba003 bash[32348]: cluster 2021-03-10T15:34:49.662313+0000 mgr.gibba043.dnkmem (mgr.34373) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:51.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:51 gibba043 bash[24019]: cluster 2021-03-10T15:34:49.662313+0000 mgr.gibba043.dnkmem (mgr.34373) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:53 gibba003 bash[31385]: cluster 2021-03-10T15:34:51.663994+0000 mgr.gibba043.dnkmem (mgr.34373) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:53.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:53 gibba003 bash[32348]: cluster 2021-03-10T15:34:51.663994+0000 mgr.gibba043.dnkmem (mgr.34373) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:53 gibba043 bash[24019]: cluster 2021-03-10T15:34:51.663994+0000 mgr.gibba043.dnkmem (mgr.34373) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:55 gibba003 bash[31385]: cluster 2021-03-10T15:34:53.665240+0000 mgr.gibba043.dnkmem (mgr.34373) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:55 gibba003 bash[32348]: cluster 2021-03-10T15:34:53.665240+0000 mgr.gibba043.dnkmem (mgr.34373) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:55 gibba043 bash[24019]: cluster 2021-03-10T15:34:53.665240+0000 mgr.gibba043.dnkmem (mgr.34373) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:57 gibba043 bash[24019]: cluster 2021-03-10T15:34:55.666717+0000 mgr.gibba043.dnkmem (mgr.34373) 5497 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:57 gibba003 bash[31385]: cluster 2021-03-10T15:34:55.666717+0000 mgr.gibba043.dnkmem (mgr.34373) 5497 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:57.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:57 gibba003 bash[32348]: cluster 2021-03-10T15:34:55.666717+0000 mgr.gibba043.dnkmem (mgr.34373) 5497 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:58.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:58 gibba003 bash[31385]: cephadm 2021-03-10T15:34:57.147180+0000 mgr.gibba043.dnkmem (mgr.34373) 5498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:58.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:58 gibba003 bash[32348]: cephadm 2021-03-10T15:34:57.147180+0000 mgr.gibba043.dnkmem (mgr.34373) 5498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:58.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:58 gibba043 bash[24019]: cephadm 2021-03-10T15:34:57.147180+0000 mgr.gibba043.dnkmem (mgr.34373) 5498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:34:59.226 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:34:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:34:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (103m) 7m ago 108m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:34:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (108m) 6m ago 108m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:34:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (103m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:34:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (104m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:34:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (103m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:34:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:34:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (102m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:34:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:34:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (108m) 7m ago 108m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:34:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (108m) 6m ago 108m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:34:59.459 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:34:59.459 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:34:59.459 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:34:59.459 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:34:59.459 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:34:59.460 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:34:59.460 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:34:59.460 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:34:59.460 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (108m) 6m ago 108m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:34:59.461 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 106m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:34:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:34:59 gibba003 bash[31385]: cluster 2021-03-10T15:34:57.668384+0000 mgr.gibba043.dnkmem (mgr.34373) 5499 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:59.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:34:59 gibba003 bash[32348]: cluster 2021-03-10T15:34:57.668384+0000 mgr.gibba043.dnkmem (mgr.34373) 5499 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:59.710 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:34:59.710 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:34:59.711 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:59.711 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:34:59.711 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:34:59.711 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:59.712 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:34:59.712 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:34:59.712 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:34:59.712 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:34:59.713 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:34:59.713 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:34:59.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:34:59.713 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:34:59.713 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:34:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:34:59 gibba043 bash[24019]: cluster 2021-03-10T15:34:57.668384+0000 mgr.gibba043.dnkmem (mgr.34373) 5499 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:00 gibba003 bash[31385]: audit 2021-03-10T15:34:59.213383+0000 mgr.gibba043.dnkmem (mgr.34373) 5500 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:00.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:00 gibba003 bash[31385]: audit 2021-03-10T15:34:59.440483+0000 mgr.gibba043.dnkmem (mgr.34373) 5501 : audit [DBG] from='client.47748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:00.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:00 gibba003 bash[31385]: audit 2021-03-10T15:34:59.708731+0000 mon.c (mon.1) 1437 : audit [DBG] from='client.? 172.21.2.103:0/1996309739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:00.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:00 gibba003 bash[32348]: audit 2021-03-10T15:34:59.213383+0000 mgr.gibba043.dnkmem (mgr.34373) 5500 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:00.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:00 gibba003 bash[32348]: audit 2021-03-10T15:34:59.440483+0000 mgr.gibba043.dnkmem (mgr.34373) 5501 : audit [DBG] from='client.47748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:00.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:00 gibba003 bash[32348]: audit 2021-03-10T15:34:59.708731+0000 mon.c (mon.1) 1437 : audit [DBG] from='client.? 172.21.2.103:0/1996309739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:00.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:00 gibba043 bash[24019]: audit 2021-03-10T15:34:59.213383+0000 mgr.gibba043.dnkmem (mgr.34373) 5500 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:00.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:00 gibba043 bash[24019]: audit 2021-03-10T15:34:59.440483+0000 mgr.gibba043.dnkmem (mgr.34373) 5501 : audit [DBG] from='client.47748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:00.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:00 gibba043 bash[24019]: audit 2021-03-10T15:34:59.708731+0000 mon.c (mon.1) 1437 : audit [DBG] from='client.? 172.21.2.103:0/1996309739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:01 gibba003 bash[31385]: cluster 2021-03-10T15:34:59.669833+0000 mgr.gibba043.dnkmem (mgr.34373) 5502 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:01.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:01 gibba003 bash[32348]: cluster 2021-03-10T15:34:59.669833+0000 mgr.gibba043.dnkmem (mgr.34373) 5502 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:01.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:01 gibba043 bash[24019]: cluster 2021-03-10T15:34:59.669833+0000 mgr.gibba043.dnkmem (mgr.34373) 5502 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:03.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:03 gibba003 bash[31385]: cluster 2021-03-10T15:35:01.671644+0000 mgr.gibba043.dnkmem (mgr.34373) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:03.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:03 gibba003 bash[32348]: cluster 2021-03-10T15:35:01.671644+0000 mgr.gibba043.dnkmem (mgr.34373) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:03.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:03 gibba043 bash[24019]: cluster 2021-03-10T15:35:01.671644+0000 mgr.gibba043.dnkmem (mgr.34373) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:05.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:05 gibba003 bash[31385]: cluster 2021-03-10T15:35:03.672251+0000 mgr.gibba043.dnkmem (mgr.34373) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:05 gibba003 bash[32348]: cluster 2021-03-10T15:35:03.672251+0000 mgr.gibba043.dnkmem (mgr.34373) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:05.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:05 gibba043 bash[24019]: cluster 2021-03-10T15:35:03.672251+0000 mgr.gibba043.dnkmem (mgr.34373) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:07 gibba003 bash[31385]: cluster 2021-03-10T15:35:05.673376+0000 mgr.gibba043.dnkmem (mgr.34373) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:07.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:07 gibba003 bash[32348]: cluster 2021-03-10T15:35:05.673376+0000 mgr.gibba043.dnkmem (mgr.34373) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:07.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:07 gibba043 bash[24019]: cluster 2021-03-10T15:35:05.673376+0000 mgr.gibba043.dnkmem (mgr.34373) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:09 gibba003 bash[31385]: cluster 2021-03-10T15:35:07.674732+0000 mgr.gibba043.dnkmem (mgr.34373) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:09 gibba003 bash[32348]: cluster 2021-03-10T15:35:07.674732+0000 mgr.gibba043.dnkmem (mgr.34373) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:09.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:09 gibba043 bash[24019]: cluster 2021-03-10T15:35:07.674732+0000 mgr.gibba043.dnkmem (mgr.34373) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:11 gibba003 bash[31385]: cluster 2021-03-10T15:35:09.675616+0000 mgr.gibba043.dnkmem (mgr.34373) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:11 gibba003 bash[32348]: cluster 2021-03-10T15:35:09.675616+0000 mgr.gibba043.dnkmem (mgr.34373) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:11.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:11 gibba043 bash[24019]: cluster 2021-03-10T15:35:09.675616+0000 mgr.gibba043.dnkmem (mgr.34373) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[31385]: cluster 2021-03-10T15:35:11.677152+0000 mgr.gibba043.dnkmem (mgr.34373) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[31385]: cephadm 2021-03-10T15:35:12.163291+0000 mgr.gibba043.dnkmem (mgr.34373) 5509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:13.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[31385]: audit 2021-03-10T15:35:13.376672+0000 mon.c (mon.1) 1438 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:13.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[31385]: audit 2021-03-10T15:35:13.377782+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[32348]: cluster 2021-03-10T15:35:11.677152+0000 mgr.gibba043.dnkmem (mgr.34373) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[32348]: cephadm 2021-03-10T15:35:12.163291+0000 mgr.gibba043.dnkmem (mgr.34373) 5509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[32348]: audit 2021-03-10T15:35:13.376672+0000 mon.c (mon.1) 1438 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:13.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:13 gibba003 bash[32348]: audit 2021-03-10T15:35:13.377782+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:13 gibba043 bash[24019]: cluster 2021-03-10T15:35:11.677152+0000 mgr.gibba043.dnkmem (mgr.34373) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:13 gibba043 bash[24019]: cephadm 2021-03-10T15:35:12.163291+0000 mgr.gibba043.dnkmem (mgr.34373) 5509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:13 gibba043 bash[24019]: audit 2021-03-10T15:35:13.376672+0000 mon.c (mon.1) 1438 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:13.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:13 gibba043 bash[24019]: audit 2021-03-10T15:35:13.377782+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.508571+0000 mon.c (mon.1) 1439 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.509642+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.598534+0000 mon.c (mon.1) 1440 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:35:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.599337+0000 mon.c (mon.1) 1441 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.599799+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:35:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.600031+0000 mon.c (mon.1) 1442 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:35:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.600847+0000 mon.c (mon.1) 1443 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.601298+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.602564+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:35:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[31385]: audit 2021-03-10T15:35:13.603444+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.508571+0000 mon.c (mon.1) 1439 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.509642+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.598534+0000 mon.c (mon.1) 1440 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:35:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.599337+0000 mon.c (mon.1) 1441 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.599799+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:35:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.600031+0000 mon.c (mon.1) 1442 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:35:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.600847+0000 mon.c (mon.1) 1443 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.601298+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.602564+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:35:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:14 gibba003 bash[32348]: audit 2021-03-10T15:35:13.603444+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.508571+0000 mon.c (mon.1) 1439 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.509642+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.598534+0000 mon.c (mon.1) 1440 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:35:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.599337+0000 mon.c (mon.1) 1441 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.599799+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:35:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.600031+0000 mon.c (mon.1) 1442 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:35:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.600847+0000 mon.c (mon.1) 1443 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.601298+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.602564+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:35:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:14 gibba043 bash[24019]: audit 2021-03-10T15:35:13.603444+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:35:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:15 gibba003 bash[32348]: cluster 2021-03-10T15:35:13.678612+0000 mgr.gibba043.dnkmem (mgr.34373) 5510 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:15 gibba003 bash[31385]: cluster 2021-03-10T15:35:13.678612+0000 mgr.gibba043.dnkmem (mgr.34373) 5510 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:15 gibba043 bash[24019]: cluster 2021-03-10T15:35:13.678612+0000 mgr.gibba043.dnkmem (mgr.34373) 5510 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:17 gibba003 bash[31385]: cluster 2021-03-10T15:35:15.680237+0000 mgr.gibba043.dnkmem (mgr.34373) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:17 gibba003 bash[32348]: cluster 2021-03-10T15:35:15.680237+0000 mgr.gibba043.dnkmem (mgr.34373) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:17 gibba043 bash[24019]: cluster 2021-03-10T15:35:15.680237+0000 mgr.gibba043.dnkmem (mgr.34373) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:19 gibba003 bash[31385]: cluster 2021-03-10T15:35:17.681884+0000 mgr.gibba043.dnkmem (mgr.34373) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:19 gibba003 bash[32348]: cluster 2021-03-10T15:35:17.681884+0000 mgr.gibba043.dnkmem (mgr.34373) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:19.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:19 gibba043 bash[24019]: cluster 2021-03-10T15:35:17.681884+0000 mgr.gibba043.dnkmem (mgr.34373) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:21.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:21 gibba043 bash[24019]: cluster 2021-03-10T15:35:19.683330+0000 mgr.gibba043.dnkmem (mgr.34373) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:21.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:21 gibba003 bash[31385]: cluster 2021-03-10T15:35:19.683330+0000 mgr.gibba043.dnkmem (mgr.34373) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:21.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:21 gibba003 bash[32348]: cluster 2021-03-10T15:35:19.683330+0000 mgr.gibba043.dnkmem (mgr.34373) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:23.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:23 gibba043 bash[24019]: cluster 2021-03-10T15:35:21.684351+0000 mgr.gibba043.dnkmem (mgr.34373) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:23.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:23 gibba003 bash[31385]: cluster 2021-03-10T15:35:21.684351+0000 mgr.gibba043.dnkmem (mgr.34373) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:23.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:23 gibba003 bash[32348]: cluster 2021-03-10T15:35:21.684351+0000 mgr.gibba043.dnkmem (mgr.34373) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:25.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:25 gibba043 bash[24019]: cluster 2021-03-10T15:35:23.685601+0000 mgr.gibba043.dnkmem (mgr.34373) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:25.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:25 gibba003 bash[31385]: cluster 2021-03-10T15:35:23.685601+0000 mgr.gibba043.dnkmem (mgr.34373) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:25.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:25 gibba003 bash[32348]: cluster 2021-03-10T15:35:23.685601+0000 mgr.gibba043.dnkmem (mgr.34373) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:26 gibba043 bash[24019]: cluster 2021-03-10T15:35:25.687149+0000 mgr.gibba043.dnkmem (mgr.34373) 5516 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:26 gibba003 bash[31385]: cluster 2021-03-10T15:35:25.687149+0000 mgr.gibba043.dnkmem (mgr.34373) 5516 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:26 gibba003 bash[32348]: cluster 2021-03-10T15:35:25.687149+0000 mgr.gibba043.dnkmem (mgr.34373) 5516 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:28.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.172379+0000 mgr.gibba043.dnkmem (mgr.34373) 5517 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:35:28.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.173949+0000 mgr.gibba043.dnkmem (mgr.34373) 5518 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:35:28.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.380265+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:35:28.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.381331+0000 mgr.gibba043.dnkmem (mgr.34373) 5519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:28.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.383303+0000 mgr.gibba043.dnkmem (mgr.34373) 5520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:28.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.383935+0000 mon.c (mon.1) 1444 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:28.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.384716+0000 mgr.gibba043.dnkmem (mgr.34373) 5521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:28.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.384753+0000 mgr.gibba043.dnkmem (mgr.34373) 5522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:28.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.385618+0000 mon.c (mon.1) 1445 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.386281+0000 mgr.gibba043.dnkmem (mgr.34373) 5523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:28.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.386318+0000 mgr.gibba043.dnkmem (mgr.34373) 5524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:28.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.387012+0000 mon.c (mon.1) 1446 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.387780+0000 mgr.gibba043.dnkmem (mgr.34373) 5525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:28.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.388566+0000 mon.c (mon.1) 1447 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.389229+0000 mgr.gibba043.dnkmem (mgr.34373) 5526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:28.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.389266+0000 mgr.gibba043.dnkmem (mgr.34373) 5527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:28.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.390635+0000 mgr.gibba043.dnkmem (mgr.34373) 5528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:28.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.390954+0000 mgr.gibba043.dnkmem (mgr.34373) 5529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:28.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.391651+0000 mon.c (mon.1) 1448 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.392107+0000 mgr.gibba043.dnkmem (mgr.34373) 5530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:28.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.392143+0000 mgr.gibba043.dnkmem (mgr.34373) 5531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:28.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: cephadm 2021-03-10T15:35:27.392247+0000 mgr.gibba043.dnkmem (mgr.34373) 5532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:28.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[31385]: audit 2021-03-10T15:35:27.393191+0000 mon.c (mon.1) 1449 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.172379+0000 mgr.gibba043.dnkmem (mgr.34373) 5517 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:35:28.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.173949+0000 mgr.gibba043.dnkmem (mgr.34373) 5518 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:35:28.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.380265+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:35:28.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.381331+0000 mgr.gibba043.dnkmem (mgr.34373) 5519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:28.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.383303+0000 mgr.gibba043.dnkmem (mgr.34373) 5520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:28.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.383935+0000 mon.c (mon.1) 1444 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:28.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.384716+0000 mgr.gibba043.dnkmem (mgr.34373) 5521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:28.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.384753+0000 mgr.gibba043.dnkmem (mgr.34373) 5522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:28.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.385618+0000 mon.c (mon.1) 1445 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.386281+0000 mgr.gibba043.dnkmem (mgr.34373) 5523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:28.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.386318+0000 mgr.gibba043.dnkmem (mgr.34373) 5524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:28.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.387012+0000 mon.c (mon.1) 1446 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.387780+0000 mgr.gibba043.dnkmem (mgr.34373) 5525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:28.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.388566+0000 mon.c (mon.1) 1447 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.389229+0000 mgr.gibba043.dnkmem (mgr.34373) 5526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:28.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.389266+0000 mgr.gibba043.dnkmem (mgr.34373) 5527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:28.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.390635+0000 mgr.gibba043.dnkmem (mgr.34373) 5528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:28.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.390954+0000 mgr.gibba043.dnkmem (mgr.34373) 5529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:28.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.391651+0000 mon.c (mon.1) 1448 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.392107+0000 mgr.gibba043.dnkmem (mgr.34373) 5530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:28.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.392143+0000 mgr.gibba043.dnkmem (mgr.34373) 5531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:28.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: cephadm 2021-03-10T15:35:27.392247+0000 mgr.gibba043.dnkmem (mgr.34373) 5532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:28.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:28 gibba003 bash[32348]: audit 2021-03-10T15:35:27.393191+0000 mon.c (mon.1) 1449 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.172379+0000 mgr.gibba043.dnkmem (mgr.34373) 5517 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:35:28.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.173949+0000 mgr.gibba043.dnkmem (mgr.34373) 5518 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:35:28.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.380265+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:35:28.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.381331+0000 mgr.gibba043.dnkmem (mgr.34373) 5519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:28.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.383303+0000 mgr.gibba043.dnkmem (mgr.34373) 5520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:28.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.383935+0000 mon.c (mon.1) 1444 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:28.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.384716+0000 mgr.gibba043.dnkmem (mgr.34373) 5521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:28.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.384753+0000 mgr.gibba043.dnkmem (mgr.34373) 5522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:28.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.385618+0000 mon.c (mon.1) 1445 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.386281+0000 mgr.gibba043.dnkmem (mgr.34373) 5523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:28.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.386318+0000 mgr.gibba043.dnkmem (mgr.34373) 5524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:28.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.387012+0000 mon.c (mon.1) 1446 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.387780+0000 mgr.gibba043.dnkmem (mgr.34373) 5525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:28.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.388566+0000 mon.c (mon.1) 1447 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.389229+0000 mgr.gibba043.dnkmem (mgr.34373) 5526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:28.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.389266+0000 mgr.gibba043.dnkmem (mgr.34373) 5527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:28.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.390635+0000 mgr.gibba043.dnkmem (mgr.34373) 5528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:28.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.390954+0000 mgr.gibba043.dnkmem (mgr.34373) 5529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:28.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.391651+0000 mon.c (mon.1) 1448 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:28.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.392107+0000 mgr.gibba043.dnkmem (mgr.34373) 5530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:28.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.392143+0000 mgr.gibba043.dnkmem (mgr.34373) 5531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:28.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: cephadm 2021-03-10T15:35:27.392247+0000 mgr.gibba043.dnkmem (mgr.34373) 5532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:28.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:28 gibba043 bash[24019]: audit 2021-03-10T15:35:27.393191+0000 mon.c (mon.1) 1449 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:29 gibba003 bash[31385]: cluster 2021-03-10T15:35:27.688779+0000 mgr.gibba043.dnkmem (mgr.34373) 5533 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:29 gibba003 bash[32348]: cluster 2021-03-10T15:35:27.688779+0000 mgr.gibba043.dnkmem (mgr.34373) 5533 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:29.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:29 gibba043 bash[24019]: cluster 2021-03-10T15:35:27.688779+0000 mgr.gibba043.dnkmem (mgr.34373) 5533 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:29.949 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:35:30.178 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:35:30.178 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (103m) 8m ago 109m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:35:30.179 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (108m) 7m ago 108m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:35:30.179 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (104m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:35:30.180 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (104m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:35:30.180 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:35:30.181 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:35:30.181 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:35:30.181 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:35:30.182 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (109m) 8m ago 109m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:35:30.182 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (109m) 7m ago 109m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:35:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:35:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:35:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:35:30.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:35:30.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:35:30.185 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:35:30.185 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:35:30.186 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (99m) 7m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:35:30.186 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (108m) 7m ago 109m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:35:30.186 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 107m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:35:30.427 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:35:30.427 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:35:30.428 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:30.428 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:35:30.428 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:35:30.429 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:30.429 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:35:30.429 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:35:30.429 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:35:30.429 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:35:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:35:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:35:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:35:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:35:30.431 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:35:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[31385]: cluster 2021-03-10T15:35:29.690189+0000 mgr.gibba043.dnkmem (mgr.34373) 5534 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[31385]: audit 2021-03-10T15:35:29.936910+0000 mgr.gibba043.dnkmem (mgr.34373) 5535 : audit [DBG] from='client.47760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[31385]: audit 2021-03-10T15:35:30.161896+0000 mgr.gibba043.dnkmem (mgr.34373) 5536 : audit [DBG] from='client.47766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:31.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[31385]: audit 2021-03-10T15:35:30.425670+0000 mon.a (mon.0) 1330 : audit [DBG] from='client.? 172.21.2.103:0/1028858602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:31.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[32348]: cluster 2021-03-10T15:35:29.690189+0000 mgr.gibba043.dnkmem (mgr.34373) 5534 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:31.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[32348]: audit 2021-03-10T15:35:29.936910+0000 mgr.gibba043.dnkmem (mgr.34373) 5535 : audit [DBG] from='client.47760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:31.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[32348]: audit 2021-03-10T15:35:30.161896+0000 mgr.gibba043.dnkmem (mgr.34373) 5536 : audit [DBG] from='client.47766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:31.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:31 gibba003 bash[32348]: audit 2021-03-10T15:35:30.425670+0000 mon.a (mon.0) 1330 : audit [DBG] from='client.? 172.21.2.103:0/1028858602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:31.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:31 gibba043 bash[24019]: cluster 2021-03-10T15:35:29.690189+0000 mgr.gibba043.dnkmem (mgr.34373) 5534 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:31.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:31 gibba043 bash[24019]: audit 2021-03-10T15:35:29.936910+0000 mgr.gibba043.dnkmem (mgr.34373) 5535 : audit [DBG] from='client.47760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:31.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:31 gibba043 bash[24019]: audit 2021-03-10T15:35:30.161896+0000 mgr.gibba043.dnkmem (mgr.34373) 5536 : audit [DBG] from='client.47766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:31.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:31 gibba043 bash[24019]: audit 2021-03-10T15:35:30.425670+0000 mon.a (mon.0) 1330 : audit [DBG] from='client.? 172.21.2.103:0/1028858602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:33 gibba003 bash[31385]: cluster 2021-03-10T15:35:31.691974+0000 mgr.gibba043.dnkmem (mgr.34373) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:33 gibba003 bash[32348]: cluster 2021-03-10T15:35:31.691974+0000 mgr.gibba043.dnkmem (mgr.34373) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:33.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:33 gibba043 bash[24019]: cluster 2021-03-10T15:35:31.691974+0000 mgr.gibba043.dnkmem (mgr.34373) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:35 gibba003 bash[31385]: cluster 2021-03-10T15:35:33.692960+0000 mgr.gibba043.dnkmem (mgr.34373) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:35 gibba003 bash[32348]: cluster 2021-03-10T15:35:33.692960+0000 mgr.gibba043.dnkmem (mgr.34373) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:35.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:35 gibba043 bash[24019]: cluster 2021-03-10T15:35:33.692960+0000 mgr.gibba043.dnkmem (mgr.34373) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:37 gibba003 bash[31385]: cluster 2021-03-10T15:35:35.694385+0000 mgr.gibba043.dnkmem (mgr.34373) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:37 gibba003 bash[32348]: cluster 2021-03-10T15:35:35.694385+0000 mgr.gibba043.dnkmem (mgr.34373) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:37 gibba043 bash[24019]: cluster 2021-03-10T15:35:35.694385+0000 mgr.gibba043.dnkmem (mgr.34373) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:39 gibba043 bash[24019]: cluster 2021-03-10T15:35:37.696097+0000 mgr.gibba043.dnkmem (mgr.34373) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:39 gibba003 bash[31385]: cluster 2021-03-10T15:35:37.696097+0000 mgr.gibba043.dnkmem (mgr.34373) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:39 gibba003 bash[32348]: cluster 2021-03-10T15:35:37.696097+0000 mgr.gibba043.dnkmem (mgr.34373) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:41.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:41 gibba043 bash[24019]: cluster 2021-03-10T15:35:39.697472+0000 mgr.gibba043.dnkmem (mgr.34373) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:41.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:41 gibba003 bash[31385]: cluster 2021-03-10T15:35:39.697472+0000 mgr.gibba043.dnkmem (mgr.34373) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:41.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:41 gibba003 bash[32348]: cluster 2021-03-10T15:35:39.697472+0000 mgr.gibba043.dnkmem (mgr.34373) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:43.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:43 gibba043 bash[24019]: cluster 2021-03-10T15:35:41.698938+0000 mgr.gibba043.dnkmem (mgr.34373) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:43.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:43 gibba043 bash[24019]: cephadm 2021-03-10T15:35:42.408359+0000 mgr.gibba043.dnkmem (mgr.34373) 5543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:43 gibba003 bash[31385]: cluster 2021-03-10T15:35:41.698938+0000 mgr.gibba043.dnkmem (mgr.34373) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:43.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:43 gibba003 bash[31385]: cephadm 2021-03-10T15:35:42.408359+0000 mgr.gibba043.dnkmem (mgr.34373) 5543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:43.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:43 gibba003 bash[32348]: cluster 2021-03-10T15:35:41.698938+0000 mgr.gibba043.dnkmem (mgr.34373) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:43.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:43 gibba003 bash[32348]: cephadm 2021-03-10T15:35:42.408359+0000 mgr.gibba043.dnkmem (mgr.34373) 5543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:45.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:45 gibba043 bash[24019]: cluster 2021-03-10T15:35:43.700603+0000 mgr.gibba043.dnkmem (mgr.34373) 5544 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:45.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:45 gibba003 bash[31385]: cluster 2021-03-10T15:35:43.700603+0000 mgr.gibba043.dnkmem (mgr.34373) 5544 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:45.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:45 gibba003 bash[32348]: cluster 2021-03-10T15:35:43.700603+0000 mgr.gibba043.dnkmem (mgr.34373) 5544 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:46 gibba043 bash[24019]: cluster 2021-03-10T15:35:45.701657+0000 mgr.gibba043.dnkmem (mgr.34373) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:46 gibba003 bash[31385]: cluster 2021-03-10T15:35:45.701657+0000 mgr.gibba043.dnkmem (mgr.34373) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:46 gibba003 bash[32348]: cluster 2021-03-10T15:35:45.701657+0000 mgr.gibba043.dnkmem (mgr.34373) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:48 gibba043 bash[24019]: cluster 2021-03-10T15:35:47.703120+0000 mgr.gibba043.dnkmem (mgr.34373) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:49.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:48 gibba003 bash[31385]: cluster 2021-03-10T15:35:47.703120+0000 mgr.gibba043.dnkmem (mgr.34373) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:48 gibba003 bash[32348]: cluster 2021-03-10T15:35:47.703120+0000 mgr.gibba043.dnkmem (mgr.34373) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:50 gibba003 bash[31385]: cluster 2021-03-10T15:35:49.704633+0000 mgr.gibba043.dnkmem (mgr.34373) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:50 gibba003 bash[32348]: cluster 2021-03-10T15:35:49.704633+0000 mgr.gibba043.dnkmem (mgr.34373) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:50 gibba043 bash[24019]: cluster 2021-03-10T15:35:49.704633+0000 mgr.gibba043.dnkmem (mgr.34373) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:52 gibba003 bash[31385]: cluster 2021-03-10T15:35:51.705758+0000 mgr.gibba043.dnkmem (mgr.34373) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:52 gibba003 bash[32348]: cluster 2021-03-10T15:35:51.705758+0000 mgr.gibba043.dnkmem (mgr.34373) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:52 gibba043 bash[24019]: cluster 2021-03-10T15:35:51.705758+0000 mgr.gibba043.dnkmem (mgr.34373) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:55.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:54 gibba003 bash[31385]: cluster 2021-03-10T15:35:53.707359+0000 mgr.gibba043.dnkmem (mgr.34373) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:54 gibba003 bash[32348]: cluster 2021-03-10T15:35:53.707359+0000 mgr.gibba043.dnkmem (mgr.34373) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:54 gibba043 bash[24019]: cluster 2021-03-10T15:35:53.707359+0000 mgr.gibba043.dnkmem (mgr.34373) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:57.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:56 gibba003 bash[31385]: cluster 2021-03-10T15:35:55.708832+0000 mgr.gibba043.dnkmem (mgr.34373) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:57.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:56 gibba003 bash[32348]: cluster 2021-03-10T15:35:55.708832+0000 mgr.gibba043.dnkmem (mgr.34373) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:56 gibba043 bash[24019]: cluster 2021-03-10T15:35:55.708832+0000 mgr.gibba043.dnkmem (mgr.34373) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:57 gibba003 bash[31385]: cephadm 2021-03-10T15:35:57.417081+0000 mgr.gibba043.dnkmem (mgr.34373) 5551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:58.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:57 gibba003 bash[32348]: cephadm 2021-03-10T15:35:57.417081+0000 mgr.gibba043.dnkmem (mgr.34373) 5551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:57 gibba043 bash[24019]: cephadm 2021-03-10T15:35:57.417081+0000 mgr.gibba043.dnkmem (mgr.34373) 5551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:35:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:35:58 gibba003 bash[31385]: cluster 2021-03-10T15:35:57.710065+0000 mgr.gibba043.dnkmem (mgr.34373) 5552 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:35:58 gibba003 bash[32348]: cluster 2021-03-10T15:35:57.710065+0000 mgr.gibba043.dnkmem (mgr.34373) 5552 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:35:58 gibba043 bash[24019]: cluster 2021-03-10T15:35:57.710065+0000 mgr.gibba043.dnkmem (mgr.34373) 5552 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:00.671 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:36:00.895 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:36:00.895 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (104m) 8m ago 109m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:36:00.896 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (109m) 7m ago 109m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:36:00.896 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (104m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:36:00.896 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (105m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:36:00.896 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (104m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:36:00.897 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:36:00.897 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (103m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:36:00.897 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:36:00.897 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (109m) 8m ago 109m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:36:00.897 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (109m) 7m ago 109m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:36:00.898 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:36:00.898 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:36:00.898 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:36:00.898 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:36:00.898 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:36:00.899 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:36:00.899 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:36:00.899 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:36:00.899 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (109m) 7m ago 109m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:36:00.899 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 107m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:36:01.144 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:36:01.144 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:36:01.144 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:01.144 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:36:01.145 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:36:01.145 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:01.145 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:36:01.145 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:36:01.146 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:36:01.146 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:36:01.146 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:36:01.146 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:36:01.147 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:36:01.147 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:36:01.147 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:36:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:00 gibba003 bash[31385]: cluster 2021-03-10T15:35:59.711416+0000 mgr.gibba043.dnkmem (mgr.34373) 5553 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:00 gibba003 bash[32348]: cluster 2021-03-10T15:35:59.711416+0000 mgr.gibba043.dnkmem (mgr.34373) 5553 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:00 gibba043 bash[24019]: cluster 2021-03-10T15:35:59.711416+0000 mgr.gibba043.dnkmem (mgr.34373) 5553 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:01 gibba003 bash[31385]: audit 2021-03-10T15:36:00.659128+0000 mgr.gibba043.dnkmem (mgr.34373) 5554 : audit [DBG] from='client.57766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:01 gibba003 bash[31385]: audit 2021-03-10T15:36:00.881507+0000 mgr.gibba043.dnkmem (mgr.34373) 5555 : audit [DBG] from='client.57772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:02.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:01 gibba003 bash[31385]: audit 2021-03-10T15:36:01.142141+0000 mon.a (mon.0) 1331 : audit [DBG] from='client.? 172.21.2.103:0/2852802556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:01 gibba003 bash[32348]: audit 2021-03-10T15:36:00.659128+0000 mgr.gibba043.dnkmem (mgr.34373) 5554 : audit [DBG] from='client.57766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:01 gibba003 bash[32348]: audit 2021-03-10T15:36:00.881507+0000 mgr.gibba043.dnkmem (mgr.34373) 5555 : audit [DBG] from='client.57772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:02.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:01 gibba003 bash[32348]: audit 2021-03-10T15:36:01.142141+0000 mon.a (mon.0) 1331 : audit [DBG] from='client.? 172.21.2.103:0/2852802556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:02.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:01 gibba043 bash[24019]: audit 2021-03-10T15:36:00.659128+0000 mgr.gibba043.dnkmem (mgr.34373) 5554 : audit [DBG] from='client.57766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:02.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:01 gibba043 bash[24019]: audit 2021-03-10T15:36:00.881507+0000 mgr.gibba043.dnkmem (mgr.34373) 5555 : audit [DBG] from='client.57772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:02.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:01 gibba043 bash[24019]: audit 2021-03-10T15:36:01.142141+0000 mon.a (mon.0) 1331 : audit [DBG] from='client.? 172.21.2.103:0/2852802556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:03.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:02 gibba003 bash[31385]: cluster 2021-03-10T15:36:01.713206+0000 mgr.gibba043.dnkmem (mgr.34373) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:02 gibba003 bash[32348]: cluster 2021-03-10T15:36:01.713206+0000 mgr.gibba043.dnkmem (mgr.34373) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:02 gibba043 bash[24019]: cluster 2021-03-10T15:36:01.713206+0000 mgr.gibba043.dnkmem (mgr.34373) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:04 gibba003 bash[31385]: cluster 2021-03-10T15:36:03.714491+0000 mgr.gibba043.dnkmem (mgr.34373) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:04 gibba003 bash[32348]: cluster 2021-03-10T15:36:03.714491+0000 mgr.gibba043.dnkmem (mgr.34373) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:04 gibba043 bash[24019]: cluster 2021-03-10T15:36:03.714491+0000 mgr.gibba043.dnkmem (mgr.34373) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:06 gibba003 bash[31385]: cluster 2021-03-10T15:36:05.715878+0000 mgr.gibba043.dnkmem (mgr.34373) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:06 gibba003 bash[32348]: cluster 2021-03-10T15:36:05.715878+0000 mgr.gibba043.dnkmem (mgr.34373) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:06 gibba043 bash[24019]: cluster 2021-03-10T15:36:05.715878+0000 mgr.gibba043.dnkmem (mgr.34373) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:08 gibba003 bash[31385]: cluster 2021-03-10T15:36:07.717538+0000 mgr.gibba043.dnkmem (mgr.34373) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:08 gibba003 bash[32348]: cluster 2021-03-10T15:36:07.717538+0000 mgr.gibba043.dnkmem (mgr.34373) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:08 gibba043 bash[24019]: cluster 2021-03-10T15:36:07.717538+0000 mgr.gibba043.dnkmem (mgr.34373) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:10 gibba003 bash[31385]: cluster 2021-03-10T15:36:09.718962+0000 mgr.gibba043.dnkmem (mgr.34373) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:11.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:10 gibba003 bash[32348]: cluster 2021-03-10T15:36:09.718962+0000 mgr.gibba043.dnkmem (mgr.34373) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:10 gibba043 bash[24019]: cluster 2021-03-10T15:36:09.718962+0000 mgr.gibba043.dnkmem (mgr.34373) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:12 gibba003 bash[31385]: cluster 2021-03-10T15:36:11.720810+0000 mgr.gibba043.dnkmem (mgr.34373) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:12 gibba003 bash[31385]: cephadm 2021-03-10T15:36:12.432515+0000 mgr.gibba043.dnkmem (mgr.34373) 5562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:12 gibba003 bash[32348]: cluster 2021-03-10T15:36:11.720810+0000 mgr.gibba043.dnkmem (mgr.34373) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:13.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:12 gibba003 bash[32348]: cephadm 2021-03-10T15:36:12.432515+0000 mgr.gibba043.dnkmem (mgr.34373) 5562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:12 gibba043 bash[24019]: cluster 2021-03-10T15:36:11.720810+0000 mgr.gibba043.dnkmem (mgr.34373) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:12 gibba043 bash[24019]: cephadm 2021-03-10T15:36:12.432515+0000 mgr.gibba043.dnkmem (mgr.34373) 5562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.383912+0000 mon.c (mon.1) 1450 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.385058+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.516728+0000 mon.c (mon.1) 1451 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.517893+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.608989+0000 mon.c (mon.1) 1452 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:36:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.609709+0000 mon.c (mon.1) 1453 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.610367+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:36:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.610418+0000 mon.c (mon.1) 1454 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:36:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.611157+0000 mon.c (mon.1) 1455 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.612525+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.613456+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:36:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[31385]: audit 2021-03-10T15:36:13.614380+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.383912+0000 mon.c (mon.1) 1450 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.385058+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.516728+0000 mon.c (mon.1) 1451 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.517893+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.608989+0000 mon.c (mon.1) 1452 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:36:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.609709+0000 mon.c (mon.1) 1453 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.610367+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:36:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.610418+0000 mon.c (mon.1) 1454 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:36:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.611157+0000 mon.c (mon.1) 1455 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.612525+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.613456+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:36:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:13 gibba003 bash[32348]: audit 2021-03-10T15:36:13.614380+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.383912+0000 mon.c (mon.1) 1450 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.385058+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.516728+0000 mon.c (mon.1) 1451 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.517893+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.608989+0000 mon.c (mon.1) 1452 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:36:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.609709+0000 mon.c (mon.1) 1453 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.610367+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:36:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.610418+0000 mon.c (mon.1) 1454 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:36:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.611157+0000 mon.c (mon.1) 1455 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.612525+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:36:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.613456+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:36:14.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:13 gibba043 bash[24019]: audit 2021-03-10T15:36:13.614380+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:36:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:14 gibba003 bash[31385]: cluster 2021-03-10T15:36:13.722503+0000 mgr.gibba043.dnkmem (mgr.34373) 5563 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:14 gibba003 bash[32348]: cluster 2021-03-10T15:36:13.722503+0000 mgr.gibba043.dnkmem (mgr.34373) 5563 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:14 gibba043 bash[24019]: cluster 2021-03-10T15:36:13.722503+0000 mgr.gibba043.dnkmem (mgr.34373) 5563 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:16 gibba003 bash[31385]: cluster 2021-03-10T15:36:15.724105+0000 mgr.gibba043.dnkmem (mgr.34373) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:16 gibba003 bash[32348]: cluster 2021-03-10T15:36:15.724105+0000 mgr.gibba043.dnkmem (mgr.34373) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:16 gibba043 bash[24019]: cluster 2021-03-10T15:36:15.724105+0000 mgr.gibba043.dnkmem (mgr.34373) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:18 gibba003 bash[31385]: cluster 2021-03-10T15:36:17.725455+0000 mgr.gibba043.dnkmem (mgr.34373) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:18 gibba003 bash[32348]: cluster 2021-03-10T15:36:17.725455+0000 mgr.gibba043.dnkmem (mgr.34373) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:18 gibba043 bash[24019]: cluster 2021-03-10T15:36:17.725455+0000 mgr.gibba043.dnkmem (mgr.34373) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:21.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:20 gibba003 bash[31385]: cluster 2021-03-10T15:36:19.726969+0000 mgr.gibba043.dnkmem (mgr.34373) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:20 gibba003 bash[32348]: cluster 2021-03-10T15:36:19.726969+0000 mgr.gibba043.dnkmem (mgr.34373) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:20 gibba043 bash[24019]: cluster 2021-03-10T15:36:19.726969+0000 mgr.gibba043.dnkmem (mgr.34373) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:23.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:22 gibba003 bash[31385]: cluster 2021-03-10T15:36:21.728668+0000 mgr.gibba043.dnkmem (mgr.34373) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:23.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:22 gibba003 bash[32348]: cluster 2021-03-10T15:36:21.728668+0000 mgr.gibba043.dnkmem (mgr.34373) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:22 gibba043 bash[24019]: cluster 2021-03-10T15:36:21.728668+0000 mgr.gibba043.dnkmem (mgr.34373) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:24 gibba003 bash[31385]: cluster 2021-03-10T15:36:23.730138+0000 mgr.gibba043.dnkmem (mgr.34373) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:24 gibba003 bash[32348]: cluster 2021-03-10T15:36:23.730138+0000 mgr.gibba043.dnkmem (mgr.34373) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:24 gibba043 bash[24019]: cluster 2021-03-10T15:36:23.730138+0000 mgr.gibba043.dnkmem (mgr.34373) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:26 gibba043 bash[24019]: cluster 2021-03-10T15:36:25.731520+0000 mgr.gibba043.dnkmem (mgr.34373) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:26 gibba003 bash[31385]: cluster 2021-03-10T15:36:25.731520+0000 mgr.gibba043.dnkmem (mgr.34373) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:26 gibba003 bash[32348]: cluster 2021-03-10T15:36:25.731520+0000 mgr.gibba043.dnkmem (mgr.34373) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.449293+0000 mgr.gibba043.dnkmem (mgr.34373) 5570 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:36:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.450861+0000 mgr.gibba043.dnkmem (mgr.34373) 5571 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:36:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.660289+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:36:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.663989+0000 mon.c (mon.1) 1456 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.665791+0000 mon.c (mon.1) 1457 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.667345+0000 mon.c (mon.1) 1458 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.668792+0000 mon.c (mon.1) 1459 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.671577+0000 mon.c (mon.1) 1460 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:27 gibba043 bash[24019]: audit 2021-03-10T15:36:27.672957+0000 mon.c (mon.1) 1461 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.449293+0000 mgr.gibba043.dnkmem (mgr.34373) 5570 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:36:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.450861+0000 mgr.gibba043.dnkmem (mgr.34373) 5571 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:36:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.660289+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:36:28.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.663989+0000 mon.c (mon.1) 1456 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.665791+0000 mon.c (mon.1) 1457 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.667345+0000 mon.c (mon.1) 1458 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.668792+0000 mon.c (mon.1) 1459 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.671577+0000 mon.c (mon.1) 1460 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[31385]: audit 2021-03-10T15:36:27.672957+0000 mon.c (mon.1) 1461 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.449293+0000 mgr.gibba043.dnkmem (mgr.34373) 5570 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:36:28.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.450861+0000 mgr.gibba043.dnkmem (mgr.34373) 5571 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:36:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.660289+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:36:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.663989+0000 mon.c (mon.1) 1456 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.665791+0000 mon.c (mon.1) 1457 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.667345+0000 mon.c (mon.1) 1458 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.668792+0000 mon.c (mon.1) 1459 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.671577+0000 mon.c (mon.1) 1460 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:28.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:27 gibba003 bash[32348]: audit 2021-03-10T15:36:27.672957+0000 mon.c (mon.1) 1461 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.661253+0000 mgr.gibba043.dnkmem (mgr.34373) 5572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.663419+0000 mgr.gibba043.dnkmem (mgr.34373) 5573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.665015+0000 mgr.gibba043.dnkmem (mgr.34373) 5574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.665054+0000 mgr.gibba043.dnkmem (mgr.34373) 5575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.666467+0000 mgr.gibba043.dnkmem (mgr.34373) 5576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.666504+0000 mgr.gibba043.dnkmem (mgr.34373) 5577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.667803+0000 mgr.gibba043.dnkmem (mgr.34373) 5578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.669290+0000 mgr.gibba043.dnkmem (mgr.34373) 5579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.669391+0000 mgr.gibba043.dnkmem (mgr.34373) 5580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.670312+0000 mgr.gibba043.dnkmem (mgr.34373) 5581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.670695+0000 mgr.gibba043.dnkmem (mgr.34373) 5582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.671865+0000 mgr.gibba043.dnkmem (mgr.34373) 5583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.671901+0000 mgr.gibba043.dnkmem (mgr.34373) 5584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:29.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cephadm 2021-03-10T15:36:27.672008+0000 mgr.gibba043.dnkmem (mgr.34373) 5585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:29.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:28 gibba043 bash[24019]: cluster 2021-03-10T15:36:27.732913+0000 mgr.gibba043.dnkmem (mgr.34373) 5586 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.661253+0000 mgr.gibba043.dnkmem (mgr.34373) 5572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.663419+0000 mgr.gibba043.dnkmem (mgr.34373) 5573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.665015+0000 mgr.gibba043.dnkmem (mgr.34373) 5574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.665054+0000 mgr.gibba043.dnkmem (mgr.34373) 5575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.666467+0000 mgr.gibba043.dnkmem (mgr.34373) 5576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.666504+0000 mgr.gibba043.dnkmem (mgr.34373) 5577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:29.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.667803+0000 mgr.gibba043.dnkmem (mgr.34373) 5578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:29.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.669290+0000 mgr.gibba043.dnkmem (mgr.34373) 5579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:29.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.669391+0000 mgr.gibba043.dnkmem (mgr.34373) 5580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:29.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.670312+0000 mgr.gibba043.dnkmem (mgr.34373) 5581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.670695+0000 mgr.gibba043.dnkmem (mgr.34373) 5582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.671865+0000 mgr.gibba043.dnkmem (mgr.34373) 5583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.671901+0000 mgr.gibba043.dnkmem (mgr.34373) 5584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cephadm 2021-03-10T15:36:27.672008+0000 mgr.gibba043.dnkmem (mgr.34373) 5585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[31385]: cluster 2021-03-10T15:36:27.732913+0000 mgr.gibba043.dnkmem (mgr.34373) 5586 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:29.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.661253+0000 mgr.gibba043.dnkmem (mgr.34373) 5572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:29.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.663419+0000 mgr.gibba043.dnkmem (mgr.34373) 5573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:29.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.665015+0000 mgr.gibba043.dnkmem (mgr.34373) 5574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.665054+0000 mgr.gibba043.dnkmem (mgr.34373) 5575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.666467+0000 mgr.gibba043.dnkmem (mgr.34373) 5576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.666504+0000 mgr.gibba043.dnkmem (mgr.34373) 5577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:29.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.667803+0000 mgr.gibba043.dnkmem (mgr.34373) 5578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.669290+0000 mgr.gibba043.dnkmem (mgr.34373) 5579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.669391+0000 mgr.gibba043.dnkmem (mgr.34373) 5580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.670312+0000 mgr.gibba043.dnkmem (mgr.34373) 5581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.670695+0000 mgr.gibba043.dnkmem (mgr.34373) 5582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.671865+0000 mgr.gibba043.dnkmem (mgr.34373) 5583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.671901+0000 mgr.gibba043.dnkmem (mgr.34373) 5584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cephadm 2021-03-10T15:36:27.672008+0000 mgr.gibba043.dnkmem (mgr.34373) 5585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:28 gibba003 bash[32348]: cluster 2021-03-10T15:36:27.732913+0000 mgr.gibba043.dnkmem (mgr.34373) 5586 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:30 gibba043 bash[24019]: cluster 2021-03-10T15:36:29.734458+0000 mgr.gibba043.dnkmem (mgr.34373) 5587 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:31.387 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:36:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:30 gibba003 bash[31385]: cluster 2021-03-10T15:36:29.734458+0000 mgr.gibba043.dnkmem (mgr.34373) 5587 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:30 gibba003 bash[32348]: cluster 2021-03-10T15:36:29.734458+0000 mgr.gibba043.dnkmem (mgr.34373) 5587 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:31.650 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:36:31.650 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (104m) 9m ago 110m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:36:31.651 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (109m) 8m ago 109m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:36:31.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (105m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:36:31.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (105m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:36:31.651 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:36:31.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:36:31.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:36:31.652 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:36:31.652 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (110m) 9m ago 110m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:36:31.653 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (110m) 8m ago 110m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:36:31.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:36:31.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:36:31.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:36:31.653 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:36:31.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:36:31.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:36:31.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:36:31.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (100m) 8m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:36:31.655 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (109m) 8m ago 110m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:36:31.655 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 108m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:36:31.900 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:36:31.900 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:36:31.901 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:31.901 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:36:31.901 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:36:31.901 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:31.902 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:36:31.902 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:36:31.902 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:36:31.902 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:36:31.903 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:36:31.903 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:36:31.903 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:36:31.903 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:36:31.903 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:36:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:31 gibba043 bash[24019]: audit 2021-03-10T15:36:31.374428+0000 mgr.gibba043.dnkmem (mgr.34373) 5588 : audit [DBG] from='client.57784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:31 gibba043 bash[24019]: audit 2021-03-10T15:36:31.898768+0000 mon.c (mon.1) 1462 : audit [DBG] from='client.? 172.21.2.103:0/3728524120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:31 gibba003 bash[31385]: audit 2021-03-10T15:36:31.374428+0000 mgr.gibba043.dnkmem (mgr.34373) 5588 : audit [DBG] from='client.57784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:31 gibba003 bash[31385]: audit 2021-03-10T15:36:31.898768+0000 mon.c (mon.1) 1462 : audit [DBG] from='client.? 172.21.2.103:0/3728524120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:31 gibba003 bash[32348]: audit 2021-03-10T15:36:31.374428+0000 mgr.gibba043.dnkmem (mgr.34373) 5588 : audit [DBG] from='client.57784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:32.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:31 gibba003 bash[32348]: audit 2021-03-10T15:36:31.898768+0000 mon.c (mon.1) 1462 : audit [DBG] from='client.? 172.21.2.103:0/3728524120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:32 gibba043 bash[24019]: audit 2021-03-10T15:36:31.607735+0000 mgr.gibba043.dnkmem (mgr.34373) 5589 : audit [DBG] from='client.47802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:32 gibba043 bash[24019]: cluster 2021-03-10T15:36:31.736155+0000 mgr.gibba043.dnkmem (mgr.34373) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:32 gibba003 bash[31385]: audit 2021-03-10T15:36:31.607735+0000 mgr.gibba043.dnkmem (mgr.34373) 5589 : audit [DBG] from='client.47802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:32 gibba003 bash[31385]: cluster 2021-03-10T15:36:31.736155+0000 mgr.gibba043.dnkmem (mgr.34373) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:32 gibba003 bash[32348]: audit 2021-03-10T15:36:31.607735+0000 mgr.gibba043.dnkmem (mgr.34373) 5589 : audit [DBG] from='client.47802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:33.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:32 gibba003 bash[32348]: cluster 2021-03-10T15:36:31.736155+0000 mgr.gibba043.dnkmem (mgr.34373) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:34 gibba043 bash[24019]: cluster 2021-03-10T15:36:33.737727+0000 mgr.gibba043.dnkmem (mgr.34373) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:34 gibba003 bash[31385]: cluster 2021-03-10T15:36:33.737727+0000 mgr.gibba043.dnkmem (mgr.34373) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:34 gibba003 bash[32348]: cluster 2021-03-10T15:36:33.737727+0000 mgr.gibba043.dnkmem (mgr.34373) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:36 gibba043 bash[24019]: cluster 2021-03-10T15:36:35.739291+0000 mgr.gibba043.dnkmem (mgr.34373) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:36 gibba003 bash[31385]: cluster 2021-03-10T15:36:35.739291+0000 mgr.gibba043.dnkmem (mgr.34373) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:37 gibba003 bash[32348]: cluster 2021-03-10T15:36:35.739291+0000 mgr.gibba043.dnkmem (mgr.34373) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:39 gibba043 bash[24019]: cluster 2021-03-10T15:36:37.740954+0000 mgr.gibba043.dnkmem (mgr.34373) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:39 gibba003 bash[31385]: cluster 2021-03-10T15:36:37.740954+0000 mgr.gibba043.dnkmem (mgr.34373) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:39 gibba003 bash[32348]: cluster 2021-03-10T15:36:37.740954+0000 mgr.gibba043.dnkmem (mgr.34373) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:41 gibba043 bash[24019]: cluster 2021-03-10T15:36:39.742449+0000 mgr.gibba043.dnkmem (mgr.34373) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:41 gibba003 bash[31385]: cluster 2021-03-10T15:36:39.742449+0000 mgr.gibba043.dnkmem (mgr.34373) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:41 gibba003 bash[32348]: cluster 2021-03-10T15:36:39.742449+0000 mgr.gibba043.dnkmem (mgr.34373) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:43 gibba003 bash[31385]: cluster 2021-03-10T15:36:41.744326+0000 mgr.gibba043.dnkmem (mgr.34373) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:43 gibba003 bash[32348]: cluster 2021-03-10T15:36:41.744326+0000 mgr.gibba043.dnkmem (mgr.34373) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:43 gibba043 bash[24019]: cluster 2021-03-10T15:36:41.744326+0000 mgr.gibba043.dnkmem (mgr.34373) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:44 gibba003 bash[31385]: cephadm 2021-03-10T15:36:42.687614+0000 mgr.gibba043.dnkmem (mgr.34373) 5596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:44.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:44 gibba003 bash[32348]: cephadm 2021-03-10T15:36:42.687614+0000 mgr.gibba043.dnkmem (mgr.34373) 5596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:44.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:44 gibba043 bash[24019]: cephadm 2021-03-10T15:36:42.687614+0000 mgr.gibba043.dnkmem (mgr.34373) 5596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:45 gibba003 bash[31385]: cluster 2021-03-10T15:36:43.745781+0000 mgr.gibba043.dnkmem (mgr.34373) 5597 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:45 gibba003 bash[32348]: cluster 2021-03-10T15:36:43.745781+0000 mgr.gibba043.dnkmem (mgr.34373) 5597 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:45.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:45 gibba043 bash[24019]: cluster 2021-03-10T15:36:43.745781+0000 mgr.gibba043.dnkmem (mgr.34373) 5597 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:47 gibba003 bash[31385]: cluster 2021-03-10T15:36:45.747297+0000 mgr.gibba043.dnkmem (mgr.34373) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:47 gibba003 bash[32348]: cluster 2021-03-10T15:36:45.747297+0000 mgr.gibba043.dnkmem (mgr.34373) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:47 gibba043 bash[24019]: cluster 2021-03-10T15:36:45.747297+0000 mgr.gibba043.dnkmem (mgr.34373) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:49 gibba003 bash[31385]: cluster 2021-03-10T15:36:47.748946+0000 mgr.gibba043.dnkmem (mgr.34373) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:49 gibba003 bash[32348]: cluster 2021-03-10T15:36:47.748946+0000 mgr.gibba043.dnkmem (mgr.34373) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:49.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:49 gibba043 bash[24019]: cluster 2021-03-10T15:36:47.748946+0000 mgr.gibba043.dnkmem (mgr.34373) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:51 gibba003 bash[31385]: cluster 2021-03-10T15:36:49.750473+0000 mgr.gibba043.dnkmem (mgr.34373) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:51 gibba003 bash[32348]: cluster 2021-03-10T15:36:49.750473+0000 mgr.gibba043.dnkmem (mgr.34373) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:51 gibba043 bash[24019]: cluster 2021-03-10T15:36:49.750473+0000 mgr.gibba043.dnkmem (mgr.34373) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:53 gibba003 bash[31385]: cluster 2021-03-10T15:36:51.752295+0000 mgr.gibba043.dnkmem (mgr.34373) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:53 gibba003 bash[32348]: cluster 2021-03-10T15:36:51.752295+0000 mgr.gibba043.dnkmem (mgr.34373) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:53.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:53 gibba043 bash[24019]: cluster 2021-03-10T15:36:51.752295+0000 mgr.gibba043.dnkmem (mgr.34373) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:55 gibba003 bash[31385]: cluster 2021-03-10T15:36:53.753858+0000 mgr.gibba043.dnkmem (mgr.34373) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:55 gibba003 bash[32348]: cluster 2021-03-10T15:36:53.753858+0000 mgr.gibba043.dnkmem (mgr.34373) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:55 gibba043 bash[24019]: cluster 2021-03-10T15:36:53.753858+0000 mgr.gibba043.dnkmem (mgr.34373) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:57 gibba003 bash[31385]: cluster 2021-03-10T15:36:55.755361+0000 mgr.gibba043.dnkmem (mgr.34373) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:57 gibba003 bash[32348]: cluster 2021-03-10T15:36:55.755361+0000 mgr.gibba043.dnkmem (mgr.34373) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:57 gibba043 bash[24019]: cluster 2021-03-10T15:36:55.755361+0000 mgr.gibba043.dnkmem (mgr.34373) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:59 gibba003 bash[31385]: cephadm 2021-03-10T15:36:57.702995+0000 mgr.gibba043.dnkmem (mgr.34373) 5604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:36:59 gibba003 bash[31385]: cluster 2021-03-10T15:36:57.756901+0000 mgr.gibba043.dnkmem (mgr.34373) 5605 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:59 gibba003 bash[32348]: cephadm 2021-03-10T15:36:57.702995+0000 mgr.gibba043.dnkmem (mgr.34373) 5604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:36:59 gibba003 bash[32348]: cluster 2021-03-10T15:36:57.756901+0000 mgr.gibba043.dnkmem (mgr.34373) 5605 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:59 gibba043 bash[24019]: cephadm 2021-03-10T15:36:57.702995+0000 mgr.gibba043.dnkmem (mgr.34373) 5604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:36:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:36:59 gibba043 bash[24019]: cluster 2021-03-10T15:36:57.756901+0000 mgr.gibba043.dnkmem (mgr.34373) 5605 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:01 gibba003 bash[31385]: cluster 2021-03-10T15:36:59.758366+0000 mgr.gibba043.dnkmem (mgr.34373) 5606 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:01 gibba003 bash[32348]: cluster 2021-03-10T15:36:59.758366+0000 mgr.gibba043.dnkmem (mgr.34373) 5606 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:01 gibba043 bash[24019]: cluster 2021-03-10T15:36:59.758366+0000 mgr.gibba043.dnkmem (mgr.34373) 5606 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:02.145 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:37:02.373 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:37:02.374 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (105m) 9m ago 110m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:37:02.374 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (110m) 8m ago 110m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:37:02.374 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (105m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:37:02.375 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (106m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:37:02.375 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:37:02.375 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:37:02.375 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (104m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:37:02.375 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:37:02.376 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (110m) 9m ago 110m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:37:02.376 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (110m) 8m ago 110m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:37:02.376 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:37:02.376 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:37:02.377 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:37:02.377 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:37:02.377 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:37:02.377 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:37:02.377 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:37:02.378 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:37:02.378 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (110m) 8m ago 110m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:37:02.378 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 108m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:37:02.622 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:37:02.623 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:37:02.623 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:02.623 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:37:02.624 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:37:02.624 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:02.624 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:37:02.624 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:37:02.624 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:37:02.625 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:37:02.625 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:37:02.625 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:37:02.625 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:37:02.626 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:37:02.626 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:37:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[31385]: cluster 2021-03-10T15:37:01.760215+0000 mgr.gibba043.dnkmem (mgr.34373) 5607 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[31385]: audit 2021-03-10T15:37:02.132827+0000 mgr.gibba043.dnkmem (mgr.34373) 5608 : audit [DBG] from='client.57802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[31385]: audit 2021-03-10T15:37:02.358304+0000 mgr.gibba043.dnkmem (mgr.34373) 5609 : audit [DBG] from='client.57808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[31385]: audit 2021-03-10T15:37:02.621052+0000 mon.a (mon.0) 1339 : audit [DBG] from='client.? 172.21.2.103:0/57227074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[32348]: cluster 2021-03-10T15:37:01.760215+0000 mgr.gibba043.dnkmem (mgr.34373) 5607 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[32348]: audit 2021-03-10T15:37:02.132827+0000 mgr.gibba043.dnkmem (mgr.34373) 5608 : audit [DBG] from='client.57802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[32348]: audit 2021-03-10T15:37:02.358304+0000 mgr.gibba043.dnkmem (mgr.34373) 5609 : audit [DBG] from='client.57808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:03.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:03 gibba003 bash[32348]: audit 2021-03-10T15:37:02.621052+0000 mon.a (mon.0) 1339 : audit [DBG] from='client.? 172.21.2.103:0/57227074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:03 gibba043 bash[24019]: cluster 2021-03-10T15:37:01.760215+0000 mgr.gibba043.dnkmem (mgr.34373) 5607 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:03 gibba043 bash[24019]: audit 2021-03-10T15:37:02.132827+0000 mgr.gibba043.dnkmem (mgr.34373) 5608 : audit [DBG] from='client.57802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:03 gibba043 bash[24019]: audit 2021-03-10T15:37:02.358304+0000 mgr.gibba043.dnkmem (mgr.34373) 5609 : audit [DBG] from='client.57808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:03.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:03 gibba043 bash[24019]: audit 2021-03-10T15:37:02.621052+0000 mon.a (mon.0) 1339 : audit [DBG] from='client.? 172.21.2.103:0/57227074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:05 gibba003 bash[31385]: cluster 2021-03-10T15:37:03.761892+0000 mgr.gibba043.dnkmem (mgr.34373) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:05 gibba003 bash[32348]: cluster 2021-03-10T15:37:03.761892+0000 mgr.gibba043.dnkmem (mgr.34373) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:05 gibba043 bash[24019]: cluster 2021-03-10T15:37:03.761892+0000 mgr.gibba043.dnkmem (mgr.34373) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:07 gibba003 bash[31385]: cluster 2021-03-10T15:37:05.763143+0000 mgr.gibba043.dnkmem (mgr.34373) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:07 gibba003 bash[32348]: cluster 2021-03-10T15:37:05.763143+0000 mgr.gibba043.dnkmem (mgr.34373) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:07 gibba043 bash[24019]: cluster 2021-03-10T15:37:05.763143+0000 mgr.gibba043.dnkmem (mgr.34373) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:09 gibba003 bash[31385]: cluster 2021-03-10T15:37:07.764801+0000 mgr.gibba043.dnkmem (mgr.34373) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:09 gibba003 bash[32348]: cluster 2021-03-10T15:37:07.764801+0000 mgr.gibba043.dnkmem (mgr.34373) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:09 gibba043 bash[24019]: cluster 2021-03-10T15:37:07.764801+0000 mgr.gibba043.dnkmem (mgr.34373) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:10 gibba003 bash[31385]: cluster 2021-03-10T15:37:09.766192+0000 mgr.gibba043.dnkmem (mgr.34373) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:10 gibba003 bash[32348]: cluster 2021-03-10T15:37:09.766192+0000 mgr.gibba043.dnkmem (mgr.34373) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:10 gibba043 bash[24019]: cluster 2021-03-10T15:37:09.766192+0000 mgr.gibba043.dnkmem (mgr.34373) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:13.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:12 gibba043 bash[24019]: cluster 2021-03-10T15:37:11.767965+0000 mgr.gibba043.dnkmem (mgr.34373) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:12 gibba003 bash[31385]: cluster 2021-03-10T15:37:11.767965+0000 mgr.gibba043.dnkmem (mgr.34373) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:12 gibba003 bash[32348]: cluster 2021-03-10T15:37:11.767965+0000 mgr.gibba043.dnkmem (mgr.34373) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: cephadm 2021-03-10T15:37:12.718862+0000 mgr.gibba043.dnkmem (mgr.34373) 5615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.390455+0000 mon.c (mon.1) 1463 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.391579+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.524999+0000 mon.c (mon.1) 1464 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.526127+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.622090+0000 mon.c (mon.1) 1465 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.623301+0000 mon.c (mon.1) 1466 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.623462+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.624327+0000 mon.c (mon.1) 1467 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.624767+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.625639+0000 mon.c (mon.1) 1468 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.625825+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[31385]: audit 2021-03-10T15:37:13.626739+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: cephadm 2021-03-10T15:37:12.718862+0000 mgr.gibba043.dnkmem (mgr.34373) 5615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.390455+0000 mon.c (mon.1) 1463 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.391579+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.524999+0000 mon.c (mon.1) 1464 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.526127+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.622090+0000 mon.c (mon.1) 1465 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.623301+0000 mon.c (mon.1) 1466 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.623462+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.624327+0000 mon.c (mon.1) 1467 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.624767+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.625639+0000 mon.c (mon.1) 1468 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.625825+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:13 gibba003 bash[32348]: audit 2021-03-10T15:37:13.626739+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: cephadm 2021-03-10T15:37:12.718862+0000 mgr.gibba043.dnkmem (mgr.34373) 5615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.390455+0000 mon.c (mon.1) 1463 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.391579+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.524999+0000 mon.c (mon.1) 1464 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.526127+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.622090+0000 mon.c (mon.1) 1465 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.623301+0000 mon.c (mon.1) 1466 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.623462+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.624327+0000 mon.c (mon.1) 1467 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.624767+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.625639+0000 mon.c (mon.1) 1468 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.625825+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:37:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:13 gibba043 bash[24019]: audit 2021-03-10T15:37:13.626739+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:37:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:14 gibba003 bash[31385]: cluster 2021-03-10T15:37:13.769620+0000 mgr.gibba043.dnkmem (mgr.34373) 5616 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:14 gibba003 bash[32348]: cluster 2021-03-10T15:37:13.769620+0000 mgr.gibba043.dnkmem (mgr.34373) 5616 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:14 gibba043 bash[24019]: cluster 2021-03-10T15:37:13.769620+0000 mgr.gibba043.dnkmem (mgr.34373) 5616 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:16 gibba003 bash[31385]: cluster 2021-03-10T15:37:15.771008+0000 mgr.gibba043.dnkmem (mgr.34373) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:16 gibba003 bash[32348]: cluster 2021-03-10T15:37:15.771008+0000 mgr.gibba043.dnkmem (mgr.34373) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:16 gibba043 bash[24019]: cluster 2021-03-10T15:37:15.771008+0000 mgr.gibba043.dnkmem (mgr.34373) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:18 gibba003 bash[31385]: cluster 2021-03-10T15:37:17.772592+0000 mgr.gibba043.dnkmem (mgr.34373) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:18 gibba003 bash[32348]: cluster 2021-03-10T15:37:17.772592+0000 mgr.gibba043.dnkmem (mgr.34373) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:18 gibba043 bash[24019]: cluster 2021-03-10T15:37:17.772592+0000 mgr.gibba043.dnkmem (mgr.34373) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:20 gibba003 bash[31385]: cluster 2021-03-10T15:37:19.774108+0000 mgr.gibba043.dnkmem (mgr.34373) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:20 gibba003 bash[32348]: cluster 2021-03-10T15:37:19.774108+0000 mgr.gibba043.dnkmem (mgr.34373) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:20 gibba043 bash[24019]: cluster 2021-03-10T15:37:19.774108+0000 mgr.gibba043.dnkmem (mgr.34373) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:23.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:22 gibba003 bash[31385]: cluster 2021-03-10T15:37:21.775975+0000 mgr.gibba043.dnkmem (mgr.34373) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:22 gibba003 bash[32348]: cluster 2021-03-10T15:37:21.775975+0000 mgr.gibba043.dnkmem (mgr.34373) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:22 gibba043 bash[24019]: cluster 2021-03-10T15:37:21.775975+0000 mgr.gibba043.dnkmem (mgr.34373) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:25.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:24 gibba003 bash[31385]: cluster 2021-03-10T15:37:23.777554+0000 mgr.gibba043.dnkmem (mgr.34373) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:24 gibba003 bash[32348]: cluster 2021-03-10T15:37:23.777554+0000 mgr.gibba043.dnkmem (mgr.34373) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:24 gibba043 bash[24019]: cluster 2021-03-10T15:37:23.777554+0000 mgr.gibba043.dnkmem (mgr.34373) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:26 gibba003 bash[31385]: cluster 2021-03-10T15:37:25.779194+0000 mgr.gibba043.dnkmem (mgr.34373) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:26 gibba003 bash[32348]: cluster 2021-03-10T15:37:25.779194+0000 mgr.gibba043.dnkmem (mgr.34373) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:26 gibba043 bash[24019]: cluster 2021-03-10T15:37:25.779194+0000 mgr.gibba043.dnkmem (mgr.34373) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:27 gibba003 bash[31385]: audit 2021-03-10T15:37:27.735437+0000 mon.c (mon.1) 1469 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:37:28.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:27 gibba003 bash[32348]: audit 2021-03-10T15:37:27.735437+0000 mon.c (mon.1) 1469 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:37:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:27 gibba043 bash[24019]: audit 2021-03-10T15:37:27.735437+0000 mon.c (mon.1) 1469 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:37:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:28 gibba003 bash[31385]: cephadm 2021-03-10T15:37:27.732995+0000 mgr.gibba043.dnkmem (mgr.34373) 5623 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:37:29.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:28 gibba003 bash[31385]: cluster 2021-03-10T15:37:27.779671+0000 mgr.gibba043.dnkmem (mgr.34373) 5624 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:28 gibba003 bash[32348]: cephadm 2021-03-10T15:37:27.732995+0000 mgr.gibba043.dnkmem (mgr.34373) 5623 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:37:29.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:28 gibba003 bash[32348]: cluster 2021-03-10T15:37:27.779671+0000 mgr.gibba043.dnkmem (mgr.34373) 5624 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:28 gibba043 bash[24019]: cephadm 2021-03-10T15:37:27.732995+0000 mgr.gibba043.dnkmem (mgr.34373) 5623 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:37:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:28 gibba043 bash[24019]: cluster 2021-03-10T15:37:27.779671+0000 mgr.gibba043.dnkmem (mgr.34373) 5624 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:30 gibba003 bash[31385]: cluster 2021-03-10T15:37:29.781086+0000 mgr.gibba043.dnkmem (mgr.34373) 5625 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:30 gibba003 bash[32348]: cluster 2021-03-10T15:37:29.781086+0000 mgr.gibba043.dnkmem (mgr.34373) 5625 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:30 gibba043 bash[24019]: cluster 2021-03-10T15:37:29.781086+0000 mgr.gibba043.dnkmem (mgr.34373) 5625 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:32.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.304738+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:37:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.308382+0000 mgr.gibba043.dnkmem (mgr.34373) 5626 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:37:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.534242+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:37:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.541432+0000 mon.c (mon.1) 1470 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:32.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.542971+0000 mon.c (mon.1) 1471 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.544212+0000 mon.c (mon.1) 1472 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.545593+0000 mon.c (mon.1) 1473 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.548373+0000 mon.c (mon.1) 1474 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[31385]: audit 2021-03-10T15:37:31.549897+0000 mon.c (mon.1) 1475 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.304738+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:37:32.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.308382+0000 mgr.gibba043.dnkmem (mgr.34373) 5626 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:37:32.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.534242+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:37:32.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.541432+0000 mon.c (mon.1) 1470 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:32.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.542971+0000 mon.c (mon.1) 1471 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.544212+0000 mon.c (mon.1) 1472 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.545593+0000 mon.c (mon.1) 1473 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.548373+0000 mon.c (mon.1) 1474 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:32 gibba003 bash[32348]: audit 2021-03-10T15:37:31.549897+0000 mon.c (mon.1) 1475 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.304738+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:37:32.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.308382+0000 mgr.gibba043.dnkmem (mgr.34373) 5626 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:37:32.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.534242+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:37:32.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.541432+0000 mon.c (mon.1) 1470 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:32.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.542971+0000 mon.c (mon.1) 1471 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.544212+0000 mon.c (mon.1) 1472 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.545593+0000 mon.c (mon.1) 1473 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.548373+0000 mon.c (mon.1) 1474 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:32 gibba043 bash[24019]: audit 2021-03-10T15:37:31.549897+0000 mon.c (mon.1) 1475 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:32.904 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:37:33.160 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:37:33.426 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (105m) 1s ago 111m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:37:33.426 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (111m) 9m ago 111m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:37:33.427 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (106m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:37:33.427 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (106m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:37:33.428 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (105m) 1s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:37:33.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (105m) 1s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:37:33.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:37:33.429 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (105m) 1s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:37:33.429 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (111m) 1s ago 111m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:37:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (111m) 9m ago 111m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:37:33.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (104m) 1s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:37:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (103m) 1s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:37:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (103m) 1s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:37:33.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (102m) 1s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:37:33.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:37:33.432 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:37:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:37:33.433 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (101m) 9m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:37:33.434 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (110m) 9m ago 111m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:37:33.434 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 1s ago 109m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:37:33.435 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:37:33.436 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:37:33.436 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:33.437 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:37:33.437 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:37:33.437 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:33.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:37:33.438 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:37:33.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:37:33.439 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:37:33.440 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:37:33.440 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:37:33.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:37:33.441 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:37:33.441 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:37:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.538770+0000 mgr.gibba043.dnkmem (mgr.34373) 5627 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:33.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.540721+0000 mgr.gibba043.dnkmem (mgr.34373) 5628 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:33.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.541965+0000 mgr.gibba043.dnkmem (mgr.34373) 5629 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:33.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.542005+0000 mgr.gibba043.dnkmem (mgr.34373) 5630 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:33.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.543246+0000 mgr.gibba043.dnkmem (mgr.34373) 5631 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:33.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.543286+0000 mgr.gibba043.dnkmem (mgr.34373) 5632 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:33.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.544550+0000 mgr.gibba043.dnkmem (mgr.34373) 5633 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:33.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.546010+0000 mgr.gibba043.dnkmem (mgr.34373) 5634 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:33.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.546051+0000 mgr.gibba043.dnkmem (mgr.34373) 5635 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:33.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.547287+0000 mgr.gibba043.dnkmem (mgr.34373) 5636 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:33.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.547732+0000 mgr.gibba043.dnkmem (mgr.34373) 5637 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:33.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.548710+0000 mgr.gibba043.dnkmem (mgr.34373) 5638 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:33.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.548753+0000 mgr.gibba043.dnkmem (mgr.34373) 5639 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:33.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cephadm 2021-03-10T15:37:31.548876+0000 mgr.gibba043.dnkmem (mgr.34373) 5640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:33.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[31385]: cluster 2021-03-10T15:37:31.782853+0000 mgr.gibba043.dnkmem (mgr.34373) 5641 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:33.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.538770+0000 mgr.gibba043.dnkmem (mgr.34373) 5627 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:33.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.540721+0000 mgr.gibba043.dnkmem (mgr.34373) 5628 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:33.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.541965+0000 mgr.gibba043.dnkmem (mgr.34373) 5629 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:33.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.542005+0000 mgr.gibba043.dnkmem (mgr.34373) 5630 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:33.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.543246+0000 mgr.gibba043.dnkmem (mgr.34373) 5631 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:33.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.543286+0000 mgr.gibba043.dnkmem (mgr.34373) 5632 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:33.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.544550+0000 mgr.gibba043.dnkmem (mgr.34373) 5633 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:33.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.546010+0000 mgr.gibba043.dnkmem (mgr.34373) 5634 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:33.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.546051+0000 mgr.gibba043.dnkmem (mgr.34373) 5635 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:33.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.547287+0000 mgr.gibba043.dnkmem (mgr.34373) 5636 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:33.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.547732+0000 mgr.gibba043.dnkmem (mgr.34373) 5637 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:33.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.548710+0000 mgr.gibba043.dnkmem (mgr.34373) 5638 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:33.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.548753+0000 mgr.gibba043.dnkmem (mgr.34373) 5639 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:33.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cephadm 2021-03-10T15:37:31.548876+0000 mgr.gibba043.dnkmem (mgr.34373) 5640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:33.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:33 gibba003 bash[32348]: cluster 2021-03-10T15:37:31.782853+0000 mgr.gibba043.dnkmem (mgr.34373) 5641 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:33.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.538770+0000 mgr.gibba043.dnkmem (mgr.34373) 5627 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:33.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.540721+0000 mgr.gibba043.dnkmem (mgr.34373) 5628 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:33.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.541965+0000 mgr.gibba043.dnkmem (mgr.34373) 5629 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:33.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.542005+0000 mgr.gibba043.dnkmem (mgr.34373) 5630 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:33.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.543246+0000 mgr.gibba043.dnkmem (mgr.34373) 5631 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:33.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.543286+0000 mgr.gibba043.dnkmem (mgr.34373) 5632 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:33.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.544550+0000 mgr.gibba043.dnkmem (mgr.34373) 5633 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:33.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.546010+0000 mgr.gibba043.dnkmem (mgr.34373) 5634 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:33.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.546051+0000 mgr.gibba043.dnkmem (mgr.34373) 5635 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:33.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.547287+0000 mgr.gibba043.dnkmem (mgr.34373) 5636 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:33.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.547732+0000 mgr.gibba043.dnkmem (mgr.34373) 5637 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:33.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.548710+0000 mgr.gibba043.dnkmem (mgr.34373) 5638 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:33.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.548753+0000 mgr.gibba043.dnkmem (mgr.34373) 5639 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:33.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cephadm 2021-03-10T15:37:31.548876+0000 mgr.gibba043.dnkmem (mgr.34373) 5640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:33.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:33 gibba043 bash[24019]: cluster 2021-03-10T15:37:31.782853+0000 mgr.gibba043.dnkmem (mgr.34373) 5641 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:34.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:34 gibba003 bash[31385]: audit 2021-03-10T15:37:32.891682+0000 mgr.gibba043.dnkmem (mgr.34373) 5642 : audit [DBG] from='client.47832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:34.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:34 gibba003 bash[31385]: audit 2021-03-10T15:37:33.115957+0000 mgr.gibba043.dnkmem (mgr.34373) 5643 : audit [DBG] from='client.47838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:34.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:34 gibba003 bash[31385]: audit 2021-03-10T15:37:33.411939+0000 mon.c (mon.1) 1476 : audit [DBG] from='client.? 172.21.2.103:0/2899797436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:34.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:34 gibba003 bash[32348]: audit 2021-03-10T15:37:32.891682+0000 mgr.gibba043.dnkmem (mgr.34373) 5642 : audit [DBG] from='client.47832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:34.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:34 gibba003 bash[32348]: audit 2021-03-10T15:37:33.115957+0000 mgr.gibba043.dnkmem (mgr.34373) 5643 : audit [DBG] from='client.47838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:34.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:34 gibba003 bash[32348]: audit 2021-03-10T15:37:33.411939+0000 mon.c (mon.1) 1476 : audit [DBG] from='client.? 172.21.2.103:0/2899797436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:34.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:34 gibba043 bash[24019]: audit 2021-03-10T15:37:32.891682+0000 mgr.gibba043.dnkmem (mgr.34373) 5642 : audit [DBG] from='client.47832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:34.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:34 gibba043 bash[24019]: audit 2021-03-10T15:37:33.115957+0000 mgr.gibba043.dnkmem (mgr.34373) 5643 : audit [DBG] from='client.47838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:34.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:34 gibba043 bash[24019]: audit 2021-03-10T15:37:33.411939+0000 mon.c (mon.1) 1476 : audit [DBG] from='client.? 172.21.2.103:0/2899797436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:35 gibba003 bash[31385]: cluster 2021-03-10T15:37:33.784421+0000 mgr.gibba043.dnkmem (mgr.34373) 5644 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:35.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:35 gibba003 bash[32348]: cluster 2021-03-10T15:37:33.784421+0000 mgr.gibba043.dnkmem (mgr.34373) 5644 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:35.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:35 gibba043 bash[24019]: cluster 2021-03-10T15:37:33.784421+0000 mgr.gibba043.dnkmem (mgr.34373) 5644 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:37 gibba003 bash[31385]: cluster 2021-03-10T15:37:35.785844+0000 mgr.gibba043.dnkmem (mgr.34373) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:37 gibba003 bash[32348]: cluster 2021-03-10T15:37:35.785844+0000 mgr.gibba043.dnkmem (mgr.34373) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:37 gibba043 bash[24019]: cluster 2021-03-10T15:37:35.785844+0000 mgr.gibba043.dnkmem (mgr.34373) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:39 gibba003 bash[31385]: cluster 2021-03-10T15:37:37.787216+0000 mgr.gibba043.dnkmem (mgr.34373) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:39 gibba003 bash[32348]: cluster 2021-03-10T15:37:37.787216+0000 mgr.gibba043.dnkmem (mgr.34373) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:39 gibba043 bash[24019]: cluster 2021-03-10T15:37:37.787216+0000 mgr.gibba043.dnkmem (mgr.34373) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:40 gibba003 bash[31385]: cluster 2021-03-10T15:37:39.788703+0000 mgr.gibba043.dnkmem (mgr.34373) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:40 gibba003 bash[32348]: cluster 2021-03-10T15:37:39.788703+0000 mgr.gibba043.dnkmem (mgr.34373) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:40 gibba043 bash[24019]: cluster 2021-03-10T15:37:39.788703+0000 mgr.gibba043.dnkmem (mgr.34373) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:42 gibba003 bash[31385]: cluster 2021-03-10T15:37:41.790504+0000 mgr.gibba043.dnkmem (mgr.34373) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:42 gibba003 bash[32348]: cluster 2021-03-10T15:37:41.790504+0000 mgr.gibba043.dnkmem (mgr.34373) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:42 gibba043 bash[24019]: cluster 2021-03-10T15:37:41.790504+0000 mgr.gibba043.dnkmem (mgr.34373) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:44 gibba003 bash[31385]: cluster 2021-03-10T15:37:43.792157+0000 mgr.gibba043.dnkmem (mgr.34373) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:44 gibba003 bash[32348]: cluster 2021-03-10T15:37:43.792157+0000 mgr.gibba043.dnkmem (mgr.34373) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:45.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:44 gibba043 bash[24019]: cluster 2021-03-10T15:37:43.792157+0000 mgr.gibba043.dnkmem (mgr.34373) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:46 gibba003 bash[31385]: cluster 2021-03-10T15:37:45.793585+0000 mgr.gibba043.dnkmem (mgr.34373) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:46 gibba003 bash[32348]: cluster 2021-03-10T15:37:45.793585+0000 mgr.gibba043.dnkmem (mgr.34373) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:46 gibba043 bash[24019]: cluster 2021-03-10T15:37:45.793585+0000 mgr.gibba043.dnkmem (mgr.34373) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:48.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:47 gibba003 bash[31385]: cephadm 2021-03-10T15:37:46.564466+0000 mgr.gibba043.dnkmem (mgr.34373) 5651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:48.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:47 gibba003 bash[32348]: cephadm 2021-03-10T15:37:46.564466+0000 mgr.gibba043.dnkmem (mgr.34373) 5651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:48.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:47 gibba043 bash[24019]: cephadm 2021-03-10T15:37:46.564466+0000 mgr.gibba043.dnkmem (mgr.34373) 5651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:37:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:48 gibba003 bash[31385]: cluster 2021-03-10T15:37:47.795131+0000 mgr.gibba043.dnkmem (mgr.34373) 5652 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:48 gibba003 bash[32348]: cluster 2021-03-10T15:37:47.795131+0000 mgr.gibba043.dnkmem (mgr.34373) 5652 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:48 gibba043 bash[24019]: cluster 2021-03-10T15:37:47.795131+0000 mgr.gibba043.dnkmem (mgr.34373) 5652 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:50 gibba003 bash[31385]: cluster 2021-03-10T15:37:49.796658+0000 mgr.gibba043.dnkmem (mgr.34373) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:50 gibba003 bash[32348]: cluster 2021-03-10T15:37:49.796658+0000 mgr.gibba043.dnkmem (mgr.34373) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:50 gibba043 bash[24019]: cluster 2021-03-10T15:37:49.796658+0000 mgr.gibba043.dnkmem (mgr.34373) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:52 gibba003 bash[31385]: cluster 2021-03-10T15:37:51.798489+0000 mgr.gibba043.dnkmem (mgr.34373) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:52 gibba003 bash[32348]: cluster 2021-03-10T15:37:51.798489+0000 mgr.gibba043.dnkmem (mgr.34373) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:52 gibba043 bash[24019]: cluster 2021-03-10T15:37:51.798489+0000 mgr.gibba043.dnkmem (mgr.34373) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:55.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:54 gibba003 bash[31385]: cluster 2021-03-10T15:37:53.800208+0000 mgr.gibba043.dnkmem (mgr.34373) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:54 gibba003 bash[32348]: cluster 2021-03-10T15:37:53.800208+0000 mgr.gibba043.dnkmem (mgr.34373) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:54 gibba043 bash[24019]: cluster 2021-03-10T15:37:53.800208+0000 mgr.gibba043.dnkmem (mgr.34373) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:56 gibba003 bash[31385]: cluster 2021-03-10T15:37:55.801633+0000 mgr.gibba043.dnkmem (mgr.34373) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:57.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:56 gibba003 bash[32348]: cluster 2021-03-10T15:37:55.801633+0000 mgr.gibba043.dnkmem (mgr.34373) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:56 gibba043 bash[24019]: cluster 2021-03-10T15:37:55.801633+0000 mgr.gibba043.dnkmem (mgr.34373) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:37:58 gibba003 bash[31385]: cluster 2021-03-10T15:37:57.803003+0000 mgr.gibba043.dnkmem (mgr.34373) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:37:58 gibba003 bash[32348]: cluster 2021-03-10T15:37:57.803003+0000 mgr.gibba043.dnkmem (mgr.34373) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:37:58 gibba043 bash[24019]: cluster 2021-03-10T15:37:57.803003+0000 mgr.gibba043.dnkmem (mgr.34373) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:00 gibba003 bash[31385]: cluster 2021-03-10T15:37:59.803525+0000 mgr.gibba043.dnkmem (mgr.34373) 5658 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:00 gibba003 bash[32348]: cluster 2021-03-10T15:37:59.803525+0000 mgr.gibba043.dnkmem (mgr.34373) 5658 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:00 gibba043 bash[24019]: cluster 2021-03-10T15:37:59.803525+0000 mgr.gibba043.dnkmem (mgr.34373) 5658 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:02 gibba003 bash[31385]: cephadm 2021-03-10T15:38:01.576588+0000 mgr.gibba043.dnkmem (mgr.34373) 5659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:02 gibba003 bash[31385]: cluster 2021-03-10T15:38:01.805234+0000 mgr.gibba043.dnkmem (mgr.34373) 5660 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:03.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:02 gibba003 bash[32348]: cephadm 2021-03-10T15:38:01.576588+0000 mgr.gibba043.dnkmem (mgr.34373) 5659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:03.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:02 gibba003 bash[32348]: cluster 2021-03-10T15:38:01.805234+0000 mgr.gibba043.dnkmem (mgr.34373) 5660 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:02 gibba043 bash[24019]: cephadm 2021-03-10T15:38:01.576588+0000 mgr.gibba043.dnkmem (mgr.34373) 5659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:02 gibba043 bash[24019]: cluster 2021-03-10T15:38:01.805234+0000 mgr.gibba043.dnkmem (mgr.34373) 5660 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:03.659 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:38:03.890 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:38:03.890 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (106m) 32s ago 111m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:38:03.890 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (111m) 9m ago 111m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:38:03.890 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (106m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:38:03.891 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (107m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:38:03.891 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (106m) 32s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:38:03.891 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (105m) 32s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:38:03.891 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:38:03.891 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (105m) 32s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:38:03.892 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (111m) 32s ago 111m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:38:03.892 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (111m) 9m ago 111m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:38:03.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (104m) 32s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:38:03.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (104m) 32s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:38:03.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (103m) 32s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:38:03.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (103m) 32s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:38:03.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:38:03.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:38:03.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:38:03.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:38:03.894 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (111m) 9m ago 111m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:38:03.894 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 32s ago 109m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:38:04.135 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:38:04.135 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:38:04.136 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:04.136 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:38:04.136 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:38:04.136 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:04.136 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:38:04.137 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:38:04.137 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:38:04.137 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:38:04.137 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:38:04.138 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:38:04.138 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:38:04.138 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:38:04.138 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:38:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[31385]: audit 2021-03-10T15:38:03.647277+0000 mgr.gibba043.dnkmem (mgr.34373) 5661 : audit [DBG] from='client.47850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[31385]: cluster 2021-03-10T15:38:03.806905+0000 mgr.gibba043.dnkmem (mgr.34373) 5662 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[31385]: audit 2021-03-10T15:38:03.873784+0000 mgr.gibba043.dnkmem (mgr.34373) 5663 : audit [DBG] from='client.47856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:05.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[31385]: audit 2021-03-10T15:38:04.133478+0000 mon.a (mon.0) 1348 : audit [DBG] from='client.? 172.21.2.103:0/2775343889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:05.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[32348]: audit 2021-03-10T15:38:03.647277+0000 mgr.gibba043.dnkmem (mgr.34373) 5661 : audit [DBG] from='client.47850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:05.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[32348]: cluster 2021-03-10T15:38:03.806905+0000 mgr.gibba043.dnkmem (mgr.34373) 5662 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:05.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[32348]: audit 2021-03-10T15:38:03.873784+0000 mgr.gibba043.dnkmem (mgr.34373) 5663 : audit [DBG] from='client.47856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:05.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:04 gibba003 bash[32348]: audit 2021-03-10T15:38:04.133478+0000 mon.a (mon.0) 1348 : audit [DBG] from='client.? 172.21.2.103:0/2775343889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:04 gibba043 bash[24019]: audit 2021-03-10T15:38:03.647277+0000 mgr.gibba043.dnkmem (mgr.34373) 5661 : audit [DBG] from='client.47850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:04 gibba043 bash[24019]: cluster 2021-03-10T15:38:03.806905+0000 mgr.gibba043.dnkmem (mgr.34373) 5662 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:05.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:04 gibba043 bash[24019]: audit 2021-03-10T15:38:03.873784+0000 mgr.gibba043.dnkmem (mgr.34373) 5663 : audit [DBG] from='client.47856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:05.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:04 gibba043 bash[24019]: audit 2021-03-10T15:38:04.133478+0000 mon.a (mon.0) 1348 : audit [DBG] from='client.? 172.21.2.103:0/2775343889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:06 gibba003 bash[31385]: cluster 2021-03-10T15:38:05.808538+0000 mgr.gibba043.dnkmem (mgr.34373) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:06 gibba003 bash[32348]: cluster 2021-03-10T15:38:05.808538+0000 mgr.gibba043.dnkmem (mgr.34373) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:06 gibba043 bash[24019]: cluster 2021-03-10T15:38:05.808538+0000 mgr.gibba043.dnkmem (mgr.34373) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:08 gibba003 bash[31385]: cluster 2021-03-10T15:38:07.809755+0000 mgr.gibba043.dnkmem (mgr.34373) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:08 gibba003 bash[32348]: cluster 2021-03-10T15:38:07.809755+0000 mgr.gibba043.dnkmem (mgr.34373) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:08 gibba043 bash[24019]: cluster 2021-03-10T15:38:07.809755+0000 mgr.gibba043.dnkmem (mgr.34373) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:10 gibba003 bash[31385]: cluster 2021-03-10T15:38:09.810768+0000 mgr.gibba043.dnkmem (mgr.34373) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:10 gibba003 bash[32348]: cluster 2021-03-10T15:38:09.810768+0000 mgr.gibba043.dnkmem (mgr.34373) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:10 gibba043 bash[24019]: cluster 2021-03-10T15:38:09.810768+0000 mgr.gibba043.dnkmem (mgr.34373) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:12 gibba003 bash[31385]: cluster 2021-03-10T15:38:11.812265+0000 mgr.gibba043.dnkmem (mgr.34373) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:12 gibba003 bash[32348]: cluster 2021-03-10T15:38:11.812265+0000 mgr.gibba043.dnkmem (mgr.34373) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:12 gibba043 bash[24019]: cluster 2021-03-10T15:38:11.812265+0000 mgr.gibba043.dnkmem (mgr.34373) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.397533+0000 mon.c (mon.1) 1477 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.398664+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.533466+0000 mon.c (mon.1) 1478 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.534560+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.634025+0000 mon.c (mon.1) 1479 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:38:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.634739+0000 mon.c (mon.1) 1480 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.635276+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:38:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.635451+0000 mon.c (mon.1) 1481 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.636125+0000 mon.c (mon.1) 1482 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:38:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.636696+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.637673+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[31385]: audit 2021-03-10T15:38:13.638509+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:38:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.397533+0000 mon.c (mon.1) 1477 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.398664+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.533466+0000 mon.c (mon.1) 1478 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.534560+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.634025+0000 mon.c (mon.1) 1479 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:38:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.634739+0000 mon.c (mon.1) 1480 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.635276+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:38:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.635451+0000 mon.c (mon.1) 1481 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.636125+0000 mon.c (mon.1) 1482 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:38:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.636696+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.637673+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:13 gibba003 bash[32348]: audit 2021-03-10T15:38:13.638509+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:38:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.397533+0000 mon.c (mon.1) 1477 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.398664+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.533466+0000 mon.c (mon.1) 1478 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.534560+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.634025+0000 mon.c (mon.1) 1479 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:38:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.634739+0000 mon.c (mon.1) 1480 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.635276+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:38:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.635451+0000 mon.c (mon.1) 1481 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.636125+0000 mon.c (mon.1) 1482 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:38:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.636696+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.637673+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:13 gibba043 bash[24019]: audit 2021-03-10T15:38:13.638509+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:38:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:14 gibba003 bash[31385]: cluster 2021-03-10T15:38:13.813832+0000 mgr.gibba043.dnkmem (mgr.34373) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:14 gibba003 bash[32348]: cluster 2021-03-10T15:38:13.813832+0000 mgr.gibba043.dnkmem (mgr.34373) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:14 gibba043 bash[24019]: cluster 2021-03-10T15:38:13.813832+0000 mgr.gibba043.dnkmem (mgr.34373) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:16 gibba003 bash[31385]: cluster 2021-03-10T15:38:15.815376+0000 mgr.gibba043.dnkmem (mgr.34373) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:16 gibba003 bash[32348]: cluster 2021-03-10T15:38:15.815376+0000 mgr.gibba043.dnkmem (mgr.34373) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:16 gibba043 bash[24019]: cluster 2021-03-10T15:38:15.815376+0000 mgr.gibba043.dnkmem (mgr.34373) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:17 gibba003 bash[31385]: cephadm 2021-03-10T15:38:16.592571+0000 mgr.gibba043.dnkmem (mgr.34373) 5670 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:18.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:17 gibba003 bash[32348]: cephadm 2021-03-10T15:38:16.592571+0000 mgr.gibba043.dnkmem (mgr.34373) 5670 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:17 gibba043 bash[24019]: cephadm 2021-03-10T15:38:16.592571+0000 mgr.gibba043.dnkmem (mgr.34373) 5670 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:18 gibba003 bash[31385]: cluster 2021-03-10T15:38:17.818453+0000 mgr.gibba043.dnkmem (mgr.34373) 5671 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:18 gibba003 bash[32348]: cluster 2021-03-10T15:38:17.818453+0000 mgr.gibba043.dnkmem (mgr.34373) 5671 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:18 gibba043 bash[24019]: cluster 2021-03-10T15:38:17.818453+0000 mgr.gibba043.dnkmem (mgr.34373) 5671 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:20 gibba003 bash[31385]: cluster 2021-03-10T15:38:19.819862+0000 mgr.gibba043.dnkmem (mgr.34373) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:20 gibba003 bash[32348]: cluster 2021-03-10T15:38:19.819862+0000 mgr.gibba043.dnkmem (mgr.34373) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:20 gibba043 bash[24019]: cluster 2021-03-10T15:38:19.819862+0000 mgr.gibba043.dnkmem (mgr.34373) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:22 gibba003 bash[31385]: cluster 2021-03-10T15:38:21.821501+0000 mgr.gibba043.dnkmem (mgr.34373) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:22 gibba003 bash[32348]: cluster 2021-03-10T15:38:21.821501+0000 mgr.gibba043.dnkmem (mgr.34373) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:22 gibba043 bash[24019]: cluster 2021-03-10T15:38:21.821501+0000 mgr.gibba043.dnkmem (mgr.34373) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:24 gibba003 bash[31385]: cluster 2021-03-10T15:38:23.823229+0000 mgr.gibba043.dnkmem (mgr.34373) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:24 gibba003 bash[32348]: cluster 2021-03-10T15:38:23.823229+0000 mgr.gibba043.dnkmem (mgr.34373) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:24 gibba043 bash[24019]: cluster 2021-03-10T15:38:23.823229+0000 mgr.gibba043.dnkmem (mgr.34373) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:26 gibba003 bash[31385]: cluster 2021-03-10T15:38:25.824859+0000 mgr.gibba043.dnkmem (mgr.34373) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:26 gibba003 bash[32348]: cluster 2021-03-10T15:38:25.824859+0000 mgr.gibba043.dnkmem (mgr.34373) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:26 gibba043 bash[24019]: cluster 2021-03-10T15:38:25.824859+0000 mgr.gibba043.dnkmem (mgr.34373) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:28 gibba003 bash[31385]: cluster 2021-03-10T15:38:27.825751+0000 mgr.gibba043.dnkmem (mgr.34373) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:28 gibba003 bash[32348]: cluster 2021-03-10T15:38:27.825751+0000 mgr.gibba043.dnkmem (mgr.34373) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:28 gibba043 bash[24019]: cluster 2021-03-10T15:38:27.825751+0000 mgr.gibba043.dnkmem (mgr.34373) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:30 gibba003 bash[31385]: cluster 2021-03-10T15:38:29.826207+0000 mgr.gibba043.dnkmem (mgr.34373) 5677 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:30 gibba003 bash[32348]: cluster 2021-03-10T15:38:29.826207+0000 mgr.gibba043.dnkmem (mgr.34373) 5677 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:30 gibba043 bash[24019]: cluster 2021-03-10T15:38:29.826207+0000 mgr.gibba043.dnkmem (mgr.34373) 5677 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:32.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:31 gibba003 bash[31385]: audit 2021-03-10T15:38:31.613424+0000 mon.c (mon.1) 1483 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:38:32.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:31 gibba003 bash[32348]: audit 2021-03-10T15:38:31.613424+0000 mon.c (mon.1) 1483 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:38:32.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:31 gibba043 bash[24019]: audit 2021-03-10T15:38:31.613424+0000 mon.c (mon.1) 1483 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:38:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:32 gibba003 bash[31385]: cephadm 2021-03-10T15:38:31.609695+0000 mgr.gibba043.dnkmem (mgr.34373) 5678 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:38:33.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:32 gibba003 bash[31385]: cluster 2021-03-10T15:38:31.826733+0000 mgr.gibba043.dnkmem (mgr.34373) 5679 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:32 gibba003 bash[32348]: cephadm 2021-03-10T15:38:31.609695+0000 mgr.gibba043.dnkmem (mgr.34373) 5678 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:38:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:32 gibba003 bash[32348]: cluster 2021-03-10T15:38:31.826733+0000 mgr.gibba043.dnkmem (mgr.34373) 5679 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:32 gibba043 bash[24019]: cephadm 2021-03-10T15:38:31.609695+0000 mgr.gibba043.dnkmem (mgr.34373) 5678 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:38:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:32 gibba043 bash[24019]: cluster 2021-03-10T15:38:31.826733+0000 mgr.gibba043.dnkmem (mgr.34373) 5679 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:34.377 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:38:34.598 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:38:34.598 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (106m) 63s ago 112m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:38:34.599 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (112m) 10m ago 112m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:38:34.599 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (107m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:38:34.599 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (107m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:38:34.599 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (106m) 63s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:38:34.600 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (106m) 63s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:38:34.600 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (106m) 10m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:38:34.600 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (106m) 63s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:38:34.600 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (112m) 63s ago 112m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:38:34.600 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (112m) 10m ago 112m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:38:34.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (105m) 63s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:38:34.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (104m) 63s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:38:34.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (104m) 63s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:38:34.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (103m) 63s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:38:34.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:38:34.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:38:34.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (102m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:38:34.602 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (102m) 10m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:38:34.602 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (111m) 10m ago 112m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:38:34.603 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 63s ago 110m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:38:34.846 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:38:34.846 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:38:34.847 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:34.847 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:38:34.847 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:38:34.847 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:34.848 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:38:34.848 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:38:34.848 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:38:34.848 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:38:34.849 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:38:34.849 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:38:34.849 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:38:34.849 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:38:34.850 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:38:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:34 gibba003 bash[31385]: cluster 2021-03-10T15:38:33.828059+0000 mgr.gibba043.dnkmem (mgr.34373) 5680 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:34 gibba003 bash[31385]: audit 2021-03-10T15:38:34.364572+0000 mgr.gibba043.dnkmem (mgr.34373) 5681 : audit [DBG] from='client.57856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:34 gibba003 bash[32348]: cluster 2021-03-10T15:38:33.828059+0000 mgr.gibba043.dnkmem (mgr.34373) 5680 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:35.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:34 gibba003 bash[32348]: audit 2021-03-10T15:38:34.364572+0000 mgr.gibba043.dnkmem (mgr.34373) 5681 : audit [DBG] from='client.57856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:34 gibba043 bash[24019]: cluster 2021-03-10T15:38:33.828059+0000 mgr.gibba043.dnkmem (mgr.34373) 5680 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:34 gibba043 bash[24019]: audit 2021-03-10T15:38:34.364572+0000 mgr.gibba043.dnkmem (mgr.34373) 5681 : audit [DBG] from='client.57856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:36.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:34.584824+0000 mgr.gibba043.dnkmem (mgr.34373) 5682 : audit [DBG] from='client.57862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:34.844514+0000 mon.a (mon.0) 1355 : audit [DBG] from='client.? 172.21.2.103:0/2177838679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.291100+0000 mgr.gibba043.dnkmem (mgr.34373) 5683 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:38:36.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.291757+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:38:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.510732+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:38:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.511756+0000 mgr.gibba043.dnkmem (mgr.34373) 5684 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.514098+0000 mgr.gibba043.dnkmem (mgr.34373) 5685 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.514446+0000 mon.c (mon.1) 1484 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:36.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.515497+0000 mgr.gibba043.dnkmem (mgr.34373) 5686 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.515541+0000 mgr.gibba043.dnkmem (mgr.34373) 5687 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.516458+0000 mon.c (mon.1) 1485 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.517164+0000 mgr.gibba043.dnkmem (mgr.34373) 5688 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:36.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.517215+0000 mgr.gibba043.dnkmem (mgr.34373) 5689 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:36.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.518099+0000 mon.c (mon.1) 1486 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.518524+0000 mgr.gibba043.dnkmem (mgr.34373) 5690 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:36.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.519624+0000 mon.c (mon.1) 1487 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.520254+0000 mgr.gibba043.dnkmem (mgr.34373) 5691 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:36.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.520297+0000 mgr.gibba043.dnkmem (mgr.34373) 5692 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:36.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.521698+0000 mgr.gibba043.dnkmem (mgr.34373) 5693 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:36.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.522088+0000 mgr.gibba043.dnkmem (mgr.34373) 5694 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:36.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.522869+0000 mon.c (mon.1) 1488 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:34.584824+0000 mgr.gibba043.dnkmem (mgr.34373) 5682 : audit [DBG] from='client.57862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:34.844514+0000 mon.a (mon.0) 1355 : audit [DBG] from='client.? 172.21.2.103:0/2177838679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.291100+0000 mgr.gibba043.dnkmem (mgr.34373) 5683 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:38:36.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.291757+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:38:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.510732+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:38:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.511756+0000 mgr.gibba043.dnkmem (mgr.34373) 5684 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.514098+0000 mgr.gibba043.dnkmem (mgr.34373) 5685 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.514446+0000 mon.c (mon.1) 1484 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:36.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.515497+0000 mgr.gibba043.dnkmem (mgr.34373) 5686 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.515541+0000 mgr.gibba043.dnkmem (mgr.34373) 5687 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.516458+0000 mon.c (mon.1) 1485 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.517164+0000 mgr.gibba043.dnkmem (mgr.34373) 5688 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:36.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.517215+0000 mgr.gibba043.dnkmem (mgr.34373) 5689 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:36.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.518099+0000 mon.c (mon.1) 1486 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.518524+0000 mgr.gibba043.dnkmem (mgr.34373) 5690 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:36.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.519624+0000 mon.c (mon.1) 1487 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.520254+0000 mgr.gibba043.dnkmem (mgr.34373) 5691 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:36.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.520297+0000 mgr.gibba043.dnkmem (mgr.34373) 5692 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:36.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.521698+0000 mgr.gibba043.dnkmem (mgr.34373) 5693 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:36.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.522088+0000 mgr.gibba043.dnkmem (mgr.34373) 5694 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:36.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.522869+0000 mon.c (mon.1) 1488 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.523442+0000 mgr.gibba043.dnkmem (mgr.34373) 5695 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:36.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.523488+0000 mgr.gibba043.dnkmem (mgr.34373) 5696 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:36.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: cephadm 2021-03-10T15:38:35.523610+0000 mgr.gibba043.dnkmem (mgr.34373) 5697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:36.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[31385]: audit 2021-03-10T15:38:35.524480+0000 mon.c (mon.1) 1489 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.523442+0000 mgr.gibba043.dnkmem (mgr.34373) 5695 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:36.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.523488+0000 mgr.gibba043.dnkmem (mgr.34373) 5696 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:36.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: cephadm 2021-03-10T15:38:35.523610+0000 mgr.gibba043.dnkmem (mgr.34373) 5697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:36.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:35 gibba003 bash[32348]: audit 2021-03-10T15:38:35.524480+0000 mon.c (mon.1) 1489 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:34.584824+0000 mgr.gibba043.dnkmem (mgr.34373) 5682 : audit [DBG] from='client.57862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:34.844514+0000 mon.a (mon.0) 1355 : audit [DBG] from='client.? 172.21.2.103:0/2177838679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.291100+0000 mgr.gibba043.dnkmem (mgr.34373) 5683 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:38:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.291757+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:38:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.510732+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:38:36.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.511756+0000 mgr.gibba043.dnkmem (mgr.34373) 5684 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.514098+0000 mgr.gibba043.dnkmem (mgr.34373) 5685 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.514446+0000 mon.c (mon.1) 1484 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.515497+0000 mgr.gibba043.dnkmem (mgr.34373) 5686 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:36.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.515541+0000 mgr.gibba043.dnkmem (mgr.34373) 5687 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.516458+0000 mon.c (mon.1) 1485 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.517164+0000 mgr.gibba043.dnkmem (mgr.34373) 5688 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:36.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.517215+0000 mgr.gibba043.dnkmem (mgr.34373) 5689 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:36.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.518099+0000 mon.c (mon.1) 1486 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.518524+0000 mgr.gibba043.dnkmem (mgr.34373) 5690 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:36.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.519624+0000 mon.c (mon.1) 1487 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.520254+0000 mgr.gibba043.dnkmem (mgr.34373) 5691 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:36.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.520297+0000 mgr.gibba043.dnkmem (mgr.34373) 5692 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:36.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.521698+0000 mgr.gibba043.dnkmem (mgr.34373) 5693 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:36.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.522088+0000 mgr.gibba043.dnkmem (mgr.34373) 5694 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:36.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.522869+0000 mon.c (mon.1) 1488 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:36.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.523442+0000 mgr.gibba043.dnkmem (mgr.34373) 5695 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:36.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.523488+0000 mgr.gibba043.dnkmem (mgr.34373) 5696 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:36.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: cephadm 2021-03-10T15:38:35.523610+0000 mgr.gibba043.dnkmem (mgr.34373) 5697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:36.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:35 gibba043 bash[24019]: audit 2021-03-10T15:38:35.524480+0000 mon.c (mon.1) 1489 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:37 gibba043 bash[24019]: cluster 2021-03-10T15:38:35.829957+0000 mgr.gibba043.dnkmem (mgr.34373) 5698 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:37 gibba003 bash[31385]: cluster 2021-03-10T15:38:35.829957+0000 mgr.gibba043.dnkmem (mgr.34373) 5698 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:37 gibba003 bash[32348]: cluster 2021-03-10T15:38:35.829957+0000 mgr.gibba043.dnkmem (mgr.34373) 5698 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:39 gibba003 bash[31385]: cluster 2021-03-10T15:38:37.830770+0000 mgr.gibba043.dnkmem (mgr.34373) 5699 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:39 gibba003 bash[32348]: cluster 2021-03-10T15:38:37.830770+0000 mgr.gibba043.dnkmem (mgr.34373) 5699 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:39 gibba043 bash[24019]: cluster 2021-03-10T15:38:37.830770+0000 mgr.gibba043.dnkmem (mgr.34373) 5699 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:40 gibba003 bash[31385]: cluster 2021-03-10T15:38:39.832003+0000 mgr.gibba043.dnkmem (mgr.34373) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:40 gibba003 bash[32348]: cluster 2021-03-10T15:38:39.832003+0000 mgr.gibba043.dnkmem (mgr.34373) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:40 gibba043 bash[24019]: cluster 2021-03-10T15:38:39.832003+0000 mgr.gibba043.dnkmem (mgr.34373) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:42 gibba003 bash[31385]: cluster 2021-03-10T15:38:41.833494+0000 mgr.gibba043.dnkmem (mgr.34373) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:42 gibba003 bash[32348]: cluster 2021-03-10T15:38:41.833494+0000 mgr.gibba043.dnkmem (mgr.34373) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:42 gibba043 bash[24019]: cluster 2021-03-10T15:38:41.833494+0000 mgr.gibba043.dnkmem (mgr.34373) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:45.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:44 gibba003 bash[31385]: cluster 2021-03-10T15:38:43.834992+0000 mgr.gibba043.dnkmem (mgr.34373) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:44 gibba003 bash[32348]: cluster 2021-03-10T15:38:43.834992+0000 mgr.gibba043.dnkmem (mgr.34373) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:45.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:44 gibba043 bash[24019]: cluster 2021-03-10T15:38:43.834992+0000 mgr.gibba043.dnkmem (mgr.34373) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:47.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:46 gibba003 bash[31385]: cluster 2021-03-10T15:38:45.836565+0000 mgr.gibba043.dnkmem (mgr.34373) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:47.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:46 gibba003 bash[32348]: cluster 2021-03-10T15:38:45.836565+0000 mgr.gibba043.dnkmem (mgr.34373) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:46 gibba043 bash[24019]: cluster 2021-03-10T15:38:45.836565+0000 mgr.gibba043.dnkmem (mgr.34373) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:48 gibba003 bash[31385]: cluster 2021-03-10T15:38:47.837237+0000 mgr.gibba043.dnkmem (mgr.34373) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:48 gibba003 bash[32348]: cluster 2021-03-10T15:38:47.837237+0000 mgr.gibba043.dnkmem (mgr.34373) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:48 gibba043 bash[24019]: cluster 2021-03-10T15:38:47.837237+0000 mgr.gibba043.dnkmem (mgr.34373) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:50 gibba003 bash[31385]: cluster 2021-03-10T15:38:49.837651+0000 mgr.gibba043.dnkmem (mgr.34373) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:50 gibba003 bash[31385]: cephadm 2021-03-10T15:38:50.539926+0000 mgr.gibba043.dnkmem (mgr.34373) 5706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:50 gibba003 bash[32348]: cluster 2021-03-10T15:38:49.837651+0000 mgr.gibba043.dnkmem (mgr.34373) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:51.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:50 gibba003 bash[32348]: cephadm 2021-03-10T15:38:50.539926+0000 mgr.gibba043.dnkmem (mgr.34373) 5706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:50 gibba043 bash[24019]: cluster 2021-03-10T15:38:49.837651+0000 mgr.gibba043.dnkmem (mgr.34373) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:50 gibba043 bash[24019]: cephadm 2021-03-10T15:38:50.539926+0000 mgr.gibba043.dnkmem (mgr.34373) 5706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:38:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:52 gibba003 bash[31385]: cluster 2021-03-10T15:38:51.839177+0000 mgr.gibba043.dnkmem (mgr.34373) 5707 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:52 gibba003 bash[32348]: cluster 2021-03-10T15:38:51.839177+0000 mgr.gibba043.dnkmem (mgr.34373) 5707 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:52 gibba043 bash[24019]: cluster 2021-03-10T15:38:51.839177+0000 mgr.gibba043.dnkmem (mgr.34373) 5707 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:55.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:54 gibba003 bash[31385]: cluster 2021-03-10T15:38:53.840713+0000 mgr.gibba043.dnkmem (mgr.34373) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:54 gibba003 bash[32348]: cluster 2021-03-10T15:38:53.840713+0000 mgr.gibba043.dnkmem (mgr.34373) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:54 gibba043 bash[24019]: cluster 2021-03-10T15:38:53.840713+0000 mgr.gibba043.dnkmem (mgr.34373) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:57.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:56 gibba003 bash[31385]: cluster 2021-03-10T15:38:55.842249+0000 mgr.gibba043.dnkmem (mgr.34373) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:57.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:56 gibba003 bash[32348]: cluster 2021-03-10T15:38:55.842249+0000 mgr.gibba043.dnkmem (mgr.34373) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:56 gibba043 bash[24019]: cluster 2021-03-10T15:38:55.842249+0000 mgr.gibba043.dnkmem (mgr.34373) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:38:58 gibba003 bash[31385]: cluster 2021-03-10T15:38:57.843027+0000 mgr.gibba043.dnkmem (mgr.34373) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:38:58 gibba003 bash[32348]: cluster 2021-03-10T15:38:57.843027+0000 mgr.gibba043.dnkmem (mgr.34373) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:38:58 gibba043 bash[24019]: cluster 2021-03-10T15:38:57.843027+0000 mgr.gibba043.dnkmem (mgr.34373) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:00 gibba003 bash[31385]: cluster 2021-03-10T15:38:59.843425+0000 mgr.gibba043.dnkmem (mgr.34373) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:00 gibba003 bash[32348]: cluster 2021-03-10T15:38:59.843425+0000 mgr.gibba043.dnkmem (mgr.34373) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:00 gibba043 bash[24019]: cluster 2021-03-10T15:38:59.843425+0000 mgr.gibba043.dnkmem (mgr.34373) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:03.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:02 gibba003 bash[31385]: cluster 2021-03-10T15:39:01.844900+0000 mgr.gibba043.dnkmem (mgr.34373) 5712 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:02 gibba003 bash[32348]: cluster 2021-03-10T15:39:01.844900+0000 mgr.gibba043.dnkmem (mgr.34373) 5712 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:02 gibba043 bash[24019]: cluster 2021-03-10T15:39:01.844900+0000 mgr.gibba043.dnkmem (mgr.34373) 5712 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.086 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:39:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:04 gibba003 bash[31385]: cluster 2021-03-10T15:39:03.846583+0000 mgr.gibba043.dnkmem (mgr.34373) 5713 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:04 gibba003 bash[32348]: cluster 2021-03-10T15:39:03.846583+0000 mgr.gibba043.dnkmem (mgr.34373) 5713 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:04 gibba043 bash[24019]: cluster 2021-03-10T15:39:03.846583+0000 mgr.gibba043.dnkmem (mgr.34373) 5713 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.317 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:39:05.318 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (107m) 94s ago 112m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:39:05.318 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (112m) 30s ago 112m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:39:05.318 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (107m) 30s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:39:05.318 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (108m) 30s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:39:05.319 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (107m) 94s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:39:05.319 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (106m) 94s ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:39:05.319 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (106m) 30s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:39:05.319 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (106m) 94s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:39:05.320 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (112m) 94s ago 112m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:39:05.320 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (112m) 30s ago 112m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:39:05.320 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (105m) 94s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:39:05.320 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (105m) 94s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:39:05.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (104m) 94s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:39:05.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (104m) 94s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:39:05.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (104m) 30s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:39:05.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (103m) 30s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:39:05.321 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (103m) 30s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:39:05.322 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (102m) 30s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:39:05.322 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (112m) 30s ago 112m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:39:05.322 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 94s ago 110m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:39:05.563 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:39:05.563 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:39:05.563 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:05.564 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:39:05.564 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:39:05.564 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:05.564 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:39:05.565 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:39:05.565 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:39:05.565 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:39:05.565 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:39:05.565 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:39:05.566 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:39:05.566 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:39:05.566 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:39:06.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[31385]: audit 2021-03-10T15:39:05.073754+0000 mgr.gibba043.dnkmem (mgr.34373) 5714 : audit [DBG] from='client.57874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:06.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[31385]: audit 2021-03-10T15:39:05.301620+0000 mgr.gibba043.dnkmem (mgr.34373) 5715 : audit [DBG] from='client.57880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:06.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[31385]: cephadm 2021-03-10T15:39:05.541688+0000 mgr.gibba043.dnkmem (mgr.34373) 5716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:06.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[31385]: audit 2021-03-10T15:39:05.561549+0000 mon.c (mon.1) 1490 : audit [DBG] from='client.? 172.21.2.103:0/149043198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[32348]: audit 2021-03-10T15:39:05.073754+0000 mgr.gibba043.dnkmem (mgr.34373) 5714 : audit [DBG] from='client.57874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[32348]: audit 2021-03-10T15:39:05.301620+0000 mgr.gibba043.dnkmem (mgr.34373) 5715 : audit [DBG] from='client.57880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:06.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[32348]: cephadm 2021-03-10T15:39:05.541688+0000 mgr.gibba043.dnkmem (mgr.34373) 5716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:06.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:05 gibba003 bash[32348]: audit 2021-03-10T15:39:05.561549+0000 mon.c (mon.1) 1490 : audit [DBG] from='client.? 172.21.2.103:0/149043198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:06.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:05 gibba043 bash[24019]: audit 2021-03-10T15:39:05.073754+0000 mgr.gibba043.dnkmem (mgr.34373) 5714 : audit [DBG] from='client.57874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:06.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:05 gibba043 bash[24019]: audit 2021-03-10T15:39:05.301620+0000 mgr.gibba043.dnkmem (mgr.34373) 5715 : audit [DBG] from='client.57880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:06.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:05 gibba043 bash[24019]: cephadm 2021-03-10T15:39:05.541688+0000 mgr.gibba043.dnkmem (mgr.34373) 5716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:06.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:05 gibba043 bash[24019]: audit 2021-03-10T15:39:05.561549+0000 mon.c (mon.1) 1490 : audit [DBG] from='client.? 172.21.2.103:0/149043198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:06 gibba003 bash[31385]: cluster 2021-03-10T15:39:05.848269+0000 mgr.gibba043.dnkmem (mgr.34373) 5717 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:06 gibba003 bash[32348]: cluster 2021-03-10T15:39:05.848269+0000 mgr.gibba043.dnkmem (mgr.34373) 5717 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:06 gibba043 bash[24019]: cluster 2021-03-10T15:39:05.848269+0000 mgr.gibba043.dnkmem (mgr.34373) 5717 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:08 gibba043 bash[24019]: cluster 2021-03-10T15:39:07.849179+0000 mgr.gibba043.dnkmem (mgr.34373) 5718 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:08 gibba003 bash[31385]: cluster 2021-03-10T15:39:07.849179+0000 mgr.gibba043.dnkmem (mgr.34373) 5718 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:08 gibba003 bash[32348]: cluster 2021-03-10T15:39:07.849179+0000 mgr.gibba043.dnkmem (mgr.34373) 5718 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:10 gibba003 bash[31385]: cluster 2021-03-10T15:39:09.849656+0000 mgr.gibba043.dnkmem (mgr.34373) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:10 gibba003 bash[32348]: cluster 2021-03-10T15:39:09.849656+0000 mgr.gibba043.dnkmem (mgr.34373) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:10 gibba043 bash[24019]: cluster 2021-03-10T15:39:09.849656+0000 mgr.gibba043.dnkmem (mgr.34373) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:12 gibba003 bash[31385]: cluster 2021-03-10T15:39:11.851338+0000 mgr.gibba043.dnkmem (mgr.34373) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:12 gibba003 bash[32348]: cluster 2021-03-10T15:39:11.851338+0000 mgr.gibba043.dnkmem (mgr.34373) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:12 gibba043 bash[24019]: cluster 2021-03-10T15:39:11.851338+0000 mgr.gibba043.dnkmem (mgr.34373) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.404486+0000 mon.c (mon.1) 1491 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.405785+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.542229+0000 mon.c (mon.1) 1492 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.543511+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.644834+0000 mon.c (mon.1) 1493 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:39:14.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.645963+0000 mon.c (mon.1) 1494 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:39:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.646248+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:39:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.647072+0000 mon.c (mon.1) 1495 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.647572+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:39:14.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.648382+0000 mon.c (mon.1) 1496 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.648681+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[31385]: audit 2021-03-10T15:39:13.649257+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.404486+0000 mon.c (mon.1) 1491 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.405785+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.542229+0000 mon.c (mon.1) 1492 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.543511+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:14.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.644834+0000 mon.c (mon.1) 1493 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:39:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.645963+0000 mon.c (mon.1) 1494 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:39:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.646248+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:39:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.647072+0000 mon.c (mon.1) 1495 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.647572+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:39:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.648382+0000 mon.c (mon.1) 1496 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.648681+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:13 gibba003 bash[32348]: audit 2021-03-10T15:39:13.649257+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.404486+0000 mon.c (mon.1) 1491 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.405785+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.542229+0000 mon.c (mon.1) 1492 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.543511+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.644834+0000 mon.c (mon.1) 1493 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:39:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.645963+0000 mon.c (mon.1) 1494 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:39:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.646248+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:39:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.647072+0000 mon.c (mon.1) 1495 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.647572+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:39:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.648382+0000 mon.c (mon.1) 1496 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.648681+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:39:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:13 gibba043 bash[24019]: audit 2021-03-10T15:39:13.649257+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:39:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:14 gibba003 bash[31385]: cluster 2021-03-10T15:39:13.853014+0000 mgr.gibba043.dnkmem (mgr.34373) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:14 gibba003 bash[32348]: cluster 2021-03-10T15:39:13.853014+0000 mgr.gibba043.dnkmem (mgr.34373) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:14 gibba043 bash[24019]: cluster 2021-03-10T15:39:13.853014+0000 mgr.gibba043.dnkmem (mgr.34373) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:16 gibba043 bash[24019]: cluster 2021-03-10T15:39:15.854656+0000 mgr.gibba043.dnkmem (mgr.34373) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:16 gibba003 bash[31385]: cluster 2021-03-10T15:39:15.854656+0000 mgr.gibba043.dnkmem (mgr.34373) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:16 gibba003 bash[32348]: cluster 2021-03-10T15:39:15.854656+0000 mgr.gibba043.dnkmem (mgr.34373) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:18 gibba043 bash[24019]: cluster 2021-03-10T15:39:17.855565+0000 mgr.gibba043.dnkmem (mgr.34373) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:18 gibba003 bash[31385]: cluster 2021-03-10T15:39:17.855565+0000 mgr.gibba043.dnkmem (mgr.34373) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:18 gibba003 bash[32348]: cluster 2021-03-10T15:39:17.855565+0000 mgr.gibba043.dnkmem (mgr.34373) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:21.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:20 gibba003 bash[31385]: cluster 2021-03-10T15:39:19.856965+0000 mgr.gibba043.dnkmem (mgr.34373) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:21.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:20 gibba003 bash[31385]: cephadm 2021-03-10T15:39:20.557781+0000 mgr.gibba043.dnkmem (mgr.34373) 5725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:21.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:20 gibba003 bash[32348]: cluster 2021-03-10T15:39:19.856965+0000 mgr.gibba043.dnkmem (mgr.34373) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:21.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:20 gibba003 bash[32348]: cephadm 2021-03-10T15:39:20.557781+0000 mgr.gibba043.dnkmem (mgr.34373) 5725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:20 gibba043 bash[24019]: cluster 2021-03-10T15:39:19.856965+0000 mgr.gibba043.dnkmem (mgr.34373) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:20 gibba043 bash[24019]: cephadm 2021-03-10T15:39:20.557781+0000 mgr.gibba043.dnkmem (mgr.34373) 5725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:22 gibba003 bash[31385]: cluster 2021-03-10T15:39:21.858764+0000 mgr.gibba043.dnkmem (mgr.34373) 5726 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:22 gibba003 bash[32348]: cluster 2021-03-10T15:39:21.858764+0000 mgr.gibba043.dnkmem (mgr.34373) 5726 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:22 gibba043 bash[24019]: cluster 2021-03-10T15:39:21.858764+0000 mgr.gibba043.dnkmem (mgr.34373) 5726 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:24 gibba003 bash[31385]: cluster 2021-03-10T15:39:23.860529+0000 mgr.gibba043.dnkmem (mgr.34373) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:24 gibba003 bash[32348]: cluster 2021-03-10T15:39:23.860529+0000 mgr.gibba043.dnkmem (mgr.34373) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:24 gibba043 bash[24019]: cluster 2021-03-10T15:39:23.860529+0000 mgr.gibba043.dnkmem (mgr.34373) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:26 gibba003 bash[31385]: cluster 2021-03-10T15:39:25.862306+0000 mgr.gibba043.dnkmem (mgr.34373) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:26 gibba003 bash[32348]: cluster 2021-03-10T15:39:25.862306+0000 mgr.gibba043.dnkmem (mgr.34373) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:26 gibba043 bash[24019]: cluster 2021-03-10T15:39:25.862306+0000 mgr.gibba043.dnkmem (mgr.34373) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:28 gibba043 bash[24019]: cluster 2021-03-10T15:39:27.863150+0000 mgr.gibba043.dnkmem (mgr.34373) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:28 gibba003 bash[31385]: cluster 2021-03-10T15:39:27.863150+0000 mgr.gibba043.dnkmem (mgr.34373) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:28 gibba003 bash[32348]: cluster 2021-03-10T15:39:27.863150+0000 mgr.gibba043.dnkmem (mgr.34373) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:30 gibba003 bash[31385]: cluster 2021-03-10T15:39:29.863550+0000 mgr.gibba043.dnkmem (mgr.34373) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:30 gibba003 bash[32348]: cluster 2021-03-10T15:39:29.863550+0000 mgr.gibba043.dnkmem (mgr.34373) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:30 gibba043 bash[24019]: cluster 2021-03-10T15:39:29.863550+0000 mgr.gibba043.dnkmem (mgr.34373) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:32 gibba003 bash[31385]: cluster 2021-03-10T15:39:31.865340+0000 mgr.gibba043.dnkmem (mgr.34373) 5731 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:32 gibba003 bash[32348]: cluster 2021-03-10T15:39:31.865340+0000 mgr.gibba043.dnkmem (mgr.34373) 5731 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:32 gibba043 bash[24019]: cluster 2021-03-10T15:39:31.865340+0000 mgr.gibba043.dnkmem (mgr.34373) 5731 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:34 gibba003 bash[31385]: cluster 2021-03-10T15:39:33.867021+0000 mgr.gibba043.dnkmem (mgr.34373) 5732 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:34 gibba003 bash[32348]: cluster 2021-03-10T15:39:33.867021+0000 mgr.gibba043.dnkmem (mgr.34373) 5732 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:34 gibba043 bash[24019]: cluster 2021-03-10T15:39:33.867021+0000 mgr.gibba043.dnkmem (mgr.34373) 5732 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.803 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:39:36.057 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:39:36.057 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (107m) 2m ago 113m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:39:36.057 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (113m) 60s ago 113m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:39:36.058 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (108m) 60s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:39:36.058 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (108m) 60s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:39:36.058 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (107m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:39:36.058 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (107m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:39:36.059 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (107m) 60s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:39:36.059 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (107m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:39:36.059 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (113m) 2m ago 113m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:39:36.059 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (113m) 60s ago 113m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:39:36.060 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:39:36.060 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:39:36.060 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:39:36.060 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (104m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:39:36.061 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (104m) 60s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:39:36.061 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (104m) 60s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:39:36.061 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (103m) 60s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:39:36.061 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (103m) 60s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:39:36.061 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (112m) 60s ago 113m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:39:36.062 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 111m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:39:36.310 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:39:36.311 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:39:36.311 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:36.311 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:39:36.311 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:39:36.312 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:36.312 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:39:36.312 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:39:36.312 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:39:36.312 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:39:36.313 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:39:36.313 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:39:36.313 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:39:36.313 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:39:36.314 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:39:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.574340+0000 mgr.gibba043.dnkmem (mgr.34373) 5733 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:39:37.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.575981+0000 mgr.gibba043.dnkmem (mgr.34373) 5734 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:39:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.791281+0000 mgr.gibba043.dnkmem (mgr.34373) 5735 : audit [DBG] from='client.57892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.796481+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:39:37.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.797219+0000 mgr.gibba043.dnkmem (mgr.34373) 5736 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.799045+0000 mgr.gibba043.dnkmem (mgr.34373) 5737 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.799953+0000 mon.c (mon.1) 1497 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.800361+0000 mgr.gibba043.dnkmem (mgr.34373) 5738 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:37.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.800402+0000 mgr.gibba043.dnkmem (mgr.34373) 5739 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.801426+0000 mon.c (mon.1) 1498 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.801697+0000 mgr.gibba043.dnkmem (mgr.34373) 5740 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.801736+0000 mgr.gibba043.dnkmem (mgr.34373) 5741 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.802724+0000 mgr.gibba043.dnkmem (mgr.34373) 5742 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.802787+0000 mon.c (mon.1) 1499 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.804061+0000 mon.c (mon.1) 1500 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.804217+0000 mgr.gibba043.dnkmem (mgr.34373) 5743 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.804258+0000 mgr.gibba043.dnkmem (mgr.34373) 5744 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:37.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.805533+0000 mgr.gibba043.dnkmem (mgr.34373) 5745 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:37.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.805925+0000 mgr.gibba043.dnkmem (mgr.34373) 5746 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:37.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.806705+0000 mon.c (mon.1) 1501 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.806964+0000 mgr.gibba043.dnkmem (mgr.34373) 5747 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.574340+0000 mgr.gibba043.dnkmem (mgr.34373) 5733 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:39:37.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.575981+0000 mgr.gibba043.dnkmem (mgr.34373) 5734 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:39:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.791281+0000 mgr.gibba043.dnkmem (mgr.34373) 5735 : audit [DBG] from='client.57892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.796481+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:39:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.797219+0000 mgr.gibba043.dnkmem (mgr.34373) 5736 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:37.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.799045+0000 mgr.gibba043.dnkmem (mgr.34373) 5737 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.799953+0000 mon.c (mon.1) 1497 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.800361+0000 mgr.gibba043.dnkmem (mgr.34373) 5738 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.800402+0000 mgr.gibba043.dnkmem (mgr.34373) 5739 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:37.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.801426+0000 mon.c (mon.1) 1498 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.801697+0000 mgr.gibba043.dnkmem (mgr.34373) 5740 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.801736+0000 mgr.gibba043.dnkmem (mgr.34373) 5741 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.802724+0000 mgr.gibba043.dnkmem (mgr.34373) 5742 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:37.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.802787+0000 mon.c (mon.1) 1499 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.804061+0000 mon.c (mon.1) 1500 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.804217+0000 mgr.gibba043.dnkmem (mgr.34373) 5743 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:37.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.804258+0000 mgr.gibba043.dnkmem (mgr.34373) 5744 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:37.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.805533+0000 mgr.gibba043.dnkmem (mgr.34373) 5745 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:37.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.805925+0000 mgr.gibba043.dnkmem (mgr.34373) 5746 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:37.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.806705+0000 mon.c (mon.1) 1501 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.806964+0000 mgr.gibba043.dnkmem (mgr.34373) 5747 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:37.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.807008+0000 mgr.gibba043.dnkmem (mgr.34373) 5748 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:37.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cephadm 2021-03-10T15:39:35.807129+0000 mgr.gibba043.dnkmem (mgr.34373) 5749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:37.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:35.808222+0000 mon.c (mon.1) 1502 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: cluster 2021-03-10T15:39:35.868303+0000 mgr.gibba043.dnkmem (mgr.34373) 5750 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:37.205 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:36.014543+0000 mgr.gibba043.dnkmem (mgr.34373) 5751 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:37.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[31385]: audit 2021-03-10T15:39:36.308888+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.2.103:0/2738255448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.807008+0000 mgr.gibba043.dnkmem (mgr.34373) 5748 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:37.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cephadm 2021-03-10T15:39:35.807129+0000 mgr.gibba043.dnkmem (mgr.34373) 5749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:37.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:35.808222+0000 mon.c (mon.1) 1502 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: cluster 2021-03-10T15:39:35.868303+0000 mgr.gibba043.dnkmem (mgr.34373) 5750 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:37.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:36.014543+0000 mgr.gibba043.dnkmem (mgr.34373) 5751 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:37.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:36 gibba003 bash[32348]: audit 2021-03-10T15:39:36.308888+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.2.103:0/2738255448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.574340+0000 mgr.gibba043.dnkmem (mgr.34373) 5733 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:39:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.575981+0000 mgr.gibba043.dnkmem (mgr.34373) 5734 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:39:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.791281+0000 mgr.gibba043.dnkmem (mgr.34373) 5735 : audit [DBG] from='client.57892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.796481+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:39:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.797219+0000 mgr.gibba043.dnkmem (mgr.34373) 5736 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.799045+0000 mgr.gibba043.dnkmem (mgr.34373) 5737 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:37.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.799953+0000 mon.c (mon.1) 1497 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.800361+0000 mgr.gibba043.dnkmem (mgr.34373) 5738 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.800402+0000 mgr.gibba043.dnkmem (mgr.34373) 5739 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:37.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.801426+0000 mon.c (mon.1) 1498 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.801697+0000 mgr.gibba043.dnkmem (mgr.34373) 5740 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:37.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.801736+0000 mgr.gibba043.dnkmem (mgr.34373) 5741 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:37.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.802724+0000 mgr.gibba043.dnkmem (mgr.34373) 5742 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:37.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.802787+0000 mon.c (mon.1) 1499 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.804061+0000 mon.c (mon.1) 1500 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.804217+0000 mgr.gibba043.dnkmem (mgr.34373) 5743 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:37.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.804258+0000 mgr.gibba043.dnkmem (mgr.34373) 5744 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:37.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.805533+0000 mgr.gibba043.dnkmem (mgr.34373) 5745 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:37.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.805925+0000 mgr.gibba043.dnkmem (mgr.34373) 5746 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:37.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.806705+0000 mon.c (mon.1) 1501 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.806964+0000 mgr.gibba043.dnkmem (mgr.34373) 5747 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:37.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.807008+0000 mgr.gibba043.dnkmem (mgr.34373) 5748 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:37.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cephadm 2021-03-10T15:39:35.807129+0000 mgr.gibba043.dnkmem (mgr.34373) 5749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:37.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:35.808222+0000 mon.c (mon.1) 1502 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:37.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: cluster 2021-03-10T15:39:35.868303+0000 mgr.gibba043.dnkmem (mgr.34373) 5750 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:37.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:36.014543+0000 mgr.gibba043.dnkmem (mgr.34373) 5751 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:37.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:36 gibba043 bash[24019]: audit 2021-03-10T15:39:36.308888+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.2.103:0/2738255448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:38 gibba003 bash[31385]: cluster 2021-03-10T15:39:37.869104+0000 mgr.gibba043.dnkmem (mgr.34373) 5752 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:38 gibba003 bash[32348]: cluster 2021-03-10T15:39:37.869104+0000 mgr.gibba043.dnkmem (mgr.34373) 5752 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:38 gibba043 bash[24019]: cluster 2021-03-10T15:39:37.869104+0000 mgr.gibba043.dnkmem (mgr.34373) 5752 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:40 gibba003 bash[31385]: cluster 2021-03-10T15:39:39.869530+0000 mgr.gibba043.dnkmem (mgr.34373) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:40 gibba003 bash[32348]: cluster 2021-03-10T15:39:39.869530+0000 mgr.gibba043.dnkmem (mgr.34373) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:40 gibba043 bash[24019]: cluster 2021-03-10T15:39:39.869530+0000 mgr.gibba043.dnkmem (mgr.34373) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:43.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:42 gibba003 bash[31385]: cluster 2021-03-10T15:39:41.871016+0000 mgr.gibba043.dnkmem (mgr.34373) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:42 gibba003 bash[32348]: cluster 2021-03-10T15:39:41.871016+0000 mgr.gibba043.dnkmem (mgr.34373) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:42 gibba043 bash[24019]: cluster 2021-03-10T15:39:41.871016+0000 mgr.gibba043.dnkmem (mgr.34373) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:44 gibba043 bash[24019]: cluster 2021-03-10T15:39:43.872734+0000 mgr.gibba043.dnkmem (mgr.34373) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:44 gibba003 bash[31385]: cluster 2021-03-10T15:39:43.872734+0000 mgr.gibba043.dnkmem (mgr.34373) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:44 gibba003 bash[32348]: cluster 2021-03-10T15:39:43.872734+0000 mgr.gibba043.dnkmem (mgr.34373) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:46 gibba043 bash[24019]: cluster 2021-03-10T15:39:45.874469+0000 mgr.gibba043.dnkmem (mgr.34373) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:46 gibba003 bash[31385]: cluster 2021-03-10T15:39:45.874469+0000 mgr.gibba043.dnkmem (mgr.34373) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:46 gibba003 bash[32348]: cluster 2021-03-10T15:39:45.874469+0000 mgr.gibba043.dnkmem (mgr.34373) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:48 gibba043 bash[24019]: cluster 2021-03-10T15:39:47.875318+0000 mgr.gibba043.dnkmem (mgr.34373) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:48 gibba003 bash[31385]: cluster 2021-03-10T15:39:47.875318+0000 mgr.gibba043.dnkmem (mgr.34373) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:48 gibba003 bash[32348]: cluster 2021-03-10T15:39:47.875318+0000 mgr.gibba043.dnkmem (mgr.34373) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:50 gibba003 bash[31385]: cluster 2021-03-10T15:39:49.876756+0000 mgr.gibba043.dnkmem (mgr.34373) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:50 gibba003 bash[32348]: cluster 2021-03-10T15:39:49.876756+0000 mgr.gibba043.dnkmem (mgr.34373) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:50 gibba043 bash[24019]: cluster 2021-03-10T15:39:49.876756+0000 mgr.gibba043.dnkmem (mgr.34373) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:51 gibba003 bash[31385]: cephadm 2021-03-10T15:39:50.823204+0000 mgr.gibba043.dnkmem (mgr.34373) 5759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:52.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:51 gibba003 bash[32348]: cephadm 2021-03-10T15:39:50.823204+0000 mgr.gibba043.dnkmem (mgr.34373) 5759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:52.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:51 gibba043 bash[24019]: cephadm 2021-03-10T15:39:50.823204+0000 mgr.gibba043.dnkmem (mgr.34373) 5759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:39:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:52 gibba003 bash[31385]: cluster 2021-03-10T15:39:51.877473+0000 mgr.gibba043.dnkmem (mgr.34373) 5760 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:52 gibba003 bash[32348]: cluster 2021-03-10T15:39:51.877473+0000 mgr.gibba043.dnkmem (mgr.34373) 5760 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:52 gibba043 bash[24019]: cluster 2021-03-10T15:39:51.877473+0000 mgr.gibba043.dnkmem (mgr.34373) 5760 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:54 gibba043 bash[24019]: cluster 2021-03-10T15:39:53.879021+0000 mgr.gibba043.dnkmem (mgr.34373) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:54 gibba003 bash[31385]: cluster 2021-03-10T15:39:53.879021+0000 mgr.gibba043.dnkmem (mgr.34373) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:54 gibba003 bash[32348]: cluster 2021-03-10T15:39:53.879021+0000 mgr.gibba043.dnkmem (mgr.34373) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:56 gibba043 bash[24019]: cluster 2021-03-10T15:39:55.880745+0000 mgr.gibba043.dnkmem (mgr.34373) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:56 gibba003 bash[31385]: cluster 2021-03-10T15:39:55.880745+0000 mgr.gibba043.dnkmem (mgr.34373) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:56 gibba003 bash[32348]: cluster 2021-03-10T15:39:55.880745+0000 mgr.gibba043.dnkmem (mgr.34373) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:39:58 gibba043 bash[24019]: cluster 2021-03-10T15:39:57.881664+0000 mgr.gibba043.dnkmem (mgr.34373) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:39:58 gibba003 bash[31385]: cluster 2021-03-10T15:39:57.881664+0000 mgr.gibba043.dnkmem (mgr.34373) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:39:58 gibba003 bash[32348]: cluster 2021-03-10T15:39:57.881664+0000 mgr.gibba043.dnkmem (mgr.34373) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:00 gibba003 bash[31385]: debug 2021-03-10T15:39:59.999+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:00 gibba003 bash[31385]: cluster 2021-03-10T15:39:59.882110+0000 mgr.gibba043.dnkmem (mgr.34373) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:00 gibba003 bash[31385]: cluster 2021-03-10T15:40:00.000220+0000 mon.a (mon.0) 1366 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:00 gibba003 bash[32348]: cluster 2021-03-10T15:39:59.882110+0000 mgr.gibba043.dnkmem (mgr.34373) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:00 gibba003 bash[32348]: cluster 2021-03-10T15:40:00.000220+0000 mon.a (mon.0) 1366 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:00 gibba043 bash[24019]: cluster 2021-03-10T15:39:59.882110+0000 mgr.gibba043.dnkmem (mgr.34373) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:00 gibba043 bash[24019]: cluster 2021-03-10T15:40:00.000220+0000 mon.a (mon.0) 1366 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:02 gibba043 bash[24019]: cluster 2021-03-10T15:40:01.883839+0000 mgr.gibba043.dnkmem (mgr.34373) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:03.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:02 gibba003 bash[31385]: cluster 2021-03-10T15:40:01.883839+0000 mgr.gibba043.dnkmem (mgr.34373) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:02 gibba003 bash[32348]: cluster 2021-03-10T15:40:01.883839+0000 mgr.gibba043.dnkmem (mgr.34373) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:04 gibba043 bash[24019]: cluster 2021-03-10T15:40:03.885194+0000 mgr.gibba043.dnkmem (mgr.34373) 5766 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:04 gibba003 bash[31385]: cluster 2021-03-10T15:40:03.885194+0000 mgr.gibba043.dnkmem (mgr.34373) 5766 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:04 gibba003 bash[32348]: cluster 2021-03-10T15:40:03.885194+0000 mgr.gibba043.dnkmem (mgr.34373) 5766 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:06.556 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:40:06.788 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:40:06.788 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (108m) 2m ago 113m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:40:06.789 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (113m) 91s ago 113m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:40:06.789 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (108m) 91s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:40:06.789 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (109m) 91s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:40:06.789 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:40:06.790 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (108m) 2m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:40:06.790 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (107m) 91s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:40:06.790 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (107m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:40:06.790 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (113m) 2m ago 113m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:40:06.790 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (113m) 91s ago 113m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:40:06.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (106m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:40:06.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:40:06.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:40:06.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:40:06.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (105m) 91s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:40:06.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (104m) 91s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:40:06.792 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (104m) 91s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:40:06.792 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (103m) 91s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:40:06.792 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (113m) 91s ago 113m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:40:06.792 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 111m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:40:07.037 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:40:07.037 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:40:07.037 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:07.038 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:40:07.038 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:40:07.038 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:07.038 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:40:07.038 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:40:07.039 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:40:07.039 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:40:07.039 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:40:07.039 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:40:07.039 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:40:07.040 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:40:07.040 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:40:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:06 gibba043 bash[24019]: cephadm 2021-03-10T15:40:05.839274+0000 mgr.gibba043.dnkmem (mgr.34373) 5767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:06 gibba043 bash[24019]: cluster 2021-03-10T15:40:05.886694+0000 mgr.gibba043.dnkmem (mgr.34373) 5768 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:06 gibba043 bash[24019]: audit 2021-03-10T15:40:06.544711+0000 mgr.gibba043.dnkmem (mgr.34373) 5769 : audit [DBG] from='client.57910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:06 gibba003 bash[31385]: cephadm 2021-03-10T15:40:05.839274+0000 mgr.gibba043.dnkmem (mgr.34373) 5767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:06 gibba003 bash[31385]: cluster 2021-03-10T15:40:05.886694+0000 mgr.gibba043.dnkmem (mgr.34373) 5768 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:06 gibba003 bash[31385]: audit 2021-03-10T15:40:06.544711+0000 mgr.gibba043.dnkmem (mgr.34373) 5769 : audit [DBG] from='client.57910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:06 gibba003 bash[32348]: cephadm 2021-03-10T15:40:05.839274+0000 mgr.gibba043.dnkmem (mgr.34373) 5767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:06 gibba003 bash[32348]: cluster 2021-03-10T15:40:05.886694+0000 mgr.gibba043.dnkmem (mgr.34373) 5768 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:06 gibba003 bash[32348]: audit 2021-03-10T15:40:06.544711+0000 mgr.gibba043.dnkmem (mgr.34373) 5769 : audit [DBG] from='client.57910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:07 gibba043 bash[24019]: audit 2021-03-10T15:40:06.772996+0000 mgr.gibba043.dnkmem (mgr.34373) 5770 : audit [DBG] from='client.47928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:07 gibba043 bash[24019]: audit 2021-03-10T15:40:07.035472+0000 mon.a (mon.0) 1367 : audit [DBG] from='client.? 172.21.2.103:0/3526057026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:07 gibba003 bash[31385]: audit 2021-03-10T15:40:06.772996+0000 mgr.gibba043.dnkmem (mgr.34373) 5770 : audit [DBG] from='client.47928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:07 gibba003 bash[31385]: audit 2021-03-10T15:40:07.035472+0000 mon.a (mon.0) 1367 : audit [DBG] from='client.? 172.21.2.103:0/3526057026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:07 gibba003 bash[32348]: audit 2021-03-10T15:40:06.772996+0000 mgr.gibba043.dnkmem (mgr.34373) 5770 : audit [DBG] from='client.47928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:07 gibba003 bash[32348]: audit 2021-03-10T15:40:07.035472+0000 mon.a (mon.0) 1367 : audit [DBG] from='client.? 172.21.2.103:0/3526057026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:08 gibba043 bash[24019]: cluster 2021-03-10T15:40:07.887471+0000 mgr.gibba043.dnkmem (mgr.34373) 5771 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:08 gibba003 bash[31385]: cluster 2021-03-10T15:40:07.887471+0000 mgr.gibba043.dnkmem (mgr.34373) 5771 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:08 gibba003 bash[32348]: cluster 2021-03-10T15:40:07.887471+0000 mgr.gibba043.dnkmem (mgr.34373) 5771 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:10 gibba003 bash[31385]: cluster 2021-03-10T15:40:09.888745+0000 mgr.gibba043.dnkmem (mgr.34373) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:10 gibba003 bash[32348]: cluster 2021-03-10T15:40:09.888745+0000 mgr.gibba043.dnkmem (mgr.34373) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:10 gibba043 bash[24019]: cluster 2021-03-10T15:40:09.888745+0000 mgr.gibba043.dnkmem (mgr.34373) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:12 gibba043 bash[24019]: cluster 2021-03-10T15:40:11.890355+0000 mgr.gibba043.dnkmem (mgr.34373) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:13.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:12 gibba003 bash[31385]: cluster 2021-03-10T15:40:11.890355+0000 mgr.gibba043.dnkmem (mgr.34373) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:12 gibba003 bash[32348]: cluster 2021-03-10T15:40:11.890355+0000 mgr.gibba043.dnkmem (mgr.34373) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.411631+0000 mon.c (mon.1) 1503 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.412751+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.551096+0000 mon.c (mon.1) 1504 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.552212+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.655565+0000 mon.c (mon.1) 1505 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:40:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.656343+0000 mon.c (mon.1) 1506 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.656775+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:40:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.657036+0000 mon.c (mon.1) 1507 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.658084+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.658142+0000 mon.c (mon.1) 1508 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.659085+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:13 gibba043 bash[24019]: audit 2021-03-10T15:40:13.660118+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.411631+0000 mon.c (mon.1) 1503 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.412751+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.551096+0000 mon.c (mon.1) 1504 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.552212+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.655565+0000 mon.c (mon.1) 1505 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:40:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.656343+0000 mon.c (mon.1) 1506 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.656775+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:40:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.657036+0000 mon.c (mon.1) 1507 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.658084+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.658142+0000 mon.c (mon.1) 1508 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.659085+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[31385]: audit 2021-03-10T15:40:13.660118+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.411631+0000 mon.c (mon.1) 1503 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.412751+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.551096+0000 mon.c (mon.1) 1504 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.552212+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.655565+0000 mon.c (mon.1) 1505 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:40:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.656343+0000 mon.c (mon.1) 1506 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.656775+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:40:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.657036+0000 mon.c (mon.1) 1507 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.658084+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.658142+0000 mon.c (mon.1) 1508 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.659085+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:13 gibba003 bash[32348]: audit 2021-03-10T15:40:13.660118+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:14 gibba043 bash[24019]: cluster 2021-03-10T15:40:13.891759+0000 mgr.gibba043.dnkmem (mgr.34373) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:14 gibba003 bash[31385]: cluster 2021-03-10T15:40:13.891759+0000 mgr.gibba043.dnkmem (mgr.34373) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:14 gibba003 bash[32348]: cluster 2021-03-10T15:40:13.891759+0000 mgr.gibba043.dnkmem (mgr.34373) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:16 gibba043 bash[24019]: cluster 2021-03-10T15:40:15.893417+0000 mgr.gibba043.dnkmem (mgr.34373) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:16 gibba003 bash[31385]: cluster 2021-03-10T15:40:15.893417+0000 mgr.gibba043.dnkmem (mgr.34373) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:16 gibba003 bash[32348]: cluster 2021-03-10T15:40:15.893417+0000 mgr.gibba043.dnkmem (mgr.34373) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:18 gibba043 bash[24019]: cluster 2021-03-10T15:40:17.894341+0000 mgr.gibba043.dnkmem (mgr.34373) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:18 gibba003 bash[31385]: cluster 2021-03-10T15:40:17.894341+0000 mgr.gibba043.dnkmem (mgr.34373) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:18 gibba003 bash[32348]: cluster 2021-03-10T15:40:17.894341+0000 mgr.gibba043.dnkmem (mgr.34373) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:20 gibba003 bash[31385]: cluster 2021-03-10T15:40:19.895774+0000 mgr.gibba043.dnkmem (mgr.34373) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:20 gibba003 bash[32348]: cluster 2021-03-10T15:40:19.895774+0000 mgr.gibba043.dnkmem (mgr.34373) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:20 gibba043 bash[24019]: cluster 2021-03-10T15:40:19.895774+0000 mgr.gibba043.dnkmem (mgr.34373) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:22.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:21 gibba003 bash[31385]: cephadm 2021-03-10T15:40:20.855353+0000 mgr.gibba043.dnkmem (mgr.34373) 5778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:22.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:21 gibba003 bash[32348]: cephadm 2021-03-10T15:40:20.855353+0000 mgr.gibba043.dnkmem (mgr.34373) 5778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:21 gibba043 bash[24019]: cephadm 2021-03-10T15:40:20.855353+0000 mgr.gibba043.dnkmem (mgr.34373) 5778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:22 gibba003 bash[31385]: cluster 2021-03-10T15:40:21.897280+0000 mgr.gibba043.dnkmem (mgr.34373) 5779 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:22 gibba003 bash[32348]: cluster 2021-03-10T15:40:21.897280+0000 mgr.gibba043.dnkmem (mgr.34373) 5779 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:22 gibba043 bash[24019]: cluster 2021-03-10T15:40:21.897280+0000 mgr.gibba043.dnkmem (mgr.34373) 5779 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:24 gibba043 bash[24019]: cluster 2021-03-10T15:40:23.898798+0000 mgr.gibba043.dnkmem (mgr.34373) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:24 gibba003 bash[31385]: cluster 2021-03-10T15:40:23.898798+0000 mgr.gibba043.dnkmem (mgr.34373) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:24 gibba003 bash[32348]: cluster 2021-03-10T15:40:23.898798+0000 mgr.gibba043.dnkmem (mgr.34373) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:26 gibba043 bash[24019]: cluster 2021-03-10T15:40:25.900527+0000 mgr.gibba043.dnkmem (mgr.34373) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:26 gibba003 bash[31385]: cluster 2021-03-10T15:40:25.900527+0000 mgr.gibba043.dnkmem (mgr.34373) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:26 gibba003 bash[32348]: cluster 2021-03-10T15:40:25.900527+0000 mgr.gibba043.dnkmem (mgr.34373) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:28 gibba043 bash[24019]: cluster 2021-03-10T15:40:27.901460+0000 mgr.gibba043.dnkmem (mgr.34373) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:28 gibba003 bash[31385]: cluster 2021-03-10T15:40:27.901460+0000 mgr.gibba043.dnkmem (mgr.34373) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:28 gibba003 bash[32348]: cluster 2021-03-10T15:40:27.901460+0000 mgr.gibba043.dnkmem (mgr.34373) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:30 gibba003 bash[31385]: cluster 2021-03-10T15:40:29.902015+0000 mgr.gibba043.dnkmem (mgr.34373) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:30 gibba003 bash[32348]: cluster 2021-03-10T15:40:29.902015+0000 mgr.gibba043.dnkmem (mgr.34373) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:30 gibba043 bash[24019]: cluster 2021-03-10T15:40:29.902015+0000 mgr.gibba043.dnkmem (mgr.34373) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:32 gibba043 bash[24019]: cluster 2021-03-10T15:40:31.903717+0000 mgr.gibba043.dnkmem (mgr.34373) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:32 gibba003 bash[31385]: cluster 2021-03-10T15:40:31.903717+0000 mgr.gibba043.dnkmem (mgr.34373) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:32 gibba003 bash[32348]: cluster 2021-03-10T15:40:31.903717+0000 mgr.gibba043.dnkmem (mgr.34373) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:34 gibba043 bash[24019]: cluster 2021-03-10T15:40:33.905389+0000 mgr.gibba043.dnkmem (mgr.34373) 5785 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:34 gibba003 bash[31385]: cluster 2021-03-10T15:40:33.905389+0000 mgr.gibba043.dnkmem (mgr.34373) 5785 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:34 gibba003 bash[32348]: cluster 2021-03-10T15:40:33.905389+0000 mgr.gibba043.dnkmem (mgr.34373) 5785 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.281 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:40:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:35.859336+0000 mgr.gibba043.dnkmem (mgr.34373) 5786 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:40:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:35.860919+0000 mgr.gibba043.dnkmem (mgr.34373) 5787 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:40:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cluster 2021-03-10T15:40:35.905925+0000 mgr.gibba043.dnkmem (mgr.34373) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.077455+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:40:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.078249+0000 mgr.gibba043.dnkmem (mgr.34373) 5789 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.080417+0000 mgr.gibba043.dnkmem (mgr.34373) 5790 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.081176+0000 mon.c (mon.1) 1509 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.082240+0000 mgr.gibba043.dnkmem (mgr.34373) 5791 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.082288+0000 mgr.gibba043.dnkmem (mgr.34373) 5792 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.083111+0000 mon.c (mon.1) 1510 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.083831+0000 mgr.gibba043.dnkmem (mgr.34373) 5793 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.083876+0000 mgr.gibba043.dnkmem (mgr.34373) 5794 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.084884+0000 mon.c (mon.1) 1511 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.085297+0000 mgr.gibba043.dnkmem (mgr.34373) 5795 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.086394+0000 mon.c (mon.1) 1512 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.086945+0000 mgr.gibba043.dnkmem (mgr.34373) 5796 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.086989+0000 mgr.gibba043.dnkmem (mgr.34373) 5797 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.088670+0000 mgr.gibba043.dnkmem (mgr.34373) 5798 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:37.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.088999+0000 mgr.gibba043.dnkmem (mgr.34373) 5799 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.089573+0000 mon.c (mon.1) 1513 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.090418+0000 mgr.gibba043.dnkmem (mgr.34373) 5800 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.090464+0000 mgr.gibba043.dnkmem (mgr.34373) 5801 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:37.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: cephadm 2021-03-10T15:40:36.090583+0000 mgr.gibba043.dnkmem (mgr.34373) 5802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:37.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[31385]: audit 2021-03-10T15:40:36.091506+0000 mon.c (mon.1) 1514 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:35.859336+0000 mgr.gibba043.dnkmem (mgr.34373) 5786 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:40:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:35.860919+0000 mgr.gibba043.dnkmem (mgr.34373) 5787 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:40:37.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cluster 2021-03-10T15:40:35.905925+0000 mgr.gibba043.dnkmem (mgr.34373) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.077455+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:40:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.078249+0000 mgr.gibba043.dnkmem (mgr.34373) 5789 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.080417+0000 mgr.gibba043.dnkmem (mgr.34373) 5790 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.081176+0000 mon.c (mon.1) 1509 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:37.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.082240+0000 mgr.gibba043.dnkmem (mgr.34373) 5791 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.082288+0000 mgr.gibba043.dnkmem (mgr.34373) 5792 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.083111+0000 mon.c (mon.1) 1510 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.083831+0000 mgr.gibba043.dnkmem (mgr.34373) 5793 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:37.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.083876+0000 mgr.gibba043.dnkmem (mgr.34373) 5794 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.084884+0000 mon.c (mon.1) 1511 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.085297+0000 mgr.gibba043.dnkmem (mgr.34373) 5795 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.086394+0000 mon.c (mon.1) 1512 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.086945+0000 mgr.gibba043.dnkmem (mgr.34373) 5796 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.086989+0000 mgr.gibba043.dnkmem (mgr.34373) 5797 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.088670+0000 mgr.gibba043.dnkmem (mgr.34373) 5798 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.088999+0000 mgr.gibba043.dnkmem (mgr.34373) 5799 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.089573+0000 mon.c (mon.1) 1513 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.090418+0000 mgr.gibba043.dnkmem (mgr.34373) 5800 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.090464+0000 mgr.gibba043.dnkmem (mgr.34373) 5801 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: cephadm 2021-03-10T15:40:36.090583+0000 mgr.gibba043.dnkmem (mgr.34373) 5802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:37.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:37 gibba003 bash[32348]: audit 2021-03-10T15:40:36.091506+0000 mon.c (mon.1) 1514 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.513 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:40:37.513 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (108m) 3m ago 114m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:40:37.514 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (114m) 2m ago 114m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:40:37.514 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (109m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:40:37.514 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (109m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:40:37.514 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (108m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:40:37.515 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (108m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:40:37.515 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:40:37.515 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (108m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:40:37.515 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (114m) 3m ago 114m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:40:37.516 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (114m) 2m ago 114m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:40:37.516 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:40:37.516 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:40:37.516 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:40:37.516 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:40:37.517 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:40:37.517 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:40:37.517 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (104m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:40:37.517 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (104m) 2m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:40:37.518 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (113m) 2m ago 114m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:40:37.518 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 112m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:40:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:35.859336+0000 mgr.gibba043.dnkmem (mgr.34373) 5786 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:40:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:35.860919+0000 mgr.gibba043.dnkmem (mgr.34373) 5787 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:40:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cluster 2021-03-10T15:40:35.905925+0000 mgr.gibba043.dnkmem (mgr.34373) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.077455+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:40:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.078249+0000 mgr.gibba043.dnkmem (mgr.34373) 5789 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.080417+0000 mgr.gibba043.dnkmem (mgr.34373) 5790 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.081176+0000 mon.c (mon.1) 1509 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.082240+0000 mgr.gibba043.dnkmem (mgr.34373) 5791 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.082288+0000 mgr.gibba043.dnkmem (mgr.34373) 5792 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.083111+0000 mon.c (mon.1) 1510 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.083831+0000 mgr.gibba043.dnkmem (mgr.34373) 5793 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.083876+0000 mgr.gibba043.dnkmem (mgr.34373) 5794 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.084884+0000 mon.c (mon.1) 1511 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.085297+0000 mgr.gibba043.dnkmem (mgr.34373) 5795 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.086394+0000 mon.c (mon.1) 1512 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.086945+0000 mgr.gibba043.dnkmem (mgr.34373) 5796 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.086989+0000 mgr.gibba043.dnkmem (mgr.34373) 5797 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.088670+0000 mgr.gibba043.dnkmem (mgr.34373) 5798 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.088999+0000 mgr.gibba043.dnkmem (mgr.34373) 5799 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.089573+0000 mon.c (mon.1) 1513 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.090418+0000 mgr.gibba043.dnkmem (mgr.34373) 5800 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.090464+0000 mgr.gibba043.dnkmem (mgr.34373) 5801 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:37.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: cephadm 2021-03-10T15:40:36.090583+0000 mgr.gibba043.dnkmem (mgr.34373) 5802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:37.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:37 gibba043 bash[24019]: audit 2021-03-10T15:40:36.091506+0000 mon.c (mon.1) 1514 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:37.766 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:40:37.767 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:40:37.767 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:37.767 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:40:37.767 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:40:37.768 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:37.768 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:40:37.768 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:40:37.768 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:40:37.768 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:40:37.769 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:40:37.769 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:40:37.769 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:40:37.769 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:40:37.770 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:40:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:38 gibba003 bash[31385]: audit 2021-03-10T15:40:37.268717+0000 mgr.gibba043.dnkmem (mgr.34373) 5803 : audit [DBG] from='client.57928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:38 gibba003 bash[31385]: audit 2021-03-10T15:40:37.497694+0000 mgr.gibba043.dnkmem (mgr.34373) 5804 : audit [DBG] from='client.47946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:38 gibba003 bash[31385]: audit 2021-03-10T15:40:37.765149+0000 mon.c (mon.1) 1515 : audit [DBG] from='client.? 172.21.2.103:0/387633982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:38 gibba003 bash[32348]: audit 2021-03-10T15:40:37.268717+0000 mgr.gibba043.dnkmem (mgr.34373) 5803 : audit [DBG] from='client.57928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:38 gibba003 bash[32348]: audit 2021-03-10T15:40:37.497694+0000 mgr.gibba043.dnkmem (mgr.34373) 5804 : audit [DBG] from='client.47946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:38 gibba003 bash[32348]: audit 2021-03-10T15:40:37.765149+0000 mon.c (mon.1) 1515 : audit [DBG] from='client.? 172.21.2.103:0/387633982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:38 gibba043 bash[24019]: audit 2021-03-10T15:40:37.268717+0000 mgr.gibba043.dnkmem (mgr.34373) 5803 : audit [DBG] from='client.57928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:38 gibba043 bash[24019]: audit 2021-03-10T15:40:37.497694+0000 mgr.gibba043.dnkmem (mgr.34373) 5804 : audit [DBG] from='client.47946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:38 gibba043 bash[24019]: audit 2021-03-10T15:40:37.765149+0000 mon.c (mon.1) 1515 : audit [DBG] from='client.? 172.21.2.103:0/387633982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:39 gibba003 bash[31385]: cluster 2021-03-10T15:40:37.907177+0000 mgr.gibba043.dnkmem (mgr.34373) 5805 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:39 gibba003 bash[32348]: cluster 2021-03-10T15:40:37.907177+0000 mgr.gibba043.dnkmem (mgr.34373) 5805 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:39 gibba043 bash[24019]: cluster 2021-03-10T15:40:37.907177+0000 mgr.gibba043.dnkmem (mgr.34373) 5805 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:40 gibba003 bash[31385]: cluster 2021-03-10T15:40:39.907956+0000 mgr.gibba043.dnkmem (mgr.34373) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:40 gibba003 bash[32348]: cluster 2021-03-10T15:40:39.907956+0000 mgr.gibba043.dnkmem (mgr.34373) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:40 gibba043 bash[24019]: cluster 2021-03-10T15:40:39.907956+0000 mgr.gibba043.dnkmem (mgr.34373) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:42 gibba043 bash[24019]: cluster 2021-03-10T15:40:41.909472+0000 mgr.gibba043.dnkmem (mgr.34373) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:42 gibba003 bash[31385]: cluster 2021-03-10T15:40:41.909472+0000 mgr.gibba043.dnkmem (mgr.34373) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:42 gibba003 bash[32348]: cluster 2021-03-10T15:40:41.909472+0000 mgr.gibba043.dnkmem (mgr.34373) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:45.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:44 gibba043 bash[24019]: cluster 2021-03-10T15:40:43.911281+0000 mgr.gibba043.dnkmem (mgr.34373) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:45.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:44 gibba003 bash[31385]: cluster 2021-03-10T15:40:43.911281+0000 mgr.gibba043.dnkmem (mgr.34373) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:44 gibba003 bash[32348]: cluster 2021-03-10T15:40:43.911281+0000 mgr.gibba043.dnkmem (mgr.34373) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:47.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:46 gibba043 bash[24019]: cluster 2021-03-10T15:40:45.913017+0000 mgr.gibba043.dnkmem (mgr.34373) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:46 gibba003 bash[31385]: cluster 2021-03-10T15:40:45.913017+0000 mgr.gibba043.dnkmem (mgr.34373) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:46 gibba003 bash[32348]: cluster 2021-03-10T15:40:45.913017+0000 mgr.gibba043.dnkmem (mgr.34373) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:49 gibba043 bash[24019]: cluster 2021-03-10T15:40:47.913936+0000 mgr.gibba043.dnkmem (mgr.34373) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:49 gibba003 bash[31385]: cluster 2021-03-10T15:40:47.913936+0000 mgr.gibba043.dnkmem (mgr.34373) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:49 gibba003 bash[32348]: cluster 2021-03-10T15:40:47.913936+0000 mgr.gibba043.dnkmem (mgr.34373) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:51.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:50 gibba003 bash[31385]: cluster 2021-03-10T15:40:49.915424+0000 mgr.gibba043.dnkmem (mgr.34373) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:50 gibba003 bash[32348]: cluster 2021-03-10T15:40:49.915424+0000 mgr.gibba043.dnkmem (mgr.34373) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:50 gibba043 bash[24019]: cluster 2021-03-10T15:40:49.915424+0000 mgr.gibba043.dnkmem (mgr.34373) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:52.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:51 gibba003 bash[31385]: cephadm 2021-03-10T15:40:51.106594+0000 mgr.gibba043.dnkmem (mgr.34373) 5812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:52.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:51 gibba003 bash[32348]: cephadm 2021-03-10T15:40:51.106594+0000 mgr.gibba043.dnkmem (mgr.34373) 5812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:52.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:51 gibba043 bash[24019]: cephadm 2021-03-10T15:40:51.106594+0000 mgr.gibba043.dnkmem (mgr.34373) 5812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:40:53.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:52 gibba003 bash[31385]: cluster 2021-03-10T15:40:51.916151+0000 mgr.gibba043.dnkmem (mgr.34373) 5813 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:52 gibba003 bash[32348]: cluster 2021-03-10T15:40:51.916151+0000 mgr.gibba043.dnkmem (mgr.34373) 5813 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:52 gibba043 bash[24019]: cluster 2021-03-10T15:40:51.916151+0000 mgr.gibba043.dnkmem (mgr.34373) 5813 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:55.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:54 gibba043 bash[24019]: cluster 2021-03-10T15:40:53.917686+0000 mgr.gibba043.dnkmem (mgr.34373) 5814 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:54 gibba003 bash[31385]: cluster 2021-03-10T15:40:53.917686+0000 mgr.gibba043.dnkmem (mgr.34373) 5814 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:54 gibba003 bash[32348]: cluster 2021-03-10T15:40:53.917686+0000 mgr.gibba043.dnkmem (mgr.34373) 5814 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:57.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:56 gibba043 bash[24019]: cluster 2021-03-10T15:40:55.919318+0000 mgr.gibba043.dnkmem (mgr.34373) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:56 gibba003 bash[31385]: cluster 2021-03-10T15:40:55.919318+0000 mgr.gibba043.dnkmem (mgr.34373) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:57.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:56 gibba003 bash[32348]: cluster 2021-03-10T15:40:55.919318+0000 mgr.gibba043.dnkmem (mgr.34373) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:40:59 gibba043 bash[24019]: cluster 2021-03-10T15:40:57.920216+0000 mgr.gibba043.dnkmem (mgr.34373) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:40:59 gibba003 bash[31385]: cluster 2021-03-10T15:40:57.920216+0000 mgr.gibba043.dnkmem (mgr.34373) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:40:59 gibba003 bash[32348]: cluster 2021-03-10T15:40:57.920216+0000 mgr.gibba043.dnkmem (mgr.34373) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:00 gibba003 bash[31385]: cluster 2021-03-10T15:40:59.921673+0000 mgr.gibba043.dnkmem (mgr.34373) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:00 gibba003 bash[32348]: cluster 2021-03-10T15:40:59.921673+0000 mgr.gibba043.dnkmem (mgr.34373) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:00 gibba043 bash[24019]: cluster 2021-03-10T15:40:59.921673+0000 mgr.gibba043.dnkmem (mgr.34373) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:02 gibba043 bash[24019]: cluster 2021-03-10T15:41:01.923252+0000 mgr.gibba043.dnkmem (mgr.34373) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:02 gibba003 bash[31385]: cluster 2021-03-10T15:41:01.923252+0000 mgr.gibba043.dnkmem (mgr.34373) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:02 gibba003 bash[32348]: cluster 2021-03-10T15:41:01.923252+0000 mgr.gibba043.dnkmem (mgr.34373) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:04 gibba043 bash[24019]: cluster 2021-03-10T15:41:03.924943+0000 mgr.gibba043.dnkmem (mgr.34373) 5819 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:04 gibba003 bash[31385]: cluster 2021-03-10T15:41:03.924943+0000 mgr.gibba043.dnkmem (mgr.34373) 5819 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:04 gibba003 bash[32348]: cluster 2021-03-10T15:41:03.924943+0000 mgr.gibba043.dnkmem (mgr.34373) 5819 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:07 gibba043 bash[24019]: cluster 2021-03-10T15:41:05.926667+0000 mgr.gibba043.dnkmem (mgr.34373) 5820 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:07 gibba043 bash[24019]: cephadm 2021-03-10T15:41:06.122556+0000 mgr.gibba043.dnkmem (mgr.34373) 5821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:07 gibba003 bash[31385]: cluster 2021-03-10T15:41:05.926667+0000 mgr.gibba043.dnkmem (mgr.34373) 5820 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:07 gibba003 bash[31385]: cephadm 2021-03-10T15:41:06.122556+0000 mgr.gibba043.dnkmem (mgr.34373) 5821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:07 gibba003 bash[32348]: cluster 2021-03-10T15:41:05.926667+0000 mgr.gibba043.dnkmem (mgr.34373) 5820 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:07 gibba003 bash[32348]: cephadm 2021-03-10T15:41:06.122556+0000 mgr.gibba043.dnkmem (mgr.34373) 5821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:08.010 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:41:08.268 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:41:08.269 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (109m) 3m ago 114m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:41:08.269 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (114m) 2m ago 114m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:41:08.269 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (109m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:41:08.269 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:41:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:41:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (109m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:41:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:41:08.270 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (108m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:41:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (114m) 3m ago 114m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:41:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (114m) 2m ago 114m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:41:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (107m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:41:08.271 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:41:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:41:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:41:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:41:08.272 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:41:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:41:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (104m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:41:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (114m) 2m ago 115m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:41:08.273 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 112m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:41:08.521 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:41:08.522 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:41:08.522 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:08.522 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:41:08.522 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:41:08.523 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:08.523 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:41:08.523 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:41:08.523 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:41:08.524 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:41:08.524 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:41:08.524 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:41:08.524 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:41:08.524 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:41:08.525 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:41:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:09 gibba043 bash[24019]: cluster 2021-03-10T15:41:07.928275+0000 mgr.gibba043.dnkmem (mgr.34373) 5822 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:09 gibba043 bash[24019]: audit 2021-03-10T15:41:07.996647+0000 mgr.gibba043.dnkmem (mgr.34373) 5823 : audit [DBG] from='client.57946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:09 gibba043 bash[24019]: audit 2021-03-10T15:41:08.225685+0000 mgr.gibba043.dnkmem (mgr.34373) 5824 : audit [DBG] from='client.57952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:09 gibba043 bash[24019]: audit 2021-03-10T15:41:08.520089+0000 mon.a (mon.0) 1375 : audit [DBG] from='client.? 172.21.2.103:0/651788540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[31385]: cluster 2021-03-10T15:41:07.928275+0000 mgr.gibba043.dnkmem (mgr.34373) 5822 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[31385]: audit 2021-03-10T15:41:07.996647+0000 mgr.gibba043.dnkmem (mgr.34373) 5823 : audit [DBG] from='client.57946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[31385]: audit 2021-03-10T15:41:08.225685+0000 mgr.gibba043.dnkmem (mgr.34373) 5824 : audit [DBG] from='client.57952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[31385]: audit 2021-03-10T15:41:08.520089+0000 mon.a (mon.0) 1375 : audit [DBG] from='client.? 172.21.2.103:0/651788540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[32348]: cluster 2021-03-10T15:41:07.928275+0000 mgr.gibba043.dnkmem (mgr.34373) 5822 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[32348]: audit 2021-03-10T15:41:07.996647+0000 mgr.gibba043.dnkmem (mgr.34373) 5823 : audit [DBG] from='client.57946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[32348]: audit 2021-03-10T15:41:08.225685+0000 mgr.gibba043.dnkmem (mgr.34373) 5824 : audit [DBG] from='client.57952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:09 gibba003 bash[32348]: audit 2021-03-10T15:41:08.520089+0000 mon.a (mon.0) 1375 : audit [DBG] from='client.? 172.21.2.103:0/651788540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:10 gibba003 bash[31385]: cluster 2021-03-10T15:41:09.930168+0000 mgr.gibba043.dnkmem (mgr.34373) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:10 gibba003 bash[32348]: cluster 2021-03-10T15:41:09.930168+0000 mgr.gibba043.dnkmem (mgr.34373) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:10 gibba043 bash[24019]: cluster 2021-03-10T15:41:09.930168+0000 mgr.gibba043.dnkmem (mgr.34373) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:13.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:12 gibba043 bash[24019]: cluster 2021-03-10T15:41:11.931796+0000 mgr.gibba043.dnkmem (mgr.34373) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:13.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:12 gibba003 bash[31385]: cluster 2021-03-10T15:41:11.931796+0000 mgr.gibba043.dnkmem (mgr.34373) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:13.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:12 gibba003 bash[32348]: cluster 2021-03-10T15:41:11.931796+0000 mgr.gibba043.dnkmem (mgr.34373) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.418963+0000 mon.c (mon.1) 1516 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.420102+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.559599+0000 mon.c (mon.1) 1517 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.560707+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.665863+0000 mon.c (mon.1) 1518 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:41:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.666572+0000 mon.c (mon.1) 1519 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:41:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.667274+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:41:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.667734+0000 mon.c (mon.1) 1520 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.669188+0000 mon.c (mon.1) 1521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.669797+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:41:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.670813+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:14 gibba043 bash[24019]: audit 2021-03-10T15:41:13.670971+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.418963+0000 mon.c (mon.1) 1516 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.420102+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.559599+0000 mon.c (mon.1) 1517 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.560707+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.665863+0000 mon.c (mon.1) 1518 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:41:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.666572+0000 mon.c (mon.1) 1519 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:41:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.667274+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:41:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.667734+0000 mon.c (mon.1) 1520 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.669188+0000 mon.c (mon.1) 1521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.669797+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:41:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.670813+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[31385]: audit 2021-03-10T15:41:13.670971+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.418963+0000 mon.c (mon.1) 1516 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.420102+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.559599+0000 mon.c (mon.1) 1517 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.560707+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.665863+0000 mon.c (mon.1) 1518 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:41:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.666572+0000 mon.c (mon.1) 1519 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:41:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.667274+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:41:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.667734+0000 mon.c (mon.1) 1520 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.669188+0000 mon.c (mon.1) 1521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.669797+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:41:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.670813+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:41:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:14 gibba003 bash[32348]: audit 2021-03-10T15:41:13.670971+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:41:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:15 gibba043 bash[24019]: cluster 2021-03-10T15:41:13.933428+0000 mgr.gibba043.dnkmem (mgr.34373) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:15 gibba003 bash[31385]: cluster 2021-03-10T15:41:13.933428+0000 mgr.gibba043.dnkmem (mgr.34373) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:15 gibba003 bash[32348]: cluster 2021-03-10T15:41:13.933428+0000 mgr.gibba043.dnkmem (mgr.34373) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:17 gibba003 bash[31385]: cluster 2021-03-10T15:41:15.934964+0000 mgr.gibba043.dnkmem (mgr.34373) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:17 gibba003 bash[32348]: cluster 2021-03-10T15:41:15.934964+0000 mgr.gibba043.dnkmem (mgr.34373) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:17 gibba043 bash[24019]: cluster 2021-03-10T15:41:15.934964+0000 mgr.gibba043.dnkmem (mgr.34373) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:19 gibba003 bash[31385]: cluster 2021-03-10T15:41:17.935966+0000 mgr.gibba043.dnkmem (mgr.34373) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:19 gibba003 bash[32348]: cluster 2021-03-10T15:41:17.935966+0000 mgr.gibba043.dnkmem (mgr.34373) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:19 gibba043 bash[24019]: cluster 2021-03-10T15:41:17.935966+0000 mgr.gibba043.dnkmem (mgr.34373) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:21.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:20 gibba003 bash[31385]: cluster 2021-03-10T15:41:19.936500+0000 mgr.gibba043.dnkmem (mgr.34373) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:20 gibba003 bash[32348]: cluster 2021-03-10T15:41:19.936500+0000 mgr.gibba043.dnkmem (mgr.34373) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:20 gibba043 bash[24019]: cluster 2021-03-10T15:41:19.936500+0000 mgr.gibba043.dnkmem (mgr.34373) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:22.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:21 gibba003 bash[31385]: cephadm 2021-03-10T15:41:21.138672+0000 mgr.gibba043.dnkmem (mgr.34373) 5831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:22.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:21 gibba003 bash[32348]: cephadm 2021-03-10T15:41:21.138672+0000 mgr.gibba043.dnkmem (mgr.34373) 5831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:21 gibba043 bash[24019]: cephadm 2021-03-10T15:41:21.138672+0000 mgr.gibba043.dnkmem (mgr.34373) 5831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:23.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:22 gibba003 bash[31385]: cluster 2021-03-10T15:41:21.937126+0000 mgr.gibba043.dnkmem (mgr.34373) 5832 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:22 gibba003 bash[32348]: cluster 2021-03-10T15:41:21.937126+0000 mgr.gibba043.dnkmem (mgr.34373) 5832 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:23.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:22 gibba043 bash[24019]: cluster 2021-03-10T15:41:21.937126+0000 mgr.gibba043.dnkmem (mgr.34373) 5832 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:25.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:25 gibba043 bash[24019]: cluster 2021-03-10T15:41:23.938684+0000 mgr.gibba043.dnkmem (mgr.34373) 5833 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:25 gibba003 bash[31385]: cluster 2021-03-10T15:41:23.938684+0000 mgr.gibba043.dnkmem (mgr.34373) 5833 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:25 gibba003 bash[32348]: cluster 2021-03-10T15:41:23.938684+0000 mgr.gibba043.dnkmem (mgr.34373) 5833 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:27.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:27 gibba043 bash[24019]: cluster 2021-03-10T15:41:25.940277+0000 mgr.gibba043.dnkmem (mgr.34373) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:27 gibba003 bash[31385]: cluster 2021-03-10T15:41:25.940277+0000 mgr.gibba043.dnkmem (mgr.34373) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:27 gibba003 bash[32348]: cluster 2021-03-10T15:41:25.940277+0000 mgr.gibba043.dnkmem (mgr.34373) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:29 gibba003 bash[31385]: cluster 2021-03-10T15:41:27.941751+0000 mgr.gibba043.dnkmem (mgr.34373) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:29 gibba003 bash[32348]: cluster 2021-03-10T15:41:27.941751+0000 mgr.gibba043.dnkmem (mgr.34373) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:29 gibba043 bash[24019]: cluster 2021-03-10T15:41:27.941751+0000 mgr.gibba043.dnkmem (mgr.34373) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:31.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:30 gibba003 bash[31385]: cluster 2021-03-10T15:41:29.943432+0000 mgr.gibba043.dnkmem (mgr.34373) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:30 gibba003 bash[32348]: cluster 2021-03-10T15:41:29.943432+0000 mgr.gibba043.dnkmem (mgr.34373) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:30 gibba043 bash[24019]: cluster 2021-03-10T15:41:29.943432+0000 mgr.gibba043.dnkmem (mgr.34373) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:33 gibba043 bash[24019]: cluster 2021-03-10T15:41:31.945070+0000 mgr.gibba043.dnkmem (mgr.34373) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:33 gibba003 bash[31385]: cluster 2021-03-10T15:41:31.945070+0000 mgr.gibba043.dnkmem (mgr.34373) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:33 gibba003 bash[32348]: cluster 2021-03-10T15:41:31.945070+0000 mgr.gibba043.dnkmem (mgr.34373) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:35 gibba043 bash[24019]: cluster 2021-03-10T15:41:33.946456+0000 mgr.gibba043.dnkmem (mgr.34373) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:35 gibba003 bash[31385]: cluster 2021-03-10T15:41:33.946456+0000 mgr.gibba043.dnkmem (mgr.34373) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:35 gibba003 bash[32348]: cluster 2021-03-10T15:41:33.946456+0000 mgr.gibba043.dnkmem (mgr.34373) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cluster 2021-03-10T15:41:35.948247+0000 mgr.gibba043.dnkmem (mgr.34373) 5839 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.155566+0000 mgr.gibba043.dnkmem (mgr.34373) 5840 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:41:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.157167+0000 mgr.gibba043.dnkmem (mgr.34373) 5841 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:41:37.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.389721+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:41:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.390441+0000 mgr.gibba043.dnkmem (mgr.34373) 5842 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.392521+0000 mgr.gibba043.dnkmem (mgr.34373) 5843 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.393675+0000 mon.c (mon.1) 1522 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:37.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.393934+0000 mgr.gibba043.dnkmem (mgr.34373) 5844 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.393973+0000 mgr.gibba043.dnkmem (mgr.34373) 5845 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.395232+0000 mon.c (mon.1) 1523 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.395497+0000 mgr.gibba043.dnkmem (mgr.34373) 5846 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:37.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.395536+0000 mgr.gibba043.dnkmem (mgr.34373) 5847 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:37.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.396785+0000 mgr.gibba043.dnkmem (mgr.34373) 5848 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:37.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.396789+0000 mon.c (mon.1) 1524 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.398140+0000 mon.c (mon.1) 1525 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.398397+0000 mgr.gibba043.dnkmem (mgr.34373) 5849 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:37.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.398436+0000 mgr.gibba043.dnkmem (mgr.34373) 5850 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:37.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.399808+0000 mgr.gibba043.dnkmem (mgr.34373) 5851 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:37.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.400132+0000 mgr.gibba043.dnkmem (mgr.34373) 5852 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:37.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.401133+0000 mon.c (mon.1) 1526 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.401315+0000 mgr.gibba043.dnkmem (mgr.34373) 5853 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:37.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cluster 2021-03-10T15:41:35.948247+0000 mgr.gibba043.dnkmem (mgr.34373) 5839 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.155566+0000 mgr.gibba043.dnkmem (mgr.34373) 5840 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:41:37.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.157167+0000 mgr.gibba043.dnkmem (mgr.34373) 5841 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:41:37.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.389721+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:41:37.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.390441+0000 mgr.gibba043.dnkmem (mgr.34373) 5842 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:37.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.392521+0000 mgr.gibba043.dnkmem (mgr.34373) 5843 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:37.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.393675+0000 mon.c (mon.1) 1522 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:37.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.393934+0000 mgr.gibba043.dnkmem (mgr.34373) 5844 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:37.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.393973+0000 mgr.gibba043.dnkmem (mgr.34373) 5845 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:37.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.395232+0000 mon.c (mon.1) 1523 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.395497+0000 mgr.gibba043.dnkmem (mgr.34373) 5846 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:37.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.395536+0000 mgr.gibba043.dnkmem (mgr.34373) 5847 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:37.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.396785+0000 mgr.gibba043.dnkmem (mgr.34373) 5848 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:37.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.396789+0000 mon.c (mon.1) 1524 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.398140+0000 mon.c (mon.1) 1525 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.398397+0000 mgr.gibba043.dnkmem (mgr.34373) 5849 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:37.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.398436+0000 mgr.gibba043.dnkmem (mgr.34373) 5850 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:37.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.399808+0000 mgr.gibba043.dnkmem (mgr.34373) 5851 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:37.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.400132+0000 mgr.gibba043.dnkmem (mgr.34373) 5852 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:37.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.401133+0000 mon.c (mon.1) 1526 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.709 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.401315+0000 mgr.gibba043.dnkmem (mgr.34373) 5853 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:37.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.401354+0000 mgr.gibba043.dnkmem (mgr.34373) 5854 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:37.709 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: cephadm 2021-03-10T15:41:36.401460+0000 mgr.gibba043.dnkmem (mgr.34373) 5855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:37.710 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[31385]: audit 2021-03-10T15:41:36.402679+0000 mon.c (mon.1) 1527 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.710 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.401354+0000 mgr.gibba043.dnkmem (mgr.34373) 5854 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:37.710 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: cephadm 2021-03-10T15:41:36.401460+0000 mgr.gibba043.dnkmem (mgr.34373) 5855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:37.711 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:37 gibba003 bash[32348]: audit 2021-03-10T15:41:36.402679+0000 mon.c (mon.1) 1527 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cluster 2021-03-10T15:41:35.948247+0000 mgr.gibba043.dnkmem (mgr.34373) 5839 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.155566+0000 mgr.gibba043.dnkmem (mgr.34373) 5840 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:41:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.157167+0000 mgr.gibba043.dnkmem (mgr.34373) 5841 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:41:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.389721+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:41:37.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.390441+0000 mgr.gibba043.dnkmem (mgr.34373) 5842 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:37.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.392521+0000 mgr.gibba043.dnkmem (mgr.34373) 5843 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:37.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.393675+0000 mon.c (mon.1) 1522 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:37.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.393934+0000 mgr.gibba043.dnkmem (mgr.34373) 5844 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:37.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.393973+0000 mgr.gibba043.dnkmem (mgr.34373) 5845 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:37.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.395232+0000 mon.c (mon.1) 1523 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.395497+0000 mgr.gibba043.dnkmem (mgr.34373) 5846 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:37.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.395536+0000 mgr.gibba043.dnkmem (mgr.34373) 5847 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:37.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.396785+0000 mgr.gibba043.dnkmem (mgr.34373) 5848 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:37.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.396789+0000 mon.c (mon.1) 1524 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.398140+0000 mon.c (mon.1) 1525 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.398397+0000 mgr.gibba043.dnkmem (mgr.34373) 5849 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:37.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.398436+0000 mgr.gibba043.dnkmem (mgr.34373) 5850 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:37.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.399808+0000 mgr.gibba043.dnkmem (mgr.34373) 5851 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:37.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.400132+0000 mgr.gibba043.dnkmem (mgr.34373) 5852 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:37.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.401133+0000 mon.c (mon.1) 1526 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:37.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.401315+0000 mgr.gibba043.dnkmem (mgr.34373) 5853 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:37.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.401354+0000 mgr.gibba043.dnkmem (mgr.34373) 5854 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:37.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: cephadm 2021-03-10T15:41:36.401460+0000 mgr.gibba043.dnkmem (mgr.34373) 5855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:37.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:37 gibba043 bash[24019]: audit 2021-03-10T15:41:36.402679+0000 mon.c (mon.1) 1527 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:38.764 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:41:38.990 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:41:38.990 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (110m) 4m ago 115m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:41:38.990 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (115m) 3m ago 115m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:41:38.991 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (110m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:41:38.991 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (110m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:41:38.991 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:41:38.991 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:41:38.992 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:41:38.992 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (109m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:41:38.992 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (115m) 4m ago 115m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:41:38.992 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (115m) 3m ago 115m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:41:38.992 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:41:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:41:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:41:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:41:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:41:38.993 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:41:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (105m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:41:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (105m) 3m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:41:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (114m) 3m ago 115m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:41:38.994 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 113m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:41:39.238 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:41:39.239 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:41:39.239 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:39.239 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:41:39.240 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:41:39.240 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:39.240 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:41:39.240 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:41:39.240 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:41:39.241 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:41:39.241 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:41:39.241 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:41:39.241 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:41:39.242 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:41:39.242 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:41:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:39 gibba003 bash[31385]: cluster 2021-03-10T15:41:37.949360+0000 mgr.gibba043.dnkmem (mgr.34373) 5856 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:39 gibba003 bash[31385]: audit 2021-03-10T15:41:39.237066+0000 mon.c (mon.1) 1528 : audit [DBG] from='client.? 172.21.2.103:0/2413196242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:39 gibba003 bash[32348]: cluster 2021-03-10T15:41:37.949360+0000 mgr.gibba043.dnkmem (mgr.34373) 5856 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:39 gibba003 bash[32348]: audit 2021-03-10T15:41:39.237066+0000 mon.c (mon.1) 1528 : audit [DBG] from='client.? 172.21.2.103:0/2413196242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:39 gibba043 bash[24019]: cluster 2021-03-10T15:41:37.949360+0000 mgr.gibba043.dnkmem (mgr.34373) 5856 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:39.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:39 gibba043 bash[24019]: audit 2021-03-10T15:41:39.237066+0000 mon.c (mon.1) 1528 : audit [DBG] from='client.? 172.21.2.103:0/2413196242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:40.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:40 gibba003 bash[31385]: audit 2021-03-10T15:41:38.752535+0000 mgr.gibba043.dnkmem (mgr.34373) 5857 : audit [DBG] from='client.57964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:40.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:40 gibba003 bash[31385]: audit 2021-03-10T15:41:38.974390+0000 mgr.gibba043.dnkmem (mgr.34373) 5858 : audit [DBG] from='client.57970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:40.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:40 gibba003 bash[32348]: audit 2021-03-10T15:41:38.752535+0000 mgr.gibba043.dnkmem (mgr.34373) 5857 : audit [DBG] from='client.57964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:40.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:40 gibba003 bash[32348]: audit 2021-03-10T15:41:38.974390+0000 mgr.gibba043.dnkmem (mgr.34373) 5858 : audit [DBG] from='client.57970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:40.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:40 gibba043 bash[24019]: audit 2021-03-10T15:41:38.752535+0000 mgr.gibba043.dnkmem (mgr.34373) 5857 : audit [DBG] from='client.57964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:40.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:40 gibba043 bash[24019]: audit 2021-03-10T15:41:38.974390+0000 mgr.gibba043.dnkmem (mgr.34373) 5858 : audit [DBG] from='client.57970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:41.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:41 gibba003 bash[31385]: cluster 2021-03-10T15:41:39.949913+0000 mgr.gibba043.dnkmem (mgr.34373) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:41 gibba003 bash[32348]: cluster 2021-03-10T15:41:39.949913+0000 mgr.gibba043.dnkmem (mgr.34373) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:41.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:41 gibba043 bash[24019]: cluster 2021-03-10T15:41:39.949913+0000 mgr.gibba043.dnkmem (mgr.34373) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:43 gibba003 bash[31385]: cluster 2021-03-10T15:41:41.951413+0000 mgr.gibba043.dnkmem (mgr.34373) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:43 gibba003 bash[32348]: cluster 2021-03-10T15:41:41.951413+0000 mgr.gibba043.dnkmem (mgr.34373) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:43.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:43 gibba043 bash[24019]: cluster 2021-03-10T15:41:41.951413+0000 mgr.gibba043.dnkmem (mgr.34373) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:45 gibba003 bash[31385]: cluster 2021-03-10T15:41:43.953015+0000 mgr.gibba043.dnkmem (mgr.34373) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:45 gibba003 bash[32348]: cluster 2021-03-10T15:41:43.953015+0000 mgr.gibba043.dnkmem (mgr.34373) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:45.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:45 gibba043 bash[24019]: cluster 2021-03-10T15:41:43.953015+0000 mgr.gibba043.dnkmem (mgr.34373) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:47.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:47 gibba043 bash[24019]: cluster 2021-03-10T15:41:45.954828+0000 mgr.gibba043.dnkmem (mgr.34373) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:47 gibba003 bash[31385]: cluster 2021-03-10T15:41:45.954828+0000 mgr.gibba043.dnkmem (mgr.34373) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:47.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:47 gibba003 bash[32348]: cluster 2021-03-10T15:41:45.954828+0000 mgr.gibba043.dnkmem (mgr.34373) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:49 gibba043 bash[24019]: cluster 2021-03-10T15:41:47.956379+0000 mgr.gibba043.dnkmem (mgr.34373) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:49 gibba003 bash[31385]: cluster 2021-03-10T15:41:47.956379+0000 mgr.gibba043.dnkmem (mgr.34373) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:49.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:49 gibba003 bash[32348]: cluster 2021-03-10T15:41:47.956379+0000 mgr.gibba043.dnkmem (mgr.34373) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:50 gibba003 bash[31385]: cluster 2021-03-10T15:41:49.957935+0000 mgr.gibba043.dnkmem (mgr.34373) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:50 gibba003 bash[32348]: cluster 2021-03-10T15:41:49.957935+0000 mgr.gibba043.dnkmem (mgr.34373) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:51.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:50 gibba043 bash[24019]: cluster 2021-03-10T15:41:49.957935+0000 mgr.gibba043.dnkmem (mgr.34373) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:52.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:51 gibba003 bash[31385]: cephadm 2021-03-10T15:41:51.417542+0000 mgr.gibba043.dnkmem (mgr.34373) 5865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:52.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:51 gibba003 bash[32348]: cephadm 2021-03-10T15:41:51.417542+0000 mgr.gibba043.dnkmem (mgr.34373) 5865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:52.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:51 gibba043 bash[24019]: cephadm 2021-03-10T15:41:51.417542+0000 mgr.gibba043.dnkmem (mgr.34373) 5865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:41:53.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:52 gibba043 bash[24019]: cluster 2021-03-10T15:41:51.958697+0000 mgr.gibba043.dnkmem (mgr.34373) 5866 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:52 gibba003 bash[31385]: cluster 2021-03-10T15:41:51.958697+0000 mgr.gibba043.dnkmem (mgr.34373) 5866 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:52 gibba003 bash[32348]: cluster 2021-03-10T15:41:51.958697+0000 mgr.gibba043.dnkmem (mgr.34373) 5866 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:55 gibba003 bash[31385]: cluster 2021-03-10T15:41:53.960289+0000 mgr.gibba043.dnkmem (mgr.34373) 5867 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:55 gibba003 bash[32348]: cluster 2021-03-10T15:41:53.960289+0000 mgr.gibba043.dnkmem (mgr.34373) 5867 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:55.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:55 gibba043 bash[24019]: cluster 2021-03-10T15:41:53.960289+0000 mgr.gibba043.dnkmem (mgr.34373) 5867 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:57 gibba003 bash[31385]: cluster 2021-03-10T15:41:55.962120+0000 mgr.gibba043.dnkmem (mgr.34373) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:57 gibba003 bash[32348]: cluster 2021-03-10T15:41:55.962120+0000 mgr.gibba043.dnkmem (mgr.34373) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:57 gibba043 bash[24019]: cluster 2021-03-10T15:41:55.962120+0000 mgr.gibba043.dnkmem (mgr.34373) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:41:59 gibba003 bash[31385]: cluster 2021-03-10T15:41:57.963451+0000 mgr.gibba043.dnkmem (mgr.34373) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:41:59 gibba003 bash[32348]: cluster 2021-03-10T15:41:57.963451+0000 mgr.gibba043.dnkmem (mgr.34373) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:41:59 gibba043 bash[24019]: cluster 2021-03-10T15:41:57.963451+0000 mgr.gibba043.dnkmem (mgr.34373) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:00 gibba003 bash[31385]: cluster 2021-03-10T15:41:59.964986+0000 mgr.gibba043.dnkmem (mgr.34373) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:00 gibba003 bash[32348]: cluster 2021-03-10T15:41:59.964986+0000 mgr.gibba043.dnkmem (mgr.34373) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:01.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:00 gibba043 bash[24019]: cluster 2021-03-10T15:41:59.964986+0000 mgr.gibba043.dnkmem (mgr.34373) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:03 gibba003 bash[31385]: cluster 2021-03-10T15:42:01.966720+0000 mgr.gibba043.dnkmem (mgr.34373) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:03 gibba003 bash[32348]: cluster 2021-03-10T15:42:01.966720+0000 mgr.gibba043.dnkmem (mgr.34373) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:03 gibba043 bash[24019]: cluster 2021-03-10T15:42:01.966720+0000 mgr.gibba043.dnkmem (mgr.34373) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:05 gibba003 bash[31385]: cluster 2021-03-10T15:42:03.968450+0000 mgr.gibba043.dnkmem (mgr.34373) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:05 gibba003 bash[32348]: cluster 2021-03-10T15:42:03.968450+0000 mgr.gibba043.dnkmem (mgr.34373) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:05 gibba043 bash[24019]: cluster 2021-03-10T15:42:03.968450+0000 mgr.gibba043.dnkmem (mgr.34373) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:07 gibba003 bash[31385]: cluster 2021-03-10T15:42:05.970294+0000 mgr.gibba043.dnkmem (mgr.34373) 5873 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:07 gibba003 bash[31385]: cephadm 2021-03-10T15:42:06.426558+0000 mgr.gibba043.dnkmem (mgr.34373) 5874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:07 gibba003 bash[32348]: cluster 2021-03-10T15:42:05.970294+0000 mgr.gibba043.dnkmem (mgr.34373) 5873 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:07 gibba003 bash[32348]: cephadm 2021-03-10T15:42:06.426558+0000 mgr.gibba043.dnkmem (mgr.34373) 5874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:07 gibba043 bash[24019]: cluster 2021-03-10T15:42:05.970294+0000 mgr.gibba043.dnkmem (mgr.34373) 5873 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:07 gibba043 bash[24019]: cephadm 2021-03-10T15:42:06.426558+0000 mgr.gibba043.dnkmem (mgr.34373) 5874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:09 gibba003 bash[31385]: cluster 2021-03-10T15:42:07.971835+0000 mgr.gibba043.dnkmem (mgr.34373) 5875 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:09 gibba003 bash[32348]: cluster 2021-03-10T15:42:07.971835+0000 mgr.gibba043.dnkmem (mgr.34373) 5875 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:09.482 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:42:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:09 gibba043 bash[24019]: cluster 2021-03-10T15:42:07.971835+0000 mgr.gibba043.dnkmem (mgr.34373) 5875 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:09.709 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:42:09.709 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (110m) 4m ago 115m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:42:09.710 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (115m) 3m ago 115m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:42:09.710 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (110m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:42:09.710 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (111m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:42:09.710 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:42:09.710 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:42:09.711 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:42:09.711 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (109m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:42:09.711 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (115m) 4m ago 116m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:42:09.711 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (115m) 3m ago 116m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:42:09.712 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (108m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:42:09.712 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:42:09.712 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:42:09.712 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:42:09.712 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:42:09.713 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:42:09.713 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:42:09.713 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (105m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:42:09.713 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (115m) 3m ago 116m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:42:09.713 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 113m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:42:09.958 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:42:09.958 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:42:09.959 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:09.959 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:42:09.959 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:42:09.959 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:09.960 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:42:09.960 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:42:09.960 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:42:09.960 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:42:09.960 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:42:09.961 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:42:09.961 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:42:09.961 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:42:09.961 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:42:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:10 gibba003 bash[31385]: audit 2021-03-10T15:42:09.469801+0000 mgr.gibba043.dnkmem (mgr.34373) 5876 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:10 gibba003 bash[31385]: audit 2021-03-10T15:42:09.956220+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.2.103:0/1232209289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:10 gibba003 bash[32348]: audit 2021-03-10T15:42:09.469801+0000 mgr.gibba043.dnkmem (mgr.34373) 5876 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:10 gibba003 bash[32348]: audit 2021-03-10T15:42:09.956220+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.2.103:0/1232209289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:10 gibba043 bash[24019]: audit 2021-03-10T15:42:09.469801+0000 mgr.gibba043.dnkmem (mgr.34373) 5876 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:10 gibba043 bash[24019]: audit 2021-03-10T15:42:09.956220+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.2.103:0/1232209289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:11 gibba003 bash[31385]: audit 2021-03-10T15:42:09.693777+0000 mgr.gibba043.dnkmem (mgr.34373) 5877 : audit [DBG] from='client.57988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:11.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:11 gibba003 bash[31385]: cluster 2021-03-10T15:42:09.973397+0000 mgr.gibba043.dnkmem (mgr.34373) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:11 gibba003 bash[32348]: audit 2021-03-10T15:42:09.693777+0000 mgr.gibba043.dnkmem (mgr.34373) 5877 : audit [DBG] from='client.57988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:11 gibba003 bash[32348]: cluster 2021-03-10T15:42:09.973397+0000 mgr.gibba043.dnkmem (mgr.34373) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:11 gibba043 bash[24019]: audit 2021-03-10T15:42:09.693777+0000 mgr.gibba043.dnkmem (mgr.34373) 5877 : audit [DBG] from='client.57988 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:11.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:11 gibba043 bash[24019]: cluster 2021-03-10T15:42:09.973397+0000 mgr.gibba043.dnkmem (mgr.34373) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:13 gibba003 bash[31385]: cluster 2021-03-10T15:42:11.974924+0000 mgr.gibba043.dnkmem (mgr.34373) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:13 gibba003 bash[32348]: cluster 2021-03-10T15:42:11.974924+0000 mgr.gibba043.dnkmem (mgr.34373) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:13 gibba043 bash[24019]: cluster 2021-03-10T15:42:11.974924+0000 mgr.gibba043.dnkmem (mgr.34373) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.426173+0000 mon.c (mon.1) 1529 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.427385+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.567897+0000 mon.c (mon.1) 1530 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.568999+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.677978+0000 mon.c (mon.1) 1531 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:42:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.678768+0000 mon.c (mon.1) 1532 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.679254+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:42:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.679515+0000 mon.c (mon.1) 1533 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:42:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.680444+0000 mon.c (mon.1) 1534 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.680499+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.681484+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:42:14.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[31385]: audit 2021-03-10T15:42:13.682521+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.426173+0000 mon.c (mon.1) 1529 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.427385+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.567897+0000 mon.c (mon.1) 1530 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.568999+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.677978+0000 mon.c (mon.1) 1531 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:42:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.678768+0000 mon.c (mon.1) 1532 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.679254+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:42:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.679515+0000 mon.c (mon.1) 1533 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:42:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.680444+0000 mon.c (mon.1) 1534 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.680499+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.681484+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:42:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:14 gibba003 bash[32348]: audit 2021-03-10T15:42:13.682521+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.426173+0000 mon.c (mon.1) 1529 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.427385+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.567897+0000 mon.c (mon.1) 1530 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.568999+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.677978+0000 mon.c (mon.1) 1531 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:42:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.678768+0000 mon.c (mon.1) 1532 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.679254+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:42:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.679515+0000 mon.c (mon.1) 1533 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:42:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.680444+0000 mon.c (mon.1) 1534 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.680499+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:42:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.681484+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:42:14.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:14 gibba043 bash[24019]: audit 2021-03-10T15:42:13.682521+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:42:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:15 gibba003 bash[31385]: cluster 2021-03-10T15:42:13.976680+0000 mgr.gibba043.dnkmem (mgr.34373) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:15 gibba003 bash[32348]: cluster 2021-03-10T15:42:13.976680+0000 mgr.gibba043.dnkmem (mgr.34373) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:15 gibba043 bash[24019]: cluster 2021-03-10T15:42:13.976680+0000 mgr.gibba043.dnkmem (mgr.34373) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:17 gibba003 bash[31385]: cluster 2021-03-10T15:42:15.978487+0000 mgr.gibba043.dnkmem (mgr.34373) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:17 gibba003 bash[32348]: cluster 2021-03-10T15:42:15.978487+0000 mgr.gibba043.dnkmem (mgr.34373) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:17 gibba043 bash[24019]: cluster 2021-03-10T15:42:15.978487+0000 mgr.gibba043.dnkmem (mgr.34373) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:19 gibba003 bash[31385]: cluster 2021-03-10T15:42:17.979853+0000 mgr.gibba043.dnkmem (mgr.34373) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:19 gibba003 bash[32348]: cluster 2021-03-10T15:42:17.979853+0000 mgr.gibba043.dnkmem (mgr.34373) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:19 gibba043 bash[24019]: cluster 2021-03-10T15:42:17.979853+0000 mgr.gibba043.dnkmem (mgr.34373) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:20 gibba003 bash[31385]: cluster 2021-03-10T15:42:19.980655+0000 mgr.gibba043.dnkmem (mgr.34373) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:20 gibba003 bash[32348]: cluster 2021-03-10T15:42:19.980655+0000 mgr.gibba043.dnkmem (mgr.34373) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:21.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:20 gibba043 bash[24019]: cluster 2021-03-10T15:42:19.980655+0000 mgr.gibba043.dnkmem (mgr.34373) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:22.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:21 gibba043 bash[24019]: cephadm 2021-03-10T15:42:21.442648+0000 mgr.gibba043.dnkmem (mgr.34373) 5884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:21 gibba003 bash[31385]: cephadm 2021-03-10T15:42:21.442648+0000 mgr.gibba043.dnkmem (mgr.34373) 5884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:21 gibba003 bash[32348]: cephadm 2021-03-10T15:42:21.442648+0000 mgr.gibba043.dnkmem (mgr.34373) 5884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:22 gibba043 bash[24019]: cluster 2021-03-10T15:42:21.981226+0000 mgr.gibba043.dnkmem (mgr.34373) 5885 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:22 gibba003 bash[31385]: cluster 2021-03-10T15:42:21.981226+0000 mgr.gibba043.dnkmem (mgr.34373) 5885 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:22 gibba003 bash[32348]: cluster 2021-03-10T15:42:21.981226+0000 mgr.gibba043.dnkmem (mgr.34373) 5885 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:25 gibba003 bash[31385]: cluster 2021-03-10T15:42:23.982494+0000 mgr.gibba043.dnkmem (mgr.34373) 5886 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:25 gibba003 bash[32348]: cluster 2021-03-10T15:42:23.982494+0000 mgr.gibba043.dnkmem (mgr.34373) 5886 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:25 gibba043 bash[24019]: cluster 2021-03-10T15:42:23.982494+0000 mgr.gibba043.dnkmem (mgr.34373) 5886 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:27 gibba003 bash[31385]: cluster 2021-03-10T15:42:25.984117+0000 mgr.gibba043.dnkmem (mgr.34373) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:27 gibba003 bash[32348]: cluster 2021-03-10T15:42:25.984117+0000 mgr.gibba043.dnkmem (mgr.34373) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:27 gibba043 bash[24019]: cluster 2021-03-10T15:42:25.984117+0000 mgr.gibba043.dnkmem (mgr.34373) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:29 gibba003 bash[31385]: cluster 2021-03-10T15:42:27.985294+0000 mgr.gibba043.dnkmem (mgr.34373) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:29 gibba003 bash[32348]: cluster 2021-03-10T15:42:27.985294+0000 mgr.gibba043.dnkmem (mgr.34373) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:29 gibba043 bash[24019]: cluster 2021-03-10T15:42:27.985294+0000 mgr.gibba043.dnkmem (mgr.34373) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:31.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:30 gibba043 bash[24019]: cluster 2021-03-10T15:42:29.986889+0000 mgr.gibba043.dnkmem (mgr.34373) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:30 gibba003 bash[31385]: cluster 2021-03-10T15:42:29.986889+0000 mgr.gibba043.dnkmem (mgr.34373) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:30 gibba003 bash[32348]: cluster 2021-03-10T15:42:29.986889+0000 mgr.gibba043.dnkmem (mgr.34373) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:33 gibba003 bash[31385]: cluster 2021-03-10T15:42:31.988556+0000 mgr.gibba043.dnkmem (mgr.34373) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:33 gibba003 bash[32348]: cluster 2021-03-10T15:42:31.988556+0000 mgr.gibba043.dnkmem (mgr.34373) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:33 gibba043 bash[24019]: cluster 2021-03-10T15:42:31.988556+0000 mgr.gibba043.dnkmem (mgr.34373) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:35 gibba003 bash[31385]: cluster 2021-03-10T15:42:33.989955+0000 mgr.gibba043.dnkmem (mgr.34373) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:35 gibba003 bash[32348]: cluster 2021-03-10T15:42:33.989955+0000 mgr.gibba043.dnkmem (mgr.34373) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:35 gibba043 bash[24019]: cluster 2021-03-10T15:42:33.989955+0000 mgr.gibba043.dnkmem (mgr.34373) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: cluster 2021-03-10T15:42:35.991838+0000 mgr.gibba043.dnkmem (mgr.34373) 5892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.456075+0000 mgr.gibba043.dnkmem (mgr.34373) 5893 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:42:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.456404+0000 mgr.gibba043.dnkmem (mgr.34373) 5894 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:42:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.663014+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:42:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.666988+0000 mon.c (mon.1) 1535 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.668621+0000 mon.c (mon.1) 1536 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.669707+0000 mon.c (mon.1) 1537 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.670704+0000 mon.c (mon.1) 1538 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.673657+0000 mon.c (mon.1) 1539 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[31385]: audit 2021-03-10T15:42:36.675374+0000 mon.c (mon.1) 1540 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: cluster 2021-03-10T15:42:35.991838+0000 mgr.gibba043.dnkmem (mgr.34373) 5892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.456075+0000 mgr.gibba043.dnkmem (mgr.34373) 5893 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:42:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.456404+0000 mgr.gibba043.dnkmem (mgr.34373) 5894 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:42:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.663014+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:42:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.666988+0000 mon.c (mon.1) 1535 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.668621+0000 mon.c (mon.1) 1536 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.669707+0000 mon.c (mon.1) 1537 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.670704+0000 mon.c (mon.1) 1538 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.673657+0000 mon.c (mon.1) 1539 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:37 gibba003 bash[32348]: audit 2021-03-10T15:42:36.675374+0000 mon.c (mon.1) 1540 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: cluster 2021-03-10T15:42:35.991838+0000 mgr.gibba043.dnkmem (mgr.34373) 5892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.456075+0000 mgr.gibba043.dnkmem (mgr.34373) 5893 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:42:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.456404+0000 mgr.gibba043.dnkmem (mgr.34373) 5894 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:42:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.663014+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:42:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.666988+0000 mon.c (mon.1) 1535 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.668621+0000 mon.c (mon.1) 1536 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.669707+0000 mon.c (mon.1) 1537 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.670704+0000 mon.c (mon.1) 1538 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.673657+0000 mon.c (mon.1) 1539 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:37.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:37 gibba043 bash[24019]: audit 2021-03-10T15:42:36.675374+0000 mon.c (mon.1) 1540 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.663851+0000 mgr.gibba043.dnkmem (mgr.34373) 5895 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.665997+0000 mgr.gibba043.dnkmem (mgr.34373) 5896 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.667215+0000 mgr.gibba043.dnkmem (mgr.34373) 5897 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.667254+0000 mgr.gibba043.dnkmem (mgr.34373) 5898 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.668282+0000 mgr.gibba043.dnkmem (mgr.34373) 5899 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.668318+0000 mgr.gibba043.dnkmem (mgr.34373) 5900 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.669291+0000 mgr.gibba043.dnkmem (mgr.34373) 5901 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.670913+0000 mgr.gibba043.dnkmem (mgr.34373) 5902 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.670950+0000 mgr.gibba043.dnkmem (mgr.34373) 5903 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.672636+0000 mgr.gibba043.dnkmem (mgr.34373) 5904 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.672953+0000 mgr.gibba043.dnkmem (mgr.34373) 5905 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.674339+0000 mgr.gibba043.dnkmem (mgr.34373) 5906 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.674378+0000 mgr.gibba043.dnkmem (mgr.34373) 5907 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[31385]: cephadm 2021-03-10T15:42:36.674483+0000 mgr.gibba043.dnkmem (mgr.34373) 5908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.663851+0000 mgr.gibba043.dnkmem (mgr.34373) 5895 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.665997+0000 mgr.gibba043.dnkmem (mgr.34373) 5896 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.667215+0000 mgr.gibba043.dnkmem (mgr.34373) 5897 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.667254+0000 mgr.gibba043.dnkmem (mgr.34373) 5898 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.668282+0000 mgr.gibba043.dnkmem (mgr.34373) 5899 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.668318+0000 mgr.gibba043.dnkmem (mgr.34373) 5900 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.669291+0000 mgr.gibba043.dnkmem (mgr.34373) 5901 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.670913+0000 mgr.gibba043.dnkmem (mgr.34373) 5902 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.670950+0000 mgr.gibba043.dnkmem (mgr.34373) 5903 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.672636+0000 mgr.gibba043.dnkmem (mgr.34373) 5904 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.672953+0000 mgr.gibba043.dnkmem (mgr.34373) 5905 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.674339+0000 mgr.gibba043.dnkmem (mgr.34373) 5906 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.674378+0000 mgr.gibba043.dnkmem (mgr.34373) 5907 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:38 gibba003 bash[32348]: cephadm 2021-03-10T15:42:36.674483+0000 mgr.gibba043.dnkmem (mgr.34373) 5908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.663851+0000 mgr.gibba043.dnkmem (mgr.34373) 5895 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.665997+0000 mgr.gibba043.dnkmem (mgr.34373) 5896 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.667215+0000 mgr.gibba043.dnkmem (mgr.34373) 5897 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.667254+0000 mgr.gibba043.dnkmem (mgr.34373) 5898 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.668282+0000 mgr.gibba043.dnkmem (mgr.34373) 5899 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.668318+0000 mgr.gibba043.dnkmem (mgr.34373) 5900 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.669291+0000 mgr.gibba043.dnkmem (mgr.34373) 5901 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.670913+0000 mgr.gibba043.dnkmem (mgr.34373) 5902 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.670950+0000 mgr.gibba043.dnkmem (mgr.34373) 5903 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.672636+0000 mgr.gibba043.dnkmem (mgr.34373) 5904 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.672953+0000 mgr.gibba043.dnkmem (mgr.34373) 5905 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.674339+0000 mgr.gibba043.dnkmem (mgr.34373) 5906 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.674378+0000 mgr.gibba043.dnkmem (mgr.34373) 5907 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:38 gibba043 bash[24019]: cephadm 2021-03-10T15:42:36.674483+0000 mgr.gibba043.dnkmem (mgr.34373) 5908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:39 gibba003 bash[31385]: cluster 2021-03-10T15:42:37.993138+0000 mgr.gibba043.dnkmem (mgr.34373) 5909 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:39 gibba003 bash[32348]: cluster 2021-03-10T15:42:37.993138+0000 mgr.gibba043.dnkmem (mgr.34373) 5909 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:39 gibba043 bash[24019]: cluster 2021-03-10T15:42:37.993138+0000 mgr.gibba043.dnkmem (mgr.34373) 5909 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:40.199 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:42:40.427 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:42:40.427 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (111m) 5m ago 116m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:42:40.427 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (116m) 4m ago 116m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:42:40.427 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (111m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:42:40.428 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (111m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:42:40.428 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:42:40.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:42:40.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:42:40.429 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:42:40.429 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (116m) 5m ago 116m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:42:40.429 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (116m) 4m ago 116m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:42:40.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:42:40.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:42:40.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:42:40.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:42:40.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:42:40.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:42:40.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:42:40.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (106m) 4m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:42:40.431 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (115m) 4m ago 116m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:42:40.431 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 114m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:42:40.673 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:42:40.674 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:42:40.674 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:40.674 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:42:40.674 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:42:40.675 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:40.675 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:42:40.675 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:42:40.675 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:42:40.676 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:42:40.676 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:42:40.676 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:42:40.676 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:42:40.677 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:42:40.677 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:42:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:40 gibba043 bash[24019]: cluster 2021-03-10T15:42:39.994489+0000 mgr.gibba043.dnkmem (mgr.34373) 5910 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:40 gibba043 bash[24019]: audit 2021-03-10T15:42:40.187000+0000 mgr.gibba043.dnkmem (mgr.34373) 5911 : audit [DBG] from='client.48012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:40 gibba043 bash[24019]: audit 2021-03-10T15:42:40.411056+0000 mgr.gibba043.dnkmem (mgr.34373) 5912 : audit [DBG] from='client.58006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:40 gibba043 bash[24019]: audit 2021-03-10T15:42:40.672443+0000 mon.a (mon.0) 1391 : audit [DBG] from='client.? 172.21.2.103:0/4180840975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[31385]: cluster 2021-03-10T15:42:39.994489+0000 mgr.gibba043.dnkmem (mgr.34373) 5910 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[31385]: audit 2021-03-10T15:42:40.187000+0000 mgr.gibba043.dnkmem (mgr.34373) 5911 : audit [DBG] from='client.48012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[31385]: audit 2021-03-10T15:42:40.411056+0000 mgr.gibba043.dnkmem (mgr.34373) 5912 : audit [DBG] from='client.58006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:41.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[31385]: audit 2021-03-10T15:42:40.672443+0000 mon.a (mon.0) 1391 : audit [DBG] from='client.? 172.21.2.103:0/4180840975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[32348]: cluster 2021-03-10T15:42:39.994489+0000 mgr.gibba043.dnkmem (mgr.34373) 5910 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[32348]: audit 2021-03-10T15:42:40.187000+0000 mgr.gibba043.dnkmem (mgr.34373) 5911 : audit [DBG] from='client.48012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:41.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[32348]: audit 2021-03-10T15:42:40.411056+0000 mgr.gibba043.dnkmem (mgr.34373) 5912 : audit [DBG] from='client.58006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:41.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:40 gibba003 bash[32348]: audit 2021-03-10T15:42:40.672443+0000 mon.a (mon.0) 1391 : audit [DBG] from='client.? 172.21.2.103:0/4180840975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:43 gibba003 bash[31385]: cluster 2021-03-10T15:42:41.995956+0000 mgr.gibba043.dnkmem (mgr.34373) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:43 gibba003 bash[32348]: cluster 2021-03-10T15:42:41.995956+0000 mgr.gibba043.dnkmem (mgr.34373) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:43 gibba043 bash[24019]: cluster 2021-03-10T15:42:41.995956+0000 mgr.gibba043.dnkmem (mgr.34373) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:45 gibba003 bash[31385]: cluster 2021-03-10T15:42:43.997589+0000 mgr.gibba043.dnkmem (mgr.34373) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:45 gibba003 bash[32348]: cluster 2021-03-10T15:42:43.997589+0000 mgr.gibba043.dnkmem (mgr.34373) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:45 gibba043 bash[24019]: cluster 2021-03-10T15:42:43.997589+0000 mgr.gibba043.dnkmem (mgr.34373) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:47 gibba003 bash[31385]: cluster 2021-03-10T15:42:45.999276+0000 mgr.gibba043.dnkmem (mgr.34373) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:47 gibba003 bash[32348]: cluster 2021-03-10T15:42:45.999276+0000 mgr.gibba043.dnkmem (mgr.34373) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:47 gibba043 bash[24019]: cluster 2021-03-10T15:42:45.999276+0000 mgr.gibba043.dnkmem (mgr.34373) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:49 gibba003 bash[31385]: cluster 2021-03-10T15:42:48.000903+0000 mgr.gibba043.dnkmem (mgr.34373) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:49 gibba003 bash[32348]: cluster 2021-03-10T15:42:48.000903+0000 mgr.gibba043.dnkmem (mgr.34373) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:49 gibba043 bash[24019]: cluster 2021-03-10T15:42:48.000903+0000 mgr.gibba043.dnkmem (mgr.34373) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:50 gibba043 bash[24019]: cluster 2021-03-10T15:42:50.001577+0000 mgr.gibba043.dnkmem (mgr.34373) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:51.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:50 gibba003 bash[31385]: cluster 2021-03-10T15:42:50.001577+0000 mgr.gibba043.dnkmem (mgr.34373) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:51.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:50 gibba003 bash[32348]: cluster 2021-03-10T15:42:50.001577+0000 mgr.gibba043.dnkmem (mgr.34373) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:53 gibba003 bash[31385]: cephadm 2021-03-10T15:42:51.690174+0000 mgr.gibba043.dnkmem (mgr.34373) 5918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:53 gibba003 bash[31385]: cluster 2021-03-10T15:42:52.002973+0000 mgr.gibba043.dnkmem (mgr.34373) 5919 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:53 gibba003 bash[32348]: cephadm 2021-03-10T15:42:51.690174+0000 mgr.gibba043.dnkmem (mgr.34373) 5918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:53 gibba003 bash[32348]: cluster 2021-03-10T15:42:52.002973+0000 mgr.gibba043.dnkmem (mgr.34373) 5919 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:53 gibba043 bash[24019]: cephadm 2021-03-10T15:42:51.690174+0000 mgr.gibba043.dnkmem (mgr.34373) 5918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:42:53.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:53 gibba043 bash[24019]: cluster 2021-03-10T15:42:52.002973+0000 mgr.gibba043.dnkmem (mgr.34373) 5919 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:55 gibba003 bash[31385]: cluster 2021-03-10T15:42:54.004573+0000 mgr.gibba043.dnkmem (mgr.34373) 5920 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:55 gibba003 bash[32348]: cluster 2021-03-10T15:42:54.004573+0000 mgr.gibba043.dnkmem (mgr.34373) 5920 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:55 gibba043 bash[24019]: cluster 2021-03-10T15:42:54.004573+0000 mgr.gibba043.dnkmem (mgr.34373) 5920 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:57 gibba003 bash[31385]: cluster 2021-03-10T15:42:56.006379+0000 mgr.gibba043.dnkmem (mgr.34373) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:57 gibba003 bash[32348]: cluster 2021-03-10T15:42:56.006379+0000 mgr.gibba043.dnkmem (mgr.34373) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:57 gibba043 bash[24019]: cluster 2021-03-10T15:42:56.006379+0000 mgr.gibba043.dnkmem (mgr.34373) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:42:59 gibba003 bash[31385]: cluster 2021-03-10T15:42:58.007745+0000 mgr.gibba043.dnkmem (mgr.34373) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:42:59 gibba003 bash[32348]: cluster 2021-03-10T15:42:58.007745+0000 mgr.gibba043.dnkmem (mgr.34373) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:42:59 gibba043 bash[24019]: cluster 2021-03-10T15:42:58.007745+0000 mgr.gibba043.dnkmem (mgr.34373) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:00 gibba043 bash[24019]: cluster 2021-03-10T15:43:00.008212+0000 mgr.gibba043.dnkmem (mgr.34373) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:00 gibba003 bash[31385]: cluster 2021-03-10T15:43:00.008212+0000 mgr.gibba043.dnkmem (mgr.34373) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:00 gibba003 bash[32348]: cluster 2021-03-10T15:43:00.008212+0000 mgr.gibba043.dnkmem (mgr.34373) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:03 gibba003 bash[31385]: cluster 2021-03-10T15:43:02.009761+0000 mgr.gibba043.dnkmem (mgr.34373) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:03 gibba003 bash[32348]: cluster 2021-03-10T15:43:02.009761+0000 mgr.gibba043.dnkmem (mgr.34373) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:03 gibba043 bash[24019]: cluster 2021-03-10T15:43:02.009761+0000 mgr.gibba043.dnkmem (mgr.34373) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:05 gibba003 bash[31385]: cluster 2021-03-10T15:43:04.011378+0000 mgr.gibba043.dnkmem (mgr.34373) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:05 gibba003 bash[32348]: cluster 2021-03-10T15:43:04.011378+0000 mgr.gibba043.dnkmem (mgr.34373) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:05 gibba043 bash[24019]: cluster 2021-03-10T15:43:04.011378+0000 mgr.gibba043.dnkmem (mgr.34373) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:07 gibba003 bash[31385]: cluster 2021-03-10T15:43:06.012966+0000 mgr.gibba043.dnkmem (mgr.34373) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:07 gibba003 bash[32348]: cluster 2021-03-10T15:43:06.012966+0000 mgr.gibba043.dnkmem (mgr.34373) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:07 gibba043 bash[24019]: cluster 2021-03-10T15:43:06.012966+0000 mgr.gibba043.dnkmem (mgr.34373) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:08 gibba003 bash[31385]: cephadm 2021-03-10T15:43:06.705881+0000 mgr.gibba043.dnkmem (mgr.34373) 5927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:08 gibba003 bash[32348]: cephadm 2021-03-10T15:43:06.705881+0000 mgr.gibba043.dnkmem (mgr.34373) 5927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:08 gibba043 bash[24019]: cephadm 2021-03-10T15:43:06.705881+0000 mgr.gibba043.dnkmem (mgr.34373) 5927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:09 gibba003 bash[31385]: cluster 2021-03-10T15:43:08.014438+0000 mgr.gibba043.dnkmem (mgr.34373) 5928 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:09 gibba003 bash[32348]: cluster 2021-03-10T15:43:08.014438+0000 mgr.gibba043.dnkmem (mgr.34373) 5928 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:09 gibba043 bash[24019]: cluster 2021-03-10T15:43:08.014438+0000 mgr.gibba043.dnkmem (mgr.34373) 5928 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:10.916 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:43:11.145 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:43:11.146 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (111m) 5m ago 116m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:43:11.146 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (116m) 4m ago 116m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:43:11.146 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (111m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:43:11.147 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (112m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:43:11.147 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:43:11.147 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:43:11.147 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:43:11.148 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:43:11.148 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (116m) 5m ago 117m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:43:11.148 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (117m) 4m ago 117m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:43:11.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (109m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:43:11.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:43:11.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:43:11.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:43:11.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:43:11.150 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:43:11.150 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:43:11.150 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:43:11.150 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (116m) 4m ago 117m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:43:11.151 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 115m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:43:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:10 gibba043 bash[24019]: cluster 2021-03-10T15:43:10.015801+0000 mgr.gibba043.dnkmem (mgr.34373) 5929 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:11.392 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:43:11.392 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:43:11.392 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:11.393 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:43:11.393 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:43:11.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:11.394 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:43:11.394 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:43:11.394 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:43:11.394 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:43:11.395 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:43:11.395 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:43:11.395 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:43:11.395 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:43:11.396 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:43:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:10 gibba003 bash[31385]: cluster 2021-03-10T15:43:10.015801+0000 mgr.gibba043.dnkmem (mgr.34373) 5929 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:10 gibba003 bash[32348]: cluster 2021-03-10T15:43:10.015801+0000 mgr.gibba043.dnkmem (mgr.34373) 5929 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:12.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:11 gibba043 bash[24019]: audit 2021-03-10T15:43:10.903459+0000 mgr.gibba043.dnkmem (mgr.34373) 5930 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:11 gibba043 bash[24019]: audit 2021-03-10T15:43:11.132228+0000 mgr.gibba043.dnkmem (mgr.34373) 5931 : audit [DBG] from='client.48036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:12.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:11 gibba043 bash[24019]: audit 2021-03-10T15:43:11.391271+0000 mon.a (mon.0) 1392 : audit [DBG] from='client.? 172.21.2.103:0/712587198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:12.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:11 gibba003 bash[31385]: audit 2021-03-10T15:43:10.903459+0000 mgr.gibba043.dnkmem (mgr.34373) 5930 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:12.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:11 gibba003 bash[31385]: audit 2021-03-10T15:43:11.132228+0000 mgr.gibba043.dnkmem (mgr.34373) 5931 : audit [DBG] from='client.48036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:12.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:11 gibba003 bash[31385]: audit 2021-03-10T15:43:11.391271+0000 mon.a (mon.0) 1392 : audit [DBG] from='client.? 172.21.2.103:0/712587198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:11 gibba003 bash[32348]: audit 2021-03-10T15:43:10.903459+0000 mgr.gibba043.dnkmem (mgr.34373) 5930 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:11 gibba003 bash[32348]: audit 2021-03-10T15:43:11.132228+0000 mgr.gibba043.dnkmem (mgr.34373) 5931 : audit [DBG] from='client.48036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:12.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:11 gibba003 bash[32348]: audit 2021-03-10T15:43:11.391271+0000 mon.a (mon.0) 1392 : audit [DBG] from='client.? 172.21.2.103:0/712587198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:12 gibba043 bash[24019]: cluster 2021-03-10T15:43:12.016548+0000 mgr.gibba043.dnkmem (mgr.34373) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:12 gibba003 bash[31385]: cluster 2021-03-10T15:43:12.016548+0000 mgr.gibba043.dnkmem (mgr.34373) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:12 gibba003 bash[32348]: cluster 2021-03-10T15:43:12.016548+0000 mgr.gibba043.dnkmem (mgr.34373) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.432899+0000 mon.c (mon.1) 1541 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.433990+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.576063+0000 mon.c (mon.1) 1542 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.577173+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.688559+0000 mon.c (mon.1) 1543 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:43:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.689436+0000 mon.c (mon.1) 1544 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:43:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.689788+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:43:14.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.690330+0000 mon.c (mon.1) 1545 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.691001+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:43:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.691511+0000 mon.c (mon.1) 1546 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.692027+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:13 gibba043 bash[24019]: audit 2021-03-10T15:43:13.692808+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.432899+0000 mon.c (mon.1) 1541 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.433990+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.576063+0000 mon.c (mon.1) 1542 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.577173+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.688559+0000 mon.c (mon.1) 1543 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:43:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.689436+0000 mon.c (mon.1) 1544 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:43:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.689788+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:43:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.690330+0000 mon.c (mon.1) 1545 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.691001+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:43:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.691511+0000 mon.c (mon.1) 1546 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.692027+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[31385]: audit 2021-03-10T15:43:13.692808+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.432899+0000 mon.c (mon.1) 1541 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.433990+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.576063+0000 mon.c (mon.1) 1542 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.577173+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.688559+0000 mon.c (mon.1) 1543 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:43:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.689436+0000 mon.c (mon.1) 1544 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:43:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.689788+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:43:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.690330+0000 mon.c (mon.1) 1545 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.691001+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:43:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.691511+0000 mon.c (mon.1) 1546 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.692027+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:43:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:13 gibba003 bash[32348]: audit 2021-03-10T15:43:13.692808+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:14 gibba043 bash[24019]: cluster 2021-03-10T15:43:14.017022+0000 mgr.gibba043.dnkmem (mgr.34373) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:14 gibba003 bash[31385]: cluster 2021-03-10T15:43:14.017022+0000 mgr.gibba043.dnkmem (mgr.34373) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:14 gibba003 bash[32348]: cluster 2021-03-10T15:43:14.017022+0000 mgr.gibba043.dnkmem (mgr.34373) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:17 gibba003 bash[31385]: cluster 2021-03-10T15:43:16.018629+0000 mgr.gibba043.dnkmem (mgr.34373) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:17 gibba003 bash[32348]: cluster 2021-03-10T15:43:16.018629+0000 mgr.gibba043.dnkmem (mgr.34373) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:17 gibba043 bash[24019]: cluster 2021-03-10T15:43:16.018629+0000 mgr.gibba043.dnkmem (mgr.34373) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:19 gibba003 bash[31385]: cluster 2021-03-10T15:43:18.020232+0000 mgr.gibba043.dnkmem (mgr.34373) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:19 gibba003 bash[32348]: cluster 2021-03-10T15:43:18.020232+0000 mgr.gibba043.dnkmem (mgr.34373) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:19 gibba043 bash[24019]: cluster 2021-03-10T15:43:18.020232+0000 mgr.gibba043.dnkmem (mgr.34373) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:20 gibba043 bash[24019]: cluster 2021-03-10T15:43:20.020969+0000 mgr.gibba043.dnkmem (mgr.34373) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:20 gibba003 bash[31385]: cluster 2021-03-10T15:43:20.020969+0000 mgr.gibba043.dnkmem (mgr.34373) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:21.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:20 gibba003 bash[32348]: cluster 2021-03-10T15:43:20.020969+0000 mgr.gibba043.dnkmem (mgr.34373) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:23 gibba003 bash[31385]: cephadm 2021-03-10T15:43:21.721798+0000 mgr.gibba043.dnkmem (mgr.34373) 5937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:23 gibba003 bash[31385]: cluster 2021-03-10T15:43:22.022175+0000 mgr.gibba043.dnkmem (mgr.34373) 5938 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:23 gibba003 bash[32348]: cephadm 2021-03-10T15:43:21.721798+0000 mgr.gibba043.dnkmem (mgr.34373) 5937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:23 gibba003 bash[32348]: cluster 2021-03-10T15:43:22.022175+0000 mgr.gibba043.dnkmem (mgr.34373) 5938 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:23 gibba043 bash[24019]: cephadm 2021-03-10T15:43:21.721798+0000 mgr.gibba043.dnkmem (mgr.34373) 5937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:23 gibba043 bash[24019]: cluster 2021-03-10T15:43:22.022175+0000 mgr.gibba043.dnkmem (mgr.34373) 5938 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:25 gibba003 bash[31385]: cluster 2021-03-10T15:43:24.023620+0000 mgr.gibba043.dnkmem (mgr.34373) 5939 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:25.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:25 gibba003 bash[32348]: cluster 2021-03-10T15:43:24.023620+0000 mgr.gibba043.dnkmem (mgr.34373) 5939 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:25 gibba043 bash[24019]: cluster 2021-03-10T15:43:24.023620+0000 mgr.gibba043.dnkmem (mgr.34373) 5939 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:27 gibba003 bash[31385]: cluster 2021-03-10T15:43:26.025400+0000 mgr.gibba043.dnkmem (mgr.34373) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:27 gibba003 bash[32348]: cluster 2021-03-10T15:43:26.025400+0000 mgr.gibba043.dnkmem (mgr.34373) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:27 gibba043 bash[24019]: cluster 2021-03-10T15:43:26.025400+0000 mgr.gibba043.dnkmem (mgr.34373) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:29 gibba003 bash[31385]: cluster 2021-03-10T15:43:28.026889+0000 mgr.gibba043.dnkmem (mgr.34373) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:29 gibba003 bash[32348]: cluster 2021-03-10T15:43:28.026889+0000 mgr.gibba043.dnkmem (mgr.34373) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:29 gibba043 bash[24019]: cluster 2021-03-10T15:43:28.026889+0000 mgr.gibba043.dnkmem (mgr.34373) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:30 gibba043 bash[24019]: cluster 2021-03-10T15:43:30.027927+0000 mgr.gibba043.dnkmem (mgr.34373) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:30 gibba003 bash[32348]: cluster 2021-03-10T15:43:30.027927+0000 mgr.gibba043.dnkmem (mgr.34373) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:30 gibba003 bash[31385]: cluster 2021-03-10T15:43:30.027927+0000 mgr.gibba043.dnkmem (mgr.34373) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:33 gibba003 bash[31385]: cluster 2021-03-10T15:43:32.029508+0000 mgr.gibba043.dnkmem (mgr.34373) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:33 gibba003 bash[32348]: cluster 2021-03-10T15:43:32.029508+0000 mgr.gibba043.dnkmem (mgr.34373) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:33 gibba043 bash[24019]: cluster 2021-03-10T15:43:32.029508+0000 mgr.gibba043.dnkmem (mgr.34373) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:35 gibba003 bash[31385]: cluster 2021-03-10T15:43:34.030836+0000 mgr.gibba043.dnkmem (mgr.34373) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:35.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:35 gibba003 bash[32348]: cluster 2021-03-10T15:43:34.030836+0000 mgr.gibba043.dnkmem (mgr.34373) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:35 gibba043 bash[24019]: cluster 2021-03-10T15:43:34.030836+0000 mgr.gibba043.dnkmem (mgr.34373) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: cluster 2021-03-10T15:43:36.032562+0000 mgr.gibba043.dnkmem (mgr.34373) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.964078+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:43:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.967907+0000 mon.c (mon.1) 1547 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.969496+0000 mon.c (mon.1) 1548 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.970643+0000 mon.c (mon.1) 1549 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.971827+0000 mon.c (mon.1) 1550 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.974632+0000 mon.c (mon.1) 1551 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:37 gibba043 bash[24019]: audit 2021-03-10T15:43:36.976057+0000 mon.c (mon.1) 1552 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: cluster 2021-03-10T15:43:36.032562+0000 mgr.gibba043.dnkmem (mgr.34373) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.964078+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:43:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.967907+0000 mon.c (mon.1) 1547 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.969496+0000 mon.c (mon.1) 1548 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.970643+0000 mon.c (mon.1) 1549 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.971827+0000 mon.c (mon.1) 1550 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.974632+0000 mon.c (mon.1) 1551 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[31385]: audit 2021-03-10T15:43:36.976057+0000 mon.c (mon.1) 1552 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: cluster 2021-03-10T15:43:36.032562+0000 mgr.gibba043.dnkmem (mgr.34373) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.964078+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:43:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.967907+0000 mon.c (mon.1) 1547 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.969496+0000 mon.c (mon.1) 1548 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.970643+0000 mon.c (mon.1) 1549 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.971827+0000 mon.c (mon.1) 1550 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.974632+0000 mon.c (mon.1) 1551 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:37.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:37 gibba003 bash[32348]: audit 2021-03-10T15:43:36.976057+0000 mon.c (mon.1) 1552 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.737414+0000 mgr.gibba043.dnkmem (mgr.34373) 5946 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:43:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.738933+0000 mgr.gibba043.dnkmem (mgr.34373) 5947 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:43:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.964946+0000 mgr.gibba043.dnkmem (mgr.34373) 5948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.966892+0000 mgr.gibba043.dnkmem (mgr.34373) 5949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:38.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.968181+0000 mgr.gibba043.dnkmem (mgr.34373) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.968226+0000 mgr.gibba043.dnkmem (mgr.34373) 5951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.969281+0000 mgr.gibba043.dnkmem (mgr.34373) 5952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.969323+0000 mgr.gibba043.dnkmem (mgr.34373) 5953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:38.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.970434+0000 mgr.gibba043.dnkmem (mgr.34373) 5954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.971978+0000 mgr.gibba043.dnkmem (mgr.34373) 5955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.972023+0000 mgr.gibba043.dnkmem (mgr.34373) 5956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.973190+0000 mgr.gibba043.dnkmem (mgr.34373) 5957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.973503+0000 mgr.gibba043.dnkmem (mgr.34373) 5958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:38.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.974632+0000 mgr.gibba043.dnkmem (mgr.34373) 5959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.974676+0000 mgr.gibba043.dnkmem (mgr.34373) 5960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:38.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[31385]: cephadm 2021-03-10T15:43:36.974788+0000 mgr.gibba043.dnkmem (mgr.34373) 5961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:38.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.737414+0000 mgr.gibba043.dnkmem (mgr.34373) 5946 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:43:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.738933+0000 mgr.gibba043.dnkmem (mgr.34373) 5947 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:43:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.964946+0000 mgr.gibba043.dnkmem (mgr.34373) 5948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.966892+0000 mgr.gibba043.dnkmem (mgr.34373) 5949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.968181+0000 mgr.gibba043.dnkmem (mgr.34373) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:38.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.968226+0000 mgr.gibba043.dnkmem (mgr.34373) 5951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.969281+0000 mgr.gibba043.dnkmem (mgr.34373) 5952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.969323+0000 mgr.gibba043.dnkmem (mgr.34373) 5953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.970434+0000 mgr.gibba043.dnkmem (mgr.34373) 5954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:38.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.971978+0000 mgr.gibba043.dnkmem (mgr.34373) 5955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.972023+0000 mgr.gibba043.dnkmem (mgr.34373) 5956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.973190+0000 mgr.gibba043.dnkmem (mgr.34373) 5957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.973503+0000 mgr.gibba043.dnkmem (mgr.34373) 5958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.974632+0000 mgr.gibba043.dnkmem (mgr.34373) 5959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:38.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.974676+0000 mgr.gibba043.dnkmem (mgr.34373) 5960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:38.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:38 gibba003 bash[32348]: cephadm 2021-03-10T15:43:36.974788+0000 mgr.gibba043.dnkmem (mgr.34373) 5961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.737414+0000 mgr.gibba043.dnkmem (mgr.34373) 5946 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:43:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.738933+0000 mgr.gibba043.dnkmem (mgr.34373) 5947 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:43:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.964946+0000 mgr.gibba043.dnkmem (mgr.34373) 5948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.966892+0000 mgr.gibba043.dnkmem (mgr.34373) 5949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.968181+0000 mgr.gibba043.dnkmem (mgr.34373) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.968226+0000 mgr.gibba043.dnkmem (mgr.34373) 5951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.969281+0000 mgr.gibba043.dnkmem (mgr.34373) 5952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.969323+0000 mgr.gibba043.dnkmem (mgr.34373) 5953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.970434+0000 mgr.gibba043.dnkmem (mgr.34373) 5954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.971978+0000 mgr.gibba043.dnkmem (mgr.34373) 5955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.972023+0000 mgr.gibba043.dnkmem (mgr.34373) 5956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.973190+0000 mgr.gibba043.dnkmem (mgr.34373) 5957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.973503+0000 mgr.gibba043.dnkmem (mgr.34373) 5958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.974632+0000 mgr.gibba043.dnkmem (mgr.34373) 5959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.974676+0000 mgr.gibba043.dnkmem (mgr.34373) 5960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:38 gibba043 bash[24019]: cephadm 2021-03-10T15:43:36.974788+0000 mgr.gibba043.dnkmem (mgr.34373) 5961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:39 gibba003 bash[31385]: cluster 2021-03-10T15:43:38.033891+0000 mgr.gibba043.dnkmem (mgr.34373) 5962 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:39 gibba003 bash[32348]: cluster 2021-03-10T15:43:38.033891+0000 mgr.gibba043.dnkmem (mgr.34373) 5962 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:39 gibba043 bash[24019]: cluster 2021-03-10T15:43:38.033891+0000 mgr.gibba043.dnkmem (mgr.34373) 5962 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:40 gibba043 bash[24019]: cluster 2021-03-10T15:43:40.034644+0000 mgr.gibba043.dnkmem (mgr.34373) 5963 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:40 gibba003 bash[31385]: cluster 2021-03-10T15:43:40.034644+0000 mgr.gibba043.dnkmem (mgr.34373) 5963 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:40 gibba003 bash[32348]: cluster 2021-03-10T15:43:40.034644+0000 mgr.gibba043.dnkmem (mgr.34373) 5963 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.642 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:43:41.871 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:43:41.871 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (112m) 6m ago 117m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:43:41.872 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (117m) 5m ago 117m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:43:41.872 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:43:41.873 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:43:41.873 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:43:41.874 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:43:41.874 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:43:41.874 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:43:41.875 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (117m) 6m ago 117m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:43:41.875 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (117m) 5m ago 117m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:43:41.876 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:43:41.876 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:43:41.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:43:41.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:43:41.877 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:43:41.878 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:43:41.878 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (107m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:43:41.879 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (107m) 5m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:43:41.879 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (116m) 5m ago 117m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:43:41.880 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 115m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:43:42.123 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:43:42.124 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:43:42.124 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:42.124 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:43:42.125 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:43:42.125 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:42.125 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:43:42.125 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:43:42.126 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:43:42.126 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:43:42.126 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:43:42.126 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:43:42.127 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:43:42.127 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:43:42.127 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:43:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:41 gibba043 bash[24019]: audit 2021-03-10T15:43:41.630224+0000 mgr.gibba043.dnkmem (mgr.34373) 5964 : audit [DBG] from='client.58036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:41 gibba003 bash[31385]: audit 2021-03-10T15:43:41.630224+0000 mgr.gibba043.dnkmem (mgr.34373) 5964 : audit [DBG] from='client.58036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:41 gibba003 bash[32348]: audit 2021-03-10T15:43:41.630224+0000 mgr.gibba043.dnkmem (mgr.34373) 5964 : audit [DBG] from='client.58036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:43 gibba043 bash[24019]: audit 2021-03-10T15:43:41.855819+0000 mgr.gibba043.dnkmem (mgr.34373) 5965 : audit [DBG] from='client.58042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:43 gibba043 bash[24019]: cluster 2021-03-10T15:43:42.035403+0000 mgr.gibba043.dnkmem (mgr.34373) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:43.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:43 gibba043 bash[24019]: audit 2021-03-10T15:43:42.122954+0000 mon.a (mon.0) 1400 : audit [DBG] from='client.? 172.21.2.103:0/4142136021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:43 gibba003 bash[31385]: audit 2021-03-10T15:43:41.855819+0000 mgr.gibba043.dnkmem (mgr.34373) 5965 : audit [DBG] from='client.58042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:43 gibba003 bash[31385]: cluster 2021-03-10T15:43:42.035403+0000 mgr.gibba043.dnkmem (mgr.34373) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:43 gibba003 bash[31385]: audit 2021-03-10T15:43:42.122954+0000 mon.a (mon.0) 1400 : audit [DBG] from='client.? 172.21.2.103:0/4142136021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:43 gibba003 bash[32348]: audit 2021-03-10T15:43:41.855819+0000 mgr.gibba043.dnkmem (mgr.34373) 5965 : audit [DBG] from='client.58042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:43 gibba003 bash[32348]: cluster 2021-03-10T15:43:42.035403+0000 mgr.gibba043.dnkmem (mgr.34373) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:43 gibba003 bash[32348]: audit 2021-03-10T15:43:42.122954+0000 mon.a (mon.0) 1400 : audit [DBG] from='client.? 172.21.2.103:0/4142136021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:45 gibba003 bash[31385]: cluster 2021-03-10T15:43:44.036942+0000 mgr.gibba043.dnkmem (mgr.34373) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:45.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:45 gibba003 bash[32348]: cluster 2021-03-10T15:43:44.036942+0000 mgr.gibba043.dnkmem (mgr.34373) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:45 gibba043 bash[24019]: cluster 2021-03-10T15:43:44.036942+0000 mgr.gibba043.dnkmem (mgr.34373) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:47 gibba003 bash[31385]: cluster 2021-03-10T15:43:46.038695+0000 mgr.gibba043.dnkmem (mgr.34373) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:47 gibba003 bash[32348]: cluster 2021-03-10T15:43:46.038695+0000 mgr.gibba043.dnkmem (mgr.34373) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:47 gibba043 bash[24019]: cluster 2021-03-10T15:43:46.038695+0000 mgr.gibba043.dnkmem (mgr.34373) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:49 gibba003 bash[31385]: cluster 2021-03-10T15:43:48.040394+0000 mgr.gibba043.dnkmem (mgr.34373) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:49 gibba003 bash[32348]: cluster 2021-03-10T15:43:48.040394+0000 mgr.gibba043.dnkmem (mgr.34373) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:49 gibba043 bash[24019]: cluster 2021-03-10T15:43:48.040394+0000 mgr.gibba043.dnkmem (mgr.34373) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:50 gibba043 bash[24019]: cluster 2021-03-10T15:43:50.040993+0000 mgr.gibba043.dnkmem (mgr.34373) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:50 gibba003 bash[31385]: cluster 2021-03-10T15:43:50.040993+0000 mgr.gibba043.dnkmem (mgr.34373) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:51.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:50 gibba003 bash[32348]: cluster 2021-03-10T15:43:50.040993+0000 mgr.gibba043.dnkmem (mgr.34373) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:53 gibba003 bash[31385]: cephadm 2021-03-10T15:43:51.990820+0000 mgr.gibba043.dnkmem (mgr.34373) 5971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:53 gibba003 bash[31385]: cluster 2021-03-10T15:43:52.042410+0000 mgr.gibba043.dnkmem (mgr.34373) 5972 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:53 gibba003 bash[32348]: cephadm 2021-03-10T15:43:51.990820+0000 mgr.gibba043.dnkmem (mgr.34373) 5971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:53 gibba003 bash[32348]: cluster 2021-03-10T15:43:52.042410+0000 mgr.gibba043.dnkmem (mgr.34373) 5972 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:53 gibba043 bash[24019]: cephadm 2021-03-10T15:43:51.990820+0000 mgr.gibba043.dnkmem (mgr.34373) 5971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:43:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:53 gibba043 bash[24019]: cluster 2021-03-10T15:43:52.042410+0000 mgr.gibba043.dnkmem (mgr.34373) 5972 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:55 gibba003 bash[31385]: cluster 2021-03-10T15:43:54.043988+0000 mgr.gibba043.dnkmem (mgr.34373) 5973 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:55 gibba003 bash[32348]: cluster 2021-03-10T15:43:54.043988+0000 mgr.gibba043.dnkmem (mgr.34373) 5973 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:55 gibba043 bash[24019]: cluster 2021-03-10T15:43:54.043988+0000 mgr.gibba043.dnkmem (mgr.34373) 5973 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:57 gibba003 bash[31385]: cluster 2021-03-10T15:43:56.045827+0000 mgr.gibba043.dnkmem (mgr.34373) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:57 gibba003 bash[32348]: cluster 2021-03-10T15:43:56.045827+0000 mgr.gibba043.dnkmem (mgr.34373) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:57 gibba043 bash[24019]: cluster 2021-03-10T15:43:56.045827+0000 mgr.gibba043.dnkmem (mgr.34373) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:43:59 gibba003 bash[31385]: cluster 2021-03-10T15:43:58.047476+0000 mgr.gibba043.dnkmem (mgr.34373) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:43:59 gibba003 bash[32348]: cluster 2021-03-10T15:43:58.047476+0000 mgr.gibba043.dnkmem (mgr.34373) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:43:59 gibba043 bash[24019]: cluster 2021-03-10T15:43:58.047476+0000 mgr.gibba043.dnkmem (mgr.34373) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:00 gibba043 bash[24019]: cluster 2021-03-10T15:44:00.048508+0000 mgr.gibba043.dnkmem (mgr.34373) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:00 gibba003 bash[31385]: cluster 2021-03-10T15:44:00.048508+0000 mgr.gibba043.dnkmem (mgr.34373) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:00 gibba003 bash[32348]: cluster 2021-03-10T15:44:00.048508+0000 mgr.gibba043.dnkmem (mgr.34373) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:03 gibba003 bash[31385]: cluster 2021-03-10T15:44:02.050122+0000 mgr.gibba043.dnkmem (mgr.34373) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:03 gibba003 bash[32348]: cluster 2021-03-10T15:44:02.050122+0000 mgr.gibba043.dnkmem (mgr.34373) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:03 gibba043 bash[24019]: cluster 2021-03-10T15:44:02.050122+0000 mgr.gibba043.dnkmem (mgr.34373) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:05 gibba003 bash[31385]: cluster 2021-03-10T15:44:04.051829+0000 mgr.gibba043.dnkmem (mgr.34373) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:05 gibba003 bash[32348]: cluster 2021-03-10T15:44:04.051829+0000 mgr.gibba043.dnkmem (mgr.34373) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:05 gibba043 bash[24019]: cluster 2021-03-10T15:44:04.051829+0000 mgr.gibba043.dnkmem (mgr.34373) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:07 gibba043 bash[24019]: cluster 2021-03-10T15:44:06.053398+0000 mgr.gibba043.dnkmem (mgr.34373) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:07 gibba003 bash[31385]: cluster 2021-03-10T15:44:06.053398+0000 mgr.gibba043.dnkmem (mgr.34373) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:07 gibba003 bash[32348]: cluster 2021-03-10T15:44:06.053398+0000 mgr.gibba043.dnkmem (mgr.34373) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:08 gibba003 bash[31385]: cephadm 2021-03-10T15:44:07.001048+0000 mgr.gibba043.dnkmem (mgr.34373) 5980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:08 gibba003 bash[32348]: cephadm 2021-03-10T15:44:07.001048+0000 mgr.gibba043.dnkmem (mgr.34373) 5980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:08 gibba043 bash[24019]: cephadm 2021-03-10T15:44:07.001048+0000 mgr.gibba043.dnkmem (mgr.34373) 5980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:09 gibba003 bash[31385]: cluster 2021-03-10T15:44:08.055017+0000 mgr.gibba043.dnkmem (mgr.34373) 5981 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:09 gibba003 bash[32348]: cluster 2021-03-10T15:44:08.055017+0000 mgr.gibba043.dnkmem (mgr.34373) 5981 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:09 gibba043 bash[24019]: cluster 2021-03-10T15:44:08.055017+0000 mgr.gibba043.dnkmem (mgr.34373) 5981 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:11 gibba043 bash[24019]: cluster 2021-03-10T15:44:10.056631+0000 mgr.gibba043.dnkmem (mgr.34373) 5982 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:11 gibba003 bash[31385]: cluster 2021-03-10T15:44:10.056631+0000 mgr.gibba043.dnkmem (mgr.34373) 5982 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:11 gibba003 bash[32348]: cluster 2021-03-10T15:44:10.056631+0000 mgr.gibba043.dnkmem (mgr.34373) 5982 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:12.363 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:44:12.622 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:44:12.622 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (112m) 6m ago 117m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:44:12.623 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (117m) 5m ago 117m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:44:12.623 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:44:12.623 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (113m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:44:12.624 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:44:12.624 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:44:12.624 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:44:12.625 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:44:12.625 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (118m) 6m ago 118m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:44:12.625 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (118m) 5m ago 118m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:44:12.625 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:44:12.626 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:44:12.626 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:44:12.627 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:44:12.627 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:44:12.627 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:44:12.628 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:44:12.628 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (107m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:44:12.629 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (117m) 5m ago 118m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:44:12.629 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 116m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:44:12.884 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:44:12.884 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:44:12.884 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:12.885 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:44:12.885 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:44:12.885 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:12.885 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:44:12.886 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:44:12.886 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:44:12.886 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:44:12.886 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:44:12.886 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:44:12.887 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:44:12.887 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:44:12.887 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:44:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[31385]: cluster 2021-03-10T15:44:12.058351+0000 mgr.gibba043.dnkmem (mgr.34373) 5983 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[31385]: audit 2021-03-10T15:44:12.352179+0000 mgr.gibba043.dnkmem (mgr.34373) 5984 : audit [DBG] from='client.58054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[31385]: audit 2021-03-10T15:44:12.578789+0000 mgr.gibba043.dnkmem (mgr.34373) 5985 : audit [DBG] from='client.58060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[31385]: audit 2021-03-10T15:44:12.883457+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.103:0/4115858095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[32348]: cluster 2021-03-10T15:44:12.058351+0000 mgr.gibba043.dnkmem (mgr.34373) 5983 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[32348]: audit 2021-03-10T15:44:12.352179+0000 mgr.gibba043.dnkmem (mgr.34373) 5984 : audit [DBG] from='client.58054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[32348]: audit 2021-03-10T15:44:12.578789+0000 mgr.gibba043.dnkmem (mgr.34373) 5985 : audit [DBG] from='client.58060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:13 gibba003 bash[32348]: audit 2021-03-10T15:44:12.883457+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.103:0/4115858095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:13 gibba043 bash[24019]: cluster 2021-03-10T15:44:12.058351+0000 mgr.gibba043.dnkmem (mgr.34373) 5983 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:13 gibba043 bash[24019]: audit 2021-03-10T15:44:12.352179+0000 mgr.gibba043.dnkmem (mgr.34373) 5984 : audit [DBG] from='client.58054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:13 gibba043 bash[24019]: audit 2021-03-10T15:44:12.578789+0000 mgr.gibba043.dnkmem (mgr.34373) 5985 : audit [DBG] from='client.58060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:13.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:13 gibba043 bash[24019]: audit 2021-03-10T15:44:12.883457+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.103:0/4115858095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.439929+0000 mon.c (mon.1) 1553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.441084+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.584359+0000 mon.c (mon.1) 1554 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.585533+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.697968+0000 mon.c (mon.1) 1555 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:44:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.698699+0000 mon.c (mon.1) 1556 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.699251+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:44:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.699415+0000 mon.c (mon.1) 1557 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.700082+0000 mon.c (mon.1) 1558 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.700602+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.701532+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[31385]: audit 2021-03-10T15:44:13.702349+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.439929+0000 mon.c (mon.1) 1553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.441084+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.584359+0000 mon.c (mon.1) 1554 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.585533+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.697968+0000 mon.c (mon.1) 1555 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:44:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.698699+0000 mon.c (mon.1) 1556 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.699251+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:44:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.699415+0000 mon.c (mon.1) 1557 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.700082+0000 mon.c (mon.1) 1558 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.700602+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.701532+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:14 gibba003 bash[32348]: audit 2021-03-10T15:44:13.702349+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.439929+0000 mon.c (mon.1) 1553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.441084+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.584359+0000 mon.c (mon.1) 1554 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.585533+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.697968+0000 mon.c (mon.1) 1555 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:44:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.698699+0000 mon.c (mon.1) 1556 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.699251+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:44:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.699415+0000 mon.c (mon.1) 1557 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.700082+0000 mon.c (mon.1) 1558 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.700602+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.701532+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:44:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:14 gibba043 bash[24019]: audit 2021-03-10T15:44:13.702349+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:15 gibba003 bash[31385]: cluster 2021-03-10T15:44:14.060061+0000 mgr.gibba043.dnkmem (mgr.34373) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:15 gibba003 bash[32348]: cluster 2021-03-10T15:44:14.060061+0000 mgr.gibba043.dnkmem (mgr.34373) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:15 gibba043 bash[24019]: cluster 2021-03-10T15:44:14.060061+0000 mgr.gibba043.dnkmem (mgr.34373) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:17 gibba003 bash[31385]: cluster 2021-03-10T15:44:16.061891+0000 mgr.gibba043.dnkmem (mgr.34373) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:17 gibba003 bash[32348]: cluster 2021-03-10T15:44:16.061891+0000 mgr.gibba043.dnkmem (mgr.34373) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:17 gibba043 bash[24019]: cluster 2021-03-10T15:44:16.061891+0000 mgr.gibba043.dnkmem (mgr.34373) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:19 gibba003 bash[31385]: cluster 2021-03-10T15:44:18.063466+0000 mgr.gibba043.dnkmem (mgr.34373) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:19 gibba003 bash[32348]: cluster 2021-03-10T15:44:18.063466+0000 mgr.gibba043.dnkmem (mgr.34373) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:19 gibba043 bash[24019]: cluster 2021-03-10T15:44:18.063466+0000 mgr.gibba043.dnkmem (mgr.34373) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:21 gibba043 bash[24019]: cluster 2021-03-10T15:44:20.064720+0000 mgr.gibba043.dnkmem (mgr.34373) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:21 gibba003 bash[31385]: cluster 2021-03-10T15:44:20.064720+0000 mgr.gibba043.dnkmem (mgr.34373) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:21 gibba003 bash[32348]: cluster 2021-03-10T15:44:20.064720+0000 mgr.gibba043.dnkmem (mgr.34373) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:23 gibba003 bash[31385]: cephadm 2021-03-10T15:44:22.016512+0000 mgr.gibba043.dnkmem (mgr.34373) 5990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:23 gibba003 bash[31385]: cluster 2021-03-10T15:44:22.066426+0000 mgr.gibba043.dnkmem (mgr.34373) 5991 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:23 gibba003 bash[32348]: cephadm 2021-03-10T15:44:22.016512+0000 mgr.gibba043.dnkmem (mgr.34373) 5990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:23 gibba003 bash[32348]: cluster 2021-03-10T15:44:22.066426+0000 mgr.gibba043.dnkmem (mgr.34373) 5991 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:23 gibba043 bash[24019]: cephadm 2021-03-10T15:44:22.016512+0000 mgr.gibba043.dnkmem (mgr.34373) 5990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:23 gibba043 bash[24019]: cluster 2021-03-10T15:44:22.066426+0000 mgr.gibba043.dnkmem (mgr.34373) 5991 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:25 gibba003 bash[31385]: cluster 2021-03-10T15:44:24.067808+0000 mgr.gibba043.dnkmem (mgr.34373) 5992 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:25.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:25 gibba003 bash[32348]: cluster 2021-03-10T15:44:24.067808+0000 mgr.gibba043.dnkmem (mgr.34373) 5992 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:25 gibba043 bash[24019]: cluster 2021-03-10T15:44:24.067808+0000 mgr.gibba043.dnkmem (mgr.34373) 5992 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:27 gibba003 bash[31385]: cluster 2021-03-10T15:44:26.069559+0000 mgr.gibba043.dnkmem (mgr.34373) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:27.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:27 gibba003 bash[32348]: cluster 2021-03-10T15:44:26.069559+0000 mgr.gibba043.dnkmem (mgr.34373) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:27 gibba043 bash[24019]: cluster 2021-03-10T15:44:26.069559+0000 mgr.gibba043.dnkmem (mgr.34373) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:29 gibba003 bash[31385]: cluster 2021-03-10T15:44:28.070928+0000 mgr.gibba043.dnkmem (mgr.34373) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:29 gibba003 bash[32348]: cluster 2021-03-10T15:44:28.070928+0000 mgr.gibba043.dnkmem (mgr.34373) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:29 gibba043 bash[24019]: cluster 2021-03-10T15:44:28.070928+0000 mgr.gibba043.dnkmem (mgr.34373) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:31 gibba043 bash[24019]: cluster 2021-03-10T15:44:30.072567+0000 mgr.gibba043.dnkmem (mgr.34373) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:31 gibba003 bash[31385]: cluster 2021-03-10T15:44:30.072567+0000 mgr.gibba043.dnkmem (mgr.34373) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:31 gibba003 bash[32348]: cluster 2021-03-10T15:44:30.072567+0000 mgr.gibba043.dnkmem (mgr.34373) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:33 gibba003 bash[31385]: cluster 2021-03-10T15:44:32.073907+0000 mgr.gibba043.dnkmem (mgr.34373) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:33 gibba003 bash[32348]: cluster 2021-03-10T15:44:32.073907+0000 mgr.gibba043.dnkmem (mgr.34373) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:33 gibba043 bash[24019]: cluster 2021-03-10T15:44:32.073907+0000 mgr.gibba043.dnkmem (mgr.34373) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:35.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:35 gibba003 bash[31385]: cluster 2021-03-10T15:44:34.075556+0000 mgr.gibba043.dnkmem (mgr.34373) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:35.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:35 gibba003 bash[32348]: cluster 2021-03-10T15:44:34.075556+0000 mgr.gibba043.dnkmem (mgr.34373) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:35 gibba043 bash[24019]: cluster 2021-03-10T15:44:34.075556+0000 mgr.gibba043.dnkmem (mgr.34373) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:37 gibba003 bash[31385]: cluster 2021-03-10T15:44:36.077277+0000 mgr.gibba043.dnkmem (mgr.34373) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:37 gibba003 bash[32348]: cluster 2021-03-10T15:44:36.077277+0000 mgr.gibba043.dnkmem (mgr.34373) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:37.475 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:37 gibba043 bash[24019]: cluster 2021-03-10T15:44:36.077277+0000 mgr.gibba043.dnkmem (mgr.34373) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.235102+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.235136+0000 mgr.gibba043.dnkmem (mgr.34373) 5999 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:44:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.239294+0000 mgr.gibba043.dnkmem (mgr.34373) 6000 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:44:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.239456+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.460532+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.461603+0000 mgr.gibba043.dnkmem (mgr.34373) 6001 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.463193+0000 mgr.gibba043.dnkmem (mgr.34373) 6002 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.464363+0000 mon.c (mon.1) 1559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.464746+0000 mgr.gibba043.dnkmem (mgr.34373) 6003 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.464792+0000 mgr.gibba043.dnkmem (mgr.34373) 6004 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.465785+0000 mon.c (mon.1) 1560 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.466265+0000 mgr.gibba043.dnkmem (mgr.34373) 6005 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.466307+0000 mgr.gibba043.dnkmem (mgr.34373) 6006 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.467352+0000 mon.c (mon.1) 1561 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.467811+0000 mgr.gibba043.dnkmem (mgr.34373) 6007 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.468824+0000 mon.c (mon.1) 1562 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.469392+0000 mgr.gibba043.dnkmem (mgr.34373) 6008 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.469433+0000 mgr.gibba043.dnkmem (mgr.34373) 6009 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.470873+0000 mgr.gibba043.dnkmem (mgr.34373) 6010 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.471188+0000 mgr.gibba043.dnkmem (mgr.34373) 6011 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.472120+0000 mon.c (mon.1) 1563 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.472604+0000 mgr.gibba043.dnkmem (mgr.34373) 6012 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:38.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.472650+0000 mgr.gibba043.dnkmem (mgr.34373) 6013 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:38.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: cephadm 2021-03-10T15:44:37.472764+0000 mgr.gibba043.dnkmem (mgr.34373) 6014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:38.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:38 gibba043 bash[24019]: audit 2021-03-10T15:44:37.473702+0000 mon.c (mon.1) 1564 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.235102+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.235136+0000 mgr.gibba043.dnkmem (mgr.34373) 5999 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:44:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.239294+0000 mgr.gibba043.dnkmem (mgr.34373) 6000 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:44:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.239456+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.460532+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.461603+0000 mgr.gibba043.dnkmem (mgr.34373) 6001 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.463193+0000 mgr.gibba043.dnkmem (mgr.34373) 6002 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.464363+0000 mon.c (mon.1) 1559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.464746+0000 mgr.gibba043.dnkmem (mgr.34373) 6003 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.464792+0000 mgr.gibba043.dnkmem (mgr.34373) 6004 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.465785+0000 mon.c (mon.1) 1560 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.466265+0000 mgr.gibba043.dnkmem (mgr.34373) 6005 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:38.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.466307+0000 mgr.gibba043.dnkmem (mgr.34373) 6006 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:38.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.467352+0000 mon.c (mon.1) 1561 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.467811+0000 mgr.gibba043.dnkmem (mgr.34373) 6007 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:38.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.468824+0000 mon.c (mon.1) 1562 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.469392+0000 mgr.gibba043.dnkmem (mgr.34373) 6008 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:38.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.469433+0000 mgr.gibba043.dnkmem (mgr.34373) 6009 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:38.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.470873+0000 mgr.gibba043.dnkmem (mgr.34373) 6010 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:38.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.471188+0000 mgr.gibba043.dnkmem (mgr.34373) 6011 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:38.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.472120+0000 mon.c (mon.1) 1563 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.235102+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.235136+0000 mgr.gibba043.dnkmem (mgr.34373) 5999 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:44:38.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.239294+0000 mgr.gibba043.dnkmem (mgr.34373) 6000 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:44:38.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.239456+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.460532+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:44:38.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.461603+0000 mgr.gibba043.dnkmem (mgr.34373) 6001 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:38.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.463193+0000 mgr.gibba043.dnkmem (mgr.34373) 6002 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:38.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.464363+0000 mon.c (mon.1) 1559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:38.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.464746+0000 mgr.gibba043.dnkmem (mgr.34373) 6003 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:38.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.464792+0000 mgr.gibba043.dnkmem (mgr.34373) 6004 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:38.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.465785+0000 mon.c (mon.1) 1560 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.466265+0000 mgr.gibba043.dnkmem (mgr.34373) 6005 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:38.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.466307+0000 mgr.gibba043.dnkmem (mgr.34373) 6006 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:38.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.467352+0000 mon.c (mon.1) 1561 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.467811+0000 mgr.gibba043.dnkmem (mgr.34373) 6007 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:38.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.468824+0000 mon.c (mon.1) 1562 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.469392+0000 mgr.gibba043.dnkmem (mgr.34373) 6008 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:38.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.469433+0000 mgr.gibba043.dnkmem (mgr.34373) 6009 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:38.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.470873+0000 mgr.gibba043.dnkmem (mgr.34373) 6010 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:38.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.471188+0000 mgr.gibba043.dnkmem (mgr.34373) 6011 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:38.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.472120+0000 mon.c (mon.1) 1563 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.472604+0000 mgr.gibba043.dnkmem (mgr.34373) 6012 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:38.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.472650+0000 mgr.gibba043.dnkmem (mgr.34373) 6013 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:38.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: cephadm 2021-03-10T15:44:37.472764+0000 mgr.gibba043.dnkmem (mgr.34373) 6014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:38.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[31385]: audit 2021-03-10T15:44:37.473702+0000 mon.c (mon.1) 1564 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:38.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.472604+0000 mgr.gibba043.dnkmem (mgr.34373) 6012 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:38.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.472650+0000 mgr.gibba043.dnkmem (mgr.34373) 6013 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:38.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: cephadm 2021-03-10T15:44:37.472764+0000 mgr.gibba043.dnkmem (mgr.34373) 6014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:38.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:38 gibba003 bash[32348]: audit 2021-03-10T15:44:37.473702+0000 mon.c (mon.1) 1564 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:39 gibba043 bash[24019]: cluster 2021-03-10T15:44:38.078719+0000 mgr.gibba043.dnkmem (mgr.34373) 6015 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:39 gibba003 bash[31385]: cluster 2021-03-10T15:44:38.078719+0000 mgr.gibba043.dnkmem (mgr.34373) 6015 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:39.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:39 gibba003 bash[32348]: cluster 2021-03-10T15:44:38.078719+0000 mgr.gibba043.dnkmem (mgr.34373) 6015 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:41 gibba043 bash[24019]: cluster 2021-03-10T15:44:40.080434+0000 mgr.gibba043.dnkmem (mgr.34373) 6016 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:41 gibba003 bash[31385]: cluster 2021-03-10T15:44:40.080434+0000 mgr.gibba043.dnkmem (mgr.34373) 6016 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:41 gibba003 bash[32348]: cluster 2021-03-10T15:44:40.080434+0000 mgr.gibba043.dnkmem (mgr.34373) 6016 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.126 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:44:43.353 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:44:43.354 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (113m) 7m ago 118m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:44:43.354 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (118m) 6m ago 118m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:44:43.354 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:44:43.354 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:44:43.355 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:44:43.355 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:44:43.355 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:44:43.355 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:44:43.356 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (118m) 7m ago 118m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:44:43.356 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (118m) 6m ago 118m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:44:43.356 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:44:43.356 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:44:43.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:44:43.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:44:43.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:44:43.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:44:43.358 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (108m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:44:43.358 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (108m) 6m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:44:43.358 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (117m) 6m ago 118m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:44:43.358 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 116m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:44:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:43 gibba003 bash[31385]: cluster 2021-03-10T15:44:42.081837+0000 mgr.gibba043.dnkmem (mgr.34373) 6017 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:43 gibba003 bash[32348]: cluster 2021-03-10T15:44:42.081837+0000 mgr.gibba043.dnkmem (mgr.34373) 6017 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:43 gibba043 bash[24019]: cluster 2021-03-10T15:44:42.081837+0000 mgr.gibba043.dnkmem (mgr.34373) 6017 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.601 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:44:43.601 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:44:43.601 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:43.601 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:44:43.602 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:44:43.602 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:43.602 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:44:43.602 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:44:43.603 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:44:43.603 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:44:43.603 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:44:43.603 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:44:43.604 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:44:43.604 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:44:43.604 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:44:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:44 gibba003 bash[31385]: audit 2021-03-10T15:44:43.114606+0000 mgr.gibba043.dnkmem (mgr.34373) 6018 : audit [DBG] from='client.58072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:44 gibba003 bash[31385]: audit 2021-03-10T15:44:43.338643+0000 mgr.gibba043.dnkmem (mgr.34373) 6019 : audit [DBG] from='client.58078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:44 gibba003 bash[31385]: audit 2021-03-10T15:44:43.600383+0000 mon.a (mon.0) 1411 : audit [DBG] from='client.? 172.21.2.103:0/409523664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:44 gibba003 bash[32348]: audit 2021-03-10T15:44:43.114606+0000 mgr.gibba043.dnkmem (mgr.34373) 6018 : audit [DBG] from='client.58072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:44.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:44 gibba003 bash[32348]: audit 2021-03-10T15:44:43.338643+0000 mgr.gibba043.dnkmem (mgr.34373) 6019 : audit [DBG] from='client.58078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:44.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:44 gibba003 bash[32348]: audit 2021-03-10T15:44:43.600383+0000 mon.a (mon.0) 1411 : audit [DBG] from='client.? 172.21.2.103:0/409523664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:44 gibba043 bash[24019]: audit 2021-03-10T15:44:43.114606+0000 mgr.gibba043.dnkmem (mgr.34373) 6018 : audit [DBG] from='client.58072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:44 gibba043 bash[24019]: audit 2021-03-10T15:44:43.338643+0000 mgr.gibba043.dnkmem (mgr.34373) 6019 : audit [DBG] from='client.58078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:44 gibba043 bash[24019]: audit 2021-03-10T15:44:43.600383+0000 mon.a (mon.0) 1411 : audit [DBG] from='client.? 172.21.2.103:0/409523664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:45.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:45 gibba003 bash[31385]: cluster 2021-03-10T15:44:44.083470+0000 mgr.gibba043.dnkmem (mgr.34373) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:45.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:45 gibba003 bash[32348]: cluster 2021-03-10T15:44:44.083470+0000 mgr.gibba043.dnkmem (mgr.34373) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:45 gibba043 bash[24019]: cluster 2021-03-10T15:44:44.083470+0000 mgr.gibba043.dnkmem (mgr.34373) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:47 gibba003 bash[31385]: cluster 2021-03-10T15:44:46.085447+0000 mgr.gibba043.dnkmem (mgr.34373) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:47 gibba003 bash[32348]: cluster 2021-03-10T15:44:46.085447+0000 mgr.gibba043.dnkmem (mgr.34373) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:47 gibba043 bash[24019]: cluster 2021-03-10T15:44:46.085447+0000 mgr.gibba043.dnkmem (mgr.34373) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:49 gibba003 bash[31385]: cluster 2021-03-10T15:44:48.086687+0000 mgr.gibba043.dnkmem (mgr.34373) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:49 gibba003 bash[32348]: cluster 2021-03-10T15:44:48.086687+0000 mgr.gibba043.dnkmem (mgr.34373) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:49 gibba043 bash[24019]: cluster 2021-03-10T15:44:48.086687+0000 mgr.gibba043.dnkmem (mgr.34373) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:51 gibba003 bash[31385]: cluster 2021-03-10T15:44:50.087321+0000 mgr.gibba043.dnkmem (mgr.34373) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:51 gibba003 bash[32348]: cluster 2021-03-10T15:44:50.087321+0000 mgr.gibba043.dnkmem (mgr.34373) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:51 gibba043 bash[24019]: cluster 2021-03-10T15:44:50.087321+0000 mgr.gibba043.dnkmem (mgr.34373) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:53 gibba003 bash[31385]: cluster 2021-03-10T15:44:52.088769+0000 mgr.gibba043.dnkmem (mgr.34373) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:53 gibba003 bash[31385]: cephadm 2021-03-10T15:44:52.488249+0000 mgr.gibba043.dnkmem (mgr.34373) 6025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:53.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:53 gibba003 bash[32348]: cluster 2021-03-10T15:44:52.088769+0000 mgr.gibba043.dnkmem (mgr.34373) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:53 gibba003 bash[32348]: cephadm 2021-03-10T15:44:52.488249+0000 mgr.gibba043.dnkmem (mgr.34373) 6025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:53 gibba043 bash[24019]: cluster 2021-03-10T15:44:52.088769+0000 mgr.gibba043.dnkmem (mgr.34373) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:53 gibba043 bash[24019]: cephadm 2021-03-10T15:44:52.488249+0000 mgr.gibba043.dnkmem (mgr.34373) 6025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:44:55.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:55 gibba003 bash[31385]: cluster 2021-03-10T15:44:54.090417+0000 mgr.gibba043.dnkmem (mgr.34373) 6026 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:55 gibba003 bash[32348]: cluster 2021-03-10T15:44:54.090417+0000 mgr.gibba043.dnkmem (mgr.34373) 6026 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:55 gibba043 bash[24019]: cluster 2021-03-10T15:44:54.090417+0000 mgr.gibba043.dnkmem (mgr.34373) 6026 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:57 gibba003 bash[31385]: cluster 2021-03-10T15:44:56.092267+0000 mgr.gibba043.dnkmem (mgr.34373) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:57.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:57 gibba003 bash[32348]: cluster 2021-03-10T15:44:56.092267+0000 mgr.gibba043.dnkmem (mgr.34373) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:57 gibba043 bash[24019]: cluster 2021-03-10T15:44:56.092267+0000 mgr.gibba043.dnkmem (mgr.34373) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:44:59 gibba003 bash[31385]: cluster 2021-03-10T15:44:58.093484+0000 mgr.gibba043.dnkmem (mgr.34373) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:44:59 gibba003 bash[32348]: cluster 2021-03-10T15:44:58.093484+0000 mgr.gibba043.dnkmem (mgr.34373) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:44:59 gibba043 bash[24019]: cluster 2021-03-10T15:44:58.093484+0000 mgr.gibba043.dnkmem (mgr.34373) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:01.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:01 gibba043 bash[24019]: cluster 2021-03-10T15:45:00.094904+0000 mgr.gibba043.dnkmem (mgr.34373) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:01 gibba003 bash[31385]: cluster 2021-03-10T15:45:00.094904+0000 mgr.gibba043.dnkmem (mgr.34373) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:01 gibba003 bash[32348]: cluster 2021-03-10T15:45:00.094904+0000 mgr.gibba043.dnkmem (mgr.34373) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:03 gibba003 bash[31385]: cluster 2021-03-10T15:45:02.096661+0000 mgr.gibba043.dnkmem (mgr.34373) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:03 gibba003 bash[32348]: cluster 2021-03-10T15:45:02.096661+0000 mgr.gibba043.dnkmem (mgr.34373) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:03 gibba043 bash[24019]: cluster 2021-03-10T15:45:02.096661+0000 mgr.gibba043.dnkmem (mgr.34373) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:05 gibba003 bash[31385]: cluster 2021-03-10T15:45:04.098287+0000 mgr.gibba043.dnkmem (mgr.34373) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:05 gibba003 bash[32348]: cluster 2021-03-10T15:45:04.098287+0000 mgr.gibba043.dnkmem (mgr.34373) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:05 gibba043 bash[24019]: cluster 2021-03-10T15:45:04.098287+0000 mgr.gibba043.dnkmem (mgr.34373) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:07 gibba003 bash[31385]: cluster 2021-03-10T15:45:06.100229+0000 mgr.gibba043.dnkmem (mgr.34373) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:07 gibba003 bash[32348]: cluster 2021-03-10T15:45:06.100229+0000 mgr.gibba043.dnkmem (mgr.34373) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.503 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:07 gibba043 bash[24019]: cluster 2021-03-10T15:45:06.100229+0000 mgr.gibba043.dnkmem (mgr.34373) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:08 gibba043 bash[24019]: cephadm 2021-03-10T15:45:07.500477+0000 mgr.gibba043.dnkmem (mgr.34373) 6033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:08.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:08 gibba003 bash[32348]: cephadm 2021-03-10T15:45:07.500477+0000 mgr.gibba043.dnkmem (mgr.34373) 6033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:08.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:08 gibba003 bash[31385]: cephadm 2021-03-10T15:45:07.500477+0000 mgr.gibba043.dnkmem (mgr.34373) 6033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:09 gibba043 bash[24019]: cluster 2021-03-10T15:45:08.101777+0000 mgr.gibba043.dnkmem (mgr.34373) 6034 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:09 gibba003 bash[31385]: cluster 2021-03-10T15:45:08.101777+0000 mgr.gibba043.dnkmem (mgr.34373) 6034 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:09 gibba003 bash[32348]: cluster 2021-03-10T15:45:08.101777+0000 mgr.gibba043.dnkmem (mgr.34373) 6034 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:11 gibba003 bash[31385]: cluster 2021-03-10T15:45:10.103186+0000 mgr.gibba043.dnkmem (mgr.34373) 6035 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:11 gibba003 bash[32348]: cluster 2021-03-10T15:45:10.103186+0000 mgr.gibba043.dnkmem (mgr.34373) 6035 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:11 gibba043 bash[24019]: cluster 2021-03-10T15:45:10.103186+0000 mgr.gibba043.dnkmem (mgr.34373) 6035 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:13 gibba003 bash[31385]: cluster 2021-03-10T15:45:12.104839+0000 mgr.gibba043.dnkmem (mgr.34373) 6036 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:13 gibba003 bash[32348]: cluster 2021-03-10T15:45:12.104839+0000 mgr.gibba043.dnkmem (mgr.34373) 6036 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:13 gibba043 bash[24019]: cluster 2021-03-10T15:45:12.104839+0000 mgr.gibba043.dnkmem (mgr.34373) 6036 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.846 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:45:14.074 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:45:14.080 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (113m) 7m ago 118m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:45:14.080 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (118m) 6m ago 118m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:45:14.081 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:45:14.081 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (114m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:45:14.081 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:45:14.081 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:45:14.082 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:45:14.082 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:45:14.082 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (119m) 7m ago 119m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:45:14.082 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (119m) 6m ago 119m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:45:14.082 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:45:14.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:45:14.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:45:14.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:45:14.083 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:45:14.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:45:14.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:45:14.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (108m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:45:14.084 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (118m) 6m ago 119m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:45:14.084 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 117m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:45:14.326 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:45:14.326 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:45:14.327 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:14.327 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:45:14.327 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:45:14.327 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:14.327 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:45:14.328 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:45:14.328 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:45:14.328 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:45:14.328 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:45:14.329 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:45:14.329 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:45:14.329 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:45:14.329 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:45:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.446725+0000 mon.c (mon.1) 1565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.447846+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.593079+0000 mon.c (mon.1) 1566 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.594176+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.705199+0000 mon.c (mon.1) 1567 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:45:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.705385+0000 mon.c (mon.1) 1568 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.705579+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:45:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.705630+0000 mon.c (mon.1) 1569 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:45:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.705909+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.705954+0000 mon.c (mon.1) 1570 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.706198+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:45:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[31385]: audit 2021-03-10T15:45:13.706449+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.446725+0000 mon.c (mon.1) 1565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.447846+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.593079+0000 mon.c (mon.1) 1566 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.594176+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.705199+0000 mon.c (mon.1) 1567 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:45:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.705385+0000 mon.c (mon.1) 1568 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.705579+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:45:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.705630+0000 mon.c (mon.1) 1569 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:45:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.705909+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.705954+0000 mon.c (mon.1) 1570 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.706198+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:45:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:14 gibba003 bash[32348]: audit 2021-03-10T15:45:13.706449+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.446725+0000 mon.c (mon.1) 1565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.447846+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.593079+0000 mon.c (mon.1) 1566 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.594176+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.705199+0000 mon.c (mon.1) 1567 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:45:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.705385+0000 mon.c (mon.1) 1568 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.705579+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:45:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.705630+0000 mon.c (mon.1) 1569 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:45:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.705909+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.705954+0000 mon.c (mon.1) 1570 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:45:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.706198+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:45:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:14 gibba043 bash[24019]: audit 2021-03-10T15:45:13.706449+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:45:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[31385]: audit 2021-03-10T15:45:13.834484+0000 mgr.gibba043.dnkmem (mgr.34373) 6037 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[31385]: audit 2021-03-10T15:45:14.060406+0000 mgr.gibba043.dnkmem (mgr.34373) 6038 : audit [DBG] from='client.58096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[31385]: cluster 2021-03-10T15:45:14.105820+0000 mgr.gibba043.dnkmem (mgr.34373) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[31385]: audit 2021-03-10T15:45:14.325820+0000 mon.c (mon.1) 1571 : audit [DBG] from='client.? 172.21.2.103:0/1514360223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[32348]: audit 2021-03-10T15:45:13.834484+0000 mgr.gibba043.dnkmem (mgr.34373) 6037 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[32348]: audit 2021-03-10T15:45:14.060406+0000 mgr.gibba043.dnkmem (mgr.34373) 6038 : audit [DBG] from='client.58096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[32348]: cluster 2021-03-10T15:45:14.105820+0000 mgr.gibba043.dnkmem (mgr.34373) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:15 gibba003 bash[32348]: audit 2021-03-10T15:45:14.325820+0000 mon.c (mon.1) 1571 : audit [DBG] from='client.? 172.21.2.103:0/1514360223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:15 gibba043 bash[24019]: audit 2021-03-10T15:45:13.834484+0000 mgr.gibba043.dnkmem (mgr.34373) 6037 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:15 gibba043 bash[24019]: audit 2021-03-10T15:45:14.060406+0000 mgr.gibba043.dnkmem (mgr.34373) 6038 : audit [DBG] from='client.58096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:15 gibba043 bash[24019]: cluster 2021-03-10T15:45:14.105820+0000 mgr.gibba043.dnkmem (mgr.34373) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:15 gibba043 bash[24019]: audit 2021-03-10T15:45:14.325820+0000 mon.c (mon.1) 1571 : audit [DBG] from='client.? 172.21.2.103:0/1514360223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:17 gibba043 bash[24019]: cluster 2021-03-10T15:45:16.107531+0000 mgr.gibba043.dnkmem (mgr.34373) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:17 gibba003 bash[31385]: cluster 2021-03-10T15:45:16.107531+0000 mgr.gibba043.dnkmem (mgr.34373) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:17 gibba003 bash[32348]: cluster 2021-03-10T15:45:16.107531+0000 mgr.gibba043.dnkmem (mgr.34373) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:19 gibba043 bash[24019]: cluster 2021-03-10T15:45:18.108900+0000 mgr.gibba043.dnkmem (mgr.34373) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:19 gibba003 bash[31385]: cluster 2021-03-10T15:45:18.108900+0000 mgr.gibba043.dnkmem (mgr.34373) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:19 gibba003 bash[32348]: cluster 2021-03-10T15:45:18.108900+0000 mgr.gibba043.dnkmem (mgr.34373) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:21.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:21 gibba003 bash[31385]: cluster 2021-03-10T15:45:20.110237+0000 mgr.gibba043.dnkmem (mgr.34373) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:21 gibba003 bash[32348]: cluster 2021-03-10T15:45:20.110237+0000 mgr.gibba043.dnkmem (mgr.34373) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:21 gibba043 bash[24019]: cluster 2021-03-10T15:45:20.110237+0000 mgr.gibba043.dnkmem (mgr.34373) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:23 gibba003 bash[31385]: cluster 2021-03-10T15:45:22.111891+0000 mgr.gibba043.dnkmem (mgr.34373) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:23 gibba003 bash[31385]: cephadm 2021-03-10T15:45:22.505210+0000 mgr.gibba043.dnkmem (mgr.34373) 6044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:23 gibba003 bash[32348]: cluster 2021-03-10T15:45:22.111891+0000 mgr.gibba043.dnkmem (mgr.34373) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:23 gibba003 bash[32348]: cephadm 2021-03-10T15:45:22.505210+0000 mgr.gibba043.dnkmem (mgr.34373) 6044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:23 gibba043 bash[24019]: cluster 2021-03-10T15:45:22.111891+0000 mgr.gibba043.dnkmem (mgr.34373) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:23 gibba043 bash[24019]: cephadm 2021-03-10T15:45:22.505210+0000 mgr.gibba043.dnkmem (mgr.34373) 6044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:25.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:25 gibba003 bash[31385]: cluster 2021-03-10T15:45:24.113484+0000 mgr.gibba043.dnkmem (mgr.34373) 6045 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:25.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:25 gibba003 bash[32348]: cluster 2021-03-10T15:45:24.113484+0000 mgr.gibba043.dnkmem (mgr.34373) 6045 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:25 gibba043 bash[24019]: cluster 2021-03-10T15:45:24.113484+0000 mgr.gibba043.dnkmem (mgr.34373) 6045 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:27 gibba043 bash[24019]: cluster 2021-03-10T15:45:26.115375+0000 mgr.gibba043.dnkmem (mgr.34373) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:27 gibba003 bash[31385]: cluster 2021-03-10T15:45:26.115375+0000 mgr.gibba043.dnkmem (mgr.34373) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:27 gibba003 bash[32348]: cluster 2021-03-10T15:45:26.115375+0000 mgr.gibba043.dnkmem (mgr.34373) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:29 gibba043 bash[24019]: cluster 2021-03-10T15:45:28.116785+0000 mgr.gibba043.dnkmem (mgr.34373) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:29 gibba003 bash[31385]: cluster 2021-03-10T15:45:28.116785+0000 mgr.gibba043.dnkmem (mgr.34373) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:29 gibba003 bash[32348]: cluster 2021-03-10T15:45:28.116785+0000 mgr.gibba043.dnkmem (mgr.34373) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:31 gibba003 bash[32348]: cluster 2021-03-10T15:45:30.118345+0000 mgr.gibba043.dnkmem (mgr.34373) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:31 gibba003 bash[31385]: cluster 2021-03-10T15:45:30.118345+0000 mgr.gibba043.dnkmem (mgr.34373) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:31 gibba043 bash[24019]: cluster 2021-03-10T15:45:30.118345+0000 mgr.gibba043.dnkmem (mgr.34373) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:33 gibba003 bash[31385]: cluster 2021-03-10T15:45:32.119864+0000 mgr.gibba043.dnkmem (mgr.34373) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:33 gibba003 bash[32348]: cluster 2021-03-10T15:45:32.119864+0000 mgr.gibba043.dnkmem (mgr.34373) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:33 gibba043 bash[24019]: cluster 2021-03-10T15:45:32.119864+0000 mgr.gibba043.dnkmem (mgr.34373) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:35 gibba043 bash[24019]: cluster 2021-03-10T15:45:34.121304+0000 mgr.gibba043.dnkmem (mgr.34373) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:35 gibba003 bash[31385]: cluster 2021-03-10T15:45:34.121304+0000 mgr.gibba043.dnkmem (mgr.34373) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:35 gibba003 bash[32348]: cluster 2021-03-10T15:45:34.121304+0000 mgr.gibba043.dnkmem (mgr.34373) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:37 gibba043 bash[24019]: cluster 2021-03-10T15:45:36.123253+0000 mgr.gibba043.dnkmem (mgr.34373) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:37 gibba003 bash[31385]: cluster 2021-03-10T15:45:36.123253+0000 mgr.gibba043.dnkmem (mgr.34373) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:37 gibba003 bash[32348]: cluster 2021-03-10T15:45:36.123253+0000 mgr.gibba043.dnkmem (mgr.34373) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.521892+0000 mgr.gibba043.dnkmem (mgr.34373) 6052 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:45:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.523489+0000 mgr.gibba043.dnkmem (mgr.34373) 6053 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:45:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.754895+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:45:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.758542+0000 mon.c (mon.1) 1572 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.760164+0000 mon.c (mon.1) 1573 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.761328+0000 mon.c (mon.1) 1574 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.762386+0000 mon.c (mon.1) 1575 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.765351+0000 mon.c (mon.1) 1576 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:38 gibba043 bash[24019]: audit 2021-03-10T15:45:37.766822+0000 mon.c (mon.1) 1577 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.521892+0000 mgr.gibba043.dnkmem (mgr.34373) 6052 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:45:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.523489+0000 mgr.gibba043.dnkmem (mgr.34373) 6053 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:45:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.754895+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:45:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.758542+0000 mon.c (mon.1) 1572 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.760164+0000 mon.c (mon.1) 1573 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.761328+0000 mon.c (mon.1) 1574 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.762386+0000 mon.c (mon.1) 1575 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.765351+0000 mon.c (mon.1) 1576 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[31385]: audit 2021-03-10T15:45:37.766822+0000 mon.c (mon.1) 1577 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.521892+0000 mgr.gibba043.dnkmem (mgr.34373) 6052 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:45:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.523489+0000 mgr.gibba043.dnkmem (mgr.34373) 6053 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:45:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.754895+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:45:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.758542+0000 mon.c (mon.1) 1572 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.760164+0000 mon.c (mon.1) 1573 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.761328+0000 mon.c (mon.1) 1574 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.762386+0000 mon.c (mon.1) 1575 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.765351+0000 mon.c (mon.1) 1576 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:38 gibba003 bash[32348]: audit 2021-03-10T15:45:37.766822+0000 mon.c (mon.1) 1577 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.755766+0000 mgr.gibba043.dnkmem (mgr.34373) 6054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.757762+0000 mgr.gibba043.dnkmem (mgr.34373) 6055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.758967+0000 mgr.gibba043.dnkmem (mgr.34373) 6056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.759005+0000 mgr.gibba043.dnkmem (mgr.34373) 6057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.760088+0000 mgr.gibba043.dnkmem (mgr.34373) 6058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.760123+0000 mgr.gibba043.dnkmem (mgr.34373) 6059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.761112+0000 mgr.gibba043.dnkmem (mgr.34373) 6060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.762722+0000 mgr.gibba043.dnkmem (mgr.34373) 6061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.762759+0000 mgr.gibba043.dnkmem (mgr.34373) 6062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.764076+0000 mgr.gibba043.dnkmem (mgr.34373) 6063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.764384+0000 mgr.gibba043.dnkmem (mgr.34373) 6064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.765539+0000 mgr.gibba043.dnkmem (mgr.34373) 6065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.765575+0000 mgr.gibba043.dnkmem (mgr.34373) 6066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cephadm 2021-03-10T15:45:37.765671+0000 mgr.gibba043.dnkmem (mgr.34373) 6067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:39 gibba043 bash[24019]: cluster 2021-03-10T15:45:38.124815+0000 mgr.gibba043.dnkmem (mgr.34373) 6068 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.755766+0000 mgr.gibba043.dnkmem (mgr.34373) 6054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.757762+0000 mgr.gibba043.dnkmem (mgr.34373) 6055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.758967+0000 mgr.gibba043.dnkmem (mgr.34373) 6056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.759005+0000 mgr.gibba043.dnkmem (mgr.34373) 6057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.760088+0000 mgr.gibba043.dnkmem (mgr.34373) 6058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.760123+0000 mgr.gibba043.dnkmem (mgr.34373) 6059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.761112+0000 mgr.gibba043.dnkmem (mgr.34373) 6060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.762722+0000 mgr.gibba043.dnkmem (mgr.34373) 6061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.762759+0000 mgr.gibba043.dnkmem (mgr.34373) 6062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.764076+0000 mgr.gibba043.dnkmem (mgr.34373) 6063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.764384+0000 mgr.gibba043.dnkmem (mgr.34373) 6064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.765539+0000 mgr.gibba043.dnkmem (mgr.34373) 6065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.765575+0000 mgr.gibba043.dnkmem (mgr.34373) 6066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cephadm 2021-03-10T15:45:37.765671+0000 mgr.gibba043.dnkmem (mgr.34373) 6067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[31385]: cluster 2021-03-10T15:45:38.124815+0000 mgr.gibba043.dnkmem (mgr.34373) 6068 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.755766+0000 mgr.gibba043.dnkmem (mgr.34373) 6054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.757762+0000 mgr.gibba043.dnkmem (mgr.34373) 6055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.758967+0000 mgr.gibba043.dnkmem (mgr.34373) 6056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.759005+0000 mgr.gibba043.dnkmem (mgr.34373) 6057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.760088+0000 mgr.gibba043.dnkmem (mgr.34373) 6058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.760123+0000 mgr.gibba043.dnkmem (mgr.34373) 6059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.761112+0000 mgr.gibba043.dnkmem (mgr.34373) 6060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.762722+0000 mgr.gibba043.dnkmem (mgr.34373) 6061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.762759+0000 mgr.gibba043.dnkmem (mgr.34373) 6062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.764076+0000 mgr.gibba043.dnkmem (mgr.34373) 6063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.764384+0000 mgr.gibba043.dnkmem (mgr.34373) 6064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.765539+0000 mgr.gibba043.dnkmem (mgr.34373) 6065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.765575+0000 mgr.gibba043.dnkmem (mgr.34373) 6066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cephadm 2021-03-10T15:45:37.765671+0000 mgr.gibba043.dnkmem (mgr.34373) 6067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:39 gibba003 bash[32348]: cluster 2021-03-10T15:45:38.124815+0000 mgr.gibba043.dnkmem (mgr.34373) 6068 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:41 gibba003 bash[31385]: cluster 2021-03-10T15:45:40.126383+0000 mgr.gibba043.dnkmem (mgr.34373) 6069 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:41 gibba003 bash[32348]: cluster 2021-03-10T15:45:40.126383+0000 mgr.gibba043.dnkmem (mgr.34373) 6069 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:41 gibba043 bash[24019]: cluster 2021-03-10T15:45:40.126383+0000 mgr.gibba043.dnkmem (mgr.34373) 6069 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:43 gibba043 bash[24019]: cluster 2021-03-10T15:45:42.127907+0000 mgr.gibba043.dnkmem (mgr.34373) 6070 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:43.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:43 gibba003 bash[31385]: cluster 2021-03-10T15:45:42.127907+0000 mgr.gibba043.dnkmem (mgr.34373) 6070 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:43.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:43 gibba003 bash[32348]: cluster 2021-03-10T15:45:42.127907+0000 mgr.gibba043.dnkmem (mgr.34373) 6070 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:44.569 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:45:44.794 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:45:44.795 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (114m) 8m ago 119m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:45:44.795 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (119m) 7m ago 119m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:45:44.795 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:45:44.795 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:45:44.795 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:45:44.796 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:45:44.796 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:45:44.796 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:45:44.796 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (119m) 8m ago 119m 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:45:44.797 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (119m) 7m ago 119m 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:45:44.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:45:44.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:45:44.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:45:44.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:45:44.798 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:45:44.798 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:45:44.798 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:45:44.798 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (109m) 7m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:45:44.799 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (118m) 7m ago 119m 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:45:44.799 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 117m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:45:45.043 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:45:45.043 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:45:45.044 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:45.044 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:45:45.044 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:45:45.044 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:45.045 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:45:45.045 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:45:45.045 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:45:45.045 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:45:45.045 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:45:45.046 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:45:45.046 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:45:45.046 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:45:45.046 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:45:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:45 gibba043 bash[24019]: cluster 2021-03-10T15:45:44.129324+0000 mgr.gibba043.dnkmem (mgr.34373) 6071 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:45 gibba043 bash[24019]: audit 2021-03-10T15:45:44.557840+0000 mgr.gibba043.dnkmem (mgr.34373) 6072 : audit [DBG] from='client.48120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:45 gibba043 bash[24019]: audit 2021-03-10T15:45:45.042986+0000 mon.c (mon.1) 1578 : audit [DBG] from='client.? 172.21.2.103:0/3386777025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:45.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:45 gibba003 bash[31385]: cluster 2021-03-10T15:45:44.129324+0000 mgr.gibba043.dnkmem (mgr.34373) 6071 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:45 gibba003 bash[31385]: audit 2021-03-10T15:45:44.557840+0000 mgr.gibba043.dnkmem (mgr.34373) 6072 : audit [DBG] from='client.48120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:45 gibba003 bash[31385]: audit 2021-03-10T15:45:45.042986+0000 mon.c (mon.1) 1578 : audit [DBG] from='client.? 172.21.2.103:0/3386777025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:45 gibba003 bash[32348]: cluster 2021-03-10T15:45:44.129324+0000 mgr.gibba043.dnkmem (mgr.34373) 6071 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:45 gibba003 bash[32348]: audit 2021-03-10T15:45:44.557840+0000 mgr.gibba043.dnkmem (mgr.34373) 6072 : audit [DBG] from='client.48120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:45 gibba003 bash[32348]: audit 2021-03-10T15:45:45.042986+0000 mon.c (mon.1) 1578 : audit [DBG] from='client.? 172.21.2.103:0/3386777025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:46.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:46 gibba043 bash[24019]: audit 2021-03-10T15:45:44.781293+0000 mgr.gibba043.dnkmem (mgr.34373) 6073 : audit [DBG] from='client.58114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:46.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:46 gibba003 bash[31385]: audit 2021-03-10T15:45:44.781293+0000 mgr.gibba043.dnkmem (mgr.34373) 6073 : audit [DBG] from='client.58114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:46.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:46 gibba003 bash[32348]: audit 2021-03-10T15:45:44.781293+0000 mgr.gibba043.dnkmem (mgr.34373) 6073 : audit [DBG] from='client.58114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:47 gibba043 bash[24019]: cluster 2021-03-10T15:45:46.131136+0000 mgr.gibba043.dnkmem (mgr.34373) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:47.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:47 gibba003 bash[31385]: cluster 2021-03-10T15:45:46.131136+0000 mgr.gibba043.dnkmem (mgr.34373) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:47 gibba003 bash[32348]: cluster 2021-03-10T15:45:46.131136+0000 mgr.gibba043.dnkmem (mgr.34373) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:49 gibba043 bash[24019]: cluster 2021-03-10T15:45:48.132689+0000 mgr.gibba043.dnkmem (mgr.34373) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:49 gibba003 bash[31385]: cluster 2021-03-10T15:45:48.132689+0000 mgr.gibba043.dnkmem (mgr.34373) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:49 gibba003 bash[32348]: cluster 2021-03-10T15:45:48.132689+0000 mgr.gibba043.dnkmem (mgr.34373) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:51 gibba003 bash[31385]: cluster 2021-03-10T15:45:50.133436+0000 mgr.gibba043.dnkmem (mgr.34373) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:51 gibba003 bash[32348]: cluster 2021-03-10T15:45:50.133436+0000 mgr.gibba043.dnkmem (mgr.34373) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:51 gibba043 bash[24019]: cluster 2021-03-10T15:45:50.133436+0000 mgr.gibba043.dnkmem (mgr.34373) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:53 gibba043 bash[24019]: cluster 2021-03-10T15:45:52.134968+0000 mgr.gibba043.dnkmem (mgr.34373) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:53 gibba003 bash[31385]: cluster 2021-03-10T15:45:52.134968+0000 mgr.gibba043.dnkmem (mgr.34373) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:53 gibba003 bash[32348]: cluster 2021-03-10T15:45:52.134968+0000 mgr.gibba043.dnkmem (mgr.34373) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:54 gibba043 bash[24019]: cephadm 2021-03-10T15:45:52.781750+0000 mgr.gibba043.dnkmem (mgr.34373) 6078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:54.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:54 gibba003 bash[31385]: cephadm 2021-03-10T15:45:52.781750+0000 mgr.gibba043.dnkmem (mgr.34373) 6078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:54.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:54 gibba003 bash[32348]: cephadm 2021-03-10T15:45:52.781750+0000 mgr.gibba043.dnkmem (mgr.34373) 6078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:45:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:55 gibba043 bash[24019]: cluster 2021-03-10T15:45:54.136750+0000 mgr.gibba043.dnkmem (mgr.34373) 6079 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:55 gibba003 bash[31385]: cluster 2021-03-10T15:45:54.136750+0000 mgr.gibba043.dnkmem (mgr.34373) 6079 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:55.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:55 gibba003 bash[32348]: cluster 2021-03-10T15:45:54.136750+0000 mgr.gibba043.dnkmem (mgr.34373) 6079 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:57 gibba043 bash[24019]: cluster 2021-03-10T15:45:56.138410+0000 mgr.gibba043.dnkmem (mgr.34373) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:57 gibba003 bash[31385]: cluster 2021-03-10T15:45:56.138410+0000 mgr.gibba043.dnkmem (mgr.34373) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:57 gibba003 bash[32348]: cluster 2021-03-10T15:45:56.138410+0000 mgr.gibba043.dnkmem (mgr.34373) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:45:59 gibba043 bash[24019]: cluster 2021-03-10T15:45:58.139971+0000 mgr.gibba043.dnkmem (mgr.34373) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:45:59 gibba003 bash[31385]: cluster 2021-03-10T15:45:58.139971+0000 mgr.gibba043.dnkmem (mgr.34373) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:45:59 gibba003 bash[32348]: cluster 2021-03-10T15:45:58.139971+0000 mgr.gibba043.dnkmem (mgr.34373) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:01 gibba003 bash[31385]: cluster 2021-03-10T15:46:00.141402+0000 mgr.gibba043.dnkmem (mgr.34373) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:01 gibba003 bash[32348]: cluster 2021-03-10T15:46:00.141402+0000 mgr.gibba043.dnkmem (mgr.34373) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:01 gibba043 bash[24019]: cluster 2021-03-10T15:46:00.141402+0000 mgr.gibba043.dnkmem (mgr.34373) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:03 gibba043 bash[24019]: cluster 2021-03-10T15:46:02.142998+0000 mgr.gibba043.dnkmem (mgr.34373) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:03.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:03 gibba003 bash[31385]: cluster 2021-03-10T15:46:02.142998+0000 mgr.gibba043.dnkmem (mgr.34373) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:03 gibba003 bash[32348]: cluster 2021-03-10T15:46:02.142998+0000 mgr.gibba043.dnkmem (mgr.34373) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:05 gibba043 bash[24019]: cluster 2021-03-10T15:46:04.144379+0000 mgr.gibba043.dnkmem (mgr.34373) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:05 gibba003 bash[31385]: cluster 2021-03-10T15:46:04.144379+0000 mgr.gibba043.dnkmem (mgr.34373) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:05 gibba003 bash[32348]: cluster 2021-03-10T15:46:04.144379+0000 mgr.gibba043.dnkmem (mgr.34373) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:07 gibba043 bash[24019]: cluster 2021-03-10T15:46:06.146350+0000 mgr.gibba043.dnkmem (mgr.34373) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:07 gibba003 bash[31385]: cluster 2021-03-10T15:46:06.146350+0000 mgr.gibba043.dnkmem (mgr.34373) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:07 gibba003 bash[32348]: cluster 2021-03-10T15:46:06.146350+0000 mgr.gibba043.dnkmem (mgr.34373) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:09 gibba043 bash[24019]: cephadm 2021-03-10T15:46:07.797787+0000 mgr.gibba043.dnkmem (mgr.34373) 6086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:09 gibba043 bash[24019]: cluster 2021-03-10T15:46:08.147875+0000 mgr.gibba043.dnkmem (mgr.34373) 6087 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:09 gibba003 bash[31385]: cephadm 2021-03-10T15:46:07.797787+0000 mgr.gibba043.dnkmem (mgr.34373) 6086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:09 gibba003 bash[31385]: cluster 2021-03-10T15:46:08.147875+0000 mgr.gibba043.dnkmem (mgr.34373) 6087 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:09.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:09 gibba003 bash[32348]: cephadm 2021-03-10T15:46:07.797787+0000 mgr.gibba043.dnkmem (mgr.34373) 6086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:09.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:09 gibba003 bash[32348]: cluster 2021-03-10T15:46:08.147875+0000 mgr.gibba043.dnkmem (mgr.34373) 6087 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:11 gibba003 bash[31385]: cluster 2021-03-10T15:46:10.149370+0000 mgr.gibba043.dnkmem (mgr.34373) 6088 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:11 gibba003 bash[32348]: cluster 2021-03-10T15:46:10.149370+0000 mgr.gibba043.dnkmem (mgr.34373) 6088 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:11 gibba043 bash[24019]: cluster 2021-03-10T15:46:10.149370+0000 mgr.gibba043.dnkmem (mgr.34373) 6088 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:13 gibba043 bash[24019]: cluster 2021-03-10T15:46:12.150772+0000 mgr.gibba043.dnkmem (mgr.34373) 6089 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:13 gibba003 bash[31385]: cluster 2021-03-10T15:46:12.150772+0000 mgr.gibba043.dnkmem (mgr.34373) 6089 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:13 gibba003 bash[32348]: cluster 2021-03-10T15:46:12.150772+0000 mgr.gibba043.dnkmem (mgr.34373) 6089 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.453596+0000 mon.c (mon.1) 1579 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.454683+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.601534+0000 mon.c (mon.1) 1580 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.602606+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.711988+0000 mon.c (mon.1) 1581 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:46:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.712750+0000 mon.c (mon.1) 1582 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.713271+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:46:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.713484+0000 mon.c (mon.1) 1583 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.714141+0000 mon.c (mon.1) 1584 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.714688+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.716114+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:14 gibba043 bash[24019]: audit 2021-03-10T15:46:13.716972+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.453596+0000 mon.c (mon.1) 1579 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.454683+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.601534+0000 mon.c (mon.1) 1580 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.602606+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.711988+0000 mon.c (mon.1) 1581 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:46:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.712750+0000 mon.c (mon.1) 1582 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.713271+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:46:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.713484+0000 mon.c (mon.1) 1583 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.714141+0000 mon.c (mon.1) 1584 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.714688+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.716114+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[31385]: audit 2021-03-10T15:46:13.716972+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.453596+0000 mon.c (mon.1) 1579 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.454683+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.601534+0000 mon.c (mon.1) 1580 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.602606+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.711988+0000 mon.c (mon.1) 1581 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:46:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.712750+0000 mon.c (mon.1) 1582 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.713271+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:46:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.713484+0000 mon.c (mon.1) 1583 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.714141+0000 mon.c (mon.1) 1584 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.714688+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:46:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.716114+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:14 gibba003 bash[32348]: audit 2021-03-10T15:46:13.716972+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:15.277 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:46:15.506 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:46:15.507 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (114m) 8m ago 119m 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:46:15.507 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (119m) 7m ago 119m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:46:15.507 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:46:15.507 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (115m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:46:15.507 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:46:15.508 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:46:15.508 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:46:15.508 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:46:15.508 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:46:15.509 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:46:15.509 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:46:15.509 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:46:15.509 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:46:15.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:46:15.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:46:15.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:46:15.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:46:15.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:46:15.511 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (119m) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:46:15.511 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 118m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:46:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:15 gibba043 bash[24019]: cluster 2021-03-10T15:46:14.152401+0000 mgr.gibba043.dnkmem (mgr.34373) 6090 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:15 gibba003 bash[31385]: cluster 2021-03-10T15:46:14.152401+0000 mgr.gibba043.dnkmem (mgr.34373) 6090 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:15 gibba003 bash[32348]: cluster 2021-03-10T15:46:14.152401+0000 mgr.gibba043.dnkmem (mgr.34373) 6090 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:15.757 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:46:15.757 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:46:15.757 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:15.757 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:46:15.758 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:46:15.758 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:15.758 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:46:15.758 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:46:15.759 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:46:15.759 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:46:15.759 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:46:15.759 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:46:15.760 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:46:15.760 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:46:15.760 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:46:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:16 gibba043 bash[24019]: audit 2021-03-10T15:46:15.267614+0000 mgr.gibba043.dnkmem (mgr.34373) 6091 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:16 gibba043 bash[24019]: audit 2021-03-10T15:46:15.492419+0000 mgr.gibba043.dnkmem (mgr.34373) 6092 : audit [DBG] from='client.58132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:16.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:16 gibba043 bash[24019]: audit 2021-03-10T15:46:15.756879+0000 mon.a (mon.0) 1425 : audit [DBG] from='client.? 172.21.2.103:0/1393201502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:16.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:16 gibba003 bash[31385]: audit 2021-03-10T15:46:15.267614+0000 mgr.gibba043.dnkmem (mgr.34373) 6091 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:16.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:16 gibba003 bash[31385]: audit 2021-03-10T15:46:15.492419+0000 mgr.gibba043.dnkmem (mgr.34373) 6092 : audit [DBG] from='client.58132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:16.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:16 gibba003 bash[31385]: audit 2021-03-10T15:46:15.756879+0000 mon.a (mon.0) 1425 : audit [DBG] from='client.? 172.21.2.103:0/1393201502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:16 gibba003 bash[32348]: audit 2021-03-10T15:46:15.267614+0000 mgr.gibba043.dnkmem (mgr.34373) 6091 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:16 gibba003 bash[32348]: audit 2021-03-10T15:46:15.492419+0000 mgr.gibba043.dnkmem (mgr.34373) 6092 : audit [DBG] from='client.58132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:16 gibba003 bash[32348]: audit 2021-03-10T15:46:15.756879+0000 mon.a (mon.0) 1425 : audit [DBG] from='client.? 172.21.2.103:0/1393201502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:17 gibba043 bash[24019]: cluster 2021-03-10T15:46:16.154295+0000 mgr.gibba043.dnkmem (mgr.34373) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:17 gibba003 bash[31385]: cluster 2021-03-10T15:46:16.154295+0000 mgr.gibba043.dnkmem (mgr.34373) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:17 gibba003 bash[32348]: cluster 2021-03-10T15:46:16.154295+0000 mgr.gibba043.dnkmem (mgr.34373) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:19 gibba043 bash[24019]: cluster 2021-03-10T15:46:18.155825+0000 mgr.gibba043.dnkmem (mgr.34373) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:19 gibba003 bash[31385]: cluster 2021-03-10T15:46:18.155825+0000 mgr.gibba043.dnkmem (mgr.34373) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:19 gibba003 bash[32348]: cluster 2021-03-10T15:46:18.155825+0000 mgr.gibba043.dnkmem (mgr.34373) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:21 gibba003 bash[32348]: cluster 2021-03-10T15:46:20.157546+0000 mgr.gibba043.dnkmem (mgr.34373) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:21.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:21 gibba003 bash[31385]: cluster 2021-03-10T15:46:20.157546+0000 mgr.gibba043.dnkmem (mgr.34373) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:21 gibba043 bash[24019]: cluster 2021-03-10T15:46:20.157546+0000 mgr.gibba043.dnkmem (mgr.34373) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:23 gibba043 bash[24019]: cluster 2021-03-10T15:46:22.158921+0000 mgr.gibba043.dnkmem (mgr.34373) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:23 gibba003 bash[31385]: cluster 2021-03-10T15:46:22.158921+0000 mgr.gibba043.dnkmem (mgr.34373) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:23 gibba003 bash[32348]: cluster 2021-03-10T15:46:22.158921+0000 mgr.gibba043.dnkmem (mgr.34373) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:24 gibba043 bash[24019]: cephadm 2021-03-10T15:46:22.813825+0000 mgr.gibba043.dnkmem (mgr.34373) 6097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:24 gibba003 bash[31385]: cephadm 2021-03-10T15:46:22.813825+0000 mgr.gibba043.dnkmem (mgr.34373) 6097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:24 gibba003 bash[32348]: cephadm 2021-03-10T15:46:22.813825+0000 mgr.gibba043.dnkmem (mgr.34373) 6097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:25 gibba043 bash[24019]: cluster 2021-03-10T15:46:24.160591+0000 mgr.gibba043.dnkmem (mgr.34373) 6098 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:25.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:25 gibba003 bash[31385]: cluster 2021-03-10T15:46:24.160591+0000 mgr.gibba043.dnkmem (mgr.34373) 6098 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:25.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:25 gibba003 bash[32348]: cluster 2021-03-10T15:46:24.160591+0000 mgr.gibba043.dnkmem (mgr.34373) 6098 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:27 gibba043 bash[24019]: cluster 2021-03-10T15:46:26.162562+0000 mgr.gibba043.dnkmem (mgr.34373) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:27 gibba003 bash[31385]: cluster 2021-03-10T15:46:26.162562+0000 mgr.gibba043.dnkmem (mgr.34373) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:27.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:27 gibba003 bash[32348]: cluster 2021-03-10T15:46:26.162562+0000 mgr.gibba043.dnkmem (mgr.34373) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:29 gibba043 bash[24019]: cluster 2021-03-10T15:46:28.164173+0000 mgr.gibba043.dnkmem (mgr.34373) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:29 gibba003 bash[31385]: cluster 2021-03-10T15:46:28.164173+0000 mgr.gibba043.dnkmem (mgr.34373) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:29 gibba003 bash[32348]: cluster 2021-03-10T15:46:28.164173+0000 mgr.gibba043.dnkmem (mgr.34373) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:31 gibba003 bash[31385]: cluster 2021-03-10T15:46:30.165576+0000 mgr.gibba043.dnkmem (mgr.34373) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:31 gibba003 bash[32348]: cluster 2021-03-10T15:46:30.165576+0000 mgr.gibba043.dnkmem (mgr.34373) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:31 gibba043 bash[24019]: cluster 2021-03-10T15:46:30.165576+0000 mgr.gibba043.dnkmem (mgr.34373) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:33 gibba043 bash[24019]: cluster 2021-03-10T15:46:32.167283+0000 mgr.gibba043.dnkmem (mgr.34373) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:33 gibba003 bash[31385]: cluster 2021-03-10T15:46:32.167283+0000 mgr.gibba043.dnkmem (mgr.34373) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:33 gibba003 bash[32348]: cluster 2021-03-10T15:46:32.167283+0000 mgr.gibba043.dnkmem (mgr.34373) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:35 gibba043 bash[24019]: cluster 2021-03-10T15:46:34.168835+0000 mgr.gibba043.dnkmem (mgr.34373) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:35 gibba003 bash[31385]: cluster 2021-03-10T15:46:34.168835+0000 mgr.gibba043.dnkmem (mgr.34373) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:35 gibba003 bash[32348]: cluster 2021-03-10T15:46:34.168835+0000 mgr.gibba043.dnkmem (mgr.34373) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:37 gibba043 bash[24019]: cluster 2021-03-10T15:46:36.170806+0000 mgr.gibba043.dnkmem (mgr.34373) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:37 gibba003 bash[31385]: cluster 2021-03-10T15:46:36.170806+0000 mgr.gibba043.dnkmem (mgr.34373) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:37 gibba003 bash[32348]: cluster 2021-03-10T15:46:36.170806+0000 mgr.gibba043.dnkmem (mgr.34373) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:38 gibba043 bash[24019]: audit 2021-03-10T15:46:37.834095+0000 mon.c (mon.1) 1585 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:46:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:38 gibba003 bash[31385]: audit 2021-03-10T15:46:37.834095+0000 mon.c (mon.1) 1585 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:46:38.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:38 gibba003 bash[32348]: audit 2021-03-10T15:46:37.834095+0000 mon.c (mon.1) 1585 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:46:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:39 gibba043 bash[24019]: cephadm 2021-03-10T15:46:37.831356+0000 mgr.gibba043.dnkmem (mgr.34373) 6105 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:46:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:39 gibba043 bash[24019]: cluster 2021-03-10T15:46:38.172250+0000 mgr.gibba043.dnkmem (mgr.34373) 6106 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:39.637 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:39 gibba003 bash[31385]: cephadm 2021-03-10T15:46:37.831356+0000 mgr.gibba043.dnkmem (mgr.34373) 6105 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:46:39.637 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:39 gibba003 bash[31385]: cluster 2021-03-10T15:46:38.172250+0000 mgr.gibba043.dnkmem (mgr.34373) 6106 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:39.638 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:39 gibba003 bash[32348]: cephadm 2021-03-10T15:46:37.831356+0000 mgr.gibba043.dnkmem (mgr.34373) 6105 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:46:39.638 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:39 gibba003 bash[32348]: cluster 2021-03-10T15:46:38.172250+0000 mgr.gibba043.dnkmem (mgr.34373) 6106 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:41 gibba003 bash[31385]: cluster 2021-03-10T15:46:40.173993+0000 mgr.gibba043.dnkmem (mgr.34373) 6107 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:41 gibba003 bash[32348]: cluster 2021-03-10T15:46:40.173993+0000 mgr.gibba043.dnkmem (mgr.34373) 6107 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:41 gibba043 bash[24019]: cluster 2021-03-10T15:46:40.173993+0000 mgr.gibba043.dnkmem (mgr.34373) 6107 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cluster 2021-03-10T15:46:42.175558+0000 mgr.gibba043.dnkmem (mgr.34373) 6108 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.310476+0000 mon.c (mon.1) 1586 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.484451+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:46:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.484624+0000 mgr.gibba043.dnkmem (mgr.34373) 6109 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:46:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.677056+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:46:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.681821+0000 mgr.gibba043.dnkmem (mgr.34373) 6110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.683804+0000 mgr.gibba043.dnkmem (mgr.34373) 6111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.684874+0000 mon.c (mon.1) 1587 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.686113+0000 mon.c (mon.1) 1588 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.686328+0000 mgr.gibba043.dnkmem (mgr.34373) 6112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.686774+0000 mgr.gibba043.dnkmem (mgr.34373) 6113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.690325+0000 mgr.gibba043.dnkmem (mgr.34373) 6114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.690409+0000 mon.c (mon.1) 1589 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.690606+0000 mgr.gibba043.dnkmem (mgr.34373) 6115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.693468+0000 mon.c (mon.1) 1590 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.693508+0000 mgr.gibba043.dnkmem (mgr.34373) 6116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.696933+0000 mgr.gibba043.dnkmem (mgr.34373) 6117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.697129+0000 mgr.gibba043.dnkmem (mgr.34373) 6118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.700766+0000 mon.c (mon.1) 1591 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.700914+0000 mgr.gibba043.dnkmem (mgr.34373) 6119 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.703194+0000 mgr.gibba043.dnkmem (mgr.34373) 6120 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: audit 2021-03-10T15:46:42.706062+0000 mon.c (mon.1) 1592 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.706284+0000 mgr.gibba043.dnkmem (mgr.34373) 6121 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.706542+0000 mgr.gibba043.dnkmem (mgr.34373) 6122 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:43 gibba043 bash[24019]: cephadm 2021-03-10T15:46:42.707137+0000 mgr.gibba043.dnkmem (mgr.34373) 6123 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:43.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cluster 2021-03-10T15:46:42.175558+0000 mgr.gibba043.dnkmem (mgr.34373) 6108 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.310476+0000 mon.c (mon.1) 1586 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.484451+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:46:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.484624+0000 mgr.gibba043.dnkmem (mgr.34373) 6109 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:46:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.677056+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:46:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.681821+0000 mgr.gibba043.dnkmem (mgr.34373) 6110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.683804+0000 mgr.gibba043.dnkmem (mgr.34373) 6111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.684874+0000 mon.c (mon.1) 1587 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.686113+0000 mon.c (mon.1) 1588 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.686328+0000 mgr.gibba043.dnkmem (mgr.34373) 6112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:43.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.686774+0000 mgr.gibba043.dnkmem (mgr.34373) 6113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:43.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.690325+0000 mgr.gibba043.dnkmem (mgr.34373) 6114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:43.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.690409+0000 mon.c (mon.1) 1589 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.690606+0000 mgr.gibba043.dnkmem (mgr.34373) 6115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:43.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.693468+0000 mon.c (mon.1) 1590 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.693508+0000 mgr.gibba043.dnkmem (mgr.34373) 6116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:43.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.696933+0000 mgr.gibba043.dnkmem (mgr.34373) 6117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:43.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.697129+0000 mgr.gibba043.dnkmem (mgr.34373) 6118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:43.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.700766+0000 mon.c (mon.1) 1591 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.700914+0000 mgr.gibba043.dnkmem (mgr.34373) 6119 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:43.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cluster 2021-03-10T15:46:42.175558+0000 mgr.gibba043.dnkmem (mgr.34373) 6108 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.310476+0000 mon.c (mon.1) 1586 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:43.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.484451+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:46:43.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.484624+0000 mgr.gibba043.dnkmem (mgr.34373) 6109 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:46:43.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.677056+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:46:43.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.681821+0000 mgr.gibba043.dnkmem (mgr.34373) 6110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:43.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.683804+0000 mgr.gibba043.dnkmem (mgr.34373) 6111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:43.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.684874+0000 mon.c (mon.1) 1587 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:43.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.686113+0000 mon.c (mon.1) 1588 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.686328+0000 mgr.gibba043.dnkmem (mgr.34373) 6112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:43.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.686774+0000 mgr.gibba043.dnkmem (mgr.34373) 6113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:43.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.690325+0000 mgr.gibba043.dnkmem (mgr.34373) 6114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:43.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.690409+0000 mon.c (mon.1) 1589 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.690606+0000 mgr.gibba043.dnkmem (mgr.34373) 6115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:43.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.693468+0000 mon.c (mon.1) 1590 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.693508+0000 mgr.gibba043.dnkmem (mgr.34373) 6116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:43.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.696933+0000 mgr.gibba043.dnkmem (mgr.34373) 6117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:43.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.697129+0000 mgr.gibba043.dnkmem (mgr.34373) 6118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:43.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.700766+0000 mon.c (mon.1) 1591 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.700914+0000 mgr.gibba043.dnkmem (mgr.34373) 6119 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:43.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.703194+0000 mgr.gibba043.dnkmem (mgr.34373) 6120 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:43.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: audit 2021-03-10T15:46:42.706062+0000 mon.c (mon.1) 1592 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.706284+0000 mgr.gibba043.dnkmem (mgr.34373) 6121 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:43.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.706542+0000 mgr.gibba043.dnkmem (mgr.34373) 6122 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:43.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[31385]: cephadm 2021-03-10T15:46:42.707137+0000 mgr.gibba043.dnkmem (mgr.34373) 6123 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:43.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.703194+0000 mgr.gibba043.dnkmem (mgr.34373) 6120 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:43.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: audit 2021-03-10T15:46:42.706062+0000 mon.c (mon.1) 1592 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:43.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.706284+0000 mgr.gibba043.dnkmem (mgr.34373) 6121 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:43.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.706542+0000 mgr.gibba043.dnkmem (mgr.34373) 6122 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:43.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:43 gibba003 bash[32348]: cephadm 2021-03-10T15:46:42.707137+0000 mgr.gibba043.dnkmem (mgr.34373) 6123 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:45.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:45 gibba043 bash[24019]: cluster 2021-03-10T15:46:44.177013+0000 mgr.gibba043.dnkmem (mgr.34373) 6124 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:45.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:45 gibba003 bash[31385]: cluster 2021-03-10T15:46:44.177013+0000 mgr.gibba043.dnkmem (mgr.34373) 6124 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:45.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:45 gibba003 bash[32348]: cluster 2021-03-10T15:46:44.177013+0000 mgr.gibba043.dnkmem (mgr.34373) 6124 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:46.002 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:46:46.231 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:46:46.232 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (115m) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:46:46.232 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:46:46.232 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:46:46.232 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:46:46.232 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:46:46.233 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:46:46.233 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:46:46.233 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:46:46.233 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:46:46.233 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:46:46.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:46:46.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:46:46.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:46:46.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:46:46.235 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:46:46.235 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:46:46.235 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:46:46.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:46:46.236 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (119m) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:46:46.236 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 118m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:46:46.487 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:46:46.488 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:46:46.488 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:46.488 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:46:46.488 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:46:46.489 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:46.489 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:46:46.489 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:46:46.489 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:46:46.490 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:46:46.490 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:46:46.490 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:46:46.490 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:46:46.491 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:46:46.491 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:46:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:47 gibba043 bash[24019]: audit 2021-03-10T15:46:45.990554+0000 mgr.gibba043.dnkmem (mgr.34373) 6125 : audit [DBG] from='client.48156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:47 gibba043 bash[24019]: cluster 2021-03-10T15:46:46.178934+0000 mgr.gibba043.dnkmem (mgr.34373) 6126 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:47 gibba043 bash[24019]: audit 2021-03-10T15:46:46.217817+0000 mgr.gibba043.dnkmem (mgr.34373) 6127 : audit [DBG] from='client.48162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:47 gibba043 bash[24019]: audit 2021-03-10T15:46:46.487590+0000 mon.a (mon.0) 1428 : audit [DBG] from='client.? 172.21.2.103:0/1935076982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:47.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[31385]: audit 2021-03-10T15:46:45.990554+0000 mgr.gibba043.dnkmem (mgr.34373) 6125 : audit [DBG] from='client.48156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:47.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[31385]: cluster 2021-03-10T15:46:46.178934+0000 mgr.gibba043.dnkmem (mgr.34373) 6126 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:47.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[31385]: audit 2021-03-10T15:46:46.217817+0000 mgr.gibba043.dnkmem (mgr.34373) 6127 : audit [DBG] from='client.48162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[31385]: audit 2021-03-10T15:46:46.487590+0000 mon.a (mon.0) 1428 : audit [DBG] from='client.? 172.21.2.103:0/1935076982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[32348]: audit 2021-03-10T15:46:45.990554+0000 mgr.gibba043.dnkmem (mgr.34373) 6125 : audit [DBG] from='client.48156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[32348]: cluster 2021-03-10T15:46:46.178934+0000 mgr.gibba043.dnkmem (mgr.34373) 6126 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[32348]: audit 2021-03-10T15:46:46.217817+0000 mgr.gibba043.dnkmem (mgr.34373) 6127 : audit [DBG] from='client.48162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:47 gibba003 bash[32348]: audit 2021-03-10T15:46:46.487590+0000 mon.a (mon.0) 1428 : audit [DBG] from='client.? 172.21.2.103:0/1935076982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:49 gibba043 bash[24019]: cluster 2021-03-10T15:46:48.180346+0000 mgr.gibba043.dnkmem (mgr.34373) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:49 gibba003 bash[31385]: cluster 2021-03-10T15:46:48.180346+0000 mgr.gibba043.dnkmem (mgr.34373) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:49 gibba003 bash[32348]: cluster 2021-03-10T15:46:48.180346+0000 mgr.gibba043.dnkmem (mgr.34373) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:51 gibba003 bash[32348]: cluster 2021-03-10T15:46:50.182002+0000 mgr.gibba043.dnkmem (mgr.34373) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:51 gibba003 bash[31385]: cluster 2021-03-10T15:46:50.182002+0000 mgr.gibba043.dnkmem (mgr.34373) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:51 gibba043 bash[24019]: cluster 2021-03-10T15:46:50.182002+0000 mgr.gibba043.dnkmem (mgr.34373) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:53 gibba043 bash[24019]: cluster 2021-03-10T15:46:52.183604+0000 mgr.gibba043.dnkmem (mgr.34373) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:53 gibba003 bash[31385]: cluster 2021-03-10T15:46:52.183604+0000 mgr.gibba043.dnkmem (mgr.34373) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:53 gibba003 bash[32348]: cluster 2021-03-10T15:46:52.183604+0000 mgr.gibba043.dnkmem (mgr.34373) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:55 gibba043 bash[24019]: cluster 2021-03-10T15:46:54.184955+0000 mgr.gibba043.dnkmem (mgr.34373) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:55 gibba003 bash[31385]: cluster 2021-03-10T15:46:54.184955+0000 mgr.gibba043.dnkmem (mgr.34373) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:55 gibba003 bash[32348]: cluster 2021-03-10T15:46:54.184955+0000 mgr.gibba043.dnkmem (mgr.34373) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:57 gibba043 bash[24019]: cluster 2021-03-10T15:46:56.186730+0000 mgr.gibba043.dnkmem (mgr.34373) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:57 gibba003 bash[31385]: cluster 2021-03-10T15:46:56.186730+0000 mgr.gibba043.dnkmem (mgr.34373) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:57 gibba003 bash[32348]: cluster 2021-03-10T15:46:56.186730+0000 mgr.gibba043.dnkmem (mgr.34373) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:58.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:58 gibba003 bash[31385]: cephadm 2021-03-10T15:46:57.722843+0000 mgr.gibba043.dnkmem (mgr.34373) 6133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:58.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:58 gibba003 bash[32348]: cephadm 2021-03-10T15:46:57.722843+0000 mgr.gibba043.dnkmem (mgr.34373) 6133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:58.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:58 gibba043 bash[24019]: cephadm 2021-03-10T15:46:57.722843+0000 mgr.gibba043.dnkmem (mgr.34373) 6133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:46:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:46:59 gibba003 bash[31385]: cluster 2021-03-10T15:46:58.188167+0000 mgr.gibba043.dnkmem (mgr.34373) 6134 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:46:59 gibba003 bash[32348]: cluster 2021-03-10T15:46:58.188167+0000 mgr.gibba043.dnkmem (mgr.34373) 6134 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:46:59 gibba043 bash[24019]: cluster 2021-03-10T15:46:58.188167+0000 mgr.gibba043.dnkmem (mgr.34373) 6134 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:01 gibba003 bash[32348]: cluster 2021-03-10T15:47:00.189550+0000 mgr.gibba043.dnkmem (mgr.34373) 6135 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:01.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:01 gibba003 bash[31385]: cluster 2021-03-10T15:47:00.189550+0000 mgr.gibba043.dnkmem (mgr.34373) 6135 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:01 gibba043 bash[24019]: cluster 2021-03-10T15:47:00.189550+0000 mgr.gibba043.dnkmem (mgr.34373) 6135 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:03 gibba043 bash[24019]: cluster 2021-03-10T15:47:02.191264+0000 mgr.gibba043.dnkmem (mgr.34373) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:03 gibba003 bash[31385]: cluster 2021-03-10T15:47:02.191264+0000 mgr.gibba043.dnkmem (mgr.34373) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:03 gibba003 bash[32348]: cluster 2021-03-10T15:47:02.191264+0000 mgr.gibba043.dnkmem (mgr.34373) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:05 gibba043 bash[24019]: cluster 2021-03-10T15:47:04.192844+0000 mgr.gibba043.dnkmem (mgr.34373) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:05 gibba003 bash[31385]: cluster 2021-03-10T15:47:04.192844+0000 mgr.gibba043.dnkmem (mgr.34373) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:05 gibba003 bash[32348]: cluster 2021-03-10T15:47:04.192844+0000 mgr.gibba043.dnkmem (mgr.34373) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:07 gibba003 bash[31385]: cluster 2021-03-10T15:47:06.194760+0000 mgr.gibba043.dnkmem (mgr.34373) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:07 gibba003 bash[32348]: cluster 2021-03-10T15:47:06.194760+0000 mgr.gibba043.dnkmem (mgr.34373) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:07 gibba043 bash[24019]: cluster 2021-03-10T15:47:06.194760+0000 mgr.gibba043.dnkmem (mgr.34373) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:09 gibba003 bash[31385]: cluster 2021-03-10T15:47:08.196339+0000 mgr.gibba043.dnkmem (mgr.34373) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:09 gibba003 bash[32348]: cluster 2021-03-10T15:47:08.196339+0000 mgr.gibba043.dnkmem (mgr.34373) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:09.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:09 gibba043 bash[24019]: cluster 2021-03-10T15:47:08.196339+0000 mgr.gibba043.dnkmem (mgr.34373) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:11 gibba003 bash[32348]: cluster 2021-03-10T15:47:10.197755+0000 mgr.gibba043.dnkmem (mgr.34373) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:11 gibba003 bash[31385]: cluster 2021-03-10T15:47:10.197755+0000 mgr.gibba043.dnkmem (mgr.34373) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:11 gibba043 bash[24019]: cluster 2021-03-10T15:47:10.197755+0000 mgr.gibba043.dnkmem (mgr.34373) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:13 gibba043 bash[24019]: cluster 2021-03-10T15:47:12.199220+0000 mgr.gibba043.dnkmem (mgr.34373) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:13 gibba043 bash[24019]: cephadm 2021-03-10T15:47:12.738868+0000 mgr.gibba043.dnkmem (mgr.34373) 6142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:13 gibba003 bash[31385]: cluster 2021-03-10T15:47:12.199220+0000 mgr.gibba043.dnkmem (mgr.34373) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:13 gibba003 bash[31385]: cephadm 2021-03-10T15:47:12.738868+0000 mgr.gibba043.dnkmem (mgr.34373) 6142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:13 gibba003 bash[32348]: cluster 2021-03-10T15:47:12.199220+0000 mgr.gibba043.dnkmem (mgr.34373) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:13 gibba003 bash[32348]: cephadm 2021-03-10T15:47:12.738868+0000 mgr.gibba043.dnkmem (mgr.34373) 6142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.460266+0000 mon.c (mon.1) 1593 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.461423+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.610117+0000 mon.c (mon.1) 1594 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.611300+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.721576+0000 mon.c (mon.1) 1595 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:47:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.722339+0000 mon.c (mon.1) 1596 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:47:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.722829+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:47:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.723062+0000 mon.c (mon.1) 1597 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.723747+0000 mon.c (mon.1) 1598 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.724297+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:47:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.725365+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[31385]: audit 2021-03-10T15:47:13.726169+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.460266+0000 mon.c (mon.1) 1593 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.461423+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.610117+0000 mon.c (mon.1) 1594 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.611300+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.721576+0000 mon.c (mon.1) 1595 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:47:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.722339+0000 mon.c (mon.1) 1596 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:47:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.722829+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:47:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.723062+0000 mon.c (mon.1) 1597 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.723747+0000 mon.c (mon.1) 1598 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.724297+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:47:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.725365+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:14 gibba003 bash[32348]: audit 2021-03-10T15:47:13.726169+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.460266+0000 mon.c (mon.1) 1593 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.461423+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.610117+0000 mon.c (mon.1) 1594 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.611300+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.721576+0000 mon.c (mon.1) 1595 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:47:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.722339+0000 mon.c (mon.1) 1596 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:47:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.722829+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:47:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.723062+0000 mon.c (mon.1) 1597 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.723747+0000 mon.c (mon.1) 1598 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.724297+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:47:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.725365+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:47:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:14 gibba043 bash[24019]: audit 2021-03-10T15:47:13.726169+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:15 gibba003 bash[31385]: cluster 2021-03-10T15:47:14.200900+0000 mgr.gibba043.dnkmem (mgr.34373) 6143 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:15 gibba003 bash[32348]: cluster 2021-03-10T15:47:14.200900+0000 mgr.gibba043.dnkmem (mgr.34373) 6143 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:15 gibba043 bash[24019]: cluster 2021-03-10T15:47:14.200900+0000 mgr.gibba043.dnkmem (mgr.34373) 6143 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:16.755 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:47:16.984 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:47:16.984 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (115m) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:47:16.985 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:47:16.985 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:47:16.985 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (116m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:47:16.985 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:47:16.986 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:47:16.986 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:47:16.986 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:47:16.986 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:47:16.987 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:47:16.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:47:16.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:47:16.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:47:16.987 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:47:16.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:47:16.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:47:16.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:47:16.988 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:47:16.989 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:47:16.989 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 119m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:47:17.235 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:47:17.236 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:47:17.236 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:17.236 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:47:17.236 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:47:17.237 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:17.237 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:47:17.237 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:47:17.237 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:47:17.237 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:47:17.238 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:47:17.238 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:47:17.238 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:47:17.238 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:47:17.239 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:47:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:17 gibba003 bash[31385]: cluster 2021-03-10T15:47:16.202840+0000 mgr.gibba043.dnkmem (mgr.34373) 6144 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:17 gibba003 bash[31385]: audit 2021-03-10T15:47:16.744062+0000 mgr.gibba043.dnkmem (mgr.34373) 6145 : audit [DBG] from='client.48174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:17 gibba003 bash[31385]: audit 2021-03-10T15:47:17.235898+0000 mon.a (mon.0) 1435 : audit [DBG] from='client.? 172.21.2.103:0/209267120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:17 gibba003 bash[32348]: cluster 2021-03-10T15:47:16.202840+0000 mgr.gibba043.dnkmem (mgr.34373) 6144 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:17 gibba003 bash[32348]: audit 2021-03-10T15:47:16.744062+0000 mgr.gibba043.dnkmem (mgr.34373) 6145 : audit [DBG] from='client.48174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:17 gibba003 bash[32348]: audit 2021-03-10T15:47:17.235898+0000 mon.a (mon.0) 1435 : audit [DBG] from='client.? 172.21.2.103:0/209267120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:17 gibba043 bash[24019]: cluster 2021-03-10T15:47:16.202840+0000 mgr.gibba043.dnkmem (mgr.34373) 6144 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:17 gibba043 bash[24019]: audit 2021-03-10T15:47:16.744062+0000 mgr.gibba043.dnkmem (mgr.34373) 6145 : audit [DBG] from='client.48174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:17 gibba043 bash[24019]: audit 2021-03-10T15:47:17.235898+0000 mon.a (mon.0) 1435 : audit [DBG] from='client.? 172.21.2.103:0/209267120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:18.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:18 gibba003 bash[31385]: audit 2021-03-10T15:47:16.970347+0000 mgr.gibba043.dnkmem (mgr.34373) 6146 : audit [DBG] from='client.48180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:18.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:18 gibba003 bash[32348]: audit 2021-03-10T15:47:16.970347+0000 mgr.gibba043.dnkmem (mgr.34373) 6146 : audit [DBG] from='client.48180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:18 gibba043 bash[24019]: audit 2021-03-10T15:47:16.970347+0000 mgr.gibba043.dnkmem (mgr.34373) 6146 : audit [DBG] from='client.48180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:19 gibba003 bash[31385]: cluster 2021-03-10T15:47:18.204147+0000 mgr.gibba043.dnkmem (mgr.34373) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:19 gibba003 bash[32348]: cluster 2021-03-10T15:47:18.204147+0000 mgr.gibba043.dnkmem (mgr.34373) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:19 gibba043 bash[24019]: cluster 2021-03-10T15:47:18.204147+0000 mgr.gibba043.dnkmem (mgr.34373) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:21.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:21 gibba003 bash[31385]: cluster 2021-03-10T15:47:20.205838+0000 mgr.gibba043.dnkmem (mgr.34373) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:21 gibba003 bash[32348]: cluster 2021-03-10T15:47:20.205838+0000 mgr.gibba043.dnkmem (mgr.34373) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:21 gibba043 bash[24019]: cluster 2021-03-10T15:47:20.205838+0000 mgr.gibba043.dnkmem (mgr.34373) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:23 gibba003 bash[31385]: cluster 2021-03-10T15:47:22.207430+0000 mgr.gibba043.dnkmem (mgr.34373) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:23 gibba003 bash[32348]: cluster 2021-03-10T15:47:22.207430+0000 mgr.gibba043.dnkmem (mgr.34373) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:23 gibba043 bash[24019]: cluster 2021-03-10T15:47:22.207430+0000 mgr.gibba043.dnkmem (mgr.34373) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:25.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:25 gibba003 bash[31385]: cluster 2021-03-10T15:47:24.209089+0000 mgr.gibba043.dnkmem (mgr.34373) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:25 gibba003 bash[32348]: cluster 2021-03-10T15:47:24.209089+0000 mgr.gibba043.dnkmem (mgr.34373) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:25.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:25 gibba043 bash[24019]: cluster 2021-03-10T15:47:24.209089+0000 mgr.gibba043.dnkmem (mgr.34373) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:27 gibba003 bash[31385]: cluster 2021-03-10T15:47:26.210728+0000 mgr.gibba043.dnkmem (mgr.34373) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:27 gibba003 bash[32348]: cluster 2021-03-10T15:47:26.210728+0000 mgr.gibba043.dnkmem (mgr.34373) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:27.757 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:27 gibba043 bash[24019]: cluster 2021-03-10T15:47:26.210728+0000 mgr.gibba043.dnkmem (mgr.34373) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:29 gibba003 bash[31385]: cephadm 2021-03-10T15:47:27.754935+0000 mgr.gibba043.dnkmem (mgr.34373) 6152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:29 gibba003 bash[31385]: cluster 2021-03-10T15:47:28.212170+0000 mgr.gibba043.dnkmem (mgr.34373) 6153 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:29 gibba003 bash[32348]: cephadm 2021-03-10T15:47:27.754935+0000 mgr.gibba043.dnkmem (mgr.34373) 6152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:29 gibba003 bash[32348]: cluster 2021-03-10T15:47:28.212170+0000 mgr.gibba043.dnkmem (mgr.34373) 6153 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:29 gibba043 bash[24019]: cephadm 2021-03-10T15:47:27.754935+0000 mgr.gibba043.dnkmem (mgr.34373) 6152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:29 gibba043 bash[24019]: cluster 2021-03-10T15:47:28.212170+0000 mgr.gibba043.dnkmem (mgr.34373) 6153 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:31 gibba003 bash[31385]: cluster 2021-03-10T15:47:30.213416+0000 mgr.gibba043.dnkmem (mgr.34373) 6154 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:31 gibba003 bash[32348]: cluster 2021-03-10T15:47:30.213416+0000 mgr.gibba043.dnkmem (mgr.34373) 6154 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:31 gibba043 bash[24019]: cluster 2021-03-10T15:47:30.213416+0000 mgr.gibba043.dnkmem (mgr.34373) 6154 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:33 gibba003 bash[31385]: cluster 2021-03-10T15:47:32.215018+0000 mgr.gibba043.dnkmem (mgr.34373) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:33 gibba003 bash[32348]: cluster 2021-03-10T15:47:32.215018+0000 mgr.gibba043.dnkmem (mgr.34373) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:33 gibba043 bash[24019]: cluster 2021-03-10T15:47:32.215018+0000 mgr.gibba043.dnkmem (mgr.34373) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:35 gibba003 bash[31385]: cluster 2021-03-10T15:47:34.216600+0000 mgr.gibba043.dnkmem (mgr.34373) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:35 gibba003 bash[32348]: cluster 2021-03-10T15:47:34.216600+0000 mgr.gibba043.dnkmem (mgr.34373) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:35.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:35 gibba043 bash[24019]: cluster 2021-03-10T15:47:34.216600+0000 mgr.gibba043.dnkmem (mgr.34373) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:37 gibba003 bash[31385]: cluster 2021-03-10T15:47:36.218564+0000 mgr.gibba043.dnkmem (mgr.34373) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:37 gibba003 bash[32348]: cluster 2021-03-10T15:47:36.218564+0000 mgr.gibba043.dnkmem (mgr.34373) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:37 gibba043 bash[24019]: cluster 2021-03-10T15:47:36.218564+0000 mgr.gibba043.dnkmem (mgr.34373) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:39 gibba003 bash[31385]: cluster 2021-03-10T15:47:38.220299+0000 mgr.gibba043.dnkmem (mgr.34373) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:39 gibba003 bash[32348]: cluster 2021-03-10T15:47:38.220299+0000 mgr.gibba043.dnkmem (mgr.34373) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:39 gibba043 bash[24019]: cluster 2021-03-10T15:47:38.220299+0000 mgr.gibba043.dnkmem (mgr.34373) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:41 gibba003 bash[32348]: cluster 2021-03-10T15:47:40.221508+0000 mgr.gibba043.dnkmem (mgr.34373) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:41 gibba003 bash[31385]: cluster 2021-03-10T15:47:40.221508+0000 mgr.gibba043.dnkmem (mgr.34373) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:41 gibba043 bash[24019]: cluster 2021-03-10T15:47:40.221508+0000 mgr.gibba043.dnkmem (mgr.34373) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:43 gibba003 bash[31385]: cluster 2021-03-10T15:47:42.223177+0000 mgr.gibba043.dnkmem (mgr.34373) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:43 gibba003 bash[31385]: audit 2021-03-10T15:47:42.773011+0000 mon.c (mon.1) 1599 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:47:43.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:43 gibba003 bash[32348]: cluster 2021-03-10T15:47:42.223177+0000 mgr.gibba043.dnkmem (mgr.34373) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:43 gibba003 bash[32348]: audit 2021-03-10T15:47:42.773011+0000 mon.c (mon.1) 1599 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:47:43.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:43 gibba043 bash[24019]: cluster 2021-03-10T15:47:42.223177+0000 mgr.gibba043.dnkmem (mgr.34373) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:43 gibba043 bash[24019]: audit 2021-03-10T15:47:42.773011+0000 mon.c (mon.1) 1599 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:47:44.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:44 gibba003 bash[31385]: cephadm 2021-03-10T15:47:42.770215+0000 mgr.gibba043.dnkmem (mgr.34373) 6161 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:47:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:44 gibba003 bash[32348]: cephadm 2021-03-10T15:47:42.770215+0000 mgr.gibba043.dnkmem (mgr.34373) 6161 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:47:44.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:44 gibba043 bash[24019]: cephadm 2021-03-10T15:47:42.770215+0000 mgr.gibba043.dnkmem (mgr.34373) 6161 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:47:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:45 gibba003 bash[31385]: cluster 2021-03-10T15:47:44.224838+0000 mgr.gibba043.dnkmem (mgr.34373) 6162 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:45.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:45 gibba003 bash[32348]: cluster 2021-03-10T15:47:44.224838+0000 mgr.gibba043.dnkmem (mgr.34373) 6162 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:45.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:45 gibba043 bash[24019]: cluster 2021-03-10T15:47:44.224838+0000 mgr.gibba043.dnkmem (mgr.34373) 6162 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.480 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:47:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cluster 2021-03-10T15:47:46.226828+0000 mgr.gibba043.dnkmem (mgr.34373) 6163 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.261975+0000 mgr.gibba043.dnkmem (mgr.34373) 6164 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:47:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.262942+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:47:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.513521+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:47:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.518333+0000 mgr.gibba043.dnkmem (mgr.34373) 6165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.521334+0000 mon.c (mon.1) 1600 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.523192+0000 mgr.gibba043.dnkmem (mgr.34373) 6166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.526464+0000 mon.c (mon.1) 1601 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.528236+0000 mgr.gibba043.dnkmem (mgr.34373) 6167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.528475+0000 mgr.gibba043.dnkmem (mgr.34373) 6168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.531728+0000 mon.c (mon.1) 1602 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.532754+0000 mgr.gibba043.dnkmem (mgr.34373) 6169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.533047+0000 mgr.gibba043.dnkmem (mgr.34373) 6170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.535862+0000 mon.c (mon.1) 1603 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.537509+0000 mgr.gibba043.dnkmem (mgr.34373) 6171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.543338+0000 mgr.gibba043.dnkmem (mgr.34373) 6172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:47.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.543574+0000 mgr.gibba043.dnkmem (mgr.34373) 6173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.547347+0000 mon.c (mon.1) 1604 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.548669+0000 mgr.gibba043.dnkmem (mgr.34373) 6174 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.550705+0000 mgr.gibba043.dnkmem (mgr.34373) 6175 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:47.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: audit 2021-03-10T15:47:46.554084+0000 mon.c (mon.1) 1605 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.555791+0000 mgr.gibba043.dnkmem (mgr.34373) 6176 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:47.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.556316+0000 mgr.gibba043.dnkmem (mgr.34373) 6177 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:47.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:47 gibba043 bash[24019]: cephadm 2021-03-10T15:47:46.557208+0000 mgr.gibba043.dnkmem (mgr.34373) 6178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cluster 2021-03-10T15:47:46.226828+0000 mgr.gibba043.dnkmem (mgr.34373) 6163 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.261975+0000 mgr.gibba043.dnkmem (mgr.34373) 6164 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:47:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.262942+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:47:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.513521+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:47:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.518333+0000 mgr.gibba043.dnkmem (mgr.34373) 6165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.521334+0000 mon.c (mon.1) 1600 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.523192+0000 mgr.gibba043.dnkmem (mgr.34373) 6166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.526464+0000 mon.c (mon.1) 1601 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.528236+0000 mgr.gibba043.dnkmem (mgr.34373) 6167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.528475+0000 mgr.gibba043.dnkmem (mgr.34373) 6168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.531728+0000 mon.c (mon.1) 1602 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.532754+0000 mgr.gibba043.dnkmem (mgr.34373) 6169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.533047+0000 mgr.gibba043.dnkmem (mgr.34373) 6170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.535862+0000 mon.c (mon.1) 1603 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.537509+0000 mgr.gibba043.dnkmem (mgr.34373) 6171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.543338+0000 mgr.gibba043.dnkmem (mgr.34373) 6172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.543574+0000 mgr.gibba043.dnkmem (mgr.34373) 6173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.547347+0000 mon.c (mon.1) 1604 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.548669+0000 mgr.gibba043.dnkmem (mgr.34373) 6174 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:47.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.550705+0000 mgr.gibba043.dnkmem (mgr.34373) 6175 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:47.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: audit 2021-03-10T15:47:46.554084+0000 mon.c (mon.1) 1605 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.555791+0000 mgr.gibba043.dnkmem (mgr.34373) 6176 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:47.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.556316+0000 mgr.gibba043.dnkmem (mgr.34373) 6177 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:47.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[32348]: cephadm 2021-03-10T15:47:46.557208+0000 mgr.gibba043.dnkmem (mgr.34373) 6178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:47.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cluster 2021-03-10T15:47:46.226828+0000 mgr.gibba043.dnkmem (mgr.34373) 6163 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.261975+0000 mgr.gibba043.dnkmem (mgr.34373) 6164 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:47:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.262942+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:47:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.513521+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:47:47.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.518333+0000 mgr.gibba043.dnkmem (mgr.34373) 6165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.521334+0000 mon.c (mon.1) 1600 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.523192+0000 mgr.gibba043.dnkmem (mgr.34373) 6166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.526464+0000 mon.c (mon.1) 1601 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.528236+0000 mgr.gibba043.dnkmem (mgr.34373) 6167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:47.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.528475+0000 mgr.gibba043.dnkmem (mgr.34373) 6168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.531728+0000 mon.c (mon.1) 1602 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.532754+0000 mgr.gibba043.dnkmem (mgr.34373) 6169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.533047+0000 mgr.gibba043.dnkmem (mgr.34373) 6170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:47.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.535862+0000 mon.c (mon.1) 1603 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.537509+0000 mgr.gibba043.dnkmem (mgr.34373) 6171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:47.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.543338+0000 mgr.gibba043.dnkmem (mgr.34373) 6172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:47.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.543574+0000 mgr.gibba043.dnkmem (mgr.34373) 6173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:47.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.547347+0000 mon.c (mon.1) 1604 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.548669+0000 mgr.gibba043.dnkmem (mgr.34373) 6174 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:47.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.550705+0000 mgr.gibba043.dnkmem (mgr.34373) 6175 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:47.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: audit 2021-03-10T15:47:46.554084+0000 mon.c (mon.1) 1605 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:47.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.555791+0000 mgr.gibba043.dnkmem (mgr.34373) 6176 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:47.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.556316+0000 mgr.gibba043.dnkmem (mgr.34373) 6177 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:47.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:47 gibba003 bash[31385]: cephadm 2021-03-10T15:47:46.557208+0000 mgr.gibba043.dnkmem (mgr.34373) 6178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:47:47.739 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:47:47.739 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (116m) 1s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:47:47.740 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:47:47.740 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (116m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:47:47.740 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (116m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:47:47.740 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (115m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:47:47.740 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (115m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:47:47.741 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:47:47.741 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (115m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:47:47.741 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 1s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:47:47.741 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:47:47.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (114m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:47:47.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (114m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:47:47.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (113m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:47:47.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (113m) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:47:47.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:47:47.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:47:47.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:47:47.743 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:47:47.743 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:47:47.743 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 1s ago 119m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:47:48.053 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:47:48.054 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:47:48.054 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:48.054 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:47:48.055 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:47:48.055 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:48.055 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:47:48.055 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:47:48.056 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:47:48.056 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:47:48.056 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:47:48.056 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:47:48.056 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:47:48.057 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:47:48.057 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:47:48.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:48 gibba003 bash[31385]: audit 2021-03-10T15:47:47.469535+0000 mgr.gibba043.dnkmem (mgr.34373) 6179 : audit [DBG] from='client.48192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:48.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:48 gibba003 bash[31385]: audit 2021-03-10T15:47:47.696901+0000 mgr.gibba043.dnkmem (mgr.34373) 6180 : audit [DBG] from='client.58186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:48.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:48 gibba003 bash[31385]: audit 2021-03-10T15:47:48.053950+0000 mon.a (mon.0) 1438 : audit [DBG] from='client.? 172.21.2.103:0/3116087249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:48.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:48 gibba003 bash[32348]: audit 2021-03-10T15:47:47.469535+0000 mgr.gibba043.dnkmem (mgr.34373) 6179 : audit [DBG] from='client.48192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:48.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:48 gibba003 bash[32348]: audit 2021-03-10T15:47:47.696901+0000 mgr.gibba043.dnkmem (mgr.34373) 6180 : audit [DBG] from='client.58186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:48.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:48 gibba003 bash[32348]: audit 2021-03-10T15:47:48.053950+0000 mon.a (mon.0) 1438 : audit [DBG] from='client.? 172.21.2.103:0/3116087249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:48.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:48 gibba043 bash[24019]: audit 2021-03-10T15:47:47.469535+0000 mgr.gibba043.dnkmem (mgr.34373) 6179 : audit [DBG] from='client.48192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:48.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:48 gibba043 bash[24019]: audit 2021-03-10T15:47:47.696901+0000 mgr.gibba043.dnkmem (mgr.34373) 6180 : audit [DBG] from='client.58186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:48.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:48 gibba043 bash[24019]: audit 2021-03-10T15:47:48.053950+0000 mon.a (mon.0) 1438 : audit [DBG] from='client.? 172.21.2.103:0/3116087249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:49 gibba003 bash[31385]: cluster 2021-03-10T15:47:48.228383+0000 mgr.gibba043.dnkmem (mgr.34373) 6181 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:49 gibba003 bash[32348]: cluster 2021-03-10T15:47:48.228383+0000 mgr.gibba043.dnkmem (mgr.34373) 6181 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:49 gibba043 bash[24019]: cluster 2021-03-10T15:47:48.228383+0000 mgr.gibba043.dnkmem (mgr.34373) 6181 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:51 gibba003 bash[32348]: cluster 2021-03-10T15:47:50.229957+0000 mgr.gibba043.dnkmem (mgr.34373) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:51.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:51 gibba003 bash[31385]: cluster 2021-03-10T15:47:50.229957+0000 mgr.gibba043.dnkmem (mgr.34373) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:51.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:51 gibba043 bash[24019]: cluster 2021-03-10T15:47:50.229957+0000 mgr.gibba043.dnkmem (mgr.34373) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:53 gibba003 bash[31385]: cluster 2021-03-10T15:47:52.231589+0000 mgr.gibba043.dnkmem (mgr.34373) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:53 gibba003 bash[32348]: cluster 2021-03-10T15:47:52.231589+0000 mgr.gibba043.dnkmem (mgr.34373) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:53 gibba043 bash[24019]: cluster 2021-03-10T15:47:52.231589+0000 mgr.gibba043.dnkmem (mgr.34373) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:55 gibba003 bash[31385]: cluster 2021-03-10T15:47:54.233262+0000 mgr.gibba043.dnkmem (mgr.34373) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:55 gibba003 bash[32348]: cluster 2021-03-10T15:47:54.233262+0000 mgr.gibba043.dnkmem (mgr.34373) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:55 gibba043 bash[24019]: cluster 2021-03-10T15:47:54.233262+0000 mgr.gibba043.dnkmem (mgr.34373) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:57 gibba003 bash[31385]: cluster 2021-03-10T15:47:56.235167+0000 mgr.gibba043.dnkmem (mgr.34373) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:57 gibba003 bash[32348]: cluster 2021-03-10T15:47:56.235167+0000 mgr.gibba043.dnkmem (mgr.34373) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:57 gibba043 bash[24019]: cluster 2021-03-10T15:47:56.235167+0000 mgr.gibba043.dnkmem (mgr.34373) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:47:59 gibba003 bash[31385]: cluster 2021-03-10T15:47:58.236762+0000 mgr.gibba043.dnkmem (mgr.34373) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:47:59 gibba003 bash[32348]: cluster 2021-03-10T15:47:58.236762+0000 mgr.gibba043.dnkmem (mgr.34373) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:47:59 gibba043 bash[24019]: cluster 2021-03-10T15:47:58.236762+0000 mgr.gibba043.dnkmem (mgr.34373) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:01 gibba003 bash[31385]: cluster 2021-03-10T15:48:00.238361+0000 mgr.gibba043.dnkmem (mgr.34373) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:01 gibba003 bash[32348]: cluster 2021-03-10T15:48:00.238361+0000 mgr.gibba043.dnkmem (mgr.34373) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:01 gibba043 bash[24019]: cluster 2021-03-10T15:48:00.238361+0000 mgr.gibba043.dnkmem (mgr.34373) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:02.106 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:02 gibba003 bash[31385]: cephadm 2021-03-10T15:48:01.573279+0000 mgr.gibba043.dnkmem (mgr.34373) 6188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:02.106 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:02 gibba003 bash[32348]: cephadm 2021-03-10T15:48:01.573279+0000 mgr.gibba043.dnkmem (mgr.34373) 6188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:02 gibba043 bash[24019]: cephadm 2021-03-10T15:48:01.573279+0000 mgr.gibba043.dnkmem (mgr.34373) 6188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:03.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:03 gibba003 bash[31385]: cluster 2021-03-10T15:48:02.240058+0000 mgr.gibba043.dnkmem (mgr.34373) 6189 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:03 gibba003 bash[32348]: cluster 2021-03-10T15:48:02.240058+0000 mgr.gibba043.dnkmem (mgr.34373) 6189 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:03 gibba043 bash[24019]: cluster 2021-03-10T15:48:02.240058+0000 mgr.gibba043.dnkmem (mgr.34373) 6189 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:05.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:05 gibba003 bash[31385]: cluster 2021-03-10T15:48:04.241751+0000 mgr.gibba043.dnkmem (mgr.34373) 6190 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:05 gibba003 bash[32348]: cluster 2021-03-10T15:48:04.241751+0000 mgr.gibba043.dnkmem (mgr.34373) 6190 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:05.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:05 gibba043 bash[24019]: cluster 2021-03-10T15:48:04.241751+0000 mgr.gibba043.dnkmem (mgr.34373) 6190 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:07 gibba003 bash[31385]: cluster 2021-03-10T15:48:06.243651+0000 mgr.gibba043.dnkmem (mgr.34373) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:07 gibba003 bash[32348]: cluster 2021-03-10T15:48:06.243651+0000 mgr.gibba043.dnkmem (mgr.34373) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:07 gibba043 bash[24019]: cluster 2021-03-10T15:48:06.243651+0000 mgr.gibba043.dnkmem (mgr.34373) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:09 gibba003 bash[31385]: cluster 2021-03-10T15:48:08.245387+0000 mgr.gibba043.dnkmem (mgr.34373) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:09 gibba003 bash[32348]: cluster 2021-03-10T15:48:08.245387+0000 mgr.gibba043.dnkmem (mgr.34373) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:09 gibba043 bash[24019]: cluster 2021-03-10T15:48:08.245387+0000 mgr.gibba043.dnkmem (mgr.34373) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:11 gibba003 bash[31385]: cluster 2021-03-10T15:48:10.246650+0000 mgr.gibba043.dnkmem (mgr.34373) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:11 gibba003 bash[32348]: cluster 2021-03-10T15:48:10.246650+0000 mgr.gibba043.dnkmem (mgr.34373) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:11 gibba043 bash[24019]: cluster 2021-03-10T15:48:10.246650+0000 mgr.gibba043.dnkmem (mgr.34373) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:13.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:13 gibba003 bash[31385]: cluster 2021-03-10T15:48:12.248357+0000 mgr.gibba043.dnkmem (mgr.34373) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:13 gibba003 bash[32348]: cluster 2021-03-10T15:48:12.248357+0000 mgr.gibba043.dnkmem (mgr.34373) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:13 gibba043 bash[24019]: cluster 2021-03-10T15:48:12.248357+0000 mgr.gibba043.dnkmem (mgr.34373) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.467429+0000 mon.c (mon.1) 1606 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.468599+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.618630+0000 mon.c (mon.1) 1607 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.619805+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.732369+0000 mon.c (mon.1) 1608 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:48:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.733437+0000 mon.c (mon.1) 1609 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:48:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.733921+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:48:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.734214+0000 mon.c (mon.1) 1610 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.735122+0000 mon.c (mon.1) 1611 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.735688+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:48:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.736838+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[31385]: audit 2021-03-10T15:48:13.737760+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.467429+0000 mon.c (mon.1) 1606 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.468599+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.618630+0000 mon.c (mon.1) 1607 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.619805+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.732369+0000 mon.c (mon.1) 1608 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:48:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.733437+0000 mon.c (mon.1) 1609 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:48:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.733921+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:48:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.734214+0000 mon.c (mon.1) 1610 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.735122+0000 mon.c (mon.1) 1611 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.735688+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:48:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.736838+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:14 gibba003 bash[32348]: audit 2021-03-10T15:48:13.737760+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.467429+0000 mon.c (mon.1) 1606 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.468599+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.618630+0000 mon.c (mon.1) 1607 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.619805+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.732369+0000 mon.c (mon.1) 1608 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:48:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.733437+0000 mon.c (mon.1) 1609 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:48:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.733921+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:48:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.734214+0000 mon.c (mon.1) 1610 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.735122+0000 mon.c (mon.1) 1611 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.735688+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:48:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.736838+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:48:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:14 gibba043 bash[24019]: audit 2021-03-10T15:48:13.737760+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:48:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:15 gibba003 bash[31385]: cluster 2021-03-10T15:48:14.250045+0000 mgr.gibba043.dnkmem (mgr.34373) 6195 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:15 gibba003 bash[32348]: cluster 2021-03-10T15:48:14.250045+0000 mgr.gibba043.dnkmem (mgr.34373) 6195 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:15 gibba043 bash[24019]: cluster 2021-03-10T15:48:14.250045+0000 mgr.gibba043.dnkmem (mgr.34373) 6195 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:17 gibba003 bash[31385]: cluster 2021-03-10T15:48:16.251881+0000 mgr.gibba043.dnkmem (mgr.34373) 6196 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:17 gibba003 bash[31385]: cephadm 2021-03-10T15:48:16.589376+0000 mgr.gibba043.dnkmem (mgr.34373) 6197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:17 gibba003 bash[32348]: cluster 2021-03-10T15:48:16.251881+0000 mgr.gibba043.dnkmem (mgr.34373) 6196 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:17 gibba003 bash[32348]: cephadm 2021-03-10T15:48:16.589376+0000 mgr.gibba043.dnkmem (mgr.34373) 6197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:17 gibba043 bash[24019]: cluster 2021-03-10T15:48:16.251881+0000 mgr.gibba043.dnkmem (mgr.34373) 6196 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:17 gibba043 bash[24019]: cephadm 2021-03-10T15:48:16.589376+0000 mgr.gibba043.dnkmem (mgr.34373) 6197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:18.296 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:48:18.526 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:48:18.526 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (116m) 32s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:48:18.526 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:48:18.527 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (117m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:48:18.527 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (117m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:48:18.527 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (116m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:48:18.527 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (116m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:48:18.527 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:48:18.528 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (115m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:48:18.528 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 32s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:48:18.528 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:48:18.528 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (114m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:48:18.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (114m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:48:18.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (114m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:48:18.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (113m) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:48:18.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:48:18.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:48:18.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:48:18.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:48:18.530 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:48:18.530 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 32s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:48:18.777 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:48:18.777 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:48:18.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:18.778 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:48:18.778 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:48:18.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:18.779 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:48:18.779 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:48:18.779 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:48:18.779 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:48:18.779 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:48:18.780 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:48:18.780 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:48:18.780 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:48:18.780 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:48:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[31385]: cluster 2021-03-10T15:48:18.253509+0000 mgr.gibba043.dnkmem (mgr.34373) 6198 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[31385]: audit 2021-03-10T15:48:18.285619+0000 mgr.gibba043.dnkmem (mgr.34373) 6199 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[31385]: audit 2021-03-10T15:48:18.514321+0000 mgr.gibba043.dnkmem (mgr.34373) 6200 : audit [DBG] from='client.58204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[31385]: audit 2021-03-10T15:48:18.778001+0000 mon.c (mon.1) 1612 : audit [DBG] from='client.? 172.21.2.103:0/2314266032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[32348]: cluster 2021-03-10T15:48:18.253509+0000 mgr.gibba043.dnkmem (mgr.34373) 6198 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[32348]: audit 2021-03-10T15:48:18.285619+0000 mgr.gibba043.dnkmem (mgr.34373) 6199 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[32348]: audit 2021-03-10T15:48:18.514321+0000 mgr.gibba043.dnkmem (mgr.34373) 6200 : audit [DBG] from='client.58204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:19 gibba003 bash[32348]: audit 2021-03-10T15:48:18.778001+0000 mon.c (mon.1) 1612 : audit [DBG] from='client.? 172.21.2.103:0/2314266032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:19 gibba043 bash[24019]: cluster 2021-03-10T15:48:18.253509+0000 mgr.gibba043.dnkmem (mgr.34373) 6198 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:19 gibba043 bash[24019]: audit 2021-03-10T15:48:18.285619+0000 mgr.gibba043.dnkmem (mgr.34373) 6199 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:19 gibba043 bash[24019]: audit 2021-03-10T15:48:18.514321+0000 mgr.gibba043.dnkmem (mgr.34373) 6200 : audit [DBG] from='client.58204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:19 gibba043 bash[24019]: audit 2021-03-10T15:48:18.778001+0000 mon.c (mon.1) 1612 : audit [DBG] from='client.? 172.21.2.103:0/2314266032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:21.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:21 gibba003 bash[32348]: cluster 2021-03-10T15:48:20.254914+0000 mgr.gibba043.dnkmem (mgr.34373) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:21.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:21 gibba003 bash[31385]: cluster 2021-03-10T15:48:20.254914+0000 mgr.gibba043.dnkmem (mgr.34373) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:21 gibba043 bash[24019]: cluster 2021-03-10T15:48:20.254914+0000 mgr.gibba043.dnkmem (mgr.34373) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:23 gibba003 bash[31385]: cluster 2021-03-10T15:48:22.256614+0000 mgr.gibba043.dnkmem (mgr.34373) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:23 gibba003 bash[32348]: cluster 2021-03-10T15:48:22.256614+0000 mgr.gibba043.dnkmem (mgr.34373) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:23 gibba043 bash[24019]: cluster 2021-03-10T15:48:22.256614+0000 mgr.gibba043.dnkmem (mgr.34373) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:25 gibba003 bash[31385]: cluster 2021-03-10T15:48:24.258241+0000 mgr.gibba043.dnkmem (mgr.34373) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:25 gibba003 bash[32348]: cluster 2021-03-10T15:48:24.258241+0000 mgr.gibba043.dnkmem (mgr.34373) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:25 gibba043 bash[24019]: cluster 2021-03-10T15:48:24.258241+0000 mgr.gibba043.dnkmem (mgr.34373) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:27 gibba003 bash[31385]: cluster 2021-03-10T15:48:26.260126+0000 mgr.gibba043.dnkmem (mgr.34373) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:27 gibba003 bash[32348]: cluster 2021-03-10T15:48:26.260126+0000 mgr.gibba043.dnkmem (mgr.34373) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:27 gibba043 bash[24019]: cluster 2021-03-10T15:48:26.260126+0000 mgr.gibba043.dnkmem (mgr.34373) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:29 gibba003 bash[31385]: cluster 2021-03-10T15:48:28.261757+0000 mgr.gibba043.dnkmem (mgr.34373) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:29 gibba003 bash[32348]: cluster 2021-03-10T15:48:28.261757+0000 mgr.gibba043.dnkmem (mgr.34373) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:29 gibba043 bash[24019]: cluster 2021-03-10T15:48:28.261757+0000 mgr.gibba043.dnkmem (mgr.34373) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:31 gibba003 bash[31385]: cluster 2021-03-10T15:48:30.263351+0000 mgr.gibba043.dnkmem (mgr.34373) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:31 gibba003 bash[32348]: cluster 2021-03-10T15:48:30.263351+0000 mgr.gibba043.dnkmem (mgr.34373) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:31 gibba043 bash[24019]: cluster 2021-03-10T15:48:30.263351+0000 mgr.gibba043.dnkmem (mgr.34373) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:32.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:32 gibba003 bash[31385]: cephadm 2021-03-10T15:48:31.605506+0000 mgr.gibba043.dnkmem (mgr.34373) 6207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:32.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:32 gibba003 bash[32348]: cephadm 2021-03-10T15:48:31.605506+0000 mgr.gibba043.dnkmem (mgr.34373) 6207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:32.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:32 gibba043 bash[24019]: cephadm 2021-03-10T15:48:31.605506+0000 mgr.gibba043.dnkmem (mgr.34373) 6207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:33.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:33 gibba003 bash[31385]: cluster 2021-03-10T15:48:32.265031+0000 mgr.gibba043.dnkmem (mgr.34373) 6208 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:33.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:33 gibba003 bash[32348]: cluster 2021-03-10T15:48:32.265031+0000 mgr.gibba043.dnkmem (mgr.34373) 6208 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:33 gibba043 bash[24019]: cluster 2021-03-10T15:48:32.265031+0000 mgr.gibba043.dnkmem (mgr.34373) 6208 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:35 gibba003 bash[31385]: cluster 2021-03-10T15:48:34.266744+0000 mgr.gibba043.dnkmem (mgr.34373) 6209 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:35 gibba003 bash[32348]: cluster 2021-03-10T15:48:34.266744+0000 mgr.gibba043.dnkmem (mgr.34373) 6209 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:35.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:35 gibba043 bash[24019]: cluster 2021-03-10T15:48:34.266744+0000 mgr.gibba043.dnkmem (mgr.34373) 6209 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:37 gibba003 bash[31385]: cluster 2021-03-10T15:48:36.268747+0000 mgr.gibba043.dnkmem (mgr.34373) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:37 gibba003 bash[32348]: cluster 2021-03-10T15:48:36.268747+0000 mgr.gibba043.dnkmem (mgr.34373) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:37 gibba043 bash[24019]: cluster 2021-03-10T15:48:36.268747+0000 mgr.gibba043.dnkmem (mgr.34373) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:39 gibba003 bash[31385]: cluster 2021-03-10T15:48:38.270482+0000 mgr.gibba043.dnkmem (mgr.34373) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:39 gibba003 bash[32348]: cluster 2021-03-10T15:48:38.270482+0000 mgr.gibba043.dnkmem (mgr.34373) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:39 gibba043 bash[24019]: cluster 2021-03-10T15:48:38.270482+0000 mgr.gibba043.dnkmem (mgr.34373) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:41 gibba003 bash[31385]: cluster 2021-03-10T15:48:40.272050+0000 mgr.gibba043.dnkmem (mgr.34373) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:41 gibba003 bash[32348]: cluster 2021-03-10T15:48:40.272050+0000 mgr.gibba043.dnkmem (mgr.34373) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:41 gibba043 bash[24019]: cluster 2021-03-10T15:48:40.272050+0000 mgr.gibba043.dnkmem (mgr.34373) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:43 gibba003 bash[31385]: cluster 2021-03-10T15:48:42.273865+0000 mgr.gibba043.dnkmem (mgr.34373) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:43 gibba003 bash[32348]: cluster 2021-03-10T15:48:42.273865+0000 mgr.gibba043.dnkmem (mgr.34373) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:43 gibba043 bash[24019]: cluster 2021-03-10T15:48:42.273865+0000 mgr.gibba043.dnkmem (mgr.34373) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:45 gibba003 bash[31385]: cluster 2021-03-10T15:48:44.275601+0000 mgr.gibba043.dnkmem (mgr.34373) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:45 gibba003 bash[32348]: cluster 2021-03-10T15:48:44.275601+0000 mgr.gibba043.dnkmem (mgr.34373) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:45 gibba043 bash[24019]: cluster 2021-03-10T15:48:44.275601+0000 mgr.gibba043.dnkmem (mgr.34373) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:47 gibba003 bash[31385]: cluster 2021-03-10T15:48:46.277309+0000 mgr.gibba043.dnkmem (mgr.34373) 6215 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:47 gibba003 bash[31385]: cephadm 2021-03-10T15:48:46.622421+0000 mgr.gibba043.dnkmem (mgr.34373) 6216 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:48:47.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:47 gibba003 bash[31385]: audit 2021-03-10T15:48:46.626235+0000 mon.c (mon.1) 1613 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:47 gibba003 bash[32348]: cluster 2021-03-10T15:48:46.277309+0000 mgr.gibba043.dnkmem (mgr.34373) 6215 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:47 gibba003 bash[32348]: cephadm 2021-03-10T15:48:46.622421+0000 mgr.gibba043.dnkmem (mgr.34373) 6216 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:48:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:47 gibba003 bash[32348]: audit 2021-03-10T15:48:46.626235+0000 mon.c (mon.1) 1613 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:47 gibba043 bash[24019]: cluster 2021-03-10T15:48:46.277309+0000 mgr.gibba043.dnkmem (mgr.34373) 6215 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:47 gibba043 bash[24019]: cephadm 2021-03-10T15:48:46.622421+0000 mgr.gibba043.dnkmem (mgr.34373) 6216 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:48:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:47 gibba043 bash[24019]: audit 2021-03-10T15:48:46.626235+0000 mon.c (mon.1) 1613 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:49.024 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:48:49.254 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:48:49.254 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (117m) 62s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:48:49.254 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:48:49.254 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (117m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:48:49.255 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (117m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:48:49.255 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (116m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:48:49.255 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (116m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:48:49.256 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (116m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:48:49.256 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (116m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:48:49.256 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 62s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:48:49.256 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:48:49.256 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (115m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:48:49.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (115m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:48:49.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (114m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:48:49.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (114m) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:48:49.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:48:49.258 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:48:49.258 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (112m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:48:49.258 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (112m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:48:49.258 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:48:49.258 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 62s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:48:49.506 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:48:49.507 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:48:49.507 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:49.507 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:48:49.507 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:48:49.508 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:49.508 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:48:49.508 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:48:49.508 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:48:49.508 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:48:49.509 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:48:49.509 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:48:49.509 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:48:49.509 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:48:49.509 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:48:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:49 gibba003 bash[31385]: cluster 2021-03-10T15:48:48.278925+0000 mgr.gibba043.dnkmem (mgr.34373) 6217 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:49 gibba003 bash[32348]: cluster 2021-03-10T15:48:48.278925+0000 mgr.gibba043.dnkmem (mgr.34373) 6217 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:49 gibba043 bash[24019]: cluster 2021-03-10T15:48:48.278925+0000 mgr.gibba043.dnkmem (mgr.34373) 6217 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:50.657 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:50 gibba043 bash[24019]: audit 2021-03-10T15:48:49.013081+0000 mgr.gibba043.dnkmem (mgr.34373) 6218 : audit [DBG] from='client.58216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:50.658 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:50 gibba043 bash[24019]: audit 2021-03-10T15:48:49.240310+0000 mgr.gibba043.dnkmem (mgr.34373) 6219 : audit [DBG] from='client.58222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:50.658 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:50 gibba043 bash[24019]: audit 2021-03-10T15:48:49.507546+0000 mon.c (mon.1) 1614 : audit [DBG] from='client.? 172.21.2.103:0/4266002960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:50.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:50 gibba003 bash[31385]: audit 2021-03-10T15:48:49.013081+0000 mgr.gibba043.dnkmem (mgr.34373) 6218 : audit [DBG] from='client.58216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:50.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:50 gibba003 bash[31385]: audit 2021-03-10T15:48:49.240310+0000 mgr.gibba043.dnkmem (mgr.34373) 6219 : audit [DBG] from='client.58222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:50.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:50 gibba003 bash[31385]: audit 2021-03-10T15:48:49.507546+0000 mon.c (mon.1) 1614 : audit [DBG] from='client.? 172.21.2.103:0/4266002960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:50.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:50 gibba003 bash[32348]: audit 2021-03-10T15:48:49.013081+0000 mgr.gibba043.dnkmem (mgr.34373) 6218 : audit [DBG] from='client.58216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:50.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:50 gibba003 bash[32348]: audit 2021-03-10T15:48:49.240310+0000 mgr.gibba043.dnkmem (mgr.34373) 6219 : audit [DBG] from='client.58222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:50.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:50 gibba003 bash[32348]: audit 2021-03-10T15:48:49.507546+0000 mon.c (mon.1) 1614 : audit [DBG] from='client.? 172.21.2.103:0/4266002960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:51.630 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:51 gibba043 bash[24019]: cluster 2021-03-10T15:48:50.279705+0000 mgr.gibba043.dnkmem (mgr.34373) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:51.631 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:51 gibba043 bash[24019]: audit 2021-03-10T15:48:50.365660+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:51.631 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:51 gibba043 bash[24019]: audit 2021-03-10T15:48:50.367531+0000 mon.c (mon.1) 1615 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:48:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:51 gibba003 bash[31385]: cluster 2021-03-10T15:48:50.279705+0000 mgr.gibba043.dnkmem (mgr.34373) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:51 gibba003 bash[31385]: audit 2021-03-10T15:48:50.365660+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:51 gibba003 bash[31385]: audit 2021-03-10T15:48:50.367531+0000 mon.c (mon.1) 1615 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:48:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:51 gibba003 bash[32348]: cluster 2021-03-10T15:48:50.279705+0000 mgr.gibba043.dnkmem (mgr.34373) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:51 gibba003 bash[32348]: audit 2021-03-10T15:48:50.365660+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:51.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:51 gibba003 bash[32348]: audit 2021-03-10T15:48:50.367531+0000 mon.c (mon.1) 1615 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:48:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:53 gibba003 bash[31385]: cluster 2021-03-10T15:48:52.280349+0000 mgr.gibba043.dnkmem (mgr.34373) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:53.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:53 gibba003 bash[32348]: cluster 2021-03-10T15:48:52.280349+0000 mgr.gibba043.dnkmem (mgr.34373) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:53 gibba043 bash[24019]: cluster 2021-03-10T15:48:52.280349+0000 mgr.gibba043.dnkmem (mgr.34373) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: cluster 2021-03-10T15:48:54.280769+0000 mgr.gibba043.dnkmem (mgr.34373) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:54.914674+0000 mon.c (mon.1) 1616 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.093067+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.283640+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.287667+0000 mon.c (mon.1) 1617 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.289506+0000 mon.c (mon.1) 1618 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.291301+0000 mon.c (mon.1) 1619 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.292891+0000 mon.c (mon.1) 1620 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.297399+0000 mon.c (mon.1) 1621 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[31385]: audit 2021-03-10T15:48:55.299211+0000 mon.c (mon.1) 1622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: cluster 2021-03-10T15:48:54.280769+0000 mgr.gibba043.dnkmem (mgr.34373) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:54.914674+0000 mon.c (mon.1) 1616 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.093067+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.283640+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.287667+0000 mon.c (mon.1) 1617 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.289506+0000 mon.c (mon.1) 1618 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.291301+0000 mon.c (mon.1) 1619 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.292891+0000 mon.c (mon.1) 1620 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.297399+0000 mon.c (mon.1) 1621 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:55 gibba003 bash[32348]: audit 2021-03-10T15:48:55.299211+0000 mon.c (mon.1) 1622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: cluster 2021-03-10T15:48:54.280769+0000 mgr.gibba043.dnkmem (mgr.34373) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:54.914674+0000 mon.c (mon.1) 1616 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.093067+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.283640+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:48:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.287667+0000 mon.c (mon.1) 1617 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.289506+0000 mon.c (mon.1) 1618 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.291301+0000 mon.c (mon.1) 1619 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.292891+0000 mon.c (mon.1) 1620 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.297399+0000 mon.c (mon.1) 1621 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:55.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:55 gibba043 bash[24019]: audit 2021-03-10T15:48:55.299211+0000 mon.c (mon.1) 1622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:56.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.092049+0000 mgr.gibba043.dnkmem (mgr.34373) 6223 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:48:56.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.284764+0000 mgr.gibba043.dnkmem (mgr.34373) 6224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:56.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.286851+0000 mgr.gibba043.dnkmem (mgr.34373) 6225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:56.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.288902+0000 mgr.gibba043.dnkmem (mgr.34373) 6226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:56.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.288938+0000 mgr.gibba043.dnkmem (mgr.34373) 6227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:56.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.290277+0000 mgr.gibba043.dnkmem (mgr.34373) 6228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:56.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.290313+0000 mgr.gibba043.dnkmem (mgr.34373) 6229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.292332+0000 mgr.gibba043.dnkmem (mgr.34373) 6230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.294800+0000 mgr.gibba043.dnkmem (mgr.34373) 6231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.294840+0000 mgr.gibba043.dnkmem (mgr.34373) 6232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.296395+0000 mgr.gibba043.dnkmem (mgr.34373) 6233 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.296805+0000 mgr.gibba043.dnkmem (mgr.34373) 6234 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:56.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.298263+0000 mgr.gibba043.dnkmem (mgr.34373) 6235 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:56.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.298298+0000 mgr.gibba043.dnkmem (mgr.34373) 6236 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:56.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[31385]: cephadm 2021-03-10T15:48:55.298408+0000 mgr.gibba043.dnkmem (mgr.34373) 6237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:56.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.092049+0000 mgr.gibba043.dnkmem (mgr.34373) 6223 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:48:56.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.284764+0000 mgr.gibba043.dnkmem (mgr.34373) 6224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:56.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.286851+0000 mgr.gibba043.dnkmem (mgr.34373) 6225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:56.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.288902+0000 mgr.gibba043.dnkmem (mgr.34373) 6226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:56.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.288938+0000 mgr.gibba043.dnkmem (mgr.34373) 6227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:56.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.290277+0000 mgr.gibba043.dnkmem (mgr.34373) 6228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:56.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.290313+0000 mgr.gibba043.dnkmem (mgr.34373) 6229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:56.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.292332+0000 mgr.gibba043.dnkmem (mgr.34373) 6230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:56.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.294800+0000 mgr.gibba043.dnkmem (mgr.34373) 6231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:56.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.294840+0000 mgr.gibba043.dnkmem (mgr.34373) 6232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:56.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.296395+0000 mgr.gibba043.dnkmem (mgr.34373) 6233 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:56.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.296805+0000 mgr.gibba043.dnkmem (mgr.34373) 6234 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:56.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.298263+0000 mgr.gibba043.dnkmem (mgr.34373) 6235 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:56.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.298298+0000 mgr.gibba043.dnkmem (mgr.34373) 6236 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:56.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:56 gibba003 bash[32348]: cephadm 2021-03-10T15:48:55.298408+0000 mgr.gibba043.dnkmem (mgr.34373) 6237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.092049+0000 mgr.gibba043.dnkmem (mgr.34373) 6223 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:48:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.284764+0000 mgr.gibba043.dnkmem (mgr.34373) 6224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.286851+0000 mgr.gibba043.dnkmem (mgr.34373) 6225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.288902+0000 mgr.gibba043.dnkmem (mgr.34373) 6226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.288938+0000 mgr.gibba043.dnkmem (mgr.34373) 6227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.290277+0000 mgr.gibba043.dnkmem (mgr.34373) 6228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.290313+0000 mgr.gibba043.dnkmem (mgr.34373) 6229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.292332+0000 mgr.gibba043.dnkmem (mgr.34373) 6230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.294800+0000 mgr.gibba043.dnkmem (mgr.34373) 6231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.294840+0000 mgr.gibba043.dnkmem (mgr.34373) 6232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.296395+0000 mgr.gibba043.dnkmem (mgr.34373) 6233 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.296805+0000 mgr.gibba043.dnkmem (mgr.34373) 6234 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.298263+0000 mgr.gibba043.dnkmem (mgr.34373) 6235 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.298298+0000 mgr.gibba043.dnkmem (mgr.34373) 6236 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:56.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:56 gibba043 bash[24019]: cephadm 2021-03-10T15:48:55.298408+0000 mgr.gibba043.dnkmem (mgr.34373) 6237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:48:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:57 gibba003 bash[31385]: cluster 2021-03-10T15:48:56.282515+0000 mgr.gibba043.dnkmem (mgr.34373) 6238 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:57.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:57 gibba003 bash[32348]: cluster 2021-03-10T15:48:56.282515+0000 mgr.gibba043.dnkmem (mgr.34373) 6238 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:57 gibba043 bash[24019]: cluster 2021-03-10T15:48:56.282515+0000 mgr.gibba043.dnkmem (mgr.34373) 6238 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:48:59 gibba003 bash[31385]: cluster 2021-03-10T15:48:58.284201+0000 mgr.gibba043.dnkmem (mgr.34373) 6239 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:59.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:48:59 gibba003 bash[32348]: cluster 2021-03-10T15:48:58.284201+0000 mgr.gibba043.dnkmem (mgr.34373) 6239 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:48:59 gibba043 bash[24019]: cluster 2021-03-10T15:48:58.284201+0000 mgr.gibba043.dnkmem (mgr.34373) 6239 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:01 gibba003 bash[31385]: cluster 2021-03-10T15:49:00.285635+0000 mgr.gibba043.dnkmem (mgr.34373) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:01 gibba003 bash[32348]: cluster 2021-03-10T15:49:00.285635+0000 mgr.gibba043.dnkmem (mgr.34373) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:01 gibba043 bash[24019]: cluster 2021-03-10T15:49:00.285635+0000 mgr.gibba043.dnkmem (mgr.34373) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:03.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:03 gibba003 bash[31385]: cluster 2021-03-10T15:49:02.287249+0000 mgr.gibba043.dnkmem (mgr.34373) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:03.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:03 gibba003 bash[32348]: cluster 2021-03-10T15:49:02.287249+0000 mgr.gibba043.dnkmem (mgr.34373) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:03 gibba043 bash[24019]: cluster 2021-03-10T15:49:02.287249+0000 mgr.gibba043.dnkmem (mgr.34373) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:05 gibba003 bash[31385]: cluster 2021-03-10T15:49:04.288816+0000 mgr.gibba043.dnkmem (mgr.34373) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:05 gibba003 bash[32348]: cluster 2021-03-10T15:49:04.288816+0000 mgr.gibba043.dnkmem (mgr.34373) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:05 gibba043 bash[24019]: cluster 2021-03-10T15:49:04.288816+0000 mgr.gibba043.dnkmem (mgr.34373) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:07 gibba003 bash[31385]: cluster 2021-03-10T15:49:06.290799+0000 mgr.gibba043.dnkmem (mgr.34373) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:07 gibba003 bash[32348]: cluster 2021-03-10T15:49:06.290799+0000 mgr.gibba043.dnkmem (mgr.34373) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:07 gibba043 bash[24019]: cluster 2021-03-10T15:49:06.290799+0000 mgr.gibba043.dnkmem (mgr.34373) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:09 gibba003 bash[31385]: cluster 2021-03-10T15:49:08.292606+0000 mgr.gibba043.dnkmem (mgr.34373) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:09.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:09 gibba003 bash[32348]: cluster 2021-03-10T15:49:08.292606+0000 mgr.gibba043.dnkmem (mgr.34373) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:09 gibba043 bash[24019]: cluster 2021-03-10T15:49:08.292606+0000 mgr.gibba043.dnkmem (mgr.34373) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:11 gibba003 bash[31385]: cluster 2021-03-10T15:49:10.294125+0000 mgr.gibba043.dnkmem (mgr.34373) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:11 gibba003 bash[31385]: cephadm 2021-03-10T15:49:10.314423+0000 mgr.gibba043.dnkmem (mgr.34373) 6246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:11 gibba003 bash[32348]: cluster 2021-03-10T15:49:10.294125+0000 mgr.gibba043.dnkmem (mgr.34373) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:11 gibba003 bash[32348]: cephadm 2021-03-10T15:49:10.314423+0000 mgr.gibba043.dnkmem (mgr.34373) 6246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:11 gibba043 bash[24019]: cluster 2021-03-10T15:49:10.294125+0000 mgr.gibba043.dnkmem (mgr.34373) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:11 gibba043 bash[24019]: cephadm 2021-03-10T15:49:10.314423+0000 mgr.gibba043.dnkmem (mgr.34373) 6246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:13 gibba003 bash[31385]: cluster 2021-03-10T15:49:12.295806+0000 mgr.gibba043.dnkmem (mgr.34373) 6247 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:13 gibba003 bash[32348]: cluster 2021-03-10T15:49:12.295806+0000 mgr.gibba043.dnkmem (mgr.34373) 6247 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:13 gibba043 bash[24019]: cluster 2021-03-10T15:49:12.295806+0000 mgr.gibba043.dnkmem (mgr.34373) 6247 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.474720+0000 mon.c (mon.1) 1623 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.475838+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.627219+0000 mon.c (mon.1) 1624 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.628415+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.741361+0000 mon.c (mon.1) 1625 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:49:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.742076+0000 mon.c (mon.1) 1626 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.742757+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:49:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.742757+0000 mon.c (mon.1) 1627 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.743531+0000 mon.c (mon.1) 1628 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.744893+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.745799+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[31385]: audit 2021-03-10T15:49:13.746670+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.474720+0000 mon.c (mon.1) 1623 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.475838+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.627219+0000 mon.c (mon.1) 1624 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.628415+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.741361+0000 mon.c (mon.1) 1625 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:49:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.742076+0000 mon.c (mon.1) 1626 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.742757+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:49:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.742757+0000 mon.c (mon.1) 1627 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.743531+0000 mon.c (mon.1) 1628 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.744893+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.745799+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:14 gibba003 bash[32348]: audit 2021-03-10T15:49:13.746670+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.474720+0000 mon.c (mon.1) 1623 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.475838+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.627219+0000 mon.c (mon.1) 1624 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.628415+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.741361+0000 mon.c (mon.1) 1625 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:49:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.742076+0000 mon.c (mon.1) 1626 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.742757+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:49:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.742757+0000 mon.c (mon.1) 1627 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.743531+0000 mon.c (mon.1) 1628 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.744893+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.745799+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:49:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:14 gibba043 bash[24019]: audit 2021-03-10T15:49:13.746670+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:49:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:15 gibba003 bash[31385]: cluster 2021-03-10T15:49:14.297176+0000 mgr.gibba043.dnkmem (mgr.34373) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:15 gibba003 bash[32348]: cluster 2021-03-10T15:49:14.297176+0000 mgr.gibba043.dnkmem (mgr.34373) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:15 gibba043 bash[24019]: cluster 2021-03-10T15:49:14.297176+0000 mgr.gibba043.dnkmem (mgr.34373) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:17 gibba003 bash[31385]: cluster 2021-03-10T15:49:16.298965+0000 mgr.gibba043.dnkmem (mgr.34373) 6249 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:17 gibba003 bash[32348]: cluster 2021-03-10T15:49:16.298965+0000 mgr.gibba043.dnkmem (mgr.34373) 6249 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:17 gibba043 bash[24019]: cluster 2021-03-10T15:49:16.298965+0000 mgr.gibba043.dnkmem (mgr.34373) 6249 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:19 gibba003 bash[31385]: cluster 2021-03-10T15:49:18.300552+0000 mgr.gibba043.dnkmem (mgr.34373) 6250 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.713 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:19 gibba003 bash[32348]: cluster 2021-03-10T15:49:18.300552+0000 mgr.gibba043.dnkmem (mgr.34373) 6250 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.749 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:49:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:19 gibba043 bash[24019]: cluster 2021-03-10T15:49:18.300552+0000 mgr.gibba043.dnkmem (mgr.34373) 6250 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.980 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:49:19.980 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (117m) 93s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:49:19.980 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 29s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:49:19.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (118m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:49:19.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (118m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:49:19.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (117m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:49:19.981 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (117m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:49:19.981 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (116m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:49:19.982 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (116m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:49:19.982 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 93s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:49:19.982 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 29s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:49:19.982 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (116m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:49:19.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (115m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:49:19.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (115m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:49:19.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (114m) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:49:19.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (114m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:49:19.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (113m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:49:19.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (113m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:49:19.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (112m) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:49:19.984 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 29s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:49:19.984 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 93s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:49:20.230 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:49:20.230 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:49:20.230 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:20.230 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:49:20.231 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:49:20.231 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:20.231 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:49:20.231 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:49:20.231 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:49:20.232 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:49:20.232 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:49:20.232 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:49:20.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:49:20.232 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:49:20.233 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:49:20.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:20 gibba003 bash[31385]: audit 2021-03-10T15:49:19.739192+0000 mgr.gibba043.dnkmem (mgr.34373) 6251 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:20.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:20 gibba003 bash[31385]: audit 2021-03-10T15:49:20.230524+0000 mon.c (mon.1) 1629 : audit [DBG] from='client.? 172.21.2.103:0/3061384105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:20.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:20 gibba003 bash[32348]: audit 2021-03-10T15:49:19.739192+0000 mgr.gibba043.dnkmem (mgr.34373) 6251 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:20.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:20 gibba003 bash[32348]: audit 2021-03-10T15:49:20.230524+0000 mon.c (mon.1) 1629 : audit [DBG] from='client.? 172.21.2.103:0/3061384105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:20.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:20 gibba043 bash[24019]: audit 2021-03-10T15:49:19.739192+0000 mgr.gibba043.dnkmem (mgr.34373) 6251 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:20.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:20 gibba043 bash[24019]: audit 2021-03-10T15:49:20.230524+0000 mon.c (mon.1) 1629 : audit [DBG] from='client.? 172.21.2.103:0/3061384105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:21 gibba003 bash[31385]: audit 2021-03-10T15:49:19.966331+0000 mgr.gibba043.dnkmem (mgr.34373) 6252 : audit [DBG] from='client.58240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:21.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:21 gibba003 bash[31385]: cluster 2021-03-10T15:49:20.302128+0000 mgr.gibba043.dnkmem (mgr.34373) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:21 gibba003 bash[32348]: audit 2021-03-10T15:49:19.966331+0000 mgr.gibba043.dnkmem (mgr.34373) 6252 : audit [DBG] from='client.58240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:21.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:21 gibba003 bash[32348]: cluster 2021-03-10T15:49:20.302128+0000 mgr.gibba043.dnkmem (mgr.34373) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:21 gibba043 bash[24019]: audit 2021-03-10T15:49:19.966331+0000 mgr.gibba043.dnkmem (mgr.34373) 6252 : audit [DBG] from='client.58240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:21.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:21 gibba043 bash[24019]: cluster 2021-03-10T15:49:20.302128+0000 mgr.gibba043.dnkmem (mgr.34373) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:23 gibba003 bash[31385]: cluster 2021-03-10T15:49:22.303817+0000 mgr.gibba043.dnkmem (mgr.34373) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:23 gibba003 bash[32348]: cluster 2021-03-10T15:49:22.303817+0000 mgr.gibba043.dnkmem (mgr.34373) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:23 gibba043 bash[24019]: cluster 2021-03-10T15:49:22.303817+0000 mgr.gibba043.dnkmem (mgr.34373) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:25 gibba003 bash[31385]: cluster 2021-03-10T15:49:24.305142+0000 mgr.gibba043.dnkmem (mgr.34373) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:25 gibba003 bash[32348]: cluster 2021-03-10T15:49:24.305142+0000 mgr.gibba043.dnkmem (mgr.34373) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:25 gibba043 bash[24019]: cluster 2021-03-10T15:49:24.305142+0000 mgr.gibba043.dnkmem (mgr.34373) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:26.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:26 gibba003 bash[31385]: cephadm 2021-03-10T15:49:25.330542+0000 mgr.gibba043.dnkmem (mgr.34373) 6256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:26 gibba003 bash[32348]: cephadm 2021-03-10T15:49:25.330542+0000 mgr.gibba043.dnkmem (mgr.34373) 6256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:26 gibba043 bash[24019]: cephadm 2021-03-10T15:49:25.330542+0000 mgr.gibba043.dnkmem (mgr.34373) 6256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:27 gibba043 bash[24019]: cluster 2021-03-10T15:49:26.306945+0000 mgr.gibba043.dnkmem (mgr.34373) 6257 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:27 gibba003 bash[31385]: cluster 2021-03-10T15:49:26.306945+0000 mgr.gibba043.dnkmem (mgr.34373) 6257 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:27 gibba003 bash[32348]: cluster 2021-03-10T15:49:26.306945+0000 mgr.gibba043.dnkmem (mgr.34373) 6257 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:29 gibba043 bash[24019]: cluster 2021-03-10T15:49:28.308643+0000 mgr.gibba043.dnkmem (mgr.34373) 6258 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:29 gibba003 bash[31385]: cluster 2021-03-10T15:49:28.308643+0000 mgr.gibba043.dnkmem (mgr.34373) 6258 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:29 gibba003 bash[32348]: cluster 2021-03-10T15:49:28.308643+0000 mgr.gibba043.dnkmem (mgr.34373) 6258 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:31 gibba003 bash[31385]: cluster 2021-03-10T15:49:30.309917+0000 mgr.gibba043.dnkmem (mgr.34373) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:31 gibba003 bash[32348]: cluster 2021-03-10T15:49:30.309917+0000 mgr.gibba043.dnkmem (mgr.34373) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:31 gibba043 bash[24019]: cluster 2021-03-10T15:49:30.309917+0000 mgr.gibba043.dnkmem (mgr.34373) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:33 gibba003 bash[31385]: cluster 2021-03-10T15:49:32.311627+0000 mgr.gibba043.dnkmem (mgr.34373) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:33 gibba003 bash[32348]: cluster 2021-03-10T15:49:32.311627+0000 mgr.gibba043.dnkmem (mgr.34373) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:33 gibba043 bash[24019]: cluster 2021-03-10T15:49:32.311627+0000 mgr.gibba043.dnkmem (mgr.34373) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:35 gibba003 bash[31385]: cluster 2021-03-10T15:49:34.313042+0000 mgr.gibba043.dnkmem (mgr.34373) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:35 gibba003 bash[32348]: cluster 2021-03-10T15:49:34.313042+0000 mgr.gibba043.dnkmem (mgr.34373) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:35.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:35 gibba043 bash[24019]: cluster 2021-03-10T15:49:34.313042+0000 mgr.gibba043.dnkmem (mgr.34373) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:37 gibba003 bash[31385]: cluster 2021-03-10T15:49:36.315040+0000 mgr.gibba043.dnkmem (mgr.34373) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:37 gibba003 bash[32348]: cluster 2021-03-10T15:49:36.315040+0000 mgr.gibba043.dnkmem (mgr.34373) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:37 gibba043 bash[24019]: cluster 2021-03-10T15:49:36.315040+0000 mgr.gibba043.dnkmem (mgr.34373) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:39 gibba003 bash[31385]: cluster 2021-03-10T15:49:38.316707+0000 mgr.gibba043.dnkmem (mgr.34373) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:39 gibba003 bash[32348]: cluster 2021-03-10T15:49:38.316707+0000 mgr.gibba043.dnkmem (mgr.34373) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:39 gibba043 bash[24019]: cluster 2021-03-10T15:49:38.316707+0000 mgr.gibba043.dnkmem (mgr.34373) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:41 gibba003 bash[31385]: cluster 2021-03-10T15:49:40.318232+0000 mgr.gibba043.dnkmem (mgr.34373) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:41 gibba003 bash[31385]: cephadm 2021-03-10T15:49:40.332823+0000 mgr.gibba043.dnkmem (mgr.34373) 6265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:41 gibba003 bash[32348]: cluster 2021-03-10T15:49:40.318232+0000 mgr.gibba043.dnkmem (mgr.34373) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:41 gibba003 bash[32348]: cephadm 2021-03-10T15:49:40.332823+0000 mgr.gibba043.dnkmem (mgr.34373) 6265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:41 gibba043 bash[24019]: cluster 2021-03-10T15:49:40.318232+0000 mgr.gibba043.dnkmem (mgr.34373) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:41 gibba043 bash[24019]: cephadm 2021-03-10T15:49:40.332823+0000 mgr.gibba043.dnkmem (mgr.34373) 6265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:43.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:43 gibba003 bash[31385]: cluster 2021-03-10T15:49:42.319805+0000 mgr.gibba043.dnkmem (mgr.34373) 6266 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:43 gibba003 bash[32348]: cluster 2021-03-10T15:49:42.319805+0000 mgr.gibba043.dnkmem (mgr.34373) 6266 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:43 gibba043 bash[24019]: cluster 2021-03-10T15:49:42.319805+0000 mgr.gibba043.dnkmem (mgr.34373) 6266 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:45 gibba003 bash[31385]: cluster 2021-03-10T15:49:44.321426+0000 mgr.gibba043.dnkmem (mgr.34373) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:45 gibba003 bash[32348]: cluster 2021-03-10T15:49:44.321426+0000 mgr.gibba043.dnkmem (mgr.34373) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:45 gibba043 bash[24019]: cluster 2021-03-10T15:49:44.321426+0000 mgr.gibba043.dnkmem (mgr.34373) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:47 gibba003 bash[31385]: cluster 2021-03-10T15:49:46.323241+0000 mgr.gibba043.dnkmem (mgr.34373) 6268 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:47 gibba003 bash[32348]: cluster 2021-03-10T15:49:46.323241+0000 mgr.gibba043.dnkmem (mgr.34373) 6268 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:47 gibba043 bash[24019]: cluster 2021-03-10T15:49:46.323241+0000 mgr.gibba043.dnkmem (mgr.34373) 6268 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:49.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:49 gibba003 bash[31385]: cluster 2021-03-10T15:49:48.324880+0000 mgr.gibba043.dnkmem (mgr.34373) 6269 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:49.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:49 gibba003 bash[32348]: cluster 2021-03-10T15:49:48.324880+0000 mgr.gibba043.dnkmem (mgr.34373) 6269 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:49 gibba043 bash[24019]: cluster 2021-03-10T15:49:48.324880+0000 mgr.gibba043.dnkmem (mgr.34373) 6269 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:50.474 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:49:50.700 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:49:50.700 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (118m) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:49:50.700 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 60s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:49:50.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (118m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:49:50.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (118m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:49:50.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:49:50.701 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:49:50.701 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (117m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:49:50.702 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:49:50.702 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:49:50.702 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 60s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:49:50.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:49:50.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:49:50.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:49:50.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:49:50.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (114m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:49:50.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (114m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:49:50.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (113m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:49:50.704 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (113m) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:49:50.704 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 60s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:49:50.704 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:49:50.950 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:49:50.950 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:49:50.950 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:50.951 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:49:50.951 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:49:50.951 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:50.951 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:49:50.951 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:49:50.951 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:49:50.952 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:49:50.952 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:49:50.952 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:49:50.952 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:49:50.952 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:49:50.953 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:49:51.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[31385]: cluster 2021-03-10T15:49:50.326257+0000 mgr.gibba043.dnkmem (mgr.34373) 6270 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[31385]: audit 2021-03-10T15:49:50.463862+0000 mgr.gibba043.dnkmem (mgr.34373) 6271 : audit [DBG] from='client.58252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[31385]: audit 2021-03-10T15:49:50.687304+0000 mgr.gibba043.dnkmem (mgr.34373) 6272 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[31385]: audit 2021-03-10T15:49:50.950742+0000 mon.c (mon.1) 1630 : audit [DBG] from='client.? 172.21.2.103:0/2491913471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[32348]: cluster 2021-03-10T15:49:50.326257+0000 mgr.gibba043.dnkmem (mgr.34373) 6270 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[32348]: audit 2021-03-10T15:49:50.463862+0000 mgr.gibba043.dnkmem (mgr.34373) 6271 : audit [DBG] from='client.58252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[32348]: audit 2021-03-10T15:49:50.687304+0000 mgr.gibba043.dnkmem (mgr.34373) 6272 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:51.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:51 gibba003 bash[32348]: audit 2021-03-10T15:49:50.950742+0000 mon.c (mon.1) 1630 : audit [DBG] from='client.? 172.21.2.103:0/2491913471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:51 gibba043 bash[24019]: cluster 2021-03-10T15:49:50.326257+0000 mgr.gibba043.dnkmem (mgr.34373) 6270 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:51 gibba043 bash[24019]: audit 2021-03-10T15:49:50.463862+0000 mgr.gibba043.dnkmem (mgr.34373) 6271 : audit [DBG] from='client.58252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:51 gibba043 bash[24019]: audit 2021-03-10T15:49:50.687304+0000 mgr.gibba043.dnkmem (mgr.34373) 6272 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:51 gibba043 bash[24019]: audit 2021-03-10T15:49:50.950742+0000 mon.c (mon.1) 1630 : audit [DBG] from='client.? 172.21.2.103:0/2491913471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:53 gibba003 bash[31385]: cluster 2021-03-10T15:49:52.327945+0000 mgr.gibba043.dnkmem (mgr.34373) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:53.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:53 gibba003 bash[32348]: cluster 2021-03-10T15:49:52.327945+0000 mgr.gibba043.dnkmem (mgr.34373) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:53 gibba043 bash[24019]: cluster 2021-03-10T15:49:52.327945+0000 mgr.gibba043.dnkmem (mgr.34373) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:55.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:55 gibba003 bash[31385]: cluster 2021-03-10T15:49:54.329411+0000 mgr.gibba043.dnkmem (mgr.34373) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:55.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:55 gibba003 bash[32348]: cluster 2021-03-10T15:49:54.329411+0000 mgr.gibba043.dnkmem (mgr.34373) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:55.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:55 gibba043 bash[24019]: cluster 2021-03-10T15:49:54.329411+0000 mgr.gibba043.dnkmem (mgr.34373) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.349466+0000 mgr.gibba043.dnkmem (mgr.34373) 6275 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:49:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.351034+0000 mgr.gibba043.dnkmem (mgr.34373) 6276 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:49:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.566715+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:49:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.567782+0000 mgr.gibba043.dnkmem (mgr.34373) 6277 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.569546+0000 mgr.gibba043.dnkmem (mgr.34373) 6278 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.570548+0000 mon.c (mon.1) 1631 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.570689+0000 mgr.gibba043.dnkmem (mgr.34373) 6279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.570731+0000 mgr.gibba043.dnkmem (mgr.34373) 6280 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.571911+0000 mon.c (mon.1) 1632 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.572001+0000 mgr.gibba043.dnkmem (mgr.34373) 6281 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.572044+0000 mgr.gibba043.dnkmem (mgr.34373) 6282 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:56.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.573163+0000 mon.c (mon.1) 1633 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.573169+0000 mgr.gibba043.dnkmem (mgr.34373) 6283 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.574332+0000 mon.c (mon.1) 1634 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.574760+0000 mgr.gibba043.dnkmem (mgr.34373) 6284 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.574804+0000 mgr.gibba043.dnkmem (mgr.34373) 6285 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:56.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.576052+0000 mgr.gibba043.dnkmem (mgr.34373) 6286 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.576421+0000 mgr.gibba043.dnkmem (mgr.34373) 6287 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.577285+0000 mon.c (mon.1) 1635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.577644+0000 mgr.gibba043.dnkmem (mgr.34373) 6288 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.577692+0000 mgr.gibba043.dnkmem (mgr.34373) 6289 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:56.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: cephadm 2021-03-10T15:49:55.577821+0000 mgr.gibba043.dnkmem (mgr.34373) 6290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:56.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[31385]: audit 2021-03-10T15:49:55.578770+0000 mon.c (mon.1) 1636 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.349466+0000 mgr.gibba043.dnkmem (mgr.34373) 6275 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:49:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.351034+0000 mgr.gibba043.dnkmem (mgr.34373) 6276 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:49:56.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.566715+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:49:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.567782+0000 mgr.gibba043.dnkmem (mgr.34373) 6277 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.569546+0000 mgr.gibba043.dnkmem (mgr.34373) 6278 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.570548+0000 mon.c (mon.1) 1631 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.570689+0000 mgr.gibba043.dnkmem (mgr.34373) 6279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:56.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.570731+0000 mgr.gibba043.dnkmem (mgr.34373) 6280 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:56.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.571911+0000 mon.c (mon.1) 1632 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.572001+0000 mgr.gibba043.dnkmem (mgr.34373) 6281 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:56.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.572044+0000 mgr.gibba043.dnkmem (mgr.34373) 6282 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:56.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.573163+0000 mon.c (mon.1) 1633 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.573169+0000 mgr.gibba043.dnkmem (mgr.34373) 6283 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:56.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.574332+0000 mon.c (mon.1) 1634 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.574760+0000 mgr.gibba043.dnkmem (mgr.34373) 6284 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:56.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.574804+0000 mgr.gibba043.dnkmem (mgr.34373) 6285 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:56.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.576052+0000 mgr.gibba043.dnkmem (mgr.34373) 6286 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.576421+0000 mgr.gibba043.dnkmem (mgr.34373) 6287 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.577285+0000 mon.c (mon.1) 1635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.577644+0000 mgr.gibba043.dnkmem (mgr.34373) 6288 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.577692+0000 mgr.gibba043.dnkmem (mgr.34373) 6289 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:56.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: cephadm 2021-03-10T15:49:55.577821+0000 mgr.gibba043.dnkmem (mgr.34373) 6290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:56.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:56 gibba003 bash[32348]: audit 2021-03-10T15:49:55.578770+0000 mon.c (mon.1) 1636 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.349466+0000 mgr.gibba043.dnkmem (mgr.34373) 6275 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:49:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.351034+0000 mgr.gibba043.dnkmem (mgr.34373) 6276 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:49:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.566715+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:49:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.567782+0000 mgr.gibba043.dnkmem (mgr.34373) 6277 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.569546+0000 mgr.gibba043.dnkmem (mgr.34373) 6278 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.570548+0000 mon.c (mon.1) 1631 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.570689+0000 mgr.gibba043.dnkmem (mgr.34373) 6279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.570731+0000 mgr.gibba043.dnkmem (mgr.34373) 6280 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.571911+0000 mon.c (mon.1) 1632 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.572001+0000 mgr.gibba043.dnkmem (mgr.34373) 6281 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.572044+0000 mgr.gibba043.dnkmem (mgr.34373) 6282 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:57.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.573163+0000 mon.c (mon.1) 1633 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.573169+0000 mgr.gibba043.dnkmem (mgr.34373) 6283 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.574332+0000 mon.c (mon.1) 1634 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.574760+0000 mgr.gibba043.dnkmem (mgr.34373) 6284 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.574804+0000 mgr.gibba043.dnkmem (mgr.34373) 6285 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:57.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.576052+0000 mgr.gibba043.dnkmem (mgr.34373) 6286 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.576421+0000 mgr.gibba043.dnkmem (mgr.34373) 6287 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.577285+0000 mon.c (mon.1) 1635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.577644+0000 mgr.gibba043.dnkmem (mgr.34373) 6288 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.577692+0000 mgr.gibba043.dnkmem (mgr.34373) 6289 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:57.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: cephadm 2021-03-10T15:49:55.577821+0000 mgr.gibba043.dnkmem (mgr.34373) 6290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:49:57.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:56 gibba043 bash[24019]: audit 2021-03-10T15:49:55.578770+0000 mon.c (mon.1) 1636 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:57 gibba003 bash[31385]: cluster 2021-03-10T15:49:56.331289+0000 mgr.gibba043.dnkmem (mgr.34373) 6291 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:57 gibba003 bash[32348]: cluster 2021-03-10T15:49:56.331289+0000 mgr.gibba043.dnkmem (mgr.34373) 6291 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:57 gibba043 bash[24019]: cluster 2021-03-10T15:49:56.331289+0000 mgr.gibba043.dnkmem (mgr.34373) 6291 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:49:59 gibba003 bash[31385]: cluster 2021-03-10T15:49:58.332988+0000 mgr.gibba043.dnkmem (mgr.34373) 6292 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:49:59 gibba003 bash[32348]: cluster 2021-03-10T15:49:58.332988+0000 mgr.gibba043.dnkmem (mgr.34373) 6292 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:49:59 gibba043 bash[24019]: cluster 2021-03-10T15:49:58.332988+0000 mgr.gibba043.dnkmem (mgr.34373) 6292 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:00 gibba003 bash[31385]: debug 2021-03-10T15:49:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:00.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:00 gibba003 bash[31385]: cluster 2021-03-10T15:50:00.000192+0000 mon.a (mon.0) 1455 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:00.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:00 gibba003 bash[32348]: cluster 2021-03-10T15:50:00.000192+0000 mon.a (mon.0) 1455 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:00 gibba043 bash[24019]: cluster 2021-03-10T15:50:00.000192+0000 mon.a (mon.0) 1455 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:01.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:01 gibba003 bash[31385]: cluster 2021-03-10T15:50:00.334248+0000 mgr.gibba043.dnkmem (mgr.34373) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:01 gibba003 bash[32348]: cluster 2021-03-10T15:50:00.334248+0000 mgr.gibba043.dnkmem (mgr.34373) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:01 gibba043 bash[24019]: cluster 2021-03-10T15:50:00.334248+0000 mgr.gibba043.dnkmem (mgr.34373) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:03 gibba003 bash[31385]: cluster 2021-03-10T15:50:02.336069+0000 mgr.gibba043.dnkmem (mgr.34373) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:03 gibba003 bash[32348]: cluster 2021-03-10T15:50:02.336069+0000 mgr.gibba043.dnkmem (mgr.34373) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:03 gibba043 bash[24019]: cluster 2021-03-10T15:50:02.336069+0000 mgr.gibba043.dnkmem (mgr.34373) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:05 gibba003 bash[31385]: cluster 2021-03-10T15:50:04.337710+0000 mgr.gibba043.dnkmem (mgr.34373) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:05 gibba003 bash[32348]: cluster 2021-03-10T15:50:04.337710+0000 mgr.gibba043.dnkmem (mgr.34373) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:05 gibba043 bash[24019]: cluster 2021-03-10T15:50:04.337710+0000 mgr.gibba043.dnkmem (mgr.34373) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:07 gibba003 bash[31385]: cluster 2021-03-10T15:50:06.339497+0000 mgr.gibba043.dnkmem (mgr.34373) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:07 gibba003 bash[32348]: cluster 2021-03-10T15:50:06.339497+0000 mgr.gibba043.dnkmem (mgr.34373) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:07 gibba043 bash[24019]: cluster 2021-03-10T15:50:06.339497+0000 mgr.gibba043.dnkmem (mgr.34373) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:09 gibba003 bash[31385]: cluster 2021-03-10T15:50:08.340789+0000 mgr.gibba043.dnkmem (mgr.34373) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:09 gibba003 bash[32348]: cluster 2021-03-10T15:50:08.340789+0000 mgr.gibba043.dnkmem (mgr.34373) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:09 gibba043 bash[24019]: cluster 2021-03-10T15:50:08.340789+0000 mgr.gibba043.dnkmem (mgr.34373) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:11 gibba003 bash[31385]: cluster 2021-03-10T15:50:10.342078+0000 mgr.gibba043.dnkmem (mgr.34373) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:11 gibba003 bash[31385]: cephadm 2021-03-10T15:50:10.593945+0000 mgr.gibba043.dnkmem (mgr.34373) 6299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:11 gibba003 bash[32348]: cluster 2021-03-10T15:50:10.342078+0000 mgr.gibba043.dnkmem (mgr.34373) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:11 gibba003 bash[32348]: cephadm 2021-03-10T15:50:10.593945+0000 mgr.gibba043.dnkmem (mgr.34373) 6299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:11 gibba043 bash[24019]: cluster 2021-03-10T15:50:10.342078+0000 mgr.gibba043.dnkmem (mgr.34373) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:11 gibba043 bash[24019]: cephadm 2021-03-10T15:50:10.593945+0000 mgr.gibba043.dnkmem (mgr.34373) 6299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:13 gibba003 bash[31385]: cluster 2021-03-10T15:50:12.343631+0000 mgr.gibba043.dnkmem (mgr.34373) 6300 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:13 gibba003 bash[32348]: cluster 2021-03-10T15:50:12.343631+0000 mgr.gibba043.dnkmem (mgr.34373) 6300 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:13 gibba043 bash[24019]: cluster 2021-03-10T15:50:12.343631+0000 mgr.gibba043.dnkmem (mgr.34373) 6300 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.481224+0000 mon.c (mon.1) 1637 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.482058+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.635851+0000 mon.c (mon.1) 1638 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.637076+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.752375+0000 mon.c (mon.1) 1639 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.753171+0000 mon.c (mon.1) 1640 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.753757+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.753867+0000 mon.c (mon.1) 1641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:50:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.754562+0000 mon.c (mon.1) 1642 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.756326+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.757583+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:50:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[32348]: audit 2021-03-10T15:50:13.758582+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.481224+0000 mon.c (mon.1) 1637 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.482058+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.635851+0000 mon.c (mon.1) 1638 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.637076+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.752375+0000 mon.c (mon.1) 1639 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.753171+0000 mon.c (mon.1) 1640 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.753757+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.753867+0000 mon.c (mon.1) 1641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:50:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.754562+0000 mon.c (mon.1) 1642 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.756326+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.757583+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:50:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:14 gibba003 bash[31385]: audit 2021-03-10T15:50:13.758582+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.481224+0000 mon.c (mon.1) 1637 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.482058+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.635851+0000 mon.c (mon.1) 1638 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.637076+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.752375+0000 mon.c (mon.1) 1639 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.753171+0000 mon.c (mon.1) 1640 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.753757+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.753867+0000 mon.c (mon.1) 1641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:50:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.754562+0000 mon.c (mon.1) 1642 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.756326+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:50:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.757583+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:50:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:14 gibba043 bash[24019]: audit 2021-03-10T15:50:13.758582+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:15 gibba003 bash[31385]: cluster 2021-03-10T15:50:14.345307+0000 mgr.gibba043.dnkmem (mgr.34373) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:15 gibba003 bash[32348]: cluster 2021-03-10T15:50:14.345307+0000 mgr.gibba043.dnkmem (mgr.34373) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:15 gibba043 bash[24019]: cluster 2021-03-10T15:50:14.345307+0000 mgr.gibba043.dnkmem (mgr.34373) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:17 gibba003 bash[31385]: cluster 2021-03-10T15:50:16.347133+0000 mgr.gibba043.dnkmem (mgr.34373) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:17.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:17 gibba003 bash[32348]: cluster 2021-03-10T15:50:16.347133+0000 mgr.gibba043.dnkmem (mgr.34373) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:17 gibba043 bash[24019]: cluster 2021-03-10T15:50:16.347133+0000 mgr.gibba043.dnkmem (mgr.34373) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:19 gibba043 bash[24019]: cluster 2021-03-10T15:50:18.348847+0000 mgr.gibba043.dnkmem (mgr.34373) 6303 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:19 gibba003 bash[31385]: cluster 2021-03-10T15:50:18.348847+0000 mgr.gibba043.dnkmem (mgr.34373) 6303 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:19 gibba003 bash[32348]: cluster 2021-03-10T15:50:18.348847+0000 mgr.gibba043.dnkmem (mgr.34373) 6303 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.190 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:50:21.420 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:50:21.420 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (118m) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:50:21.420 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 91s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:50:21.421 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (119m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:50:21.421 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (119m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:50:21.421 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:50:21.421 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:50:21.421 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (117m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:50:21.422 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:50:21.422 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:50:21.422 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 91s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:50:21.422 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:50:21.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:50:21.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:50:21.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:50:21.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (115m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:50:21.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (114m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:50:21.424 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (114m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:50:21.424 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (114m) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:50:21.424 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 91s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:50:21.424 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:50:21.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:21 gibba003 bash[31385]: cluster 2021-03-10T15:50:20.350339+0000 mgr.gibba043.dnkmem (mgr.34373) 6304 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:21 gibba003 bash[32348]: cluster 2021-03-10T15:50:20.350339+0000 mgr.gibba043.dnkmem (mgr.34373) 6304 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:21 gibba043 bash[24019]: cluster 2021-03-10T15:50:20.350339+0000 mgr.gibba043.dnkmem (mgr.34373) 6304 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.678 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:50:21.678 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:50:21.679 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:21.679 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:50:21.679 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:50:21.679 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:21.680 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:50:21.680 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:50:21.680 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:50:21.680 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:50:21.681 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:50:21.681 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:50:21.681 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:50:21.681 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:50:21.682 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:50:22.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:22 gibba003 bash[31385]: audit 2021-03-10T15:50:21.181045+0000 mgr.gibba043.dnkmem (mgr.34373) 6305 : audit [DBG] from='client.48282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:22.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:22 gibba003 bash[31385]: audit 2021-03-10T15:50:21.406934+0000 mgr.gibba043.dnkmem (mgr.34373) 6306 : audit [DBG] from='client.58276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:22.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:22 gibba003 bash[31385]: audit 2021-03-10T15:50:21.679533+0000 mon.c (mon.1) 1643 : audit [DBG] from='client.? 172.21.2.103:0/2153904965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:22.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:22 gibba003 bash[32348]: audit 2021-03-10T15:50:21.181045+0000 mgr.gibba043.dnkmem (mgr.34373) 6305 : audit [DBG] from='client.48282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:22.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:22 gibba003 bash[32348]: audit 2021-03-10T15:50:21.406934+0000 mgr.gibba043.dnkmem (mgr.34373) 6306 : audit [DBG] from='client.58276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:22.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:22 gibba003 bash[32348]: audit 2021-03-10T15:50:21.679533+0000 mon.c (mon.1) 1643 : audit [DBG] from='client.? 172.21.2.103:0/2153904965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:22.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:22 gibba043 bash[24019]: audit 2021-03-10T15:50:21.181045+0000 mgr.gibba043.dnkmem (mgr.34373) 6305 : audit [DBG] from='client.48282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:22 gibba043 bash[24019]: audit 2021-03-10T15:50:21.406934+0000 mgr.gibba043.dnkmem (mgr.34373) 6306 : audit [DBG] from='client.58276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:22 gibba043 bash[24019]: audit 2021-03-10T15:50:21.679533+0000 mon.c (mon.1) 1643 : audit [DBG] from='client.? 172.21.2.103:0/2153904965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:23.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:23 gibba003 bash[31385]: cluster 2021-03-10T15:50:22.351751+0000 mgr.gibba043.dnkmem (mgr.34373) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:23.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:23 gibba003 bash[32348]: cluster 2021-03-10T15:50:22.351751+0000 mgr.gibba043.dnkmem (mgr.34373) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:23.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:23 gibba043 bash[24019]: cluster 2021-03-10T15:50:22.351751+0000 mgr.gibba043.dnkmem (mgr.34373) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:25.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:25 gibba003 bash[31385]: cluster 2021-03-10T15:50:24.353157+0000 mgr.gibba043.dnkmem (mgr.34373) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:25.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:25 gibba003 bash[32348]: cluster 2021-03-10T15:50:24.353157+0000 mgr.gibba043.dnkmem (mgr.34373) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:25 gibba043 bash[24019]: cluster 2021-03-10T15:50:24.353157+0000 mgr.gibba043.dnkmem (mgr.34373) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:26.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:26 gibba003 bash[31385]: cephadm 2021-03-10T15:50:25.610079+0000 mgr.gibba043.dnkmem (mgr.34373) 6309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:26 gibba003 bash[32348]: cephadm 2021-03-10T15:50:25.610079+0000 mgr.gibba043.dnkmem (mgr.34373) 6309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:26 gibba043 bash[24019]: cephadm 2021-03-10T15:50:25.610079+0000 mgr.gibba043.dnkmem (mgr.34373) 6309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:27 gibba003 bash[31385]: cluster 2021-03-10T15:50:26.355052+0000 mgr.gibba043.dnkmem (mgr.34373) 6310 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:27.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:27 gibba003 bash[32348]: cluster 2021-03-10T15:50:26.355052+0000 mgr.gibba043.dnkmem (mgr.34373) 6310 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:27 gibba043 bash[24019]: cluster 2021-03-10T15:50:26.355052+0000 mgr.gibba043.dnkmem (mgr.34373) 6310 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:29 gibba043 bash[24019]: cluster 2021-03-10T15:50:28.356717+0000 mgr.gibba043.dnkmem (mgr.34373) 6311 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:29 gibba003 bash[31385]: cluster 2021-03-10T15:50:28.356717+0000 mgr.gibba043.dnkmem (mgr.34373) 6311 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:29 gibba003 bash[32348]: cluster 2021-03-10T15:50:28.356717+0000 mgr.gibba043.dnkmem (mgr.34373) 6311 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:31.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:31 gibba003 bash[31385]: cluster 2021-03-10T15:50:30.358315+0000 mgr.gibba043.dnkmem (mgr.34373) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:31 gibba003 bash[32348]: cluster 2021-03-10T15:50:30.358315+0000 mgr.gibba043.dnkmem (mgr.34373) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:31 gibba043 bash[24019]: cluster 2021-03-10T15:50:30.358315+0000 mgr.gibba043.dnkmem (mgr.34373) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:33 gibba003 bash[31385]: cluster 2021-03-10T15:50:32.360063+0000 mgr.gibba043.dnkmem (mgr.34373) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:33 gibba003 bash[32348]: cluster 2021-03-10T15:50:32.360063+0000 mgr.gibba043.dnkmem (mgr.34373) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:33 gibba043 bash[24019]: cluster 2021-03-10T15:50:32.360063+0000 mgr.gibba043.dnkmem (mgr.34373) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:35 gibba003 bash[31385]: cluster 2021-03-10T15:50:34.361573+0000 mgr.gibba043.dnkmem (mgr.34373) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:35.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:35 gibba003 bash[32348]: cluster 2021-03-10T15:50:34.361573+0000 mgr.gibba043.dnkmem (mgr.34373) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:35 gibba043 bash[24019]: cluster 2021-03-10T15:50:34.361573+0000 mgr.gibba043.dnkmem (mgr.34373) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:37 gibba043 bash[24019]: cluster 2021-03-10T15:50:36.363419+0000 mgr.gibba043.dnkmem (mgr.34373) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:37 gibba003 bash[31385]: cluster 2021-03-10T15:50:36.363419+0000 mgr.gibba043.dnkmem (mgr.34373) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:37 gibba003 bash[32348]: cluster 2021-03-10T15:50:36.363419+0000 mgr.gibba043.dnkmem (mgr.34373) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:39 gibba043 bash[24019]: cluster 2021-03-10T15:50:38.365057+0000 mgr.gibba043.dnkmem (mgr.34373) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:39 gibba003 bash[31385]: cluster 2021-03-10T15:50:38.365057+0000 mgr.gibba043.dnkmem (mgr.34373) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:39 gibba003 bash[32348]: cluster 2021-03-10T15:50:38.365057+0000 mgr.gibba043.dnkmem (mgr.34373) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:41 gibba003 bash[31385]: cluster 2021-03-10T15:50:40.366645+0000 mgr.gibba043.dnkmem (mgr.34373) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:41 gibba003 bash[31385]: cephadm 2021-03-10T15:50:40.612435+0000 mgr.gibba043.dnkmem (mgr.34373) 6318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:41 gibba003 bash[32348]: cluster 2021-03-10T15:50:40.366645+0000 mgr.gibba043.dnkmem (mgr.34373) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:41 gibba003 bash[32348]: cephadm 2021-03-10T15:50:40.612435+0000 mgr.gibba043.dnkmem (mgr.34373) 6318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:41 gibba043 bash[24019]: cluster 2021-03-10T15:50:40.366645+0000 mgr.gibba043.dnkmem (mgr.34373) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:41 gibba043 bash[24019]: cephadm 2021-03-10T15:50:40.612435+0000 mgr.gibba043.dnkmem (mgr.34373) 6318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:43 gibba003 bash[31385]: cluster 2021-03-10T15:50:42.368226+0000 mgr.gibba043.dnkmem (mgr.34373) 6319 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:43 gibba003 bash[32348]: cluster 2021-03-10T15:50:42.368226+0000 mgr.gibba043.dnkmem (mgr.34373) 6319 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:43 gibba043 bash[24019]: cluster 2021-03-10T15:50:42.368226+0000 mgr.gibba043.dnkmem (mgr.34373) 6319 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:45 gibba043 bash[24019]: cluster 2021-03-10T15:50:44.369917+0000 mgr.gibba043.dnkmem (mgr.34373) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:45 gibba003 bash[31385]: cluster 2021-03-10T15:50:44.369917+0000 mgr.gibba043.dnkmem (mgr.34373) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:45 gibba003 bash[32348]: cluster 2021-03-10T15:50:44.369917+0000 mgr.gibba043.dnkmem (mgr.34373) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:47 gibba043 bash[24019]: cluster 2021-03-10T15:50:46.371945+0000 mgr.gibba043.dnkmem (mgr.34373) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:47 gibba003 bash[31385]: cluster 2021-03-10T15:50:46.371945+0000 mgr.gibba043.dnkmem (mgr.34373) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:47 gibba003 bash[32348]: cluster 2021-03-10T15:50:46.371945+0000 mgr.gibba043.dnkmem (mgr.34373) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:49 gibba043 bash[24019]: cluster 2021-03-10T15:50:48.373338+0000 mgr.gibba043.dnkmem (mgr.34373) 6322 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:49 gibba003 bash[31385]: cluster 2021-03-10T15:50:48.373338+0000 mgr.gibba043.dnkmem (mgr.34373) 6322 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:49 gibba003 bash[32348]: cluster 2021-03-10T15:50:48.373338+0000 mgr.gibba043.dnkmem (mgr.34373) 6322 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:51 gibba003 bash[31385]: cluster 2021-03-10T15:50:50.374643+0000 mgr.gibba043.dnkmem (mgr.34373) 6323 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:51 gibba003 bash[32348]: cluster 2021-03-10T15:50:50.374643+0000 mgr.gibba043.dnkmem (mgr.34373) 6323 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:51 gibba043 bash[24019]: cluster 2021-03-10T15:50:50.374643+0000 mgr.gibba043.dnkmem (mgr.34373) 6323 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.928 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:50:52.154 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:50:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (119m) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:50:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:50:52.155 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (119m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:50:52.156 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (119m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:50:52.156 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:50:52.156 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:50:52.156 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:50:52.157 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:50:52.157 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:50:52.157 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:50:52.157 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:50:52.157 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:50:52.158 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:50:52.158 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:50:52.158 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:50:52.158 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:50:52.159 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (114m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:50:52.159 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (114m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:50:52.159 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:50:52.159 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:50:52.405 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:50:52.406 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:50:52.406 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:52.406 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:50:52.406 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:50:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:50:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:50:52.407 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:50:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:50:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:50:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:50:52.408 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:50:52.409 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:50:52.409 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:50:52.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:52 gibba043 bash[24019]: audit 2021-03-10T15:50:52.406393+0000 mon.a (mon.0) 1462 : audit [DBG] from='client.? 172.21.2.103:0/1930505042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:52.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:52 gibba003 bash[31385]: audit 2021-03-10T15:50:52.406393+0000 mon.a (mon.0) 1462 : audit [DBG] from='client.? 172.21.2.103:0/1930505042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:52.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:52 gibba003 bash[32348]: audit 2021-03-10T15:50:52.406393+0000 mon.a (mon.0) 1462 : audit [DBG] from='client.? 172.21.2.103:0/1930505042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:53 gibba043 bash[24019]: audit 2021-03-10T15:50:51.918093+0000 mgr.gibba043.dnkmem (mgr.34373) 6324 : audit [DBG] from='client.58288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:53 gibba043 bash[24019]: audit 2021-03-10T15:50:52.141799+0000 mgr.gibba043.dnkmem (mgr.34373) 6325 : audit [DBG] from='client.48306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:53 gibba043 bash[24019]: cluster 2021-03-10T15:50:52.376273+0000 mgr.gibba043.dnkmem (mgr.34373) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:53 gibba003 bash[31385]: audit 2021-03-10T15:50:51.918093+0000 mgr.gibba043.dnkmem (mgr.34373) 6324 : audit [DBG] from='client.58288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:53 gibba003 bash[31385]: audit 2021-03-10T15:50:52.141799+0000 mgr.gibba043.dnkmem (mgr.34373) 6325 : audit [DBG] from='client.48306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:53.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:53 gibba003 bash[31385]: cluster 2021-03-10T15:50:52.376273+0000 mgr.gibba043.dnkmem (mgr.34373) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:53 gibba003 bash[32348]: audit 2021-03-10T15:50:51.918093+0000 mgr.gibba043.dnkmem (mgr.34373) 6324 : audit [DBG] from='client.58288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:53 gibba003 bash[32348]: audit 2021-03-10T15:50:52.141799+0000 mgr.gibba043.dnkmem (mgr.34373) 6325 : audit [DBG] from='client.48306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:53 gibba003 bash[32348]: cluster 2021-03-10T15:50:52.376273+0000 mgr.gibba043.dnkmem (mgr.34373) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:55 gibba043 bash[24019]: cluster 2021-03-10T15:50:54.377858+0000 mgr.gibba043.dnkmem (mgr.34373) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:55 gibba003 bash[31385]: cluster 2021-03-10T15:50:54.377858+0000 mgr.gibba043.dnkmem (mgr.34373) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:55 gibba003 bash[32348]: cluster 2021-03-10T15:50:54.377858+0000 mgr.gibba043.dnkmem (mgr.34373) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.629264+0000 mgr.gibba043.dnkmem (mgr.34373) 6328 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:50:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.630802+0000 mgr.gibba043.dnkmem (mgr.34373) 6329 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:50:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.862024+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:50:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.865433+0000 mon.c (mon.1) 1644 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.867072+0000 mon.c (mon.1) 1645 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.870757+0000 mon.c (mon.1) 1646 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.873850+0000 mon.c (mon.1) 1647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.882164+0000 mon.c (mon.1) 1648 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:56 gibba043 bash[24019]: audit 2021-03-10T15:50:55.887418+0000 mon.c (mon.1) 1649 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.629264+0000 mgr.gibba043.dnkmem (mgr.34373) 6328 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:50:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.630802+0000 mgr.gibba043.dnkmem (mgr.34373) 6329 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:50:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.862024+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:50:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.865433+0000 mon.c (mon.1) 1644 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.867072+0000 mon.c (mon.1) 1645 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.870757+0000 mon.c (mon.1) 1646 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.873850+0000 mon.c (mon.1) 1647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.882164+0000 mon.c (mon.1) 1648 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[31385]: audit 2021-03-10T15:50:55.887418+0000 mon.c (mon.1) 1649 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.629264+0000 mgr.gibba043.dnkmem (mgr.34373) 6328 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:50:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.630802+0000 mgr.gibba043.dnkmem (mgr.34373) 6329 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:50:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.862024+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:50:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.865433+0000 mon.c (mon.1) 1644 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.867072+0000 mon.c (mon.1) 1645 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.870757+0000 mon.c (mon.1) 1646 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.873850+0000 mon.c (mon.1) 1647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.882164+0000 mon.c (mon.1) 1648 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:56 gibba003 bash[32348]: audit 2021-03-10T15:50:55.887418+0000 mon.c (mon.1) 1649 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.862773+0000 mgr.gibba043.dnkmem (mgr.34373) 6330 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.864641+0000 mgr.gibba043.dnkmem (mgr.34373) 6331 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.867297+0000 mgr.gibba043.dnkmem (mgr.34373) 6332 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.867753+0000 mgr.gibba043.dnkmem (mgr.34373) 6333 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.870713+0000 mgr.gibba043.dnkmem (mgr.34373) 6334 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.871213+0000 mgr.gibba043.dnkmem (mgr.34373) 6335 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.874244+0000 mgr.gibba043.dnkmem (mgr.34373) 6336 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.877728+0000 mgr.gibba043.dnkmem (mgr.34373) 6337 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.878188+0000 mgr.gibba043.dnkmem (mgr.34373) 6338 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.882394+0000 mgr.gibba043.dnkmem (mgr.34373) 6339 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.884516+0000 mgr.gibba043.dnkmem (mgr.34373) 6340 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.888627+0000 mgr.gibba043.dnkmem (mgr.34373) 6341 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.889102+0000 mgr.gibba043.dnkmem (mgr.34373) 6342 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cephadm 2021-03-10T15:50:55.889876+0000 mgr.gibba043.dnkmem (mgr.34373) 6343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:57.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:57 gibba043 bash[24019]: cluster 2021-03-10T15:50:56.379797+0000 mgr.gibba043.dnkmem (mgr.34373) 6344 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.862773+0000 mgr.gibba043.dnkmem (mgr.34373) 6330 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.864641+0000 mgr.gibba043.dnkmem (mgr.34373) 6331 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.867297+0000 mgr.gibba043.dnkmem (mgr.34373) 6332 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.867753+0000 mgr.gibba043.dnkmem (mgr.34373) 6333 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.870713+0000 mgr.gibba043.dnkmem (mgr.34373) 6334 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.871213+0000 mgr.gibba043.dnkmem (mgr.34373) 6335 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.874244+0000 mgr.gibba043.dnkmem (mgr.34373) 6336 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.877728+0000 mgr.gibba043.dnkmem (mgr.34373) 6337 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.878188+0000 mgr.gibba043.dnkmem (mgr.34373) 6338 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.882394+0000 mgr.gibba043.dnkmem (mgr.34373) 6339 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.884516+0000 mgr.gibba043.dnkmem (mgr.34373) 6340 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.888627+0000 mgr.gibba043.dnkmem (mgr.34373) 6341 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.889102+0000 mgr.gibba043.dnkmem (mgr.34373) 6342 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cephadm 2021-03-10T15:50:55.889876+0000 mgr.gibba043.dnkmem (mgr.34373) 6343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[31385]: cluster 2021-03-10T15:50:56.379797+0000 mgr.gibba043.dnkmem (mgr.34373) 6344 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.862773+0000 mgr.gibba043.dnkmem (mgr.34373) 6330 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.864641+0000 mgr.gibba043.dnkmem (mgr.34373) 6331 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.867297+0000 mgr.gibba043.dnkmem (mgr.34373) 6332 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.867753+0000 mgr.gibba043.dnkmem (mgr.34373) 6333 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.870713+0000 mgr.gibba043.dnkmem (mgr.34373) 6334 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.871213+0000 mgr.gibba043.dnkmem (mgr.34373) 6335 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.874244+0000 mgr.gibba043.dnkmem (mgr.34373) 6336 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.877728+0000 mgr.gibba043.dnkmem (mgr.34373) 6337 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.878188+0000 mgr.gibba043.dnkmem (mgr.34373) 6338 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.882394+0000 mgr.gibba043.dnkmem (mgr.34373) 6339 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.884516+0000 mgr.gibba043.dnkmem (mgr.34373) 6340 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.888627+0000 mgr.gibba043.dnkmem (mgr.34373) 6341 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.889102+0000 mgr.gibba043.dnkmem (mgr.34373) 6342 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cephadm 2021-03-10T15:50:55.889876+0000 mgr.gibba043.dnkmem (mgr.34373) 6343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:50:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:57 gibba003 bash[32348]: cluster 2021-03-10T15:50:56.379797+0000 mgr.gibba043.dnkmem (mgr.34373) 6344 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:50:59 gibba043 bash[24019]: cluster 2021-03-10T15:50:58.381192+0000 mgr.gibba043.dnkmem (mgr.34373) 6345 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:50:59 gibba003 bash[31385]: cluster 2021-03-10T15:50:58.381192+0000 mgr.gibba043.dnkmem (mgr.34373) 6345 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:50:59 gibba003 bash[32348]: cluster 2021-03-10T15:50:58.381192+0000 mgr.gibba043.dnkmem (mgr.34373) 6345 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:01 gibba003 bash[31385]: cluster 2021-03-10T15:51:00.382718+0000 mgr.gibba043.dnkmem (mgr.34373) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:01 gibba003 bash[32348]: cluster 2021-03-10T15:51:00.382718+0000 mgr.gibba043.dnkmem (mgr.34373) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:01 gibba043 bash[24019]: cluster 2021-03-10T15:51:00.382718+0000 mgr.gibba043.dnkmem (mgr.34373) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:03 gibba043 bash[24019]: cluster 2021-03-10T15:51:02.384456+0000 mgr.gibba043.dnkmem (mgr.34373) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:03 gibba003 bash[31385]: cluster 2021-03-10T15:51:02.384456+0000 mgr.gibba043.dnkmem (mgr.34373) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:03 gibba003 bash[32348]: cluster 2021-03-10T15:51:02.384456+0000 mgr.gibba043.dnkmem (mgr.34373) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:05 gibba043 bash[24019]: cluster 2021-03-10T15:51:04.385858+0000 mgr.gibba043.dnkmem (mgr.34373) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:05 gibba003 bash[31385]: cluster 2021-03-10T15:51:04.385858+0000 mgr.gibba043.dnkmem (mgr.34373) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:05 gibba003 bash[32348]: cluster 2021-03-10T15:51:04.385858+0000 mgr.gibba043.dnkmem (mgr.34373) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:07 gibba043 bash[24019]: cluster 2021-03-10T15:51:06.387767+0000 mgr.gibba043.dnkmem (mgr.34373) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:07 gibba003 bash[31385]: cluster 2021-03-10T15:51:06.387767+0000 mgr.gibba043.dnkmem (mgr.34373) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:07 gibba003 bash[32348]: cluster 2021-03-10T15:51:06.387767+0000 mgr.gibba043.dnkmem (mgr.34373) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:09 gibba043 bash[24019]: cluster 2021-03-10T15:51:08.389482+0000 mgr.gibba043.dnkmem (mgr.34373) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:09 gibba003 bash[31385]: cluster 2021-03-10T15:51:08.389482+0000 mgr.gibba043.dnkmem (mgr.34373) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:09 gibba003 bash[32348]: cluster 2021-03-10T15:51:08.389482+0000 mgr.gibba043.dnkmem (mgr.34373) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:11 gibba043 bash[24019]: cluster 2021-03-10T15:51:10.390878+0000 mgr.gibba043.dnkmem (mgr.34373) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:11 gibba003 bash[31385]: cluster 2021-03-10T15:51:10.390878+0000 mgr.gibba043.dnkmem (mgr.34373) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:11 gibba003 bash[32348]: cluster 2021-03-10T15:51:10.390878+0000 mgr.gibba043.dnkmem (mgr.34373) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:12.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:12 gibba043 bash[24019]: cephadm 2021-03-10T15:51:10.905903+0000 mgr.gibba043.dnkmem (mgr.34373) 6352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:12.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:12 gibba003 bash[31385]: cephadm 2021-03-10T15:51:10.905903+0000 mgr.gibba043.dnkmem (mgr.34373) 6352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:12.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:12 gibba003 bash[32348]: cephadm 2021-03-10T15:51:10.905903+0000 mgr.gibba043.dnkmem (mgr.34373) 6352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:13 gibba043 bash[24019]: cluster 2021-03-10T15:51:12.392485+0000 mgr.gibba043.dnkmem (mgr.34373) 6353 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:13 gibba003 bash[31385]: cluster 2021-03-10T15:51:12.392485+0000 mgr.gibba043.dnkmem (mgr.34373) 6353 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:13 gibba003 bash[32348]: cluster 2021-03-10T15:51:12.392485+0000 mgr.gibba043.dnkmem (mgr.34373) 6353 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.486550+0000 mon.c (mon.1) 1650 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.487678+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.644828+0000 mon.c (mon.1) 1651 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.645943+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.764087+0000 mon.c (mon.1) 1652 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:51:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.764870+0000 mon.c (mon.1) 1653 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.765305+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:51:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.765563+0000 mon.c (mon.1) 1654 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.766390+0000 mon.c (mon.1) 1655 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:51:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.766607+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.767841+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:14 gibba043 bash[24019]: audit 2021-03-10T15:51:13.768762+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:51:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.486550+0000 mon.c (mon.1) 1650 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.487678+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.644828+0000 mon.c (mon.1) 1651 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.645943+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.764087+0000 mon.c (mon.1) 1652 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:51:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.764870+0000 mon.c (mon.1) 1653 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.765305+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:51:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.765563+0000 mon.c (mon.1) 1654 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.766390+0000 mon.c (mon.1) 1655 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:51:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.766607+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.767841+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[31385]: audit 2021-03-10T15:51:13.768762+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:51:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.486550+0000 mon.c (mon.1) 1650 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.487678+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.644828+0000 mon.c (mon.1) 1651 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.645943+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.764087+0000 mon.c (mon.1) 1652 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:51:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.764870+0000 mon.c (mon.1) 1653 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.765305+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:51:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.765563+0000 mon.c (mon.1) 1654 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.766390+0000 mon.c (mon.1) 1655 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:51:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.766607+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.767841+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:51:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:14 gibba003 bash[32348]: audit 2021-03-10T15:51:13.768762+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:51:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:15 gibba043 bash[24019]: cluster 2021-03-10T15:51:14.394012+0000 mgr.gibba043.dnkmem (mgr.34373) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:15 gibba003 bash[31385]: cluster 2021-03-10T15:51:14.394012+0000 mgr.gibba043.dnkmem (mgr.34373) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:15 gibba003 bash[32348]: cluster 2021-03-10T15:51:14.394012+0000 mgr.gibba043.dnkmem (mgr.34373) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:17 gibba043 bash[24019]: cluster 2021-03-10T15:51:16.395849+0000 mgr.gibba043.dnkmem (mgr.34373) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:17 gibba003 bash[31385]: cluster 2021-03-10T15:51:16.395849+0000 mgr.gibba043.dnkmem (mgr.34373) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:17 gibba003 bash[32348]: cluster 2021-03-10T15:51:16.395849+0000 mgr.gibba043.dnkmem (mgr.34373) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:19 gibba043 bash[24019]: cluster 2021-03-10T15:51:18.397492+0000 mgr.gibba043.dnkmem (mgr.34373) 6356 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:19 gibba003 bash[31385]: cluster 2021-03-10T15:51:18.397492+0000 mgr.gibba043.dnkmem (mgr.34373) 6356 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:19 gibba003 bash[32348]: cluster 2021-03-10T15:51:18.397492+0000 mgr.gibba043.dnkmem (mgr.34373) 6356 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:21 gibba043 bash[24019]: cluster 2021-03-10T15:51:20.399059+0000 mgr.gibba043.dnkmem (mgr.34373) 6357 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:21 gibba003 bash[31385]: cluster 2021-03-10T15:51:20.399059+0000 mgr.gibba043.dnkmem (mgr.34373) 6357 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:21 gibba003 bash[32348]: cluster 2021-03-10T15:51:20.399059+0000 mgr.gibba043.dnkmem (mgr.34373) 6357 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:22.658 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:51:22.887 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:51:22.887 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (119m) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:51:22.887 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:51:22.888 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:51:22.888 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:51:22.888 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:51:22.888 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:51:22.889 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:51:22.889 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:51:22.889 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:51:22.889 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:51:22.890 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:51:22.890 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:51:22.890 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:51:22.890 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:51:22.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:51:22.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:51:22.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:51:22.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:51:22.892 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:51:22.892 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:51:23.137 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:51:23.137 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:51:23.138 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:23.138 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:51:23.138 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:51:23.139 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:23.139 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:51:23.139 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:51:23.139 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:51:23.140 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:51:23.140 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:51:23.140 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:51:23.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:51:23.141 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:51:23.141 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:51:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:23 gibba043 bash[24019]: cluster 2021-03-10T15:51:22.400784+0000 mgr.gibba043.dnkmem (mgr.34373) 6358 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:23 gibba043 bash[24019]: audit 2021-03-10T15:51:22.640067+0000 mgr.gibba043.dnkmem (mgr.34373) 6359 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:23 gibba043 bash[24019]: audit 2021-03-10T15:51:23.137887+0000 mon.c (mon.1) 1656 : audit [DBG] from='client.? 172.21.2.103:0/4165370495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:23 gibba003 bash[31385]: cluster 2021-03-10T15:51:22.400784+0000 mgr.gibba043.dnkmem (mgr.34373) 6358 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:23 gibba003 bash[31385]: audit 2021-03-10T15:51:22.640067+0000 mgr.gibba043.dnkmem (mgr.34373) 6359 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:23 gibba003 bash[31385]: audit 2021-03-10T15:51:23.137887+0000 mon.c (mon.1) 1656 : audit [DBG] from='client.? 172.21.2.103:0/4165370495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:23 gibba003 bash[32348]: cluster 2021-03-10T15:51:22.400784+0000 mgr.gibba043.dnkmem (mgr.34373) 6358 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:23 gibba003 bash[32348]: audit 2021-03-10T15:51:22.640067+0000 mgr.gibba043.dnkmem (mgr.34373) 6359 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:23.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:23 gibba003 bash[32348]: audit 2021-03-10T15:51:23.137887+0000 mon.c (mon.1) 1656 : audit [DBG] from='client.? 172.21.2.103:0/4165370495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:24.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:24 gibba043 bash[24019]: audit 2021-03-10T15:51:22.873559+0000 mgr.gibba043.dnkmem (mgr.34373) 6360 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:24.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:24 gibba003 bash[31385]: audit 2021-03-10T15:51:22.873559+0000 mgr.gibba043.dnkmem (mgr.34373) 6360 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:24.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:24 gibba003 bash[32348]: audit 2021-03-10T15:51:22.873559+0000 mgr.gibba043.dnkmem (mgr.34373) 6360 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:25 gibba043 bash[24019]: cluster 2021-03-10T15:51:24.402595+0000 mgr.gibba043.dnkmem (mgr.34373) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:25 gibba003 bash[31385]: cluster 2021-03-10T15:51:24.402595+0000 mgr.gibba043.dnkmem (mgr.34373) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:25 gibba003 bash[32348]: cluster 2021-03-10T15:51:24.402595+0000 mgr.gibba043.dnkmem (mgr.34373) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:27 gibba043 bash[24019]: cephadm 2021-03-10T15:51:25.921949+0000 mgr.gibba043.dnkmem (mgr.34373) 6362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:27 gibba043 bash[24019]: cluster 2021-03-10T15:51:26.404490+0000 mgr.gibba043.dnkmem (mgr.34373) 6363 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:27 gibba003 bash[31385]: cephadm 2021-03-10T15:51:25.921949+0000 mgr.gibba043.dnkmem (mgr.34373) 6362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:27 gibba003 bash[31385]: cluster 2021-03-10T15:51:26.404490+0000 mgr.gibba043.dnkmem (mgr.34373) 6363 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:27 gibba003 bash[32348]: cephadm 2021-03-10T15:51:25.921949+0000 mgr.gibba043.dnkmem (mgr.34373) 6362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:27 gibba003 bash[32348]: cluster 2021-03-10T15:51:26.404490+0000 mgr.gibba043.dnkmem (mgr.34373) 6363 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:29 gibba043 bash[24019]: cluster 2021-03-10T15:51:28.406145+0000 mgr.gibba043.dnkmem (mgr.34373) 6364 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:29 gibba003 bash[31385]: cluster 2021-03-10T15:51:28.406145+0000 mgr.gibba043.dnkmem (mgr.34373) 6364 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:29 gibba003 bash[32348]: cluster 2021-03-10T15:51:28.406145+0000 mgr.gibba043.dnkmem (mgr.34373) 6364 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:31 gibba043 bash[24019]: cluster 2021-03-10T15:51:30.407507+0000 mgr.gibba043.dnkmem (mgr.34373) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:31 gibba003 bash[31385]: cluster 2021-03-10T15:51:30.407507+0000 mgr.gibba043.dnkmem (mgr.34373) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:31 gibba003 bash[32348]: cluster 2021-03-10T15:51:30.407507+0000 mgr.gibba043.dnkmem (mgr.34373) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:33 gibba043 bash[24019]: cluster 2021-03-10T15:51:32.409028+0000 mgr.gibba043.dnkmem (mgr.34373) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:33 gibba003 bash[31385]: cluster 2021-03-10T15:51:32.409028+0000 mgr.gibba043.dnkmem (mgr.34373) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:33 gibba003 bash[32348]: cluster 2021-03-10T15:51:32.409028+0000 mgr.gibba043.dnkmem (mgr.34373) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:35 gibba043 bash[24019]: cluster 2021-03-10T15:51:34.410883+0000 mgr.gibba043.dnkmem (mgr.34373) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:35 gibba003 bash[31385]: cluster 2021-03-10T15:51:34.410883+0000 mgr.gibba043.dnkmem (mgr.34373) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:35 gibba003 bash[32348]: cluster 2021-03-10T15:51:34.410883+0000 mgr.gibba043.dnkmem (mgr.34373) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:37 gibba043 bash[24019]: cluster 2021-03-10T15:51:36.412684+0000 mgr.gibba043.dnkmem (mgr.34373) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:37 gibba003 bash[31385]: cluster 2021-03-10T15:51:36.412684+0000 mgr.gibba043.dnkmem (mgr.34373) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:37 gibba003 bash[32348]: cluster 2021-03-10T15:51:36.412684+0000 mgr.gibba043.dnkmem (mgr.34373) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:39 gibba043 bash[24019]: cluster 2021-03-10T15:51:38.414223+0000 mgr.gibba043.dnkmem (mgr.34373) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:39 gibba003 bash[31385]: cluster 2021-03-10T15:51:38.414223+0000 mgr.gibba043.dnkmem (mgr.34373) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:39 gibba003 bash[32348]: cluster 2021-03-10T15:51:38.414223+0000 mgr.gibba043.dnkmem (mgr.34373) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:41 gibba043 bash[24019]: cluster 2021-03-10T15:51:40.415802+0000 mgr.gibba043.dnkmem (mgr.34373) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:41 gibba003 bash[31385]: cluster 2021-03-10T15:51:40.415802+0000 mgr.gibba043.dnkmem (mgr.34373) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:41 gibba003 bash[32348]: cluster 2021-03-10T15:51:40.415802+0000 mgr.gibba043.dnkmem (mgr.34373) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:42.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:42 gibba043 bash[24019]: cephadm 2021-03-10T15:51:40.936637+0000 mgr.gibba043.dnkmem (mgr.34373) 6371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:42.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:42 gibba003 bash[31385]: cephadm 2021-03-10T15:51:40.936637+0000 mgr.gibba043.dnkmem (mgr.34373) 6371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:42.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:42 gibba003 bash[32348]: cephadm 2021-03-10T15:51:40.936637+0000 mgr.gibba043.dnkmem (mgr.34373) 6371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:43.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:43 gibba043 bash[24019]: cluster 2021-03-10T15:51:42.417200+0000 mgr.gibba043.dnkmem (mgr.34373) 6372 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:43 gibba003 bash[31385]: cluster 2021-03-10T15:51:42.417200+0000 mgr.gibba043.dnkmem (mgr.34373) 6372 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:43 gibba003 bash[32348]: cluster 2021-03-10T15:51:42.417200+0000 mgr.gibba043.dnkmem (mgr.34373) 6372 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:45 gibba043 bash[24019]: cluster 2021-03-10T15:51:44.419008+0000 mgr.gibba043.dnkmem (mgr.34373) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:45 gibba003 bash[31385]: cluster 2021-03-10T15:51:44.419008+0000 mgr.gibba043.dnkmem (mgr.34373) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:45 gibba003 bash[32348]: cluster 2021-03-10T15:51:44.419008+0000 mgr.gibba043.dnkmem (mgr.34373) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:47 gibba043 bash[24019]: cluster 2021-03-10T15:51:46.420755+0000 mgr.gibba043.dnkmem (mgr.34373) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:47 gibba003 bash[31385]: cluster 2021-03-10T15:51:46.420755+0000 mgr.gibba043.dnkmem (mgr.34373) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:47 gibba003 bash[32348]: cluster 2021-03-10T15:51:46.420755+0000 mgr.gibba043.dnkmem (mgr.34373) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:49 gibba043 bash[24019]: cluster 2021-03-10T15:51:48.422392+0000 mgr.gibba043.dnkmem (mgr.34373) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:49 gibba003 bash[31385]: cluster 2021-03-10T15:51:48.422392+0000 mgr.gibba043.dnkmem (mgr.34373) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:49 gibba003 bash[32348]: cluster 2021-03-10T15:51:48.422392+0000 mgr.gibba043.dnkmem (mgr.34373) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:51 gibba043 bash[24019]: cluster 2021-03-10T15:51:50.424025+0000 mgr.gibba043.dnkmem (mgr.34373) 6376 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:51 gibba003 bash[31385]: cluster 2021-03-10T15:51:50.424025+0000 mgr.gibba043.dnkmem (mgr.34373) 6376 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:51 gibba003 bash[32348]: cluster 2021-03-10T15:51:50.424025+0000 mgr.gibba043.dnkmem (mgr.34373) 6376 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.391 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:51:53.636 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:51:53.636 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:51:53.637 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:51:53.637 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:51:53.637 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:51:53.637 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:51:53.638 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:51:53.638 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:51:53.638 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:51:53.638 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:51:53.639 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:51:53.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:51:53.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:51:53.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:51:53.639 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:51:53.640 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:51:53.640 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:51:53.640 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (115m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:51:53.640 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (115m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:51:53.641 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:51:53.641 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:51:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:53 gibba043 bash[24019]: cluster 2021-03-10T15:51:52.425564+0000 mgr.gibba043.dnkmem (mgr.34373) 6377 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.885 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:51:53.886 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:51:53.886 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:53.886 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:51:53.886 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:51:53.887 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:53.887 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:51:53.887 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:51:53.887 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:51:53.888 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:51:53.888 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:51:53.888 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:51:53.888 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:51:53.888 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:51:53.889 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:51:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:53 gibba003 bash[31385]: cluster 2021-03-10T15:51:52.425564+0000 mgr.gibba043.dnkmem (mgr.34373) 6377 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:53 gibba003 bash[32348]: cluster 2021-03-10T15:51:52.425564+0000 mgr.gibba043.dnkmem (mgr.34373) 6377 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:54.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:54 gibba043 bash[24019]: audit 2021-03-10T15:51:53.373395+0000 mgr.gibba043.dnkmem (mgr.34373) 6378 : audit [DBG] from='client.58324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:54.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:54 gibba043 bash[24019]: audit 2021-03-10T15:51:53.623020+0000 mgr.gibba043.dnkmem (mgr.34373) 6379 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:54 gibba043 bash[24019]: audit 2021-03-10T15:51:53.886936+0000 mon.c (mon.1) 1657 : audit [DBG] from='client.? 172.21.2.103:0/2486600168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:54.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:54 gibba003 bash[31385]: audit 2021-03-10T15:51:53.373395+0000 mgr.gibba043.dnkmem (mgr.34373) 6378 : audit [DBG] from='client.58324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:54.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:54 gibba003 bash[31385]: audit 2021-03-10T15:51:53.623020+0000 mgr.gibba043.dnkmem (mgr.34373) 6379 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:54.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:54 gibba003 bash[31385]: audit 2021-03-10T15:51:53.886936+0000 mon.c (mon.1) 1657 : audit [DBG] from='client.? 172.21.2.103:0/2486600168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:54 gibba003 bash[32348]: audit 2021-03-10T15:51:53.373395+0000 mgr.gibba043.dnkmem (mgr.34373) 6378 : audit [DBG] from='client.58324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:54 gibba003 bash[32348]: audit 2021-03-10T15:51:53.623020+0000 mgr.gibba043.dnkmem (mgr.34373) 6379 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:54 gibba003 bash[32348]: audit 2021-03-10T15:51:53.886936+0000 mon.c (mon.1) 1657 : audit [DBG] from='client.? 172.21.2.103:0/2486600168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:55.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:55 gibba043 bash[24019]: cluster 2021-03-10T15:51:54.427316+0000 mgr.gibba043.dnkmem (mgr.34373) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:55 gibba003 bash[31385]: cluster 2021-03-10T15:51:54.427316+0000 mgr.gibba043.dnkmem (mgr.34373) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:55 gibba003 bash[32348]: cluster 2021-03-10T15:51:54.427316+0000 mgr.gibba043.dnkmem (mgr.34373) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:55.946374+0000 mgr.gibba043.dnkmem (mgr.34373) 6381 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:51:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:55.948027+0000 mgr.gibba043.dnkmem (mgr.34373) 6382 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:51:57.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.169477+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:51:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.170386+0000 mgr.gibba043.dnkmem (mgr.34373) 6383 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.172207+0000 mgr.gibba043.dnkmem (mgr.34373) 6384 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.173177+0000 mon.c (mon.1) 1658 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.173460+0000 mgr.gibba043.dnkmem (mgr.34373) 6385 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.173496+0000 mgr.gibba043.dnkmem (mgr.34373) 6386 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.174601+0000 mon.c (mon.1) 1659 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.174733+0000 mgr.gibba043.dnkmem (mgr.34373) 6387 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.174770+0000 mgr.gibba043.dnkmem (mgr.34373) 6388 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.175862+0000 mgr.gibba043.dnkmem (mgr.34373) 6389 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.175881+0000 mon.c (mon.1) 1660 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.177060+0000 mon.c (mon.1) 1661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.177283+0000 mgr.gibba043.dnkmem (mgr.34373) 6390 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:57.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.177319+0000 mgr.gibba043.dnkmem (mgr.34373) 6391 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.178693+0000 mgr.gibba043.dnkmem (mgr.34373) 6392 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.179015+0000 mgr.gibba043.dnkmem (mgr.34373) 6393 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.179795+0000 mon.c (mon.1) 1662 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.180175+0000 mgr.gibba043.dnkmem (mgr.34373) 6394 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:57.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.180210+0000 mgr.gibba043.dnkmem (mgr.34373) 6395 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cephadm 2021-03-10T15:51:56.180314+0000 mgr.gibba043.dnkmem (mgr.34373) 6396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: audit 2021-03-10T15:51:56.181340+0000 mon.c (mon.1) 1663 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[31385]: cluster 2021-03-10T15:51:56.428958+0000 mgr.gibba043.dnkmem (mgr.34373) 6397 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:55.946374+0000 mgr.gibba043.dnkmem (mgr.34373) 6381 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:51:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:55.948027+0000 mgr.gibba043.dnkmem (mgr.34373) 6382 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:51:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.169477+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:51:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.170386+0000 mgr.gibba043.dnkmem (mgr.34373) 6383 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:57.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.172207+0000 mgr.gibba043.dnkmem (mgr.34373) 6384 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.173177+0000 mon.c (mon.1) 1658 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.173460+0000 mgr.gibba043.dnkmem (mgr.34373) 6385 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.173496+0000 mgr.gibba043.dnkmem (mgr.34373) 6386 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.174601+0000 mon.c (mon.1) 1659 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.174733+0000 mgr.gibba043.dnkmem (mgr.34373) 6387 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.174770+0000 mgr.gibba043.dnkmem (mgr.34373) 6388 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.175862+0000 mgr.gibba043.dnkmem (mgr.34373) 6389 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.175881+0000 mon.c (mon.1) 1660 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.177060+0000 mon.c (mon.1) 1661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.177283+0000 mgr.gibba043.dnkmem (mgr.34373) 6390 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.177319+0000 mgr.gibba043.dnkmem (mgr.34373) 6391 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.178693+0000 mgr.gibba043.dnkmem (mgr.34373) 6392 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.179015+0000 mgr.gibba043.dnkmem (mgr.34373) 6393 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:57.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.179795+0000 mon.c (mon.1) 1662 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.180175+0000 mgr.gibba043.dnkmem (mgr.34373) 6394 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.180210+0000 mgr.gibba043.dnkmem (mgr.34373) 6395 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cephadm 2021-03-10T15:51:56.180314+0000 mgr.gibba043.dnkmem (mgr.34373) 6396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: audit 2021-03-10T15:51:56.181340+0000 mon.c (mon.1) 1663 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:57 gibba003 bash[32348]: cluster 2021-03-10T15:51:56.428958+0000 mgr.gibba043.dnkmem (mgr.34373) 6397 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:55.946374+0000 mgr.gibba043.dnkmem (mgr.34373) 6381 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:51:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:55.948027+0000 mgr.gibba043.dnkmem (mgr.34373) 6382 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:51:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.169477+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:51:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.170386+0000 mgr.gibba043.dnkmem (mgr.34373) 6383 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.172207+0000 mgr.gibba043.dnkmem (mgr.34373) 6384 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.173177+0000 mon.c (mon.1) 1658 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.173460+0000 mgr.gibba043.dnkmem (mgr.34373) 6385 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.173496+0000 mgr.gibba043.dnkmem (mgr.34373) 6386 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.174601+0000 mon.c (mon.1) 1659 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.174733+0000 mgr.gibba043.dnkmem (mgr.34373) 6387 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.174770+0000 mgr.gibba043.dnkmem (mgr.34373) 6388 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:57.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.175862+0000 mgr.gibba043.dnkmem (mgr.34373) 6389 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.175881+0000 mon.c (mon.1) 1660 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.177060+0000 mon.c (mon.1) 1661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.177283+0000 mgr.gibba043.dnkmem (mgr.34373) 6390 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.177319+0000 mgr.gibba043.dnkmem (mgr.34373) 6391 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:57.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.178693+0000 mgr.gibba043.dnkmem (mgr.34373) 6392 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.179015+0000 mgr.gibba043.dnkmem (mgr.34373) 6393 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.179795+0000 mon.c (mon.1) 1662 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.180175+0000 mgr.gibba043.dnkmem (mgr.34373) 6394 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:57.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.180210+0000 mgr.gibba043.dnkmem (mgr.34373) 6395 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cephadm 2021-03-10T15:51:56.180314+0000 mgr.gibba043.dnkmem (mgr.34373) 6396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:51:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: audit 2021-03-10T15:51:56.181340+0000 mon.c (mon.1) 1663 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:57.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:57 gibba043 bash[24019]: cluster 2021-03-10T15:51:56.428958+0000 mgr.gibba043.dnkmem (mgr.34373) 6397 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:51:59 gibba043 bash[24019]: cluster 2021-03-10T15:51:58.430540+0000 mgr.gibba043.dnkmem (mgr.34373) 6398 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:51:59 gibba003 bash[31385]: cluster 2021-03-10T15:51:58.430540+0000 mgr.gibba043.dnkmem (mgr.34373) 6398 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:51:59 gibba003 bash[32348]: cluster 2021-03-10T15:51:58.430540+0000 mgr.gibba043.dnkmem (mgr.34373) 6398 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:01 gibba043 bash[24019]: cluster 2021-03-10T15:52:00.432009+0000 mgr.gibba043.dnkmem (mgr.34373) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:01 gibba003 bash[31385]: cluster 2021-03-10T15:52:00.432009+0000 mgr.gibba043.dnkmem (mgr.34373) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:01 gibba003 bash[32348]: cluster 2021-03-10T15:52:00.432009+0000 mgr.gibba043.dnkmem (mgr.34373) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:03 gibba043 bash[24019]: cluster 2021-03-10T15:52:02.433585+0000 mgr.gibba043.dnkmem (mgr.34373) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:03 gibba003 bash[31385]: cluster 2021-03-10T15:52:02.433585+0000 mgr.gibba043.dnkmem (mgr.34373) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:03 gibba003 bash[32348]: cluster 2021-03-10T15:52:02.433585+0000 mgr.gibba043.dnkmem (mgr.34373) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:05 gibba043 bash[24019]: cluster 2021-03-10T15:52:04.435228+0000 mgr.gibba043.dnkmem (mgr.34373) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:05 gibba003 bash[31385]: cluster 2021-03-10T15:52:04.435228+0000 mgr.gibba043.dnkmem (mgr.34373) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:05 gibba003 bash[32348]: cluster 2021-03-10T15:52:04.435228+0000 mgr.gibba043.dnkmem (mgr.34373) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:07 gibba043 bash[24019]: cluster 2021-03-10T15:52:06.436932+0000 mgr.gibba043.dnkmem (mgr.34373) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:07 gibba003 bash[31385]: cluster 2021-03-10T15:52:06.436932+0000 mgr.gibba043.dnkmem (mgr.34373) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:07 gibba003 bash[32348]: cluster 2021-03-10T15:52:06.436932+0000 mgr.gibba043.dnkmem (mgr.34373) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:09 gibba003 bash[31385]: cluster 2021-03-10T15:52:08.438634+0000 mgr.gibba043.dnkmem (mgr.34373) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:09 gibba003 bash[32348]: cluster 2021-03-10T15:52:08.438634+0000 mgr.gibba043.dnkmem (mgr.34373) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:09 gibba043 bash[24019]: cluster 2021-03-10T15:52:08.438634+0000 mgr.gibba043.dnkmem (mgr.34373) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:11 gibba043 bash[24019]: cluster 2021-03-10T15:52:10.440104+0000 mgr.gibba043.dnkmem (mgr.34373) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:11 gibba003 bash[31385]: cluster 2021-03-10T15:52:10.440104+0000 mgr.gibba043.dnkmem (mgr.34373) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:11 gibba003 bash[32348]: cluster 2021-03-10T15:52:10.440104+0000 mgr.gibba043.dnkmem (mgr.34373) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:12.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:12 gibba043 bash[24019]: cephadm 2021-03-10T15:52:11.196328+0000 mgr.gibba043.dnkmem (mgr.34373) 6405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:12.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:12 gibba003 bash[31385]: cephadm 2021-03-10T15:52:11.196328+0000 mgr.gibba043.dnkmem (mgr.34373) 6405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:12.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:12 gibba003 bash[32348]: cephadm 2021-03-10T15:52:11.196328+0000 mgr.gibba043.dnkmem (mgr.34373) 6405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:13.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:13 gibba043 bash[24019]: cluster 2021-03-10T15:52:12.441782+0000 mgr.gibba043.dnkmem (mgr.34373) 6406 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:13 gibba003 bash[31385]: cluster 2021-03-10T15:52:12.441782+0000 mgr.gibba043.dnkmem (mgr.34373) 6406 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:13 gibba003 bash[32348]: cluster 2021-03-10T15:52:12.441782+0000 mgr.gibba043.dnkmem (mgr.34373) 6406 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.493674+0000 mon.c (mon.1) 1664 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.494840+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.652631+0000 mon.c (mon.1) 1665 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.653738+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.775219+0000 mon.c (mon.1) 1666 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:52:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.776022+0000 mon.c (mon.1) 1667 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:52:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.776430+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:52:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.776726+0000 mon.c (mon.1) 1668 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.777559+0000 mon.c (mon.1) 1669 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.777680+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:52:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.778803+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:14 gibba043 bash[24019]: audit 2021-03-10T15:52:13.779628+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.493674+0000 mon.c (mon.1) 1664 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.494840+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.652631+0000 mon.c (mon.1) 1665 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.653738+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.775219+0000 mon.c (mon.1) 1666 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:52:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.776022+0000 mon.c (mon.1) 1667 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:52:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.776430+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:52:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.776726+0000 mon.c (mon.1) 1668 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.777559+0000 mon.c (mon.1) 1669 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.777680+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:52:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.778803+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[31385]: audit 2021-03-10T15:52:13.779628+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.493674+0000 mon.c (mon.1) 1664 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.494840+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.652631+0000 mon.c (mon.1) 1665 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.653738+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.775219+0000 mon.c (mon.1) 1666 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:52:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.776022+0000 mon.c (mon.1) 1667 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:52:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.776430+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:52:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.776726+0000 mon.c (mon.1) 1668 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.777559+0000 mon.c (mon.1) 1669 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.777680+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:52:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.778803+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:14 gibba003 bash[32348]: audit 2021-03-10T15:52:13.779628+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:15 gibba043 bash[24019]: cluster 2021-03-10T15:52:14.443541+0000 mgr.gibba043.dnkmem (mgr.34373) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:15 gibba003 bash[31385]: cluster 2021-03-10T15:52:14.443541+0000 mgr.gibba043.dnkmem (mgr.34373) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:15 gibba003 bash[32348]: cluster 2021-03-10T15:52:14.443541+0000 mgr.gibba043.dnkmem (mgr.34373) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:17 gibba043 bash[24019]: cluster 2021-03-10T15:52:16.445409+0000 mgr.gibba043.dnkmem (mgr.34373) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:17 gibba003 bash[31385]: cluster 2021-03-10T15:52:16.445409+0000 mgr.gibba043.dnkmem (mgr.34373) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:17 gibba003 bash[32348]: cluster 2021-03-10T15:52:16.445409+0000 mgr.gibba043.dnkmem (mgr.34373) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:19 gibba043 bash[24019]: cluster 2021-03-10T15:52:18.447111+0000 mgr.gibba043.dnkmem (mgr.34373) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:19 gibba003 bash[31385]: cluster 2021-03-10T15:52:18.447111+0000 mgr.gibba043.dnkmem (mgr.34373) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:19 gibba003 bash[32348]: cluster 2021-03-10T15:52:18.447111+0000 mgr.gibba043.dnkmem (mgr.34373) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:21 gibba043 bash[24019]: cluster 2021-03-10T15:52:20.448500+0000 mgr.gibba043.dnkmem (mgr.34373) 6410 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:21 gibba003 bash[31385]: cluster 2021-03-10T15:52:20.448500+0000 mgr.gibba043.dnkmem (mgr.34373) 6410 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:21 gibba003 bash[32348]: cluster 2021-03-10T15:52:20.448500+0000 mgr.gibba043.dnkmem (mgr.34373) 6410 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:23 gibba043 bash[24019]: cluster 2021-03-10T15:52:22.450089+0000 mgr.gibba043.dnkmem (mgr.34373) 6411 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:23 gibba003 bash[31385]: cluster 2021-03-10T15:52:22.450089+0000 mgr.gibba043.dnkmem (mgr.34373) 6411 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:23 gibba003 bash[32348]: cluster 2021-03-10T15:52:22.450089+0000 mgr.gibba043.dnkmem (mgr.34373) 6411 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:24.133 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:52:24.359 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:52:24.359 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:52:24.360 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:52:24.360 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:52:24.360 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:52:24.360 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:52:24.361 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:52:24.361 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:52:24.361 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:52:24.361 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:52:24.362 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:52:24.362 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:52:24.362 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:52:24.362 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:52:24.363 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:52:24.363 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:52:24.363 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:52:24.363 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:52:24.364 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:52:24.364 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:52:24.364 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:52:24.612 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:52:24.612 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:52:24.613 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:24.613 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:52:24.613 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:52:24.613 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:24.614 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:52:24.614 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:52:24.614 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:52:24.614 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:52:24.614 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:52:24.615 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:52:24.615 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:52:24.615 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:52:24.615 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:52:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[31385]: audit 2021-03-10T15:52:24.123118+0000 mgr.gibba043.dnkmem (mgr.34373) 6412 : audit [DBG] from='client.58342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:25.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[31385]: audit 2021-03-10T15:52:24.346896+0000 mgr.gibba043.dnkmem (mgr.34373) 6413 : audit [DBG] from='client.48360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:25.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[31385]: cluster 2021-03-10T15:52:24.452036+0000 mgr.gibba043.dnkmem (mgr.34373) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[31385]: audit 2021-03-10T15:52:24.613604+0000 mon.c (mon.1) 1670 : audit [DBG] from='client.? 172.21.2.103:0/2681068612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:25.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[32348]: audit 2021-03-10T15:52:24.123118+0000 mgr.gibba043.dnkmem (mgr.34373) 6412 : audit [DBG] from='client.58342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:25.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[32348]: audit 2021-03-10T15:52:24.346896+0000 mgr.gibba043.dnkmem (mgr.34373) 6413 : audit [DBG] from='client.48360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:25.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[32348]: cluster 2021-03-10T15:52:24.452036+0000 mgr.gibba043.dnkmem (mgr.34373) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:25 gibba003 bash[32348]: audit 2021-03-10T15:52:24.613604+0000 mon.c (mon.1) 1670 : audit [DBG] from='client.? 172.21.2.103:0/2681068612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:25 gibba043 bash[24019]: audit 2021-03-10T15:52:24.123118+0000 mgr.gibba043.dnkmem (mgr.34373) 6412 : audit [DBG] from='client.58342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:25 gibba043 bash[24019]: audit 2021-03-10T15:52:24.346896+0000 mgr.gibba043.dnkmem (mgr.34373) 6413 : audit [DBG] from='client.48360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:25 gibba043 bash[24019]: cluster 2021-03-10T15:52:24.452036+0000 mgr.gibba043.dnkmem (mgr.34373) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:25 gibba043 bash[24019]: audit 2021-03-10T15:52:24.613604+0000 mon.c (mon.1) 1670 : audit [DBG] from='client.? 172.21.2.103:0/2681068612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:27 gibba003 bash[31385]: cephadm 2021-03-10T15:52:26.212394+0000 mgr.gibba043.dnkmem (mgr.34373) 6415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:27 gibba003 bash[31385]: cluster 2021-03-10T15:52:26.453649+0000 mgr.gibba043.dnkmem (mgr.34373) 6416 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:27 gibba003 bash[32348]: cephadm 2021-03-10T15:52:26.212394+0000 mgr.gibba043.dnkmem (mgr.34373) 6415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:27 gibba003 bash[32348]: cluster 2021-03-10T15:52:26.453649+0000 mgr.gibba043.dnkmem (mgr.34373) 6416 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:27 gibba043 bash[24019]: cephadm 2021-03-10T15:52:26.212394+0000 mgr.gibba043.dnkmem (mgr.34373) 6415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:27 gibba043 bash[24019]: cluster 2021-03-10T15:52:26.453649+0000 mgr.gibba043.dnkmem (mgr.34373) 6416 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:29 gibba003 bash[31385]: cluster 2021-03-10T15:52:28.455017+0000 mgr.gibba043.dnkmem (mgr.34373) 6417 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:29 gibba003 bash[32348]: cluster 2021-03-10T15:52:28.455017+0000 mgr.gibba043.dnkmem (mgr.34373) 6417 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:29 gibba043 bash[24019]: cluster 2021-03-10T15:52:28.455017+0000 mgr.gibba043.dnkmem (mgr.34373) 6417 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:31 gibba043 bash[24019]: cluster 2021-03-10T15:52:30.456488+0000 mgr.gibba043.dnkmem (mgr.34373) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:31 gibba003 bash[31385]: cluster 2021-03-10T15:52:30.456488+0000 mgr.gibba043.dnkmem (mgr.34373) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:31 gibba003 bash[32348]: cluster 2021-03-10T15:52:30.456488+0000 mgr.gibba043.dnkmem (mgr.34373) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:33 gibba003 bash[31385]: cluster 2021-03-10T15:52:32.457879+0000 mgr.gibba043.dnkmem (mgr.34373) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:33 gibba003 bash[32348]: cluster 2021-03-10T15:52:32.457879+0000 mgr.gibba043.dnkmem (mgr.34373) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:33 gibba043 bash[24019]: cluster 2021-03-10T15:52:32.457879+0000 mgr.gibba043.dnkmem (mgr.34373) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:35 gibba003 bash[31385]: cluster 2021-03-10T15:52:34.459565+0000 mgr.gibba043.dnkmem (mgr.34373) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:35 gibba003 bash[32348]: cluster 2021-03-10T15:52:34.459565+0000 mgr.gibba043.dnkmem (mgr.34373) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:35 gibba043 bash[24019]: cluster 2021-03-10T15:52:34.459565+0000 mgr.gibba043.dnkmem (mgr.34373) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:37 gibba003 bash[31385]: cluster 2021-03-10T15:52:36.461141+0000 mgr.gibba043.dnkmem (mgr.34373) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:37 gibba003 bash[32348]: cluster 2021-03-10T15:52:36.461141+0000 mgr.gibba043.dnkmem (mgr.34373) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:37 gibba043 bash[24019]: cluster 2021-03-10T15:52:36.461141+0000 mgr.gibba043.dnkmem (mgr.34373) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:39 gibba003 bash[31385]: cluster 2021-03-10T15:52:38.462776+0000 mgr.gibba043.dnkmem (mgr.34373) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:39 gibba003 bash[32348]: cluster 2021-03-10T15:52:38.462776+0000 mgr.gibba043.dnkmem (mgr.34373) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:39 gibba043 bash[24019]: cluster 2021-03-10T15:52:38.462776+0000 mgr.gibba043.dnkmem (mgr.34373) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:41 gibba043 bash[24019]: cluster 2021-03-10T15:52:40.464239+0000 mgr.gibba043.dnkmem (mgr.34373) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:41 gibba003 bash[31385]: cluster 2021-03-10T15:52:40.464239+0000 mgr.gibba043.dnkmem (mgr.34373) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:41 gibba003 bash[32348]: cluster 2021-03-10T15:52:40.464239+0000 mgr.gibba043.dnkmem (mgr.34373) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:42.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:42 gibba043 bash[24019]: cephadm 2021-03-10T15:52:41.228414+0000 mgr.gibba043.dnkmem (mgr.34373) 6424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:42.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:42 gibba003 bash[31385]: cephadm 2021-03-10T15:52:41.228414+0000 mgr.gibba043.dnkmem (mgr.34373) 6424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:42.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:42 gibba003 bash[32348]: cephadm 2021-03-10T15:52:41.228414+0000 mgr.gibba043.dnkmem (mgr.34373) 6424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:43.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:43 gibba043 bash[24019]: cluster 2021-03-10T15:52:42.465718+0000 mgr.gibba043.dnkmem (mgr.34373) 6425 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:43 gibba003 bash[31385]: cluster 2021-03-10T15:52:42.465718+0000 mgr.gibba043.dnkmem (mgr.34373) 6425 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:43 gibba003 bash[32348]: cluster 2021-03-10T15:52:42.465718+0000 mgr.gibba043.dnkmem (mgr.34373) 6425 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:45 gibba003 bash[31385]: cluster 2021-03-10T15:52:44.467365+0000 mgr.gibba043.dnkmem (mgr.34373) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:45 gibba003 bash[32348]: cluster 2021-03-10T15:52:44.467365+0000 mgr.gibba043.dnkmem (mgr.34373) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:45 gibba043 bash[24019]: cluster 2021-03-10T15:52:44.467365+0000 mgr.gibba043.dnkmem (mgr.34373) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:47 gibba003 bash[31385]: cluster 2021-03-10T15:52:46.468913+0000 mgr.gibba043.dnkmem (mgr.34373) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:47 gibba003 bash[32348]: cluster 2021-03-10T15:52:46.468913+0000 mgr.gibba043.dnkmem (mgr.34373) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:47 gibba043 bash[24019]: cluster 2021-03-10T15:52:46.468913+0000 mgr.gibba043.dnkmem (mgr.34373) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:49 gibba003 bash[31385]: cluster 2021-03-10T15:52:48.470479+0000 mgr.gibba043.dnkmem (mgr.34373) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:49 gibba003 bash[32348]: cluster 2021-03-10T15:52:48.470479+0000 mgr.gibba043.dnkmem (mgr.34373) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:49 gibba043 bash[24019]: cluster 2021-03-10T15:52:48.470479+0000 mgr.gibba043.dnkmem (mgr.34373) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:51 gibba043 bash[24019]: cluster 2021-03-10T15:52:50.471743+0000 mgr.gibba043.dnkmem (mgr.34373) 6429 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:51 gibba003 bash[31385]: cluster 2021-03-10T15:52:50.471743+0000 mgr.gibba043.dnkmem (mgr.34373) 6429 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:51 gibba003 bash[32348]: cluster 2021-03-10T15:52:50.471743+0000 mgr.gibba043.dnkmem (mgr.34373) 6429 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:53 gibba003 bash[31385]: cluster 2021-03-10T15:52:52.473484+0000 mgr.gibba043.dnkmem (mgr.34373) 6430 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:53 gibba003 bash[32348]: cluster 2021-03-10T15:52:52.473484+0000 mgr.gibba043.dnkmem (mgr.34373) 6430 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:53 gibba043 bash[24019]: cluster 2021-03-10T15:52:52.473484+0000 mgr.gibba043.dnkmem (mgr.34373) 6430 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:54.858 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:52:55.085 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:52:55.085 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:52:55.085 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:52:55.086 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:52:55.086 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:52:55.086 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:52:55.086 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:52:55.087 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:52:55.087 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:52:55.087 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:52:55.087 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:52:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:52:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:52:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:52:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:52:55.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:52:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:52:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (116m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:52:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (116m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:52:55.089 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:52:55.090 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:52:55.358 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:52:55.358 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:52:55.358 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:55.359 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:52:55.359 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:52:55.359 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:55.359 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:52:55.360 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:52:55.360 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:52:55.360 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:52:55.360 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:52:55.360 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:52:55.361 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:52:55.361 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:52:55.361 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:52:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:55 gibba003 bash[31385]: cluster 2021-03-10T15:52:54.475123+0000 mgr.gibba043.dnkmem (mgr.34373) 6431 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:55 gibba003 bash[31385]: audit 2021-03-10T15:52:54.848173+0000 mgr.gibba043.dnkmem (mgr.34373) 6432 : audit [DBG] from='client.58360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:55 gibba003 bash[31385]: audit 2021-03-10T15:52:55.359202+0000 mon.a (mon.0) 1477 : audit [DBG] from='client.? 172.21.2.103:0/2905658123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:55 gibba003 bash[32348]: cluster 2021-03-10T15:52:54.475123+0000 mgr.gibba043.dnkmem (mgr.34373) 6431 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:55 gibba003 bash[32348]: audit 2021-03-10T15:52:54.848173+0000 mgr.gibba043.dnkmem (mgr.34373) 6432 : audit [DBG] from='client.58360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:55 gibba003 bash[32348]: audit 2021-03-10T15:52:55.359202+0000 mon.a (mon.0) 1477 : audit [DBG] from='client.? 172.21.2.103:0/2905658123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:55 gibba043 bash[24019]: cluster 2021-03-10T15:52:54.475123+0000 mgr.gibba043.dnkmem (mgr.34373) 6431 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:55 gibba043 bash[24019]: audit 2021-03-10T15:52:54.848173+0000 mgr.gibba043.dnkmem (mgr.34373) 6432 : audit [DBG] from='client.58360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:55 gibba043 bash[24019]: audit 2021-03-10T15:52:55.359202+0000 mon.a (mon.0) 1477 : audit [DBG] from='client.? 172.21.2.103:0/2905658123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:55.072392+0000 mgr.gibba043.dnkmem (mgr.34373) 6433 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:56.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.460137+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:52:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.463528+0000 mon.c (mon.1) 1671 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.464696+0000 mon.c (mon.1) 1672 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.465698+0000 mon.c (mon.1) 1673 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.466514+0000 mon.c (mon.1) 1674 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.468558+0000 mon.c (mon.1) 1675 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:56 gibba043 bash[24019]: audit 2021-03-10T15:52:56.469676+0000 mon.c (mon.1) 1676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:55.072392+0000 mgr.gibba043.dnkmem (mgr.34373) 6433 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:56.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.460137+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:52:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.463528+0000 mon.c (mon.1) 1671 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.464696+0000 mon.c (mon.1) 1672 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.465698+0000 mon.c (mon.1) 1673 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.466514+0000 mon.c (mon.1) 1674 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.468558+0000 mon.c (mon.1) 1675 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[31385]: audit 2021-03-10T15:52:56.469676+0000 mon.c (mon.1) 1676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:55.072392+0000 mgr.gibba043.dnkmem (mgr.34373) 6433 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:56.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.460137+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:52:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.463528+0000 mon.c (mon.1) 1671 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.464696+0000 mon.c (mon.1) 1672 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.465698+0000 mon.c (mon.1) 1673 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.466514+0000 mon.c (mon.1) 1674 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.468558+0000 mon.c (mon.1) 1675 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:56.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:56 gibba003 bash[32348]: audit 2021-03-10T15:52:56.469676+0000 mon.c (mon.1) 1676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.245131+0000 mgr.gibba043.dnkmem (mgr.34373) 6434 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:52:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.246681+0000 mgr.gibba043.dnkmem (mgr.34373) 6435 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:52:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.461003+0000 mgr.gibba043.dnkmem (mgr.34373) 6436 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.462431+0000 mgr.gibba043.dnkmem (mgr.34373) 6437 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.463483+0000 mgr.gibba043.dnkmem (mgr.34373) 6438 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.463520+0000 mgr.gibba043.dnkmem (mgr.34373) 6439 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.464390+0000 mgr.gibba043.dnkmem (mgr.34373) 6440 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.464425+0000 mgr.gibba043.dnkmem (mgr.34373) 6441 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.465066+0000 mgr.gibba043.dnkmem (mgr.34373) 6442 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.466169+0000 mgr.gibba043.dnkmem (mgr.34373) 6443 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.466205+0000 mgr.gibba043.dnkmem (mgr.34373) 6444 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.467268+0000 mgr.gibba043.dnkmem (mgr.34373) 6445 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.467581+0000 mgr.gibba043.dnkmem (mgr.34373) 6446 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.468233+0000 mgr.gibba043.dnkmem (mgr.34373) 6447 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:57.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.468271+0000 mgr.gibba043.dnkmem (mgr.34373) 6448 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cephadm 2021-03-10T15:52:56.468374+0000 mgr.gibba043.dnkmem (mgr.34373) 6449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:57.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[31385]: cluster 2021-03-10T15:52:56.475621+0000 mgr.gibba043.dnkmem (mgr.34373) 6450 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.245131+0000 mgr.gibba043.dnkmem (mgr.34373) 6434 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:52:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.246681+0000 mgr.gibba043.dnkmem (mgr.34373) 6435 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:52:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.461003+0000 mgr.gibba043.dnkmem (mgr.34373) 6436 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.462431+0000 mgr.gibba043.dnkmem (mgr.34373) 6437 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:57.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.463483+0000 mgr.gibba043.dnkmem (mgr.34373) 6438 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.463520+0000 mgr.gibba043.dnkmem (mgr.34373) 6439 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.464390+0000 mgr.gibba043.dnkmem (mgr.34373) 6440 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.464425+0000 mgr.gibba043.dnkmem (mgr.34373) 6441 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:57.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.465066+0000 mgr.gibba043.dnkmem (mgr.34373) 6442 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.466169+0000 mgr.gibba043.dnkmem (mgr.34373) 6443 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.466205+0000 mgr.gibba043.dnkmem (mgr.34373) 6444 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.467268+0000 mgr.gibba043.dnkmem (mgr.34373) 6445 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:57.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.467581+0000 mgr.gibba043.dnkmem (mgr.34373) 6446 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.468233+0000 mgr.gibba043.dnkmem (mgr.34373) 6447 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.468271+0000 mgr.gibba043.dnkmem (mgr.34373) 6448 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cephadm 2021-03-10T15:52:56.468374+0000 mgr.gibba043.dnkmem (mgr.34373) 6449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:57.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:57 gibba003 bash[32348]: cluster 2021-03-10T15:52:56.475621+0000 mgr.gibba043.dnkmem (mgr.34373) 6450 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.245131+0000 mgr.gibba043.dnkmem (mgr.34373) 6434 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:52:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.246681+0000 mgr.gibba043.dnkmem (mgr.34373) 6435 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:52:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.461003+0000 mgr.gibba043.dnkmem (mgr.34373) 6436 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.462431+0000 mgr.gibba043.dnkmem (mgr.34373) 6437 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.463483+0000 mgr.gibba043.dnkmem (mgr.34373) 6438 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.463520+0000 mgr.gibba043.dnkmem (mgr.34373) 6439 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.464390+0000 mgr.gibba043.dnkmem (mgr.34373) 6440 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.464425+0000 mgr.gibba043.dnkmem (mgr.34373) 6441 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.465066+0000 mgr.gibba043.dnkmem (mgr.34373) 6442 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.466169+0000 mgr.gibba043.dnkmem (mgr.34373) 6443 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.466205+0000 mgr.gibba043.dnkmem (mgr.34373) 6444 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.467268+0000 mgr.gibba043.dnkmem (mgr.34373) 6445 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.467581+0000 mgr.gibba043.dnkmem (mgr.34373) 6446 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.468233+0000 mgr.gibba043.dnkmem (mgr.34373) 6447 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.468271+0000 mgr.gibba043.dnkmem (mgr.34373) 6448 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cephadm 2021-03-10T15:52:56.468374+0000 mgr.gibba043.dnkmem (mgr.34373) 6449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:52:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:57 gibba043 bash[24019]: cluster 2021-03-10T15:52:56.475621+0000 mgr.gibba043.dnkmem (mgr.34373) 6450 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:52:59 gibba003 bash[31385]: cluster 2021-03-10T15:52:58.477134+0000 mgr.gibba043.dnkmem (mgr.34373) 6451 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:52:59 gibba003 bash[32348]: cluster 2021-03-10T15:52:58.477134+0000 mgr.gibba043.dnkmem (mgr.34373) 6451 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:52:59 gibba043 bash[24019]: cluster 2021-03-10T15:52:58.477134+0000 mgr.gibba043.dnkmem (mgr.34373) 6451 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:01 gibba043 bash[24019]: cluster 2021-03-10T15:53:00.478538+0000 mgr.gibba043.dnkmem (mgr.34373) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:01 gibba003 bash[31385]: cluster 2021-03-10T15:53:00.478538+0000 mgr.gibba043.dnkmem (mgr.34373) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:01 gibba003 bash[32348]: cluster 2021-03-10T15:53:00.478538+0000 mgr.gibba043.dnkmem (mgr.34373) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:03 gibba003 bash[31385]: cluster 2021-03-10T15:53:02.480282+0000 mgr.gibba043.dnkmem (mgr.34373) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:03 gibba003 bash[32348]: cluster 2021-03-10T15:53:02.480282+0000 mgr.gibba043.dnkmem (mgr.34373) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:03 gibba043 bash[24019]: cluster 2021-03-10T15:53:02.480282+0000 mgr.gibba043.dnkmem (mgr.34373) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:05 gibba003 bash[31385]: cluster 2021-03-10T15:53:04.481988+0000 mgr.gibba043.dnkmem (mgr.34373) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:05 gibba003 bash[32348]: cluster 2021-03-10T15:53:04.481988+0000 mgr.gibba043.dnkmem (mgr.34373) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:05 gibba043 bash[24019]: cluster 2021-03-10T15:53:04.481988+0000 mgr.gibba043.dnkmem (mgr.34373) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:07 gibba003 bash[31385]: cluster 2021-03-10T15:53:06.482937+0000 mgr.gibba043.dnkmem (mgr.34373) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:07 gibba003 bash[32348]: cluster 2021-03-10T15:53:06.482937+0000 mgr.gibba043.dnkmem (mgr.34373) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:07 gibba043 bash[24019]: cluster 2021-03-10T15:53:06.482937+0000 mgr.gibba043.dnkmem (mgr.34373) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:09 gibba003 bash[31385]: cluster 2021-03-10T15:53:08.484480+0000 mgr.gibba043.dnkmem (mgr.34373) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:09 gibba003 bash[32348]: cluster 2021-03-10T15:53:08.484480+0000 mgr.gibba043.dnkmem (mgr.34373) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:09 gibba043 bash[24019]: cluster 2021-03-10T15:53:08.484480+0000 mgr.gibba043.dnkmem (mgr.34373) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:11 gibba043 bash[24019]: cluster 2021-03-10T15:53:10.485918+0000 mgr.gibba043.dnkmem (mgr.34373) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:11 gibba003 bash[31385]: cluster 2021-03-10T15:53:10.485918+0000 mgr.gibba043.dnkmem (mgr.34373) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:11 gibba003 bash[32348]: cluster 2021-03-10T15:53:10.485918+0000 mgr.gibba043.dnkmem (mgr.34373) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:12.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:12 gibba043 bash[24019]: cephadm 2021-03-10T15:53:11.474137+0000 mgr.gibba043.dnkmem (mgr.34373) 6458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:12.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:12 gibba003 bash[31385]: cephadm 2021-03-10T15:53:11.474137+0000 mgr.gibba043.dnkmem (mgr.34373) 6458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:12.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:12 gibba003 bash[32348]: cephadm 2021-03-10T15:53:11.474137+0000 mgr.gibba043.dnkmem (mgr.34373) 6458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:13.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:13 gibba003 bash[31385]: cluster 2021-03-10T15:53:12.487520+0000 mgr.gibba043.dnkmem (mgr.34373) 6459 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:13 gibba003 bash[32348]: cluster 2021-03-10T15:53:12.487520+0000 mgr.gibba043.dnkmem (mgr.34373) 6459 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:13 gibba043 bash[24019]: cluster 2021-03-10T15:53:12.487520+0000 mgr.gibba043.dnkmem (mgr.34373) 6459 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.500820+0000 mon.c (mon.1) 1677 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.502036+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.658225+0000 mon.c (mon.1) 1678 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.659396+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.786934+0000 mon.c (mon.1) 1679 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.787701+0000 mon.c (mon.1) 1680 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.788210+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:53:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.788375+0000 mon.c (mon.1) 1681 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:53:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.789041+0000 mon.c (mon.1) 1682 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.789679+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.790918+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:53:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[31385]: audit 2021-03-10T15:53:13.791775+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.500820+0000 mon.c (mon.1) 1677 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.502036+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.658225+0000 mon.c (mon.1) 1678 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.659396+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.786934+0000 mon.c (mon.1) 1679 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:53:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.787701+0000 mon.c (mon.1) 1680 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.788210+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:53:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.788375+0000 mon.c (mon.1) 1681 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:53:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.789041+0000 mon.c (mon.1) 1682 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.789679+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.790918+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:53:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:14 gibba003 bash[32348]: audit 2021-03-10T15:53:13.791775+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.500820+0000 mon.c (mon.1) 1677 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.502036+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.658225+0000 mon.c (mon.1) 1678 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.659396+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.786934+0000 mon.c (mon.1) 1679 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:53:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.787701+0000 mon.c (mon.1) 1680 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.788210+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:53:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.788375+0000 mon.c (mon.1) 1681 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:53:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.789041+0000 mon.c (mon.1) 1682 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.789679+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:53:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.790918+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:53:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:14 gibba043 bash[24019]: audit 2021-03-10T15:53:13.791775+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:53:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:15 gibba003 bash[31385]: cluster 2021-03-10T15:53:14.489420+0000 mgr.gibba043.dnkmem (mgr.34373) 6460 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:15 gibba003 bash[32348]: cluster 2021-03-10T15:53:14.489420+0000 mgr.gibba043.dnkmem (mgr.34373) 6460 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:15 gibba043 bash[24019]: cluster 2021-03-10T15:53:14.489420+0000 mgr.gibba043.dnkmem (mgr.34373) 6460 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:17 gibba003 bash[31385]: cluster 2021-03-10T15:53:16.490401+0000 mgr.gibba043.dnkmem (mgr.34373) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:17 gibba003 bash[32348]: cluster 2021-03-10T15:53:16.490401+0000 mgr.gibba043.dnkmem (mgr.34373) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:17 gibba043 bash[24019]: cluster 2021-03-10T15:53:16.490401+0000 mgr.gibba043.dnkmem (mgr.34373) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:19 gibba003 bash[31385]: cluster 2021-03-10T15:53:18.491659+0000 mgr.gibba043.dnkmem (mgr.34373) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:19 gibba003 bash[32348]: cluster 2021-03-10T15:53:18.491659+0000 mgr.gibba043.dnkmem (mgr.34373) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:19 gibba043 bash[24019]: cluster 2021-03-10T15:53:18.491659+0000 mgr.gibba043.dnkmem (mgr.34373) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:21 gibba043 bash[24019]: cluster 2021-03-10T15:53:20.493269+0000 mgr.gibba043.dnkmem (mgr.34373) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:21 gibba003 bash[31385]: cluster 2021-03-10T15:53:20.493269+0000 mgr.gibba043.dnkmem (mgr.34373) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:21 gibba003 bash[32348]: cluster 2021-03-10T15:53:20.493269+0000 mgr.gibba043.dnkmem (mgr.34373) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:23 gibba003 bash[31385]: cluster 2021-03-10T15:53:22.494794+0000 mgr.gibba043.dnkmem (mgr.34373) 6464 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:23 gibba003 bash[32348]: cluster 2021-03-10T15:53:22.494794+0000 mgr.gibba043.dnkmem (mgr.34373) 6464 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:23 gibba043 bash[24019]: cluster 2021-03-10T15:53:22.494794+0000 mgr.gibba043.dnkmem (mgr.34373) 6464 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:25.601 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:53:25.832 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:53:25.833 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:53:25.833 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:53:25.833 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:53:25.833 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:53:25.834 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:53:25.834 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:53:25.834 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:53:25.834 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:53:25.835 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:53:25.835 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:53:25.835 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:53:25.835 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:53:25.836 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:53:25.836 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:53:25.836 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:53:25.836 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:53:25.836 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:53:25.837 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:53:25.837 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:53:25.837 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:53:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:25 gibba003 bash[31385]: cluster 2021-03-10T15:53:24.496485+0000 mgr.gibba043.dnkmem (mgr.34373) 6465 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:25.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:25 gibba003 bash[32348]: cluster 2021-03-10T15:53:24.496485+0000 mgr.gibba043.dnkmem (mgr.34373) 6465 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:25 gibba043 bash[24019]: cluster 2021-03-10T15:53:24.496485+0000 mgr.gibba043.dnkmem (mgr.34373) 6465 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:26.084 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:53:26.085 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:53:26.085 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:26.085 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:53:26.085 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:53:26.086 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:26.086 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:53:26.086 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:53:26.086 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:53:26.087 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:53:26.087 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:53:26.087 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:53:26.087 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:53:26.087 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:53:26.088 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:53:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:26 gibba043 bash[24019]: audit 2021-03-10T15:53:25.592529+0000 mgr.gibba043.dnkmem (mgr.34373) 6466 : audit [DBG] from='client.58378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:26 gibba043 bash[24019]: audit 2021-03-10T15:53:25.819481+0000 mgr.gibba043.dnkmem (mgr.34373) 6467 : audit [DBG] from='client.48396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:26 gibba043 bash[24019]: audit 2021-03-10T15:53:26.086140+0000 mon.c (mon.1) 1683 : audit [DBG] from='client.? 172.21.2.103:0/3153136994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:26.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:26 gibba003 bash[31385]: audit 2021-03-10T15:53:25.592529+0000 mgr.gibba043.dnkmem (mgr.34373) 6466 : audit [DBG] from='client.58378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:26.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:26 gibba003 bash[31385]: audit 2021-03-10T15:53:25.819481+0000 mgr.gibba043.dnkmem (mgr.34373) 6467 : audit [DBG] from='client.48396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:26.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:26 gibba003 bash[31385]: audit 2021-03-10T15:53:26.086140+0000 mon.c (mon.1) 1683 : audit [DBG] from='client.? 172.21.2.103:0/3153136994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:26.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:26 gibba003 bash[32348]: audit 2021-03-10T15:53:25.592529+0000 mgr.gibba043.dnkmem (mgr.34373) 6466 : audit [DBG] from='client.58378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:26.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:26 gibba003 bash[32348]: audit 2021-03-10T15:53:25.819481+0000 mgr.gibba043.dnkmem (mgr.34373) 6467 : audit [DBG] from='client.48396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:26.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:26 gibba003 bash[32348]: audit 2021-03-10T15:53:26.086140+0000 mon.c (mon.1) 1683 : audit [DBG] from='client.? 172.21.2.103:0/3153136994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:27 gibba003 bash[31385]: cephadm 2021-03-10T15:53:26.480903+0000 mgr.gibba043.dnkmem (mgr.34373) 6468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:27 gibba003 bash[31385]: cluster 2021-03-10T15:53:26.497276+0000 mgr.gibba043.dnkmem (mgr.34373) 6469 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:27 gibba003 bash[32348]: cephadm 2021-03-10T15:53:26.480903+0000 mgr.gibba043.dnkmem (mgr.34373) 6468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:27 gibba003 bash[32348]: cluster 2021-03-10T15:53:26.497276+0000 mgr.gibba043.dnkmem (mgr.34373) 6469 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:27 gibba043 bash[24019]: cephadm 2021-03-10T15:53:26.480903+0000 mgr.gibba043.dnkmem (mgr.34373) 6468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:27 gibba043 bash[24019]: cluster 2021-03-10T15:53:26.497276+0000 mgr.gibba043.dnkmem (mgr.34373) 6469 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:29 gibba003 bash[31385]: cluster 2021-03-10T15:53:28.498457+0000 mgr.gibba043.dnkmem (mgr.34373) 6470 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:29 gibba003 bash[32348]: cluster 2021-03-10T15:53:28.498457+0000 mgr.gibba043.dnkmem (mgr.34373) 6470 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:29 gibba043 bash[24019]: cluster 2021-03-10T15:53:28.498457+0000 mgr.gibba043.dnkmem (mgr.34373) 6470 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:31 gibba043 bash[24019]: cluster 2021-03-10T15:53:30.499941+0000 mgr.gibba043.dnkmem (mgr.34373) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:31 gibba003 bash[31385]: cluster 2021-03-10T15:53:30.499941+0000 mgr.gibba043.dnkmem (mgr.34373) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:31 gibba003 bash[32348]: cluster 2021-03-10T15:53:30.499941+0000 mgr.gibba043.dnkmem (mgr.34373) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:33 gibba003 bash[31385]: cluster 2021-03-10T15:53:32.501516+0000 mgr.gibba043.dnkmem (mgr.34373) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:33 gibba003 bash[32348]: cluster 2021-03-10T15:53:32.501516+0000 mgr.gibba043.dnkmem (mgr.34373) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:33 gibba043 bash[24019]: cluster 2021-03-10T15:53:32.501516+0000 mgr.gibba043.dnkmem (mgr.34373) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:35 gibba003 bash[31385]: cluster 2021-03-10T15:53:34.503241+0000 mgr.gibba043.dnkmem (mgr.34373) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:35 gibba003 bash[32348]: cluster 2021-03-10T15:53:34.503241+0000 mgr.gibba043.dnkmem (mgr.34373) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:35 gibba043 bash[24019]: cluster 2021-03-10T15:53:34.503241+0000 mgr.gibba043.dnkmem (mgr.34373) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:37 gibba003 bash[31385]: cluster 2021-03-10T15:53:36.504111+0000 mgr.gibba043.dnkmem (mgr.34373) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:37 gibba003 bash[32348]: cluster 2021-03-10T15:53:36.504111+0000 mgr.gibba043.dnkmem (mgr.34373) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:37 gibba043 bash[24019]: cluster 2021-03-10T15:53:36.504111+0000 mgr.gibba043.dnkmem (mgr.34373) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:39 gibba003 bash[31385]: cluster 2021-03-10T15:53:38.505620+0000 mgr.gibba043.dnkmem (mgr.34373) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:39 gibba003 bash[32348]: cluster 2021-03-10T15:53:38.505620+0000 mgr.gibba043.dnkmem (mgr.34373) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:39 gibba043 bash[24019]: cluster 2021-03-10T15:53:38.505620+0000 mgr.gibba043.dnkmem (mgr.34373) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:41 gibba003 bash[31385]: cluster 2021-03-10T15:53:40.506147+0000 mgr.gibba043.dnkmem (mgr.34373) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:41 gibba003 bash[32348]: cluster 2021-03-10T15:53:40.506147+0000 mgr.gibba043.dnkmem (mgr.34373) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:41 gibba043 bash[24019]: cluster 2021-03-10T15:53:40.506147+0000 mgr.gibba043.dnkmem (mgr.34373) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:42.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:42 gibba003 bash[31385]: cephadm 2021-03-10T15:53:41.497030+0000 mgr.gibba043.dnkmem (mgr.34373) 6477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:42.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:42 gibba003 bash[32348]: cephadm 2021-03-10T15:53:41.497030+0000 mgr.gibba043.dnkmem (mgr.34373) 6477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:42.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:42 gibba043 bash[24019]: cephadm 2021-03-10T15:53:41.497030+0000 mgr.gibba043.dnkmem (mgr.34373) 6477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:43 gibba003 bash[31385]: cluster 2021-03-10T15:53:42.507707+0000 mgr.gibba043.dnkmem (mgr.34373) 6478 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:43 gibba003 bash[32348]: cluster 2021-03-10T15:53:42.507707+0000 mgr.gibba043.dnkmem (mgr.34373) 6478 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:43 gibba043 bash[24019]: cluster 2021-03-10T15:53:42.507707+0000 mgr.gibba043.dnkmem (mgr.34373) 6478 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:45 gibba003 bash[31385]: cluster 2021-03-10T15:53:44.509474+0000 mgr.gibba043.dnkmem (mgr.34373) 6479 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:45 gibba003 bash[32348]: cluster 2021-03-10T15:53:44.509474+0000 mgr.gibba043.dnkmem (mgr.34373) 6479 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:45 gibba043 bash[24019]: cluster 2021-03-10T15:53:44.509474+0000 mgr.gibba043.dnkmem (mgr.34373) 6479 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:47 gibba003 bash[31385]: cluster 2021-03-10T15:53:46.510976+0000 mgr.gibba043.dnkmem (mgr.34373) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:47 gibba003 bash[32348]: cluster 2021-03-10T15:53:46.510976+0000 mgr.gibba043.dnkmem (mgr.34373) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:47 gibba043 bash[24019]: cluster 2021-03-10T15:53:46.510976+0000 mgr.gibba043.dnkmem (mgr.34373) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:49 gibba003 bash[31385]: cluster 2021-03-10T15:53:48.511564+0000 mgr.gibba043.dnkmem (mgr.34373) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:49 gibba003 bash[32348]: cluster 2021-03-10T15:53:48.511564+0000 mgr.gibba043.dnkmem (mgr.34373) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:49 gibba043 bash[24019]: cluster 2021-03-10T15:53:48.511564+0000 mgr.gibba043.dnkmem (mgr.34373) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:51 gibba003 bash[31385]: cluster 2021-03-10T15:53:50.513020+0000 mgr.gibba043.dnkmem (mgr.34373) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:51 gibba003 bash[32348]: cluster 2021-03-10T15:53:50.513020+0000 mgr.gibba043.dnkmem (mgr.34373) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:51 gibba043 bash[24019]: cluster 2021-03-10T15:53:50.513020+0000 mgr.gibba043.dnkmem (mgr.34373) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:53 gibba003 bash[31385]: cluster 2021-03-10T15:53:52.514727+0000 mgr.gibba043.dnkmem (mgr.34373) 6483 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:53 gibba003 bash[32348]: cluster 2021-03-10T15:53:52.514727+0000 mgr.gibba043.dnkmem (mgr.34373) 6483 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:53 gibba043 bash[24019]: cluster 2021-03-10T15:53:52.514727+0000 mgr.gibba043.dnkmem (mgr.34373) 6483 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:55 gibba003 bash[31385]: cluster 2021-03-10T15:53:54.516600+0000 mgr.gibba043.dnkmem (mgr.34373) 6484 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:55 gibba003 bash[32348]: cluster 2021-03-10T15:53:54.516600+0000 mgr.gibba043.dnkmem (mgr.34373) 6484 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:55 gibba043 bash[24019]: cluster 2021-03-10T15:53:54.516600+0000 mgr.gibba043.dnkmem (mgr.34373) 6484 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:56.327 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:53:56.558 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:53:56.558 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:53:56.558 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:53:56.558 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:53:56.559 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:53:56.559 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:53:56.559 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:53:56.559 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:53:56.560 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:53:56.560 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:53:56.560 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:53:56.560 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:53:56.560 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:53:56.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:53:56.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:53:56.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:53:56.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:53:56.562 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:53:56.562 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (117m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:53:56.562 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:53:56.562 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:53:56.818 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:53:56.818 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:53:56.818 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:56.818 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:53:56.819 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:53:56.819 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:56.819 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:53:56.819 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:53:56.820 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:53:56.820 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:53:56.820 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:53:56.820 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:53:56.821 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:53:56.821 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:53:56.821 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:53:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.317191+0000 mgr.gibba043.dnkmem (mgr.34373) 6485 : audit [DBG] from='client.58396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.512065+0000 mgr.gibba043.dnkmem (mgr.34373) 6486 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:53:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.512388+0000 mgr.gibba043.dnkmem (mgr.34373) 6487 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:53:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cluster 2021-03-10T15:53:56.517150+0000 mgr.gibba043.dnkmem (mgr.34373) 6488 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.550108+0000 mgr.gibba043.dnkmem (mgr.34373) 6489 : audit [DBG] from='client.58402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.706769+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:53:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.707642+0000 mgr.gibba043.dnkmem (mgr.34373) 6490 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.709000+0000 mgr.gibba043.dnkmem (mgr.34373) 6491 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.709927+0000 mgr.gibba043.dnkmem (mgr.34373) 6492 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.709965+0000 mgr.gibba043.dnkmem (mgr.34373) 6493 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.710240+0000 mon.c (mon.1) 1684 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.710899+0000 mgr.gibba043.dnkmem (mgr.34373) 6494 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.710935+0000 mgr.gibba043.dnkmem (mgr.34373) 6495 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.711189+0000 mon.c (mon.1) 1685 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.711828+0000 mgr.gibba043.dnkmem (mgr.34373) 6496 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.712145+0000 mon.c (mon.1) 1686 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.713084+0000 mon.c (mon.1) 1687 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.713132+0000 mgr.gibba043.dnkmem (mgr.34373) 6497 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.713167+0000 mgr.gibba043.dnkmem (mgr.34373) 6498 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.714220+0000 mgr.gibba043.dnkmem (mgr.34373) 6499 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.714538+0000 mgr.gibba043.dnkmem (mgr.34373) 6500 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.715404+0000 mgr.gibba043.dnkmem (mgr.34373) 6501 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.715443+0000 mgr.gibba043.dnkmem (mgr.34373) 6502 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.715453+0000 mon.c (mon.1) 1688 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: cephadm 2021-03-10T15:53:56.715546+0000 mgr.gibba043.dnkmem (mgr.34373) 6503 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:58.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.716655+0000 mon.c (mon.1) 1689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:57 gibba043 bash[24019]: audit 2021-03-10T15:53:56.819232+0000 mon.c (mon.1) 1690 : audit [DBG] from='client.? 172.21.2.103:0/1031495124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.317191+0000 mgr.gibba043.dnkmem (mgr.34373) 6485 : audit [DBG] from='client.58396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.512065+0000 mgr.gibba043.dnkmem (mgr.34373) 6486 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:53:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.512388+0000 mgr.gibba043.dnkmem (mgr.34373) 6487 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:53:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cluster 2021-03-10T15:53:56.517150+0000 mgr.gibba043.dnkmem (mgr.34373) 6488 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.550108+0000 mgr.gibba043.dnkmem (mgr.34373) 6489 : audit [DBG] from='client.58402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.706769+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:53:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.707642+0000 mgr.gibba043.dnkmem (mgr.34373) 6490 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.709000+0000 mgr.gibba043.dnkmem (mgr.34373) 6491 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.709927+0000 mgr.gibba043.dnkmem (mgr.34373) 6492 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.709965+0000 mgr.gibba043.dnkmem (mgr.34373) 6493 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.710240+0000 mon.c (mon.1) 1684 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.710899+0000 mgr.gibba043.dnkmem (mgr.34373) 6494 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.710935+0000 mgr.gibba043.dnkmem (mgr.34373) 6495 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.711189+0000 mon.c (mon.1) 1685 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.711828+0000 mgr.gibba043.dnkmem (mgr.34373) 6496 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.712145+0000 mon.c (mon.1) 1686 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.713084+0000 mon.c (mon.1) 1687 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.713132+0000 mgr.gibba043.dnkmem (mgr.34373) 6497 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.713167+0000 mgr.gibba043.dnkmem (mgr.34373) 6498 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.714220+0000 mgr.gibba043.dnkmem (mgr.34373) 6499 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.317191+0000 mgr.gibba043.dnkmem (mgr.34373) 6485 : audit [DBG] from='client.58396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.512065+0000 mgr.gibba043.dnkmem (mgr.34373) 6486 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:53:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.512388+0000 mgr.gibba043.dnkmem (mgr.34373) 6487 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:53:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cluster 2021-03-10T15:53:56.517150+0000 mgr.gibba043.dnkmem (mgr.34373) 6488 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.550108+0000 mgr.gibba043.dnkmem (mgr.34373) 6489 : audit [DBG] from='client.58402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.706769+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:53:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.707642+0000 mgr.gibba043.dnkmem (mgr.34373) 6490 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.709000+0000 mgr.gibba043.dnkmem (mgr.34373) 6491 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.709927+0000 mgr.gibba043.dnkmem (mgr.34373) 6492 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.709965+0000 mgr.gibba043.dnkmem (mgr.34373) 6493 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.710240+0000 mon.c (mon.1) 1684 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.710899+0000 mgr.gibba043.dnkmem (mgr.34373) 6494 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.710935+0000 mgr.gibba043.dnkmem (mgr.34373) 6495 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.711189+0000 mon.c (mon.1) 1685 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.711828+0000 mgr.gibba043.dnkmem (mgr.34373) 6496 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.712145+0000 mon.c (mon.1) 1686 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.713084+0000 mon.c (mon.1) 1687 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.713132+0000 mgr.gibba043.dnkmem (mgr.34373) 6497 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.713167+0000 mgr.gibba043.dnkmem (mgr.34373) 6498 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.714220+0000 mgr.gibba043.dnkmem (mgr.34373) 6499 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:58.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.714538+0000 mgr.gibba043.dnkmem (mgr.34373) 6500 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:58.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.715404+0000 mgr.gibba043.dnkmem (mgr.34373) 6501 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:58.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.715443+0000 mgr.gibba043.dnkmem (mgr.34373) 6502 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.715453+0000 mon.c (mon.1) 1688 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: cephadm 2021-03-10T15:53:56.715546+0000 mgr.gibba043.dnkmem (mgr.34373) 6503 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.716655+0000 mon.c (mon.1) 1689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[31385]: audit 2021-03-10T15:53:56.819232+0000 mon.c (mon.1) 1690 : audit [DBG] from='client.? 172.21.2.103:0/1031495124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.714538+0000 mgr.gibba043.dnkmem (mgr.34373) 6500 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:58.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.715404+0000 mgr.gibba043.dnkmem (mgr.34373) 6501 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:58.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.715443+0000 mgr.gibba043.dnkmem (mgr.34373) 6502 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:58.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.715453+0000 mon.c (mon.1) 1688 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: cephadm 2021-03-10T15:53:56.715546+0000 mgr.gibba043.dnkmem (mgr.34373) 6503 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:53:58.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.716655+0000 mon.c (mon.1) 1689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:58.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:57 gibba003 bash[32348]: audit 2021-03-10T15:53:56.819232+0000 mon.c (mon.1) 1690 : audit [DBG] from='client.? 172.21.2.103:0/1031495124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:53:59 gibba043 bash[24019]: cluster 2021-03-10T15:53:58.518742+0000 mgr.gibba043.dnkmem (mgr.34373) 6504 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:53:59 gibba003 bash[31385]: cluster 2021-03-10T15:53:58.518742+0000 mgr.gibba043.dnkmem (mgr.34373) 6504 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:53:59 gibba003 bash[32348]: cluster 2021-03-10T15:53:58.518742+0000 mgr.gibba043.dnkmem (mgr.34373) 6504 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:01 gibba003 bash[31385]: cluster 2021-03-10T15:54:00.520374+0000 mgr.gibba043.dnkmem (mgr.34373) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:01 gibba003 bash[32348]: cluster 2021-03-10T15:54:00.520374+0000 mgr.gibba043.dnkmem (mgr.34373) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:01 gibba043 bash[24019]: cluster 2021-03-10T15:54:00.520374+0000 mgr.gibba043.dnkmem (mgr.34373) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:03 gibba003 bash[31385]: cluster 2021-03-10T15:54:02.522079+0000 mgr.gibba043.dnkmem (mgr.34373) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:03 gibba003 bash[32348]: cluster 2021-03-10T15:54:02.522079+0000 mgr.gibba043.dnkmem (mgr.34373) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:03 gibba043 bash[24019]: cluster 2021-03-10T15:54:02.522079+0000 mgr.gibba043.dnkmem (mgr.34373) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:05 gibba003 bash[31385]: cluster 2021-03-10T15:54:04.522638+0000 mgr.gibba043.dnkmem (mgr.34373) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:05 gibba003 bash[32348]: cluster 2021-03-10T15:54:04.522638+0000 mgr.gibba043.dnkmem (mgr.34373) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:05 gibba043 bash[24019]: cluster 2021-03-10T15:54:04.522638+0000 mgr.gibba043.dnkmem (mgr.34373) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:07 gibba003 bash[31385]: cluster 2021-03-10T15:54:06.523346+0000 mgr.gibba043.dnkmem (mgr.34373) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:07 gibba003 bash[32348]: cluster 2021-03-10T15:54:06.523346+0000 mgr.gibba043.dnkmem (mgr.34373) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:07 gibba043 bash[24019]: cluster 2021-03-10T15:54:06.523346+0000 mgr.gibba043.dnkmem (mgr.34373) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:09 gibba003 bash[31385]: cluster 2021-03-10T15:54:08.524852+0000 mgr.gibba043.dnkmem (mgr.34373) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:09 gibba003 bash[32348]: cluster 2021-03-10T15:54:08.524852+0000 mgr.gibba043.dnkmem (mgr.34373) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:09 gibba043 bash[24019]: cluster 2021-03-10T15:54:08.524852+0000 mgr.gibba043.dnkmem (mgr.34373) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:11 gibba003 bash[31385]: cluster 2021-03-10T15:54:10.526391+0000 mgr.gibba043.dnkmem (mgr.34373) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:11 gibba003 bash[32348]: cluster 2021-03-10T15:54:10.526391+0000 mgr.gibba043.dnkmem (mgr.34373) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.732 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:11 gibba043 bash[24019]: cluster 2021-03-10T15:54:10.526391+0000 mgr.gibba043.dnkmem (mgr.34373) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:12.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:12 gibba003 bash[31385]: cephadm 2021-03-10T15:54:11.731583+0000 mgr.gibba043.dnkmem (mgr.34373) 6511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:12.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:12 gibba003 bash[32348]: cephadm 2021-03-10T15:54:11.731583+0000 mgr.gibba043.dnkmem (mgr.34373) 6511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:12 gibba043 bash[24019]: cephadm 2021-03-10T15:54:11.731583+0000 mgr.gibba043.dnkmem (mgr.34373) 6511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:13.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:13 gibba003 bash[31385]: cluster 2021-03-10T15:54:12.526940+0000 mgr.gibba043.dnkmem (mgr.34373) 6512 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:13 gibba003 bash[32348]: cluster 2021-03-10T15:54:12.526940+0000 mgr.gibba043.dnkmem (mgr.34373) 6512 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:13 gibba043 bash[24019]: cluster 2021-03-10T15:54:12.526940+0000 mgr.gibba043.dnkmem (mgr.34373) 6512 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.507867+0000 mon.c (mon.1) 1691 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.509013+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.666651+0000 mon.c (mon.1) 1692 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.667825+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.797068+0000 mon.c (mon.1) 1693 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:54:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.797784+0000 mon.c (mon.1) 1694 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:54:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.798458+0000 mon.c (mon.1) 1695 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.799228+0000 mon.c (mon.1) 1696 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.799429+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:54:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.800830+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:54:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.801751+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[31385]: audit 2021-03-10T15:54:13.802129+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.507867+0000 mon.c (mon.1) 1691 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.509013+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.666651+0000 mon.c (mon.1) 1692 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.667825+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.797068+0000 mon.c (mon.1) 1693 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:54:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.797784+0000 mon.c (mon.1) 1694 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:54:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.798458+0000 mon.c (mon.1) 1695 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.799228+0000 mon.c (mon.1) 1696 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.799429+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:54:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.800830+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:54:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.801751+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:14 gibba003 bash[32348]: audit 2021-03-10T15:54:13.802129+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.507867+0000 mon.c (mon.1) 1691 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.509013+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.666651+0000 mon.c (mon.1) 1692 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.667825+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.797068+0000 mon.c (mon.1) 1693 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:54:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.797784+0000 mon.c (mon.1) 1694 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:54:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.798458+0000 mon.c (mon.1) 1695 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.799228+0000 mon.c (mon.1) 1696 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.799429+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:54:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.800830+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:54:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.801751+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:54:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:14 gibba043 bash[24019]: audit 2021-03-10T15:54:13.802129+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:15 gibba003 bash[31385]: cluster 2021-03-10T15:54:14.528550+0000 mgr.gibba043.dnkmem (mgr.34373) 6513 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:15 gibba003 bash[32348]: cluster 2021-03-10T15:54:14.528550+0000 mgr.gibba043.dnkmem (mgr.34373) 6513 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:15 gibba043 bash[24019]: cluster 2021-03-10T15:54:14.528550+0000 mgr.gibba043.dnkmem (mgr.34373) 6513 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:17 gibba003 bash[31385]: cluster 2021-03-10T15:54:16.529729+0000 mgr.gibba043.dnkmem (mgr.34373) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:17 gibba003 bash[32348]: cluster 2021-03-10T15:54:16.529729+0000 mgr.gibba043.dnkmem (mgr.34373) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:17 gibba043 bash[24019]: cluster 2021-03-10T15:54:16.529729+0000 mgr.gibba043.dnkmem (mgr.34373) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:19 gibba003 bash[31385]: cluster 2021-03-10T15:54:18.531198+0000 mgr.gibba043.dnkmem (mgr.34373) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:19 gibba003 bash[32348]: cluster 2021-03-10T15:54:18.531198+0000 mgr.gibba043.dnkmem (mgr.34373) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:19 gibba043 bash[24019]: cluster 2021-03-10T15:54:18.531198+0000 mgr.gibba043.dnkmem (mgr.34373) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:21 gibba003 bash[31385]: cluster 2021-03-10T15:54:20.531972+0000 mgr.gibba043.dnkmem (mgr.34373) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:21 gibba003 bash[32348]: cluster 2021-03-10T15:54:20.531972+0000 mgr.gibba043.dnkmem (mgr.34373) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:21 gibba043 bash[24019]: cluster 2021-03-10T15:54:20.531972+0000 mgr.gibba043.dnkmem (mgr.34373) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:23 gibba003 bash[31385]: cluster 2021-03-10T15:54:22.533234+0000 mgr.gibba043.dnkmem (mgr.34373) 6517 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:23 gibba003 bash[32348]: cluster 2021-03-10T15:54:22.533234+0000 mgr.gibba043.dnkmem (mgr.34373) 6517 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:23 gibba043 bash[24019]: cluster 2021-03-10T15:54:22.533234+0000 mgr.gibba043.dnkmem (mgr.34373) 6517 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:25 gibba003 bash[31385]: cluster 2021-03-10T15:54:24.535066+0000 mgr.gibba043.dnkmem (mgr.34373) 6518 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:25 gibba003 bash[32348]: cluster 2021-03-10T15:54:24.535066+0000 mgr.gibba043.dnkmem (mgr.34373) 6518 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:25 gibba043 bash[24019]: cluster 2021-03-10T15:54:24.535066+0000 mgr.gibba043.dnkmem (mgr.34373) 6518 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.062 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:54:27.291 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:54:27.291 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:54:27.292 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:54:27.292 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:54:27.292 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:54:27.292 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:54:27.293 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:54:27.293 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:54:27.293 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:54:27.293 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:54:27.294 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:54:27.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:54:27.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:54:27.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:54:27.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:54:27.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:54:27.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:54:27.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:54:27.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:54:27.296 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:54:27.296 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:54:27.544 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:54:27.544 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:54:27.544 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:27.545 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:54:27.545 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:54:27.545 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:27.545 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:54:27.545 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:54:27.546 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:54:27.546 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:54:27.546 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:54:27.546 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:54:27.547 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:54:27.547 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:54:27.547 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:54:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:27 gibba003 bash[31385]: cluster 2021-03-10T15:54:26.536407+0000 mgr.gibba043.dnkmem (mgr.34373) 6519 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:27 gibba003 bash[31385]: cephadm 2021-03-10T15:54:26.747730+0000 mgr.gibba043.dnkmem (mgr.34373) 6520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:27 gibba003 bash[31385]: audit 2021-03-10T15:54:27.545394+0000 mon.a (mon.0) 1492 : audit [DBG] from='client.? 172.21.2.103:0/707641544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:27 gibba003 bash[32348]: cluster 2021-03-10T15:54:26.536407+0000 mgr.gibba043.dnkmem (mgr.34373) 6519 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:27 gibba003 bash[32348]: cephadm 2021-03-10T15:54:26.747730+0000 mgr.gibba043.dnkmem (mgr.34373) 6520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:27 gibba003 bash[32348]: audit 2021-03-10T15:54:27.545394+0000 mon.a (mon.0) 1492 : audit [DBG] from='client.? 172.21.2.103:0/707641544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:27 gibba043 bash[24019]: cluster 2021-03-10T15:54:26.536407+0000 mgr.gibba043.dnkmem (mgr.34373) 6519 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:27 gibba043 bash[24019]: cephadm 2021-03-10T15:54:26.747730+0000 mgr.gibba043.dnkmem (mgr.34373) 6520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:27 gibba043 bash[24019]: audit 2021-03-10T15:54:27.545394+0000 mon.a (mon.0) 1492 : audit [DBG] from='client.? 172.21.2.103:0/707641544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:28 gibba003 bash[31385]: audit 2021-03-10T15:54:27.052711+0000 mgr.gibba043.dnkmem (mgr.34373) 6521 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:28 gibba003 bash[31385]: audit 2021-03-10T15:54:27.278013+0000 mgr.gibba043.dnkmem (mgr.34373) 6522 : audit [DBG] from='client.48432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:28.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:28 gibba003 bash[32348]: audit 2021-03-10T15:54:27.052711+0000 mgr.gibba043.dnkmem (mgr.34373) 6521 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:28.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:28 gibba003 bash[32348]: audit 2021-03-10T15:54:27.278013+0000 mgr.gibba043.dnkmem (mgr.34373) 6522 : audit [DBG] from='client.48432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:28 gibba043 bash[24019]: audit 2021-03-10T15:54:27.052711+0000 mgr.gibba043.dnkmem (mgr.34373) 6521 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:28 gibba043 bash[24019]: audit 2021-03-10T15:54:27.278013+0000 mgr.gibba043.dnkmem (mgr.34373) 6522 : audit [DBG] from='client.48432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:29 gibba003 bash[31385]: cluster 2021-03-10T15:54:28.537328+0000 mgr.gibba043.dnkmem (mgr.34373) 6523 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:29 gibba003 bash[32348]: cluster 2021-03-10T15:54:28.537328+0000 mgr.gibba043.dnkmem (mgr.34373) 6523 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:29 gibba043 bash[24019]: cluster 2021-03-10T15:54:28.537328+0000 mgr.gibba043.dnkmem (mgr.34373) 6523 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:31 gibba003 bash[31385]: cluster 2021-03-10T15:54:30.538726+0000 mgr.gibba043.dnkmem (mgr.34373) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:31 gibba003 bash[32348]: cluster 2021-03-10T15:54:30.538726+0000 mgr.gibba043.dnkmem (mgr.34373) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:31 gibba043 bash[24019]: cluster 2021-03-10T15:54:30.538726+0000 mgr.gibba043.dnkmem (mgr.34373) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:33 gibba003 bash[31385]: cluster 2021-03-10T15:54:32.540383+0000 mgr.gibba043.dnkmem (mgr.34373) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:33 gibba003 bash[32348]: cluster 2021-03-10T15:54:32.540383+0000 mgr.gibba043.dnkmem (mgr.34373) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:33 gibba043 bash[24019]: cluster 2021-03-10T15:54:32.540383+0000 mgr.gibba043.dnkmem (mgr.34373) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:35.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:35 gibba003 bash[31385]: cluster 2021-03-10T15:54:34.542153+0000 mgr.gibba043.dnkmem (mgr.34373) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:35.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:35 gibba003 bash[32348]: cluster 2021-03-10T15:54:34.542153+0000 mgr.gibba043.dnkmem (mgr.34373) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:35 gibba043 bash[24019]: cluster 2021-03-10T15:54:34.542153+0000 mgr.gibba043.dnkmem (mgr.34373) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:37 gibba003 bash[31385]: cluster 2021-03-10T15:54:36.543532+0000 mgr.gibba043.dnkmem (mgr.34373) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:37 gibba003 bash[32348]: cluster 2021-03-10T15:54:36.543532+0000 mgr.gibba043.dnkmem (mgr.34373) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:37 gibba043 bash[24019]: cluster 2021-03-10T15:54:36.543532+0000 mgr.gibba043.dnkmem (mgr.34373) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:39 gibba003 bash[31385]: cluster 2021-03-10T15:54:38.545166+0000 mgr.gibba043.dnkmem (mgr.34373) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:39 gibba003 bash[32348]: cluster 2021-03-10T15:54:38.545166+0000 mgr.gibba043.dnkmem (mgr.34373) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:39 gibba043 bash[24019]: cluster 2021-03-10T15:54:38.545166+0000 mgr.gibba043.dnkmem (mgr.34373) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:41 gibba003 bash[31385]: cluster 2021-03-10T15:54:40.546411+0000 mgr.gibba043.dnkmem (mgr.34373) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:41 gibba003 bash[32348]: cluster 2021-03-10T15:54:40.546411+0000 mgr.gibba043.dnkmem (mgr.34373) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.764 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:41 gibba043 bash[24019]: cluster 2021-03-10T15:54:40.546411+0000 mgr.gibba043.dnkmem (mgr.34373) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:42.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:42 gibba003 bash[31385]: cephadm 2021-03-10T15:54:41.763830+0000 mgr.gibba043.dnkmem (mgr.34373) 6530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:42.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:42 gibba003 bash[32348]: cephadm 2021-03-10T15:54:41.763830+0000 mgr.gibba043.dnkmem (mgr.34373) 6530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:42.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:42 gibba043 bash[24019]: cephadm 2021-03-10T15:54:41.763830+0000 mgr.gibba043.dnkmem (mgr.34373) 6530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:43 gibba003 bash[31385]: cluster 2021-03-10T15:54:42.548139+0000 mgr.gibba043.dnkmem (mgr.34373) 6531 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:43 gibba003 bash[32348]: cluster 2021-03-10T15:54:42.548139+0000 mgr.gibba043.dnkmem (mgr.34373) 6531 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:43 gibba043 bash[24019]: cluster 2021-03-10T15:54:42.548139+0000 mgr.gibba043.dnkmem (mgr.34373) 6531 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:45 gibba003 bash[31385]: cluster 2021-03-10T15:54:44.549096+0000 mgr.gibba043.dnkmem (mgr.34373) 6532 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:45 gibba003 bash[32348]: cluster 2021-03-10T15:54:44.549096+0000 mgr.gibba043.dnkmem (mgr.34373) 6532 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:46.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:45 gibba043 bash[24019]: cluster 2021-03-10T15:54:44.549096+0000 mgr.gibba043.dnkmem (mgr.34373) 6532 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:47 gibba003 bash[31385]: cluster 2021-03-10T15:54:46.550626+0000 mgr.gibba043.dnkmem (mgr.34373) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:47 gibba003 bash[32348]: cluster 2021-03-10T15:54:46.550626+0000 mgr.gibba043.dnkmem (mgr.34373) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:47 gibba043 bash[24019]: cluster 2021-03-10T15:54:46.550626+0000 mgr.gibba043.dnkmem (mgr.34373) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:49 gibba003 bash[31385]: cluster 2021-03-10T15:54:48.552189+0000 mgr.gibba043.dnkmem (mgr.34373) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:49 gibba003 bash[32348]: cluster 2021-03-10T15:54:48.552189+0000 mgr.gibba043.dnkmem (mgr.34373) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:49 gibba043 bash[24019]: cluster 2021-03-10T15:54:48.552189+0000 mgr.gibba043.dnkmem (mgr.34373) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:51 gibba003 bash[31385]: cluster 2021-03-10T15:54:50.553743+0000 mgr.gibba043.dnkmem (mgr.34373) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:51 gibba003 bash[32348]: cluster 2021-03-10T15:54:50.553743+0000 mgr.gibba043.dnkmem (mgr.34373) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:51 gibba043 bash[24019]: cluster 2021-03-10T15:54:50.553743+0000 mgr.gibba043.dnkmem (mgr.34373) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:53 gibba003 bash[31385]: cluster 2021-03-10T15:54:52.554575+0000 mgr.gibba043.dnkmem (mgr.34373) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:53 gibba003 bash[32348]: cluster 2021-03-10T15:54:52.554575+0000 mgr.gibba043.dnkmem (mgr.34373) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:53 gibba043 bash[24019]: cluster 2021-03-10T15:54:52.554575+0000 mgr.gibba043.dnkmem (mgr.34373) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:55 gibba003 bash[31385]: cluster 2021-03-10T15:54:54.556271+0000 mgr.gibba043.dnkmem (mgr.34373) 6537 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:55 gibba003 bash[32348]: cluster 2021-03-10T15:54:54.556271+0000 mgr.gibba043.dnkmem (mgr.34373) 6537 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:55 gibba043 bash[24019]: cluster 2021-03-10T15:54:54.556271+0000 mgr.gibba043.dnkmem (mgr.34373) 6537 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.790 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:54:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: cluster 2021-03-10T15:54:56.557789+0000 mgr.gibba043.dnkmem (mgr.34373) 6538 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:56.975126+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:56.981127+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.176755+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.180440+0000 mon.c (mon.1) 1697 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.181747+0000 mon.c (mon.1) 1698 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.183014+0000 mon.c (mon.1) 1699 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.184039+0000 mon.c (mon.1) 1700 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.186865+0000 mon.c (mon.1) 1701 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[31385]: audit 2021-03-10T15:54:57.189332+0000 mon.c (mon.1) 1702 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: cluster 2021-03-10T15:54:56.557789+0000 mgr.gibba043.dnkmem (mgr.34373) 6538 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:56.975126+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:56.981127+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.176755+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.180440+0000 mon.c (mon.1) 1697 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.181747+0000 mon.c (mon.1) 1698 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.183014+0000 mon.c (mon.1) 1699 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.184039+0000 mon.c (mon.1) 1700 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.186865+0000 mon.c (mon.1) 1701 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:57 gibba003 bash[32348]: audit 2021-03-10T15:54:57.189332+0000 mon.c (mon.1) 1702 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.016 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:54:58.017 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:54:58.017 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:54:58.017 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:54:58.017 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:54:58.017 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:54:58.018 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:54:58.018 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:54:58.018 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:54:58.018 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:54:58.019 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:54:58.019 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:54:58.019 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:54:58.019 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:54:58.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:54:58.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:54:58.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:54:58.020 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:54:58.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (118m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:54:58.021 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:54:58.021 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:54:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: cluster 2021-03-10T15:54:56.557789+0000 mgr.gibba043.dnkmem (mgr.34373) 6538 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:56.975126+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:56.981127+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.176755+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:54:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.180440+0000 mon.c (mon.1) 1697 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.181747+0000 mon.c (mon.1) 1698 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.183014+0000 mon.c (mon.1) 1699 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.184039+0000 mon.c (mon.1) 1700 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.186865+0000 mon.c (mon.1) 1701 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:57 gibba043 bash[24019]: audit 2021-03-10T15:54:57.189332+0000 mon.c (mon.1) 1702 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.264 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:54:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:54:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:54:58.265 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:54:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:54:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:54:58.266 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:54:58.267 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:54:58.267 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:54:58.267 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:54:58.267 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:54:58.268 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:54:58.268 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:54:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:56.974314+0000 mgr.gibba043.dnkmem (mgr.34373) 6539 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:54:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:56.980052+0000 mgr.gibba043.dnkmem (mgr.34373) 6540 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:54:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.177836+0000 mgr.gibba043.dnkmem (mgr.34373) 6541 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.179353+0000 mgr.gibba043.dnkmem (mgr.34373) 6542 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.180703+0000 mgr.gibba043.dnkmem (mgr.34373) 6543 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.180742+0000 mgr.gibba043.dnkmem (mgr.34373) 6544 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.181807+0000 mgr.gibba043.dnkmem (mgr.34373) 6545 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.181844+0000 mgr.gibba043.dnkmem (mgr.34373) 6546 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.182700+0000 mgr.gibba043.dnkmem (mgr.34373) 6547 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.184273+0000 mgr.gibba043.dnkmem (mgr.34373) 6548 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.184310+0000 mgr.gibba043.dnkmem (mgr.34373) 6549 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.186586+0000 mgr.gibba043.dnkmem (mgr.34373) 6550 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.186903+0000 mgr.gibba043.dnkmem (mgr.34373) 6551 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.189076+0000 mgr.gibba043.dnkmem (mgr.34373) 6552 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.189119+0000 mgr.gibba043.dnkmem (mgr.34373) 6553 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: cephadm 2021-03-10T15:54:57.189226+0000 mgr.gibba043.dnkmem (mgr.34373) 6554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: audit 2021-03-10T15:54:57.780068+0000 mgr.gibba043.dnkmem (mgr.34373) 6555 : audit [DBG] from='client.48444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[31385]: audit 2021-03-10T15:54:58.265937+0000 mon.c (mon.1) 1703 : audit [DBG] from='client.? 172.21.2.103:0/2451529824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:56.974314+0000 mgr.gibba043.dnkmem (mgr.34373) 6539 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:54:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:56.980052+0000 mgr.gibba043.dnkmem (mgr.34373) 6540 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:54:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.177836+0000 mgr.gibba043.dnkmem (mgr.34373) 6541 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.179353+0000 mgr.gibba043.dnkmem (mgr.34373) 6542 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.180703+0000 mgr.gibba043.dnkmem (mgr.34373) 6543 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.180742+0000 mgr.gibba043.dnkmem (mgr.34373) 6544 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.181807+0000 mgr.gibba043.dnkmem (mgr.34373) 6545 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.181844+0000 mgr.gibba043.dnkmem (mgr.34373) 6546 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.182700+0000 mgr.gibba043.dnkmem (mgr.34373) 6547 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.184273+0000 mgr.gibba043.dnkmem (mgr.34373) 6548 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.184310+0000 mgr.gibba043.dnkmem (mgr.34373) 6549 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.186586+0000 mgr.gibba043.dnkmem (mgr.34373) 6550 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.186903+0000 mgr.gibba043.dnkmem (mgr.34373) 6551 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.189076+0000 mgr.gibba043.dnkmem (mgr.34373) 6552 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.189119+0000 mgr.gibba043.dnkmem (mgr.34373) 6553 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: cephadm 2021-03-10T15:54:57.189226+0000 mgr.gibba043.dnkmem (mgr.34373) 6554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: audit 2021-03-10T15:54:57.780068+0000 mgr.gibba043.dnkmem (mgr.34373) 6555 : audit [DBG] from='client.48444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:58 gibba003 bash[32348]: audit 2021-03-10T15:54:58.265937+0000 mon.c (mon.1) 1703 : audit [DBG] from='client.? 172.21.2.103:0/2451529824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:56.974314+0000 mgr.gibba043.dnkmem (mgr.34373) 6539 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:56.980052+0000 mgr.gibba043.dnkmem (mgr.34373) 6540 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.177836+0000 mgr.gibba043.dnkmem (mgr.34373) 6541 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.179353+0000 mgr.gibba043.dnkmem (mgr.34373) 6542 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.180703+0000 mgr.gibba043.dnkmem (mgr.34373) 6543 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.180742+0000 mgr.gibba043.dnkmem (mgr.34373) 6544 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.181807+0000 mgr.gibba043.dnkmem (mgr.34373) 6545 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.181844+0000 mgr.gibba043.dnkmem (mgr.34373) 6546 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.182700+0000 mgr.gibba043.dnkmem (mgr.34373) 6547 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.184273+0000 mgr.gibba043.dnkmem (mgr.34373) 6548 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.184310+0000 mgr.gibba043.dnkmem (mgr.34373) 6549 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.186586+0000 mgr.gibba043.dnkmem (mgr.34373) 6550 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.186903+0000 mgr.gibba043.dnkmem (mgr.34373) 6551 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.189076+0000 mgr.gibba043.dnkmem (mgr.34373) 6552 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.189119+0000 mgr.gibba043.dnkmem (mgr.34373) 6553 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: cephadm 2021-03-10T15:54:57.189226+0000 mgr.gibba043.dnkmem (mgr.34373) 6554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:54:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: audit 2021-03-10T15:54:57.780068+0000 mgr.gibba043.dnkmem (mgr.34373) 6555 : audit [DBG] from='client.48444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:58 gibba043 bash[24019]: audit 2021-03-10T15:54:58.265937+0000 mon.c (mon.1) 1703 : audit [DBG] from='client.? 172.21.2.103:0/2451529824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:59 gibba003 bash[31385]: audit 2021-03-10T15:54:58.004471+0000 mgr.gibba043.dnkmem (mgr.34373) 6556 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:54:59 gibba003 bash[31385]: cluster 2021-03-10T15:54:58.559320+0000 mgr.gibba043.dnkmem (mgr.34373) 6557 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:59 gibba003 bash[32348]: audit 2021-03-10T15:54:58.004471+0000 mgr.gibba043.dnkmem (mgr.34373) 6556 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:59.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:54:59 gibba003 bash[32348]: cluster 2021-03-10T15:54:58.559320+0000 mgr.gibba043.dnkmem (mgr.34373) 6557 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:59 gibba043 bash[24019]: audit 2021-03-10T15:54:58.004471+0000 mgr.gibba043.dnkmem (mgr.34373) 6556 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:54:59 gibba043 bash[24019]: cluster 2021-03-10T15:54:58.559320+0000 mgr.gibba043.dnkmem (mgr.34373) 6557 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:01 gibba003 bash[31385]: cluster 2021-03-10T15:55:00.560191+0000 mgr.gibba043.dnkmem (mgr.34373) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:01 gibba003 bash[32348]: cluster 2021-03-10T15:55:00.560191+0000 mgr.gibba043.dnkmem (mgr.34373) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:01 gibba043 bash[24019]: cluster 2021-03-10T15:55:00.560191+0000 mgr.gibba043.dnkmem (mgr.34373) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:03 gibba003 bash[31385]: cluster 2021-03-10T15:55:02.561787+0000 mgr.gibba043.dnkmem (mgr.34373) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:03 gibba003 bash[32348]: cluster 2021-03-10T15:55:02.561787+0000 mgr.gibba043.dnkmem (mgr.34373) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:03 gibba043 bash[24019]: cluster 2021-03-10T15:55:02.561787+0000 mgr.gibba043.dnkmem (mgr.34373) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:05 gibba003 bash[31385]: cluster 2021-03-10T15:55:04.563641+0000 mgr.gibba043.dnkmem (mgr.34373) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:05 gibba003 bash[32348]: cluster 2021-03-10T15:55:04.563641+0000 mgr.gibba043.dnkmem (mgr.34373) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:05 gibba043 bash[24019]: cluster 2021-03-10T15:55:04.563641+0000 mgr.gibba043.dnkmem (mgr.34373) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:07 gibba003 bash[31385]: cluster 2021-03-10T15:55:06.565276+0000 mgr.gibba043.dnkmem (mgr.34373) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:07 gibba003 bash[32348]: cluster 2021-03-10T15:55:06.565276+0000 mgr.gibba043.dnkmem (mgr.34373) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:07 gibba043 bash[24019]: cluster 2021-03-10T15:55:06.565276+0000 mgr.gibba043.dnkmem (mgr.34373) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:09 gibba003 bash[31385]: cluster 2021-03-10T15:55:08.566137+0000 mgr.gibba043.dnkmem (mgr.34373) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:09 gibba003 bash[32348]: cluster 2021-03-10T15:55:08.566137+0000 mgr.gibba043.dnkmem (mgr.34373) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:09 gibba043 bash[24019]: cluster 2021-03-10T15:55:08.566137+0000 mgr.gibba043.dnkmem (mgr.34373) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:11 gibba003 bash[31385]: cluster 2021-03-10T15:55:10.567571+0000 mgr.gibba043.dnkmem (mgr.34373) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:11 gibba003 bash[32348]: cluster 2021-03-10T15:55:10.567571+0000 mgr.gibba043.dnkmem (mgr.34373) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:11 gibba043 bash[24019]: cluster 2021-03-10T15:55:10.567571+0000 mgr.gibba043.dnkmem (mgr.34373) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[31385]: cephadm 2021-03-10T15:55:12.193111+0000 mgr.gibba043.dnkmem (mgr.34373) 6564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[31385]: cluster 2021-03-10T15:55:12.568997+0000 mgr.gibba043.dnkmem (mgr.34373) 6565 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[31385]: audit 2021-03-10T15:55:13.514855+0000 mon.c (mon.1) 1704 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[31385]: audit 2021-03-10T15:55:13.515979+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[32348]: cephadm 2021-03-10T15:55:12.193111+0000 mgr.gibba043.dnkmem (mgr.34373) 6564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[32348]: cluster 2021-03-10T15:55:12.568997+0000 mgr.gibba043.dnkmem (mgr.34373) 6565 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[32348]: audit 2021-03-10T15:55:13.514855+0000 mon.c (mon.1) 1704 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:13 gibba003 bash[32348]: audit 2021-03-10T15:55:13.515979+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:13 gibba043 bash[24019]: cephadm 2021-03-10T15:55:12.193111+0000 mgr.gibba043.dnkmem (mgr.34373) 6564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:13 gibba043 bash[24019]: cluster 2021-03-10T15:55:12.568997+0000 mgr.gibba043.dnkmem (mgr.34373) 6565 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:13 gibba043 bash[24019]: audit 2021-03-10T15:55:13.514855+0000 mon.c (mon.1) 1704 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:13 gibba043 bash[24019]: audit 2021-03-10T15:55:13.515979+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.674361+0000 mon.c (mon.1) 1705 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.674872+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.808421+0000 mon.c (mon.1) 1706 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.809140+0000 mon.c (mon.1) 1707 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:55:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.809673+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.809832+0000 mon.c (mon.1) 1708 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.810509+0000 mon.c (mon.1) 1709 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.811122+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:55:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.812357+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[31385]: audit 2021-03-10T15:55:13.813209+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.674361+0000 mon.c (mon.1) 1705 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.674872+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.808421+0000 mon.c (mon.1) 1706 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.809140+0000 mon.c (mon.1) 1707 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:55:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.809673+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.809832+0000 mon.c (mon.1) 1708 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.810509+0000 mon.c (mon.1) 1709 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.811122+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:55:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.812357+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:14 gibba003 bash[32348]: audit 2021-03-10T15:55:13.813209+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.674361+0000 mon.c (mon.1) 1705 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.674872+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.808421+0000 mon.c (mon.1) 1706 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.809140+0000 mon.c (mon.1) 1707 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:55:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.809673+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.809832+0000 mon.c (mon.1) 1708 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.810509+0000 mon.c (mon.1) 1709 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.811122+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:55:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.812357+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:14 gibba043 bash[24019]: audit 2021-03-10T15:55:13.813209+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:15 gibba003 bash[31385]: cluster 2021-03-10T15:55:14.570704+0000 mgr.gibba043.dnkmem (mgr.34373) 6566 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:15 gibba003 bash[32348]: cluster 2021-03-10T15:55:14.570704+0000 mgr.gibba043.dnkmem (mgr.34373) 6566 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:15 gibba043 bash[24019]: cluster 2021-03-10T15:55:14.570704+0000 mgr.gibba043.dnkmem (mgr.34373) 6566 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:17 gibba003 bash[31385]: cluster 2021-03-10T15:55:16.572414+0000 mgr.gibba043.dnkmem (mgr.34373) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:17 gibba003 bash[32348]: cluster 2021-03-10T15:55:16.572414+0000 mgr.gibba043.dnkmem (mgr.34373) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:17 gibba043 bash[24019]: cluster 2021-03-10T15:55:16.572414+0000 mgr.gibba043.dnkmem (mgr.34373) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:19 gibba003 bash[31385]: cluster 2021-03-10T15:55:18.573914+0000 mgr.gibba043.dnkmem (mgr.34373) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:19 gibba003 bash[32348]: cluster 2021-03-10T15:55:18.573914+0000 mgr.gibba043.dnkmem (mgr.34373) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:19 gibba043 bash[24019]: cluster 2021-03-10T15:55:18.573914+0000 mgr.gibba043.dnkmem (mgr.34373) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:21 gibba003 bash[31385]: cluster 2021-03-10T15:55:20.575440+0000 mgr.gibba043.dnkmem (mgr.34373) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:21 gibba003 bash[32348]: cluster 2021-03-10T15:55:20.575440+0000 mgr.gibba043.dnkmem (mgr.34373) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:21 gibba043 bash[24019]: cluster 2021-03-10T15:55:20.575440+0000 mgr.gibba043.dnkmem (mgr.34373) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:23 gibba003 bash[31385]: cluster 2021-03-10T15:55:22.577011+0000 mgr.gibba043.dnkmem (mgr.34373) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:23 gibba003 bash[32348]: cluster 2021-03-10T15:55:22.577011+0000 mgr.gibba043.dnkmem (mgr.34373) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:23 gibba043 bash[24019]: cluster 2021-03-10T15:55:22.577011+0000 mgr.gibba043.dnkmem (mgr.34373) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:25 gibba003 bash[31385]: cluster 2021-03-10T15:55:24.577928+0000 mgr.gibba043.dnkmem (mgr.34373) 6571 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:25 gibba003 bash[32348]: cluster 2021-03-10T15:55:24.577928+0000 mgr.gibba043.dnkmem (mgr.34373) 6571 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:25 gibba043 bash[24019]: cluster 2021-03-10T15:55:24.577928+0000 mgr.gibba043.dnkmem (mgr.34373) 6571 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:27 gibba003 bash[31385]: cluster 2021-03-10T15:55:26.578978+0000 mgr.gibba043.dnkmem (mgr.34373) 6572 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:27 gibba003 bash[32348]: cluster 2021-03-10T15:55:26.578978+0000 mgr.gibba043.dnkmem (mgr.34373) 6572 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:27 gibba043 bash[24019]: cluster 2021-03-10T15:55:26.578978+0000 mgr.gibba043.dnkmem (mgr.34373) 6572 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:28.508 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:55:28.736 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:55:28.736 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:55:28.737 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:55:28.737 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:55:28.737 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:55:28.737 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:55:28.737 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:55:28.738 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:55:28.738 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:55:28.738 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:55:28.738 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:55:28.739 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:55:28.739 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:55:28.739 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:55:28.739 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:55:28.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:55:28.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:55:28.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:55:28.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:55:28.741 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:55:28.741 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:55:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:28 gibba003 bash[31385]: cephadm 2021-03-10T15:55:27.201318+0000 mgr.gibba043.dnkmem (mgr.34373) 6573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:28.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:28 gibba003 bash[32348]: cephadm 2021-03-10T15:55:27.201318+0000 mgr.gibba043.dnkmem (mgr.34373) 6573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:28.986 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:55:28.986 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:55:28.987 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:28.987 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:55:28.987 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:55:28.987 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:28.988 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:55:28.988 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:55:28.988 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:55:28.988 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:55:28.989 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:55:28.989 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:55:28.989 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:55:28.989 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:55:28.989 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:55:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:28 gibba043 bash[24019]: cephadm 2021-03-10T15:55:27.201318+0000 mgr.gibba043.dnkmem (mgr.34373) 6573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[31385]: audit 2021-03-10T15:55:28.497934+0000 mgr.gibba043.dnkmem (mgr.34373) 6574 : audit [DBG] from='client.58450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[31385]: cluster 2021-03-10T15:55:28.580471+0000 mgr.gibba043.dnkmem (mgr.34373) 6575 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[31385]: audit 2021-03-10T15:55:28.724957+0000 mgr.gibba043.dnkmem (mgr.34373) 6576 : audit [DBG] from='client.48468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[31385]: audit 2021-03-10T15:55:28.988184+0000 mon.a (mon.0) 1502 : audit [DBG] from='client.? 172.21.2.103:0/4114348461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[32348]: audit 2021-03-10T15:55:28.497934+0000 mgr.gibba043.dnkmem (mgr.34373) 6574 : audit [DBG] from='client.58450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[32348]: cluster 2021-03-10T15:55:28.580471+0000 mgr.gibba043.dnkmem (mgr.34373) 6575 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[32348]: audit 2021-03-10T15:55:28.724957+0000 mgr.gibba043.dnkmem (mgr.34373) 6576 : audit [DBG] from='client.48468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:29 gibba003 bash[32348]: audit 2021-03-10T15:55:28.988184+0000 mon.a (mon.0) 1502 : audit [DBG] from='client.? 172.21.2.103:0/4114348461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:29 gibba043 bash[24019]: audit 2021-03-10T15:55:28.497934+0000 mgr.gibba043.dnkmem (mgr.34373) 6574 : audit [DBG] from='client.58450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:29 gibba043 bash[24019]: cluster 2021-03-10T15:55:28.580471+0000 mgr.gibba043.dnkmem (mgr.34373) 6575 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:29 gibba043 bash[24019]: audit 2021-03-10T15:55:28.724957+0000 mgr.gibba043.dnkmem (mgr.34373) 6576 : audit [DBG] from='client.48468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:29 gibba043 bash[24019]: audit 2021-03-10T15:55:28.988184+0000 mon.a (mon.0) 1502 : audit [DBG] from='client.? 172.21.2.103:0/4114348461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:31 gibba003 bash[31385]: cluster 2021-03-10T15:55:30.582053+0000 mgr.gibba043.dnkmem (mgr.34373) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:31 gibba003 bash[32348]: cluster 2021-03-10T15:55:30.582053+0000 mgr.gibba043.dnkmem (mgr.34373) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:31 gibba043 bash[24019]: cluster 2021-03-10T15:55:30.582053+0000 mgr.gibba043.dnkmem (mgr.34373) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:33 gibba003 bash[31385]: cluster 2021-03-10T15:55:32.583006+0000 mgr.gibba043.dnkmem (mgr.34373) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:33 gibba003 bash[32348]: cluster 2021-03-10T15:55:32.583006+0000 mgr.gibba043.dnkmem (mgr.34373) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:33 gibba043 bash[24019]: cluster 2021-03-10T15:55:32.583006+0000 mgr.gibba043.dnkmem (mgr.34373) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:35 gibba003 bash[31385]: cluster 2021-03-10T15:55:34.583472+0000 mgr.gibba043.dnkmem (mgr.34373) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:35 gibba003 bash[32348]: cluster 2021-03-10T15:55:34.583472+0000 mgr.gibba043.dnkmem (mgr.34373) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:35 gibba043 bash[24019]: cluster 2021-03-10T15:55:34.583472+0000 mgr.gibba043.dnkmem (mgr.34373) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:37 gibba003 bash[31385]: cluster 2021-03-10T15:55:36.585134+0000 mgr.gibba043.dnkmem (mgr.34373) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:37 gibba003 bash[32348]: cluster 2021-03-10T15:55:36.585134+0000 mgr.gibba043.dnkmem (mgr.34373) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:37 gibba043 bash[24019]: cluster 2021-03-10T15:55:36.585134+0000 mgr.gibba043.dnkmem (mgr.34373) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:39 gibba003 bash[31385]: cluster 2021-03-10T15:55:38.586728+0000 mgr.gibba043.dnkmem (mgr.34373) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:39 gibba003 bash[32348]: cluster 2021-03-10T15:55:38.586728+0000 mgr.gibba043.dnkmem (mgr.34373) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:39 gibba043 bash[24019]: cluster 2021-03-10T15:55:38.586728+0000 mgr.gibba043.dnkmem (mgr.34373) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:41 gibba003 bash[31385]: cluster 2021-03-10T15:55:40.587907+0000 mgr.gibba043.dnkmem (mgr.34373) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:41 gibba003 bash[32348]: cluster 2021-03-10T15:55:40.587907+0000 mgr.gibba043.dnkmem (mgr.34373) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:41 gibba043 bash[24019]: cluster 2021-03-10T15:55:40.587907+0000 mgr.gibba043.dnkmem (mgr.34373) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:43 gibba003 bash[31385]: cephadm 2021-03-10T15:55:42.217246+0000 mgr.gibba043.dnkmem (mgr.34373) 6583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:43 gibba003 bash[31385]: cluster 2021-03-10T15:55:42.589556+0000 mgr.gibba043.dnkmem (mgr.34373) 6584 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:43 gibba003 bash[32348]: cephadm 2021-03-10T15:55:42.217246+0000 mgr.gibba043.dnkmem (mgr.34373) 6583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:43 gibba003 bash[32348]: cluster 2021-03-10T15:55:42.589556+0000 mgr.gibba043.dnkmem (mgr.34373) 6584 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:43 gibba043 bash[24019]: cephadm 2021-03-10T15:55:42.217246+0000 mgr.gibba043.dnkmem (mgr.34373) 6583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:43 gibba043 bash[24019]: cluster 2021-03-10T15:55:42.589556+0000 mgr.gibba043.dnkmem (mgr.34373) 6584 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:45 gibba003 bash[31385]: cluster 2021-03-10T15:55:44.590094+0000 mgr.gibba043.dnkmem (mgr.34373) 6585 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:45 gibba003 bash[32348]: cluster 2021-03-10T15:55:44.590094+0000 mgr.gibba043.dnkmem (mgr.34373) 6585 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:45 gibba043 bash[24019]: cluster 2021-03-10T15:55:44.590094+0000 mgr.gibba043.dnkmem (mgr.34373) 6585 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:47 gibba003 bash[31385]: cluster 2021-03-10T15:55:46.591761+0000 mgr.gibba043.dnkmem (mgr.34373) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:47 gibba003 bash[32348]: cluster 2021-03-10T15:55:46.591761+0000 mgr.gibba043.dnkmem (mgr.34373) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:47 gibba043 bash[24019]: cluster 2021-03-10T15:55:46.591761+0000 mgr.gibba043.dnkmem (mgr.34373) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:49 gibba003 bash[31385]: cluster 2021-03-10T15:55:48.592919+0000 mgr.gibba043.dnkmem (mgr.34373) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:49 gibba003 bash[32348]: cluster 2021-03-10T15:55:48.592919+0000 mgr.gibba043.dnkmem (mgr.34373) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:49 gibba043 bash[24019]: cluster 2021-03-10T15:55:48.592919+0000 mgr.gibba043.dnkmem (mgr.34373) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:51 gibba003 bash[31385]: cluster 2021-03-10T15:55:50.594410+0000 mgr.gibba043.dnkmem (mgr.34373) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:51 gibba003 bash[32348]: cluster 2021-03-10T15:55:50.594410+0000 mgr.gibba043.dnkmem (mgr.34373) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:51 gibba043 bash[24019]: cluster 2021-03-10T15:55:50.594410+0000 mgr.gibba043.dnkmem (mgr.34373) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:53 gibba003 bash[31385]: cluster 2021-03-10T15:55:52.596055+0000 mgr.gibba043.dnkmem (mgr.34373) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:53 gibba003 bash[32348]: cluster 2021-03-10T15:55:52.596055+0000 mgr.gibba043.dnkmem (mgr.34373) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:53 gibba043 bash[24019]: cluster 2021-03-10T15:55:52.596055+0000 mgr.gibba043.dnkmem (mgr.34373) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:55 gibba003 bash[31385]: cluster 2021-03-10T15:55:54.596586+0000 mgr.gibba043.dnkmem (mgr.34373) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:55 gibba003 bash[32348]: cluster 2021-03-10T15:55:54.596586+0000 mgr.gibba043.dnkmem (mgr.34373) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:55 gibba043 bash[24019]: cluster 2021-03-10T15:55:54.596586+0000 mgr.gibba043.dnkmem (mgr.34373) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: cluster 2021-03-10T15:55:56.598287+0000 mgr.gibba043.dnkmem (mgr.34373) 6591 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.457274+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:55:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.460806+0000 mon.c (mon.1) 1710 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.462434+0000 mon.c (mon.1) 1711 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.464029+0000 mon.c (mon.1) 1712 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.465501+0000 mon.c (mon.1) 1713 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.468603+0000 mon.c (mon.1) 1714 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:57 gibba043 bash[24019]: audit 2021-03-10T15:55:57.470145+0000 mon.c (mon.1) 1715 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: cluster 2021-03-10T15:55:56.598287+0000 mgr.gibba043.dnkmem (mgr.34373) 6591 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.457274+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:55:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.460806+0000 mon.c (mon.1) 1710 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.462434+0000 mon.c (mon.1) 1711 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.464029+0000 mon.c (mon.1) 1712 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.465501+0000 mon.c (mon.1) 1713 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.468603+0000 mon.c (mon.1) 1714 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[31385]: audit 2021-03-10T15:55:57.470145+0000 mon.c (mon.1) 1715 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: cluster 2021-03-10T15:55:56.598287+0000 mgr.gibba043.dnkmem (mgr.34373) 6591 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.457274+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:55:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.460806+0000 mon.c (mon.1) 1710 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:57.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.462434+0000 mon.c (mon.1) 1711 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.464029+0000 mon.c (mon.1) 1712 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.465501+0000 mon.c (mon.1) 1713 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.468603+0000 mon.c (mon.1) 1714 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:57 gibba003 bash[32348]: audit 2021-03-10T15:55:57.470145+0000 mon.c (mon.1) 1715 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.233437+0000 mgr.gibba043.dnkmem (mgr.34373) 6592 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:55:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.235018+0000 mgr.gibba043.dnkmem (mgr.34373) 6593 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:55:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.458206+0000 mgr.gibba043.dnkmem (mgr.34373) 6594 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.460074+0000 mgr.gibba043.dnkmem (mgr.34373) 6595 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.461605+0000 mgr.gibba043.dnkmem (mgr.34373) 6596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.461642+0000 mgr.gibba043.dnkmem (mgr.34373) 6597 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.463136+0000 mgr.gibba043.dnkmem (mgr.34373) 6598 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.463236+0000 mgr.gibba043.dnkmem (mgr.34373) 6599 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.464451+0000 mgr.gibba043.dnkmem (mgr.34373) 6600 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.466202+0000 mgr.gibba043.dnkmem (mgr.34373) 6601 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.466240+0000 mgr.gibba043.dnkmem (mgr.34373) 6602 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.467567+0000 mgr.gibba043.dnkmem (mgr.34373) 6603 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.467983+0000 mgr.gibba043.dnkmem (mgr.34373) 6604 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.468988+0000 mgr.gibba043.dnkmem (mgr.34373) 6605 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.469021+0000 mgr.gibba043.dnkmem (mgr.34373) 6606 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[31385]: cephadm 2021-03-10T15:55:57.469131+0000 mgr.gibba043.dnkmem (mgr.34373) 6607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.233437+0000 mgr.gibba043.dnkmem (mgr.34373) 6592 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:55:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.235018+0000 mgr.gibba043.dnkmem (mgr.34373) 6593 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:55:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.458206+0000 mgr.gibba043.dnkmem (mgr.34373) 6594 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.460074+0000 mgr.gibba043.dnkmem (mgr.34373) 6595 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.461605+0000 mgr.gibba043.dnkmem (mgr.34373) 6596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.461642+0000 mgr.gibba043.dnkmem (mgr.34373) 6597 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.463136+0000 mgr.gibba043.dnkmem (mgr.34373) 6598 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.463236+0000 mgr.gibba043.dnkmem (mgr.34373) 6599 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.464451+0000 mgr.gibba043.dnkmem (mgr.34373) 6600 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.466202+0000 mgr.gibba043.dnkmem (mgr.34373) 6601 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.466240+0000 mgr.gibba043.dnkmem (mgr.34373) 6602 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.467567+0000 mgr.gibba043.dnkmem (mgr.34373) 6603 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.467983+0000 mgr.gibba043.dnkmem (mgr.34373) 6604 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.468988+0000 mgr.gibba043.dnkmem (mgr.34373) 6605 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.469021+0000 mgr.gibba043.dnkmem (mgr.34373) 6606 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:58 gibba003 bash[32348]: cephadm 2021-03-10T15:55:57.469131+0000 mgr.gibba043.dnkmem (mgr.34373) 6607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.233437+0000 mgr.gibba043.dnkmem (mgr.34373) 6592 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:55:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.235018+0000 mgr.gibba043.dnkmem (mgr.34373) 6593 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:55:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.458206+0000 mgr.gibba043.dnkmem (mgr.34373) 6594 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.460074+0000 mgr.gibba043.dnkmem (mgr.34373) 6595 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.461605+0000 mgr.gibba043.dnkmem (mgr.34373) 6596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.461642+0000 mgr.gibba043.dnkmem (mgr.34373) 6597 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.463136+0000 mgr.gibba043.dnkmem (mgr.34373) 6598 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.463236+0000 mgr.gibba043.dnkmem (mgr.34373) 6599 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.464451+0000 mgr.gibba043.dnkmem (mgr.34373) 6600 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.466202+0000 mgr.gibba043.dnkmem (mgr.34373) 6601 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.466240+0000 mgr.gibba043.dnkmem (mgr.34373) 6602 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.467567+0000 mgr.gibba043.dnkmem (mgr.34373) 6603 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.467983+0000 mgr.gibba043.dnkmem (mgr.34373) 6604 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.468988+0000 mgr.gibba043.dnkmem (mgr.34373) 6605 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.469021+0000 mgr.gibba043.dnkmem (mgr.34373) 6606 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:58 gibba043 bash[24019]: cephadm 2021-03-10T15:55:57.469131+0000 mgr.gibba043.dnkmem (mgr.34373) 6607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:55:59.228 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:55:59.453 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:55:59.453 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:55:59.454 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:55:59.454 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:55:59.454 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:55:59.454 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:55:59.455 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:55:59.455 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:55:59.455 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:55:59.455 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:55:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:55:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:55:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:55:59.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:55:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:55:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:55:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:55:59.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:55:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (119m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:55:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:55:59.458 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:55:59.708 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:55:59.708 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:55:59.708 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:59.708 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:55:59.709 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:55:59.709 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:59.709 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:55:59.709 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:55:59.710 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:55:59.710 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:55:59.710 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:55:59.710 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:55:59.711 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:55:59.711 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:55:59.711 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:56:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:55:59 gibba043 bash[24019]: cluster 2021-03-10T15:55:58.600033+0000 mgr.gibba043.dnkmem (mgr.34373) 6608 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:55:59 gibba003 bash[31385]: cluster 2021-03-10T15:55:58.600033+0000 mgr.gibba043.dnkmem (mgr.34373) 6608 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:55:59 gibba003 bash[32348]: cluster 2021-03-10T15:55:58.600033+0000 mgr.gibba043.dnkmem (mgr.34373) 6608 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:00 gibba043 bash[24019]: audit 2021-03-10T15:55:59.219073+0000 mgr.gibba043.dnkmem (mgr.34373) 6609 : audit [DBG] from='client.48480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:00 gibba043 bash[24019]: audit 2021-03-10T15:55:59.440828+0000 mgr.gibba043.dnkmem (mgr.34373) 6610 : audit [DBG] from='client.58474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:00 gibba043 bash[24019]: audit 2021-03-10T15:55:59.709456+0000 mon.a (mon.0) 1504 : audit [DBG] from='client.? 172.21.2.103:0/973606505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:01.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:00 gibba003 bash[31385]: audit 2021-03-10T15:55:59.219073+0000 mgr.gibba043.dnkmem (mgr.34373) 6609 : audit [DBG] from='client.48480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:00 gibba003 bash[31385]: audit 2021-03-10T15:55:59.440828+0000 mgr.gibba043.dnkmem (mgr.34373) 6610 : audit [DBG] from='client.58474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:00 gibba003 bash[31385]: audit 2021-03-10T15:55:59.709456+0000 mon.a (mon.0) 1504 : audit [DBG] from='client.? 172.21.2.103:0/973606505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:01.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:00 gibba003 bash[32348]: audit 2021-03-10T15:55:59.219073+0000 mgr.gibba043.dnkmem (mgr.34373) 6609 : audit [DBG] from='client.48480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:00 gibba003 bash[32348]: audit 2021-03-10T15:55:59.440828+0000 mgr.gibba043.dnkmem (mgr.34373) 6610 : audit [DBG] from='client.58474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:00 gibba003 bash[32348]: audit 2021-03-10T15:55:59.709456+0000 mon.a (mon.0) 1504 : audit [DBG] from='client.? 172.21.2.103:0/973606505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:01 gibba043 bash[24019]: cluster 2021-03-10T15:56:00.601500+0000 mgr.gibba043.dnkmem (mgr.34373) 6611 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:01 gibba003 bash[31385]: cluster 2021-03-10T15:56:00.601500+0000 mgr.gibba043.dnkmem (mgr.34373) 6611 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:01 gibba003 bash[32348]: cluster 2021-03-10T15:56:00.601500+0000 mgr.gibba043.dnkmem (mgr.34373) 6611 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:03 gibba043 bash[24019]: cluster 2021-03-10T15:56:02.603310+0000 mgr.gibba043.dnkmem (mgr.34373) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:03 gibba003 bash[31385]: cluster 2021-03-10T15:56:02.603310+0000 mgr.gibba043.dnkmem (mgr.34373) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:03 gibba003 bash[32348]: cluster 2021-03-10T15:56:02.603310+0000 mgr.gibba043.dnkmem (mgr.34373) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:05 gibba043 bash[24019]: cluster 2021-03-10T15:56:04.604527+0000 mgr.gibba043.dnkmem (mgr.34373) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:05 gibba003 bash[31385]: cluster 2021-03-10T15:56:04.604527+0000 mgr.gibba043.dnkmem (mgr.34373) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:05 gibba003 bash[32348]: cluster 2021-03-10T15:56:04.604527+0000 mgr.gibba043.dnkmem (mgr.34373) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:07 gibba043 bash[24019]: cluster 2021-03-10T15:56:06.606322+0000 mgr.gibba043.dnkmem (mgr.34373) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:07 gibba003 bash[31385]: cluster 2021-03-10T15:56:06.606322+0000 mgr.gibba043.dnkmem (mgr.34373) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:07 gibba003 bash[32348]: cluster 2021-03-10T15:56:06.606322+0000 mgr.gibba043.dnkmem (mgr.34373) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:09 gibba043 bash[24019]: cluster 2021-03-10T15:56:08.608070+0000 mgr.gibba043.dnkmem (mgr.34373) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:10.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:09 gibba003 bash[31385]: cluster 2021-03-10T15:56:08.608070+0000 mgr.gibba043.dnkmem (mgr.34373) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:09 gibba003 bash[32348]: cluster 2021-03-10T15:56:08.608070+0000 mgr.gibba043.dnkmem (mgr.34373) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:11 gibba003 bash[31385]: cluster 2021-03-10T15:56:10.609330+0000 mgr.gibba043.dnkmem (mgr.34373) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:11 gibba003 bash[32348]: cluster 2021-03-10T15:56:10.609330+0000 mgr.gibba043.dnkmem (mgr.34373) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:11 gibba043 bash[24019]: cluster 2021-03-10T15:56:10.609330+0000 mgr.gibba043.dnkmem (mgr.34373) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[31385]: cephadm 2021-03-10T15:56:12.484519+0000 mgr.gibba043.dnkmem (mgr.34373) 6617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[31385]: cluster 2021-03-10T15:56:12.610842+0000 mgr.gibba043.dnkmem (mgr.34373) 6618 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[31385]: audit 2021-03-10T15:56:13.521542+0000 mon.c (mon.1) 1716 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[31385]: audit 2021-03-10T15:56:13.522644+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[32348]: cephadm 2021-03-10T15:56:12.484519+0000 mgr.gibba043.dnkmem (mgr.34373) 6617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[32348]: cluster 2021-03-10T15:56:12.610842+0000 mgr.gibba043.dnkmem (mgr.34373) 6618 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[32348]: audit 2021-03-10T15:56:13.521542+0000 mon.c (mon.1) 1716 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:13 gibba003 bash[32348]: audit 2021-03-10T15:56:13.522644+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:13 gibba043 bash[24019]: cephadm 2021-03-10T15:56:12.484519+0000 mgr.gibba043.dnkmem (mgr.34373) 6617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:13 gibba043 bash[24019]: cluster 2021-03-10T15:56:12.610842+0000 mgr.gibba043.dnkmem (mgr.34373) 6618 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:13 gibba043 bash[24019]: audit 2021-03-10T15:56:13.521542+0000 mon.c (mon.1) 1716 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:13 gibba043 bash[24019]: audit 2021-03-10T15:56:13.522644+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.681371+0000 mon.c (mon.1) 1717 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.681655+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.819161+0000 mon.c (mon.1) 1718 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.820314+0000 mon.c (mon.1) 1719 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.820557+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.821392+0000 mon.c (mon.1) 1720 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:56:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.821645+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.822868+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:56:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.822935+0000 mon.c (mon.1) 1721 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[31385]: audit 2021-03-10T15:56:13.824221+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.681371+0000 mon.c (mon.1) 1717 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.681655+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.819161+0000 mon.c (mon.1) 1718 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:56:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.820314+0000 mon.c (mon.1) 1719 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.820557+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:56:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.821392+0000 mon.c (mon.1) 1720 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:56:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.821645+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.822868+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:56:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.822935+0000 mon.c (mon.1) 1721 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:14 gibba003 bash[32348]: audit 2021-03-10T15:56:13.824221+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.681371+0000 mon.c (mon.1) 1717 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.681655+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.819161+0000 mon.c (mon.1) 1718 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:56:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.820314+0000 mon.c (mon.1) 1719 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:56:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.820557+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:56:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.821392+0000 mon.c (mon.1) 1720 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:56:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.821645+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:56:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.822868+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:56:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.822935+0000 mon.c (mon.1) 1721 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:14 gibba043 bash[24019]: audit 2021-03-10T15:56:13.824221+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:15 gibba043 bash[24019]: cluster 2021-03-10T15:56:14.612377+0000 mgr.gibba043.dnkmem (mgr.34373) 6619 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:15 gibba003 bash[31385]: cluster 2021-03-10T15:56:14.612377+0000 mgr.gibba043.dnkmem (mgr.34373) 6619 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:15 gibba003 bash[32348]: cluster 2021-03-10T15:56:14.612377+0000 mgr.gibba043.dnkmem (mgr.34373) 6619 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:17 gibba043 bash[24019]: cluster 2021-03-10T15:56:16.614186+0000 mgr.gibba043.dnkmem (mgr.34373) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:17 gibba003 bash[31385]: cluster 2021-03-10T15:56:16.614186+0000 mgr.gibba043.dnkmem (mgr.34373) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:17 gibba003 bash[32348]: cluster 2021-03-10T15:56:16.614186+0000 mgr.gibba043.dnkmem (mgr.34373) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:19 gibba043 bash[24019]: cluster 2021-03-10T15:56:18.615727+0000 mgr.gibba043.dnkmem (mgr.34373) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:19 gibba003 bash[31385]: cluster 2021-03-10T15:56:18.615727+0000 mgr.gibba043.dnkmem (mgr.34373) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:19 gibba003 bash[32348]: cluster 2021-03-10T15:56:18.615727+0000 mgr.gibba043.dnkmem (mgr.34373) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:21 gibba003 bash[31385]: cluster 2021-03-10T15:56:20.617234+0000 mgr.gibba043.dnkmem (mgr.34373) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:21 gibba003 bash[32348]: cluster 2021-03-10T15:56:20.617234+0000 mgr.gibba043.dnkmem (mgr.34373) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:21 gibba043 bash[24019]: cluster 2021-03-10T15:56:20.617234+0000 mgr.gibba043.dnkmem (mgr.34373) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:23 gibba003 bash[31385]: cluster 2021-03-10T15:56:22.618910+0000 mgr.gibba043.dnkmem (mgr.34373) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:23 gibba003 bash[32348]: cluster 2021-03-10T15:56:22.618910+0000 mgr.gibba043.dnkmem (mgr.34373) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:23 gibba043 bash[24019]: cluster 2021-03-10T15:56:22.618910+0000 mgr.gibba043.dnkmem (mgr.34373) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:25 gibba043 bash[24019]: cluster 2021-03-10T15:56:24.620409+0000 mgr.gibba043.dnkmem (mgr.34373) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:25 gibba003 bash[31385]: cluster 2021-03-10T15:56:24.620409+0000 mgr.gibba043.dnkmem (mgr.34373) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:25 gibba003 bash[32348]: cluster 2021-03-10T15:56:24.620409+0000 mgr.gibba043.dnkmem (mgr.34373) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:27 gibba043 bash[24019]: cluster 2021-03-10T15:56:26.622140+0000 mgr.gibba043.dnkmem (mgr.34373) 6625 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:27 gibba003 bash[31385]: cluster 2021-03-10T15:56:26.622140+0000 mgr.gibba043.dnkmem (mgr.34373) 6625 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:27 gibba003 bash[32348]: cluster 2021-03-10T15:56:26.622140+0000 mgr.gibba043.dnkmem (mgr.34373) 6625 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:28 gibba043 bash[24019]: cephadm 2021-03-10T15:56:27.500588+0000 mgr.gibba043.dnkmem (mgr.34373) 6626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:29.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:28 gibba003 bash[31385]: cephadm 2021-03-10T15:56:27.500588+0000 mgr.gibba043.dnkmem (mgr.34373) 6626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:28 gibba003 bash[32348]: cephadm 2021-03-10T15:56:27.500588+0000 mgr.gibba043.dnkmem (mgr.34373) 6626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:29.950 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:56:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:29 gibba043 bash[24019]: cluster 2021-03-10T15:56:28.623659+0000 mgr.gibba043.dnkmem (mgr.34373) 6627 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:30.181 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:56:30.181 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:56:30.182 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:56:30.182 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:56:30.182 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:56:30.182 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:56:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:56:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:56:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:56:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:56:30.183 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:56:30.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:56:30.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:56:30.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:56:30.184 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:56:30.185 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:56:30.185 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:56:30.185 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:56:30.185 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:56:30.186 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:56:30.186 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:56:30.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:29 gibba003 bash[31385]: cluster 2021-03-10T15:56:28.623659+0000 mgr.gibba043.dnkmem (mgr.34373) 6627 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:30.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:29 gibba003 bash[32348]: cluster 2021-03-10T15:56:28.623659+0000 mgr.gibba043.dnkmem (mgr.34373) 6627 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:30.429 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:56:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:56:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:56:30.430 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:56:30.431 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:30.431 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:56:30.431 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:56:30.432 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:56:30.432 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:56:30.432 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:56:30.432 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:56:30.432 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:56:30.433 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:56:30.433 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:56:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:30 gibba043 bash[24019]: audit 2021-03-10T15:56:29.941068+0000 mgr.gibba043.dnkmem (mgr.34373) 6628 : audit [DBG] from='client.58486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:31.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:30 gibba043 bash[24019]: audit 2021-03-10T15:56:30.431361+0000 mon.c (mon.1) 1722 : audit [DBG] from='client.? 172.21.2.103:0/3632601040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:31.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:30 gibba003 bash[31385]: audit 2021-03-10T15:56:29.941068+0000 mgr.gibba043.dnkmem (mgr.34373) 6628 : audit [DBG] from='client.58486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:30 gibba003 bash[31385]: audit 2021-03-10T15:56:30.431361+0000 mon.c (mon.1) 1722 : audit [DBG] from='client.? 172.21.2.103:0/3632601040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:31.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:30 gibba003 bash[32348]: audit 2021-03-10T15:56:29.941068+0000 mgr.gibba043.dnkmem (mgr.34373) 6628 : audit [DBG] from='client.58486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:31.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:30 gibba003 bash[32348]: audit 2021-03-10T15:56:30.431361+0000 mon.c (mon.1) 1722 : audit [DBG] from='client.? 172.21.2.103:0/3632601040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:31 gibba043 bash[24019]: audit 2021-03-10T15:56:30.169276+0000 mgr.gibba043.dnkmem (mgr.34373) 6629 : audit [DBG] from='client.58492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:31 gibba043 bash[24019]: cluster 2021-03-10T15:56:30.625182+0000 mgr.gibba043.dnkmem (mgr.34373) 6630 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:31 gibba003 bash[31385]: audit 2021-03-10T15:56:30.169276+0000 mgr.gibba043.dnkmem (mgr.34373) 6629 : audit [DBG] from='client.58492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:31 gibba003 bash[31385]: cluster 2021-03-10T15:56:30.625182+0000 mgr.gibba043.dnkmem (mgr.34373) 6630 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:31 gibba003 bash[32348]: audit 2021-03-10T15:56:30.169276+0000 mgr.gibba043.dnkmem (mgr.34373) 6629 : audit [DBG] from='client.58492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:31 gibba003 bash[32348]: cluster 2021-03-10T15:56:30.625182+0000 mgr.gibba043.dnkmem (mgr.34373) 6630 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:33 gibba043 bash[24019]: cluster 2021-03-10T15:56:32.626520+0000 mgr.gibba043.dnkmem (mgr.34373) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:33 gibba003 bash[31385]: cluster 2021-03-10T15:56:32.626520+0000 mgr.gibba043.dnkmem (mgr.34373) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:33 gibba003 bash[32348]: cluster 2021-03-10T15:56:32.626520+0000 mgr.gibba043.dnkmem (mgr.34373) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:35 gibba043 bash[24019]: cluster 2021-03-10T15:56:34.627514+0000 mgr.gibba043.dnkmem (mgr.34373) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:35 gibba003 bash[31385]: cluster 2021-03-10T15:56:34.627514+0000 mgr.gibba043.dnkmem (mgr.34373) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:36.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:35 gibba003 bash[32348]: cluster 2021-03-10T15:56:34.627514+0000 mgr.gibba043.dnkmem (mgr.34373) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:37 gibba043 bash[24019]: cluster 2021-03-10T15:56:36.629115+0000 mgr.gibba043.dnkmem (mgr.34373) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:38.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:37 gibba003 bash[31385]: cluster 2021-03-10T15:56:36.629115+0000 mgr.gibba043.dnkmem (mgr.34373) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:37 gibba003 bash[32348]: cluster 2021-03-10T15:56:36.629115+0000 mgr.gibba043.dnkmem (mgr.34373) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:39 gibba043 bash[24019]: cluster 2021-03-10T15:56:38.630630+0000 mgr.gibba043.dnkmem (mgr.34373) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:40.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:39 gibba003 bash[31385]: cluster 2021-03-10T15:56:38.630630+0000 mgr.gibba043.dnkmem (mgr.34373) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:39 gibba003 bash[32348]: cluster 2021-03-10T15:56:38.630630+0000 mgr.gibba043.dnkmem (mgr.34373) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:41 gibba003 bash[31385]: cluster 2021-03-10T15:56:40.632089+0000 mgr.gibba043.dnkmem (mgr.34373) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:41 gibba003 bash[32348]: cluster 2021-03-10T15:56:40.632089+0000 mgr.gibba043.dnkmem (mgr.34373) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:41 gibba043 bash[24019]: cluster 2021-03-10T15:56:40.632089+0000 mgr.gibba043.dnkmem (mgr.34373) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:43 gibba043 bash[24019]: cephadm 2021-03-10T15:56:42.516647+0000 mgr.gibba043.dnkmem (mgr.34373) 6636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:43 gibba043 bash[24019]: cluster 2021-03-10T15:56:42.633397+0000 mgr.gibba043.dnkmem (mgr.34373) 6637 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:43 gibba003 bash[31385]: cephadm 2021-03-10T15:56:42.516647+0000 mgr.gibba043.dnkmem (mgr.34373) 6636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:43 gibba003 bash[31385]: cluster 2021-03-10T15:56:42.633397+0000 mgr.gibba043.dnkmem (mgr.34373) 6637 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:43 gibba003 bash[32348]: cephadm 2021-03-10T15:56:42.516647+0000 mgr.gibba043.dnkmem (mgr.34373) 6636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:43 gibba003 bash[32348]: cluster 2021-03-10T15:56:42.633397+0000 mgr.gibba043.dnkmem (mgr.34373) 6637 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:46.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:45 gibba043 bash[24019]: cluster 2021-03-10T15:56:44.634692+0000 mgr.gibba043.dnkmem (mgr.34373) 6638 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:45 gibba003 bash[31385]: cluster 2021-03-10T15:56:44.634692+0000 mgr.gibba043.dnkmem (mgr.34373) 6638 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:45 gibba003 bash[32348]: cluster 2021-03-10T15:56:44.634692+0000 mgr.gibba043.dnkmem (mgr.34373) 6638 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:47 gibba043 bash[24019]: cluster 2021-03-10T15:56:46.636369+0000 mgr.gibba043.dnkmem (mgr.34373) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:47 gibba003 bash[31385]: cluster 2021-03-10T15:56:46.636369+0000 mgr.gibba043.dnkmem (mgr.34373) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:47 gibba003 bash[32348]: cluster 2021-03-10T15:56:46.636369+0000 mgr.gibba043.dnkmem (mgr.34373) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:49 gibba043 bash[24019]: cluster 2021-03-10T15:56:48.636855+0000 mgr.gibba043.dnkmem (mgr.34373) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:49 gibba003 bash[31385]: cluster 2021-03-10T15:56:48.636855+0000 mgr.gibba043.dnkmem (mgr.34373) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:50.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:49 gibba003 bash[32348]: cluster 2021-03-10T15:56:48.636855+0000 mgr.gibba043.dnkmem (mgr.34373) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:51 gibba003 bash[31385]: cluster 2021-03-10T15:56:50.638334+0000 mgr.gibba043.dnkmem (mgr.34373) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:51 gibba003 bash[32348]: cluster 2021-03-10T15:56:50.638334+0000 mgr.gibba043.dnkmem (mgr.34373) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:51 gibba043 bash[24019]: cluster 2021-03-10T15:56:50.638334+0000 mgr.gibba043.dnkmem (mgr.34373) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:53 gibba043 bash[24019]: cluster 2021-03-10T15:56:52.640052+0000 mgr.gibba043.dnkmem (mgr.34373) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:53 gibba003 bash[31385]: cluster 2021-03-10T15:56:52.640052+0000 mgr.gibba043.dnkmem (mgr.34373) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:53 gibba003 bash[32348]: cluster 2021-03-10T15:56:52.640052+0000 mgr.gibba043.dnkmem (mgr.34373) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:55 gibba043 bash[24019]: cluster 2021-03-10T15:56:54.640615+0000 mgr.gibba043.dnkmem (mgr.34373) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:55 gibba003 bash[31385]: cluster 2021-03-10T15:56:54.640615+0000 mgr.gibba043.dnkmem (mgr.34373) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:55 gibba003 bash[32348]: cluster 2021-03-10T15:56:54.640615+0000 mgr.gibba043.dnkmem (mgr.34373) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:57 gibba043 bash[24019]: cluster 2021-03-10T15:56:56.642264+0000 mgr.gibba043.dnkmem (mgr.34373) 6644 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:57 gibba003 bash[31385]: cluster 2021-03-10T15:56:56.642264+0000 mgr.gibba043.dnkmem (mgr.34373) 6644 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:57 gibba003 bash[32348]: cluster 2021-03-10T15:56:56.642264+0000 mgr.gibba043.dnkmem (mgr.34373) 6644 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.533439+0000 mgr.gibba043.dnkmem (mgr.34373) 6645 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:56:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.534986+0000 mgr.gibba043.dnkmem (mgr.34373) 6646 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:56:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.761750+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:56:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.762745+0000 mgr.gibba043.dnkmem (mgr.34373) 6647 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.764762+0000 mgr.gibba043.dnkmem (mgr.34373) 6648 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.765280+0000 mon.c (mon.1) 1723 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.766134+0000 mgr.gibba043.dnkmem (mgr.34373) 6649 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.766172+0000 mgr.gibba043.dnkmem (mgr.34373) 6650 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.767171+0000 mon.c (mon.1) 1724 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.767363+0000 mgr.gibba043.dnkmem (mgr.34373) 6651 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.767401+0000 mgr.gibba043.dnkmem (mgr.34373) 6652 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.768444+0000 mon.c (mon.1) 1725 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.768578+0000 mgr.gibba043.dnkmem (mgr.34373) 6653 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.769686+0000 mon.c (mon.1) 1726 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.770642+0000 mgr.gibba043.dnkmem (mgr.34373) 6654 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.770720+0000 mgr.gibba043.dnkmem (mgr.34373) 6655 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.772272+0000 mgr.gibba043.dnkmem (mgr.34373) 6656 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.772660+0000 mgr.gibba043.dnkmem (mgr.34373) 6657 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.773217+0000 mon.c (mon.1) 1727 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.773954+0000 mgr.gibba043.dnkmem (mgr.34373) 6658 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.773994+0000 mgr.gibba043.dnkmem (mgr.34373) 6659 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: cephadm 2021-03-10T15:56:57.774138+0000 mgr.gibba043.dnkmem (mgr.34373) 6660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[31385]: audit 2021-03-10T15:56:57.774911+0000 mon.c (mon.1) 1728 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.533439+0000 mgr.gibba043.dnkmem (mgr.34373) 6645 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:56:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.534986+0000 mgr.gibba043.dnkmem (mgr.34373) 6646 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:56:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.761750+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:56:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.762745+0000 mgr.gibba043.dnkmem (mgr.34373) 6647 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.764762+0000 mgr.gibba043.dnkmem (mgr.34373) 6648 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.765280+0000 mon.c (mon.1) 1723 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.766134+0000 mgr.gibba043.dnkmem (mgr.34373) 6649 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.766172+0000 mgr.gibba043.dnkmem (mgr.34373) 6650 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.767171+0000 mon.c (mon.1) 1724 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.767363+0000 mgr.gibba043.dnkmem (mgr.34373) 6651 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.767401+0000 mgr.gibba043.dnkmem (mgr.34373) 6652 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.768444+0000 mon.c (mon.1) 1725 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.768578+0000 mgr.gibba043.dnkmem (mgr.34373) 6653 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.769686+0000 mon.c (mon.1) 1726 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.770642+0000 mgr.gibba043.dnkmem (mgr.34373) 6654 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.770720+0000 mgr.gibba043.dnkmem (mgr.34373) 6655 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.772272+0000 mgr.gibba043.dnkmem (mgr.34373) 6656 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.772660+0000 mgr.gibba043.dnkmem (mgr.34373) 6657 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.773217+0000 mon.c (mon.1) 1727 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.773954+0000 mgr.gibba043.dnkmem (mgr.34373) 6658 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.773994+0000 mgr.gibba043.dnkmem (mgr.34373) 6659 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: cephadm 2021-03-10T15:56:57.774138+0000 mgr.gibba043.dnkmem (mgr.34373) 6660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:58 gibba003 bash[32348]: audit 2021-03-10T15:56:57.774911+0000 mon.c (mon.1) 1728 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.533439+0000 mgr.gibba043.dnkmem (mgr.34373) 6645 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:56:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.534986+0000 mgr.gibba043.dnkmem (mgr.34373) 6646 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:56:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.761750+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:56:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.762745+0000 mgr.gibba043.dnkmem (mgr.34373) 6647 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.764762+0000 mgr.gibba043.dnkmem (mgr.34373) 6648 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.765280+0000 mon.c (mon.1) 1723 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.766134+0000 mgr.gibba043.dnkmem (mgr.34373) 6649 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.766172+0000 mgr.gibba043.dnkmem (mgr.34373) 6650 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.767171+0000 mon.c (mon.1) 1724 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.767363+0000 mgr.gibba043.dnkmem (mgr.34373) 6651 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.767401+0000 mgr.gibba043.dnkmem (mgr.34373) 6652 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.768444+0000 mon.c (mon.1) 1725 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.768578+0000 mgr.gibba043.dnkmem (mgr.34373) 6653 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.769686+0000 mon.c (mon.1) 1726 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.770642+0000 mgr.gibba043.dnkmem (mgr.34373) 6654 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.770720+0000 mgr.gibba043.dnkmem (mgr.34373) 6655 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.772272+0000 mgr.gibba043.dnkmem (mgr.34373) 6656 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.772660+0000 mgr.gibba043.dnkmem (mgr.34373) 6657 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.773217+0000 mon.c (mon.1) 1727 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.773954+0000 mgr.gibba043.dnkmem (mgr.34373) 6658 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.773994+0000 mgr.gibba043.dnkmem (mgr.34373) 6659 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: cephadm 2021-03-10T15:56:57.774138+0000 mgr.gibba043.dnkmem (mgr.34373) 6660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:56:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:58 gibba043 bash[24019]: audit 2021-03-10T15:56:57.774911+0000 mon.c (mon.1) 1728 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:56:59 gibba003 bash[31385]: cluster 2021-03-10T15:56:58.643643+0000 mgr.gibba043.dnkmem (mgr.34373) 6661 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:56:59 gibba003 bash[32348]: cluster 2021-03-10T15:56:58.643643+0000 mgr.gibba043.dnkmem (mgr.34373) 6661 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:56:59 gibba043 bash[24019]: cluster 2021-03-10T15:56:58.643643+0000 mgr.gibba043.dnkmem (mgr.34373) 6661 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:00.673 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:57:00.904 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:57:00.904 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:57:00.904 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:57:00.905 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:57:00.905 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:57:00.905 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:57:00.905 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:57:00.906 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:57:00.906 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:57:00.906 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:57:00.906 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:57:00.907 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:57:00.907 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:57:00.907 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:57:00.907 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:57:00.908 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:57:00.908 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:57:00.908 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:57:00.908 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:57:00.908 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:57:00.909 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:57:01.156 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:57:01.156 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:57:01.157 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:01.157 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:57:01.157 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:57:01.157 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:01.158 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:57:01.158 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:57:01.158 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:57:01.159 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:57:01.159 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:57:01.159 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:57:01.159 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:57:01.160 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:57:01.160 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:57:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[31385]: cluster 2021-03-10T15:57:00.644216+0000 mgr.gibba043.dnkmem (mgr.34373) 6662 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[31385]: audit 2021-03-10T15:57:00.665157+0000 mgr.gibba043.dnkmem (mgr.34373) 6663 : audit [DBG] from='client.58504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[31385]: audit 2021-03-10T15:57:00.891581+0000 mgr.gibba043.dnkmem (mgr.34373) 6664 : audit [DBG] from='client.58510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:01.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[31385]: audit 2021-03-10T15:57:01.157580+0000 mon.a (mon.0) 1512 : audit [DBG] from='client.? 172.21.2.103:0/2151837811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[32348]: cluster 2021-03-10T15:57:00.644216+0000 mgr.gibba043.dnkmem (mgr.34373) 6662 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[32348]: audit 2021-03-10T15:57:00.665157+0000 mgr.gibba043.dnkmem (mgr.34373) 6663 : audit [DBG] from='client.58504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[32348]: audit 2021-03-10T15:57:00.891581+0000 mgr.gibba043.dnkmem (mgr.34373) 6664 : audit [DBG] from='client.58510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:01.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:01 gibba003 bash[32348]: audit 2021-03-10T15:57:01.157580+0000 mon.a (mon.0) 1512 : audit [DBG] from='client.? 172.21.2.103:0/2151837811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:01 gibba043 bash[24019]: cluster 2021-03-10T15:57:00.644216+0000 mgr.gibba043.dnkmem (mgr.34373) 6662 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:01 gibba043 bash[24019]: audit 2021-03-10T15:57:00.665157+0000 mgr.gibba043.dnkmem (mgr.34373) 6663 : audit [DBG] from='client.58504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:01 gibba043 bash[24019]: audit 2021-03-10T15:57:00.891581+0000 mgr.gibba043.dnkmem (mgr.34373) 6664 : audit [DBG] from='client.58510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:01 gibba043 bash[24019]: audit 2021-03-10T15:57:01.157580+0000 mon.a (mon.0) 1512 : audit [DBG] from='client.? 172.21.2.103:0/2151837811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:03 gibba043 bash[24019]: cluster 2021-03-10T15:57:02.645795+0000 mgr.gibba043.dnkmem (mgr.34373) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:03 gibba003 bash[31385]: cluster 2021-03-10T15:57:02.645795+0000 mgr.gibba043.dnkmem (mgr.34373) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:03 gibba003 bash[32348]: cluster 2021-03-10T15:57:02.645795+0000 mgr.gibba043.dnkmem (mgr.34373) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:05 gibba043 bash[24019]: cluster 2021-03-10T15:57:04.647161+0000 mgr.gibba043.dnkmem (mgr.34373) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:06.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:05 gibba003 bash[31385]: cluster 2021-03-10T15:57:04.647161+0000 mgr.gibba043.dnkmem (mgr.34373) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:05 gibba003 bash[32348]: cluster 2021-03-10T15:57:04.647161+0000 mgr.gibba043.dnkmem (mgr.34373) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:07 gibba043 bash[24019]: cluster 2021-03-10T15:57:06.647956+0000 mgr.gibba043.dnkmem (mgr.34373) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:07 gibba003 bash[31385]: cluster 2021-03-10T15:57:06.647956+0000 mgr.gibba043.dnkmem (mgr.34373) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:07 gibba003 bash[32348]: cluster 2021-03-10T15:57:06.647956+0000 mgr.gibba043.dnkmem (mgr.34373) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:09 gibba043 bash[24019]: cluster 2021-03-10T15:57:08.649430+0000 mgr.gibba043.dnkmem (mgr.34373) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:10.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:09 gibba003 bash[31385]: cluster 2021-03-10T15:57:08.649430+0000 mgr.gibba043.dnkmem (mgr.34373) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:09 gibba003 bash[32348]: cluster 2021-03-10T15:57:08.649430+0000 mgr.gibba043.dnkmem (mgr.34373) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:11 gibba003 bash[31385]: cluster 2021-03-10T15:57:10.650698+0000 mgr.gibba043.dnkmem (mgr.34373) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:11 gibba003 bash[32348]: cluster 2021-03-10T15:57:10.650698+0000 mgr.gibba043.dnkmem (mgr.34373) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:11 gibba043 bash[24019]: cluster 2021-03-10T15:57:10.650698+0000 mgr.gibba043.dnkmem (mgr.34373) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:13 gibba043 bash[24019]: cluster 2021-03-10T15:57:12.651449+0000 mgr.gibba043.dnkmem (mgr.34373) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:13 gibba043 bash[24019]: cephadm 2021-03-10T15:57:12.790059+0000 mgr.gibba043.dnkmem (mgr.34373) 6671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:13 gibba043 bash[24019]: audit 2021-03-10T15:57:13.528555+0000 mon.c (mon.1) 1729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:13 gibba043 bash[24019]: audit 2021-03-10T15:57:13.529646+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:13 gibba043 bash[24019]: audit 2021-03-10T15:57:13.684821+0000 mon.c (mon.1) 1730 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:13 gibba043 bash[24019]: audit 2021-03-10T15:57:13.685905+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[31385]: cluster 2021-03-10T15:57:12.651449+0000 mgr.gibba043.dnkmem (mgr.34373) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[31385]: cephadm 2021-03-10T15:57:12.790059+0000 mgr.gibba043.dnkmem (mgr.34373) 6671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[31385]: audit 2021-03-10T15:57:13.528555+0000 mon.c (mon.1) 1729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[31385]: audit 2021-03-10T15:57:13.529646+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[31385]: audit 2021-03-10T15:57:13.684821+0000 mon.c (mon.1) 1730 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[31385]: audit 2021-03-10T15:57:13.685905+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[32348]: cluster 2021-03-10T15:57:12.651449+0000 mgr.gibba043.dnkmem (mgr.34373) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[32348]: cephadm 2021-03-10T15:57:12.790059+0000 mgr.gibba043.dnkmem (mgr.34373) 6671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[32348]: audit 2021-03-10T15:57:13.528555+0000 mon.c (mon.1) 1729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[32348]: audit 2021-03-10T15:57:13.529646+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[32348]: audit 2021-03-10T15:57:13.684821+0000 mon.c (mon.1) 1730 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:13 gibba003 bash[32348]: audit 2021-03-10T15:57:13.685905+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.831497+0000 mon.c (mon.1) 1731 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:57:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.832283+0000 mon.c (mon.1) 1732 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.832862+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:57:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.832965+0000 mon.c (mon.1) 1733 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.833627+0000 mon.c (mon.1) 1734 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:57:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.835100+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.835944+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:14 gibba043 bash[24019]: audit 2021-03-10T15:57:13.836768+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:57:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.831497+0000 mon.c (mon.1) 1731 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:57:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.832283+0000 mon.c (mon.1) 1732 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.832862+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:57:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.832965+0000 mon.c (mon.1) 1733 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.833627+0000 mon.c (mon.1) 1734 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:57:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.835100+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.835944+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[31385]: audit 2021-03-10T15:57:13.836768+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:57:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.831497+0000 mon.c (mon.1) 1731 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:57:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.832283+0000 mon.c (mon.1) 1732 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.832862+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:57:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.832965+0000 mon.c (mon.1) 1733 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.833627+0000 mon.c (mon.1) 1734 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:57:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.835100+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.835944+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:57:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:14 gibba003 bash[32348]: audit 2021-03-10T15:57:13.836768+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T15:57:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:15 gibba043 bash[24019]: cluster 2021-03-10T15:57:14.652767+0000 mgr.gibba043.dnkmem (mgr.34373) 6672 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:15 gibba003 bash[31385]: cluster 2021-03-10T15:57:14.652767+0000 mgr.gibba043.dnkmem (mgr.34373) 6672 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:15 gibba003 bash[32348]: cluster 2021-03-10T15:57:14.652767+0000 mgr.gibba043.dnkmem (mgr.34373) 6672 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:17 gibba043 bash[24019]: cluster 2021-03-10T15:57:16.654540+0000 mgr.gibba043.dnkmem (mgr.34373) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:17 gibba003 bash[31385]: cluster 2021-03-10T15:57:16.654540+0000 mgr.gibba043.dnkmem (mgr.34373) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:17 gibba003 bash[32348]: cluster 2021-03-10T15:57:16.654540+0000 mgr.gibba043.dnkmem (mgr.34373) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:19 gibba043 bash[24019]: cluster 2021-03-10T15:57:18.655273+0000 mgr.gibba043.dnkmem (mgr.34373) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:19 gibba003 bash[31385]: cluster 2021-03-10T15:57:18.655273+0000 mgr.gibba043.dnkmem (mgr.34373) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:19 gibba003 bash[32348]: cluster 2021-03-10T15:57:18.655273+0000 mgr.gibba043.dnkmem (mgr.34373) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:21 gibba003 bash[31385]: cluster 2021-03-10T15:57:20.656431+0000 mgr.gibba043.dnkmem (mgr.34373) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:21 gibba003 bash[32348]: cluster 2021-03-10T15:57:20.656431+0000 mgr.gibba043.dnkmem (mgr.34373) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:21 gibba043 bash[24019]: cluster 2021-03-10T15:57:20.656431+0000 mgr.gibba043.dnkmem (mgr.34373) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:23 gibba043 bash[24019]: cluster 2021-03-10T15:57:22.657947+0000 mgr.gibba043.dnkmem (mgr.34373) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:23 gibba003 bash[31385]: cluster 2021-03-10T15:57:22.657947+0000 mgr.gibba043.dnkmem (mgr.34373) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:23 gibba003 bash[32348]: cluster 2021-03-10T15:57:22.657947+0000 mgr.gibba043.dnkmem (mgr.34373) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:25 gibba043 bash[24019]: cluster 2021-03-10T15:57:24.659342+0000 mgr.gibba043.dnkmem (mgr.34373) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:25 gibba003 bash[31385]: cluster 2021-03-10T15:57:24.659342+0000 mgr.gibba043.dnkmem (mgr.34373) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:25 gibba003 bash[32348]: cluster 2021-03-10T15:57:24.659342+0000 mgr.gibba043.dnkmem (mgr.34373) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:27 gibba043 bash[24019]: cluster 2021-03-10T15:57:26.661143+0000 mgr.gibba043.dnkmem (mgr.34373) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:27 gibba003 bash[31385]: cluster 2021-03-10T15:57:26.661143+0000 mgr.gibba043.dnkmem (mgr.34373) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:27 gibba003 bash[32348]: cluster 2021-03-10T15:57:26.661143+0000 mgr.gibba043.dnkmem (mgr.34373) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:28 gibba043 bash[24019]: cephadm 2021-03-10T15:57:27.805628+0000 mgr.gibba043.dnkmem (mgr.34373) 6679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:29.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:28 gibba003 bash[31385]: cephadm 2021-03-10T15:57:27.805628+0000 mgr.gibba043.dnkmem (mgr.34373) 6679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:28 gibba003 bash[32348]: cephadm 2021-03-10T15:57:27.805628+0000 mgr.gibba043.dnkmem (mgr.34373) 6679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:29 gibba043 bash[24019]: cluster 2021-03-10T15:57:28.662661+0000 mgr.gibba043.dnkmem (mgr.34373) 6680 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:30.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:29 gibba003 bash[31385]: cluster 2021-03-10T15:57:28.662661+0000 mgr.gibba043.dnkmem (mgr.34373) 6680 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:29 gibba003 bash[32348]: cluster 2021-03-10T15:57:28.662661+0000 mgr.gibba043.dnkmem (mgr.34373) 6680 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.403 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:57:31.642 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:57:31.642 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:57:31.642 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:57:31.642 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:57:31.643 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:57:31.643 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:57:31.643 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:57:31.644 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:57:31.644 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:57:31.645 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:57:31.645 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:57:31.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:57:31.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:57:31.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:57:31.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:57:31.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:57:31.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:57:31.647 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:57:31.647 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:57:31.647 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:57:31.648 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:57:31.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:31 gibba003 bash[31385]: cluster 2021-03-10T15:57:30.663516+0000 mgr.gibba043.dnkmem (mgr.34373) 6681 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:31 gibba003 bash[32348]: cluster 2021-03-10T15:57:30.663516+0000 mgr.gibba043.dnkmem (mgr.34373) 6681 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:31 gibba043 bash[24019]: cluster 2021-03-10T15:57:30.663516+0000 mgr.gibba043.dnkmem (mgr.34373) 6681 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.894 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:57:31.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:57:31.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:31.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:57:31.895 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:57:31.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:31.895 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:57:31.895 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:57:31.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:57:31.896 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:57:31.896 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:57:31.896 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:57:31.896 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:57:31.897 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:57:31.897 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:57:32.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:32 gibba003 bash[31385]: audit 2021-03-10T15:57:31.392964+0000 mgr.gibba043.dnkmem (mgr.34373) 6682 : audit [DBG] from='client.58522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:32.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:32 gibba003 bash[31385]: audit 2021-03-10T15:57:31.629297+0000 mgr.gibba043.dnkmem (mgr.34373) 6683 : audit [DBG] from='client.48540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:32.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:32 gibba003 bash[31385]: audit 2021-03-10T15:57:31.895507+0000 mon.a (mon.0) 1519 : audit [DBG] from='client.? 172.21.2.103:0/283672225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:32.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:32 gibba003 bash[32348]: audit 2021-03-10T15:57:31.392964+0000 mgr.gibba043.dnkmem (mgr.34373) 6682 : audit [DBG] from='client.58522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:32.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:32 gibba003 bash[32348]: audit 2021-03-10T15:57:31.629297+0000 mgr.gibba043.dnkmem (mgr.34373) 6683 : audit [DBG] from='client.48540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:32.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:32 gibba003 bash[32348]: audit 2021-03-10T15:57:31.895507+0000 mon.a (mon.0) 1519 : audit [DBG] from='client.? 172.21.2.103:0/283672225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:32 gibba043 bash[24019]: audit 2021-03-10T15:57:31.392964+0000 mgr.gibba043.dnkmem (mgr.34373) 6682 : audit [DBG] from='client.58522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:32.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:32 gibba043 bash[24019]: audit 2021-03-10T15:57:31.629297+0000 mgr.gibba043.dnkmem (mgr.34373) 6683 : audit [DBG] from='client.48540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:32.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:32 gibba043 bash[24019]: audit 2021-03-10T15:57:31.895507+0000 mon.a (mon.0) 1519 : audit [DBG] from='client.? 172.21.2.103:0/283672225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:33 gibba003 bash[31385]: cluster 2021-03-10T15:57:32.664967+0000 mgr.gibba043.dnkmem (mgr.34373) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:33 gibba003 bash[32348]: cluster 2021-03-10T15:57:32.664967+0000 mgr.gibba043.dnkmem (mgr.34373) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:33 gibba043 bash[24019]: cluster 2021-03-10T15:57:32.664967+0000 mgr.gibba043.dnkmem (mgr.34373) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:35 gibba043 bash[24019]: cluster 2021-03-10T15:57:34.665755+0000 mgr.gibba043.dnkmem (mgr.34373) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:35 gibba003 bash[31385]: cluster 2021-03-10T15:57:34.665755+0000 mgr.gibba043.dnkmem (mgr.34373) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:35 gibba003 bash[32348]: cluster 2021-03-10T15:57:34.665755+0000 mgr.gibba043.dnkmem (mgr.34373) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:37 gibba043 bash[24019]: cluster 2021-03-10T15:57:36.666578+0000 mgr.gibba043.dnkmem (mgr.34373) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:38.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:37 gibba003 bash[31385]: cluster 2021-03-10T15:57:36.666578+0000 mgr.gibba043.dnkmem (mgr.34373) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:37 gibba003 bash[32348]: cluster 2021-03-10T15:57:36.666578+0000 mgr.gibba043.dnkmem (mgr.34373) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:39 gibba043 bash[24019]: cluster 2021-03-10T15:57:38.667998+0000 mgr.gibba043.dnkmem (mgr.34373) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:40.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:39 gibba003 bash[31385]: cluster 2021-03-10T15:57:38.667998+0000 mgr.gibba043.dnkmem (mgr.34373) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:39 gibba003 bash[32348]: cluster 2021-03-10T15:57:38.667998+0000 mgr.gibba043.dnkmem (mgr.34373) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:41 gibba003 bash[31385]: cluster 2021-03-10T15:57:40.669550+0000 mgr.gibba043.dnkmem (mgr.34373) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:41 gibba003 bash[32348]: cluster 2021-03-10T15:57:40.669550+0000 mgr.gibba043.dnkmem (mgr.34373) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:41 gibba043 bash[24019]: cluster 2021-03-10T15:57:40.669550+0000 mgr.gibba043.dnkmem (mgr.34373) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:43 gibba043 bash[24019]: cluster 2021-03-10T15:57:42.670547+0000 mgr.gibba043.dnkmem (mgr.34373) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:43 gibba043 bash[24019]: cephadm 2021-03-10T15:57:42.821527+0000 mgr.gibba043.dnkmem (mgr.34373) 6690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:43 gibba003 bash[31385]: cluster 2021-03-10T15:57:42.670547+0000 mgr.gibba043.dnkmem (mgr.34373) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:43 gibba003 bash[31385]: cephadm 2021-03-10T15:57:42.821527+0000 mgr.gibba043.dnkmem (mgr.34373) 6690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:43 gibba003 bash[32348]: cluster 2021-03-10T15:57:42.670547+0000 mgr.gibba043.dnkmem (mgr.34373) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:43 gibba003 bash[32348]: cephadm 2021-03-10T15:57:42.821527+0000 mgr.gibba043.dnkmem (mgr.34373) 6690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:57:46.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:45 gibba043 bash[24019]: cluster 2021-03-10T15:57:44.671868+0000 mgr.gibba043.dnkmem (mgr.34373) 6691 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:45 gibba003 bash[31385]: cluster 2021-03-10T15:57:44.671868+0000 mgr.gibba043.dnkmem (mgr.34373) 6691 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:45 gibba003 bash[32348]: cluster 2021-03-10T15:57:44.671868+0000 mgr.gibba043.dnkmem (mgr.34373) 6691 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:47 gibba043 bash[24019]: cluster 2021-03-10T15:57:46.673622+0000 mgr.gibba043.dnkmem (mgr.34373) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:47 gibba003 bash[31385]: cluster 2021-03-10T15:57:46.673622+0000 mgr.gibba043.dnkmem (mgr.34373) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:47 gibba003 bash[32348]: cluster 2021-03-10T15:57:46.673622+0000 mgr.gibba043.dnkmem (mgr.34373) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:49 gibba043 bash[24019]: cluster 2021-03-10T15:57:48.675121+0000 mgr.gibba043.dnkmem (mgr.34373) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:49 gibba003 bash[31385]: cluster 2021-03-10T15:57:48.675121+0000 mgr.gibba043.dnkmem (mgr.34373) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:49 gibba003 bash[32348]: cluster 2021-03-10T15:57:48.675121+0000 mgr.gibba043.dnkmem (mgr.34373) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:51 gibba003 bash[31385]: cluster 2021-03-10T15:57:50.676557+0000 mgr.gibba043.dnkmem (mgr.34373) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:51 gibba003 bash[32348]: cluster 2021-03-10T15:57:50.676557+0000 mgr.gibba043.dnkmem (mgr.34373) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:51 gibba043 bash[24019]: cluster 2021-03-10T15:57:50.676557+0000 mgr.gibba043.dnkmem (mgr.34373) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:53 gibba043 bash[24019]: cluster 2021-03-10T15:57:52.678250+0000 mgr.gibba043.dnkmem (mgr.34373) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:53 gibba003 bash[31385]: cluster 2021-03-10T15:57:52.678250+0000 mgr.gibba043.dnkmem (mgr.34373) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:53 gibba003 bash[32348]: cluster 2021-03-10T15:57:52.678250+0000 mgr.gibba043.dnkmem (mgr.34373) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:55 gibba043 bash[24019]: cluster 2021-03-10T15:57:54.679046+0000 mgr.gibba043.dnkmem (mgr.34373) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:55 gibba003 bash[31385]: cluster 2021-03-10T15:57:54.679046+0000 mgr.gibba043.dnkmem (mgr.34373) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:55 gibba003 bash[32348]: cluster 2021-03-10T15:57:54.679046+0000 mgr.gibba043.dnkmem (mgr.34373) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:57 gibba043 bash[24019]: cluster 2021-03-10T15:57:56.680742+0000 mgr.gibba043.dnkmem (mgr.34373) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:57 gibba003 bash[31385]: cluster 2021-03-10T15:57:56.680742+0000 mgr.gibba043.dnkmem (mgr.34373) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:57 gibba003 bash[32348]: cluster 2021-03-10T15:57:56.680742+0000 mgr.gibba043.dnkmem (mgr.34373) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:58 gibba043 bash[24019]: cephadm 2021-03-10T15:57:57.839066+0000 mgr.gibba043.dnkmem (mgr.34373) 6698 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:57:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:58 gibba043 bash[24019]: audit 2021-03-10T15:57:57.841546+0000 mon.c (mon.1) 1735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:57:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:58 gibba003 bash[31385]: cephadm 2021-03-10T15:57:57.839066+0000 mgr.gibba043.dnkmem (mgr.34373) 6698 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:57:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:58 gibba003 bash[31385]: audit 2021-03-10T15:57:57.841546+0000 mon.c (mon.1) 1735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:57:59.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:58 gibba003 bash[32348]: cephadm 2021-03-10T15:57:57.839066+0000 mgr.gibba043.dnkmem (mgr.34373) 6698 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:57:59.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:58 gibba003 bash[32348]: audit 2021-03-10T15:57:57.841546+0000 mon.c (mon.1) 1735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:58:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:57:59 gibba003 bash[31385]: cluster 2021-03-10T15:57:58.682396+0000 mgr.gibba043.dnkmem (mgr.34373) 6699 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:57:59 gibba003 bash[32348]: cluster 2021-03-10T15:57:58.682396+0000 mgr.gibba043.dnkmem (mgr.34373) 6699 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:57:59 gibba043 bash[24019]: cluster 2021-03-10T15:57:58.682396+0000 mgr.gibba043.dnkmem (mgr.34373) 6699 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:01 gibba003 bash[31385]: cluster 2021-03-10T15:58:00.683158+0000 mgr.gibba043.dnkmem (mgr.34373) 6700 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:01 gibba003 bash[31385]: audit 2021-03-10T15:58:01.338636+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:58:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:01 gibba003 bash[32348]: cluster 2021-03-10T15:58:00.683158+0000 mgr.gibba043.dnkmem (mgr.34373) 6700 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:01 gibba003 bash[32348]: audit 2021-03-10T15:58:01.338636+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:58:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:01 gibba043 bash[24019]: cluster 2021-03-10T15:58:00.683158+0000 mgr.gibba043.dnkmem (mgr.34373) 6700 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:01 gibba043 bash[24019]: audit 2021-03-10T15:58:01.338636+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:58:02.136 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:58:02.362 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:58:02.362 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 1s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:58:02.362 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:58:02.363 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:58:02.363 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:58:02.363 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:58:02.363 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:58:02.364 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:58:02.364 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:58:02.364 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 1s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:58:02.364 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:58:02.364 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:58:02.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:58:02.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:58:02.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:58:02.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:58:02.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:58:02.366 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:58:02.366 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:58:02.366 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:58:02.366 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 1s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:58:02.611 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:58:02.611 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:58:02.611 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:02.612 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:58:02.612 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:58:02.612 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:02.612 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:58:02.613 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:58:02.613 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:58:02.613 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:58:02.613 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:58:02.613 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:58:02.614 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:58:02.614 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:58:02.614 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:58:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.338097+0000 mgr.gibba043.dnkmem (mgr.34373) 6701 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:58:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.574401+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:58:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.579343+0000 mgr.gibba043.dnkmem (mgr.34373) 6702 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.581329+0000 mgr.gibba043.dnkmem (mgr.34373) 6703 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.581809+0000 mon.c (mon.1) 1736 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.582661+0000 mgr.gibba043.dnkmem (mgr.34373) 6704 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.582697+0000 mgr.gibba043.dnkmem (mgr.34373) 6705 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.583511+0000 mon.c (mon.1) 1737 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.584389+0000 mgr.gibba043.dnkmem (mgr.34373) 6706 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.584427+0000 mgr.gibba043.dnkmem (mgr.34373) 6707 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.585140+0000 mon.c (mon.1) 1738 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.585726+0000 mgr.gibba043.dnkmem (mgr.34373) 6708 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.586612+0000 mon.c (mon.1) 1739 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.587721+0000 mgr.gibba043.dnkmem (mgr.34373) 6709 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:02.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.587761+0000 mgr.gibba043.dnkmem (mgr.34373) 6710 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:02.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.589202+0000 mgr.gibba043.dnkmem (mgr.34373) 6711 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:02.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.589536+0000 mgr.gibba043.dnkmem (mgr.34373) 6712 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:02.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.590083+0000 mon.c (mon.1) 1740 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.590747+0000 mgr.gibba043.dnkmem (mgr.34373) 6713 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:02.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.590790+0000 mgr.gibba043.dnkmem (mgr.34373) 6714 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:02.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: cephadm 2021-03-10T15:58:01.590905+0000 mgr.gibba043.dnkmem (mgr.34373) 6715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:02.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[31385]: audit 2021-03-10T15:58:01.591684+0000 mon.c (mon.1) 1741 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.338097+0000 mgr.gibba043.dnkmem (mgr.34373) 6701 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:58:02.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.574401+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:58:02.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.579343+0000 mgr.gibba043.dnkmem (mgr.34373) 6702 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:02.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.581329+0000 mgr.gibba043.dnkmem (mgr.34373) 6703 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:02.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.581809+0000 mon.c (mon.1) 1736 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:02.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.582661+0000 mgr.gibba043.dnkmem (mgr.34373) 6704 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:02.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.582697+0000 mgr.gibba043.dnkmem (mgr.34373) 6705 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:02.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.583511+0000 mon.c (mon.1) 1737 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.584389+0000 mgr.gibba043.dnkmem (mgr.34373) 6706 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:02.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.584427+0000 mgr.gibba043.dnkmem (mgr.34373) 6707 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:02.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.585140+0000 mon.c (mon.1) 1738 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.585726+0000 mgr.gibba043.dnkmem (mgr.34373) 6708 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:02.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.586612+0000 mon.c (mon.1) 1739 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.587721+0000 mgr.gibba043.dnkmem (mgr.34373) 6709 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:02.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.587761+0000 mgr.gibba043.dnkmem (mgr.34373) 6710 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:02.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.589202+0000 mgr.gibba043.dnkmem (mgr.34373) 6711 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:02.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.589536+0000 mgr.gibba043.dnkmem (mgr.34373) 6712 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:02.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.590083+0000 mon.c (mon.1) 1740 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:02.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.590747+0000 mgr.gibba043.dnkmem (mgr.34373) 6713 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:02.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.590790+0000 mgr.gibba043.dnkmem (mgr.34373) 6714 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:02.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: cephadm 2021-03-10T15:58:01.590905+0000 mgr.gibba043.dnkmem (mgr.34373) 6715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:02.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:02 gibba003 bash[32348]: audit 2021-03-10T15:58:01.591684+0000 mon.c (mon.1) 1741 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.338097+0000 mgr.gibba043.dnkmem (mgr.34373) 6701 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:58:03.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.574401+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:58:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.579343+0000 mgr.gibba043.dnkmem (mgr.34373) 6702 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.581329+0000 mgr.gibba043.dnkmem (mgr.34373) 6703 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.581809+0000 mon.c (mon.1) 1736 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.582661+0000 mgr.gibba043.dnkmem (mgr.34373) 6704 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.582697+0000 mgr.gibba043.dnkmem (mgr.34373) 6705 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.583511+0000 mon.c (mon.1) 1737 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.584389+0000 mgr.gibba043.dnkmem (mgr.34373) 6706 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.584427+0000 mgr.gibba043.dnkmem (mgr.34373) 6707 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.585140+0000 mon.c (mon.1) 1738 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.585726+0000 mgr.gibba043.dnkmem (mgr.34373) 6708 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.586612+0000 mon.c (mon.1) 1739 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.587721+0000 mgr.gibba043.dnkmem (mgr.34373) 6709 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.587761+0000 mgr.gibba043.dnkmem (mgr.34373) 6710 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.589202+0000 mgr.gibba043.dnkmem (mgr.34373) 6711 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.589536+0000 mgr.gibba043.dnkmem (mgr.34373) 6712 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.590083+0000 mon.c (mon.1) 1740 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.590747+0000 mgr.gibba043.dnkmem (mgr.34373) 6713 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:03.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.590790+0000 mgr.gibba043.dnkmem (mgr.34373) 6714 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:03.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: cephadm 2021-03-10T15:58:01.590905+0000 mgr.gibba043.dnkmem (mgr.34373) 6715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:03.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:02 gibba043 bash[24019]: audit 2021-03-10T15:58:01.591684+0000 mon.c (mon.1) 1741 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[31385]: audit 2021-03-10T15:58:02.127397+0000 mgr.gibba043.dnkmem (mgr.34373) 6716 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[31385]: audit 2021-03-10T15:58:02.350216+0000 mgr.gibba043.dnkmem (mgr.34373) 6717 : audit [DBG] from='client.48558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[31385]: audit 2021-03-10T15:58:02.613167+0000 mon.c (mon.1) 1742 : audit [DBG] from='client.? 172.21.2.103:0/2177011256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[31385]: cluster 2021-03-10T15:58:02.684647+0000 mgr.gibba043.dnkmem (mgr.34373) 6718 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[32348]: audit 2021-03-10T15:58:02.127397+0000 mgr.gibba043.dnkmem (mgr.34373) 6716 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[32348]: audit 2021-03-10T15:58:02.350216+0000 mgr.gibba043.dnkmem (mgr.34373) 6717 : audit [DBG] from='client.48558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[32348]: audit 2021-03-10T15:58:02.613167+0000 mon.c (mon.1) 1742 : audit [DBG] from='client.? 172.21.2.103:0/2177011256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:03 gibba003 bash[32348]: cluster 2021-03-10T15:58:02.684647+0000 mgr.gibba043.dnkmem (mgr.34373) 6718 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:03 gibba043 bash[24019]: audit 2021-03-10T15:58:02.127397+0000 mgr.gibba043.dnkmem (mgr.34373) 6716 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:03 gibba043 bash[24019]: audit 2021-03-10T15:58:02.350216+0000 mgr.gibba043.dnkmem (mgr.34373) 6717 : audit [DBG] from='client.48558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:03 gibba043 bash[24019]: audit 2021-03-10T15:58:02.613167+0000 mon.c (mon.1) 1742 : audit [DBG] from='client.? 172.21.2.103:0/2177011256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:03 gibba043 bash[24019]: cluster 2021-03-10T15:58:02.684647+0000 mgr.gibba043.dnkmem (mgr.34373) 6718 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:05 gibba043 bash[24019]: cluster 2021-03-10T15:58:04.686047+0000 mgr.gibba043.dnkmem (mgr.34373) 6719 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:06.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:05 gibba003 bash[31385]: cluster 2021-03-10T15:58:04.686047+0000 mgr.gibba043.dnkmem (mgr.34373) 6719 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:05 gibba003 bash[32348]: cluster 2021-03-10T15:58:04.686047+0000 mgr.gibba043.dnkmem (mgr.34373) 6719 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:07 gibba043 bash[24019]: cluster 2021-03-10T15:58:06.686957+0000 mgr.gibba043.dnkmem (mgr.34373) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:07 gibba003 bash[31385]: cluster 2021-03-10T15:58:06.686957+0000 mgr.gibba043.dnkmem (mgr.34373) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:07 gibba003 bash[32348]: cluster 2021-03-10T15:58:06.686957+0000 mgr.gibba043.dnkmem (mgr.34373) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:09 gibba043 bash[24019]: cluster 2021-03-10T15:58:08.688574+0000 mgr.gibba043.dnkmem (mgr.34373) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:10.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:09 gibba003 bash[31385]: cluster 2021-03-10T15:58:08.688574+0000 mgr.gibba043.dnkmem (mgr.34373) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:09 gibba003 bash[32348]: cluster 2021-03-10T15:58:08.688574+0000 mgr.gibba043.dnkmem (mgr.34373) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:11 gibba003 bash[31385]: cluster 2021-03-10T15:58:10.690250+0000 mgr.gibba043.dnkmem (mgr.34373) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:11 gibba003 bash[32348]: cluster 2021-03-10T15:58:10.690250+0000 mgr.gibba043.dnkmem (mgr.34373) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:11 gibba043 bash[24019]: cluster 2021-03-10T15:58:10.690250+0000 mgr.gibba043.dnkmem (mgr.34373) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:13 gibba043 bash[24019]: cluster 2021-03-10T15:58:12.691749+0000 mgr.gibba043.dnkmem (mgr.34373) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:13 gibba043 bash[24019]: audit 2021-03-10T15:58:13.535507+0000 mon.c (mon.1) 1743 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:13 gibba043 bash[24019]: audit 2021-03-10T15:58:13.536619+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:13 gibba043 bash[24019]: audit 2021-03-10T15:58:13.693336+0000 mon.c (mon.1) 1744 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:13 gibba043 bash[24019]: audit 2021-03-10T15:58:13.694440+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[31385]: cluster 2021-03-10T15:58:12.691749+0000 mgr.gibba043.dnkmem (mgr.34373) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[31385]: audit 2021-03-10T15:58:13.535507+0000 mon.c (mon.1) 1743 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[31385]: audit 2021-03-10T15:58:13.536619+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[31385]: audit 2021-03-10T15:58:13.693336+0000 mon.c (mon.1) 1744 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[31385]: audit 2021-03-10T15:58:13.694440+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[32348]: cluster 2021-03-10T15:58:12.691749+0000 mgr.gibba043.dnkmem (mgr.34373) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[32348]: audit 2021-03-10T15:58:13.535507+0000 mon.c (mon.1) 1743 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[32348]: audit 2021-03-10T15:58:13.536619+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[32348]: audit 2021-03-10T15:58:13.693336+0000 mon.c (mon.1) 1744 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:13 gibba003 bash[32348]: audit 2021-03-10T15:58:13.694440+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.841077+0000 mon.c (mon.1) 1745 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:58:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.841921+0000 mon.c (mon.1) 1746 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.842237+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:58:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.842846+0000 mon.c (mon.1) 1747 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.843518+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.843955+0000 mon.c (mon.1) 1748 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.844497+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:14 gibba043 bash[24019]: audit 2021-03-10T15:58:13.845888+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.841077+0000 mon.c (mon.1) 1745 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:58:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.841921+0000 mon.c (mon.1) 1746 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.842237+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:58:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.842846+0000 mon.c (mon.1) 1747 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.843518+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.843955+0000 mon.c (mon.1) 1748 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.844497+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[31385]: audit 2021-03-10T15:58:13.845888+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.841077+0000 mon.c (mon.1) 1745 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:58:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.841921+0000 mon.c (mon.1) 1746 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.842237+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:58:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.842846+0000 mon.c (mon.1) 1747 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.843518+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.843955+0000 mon.c (mon.1) 1748 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:58:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.844497+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:14 gibba003 bash[32348]: audit 2021-03-10T15:58:13.845888+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:58:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:15 gibba003 bash[31385]: cluster 2021-03-10T15:58:14.693206+0000 mgr.gibba043.dnkmem (mgr.34373) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:15 gibba003 bash[32348]: cluster 2021-03-10T15:58:14.693206+0000 mgr.gibba043.dnkmem (mgr.34373) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:15 gibba043 bash[24019]: cluster 2021-03-10T15:58:14.693206+0000 mgr.gibba043.dnkmem (mgr.34373) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:17 gibba003 bash[31385]: cephadm 2021-03-10T15:58:16.606662+0000 mgr.gibba043.dnkmem (mgr.34373) 6725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:17 gibba003 bash[31385]: cluster 2021-03-10T15:58:16.695009+0000 mgr.gibba043.dnkmem (mgr.34373) 6726 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:17 gibba003 bash[32348]: cephadm 2021-03-10T15:58:16.606662+0000 mgr.gibba043.dnkmem (mgr.34373) 6725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:17 gibba003 bash[32348]: cluster 2021-03-10T15:58:16.695009+0000 mgr.gibba043.dnkmem (mgr.34373) 6726 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:17 gibba043 bash[24019]: cephadm 2021-03-10T15:58:16.606662+0000 mgr.gibba043.dnkmem (mgr.34373) 6725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:17 gibba043 bash[24019]: cluster 2021-03-10T15:58:16.695009+0000 mgr.gibba043.dnkmem (mgr.34373) 6726 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:19 gibba003 bash[31385]: cluster 2021-03-10T15:58:18.695932+0000 mgr.gibba043.dnkmem (mgr.34373) 6727 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:19 gibba003 bash[32348]: cluster 2021-03-10T15:58:18.695932+0000 mgr.gibba043.dnkmem (mgr.34373) 6727 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:20.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:19 gibba043 bash[24019]: cluster 2021-03-10T15:58:18.695932+0000 mgr.gibba043.dnkmem (mgr.34373) 6727 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:21 gibba003 bash[31385]: cluster 2021-03-10T15:58:20.697186+0000 mgr.gibba043.dnkmem (mgr.34373) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:21 gibba003 bash[32348]: cluster 2021-03-10T15:58:20.697186+0000 mgr.gibba043.dnkmem (mgr.34373) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:21 gibba043 bash[24019]: cluster 2021-03-10T15:58:20.697186+0000 mgr.gibba043.dnkmem (mgr.34373) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:23 gibba043 bash[24019]: cluster 2021-03-10T15:58:22.698689+0000 mgr.gibba043.dnkmem (mgr.34373) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:23 gibba003 bash[31385]: cluster 2021-03-10T15:58:22.698689+0000 mgr.gibba043.dnkmem (mgr.34373) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:23 gibba003 bash[32348]: cluster 2021-03-10T15:58:22.698689+0000 mgr.gibba043.dnkmem (mgr.34373) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:25 gibba003 bash[31385]: cluster 2021-03-10T15:58:24.700131+0000 mgr.gibba043.dnkmem (mgr.34373) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:25 gibba003 bash[32348]: cluster 2021-03-10T15:58:24.700131+0000 mgr.gibba043.dnkmem (mgr.34373) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:25 gibba043 bash[24019]: cluster 2021-03-10T15:58:24.700131+0000 mgr.gibba043.dnkmem (mgr.34373) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:27 gibba003 bash[31385]: cluster 2021-03-10T15:58:26.701850+0000 mgr.gibba043.dnkmem (mgr.34373) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:27 gibba003 bash[32348]: cluster 2021-03-10T15:58:26.701850+0000 mgr.gibba043.dnkmem (mgr.34373) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:27 gibba043 bash[24019]: cluster 2021-03-10T15:58:26.701850+0000 mgr.gibba043.dnkmem (mgr.34373) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:29 gibba003 bash[31385]: cluster 2021-03-10T15:58:28.703530+0000 mgr.gibba043.dnkmem (mgr.34373) 6732 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:29 gibba003 bash[32348]: cluster 2021-03-10T15:58:28.703530+0000 mgr.gibba043.dnkmem (mgr.34373) 6732 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:29 gibba043 bash[24019]: cluster 2021-03-10T15:58:28.703530+0000 mgr.gibba043.dnkmem (mgr.34373) 6732 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:31 gibba003 bash[31385]: cluster 2021-03-10T15:58:30.704652+0000 mgr.gibba043.dnkmem (mgr.34373) 6733 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:31 gibba003 bash[32348]: cluster 2021-03-10T15:58:30.704652+0000 mgr.gibba043.dnkmem (mgr.34373) 6733 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:31 gibba043 bash[24019]: cluster 2021-03-10T15:58:30.704652+0000 mgr.gibba043.dnkmem (mgr.34373) 6733 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:32.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:32 gibba003 bash[32348]: cephadm 2021-03-10T15:58:31.622907+0000 mgr.gibba043.dnkmem (mgr.34373) 6734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:32.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:32 gibba003 bash[31385]: cephadm 2021-03-10T15:58:31.622907+0000 mgr.gibba043.dnkmem (mgr.34373) 6734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:32 gibba043 bash[24019]: cephadm 2021-03-10T15:58:31.622907+0000 mgr.gibba043.dnkmem (mgr.34373) 6734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:32.860 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:58:33.113 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:58:33.114 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 31s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:58:33.114 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:58:33.114 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:58:33.114 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:58:33.115 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:58:33.115 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:58:33.115 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:58:33.115 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:58:33.116 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 31s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:58:33.116 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:58:33.116 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:58:33.116 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:58:33.116 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:58:33.117 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:58:33.117 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:58:33.117 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:58:33.117 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:58:33.118 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:58:33.118 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:58:33.118 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 31s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:58:33.365 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:58:33.366 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:58:33.366 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:33.366 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:58:33.367 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:58:33.367 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:33.367 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:58:33.367 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:58:33.368 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:58:33.368 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:58:33.368 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:58:33.368 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:58:33.368 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:58:33.369 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:58:33.369 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:58:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:33 gibba043 bash[24019]: cluster 2021-03-10T15:58:32.706312+0000 mgr.gibba043.dnkmem (mgr.34373) 6735 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:33 gibba043 bash[24019]: audit 2021-03-10T15:58:32.851253+0000 mgr.gibba043.dnkmem (mgr.34373) 6736 : audit [DBG] from='client.58558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:33 gibba043 bash[24019]: audit 2021-03-10T15:58:33.367372+0000 mon.a (mon.0) 1528 : audit [DBG] from='client.? 172.21.2.103:0/2175327206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:33 gibba003 bash[31385]: cluster 2021-03-10T15:58:32.706312+0000 mgr.gibba043.dnkmem (mgr.34373) 6735 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:33 gibba003 bash[31385]: audit 2021-03-10T15:58:32.851253+0000 mgr.gibba043.dnkmem (mgr.34373) 6736 : audit [DBG] from='client.58558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:33 gibba003 bash[31385]: audit 2021-03-10T15:58:33.367372+0000 mon.a (mon.0) 1528 : audit [DBG] from='client.? 172.21.2.103:0/2175327206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:33 gibba003 bash[32348]: cluster 2021-03-10T15:58:32.706312+0000 mgr.gibba043.dnkmem (mgr.34373) 6735 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:33 gibba003 bash[32348]: audit 2021-03-10T15:58:32.851253+0000 mgr.gibba043.dnkmem (mgr.34373) 6736 : audit [DBG] from='client.58558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:33 gibba003 bash[32348]: audit 2021-03-10T15:58:33.367372+0000 mon.a (mon.0) 1528 : audit [DBG] from='client.? 172.21.2.103:0/2175327206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:34 gibba043 bash[24019]: audit 2021-03-10T15:58:33.074888+0000 mgr.gibba043.dnkmem (mgr.34373) 6737 : audit [DBG] from='client.48576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:34.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:34 gibba003 bash[31385]: audit 2021-03-10T15:58:33.074888+0000 mgr.gibba043.dnkmem (mgr.34373) 6737 : audit [DBG] from='client.48576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:34.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:34 gibba003 bash[32348]: audit 2021-03-10T15:58:33.074888+0000 mgr.gibba043.dnkmem (mgr.34373) 6737 : audit [DBG] from='client.48576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:35 gibba043 bash[24019]: cluster 2021-03-10T15:58:34.707885+0000 mgr.gibba043.dnkmem (mgr.34373) 6738 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:35 gibba003 bash[31385]: cluster 2021-03-10T15:58:34.707885+0000 mgr.gibba043.dnkmem (mgr.34373) 6738 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:35 gibba003 bash[32348]: cluster 2021-03-10T15:58:34.707885+0000 mgr.gibba043.dnkmem (mgr.34373) 6738 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:37 gibba003 bash[31385]: cluster 2021-03-10T15:58:36.709235+0000 mgr.gibba043.dnkmem (mgr.34373) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:37 gibba003 bash[32348]: cluster 2021-03-10T15:58:36.709235+0000 mgr.gibba043.dnkmem (mgr.34373) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:37 gibba043 bash[24019]: cluster 2021-03-10T15:58:36.709235+0000 mgr.gibba043.dnkmem (mgr.34373) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:40.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:39 gibba003 bash[31385]: cluster 2021-03-10T15:58:38.710695+0000 mgr.gibba043.dnkmem (mgr.34373) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:39 gibba003 bash[32348]: cluster 2021-03-10T15:58:38.710695+0000 mgr.gibba043.dnkmem (mgr.34373) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:39 gibba043 bash[24019]: cluster 2021-03-10T15:58:38.710695+0000 mgr.gibba043.dnkmem (mgr.34373) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:41 gibba003 bash[31385]: cluster 2021-03-10T15:58:40.712423+0000 mgr.gibba043.dnkmem (mgr.34373) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:41.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:41 gibba003 bash[32348]: cluster 2021-03-10T15:58:40.712423+0000 mgr.gibba043.dnkmem (mgr.34373) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:41 gibba043 bash[24019]: cluster 2021-03-10T15:58:40.712423+0000 mgr.gibba043.dnkmem (mgr.34373) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:43 gibba003 bash[31385]: cluster 2021-03-10T15:58:42.713515+0000 mgr.gibba043.dnkmem (mgr.34373) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:43 gibba003 bash[32348]: cluster 2021-03-10T15:58:42.713515+0000 mgr.gibba043.dnkmem (mgr.34373) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:43 gibba043 bash[24019]: cluster 2021-03-10T15:58:42.713515+0000 mgr.gibba043.dnkmem (mgr.34373) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:45 gibba003 bash[31385]: cluster 2021-03-10T15:58:44.714953+0000 mgr.gibba043.dnkmem (mgr.34373) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:45 gibba003 bash[32348]: cluster 2021-03-10T15:58:44.714953+0000 mgr.gibba043.dnkmem (mgr.34373) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:45 gibba043 bash[24019]: cluster 2021-03-10T15:58:44.714953+0000 mgr.gibba043.dnkmem (mgr.34373) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:47 gibba003 bash[31385]: cephadm 2021-03-10T15:58:46.639030+0000 mgr.gibba043.dnkmem (mgr.34373) 6744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:47 gibba003 bash[31385]: cluster 2021-03-10T15:58:46.716651+0000 mgr.gibba043.dnkmem (mgr.34373) 6745 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:47 gibba003 bash[32348]: cephadm 2021-03-10T15:58:46.639030+0000 mgr.gibba043.dnkmem (mgr.34373) 6744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:47 gibba003 bash[32348]: cluster 2021-03-10T15:58:46.716651+0000 mgr.gibba043.dnkmem (mgr.34373) 6745 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:47 gibba043 bash[24019]: cephadm 2021-03-10T15:58:46.639030+0000 mgr.gibba043.dnkmem (mgr.34373) 6744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:58:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:47 gibba043 bash[24019]: cluster 2021-03-10T15:58:46.716651+0000 mgr.gibba043.dnkmem (mgr.34373) 6745 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:49 gibba003 bash[31385]: cluster 2021-03-10T15:58:48.717949+0000 mgr.gibba043.dnkmem (mgr.34373) 6746 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:49 gibba003 bash[32348]: cluster 2021-03-10T15:58:48.717949+0000 mgr.gibba043.dnkmem (mgr.34373) 6746 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:49 gibba043 bash[24019]: cluster 2021-03-10T15:58:48.717949+0000 mgr.gibba043.dnkmem (mgr.34373) 6746 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:51 gibba043 bash[24019]: cluster 2021-03-10T15:58:50.719442+0000 mgr.gibba043.dnkmem (mgr.34373) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:51 gibba003 bash[31385]: cluster 2021-03-10T15:58:50.719442+0000 mgr.gibba043.dnkmem (mgr.34373) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:51 gibba003 bash[32348]: cluster 2021-03-10T15:58:50.719442+0000 mgr.gibba043.dnkmem (mgr.34373) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:53 gibba003 bash[31385]: cluster 2021-03-10T15:58:52.720899+0000 mgr.gibba043.dnkmem (mgr.34373) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:53 gibba003 bash[32348]: cluster 2021-03-10T15:58:52.720899+0000 mgr.gibba043.dnkmem (mgr.34373) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:53 gibba043 bash[24019]: cluster 2021-03-10T15:58:52.720899+0000 mgr.gibba043.dnkmem (mgr.34373) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:55 gibba003 bash[31385]: cluster 2021-03-10T15:58:54.722435+0000 mgr.gibba043.dnkmem (mgr.34373) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:55 gibba003 bash[32348]: cluster 2021-03-10T15:58:54.722435+0000 mgr.gibba043.dnkmem (mgr.34373) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:56.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:55 gibba043 bash[24019]: cluster 2021-03-10T15:58:54.722435+0000 mgr.gibba043.dnkmem (mgr.34373) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:57 gibba003 bash[31385]: cluster 2021-03-10T15:58:56.724306+0000 mgr.gibba043.dnkmem (mgr.34373) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:57 gibba003 bash[32348]: cluster 2021-03-10T15:58:56.724306+0000 mgr.gibba043.dnkmem (mgr.34373) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:57 gibba043 bash[24019]: cluster 2021-03-10T15:58:56.724306+0000 mgr.gibba043.dnkmem (mgr.34373) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:58:59 gibba003 bash[31385]: cluster 2021-03-10T15:58:58.725980+0000 mgr.gibba043.dnkmem (mgr.34373) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:58:59 gibba003 bash[32348]: cluster 2021-03-10T15:58:58.725980+0000 mgr.gibba043.dnkmem (mgr.34373) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:58:59 gibba043 bash[24019]: cluster 2021-03-10T15:58:58.725980+0000 mgr.gibba043.dnkmem (mgr.34373) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:01 gibba043 bash[24019]: cluster 2021-03-10T15:59:00.727587+0000 mgr.gibba043.dnkmem (mgr.34373) 6752 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:01 gibba003 bash[31385]: cluster 2021-03-10T15:59:00.727587+0000 mgr.gibba043.dnkmem (mgr.34373) 6752 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:01 gibba003 bash[32348]: cluster 2021-03-10T15:59:00.727587+0000 mgr.gibba043.dnkmem (mgr.34373) 6752 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:02.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:02 gibba043 bash[24019]: cephadm 2021-03-10T15:59:01.655953+0000 mgr.gibba043.dnkmem (mgr.34373) 6753 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:59:02.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:02 gibba043 bash[24019]: audit 2021-03-10T15:59:01.659359+0000 mon.c (mon.1) 1749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:59:02.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:02 gibba003 bash[31385]: cephadm 2021-03-10T15:59:01.655953+0000 mgr.gibba043.dnkmem (mgr.34373) 6753 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:59:02.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:02 gibba003 bash[31385]: audit 2021-03-10T15:59:01.659359+0000 mon.c (mon.1) 1749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:59:02.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:02 gibba003 bash[32348]: cephadm 2021-03-10T15:59:01.655953+0000 mgr.gibba043.dnkmem (mgr.34373) 6753 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T15:59:02.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:02 gibba003 bash[32348]: audit 2021-03-10T15:59:01.659359+0000 mon.c (mon.1) 1749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:59:03.611 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:59:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:03 gibba043 bash[24019]: cluster 2021-03-10T15:59:02.729169+0000 mgr.gibba043.dnkmem (mgr.34373) 6754 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:03.841 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:59:03.842 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 62s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:59:03.842 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:59:03.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:59:03.842 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:59:03.843 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:59:03.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:59:03.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:59:03.843 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:59:03.843 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 62s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:59:03.844 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:59:03.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:59:03.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:59:03.844 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:59:03.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:59:03.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:59:03.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:59:03.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:59:03.845 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:59:03.846 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:59:03.846 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 62s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:59:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:03 gibba003 bash[31385]: cluster 2021-03-10T15:59:02.729169+0000 mgr.gibba043.dnkmem (mgr.34373) 6754 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:03.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:03 gibba003 bash[32348]: cluster 2021-03-10T15:59:02.729169+0000 mgr.gibba043.dnkmem (mgr.34373) 6754 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:04.088 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:59:04.088 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:59:04.089 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:04.089 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:59:04.089 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:59:04.089 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:04.089 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:59:04.090 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:59:04.090 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:59:04.090 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:59:04.090 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:59:04.091 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:59:04.091 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:59:04.091 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:59:04.091 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:59:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:04 gibba043 bash[24019]: audit 2021-03-10T15:59:03.602127+0000 mgr.gibba043.dnkmem (mgr.34373) 6755 : audit [DBG] from='client.58576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:04 gibba043 bash[24019]: audit 2021-03-10T15:59:03.829471+0000 mgr.gibba043.dnkmem (mgr.34373) 6756 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:04 gibba043 bash[24019]: audit 2021-03-10T15:59:04.090239+0000 mon.c (mon.1) 1750 : audit [DBG] from='client.? 172.21.2.103:0/3784252202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:04 gibba003 bash[31385]: audit 2021-03-10T15:59:03.602127+0000 mgr.gibba043.dnkmem (mgr.34373) 6755 : audit [DBG] from='client.58576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:04 gibba003 bash[31385]: audit 2021-03-10T15:59:03.829471+0000 mgr.gibba043.dnkmem (mgr.34373) 6756 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:04.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:04 gibba003 bash[31385]: audit 2021-03-10T15:59:04.090239+0000 mon.c (mon.1) 1750 : audit [DBG] from='client.? 172.21.2.103:0/3784252202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:04.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:04 gibba003 bash[32348]: audit 2021-03-10T15:59:03.602127+0000 mgr.gibba043.dnkmem (mgr.34373) 6755 : audit [DBG] from='client.58576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:04.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:04 gibba003 bash[32348]: audit 2021-03-10T15:59:03.829471+0000 mgr.gibba043.dnkmem (mgr.34373) 6756 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:04.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:04 gibba003 bash[32348]: audit 2021-03-10T15:59:04.090239+0000 mon.c (mon.1) 1750 : audit [DBG] from='client.? 172.21.2.103:0/3784252202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:05 gibba043 bash[24019]: cluster 2021-03-10T15:59:04.729745+0000 mgr.gibba043.dnkmem (mgr.34373) 6757 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:05 gibba043 bash[24019]: audit 2021-03-10T15:59:05.398035+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:59:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:05 gibba003 bash[31385]: cluster 2021-03-10T15:59:04.729745+0000 mgr.gibba043.dnkmem (mgr.34373) 6757 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:05 gibba003 bash[31385]: audit 2021-03-10T15:59:05.398035+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:59:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:05 gibba003 bash[32348]: cluster 2021-03-10T15:59:04.729745+0000 mgr.gibba043.dnkmem (mgr.34373) 6757 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:05 gibba003 bash[32348]: audit 2021-03-10T15:59:05.398035+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:59:06.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.397714+0000 mgr.gibba043.dnkmem (mgr.34373) 6758 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:59:06.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.614641+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:59:06.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.615931+0000 mgr.gibba043.dnkmem (mgr.34373) 6759 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:06.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.617990+0000 mgr.gibba043.dnkmem (mgr.34373) 6760 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:06.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.618357+0000 mon.c (mon.1) 1751 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:06.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.619536+0000 mgr.gibba043.dnkmem (mgr.34373) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.619579+0000 mgr.gibba043.dnkmem (mgr.34373) 6762 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.620148+0000 mon.c (mon.1) 1752 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.621310+0000 mgr.gibba043.dnkmem (mgr.34373) 6763 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.621349+0000 mgr.gibba043.dnkmem (mgr.34373) 6764 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.621968+0000 mon.c (mon.1) 1753 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.622740+0000 mgr.gibba043.dnkmem (mgr.34373) 6765 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.623388+0000 mon.c (mon.1) 1754 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.624508+0000 mgr.gibba043.dnkmem (mgr.34373) 6766 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.624542+0000 mgr.gibba043.dnkmem (mgr.34373) 6767 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.625945+0000 mgr.gibba043.dnkmem (mgr.34373) 6768 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.626254+0000 mgr.gibba043.dnkmem (mgr.34373) 6769 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:06.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.626742+0000 mon.c (mon.1) 1755 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.627465+0000 mgr.gibba043.dnkmem (mgr.34373) 6770 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:06.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.627503+0000 mgr.gibba043.dnkmem (mgr.34373) 6771 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:06.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: cephadm 2021-03-10T15:59:05.627607+0000 mgr.gibba043.dnkmem (mgr.34373) 6772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:06.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[31385]: audit 2021-03-10T15:59:05.628329+0000 mon.c (mon.1) 1756 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.397714+0000 mgr.gibba043.dnkmem (mgr.34373) 6758 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:59:06.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.614641+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:59:06.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.615931+0000 mgr.gibba043.dnkmem (mgr.34373) 6759 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:06.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.617990+0000 mgr.gibba043.dnkmem (mgr.34373) 6760 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:06.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.618357+0000 mon.c (mon.1) 1751 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:06.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.619536+0000 mgr.gibba043.dnkmem (mgr.34373) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:06.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.619579+0000 mgr.gibba043.dnkmem (mgr.34373) 6762 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:06.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.620148+0000 mon.c (mon.1) 1752 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.621310+0000 mgr.gibba043.dnkmem (mgr.34373) 6763 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:06.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.621349+0000 mgr.gibba043.dnkmem (mgr.34373) 6764 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:06.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.621968+0000 mon.c (mon.1) 1753 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.622740+0000 mgr.gibba043.dnkmem (mgr.34373) 6765 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:06.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.623388+0000 mon.c (mon.1) 1754 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.624508+0000 mgr.gibba043.dnkmem (mgr.34373) 6766 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:06.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.624542+0000 mgr.gibba043.dnkmem (mgr.34373) 6767 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:06.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.625945+0000 mgr.gibba043.dnkmem (mgr.34373) 6768 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:06.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.626254+0000 mgr.gibba043.dnkmem (mgr.34373) 6769 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:06.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.626742+0000 mon.c (mon.1) 1755 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:06.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.627465+0000 mgr.gibba043.dnkmem (mgr.34373) 6770 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:06.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.627503+0000 mgr.gibba043.dnkmem (mgr.34373) 6771 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:06.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: cephadm 2021-03-10T15:59:05.627607+0000 mgr.gibba043.dnkmem (mgr.34373) 6772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:06.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:06 gibba003 bash[32348]: audit 2021-03-10T15:59:05.628329+0000 mon.c (mon.1) 1756 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:07.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.397714+0000 mgr.gibba043.dnkmem (mgr.34373) 6758 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T15:59:07.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.614641+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T15:59:07.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.615931+0000 mgr.gibba043.dnkmem (mgr.34373) 6759 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:07.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.617990+0000 mgr.gibba043.dnkmem (mgr.34373) 6760 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:07.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.618357+0000 mon.c (mon.1) 1751 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:07.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.619536+0000 mgr.gibba043.dnkmem (mgr.34373) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.619579+0000 mgr.gibba043.dnkmem (mgr.34373) 6762 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.620148+0000 mon.c (mon.1) 1752 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.621310+0000 mgr.gibba043.dnkmem (mgr.34373) 6763 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.621349+0000 mgr.gibba043.dnkmem (mgr.34373) 6764 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:07.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.621968+0000 mon.c (mon.1) 1753 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:07.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.622740+0000 mgr.gibba043.dnkmem (mgr.34373) 6765 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:07.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.623388+0000 mon.c (mon.1) 1754 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:07.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.624508+0000 mgr.gibba043.dnkmem (mgr.34373) 6766 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:07.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.624542+0000 mgr.gibba043.dnkmem (mgr.34373) 6767 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:07.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.625945+0000 mgr.gibba043.dnkmem (mgr.34373) 6768 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:07.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.626254+0000 mgr.gibba043.dnkmem (mgr.34373) 6769 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:07.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.626742+0000 mon.c (mon.1) 1755 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:07.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.627465+0000 mgr.gibba043.dnkmem (mgr.34373) 6770 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:07.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.627503+0000 mgr.gibba043.dnkmem (mgr.34373) 6771 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:07.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: cephadm 2021-03-10T15:59:05.627607+0000 mgr.gibba043.dnkmem (mgr.34373) 6772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:07.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:06 gibba043 bash[24019]: audit 2021-03-10T15:59:05.628329+0000 mon.c (mon.1) 1756 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:07 gibba003 bash[31385]: cluster 2021-03-10T15:59:06.731111+0000 mgr.gibba043.dnkmem (mgr.34373) 6773 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:07 gibba003 bash[32348]: cluster 2021-03-10T15:59:06.731111+0000 mgr.gibba043.dnkmem (mgr.34373) 6773 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:07 gibba043 bash[24019]: cluster 2021-03-10T15:59:06.731111+0000 mgr.gibba043.dnkmem (mgr.34373) 6773 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:09 gibba003 bash[31385]: cluster 2021-03-10T15:59:08.732706+0000 mgr.gibba043.dnkmem (mgr.34373) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:09 gibba003 bash[32348]: cluster 2021-03-10T15:59:08.732706+0000 mgr.gibba043.dnkmem (mgr.34373) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:09 gibba043 bash[24019]: cluster 2021-03-10T15:59:08.732706+0000 mgr.gibba043.dnkmem (mgr.34373) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:11 gibba043 bash[24019]: cluster 2021-03-10T15:59:10.734149+0000 mgr.gibba043.dnkmem (mgr.34373) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:11 gibba003 bash[31385]: cluster 2021-03-10T15:59:10.734149+0000 mgr.gibba043.dnkmem (mgr.34373) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:11 gibba003 bash[32348]: cluster 2021-03-10T15:59:10.734149+0000 mgr.gibba043.dnkmem (mgr.34373) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[31385]: cluster 2021-03-10T15:59:12.735524+0000 mgr.gibba043.dnkmem (mgr.34373) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[31385]: audit 2021-03-10T15:59:13.542348+0000 mon.c (mon.1) 1757 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[31385]: audit 2021-03-10T15:59:13.543521+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[31385]: audit 2021-03-10T15:59:13.701577+0000 mon.c (mon.1) 1758 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[31385]: audit 2021-03-10T15:59:13.702680+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[32348]: cluster 2021-03-10T15:59:12.735524+0000 mgr.gibba043.dnkmem (mgr.34373) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[32348]: audit 2021-03-10T15:59:13.542348+0000 mon.c (mon.1) 1757 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[32348]: audit 2021-03-10T15:59:13.543521+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[32348]: audit 2021-03-10T15:59:13.701577+0000 mon.c (mon.1) 1758 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:13 gibba003 bash[32348]: audit 2021-03-10T15:59:13.702680+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:13 gibba043 bash[24019]: cluster 2021-03-10T15:59:12.735524+0000 mgr.gibba043.dnkmem (mgr.34373) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:13 gibba043 bash[24019]: audit 2021-03-10T15:59:13.542348+0000 mon.c (mon.1) 1757 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:13 gibba043 bash[24019]: audit 2021-03-10T15:59:13.543521+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:13 gibba043 bash[24019]: audit 2021-03-10T15:59:13.701577+0000 mon.c (mon.1) 1758 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:13 gibba043 bash[24019]: audit 2021-03-10T15:59:13.702680+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.848698+0000 mon.c (mon.1) 1759 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:59:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.849447+0000 mon.c (mon.1) 1760 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.850083+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:59:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.850119+0000 mon.c (mon.1) 1761 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:59:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.850860+0000 mon.c (mon.1) 1762 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.852372+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.853302+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:59:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[31385]: audit 2021-03-10T15:59:13.854168+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.848698+0000 mon.c (mon.1) 1759 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:59:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.849447+0000 mon.c (mon.1) 1760 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.850083+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:59:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.850119+0000 mon.c (mon.1) 1761 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:59:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.850860+0000 mon.c (mon.1) 1762 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.852372+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.853302+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:59:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:14 gibba003 bash[32348]: audit 2021-03-10T15:59:13.854168+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.848698+0000 mon.c (mon.1) 1759 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:59:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.849447+0000 mon.c (mon.1) 1760 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.850083+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:59:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.850119+0000 mon.c (mon.1) 1761 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:59:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.850860+0000 mon.c (mon.1) 1762 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.852372+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:59:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.853302+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:59:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:14 gibba043 bash[24019]: audit 2021-03-10T15:59:13.854168+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:59:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:15 gibba003 bash[31385]: cluster 2021-03-10T15:59:14.737009+0000 mgr.gibba043.dnkmem (mgr.34373) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:15 gibba003 bash[32348]: cluster 2021-03-10T15:59:14.737009+0000 mgr.gibba043.dnkmem (mgr.34373) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:15 gibba043 bash[24019]: cluster 2021-03-10T15:59:14.737009+0000 mgr.gibba043.dnkmem (mgr.34373) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:17 gibba003 bash[31385]: cluster 2021-03-10T15:59:16.738651+0000 mgr.gibba043.dnkmem (mgr.34373) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:17 gibba003 bash[32348]: cluster 2021-03-10T15:59:16.738651+0000 mgr.gibba043.dnkmem (mgr.34373) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:17 gibba043 bash[24019]: cluster 2021-03-10T15:59:16.738651+0000 mgr.gibba043.dnkmem (mgr.34373) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:19 gibba003 bash[31385]: cluster 2021-03-10T15:59:18.739963+0000 mgr.gibba043.dnkmem (mgr.34373) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:19 gibba003 bash[32348]: cluster 2021-03-10T15:59:18.739963+0000 mgr.gibba043.dnkmem (mgr.34373) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:19 gibba043 bash[24019]: cluster 2021-03-10T15:59:18.739963+0000 mgr.gibba043.dnkmem (mgr.34373) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:21 gibba043 bash[24019]: cephadm 2021-03-10T15:59:20.643555+0000 mgr.gibba043.dnkmem (mgr.34373) 6780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:21 gibba043 bash[24019]: cluster 2021-03-10T15:59:20.741367+0000 mgr.gibba043.dnkmem (mgr.34373) 6781 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:21 gibba003 bash[31385]: cephadm 2021-03-10T15:59:20.643555+0000 mgr.gibba043.dnkmem (mgr.34373) 6780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:21 gibba003 bash[31385]: cluster 2021-03-10T15:59:20.741367+0000 mgr.gibba043.dnkmem (mgr.34373) 6781 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:21 gibba003 bash[32348]: cephadm 2021-03-10T15:59:20.643555+0000 mgr.gibba043.dnkmem (mgr.34373) 6780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:21 gibba003 bash[32348]: cluster 2021-03-10T15:59:20.741367+0000 mgr.gibba043.dnkmem (mgr.34373) 6781 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:23 gibba003 bash[31385]: cluster 2021-03-10T15:59:22.742824+0000 mgr.gibba043.dnkmem (mgr.34373) 6782 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:23 gibba003 bash[32348]: cluster 2021-03-10T15:59:22.742824+0000 mgr.gibba043.dnkmem (mgr.34373) 6782 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:23 gibba043 bash[24019]: cluster 2021-03-10T15:59:22.742824+0000 mgr.gibba043.dnkmem (mgr.34373) 6782 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:25 gibba003 bash[31385]: cluster 2021-03-10T15:59:24.744270+0000 mgr.gibba043.dnkmem (mgr.34373) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:25 gibba003 bash[32348]: cluster 2021-03-10T15:59:24.744270+0000 mgr.gibba043.dnkmem (mgr.34373) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:25 gibba043 bash[24019]: cluster 2021-03-10T15:59:24.744270+0000 mgr.gibba043.dnkmem (mgr.34373) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:27 gibba003 bash[31385]: cluster 2021-03-10T15:59:26.745736+0000 mgr.gibba043.dnkmem (mgr.34373) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:27 gibba003 bash[32348]: cluster 2021-03-10T15:59:26.745736+0000 mgr.gibba043.dnkmem (mgr.34373) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:27 gibba043 bash[24019]: cluster 2021-03-10T15:59:26.745736+0000 mgr.gibba043.dnkmem (mgr.34373) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:29 gibba003 bash[31385]: cluster 2021-03-10T15:59:28.747460+0000 mgr.gibba043.dnkmem (mgr.34373) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:29 gibba003 bash[32348]: cluster 2021-03-10T15:59:28.747460+0000 mgr.gibba043.dnkmem (mgr.34373) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:29 gibba043 bash[24019]: cluster 2021-03-10T15:59:28.747460+0000 mgr.gibba043.dnkmem (mgr.34373) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:31 gibba043 bash[24019]: cluster 2021-03-10T15:59:30.749103+0000 mgr.gibba043.dnkmem (mgr.34373) 6786 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:31 gibba003 bash[31385]: cluster 2021-03-10T15:59:30.749103+0000 mgr.gibba043.dnkmem (mgr.34373) 6786 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:31 gibba003 bash[32348]: cluster 2021-03-10T15:59:30.749103+0000 mgr.gibba043.dnkmem (mgr.34373) 6786 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:33 gibba003 bash[31385]: cluster 2021-03-10T15:59:32.750476+0000 mgr.gibba043.dnkmem (mgr.34373) 6787 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:33 gibba003 bash[32348]: cluster 2021-03-10T15:59:32.750476+0000 mgr.gibba043.dnkmem (mgr.34373) 6787 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:33 gibba043 bash[24019]: cluster 2021-03-10T15:59:32.750476+0000 mgr.gibba043.dnkmem (mgr.34373) 6787 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.330 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T15:59:34.557 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:59:34.557 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 93s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T15:59:34.558 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 29s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T15:59:34.558 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T15:59:34.558 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T15:59:34.558 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T15:59:34.559 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T15:59:34.559 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T15:59:34.559 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T15:59:34.559 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 93s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T15:59:34.560 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 29s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T15:59:34.560 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T15:59:34.560 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T15:59:34.560 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T15:59:34.560 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T15:59:34.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T15:59:34.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T15:59:34.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T15:59:34.561 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T15:59:34.562 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 29s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T15:59:34.562 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 93s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:59:34.812 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T15:59:34.812 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T15:59:34.813 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:34.813 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:59:34.813 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T15:59:34.813 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:34.814 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:59:34.814 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T15:59:34.814 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:59:34.814 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T15:59:34.815 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T15:59:34.815 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T15:59:34.815 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:59:34.815 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T15:59:34.815 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T15:59:35.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:34 gibba003 bash[31385]: audit 2021-03-10T15:59:34.812484+0000 mon.a (mon.0) 1537 : audit [DBG] from='client.? 172.21.2.103:0/809045499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:35.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:34 gibba003 bash[32348]: audit 2021-03-10T15:59:34.812484+0000 mon.a (mon.0) 1537 : audit [DBG] from='client.? 172.21.2.103:0/809045499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:35.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:34 gibba043 bash[24019]: audit 2021-03-10T15:59:34.812484+0000 mon.a (mon.0) 1537 : audit [DBG] from='client.? 172.21.2.103:0/809045499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:35 gibba043 bash[24019]: audit 2021-03-10T15:59:34.321827+0000 mgr.gibba043.dnkmem (mgr.34373) 6788 : audit [DBG] from='client.58594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:35 gibba043 bash[24019]: audit 2021-03-10T15:59:34.545569+0000 mgr.gibba043.dnkmem (mgr.34373) 6789 : audit [DBG] from='client.58600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:35 gibba043 bash[24019]: cluster 2021-03-10T15:59:34.752041+0000 mgr.gibba043.dnkmem (mgr.34373) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:35 gibba003 bash[31385]: audit 2021-03-10T15:59:34.321827+0000 mgr.gibba043.dnkmem (mgr.34373) 6788 : audit [DBG] from='client.58594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:35 gibba003 bash[31385]: audit 2021-03-10T15:59:34.545569+0000 mgr.gibba043.dnkmem (mgr.34373) 6789 : audit [DBG] from='client.58600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:35 gibba003 bash[31385]: cluster 2021-03-10T15:59:34.752041+0000 mgr.gibba043.dnkmem (mgr.34373) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:35 gibba003 bash[32348]: audit 2021-03-10T15:59:34.321827+0000 mgr.gibba043.dnkmem (mgr.34373) 6788 : audit [DBG] from='client.58594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:35 gibba003 bash[32348]: audit 2021-03-10T15:59:34.545569+0000 mgr.gibba043.dnkmem (mgr.34373) 6789 : audit [DBG] from='client.58600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:35 gibba003 bash[32348]: cluster 2021-03-10T15:59:34.752041+0000 mgr.gibba043.dnkmem (mgr.34373) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:37.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:36 gibba003 bash[31385]: cephadm 2021-03-10T15:59:35.659547+0000 mgr.gibba043.dnkmem (mgr.34373) 6791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:37.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:36 gibba003 bash[32348]: cephadm 2021-03-10T15:59:35.659547+0000 mgr.gibba043.dnkmem (mgr.34373) 6791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:37.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:36 gibba043 bash[24019]: cephadm 2021-03-10T15:59:35.659547+0000 mgr.gibba043.dnkmem (mgr.34373) 6791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:38.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:37 gibba003 bash[31385]: cluster 2021-03-10T15:59:36.753849+0000 mgr.gibba043.dnkmem (mgr.34373) 6792 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:37 gibba003 bash[32348]: cluster 2021-03-10T15:59:36.753849+0000 mgr.gibba043.dnkmem (mgr.34373) 6792 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:37 gibba043 bash[24019]: cluster 2021-03-10T15:59:36.753849+0000 mgr.gibba043.dnkmem (mgr.34373) 6792 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:39 gibba003 bash[31385]: cluster 2021-03-10T15:59:38.755490+0000 mgr.gibba043.dnkmem (mgr.34373) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:39 gibba003 bash[32348]: cluster 2021-03-10T15:59:38.755490+0000 mgr.gibba043.dnkmem (mgr.34373) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:39 gibba043 bash[24019]: cluster 2021-03-10T15:59:38.755490+0000 mgr.gibba043.dnkmem (mgr.34373) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:41 gibba043 bash[24019]: cluster 2021-03-10T15:59:40.757062+0000 mgr.gibba043.dnkmem (mgr.34373) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:41 gibba003 bash[31385]: cluster 2021-03-10T15:59:40.757062+0000 mgr.gibba043.dnkmem (mgr.34373) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:41 gibba003 bash[32348]: cluster 2021-03-10T15:59:40.757062+0000 mgr.gibba043.dnkmem (mgr.34373) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:43 gibba003 bash[31385]: cluster 2021-03-10T15:59:42.758486+0000 mgr.gibba043.dnkmem (mgr.34373) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:43 gibba003 bash[32348]: cluster 2021-03-10T15:59:42.758486+0000 mgr.gibba043.dnkmem (mgr.34373) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:43 gibba043 bash[24019]: cluster 2021-03-10T15:59:42.758486+0000 mgr.gibba043.dnkmem (mgr.34373) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:45 gibba003 bash[31385]: cluster 2021-03-10T15:59:44.759925+0000 mgr.gibba043.dnkmem (mgr.34373) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:45 gibba003 bash[32348]: cluster 2021-03-10T15:59:44.759925+0000 mgr.gibba043.dnkmem (mgr.34373) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:45 gibba043 bash[24019]: cluster 2021-03-10T15:59:44.759925+0000 mgr.gibba043.dnkmem (mgr.34373) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:47 gibba003 bash[31385]: cluster 2021-03-10T15:59:46.761561+0000 mgr.gibba043.dnkmem (mgr.34373) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:47 gibba003 bash[32348]: cluster 2021-03-10T15:59:46.761561+0000 mgr.gibba043.dnkmem (mgr.34373) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:47 gibba043 bash[24019]: cluster 2021-03-10T15:59:46.761561+0000 mgr.gibba043.dnkmem (mgr.34373) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:49 gibba003 bash[31385]: cluster 2021-03-10T15:59:48.763060+0000 mgr.gibba043.dnkmem (mgr.34373) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:49 gibba003 bash[32348]: cluster 2021-03-10T15:59:48.763060+0000 mgr.gibba043.dnkmem (mgr.34373) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:49 gibba043 bash[24019]: cluster 2021-03-10T15:59:48.763060+0000 mgr.gibba043.dnkmem (mgr.34373) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:51 gibba043 bash[24019]: cephadm 2021-03-10T15:59:50.675604+0000 mgr.gibba043.dnkmem (mgr.34373) 6799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:51 gibba043 bash[24019]: cluster 2021-03-10T15:59:50.764681+0000 mgr.gibba043.dnkmem (mgr.34373) 6800 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:51 gibba003 bash[31385]: cephadm 2021-03-10T15:59:50.675604+0000 mgr.gibba043.dnkmem (mgr.34373) 6799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:51 gibba003 bash[31385]: cluster 2021-03-10T15:59:50.764681+0000 mgr.gibba043.dnkmem (mgr.34373) 6800 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:51 gibba003 bash[32348]: cephadm 2021-03-10T15:59:50.675604+0000 mgr.gibba043.dnkmem (mgr.34373) 6799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T15:59:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:51 gibba003 bash[32348]: cluster 2021-03-10T15:59:50.764681+0000 mgr.gibba043.dnkmem (mgr.34373) 6800 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:53 gibba003 bash[31385]: cluster 2021-03-10T15:59:52.766214+0000 mgr.gibba043.dnkmem (mgr.34373) 6801 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:53 gibba003 bash[32348]: cluster 2021-03-10T15:59:52.766214+0000 mgr.gibba043.dnkmem (mgr.34373) 6801 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:53 gibba043 bash[24019]: cluster 2021-03-10T15:59:52.766214+0000 mgr.gibba043.dnkmem (mgr.34373) 6801 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:55 gibba003 bash[31385]: cluster 2021-03-10T15:59:54.767657+0000 mgr.gibba043.dnkmem (mgr.34373) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:55 gibba003 bash[32348]: cluster 2021-03-10T15:59:54.767657+0000 mgr.gibba043.dnkmem (mgr.34373) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:55 gibba043 bash[24019]: cluster 2021-03-10T15:59:54.767657+0000 mgr.gibba043.dnkmem (mgr.34373) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:57 gibba003 bash[31385]: cluster 2021-03-10T15:59:56.769482+0000 mgr.gibba043.dnkmem (mgr.34373) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:57 gibba003 bash[32348]: cluster 2021-03-10T15:59:56.769482+0000 mgr.gibba043.dnkmem (mgr.34373) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:57 gibba043 bash[24019]: cluster 2021-03-10T15:59:56.769482+0000 mgr.gibba043.dnkmem (mgr.34373) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 15:59:59 gibba003 bash[31385]: cluster 2021-03-10T15:59:58.770994+0000 mgr.gibba043.dnkmem (mgr.34373) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:00 gibba003 bash[31385]: debug 2021-03-10T15:59:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 15:59:59 gibba003 bash[32348]: cluster 2021-03-10T15:59:58.770994+0000 mgr.gibba043.dnkmem (mgr.34373) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 15:59:59 gibba043 bash[24019]: cluster 2021-03-10T15:59:58.770994+0000 mgr.gibba043.dnkmem (mgr.34373) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:01.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:00 gibba003 bash[31385]: cluster 2021-03-10T16:00:00.000193+0000 mon.a (mon.0) 1538 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:01.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:00 gibba003 bash[32348]: cluster 2021-03-10T16:00:00.000193+0000 mon.a (mon.0) 1538 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:01.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:00 gibba043 bash[24019]: cluster 2021-03-10T16:00:00.000193+0000 mon.a (mon.0) 1538 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:01 gibba003 bash[31385]: cluster 2021-03-10T16:00:00.772729+0000 mgr.gibba043.dnkmem (mgr.34373) 6805 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:01 gibba003 bash[32348]: cluster 2021-03-10T16:00:00.772729+0000 mgr.gibba043.dnkmem (mgr.34373) 6805 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:02.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:01 gibba043 bash[24019]: cluster 2021-03-10T16:00:00.772729+0000 mgr.gibba043.dnkmem (mgr.34373) 6805 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:03 gibba003 bash[31385]: cluster 2021-03-10T16:00:02.774210+0000 mgr.gibba043.dnkmem (mgr.34373) 6806 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:03 gibba003 bash[32348]: cluster 2021-03-10T16:00:02.774210+0000 mgr.gibba043.dnkmem (mgr.34373) 6806 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:03 gibba043 bash[24019]: cluster 2021-03-10T16:00:02.774210+0000 mgr.gibba043.dnkmem (mgr.34373) 6806 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:05.058 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:00:05.288 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:00:05.288 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:00:05.288 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 59s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:00:05.289 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:00:05.289 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:00:05.289 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:00:05.289 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:00:05.290 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:00:05.290 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:00:05.290 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:00:05.290 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 59s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:00:05.290 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:00:05.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:00:05.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:00:05.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:00:05.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:00:05.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:00:05.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:00:05.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:00:05.292 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 59s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:00:05.293 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:00:05.534 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:00:05.534 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:00:05.534 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:05.535 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:00:05.535 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:00:05.535 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:05.535 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:00:05.535 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:00:05.536 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:00:05.536 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:00:05.536 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:00:05.536 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:00:05.537 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:00:05.537 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:00:05.537 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:00:06.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:05 gibba003 bash[31385]: cluster 2021-03-10T16:00:04.775731+0000 mgr.gibba043.dnkmem (mgr.34373) 6807 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:05 gibba003 bash[31385]: audit 2021-03-10T16:00:05.049756+0000 mgr.gibba043.dnkmem (mgr.34373) 6808 : audit [DBG] from='client.58612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:05 gibba003 bash[31385]: audit 2021-03-10T16:00:05.535814+0000 mon.c (mon.1) 1763 : audit [DBG] from='client.? 172.21.2.103:0/1163990630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:05 gibba003 bash[32348]: cluster 2021-03-10T16:00:04.775731+0000 mgr.gibba043.dnkmem (mgr.34373) 6807 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:05 gibba003 bash[32348]: audit 2021-03-10T16:00:05.049756+0000 mgr.gibba043.dnkmem (mgr.34373) 6808 : audit [DBG] from='client.58612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:05 gibba003 bash[32348]: audit 2021-03-10T16:00:05.535814+0000 mon.c (mon.1) 1763 : audit [DBG] from='client.? 172.21.2.103:0/1163990630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:06.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:05 gibba043 bash[24019]: cluster 2021-03-10T16:00:04.775731+0000 mgr.gibba043.dnkmem (mgr.34373) 6807 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:05 gibba043 bash[24019]: audit 2021-03-10T16:00:05.049756+0000 mgr.gibba043.dnkmem (mgr.34373) 6808 : audit [DBG] from='client.58612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:06.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:05 gibba043 bash[24019]: audit 2021-03-10T16:00:05.535814+0000 mon.c (mon.1) 1763 : audit [DBG] from='client.? 172.21.2.103:0/1163990630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.275953+0000 mgr.gibba043.dnkmem (mgr.34373) 6809 : audit [DBG] from='client.58618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.692352+0000 mgr.gibba043.dnkmem (mgr.34373) 6810 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:00:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.693914+0000 mgr.gibba043.dnkmem (mgr.34373) 6811 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:00:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.906612+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:00:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.908131+0000 mgr.gibba043.dnkmem (mgr.34373) 6812 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:00:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.909823+0000 mgr.gibba043.dnkmem (mgr.34373) 6813 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:00:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.910464+0000 mon.c (mon.1) 1764 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.911759+0000 mgr.gibba043.dnkmem (mgr.34373) 6814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:00:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.911841+0000 mgr.gibba043.dnkmem (mgr.34373) 6815 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:00:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.911931+0000 mon.c (mon.1) 1765 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.913340+0000 mgr.gibba043.dnkmem (mgr.34373) 6816 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:00:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.913416+0000 mgr.gibba043.dnkmem (mgr.34373) 6817 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:00:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.913954+0000 mon.c (mon.1) 1766 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.914772+0000 mgr.gibba043.dnkmem (mgr.34373) 6818 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:00:07.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.915385+0000 mon.c (mon.1) 1767 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.916333+0000 mgr.gibba043.dnkmem (mgr.34373) 6819 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:00:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.916377+0000 mgr.gibba043.dnkmem (mgr.34373) 6820 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:00:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.917753+0000 mgr.gibba043.dnkmem (mgr.34373) 6821 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:00:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.918081+0000 mgr.gibba043.dnkmem (mgr.34373) 6822 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:00:07.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.918537+0000 mon.c (mon.1) 1768 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.919669+0000 mgr.gibba043.dnkmem (mgr.34373) 6823 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:00:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.275953+0000 mgr.gibba043.dnkmem (mgr.34373) 6809 : audit [DBG] from='client.58618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:07.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.692352+0000 mgr.gibba043.dnkmem (mgr.34373) 6810 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:00:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.693914+0000 mgr.gibba043.dnkmem (mgr.34373) 6811 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:00:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.906612+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:00:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.908131+0000 mgr.gibba043.dnkmem (mgr.34373) 6812 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:00:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.909823+0000 mgr.gibba043.dnkmem (mgr.34373) 6813 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:00:07.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.910464+0000 mon.c (mon.1) 1764 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.911759+0000 mgr.gibba043.dnkmem (mgr.34373) 6814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:00:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.911841+0000 mgr.gibba043.dnkmem (mgr.34373) 6815 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:00:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.911931+0000 mon.c (mon.1) 1765 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.913340+0000 mgr.gibba043.dnkmem (mgr.34373) 6816 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:00:07.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.913416+0000 mgr.gibba043.dnkmem (mgr.34373) 6817 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:00:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.913954+0000 mon.c (mon.1) 1766 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.914772+0000 mgr.gibba043.dnkmem (mgr.34373) 6818 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:00:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.915385+0000 mon.c (mon.1) 1767 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.916333+0000 mgr.gibba043.dnkmem (mgr.34373) 6819 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:00:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.916377+0000 mgr.gibba043.dnkmem (mgr.34373) 6820 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:00:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.917753+0000 mgr.gibba043.dnkmem (mgr.34373) 6821 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:00:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.918081+0000 mgr.gibba043.dnkmem (mgr.34373) 6822 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:00:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.918537+0000 mon.c (mon.1) 1768 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.919669+0000 mgr.gibba043.dnkmem (mgr.34373) 6823 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:00:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.919793+0000 mgr.gibba043.dnkmem (mgr.34373) 6824 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:00:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: cephadm 2021-03-10T16:00:05.919930+0000 mgr.gibba043.dnkmem (mgr.34373) 6825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:07.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[32348]: audit 2021-03-10T16:00:05.920111+0000 mon.c (mon.1) 1769 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.919793+0000 mgr.gibba043.dnkmem (mgr.34373) 6824 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:00:07.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: cephadm 2021-03-10T16:00:05.919930+0000 mgr.gibba043.dnkmem (mgr.34373) 6825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:07.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:06 gibba003 bash[31385]: audit 2021-03-10T16:00:05.920111+0000 mon.c (mon.1) 1769 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.275953+0000 mgr.gibba043.dnkmem (mgr.34373) 6809 : audit [DBG] from='client.58618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.692352+0000 mgr.gibba043.dnkmem (mgr.34373) 6810 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:00:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.693914+0000 mgr.gibba043.dnkmem (mgr.34373) 6811 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:00:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.906612+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:00:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.908131+0000 mgr.gibba043.dnkmem (mgr.34373) 6812 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:00:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.909823+0000 mgr.gibba043.dnkmem (mgr.34373) 6813 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:00:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.910464+0000 mon.c (mon.1) 1764 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.911759+0000 mgr.gibba043.dnkmem (mgr.34373) 6814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:00:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.911841+0000 mgr.gibba043.dnkmem (mgr.34373) 6815 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:00:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.911931+0000 mon.c (mon.1) 1765 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.913340+0000 mgr.gibba043.dnkmem (mgr.34373) 6816 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:00:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.913416+0000 mgr.gibba043.dnkmem (mgr.34373) 6817 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:00:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.913954+0000 mon.c (mon.1) 1766 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.914772+0000 mgr.gibba043.dnkmem (mgr.34373) 6818 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:00:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.915385+0000 mon.c (mon.1) 1767 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.916333+0000 mgr.gibba043.dnkmem (mgr.34373) 6819 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:00:07.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.916377+0000 mgr.gibba043.dnkmem (mgr.34373) 6820 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:00:07.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.917753+0000 mgr.gibba043.dnkmem (mgr.34373) 6821 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:00:07.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.918081+0000 mgr.gibba043.dnkmem (mgr.34373) 6822 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:00:07.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.918537+0000 mon.c (mon.1) 1768 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:07.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.919669+0000 mgr.gibba043.dnkmem (mgr.34373) 6823 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:00:07.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.919793+0000 mgr.gibba043.dnkmem (mgr.34373) 6824 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:00:07.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: cephadm 2021-03-10T16:00:05.919930+0000 mgr.gibba043.dnkmem (mgr.34373) 6825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:07.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:06 gibba043 bash[24019]: audit 2021-03-10T16:00:05.920111+0000 mon.c (mon.1) 1769 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:07 gibba003 bash[31385]: cluster 2021-03-10T16:00:06.777265+0000 mgr.gibba043.dnkmem (mgr.34373) 6826 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:07 gibba003 bash[32348]: cluster 2021-03-10T16:00:06.777265+0000 mgr.gibba043.dnkmem (mgr.34373) 6826 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:07 gibba043 bash[24019]: cluster 2021-03-10T16:00:06.777265+0000 mgr.gibba043.dnkmem (mgr.34373) 6826 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:10.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:09 gibba003 bash[31385]: cluster 2021-03-10T16:00:08.778898+0000 mgr.gibba043.dnkmem (mgr.34373) 6827 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:09 gibba003 bash[32348]: cluster 2021-03-10T16:00:08.778898+0000 mgr.gibba043.dnkmem (mgr.34373) 6827 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:10.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:09 gibba043 bash[24019]: cluster 2021-03-10T16:00:08.778898+0000 mgr.gibba043.dnkmem (mgr.34373) 6827 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:11 gibba043 bash[24019]: cluster 2021-03-10T16:00:10.780439+0000 mgr.gibba043.dnkmem (mgr.34373) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:11 gibba003 bash[31385]: cluster 2021-03-10T16:00:10.780439+0000 mgr.gibba043.dnkmem (mgr.34373) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:11 gibba003 bash[32348]: cluster 2021-03-10T16:00:10.780439+0000 mgr.gibba043.dnkmem (mgr.34373) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[31385]: cluster 2021-03-10T16:00:12.781908+0000 mgr.gibba043.dnkmem (mgr.34373) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[31385]: audit 2021-03-10T16:00:13.549485+0000 mon.c (mon.1) 1770 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[31385]: audit 2021-03-10T16:00:13.550699+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[31385]: audit 2021-03-10T16:00:13.709910+0000 mon.c (mon.1) 1771 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[31385]: audit 2021-03-10T16:00:13.711116+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[32348]: cluster 2021-03-10T16:00:12.781908+0000 mgr.gibba043.dnkmem (mgr.34373) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[32348]: audit 2021-03-10T16:00:13.549485+0000 mon.c (mon.1) 1770 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[32348]: audit 2021-03-10T16:00:13.550699+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[32348]: audit 2021-03-10T16:00:13.709910+0000 mon.c (mon.1) 1771 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:13 gibba003 bash[32348]: audit 2021-03-10T16:00:13.711116+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:13 gibba043 bash[24019]: cluster 2021-03-10T16:00:12.781908+0000 mgr.gibba043.dnkmem (mgr.34373) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:13 gibba043 bash[24019]: audit 2021-03-10T16:00:13.549485+0000 mon.c (mon.1) 1770 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:13 gibba043 bash[24019]: audit 2021-03-10T16:00:13.550699+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:13 gibba043 bash[24019]: audit 2021-03-10T16:00:13.709910+0000 mon.c (mon.1) 1771 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:13 gibba043 bash[24019]: audit 2021-03-10T16:00:13.711116+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.855471+0000 mon.c (mon.1) 1772 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.855662+0000 mon.c (mon.1) 1773 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.855774+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.855838+0000 mon.c (mon.1) 1774 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.855981+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.856026+0000 mon.c (mon.1) 1775 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:00:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.856174+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[31385]: audit 2021-03-10T16:00:13.856380+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:00:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.855471+0000 mon.c (mon.1) 1772 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.855662+0000 mon.c (mon.1) 1773 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.855774+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.855838+0000 mon.c (mon.1) 1774 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.855981+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.856026+0000 mon.c (mon.1) 1775 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:00:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.856174+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:14 gibba003 bash[32348]: audit 2021-03-10T16:00:13.856380+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:00:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.855471+0000 mon.c (mon.1) 1772 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.855662+0000 mon.c (mon.1) 1773 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.855774+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.855838+0000 mon.c (mon.1) 1774 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.855981+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.856026+0000 mon.c (mon.1) 1775 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:00:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.856174+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:00:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:14 gibba043 bash[24019]: audit 2021-03-10T16:00:13.856380+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:00:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:15 gibba003 bash[31385]: cluster 2021-03-10T16:00:14.783424+0000 mgr.gibba043.dnkmem (mgr.34373) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:15 gibba003 bash[32348]: cluster 2021-03-10T16:00:14.783424+0000 mgr.gibba043.dnkmem (mgr.34373) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:15 gibba043 bash[24019]: cluster 2021-03-10T16:00:14.783424+0000 mgr.gibba043.dnkmem (mgr.34373) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:17 gibba003 bash[31385]: cluster 2021-03-10T16:00:16.785196+0000 mgr.gibba043.dnkmem (mgr.34373) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:17 gibba003 bash[32348]: cluster 2021-03-10T16:00:16.785196+0000 mgr.gibba043.dnkmem (mgr.34373) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:17 gibba043 bash[24019]: cluster 2021-03-10T16:00:16.785196+0000 mgr.gibba043.dnkmem (mgr.34373) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:19 gibba003 bash[31385]: cluster 2021-03-10T16:00:18.786844+0000 mgr.gibba043.dnkmem (mgr.34373) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:19 gibba003 bash[32348]: cluster 2021-03-10T16:00:18.786844+0000 mgr.gibba043.dnkmem (mgr.34373) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:19 gibba043 bash[24019]: cluster 2021-03-10T16:00:18.786844+0000 mgr.gibba043.dnkmem (mgr.34373) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:21 gibba043 bash[24019]: cluster 2021-03-10T16:00:20.788588+0000 mgr.gibba043.dnkmem (mgr.34373) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:21 gibba043 bash[24019]: cephadm 2021-03-10T16:00:20.931531+0000 mgr.gibba043.dnkmem (mgr.34373) 6834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:21 gibba003 bash[31385]: cluster 2021-03-10T16:00:20.788588+0000 mgr.gibba043.dnkmem (mgr.34373) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:21 gibba003 bash[31385]: cephadm 2021-03-10T16:00:20.931531+0000 mgr.gibba043.dnkmem (mgr.34373) 6834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:21 gibba003 bash[32348]: cluster 2021-03-10T16:00:20.788588+0000 mgr.gibba043.dnkmem (mgr.34373) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:21 gibba003 bash[32348]: cephadm 2021-03-10T16:00:20.931531+0000 mgr.gibba043.dnkmem (mgr.34373) 6834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:24.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:23 gibba003 bash[31385]: cluster 2021-03-10T16:00:22.789809+0000 mgr.gibba043.dnkmem (mgr.34373) 6835 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:23 gibba003 bash[32348]: cluster 2021-03-10T16:00:22.789809+0000 mgr.gibba043.dnkmem (mgr.34373) 6835 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:23 gibba043 bash[24019]: cluster 2021-03-10T16:00:22.789809+0000 mgr.gibba043.dnkmem (mgr.34373) 6835 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:25 gibba003 bash[31385]: cluster 2021-03-10T16:00:24.791339+0000 mgr.gibba043.dnkmem (mgr.34373) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:25 gibba003 bash[32348]: cluster 2021-03-10T16:00:24.791339+0000 mgr.gibba043.dnkmem (mgr.34373) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:25 gibba043 bash[24019]: cluster 2021-03-10T16:00:24.791339+0000 mgr.gibba043.dnkmem (mgr.34373) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:27 gibba003 bash[31385]: cluster 2021-03-10T16:00:26.793007+0000 mgr.gibba043.dnkmem (mgr.34373) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:27 gibba003 bash[32348]: cluster 2021-03-10T16:00:26.793007+0000 mgr.gibba043.dnkmem (mgr.34373) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:27 gibba043 bash[24019]: cluster 2021-03-10T16:00:26.793007+0000 mgr.gibba043.dnkmem (mgr.34373) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:29 gibba003 bash[31385]: cluster 2021-03-10T16:00:28.794630+0000 mgr.gibba043.dnkmem (mgr.34373) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:29 gibba003 bash[32348]: cluster 2021-03-10T16:00:28.794630+0000 mgr.gibba043.dnkmem (mgr.34373) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:29 gibba043 bash[24019]: cluster 2021-03-10T16:00:28.794630+0000 mgr.gibba043.dnkmem (mgr.34373) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:31 gibba043 bash[24019]: cluster 2021-03-10T16:00:30.796254+0000 mgr.gibba043.dnkmem (mgr.34373) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:31 gibba003 bash[31385]: cluster 2021-03-10T16:00:30.796254+0000 mgr.gibba043.dnkmem (mgr.34373) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:31 gibba003 bash[32348]: cluster 2021-03-10T16:00:30.796254+0000 mgr.gibba043.dnkmem (mgr.34373) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:33 gibba003 bash[31385]: cluster 2021-03-10T16:00:32.797610+0000 mgr.gibba043.dnkmem (mgr.34373) 6840 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:33 gibba003 bash[32348]: cluster 2021-03-10T16:00:32.797610+0000 mgr.gibba043.dnkmem (mgr.34373) 6840 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:33 gibba043 bash[24019]: cluster 2021-03-10T16:00:32.797610+0000 mgr.gibba043.dnkmem (mgr.34373) 6840 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:35.778 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:00:36.008 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:00:36.009 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:00:36.009 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 90s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:00:36.009 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:00:36.010 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:00:36.010 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:00:36.010 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:00:36.010 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:00:36.011 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:00:36.011 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:00:36.011 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 90s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:00:36.011 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:00:36.012 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:00:36.012 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:00:36.012 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:00:36.012 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:00:36.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:00:36.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:00:36.013 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:00:36.013 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 90s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:00:36.013 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:00:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:35 gibba003 bash[31385]: cluster 2021-03-10T16:00:34.799127+0000 mgr.gibba043.dnkmem (mgr.34373) 6841 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:35 gibba003 bash[32348]: cluster 2021-03-10T16:00:34.799127+0000 mgr.gibba043.dnkmem (mgr.34373) 6841 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.259 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:00:36.260 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:00:36.260 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:36.260 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:00:36.261 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:00:36.261 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:36.261 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:00:36.261 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:00:36.261 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:00:36.262 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:00:36.262 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:00:36.262 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:00:36.262 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:00:36.263 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:00:36.263 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:00:36.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:35 gibba043 bash[24019]: cluster 2021-03-10T16:00:34.799127+0000 mgr.gibba043.dnkmem (mgr.34373) 6841 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:37.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[31385]: audit 2021-03-10T16:00:35.769323+0000 mgr.gibba043.dnkmem (mgr.34373) 6842 : audit [DBG] from='client.58630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:37.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[31385]: cephadm 2021-03-10T16:00:35.937869+0000 mgr.gibba043.dnkmem (mgr.34373) 6843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[31385]: audit 2021-03-10T16:00:35.998854+0000 mgr.gibba043.dnkmem (mgr.34373) 6844 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[31385]: audit 2021-03-10T16:00:36.261628+0000 mon.c (mon.1) 1776 : audit [DBG] from='client.? 172.21.2.103:0/3770460603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[32348]: audit 2021-03-10T16:00:35.769323+0000 mgr.gibba043.dnkmem (mgr.34373) 6842 : audit [DBG] from='client.58630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[32348]: cephadm 2021-03-10T16:00:35.937869+0000 mgr.gibba043.dnkmem (mgr.34373) 6843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[32348]: audit 2021-03-10T16:00:35.998854+0000 mgr.gibba043.dnkmem (mgr.34373) 6844 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:37.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:36 gibba003 bash[32348]: audit 2021-03-10T16:00:36.261628+0000 mon.c (mon.1) 1776 : audit [DBG] from='client.? 172.21.2.103:0/3770460603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:37.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:36 gibba043 bash[24019]: audit 2021-03-10T16:00:35.769323+0000 mgr.gibba043.dnkmem (mgr.34373) 6842 : audit [DBG] from='client.58630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:37.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:36 gibba043 bash[24019]: cephadm 2021-03-10T16:00:35.937869+0000 mgr.gibba043.dnkmem (mgr.34373) 6843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:36 gibba043 bash[24019]: audit 2021-03-10T16:00:35.998854+0000 mgr.gibba043.dnkmem (mgr.34373) 6844 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:36 gibba043 bash[24019]: audit 2021-03-10T16:00:36.261628+0000 mon.c (mon.1) 1776 : audit [DBG] from='client.? 172.21.2.103:0/3770460603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:37 gibba003 bash[31385]: cluster 2021-03-10T16:00:36.800804+0000 mgr.gibba043.dnkmem (mgr.34373) 6845 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:37 gibba003 bash[32348]: cluster 2021-03-10T16:00:36.800804+0000 mgr.gibba043.dnkmem (mgr.34373) 6845 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:37 gibba043 bash[24019]: cluster 2021-03-10T16:00:36.800804+0000 mgr.gibba043.dnkmem (mgr.34373) 6845 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:39 gibba003 bash[31385]: cluster 2021-03-10T16:00:38.802411+0000 mgr.gibba043.dnkmem (mgr.34373) 6846 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:39 gibba003 bash[32348]: cluster 2021-03-10T16:00:38.802411+0000 mgr.gibba043.dnkmem (mgr.34373) 6846 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:39 gibba043 bash[24019]: cluster 2021-03-10T16:00:38.802411+0000 mgr.gibba043.dnkmem (mgr.34373) 6846 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:41 gibba043 bash[24019]: cluster 2021-03-10T16:00:40.804015+0000 mgr.gibba043.dnkmem (mgr.34373) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:41 gibba003 bash[31385]: cluster 2021-03-10T16:00:40.804015+0000 mgr.gibba043.dnkmem (mgr.34373) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:41 gibba003 bash[32348]: cluster 2021-03-10T16:00:40.804015+0000 mgr.gibba043.dnkmem (mgr.34373) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:43 gibba003 bash[31385]: cluster 2021-03-10T16:00:42.805614+0000 mgr.gibba043.dnkmem (mgr.34373) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:43 gibba003 bash[32348]: cluster 2021-03-10T16:00:42.805614+0000 mgr.gibba043.dnkmem (mgr.34373) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:43 gibba043 bash[24019]: cluster 2021-03-10T16:00:42.805614+0000 mgr.gibba043.dnkmem (mgr.34373) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:45 gibba003 bash[31385]: cluster 2021-03-10T16:00:44.807210+0000 mgr.gibba043.dnkmem (mgr.34373) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:45 gibba003 bash[32348]: cluster 2021-03-10T16:00:44.807210+0000 mgr.gibba043.dnkmem (mgr.34373) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:45 gibba043 bash[24019]: cluster 2021-03-10T16:00:44.807210+0000 mgr.gibba043.dnkmem (mgr.34373) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:47 gibba003 bash[31385]: cluster 2021-03-10T16:00:46.809076+0000 mgr.gibba043.dnkmem (mgr.34373) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:47 gibba003 bash[32348]: cluster 2021-03-10T16:00:46.809076+0000 mgr.gibba043.dnkmem (mgr.34373) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:47 gibba043 bash[24019]: cluster 2021-03-10T16:00:46.809076+0000 mgr.gibba043.dnkmem (mgr.34373) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:49 gibba003 bash[31385]: cluster 2021-03-10T16:00:48.810449+0000 mgr.gibba043.dnkmem (mgr.34373) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:49 gibba003 bash[32348]: cluster 2021-03-10T16:00:48.810449+0000 mgr.gibba043.dnkmem (mgr.34373) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:49 gibba043 bash[24019]: cluster 2021-03-10T16:00:48.810449+0000 mgr.gibba043.dnkmem (mgr.34373) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:51 gibba043 bash[24019]: cluster 2021-03-10T16:00:50.812152+0000 mgr.gibba043.dnkmem (mgr.34373) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:51 gibba043 bash[24019]: cephadm 2021-03-10T16:00:50.953788+0000 mgr.gibba043.dnkmem (mgr.34373) 6853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:51 gibba003 bash[31385]: cluster 2021-03-10T16:00:50.812152+0000 mgr.gibba043.dnkmem (mgr.34373) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:51 gibba003 bash[31385]: cephadm 2021-03-10T16:00:50.953788+0000 mgr.gibba043.dnkmem (mgr.34373) 6853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:51 gibba003 bash[32348]: cluster 2021-03-10T16:00:50.812152+0000 mgr.gibba043.dnkmem (mgr.34373) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:51 gibba003 bash[32348]: cephadm 2021-03-10T16:00:50.953788+0000 mgr.gibba043.dnkmem (mgr.34373) 6853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:00:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:53 gibba003 bash[31385]: cluster 2021-03-10T16:00:52.813449+0000 mgr.gibba043.dnkmem (mgr.34373) 6854 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:53 gibba003 bash[32348]: cluster 2021-03-10T16:00:52.813449+0000 mgr.gibba043.dnkmem (mgr.34373) 6854 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:53 gibba043 bash[24019]: cluster 2021-03-10T16:00:52.813449+0000 mgr.gibba043.dnkmem (mgr.34373) 6854 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:55 gibba003 bash[31385]: cluster 2021-03-10T16:00:54.814776+0000 mgr.gibba043.dnkmem (mgr.34373) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:55 gibba003 bash[32348]: cluster 2021-03-10T16:00:54.814776+0000 mgr.gibba043.dnkmem (mgr.34373) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:55 gibba043 bash[24019]: cluster 2021-03-10T16:00:54.814776+0000 mgr.gibba043.dnkmem (mgr.34373) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:57 gibba003 bash[31385]: cluster 2021-03-10T16:00:56.816329+0000 mgr.gibba043.dnkmem (mgr.34373) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:57 gibba003 bash[32348]: cluster 2021-03-10T16:00:56.816329+0000 mgr.gibba043.dnkmem (mgr.34373) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:57 gibba043 bash[24019]: cluster 2021-03-10T16:00:56.816329+0000 mgr.gibba043.dnkmem (mgr.34373) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:00:59 gibba003 bash[31385]: cluster 2021-03-10T16:00:58.818003+0000 mgr.gibba043.dnkmem (mgr.34373) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:00:59 gibba003 bash[32348]: cluster 2021-03-10T16:00:58.818003+0000 mgr.gibba043.dnkmem (mgr.34373) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:00:59 gibba043 bash[24019]: cluster 2021-03-10T16:00:58.818003+0000 mgr.gibba043.dnkmem (mgr.34373) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:01 gibba043 bash[24019]: cluster 2021-03-10T16:01:00.819621+0000 mgr.gibba043.dnkmem (mgr.34373) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:01 gibba003 bash[31385]: cluster 2021-03-10T16:01:00.819621+0000 mgr.gibba043.dnkmem (mgr.34373) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:01 gibba003 bash[32348]: cluster 2021-03-10T16:01:00.819621+0000 mgr.gibba043.dnkmem (mgr.34373) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:03 gibba003 bash[31385]: cluster 2021-03-10T16:01:02.820917+0000 mgr.gibba043.dnkmem (mgr.34373) 6859 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:03 gibba003 bash[32348]: cluster 2021-03-10T16:01:02.820917+0000 mgr.gibba043.dnkmem (mgr.34373) 6859 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:03 gibba043 bash[24019]: cluster 2021-03-10T16:01:02.820917+0000 mgr.gibba043.dnkmem (mgr.34373) 6859 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:05 gibba003 bash[31385]: cluster 2021-03-10T16:01:04.822225+0000 mgr.gibba043.dnkmem (mgr.34373) 6860 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:05 gibba003 bash[32348]: cluster 2021-03-10T16:01:04.822225+0000 mgr.gibba043.dnkmem (mgr.34373) 6860 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.190 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:05 gibba043 bash[24019]: cluster 2021-03-10T16:01:04.822225+0000 mgr.gibba043.dnkmem (mgr.34373) 6860 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.499 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:01:06.729 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:01:06.729 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:01:06.730 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:01:06.730 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:01:06.730 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:01:06.730 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:01:06.731 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:01:06.731 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:01:06.731 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:01:06.731 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:01:06.732 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:01:06.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:01:06.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:01:06.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:01:06.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:01:06.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:01:06.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:01:06.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:01:06.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:01:06.734 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:01:06.734 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:01:06.981 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:01:06.981 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:01:06.982 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:06.982 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:01:06.982 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:01:06.982 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:06.982 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:01:06.983 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:01:06.983 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:01:06.983 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:01:06.983 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:01:06.984 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:01:06.984 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:01:06.984 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:01:06.984 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:01:07.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: cephadm 2021-03-10T16:01:05.970585+0000 mgr.gibba043.dnkmem (mgr.34373) 6861 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:01:07.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: cephadm 2021-03-10T16:01:05.972216+0000 mgr.gibba043.dnkmem (mgr.34373) 6862 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:01:07.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.179849+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:01:07.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.183524+0000 mon.c (mon.1) 1777 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.184833+0000 mon.c (mon.1) 1778 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.186211+0000 mon.c (mon.1) 1779 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.187526+0000 mon.c (mon.1) 1780 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.190817+0000 mon.c (mon.1) 1781 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[31385]: audit 2021-03-10T16:01:06.191991+0000 mon.c (mon.1) 1782 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: cephadm 2021-03-10T16:01:05.970585+0000 mgr.gibba043.dnkmem (mgr.34373) 6861 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:01:07.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: cephadm 2021-03-10T16:01:05.972216+0000 mgr.gibba043.dnkmem (mgr.34373) 6862 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:01:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.179849+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:01:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.183524+0000 mon.c (mon.1) 1777 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.184833+0000 mon.c (mon.1) 1778 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.186211+0000 mon.c (mon.1) 1779 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.187526+0000 mon.c (mon.1) 1780 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.190817+0000 mon.c (mon.1) 1781 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:06 gibba003 bash[32348]: audit 2021-03-10T16:01:06.191991+0000 mon.c (mon.1) 1782 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: cephadm 2021-03-10T16:01:05.970585+0000 mgr.gibba043.dnkmem (mgr.34373) 6861 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:01:07.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: cephadm 2021-03-10T16:01:05.972216+0000 mgr.gibba043.dnkmem (mgr.34373) 6862 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:01:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.179849+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:01:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.183524+0000 mon.c (mon.1) 1777 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.184833+0000 mon.c (mon.1) 1778 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.186211+0000 mon.c (mon.1) 1779 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.187526+0000 mon.c (mon.1) 1780 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.190817+0000 mon.c (mon.1) 1781 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:06 gibba043 bash[24019]: audit 2021-03-10T16:01:06.191991+0000 mon.c (mon.1) 1782 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.181207+0000 mgr.gibba043.dnkmem (mgr.34373) 6863 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.182927+0000 mgr.gibba043.dnkmem (mgr.34373) 6864 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.184262+0000 mgr.gibba043.dnkmem (mgr.34373) 6865 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.184301+0000 mgr.gibba043.dnkmem (mgr.34373) 6866 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.185502+0000 mgr.gibba043.dnkmem (mgr.34373) 6867 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.185538+0000 mgr.gibba043.dnkmem (mgr.34373) 6868 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.186858+0000 mgr.gibba043.dnkmem (mgr.34373) 6869 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.188622+0000 mgr.gibba043.dnkmem (mgr.34373) 6870 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.188658+0000 mgr.gibba043.dnkmem (mgr.34373) 6871 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.189851+0000 mgr.gibba043.dnkmem (mgr.34373) 6872 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.190159+0000 mgr.gibba043.dnkmem (mgr.34373) 6873 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.191068+0000 mgr.gibba043.dnkmem (mgr.34373) 6874 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.191103+0000 mgr.gibba043.dnkmem (mgr.34373) 6875 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cephadm 2021-03-10T16:01:06.191285+0000 mgr.gibba043.dnkmem (mgr.34373) 6876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: audit 2021-03-10T16:01:06.491733+0000 mgr.gibba043.dnkmem (mgr.34373) 6877 : audit [DBG] from='client.58648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: audit 2021-03-10T16:01:06.717499+0000 mgr.gibba043.dnkmem (mgr.34373) 6878 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: cluster 2021-03-10T16:01:06.823890+0000 mgr.gibba043.dnkmem (mgr.34373) 6879 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:08.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[31385]: audit 2021-03-10T16:01:06.982946+0000 mon.c (mon.1) 1783 : audit [DBG] from='client.? 172.21.2.103:0/763253436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:08.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.181207+0000 mgr.gibba043.dnkmem (mgr.34373) 6863 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:08.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.182927+0000 mgr.gibba043.dnkmem (mgr.34373) 6864 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:08.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.184262+0000 mgr.gibba043.dnkmem (mgr.34373) 6865 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:08.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.184301+0000 mgr.gibba043.dnkmem (mgr.34373) 6866 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:08.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.185502+0000 mgr.gibba043.dnkmem (mgr.34373) 6867 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:08.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.185538+0000 mgr.gibba043.dnkmem (mgr.34373) 6868 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.186858+0000 mgr.gibba043.dnkmem (mgr.34373) 6869 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.188622+0000 mgr.gibba043.dnkmem (mgr.34373) 6870 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.188658+0000 mgr.gibba043.dnkmem (mgr.34373) 6871 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.189851+0000 mgr.gibba043.dnkmem (mgr.34373) 6872 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:08.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.190159+0000 mgr.gibba043.dnkmem (mgr.34373) 6873 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:08.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.191068+0000 mgr.gibba043.dnkmem (mgr.34373) 6874 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:08.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.191103+0000 mgr.gibba043.dnkmem (mgr.34373) 6875 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:08.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cephadm 2021-03-10T16:01:06.191285+0000 mgr.gibba043.dnkmem (mgr.34373) 6876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:08.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: audit 2021-03-10T16:01:06.491733+0000 mgr.gibba043.dnkmem (mgr.34373) 6877 : audit [DBG] from='client.58648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:08.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: audit 2021-03-10T16:01:06.717499+0000 mgr.gibba043.dnkmem (mgr.34373) 6878 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:08.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: cluster 2021-03-10T16:01:06.823890+0000 mgr.gibba043.dnkmem (mgr.34373) 6879 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:08.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:07 gibba003 bash[32348]: audit 2021-03-10T16:01:06.982946+0000 mon.c (mon.1) 1783 : audit [DBG] from='client.? 172.21.2.103:0/763253436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.181207+0000 mgr.gibba043.dnkmem (mgr.34373) 6863 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.182927+0000 mgr.gibba043.dnkmem (mgr.34373) 6864 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.184262+0000 mgr.gibba043.dnkmem (mgr.34373) 6865 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.184301+0000 mgr.gibba043.dnkmem (mgr.34373) 6866 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.185502+0000 mgr.gibba043.dnkmem (mgr.34373) 6867 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.185538+0000 mgr.gibba043.dnkmem (mgr.34373) 6868 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.186858+0000 mgr.gibba043.dnkmem (mgr.34373) 6869 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.188622+0000 mgr.gibba043.dnkmem (mgr.34373) 6870 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.188658+0000 mgr.gibba043.dnkmem (mgr.34373) 6871 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.189851+0000 mgr.gibba043.dnkmem (mgr.34373) 6872 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.190159+0000 mgr.gibba043.dnkmem (mgr.34373) 6873 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.191068+0000 mgr.gibba043.dnkmem (mgr.34373) 6874 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.191103+0000 mgr.gibba043.dnkmem (mgr.34373) 6875 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cephadm 2021-03-10T16:01:06.191285+0000 mgr.gibba043.dnkmem (mgr.34373) 6876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: audit 2021-03-10T16:01:06.491733+0000 mgr.gibba043.dnkmem (mgr.34373) 6877 : audit [DBG] from='client.58648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: audit 2021-03-10T16:01:06.717499+0000 mgr.gibba043.dnkmem (mgr.34373) 6878 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: cluster 2021-03-10T16:01:06.823890+0000 mgr.gibba043.dnkmem (mgr.34373) 6879 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:07 gibba043 bash[24019]: audit 2021-03-10T16:01:06.982946+0000 mon.c (mon.1) 1783 : audit [DBG] from='client.? 172.21.2.103:0/763253436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:10.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:09 gibba003 bash[31385]: cluster 2021-03-10T16:01:08.825555+0000 mgr.gibba043.dnkmem (mgr.34373) 6880 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:09 gibba003 bash[32348]: cluster 2021-03-10T16:01:08.825555+0000 mgr.gibba043.dnkmem (mgr.34373) 6880 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:10.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:09 gibba043 bash[24019]: cluster 2021-03-10T16:01:08.825555+0000 mgr.gibba043.dnkmem (mgr.34373) 6880 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:11 gibba043 bash[24019]: cluster 2021-03-10T16:01:10.827242+0000 mgr.gibba043.dnkmem (mgr.34373) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:11 gibba003 bash[31385]: cluster 2021-03-10T16:01:10.827242+0000 mgr.gibba043.dnkmem (mgr.34373) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:11 gibba003 bash[32348]: cluster 2021-03-10T16:01:10.827242+0000 mgr.gibba043.dnkmem (mgr.34373) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.230 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: cluster 2021-03-10T16:01:12.828891+0000 mgr.gibba043.dnkmem (mgr.34373) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.230 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.556461+0000 mon.c (mon.1) 1784 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:14.230 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.557597+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:14.231 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.718656+0000 mon.c (mon.1) 1785 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:14.231 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.719778+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:14.231 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.863594+0000 mon.c (mon.1) 1786 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:01:14.231 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.864318+0000 mon.c (mon.1) 1787 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.232 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.864978+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:01:14.232 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.865012+0000 mon.c (mon.1) 1788 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:01:14.232 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.865847+0000 mon.c (mon.1) 1789 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.232 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.866877+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.233 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.867169+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:01:14.233 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[31385]: audit 2021-03-10T16:01:13.867404+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.233 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: cluster 2021-03-10T16:01:12.828891+0000 mgr.gibba043.dnkmem (mgr.34373) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.556461+0000 mon.c (mon.1) 1784 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:14.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.557597+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:14.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.718656+0000 mon.c (mon.1) 1785 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:14.234 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.719778+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:14.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.863594+0000 mon.c (mon.1) 1786 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:01:14.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.864318+0000 mon.c (mon.1) 1787 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.864978+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:01:14.235 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.865012+0000 mon.c (mon.1) 1788 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:01:14.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.865847+0000 mon.c (mon.1) 1789 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.866877+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.867169+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:01:14.236 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:13 gibba003 bash[32348]: audit 2021-03-10T16:01:13.867404+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.309 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: cluster 2021-03-10T16:01:12.828891+0000 mgr.gibba043.dnkmem (mgr.34373) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.309 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.556461+0000 mon.c (mon.1) 1784 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:14.310 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.557597+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:14.310 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.718656+0000 mon.c (mon.1) 1785 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:14.310 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.719778+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:14.310 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.863594+0000 mon.c (mon.1) 1786 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:01:14.311 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.864318+0000 mon.c (mon.1) 1787 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.311 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.864978+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:01:14.311 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.865012+0000 mon.c (mon.1) 1788 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:01:14.311 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.865847+0000 mon.c (mon.1) 1789 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.312 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.866877+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:14.312 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.867169+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:01:14.312 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:13 gibba043 bash[24019]: audit 2021-03-10T16:01:13.867404+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:15 gibba003 bash[31385]: cluster 2021-03-10T16:01:14.830280+0000 mgr.gibba043.dnkmem (mgr.34373) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:15 gibba003 bash[32348]: cluster 2021-03-10T16:01:14.830280+0000 mgr.gibba043.dnkmem (mgr.34373) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:15 gibba043 bash[24019]: cluster 2021-03-10T16:01:14.830280+0000 mgr.gibba043.dnkmem (mgr.34373) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:17 gibba003 bash[31385]: cluster 2021-03-10T16:01:16.832033+0000 mgr.gibba043.dnkmem (mgr.34373) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:17 gibba003 bash[32348]: cluster 2021-03-10T16:01:16.832033+0000 mgr.gibba043.dnkmem (mgr.34373) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:17 gibba043 bash[24019]: cluster 2021-03-10T16:01:16.832033+0000 mgr.gibba043.dnkmem (mgr.34373) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:20.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:19 gibba003 bash[31385]: cluster 2021-03-10T16:01:18.833643+0000 mgr.gibba043.dnkmem (mgr.34373) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:19 gibba003 bash[32348]: cluster 2021-03-10T16:01:18.833643+0000 mgr.gibba043.dnkmem (mgr.34373) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:20.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:19 gibba043 bash[24019]: cluster 2021-03-10T16:01:18.833643+0000 mgr.gibba043.dnkmem (mgr.34373) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:21 gibba043 bash[24019]: cluster 2021-03-10T16:01:20.835288+0000 mgr.gibba043.dnkmem (mgr.34373) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:21 gibba003 bash[31385]: cluster 2021-03-10T16:01:20.835288+0000 mgr.gibba043.dnkmem (mgr.34373) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:21 gibba003 bash[32348]: cluster 2021-03-10T16:01:20.835288+0000 mgr.gibba043.dnkmem (mgr.34373) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:22.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:22 gibba043 bash[24019]: cephadm 2021-03-10T16:01:21.207382+0000 mgr.gibba043.dnkmem (mgr.34373) 6887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:22.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:22 gibba003 bash[31385]: cephadm 2021-03-10T16:01:21.207382+0000 mgr.gibba043.dnkmem (mgr.34373) 6887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:22.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:22 gibba003 bash[32348]: cephadm 2021-03-10T16:01:21.207382+0000 mgr.gibba043.dnkmem (mgr.34373) 6887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:23 gibba003 bash[31385]: cluster 2021-03-10T16:01:22.836798+0000 mgr.gibba043.dnkmem (mgr.34373) 6888 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:23 gibba003 bash[32348]: cluster 2021-03-10T16:01:22.836798+0000 mgr.gibba043.dnkmem (mgr.34373) 6888 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:23 gibba043 bash[24019]: cluster 2021-03-10T16:01:22.836798+0000 mgr.gibba043.dnkmem (mgr.34373) 6888 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:26.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:25 gibba003 bash[31385]: cluster 2021-03-10T16:01:24.838214+0000 mgr.gibba043.dnkmem (mgr.34373) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:25 gibba003 bash[32348]: cluster 2021-03-10T16:01:24.838214+0000 mgr.gibba043.dnkmem (mgr.34373) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:25 gibba043 bash[24019]: cluster 2021-03-10T16:01:24.838214+0000 mgr.gibba043.dnkmem (mgr.34373) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:27 gibba003 bash[31385]: cluster 2021-03-10T16:01:26.839855+0000 mgr.gibba043.dnkmem (mgr.34373) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:27 gibba003 bash[32348]: cluster 2021-03-10T16:01:26.839855+0000 mgr.gibba043.dnkmem (mgr.34373) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:27 gibba043 bash[24019]: cluster 2021-03-10T16:01:26.839855+0000 mgr.gibba043.dnkmem (mgr.34373) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:30.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:29 gibba003 bash[31385]: cluster 2021-03-10T16:01:28.841472+0000 mgr.gibba043.dnkmem (mgr.34373) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:29 gibba003 bash[32348]: cluster 2021-03-10T16:01:28.841472+0000 mgr.gibba043.dnkmem (mgr.34373) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:29 gibba043 bash[24019]: cluster 2021-03-10T16:01:28.841472+0000 mgr.gibba043.dnkmem (mgr.34373) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:31 gibba043 bash[24019]: cluster 2021-03-10T16:01:30.843136+0000 mgr.gibba043.dnkmem (mgr.34373) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:31 gibba003 bash[31385]: cluster 2021-03-10T16:01:30.843136+0000 mgr.gibba043.dnkmem (mgr.34373) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:31 gibba003 bash[32348]: cluster 2021-03-10T16:01:30.843136+0000 mgr.gibba043.dnkmem (mgr.34373) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:33 gibba003 bash[31385]: cluster 2021-03-10T16:01:32.844632+0000 mgr.gibba043.dnkmem (mgr.34373) 6893 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:33 gibba003 bash[32348]: cluster 2021-03-10T16:01:32.844632+0000 mgr.gibba043.dnkmem (mgr.34373) 6893 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:33 gibba043 bash[24019]: cluster 2021-03-10T16:01:32.844632+0000 mgr.gibba043.dnkmem (mgr.34373) 6893 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:35 gibba003 bash[31385]: cluster 2021-03-10T16:01:34.846063+0000 mgr.gibba043.dnkmem (mgr.34373) 6894 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:35 gibba003 bash[32348]: cluster 2021-03-10T16:01:34.846063+0000 mgr.gibba043.dnkmem (mgr.34373) 6894 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:36.215 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:35 gibba043 bash[24019]: cluster 2021-03-10T16:01:34.846063+0000 mgr.gibba043.dnkmem (mgr.34373) 6894 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:37.224 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:01:37.452 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:01:37.453 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:01:37.453 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:01:37.453 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:01:37.453 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:01:37.454 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:01:37.454 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:01:37.454 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:01:37.454 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:01:37.455 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:01:37.455 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:01:37.455 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:01:37.455 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:01:37.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:01:37.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:01:37.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:01:37.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:01:37.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:01:37.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:01:37.457 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:01:37.457 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:01:37.703 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:01:37.703 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:01:37.703 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:37.704 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:01:37.704 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:01:37.704 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:37.704 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:01:37.704 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:01:37.705 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:01:37.705 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:01:37.705 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:01:37.705 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:01:37.706 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:01:37.706 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:01:37.706 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:01:38.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:37 gibba003 bash[31385]: cephadm 2021-03-10T16:01:36.214911+0000 mgr.gibba043.dnkmem (mgr.34373) 6895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:37 gibba003 bash[31385]: cluster 2021-03-10T16:01:36.847870+0000 mgr.gibba043.dnkmem (mgr.34373) 6896 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:37 gibba003 bash[31385]: audit 2021-03-10T16:01:37.704853+0000 mon.c (mon.1) 1790 : audit [DBG] from='client.? 172.21.2.103:0/3716632547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:37 gibba003 bash[32348]: cephadm 2021-03-10T16:01:36.214911+0000 mgr.gibba043.dnkmem (mgr.34373) 6895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:37 gibba003 bash[32348]: cluster 2021-03-10T16:01:36.847870+0000 mgr.gibba043.dnkmem (mgr.34373) 6896 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:37 gibba003 bash[32348]: audit 2021-03-10T16:01:37.704853+0000 mon.c (mon.1) 1790 : audit [DBG] from='client.? 172.21.2.103:0/3716632547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:38.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:37 gibba043 bash[24019]: cephadm 2021-03-10T16:01:36.214911+0000 mgr.gibba043.dnkmem (mgr.34373) 6895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:38.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:37 gibba043 bash[24019]: cluster 2021-03-10T16:01:36.847870+0000 mgr.gibba043.dnkmem (mgr.34373) 6896 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:37 gibba043 bash[24019]: audit 2021-03-10T16:01:37.704853+0000 mon.c (mon.1) 1790 : audit [DBG] from='client.? 172.21.2.103:0/3716632547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:39.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:38 gibba003 bash[31385]: audit 2021-03-10T16:01:37.215279+0000 mgr.gibba043.dnkmem (mgr.34373) 6897 : audit [DBG] from='client.58666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:38 gibba003 bash[31385]: audit 2021-03-10T16:01:37.441278+0000 mgr.gibba043.dnkmem (mgr.34373) 6898 : audit [DBG] from='client.58672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:38 gibba003 bash[32348]: audit 2021-03-10T16:01:37.215279+0000 mgr.gibba043.dnkmem (mgr.34373) 6897 : audit [DBG] from='client.58666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:38 gibba003 bash[32348]: audit 2021-03-10T16:01:37.441278+0000 mgr.gibba043.dnkmem (mgr.34373) 6898 : audit [DBG] from='client.58672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:39.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:38 gibba043 bash[24019]: audit 2021-03-10T16:01:37.215279+0000 mgr.gibba043.dnkmem (mgr.34373) 6897 : audit [DBG] from='client.58666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:39.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:38 gibba043 bash[24019]: audit 2021-03-10T16:01:37.441278+0000 mgr.gibba043.dnkmem (mgr.34373) 6898 : audit [DBG] from='client.58672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:39 gibba043 bash[24019]: cluster 2021-03-10T16:01:38.849540+0000 mgr.gibba043.dnkmem (mgr.34373) 6899 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:40.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:39 gibba003 bash[31385]: cluster 2021-03-10T16:01:38.849540+0000 mgr.gibba043.dnkmem (mgr.34373) 6899 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:40.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:39 gibba003 bash[32348]: cluster 2021-03-10T16:01:38.849540+0000 mgr.gibba043.dnkmem (mgr.34373) 6899 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:41 gibba003 bash[32348]: cluster 2021-03-10T16:01:40.851092+0000 mgr.gibba043.dnkmem (mgr.34373) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:41 gibba003 bash[31385]: cluster 2021-03-10T16:01:40.851092+0000 mgr.gibba043.dnkmem (mgr.34373) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:41 gibba043 bash[24019]: cluster 2021-03-10T16:01:40.851092+0000 mgr.gibba043.dnkmem (mgr.34373) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:43 gibba003 bash[31385]: cluster 2021-03-10T16:01:42.852715+0000 mgr.gibba043.dnkmem (mgr.34373) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:43 gibba003 bash[32348]: cluster 2021-03-10T16:01:42.852715+0000 mgr.gibba043.dnkmem (mgr.34373) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:43 gibba043 bash[24019]: cluster 2021-03-10T16:01:42.852715+0000 mgr.gibba043.dnkmem (mgr.34373) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:45 gibba003 bash[31385]: cluster 2021-03-10T16:01:44.854204+0000 mgr.gibba043.dnkmem (mgr.34373) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:45 gibba003 bash[32348]: cluster 2021-03-10T16:01:44.854204+0000 mgr.gibba043.dnkmem (mgr.34373) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:45 gibba043 bash[24019]: cluster 2021-03-10T16:01:44.854204+0000 mgr.gibba043.dnkmem (mgr.34373) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:47 gibba003 bash[31385]: cluster 2021-03-10T16:01:46.855725+0000 mgr.gibba043.dnkmem (mgr.34373) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:47 gibba003 bash[32348]: cluster 2021-03-10T16:01:46.855725+0000 mgr.gibba043.dnkmem (mgr.34373) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:47 gibba043 bash[24019]: cluster 2021-03-10T16:01:46.855725+0000 mgr.gibba043.dnkmem (mgr.34373) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:49 gibba043 bash[24019]: cluster 2021-03-10T16:01:48.857076+0000 mgr.gibba043.dnkmem (mgr.34373) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:50.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:49 gibba003 bash[31385]: cluster 2021-03-10T16:01:48.857076+0000 mgr.gibba043.dnkmem (mgr.34373) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:50.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:49 gibba003 bash[32348]: cluster 2021-03-10T16:01:48.857076+0000 mgr.gibba043.dnkmem (mgr.34373) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:51 gibba003 bash[31385]: cluster 2021-03-10T16:01:50.858623+0000 mgr.gibba043.dnkmem (mgr.34373) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:51 gibba003 bash[32348]: cluster 2021-03-10T16:01:50.858623+0000 mgr.gibba043.dnkmem (mgr.34373) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:51 gibba043 bash[24019]: cluster 2021-03-10T16:01:50.858623+0000 mgr.gibba043.dnkmem (mgr.34373) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:52.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:52 gibba003 bash[31385]: cephadm 2021-03-10T16:01:51.230947+0000 mgr.gibba043.dnkmem (mgr.34373) 6906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:52.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:52 gibba003 bash[32348]: cephadm 2021-03-10T16:01:51.230947+0000 mgr.gibba043.dnkmem (mgr.34373) 6906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:52 gibba043 bash[24019]: cephadm 2021-03-10T16:01:51.230947+0000 mgr.gibba043.dnkmem (mgr.34373) 6906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:01:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:53 gibba003 bash[31385]: cluster 2021-03-10T16:01:52.860296+0000 mgr.gibba043.dnkmem (mgr.34373) 6907 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:53 gibba003 bash[32348]: cluster 2021-03-10T16:01:52.860296+0000 mgr.gibba043.dnkmem (mgr.34373) 6907 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:53 gibba043 bash[24019]: cluster 2021-03-10T16:01:52.860296+0000 mgr.gibba043.dnkmem (mgr.34373) 6907 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:55 gibba003 bash[31385]: cluster 2021-03-10T16:01:54.861737+0000 mgr.gibba043.dnkmem (mgr.34373) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:55 gibba003 bash[32348]: cluster 2021-03-10T16:01:54.861737+0000 mgr.gibba043.dnkmem (mgr.34373) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:55 gibba043 bash[24019]: cluster 2021-03-10T16:01:54.861737+0000 mgr.gibba043.dnkmem (mgr.34373) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:57 gibba003 bash[31385]: cluster 2021-03-10T16:01:56.863256+0000 mgr.gibba043.dnkmem (mgr.34373) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:57 gibba003 bash[32348]: cluster 2021-03-10T16:01:56.863256+0000 mgr.gibba043.dnkmem (mgr.34373) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:57 gibba043 bash[24019]: cluster 2021-03-10T16:01:56.863256+0000 mgr.gibba043.dnkmem (mgr.34373) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:01:59 gibba043 bash[24019]: cluster 2021-03-10T16:01:58.864694+0000 mgr.gibba043.dnkmem (mgr.34373) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:01:59 gibba003 bash[31385]: cluster 2021-03-10T16:01:58.864694+0000 mgr.gibba043.dnkmem (mgr.34373) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:01:59 gibba003 bash[32348]: cluster 2021-03-10T16:01:58.864694+0000 mgr.gibba043.dnkmem (mgr.34373) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:01 gibba003 bash[31385]: cluster 2021-03-10T16:02:00.866333+0000 mgr.gibba043.dnkmem (mgr.34373) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:01 gibba003 bash[32348]: cluster 2021-03-10T16:02:00.866333+0000 mgr.gibba043.dnkmem (mgr.34373) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:01 gibba043 bash[24019]: cluster 2021-03-10T16:02:00.866333+0000 mgr.gibba043.dnkmem (mgr.34373) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:03 gibba003 bash[31385]: cluster 2021-03-10T16:02:02.867895+0000 mgr.gibba043.dnkmem (mgr.34373) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:03 gibba003 bash[32348]: cluster 2021-03-10T16:02:02.867895+0000 mgr.gibba043.dnkmem (mgr.34373) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:03 gibba043 bash[24019]: cluster 2021-03-10T16:02:02.867895+0000 mgr.gibba043.dnkmem (mgr.34373) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:06.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:05 gibba043 bash[24019]: cluster 2021-03-10T16:02:04.869474+0000 mgr.gibba043.dnkmem (mgr.34373) 6913 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:06.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:05 gibba003 bash[32348]: cluster 2021-03-10T16:02:04.869474+0000 mgr.gibba043.dnkmem (mgr.34373) 6913 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:05 gibba003 bash[31385]: cluster 2021-03-10T16:02:04.869474+0000 mgr.gibba043.dnkmem (mgr.34373) 6913 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.247807+0000 mgr.gibba043.dnkmem (mgr.34373) 6914 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:02:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.249323+0000 mgr.gibba043.dnkmem (mgr.34373) 6915 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:02:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.472348+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:02:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.473595+0000 mgr.gibba043.dnkmem (mgr.34373) 6916 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.475520+0000 mgr.gibba043.dnkmem (mgr.34373) 6917 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:07.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.475998+0000 mon.c (mon.1) 1791 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.476806+0000 mgr.gibba043.dnkmem (mgr.34373) 6918 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.476847+0000 mgr.gibba043.dnkmem (mgr.34373) 6919 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.477408+0000 mon.c (mon.1) 1792 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.478324+0000 mgr.gibba043.dnkmem (mgr.34373) 6920 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:07.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.478359+0000 mgr.gibba043.dnkmem (mgr.34373) 6921 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:07.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.478927+0000 mon.c (mon.1) 1793 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.479507+0000 mgr.gibba043.dnkmem (mgr.34373) 6922 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:07.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.480163+0000 mon.c (mon.1) 1794 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.480808+0000 mgr.gibba043.dnkmem (mgr.34373) 6923 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:07.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.480844+0000 mgr.gibba043.dnkmem (mgr.34373) 6924 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:07.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.482157+0000 mgr.gibba043.dnkmem (mgr.34373) 6925 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:07.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.482498+0000 mgr.gibba043.dnkmem (mgr.34373) 6926 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:07.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.482890+0000 mon.c (mon.1) 1795 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.483427+0000 mgr.gibba043.dnkmem (mgr.34373) 6927 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:07.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.483465+0000 mgr.gibba043.dnkmem (mgr.34373) 6928 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:07.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cephadm 2021-03-10T16:02:06.483569+0000 mgr.gibba043.dnkmem (mgr.34373) 6929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:07.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: audit 2021-03-10T16:02:06.484288+0000 mon.c (mon.1) 1796 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:07 gibba043 bash[24019]: cluster 2021-03-10T16:02:06.871146+0000 mgr.gibba043.dnkmem (mgr.34373) 6930 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.247807+0000 mgr.gibba043.dnkmem (mgr.34373) 6914 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:02:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.249323+0000 mgr.gibba043.dnkmem (mgr.34373) 6915 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:02:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.472348+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:02:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.473595+0000 mgr.gibba043.dnkmem (mgr.34373) 6916 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.475520+0000 mgr.gibba043.dnkmem (mgr.34373) 6917 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.475998+0000 mon.c (mon.1) 1791 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.476806+0000 mgr.gibba043.dnkmem (mgr.34373) 6918 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.476847+0000 mgr.gibba043.dnkmem (mgr.34373) 6919 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.477408+0000 mon.c (mon.1) 1792 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.478324+0000 mgr.gibba043.dnkmem (mgr.34373) 6920 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:07.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.478359+0000 mgr.gibba043.dnkmem (mgr.34373) 6921 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.478927+0000 mon.c (mon.1) 1793 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.479507+0000 mgr.gibba043.dnkmem (mgr.34373) 6922 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.480163+0000 mon.c (mon.1) 1794 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.480808+0000 mgr.gibba043.dnkmem (mgr.34373) 6923 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.480844+0000 mgr.gibba043.dnkmem (mgr.34373) 6924 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.482157+0000 mgr.gibba043.dnkmem (mgr.34373) 6925 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.482498+0000 mgr.gibba043.dnkmem (mgr.34373) 6926 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:07.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.482890+0000 mon.c (mon.1) 1795 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.483427+0000 mgr.gibba043.dnkmem (mgr.34373) 6927 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.483465+0000 mgr.gibba043.dnkmem (mgr.34373) 6928 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cephadm 2021-03-10T16:02:06.483569+0000 mgr.gibba043.dnkmem (mgr.34373) 6929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: audit 2021-03-10T16:02:06.484288+0000 mon.c (mon.1) 1796 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[31385]: cluster 2021-03-10T16:02:06.871146+0000 mgr.gibba043.dnkmem (mgr.34373) 6930 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:07.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.247807+0000 mgr.gibba043.dnkmem (mgr.34373) 6914 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:02:07.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.249323+0000 mgr.gibba043.dnkmem (mgr.34373) 6915 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:02:07.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.472348+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:02:07.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.473595+0000 mgr.gibba043.dnkmem (mgr.34373) 6916 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:07.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.475520+0000 mgr.gibba043.dnkmem (mgr.34373) 6917 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:07.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.475998+0000 mon.c (mon.1) 1791 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.476806+0000 mgr.gibba043.dnkmem (mgr.34373) 6918 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.476847+0000 mgr.gibba043.dnkmem (mgr.34373) 6919 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.477408+0000 mon.c (mon.1) 1792 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.478324+0000 mgr.gibba043.dnkmem (mgr.34373) 6920 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.478359+0000 mgr.gibba043.dnkmem (mgr.34373) 6921 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.478927+0000 mon.c (mon.1) 1793 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.479507+0000 mgr.gibba043.dnkmem (mgr.34373) 6922 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:07.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.480163+0000 mon.c (mon.1) 1794 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.480808+0000 mgr.gibba043.dnkmem (mgr.34373) 6923 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.480844+0000 mgr.gibba043.dnkmem (mgr.34373) 6924 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.482157+0000 mgr.gibba043.dnkmem (mgr.34373) 6925 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:07.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.482498+0000 mgr.gibba043.dnkmem (mgr.34373) 6926 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.482890+0000 mon.c (mon.1) 1795 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.483427+0000 mgr.gibba043.dnkmem (mgr.34373) 6927 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:07.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.483465+0000 mgr.gibba043.dnkmem (mgr.34373) 6928 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:07.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cephadm 2021-03-10T16:02:06.483569+0000 mgr.gibba043.dnkmem (mgr.34373) 6929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:07.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: audit 2021-03-10T16:02:06.484288+0000 mon.c (mon.1) 1796 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:07.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:07 gibba003 bash[32348]: cluster 2021-03-10T16:02:06.871146+0000 mgr.gibba043.dnkmem (mgr.34373) 6930 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:07.952 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:02:08.201 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:02:08.201 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:02:08.202 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:02:08.202 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:02:08.202 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:02:08.202 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:02:08.203 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:02:08.203 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:02:08.203 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:02:08.203 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:02:08.204 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:02:08.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:02:08.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:02:08.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:02:08.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:02:08.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:02:08.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:02:08.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:02:08.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:02:08.205 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:02:08.206 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:02:08.450 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:02:08.450 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:02:08.450 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:08.451 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:02:08.451 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:02:08.451 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:08.451 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:02:08.452 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:02:08.452 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:02:08.452 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:02:08.452 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:02:08.452 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:02:08.453 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:02:08.453 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:02:08.453 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:02:08.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:08 gibba043 bash[24019]: audit 2021-03-10T16:02:07.938680+0000 mgr.gibba043.dnkmem (mgr.34373) 6931 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:08.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:08 gibba043 bash[24019]: audit 2021-03-10T16:02:08.451764+0000 mon.c (mon.1) 1797 : audit [DBG] from='client.? 172.21.2.103:0/678310285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:08 gibba003 bash[31385]: audit 2021-03-10T16:02:07.938680+0000 mgr.gibba043.dnkmem (mgr.34373) 6931 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:08 gibba003 bash[31385]: audit 2021-03-10T16:02:08.451764+0000 mon.c (mon.1) 1797 : audit [DBG] from='client.? 172.21.2.103:0/678310285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:08 gibba003 bash[32348]: audit 2021-03-10T16:02:07.938680+0000 mgr.gibba043.dnkmem (mgr.34373) 6931 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:08 gibba003 bash[32348]: audit 2021-03-10T16:02:08.451764+0000 mon.c (mon.1) 1797 : audit [DBG] from='client.? 172.21.2.103:0/678310285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:09 gibba043 bash[24019]: audit 2021-03-10T16:02:08.161244+0000 mgr.gibba043.dnkmem (mgr.34373) 6932 : audit [DBG] from='client.58690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:09.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:09 gibba043 bash[24019]: cluster 2021-03-10T16:02:08.872679+0000 mgr.gibba043.dnkmem (mgr.34373) 6933 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:09 gibba003 bash[31385]: audit 2021-03-10T16:02:08.161244+0000 mgr.gibba043.dnkmem (mgr.34373) 6932 : audit [DBG] from='client.58690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:09 gibba003 bash[31385]: cluster 2021-03-10T16:02:08.872679+0000 mgr.gibba043.dnkmem (mgr.34373) 6933 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:09 gibba003 bash[32348]: audit 2021-03-10T16:02:08.161244+0000 mgr.gibba043.dnkmem (mgr.34373) 6932 : audit [DBG] from='client.58690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:09 gibba003 bash[32348]: cluster 2021-03-10T16:02:08.872679+0000 mgr.gibba043.dnkmem (mgr.34373) 6933 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:11 gibba003 bash[31385]: cluster 2021-03-10T16:02:10.874391+0000 mgr.gibba043.dnkmem (mgr.34373) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:11 gibba003 bash[32348]: cluster 2021-03-10T16:02:10.874391+0000 mgr.gibba043.dnkmem (mgr.34373) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:11 gibba043 bash[24019]: cluster 2021-03-10T16:02:10.874391+0000 mgr.gibba043.dnkmem (mgr.34373) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: cluster 2021-03-10T16:02:12.875738+0000 mgr.gibba043.dnkmem (mgr.34373) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.563803+0000 mon.c (mon.1) 1798 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.564946+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.727464+0000 mon.c (mon.1) 1799 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.728574+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.872451+0000 mon.c (mon.1) 1800 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:02:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.873216+0000 mon.c (mon.1) 1801 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.873649+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:02:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.873919+0000 mon.c (mon.1) 1802 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:02:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.874807+0000 mon.c (mon.1) 1803 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.874932+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.876308+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:02:14.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[31385]: audit 2021-03-10T16:02:13.877223+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: cluster 2021-03-10T16:02:12.875738+0000 mgr.gibba043.dnkmem (mgr.34373) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.563803+0000 mon.c (mon.1) 1798 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.564946+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.727464+0000 mon.c (mon.1) 1799 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.728574+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.872451+0000 mon.c (mon.1) 1800 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:02:14.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.873216+0000 mon.c (mon.1) 1801 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.873649+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:02:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.873919+0000 mon.c (mon.1) 1802 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:02:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.874807+0000 mon.c (mon.1) 1803 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.874932+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.876308+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:02:14.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:13 gibba003 bash[32348]: audit 2021-03-10T16:02:13.877223+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: cluster 2021-03-10T16:02:12.875738+0000 mgr.gibba043.dnkmem (mgr.34373) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.563803+0000 mon.c (mon.1) 1798 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.564946+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.727464+0000 mon.c (mon.1) 1799 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.728574+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.872451+0000 mon.c (mon.1) 1800 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:02:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.873216+0000 mon.c (mon.1) 1801 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.873649+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:02:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.873919+0000 mon.c (mon.1) 1802 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:02:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.874807+0000 mon.c (mon.1) 1803 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.874932+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:02:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.876308+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:02:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:13 gibba043 bash[24019]: audit 2021-03-10T16:02:13.877223+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:15 gibba043 bash[24019]: cluster 2021-03-10T16:02:14.877262+0000 mgr.gibba043.dnkmem (mgr.34373) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:16.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:15 gibba003 bash[31385]: cluster 2021-03-10T16:02:14.877262+0000 mgr.gibba043.dnkmem (mgr.34373) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:16.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:15 gibba003 bash[32348]: cluster 2021-03-10T16:02:14.877262+0000 mgr.gibba043.dnkmem (mgr.34373) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:17 gibba043 bash[24019]: cluster 2021-03-10T16:02:16.878906+0000 mgr.gibba043.dnkmem (mgr.34373) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:17 gibba003 bash[31385]: cluster 2021-03-10T16:02:16.878906+0000 mgr.gibba043.dnkmem (mgr.34373) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:17 gibba003 bash[32348]: cluster 2021-03-10T16:02:16.878906+0000 mgr.gibba043.dnkmem (mgr.34373) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:20.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:19 gibba043 bash[24019]: cluster 2021-03-10T16:02:18.880486+0000 mgr.gibba043.dnkmem (mgr.34373) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:19 gibba003 bash[31385]: cluster 2021-03-10T16:02:18.880486+0000 mgr.gibba043.dnkmem (mgr.34373) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:19 gibba003 bash[32348]: cluster 2021-03-10T16:02:18.880486+0000 mgr.gibba043.dnkmem (mgr.34373) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:21 gibba043 bash[24019]: cluster 2021-03-10T16:02:20.882018+0000 mgr.gibba043.dnkmem (mgr.34373) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:21 gibba003 bash[31385]: cluster 2021-03-10T16:02:20.882018+0000 mgr.gibba043.dnkmem (mgr.34373) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:21 gibba003 bash[32348]: cluster 2021-03-10T16:02:20.882018+0000 mgr.gibba043.dnkmem (mgr.34373) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:22.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:22 gibba003 bash[31385]: cephadm 2021-03-10T16:02:21.499177+0000 mgr.gibba043.dnkmem (mgr.34373) 6940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:22.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:22 gibba003 bash[32348]: cephadm 2021-03-10T16:02:21.499177+0000 mgr.gibba043.dnkmem (mgr.34373) 6940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:23.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:22 gibba043 bash[24019]: cephadm 2021-03-10T16:02:21.499177+0000 mgr.gibba043.dnkmem (mgr.34373) 6940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:23 gibba003 bash[31385]: cluster 2021-03-10T16:02:22.883751+0000 mgr.gibba043.dnkmem (mgr.34373) 6941 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:23 gibba003 bash[32348]: cluster 2021-03-10T16:02:22.883751+0000 mgr.gibba043.dnkmem (mgr.34373) 6941 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:23 gibba043 bash[24019]: cluster 2021-03-10T16:02:22.883751+0000 mgr.gibba043.dnkmem (mgr.34373) 6941 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:25 gibba043 bash[24019]: cluster 2021-03-10T16:02:24.885429+0000 mgr.gibba043.dnkmem (mgr.34373) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:26.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:25 gibba003 bash[31385]: cluster 2021-03-10T16:02:24.885429+0000 mgr.gibba043.dnkmem (mgr.34373) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:26.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:25 gibba003 bash[32348]: cluster 2021-03-10T16:02:24.885429+0000 mgr.gibba043.dnkmem (mgr.34373) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:27 gibba043 bash[24019]: cluster 2021-03-10T16:02:26.887154+0000 mgr.gibba043.dnkmem (mgr.34373) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:27 gibba003 bash[31385]: cluster 2021-03-10T16:02:26.887154+0000 mgr.gibba043.dnkmem (mgr.34373) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:28.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:27 gibba003 bash[32348]: cluster 2021-03-10T16:02:26.887154+0000 mgr.gibba043.dnkmem (mgr.34373) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:29 gibba043 bash[24019]: cluster 2021-03-10T16:02:28.888996+0000 mgr.gibba043.dnkmem (mgr.34373) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:30.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:29 gibba003 bash[31385]: cluster 2021-03-10T16:02:28.888996+0000 mgr.gibba043.dnkmem (mgr.34373) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:30.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:29 gibba003 bash[32348]: cluster 2021-03-10T16:02:28.888996+0000 mgr.gibba043.dnkmem (mgr.34373) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:31 gibba003 bash[31385]: cluster 2021-03-10T16:02:30.890748+0000 mgr.gibba043.dnkmem (mgr.34373) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:31 gibba003 bash[32348]: cluster 2021-03-10T16:02:30.890748+0000 mgr.gibba043.dnkmem (mgr.34373) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:32.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:31 gibba043 bash[24019]: cluster 2021-03-10T16:02:30.890748+0000 mgr.gibba043.dnkmem (mgr.34373) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:33 gibba043 bash[24019]: cluster 2021-03-10T16:02:32.892274+0000 mgr.gibba043.dnkmem (mgr.34373) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:33 gibba003 bash[31385]: cluster 2021-03-10T16:02:32.892274+0000 mgr.gibba043.dnkmem (mgr.34373) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:33 gibba003 bash[32348]: cluster 2021-03-10T16:02:32.892274+0000 mgr.gibba043.dnkmem (mgr.34373) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:36.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:35 gibba043 bash[24019]: cluster 2021-03-10T16:02:34.894010+0000 mgr.gibba043.dnkmem (mgr.34373) 6947 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:35 gibba003 bash[32348]: cluster 2021-03-10T16:02:34.894010+0000 mgr.gibba043.dnkmem (mgr.34373) 6947 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:36.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:35 gibba003 bash[31385]: cluster 2021-03-10T16:02:34.894010+0000 mgr.gibba043.dnkmem (mgr.34373) 6947 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:37 gibba043 bash[24019]: cephadm 2021-03-10T16:02:36.514797+0000 mgr.gibba043.dnkmem (mgr.34373) 6948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:37 gibba043 bash[24019]: cluster 2021-03-10T16:02:36.895724+0000 mgr.gibba043.dnkmem (mgr.34373) 6949 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:37 gibba003 bash[31385]: cephadm 2021-03-10T16:02:36.514797+0000 mgr.gibba043.dnkmem (mgr.34373) 6948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:37 gibba003 bash[31385]: cluster 2021-03-10T16:02:36.895724+0000 mgr.gibba043.dnkmem (mgr.34373) 6949 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:37 gibba003 bash[32348]: cephadm 2021-03-10T16:02:36.514797+0000 mgr.gibba043.dnkmem (mgr.34373) 6948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:37 gibba003 bash[32348]: cluster 2021-03-10T16:02:36.895724+0000 mgr.gibba043.dnkmem (mgr.34373) 6949 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.692 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:02:38.921 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:02:38.921 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:02:38.922 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:02:38.922 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:02:38.922 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:02:38.922 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:02:38.923 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:02:38.923 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:02:38.923 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:02:38.923 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:02:38.924 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:02:38.924 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:02:38.924 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:02:38.924 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:02:38.925 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:02:38.925 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:02:38.925 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:02:38.925 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:02:38.925 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:02:38.926 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:02:38.926 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:02:39.172 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:02:39.173 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:02:39.173 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:39.173 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:02:39.173 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:02:39.174 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:39.174 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:02:39.174 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:02:39.174 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:02:39.175 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:02:39.175 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:02:39.175 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:02:39.175 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:02:39.176 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:02:39.176 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:02:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:39 gibba043 bash[24019]: audit 2021-03-10T16:02:38.683409+0000 mgr.gibba043.dnkmem (mgr.34373) 6950 : audit [DBG] from='client.48714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:39 gibba043 bash[24019]: cluster 2021-03-10T16:02:38.897281+0000 mgr.gibba043.dnkmem (mgr.34373) 6951 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:40.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:39 gibba043 bash[24019]: audit 2021-03-10T16:02:38.909840+0000 mgr.gibba043.dnkmem (mgr.34373) 6952 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:39 gibba043 bash[24019]: audit 2021-03-10T16:02:39.174292+0000 mon.a (mon.0) 1560 : audit [DBG] from='client.? 172.21.2.103:0/2794840996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:40.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[31385]: audit 2021-03-10T16:02:38.683409+0000 mgr.gibba043.dnkmem (mgr.34373) 6950 : audit [DBG] from='client.48714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:40.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[31385]: cluster 2021-03-10T16:02:38.897281+0000 mgr.gibba043.dnkmem (mgr.34373) 6951 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:40.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[31385]: audit 2021-03-10T16:02:38.909840+0000 mgr.gibba043.dnkmem (mgr.34373) 6952 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:40.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[31385]: audit 2021-03-10T16:02:39.174292+0000 mon.a (mon.0) 1560 : audit [DBG] from='client.? 172.21.2.103:0/2794840996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:40.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[32348]: audit 2021-03-10T16:02:38.683409+0000 mgr.gibba043.dnkmem (mgr.34373) 6950 : audit [DBG] from='client.48714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:40.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[32348]: cluster 2021-03-10T16:02:38.897281+0000 mgr.gibba043.dnkmem (mgr.34373) 6951 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:40.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[32348]: audit 2021-03-10T16:02:38.909840+0000 mgr.gibba043.dnkmem (mgr.34373) 6952 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:40.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:39 gibba003 bash[32348]: audit 2021-03-10T16:02:39.174292+0000 mon.a (mon.0) 1560 : audit [DBG] from='client.? 172.21.2.103:0/2794840996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:41 gibba003 bash[31385]: cluster 2021-03-10T16:02:40.898995+0000 mgr.gibba043.dnkmem (mgr.34373) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:41 gibba003 bash[32348]: cluster 2021-03-10T16:02:40.898995+0000 mgr.gibba043.dnkmem (mgr.34373) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:41 gibba043 bash[24019]: cluster 2021-03-10T16:02:40.898995+0000 mgr.gibba043.dnkmem (mgr.34373) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:44.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:43 gibba043 bash[24019]: cluster 2021-03-10T16:02:42.900695+0000 mgr.gibba043.dnkmem (mgr.34373) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:44.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:43 gibba003 bash[31385]: cluster 2021-03-10T16:02:42.900695+0000 mgr.gibba043.dnkmem (mgr.34373) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:44.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:43 gibba003 bash[32348]: cluster 2021-03-10T16:02:42.900695+0000 mgr.gibba043.dnkmem (mgr.34373) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:46.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:45 gibba043 bash[24019]: cluster 2021-03-10T16:02:44.902336+0000 mgr.gibba043.dnkmem (mgr.34373) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:46.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:45 gibba003 bash[32348]: cluster 2021-03-10T16:02:44.902336+0000 mgr.gibba043.dnkmem (mgr.34373) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:45 gibba003 bash[31385]: cluster 2021-03-10T16:02:44.902336+0000 mgr.gibba043.dnkmem (mgr.34373) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:48.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:47 gibba043 bash[24019]: cluster 2021-03-10T16:02:46.903918+0000 mgr.gibba043.dnkmem (mgr.34373) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:47 gibba003 bash[31385]: cluster 2021-03-10T16:02:46.903918+0000 mgr.gibba043.dnkmem (mgr.34373) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:48.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:47 gibba003 bash[32348]: cluster 2021-03-10T16:02:46.903918+0000 mgr.gibba043.dnkmem (mgr.34373) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:49 gibba043 bash[24019]: cluster 2021-03-10T16:02:48.905505+0000 mgr.gibba043.dnkmem (mgr.34373) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:50.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:49 gibba003 bash[31385]: cluster 2021-03-10T16:02:48.905505+0000 mgr.gibba043.dnkmem (mgr.34373) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:50.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:49 gibba003 bash[32348]: cluster 2021-03-10T16:02:48.905505+0000 mgr.gibba043.dnkmem (mgr.34373) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:51 gibba003 bash[31385]: cluster 2021-03-10T16:02:50.907162+0000 mgr.gibba043.dnkmem (mgr.34373) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:51 gibba003 bash[32348]: cluster 2021-03-10T16:02:50.907162+0000 mgr.gibba043.dnkmem (mgr.34373) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:51 gibba043 bash[24019]: cluster 2021-03-10T16:02:50.907162+0000 mgr.gibba043.dnkmem (mgr.34373) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:52.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:52 gibba003 bash[31385]: cephadm 2021-03-10T16:02:51.530413+0000 mgr.gibba043.dnkmem (mgr.34373) 6959 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:52.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:52 gibba003 bash[32348]: cephadm 2021-03-10T16:02:51.530413+0000 mgr.gibba043.dnkmem (mgr.34373) 6959 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:53.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:52 gibba043 bash[24019]: cephadm 2021-03-10T16:02:51.530413+0000 mgr.gibba043.dnkmem (mgr.34373) 6959 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:02:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:53 gibba003 bash[31385]: cluster 2021-03-10T16:02:52.908738+0000 mgr.gibba043.dnkmem (mgr.34373) 6960 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:53 gibba003 bash[32348]: cluster 2021-03-10T16:02:52.908738+0000 mgr.gibba043.dnkmem (mgr.34373) 6960 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:53 gibba043 bash[24019]: cluster 2021-03-10T16:02:52.908738+0000 mgr.gibba043.dnkmem (mgr.34373) 6960 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:56.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:55 gibba043 bash[24019]: cluster 2021-03-10T16:02:54.910303+0000 mgr.gibba043.dnkmem (mgr.34373) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:56.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:55 gibba003 bash[31385]: cluster 2021-03-10T16:02:54.910303+0000 mgr.gibba043.dnkmem (mgr.34373) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:55 gibba003 bash[32348]: cluster 2021-03-10T16:02:54.910303+0000 mgr.gibba043.dnkmem (mgr.34373) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:57 gibba043 bash[24019]: cluster 2021-03-10T16:02:56.911852+0000 mgr.gibba043.dnkmem (mgr.34373) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:57 gibba003 bash[31385]: cluster 2021-03-10T16:02:56.911852+0000 mgr.gibba043.dnkmem (mgr.34373) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:57 gibba003 bash[32348]: cluster 2021-03-10T16:02:56.911852+0000 mgr.gibba043.dnkmem (mgr.34373) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:02:59 gibba043 bash[24019]: cluster 2021-03-10T16:02:58.913253+0000 mgr.gibba043.dnkmem (mgr.34373) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:00.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:02:59 gibba003 bash[31385]: cluster 2021-03-10T16:02:58.913253+0000 mgr.gibba043.dnkmem (mgr.34373) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:00.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:02:59 gibba003 bash[32348]: cluster 2021-03-10T16:02:58.913253+0000 mgr.gibba043.dnkmem (mgr.34373) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:01 gibba003 bash[31385]: cluster 2021-03-10T16:03:00.914994+0000 mgr.gibba043.dnkmem (mgr.34373) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:01 gibba003 bash[32348]: cluster 2021-03-10T16:03:00.914994+0000 mgr.gibba043.dnkmem (mgr.34373) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:01 gibba043 bash[24019]: cluster 2021-03-10T16:03:00.914994+0000 mgr.gibba043.dnkmem (mgr.34373) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:03 gibba043 bash[24019]: cluster 2021-03-10T16:03:02.916390+0000 mgr.gibba043.dnkmem (mgr.34373) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:03 gibba003 bash[31385]: cluster 2021-03-10T16:03:02.916390+0000 mgr.gibba043.dnkmem (mgr.34373) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:03 gibba003 bash[32348]: cluster 2021-03-10T16:03:02.916390+0000 mgr.gibba043.dnkmem (mgr.34373) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:06.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:05 gibba043 bash[24019]: cluster 2021-03-10T16:03:04.917948+0000 mgr.gibba043.dnkmem (mgr.34373) 6966 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:06.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:05 gibba003 bash[31385]: cluster 2021-03-10T16:03:04.917948+0000 mgr.gibba043.dnkmem (mgr.34373) 6966 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:06.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:05 gibba003 bash[32348]: cluster 2021-03-10T16:03:04.917948+0000 mgr.gibba043.dnkmem (mgr.34373) 6966 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.547323+0000 mgr.gibba043.dnkmem (mgr.34373) 6967 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:03:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.548897+0000 mgr.gibba043.dnkmem (mgr.34373) 6968 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:03:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.771754+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:03:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.773481+0000 mgr.gibba043.dnkmem (mgr.34373) 6969 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.775632+0000 mgr.gibba043.dnkmem (mgr.34373) 6970 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.775859+0000 mon.c (mon.1) 1804 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.777364+0000 mgr.gibba043.dnkmem (mgr.34373) 6971 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.777411+0000 mgr.gibba043.dnkmem (mgr.34373) 6972 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:08.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.777698+0000 mon.c (mon.1) 1805 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.778617+0000 mgr.gibba043.dnkmem (mgr.34373) 6973 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.778661+0000 mgr.gibba043.dnkmem (mgr.34373) 6974 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:08.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.779310+0000 mon.c (mon.1) 1806 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.779837+0000 mgr.gibba043.dnkmem (mgr.34373) 6975 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:08.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.780626+0000 mon.c (mon.1) 1807 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.781373+0000 mgr.gibba043.dnkmem (mgr.34373) 6976 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:08.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.781417+0000 mgr.gibba043.dnkmem (mgr.34373) 6977 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:08.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.782560+0000 mgr.gibba043.dnkmem (mgr.34373) 6978 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:08.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.782886+0000 mgr.gibba043.dnkmem (mgr.34373) 6979 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:08.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.783334+0000 mon.c (mon.1) 1808 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.784027+0000 mgr.gibba043.dnkmem (mgr.34373) 6980 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:08.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.784074+0000 mgr.gibba043.dnkmem (mgr.34373) 6981 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:08.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cephadm 2021-03-10T16:03:06.784192+0000 mgr.gibba043.dnkmem (mgr.34373) 6982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:08.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: audit 2021-03-10T16:03:06.784725+0000 mon.c (mon.1) 1809 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[31385]: cluster 2021-03-10T16:03:06.919427+0000 mgr.gibba043.dnkmem (mgr.34373) 6983 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:08.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.547323+0000 mgr.gibba043.dnkmem (mgr.34373) 6967 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:03:08.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.548897+0000 mgr.gibba043.dnkmem (mgr.34373) 6968 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:03:08.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.771754+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:03:08.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.773481+0000 mgr.gibba043.dnkmem (mgr.34373) 6969 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:08.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.775632+0000 mgr.gibba043.dnkmem (mgr.34373) 6970 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:08.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.775859+0000 mon.c (mon.1) 1804 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:08.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.777364+0000 mgr.gibba043.dnkmem (mgr.34373) 6971 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:08.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.777411+0000 mgr.gibba043.dnkmem (mgr.34373) 6972 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:08.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.777698+0000 mon.c (mon.1) 1805 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.778617+0000 mgr.gibba043.dnkmem (mgr.34373) 6973 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:08.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.778661+0000 mgr.gibba043.dnkmem (mgr.34373) 6974 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:08.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.779310+0000 mon.c (mon.1) 1806 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.779837+0000 mgr.gibba043.dnkmem (mgr.34373) 6975 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:08.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.780626+0000 mon.c (mon.1) 1807 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.781373+0000 mgr.gibba043.dnkmem (mgr.34373) 6976 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:08.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.781417+0000 mgr.gibba043.dnkmem (mgr.34373) 6977 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:08.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.782560+0000 mgr.gibba043.dnkmem (mgr.34373) 6978 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:08.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.782886+0000 mgr.gibba043.dnkmem (mgr.34373) 6979 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:08.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.783334+0000 mon.c (mon.1) 1808 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.784027+0000 mgr.gibba043.dnkmem (mgr.34373) 6980 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:08.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.784074+0000 mgr.gibba043.dnkmem (mgr.34373) 6981 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:08.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cephadm 2021-03-10T16:03:06.784192+0000 mgr.gibba043.dnkmem (mgr.34373) 6982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:08.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: audit 2021-03-10T16:03:06.784725+0000 mon.c (mon.1) 1809 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:07 gibba003 bash[32348]: cluster 2021-03-10T16:03:06.919427+0000 mgr.gibba043.dnkmem (mgr.34373) 6983 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.547323+0000 mgr.gibba043.dnkmem (mgr.34373) 6967 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:03:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.548897+0000 mgr.gibba043.dnkmem (mgr.34373) 6968 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:03:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.771754+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:03:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.773481+0000 mgr.gibba043.dnkmem (mgr.34373) 6969 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.775632+0000 mgr.gibba043.dnkmem (mgr.34373) 6970 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.775859+0000 mon.c (mon.1) 1804 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.777364+0000 mgr.gibba043.dnkmem (mgr.34373) 6971 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.777411+0000 mgr.gibba043.dnkmem (mgr.34373) 6972 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.777698+0000 mon.c (mon.1) 1805 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.778617+0000 mgr.gibba043.dnkmem (mgr.34373) 6973 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.778661+0000 mgr.gibba043.dnkmem (mgr.34373) 6974 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.779310+0000 mon.c (mon.1) 1806 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.779837+0000 mgr.gibba043.dnkmem (mgr.34373) 6975 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.780626+0000 mon.c (mon.1) 1807 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.781373+0000 mgr.gibba043.dnkmem (mgr.34373) 6976 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.781417+0000 mgr.gibba043.dnkmem (mgr.34373) 6977 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.782560+0000 mgr.gibba043.dnkmem (mgr.34373) 6978 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.782886+0000 mgr.gibba043.dnkmem (mgr.34373) 6979 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.783334+0000 mon.c (mon.1) 1808 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.784027+0000 mgr.gibba043.dnkmem (mgr.34373) 6980 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.784074+0000 mgr.gibba043.dnkmem (mgr.34373) 6981 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cephadm 2021-03-10T16:03:06.784192+0000 mgr.gibba043.dnkmem (mgr.34373) 6982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:08.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: audit 2021-03-10T16:03:06.784725+0000 mon.c (mon.1) 1809 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:08.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:07 gibba043 bash[24019]: cluster 2021-03-10T16:03:06.919427+0000 mgr.gibba043.dnkmem (mgr.34373) 6983 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:09.416 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:03:09.644 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:03:09.644 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:03:09.645 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:03:09.645 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:03:09.645 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:03:09.645 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:03:09.646 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:03:09.646 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:03:09.646 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:03:09.646 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:03:09.647 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:03:09.647 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:03:09.647 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:03:09.647 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:03:09.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:03:09.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:03:09.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:03:09.648 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:03:09.649 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:03:09.649 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:03:09.649 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:03:09.893 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:03:09.893 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:03:09.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:09.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:03:09.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:03:09.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:09.895 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:03:09.895 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:03:09.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:03:09.895 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:03:09.896 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:03:09.896 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:03:09.896 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:03:09.896 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:03:09.897 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:03:10.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:09 gibba043 bash[24019]: cluster 2021-03-10T16:03:08.921111+0000 mgr.gibba043.dnkmem (mgr.34373) 6984 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:10.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:09 gibba043 bash[24019]: audit 2021-03-10T16:03:09.895115+0000 mon.a (mon.0) 1562 : audit [DBG] from='client.? 172.21.2.103:0/3964071370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:10.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:09 gibba003 bash[31385]: cluster 2021-03-10T16:03:08.921111+0000 mgr.gibba043.dnkmem (mgr.34373) 6984 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:10.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:09 gibba003 bash[31385]: audit 2021-03-10T16:03:09.895115+0000 mon.a (mon.0) 1562 : audit [DBG] from='client.? 172.21.2.103:0/3964071370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:09 gibba003 bash[32348]: cluster 2021-03-10T16:03:08.921111+0000 mgr.gibba043.dnkmem (mgr.34373) 6984 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:09 gibba003 bash[32348]: audit 2021-03-10T16:03:09.895115+0000 mon.a (mon.0) 1562 : audit [DBG] from='client.? 172.21.2.103:0/3964071370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:11.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:10 gibba043 bash[24019]: audit 2021-03-10T16:03:09.408210+0000 mgr.gibba043.dnkmem (mgr.34373) 6985 : audit [DBG] from='client.48732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:11.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:10 gibba043 bash[24019]: audit 2021-03-10T16:03:09.636033+0000 mgr.gibba043.dnkmem (mgr.34373) 6986 : audit [DBG] from='client.48738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:11.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:10 gibba003 bash[31385]: audit 2021-03-10T16:03:09.408210+0000 mgr.gibba043.dnkmem (mgr.34373) 6985 : audit [DBG] from='client.48732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:11.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:10 gibba003 bash[31385]: audit 2021-03-10T16:03:09.636033+0000 mgr.gibba043.dnkmem (mgr.34373) 6986 : audit [DBG] from='client.48738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:11.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:10 gibba003 bash[32348]: audit 2021-03-10T16:03:09.408210+0000 mgr.gibba043.dnkmem (mgr.34373) 6985 : audit [DBG] from='client.48732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:11.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:10 gibba003 bash[32348]: audit 2021-03-10T16:03:09.636033+0000 mgr.gibba043.dnkmem (mgr.34373) 6986 : audit [DBG] from='client.48738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:12.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:11 gibba043 bash[24019]: cluster 2021-03-10T16:03:10.922796+0000 mgr.gibba043.dnkmem (mgr.34373) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:12.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:11 gibba003 bash[31385]: cluster 2021-03-10T16:03:10.922796+0000 mgr.gibba043.dnkmem (mgr.34373) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:12.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:11 gibba003 bash[32348]: cluster 2021-03-10T16:03:10.922796+0000 mgr.gibba043.dnkmem (mgr.34373) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: cluster 2021-03-10T16:03:12.924470+0000 mgr.gibba043.dnkmem (mgr.34373) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.570642+0000 mon.c (mon.1) 1810 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.571797+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.735540+0000 mon.c (mon.1) 1811 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.736640+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.881773+0000 mon.c (mon.1) 1812 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:03:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.882726+0000 mon.c (mon.1) 1813 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.883000+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:03:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.883653+0000 mon.c (mon.1) 1814 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:03:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.884289+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.884791+0000 mon.c (mon.1) 1815 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.885275+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:03:14.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:14 gibba043 bash[24019]: audit 2021-03-10T16:03:13.886237+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: cluster 2021-03-10T16:03:12.924470+0000 mgr.gibba043.dnkmem (mgr.34373) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.570642+0000 mon.c (mon.1) 1810 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.571797+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.735540+0000 mon.c (mon.1) 1811 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.736640+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.881773+0000 mon.c (mon.1) 1812 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:03:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.882726+0000 mon.c (mon.1) 1813 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.883000+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:03:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.883653+0000 mon.c (mon.1) 1814 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:03:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.884289+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.884791+0000 mon.c (mon.1) 1815 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.885275+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:03:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[31385]: audit 2021-03-10T16:03:13.886237+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: cluster 2021-03-10T16:03:12.924470+0000 mgr.gibba043.dnkmem (mgr.34373) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.570642+0000 mon.c (mon.1) 1810 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.571797+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.735540+0000 mon.c (mon.1) 1811 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.736640+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.881773+0000 mon.c (mon.1) 1812 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:03:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.882726+0000 mon.c (mon.1) 1813 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.883000+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:03:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.883653+0000 mon.c (mon.1) 1814 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:03:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.884289+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.884791+0000 mon.c (mon.1) 1815 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:03:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.885275+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:03:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:14 gibba003 bash[32348]: audit 2021-03-10T16:03:13.886237+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:03:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:16 gibba043 bash[24019]: cluster 2021-03-10T16:03:14.926248+0000 mgr.gibba043.dnkmem (mgr.34373) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:16 gibba003 bash[31385]: cluster 2021-03-10T16:03:14.926248+0000 mgr.gibba043.dnkmem (mgr.34373) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:16.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:16 gibba003 bash[32348]: cluster 2021-03-10T16:03:14.926248+0000 mgr.gibba043.dnkmem (mgr.34373) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:18 gibba003 bash[31385]: cluster 2021-03-10T16:03:16.928085+0000 mgr.gibba043.dnkmem (mgr.34373) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:18 gibba003 bash[32348]: cluster 2021-03-10T16:03:16.928085+0000 mgr.gibba043.dnkmem (mgr.34373) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:18 gibba043 bash[24019]: cluster 2021-03-10T16:03:16.928085+0000 mgr.gibba043.dnkmem (mgr.34373) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:20 gibba003 bash[31385]: cluster 2021-03-10T16:03:18.929660+0000 mgr.gibba043.dnkmem (mgr.34373) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:20 gibba003 bash[32348]: cluster 2021-03-10T16:03:18.929660+0000 mgr.gibba043.dnkmem (mgr.34373) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:20 gibba043 bash[24019]: cluster 2021-03-10T16:03:18.929660+0000 mgr.gibba043.dnkmem (mgr.34373) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:21 gibba003 bash[31385]: cluster 2021-03-10T16:03:20.931560+0000 mgr.gibba043.dnkmem (mgr.34373) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:21 gibba003 bash[32348]: cluster 2021-03-10T16:03:20.931560+0000 mgr.gibba043.dnkmem (mgr.34373) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:21 gibba043 bash[24019]: cluster 2021-03-10T16:03:20.931560+0000 mgr.gibba043.dnkmem (mgr.34373) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:22.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:22 gibba003 bash[31385]: cephadm 2021-03-10T16:03:21.787305+0000 mgr.gibba043.dnkmem (mgr.34373) 6993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:22.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:22 gibba003 bash[32348]: cephadm 2021-03-10T16:03:21.787305+0000 mgr.gibba043.dnkmem (mgr.34373) 6993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:23.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:22 gibba043 bash[24019]: cephadm 2021-03-10T16:03:21.787305+0000 mgr.gibba043.dnkmem (mgr.34373) 6993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:23 gibba003 bash[31385]: cluster 2021-03-10T16:03:22.933327+0000 mgr.gibba043.dnkmem (mgr.34373) 6994 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:23 gibba003 bash[32348]: cluster 2021-03-10T16:03:22.933327+0000 mgr.gibba043.dnkmem (mgr.34373) 6994 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:23 gibba043 bash[24019]: cluster 2021-03-10T16:03:22.933327+0000 mgr.gibba043.dnkmem (mgr.34373) 6994 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:26.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:25 gibba043 bash[24019]: cluster 2021-03-10T16:03:24.934948+0000 mgr.gibba043.dnkmem (mgr.34373) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:26.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:25 gibba003 bash[31385]: cluster 2021-03-10T16:03:24.934948+0000 mgr.gibba043.dnkmem (mgr.34373) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:26.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:26 gibba003 bash[32348]: cluster 2021-03-10T16:03:24.934948+0000 mgr.gibba043.dnkmem (mgr.34373) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:28 gibba043 bash[24019]: cluster 2021-03-10T16:03:26.936773+0000 mgr.gibba043.dnkmem (mgr.34373) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:28.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:28 gibba003 bash[32348]: cluster 2021-03-10T16:03:26.936773+0000 mgr.gibba043.dnkmem (mgr.34373) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:28.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:28 gibba003 bash[31385]: cluster 2021-03-10T16:03:26.936773+0000 mgr.gibba043.dnkmem (mgr.34373) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:30.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:30 gibba043 bash[24019]: cluster 2021-03-10T16:03:28.938295+0000 mgr.gibba043.dnkmem (mgr.34373) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:30.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:30 gibba003 bash[31385]: cluster 2021-03-10T16:03:28.938295+0000 mgr.gibba043.dnkmem (mgr.34373) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:30.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:30 gibba003 bash[32348]: cluster 2021-03-10T16:03:28.938295+0000 mgr.gibba043.dnkmem (mgr.34373) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:31 gibba003 bash[31385]: cluster 2021-03-10T16:03:30.939948+0000 mgr.gibba043.dnkmem (mgr.34373) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:31 gibba003 bash[32348]: cluster 2021-03-10T16:03:30.939948+0000 mgr.gibba043.dnkmem (mgr.34373) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:31 gibba043 bash[24019]: cluster 2021-03-10T16:03:30.939948+0000 mgr.gibba043.dnkmem (mgr.34373) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:34 gibba043 bash[24019]: cluster 2021-03-10T16:03:32.941540+0000 mgr.gibba043.dnkmem (mgr.34373) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:34.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:34 gibba003 bash[31385]: cluster 2021-03-10T16:03:32.941540+0000 mgr.gibba043.dnkmem (mgr.34373) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:34.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:34 gibba003 bash[32348]: cluster 2021-03-10T16:03:32.941540+0000 mgr.gibba043.dnkmem (mgr.34373) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:36.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:36 gibba043 bash[24019]: cluster 2021-03-10T16:03:34.943137+0000 mgr.gibba043.dnkmem (mgr.34373) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:36 gibba003 bash[31385]: cluster 2021-03-10T16:03:34.943137+0000 mgr.gibba043.dnkmem (mgr.34373) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:36 gibba003 bash[32348]: cluster 2021-03-10T16:03:34.943137+0000 mgr.gibba043.dnkmem (mgr.34373) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:38 gibba003 bash[31385]: cephadm 2021-03-10T16:03:36.803448+0000 mgr.gibba043.dnkmem (mgr.34373) 7001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:38 gibba003 bash[31385]: cluster 2021-03-10T16:03:36.944829+0000 mgr.gibba043.dnkmem (mgr.34373) 7002 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:38 gibba003 bash[32348]: cephadm 2021-03-10T16:03:36.803448+0000 mgr.gibba043.dnkmem (mgr.34373) 7001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:38 gibba003 bash[32348]: cluster 2021-03-10T16:03:36.944829+0000 mgr.gibba043.dnkmem (mgr.34373) 7002 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:38 gibba043 bash[24019]: cephadm 2021-03-10T16:03:36.803448+0000 mgr.gibba043.dnkmem (mgr.34373) 7001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:38 gibba043 bash[24019]: cluster 2021-03-10T16:03:36.944829+0000 mgr.gibba043.dnkmem (mgr.34373) 7002 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:40.135 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:03:40.362 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:03:40.363 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:03:40.363 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:03:40.363 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:03:40.363 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:03:40.364 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:03:40.364 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:03:40.364 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:03:40.364 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:03:40.364 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:03:40.365 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:03:40.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:03:40.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:03:40.365 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:03:40.366 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:03:40.366 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:03:40.366 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:03:40.366 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:03:40.367 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:03:40.367 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:03:40.367 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:03:40.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:40 gibba003 bash[31385]: cluster 2021-03-10T16:03:38.946515+0000 mgr.gibba043.dnkmem (mgr.34373) 7003 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:40.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:40 gibba003 bash[32348]: cluster 2021-03-10T16:03:38.946515+0000 mgr.gibba043.dnkmem (mgr.34373) 7003 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:40.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:40 gibba043 bash[24019]: cluster 2021-03-10T16:03:38.946515+0000 mgr.gibba043.dnkmem (mgr.34373) 7003 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:40.616 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:03:40.616 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:03:40.616 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:40.617 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:03:40.617 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:03:40.617 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:40.617 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:03:40.617 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:03:40.618 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:03:40.618 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:03:40.618 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:03:40.618 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:03:40.619 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:03:40.619 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:03:40.619 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:03:41.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:41 gibba003 bash[31385]: audit 2021-03-10T16:03:40.127091+0000 mgr.gibba043.dnkmem (mgr.34373) 7004 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:41.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:41 gibba003 bash[31385]: audit 2021-03-10T16:03:40.618114+0000 mon.c (mon.1) 1816 : audit [DBG] from='client.? 172.21.2.103:0/3965943722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:41 gibba003 bash[32348]: audit 2021-03-10T16:03:40.127091+0000 mgr.gibba043.dnkmem (mgr.34373) 7004 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:41 gibba003 bash[32348]: audit 2021-03-10T16:03:40.618114+0000 mon.c (mon.1) 1816 : audit [DBG] from='client.? 172.21.2.103:0/3965943722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:41 gibba043 bash[24019]: audit 2021-03-10T16:03:40.127091+0000 mgr.gibba043.dnkmem (mgr.34373) 7004 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:41.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:41 gibba043 bash[24019]: audit 2021-03-10T16:03:40.618114+0000 mon.c (mon.1) 1816 : audit [DBG] from='client.? 172.21.2.103:0/3965943722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:42.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:42 gibba003 bash[31385]: audit 2021-03-10T16:03:40.350310+0000 mgr.gibba043.dnkmem (mgr.34373) 7005 : audit [DBG] from='client.58744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:42.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:42 gibba003 bash[31385]: cluster 2021-03-10T16:03:40.948323+0000 mgr.gibba043.dnkmem (mgr.34373) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:42.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:42 gibba003 bash[32348]: audit 2021-03-10T16:03:40.350310+0000 mgr.gibba043.dnkmem (mgr.34373) 7005 : audit [DBG] from='client.58744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:42.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:42 gibba003 bash[32348]: cluster 2021-03-10T16:03:40.948323+0000 mgr.gibba043.dnkmem (mgr.34373) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:42.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:42 gibba043 bash[24019]: audit 2021-03-10T16:03:40.350310+0000 mgr.gibba043.dnkmem (mgr.34373) 7005 : audit [DBG] from='client.58744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:42.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:42 gibba043 bash[24019]: cluster 2021-03-10T16:03:40.948323+0000 mgr.gibba043.dnkmem (mgr.34373) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:44.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:44 gibba003 bash[31385]: cluster 2021-03-10T16:03:42.949661+0000 mgr.gibba043.dnkmem (mgr.34373) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:44.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:44 gibba003 bash[32348]: cluster 2021-03-10T16:03:42.949661+0000 mgr.gibba043.dnkmem (mgr.34373) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:44 gibba043 bash[24019]: cluster 2021-03-10T16:03:42.949661+0000 mgr.gibba043.dnkmem (mgr.34373) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:46.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:46 gibba003 bash[31385]: cluster 2021-03-10T16:03:44.951257+0000 mgr.gibba043.dnkmem (mgr.34373) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:46.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:46 gibba003 bash[32348]: cluster 2021-03-10T16:03:44.951257+0000 mgr.gibba043.dnkmem (mgr.34373) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:46 gibba043 bash[24019]: cluster 2021-03-10T16:03:44.951257+0000 mgr.gibba043.dnkmem (mgr.34373) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:48 gibba003 bash[31385]: cluster 2021-03-10T16:03:46.952924+0000 mgr.gibba043.dnkmem (mgr.34373) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:48 gibba003 bash[32348]: cluster 2021-03-10T16:03:46.952924+0000 mgr.gibba043.dnkmem (mgr.34373) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:48 gibba043 bash[24019]: cluster 2021-03-10T16:03:46.952924+0000 mgr.gibba043.dnkmem (mgr.34373) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:50.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:50 gibba003 bash[31385]: cluster 2021-03-10T16:03:48.954618+0000 mgr.gibba043.dnkmem (mgr.34373) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:50.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:50 gibba003 bash[32348]: cluster 2021-03-10T16:03:48.954618+0000 mgr.gibba043.dnkmem (mgr.34373) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:50.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:50 gibba043 bash[24019]: cluster 2021-03-10T16:03:48.954618+0000 mgr.gibba043.dnkmem (mgr.34373) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:51 gibba003 bash[31385]: cluster 2021-03-10T16:03:50.956317+0000 mgr.gibba043.dnkmem (mgr.34373) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:51 gibba003 bash[32348]: cluster 2021-03-10T16:03:50.956317+0000 mgr.gibba043.dnkmem (mgr.34373) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:51 gibba043 bash[24019]: cluster 2021-03-10T16:03:50.956317+0000 mgr.gibba043.dnkmem (mgr.34373) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:52.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:52 gibba003 bash[31385]: cephadm 2021-03-10T16:03:51.819533+0000 mgr.gibba043.dnkmem (mgr.34373) 7012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:52.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:52 gibba003 bash[32348]: cephadm 2021-03-10T16:03:51.819533+0000 mgr.gibba043.dnkmem (mgr.34373) 7012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:52 gibba043 bash[24019]: cephadm 2021-03-10T16:03:51.819533+0000 mgr.gibba043.dnkmem (mgr.34373) 7012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:03:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:53 gibba003 bash[31385]: cluster 2021-03-10T16:03:52.957798+0000 mgr.gibba043.dnkmem (mgr.34373) 7013 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:53 gibba003 bash[32348]: cluster 2021-03-10T16:03:52.957798+0000 mgr.gibba043.dnkmem (mgr.34373) 7013 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:53 gibba043 bash[24019]: cluster 2021-03-10T16:03:52.957798+0000 mgr.gibba043.dnkmem (mgr.34373) 7013 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:56 gibba003 bash[32348]: cluster 2021-03-10T16:03:54.959373+0000 mgr.gibba043.dnkmem (mgr.34373) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:56 gibba003 bash[31385]: cluster 2021-03-10T16:03:54.959373+0000 mgr.gibba043.dnkmem (mgr.34373) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:56 gibba043 bash[24019]: cluster 2021-03-10T16:03:54.959373+0000 mgr.gibba043.dnkmem (mgr.34373) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:03:58 gibba003 bash[31385]: cluster 2021-03-10T16:03:56.961026+0000 mgr.gibba043.dnkmem (mgr.34373) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:03:58 gibba003 bash[32348]: cluster 2021-03-10T16:03:56.961026+0000 mgr.gibba043.dnkmem (mgr.34373) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:03:58 gibba043 bash[24019]: cluster 2021-03-10T16:03:56.961026+0000 mgr.gibba043.dnkmem (mgr.34373) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:00.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:00 gibba003 bash[31385]: cluster 2021-03-10T16:03:58.962671+0000 mgr.gibba043.dnkmem (mgr.34373) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:00.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:00 gibba003 bash[32348]: cluster 2021-03-10T16:03:58.962671+0000 mgr.gibba043.dnkmem (mgr.34373) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:00 gibba043 bash[24019]: cluster 2021-03-10T16:03:58.962671+0000 mgr.gibba043.dnkmem (mgr.34373) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:01 gibba003 bash[31385]: cluster 2021-03-10T16:04:00.964466+0000 mgr.gibba043.dnkmem (mgr.34373) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:01 gibba003 bash[32348]: cluster 2021-03-10T16:04:00.964466+0000 mgr.gibba043.dnkmem (mgr.34373) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:01 gibba043 bash[24019]: cluster 2021-03-10T16:04:00.964466+0000 mgr.gibba043.dnkmem (mgr.34373) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:04 gibba003 bash[31385]: cluster 2021-03-10T16:04:02.966126+0000 mgr.gibba043.dnkmem (mgr.34373) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:04 gibba003 bash[32348]: cluster 2021-03-10T16:04:02.966126+0000 mgr.gibba043.dnkmem (mgr.34373) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:04 gibba043 bash[24019]: cluster 2021-03-10T16:04:02.966126+0000 mgr.gibba043.dnkmem (mgr.34373) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:06.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:06 gibba003 bash[32348]: cluster 2021-03-10T16:04:04.967860+0000 mgr.gibba043.dnkmem (mgr.34373) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:06 gibba003 bash[31385]: cluster 2021-03-10T16:04:04.967860+0000 mgr.gibba043.dnkmem (mgr.34373) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:06 gibba043 bash[24019]: cluster 2021-03-10T16:04:04.967860+0000 mgr.gibba043.dnkmem (mgr.34373) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:06.836463+0000 mgr.gibba043.dnkmem (mgr.34373) 7020 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:04:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:06.838000+0000 mgr.gibba043.dnkmem (mgr.34373) 7021 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:04:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cluster 2021-03-10T16:04:06.968393+0000 mgr.gibba043.dnkmem (mgr.34373) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.065076+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:04:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.066830+0000 mgr.gibba043.dnkmem (mgr.34373) 7023 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.068810+0000 mgr.gibba043.dnkmem (mgr.34373) 7024 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.069197+0000 mon.c (mon.1) 1817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.070116+0000 mgr.gibba043.dnkmem (mgr.34373) 7025 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.070155+0000 mgr.gibba043.dnkmem (mgr.34373) 7026 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.070774+0000 mon.c (mon.1) 1818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.071525+0000 mgr.gibba043.dnkmem (mgr.34373) 7027 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.071586+0000 mgr.gibba043.dnkmem (mgr.34373) 7028 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.072169+0000 mon.c (mon.1) 1819 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.072823+0000 mgr.gibba043.dnkmem (mgr.34373) 7029 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.073550+0000 mon.c (mon.1) 1820 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.074481+0000 mgr.gibba043.dnkmem (mgr.34373) 7030 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.074520+0000 mgr.gibba043.dnkmem (mgr.34373) 7031 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.075950+0000 mgr.gibba043.dnkmem (mgr.34373) 7032 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.076266+0000 mgr.gibba043.dnkmem (mgr.34373) 7033 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.076563+0000 mon.c (mon.1) 1821 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.077836+0000 mgr.gibba043.dnkmem (mgr.34373) 7034 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:06.836463+0000 mgr.gibba043.dnkmem (mgr.34373) 7020 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:04:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:06.838000+0000 mgr.gibba043.dnkmem (mgr.34373) 7021 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:04:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cluster 2021-03-10T16:04:06.968393+0000 mgr.gibba043.dnkmem (mgr.34373) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.065076+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:04:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.066830+0000 mgr.gibba043.dnkmem (mgr.34373) 7023 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.068810+0000 mgr.gibba043.dnkmem (mgr.34373) 7024 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.069197+0000 mon.c (mon.1) 1817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.070116+0000 mgr.gibba043.dnkmem (mgr.34373) 7025 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.070155+0000 mgr.gibba043.dnkmem (mgr.34373) 7026 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.070774+0000 mon.c (mon.1) 1818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.071525+0000 mgr.gibba043.dnkmem (mgr.34373) 7027 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:08.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.071586+0000 mgr.gibba043.dnkmem (mgr.34373) 7028 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.072169+0000 mon.c (mon.1) 1819 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.072823+0000 mgr.gibba043.dnkmem (mgr.34373) 7029 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.073550+0000 mon.c (mon.1) 1820 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.074481+0000 mgr.gibba043.dnkmem (mgr.34373) 7030 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:08.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.074520+0000 mgr.gibba043.dnkmem (mgr.34373) 7031 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.075950+0000 mgr.gibba043.dnkmem (mgr.34373) 7032 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.076266+0000 mgr.gibba043.dnkmem (mgr.34373) 7033 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.076563+0000 mon.c (mon.1) 1821 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.077836+0000 mgr.gibba043.dnkmem (mgr.34373) 7034 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:08.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.077876+0000 mgr.gibba043.dnkmem (mgr.34373) 7035 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:08.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: cephadm 2021-03-10T16:04:07.078053+0000 mgr.gibba043.dnkmem (mgr.34373) 7036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:08.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[32348]: audit 2021-03-10T16:04:07.078159+0000 mon.c (mon.1) 1822 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.077876+0000 mgr.gibba043.dnkmem (mgr.34373) 7035 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:08.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: cephadm 2021-03-10T16:04:07.078053+0000 mgr.gibba043.dnkmem (mgr.34373) 7036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:08.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:08 gibba003 bash[31385]: audit 2021-03-10T16:04:07.078159+0000 mon.c (mon.1) 1822 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:06.836463+0000 mgr.gibba043.dnkmem (mgr.34373) 7020 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:04:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:06.838000+0000 mgr.gibba043.dnkmem (mgr.34373) 7021 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:04:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cluster 2021-03-10T16:04:06.968393+0000 mgr.gibba043.dnkmem (mgr.34373) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.065076+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:04:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.066830+0000 mgr.gibba043.dnkmem (mgr.34373) 7023 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.068810+0000 mgr.gibba043.dnkmem (mgr.34373) 7024 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.069197+0000 mon.c (mon.1) 1817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.070116+0000 mgr.gibba043.dnkmem (mgr.34373) 7025 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.070155+0000 mgr.gibba043.dnkmem (mgr.34373) 7026 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.070774+0000 mon.c (mon.1) 1818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.071525+0000 mgr.gibba043.dnkmem (mgr.34373) 7027 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.071586+0000 mgr.gibba043.dnkmem (mgr.34373) 7028 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.072169+0000 mon.c (mon.1) 1819 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.072823+0000 mgr.gibba043.dnkmem (mgr.34373) 7029 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.073550+0000 mon.c (mon.1) 1820 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.074481+0000 mgr.gibba043.dnkmem (mgr.34373) 7030 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.074520+0000 mgr.gibba043.dnkmem (mgr.34373) 7031 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.075950+0000 mgr.gibba043.dnkmem (mgr.34373) 7032 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.076266+0000 mgr.gibba043.dnkmem (mgr.34373) 7033 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.076563+0000 mon.c (mon.1) 1821 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.077836+0000 mgr.gibba043.dnkmem (mgr.34373) 7034 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.077876+0000 mgr.gibba043.dnkmem (mgr.34373) 7035 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:08.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: cephadm 2021-03-10T16:04:07.078053+0000 mgr.gibba043.dnkmem (mgr.34373) 7036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:08.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:08 gibba043 bash[24019]: audit 2021-03-10T16:04:07.078159+0000 mon.c (mon.1) 1822 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:10.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:10 gibba003 bash[31385]: cluster 2021-03-10T16:04:08.969959+0000 mgr.gibba043.dnkmem (mgr.34373) 7037 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:10 gibba003 bash[32348]: cluster 2021-03-10T16:04:08.969959+0000 mgr.gibba043.dnkmem (mgr.34373) 7037 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:10 gibba043 bash[24019]: cluster 2021-03-10T16:04:08.969959+0000 mgr.gibba043.dnkmem (mgr.34373) 7037 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:10.858 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:04:11.085 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:04:11.086 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:04:11.086 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:04:11.086 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:04:11.086 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:04:11.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:04:11.087 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:04:11.087 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:04:11.087 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:04:11.088 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:04:11.088 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:04:11.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:04:11.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:04:11.088 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:04:11.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:04:11.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:04:11.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:04:11.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:04:11.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:04:11.090 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:04:11.090 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:04:11.334 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:04:11.335 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:04:11.335 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:11.335 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:04:11.335 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:04:11.336 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:11.336 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:04:11.336 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:04:11.336 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:04:11.336 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:04:11.337 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:04:11.337 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:04:11.337 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:04:11.337 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:04:11.338 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:04:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[31385]: audit 2021-03-10T16:04:10.849005+0000 mgr.gibba043.dnkmem (mgr.34373) 7038 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[31385]: cluster 2021-03-10T16:04:10.971656+0000 mgr.gibba043.dnkmem (mgr.34373) 7039 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[31385]: audit 2021-03-10T16:04:11.073892+0000 mgr.gibba043.dnkmem (mgr.34373) 7040 : audit [DBG] from='client.58762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[31385]: audit 2021-03-10T16:04:11.336374+0000 mon.a (mon.0) 1570 : audit [DBG] from='client.? 172.21.2.103:0/380266322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[32348]: audit 2021-03-10T16:04:10.849005+0000 mgr.gibba043.dnkmem (mgr.34373) 7038 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[32348]: cluster 2021-03-10T16:04:10.971656+0000 mgr.gibba043.dnkmem (mgr.34373) 7039 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[32348]: audit 2021-03-10T16:04:11.073892+0000 mgr.gibba043.dnkmem (mgr.34373) 7040 : audit [DBG] from='client.58762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:11 gibba003 bash[32348]: audit 2021-03-10T16:04:11.336374+0000 mon.a (mon.0) 1570 : audit [DBG] from='client.? 172.21.2.103:0/380266322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:11 gibba043 bash[24019]: audit 2021-03-10T16:04:10.849005+0000 mgr.gibba043.dnkmem (mgr.34373) 7038 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:11 gibba043 bash[24019]: cluster 2021-03-10T16:04:10.971656+0000 mgr.gibba043.dnkmem (mgr.34373) 7039 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:11 gibba043 bash[24019]: audit 2021-03-10T16:04:11.073892+0000 mgr.gibba043.dnkmem (mgr.34373) 7040 : audit [DBG] from='client.58762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:11 gibba043 bash[24019]: audit 2021-03-10T16:04:11.336374+0000 mon.a (mon.0) 1570 : audit [DBG] from='client.? 172.21.2.103:0/380266322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: cluster 2021-03-10T16:04:12.973319+0000 mgr.gibba043.dnkmem (mgr.34373) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.577546+0000 mon.c (mon.1) 1823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.578793+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.744258+0000 mon.c (mon.1) 1824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.745471+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.892525+0000 mon.c (mon.1) 1825 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:04:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.893304+0000 mon.c (mon.1) 1826 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:04:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.893892+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:04:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.894008+0000 mon.c (mon.1) 1827 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.894714+0000 mon.c (mon.1) 1828 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.896417+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:04:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.897645+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[31385]: audit 2021-03-10T16:04:13.898696+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: cluster 2021-03-10T16:04:12.973319+0000 mgr.gibba043.dnkmem (mgr.34373) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.577546+0000 mon.c (mon.1) 1823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.578793+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.744258+0000 mon.c (mon.1) 1824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.745471+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.892525+0000 mon.c (mon.1) 1825 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:04:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.893304+0000 mon.c (mon.1) 1826 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:04:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.893892+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:04:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.894008+0000 mon.c (mon.1) 1827 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.894714+0000 mon.c (mon.1) 1828 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.896417+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:04:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.897645+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:14 gibba003 bash[32348]: audit 2021-03-10T16:04:13.898696+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: cluster 2021-03-10T16:04:12.973319+0000 mgr.gibba043.dnkmem (mgr.34373) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.577546+0000 mon.c (mon.1) 1823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.578793+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.744258+0000 mon.c (mon.1) 1824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.745471+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.892525+0000 mon.c (mon.1) 1825 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:04:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.893304+0000 mon.c (mon.1) 1826 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:04:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.893892+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:04:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.894008+0000 mon.c (mon.1) 1827 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.894714+0000 mon.c (mon.1) 1828 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.896417+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:04:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.897645+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:04:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:14 gibba043 bash[24019]: audit 2021-03-10T16:04:13.898696+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:16.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:16 gibba003 bash[31385]: cluster 2021-03-10T16:04:14.974808+0000 mgr.gibba043.dnkmem (mgr.34373) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:16.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:16 gibba003 bash[32348]: cluster 2021-03-10T16:04:14.974808+0000 mgr.gibba043.dnkmem (mgr.34373) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:16.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:16 gibba043 bash[24019]: cluster 2021-03-10T16:04:14.974808+0000 mgr.gibba043.dnkmem (mgr.34373) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:18 gibba003 bash[31385]: cluster 2021-03-10T16:04:16.976468+0000 mgr.gibba043.dnkmem (mgr.34373) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:18 gibba003 bash[32348]: cluster 2021-03-10T16:04:16.976468+0000 mgr.gibba043.dnkmem (mgr.34373) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:18.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:18 gibba043 bash[24019]: cluster 2021-03-10T16:04:16.976468+0000 mgr.gibba043.dnkmem (mgr.34373) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:20 gibba003 bash[31385]: cluster 2021-03-10T16:04:18.978093+0000 mgr.gibba043.dnkmem (mgr.34373) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:20 gibba003 bash[32348]: cluster 2021-03-10T16:04:18.978093+0000 mgr.gibba043.dnkmem (mgr.34373) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:20 gibba043 bash[24019]: cluster 2021-03-10T16:04:18.978093+0000 mgr.gibba043.dnkmem (mgr.34373) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:21 gibba003 bash[31385]: cluster 2021-03-10T16:04:20.979769+0000 mgr.gibba043.dnkmem (mgr.34373) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:21 gibba003 bash[32348]: cluster 2021-03-10T16:04:20.979769+0000 mgr.gibba043.dnkmem (mgr.34373) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:21 gibba043 bash[24019]: cluster 2021-03-10T16:04:20.979769+0000 mgr.gibba043.dnkmem (mgr.34373) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:22.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:22 gibba003 bash[31385]: cephadm 2021-03-10T16:04:22.094139+0000 mgr.gibba043.dnkmem (mgr.34373) 7046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:22.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:22 gibba003 bash[32348]: cephadm 2021-03-10T16:04:22.094139+0000 mgr.gibba043.dnkmem (mgr.34373) 7046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:23.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:22 gibba043 bash[24019]: cephadm 2021-03-10T16:04:22.094139+0000 mgr.gibba043.dnkmem (mgr.34373) 7046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:23 gibba003 bash[31385]: cluster 2021-03-10T16:04:22.981349+0000 mgr.gibba043.dnkmem (mgr.34373) 7047 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:23 gibba003 bash[32348]: cluster 2021-03-10T16:04:22.981349+0000 mgr.gibba043.dnkmem (mgr.34373) 7047 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:23 gibba043 bash[24019]: cluster 2021-03-10T16:04:22.981349+0000 mgr.gibba043.dnkmem (mgr.34373) 7047 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:26.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:26 gibba003 bash[31385]: cluster 2021-03-10T16:04:24.982805+0000 mgr.gibba043.dnkmem (mgr.34373) 7048 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:26.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:26 gibba003 bash[32348]: cluster 2021-03-10T16:04:24.982805+0000 mgr.gibba043.dnkmem (mgr.34373) 7048 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:26 gibba043 bash[24019]: cluster 2021-03-10T16:04:24.982805+0000 mgr.gibba043.dnkmem (mgr.34373) 7048 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:28 gibba003 bash[31385]: cluster 2021-03-10T16:04:26.984533+0000 mgr.gibba043.dnkmem (mgr.34373) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:28 gibba003 bash[32348]: cluster 2021-03-10T16:04:26.984533+0000 mgr.gibba043.dnkmem (mgr.34373) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:28 gibba043 bash[24019]: cluster 2021-03-10T16:04:26.984533+0000 mgr.gibba043.dnkmem (mgr.34373) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:30.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:30 gibba003 bash[31385]: cluster 2021-03-10T16:04:28.986022+0000 mgr.gibba043.dnkmem (mgr.34373) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:30.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:30 gibba003 bash[32348]: cluster 2021-03-10T16:04:28.986022+0000 mgr.gibba043.dnkmem (mgr.34373) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:30.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:30 gibba043 bash[24019]: cluster 2021-03-10T16:04:28.986022+0000 mgr.gibba043.dnkmem (mgr.34373) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:31 gibba003 bash[31385]: cluster 2021-03-10T16:04:30.987727+0000 mgr.gibba043.dnkmem (mgr.34373) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:31 gibba003 bash[32348]: cluster 2021-03-10T16:04:30.987727+0000 mgr.gibba043.dnkmem (mgr.34373) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:31 gibba043 bash[24019]: cluster 2021-03-10T16:04:30.987727+0000 mgr.gibba043.dnkmem (mgr.34373) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:34 gibba003 bash[31385]: cluster 2021-03-10T16:04:32.989404+0000 mgr.gibba043.dnkmem (mgr.34373) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:34 gibba003 bash[32348]: cluster 2021-03-10T16:04:32.989404+0000 mgr.gibba043.dnkmem (mgr.34373) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:34 gibba043 bash[24019]: cluster 2021-03-10T16:04:32.989404+0000 mgr.gibba043.dnkmem (mgr.34373) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:36 gibba003 bash[32348]: cluster 2021-03-10T16:04:34.990908+0000 mgr.gibba043.dnkmem (mgr.34373) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:36 gibba003 bash[31385]: cluster 2021-03-10T16:04:34.990908+0000 mgr.gibba043.dnkmem (mgr.34373) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:36 gibba043 bash[24019]: cluster 2021-03-10T16:04:34.990908+0000 mgr.gibba043.dnkmem (mgr.34373) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:38 gibba003 bash[31385]: cluster 2021-03-10T16:04:36.992674+0000 mgr.gibba043.dnkmem (mgr.34373) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:38 gibba003 bash[31385]: cephadm 2021-03-10T16:04:37.110206+0000 mgr.gibba043.dnkmem (mgr.34373) 7055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:38 gibba003 bash[32348]: cluster 2021-03-10T16:04:36.992674+0000 mgr.gibba043.dnkmem (mgr.34373) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:38 gibba003 bash[32348]: cephadm 2021-03-10T16:04:37.110206+0000 mgr.gibba043.dnkmem (mgr.34373) 7055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:38 gibba043 bash[24019]: cluster 2021-03-10T16:04:36.992674+0000 mgr.gibba043.dnkmem (mgr.34373) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:38 gibba043 bash[24019]: cephadm 2021-03-10T16:04:37.110206+0000 mgr.gibba043.dnkmem (mgr.34373) 7055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:40.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:40 gibba003 bash[31385]: cluster 2021-03-10T16:04:38.994336+0000 mgr.gibba043.dnkmem (mgr.34373) 7056 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:40.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:40 gibba003 bash[32348]: cluster 2021-03-10T16:04:38.994336+0000 mgr.gibba043.dnkmem (mgr.34373) 7056 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:40.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:40 gibba043 bash[24019]: cluster 2021-03-10T16:04:38.994336+0000 mgr.gibba043.dnkmem (mgr.34373) 7056 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:41.585 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:04:41.814 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:04:41.814 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:04:41.815 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:04:41.815 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:04:41.815 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:04:41.815 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:04:41.816 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:04:41.816 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:04:41.816 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:04:41.816 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:04:41.816 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:04:41.817 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:04:41.817 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:04:41.817 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:04:41.817 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:04:41.818 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:04:41.818 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:04:41.818 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:04:41.818 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:04:41.819 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:04:41.819 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:04:41.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:41 gibba003 bash[31385]: cluster 2021-03-10T16:04:40.995985+0000 mgr.gibba043.dnkmem (mgr.34373) 7057 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:41 gibba003 bash[32348]: cluster 2021-03-10T16:04:40.995985+0000 mgr.gibba043.dnkmem (mgr.34373) 7057 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:41 gibba043 bash[24019]: cluster 2021-03-10T16:04:40.995985+0000 mgr.gibba043.dnkmem (mgr.34373) 7057 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:42.063 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:04:42.063 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:04:42.064 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:42.064 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:04:42.064 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:04:42.064 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:42.064 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:04:42.065 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:04:42.065 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:04:42.065 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:04:42.065 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:04:42.066 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:04:42.066 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:04:42.066 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:04:42.067 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:04:42.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:42 gibba003 bash[31385]: audit 2021-03-10T16:04:41.576733+0000 mgr.gibba043.dnkmem (mgr.34373) 7058 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:42.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:42 gibba003 bash[31385]: audit 2021-03-10T16:04:41.802531+0000 mgr.gibba043.dnkmem (mgr.34373) 7059 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:42 gibba003 bash[31385]: audit 2021-03-10T16:04:42.065374+0000 mon.a (mon.0) 1577 : audit [DBG] from='client.? 172.21.2.103:0/287077931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:42.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:42 gibba003 bash[32348]: audit 2021-03-10T16:04:41.576733+0000 mgr.gibba043.dnkmem (mgr.34373) 7058 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:42.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:42 gibba003 bash[32348]: audit 2021-03-10T16:04:41.802531+0000 mgr.gibba043.dnkmem (mgr.34373) 7059 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:42 gibba003 bash[32348]: audit 2021-03-10T16:04:42.065374+0000 mon.a (mon.0) 1577 : audit [DBG] from='client.? 172.21.2.103:0/287077931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:43.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:42 gibba043 bash[24019]: audit 2021-03-10T16:04:41.576733+0000 mgr.gibba043.dnkmem (mgr.34373) 7058 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:43.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:42 gibba043 bash[24019]: audit 2021-03-10T16:04:41.802531+0000 mgr.gibba043.dnkmem (mgr.34373) 7059 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:43.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:42 gibba043 bash[24019]: audit 2021-03-10T16:04:42.065374+0000 mon.a (mon.0) 1577 : audit [DBG] from='client.? 172.21.2.103:0/287077931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:43 gibba003 bash[31385]: cluster 2021-03-10T16:04:42.997640+0000 mgr.gibba043.dnkmem (mgr.34373) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:43 gibba003 bash[32348]: cluster 2021-03-10T16:04:42.997640+0000 mgr.gibba043.dnkmem (mgr.34373) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:43 gibba043 bash[24019]: cluster 2021-03-10T16:04:42.997640+0000 mgr.gibba043.dnkmem (mgr.34373) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:46 gibba003 bash[31385]: cluster 2021-03-10T16:04:44.999302+0000 mgr.gibba043.dnkmem (mgr.34373) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:46 gibba003 bash[32348]: cluster 2021-03-10T16:04:44.999302+0000 mgr.gibba043.dnkmem (mgr.34373) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:46 gibba043 bash[24019]: cluster 2021-03-10T16:04:44.999302+0000 mgr.gibba043.dnkmem (mgr.34373) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:48 gibba003 bash[31385]: cluster 2021-03-10T16:04:47.001041+0000 mgr.gibba043.dnkmem (mgr.34373) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:48 gibba003 bash[32348]: cluster 2021-03-10T16:04:47.001041+0000 mgr.gibba043.dnkmem (mgr.34373) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:48 gibba043 bash[24019]: cluster 2021-03-10T16:04:47.001041+0000 mgr.gibba043.dnkmem (mgr.34373) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:50.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:50 gibba003 bash[31385]: cluster 2021-03-10T16:04:49.002628+0000 mgr.gibba043.dnkmem (mgr.34373) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:50 gibba003 bash[32348]: cluster 2021-03-10T16:04:49.002628+0000 mgr.gibba043.dnkmem (mgr.34373) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:50.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:50 gibba043 bash[24019]: cluster 2021-03-10T16:04:49.002628+0000 mgr.gibba043.dnkmem (mgr.34373) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:51 gibba003 bash[31385]: cluster 2021-03-10T16:04:51.004354+0000 mgr.gibba043.dnkmem (mgr.34373) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:51 gibba003 bash[32348]: cluster 2021-03-10T16:04:51.004354+0000 mgr.gibba043.dnkmem (mgr.34373) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:51 gibba043 bash[24019]: cluster 2021-03-10T16:04:51.004354+0000 mgr.gibba043.dnkmem (mgr.34373) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:52 gibba003 bash[31385]: cephadm 2021-03-10T16:04:52.126296+0000 mgr.gibba043.dnkmem (mgr.34373) 7065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:52.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:52 gibba003 bash[32348]: cephadm 2021-03-10T16:04:52.126296+0000 mgr.gibba043.dnkmem (mgr.34373) 7065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:53.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:52 gibba043 bash[24019]: cephadm 2021-03-10T16:04:52.126296+0000 mgr.gibba043.dnkmem (mgr.34373) 7065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:04:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:53 gibba003 bash[31385]: cluster 2021-03-10T16:04:53.005517+0000 mgr.gibba043.dnkmem (mgr.34373) 7066 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:53 gibba003 bash[32348]: cluster 2021-03-10T16:04:53.005517+0000 mgr.gibba043.dnkmem (mgr.34373) 7066 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:53 gibba043 bash[24019]: cluster 2021-03-10T16:04:53.005517+0000 mgr.gibba043.dnkmem (mgr.34373) 7066 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:56 gibba003 bash[31385]: cluster 2021-03-10T16:04:55.007013+0000 mgr.gibba043.dnkmem (mgr.34373) 7067 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:56 gibba003 bash[32348]: cluster 2021-03-10T16:04:55.007013+0000 mgr.gibba043.dnkmem (mgr.34373) 7067 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:56 gibba043 bash[24019]: cluster 2021-03-10T16:04:55.007013+0000 mgr.gibba043.dnkmem (mgr.34373) 7067 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:04:58 gibba003 bash[31385]: cluster 2021-03-10T16:04:57.008699+0000 mgr.gibba043.dnkmem (mgr.34373) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:04:58 gibba003 bash[32348]: cluster 2021-03-10T16:04:57.008699+0000 mgr.gibba043.dnkmem (mgr.34373) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:04:58 gibba043 bash[24019]: cluster 2021-03-10T16:04:57.008699+0000 mgr.gibba043.dnkmem (mgr.34373) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:00 gibba003 bash[31385]: cluster 2021-03-10T16:04:59.010314+0000 mgr.gibba043.dnkmem (mgr.34373) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:00 gibba003 bash[32348]: cluster 2021-03-10T16:04:59.010314+0000 mgr.gibba043.dnkmem (mgr.34373) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:00 gibba043 bash[24019]: cluster 2021-03-10T16:04:59.010314+0000 mgr.gibba043.dnkmem (mgr.34373) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:01 gibba043 bash[24019]: cluster 2021-03-10T16:05:01.012126+0000 mgr.gibba043.dnkmem (mgr.34373) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:01 gibba003 bash[31385]: cluster 2021-03-10T16:05:01.012126+0000 mgr.gibba043.dnkmem (mgr.34373) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:01 gibba003 bash[32348]: cluster 2021-03-10T16:05:01.012126+0000 mgr.gibba043.dnkmem (mgr.34373) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:04 gibba003 bash[31385]: cluster 2021-03-10T16:05:03.013538+0000 mgr.gibba043.dnkmem (mgr.34373) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:04 gibba003 bash[32348]: cluster 2021-03-10T16:05:03.013538+0000 mgr.gibba043.dnkmem (mgr.34373) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:04 gibba043 bash[24019]: cluster 2021-03-10T16:05:03.013538+0000 mgr.gibba043.dnkmem (mgr.34373) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:06 gibba003 bash[31385]: cluster 2021-03-10T16:05:05.015066+0000 mgr.gibba043.dnkmem (mgr.34373) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:06.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:06 gibba003 bash[32348]: cluster 2021-03-10T16:05:05.015066+0000 mgr.gibba043.dnkmem (mgr.34373) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:06 gibba043 bash[24019]: cluster 2021-03-10T16:05:05.015066+0000 mgr.gibba043.dnkmem (mgr.34373) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: cluster 2021-03-10T16:05:07.016742+0000 mgr.gibba043.dnkmem (mgr.34373) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.329683+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.333669+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.536035+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.540136+0000 mon.c (mon.1) 1829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.542318+0000 mon.c (mon.1) 1830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.544473+0000 mon.c (mon.1) 1831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.546075+0000 mon.c (mon.1) 1832 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.550007+0000 mon.c (mon.1) 1833 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[31385]: audit 2021-03-10T16:05:07.551805+0000 mon.c (mon.1) 1834 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: cluster 2021-03-10T16:05:07.016742+0000 mgr.gibba043.dnkmem (mgr.34373) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.329683+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.333669+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.536035+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.540136+0000 mon.c (mon.1) 1829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.542318+0000 mon.c (mon.1) 1830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.544473+0000 mon.c (mon.1) 1831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.546075+0000 mon.c (mon.1) 1832 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.550007+0000 mon.c (mon.1) 1833 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:08 gibba003 bash[32348]: audit 2021-03-10T16:05:07.551805+0000 mon.c (mon.1) 1834 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: cluster 2021-03-10T16:05:07.016742+0000 mgr.gibba043.dnkmem (mgr.34373) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.329683+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.333669+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.536035+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:05:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.540136+0000 mon.c (mon.1) 1829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.542318+0000 mon.c (mon.1) 1830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.544473+0000 mon.c (mon.1) 1831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.546075+0000 mon.c (mon.1) 1832 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.550007+0000 mon.c (mon.1) 1833 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:08 gibba043 bash[24019]: audit 2021-03-10T16:05:07.551805+0000 mon.c (mon.1) 1834 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:09.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.329654+0000 mgr.gibba043.dnkmem (mgr.34373) 7074 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:05:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.333336+0000 mgr.gibba043.dnkmem (mgr.34373) 7075 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:05:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.537638+0000 mgr.gibba043.dnkmem (mgr.34373) 7076 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.540345+0000 mgr.gibba043.dnkmem (mgr.34373) 7077 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.542348+0000 mgr.gibba043.dnkmem (mgr.34373) 7078 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.542385+0000 mgr.gibba043.dnkmem (mgr.34373) 7079 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.544175+0000 mgr.gibba043.dnkmem (mgr.34373) 7080 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.544211+0000 mgr.gibba043.dnkmem (mgr.34373) 7081 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.545924+0000 mgr.gibba043.dnkmem (mgr.34373) 7082 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.548048+0000 mgr.gibba043.dnkmem (mgr.34373) 7083 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.548083+0000 mgr.gibba043.dnkmem (mgr.34373) 7084 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.549550+0000 mgr.gibba043.dnkmem (mgr.34373) 7085 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.549868+0000 mgr.gibba043.dnkmem (mgr.34373) 7086 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.551461+0000 mgr.gibba043.dnkmem (mgr.34373) 7087 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.551499+0000 mgr.gibba043.dnkmem (mgr.34373) 7088 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[31385]: cephadm 2021-03-10T16:05:07.551602+0000 mgr.gibba043.dnkmem (mgr.34373) 7089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.329654+0000 mgr.gibba043.dnkmem (mgr.34373) 7074 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:05:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.333336+0000 mgr.gibba043.dnkmem (mgr.34373) 7075 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:05:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.537638+0000 mgr.gibba043.dnkmem (mgr.34373) 7076 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.540345+0000 mgr.gibba043.dnkmem (mgr.34373) 7077 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.542348+0000 mgr.gibba043.dnkmem (mgr.34373) 7078 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.542385+0000 mgr.gibba043.dnkmem (mgr.34373) 7079 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.544175+0000 mgr.gibba043.dnkmem (mgr.34373) 7080 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.544211+0000 mgr.gibba043.dnkmem (mgr.34373) 7081 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.545924+0000 mgr.gibba043.dnkmem (mgr.34373) 7082 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.548048+0000 mgr.gibba043.dnkmem (mgr.34373) 7083 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.548083+0000 mgr.gibba043.dnkmem (mgr.34373) 7084 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.549550+0000 mgr.gibba043.dnkmem (mgr.34373) 7085 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.549868+0000 mgr.gibba043.dnkmem (mgr.34373) 7086 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.551461+0000 mgr.gibba043.dnkmem (mgr.34373) 7087 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.551499+0000 mgr.gibba043.dnkmem (mgr.34373) 7088 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:09 gibba003 bash[32348]: cephadm 2021-03-10T16:05:07.551602+0000 mgr.gibba043.dnkmem (mgr.34373) 7089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.329654+0000 mgr.gibba043.dnkmem (mgr.34373) 7074 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:05:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.333336+0000 mgr.gibba043.dnkmem (mgr.34373) 7075 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:05:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.537638+0000 mgr.gibba043.dnkmem (mgr.34373) 7076 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.540345+0000 mgr.gibba043.dnkmem (mgr.34373) 7077 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.542348+0000 mgr.gibba043.dnkmem (mgr.34373) 7078 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.542385+0000 mgr.gibba043.dnkmem (mgr.34373) 7079 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.544175+0000 mgr.gibba043.dnkmem (mgr.34373) 7080 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.544211+0000 mgr.gibba043.dnkmem (mgr.34373) 7081 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.545924+0000 mgr.gibba043.dnkmem (mgr.34373) 7082 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.548048+0000 mgr.gibba043.dnkmem (mgr.34373) 7083 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.548083+0000 mgr.gibba043.dnkmem (mgr.34373) 7084 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.549550+0000 mgr.gibba043.dnkmem (mgr.34373) 7085 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.549868+0000 mgr.gibba043.dnkmem (mgr.34373) 7086 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.551461+0000 mgr.gibba043.dnkmem (mgr.34373) 7087 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.551499+0000 mgr.gibba043.dnkmem (mgr.34373) 7088 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:09 gibba043 bash[24019]: cephadm 2021-03-10T16:05:07.551602+0000 mgr.gibba043.dnkmem (mgr.34373) 7089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:10.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:10 gibba003 bash[31385]: cluster 2021-03-10T16:05:09.018339+0000 mgr.gibba043.dnkmem (mgr.34373) 7090 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:10 gibba003 bash[32348]: cluster 2021-03-10T16:05:09.018339+0000 mgr.gibba043.dnkmem (mgr.34373) 7090 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:10 gibba043 bash[24019]: cluster 2021-03-10T16:05:09.018339+0000 mgr.gibba043.dnkmem (mgr.34373) 7090 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:11 gibba003 bash[31385]: cluster 2021-03-10T16:05:11.020199+0000 mgr.gibba043.dnkmem (mgr.34373) 7091 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:11 gibba003 bash[32348]: cluster 2021-03-10T16:05:11.020199+0000 mgr.gibba043.dnkmem (mgr.34373) 7091 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:11 gibba043 bash[24019]: cluster 2021-03-10T16:05:11.020199+0000 mgr.gibba043.dnkmem (mgr.34373) 7091 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.305 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:05:12.535 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:05:12.535 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:05:12.535 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:05:12.535 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:05:12.536 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:05:12.536 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:05:12.536 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:05:12.536 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:05:12.537 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:05:12.537 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:05:12.537 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:05:12.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:05:12.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:05:12.538 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:05:12.538 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:05:12.538 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:05:12.538 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:05:12.539 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:05:12.539 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:05:12.539 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:05:12.539 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:05:12.789 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:05:12.789 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:05:12.789 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:12.790 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:05:12.790 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:05:12.790 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:12.790 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:05:12.791 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:05:12.791 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:05:12.791 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:05:12.791 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:05:12.792 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:05:12.792 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:05:12.792 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:05:12.792 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:05:13.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:12 gibba003 bash[31385]: audit 2021-03-10T16:05:12.790713+0000 mon.a (mon.0) 1581 : audit [DBG] from='client.? 172.21.2.103:0/423351058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:13.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:12 gibba003 bash[32348]: audit 2021-03-10T16:05:12.790713+0000 mon.a (mon.0) 1581 : audit [DBG] from='client.? 172.21.2.103:0/423351058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:13.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:12 gibba043 bash[24019]: audit 2021-03-10T16:05:12.790713+0000 mon.a (mon.0) 1581 : audit [DBG] from='client.? 172.21.2.103:0/423351058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: audit 2021-03-10T16:05:12.297199+0000 mgr.gibba043.dnkmem (mgr.34373) 7092 : audit [DBG] from='client.48804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: audit 2021-03-10T16:05:12.523378+0000 mgr.gibba043.dnkmem (mgr.34373) 7093 : audit [DBG] from='client.58798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: cluster 2021-03-10T16:05:13.021471+0000 mgr.gibba043.dnkmem (mgr.34373) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: audit 2021-03-10T16:05:13.584926+0000 mon.c (mon.1) 1835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: audit 2021-03-10T16:05:13.586002+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: audit 2021-03-10T16:05:13.753034+0000 mon.c (mon.1) 1836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[31385]: audit 2021-03-10T16:05:13.754152+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: audit 2021-03-10T16:05:12.297199+0000 mgr.gibba043.dnkmem (mgr.34373) 7092 : audit [DBG] from='client.48804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: audit 2021-03-10T16:05:12.523378+0000 mgr.gibba043.dnkmem (mgr.34373) 7093 : audit [DBG] from='client.58798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: cluster 2021-03-10T16:05:13.021471+0000 mgr.gibba043.dnkmem (mgr.34373) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: audit 2021-03-10T16:05:13.584926+0000 mon.c (mon.1) 1835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: audit 2021-03-10T16:05:13.586002+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: audit 2021-03-10T16:05:13.753034+0000 mon.c (mon.1) 1836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:13 gibba003 bash[32348]: audit 2021-03-10T16:05:13.754152+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: audit 2021-03-10T16:05:12.297199+0000 mgr.gibba043.dnkmem (mgr.34373) 7092 : audit [DBG] from='client.48804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: audit 2021-03-10T16:05:12.523378+0000 mgr.gibba043.dnkmem (mgr.34373) 7093 : audit [DBG] from='client.58798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: cluster 2021-03-10T16:05:13.021471+0000 mgr.gibba043.dnkmem (mgr.34373) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: audit 2021-03-10T16:05:13.584926+0000 mon.c (mon.1) 1835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: audit 2021-03-10T16:05:13.586002+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: audit 2021-03-10T16:05:13.753034+0000 mon.c (mon.1) 1836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:13 gibba043 bash[24019]: audit 2021-03-10T16:05:13.754152+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.899529+0000 mon.c (mon.1) 1837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:05:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.899829+0000 mon.c (mon.1) 1838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.900014+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:05:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.900127+0000 mon.c (mon.1) 1839 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.900512+0000 mon.c (mon.1) 1840 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:05:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.900710+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.901070+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[31385]: audit 2021-03-10T16:05:13.901323+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:05:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.899529+0000 mon.c (mon.1) 1837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:05:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.899829+0000 mon.c (mon.1) 1838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.900014+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:05:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.900127+0000 mon.c (mon.1) 1839 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.900512+0000 mon.c (mon.1) 1840 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:05:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.900710+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.901070+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:14 gibba003 bash[32348]: audit 2021-03-10T16:05:13.901323+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:05:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.899529+0000 mon.c (mon.1) 1837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:05:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.899829+0000 mon.c (mon.1) 1838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.900014+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:05:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.900127+0000 mon.c (mon.1) 1839 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.900512+0000 mon.c (mon.1) 1840 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:05:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.900710+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.901070+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:05:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:14 gibba043 bash[24019]: audit 2021-03-10T16:05:13.901323+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:05:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:15 gibba003 bash[31385]: cluster 2021-03-10T16:05:15.023020+0000 mgr.gibba043.dnkmem (mgr.34373) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:16.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:15 gibba003 bash[32348]: cluster 2021-03-10T16:05:15.023020+0000 mgr.gibba043.dnkmem (mgr.34373) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:15 gibba043 bash[24019]: cluster 2021-03-10T16:05:15.023020+0000 mgr.gibba043.dnkmem (mgr.34373) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:18 gibba003 bash[31385]: cluster 2021-03-10T16:05:17.024363+0000 mgr.gibba043.dnkmem (mgr.34373) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:18.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:18 gibba003 bash[32348]: cluster 2021-03-10T16:05:17.024363+0000 mgr.gibba043.dnkmem (mgr.34373) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:18 gibba043 bash[24019]: cluster 2021-03-10T16:05:17.024363+0000 mgr.gibba043.dnkmem (mgr.34373) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:20 gibba003 bash[31385]: cluster 2021-03-10T16:05:19.025712+0000 mgr.gibba043.dnkmem (mgr.34373) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:20.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:20 gibba003 bash[32348]: cluster 2021-03-10T16:05:19.025712+0000 mgr.gibba043.dnkmem (mgr.34373) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:20 gibba043 bash[24019]: cluster 2021-03-10T16:05:19.025712+0000 mgr.gibba043.dnkmem (mgr.34373) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:21 gibba003 bash[32348]: cluster 2021-03-10T16:05:21.027484+0000 mgr.gibba043.dnkmem (mgr.34373) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:21 gibba003 bash[31385]: cluster 2021-03-10T16:05:21.027484+0000 mgr.gibba043.dnkmem (mgr.34373) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:21 gibba043 bash[24019]: cluster 2021-03-10T16:05:21.027484+0000 mgr.gibba043.dnkmem (mgr.34373) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:24 gibba003 bash[31385]: cephadm 2021-03-10T16:05:22.567536+0000 mgr.gibba043.dnkmem (mgr.34373) 7099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:24 gibba003 bash[31385]: cluster 2021-03-10T16:05:23.028845+0000 mgr.gibba043.dnkmem (mgr.34373) 7100 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:24 gibba003 bash[32348]: cephadm 2021-03-10T16:05:22.567536+0000 mgr.gibba043.dnkmem (mgr.34373) 7099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:24 gibba003 bash[32348]: cluster 2021-03-10T16:05:23.028845+0000 mgr.gibba043.dnkmem (mgr.34373) 7100 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:24 gibba043 bash[24019]: cephadm 2021-03-10T16:05:22.567536+0000 mgr.gibba043.dnkmem (mgr.34373) 7099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:24 gibba043 bash[24019]: cluster 2021-03-10T16:05:23.028845+0000 mgr.gibba043.dnkmem (mgr.34373) 7100 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:26.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:26 gibba003 bash[31385]: cluster 2021-03-10T16:05:25.030396+0000 mgr.gibba043.dnkmem (mgr.34373) 7101 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:26.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:26 gibba003 bash[32348]: cluster 2021-03-10T16:05:25.030396+0000 mgr.gibba043.dnkmem (mgr.34373) 7101 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:26 gibba043 bash[24019]: cluster 2021-03-10T16:05:25.030396+0000 mgr.gibba043.dnkmem (mgr.34373) 7101 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:28 gibba003 bash[31385]: cluster 2021-03-10T16:05:27.032104+0000 mgr.gibba043.dnkmem (mgr.34373) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:28 gibba003 bash[32348]: cluster 2021-03-10T16:05:27.032104+0000 mgr.gibba043.dnkmem (mgr.34373) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:28 gibba043 bash[24019]: cluster 2021-03-10T16:05:27.032104+0000 mgr.gibba043.dnkmem (mgr.34373) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:30.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:30 gibba003 bash[31385]: cluster 2021-03-10T16:05:29.033793+0000 mgr.gibba043.dnkmem (mgr.34373) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:30.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:30 gibba003 bash[32348]: cluster 2021-03-10T16:05:29.033793+0000 mgr.gibba043.dnkmem (mgr.34373) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:30.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:30 gibba043 bash[24019]: cluster 2021-03-10T16:05:29.033793+0000 mgr.gibba043.dnkmem (mgr.34373) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:31 gibba003 bash[31385]: cluster 2021-03-10T16:05:31.035470+0000 mgr.gibba043.dnkmem (mgr.34373) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:31 gibba003 bash[32348]: cluster 2021-03-10T16:05:31.035470+0000 mgr.gibba043.dnkmem (mgr.34373) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:32.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:31 gibba043 bash[24019]: cluster 2021-03-10T16:05:31.035470+0000 mgr.gibba043.dnkmem (mgr.34373) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:34.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:34 gibba003 bash[31385]: cluster 2021-03-10T16:05:33.036664+0000 mgr.gibba043.dnkmem (mgr.34373) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:34.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:34 gibba003 bash[32348]: cluster 2021-03-10T16:05:33.036664+0000 mgr.gibba043.dnkmem (mgr.34373) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:34.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:34 gibba043 bash[24019]: cluster 2021-03-10T16:05:33.036664+0000 mgr.gibba043.dnkmem (mgr.34373) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:36 gibba003 bash[31385]: cluster 2021-03-10T16:05:35.038222+0000 mgr.gibba043.dnkmem (mgr.34373) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:36 gibba003 bash[32348]: cluster 2021-03-10T16:05:35.038222+0000 mgr.gibba043.dnkmem (mgr.34373) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:36 gibba043 bash[24019]: cluster 2021-03-10T16:05:35.038222+0000 mgr.gibba043.dnkmem (mgr.34373) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:38 gibba003 bash[31385]: cluster 2021-03-10T16:05:37.039960+0000 mgr.gibba043.dnkmem (mgr.34373) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:38.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:38 gibba003 bash[32348]: cluster 2021-03-10T16:05:37.039960+0000 mgr.gibba043.dnkmem (mgr.34373) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:38 gibba043 bash[24019]: cluster 2021-03-10T16:05:37.039960+0000 mgr.gibba043.dnkmem (mgr.34373) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:39.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:39 gibba003 bash[31385]: cephadm 2021-03-10T16:05:37.583419+0000 mgr.gibba043.dnkmem (mgr.34373) 7108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:39.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:39 gibba003 bash[32348]: cephadm 2021-03-10T16:05:37.583419+0000 mgr.gibba043.dnkmem (mgr.34373) 7108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:39 gibba043 bash[24019]: cephadm 2021-03-10T16:05:37.583419+0000 mgr.gibba043.dnkmem (mgr.34373) 7108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:40.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:40 gibba003 bash[31385]: cluster 2021-03-10T16:05:39.041487+0000 mgr.gibba043.dnkmem (mgr.34373) 7109 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:40.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:40 gibba003 bash[32348]: cluster 2021-03-10T16:05:39.041487+0000 mgr.gibba043.dnkmem (mgr.34373) 7109 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:40.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:40 gibba043 bash[24019]: cluster 2021-03-10T16:05:39.041487+0000 mgr.gibba043.dnkmem (mgr.34373) 7109 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:41 gibba003 bash[31385]: cluster 2021-03-10T16:05:41.043198+0000 mgr.gibba043.dnkmem (mgr.34373) 7110 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:41 gibba003 bash[32348]: cluster 2021-03-10T16:05:41.043198+0000 mgr.gibba043.dnkmem (mgr.34373) 7110 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:41 gibba043 bash[24019]: cluster 2021-03-10T16:05:41.043198+0000 mgr.gibba043.dnkmem (mgr.34373) 7110 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:43.031 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:05:43.286 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:05:43.287 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:05:43.287 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:05:43.287 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:05:43.288 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:05:43.288 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:05:43.288 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:05:43.288 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:05:43.288 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:05:43.289 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:05:43.289 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:05:43.289 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:05:43.289 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:05:43.289 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:05:43.290 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:05:43.290 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:05:43.290 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:05:43.290 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:05:43.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:05:43.291 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:05:43.291 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:05:43.533 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:05:43.533 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:05:43.534 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:43.534 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:05:43.534 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:05:43.534 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:43.535 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:05:43.535 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:05:43.535 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:05:43.535 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:05:43.536 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:05:43.536 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:05:43.536 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:05:43.536 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:05:43.536 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:05:44.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:44 gibba003 bash[31385]: audit 2021-03-10T16:05:43.022648+0000 mgr.gibba043.dnkmem (mgr.34373) 7111 : audit [DBG] from='client.58810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:44.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:44 gibba003 bash[31385]: cluster 2021-03-10T16:05:43.044638+0000 mgr.gibba043.dnkmem (mgr.34373) 7112 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:44.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:44 gibba003 bash[31385]: audit 2021-03-10T16:05:43.535370+0000 mon.a (mon.0) 1588 : audit [DBG] from='client.? 172.21.2.103:0/2279132290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:44.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:44 gibba003 bash[32348]: audit 2021-03-10T16:05:43.022648+0000 mgr.gibba043.dnkmem (mgr.34373) 7111 : audit [DBG] from='client.58810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:44.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:44 gibba003 bash[32348]: cluster 2021-03-10T16:05:43.044638+0000 mgr.gibba043.dnkmem (mgr.34373) 7112 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:44 gibba003 bash[32348]: audit 2021-03-10T16:05:43.535370+0000 mon.a (mon.0) 1588 : audit [DBG] from='client.? 172.21.2.103:0/2279132290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:44 gibba043 bash[24019]: audit 2021-03-10T16:05:43.022648+0000 mgr.gibba043.dnkmem (mgr.34373) 7111 : audit [DBG] from='client.58810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:44 gibba043 bash[24019]: cluster 2021-03-10T16:05:43.044638+0000 mgr.gibba043.dnkmem (mgr.34373) 7112 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:44 gibba043 bash[24019]: audit 2021-03-10T16:05:43.535370+0000 mon.a (mon.0) 1588 : audit [DBG] from='client.? 172.21.2.103:0/2279132290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:45.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:45 gibba003 bash[31385]: audit 2021-03-10T16:05:43.248622+0000 mgr.gibba043.dnkmem (mgr.34373) 7113 : audit [DBG] from='client.48828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:45.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:45 gibba003 bash[32348]: audit 2021-03-10T16:05:43.248622+0000 mgr.gibba043.dnkmem (mgr.34373) 7113 : audit [DBG] from='client.48828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:45 gibba043 bash[24019]: audit 2021-03-10T16:05:43.248622+0000 mgr.gibba043.dnkmem (mgr.34373) 7113 : audit [DBG] from='client.48828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:46.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:46 gibba003 bash[31385]: cluster 2021-03-10T16:05:45.046474+0000 mgr.gibba043.dnkmem (mgr.34373) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:46.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:46 gibba003 bash[32348]: cluster 2021-03-10T16:05:45.046474+0000 mgr.gibba043.dnkmem (mgr.34373) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:46 gibba043 bash[24019]: cluster 2021-03-10T16:05:45.046474+0000 mgr.gibba043.dnkmem (mgr.34373) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:48 gibba003 bash[31385]: cluster 2021-03-10T16:05:47.048208+0000 mgr.gibba043.dnkmem (mgr.34373) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:48 gibba003 bash[32348]: cluster 2021-03-10T16:05:47.048208+0000 mgr.gibba043.dnkmem (mgr.34373) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:48 gibba043 bash[24019]: cluster 2021-03-10T16:05:47.048208+0000 mgr.gibba043.dnkmem (mgr.34373) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:50.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:50 gibba003 bash[31385]: cluster 2021-03-10T16:05:49.049892+0000 mgr.gibba043.dnkmem (mgr.34373) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:50 gibba003 bash[32348]: cluster 2021-03-10T16:05:49.049892+0000 mgr.gibba043.dnkmem (mgr.34373) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:50.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:50 gibba043 bash[24019]: cluster 2021-03-10T16:05:49.049892+0000 mgr.gibba043.dnkmem (mgr.34373) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:51 gibba003 bash[31385]: cluster 2021-03-10T16:05:51.051650+0000 mgr.gibba043.dnkmem (mgr.34373) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:51 gibba003 bash[32348]: cluster 2021-03-10T16:05:51.051650+0000 mgr.gibba043.dnkmem (mgr.34373) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:51 gibba043 bash[24019]: cluster 2021-03-10T16:05:51.051650+0000 mgr.gibba043.dnkmem (mgr.34373) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:54.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:54 gibba003 bash[31385]: cephadm 2021-03-10T16:05:52.599470+0000 mgr.gibba043.dnkmem (mgr.34373) 7118 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:54.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:54 gibba003 bash[31385]: cluster 2021-03-10T16:05:53.052909+0000 mgr.gibba043.dnkmem (mgr.34373) 7119 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:54.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:54 gibba003 bash[32348]: cephadm 2021-03-10T16:05:52.599470+0000 mgr.gibba043.dnkmem (mgr.34373) 7118 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:54.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:54 gibba003 bash[32348]: cluster 2021-03-10T16:05:53.052909+0000 mgr.gibba043.dnkmem (mgr.34373) 7119 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:54.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:54 gibba043 bash[24019]: cephadm 2021-03-10T16:05:52.599470+0000 mgr.gibba043.dnkmem (mgr.34373) 7118 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:05:54.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:54 gibba043 bash[24019]: cluster 2021-03-10T16:05:53.052909+0000 mgr.gibba043.dnkmem (mgr.34373) 7119 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:56.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:56 gibba003 bash[31385]: cluster 2021-03-10T16:05:55.054633+0000 mgr.gibba043.dnkmem (mgr.34373) 7120 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:56 gibba003 bash[32348]: cluster 2021-03-10T16:05:55.054633+0000 mgr.gibba043.dnkmem (mgr.34373) 7120 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:56 gibba043 bash[24019]: cluster 2021-03-10T16:05:55.054633+0000 mgr.gibba043.dnkmem (mgr.34373) 7120 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:05:58 gibba003 bash[31385]: cluster 2021-03-10T16:05:57.056359+0000 mgr.gibba043.dnkmem (mgr.34373) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:58.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:05:58 gibba003 bash[32348]: cluster 2021-03-10T16:05:57.056359+0000 mgr.gibba043.dnkmem (mgr.34373) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:05:58 gibba043 bash[24019]: cluster 2021-03-10T16:05:57.056359+0000 mgr.gibba043.dnkmem (mgr.34373) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:00.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:00 gibba003 bash[31385]: cluster 2021-03-10T16:05:59.058043+0000 mgr.gibba043.dnkmem (mgr.34373) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:00.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:00 gibba003 bash[32348]: cluster 2021-03-10T16:05:59.058043+0000 mgr.gibba043.dnkmem (mgr.34373) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:00 gibba043 bash[24019]: cluster 2021-03-10T16:05:59.058043+0000 mgr.gibba043.dnkmem (mgr.34373) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:01 gibba003 bash[31385]: cluster 2021-03-10T16:06:01.059558+0000 mgr.gibba043.dnkmem (mgr.34373) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:01 gibba003 bash[32348]: cluster 2021-03-10T16:06:01.059558+0000 mgr.gibba043.dnkmem (mgr.34373) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:01 gibba043 bash[24019]: cluster 2021-03-10T16:06:01.059558+0000 mgr.gibba043.dnkmem (mgr.34373) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:04 gibba003 bash[31385]: cluster 2021-03-10T16:06:03.065935+0000 mgr.gibba043.dnkmem (mgr.34373) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:04 gibba003 bash[32348]: cluster 2021-03-10T16:06:03.065935+0000 mgr.gibba043.dnkmem (mgr.34373) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:04 gibba043 bash[24019]: cluster 2021-03-10T16:06:03.065935+0000 mgr.gibba043.dnkmem (mgr.34373) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:06 gibba003 bash[31385]: cluster 2021-03-10T16:06:05.067722+0000 mgr.gibba043.dnkmem (mgr.34373) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:06 gibba003 bash[32348]: cluster 2021-03-10T16:06:05.067722+0000 mgr.gibba043.dnkmem (mgr.34373) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:06 gibba043 bash[24019]: cluster 2021-03-10T16:06:05.067722+0000 mgr.gibba043.dnkmem (mgr.34373) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: cluster 2021-03-10T16:06:07.069346+0000 mgr.gibba043.dnkmem (mgr.34373) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.822062+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:06:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.825769+0000 mon.c (mon.1) 1841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.827782+0000 mon.c (mon.1) 1842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.829636+0000 mon.c (mon.1) 1843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.830789+0000 mon.c (mon.1) 1844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.833951+0000 mon.c (mon.1) 1845 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[31385]: audit 2021-03-10T16:06:07.835723+0000 mon.c (mon.1) 1846 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: cluster 2021-03-10T16:06:07.069346+0000 mgr.gibba043.dnkmem (mgr.34373) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.822062+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:06:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.825769+0000 mon.c (mon.1) 1841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.827782+0000 mon.c (mon.1) 1842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.829636+0000 mon.c (mon.1) 1843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.830789+0000 mon.c (mon.1) 1844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.833951+0000 mon.c (mon.1) 1845 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:08 gibba003 bash[32348]: audit 2021-03-10T16:06:07.835723+0000 mon.c (mon.1) 1846 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: cluster 2021-03-10T16:06:07.069346+0000 mgr.gibba043.dnkmem (mgr.34373) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.822062+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:06:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.825769+0000 mon.c (mon.1) 1841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.827782+0000 mon.c (mon.1) 1842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.829636+0000 mon.c (mon.1) 1843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.830789+0000 mon.c (mon.1) 1844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.833951+0000 mon.c (mon.1) 1845 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:08 gibba043 bash[24019]: audit 2021-03-10T16:06:07.835723+0000 mon.c (mon.1) 1846 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:09.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.607011+0000 mgr.gibba043.dnkmem (mgr.34373) 7127 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:06:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.608618+0000 mgr.gibba043.dnkmem (mgr.34373) 7128 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:06:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.823589+0000 mgr.gibba043.dnkmem (mgr.34373) 7129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:09.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.825829+0000 mgr.gibba043.dnkmem (mgr.34373) 7130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.827623+0000 mgr.gibba043.dnkmem (mgr.34373) 7131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.827717+0000 mgr.gibba043.dnkmem (mgr.34373) 7132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.828939+0000 mgr.gibba043.dnkmem (mgr.34373) 7133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.828973+0000 mgr.gibba043.dnkmem (mgr.34373) 7134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.830279+0000 mgr.gibba043.dnkmem (mgr.34373) 7135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.831961+0000 mgr.gibba043.dnkmem (mgr.34373) 7136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.831996+0000 mgr.gibba043.dnkmem (mgr.34373) 7137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.833508+0000 mgr.gibba043.dnkmem (mgr.34373) 7138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.833899+0000 mgr.gibba043.dnkmem (mgr.34373) 7139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.835285+0000 mgr.gibba043.dnkmem (mgr.34373) 7140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.835326+0000 mgr.gibba043.dnkmem (mgr.34373) 7141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[31385]: cephadm 2021-03-10T16:06:07.835482+0000 mgr.gibba043.dnkmem (mgr.34373) 7142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.607011+0000 mgr.gibba043.dnkmem (mgr.34373) 7127 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:06:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.608618+0000 mgr.gibba043.dnkmem (mgr.34373) 7128 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:06:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.823589+0000 mgr.gibba043.dnkmem (mgr.34373) 7129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:09.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.825829+0000 mgr.gibba043.dnkmem (mgr.34373) 7130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.827623+0000 mgr.gibba043.dnkmem (mgr.34373) 7131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.827717+0000 mgr.gibba043.dnkmem (mgr.34373) 7132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.828939+0000 mgr.gibba043.dnkmem (mgr.34373) 7133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.828973+0000 mgr.gibba043.dnkmem (mgr.34373) 7134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.830279+0000 mgr.gibba043.dnkmem (mgr.34373) 7135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.831961+0000 mgr.gibba043.dnkmem (mgr.34373) 7136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.831996+0000 mgr.gibba043.dnkmem (mgr.34373) 7137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.833508+0000 mgr.gibba043.dnkmem (mgr.34373) 7138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.833899+0000 mgr.gibba043.dnkmem (mgr.34373) 7139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.835285+0000 mgr.gibba043.dnkmem (mgr.34373) 7140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.835326+0000 mgr.gibba043.dnkmem (mgr.34373) 7141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:09 gibba003 bash[32348]: cephadm 2021-03-10T16:06:07.835482+0000 mgr.gibba043.dnkmem (mgr.34373) 7142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.607011+0000 mgr.gibba043.dnkmem (mgr.34373) 7127 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:06:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.608618+0000 mgr.gibba043.dnkmem (mgr.34373) 7128 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:06:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.823589+0000 mgr.gibba043.dnkmem (mgr.34373) 7129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.825829+0000 mgr.gibba043.dnkmem (mgr.34373) 7130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.827623+0000 mgr.gibba043.dnkmem (mgr.34373) 7131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.827717+0000 mgr.gibba043.dnkmem (mgr.34373) 7132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.828939+0000 mgr.gibba043.dnkmem (mgr.34373) 7133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.828973+0000 mgr.gibba043.dnkmem (mgr.34373) 7134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.830279+0000 mgr.gibba043.dnkmem (mgr.34373) 7135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.831961+0000 mgr.gibba043.dnkmem (mgr.34373) 7136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.831996+0000 mgr.gibba043.dnkmem (mgr.34373) 7137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.833508+0000 mgr.gibba043.dnkmem (mgr.34373) 7138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.833899+0000 mgr.gibba043.dnkmem (mgr.34373) 7139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.835285+0000 mgr.gibba043.dnkmem (mgr.34373) 7140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.835326+0000 mgr.gibba043.dnkmem (mgr.34373) 7141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:09 gibba043 bash[24019]: cephadm 2021-03-10T16:06:07.835482+0000 mgr.gibba043.dnkmem (mgr.34373) 7142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:10.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:10 gibba003 bash[31385]: cluster 2021-03-10T16:06:09.070980+0000 mgr.gibba043.dnkmem (mgr.34373) 7143 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:10.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:10 gibba003 bash[32348]: cluster 2021-03-10T16:06:09.070980+0000 mgr.gibba043.dnkmem (mgr.34373) 7143 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:10 gibba043 bash[24019]: cluster 2021-03-10T16:06:09.070980+0000 mgr.gibba043.dnkmem (mgr.34373) 7143 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:11 gibba003 bash[31385]: cluster 2021-03-10T16:06:11.072874+0000 mgr.gibba043.dnkmem (mgr.34373) 7144 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:11 gibba003 bash[32348]: cluster 2021-03-10T16:06:11.072874+0000 mgr.gibba043.dnkmem (mgr.34373) 7144 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:11 gibba043 bash[24019]: cluster 2021-03-10T16:06:11.072874+0000 mgr.gibba043.dnkmem (mgr.34373) 7144 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:13.780 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:06:14.007 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:06:14.008 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:06:14.008 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:06:14.008 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:06:14.009 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:06:14.009 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:06:14.009 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:06:14.009 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:06:14.009 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:06:14.010 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:06:14.010 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:06:14.010 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:06:14.010 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:06:14.010 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:06:14.011 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:06:14.011 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:06:14.011 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:06:14.011 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:06:14.011 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:06:14.012 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:06:14.012 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:06:14.258 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:06:14.258 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:06:14.259 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:14.259 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:06:14.259 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:06:14.259 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:14.260 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:06:14.260 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:06:14.260 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:06:14.260 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:06:14.261 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:06:14.261 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:06:14.261 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:06:14.261 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:06:14.261 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:06:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: cluster 2021-03-10T16:06:13.073677+0000 mgr.gibba043.dnkmem (mgr.34373) 7145 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.591296+0000 mon.c (mon.1) 1847 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.591726+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.761036+0000 mon.c (mon.1) 1848 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.761364+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.906764+0000 mon.c (mon.1) 1849 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:06:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.906910+0000 mon.c (mon.1) 1850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.907141+0000 mon.c (mon.1) 1851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.907156+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:06:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.907373+0000 mon.c (mon.1) 1852 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.907642+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.907877+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[31385]: audit 2021-03-10T16:06:13.908083+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: cluster 2021-03-10T16:06:13.073677+0000 mgr.gibba043.dnkmem (mgr.34373) 7145 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.591296+0000 mon.c (mon.1) 1847 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.591726+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.761036+0000 mon.c (mon.1) 1848 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.761364+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.906764+0000 mon.c (mon.1) 1849 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:06:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.906910+0000 mon.c (mon.1) 1850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.907141+0000 mon.c (mon.1) 1851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.907156+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:06:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.907373+0000 mon.c (mon.1) 1852 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.907642+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.907877+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:14 gibba003 bash[32348]: audit 2021-03-10T16:06:13.908083+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: cluster 2021-03-10T16:06:13.073677+0000 mgr.gibba043.dnkmem (mgr.34373) 7145 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.591296+0000 mon.c (mon.1) 1847 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.591726+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.761036+0000 mon.c (mon.1) 1848 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.761364+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.906764+0000 mon.c (mon.1) 1849 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:06:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.906910+0000 mon.c (mon.1) 1850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.907141+0000 mon.c (mon.1) 1851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.907156+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:06:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.907373+0000 mon.c (mon.1) 1852 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.907642+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.907877+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:06:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:14 gibba043 bash[24019]: audit 2021-03-10T16:06:13.908083+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:06:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:15 gibba003 bash[31385]: audit 2021-03-10T16:06:13.766437+0000 mgr.gibba043.dnkmem (mgr.34373) 7146 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:15 gibba003 bash[31385]: audit 2021-03-10T16:06:13.995730+0000 mgr.gibba043.dnkmem (mgr.34373) 7147 : audit [DBG] from='client.58834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:15 gibba003 bash[31385]: audit 2021-03-10T16:06:14.259963+0000 mon.c (mon.1) 1853 : audit [DBG] from='client.? 172.21.2.103:0/1171789147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:15 gibba003 bash[32348]: audit 2021-03-10T16:06:13.766437+0000 mgr.gibba043.dnkmem (mgr.34373) 7146 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:15 gibba003 bash[32348]: audit 2021-03-10T16:06:13.995730+0000 mgr.gibba043.dnkmem (mgr.34373) 7147 : audit [DBG] from='client.58834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:15 gibba003 bash[32348]: audit 2021-03-10T16:06:14.259963+0000 mon.c (mon.1) 1853 : audit [DBG] from='client.? 172.21.2.103:0/1171789147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:15 gibba043 bash[24019]: audit 2021-03-10T16:06:13.766437+0000 mgr.gibba043.dnkmem (mgr.34373) 7146 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:15 gibba043 bash[24019]: audit 2021-03-10T16:06:13.995730+0000 mgr.gibba043.dnkmem (mgr.34373) 7147 : audit [DBG] from='client.58834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:15 gibba043 bash[24019]: audit 2021-03-10T16:06:14.259963+0000 mon.c (mon.1) 1853 : audit [DBG] from='client.? 172.21.2.103:0/1171789147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:16.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:16 gibba003 bash[31385]: cluster 2021-03-10T16:06:15.075253+0000 mgr.gibba043.dnkmem (mgr.34373) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:16 gibba003 bash[32348]: cluster 2021-03-10T16:06:15.075253+0000 mgr.gibba043.dnkmem (mgr.34373) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:16 gibba043 bash[24019]: cluster 2021-03-10T16:06:15.075253+0000 mgr.gibba043.dnkmem (mgr.34373) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:18 gibba003 bash[31385]: cluster 2021-03-10T16:06:17.076871+0000 mgr.gibba043.dnkmem (mgr.34373) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:18 gibba003 bash[32348]: cluster 2021-03-10T16:06:17.076871+0000 mgr.gibba043.dnkmem (mgr.34373) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:18 gibba043 bash[24019]: cluster 2021-03-10T16:06:17.076871+0000 mgr.gibba043.dnkmem (mgr.34373) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:20 gibba003 bash[31385]: cluster 2021-03-10T16:06:19.078401+0000 mgr.gibba043.dnkmem (mgr.34373) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:20 gibba003 bash[32348]: cluster 2021-03-10T16:06:19.078401+0000 mgr.gibba043.dnkmem (mgr.34373) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:20 gibba043 bash[24019]: cluster 2021-03-10T16:06:19.078401+0000 mgr.gibba043.dnkmem (mgr.34373) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:21 gibba003 bash[31385]: cluster 2021-03-10T16:06:21.080122+0000 mgr.gibba043.dnkmem (mgr.34373) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:21 gibba003 bash[32348]: cluster 2021-03-10T16:06:21.080122+0000 mgr.gibba043.dnkmem (mgr.34373) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:21 gibba043 bash[24019]: cluster 2021-03-10T16:06:21.080122+0000 mgr.gibba043.dnkmem (mgr.34373) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:24 gibba003 bash[31385]: cephadm 2021-03-10T16:06:22.851412+0000 mgr.gibba043.dnkmem (mgr.34373) 7152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:24 gibba003 bash[31385]: cluster 2021-03-10T16:06:23.080801+0000 mgr.gibba043.dnkmem (mgr.34373) 7153 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:24 gibba003 bash[32348]: cephadm 2021-03-10T16:06:22.851412+0000 mgr.gibba043.dnkmem (mgr.34373) 7152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:24 gibba003 bash[32348]: cluster 2021-03-10T16:06:23.080801+0000 mgr.gibba043.dnkmem (mgr.34373) 7153 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:24 gibba043 bash[24019]: cephadm 2021-03-10T16:06:22.851412+0000 mgr.gibba043.dnkmem (mgr.34373) 7152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:24 gibba043 bash[24019]: cluster 2021-03-10T16:06:23.080801+0000 mgr.gibba043.dnkmem (mgr.34373) 7153 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:26 gibba003 bash[31385]: cluster 2021-03-10T16:06:25.082370+0000 mgr.gibba043.dnkmem (mgr.34373) 7154 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:26 gibba003 bash[32348]: cluster 2021-03-10T16:06:25.082370+0000 mgr.gibba043.dnkmem (mgr.34373) 7154 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:26 gibba043 bash[24019]: cluster 2021-03-10T16:06:25.082370+0000 mgr.gibba043.dnkmem (mgr.34373) 7154 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:28 gibba003 bash[31385]: cluster 2021-03-10T16:06:27.084008+0000 mgr.gibba043.dnkmem (mgr.34373) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:28 gibba003 bash[32348]: cluster 2021-03-10T16:06:27.084008+0000 mgr.gibba043.dnkmem (mgr.34373) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:28 gibba043 bash[24019]: cluster 2021-03-10T16:06:27.084008+0000 mgr.gibba043.dnkmem (mgr.34373) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:30 gibba003 bash[31385]: cluster 2021-03-10T16:06:29.085375+0000 mgr.gibba043.dnkmem (mgr.34373) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:30 gibba003 bash[32348]: cluster 2021-03-10T16:06:29.085375+0000 mgr.gibba043.dnkmem (mgr.34373) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:30 gibba043 bash[24019]: cluster 2021-03-10T16:06:29.085375+0000 mgr.gibba043.dnkmem (mgr.34373) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:31 gibba003 bash[31385]: cluster 2021-03-10T16:06:31.087153+0000 mgr.gibba043.dnkmem (mgr.34373) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:31 gibba003 bash[32348]: cluster 2021-03-10T16:06:31.087153+0000 mgr.gibba043.dnkmem (mgr.34373) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:31 gibba043 bash[24019]: cluster 2021-03-10T16:06:31.087153+0000 mgr.gibba043.dnkmem (mgr.34373) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:34 gibba003 bash[31385]: cluster 2021-03-10T16:06:33.088013+0000 mgr.gibba043.dnkmem (mgr.34373) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:34 gibba003 bash[32348]: cluster 2021-03-10T16:06:33.088013+0000 mgr.gibba043.dnkmem (mgr.34373) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:34 gibba043 bash[24019]: cluster 2021-03-10T16:06:33.088013+0000 mgr.gibba043.dnkmem (mgr.34373) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:36 gibba003 bash[32348]: cluster 2021-03-10T16:06:35.089672+0000 mgr.gibba043.dnkmem (mgr.34373) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:36 gibba003 bash[31385]: cluster 2021-03-10T16:06:35.089672+0000 mgr.gibba043.dnkmem (mgr.34373) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:36 gibba043 bash[24019]: cluster 2021-03-10T16:06:35.089672+0000 mgr.gibba043.dnkmem (mgr.34373) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:38 gibba003 bash[31385]: cluster 2021-03-10T16:06:37.091265+0000 mgr.gibba043.dnkmem (mgr.34373) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:38 gibba003 bash[32348]: cluster 2021-03-10T16:06:37.091265+0000 mgr.gibba043.dnkmem (mgr.34373) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:38 gibba043 bash[24019]: cluster 2021-03-10T16:06:37.091265+0000 mgr.gibba043.dnkmem (mgr.34373) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:39.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:39 gibba003 bash[31385]: cephadm 2021-03-10T16:06:37.867379+0000 mgr.gibba043.dnkmem (mgr.34373) 7161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:39.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:39 gibba003 bash[32348]: cephadm 2021-03-10T16:06:37.867379+0000 mgr.gibba043.dnkmem (mgr.34373) 7161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:39 gibba043 bash[24019]: cephadm 2021-03-10T16:06:37.867379+0000 mgr.gibba043.dnkmem (mgr.34373) 7161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:40.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:40 gibba003 bash[31385]: cluster 2021-03-10T16:06:39.092856+0000 mgr.gibba043.dnkmem (mgr.34373) 7162 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:40 gibba003 bash[32348]: cluster 2021-03-10T16:06:39.092856+0000 mgr.gibba043.dnkmem (mgr.34373) 7162 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:40 gibba043 bash[24019]: cluster 2021-03-10T16:06:39.092856+0000 mgr.gibba043.dnkmem (mgr.34373) 7162 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:41 gibba003 bash[31385]: cluster 2021-03-10T16:06:41.094469+0000 mgr.gibba043.dnkmem (mgr.34373) 7163 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:41 gibba003 bash[32348]: cluster 2021-03-10T16:06:41.094469+0000 mgr.gibba043.dnkmem (mgr.34373) 7163 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:41 gibba043 bash[24019]: cluster 2021-03-10T16:06:41.094469+0000 mgr.gibba043.dnkmem (mgr.34373) 7163 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:44 gibba003 bash[31385]: cluster 2021-03-10T16:06:43.095210+0000 mgr.gibba043.dnkmem (mgr.34373) 7164 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:44 gibba003 bash[32348]: cluster 2021-03-10T16:06:43.095210+0000 mgr.gibba043.dnkmem (mgr.34373) 7164 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.502 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:06:44.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:44 gibba043 bash[24019]: cluster 2021-03-10T16:06:43.095210+0000 mgr.gibba043.dnkmem (mgr.34373) 7164 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.763 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:06:44.763 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:06:44.764 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:06:44.764 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:06:44.764 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:06:44.764 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:06:44.765 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:06:44.765 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:06:44.765 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:06:44.765 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:06:44.766 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:06:44.766 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:06:44.766 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:06:44.766 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:06:44.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:06:44.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:06:44.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:06:44.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:06:44.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:06:44.768 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:06:44.768 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:06:45.018 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:06:45.019 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:06:45.019 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:45.019 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:06:45.019 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:06:45.020 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:45.020 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:06:45.020 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:06:45.020 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:06:45.021 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:06:45.021 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:06:45.021 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:06:45.021 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:06:45.022 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:06:45.022 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:06:45.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:45 gibba003 bash[31385]: audit 2021-03-10T16:06:45.020348+0000 mon.c (mon.1) 1854 : audit [DBG] from='client.? 172.21.2.103:0/2433929737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:45.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:45 gibba003 bash[32348]: audit 2021-03-10T16:06:45.020348+0000 mon.c (mon.1) 1854 : audit [DBG] from='client.? 172.21.2.103:0/2433929737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:45.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:45 gibba043 bash[24019]: audit 2021-03-10T16:06:45.020348+0000 mon.c (mon.1) 1854 : audit [DBG] from='client.? 172.21.2.103:0/2433929737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:46.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:46 gibba003 bash[31385]: audit 2021-03-10T16:06:44.493444+0000 mgr.gibba043.dnkmem (mgr.34373) 7165 : audit [DBG] from='client.58846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:46.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:46 gibba003 bash[31385]: audit 2021-03-10T16:06:44.725256+0000 mgr.gibba043.dnkmem (mgr.34373) 7166 : audit [DBG] from='client.58852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:46.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:46 gibba003 bash[31385]: cluster 2021-03-10T16:06:45.096532+0000 mgr.gibba043.dnkmem (mgr.34373) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:46 gibba003 bash[32348]: audit 2021-03-10T16:06:44.493444+0000 mgr.gibba043.dnkmem (mgr.34373) 7165 : audit [DBG] from='client.58846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:46.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:46 gibba003 bash[32348]: audit 2021-03-10T16:06:44.725256+0000 mgr.gibba043.dnkmem (mgr.34373) 7166 : audit [DBG] from='client.58852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:46.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:46 gibba003 bash[32348]: cluster 2021-03-10T16:06:45.096532+0000 mgr.gibba043.dnkmem (mgr.34373) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:46 gibba043 bash[24019]: audit 2021-03-10T16:06:44.493444+0000 mgr.gibba043.dnkmem (mgr.34373) 7165 : audit [DBG] from='client.58846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:46 gibba043 bash[24019]: audit 2021-03-10T16:06:44.725256+0000 mgr.gibba043.dnkmem (mgr.34373) 7166 : audit [DBG] from='client.58852 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:46 gibba043 bash[24019]: cluster 2021-03-10T16:06:45.096532+0000 mgr.gibba043.dnkmem (mgr.34373) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:48 gibba003 bash[31385]: cluster 2021-03-10T16:06:47.098203+0000 mgr.gibba043.dnkmem (mgr.34373) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:48 gibba003 bash[32348]: cluster 2021-03-10T16:06:47.098203+0000 mgr.gibba043.dnkmem (mgr.34373) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:48 gibba043 bash[24019]: cluster 2021-03-10T16:06:47.098203+0000 mgr.gibba043.dnkmem (mgr.34373) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:50 gibba043 bash[24019]: cluster 2021-03-10T16:06:49.099973+0000 mgr.gibba043.dnkmem (mgr.34373) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:50 gibba003 bash[32348]: cluster 2021-03-10T16:06:49.099973+0000 mgr.gibba043.dnkmem (mgr.34373) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:50 gibba003 bash[31385]: cluster 2021-03-10T16:06:49.099973+0000 mgr.gibba043.dnkmem (mgr.34373) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:51 gibba003 bash[31385]: cluster 2021-03-10T16:06:51.101763+0000 mgr.gibba043.dnkmem (mgr.34373) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:51 gibba003 bash[32348]: cluster 2021-03-10T16:06:51.101763+0000 mgr.gibba043.dnkmem (mgr.34373) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:51 gibba043 bash[24019]: cluster 2021-03-10T16:06:51.101763+0000 mgr.gibba043.dnkmem (mgr.34373) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:54 gibba003 bash[31385]: cephadm 2021-03-10T16:06:52.883555+0000 mgr.gibba043.dnkmem (mgr.34373) 7171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:54.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:54 gibba003 bash[31385]: cluster 2021-03-10T16:06:53.102639+0000 mgr.gibba043.dnkmem (mgr.34373) 7172 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:54 gibba003 bash[32348]: cephadm 2021-03-10T16:06:52.883555+0000 mgr.gibba043.dnkmem (mgr.34373) 7171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:54.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:54 gibba003 bash[32348]: cluster 2021-03-10T16:06:53.102639+0000 mgr.gibba043.dnkmem (mgr.34373) 7172 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:54 gibba043 bash[24019]: cephadm 2021-03-10T16:06:52.883555+0000 mgr.gibba043.dnkmem (mgr.34373) 7171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:06:54.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:54 gibba043 bash[24019]: cluster 2021-03-10T16:06:53.102639+0000 mgr.gibba043.dnkmem (mgr.34373) 7172 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:56 gibba003 bash[32348]: cluster 2021-03-10T16:06:55.104096+0000 mgr.gibba043.dnkmem (mgr.34373) 7173 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:56 gibba003 bash[31385]: cluster 2021-03-10T16:06:55.104096+0000 mgr.gibba043.dnkmem (mgr.34373) 7173 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:56 gibba043 bash[24019]: cluster 2021-03-10T16:06:55.104096+0000 mgr.gibba043.dnkmem (mgr.34373) 7173 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:06:58 gibba003 bash[31385]: cluster 2021-03-10T16:06:57.105725+0000 mgr.gibba043.dnkmem (mgr.34373) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:06:58 gibba003 bash[32348]: cluster 2021-03-10T16:06:57.105725+0000 mgr.gibba043.dnkmem (mgr.34373) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:06:58 gibba043 bash[24019]: cluster 2021-03-10T16:06:57.105725+0000 mgr.gibba043.dnkmem (mgr.34373) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:00 gibba043 bash[24019]: cluster 2021-03-10T16:06:59.107393+0000 mgr.gibba043.dnkmem (mgr.34373) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:00 gibba003 bash[31385]: cluster 2021-03-10T16:06:59.107393+0000 mgr.gibba043.dnkmem (mgr.34373) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:00 gibba003 bash[32348]: cluster 2021-03-10T16:06:59.107393+0000 mgr.gibba043.dnkmem (mgr.34373) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:01 gibba043 bash[24019]: cluster 2021-03-10T16:07:01.109186+0000 mgr.gibba043.dnkmem (mgr.34373) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:01 gibba003 bash[31385]: cluster 2021-03-10T16:07:01.109186+0000 mgr.gibba043.dnkmem (mgr.34373) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:01 gibba003 bash[32348]: cluster 2021-03-10T16:07:01.109186+0000 mgr.gibba043.dnkmem (mgr.34373) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:04 gibba003 bash[31385]: cluster 2021-03-10T16:07:03.110147+0000 mgr.gibba043.dnkmem (mgr.34373) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:04 gibba003 bash[32348]: cluster 2021-03-10T16:07:03.110147+0000 mgr.gibba043.dnkmem (mgr.34373) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:04 gibba043 bash[24019]: cluster 2021-03-10T16:07:03.110147+0000 mgr.gibba043.dnkmem (mgr.34373) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:06 gibba003 bash[32348]: cluster 2021-03-10T16:07:05.111420+0000 mgr.gibba043.dnkmem (mgr.34373) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:06 gibba003 bash[31385]: cluster 2021-03-10T16:07:05.111420+0000 mgr.gibba043.dnkmem (mgr.34373) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:06 gibba043 bash[24019]: cluster 2021-03-10T16:07:05.111420+0000 mgr.gibba043.dnkmem (mgr.34373) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: cluster 2021-03-10T16:07:07.113101+0000 mgr.gibba043.dnkmem (mgr.34373) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.117509+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:07:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.121201+0000 mon.c (mon.1) 1855 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:08.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.122584+0000 mon.c (mon.1) 1856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.123647+0000 mon.c (mon.1) 1857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.124964+0000 mon.c (mon.1) 1858 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.127773+0000 mon.c (mon.1) 1859 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:08 gibba043 bash[24019]: audit 2021-03-10T16:07:08.128993+0000 mon.c (mon.1) 1860 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: cluster 2021-03-10T16:07:07.113101+0000 mgr.gibba043.dnkmem (mgr.34373) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.117509+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:07:08.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.121201+0000 mon.c (mon.1) 1855 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:08.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.122584+0000 mon.c (mon.1) 1856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.123647+0000 mon.c (mon.1) 1857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.124964+0000 mon.c (mon.1) 1858 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.127773+0000 mon.c (mon.1) 1859 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[31385]: audit 2021-03-10T16:07:08.128993+0000 mon.c (mon.1) 1860 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: cluster 2021-03-10T16:07:07.113101+0000 mgr.gibba043.dnkmem (mgr.34373) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.117509+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:07:08.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.121201+0000 mon.c (mon.1) 1855 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:08.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.122584+0000 mon.c (mon.1) 1856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.123647+0000 mon.c (mon.1) 1857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.124964+0000 mon.c (mon.1) 1858 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.127773+0000 mon.c (mon.1) 1859 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:08.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:08 gibba003 bash[32348]: audit 2021-03-10T16:07:08.128993+0000 mon.c (mon.1) 1860 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:07.900278+0000 mgr.gibba043.dnkmem (mgr.34373) 7180 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:07:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:07.901842+0000 mgr.gibba043.dnkmem (mgr.34373) 7181 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:07:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.119138+0000 mgr.gibba043.dnkmem (mgr.34373) 7182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.120707+0000 mgr.gibba043.dnkmem (mgr.34373) 7183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.121958+0000 mgr.gibba043.dnkmem (mgr.34373) 7184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.121996+0000 mgr.gibba043.dnkmem (mgr.34373) 7185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.123143+0000 mgr.gibba043.dnkmem (mgr.34373) 7186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.123181+0000 mgr.gibba043.dnkmem (mgr.34373) 7187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.124368+0000 mgr.gibba043.dnkmem (mgr.34373) 7188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.125765+0000 mgr.gibba043.dnkmem (mgr.34373) 7189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.125803+0000 mgr.gibba043.dnkmem (mgr.34373) 7190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.127067+0000 mgr.gibba043.dnkmem (mgr.34373) 7191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.127385+0000 mgr.gibba043.dnkmem (mgr.34373) 7192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.128498+0000 mgr.gibba043.dnkmem (mgr.34373) 7193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.128533+0000 mgr.gibba043.dnkmem (mgr.34373) 7194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:09 gibba043 bash[24019]: cephadm 2021-03-10T16:07:08.128716+0000 mgr.gibba043.dnkmem (mgr.34373) 7195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:07.900278+0000 mgr.gibba043.dnkmem (mgr.34373) 7180 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:07:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:07.901842+0000 mgr.gibba043.dnkmem (mgr.34373) 7181 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:07:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.119138+0000 mgr.gibba043.dnkmem (mgr.34373) 7182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:09.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.120707+0000 mgr.gibba043.dnkmem (mgr.34373) 7183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.121958+0000 mgr.gibba043.dnkmem (mgr.34373) 7184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.121996+0000 mgr.gibba043.dnkmem (mgr.34373) 7185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.123143+0000 mgr.gibba043.dnkmem (mgr.34373) 7186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:09.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.123181+0000 mgr.gibba043.dnkmem (mgr.34373) 7187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.124368+0000 mgr.gibba043.dnkmem (mgr.34373) 7188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.125765+0000 mgr.gibba043.dnkmem (mgr.34373) 7189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.125803+0000 mgr.gibba043.dnkmem (mgr.34373) 7190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.127067+0000 mgr.gibba043.dnkmem (mgr.34373) 7191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.127385+0000 mgr.gibba043.dnkmem (mgr.34373) 7192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.128498+0000 mgr.gibba043.dnkmem (mgr.34373) 7193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.128533+0000 mgr.gibba043.dnkmem (mgr.34373) 7194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[31385]: cephadm 2021-03-10T16:07:08.128716+0000 mgr.gibba043.dnkmem (mgr.34373) 7195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:07.900278+0000 mgr.gibba043.dnkmem (mgr.34373) 7180 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:07:09.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:07.901842+0000 mgr.gibba043.dnkmem (mgr.34373) 7181 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:07:09.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.119138+0000 mgr.gibba043.dnkmem (mgr.34373) 7182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:09.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.120707+0000 mgr.gibba043.dnkmem (mgr.34373) 7183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:09.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.121958+0000 mgr.gibba043.dnkmem (mgr.34373) 7184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:09.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.121996+0000 mgr.gibba043.dnkmem (mgr.34373) 7185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:09.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.123143+0000 mgr.gibba043.dnkmem (mgr.34373) 7186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:09.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.123181+0000 mgr.gibba043.dnkmem (mgr.34373) 7187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:09.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.124368+0000 mgr.gibba043.dnkmem (mgr.34373) 7188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.125765+0000 mgr.gibba043.dnkmem (mgr.34373) 7189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.125803+0000 mgr.gibba043.dnkmem (mgr.34373) 7190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.127067+0000 mgr.gibba043.dnkmem (mgr.34373) 7191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.127385+0000 mgr.gibba043.dnkmem (mgr.34373) 7192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.128498+0000 mgr.gibba043.dnkmem (mgr.34373) 7193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:09.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.128533+0000 mgr.gibba043.dnkmem (mgr.34373) 7194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:09.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:09 gibba003 bash[32348]: cephadm 2021-03-10T16:07:08.128716+0000 mgr.gibba043.dnkmem (mgr.34373) 7195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:10 gibba043 bash[24019]: cluster 2021-03-10T16:07:09.114466+0000 mgr.gibba043.dnkmem (mgr.34373) 7196 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:10 gibba003 bash[31385]: cluster 2021-03-10T16:07:09.114466+0000 mgr.gibba043.dnkmem (mgr.34373) 7196 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:10 gibba003 bash[32348]: cluster 2021-03-10T16:07:09.114466+0000 mgr.gibba043.dnkmem (mgr.34373) 7196 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:11 gibba043 bash[24019]: cluster 2021-03-10T16:07:11.116121+0000 mgr.gibba043.dnkmem (mgr.34373) 7197 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:11 gibba003 bash[31385]: cluster 2021-03-10T16:07:11.116121+0000 mgr.gibba043.dnkmem (mgr.34373) 7197 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:11 gibba003 bash[32348]: cluster 2021-03-10T16:07:11.116121+0000 mgr.gibba043.dnkmem (mgr.34373) 7197 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: cluster 2021-03-10T16:07:13.116779+0000 mgr.gibba043.dnkmem (mgr.34373) 7198 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.596700+0000 mon.c (mon.1) 1861 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.597779+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.768199+0000 mon.c (mon.1) 1862 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.769266+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.915379+0000 mon.c (mon.1) 1863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:07:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.916286+0000 mon.c (mon.1) 1864 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:07:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.916569+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:07:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.917232+0000 mon.c (mon.1) 1865 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.918009+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:07:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.918558+0000 mon.c (mon.1) 1866 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.919096+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[31385]: audit 2021-03-10T16:07:13.919974+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: cluster 2021-03-10T16:07:13.116779+0000 mgr.gibba043.dnkmem (mgr.34373) 7198 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.596700+0000 mon.c (mon.1) 1861 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.597779+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.768199+0000 mon.c (mon.1) 1862 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.769266+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.915379+0000 mon.c (mon.1) 1863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:07:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.916286+0000 mon.c (mon.1) 1864 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:07:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.916569+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:07:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.917232+0000 mon.c (mon.1) 1865 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.918009+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:07:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.918558+0000 mon.c (mon.1) 1866 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.919096+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:14 gibba003 bash[32348]: audit 2021-03-10T16:07:13.919974+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: cluster 2021-03-10T16:07:13.116779+0000 mgr.gibba043.dnkmem (mgr.34373) 7198 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.596700+0000 mon.c (mon.1) 1861 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.597779+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.768199+0000 mon.c (mon.1) 1862 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.769266+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.915379+0000 mon.c (mon.1) 1863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:07:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.916286+0000 mon.c (mon.1) 1864 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:07:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.916569+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:07:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.917232+0000 mon.c (mon.1) 1865 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.918009+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:07:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.918558+0000 mon.c (mon.1) 1866 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.919096+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:07:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:14 gibba043 bash[24019]: audit 2021-03-10T16:07:13.919974+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:07:15.259 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:07:15.488 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:07:15.488 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:07:15.489 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:07:15.489 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:07:15.489 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:07:15.489 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:07:15.490 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:07:15.490 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:07:15.490 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:07:15.490 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:07:15.491 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:07:15.491 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:07:15.491 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:07:15.491 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:07:15.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:07:15.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:07:15.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:07:15.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:07:15.493 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:07:15.493 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:07:15.493 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:07:15.738 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:07:15.738 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:07:15.738 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:15.739 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:07:15.739 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:07:15.739 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:15.739 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:07:15.740 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:07:15.740 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:07:15.740 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:07:15.740 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:07:15.740 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:07:15.741 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:07:15.741 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:07:15.741 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:07:16.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:16 gibba003 bash[31385]: cluster 2021-03-10T16:07:15.118278+0000 mgr.gibba043.dnkmem (mgr.34373) 7199 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:16 gibba003 bash[31385]: audit 2021-03-10T16:07:15.251952+0000 mgr.gibba043.dnkmem (mgr.34373) 7200 : audit [DBG] from='client.48876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:16.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:16 gibba003 bash[31385]: audit 2021-03-10T16:07:15.740148+0000 mon.c (mon.1) 1867 : audit [DBG] from='client.? 172.21.2.103:0/4099204730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:16.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:16 gibba003 bash[32348]: cluster 2021-03-10T16:07:15.118278+0000 mgr.gibba043.dnkmem (mgr.34373) 7199 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:16 gibba003 bash[32348]: audit 2021-03-10T16:07:15.251952+0000 mgr.gibba043.dnkmem (mgr.34373) 7200 : audit [DBG] from='client.48876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:16.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:16 gibba003 bash[32348]: audit 2021-03-10T16:07:15.740148+0000 mon.c (mon.1) 1867 : audit [DBG] from='client.? 172.21.2.103:0/4099204730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:16.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:16 gibba043 bash[24019]: cluster 2021-03-10T16:07:15.118278+0000 mgr.gibba043.dnkmem (mgr.34373) 7199 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:16 gibba043 bash[24019]: audit 2021-03-10T16:07:15.251952+0000 mgr.gibba043.dnkmem (mgr.34373) 7200 : audit [DBG] from='client.48876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:16.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:16 gibba043 bash[24019]: audit 2021-03-10T16:07:15.740148+0000 mon.c (mon.1) 1867 : audit [DBG] from='client.? 172.21.2.103:0/4099204730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:17 gibba043 bash[24019]: audit 2021-03-10T16:07:15.476353+0000 mgr.gibba043.dnkmem (mgr.34373) 7201 : audit [DBG] from='client.48882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:17 gibba003 bash[31385]: audit 2021-03-10T16:07:15.476353+0000 mgr.gibba043.dnkmem (mgr.34373) 7201 : audit [DBG] from='client.48882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:17.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:17 gibba003 bash[32348]: audit 2021-03-10T16:07:15.476353+0000 mgr.gibba043.dnkmem (mgr.34373) 7201 : audit [DBG] from='client.48882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:18.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:18 gibba043 bash[24019]: cluster 2021-03-10T16:07:17.119816+0000 mgr.gibba043.dnkmem (mgr.34373) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:18 gibba003 bash[31385]: cluster 2021-03-10T16:07:17.119816+0000 mgr.gibba043.dnkmem (mgr.34373) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:18.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:18 gibba003 bash[32348]: cluster 2021-03-10T16:07:17.119816+0000 mgr.gibba043.dnkmem (mgr.34373) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:20 gibba043 bash[24019]: cluster 2021-03-10T16:07:19.121470+0000 mgr.gibba043.dnkmem (mgr.34373) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:20.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:20 gibba003 bash[31385]: cluster 2021-03-10T16:07:19.121470+0000 mgr.gibba043.dnkmem (mgr.34373) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:20.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:20 gibba003 bash[32348]: cluster 2021-03-10T16:07:19.121470+0000 mgr.gibba043.dnkmem (mgr.34373) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:21 gibba043 bash[24019]: cluster 2021-03-10T16:07:21.123139+0000 mgr.gibba043.dnkmem (mgr.34373) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:21 gibba003 bash[31385]: cluster 2021-03-10T16:07:21.123139+0000 mgr.gibba043.dnkmem (mgr.34373) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:21 gibba003 bash[32348]: cluster 2021-03-10T16:07:21.123139+0000 mgr.gibba043.dnkmem (mgr.34373) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:24 gibba003 bash[31385]: cluster 2021-03-10T16:07:23.124116+0000 mgr.gibba043.dnkmem (mgr.34373) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:24 gibba003 bash[31385]: cephadm 2021-03-10T16:07:23.144490+0000 mgr.gibba043.dnkmem (mgr.34373) 7206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:24 gibba003 bash[32348]: cluster 2021-03-10T16:07:23.124116+0000 mgr.gibba043.dnkmem (mgr.34373) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:24 gibba003 bash[32348]: cephadm 2021-03-10T16:07:23.144490+0000 mgr.gibba043.dnkmem (mgr.34373) 7206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:24 gibba043 bash[24019]: cluster 2021-03-10T16:07:23.124116+0000 mgr.gibba043.dnkmem (mgr.34373) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:24 gibba043 bash[24019]: cephadm 2021-03-10T16:07:23.144490+0000 mgr.gibba043.dnkmem (mgr.34373) 7206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:26 gibba043 bash[24019]: cluster 2021-03-10T16:07:25.125402+0000 mgr.gibba043.dnkmem (mgr.34373) 7207 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:26.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:26 gibba003 bash[31385]: cluster 2021-03-10T16:07:25.125402+0000 mgr.gibba043.dnkmem (mgr.34373) 7207 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:26.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:26 gibba003 bash[32348]: cluster 2021-03-10T16:07:25.125402+0000 mgr.gibba043.dnkmem (mgr.34373) 7207 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:28 gibba043 bash[24019]: cluster 2021-03-10T16:07:27.127083+0000 mgr.gibba043.dnkmem (mgr.34373) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:28.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:28 gibba003 bash[31385]: cluster 2021-03-10T16:07:27.127083+0000 mgr.gibba043.dnkmem (mgr.34373) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:28.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:28 gibba003 bash[32348]: cluster 2021-03-10T16:07:27.127083+0000 mgr.gibba043.dnkmem (mgr.34373) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:30 gibba043 bash[24019]: cluster 2021-03-10T16:07:29.128746+0000 mgr.gibba043.dnkmem (mgr.34373) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:30.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:30 gibba003 bash[31385]: cluster 2021-03-10T16:07:29.128746+0000 mgr.gibba043.dnkmem (mgr.34373) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:30 gibba003 bash[32348]: cluster 2021-03-10T16:07:29.128746+0000 mgr.gibba043.dnkmem (mgr.34373) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:32.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:31 gibba043 bash[24019]: cluster 2021-03-10T16:07:31.130571+0000 mgr.gibba043.dnkmem (mgr.34373) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:31 gibba003 bash[31385]: cluster 2021-03-10T16:07:31.130571+0000 mgr.gibba043.dnkmem (mgr.34373) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:31 gibba003 bash[32348]: cluster 2021-03-10T16:07:31.130571+0000 mgr.gibba043.dnkmem (mgr.34373) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:34.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:34 gibba043 bash[24019]: cluster 2021-03-10T16:07:33.131624+0000 mgr.gibba043.dnkmem (mgr.34373) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:34 gibba003 bash[31385]: cluster 2021-03-10T16:07:33.131624+0000 mgr.gibba043.dnkmem (mgr.34373) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:34 gibba003 bash[32348]: cluster 2021-03-10T16:07:33.131624+0000 mgr.gibba043.dnkmem (mgr.34373) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:36 gibba043 bash[24019]: cluster 2021-03-10T16:07:35.132956+0000 mgr.gibba043.dnkmem (mgr.34373) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:36.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:36 gibba003 bash[31385]: cluster 2021-03-10T16:07:35.132956+0000 mgr.gibba043.dnkmem (mgr.34373) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:36.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:36 gibba003 bash[32348]: cluster 2021-03-10T16:07:35.132956+0000 mgr.gibba043.dnkmem (mgr.34373) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:38 gibba043 bash[24019]: cluster 2021-03-10T16:07:37.134625+0000 mgr.gibba043.dnkmem (mgr.34373) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:38 gibba003 bash[31385]: cluster 2021-03-10T16:07:37.134625+0000 mgr.gibba043.dnkmem (mgr.34373) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:38.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:38 gibba003 bash[32348]: cluster 2021-03-10T16:07:37.134625+0000 mgr.gibba043.dnkmem (mgr.34373) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:39 gibba043 bash[24019]: cephadm 2021-03-10T16:07:38.156322+0000 mgr.gibba043.dnkmem (mgr.34373) 7214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:39 gibba003 bash[31385]: cephadm 2021-03-10T16:07:38.156322+0000 mgr.gibba043.dnkmem (mgr.34373) 7214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:39 gibba003 bash[32348]: cephadm 2021-03-10T16:07:38.156322+0000 mgr.gibba043.dnkmem (mgr.34373) 7214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:40.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:40 gibba043 bash[24019]: cluster 2021-03-10T16:07:39.136250+0000 mgr.gibba043.dnkmem (mgr.34373) 7215 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:40.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:40 gibba003 bash[31385]: cluster 2021-03-10T16:07:39.136250+0000 mgr.gibba043.dnkmem (mgr.34373) 7215 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:40 gibba003 bash[32348]: cluster 2021-03-10T16:07:39.136250+0000 mgr.gibba043.dnkmem (mgr.34373) 7215 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:41 gibba043 bash[24019]: cluster 2021-03-10T16:07:41.137914+0000 mgr.gibba043.dnkmem (mgr.34373) 7216 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:42.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:41 gibba003 bash[31385]: cluster 2021-03-10T16:07:41.137914+0000 mgr.gibba043.dnkmem (mgr.34373) 7216 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:41 gibba003 bash[32348]: cluster 2021-03-10T16:07:41.137914+0000 mgr.gibba043.dnkmem (mgr.34373) 7216 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:44.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:44 gibba043 bash[24019]: cluster 2021-03-10T16:07:43.138767+0000 mgr.gibba043.dnkmem (mgr.34373) 7217 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:44.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:44 gibba003 bash[31385]: cluster 2021-03-10T16:07:43.138767+0000 mgr.gibba043.dnkmem (mgr.34373) 7217 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:44 gibba003 bash[32348]: cluster 2021-03-10T16:07:43.138767+0000 mgr.gibba043.dnkmem (mgr.34373) 7217 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:45.976 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:07:46.201 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:07:46.201 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:07:46.202 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:07:46.202 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:07:46.202 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:07:46.202 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:07:46.203 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:07:46.203 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:07:46.203 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:07:46.203 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:07:46.204 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:07:46.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:07:46.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:07:46.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:07:46.204 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:07:46.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:07:46.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:07:46.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:07:46.205 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:07:46.205 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:07:46.206 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:07:46.455 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:07:46.455 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:07:46.456 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:46.456 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:07:46.456 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:07:46.456 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:46.457 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:07:46.457 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:07:46.457 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:07:46.457 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:07:46.458 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:07:46.458 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:07:46.458 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:07:46.458 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:07:46.458 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:07:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:46 gibba043 bash[24019]: cluster 2021-03-10T16:07:45.140063+0000 mgr.gibba043.dnkmem (mgr.34373) 7218 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:46.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:46 gibba003 bash[31385]: cluster 2021-03-10T16:07:45.140063+0000 mgr.gibba043.dnkmem (mgr.34373) 7218 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:46 gibba003 bash[32348]: cluster 2021-03-10T16:07:45.140063+0000 mgr.gibba043.dnkmem (mgr.34373) 7218 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:47 gibba043 bash[24019]: audit 2021-03-10T16:07:45.968855+0000 mgr.gibba043.dnkmem (mgr.34373) 7219 : audit [DBG] from='client.58882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:47 gibba043 bash[24019]: audit 2021-03-10T16:07:46.190112+0000 mgr.gibba043.dnkmem (mgr.34373) 7220 : audit [DBG] from='client.48900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:47 gibba043 bash[24019]: audit 2021-03-10T16:07:46.457239+0000 mon.c (mon.1) 1868 : audit [DBG] from='client.? 172.21.2.103:0/1448764120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:47 gibba003 bash[31385]: audit 2021-03-10T16:07:45.968855+0000 mgr.gibba043.dnkmem (mgr.34373) 7219 : audit [DBG] from='client.58882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:47 gibba003 bash[31385]: audit 2021-03-10T16:07:46.190112+0000 mgr.gibba043.dnkmem (mgr.34373) 7220 : audit [DBG] from='client.48900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:47 gibba003 bash[31385]: audit 2021-03-10T16:07:46.457239+0000 mon.c (mon.1) 1868 : audit [DBG] from='client.? 172.21.2.103:0/1448764120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:47 gibba003 bash[32348]: audit 2021-03-10T16:07:45.968855+0000 mgr.gibba043.dnkmem (mgr.34373) 7219 : audit [DBG] from='client.58882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:47 gibba003 bash[32348]: audit 2021-03-10T16:07:46.190112+0000 mgr.gibba043.dnkmem (mgr.34373) 7220 : audit [DBG] from='client.48900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:47.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:47 gibba003 bash[32348]: audit 2021-03-10T16:07:46.457239+0000 mon.c (mon.1) 1868 : audit [DBG] from='client.? 172.21.2.103:0/1448764120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:48 gibba043 bash[24019]: cluster 2021-03-10T16:07:47.141509+0000 mgr.gibba043.dnkmem (mgr.34373) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:48.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:48 gibba003 bash[31385]: cluster 2021-03-10T16:07:47.141509+0000 mgr.gibba043.dnkmem (mgr.34373) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:48.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:48 gibba003 bash[32348]: cluster 2021-03-10T16:07:47.141509+0000 mgr.gibba043.dnkmem (mgr.34373) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:50 gibba043 bash[24019]: cluster 2021-03-10T16:07:49.143265+0000 mgr.gibba043.dnkmem (mgr.34373) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:50 gibba003 bash[31385]: cluster 2021-03-10T16:07:49.143265+0000 mgr.gibba043.dnkmem (mgr.34373) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:50 gibba003 bash[32348]: cluster 2021-03-10T16:07:49.143265+0000 mgr.gibba043.dnkmem (mgr.34373) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:51 gibba043 bash[24019]: cluster 2021-03-10T16:07:51.145107+0000 mgr.gibba043.dnkmem (mgr.34373) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:52.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:51 gibba003 bash[31385]: cluster 2021-03-10T16:07:51.145107+0000 mgr.gibba043.dnkmem (mgr.34373) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:52.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:51 gibba003 bash[32348]: cluster 2021-03-10T16:07:51.145107+0000 mgr.gibba043.dnkmem (mgr.34373) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:54 gibba043 bash[24019]: cluster 2021-03-10T16:07:53.146149+0000 mgr.gibba043.dnkmem (mgr.34373) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:54 gibba043 bash[24019]: cephadm 2021-03-10T16:07:53.172184+0000 mgr.gibba043.dnkmem (mgr.34373) 7225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:54 gibba003 bash[31385]: cluster 2021-03-10T16:07:53.146149+0000 mgr.gibba043.dnkmem (mgr.34373) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:54 gibba003 bash[31385]: cephadm 2021-03-10T16:07:53.172184+0000 mgr.gibba043.dnkmem (mgr.34373) 7225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:54.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:54 gibba003 bash[32348]: cluster 2021-03-10T16:07:53.146149+0000 mgr.gibba043.dnkmem (mgr.34373) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:54 gibba003 bash[32348]: cephadm 2021-03-10T16:07:53.172184+0000 mgr.gibba043.dnkmem (mgr.34373) 7225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:07:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:56 gibba043 bash[24019]: cluster 2021-03-10T16:07:55.147793+0000 mgr.gibba043.dnkmem (mgr.34373) 7226 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:56 gibba003 bash[31385]: cluster 2021-03-10T16:07:55.147793+0000 mgr.gibba043.dnkmem (mgr.34373) 7226 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:56 gibba003 bash[32348]: cluster 2021-03-10T16:07:55.147793+0000 mgr.gibba043.dnkmem (mgr.34373) 7226 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:07:58 gibba043 bash[24019]: cluster 2021-03-10T16:07:57.149537+0000 mgr.gibba043.dnkmem (mgr.34373) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:07:58 gibba003 bash[31385]: cluster 2021-03-10T16:07:57.149537+0000 mgr.gibba043.dnkmem (mgr.34373) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:07:58 gibba003 bash[32348]: cluster 2021-03-10T16:07:57.149537+0000 mgr.gibba043.dnkmem (mgr.34373) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:00 gibba043 bash[24019]: cluster 2021-03-10T16:07:59.151181+0000 mgr.gibba043.dnkmem (mgr.34373) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:00 gibba003 bash[31385]: cluster 2021-03-10T16:07:59.151181+0000 mgr.gibba043.dnkmem (mgr.34373) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:00 gibba003 bash[32348]: cluster 2021-03-10T16:07:59.151181+0000 mgr.gibba043.dnkmem (mgr.34373) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:01 gibba043 bash[24019]: cluster 2021-03-10T16:08:01.153017+0000 mgr.gibba043.dnkmem (mgr.34373) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:01 gibba003 bash[31385]: cluster 2021-03-10T16:08:01.153017+0000 mgr.gibba043.dnkmem (mgr.34373) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:01 gibba003 bash[32348]: cluster 2021-03-10T16:08:01.153017+0000 mgr.gibba043.dnkmem (mgr.34373) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:04 gibba043 bash[24019]: cluster 2021-03-10T16:08:03.153893+0000 mgr.gibba043.dnkmem (mgr.34373) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:04 gibba003 bash[31385]: cluster 2021-03-10T16:08:03.153893+0000 mgr.gibba043.dnkmem (mgr.34373) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:04 gibba003 bash[32348]: cluster 2021-03-10T16:08:03.153893+0000 mgr.gibba043.dnkmem (mgr.34373) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:06 gibba043 bash[24019]: cluster 2021-03-10T16:08:05.155233+0000 mgr.gibba043.dnkmem (mgr.34373) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:06 gibba003 bash[31385]: cluster 2021-03-10T16:08:05.155233+0000 mgr.gibba043.dnkmem (mgr.34373) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:06 gibba003 bash[32348]: cluster 2021-03-10T16:08:05.155233+0000 mgr.gibba043.dnkmem (mgr.34373) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:08 gibba043 bash[24019]: cluster 2021-03-10T16:08:07.156858+0000 mgr.gibba043.dnkmem (mgr.34373) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:08 gibba043 bash[24019]: audit 2021-03-10T16:08:08.191920+0000 mon.c (mon.1) 1869 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:08:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:08 gibba003 bash[31385]: cluster 2021-03-10T16:08:07.156858+0000 mgr.gibba043.dnkmem (mgr.34373) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:08 gibba003 bash[31385]: audit 2021-03-10T16:08:08.191920+0000 mon.c (mon.1) 1869 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:08:08.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:08 gibba003 bash[32348]: cluster 2021-03-10T16:08:07.156858+0000 mgr.gibba043.dnkmem (mgr.34373) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:08 gibba003 bash[32348]: audit 2021-03-10T16:08:08.191920+0000 mon.c (mon.1) 1869 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:08:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:09 gibba043 bash[24019]: cephadm 2021-03-10T16:08:08.189858+0000 mgr.gibba043.dnkmem (mgr.34373) 7233 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:08:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:09 gibba003 bash[31385]: cephadm 2021-03-10T16:08:08.189858+0000 mgr.gibba043.dnkmem (mgr.34373) 7233 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:08:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:09 gibba003 bash[32348]: cephadm 2021-03-10T16:08:08.189858+0000 mgr.gibba043.dnkmem (mgr.34373) 7233 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:08:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:10 gibba043 bash[24019]: cluster 2021-03-10T16:08:09.158221+0000 mgr.gibba043.dnkmem (mgr.34373) 7234 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:10 gibba003 bash[31385]: cluster 2021-03-10T16:08:09.158221+0000 mgr.gibba043.dnkmem (mgr.34373) 7234 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:10 gibba003 bash[32348]: cluster 2021-03-10T16:08:09.158221+0000 mgr.gibba043.dnkmem (mgr.34373) 7234 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:11 gibba043 bash[24019]: cluster 2021-03-10T16:08:11.160118+0000 mgr.gibba043.dnkmem (mgr.34373) 7235 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:11 gibba003 bash[31385]: cluster 2021-03-10T16:08:11.160118+0000 mgr.gibba043.dnkmem (mgr.34373) 7235 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:11 gibba003 bash[32348]: cluster 2021-03-10T16:08:11.160118+0000 mgr.gibba043.dnkmem (mgr.34373) 7235 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.729153+0000 mgr.gibba043.dnkmem (mgr.34373) 7236 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:08:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.729576+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:08:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.938536+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:08:13.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.943654+0000 mgr.gibba043.dnkmem (mgr.34373) 7237 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.945764+0000 mon.c (mon.1) 1870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.945997+0000 mgr.gibba043.dnkmem (mgr.34373) 7238 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.947547+0000 mgr.gibba043.dnkmem (mgr.34373) 7239 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:13.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.947586+0000 mgr.gibba043.dnkmem (mgr.34373) 7240 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.947889+0000 mon.c (mon.1) 1871 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.949095+0000 mgr.gibba043.dnkmem (mgr.34373) 7241 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.949135+0000 mgr.gibba043.dnkmem (mgr.34373) 7242 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:13.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.949478+0000 mon.c (mon.1) 1872 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.950616+0000 mgr.gibba043.dnkmem (mgr.34373) 7243 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:13.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.950955+0000 mon.c (mon.1) 1873 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.952321+0000 mgr.gibba043.dnkmem (mgr.34373) 7244 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:13.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.952360+0000 mgr.gibba043.dnkmem (mgr.34373) 7245 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:13.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.953858+0000 mgr.gibba043.dnkmem (mgr.34373) 7246 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:13.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.954242+0000 mon.c (mon.1) 1874 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.954322+0000 mgr.gibba043.dnkmem (mgr.34373) 7247 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:13.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.955788+0000 mgr.gibba043.dnkmem (mgr.34373) 7248 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:13.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.955833+0000 mgr.gibba043.dnkmem (mgr.34373) 7249 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:13.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: cephadm 2021-03-10T16:08:11.955961+0000 mgr.gibba043.dnkmem (mgr.34373) 7250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:13.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:12 gibba043 bash[24019]: audit 2021-03-10T16:08:11.956037+0000 mon.c (mon.1) 1875 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.729153+0000 mgr.gibba043.dnkmem (mgr.34373) 7236 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:08:13.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.729576+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:08:13.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.938536+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:08:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.943654+0000 mgr.gibba043.dnkmem (mgr.34373) 7237 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.945764+0000 mon.c (mon.1) 1870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.945997+0000 mgr.gibba043.dnkmem (mgr.34373) 7238 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.947547+0000 mgr.gibba043.dnkmem (mgr.34373) 7239 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.947586+0000 mgr.gibba043.dnkmem (mgr.34373) 7240 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.947889+0000 mon.c (mon.1) 1871 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.949095+0000 mgr.gibba043.dnkmem (mgr.34373) 7241 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.949135+0000 mgr.gibba043.dnkmem (mgr.34373) 7242 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.949478+0000 mon.c (mon.1) 1872 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.950616+0000 mgr.gibba043.dnkmem (mgr.34373) 7243 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.950955+0000 mon.c (mon.1) 1873 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.952321+0000 mgr.gibba043.dnkmem (mgr.34373) 7244 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:13.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.952360+0000 mgr.gibba043.dnkmem (mgr.34373) 7245 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.953858+0000 mgr.gibba043.dnkmem (mgr.34373) 7246 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.954242+0000 mon.c (mon.1) 1874 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.954322+0000 mgr.gibba043.dnkmem (mgr.34373) 7247 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:13.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.955788+0000 mgr.gibba043.dnkmem (mgr.34373) 7248 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:13.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.955833+0000 mgr.gibba043.dnkmem (mgr.34373) 7249 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:13.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: cephadm 2021-03-10T16:08:11.955961+0000 mgr.gibba043.dnkmem (mgr.34373) 7250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:13.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[31385]: audit 2021-03-10T16:08:11.956037+0000 mon.c (mon.1) 1875 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.729153+0000 mgr.gibba043.dnkmem (mgr.34373) 7236 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:08:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.729576+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:08:13.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.938536+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:08:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.943654+0000 mgr.gibba043.dnkmem (mgr.34373) 7237 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.945764+0000 mon.c (mon.1) 1870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:13.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.945997+0000 mgr.gibba043.dnkmem (mgr.34373) 7238 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:13.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.947547+0000 mgr.gibba043.dnkmem (mgr.34373) 7239 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:13.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.947586+0000 mgr.gibba043.dnkmem (mgr.34373) 7240 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:13.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.947889+0000 mon.c (mon.1) 1871 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.949095+0000 mgr.gibba043.dnkmem (mgr.34373) 7241 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:13.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.949135+0000 mgr.gibba043.dnkmem (mgr.34373) 7242 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:13.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.949478+0000 mon.c (mon.1) 1872 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.950616+0000 mgr.gibba043.dnkmem (mgr.34373) 7243 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:13.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.950955+0000 mon.c (mon.1) 1873 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.952321+0000 mgr.gibba043.dnkmem (mgr.34373) 7244 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:13.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.952360+0000 mgr.gibba043.dnkmem (mgr.34373) 7245 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:13.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.953858+0000 mgr.gibba043.dnkmem (mgr.34373) 7246 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:13.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.954242+0000 mon.c (mon.1) 1874 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:13.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.954322+0000 mgr.gibba043.dnkmem (mgr.34373) 7247 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:13.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.955788+0000 mgr.gibba043.dnkmem (mgr.34373) 7248 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:13.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.955833+0000 mgr.gibba043.dnkmem (mgr.34373) 7249 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:13.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: cephadm 2021-03-10T16:08:11.955961+0000 mgr.gibba043.dnkmem (mgr.34373) 7250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:13.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:12 gibba003 bash[32348]: audit 2021-03-10T16:08:11.956037+0000 mon.c (mon.1) 1875 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:13 gibba043 bash[24019]: cluster 2021-03-10T16:08:13.160910+0000 mgr.gibba043.dnkmem (mgr.34373) 7251 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:13 gibba043 bash[24019]: audit 2021-03-10T16:08:13.602956+0000 mon.c (mon.1) 1876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:13 gibba043 bash[24019]: audit 2021-03-10T16:08:13.604213+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:13 gibba003 bash[31385]: cluster 2021-03-10T16:08:13.160910+0000 mgr.gibba043.dnkmem (mgr.34373) 7251 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:13 gibba003 bash[31385]: audit 2021-03-10T16:08:13.602956+0000 mon.c (mon.1) 1876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:13 gibba003 bash[31385]: audit 2021-03-10T16:08:13.604213+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:13 gibba003 bash[32348]: cluster 2021-03-10T16:08:13.160910+0000 mgr.gibba043.dnkmem (mgr.34373) 7251 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:13 gibba003 bash[32348]: audit 2021-03-10T16:08:13.602956+0000 mon.c (mon.1) 1876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:13 gibba003 bash[32348]: audit 2021-03-10T16:08:13.604213+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.775395+0000 mon.c (mon.1) 1877 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.775857+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.925078+0000 mon.c (mon.1) 1878 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.925805+0000 mon.c (mon.1) 1879 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.926309+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.926494+0000 mon.c (mon.1) 1880 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.927183+0000 mon.c (mon.1) 1881 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.927776+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:08:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.928728+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:14 gibba043 bash[24019]: audit 2021-03-10T16:08:13.929502+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.775395+0000 mon.c (mon.1) 1877 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.775857+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.925078+0000 mon.c (mon.1) 1878 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:08:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.925805+0000 mon.c (mon.1) 1879 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:08:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.926309+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:08:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.926494+0000 mon.c (mon.1) 1880 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.927183+0000 mon.c (mon.1) 1881 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.927776+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:08:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.928728+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[31385]: audit 2021-03-10T16:08:13.929502+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.775395+0000 mon.c (mon.1) 1877 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.775857+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.925078+0000 mon.c (mon.1) 1878 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:08:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.925805+0000 mon.c (mon.1) 1879 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:08:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.926309+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:08:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.926494+0000 mon.c (mon.1) 1880 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.927183+0000 mon.c (mon.1) 1881 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.927776+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:08:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.928728+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:14 gibba003 bash[32348]: audit 2021-03-10T16:08:13.929502+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:08:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:15 gibba043 bash[24019]: cluster 2021-03-10T16:08:15.162300+0000 mgr.gibba043.dnkmem (mgr.34373) 7252 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:15 gibba003 bash[31385]: cluster 2021-03-10T16:08:15.162300+0000 mgr.gibba043.dnkmem (mgr.34373) 7252 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:15 gibba003 bash[32348]: cluster 2021-03-10T16:08:15.162300+0000 mgr.gibba043.dnkmem (mgr.34373) 7252 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.701 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:08:16.925 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:08:16.925 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:08:16.925 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:08:16.926 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:08:16.926 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:08:16.926 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:08:16.926 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:08:16.927 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:08:16.927 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:08:16.927 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:08:16.928 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:08:16.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:08:16.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:08:16.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:08:16.929 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:08:16.929 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:08:16.929 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:08:16.929 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:08:16.929 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:08:16.930 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:08:16.930 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:08:17.172 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:08:17.173 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:08:17.173 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:17.173 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:08:17.173 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:08:17.174 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:17.174 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:08:17.174 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:08:17.174 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:08:17.175 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:08:17.175 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:08:17.175 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:08:17.175 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:08:17.175 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:08:17.176 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:08:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:17 gibba043 bash[24019]: audit 2021-03-10T16:08:17.174817+0000 mon.c (mon.1) 1882 : audit [DBG] from='client.? 172.21.2.103:0/2665280458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:17 gibba003 bash[31385]: audit 2021-03-10T16:08:17.174817+0000 mon.c (mon.1) 1882 : audit [DBG] from='client.? 172.21.2.103:0/2665280458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:17.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:17 gibba003 bash[32348]: audit 2021-03-10T16:08:17.174817+0000 mon.c (mon.1) 1882 : audit [DBG] from='client.? 172.21.2.103:0/2665280458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:18 gibba043 bash[24019]: audit 2021-03-10T16:08:16.692439+0000 mgr.gibba043.dnkmem (mgr.34373) 7253 : audit [DBG] from='client.58900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:18 gibba043 bash[24019]: audit 2021-03-10T16:08:16.914640+0000 mgr.gibba043.dnkmem (mgr.34373) 7254 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:18 gibba043 bash[24019]: cluster 2021-03-10T16:08:17.163992+0000 mgr.gibba043.dnkmem (mgr.34373) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:18 gibba003 bash[31385]: audit 2021-03-10T16:08:16.692439+0000 mgr.gibba043.dnkmem (mgr.34373) 7253 : audit [DBG] from='client.58900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:18 gibba003 bash[31385]: audit 2021-03-10T16:08:16.914640+0000 mgr.gibba043.dnkmem (mgr.34373) 7254 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:18.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:18 gibba003 bash[31385]: cluster 2021-03-10T16:08:17.163992+0000 mgr.gibba043.dnkmem (mgr.34373) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:18.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:18 gibba003 bash[32348]: audit 2021-03-10T16:08:16.692439+0000 mgr.gibba043.dnkmem (mgr.34373) 7253 : audit [DBG] from='client.58900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:18.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:18 gibba003 bash[32348]: audit 2021-03-10T16:08:16.914640+0000 mgr.gibba043.dnkmem (mgr.34373) 7254 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:18.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:18 gibba003 bash[32348]: cluster 2021-03-10T16:08:17.163992+0000 mgr.gibba043.dnkmem (mgr.34373) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:20 gibba043 bash[24019]: cluster 2021-03-10T16:08:19.165320+0000 mgr.gibba043.dnkmem (mgr.34373) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:20 gibba003 bash[31385]: cluster 2021-03-10T16:08:19.165320+0000 mgr.gibba043.dnkmem (mgr.34373) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:20 gibba003 bash[32348]: cluster 2021-03-10T16:08:19.165320+0000 mgr.gibba043.dnkmem (mgr.34373) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:21 gibba043 bash[24019]: cluster 2021-03-10T16:08:21.167157+0000 mgr.gibba043.dnkmem (mgr.34373) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:21 gibba003 bash[31385]: cluster 2021-03-10T16:08:21.167157+0000 mgr.gibba043.dnkmem (mgr.34373) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:21 gibba003 bash[32348]: cluster 2021-03-10T16:08:21.167157+0000 mgr.gibba043.dnkmem (mgr.34373) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:24 gibba043 bash[24019]: cluster 2021-03-10T16:08:23.168235+0000 mgr.gibba043.dnkmem (mgr.34373) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:24 gibba003 bash[31385]: cluster 2021-03-10T16:08:23.168235+0000 mgr.gibba043.dnkmem (mgr.34373) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:24 gibba003 bash[32348]: cluster 2021-03-10T16:08:23.168235+0000 mgr.gibba043.dnkmem (mgr.34373) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:26 gibba043 bash[24019]: cluster 2021-03-10T16:08:25.169850+0000 mgr.gibba043.dnkmem (mgr.34373) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:26 gibba003 bash[31385]: cluster 2021-03-10T16:08:25.169850+0000 mgr.gibba043.dnkmem (mgr.34373) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:26 gibba003 bash[32348]: cluster 2021-03-10T16:08:25.169850+0000 mgr.gibba043.dnkmem (mgr.34373) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:28 gibba043 bash[24019]: cephadm 2021-03-10T16:08:26.972019+0000 mgr.gibba043.dnkmem (mgr.34373) 7260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:28 gibba043 bash[24019]: cluster 2021-03-10T16:08:27.171346+0000 mgr.gibba043.dnkmem (mgr.34373) 7261 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:28 gibba003 bash[31385]: cephadm 2021-03-10T16:08:26.972019+0000 mgr.gibba043.dnkmem (mgr.34373) 7260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:28.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:28 gibba003 bash[31385]: cluster 2021-03-10T16:08:27.171346+0000 mgr.gibba043.dnkmem (mgr.34373) 7261 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:28 gibba003 bash[32348]: cephadm 2021-03-10T16:08:26.972019+0000 mgr.gibba043.dnkmem (mgr.34373) 7260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:28.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:28 gibba003 bash[32348]: cluster 2021-03-10T16:08:27.171346+0000 mgr.gibba043.dnkmem (mgr.34373) 7261 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:30 gibba043 bash[24019]: cluster 2021-03-10T16:08:29.173020+0000 mgr.gibba043.dnkmem (mgr.34373) 7262 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:30 gibba003 bash[31385]: cluster 2021-03-10T16:08:29.173020+0000 mgr.gibba043.dnkmem (mgr.34373) 7262 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:30 gibba003 bash[32348]: cluster 2021-03-10T16:08:29.173020+0000 mgr.gibba043.dnkmem (mgr.34373) 7262 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:31 gibba043 bash[24019]: cluster 2021-03-10T16:08:31.174783+0000 mgr.gibba043.dnkmem (mgr.34373) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:32.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:31 gibba003 bash[31385]: cluster 2021-03-10T16:08:31.174783+0000 mgr.gibba043.dnkmem (mgr.34373) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:31 gibba003 bash[32348]: cluster 2021-03-10T16:08:31.174783+0000 mgr.gibba043.dnkmem (mgr.34373) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:34.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:34 gibba043 bash[24019]: cluster 2021-03-10T16:08:33.176016+0000 mgr.gibba043.dnkmem (mgr.34373) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:34 gibba003 bash[31385]: cluster 2021-03-10T16:08:33.176016+0000 mgr.gibba043.dnkmem (mgr.34373) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:34 gibba003 bash[32348]: cluster 2021-03-10T16:08:33.176016+0000 mgr.gibba043.dnkmem (mgr.34373) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:36 gibba043 bash[24019]: cluster 2021-03-10T16:08:35.177384+0000 mgr.gibba043.dnkmem (mgr.34373) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:36.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:36 gibba003 bash[31385]: cluster 2021-03-10T16:08:35.177384+0000 mgr.gibba043.dnkmem (mgr.34373) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:36.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:36 gibba003 bash[32348]: cluster 2021-03-10T16:08:35.177384+0000 mgr.gibba043.dnkmem (mgr.34373) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:38 gibba043 bash[24019]: cluster 2021-03-10T16:08:37.178983+0000 mgr.gibba043.dnkmem (mgr.34373) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:38 gibba003 bash[31385]: cluster 2021-03-10T16:08:37.178983+0000 mgr.gibba043.dnkmem (mgr.34373) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:38.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:38 gibba003 bash[32348]: cluster 2021-03-10T16:08:37.178983+0000 mgr.gibba043.dnkmem (mgr.34373) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:40.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:40 gibba043 bash[24019]: cluster 2021-03-10T16:08:39.180629+0000 mgr.gibba043.dnkmem (mgr.34373) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:40.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:40 gibba003 bash[31385]: cluster 2021-03-10T16:08:39.180629+0000 mgr.gibba043.dnkmem (mgr.34373) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:40 gibba003 bash[32348]: cluster 2021-03-10T16:08:39.180629+0000 mgr.gibba043.dnkmem (mgr.34373) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:41 gibba043 bash[24019]: cluster 2021-03-10T16:08:41.182443+0000 mgr.gibba043.dnkmem (mgr.34373) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:42.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:41 gibba003 bash[31385]: cluster 2021-03-10T16:08:41.182443+0000 mgr.gibba043.dnkmem (mgr.34373) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:41 gibba003 bash[32348]: cluster 2021-03-10T16:08:41.182443+0000 mgr.gibba043.dnkmem (mgr.34373) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:43.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:42 gibba043 bash[24019]: cephadm 2021-03-10T16:08:41.974729+0000 mgr.gibba043.dnkmem (mgr.34373) 7269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:43.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:42 gibba003 bash[31385]: cephadm 2021-03-10T16:08:41.974729+0000 mgr.gibba043.dnkmem (mgr.34373) 7269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:43.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:42 gibba003 bash[32348]: cephadm 2021-03-10T16:08:41.974729+0000 mgr.gibba043.dnkmem (mgr.34373) 7269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:44.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:43 gibba043 bash[24019]: cluster 2021-03-10T16:08:43.183816+0000 mgr.gibba043.dnkmem (mgr.34373) 7270 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:43 gibba003 bash[31385]: cluster 2021-03-10T16:08:43.183816+0000 mgr.gibba043.dnkmem (mgr.34373) 7270 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:44.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:43 gibba003 bash[32348]: cluster 2021-03-10T16:08:43.183816+0000 mgr.gibba043.dnkmem (mgr.34373) 7270 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:46 gibba043 bash[24019]: cluster 2021-03-10T16:08:45.185202+0000 mgr.gibba043.dnkmem (mgr.34373) 7271 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:46.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:46 gibba003 bash[31385]: cluster 2021-03-10T16:08:45.185202+0000 mgr.gibba043.dnkmem (mgr.34373) 7271 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:46 gibba003 bash[32348]: cluster 2021-03-10T16:08:45.185202+0000 mgr.gibba043.dnkmem (mgr.34373) 7271 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:47.419 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:08:47.644 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:08:47.645 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 35s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:08:47.645 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:08:47.646 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:08:47.646 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:08:47.647 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:08:47.647 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:08:47.648 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:08:47.648 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:08:47.648 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 35s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:08:47.649 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:08:47.649 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:08:47.650 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:08:47.650 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:08:47.651 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:08:47.651 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:08:47.651 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:08:47.651 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:08:47.652 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:08:47.652 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:08:47.652 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 35s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:08:47.892 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:08:47.892 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:08:47.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:47.893 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:08:47.893 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:08:47.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:47.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:08:47.894 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:08:47.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:08:47.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:08:47.895 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:08:47.895 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:08:47.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:08:47.895 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:08:47.896 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:08:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:48 gibba043 bash[24019]: cluster 2021-03-10T16:08:47.186713+0000 mgr.gibba043.dnkmem (mgr.34373) 7272 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:48 gibba043 bash[24019]: audit 2021-03-10T16:08:47.894418+0000 mon.c (mon.1) 1883 : audit [DBG] from='client.? 172.21.2.103:0/2628019597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:48.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:48 gibba003 bash[31385]: cluster 2021-03-10T16:08:47.186713+0000 mgr.gibba043.dnkmem (mgr.34373) 7272 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:48.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:48 gibba003 bash[31385]: audit 2021-03-10T16:08:47.894418+0000 mon.c (mon.1) 1883 : audit [DBG] from='client.? 172.21.2.103:0/2628019597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:48.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:48 gibba003 bash[32348]: cluster 2021-03-10T16:08:47.186713+0000 mgr.gibba043.dnkmem (mgr.34373) 7272 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:48.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:48 gibba003 bash[32348]: audit 2021-03-10T16:08:47.894418+0000 mon.c (mon.1) 1883 : audit [DBG] from='client.? 172.21.2.103:0/2628019597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:49 gibba043 bash[24019]: audit 2021-03-10T16:08:47.411059+0000 mgr.gibba043.dnkmem (mgr.34373) 7273 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:49 gibba043 bash[24019]: audit 2021-03-10T16:08:47.633384+0000 mgr.gibba043.dnkmem (mgr.34373) 7274 : audit [DBG] from='client.58924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:49 gibba003 bash[31385]: audit 2021-03-10T16:08:47.411059+0000 mgr.gibba043.dnkmem (mgr.34373) 7273 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:49 gibba003 bash[31385]: audit 2021-03-10T16:08:47.633384+0000 mgr.gibba043.dnkmem (mgr.34373) 7274 : audit [DBG] from='client.58924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:49 gibba003 bash[32348]: audit 2021-03-10T16:08:47.411059+0000 mgr.gibba043.dnkmem (mgr.34373) 7273 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:49 gibba003 bash[32348]: audit 2021-03-10T16:08:47.633384+0000 mgr.gibba043.dnkmem (mgr.34373) 7274 : audit [DBG] from='client.58924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:50.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:50 gibba003 bash[31385]: cluster 2021-03-10T16:08:49.188269+0000 mgr.gibba043.dnkmem (mgr.34373) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:50.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:50 gibba003 bash[32348]: cluster 2021-03-10T16:08:49.188269+0000 mgr.gibba043.dnkmem (mgr.34373) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:50.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:50 gibba043 bash[24019]: cluster 2021-03-10T16:08:49.188269+0000 mgr.gibba043.dnkmem (mgr.34373) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:52.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:51 gibba043 bash[24019]: cluster 2021-03-10T16:08:51.190127+0000 mgr.gibba043.dnkmem (mgr.34373) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:52.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:51 gibba003 bash[31385]: cluster 2021-03-10T16:08:51.190127+0000 mgr.gibba043.dnkmem (mgr.34373) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:52.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:51 gibba003 bash[32348]: cluster 2021-03-10T16:08:51.190127+0000 mgr.gibba043.dnkmem (mgr.34373) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:54 gibba043 bash[24019]: cluster 2021-03-10T16:08:53.191618+0000 mgr.gibba043.dnkmem (mgr.34373) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:54 gibba003 bash[31385]: cluster 2021-03-10T16:08:53.191618+0000 mgr.gibba043.dnkmem (mgr.34373) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:54 gibba003 bash[32348]: cluster 2021-03-10T16:08:53.191618+0000 mgr.gibba043.dnkmem (mgr.34373) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:56 gibba043 bash[24019]: cluster 2021-03-10T16:08:55.193047+0000 mgr.gibba043.dnkmem (mgr.34373) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:56 gibba003 bash[31385]: cluster 2021-03-10T16:08:55.193047+0000 mgr.gibba043.dnkmem (mgr.34373) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:56 gibba003 bash[32348]: cluster 2021-03-10T16:08:55.193047+0000 mgr.gibba043.dnkmem (mgr.34373) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:58 gibba003 bash[31385]: cephadm 2021-03-10T16:08:56.976468+0000 mgr.gibba043.dnkmem (mgr.34373) 7279 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:08:58 gibba003 bash[31385]: cluster 2021-03-10T16:08:57.194722+0000 mgr.gibba043.dnkmem (mgr.34373) 7280 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:58.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:58 gibba003 bash[32348]: cephadm 2021-03-10T16:08:56.976468+0000 mgr.gibba043.dnkmem (mgr.34373) 7279 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:58.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:08:58 gibba003 bash[32348]: cluster 2021-03-10T16:08:57.194722+0000 mgr.gibba043.dnkmem (mgr.34373) 7280 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:58 gibba043 bash[24019]: cephadm 2021-03-10T16:08:56.976468+0000 mgr.gibba043.dnkmem (mgr.34373) 7279 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:08:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:08:58 gibba043 bash[24019]: cluster 2021-03-10T16:08:57.194722+0000 mgr.gibba043.dnkmem (mgr.34373) 7280 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:00 gibba003 bash[31385]: cluster 2021-03-10T16:08:59.196103+0000 mgr.gibba043.dnkmem (mgr.34373) 7281 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:00 gibba003 bash[32348]: cluster 2021-03-10T16:08:59.196103+0000 mgr.gibba043.dnkmem (mgr.34373) 7281 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:00 gibba043 bash[24019]: cluster 2021-03-10T16:08:59.196103+0000 mgr.gibba043.dnkmem (mgr.34373) 7281 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:01 gibba043 bash[24019]: cluster 2021-03-10T16:09:01.197759+0000 mgr.gibba043.dnkmem (mgr.34373) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:01 gibba003 bash[31385]: cluster 2021-03-10T16:09:01.197759+0000 mgr.gibba043.dnkmem (mgr.34373) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:01 gibba003 bash[32348]: cluster 2021-03-10T16:09:01.197759+0000 mgr.gibba043.dnkmem (mgr.34373) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:04 gibba043 bash[24019]: cluster 2021-03-10T16:09:03.199063+0000 mgr.gibba043.dnkmem (mgr.34373) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:04.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:04 gibba003 bash[31385]: cluster 2021-03-10T16:09:03.199063+0000 mgr.gibba043.dnkmem (mgr.34373) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:04 gibba003 bash[32348]: cluster 2021-03-10T16:09:03.199063+0000 mgr.gibba043.dnkmem (mgr.34373) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:06.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:06 gibba003 bash[31385]: cluster 2021-03-10T16:09:05.200520+0000 mgr.gibba043.dnkmem (mgr.34373) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:06.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:06 gibba003 bash[32348]: cluster 2021-03-10T16:09:05.200520+0000 mgr.gibba043.dnkmem (mgr.34373) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:06 gibba043 bash[24019]: cluster 2021-03-10T16:09:05.200520+0000 mgr.gibba043.dnkmem (mgr.34373) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:08 gibba003 bash[31385]: cluster 2021-03-10T16:09:07.202092+0000 mgr.gibba043.dnkmem (mgr.34373) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:08.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:08 gibba003 bash[32348]: cluster 2021-03-10T16:09:07.202092+0000 mgr.gibba043.dnkmem (mgr.34373) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:08.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:08 gibba043 bash[24019]: cluster 2021-03-10T16:09:07.202092+0000 mgr.gibba043.dnkmem (mgr.34373) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:10 gibba003 bash[31385]: cluster 2021-03-10T16:09:09.203719+0000 mgr.gibba043.dnkmem (mgr.34373) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:10 gibba003 bash[32348]: cluster 2021-03-10T16:09:09.203719+0000 mgr.gibba043.dnkmem (mgr.34373) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:10.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:10 gibba043 bash[24019]: cluster 2021-03-10T16:09:09.203719+0000 mgr.gibba043.dnkmem (mgr.34373) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:11 gibba043 bash[24019]: cluster 2021-03-10T16:09:11.205464+0000 mgr.gibba043.dnkmem (mgr.34373) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:12.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:11 gibba003 bash[31385]: cluster 2021-03-10T16:09:11.205464+0000 mgr.gibba043.dnkmem (mgr.34373) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:12.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:11 gibba003 bash[32348]: cluster 2021-03-10T16:09:11.205464+0000 mgr.gibba043.dnkmem (mgr.34373) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:12 gibba043 bash[24019]: cephadm 2021-03-10T16:09:11.993354+0000 mgr.gibba043.dnkmem (mgr.34373) 7288 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:09:13.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:12 gibba043 bash[24019]: audit 2021-03-10T16:09:11.996763+0000 mon.c (mon.1) 1884 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:09:13.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:12 gibba003 bash[31385]: cephadm 2021-03-10T16:09:11.993354+0000 mgr.gibba043.dnkmem (mgr.34373) 7288 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:09:13.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:12 gibba003 bash[31385]: audit 2021-03-10T16:09:11.996763+0000 mon.c (mon.1) 1884 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:09:13.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:12 gibba003 bash[32348]: cephadm 2021-03-10T16:09:11.993354+0000 mgr.gibba043.dnkmem (mgr.34373) 7288 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:09:13.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:12 gibba003 bash[32348]: audit 2021-03-10T16:09:11.996763+0000 mon.c (mon.1) 1884 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:09:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:13 gibba043 bash[24019]: cluster 2021-03-10T16:09:13.206764+0000 mgr.gibba043.dnkmem (mgr.34373) 7289 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:13 gibba043 bash[24019]: audit 2021-03-10T16:09:13.610236+0000 mon.c (mon.1) 1885 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:13 gibba043 bash[24019]: audit 2021-03-10T16:09:13.611395+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:13 gibba003 bash[31385]: cluster 2021-03-10T16:09:13.206764+0000 mgr.gibba043.dnkmem (mgr.34373) 7289 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:13 gibba003 bash[31385]: audit 2021-03-10T16:09:13.610236+0000 mon.c (mon.1) 1885 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:13 gibba003 bash[31385]: audit 2021-03-10T16:09:13.611395+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:13 gibba003 bash[32348]: cluster 2021-03-10T16:09:13.206764+0000 mgr.gibba043.dnkmem (mgr.34373) 7289 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:13 gibba003 bash[32348]: audit 2021-03-10T16:09:13.610236+0000 mon.c (mon.1) 1885 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:13 gibba003 bash[32348]: audit 2021-03-10T16:09:13.611395+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.779037+0000 mon.c (mon.1) 1886 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.779469+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.936769+0000 mon.c (mon.1) 1887 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:09:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.937617+0000 mon.c (mon.1) 1888 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.938041+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:09:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.938669+0000 mon.c (mon.1) 1889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:09:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.939333+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.939842+0000 mon.c (mon.1) 1890 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.940119+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:09:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[31385]: audit 2021-03-10T16:09:13.941002+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.779037+0000 mon.c (mon.1) 1886 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.779469+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.936769+0000 mon.c (mon.1) 1887 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:09:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.937617+0000 mon.c (mon.1) 1888 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.938041+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:09:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.938669+0000 mon.c (mon.1) 1889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:09:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.939333+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.939842+0000 mon.c (mon.1) 1890 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.940119+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:09:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:14 gibba003 bash[32348]: audit 2021-03-10T16:09:13.941002+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.779037+0000 mon.c (mon.1) 1886 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.779469+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.936769+0000 mon.c (mon.1) 1887 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:09:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.937617+0000 mon.c (mon.1) 1888 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.938041+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:09:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.938669+0000 mon.c (mon.1) 1889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:09:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.939333+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.939842+0000 mon.c (mon.1) 1890 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:09:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.940119+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:09:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:14 gibba043 bash[24019]: audit 2021-03-10T16:09:13.941002+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:09:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:15 gibba003 bash[31385]: cluster 2021-03-10T16:09:15.207295+0000 mgr.gibba043.dnkmem (mgr.34373) 7290 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:15 gibba003 bash[31385]: audit 2021-03-10T16:09:15.707499+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:09:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:15 gibba003 bash[32348]: cluster 2021-03-10T16:09:15.207295+0000 mgr.gibba043.dnkmem (mgr.34373) 7290 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:15 gibba003 bash[32348]: audit 2021-03-10T16:09:15.707499+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:09:16.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:15 gibba043 bash[24019]: cluster 2021-03-10T16:09:15.207295+0000 mgr.gibba043.dnkmem (mgr.34373) 7290 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:15 gibba043 bash[24019]: audit 2021-03-10T16:09:15.707499+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:09:17.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.707406+0000 mgr.gibba043.dnkmem (mgr.34373) 7291 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:09:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.924854+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:09:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.926933+0000 mgr.gibba043.dnkmem (mgr.34373) 7292 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.929338+0000 mon.c (mon.1) 1891 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.930096+0000 mgr.gibba043.dnkmem (mgr.34373) 7293 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.932142+0000 mon.c (mon.1) 1892 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.932528+0000 mgr.gibba043.dnkmem (mgr.34373) 7294 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.932567+0000 mgr.gibba043.dnkmem (mgr.34373) 7295 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.934566+0000 mon.c (mon.1) 1893 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.934971+0000 mgr.gibba043.dnkmem (mgr.34373) 7296 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.935009+0000 mgr.gibba043.dnkmem (mgr.34373) 7297 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.936965+0000 mon.c (mon.1) 1894 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.937422+0000 mgr.gibba043.dnkmem (mgr.34373) 7298 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.941384+0000 mgr.gibba043.dnkmem (mgr.34373) 7299 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.941423+0000 mgr.gibba043.dnkmem (mgr.34373) 7300 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.943489+0000 mon.c (mon.1) 1895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.943968+0000 mgr.gibba043.dnkmem (mgr.34373) 7301 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.944313+0000 mgr.gibba043.dnkmem (mgr.34373) 7302 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: audit 2021-03-10T16:09:15.946517+0000 mon.c (mon.1) 1896 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.946929+0000 mgr.gibba043.dnkmem (mgr.34373) 7303 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:17.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.946973+0000 mgr.gibba043.dnkmem (mgr.34373) 7304 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:17.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[31385]: cephadm 2021-03-10T16:09:15.947130+0000 mgr.gibba043.dnkmem (mgr.34373) 7305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:17.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.707406+0000 mgr.gibba043.dnkmem (mgr.34373) 7291 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:09:17.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.924854+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:09:17.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.926933+0000 mgr.gibba043.dnkmem (mgr.34373) 7292 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.929338+0000 mon.c (mon.1) 1891 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.930096+0000 mgr.gibba043.dnkmem (mgr.34373) 7293 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.932142+0000 mon.c (mon.1) 1892 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.932528+0000 mgr.gibba043.dnkmem (mgr.34373) 7294 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.932567+0000 mgr.gibba043.dnkmem (mgr.34373) 7295 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.934566+0000 mon.c (mon.1) 1893 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.934971+0000 mgr.gibba043.dnkmem (mgr.34373) 7296 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:17.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.935009+0000 mgr.gibba043.dnkmem (mgr.34373) 7297 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.936965+0000 mon.c (mon.1) 1894 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.937422+0000 mgr.gibba043.dnkmem (mgr.34373) 7298 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.941384+0000 mgr.gibba043.dnkmem (mgr.34373) 7299 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:17.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.941423+0000 mgr.gibba043.dnkmem (mgr.34373) 7300 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.943489+0000 mon.c (mon.1) 1895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.943968+0000 mgr.gibba043.dnkmem (mgr.34373) 7301 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.944313+0000 mgr.gibba043.dnkmem (mgr.34373) 7302 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: audit 2021-03-10T16:09:15.946517+0000 mon.c (mon.1) 1896 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.946929+0000 mgr.gibba043.dnkmem (mgr.34373) 7303 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.946973+0000 mgr.gibba043.dnkmem (mgr.34373) 7304 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:17.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:16 gibba003 bash[32348]: cephadm 2021-03-10T16:09:15.947130+0000 mgr.gibba043.dnkmem (mgr.34373) 7305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.707406+0000 mgr.gibba043.dnkmem (mgr.34373) 7291 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:09:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.924854+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:09:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.926933+0000 mgr.gibba043.dnkmem (mgr.34373) 7292 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.929338+0000 mon.c (mon.1) 1891 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.930096+0000 mgr.gibba043.dnkmem (mgr.34373) 7293 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.932142+0000 mon.c (mon.1) 1892 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.932528+0000 mgr.gibba043.dnkmem (mgr.34373) 7294 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.932567+0000 mgr.gibba043.dnkmem (mgr.34373) 7295 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.934566+0000 mon.c (mon.1) 1893 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.934971+0000 mgr.gibba043.dnkmem (mgr.34373) 7296 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.935009+0000 mgr.gibba043.dnkmem (mgr.34373) 7297 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.936965+0000 mon.c (mon.1) 1894 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.937422+0000 mgr.gibba043.dnkmem (mgr.34373) 7298 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.941384+0000 mgr.gibba043.dnkmem (mgr.34373) 7299 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.941423+0000 mgr.gibba043.dnkmem (mgr.34373) 7300 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.943489+0000 mon.c (mon.1) 1895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.943968+0000 mgr.gibba043.dnkmem (mgr.34373) 7301 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.944313+0000 mgr.gibba043.dnkmem (mgr.34373) 7302 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: audit 2021-03-10T16:09:15.946517+0000 mon.c (mon.1) 1896 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:17.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.946929+0000 mgr.gibba043.dnkmem (mgr.34373) 7303 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:17.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.946973+0000 mgr.gibba043.dnkmem (mgr.34373) 7304 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:17.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:16 gibba043 bash[24019]: cephadm 2021-03-10T16:09:15.947130+0000 mgr.gibba043.dnkmem (mgr.34373) 7305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:18.136 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:09:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:17 gibba003 bash[31385]: cluster 2021-03-10T16:09:17.208863+0000 mgr.gibba043.dnkmem (mgr.34373) 7306 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:18.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:17 gibba003 bash[32348]: cluster 2021-03-10T16:09:17.208863+0000 mgr.gibba043.dnkmem (mgr.34373) 7306 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:18.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:17 gibba043 bash[24019]: cluster 2021-03-10T16:09:17.208863+0000 mgr.gibba043.dnkmem (mgr.34373) 7306 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:18.389 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:09:18.389 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 66s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:09:18.389 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:09:18.390 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:09:18.390 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:09:18.390 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:09:18.391 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:09:18.391 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:09:18.391 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:09:18.391 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 66s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:09:18.391 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:09:18.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:09:18.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:09:18.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:09:18.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:09:18.393 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:09:18.393 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:09:18.393 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:09:18.393 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:09:18.394 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:09:18.394 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 66s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:09:18.637 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:09:18.637 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:09:18.637 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:18.638 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:09:18.638 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:09:18.638 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:18.638 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:09:18.639 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:09:18.639 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:09:18.639 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:09:18.639 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:09:18.639 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:09:18.640 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:09:18.640 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:09:18.640 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:09:19.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:18 gibba043 bash[24019]: audit 2021-03-10T16:09:18.129061+0000 mgr.gibba043.dnkmem (mgr.34373) 7307 : audit [DBG] from='client.58936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:19.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:18 gibba043 bash[24019]: audit 2021-03-10T16:09:18.639042+0000 mon.a (mon.0) 1619 : audit [DBG] from='client.? 172.21.2.103:0/2381224190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:18 gibba003 bash[31385]: audit 2021-03-10T16:09:18.129061+0000 mgr.gibba043.dnkmem (mgr.34373) 7307 : audit [DBG] from='client.58936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:18 gibba003 bash[31385]: audit 2021-03-10T16:09:18.639042+0000 mon.a (mon.0) 1619 : audit [DBG] from='client.? 172.21.2.103:0/2381224190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:18 gibba003 bash[32348]: audit 2021-03-10T16:09:18.129061+0000 mgr.gibba043.dnkmem (mgr.34373) 7307 : audit [DBG] from='client.58936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:18 gibba003 bash[32348]: audit 2021-03-10T16:09:18.639042+0000 mon.a (mon.0) 1619 : audit [DBG] from='client.? 172.21.2.103:0/2381224190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:20.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:19 gibba043 bash[24019]: audit 2021-03-10T16:09:18.350631+0000 mgr.gibba043.dnkmem (mgr.34373) 7308 : audit [DBG] from='client.58942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:20.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:19 gibba043 bash[24019]: cluster 2021-03-10T16:09:19.210560+0000 mgr.gibba043.dnkmem (mgr.34373) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:19 gibba003 bash[31385]: audit 2021-03-10T16:09:18.350631+0000 mgr.gibba043.dnkmem (mgr.34373) 7308 : audit [DBG] from='client.58942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:19 gibba003 bash[31385]: cluster 2021-03-10T16:09:19.210560+0000 mgr.gibba043.dnkmem (mgr.34373) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:20.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:19 gibba003 bash[32348]: audit 2021-03-10T16:09:18.350631+0000 mgr.gibba043.dnkmem (mgr.34373) 7308 : audit [DBG] from='client.58942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:20.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:19 gibba003 bash[32348]: cluster 2021-03-10T16:09:19.210560+0000 mgr.gibba043.dnkmem (mgr.34373) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:21 gibba043 bash[24019]: cluster 2021-03-10T16:09:21.212379+0000 mgr.gibba043.dnkmem (mgr.34373) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:21 gibba003 bash[31385]: cluster 2021-03-10T16:09:21.212379+0000 mgr.gibba043.dnkmem (mgr.34373) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:22.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:21 gibba003 bash[32348]: cluster 2021-03-10T16:09:21.212379+0000 mgr.gibba043.dnkmem (mgr.34373) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:24.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:24 gibba003 bash[31385]: cluster 2021-03-10T16:09:23.213952+0000 mgr.gibba043.dnkmem (mgr.34373) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:24.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:24 gibba003 bash[32348]: cluster 2021-03-10T16:09:23.213952+0000 mgr.gibba043.dnkmem (mgr.34373) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:24.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:24 gibba043 bash[24019]: cluster 2021-03-10T16:09:23.213952+0000 mgr.gibba043.dnkmem (mgr.34373) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:26.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:26 gibba003 bash[31385]: cluster 2021-03-10T16:09:25.215400+0000 mgr.gibba043.dnkmem (mgr.34373) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:26.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:26 gibba003 bash[32348]: cluster 2021-03-10T16:09:25.215400+0000 mgr.gibba043.dnkmem (mgr.34373) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:26.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:26 gibba043 bash[24019]: cluster 2021-03-10T16:09:25.215400+0000 mgr.gibba043.dnkmem (mgr.34373) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:28.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:28 gibba003 bash[31385]: cluster 2021-03-10T16:09:27.216774+0000 mgr.gibba043.dnkmem (mgr.34373) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:28.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:28 gibba003 bash[32348]: cluster 2021-03-10T16:09:27.216774+0000 mgr.gibba043.dnkmem (mgr.34373) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:28.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:28 gibba043 bash[24019]: cluster 2021-03-10T16:09:27.216774+0000 mgr.gibba043.dnkmem (mgr.34373) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:30 gibba003 bash[31385]: cluster 2021-03-10T16:09:29.218371+0000 mgr.gibba043.dnkmem (mgr.34373) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:30 gibba003 bash[32348]: cluster 2021-03-10T16:09:29.218371+0000 mgr.gibba043.dnkmem (mgr.34373) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:30 gibba043 bash[24019]: cluster 2021-03-10T16:09:29.218371+0000 mgr.gibba043.dnkmem (mgr.34373) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:31 gibba043 bash[24019]: cephadm 2021-03-10T16:09:30.963082+0000 mgr.gibba043.dnkmem (mgr.34373) 7315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:31 gibba043 bash[24019]: cluster 2021-03-10T16:09:31.220189+0000 mgr.gibba043.dnkmem (mgr.34373) 7316 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:31 gibba003 bash[31385]: cephadm 2021-03-10T16:09:30.963082+0000 mgr.gibba043.dnkmem (mgr.34373) 7315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:31 gibba003 bash[31385]: cluster 2021-03-10T16:09:31.220189+0000 mgr.gibba043.dnkmem (mgr.34373) 7316 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:31 gibba003 bash[32348]: cephadm 2021-03-10T16:09:30.963082+0000 mgr.gibba043.dnkmem (mgr.34373) 7315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:31 gibba003 bash[32348]: cluster 2021-03-10T16:09:31.220189+0000 mgr.gibba043.dnkmem (mgr.34373) 7316 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:34 gibba003 bash[31385]: cluster 2021-03-10T16:09:33.221777+0000 mgr.gibba043.dnkmem (mgr.34373) 7317 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:34 gibba003 bash[32348]: cluster 2021-03-10T16:09:33.221777+0000 mgr.gibba043.dnkmem (mgr.34373) 7317 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:34 gibba043 bash[24019]: cluster 2021-03-10T16:09:33.221777+0000 mgr.gibba043.dnkmem (mgr.34373) 7317 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:36 gibba003 bash[31385]: cluster 2021-03-10T16:09:35.223473+0000 mgr.gibba043.dnkmem (mgr.34373) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:36 gibba003 bash[32348]: cluster 2021-03-10T16:09:35.223473+0000 mgr.gibba043.dnkmem (mgr.34373) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:36 gibba043 bash[24019]: cluster 2021-03-10T16:09:35.223473+0000 mgr.gibba043.dnkmem (mgr.34373) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:38 gibba003 bash[31385]: cluster 2021-03-10T16:09:37.225002+0000 mgr.gibba043.dnkmem (mgr.34373) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:38 gibba003 bash[32348]: cluster 2021-03-10T16:09:37.225002+0000 mgr.gibba043.dnkmem (mgr.34373) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:38 gibba043 bash[24019]: cluster 2021-03-10T16:09:37.225002+0000 mgr.gibba043.dnkmem (mgr.34373) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:40 gibba003 bash[31385]: cluster 2021-03-10T16:09:39.226379+0000 mgr.gibba043.dnkmem (mgr.34373) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:40 gibba003 bash[32348]: cluster 2021-03-10T16:09:39.226379+0000 mgr.gibba043.dnkmem (mgr.34373) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:40 gibba043 bash[24019]: cluster 2021-03-10T16:09:39.226379+0000 mgr.gibba043.dnkmem (mgr.34373) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:41 gibba043 bash[24019]: cluster 2021-03-10T16:09:41.228090+0000 mgr.gibba043.dnkmem (mgr.34373) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:41 gibba003 bash[31385]: cluster 2021-03-10T16:09:41.228090+0000 mgr.gibba043.dnkmem (mgr.34373) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:41 gibba003 bash[32348]: cluster 2021-03-10T16:09:41.228090+0000 mgr.gibba043.dnkmem (mgr.34373) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:44 gibba003 bash[31385]: cluster 2021-03-10T16:09:43.229720+0000 mgr.gibba043.dnkmem (mgr.34373) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:44 gibba003 bash[32348]: cluster 2021-03-10T16:09:43.229720+0000 mgr.gibba043.dnkmem (mgr.34373) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:44 gibba043 bash[24019]: cluster 2021-03-10T16:09:43.229720+0000 mgr.gibba043.dnkmem (mgr.34373) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:46 gibba003 bash[31385]: cluster 2021-03-10T16:09:45.231379+0000 mgr.gibba043.dnkmem (mgr.34373) 7323 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:46 gibba003 bash[32348]: cluster 2021-03-10T16:09:45.231379+0000 mgr.gibba043.dnkmem (mgr.34373) 7323 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:46 gibba043 bash[24019]: cluster 2021-03-10T16:09:45.231379+0000 mgr.gibba043.dnkmem (mgr.34373) 7323 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:47 gibba003 bash[31385]: cephadm 2021-03-10T16:09:45.979038+0000 mgr.gibba043.dnkmem (mgr.34373) 7324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:47 gibba003 bash[32348]: cephadm 2021-03-10T16:09:45.979038+0000 mgr.gibba043.dnkmem (mgr.34373) 7324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:47 gibba043 bash[24019]: cephadm 2021-03-10T16:09:45.979038+0000 mgr.gibba043.dnkmem (mgr.34373) 7324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:09:48.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:48 gibba003 bash[31385]: cluster 2021-03-10T16:09:47.232987+0000 mgr.gibba043.dnkmem (mgr.34373) 7325 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:48 gibba003 bash[32348]: cluster 2021-03-10T16:09:47.232987+0000 mgr.gibba043.dnkmem (mgr.34373) 7325 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:48 gibba043 bash[24019]: cluster 2021-03-10T16:09:47.232987+0000 mgr.gibba043.dnkmem (mgr.34373) 7325 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.913 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:09:49.140 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:09:49.141 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 97s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:09:49.141 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 33s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:09:49.141 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:09:49.143 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:09:49.144 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:09:49.145 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:09:49.147 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:09:49.147 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:09:49.147 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 97s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:09:49.147 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 33s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:09:49.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:09:49.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:09:49.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:09:49.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:09:49.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:09:49.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:09:49.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:09:49.149 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 33s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:09:49.149 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 33s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:09:49.150 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 97s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:09:49.389 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:09:49.390 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:09:49.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:49.391 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:09:49.391 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:09:49.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:49.393 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:09:49.394 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:09:49.395 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:09:49.395 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:09:49.395 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:09:49.395 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:09:49.396 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:09:49.396 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:09:49.396 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:09:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:49 gibba003 bash[31385]: audit 2021-03-10T16:09:48.905319+0000 mgr.gibba043.dnkmem (mgr.34373) 7326 : audit [DBG] from='client.58954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:49 gibba003 bash[31385]: audit 2021-03-10T16:09:49.128999+0000 mgr.gibba043.dnkmem (mgr.34373) 7327 : audit [DBG] from='client.48972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:49 gibba003 bash[31385]: cluster 2021-03-10T16:09:49.234361+0000 mgr.gibba043.dnkmem (mgr.34373) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:49 gibba003 bash[32348]: audit 2021-03-10T16:09:48.905319+0000 mgr.gibba043.dnkmem (mgr.34373) 7326 : audit [DBG] from='client.58954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:49 gibba003 bash[32348]: audit 2021-03-10T16:09:49.128999+0000 mgr.gibba043.dnkmem (mgr.34373) 7327 : audit [DBG] from='client.48972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:49 gibba003 bash[32348]: cluster 2021-03-10T16:09:49.234361+0000 mgr.gibba043.dnkmem (mgr.34373) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:49 gibba043 bash[24019]: audit 2021-03-10T16:09:48.905319+0000 mgr.gibba043.dnkmem (mgr.34373) 7326 : audit [DBG] from='client.58954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:49 gibba043 bash[24019]: audit 2021-03-10T16:09:49.128999+0000 mgr.gibba043.dnkmem (mgr.34373) 7327 : audit [DBG] from='client.48972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:49 gibba043 bash[24019]: cluster 2021-03-10T16:09:49.234361+0000 mgr.gibba043.dnkmem (mgr.34373) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:50.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:50 gibba003 bash[31385]: audit 2021-03-10T16:09:49.390729+0000 mon.a (mon.0) 1620 : audit [DBG] from='client.? 172.21.2.103:0/2808001898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:50.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:50 gibba003 bash[32348]: audit 2021-03-10T16:09:49.390729+0000 mon.a (mon.0) 1620 : audit [DBG] from='client.? 172.21.2.103:0/2808001898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:50.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:50 gibba043 bash[24019]: audit 2021-03-10T16:09:49.390729+0000 mon.a (mon.0) 1620 : audit [DBG] from='client.? 172.21.2.103:0/2808001898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:52.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:51 gibba003 bash[31385]: cluster 2021-03-10T16:09:51.236097+0000 mgr.gibba043.dnkmem (mgr.34373) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:52.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:51 gibba003 bash[32348]: cluster 2021-03-10T16:09:51.236097+0000 mgr.gibba043.dnkmem (mgr.34373) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:52.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:51 gibba043 bash[24019]: cluster 2021-03-10T16:09:51.236097+0000 mgr.gibba043.dnkmem (mgr.34373) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:54 gibba003 bash[31385]: cluster 2021-03-10T16:09:53.237738+0000 mgr.gibba043.dnkmem (mgr.34373) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:54 gibba003 bash[32348]: cluster 2021-03-10T16:09:53.237738+0000 mgr.gibba043.dnkmem (mgr.34373) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:54 gibba043 bash[24019]: cluster 2021-03-10T16:09:53.237738+0000 mgr.gibba043.dnkmem (mgr.34373) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:56 gibba003 bash[31385]: cluster 2021-03-10T16:09:55.239350+0000 mgr.gibba043.dnkmem (mgr.34373) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:56 gibba003 bash[32348]: cluster 2021-03-10T16:09:55.239350+0000 mgr.gibba043.dnkmem (mgr.34373) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:56 gibba043 bash[24019]: cluster 2021-03-10T16:09:55.239350+0000 mgr.gibba043.dnkmem (mgr.34373) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:58 gibba003 bash[31385]: cluster 2021-03-10T16:09:57.240984+0000 mgr.gibba043.dnkmem (mgr.34373) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:58 gibba003 bash[32348]: cluster 2021-03-10T16:09:57.240984+0000 mgr.gibba043.dnkmem (mgr.34373) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:58 gibba043 bash[24019]: cluster 2021-03-10T16:09:57.240984+0000 mgr.gibba043.dnkmem (mgr.34373) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:09:59 gibba003 bash[31385]: cluster 2021-03-10T16:09:59.242474+0000 mgr.gibba043.dnkmem (mgr.34373) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:09:59 gibba003 bash[32348]: cluster 2021-03-10T16:09:59.242474+0000 mgr.gibba043.dnkmem (mgr.34373) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:09:59 gibba043 bash[24019]: cluster 2021-03-10T16:09:59.242474+0000 mgr.gibba043.dnkmem (mgr.34373) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.334 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:00 gibba003 bash[31385]: debug 2021-03-10T16:09:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:00 gibba003 bash[31385]: cluster 2021-03-10T16:10:00.000471+0000 mon.a (mon.0) 1621 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:00 gibba003 bash[32348]: cluster 2021-03-10T16:10:00.000471+0000 mon.a (mon.0) 1621 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:00 gibba043 bash[24019]: cluster 2021-03-10T16:10:00.000471+0000 mon.a (mon.0) 1621 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:01 gibba003 bash[31385]: cephadm 2021-03-10T16:10:00.995001+0000 mgr.gibba043.dnkmem (mgr.34373) 7334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:01 gibba003 bash[31385]: cluster 2021-03-10T16:10:01.244367+0000 mgr.gibba043.dnkmem (mgr.34373) 7335 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:01 gibba003 bash[32348]: cephadm 2021-03-10T16:10:00.995001+0000 mgr.gibba043.dnkmem (mgr.34373) 7334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:01 gibba003 bash[32348]: cluster 2021-03-10T16:10:01.244367+0000 mgr.gibba043.dnkmem (mgr.34373) 7335 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:01 gibba043 bash[24019]: cephadm 2021-03-10T16:10:00.995001+0000 mgr.gibba043.dnkmem (mgr.34373) 7334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:02.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:01 gibba043 bash[24019]: cluster 2021-03-10T16:10:01.244367+0000 mgr.gibba043.dnkmem (mgr.34373) 7335 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:04 gibba003 bash[31385]: cluster 2021-03-10T16:10:03.245698+0000 mgr.gibba043.dnkmem (mgr.34373) 7336 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:04 gibba003 bash[32348]: cluster 2021-03-10T16:10:03.245698+0000 mgr.gibba043.dnkmem (mgr.34373) 7336 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:04 gibba043 bash[24019]: cluster 2021-03-10T16:10:03.245698+0000 mgr.gibba043.dnkmem (mgr.34373) 7336 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:06 gibba003 bash[31385]: cluster 2021-03-10T16:10:05.247329+0000 mgr.gibba043.dnkmem (mgr.34373) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:06 gibba003 bash[32348]: cluster 2021-03-10T16:10:05.247329+0000 mgr.gibba043.dnkmem (mgr.34373) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:06 gibba043 bash[24019]: cluster 2021-03-10T16:10:05.247329+0000 mgr.gibba043.dnkmem (mgr.34373) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:07.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:07 gibba003 bash[31385]: cluster 2021-03-10T16:10:07.248948+0000 mgr.gibba043.dnkmem (mgr.34373) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:07 gibba003 bash[32348]: cluster 2021-03-10T16:10:07.248948+0000 mgr.gibba043.dnkmem (mgr.34373) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:07 gibba043 bash[24019]: cluster 2021-03-10T16:10:07.248948+0000 mgr.gibba043.dnkmem (mgr.34373) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:10 gibba003 bash[31385]: cluster 2021-03-10T16:10:09.250441+0000 mgr.gibba043.dnkmem (mgr.34373) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:10 gibba003 bash[32348]: cluster 2021-03-10T16:10:09.250441+0000 mgr.gibba043.dnkmem (mgr.34373) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:10 gibba043 bash[24019]: cluster 2021-03-10T16:10:09.250441+0000 mgr.gibba043.dnkmem (mgr.34373) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:12.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:11 gibba003 bash[31385]: cluster 2021-03-10T16:10:11.252158+0000 mgr.gibba043.dnkmem (mgr.34373) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:12.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:11 gibba003 bash[32348]: cluster 2021-03-10T16:10:11.252158+0000 mgr.gibba043.dnkmem (mgr.34373) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:12.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:11 gibba043 bash[24019]: cluster 2021-03-10T16:10:11.252158+0000 mgr.gibba043.dnkmem (mgr.34373) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: cluster 2021-03-10T16:10:13.253684+0000 mgr.gibba043.dnkmem (mgr.34373) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.617362+0000 mon.c (mon.1) 1897 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.618498+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.786443+0000 mon.c (mon.1) 1898 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.787584+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.949003+0000 mon.c (mon.1) 1899 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:10:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.949742+0000 mon.c (mon.1) 1900 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:10:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.950217+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:10:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.950416+0000 mon.c (mon.1) 1901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.951281+0000 mon.c (mon.1) 1902 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.951695+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:10:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.952951+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[31385]: audit 2021-03-10T16:10:13.953746+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: cluster 2021-03-10T16:10:13.253684+0000 mgr.gibba043.dnkmem (mgr.34373) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.617362+0000 mon.c (mon.1) 1897 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.618498+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.786443+0000 mon.c (mon.1) 1898 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.787584+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.949003+0000 mon.c (mon.1) 1899 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:10:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.949742+0000 mon.c (mon.1) 1900 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:10:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.950217+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:10:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.950416+0000 mon.c (mon.1) 1901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.951281+0000 mon.c (mon.1) 1902 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.951695+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:10:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.952951+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:14 gibba003 bash[32348]: audit 2021-03-10T16:10:13.953746+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: cluster 2021-03-10T16:10:13.253684+0000 mgr.gibba043.dnkmem (mgr.34373) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.617362+0000 mon.c (mon.1) 1897 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.618498+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.786443+0000 mon.c (mon.1) 1898 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.787584+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.949003+0000 mon.c (mon.1) 1899 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:10:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.949742+0000 mon.c (mon.1) 1900 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:10:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.950217+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:10:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.950416+0000 mon.c (mon.1) 1901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.951281+0000 mon.c (mon.1) 1902 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.951695+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:10:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.952951+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:14 gibba043 bash[24019]: audit 2021-03-10T16:10:13.953746+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:10:16.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: cluster 2021-03-10T16:10:15.255239+0000 mgr.gibba043.dnkmem (mgr.34373) 7342 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.227653+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:10:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.231339+0000 mon.c (mon.1) 1903 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.232977+0000 mon.c (mon.1) 1904 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.234715+0000 mon.c (mon.1) 1905 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.236031+0000 mon.c (mon.1) 1906 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.239501+0000 mon.c (mon.1) 1907 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:16 gibba043 bash[24019]: audit 2021-03-10T16:10:16.241193+0000 mon.c (mon.1) 1908 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: cluster 2021-03-10T16:10:15.255239+0000 mgr.gibba043.dnkmem (mgr.34373) 7342 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.227653+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:10:16.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.231339+0000 mon.c (mon.1) 1903 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:16.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.232977+0000 mon.c (mon.1) 1904 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.234715+0000 mon.c (mon.1) 1905 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.236031+0000 mon.c (mon.1) 1906 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.239501+0000 mon.c (mon.1) 1907 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[31385]: audit 2021-03-10T16:10:16.241193+0000 mon.c (mon.1) 1908 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: cluster 2021-03-10T16:10:15.255239+0000 mgr.gibba043.dnkmem (mgr.34373) 7342 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.227653+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:10:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.231339+0000 mon.c (mon.1) 1903 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.232977+0000 mon.c (mon.1) 1904 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.234715+0000 mon.c (mon.1) 1905 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.236031+0000 mon.c (mon.1) 1906 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.239501+0000 mon.c (mon.1) 1907 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:16.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:16 gibba003 bash[32348]: audit 2021-03-10T16:10:16.241193+0000 mon.c (mon.1) 1908 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.012005+0000 mgr.gibba043.dnkmem (mgr.34373) 7343 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:10:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.013577+0000 mgr.gibba043.dnkmem (mgr.34373) 7344 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:10:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.229117+0000 mgr.gibba043.dnkmem (mgr.34373) 7345 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.231142+0000 mgr.gibba043.dnkmem (mgr.34373) 7346 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.232839+0000 mgr.gibba043.dnkmem (mgr.34373) 7347 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.232876+0000 mgr.gibba043.dnkmem (mgr.34373) 7348 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.234268+0000 mgr.gibba043.dnkmem (mgr.34373) 7349 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.234306+0000 mgr.gibba043.dnkmem (mgr.34373) 7350 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.235886+0000 mgr.gibba043.dnkmem (mgr.34373) 7351 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.237586+0000 mgr.gibba043.dnkmem (mgr.34373) 7352 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.237624+0000 mgr.gibba043.dnkmem (mgr.34373) 7353 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.239114+0000 mgr.gibba043.dnkmem (mgr.34373) 7354 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.239432+0000 mgr.gibba043.dnkmem (mgr.34373) 7355 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.240999+0000 mgr.gibba043.dnkmem (mgr.34373) 7356 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.241036+0000 mgr.gibba043.dnkmem (mgr.34373) 7357 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:17.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cephadm 2021-03-10T16:10:16.241185+0000 mgr.gibba043.dnkmem (mgr.34373) 7358 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:17.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[31385]: cluster 2021-03-10T16:10:17.256932+0000 mgr.gibba043.dnkmem (mgr.34373) 7359 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.012005+0000 mgr.gibba043.dnkmem (mgr.34373) 7343 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:10:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.013577+0000 mgr.gibba043.dnkmem (mgr.34373) 7344 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:10:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.229117+0000 mgr.gibba043.dnkmem (mgr.34373) 7345 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.231142+0000 mgr.gibba043.dnkmem (mgr.34373) 7346 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.232839+0000 mgr.gibba043.dnkmem (mgr.34373) 7347 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.232876+0000 mgr.gibba043.dnkmem (mgr.34373) 7348 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.234268+0000 mgr.gibba043.dnkmem (mgr.34373) 7349 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.234306+0000 mgr.gibba043.dnkmem (mgr.34373) 7350 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.235886+0000 mgr.gibba043.dnkmem (mgr.34373) 7351 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.237586+0000 mgr.gibba043.dnkmem (mgr.34373) 7352 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.237624+0000 mgr.gibba043.dnkmem (mgr.34373) 7353 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.239114+0000 mgr.gibba043.dnkmem (mgr.34373) 7354 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.239432+0000 mgr.gibba043.dnkmem (mgr.34373) 7355 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.240999+0000 mgr.gibba043.dnkmem (mgr.34373) 7356 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.241036+0000 mgr.gibba043.dnkmem (mgr.34373) 7357 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cephadm 2021-03-10T16:10:16.241185+0000 mgr.gibba043.dnkmem (mgr.34373) 7358 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:17 gibba003 bash[32348]: cluster 2021-03-10T16:10:17.256932+0000 mgr.gibba043.dnkmem (mgr.34373) 7359 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.012005+0000 mgr.gibba043.dnkmem (mgr.34373) 7343 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:10:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.013577+0000 mgr.gibba043.dnkmem (mgr.34373) 7344 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:10:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.229117+0000 mgr.gibba043.dnkmem (mgr.34373) 7345 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.231142+0000 mgr.gibba043.dnkmem (mgr.34373) 7346 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.232839+0000 mgr.gibba043.dnkmem (mgr.34373) 7347 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.232876+0000 mgr.gibba043.dnkmem (mgr.34373) 7348 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.234268+0000 mgr.gibba043.dnkmem (mgr.34373) 7349 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.234306+0000 mgr.gibba043.dnkmem (mgr.34373) 7350 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.235886+0000 mgr.gibba043.dnkmem (mgr.34373) 7351 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.237586+0000 mgr.gibba043.dnkmem (mgr.34373) 7352 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.237624+0000 mgr.gibba043.dnkmem (mgr.34373) 7353 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.239114+0000 mgr.gibba043.dnkmem (mgr.34373) 7354 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.239432+0000 mgr.gibba043.dnkmem (mgr.34373) 7355 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.240999+0000 mgr.gibba043.dnkmem (mgr.34373) 7356 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.241036+0000 mgr.gibba043.dnkmem (mgr.34373) 7357 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cephadm 2021-03-10T16:10:16.241185+0000 mgr.gibba043.dnkmem (mgr.34373) 7358 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:17 gibba043 bash[24019]: cluster 2021-03-10T16:10:17.256932+0000 mgr.gibba043.dnkmem (mgr.34373) 7359 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:19.627 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:10:19.879 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:10:19.879 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:10:19.880 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 64s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:10:19.880 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:10:19.880 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:10:19.880 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:10:19.881 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:10:19.881 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:10:19.881 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:10:19.881 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:10:19.881 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 64s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:10:19.882 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:10:19.882 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:10:19.882 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:10:19.883 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:10:19.883 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:10:19.883 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:10:19.883 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:10:19.884 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:10:19.884 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 64s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:10:19.884 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:10:20.129 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:10:20.129 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:10:20.130 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:20.130 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:10:20.130 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:10:20.130 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:20.131 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:10:20.131 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:10:20.131 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:10:20.131 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:10:20.132 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:10:20.132 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:10:20.132 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:10:20.133 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:10:20.133 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:10:20.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:20 gibba003 bash[31385]: cluster 2021-03-10T16:10:19.258652+0000 mgr.gibba043.dnkmem (mgr.34373) 7360 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:20.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:20 gibba003 bash[31385]: audit 2021-03-10T16:10:20.131404+0000 mon.a (mon.0) 1629 : audit [DBG] from='client.? 172.21.2.103:0/3933751414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:20.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:20 gibba003 bash[32348]: cluster 2021-03-10T16:10:19.258652+0000 mgr.gibba043.dnkmem (mgr.34373) 7360 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:20.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:20 gibba003 bash[32348]: audit 2021-03-10T16:10:20.131404+0000 mon.a (mon.0) 1629 : audit [DBG] from='client.? 172.21.2.103:0/3933751414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:20.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:20 gibba043 bash[24019]: cluster 2021-03-10T16:10:19.258652+0000 mgr.gibba043.dnkmem (mgr.34373) 7360 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:20.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:20 gibba043 bash[24019]: audit 2021-03-10T16:10:20.131404+0000 mon.a (mon.0) 1629 : audit [DBG] from='client.? 172.21.2.103:0/3933751414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:21 gibba003 bash[31385]: audit 2021-03-10T16:10:19.619484+0000 mgr.gibba043.dnkmem (mgr.34373) 7361 : audit [DBG] from='client.58972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:21.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:21 gibba003 bash[31385]: audit 2021-03-10T16:10:19.844011+0000 mgr.gibba043.dnkmem (mgr.34373) 7362 : audit [DBG] from='client.48990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:21 gibba003 bash[32348]: audit 2021-03-10T16:10:19.619484+0000 mgr.gibba043.dnkmem (mgr.34373) 7361 : audit [DBG] from='client.58972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:21 gibba003 bash[32348]: audit 2021-03-10T16:10:19.844011+0000 mgr.gibba043.dnkmem (mgr.34373) 7362 : audit [DBG] from='client.48990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:21 gibba043 bash[24019]: audit 2021-03-10T16:10:19.619484+0000 mgr.gibba043.dnkmem (mgr.34373) 7361 : audit [DBG] from='client.58972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:21.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:21 gibba043 bash[24019]: audit 2021-03-10T16:10:19.844011+0000 mgr.gibba043.dnkmem (mgr.34373) 7362 : audit [DBG] from='client.48990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:22.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:22 gibba003 bash[31385]: cluster 2021-03-10T16:10:21.260375+0000 mgr.gibba043.dnkmem (mgr.34373) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:22.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:22 gibba003 bash[32348]: cluster 2021-03-10T16:10:21.260375+0000 mgr.gibba043.dnkmem (mgr.34373) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:22.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:22 gibba043 bash[24019]: cluster 2021-03-10T16:10:21.260375+0000 mgr.gibba043.dnkmem (mgr.34373) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:23 gibba003 bash[31385]: cluster 2021-03-10T16:10:23.262007+0000 mgr.gibba043.dnkmem (mgr.34373) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:23 gibba003 bash[32348]: cluster 2021-03-10T16:10:23.262007+0000 mgr.gibba043.dnkmem (mgr.34373) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:23 gibba043 bash[24019]: cluster 2021-03-10T16:10:23.262007+0000 mgr.gibba043.dnkmem (mgr.34373) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:26.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:26 gibba003 bash[31385]: cluster 2021-03-10T16:10:25.263393+0000 mgr.gibba043.dnkmem (mgr.34373) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:26.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:26 gibba003 bash[32348]: cluster 2021-03-10T16:10:25.263393+0000 mgr.gibba043.dnkmem (mgr.34373) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:26 gibba043 bash[24019]: cluster 2021-03-10T16:10:25.263393+0000 mgr.gibba043.dnkmem (mgr.34373) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:27 gibba003 bash[31385]: cluster 2021-03-10T16:10:27.265013+0000 mgr.gibba043.dnkmem (mgr.34373) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:27 gibba003 bash[32348]: cluster 2021-03-10T16:10:27.265013+0000 mgr.gibba043.dnkmem (mgr.34373) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:27 gibba043 bash[24019]: cluster 2021-03-10T16:10:27.265013+0000 mgr.gibba043.dnkmem (mgr.34373) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:30 gibba003 bash[31385]: cluster 2021-03-10T16:10:29.266367+0000 mgr.gibba043.dnkmem (mgr.34373) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:30.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:30 gibba003 bash[32348]: cluster 2021-03-10T16:10:29.266367+0000 mgr.gibba043.dnkmem (mgr.34373) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:30.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:30 gibba043 bash[24019]: cluster 2021-03-10T16:10:29.266367+0000 mgr.gibba043.dnkmem (mgr.34373) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:31 gibba003 bash[31385]: cephadm 2021-03-10T16:10:31.252786+0000 mgr.gibba043.dnkmem (mgr.34373) 7368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:31 gibba003 bash[31385]: cluster 2021-03-10T16:10:31.268004+0000 mgr.gibba043.dnkmem (mgr.34373) 7369 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:31 gibba003 bash[32348]: cephadm 2021-03-10T16:10:31.252786+0000 mgr.gibba043.dnkmem (mgr.34373) 7368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:31 gibba003 bash[32348]: cluster 2021-03-10T16:10:31.268004+0000 mgr.gibba043.dnkmem (mgr.34373) 7369 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:32.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:31 gibba043 bash[24019]: cephadm 2021-03-10T16:10:31.252786+0000 mgr.gibba043.dnkmem (mgr.34373) 7368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:32.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:31 gibba043 bash[24019]: cluster 2021-03-10T16:10:31.268004+0000 mgr.gibba043.dnkmem (mgr.34373) 7369 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:34 gibba003 bash[31385]: cluster 2021-03-10T16:10:33.269338+0000 mgr.gibba043.dnkmem (mgr.34373) 7370 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:34.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:34 gibba003 bash[32348]: cluster 2021-03-10T16:10:33.269338+0000 mgr.gibba043.dnkmem (mgr.34373) 7370 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:34 gibba043 bash[24019]: cluster 2021-03-10T16:10:33.269338+0000 mgr.gibba043.dnkmem (mgr.34373) 7370 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:35 gibba003 bash[31385]: cluster 2021-03-10T16:10:35.271059+0000 mgr.gibba043.dnkmem (mgr.34373) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:35 gibba003 bash[32348]: cluster 2021-03-10T16:10:35.271059+0000 mgr.gibba043.dnkmem (mgr.34373) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:35 gibba043 bash[24019]: cluster 2021-03-10T16:10:35.271059+0000 mgr.gibba043.dnkmem (mgr.34373) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:38.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:38 gibba003 bash[31385]: cluster 2021-03-10T16:10:37.272691+0000 mgr.gibba043.dnkmem (mgr.34373) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:38.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:38 gibba003 bash[32348]: cluster 2021-03-10T16:10:37.272691+0000 mgr.gibba043.dnkmem (mgr.34373) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:38 gibba043 bash[24019]: cluster 2021-03-10T16:10:37.272691+0000 mgr.gibba043.dnkmem (mgr.34373) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:39 gibba003 bash[31385]: cluster 2021-03-10T16:10:39.274061+0000 mgr.gibba043.dnkmem (mgr.34373) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:39 gibba003 bash[32348]: cluster 2021-03-10T16:10:39.274061+0000 mgr.gibba043.dnkmem (mgr.34373) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:39 gibba043 bash[24019]: cluster 2021-03-10T16:10:39.274061+0000 mgr.gibba043.dnkmem (mgr.34373) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:42.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:41 gibba003 bash[31385]: cluster 2021-03-10T16:10:41.275861+0000 mgr.gibba043.dnkmem (mgr.34373) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:41 gibba003 bash[32348]: cluster 2021-03-10T16:10:41.275861+0000 mgr.gibba043.dnkmem (mgr.34373) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:42.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:41 gibba043 bash[24019]: cluster 2021-03-10T16:10:41.275861+0000 mgr.gibba043.dnkmem (mgr.34373) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:44 gibba003 bash[31385]: cluster 2021-03-10T16:10:43.277209+0000 mgr.gibba043.dnkmem (mgr.34373) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:44 gibba003 bash[32348]: cluster 2021-03-10T16:10:43.277209+0000 mgr.gibba043.dnkmem (mgr.34373) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:44 gibba043 bash[24019]: cluster 2021-03-10T16:10:43.277209+0000 mgr.gibba043.dnkmem (mgr.34373) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:45 gibba003 bash[31385]: cluster 2021-03-10T16:10:45.278731+0000 mgr.gibba043.dnkmem (mgr.34373) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:45 gibba003 bash[32348]: cluster 2021-03-10T16:10:45.278731+0000 mgr.gibba043.dnkmem (mgr.34373) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:45 gibba043 bash[24019]: cluster 2021-03-10T16:10:45.278731+0000 mgr.gibba043.dnkmem (mgr.34373) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:47.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:46 gibba003 bash[31385]: cephadm 2021-03-10T16:10:46.268904+0000 mgr.gibba043.dnkmem (mgr.34373) 7377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:47.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:46 gibba003 bash[32348]: cephadm 2021-03-10T16:10:46.268904+0000 mgr.gibba043.dnkmem (mgr.34373) 7377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:47.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:46 gibba043 bash[24019]: cephadm 2021-03-10T16:10:46.268904+0000 mgr.gibba043.dnkmem (mgr.34373) 7377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:10:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:47 gibba003 bash[31385]: cluster 2021-03-10T16:10:47.280285+0000 mgr.gibba043.dnkmem (mgr.34373) 7378 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:48.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:47 gibba003 bash[32348]: cluster 2021-03-10T16:10:47.280285+0000 mgr.gibba043.dnkmem (mgr.34373) 7378 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:48.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:47 gibba043 bash[24019]: cluster 2021-03-10T16:10:47.280285+0000 mgr.gibba043.dnkmem (mgr.34373) 7378 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:49 gibba003 bash[31385]: cluster 2021-03-10T16:10:49.281819+0000 mgr.gibba043.dnkmem (mgr.34373) 7379 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:49 gibba003 bash[32348]: cluster 2021-03-10T16:10:49.281819+0000 mgr.gibba043.dnkmem (mgr.34373) 7379 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:49 gibba043 bash[24019]: cluster 2021-03-10T16:10:49.281819+0000 mgr.gibba043.dnkmem (mgr.34373) 7379 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:50.368 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:10:50.594 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:10:50.595 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:10:50.595 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 94s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:10:50.595 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:10:50.596 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:10:50.596 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:10:50.596 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:10:50.596 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:10:50.597 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:10:50.597 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:10:50.597 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 94s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:10:50.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:10:50.597 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:10:50.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:10:50.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:10:50.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:10:50.598 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:10:50.599 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:10:50.599 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:10:50.599 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 94s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:10:50.599 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:10:50.844 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:10:50.845 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:10:50.845 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:50.845 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:10:50.845 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:10:50.846 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:50.846 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:10:50.846 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:10:50.846 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:10:50.847 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:10:50.847 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:10:50.847 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:10:50.847 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:10:50.848 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:10:50.848 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:10:52.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[31385]: audit 2021-03-10T16:10:50.360457+0000 mgr.gibba043.dnkmem (mgr.34373) 7380 : audit [DBG] from='client.49002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:52.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[31385]: audit 2021-03-10T16:10:50.583830+0000 mgr.gibba043.dnkmem (mgr.34373) 7381 : audit [DBG] from='client.58996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[31385]: audit 2021-03-10T16:10:50.846814+0000 mon.a (mon.0) 1630 : audit [DBG] from='client.? 172.21.2.103:0/443629834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[31385]: cluster 2021-03-10T16:10:51.283511+0000 mgr.gibba043.dnkmem (mgr.34373) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[32348]: audit 2021-03-10T16:10:50.360457+0000 mgr.gibba043.dnkmem (mgr.34373) 7380 : audit [DBG] from='client.49002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[32348]: audit 2021-03-10T16:10:50.583830+0000 mgr.gibba043.dnkmem (mgr.34373) 7381 : audit [DBG] from='client.58996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[32348]: audit 2021-03-10T16:10:50.846814+0000 mon.a (mon.0) 1630 : audit [DBG] from='client.? 172.21.2.103:0/443629834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:51 gibba003 bash[32348]: cluster 2021-03-10T16:10:51.283511+0000 mgr.gibba043.dnkmem (mgr.34373) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:52.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:51 gibba043 bash[24019]: audit 2021-03-10T16:10:50.360457+0000 mgr.gibba043.dnkmem (mgr.34373) 7380 : audit [DBG] from='client.49002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:52.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:51 gibba043 bash[24019]: audit 2021-03-10T16:10:50.583830+0000 mgr.gibba043.dnkmem (mgr.34373) 7381 : audit [DBG] from='client.58996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:52.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:51 gibba043 bash[24019]: audit 2021-03-10T16:10:50.846814+0000 mon.a (mon.0) 1630 : audit [DBG] from='client.? 172.21.2.103:0/443629834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:52.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:51 gibba043 bash[24019]: cluster 2021-03-10T16:10:51.283511+0000 mgr.gibba043.dnkmem (mgr.34373) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:53 gibba003 bash[31385]: cluster 2021-03-10T16:10:53.284977+0000 mgr.gibba043.dnkmem (mgr.34373) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:53 gibba003 bash[32348]: cluster 2021-03-10T16:10:53.284977+0000 mgr.gibba043.dnkmem (mgr.34373) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:53 gibba043 bash[24019]: cluster 2021-03-10T16:10:53.284977+0000 mgr.gibba043.dnkmem (mgr.34373) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:55 gibba003 bash[31385]: cluster 2021-03-10T16:10:55.286384+0000 mgr.gibba043.dnkmem (mgr.34373) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:55 gibba003 bash[32348]: cluster 2021-03-10T16:10:55.286384+0000 mgr.gibba043.dnkmem (mgr.34373) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:55 gibba043 bash[24019]: cluster 2021-03-10T16:10:55.286384+0000 mgr.gibba043.dnkmem (mgr.34373) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:57 gibba003 bash[31385]: cluster 2021-03-10T16:10:57.287774+0000 mgr.gibba043.dnkmem (mgr.34373) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:57 gibba003 bash[32348]: cluster 2021-03-10T16:10:57.287774+0000 mgr.gibba043.dnkmem (mgr.34373) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:57 gibba043 bash[24019]: cluster 2021-03-10T16:10:57.287774+0000 mgr.gibba043.dnkmem (mgr.34373) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:10:59 gibba003 bash[31385]: cluster 2021-03-10T16:10:59.289298+0000 mgr.gibba043.dnkmem (mgr.34373) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:59.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:10:59 gibba003 bash[32348]: cluster 2021-03-10T16:10:59.289298+0000 mgr.gibba043.dnkmem (mgr.34373) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:10:59 gibba043 bash[24019]: cluster 2021-03-10T16:10:59.289298+0000 mgr.gibba043.dnkmem (mgr.34373) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:01 gibba003 bash[31385]: cephadm 2021-03-10T16:11:01.280888+0000 mgr.gibba043.dnkmem (mgr.34373) 7387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:01 gibba003 bash[31385]: cluster 2021-03-10T16:11:01.291072+0000 mgr.gibba043.dnkmem (mgr.34373) 7388 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:01 gibba003 bash[32348]: cephadm 2021-03-10T16:11:01.280888+0000 mgr.gibba043.dnkmem (mgr.34373) 7387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:01 gibba003 bash[32348]: cluster 2021-03-10T16:11:01.291072+0000 mgr.gibba043.dnkmem (mgr.34373) 7388 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:01 gibba043 bash[24019]: cephadm 2021-03-10T16:11:01.280888+0000 mgr.gibba043.dnkmem (mgr.34373) 7387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:02.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:01 gibba043 bash[24019]: cluster 2021-03-10T16:11:01.291072+0000 mgr.gibba043.dnkmem (mgr.34373) 7388 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:03.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:03 gibba003 bash[31385]: cluster 2021-03-10T16:11:03.292689+0000 mgr.gibba043.dnkmem (mgr.34373) 7389 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:03 gibba003 bash[32348]: cluster 2021-03-10T16:11:03.292689+0000 mgr.gibba043.dnkmem (mgr.34373) 7389 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:03 gibba043 bash[24019]: cluster 2021-03-10T16:11:03.292689+0000 mgr.gibba043.dnkmem (mgr.34373) 7389 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:05.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:05 gibba003 bash[31385]: cluster 2021-03-10T16:11:05.294066+0000 mgr.gibba043.dnkmem (mgr.34373) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:05.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:05 gibba003 bash[32348]: cluster 2021-03-10T16:11:05.294066+0000 mgr.gibba043.dnkmem (mgr.34373) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:05 gibba043 bash[24019]: cluster 2021-03-10T16:11:05.294066+0000 mgr.gibba043.dnkmem (mgr.34373) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:07.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:07 gibba003 bash[31385]: cluster 2021-03-10T16:11:07.295469+0000 mgr.gibba043.dnkmem (mgr.34373) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:07 gibba003 bash[32348]: cluster 2021-03-10T16:11:07.295469+0000 mgr.gibba043.dnkmem (mgr.34373) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:07 gibba043 bash[24019]: cluster 2021-03-10T16:11:07.295469+0000 mgr.gibba043.dnkmem (mgr.34373) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:09 gibba003 bash[31385]: cluster 2021-03-10T16:11:09.297282+0000 mgr.gibba043.dnkmem (mgr.34373) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:09 gibba003 bash[32348]: cluster 2021-03-10T16:11:09.297282+0000 mgr.gibba043.dnkmem (mgr.34373) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:09 gibba043 bash[24019]: cluster 2021-03-10T16:11:09.297282+0000 mgr.gibba043.dnkmem (mgr.34373) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:12.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:11 gibba003 bash[31385]: cluster 2021-03-10T16:11:11.299108+0000 mgr.gibba043.dnkmem (mgr.34373) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:11 gibba003 bash[32348]: cluster 2021-03-10T16:11:11.299108+0000 mgr.gibba043.dnkmem (mgr.34373) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:12.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:11 gibba043 bash[24019]: cluster 2021-03-10T16:11:11.299108+0000 mgr.gibba043.dnkmem (mgr.34373) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:13 gibba003 bash[31385]: cluster 2021-03-10T16:11:13.300334+0000 mgr.gibba043.dnkmem (mgr.34373) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:13 gibba003 bash[32348]: cluster 2021-03-10T16:11:13.300334+0000 mgr.gibba043.dnkmem (mgr.34373) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:13 gibba043 bash[24019]: cluster 2021-03-10T16:11:13.300334+0000 mgr.gibba043.dnkmem (mgr.34373) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.624316+0000 mon.c (mon.1) 1909 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.625457+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.794922+0000 mon.c (mon.1) 1910 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.796037+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.957382+0000 mon.c (mon.1) 1911 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:11:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.958148+0000 mon.c (mon.1) 1912 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.958685+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:11:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.959203+0000 mon.c (mon.1) 1913 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.960137+0000 mon.c (mon.1) 1914 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.960905+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.962062+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[31385]: audit 2021-03-10T16:11:13.962978+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.624316+0000 mon.c (mon.1) 1909 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.625457+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.794922+0000 mon.c (mon.1) 1910 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.796037+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.957382+0000 mon.c (mon.1) 1911 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:11:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.958148+0000 mon.c (mon.1) 1912 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.958685+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:11:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.959203+0000 mon.c (mon.1) 1913 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.960137+0000 mon.c (mon.1) 1914 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.960905+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.962062+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:14 gibba003 bash[32348]: audit 2021-03-10T16:11:13.962978+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.624316+0000 mon.c (mon.1) 1909 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.625457+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.794922+0000 mon.c (mon.1) 1910 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.796037+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.957382+0000 mon.c (mon.1) 1911 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:11:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.958148+0000 mon.c (mon.1) 1912 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.958685+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:11:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.959203+0000 mon.c (mon.1) 1913 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.960137+0000 mon.c (mon.1) 1914 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.960905+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.962062+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:11:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:14 gibba043 bash[24019]: audit 2021-03-10T16:11:13.962978+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:15 gibba003 bash[31385]: cluster 2021-03-10T16:11:15.301722+0000 mgr.gibba043.dnkmem (mgr.34373) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:15 gibba003 bash[32348]: cluster 2021-03-10T16:11:15.301722+0000 mgr.gibba043.dnkmem (mgr.34373) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:15 gibba043 bash[24019]: cluster 2021-03-10T16:11:15.301722+0000 mgr.gibba043.dnkmem (mgr.34373) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.297751+0000 mgr.gibba043.dnkmem (mgr.34373) 7396 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:11:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.299293+0000 mgr.gibba043.dnkmem (mgr.34373) 7397 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:11:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.518726+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:11:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.522326+0000 mon.c (mon.1) 1915 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.523524+0000 mon.c (mon.1) 1916 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.524511+0000 mon.c (mon.1) 1917 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.525491+0000 mon.c (mon.1) 1918 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.527766+0000 mon.c (mon.1) 1919 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[31385]: audit 2021-03-10T16:11:16.529080+0000 mon.c (mon.1) 1920 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.297751+0000 mgr.gibba043.dnkmem (mgr.34373) 7396 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:11:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.299293+0000 mgr.gibba043.dnkmem (mgr.34373) 7397 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:11:17.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.518726+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:11:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.522326+0000 mon.c (mon.1) 1915 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.523524+0000 mon.c (mon.1) 1916 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.524511+0000 mon.c (mon.1) 1917 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.525491+0000 mon.c (mon.1) 1918 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.527766+0000 mon.c (mon.1) 1919 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:16 gibba003 bash[32348]: audit 2021-03-10T16:11:16.529080+0000 mon.c (mon.1) 1920 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.297751+0000 mgr.gibba043.dnkmem (mgr.34373) 7396 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:11:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.299293+0000 mgr.gibba043.dnkmem (mgr.34373) 7397 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:11:17.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.518726+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:11:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.522326+0000 mon.c (mon.1) 1915 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.523524+0000 mon.c (mon.1) 1916 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.524511+0000 mon.c (mon.1) 1917 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.525491+0000 mon.c (mon.1) 1918 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.527766+0000 mon.c (mon.1) 1919 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:17.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:16 gibba043 bash[24019]: audit 2021-03-10T16:11:16.529080+0000 mon.c (mon.1) 1920 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.520380+0000 mgr.gibba043.dnkmem (mgr.34373) 7398 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.521876+0000 mgr.gibba043.dnkmem (mgr.34373) 7399 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.522849+0000 mgr.gibba043.dnkmem (mgr.34373) 7400 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.522886+0000 mgr.gibba043.dnkmem (mgr.34373) 7401 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.523851+0000 mgr.gibba043.dnkmem (mgr.34373) 7402 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.523890+0000 mgr.gibba043.dnkmem (mgr.34373) 7403 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.524771+0000 mgr.gibba043.dnkmem (mgr.34373) 7404 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.525879+0000 mgr.gibba043.dnkmem (mgr.34373) 7405 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.526061+0000 mgr.gibba043.dnkmem (mgr.34373) 7406 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.527084+0000 mgr.gibba043.dnkmem (mgr.34373) 7407 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.527535+0000 mgr.gibba043.dnkmem (mgr.34373) 7408 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.528251+0000 mgr.gibba043.dnkmem (mgr.34373) 7409 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.528301+0000 mgr.gibba043.dnkmem (mgr.34373) 7410 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cephadm 2021-03-10T16:11:16.528420+0000 mgr.gibba043.dnkmem (mgr.34373) 7411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[31385]: cluster 2021-03-10T16:11:17.303223+0000 mgr.gibba043.dnkmem (mgr.34373) 7412 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:18.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.520380+0000 mgr.gibba043.dnkmem (mgr.34373) 7398 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:18.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.521876+0000 mgr.gibba043.dnkmem (mgr.34373) 7399 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:18.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.522849+0000 mgr.gibba043.dnkmem (mgr.34373) 7400 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:18.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.522886+0000 mgr.gibba043.dnkmem (mgr.34373) 7401 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:18.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.523851+0000 mgr.gibba043.dnkmem (mgr.34373) 7402 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:18.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.523890+0000 mgr.gibba043.dnkmem (mgr.34373) 7403 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.524771+0000 mgr.gibba043.dnkmem (mgr.34373) 7404 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.525879+0000 mgr.gibba043.dnkmem (mgr.34373) 7405 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.526061+0000 mgr.gibba043.dnkmem (mgr.34373) 7406 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.527084+0000 mgr.gibba043.dnkmem (mgr.34373) 7407 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.527535+0000 mgr.gibba043.dnkmem (mgr.34373) 7408 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.528251+0000 mgr.gibba043.dnkmem (mgr.34373) 7409 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.528301+0000 mgr.gibba043.dnkmem (mgr.34373) 7410 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cephadm 2021-03-10T16:11:16.528420+0000 mgr.gibba043.dnkmem (mgr.34373) 7411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:17 gibba003 bash[32348]: cluster 2021-03-10T16:11:17.303223+0000 mgr.gibba043.dnkmem (mgr.34373) 7412 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.520380+0000 mgr.gibba043.dnkmem (mgr.34373) 7398 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.521876+0000 mgr.gibba043.dnkmem (mgr.34373) 7399 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.522849+0000 mgr.gibba043.dnkmem (mgr.34373) 7400 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.522886+0000 mgr.gibba043.dnkmem (mgr.34373) 7401 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.523851+0000 mgr.gibba043.dnkmem (mgr.34373) 7402 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.523890+0000 mgr.gibba043.dnkmem (mgr.34373) 7403 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.524771+0000 mgr.gibba043.dnkmem (mgr.34373) 7404 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.525879+0000 mgr.gibba043.dnkmem (mgr.34373) 7405 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.526061+0000 mgr.gibba043.dnkmem (mgr.34373) 7406 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.527084+0000 mgr.gibba043.dnkmem (mgr.34373) 7407 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.527535+0000 mgr.gibba043.dnkmem (mgr.34373) 7408 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.528251+0000 mgr.gibba043.dnkmem (mgr.34373) 7409 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.528301+0000 mgr.gibba043.dnkmem (mgr.34373) 7410 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cephadm 2021-03-10T16:11:16.528420+0000 mgr.gibba043.dnkmem (mgr.34373) 7411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:17 gibba043 bash[24019]: cluster 2021-03-10T16:11:17.303223+0000 mgr.gibba043.dnkmem (mgr.34373) 7412 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:19 gibba003 bash[31385]: cluster 2021-03-10T16:11:19.304990+0000 mgr.gibba043.dnkmem (mgr.34373) 7413 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:19 gibba003 bash[32348]: cluster 2021-03-10T16:11:19.304990+0000 mgr.gibba043.dnkmem (mgr.34373) 7413 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:19 gibba043 bash[24019]: cluster 2021-03-10T16:11:19.304990+0000 mgr.gibba043.dnkmem (mgr.34373) 7413 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:21.085 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:11:21.313 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:11:21.314 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:11:21.314 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:11:21.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:11:21.315 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:11:21.315 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:11:21.315 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:11:21.315 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:11:21.316 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:11:21.316 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:11:21.316 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:11:21.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:11:21.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:11:21.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:11:21.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:11:21.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:11:21.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:11:21.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:11:21.318 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:11:21.318 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:11:21.318 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:11:21.570 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:11:21.570 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:11:21.570 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:21.571 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:11:21.571 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:11:21.571 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:21.571 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:11:21.572 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:11:21.572 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:11:21.572 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:11:21.572 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:11:21.572 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:11:21.573 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:11:21.573 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:11:21.573 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:11:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[31385]: audit 2021-03-10T16:11:21.076892+0000 mgr.gibba043.dnkmem (mgr.34373) 7414 : audit [DBG] from='client.49020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[31385]: audit 2021-03-10T16:11:21.302614+0000 mgr.gibba043.dnkmem (mgr.34373) 7415 : audit [DBG] from='client.59014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[31385]: cluster 2021-03-10T16:11:21.306431+0000 mgr.gibba043.dnkmem (mgr.34373) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[31385]: audit 2021-03-10T16:11:21.572313+0000 mon.c (mon.1) 1921 : audit [DBG] from='client.? 172.21.2.103:0/3945645909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[32348]: audit 2021-03-10T16:11:21.076892+0000 mgr.gibba043.dnkmem (mgr.34373) 7414 : audit [DBG] from='client.49020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[32348]: audit 2021-03-10T16:11:21.302614+0000 mgr.gibba043.dnkmem (mgr.34373) 7415 : audit [DBG] from='client.59014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[32348]: cluster 2021-03-10T16:11:21.306431+0000 mgr.gibba043.dnkmem (mgr.34373) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:21 gibba003 bash[32348]: audit 2021-03-10T16:11:21.572313+0000 mon.c (mon.1) 1921 : audit [DBG] from='client.? 172.21.2.103:0/3945645909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:22.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:21 gibba043 bash[24019]: audit 2021-03-10T16:11:21.076892+0000 mgr.gibba043.dnkmem (mgr.34373) 7414 : audit [DBG] from='client.49020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:22.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:21 gibba043 bash[24019]: audit 2021-03-10T16:11:21.302614+0000 mgr.gibba043.dnkmem (mgr.34373) 7415 : audit [DBG] from='client.59014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:22.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:21 gibba043 bash[24019]: cluster 2021-03-10T16:11:21.306431+0000 mgr.gibba043.dnkmem (mgr.34373) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:22.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:21 gibba043 bash[24019]: audit 2021-03-10T16:11:21.572313+0000 mon.c (mon.1) 1921 : audit [DBG] from='client.? 172.21.2.103:0/3945645909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:23 gibba003 bash[31385]: cluster 2021-03-10T16:11:23.307699+0000 mgr.gibba043.dnkmem (mgr.34373) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:23 gibba003 bash[32348]: cluster 2021-03-10T16:11:23.307699+0000 mgr.gibba043.dnkmem (mgr.34373) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:23 gibba043 bash[24019]: cluster 2021-03-10T16:11:23.307699+0000 mgr.gibba043.dnkmem (mgr.34373) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:25.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:25 gibba003 bash[31385]: cluster 2021-03-10T16:11:25.309184+0000 mgr.gibba043.dnkmem (mgr.34373) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:25.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:25 gibba003 bash[32348]: cluster 2021-03-10T16:11:25.309184+0000 mgr.gibba043.dnkmem (mgr.34373) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:25 gibba043 bash[24019]: cluster 2021-03-10T16:11:25.309184+0000 mgr.gibba043.dnkmem (mgr.34373) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:27 gibba003 bash[31385]: cluster 2021-03-10T16:11:27.310548+0000 mgr.gibba043.dnkmem (mgr.34373) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:27 gibba003 bash[32348]: cluster 2021-03-10T16:11:27.310548+0000 mgr.gibba043.dnkmem (mgr.34373) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:27 gibba043 bash[24019]: cluster 2021-03-10T16:11:27.310548+0000 mgr.gibba043.dnkmem (mgr.34373) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:29 gibba003 bash[31385]: cluster 2021-03-10T16:11:29.312264+0000 mgr.gibba043.dnkmem (mgr.34373) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:29.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:29 gibba003 bash[32348]: cluster 2021-03-10T16:11:29.312264+0000 mgr.gibba043.dnkmem (mgr.34373) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:29 gibba043 bash[24019]: cluster 2021-03-10T16:11:29.312264+0000 mgr.gibba043.dnkmem (mgr.34373) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:31 gibba003 bash[31385]: cluster 2021-03-10T16:11:31.314011+0000 mgr.gibba043.dnkmem (mgr.34373) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:31 gibba003 bash[32348]: cluster 2021-03-10T16:11:31.314011+0000 mgr.gibba043.dnkmem (mgr.34373) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:31 gibba043 bash[24019]: cluster 2021-03-10T16:11:31.314011+0000 mgr.gibba043.dnkmem (mgr.34373) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:33.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:32 gibba003 bash[31385]: cephadm 2021-03-10T16:11:31.534148+0000 mgr.gibba043.dnkmem (mgr.34373) 7422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:33.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:32 gibba003 bash[32348]: cephadm 2021-03-10T16:11:31.534148+0000 mgr.gibba043.dnkmem (mgr.34373) 7422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:33.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:32 gibba043 bash[24019]: cephadm 2021-03-10T16:11:31.534148+0000 mgr.gibba043.dnkmem (mgr.34373) 7422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:33 gibba003 bash[31385]: cluster 2021-03-10T16:11:33.315515+0000 mgr.gibba043.dnkmem (mgr.34373) 7423 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:33 gibba003 bash[32348]: cluster 2021-03-10T16:11:33.315515+0000 mgr.gibba043.dnkmem (mgr.34373) 7423 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:33 gibba043 bash[24019]: cluster 2021-03-10T16:11:33.315515+0000 mgr.gibba043.dnkmem (mgr.34373) 7423 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:35 gibba003 bash[31385]: cluster 2021-03-10T16:11:35.317145+0000 mgr.gibba043.dnkmem (mgr.34373) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:35 gibba003 bash[32348]: cluster 2021-03-10T16:11:35.317145+0000 mgr.gibba043.dnkmem (mgr.34373) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:35 gibba043 bash[24019]: cluster 2021-03-10T16:11:35.317145+0000 mgr.gibba043.dnkmem (mgr.34373) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:37 gibba003 bash[31385]: cluster 2021-03-10T16:11:37.318531+0000 mgr.gibba043.dnkmem (mgr.34373) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:37.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:37 gibba003 bash[32348]: cluster 2021-03-10T16:11:37.318531+0000 mgr.gibba043.dnkmem (mgr.34373) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:37 gibba043 bash[24019]: cluster 2021-03-10T16:11:37.318531+0000 mgr.gibba043.dnkmem (mgr.34373) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:39 gibba003 bash[31385]: cluster 2021-03-10T16:11:39.320289+0000 mgr.gibba043.dnkmem (mgr.34373) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:39 gibba003 bash[32348]: cluster 2021-03-10T16:11:39.320289+0000 mgr.gibba043.dnkmem (mgr.34373) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:39 gibba043 bash[24019]: cluster 2021-03-10T16:11:39.320289+0000 mgr.gibba043.dnkmem (mgr.34373) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:41 gibba003 bash[31385]: cluster 2021-03-10T16:11:41.321994+0000 mgr.gibba043.dnkmem (mgr.34373) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:41 gibba003 bash[32348]: cluster 2021-03-10T16:11:41.321994+0000 mgr.gibba043.dnkmem (mgr.34373) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:41 gibba043 bash[24019]: cluster 2021-03-10T16:11:41.321994+0000 mgr.gibba043.dnkmem (mgr.34373) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:43 gibba003 bash[31385]: cluster 2021-03-10T16:11:43.323503+0000 mgr.gibba043.dnkmem (mgr.34373) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:43 gibba003 bash[32348]: cluster 2021-03-10T16:11:43.323503+0000 mgr.gibba043.dnkmem (mgr.34373) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:43 gibba043 bash[24019]: cluster 2021-03-10T16:11:43.323503+0000 mgr.gibba043.dnkmem (mgr.34373) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:45.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:45 gibba003 bash[31385]: cluster 2021-03-10T16:11:45.324889+0000 mgr.gibba043.dnkmem (mgr.34373) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:45 gibba003 bash[32348]: cluster 2021-03-10T16:11:45.324889+0000 mgr.gibba043.dnkmem (mgr.34373) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:45 gibba043 bash[24019]: cluster 2021-03-10T16:11:45.324889+0000 mgr.gibba043.dnkmem (mgr.34373) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:47 gibba003 bash[31385]: cephadm 2021-03-10T16:11:46.550025+0000 mgr.gibba043.dnkmem (mgr.34373) 7430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:47 gibba003 bash[31385]: cluster 2021-03-10T16:11:47.326742+0000 mgr.gibba043.dnkmem (mgr.34373) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:47 gibba003 bash[32348]: cephadm 2021-03-10T16:11:46.550025+0000 mgr.gibba043.dnkmem (mgr.34373) 7430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:47 gibba003 bash[32348]: cluster 2021-03-10T16:11:47.326742+0000 mgr.gibba043.dnkmem (mgr.34373) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:47 gibba043 bash[24019]: cephadm 2021-03-10T16:11:46.550025+0000 mgr.gibba043.dnkmem (mgr.34373) 7430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:11:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:47 gibba043 bash[24019]: cluster 2021-03-10T16:11:47.326742+0000 mgr.gibba043.dnkmem (mgr.34373) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:49 gibba003 bash[31385]: cluster 2021-03-10T16:11:49.328645+0000 mgr.gibba043.dnkmem (mgr.34373) 7432 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:49 gibba003 bash[32348]: cluster 2021-03-10T16:11:49.328645+0000 mgr.gibba043.dnkmem (mgr.34373) 7432 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:49 gibba043 bash[24019]: cluster 2021-03-10T16:11:49.328645+0000 mgr.gibba043.dnkmem (mgr.34373) 7432 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:51.819 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:11:52.047 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:11:52.048 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:11:52.048 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:11:52.048 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:11:52.048 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:11:52.049 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:11:52.049 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:11:52.049 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:11:52.049 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:11:52.050 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:11:52.050 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:11:52.050 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:11:52.050 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:11:52.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:11:52.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:11:52.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:11:52.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:11:52.051 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:11:52.052 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:11:52.052 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:11:52.052 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:11:52.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:51 gibba003 bash[31385]: cluster 2021-03-10T16:11:51.330415+0000 mgr.gibba043.dnkmem (mgr.34373) 7433 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:51 gibba003 bash[32348]: cluster 2021-03-10T16:11:51.330415+0000 mgr.gibba043.dnkmem (mgr.34373) 7433 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:51 gibba043 bash[24019]: cluster 2021-03-10T16:11:51.330415+0000 mgr.gibba043.dnkmem (mgr.34373) 7433 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.297 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:11:52.297 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:11:52.297 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:52.298 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:11:52.298 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:11:52.298 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:52.299 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:11:52.299 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:11:52.299 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:11:52.299 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:11:52.300 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:11:52.300 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:11:52.300 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:11:52.300 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:11:52.301 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:11:53.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:52 gibba003 bash[31385]: audit 2021-03-10T16:11:51.810400+0000 mgr.gibba043.dnkmem (mgr.34373) 7434 : audit [DBG] from='client.49038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:53.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:52 gibba003 bash[31385]: audit 2021-03-10T16:11:52.036260+0000 mgr.gibba043.dnkmem (mgr.34373) 7435 : audit [DBG] from='client.49044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:52 gibba003 bash[31385]: audit 2021-03-10T16:11:52.299264+0000 mon.c (mon.1) 1922 : audit [DBG] from='client.? 172.21.2.103:0/1746065128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:53.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:52 gibba003 bash[32348]: audit 2021-03-10T16:11:51.810400+0000 mgr.gibba043.dnkmem (mgr.34373) 7434 : audit [DBG] from='client.49038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:53.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:52 gibba003 bash[32348]: audit 2021-03-10T16:11:52.036260+0000 mgr.gibba043.dnkmem (mgr.34373) 7435 : audit [DBG] from='client.49044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:52 gibba003 bash[32348]: audit 2021-03-10T16:11:52.299264+0000 mon.c (mon.1) 1922 : audit [DBG] from='client.? 172.21.2.103:0/1746065128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:53.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:52 gibba043 bash[24019]: audit 2021-03-10T16:11:51.810400+0000 mgr.gibba043.dnkmem (mgr.34373) 7434 : audit [DBG] from='client.49038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:53.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:52 gibba043 bash[24019]: audit 2021-03-10T16:11:52.036260+0000 mgr.gibba043.dnkmem (mgr.34373) 7435 : audit [DBG] from='client.49044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:53.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:52 gibba043 bash[24019]: audit 2021-03-10T16:11:52.299264+0000 mon.c (mon.1) 1922 : audit [DBG] from='client.? 172.21.2.103:0/1746065128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:53 gibba003 bash[31385]: cluster 2021-03-10T16:11:53.331951+0000 mgr.gibba043.dnkmem (mgr.34373) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:54.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:53 gibba003 bash[32348]: cluster 2021-03-10T16:11:53.331951+0000 mgr.gibba043.dnkmem (mgr.34373) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:54.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:53 gibba043 bash[24019]: cluster 2021-03-10T16:11:53.331951+0000 mgr.gibba043.dnkmem (mgr.34373) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:55 gibba003 bash[31385]: cluster 2021-03-10T16:11:55.333258+0000 mgr.gibba043.dnkmem (mgr.34373) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:55 gibba003 bash[32348]: cluster 2021-03-10T16:11:55.333258+0000 mgr.gibba043.dnkmem (mgr.34373) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:55 gibba043 bash[24019]: cluster 2021-03-10T16:11:55.333258+0000 mgr.gibba043.dnkmem (mgr.34373) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:57 gibba003 bash[31385]: cluster 2021-03-10T16:11:57.334922+0000 mgr.gibba043.dnkmem (mgr.34373) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:57 gibba003 bash[32348]: cluster 2021-03-10T16:11:57.334922+0000 mgr.gibba043.dnkmem (mgr.34373) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:57 gibba043 bash[24019]: cluster 2021-03-10T16:11:57.334922+0000 mgr.gibba043.dnkmem (mgr.34373) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:11:59 gibba003 bash[31385]: cluster 2021-03-10T16:11:59.336773+0000 mgr.gibba043.dnkmem (mgr.34373) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:11:59 gibba003 bash[32348]: cluster 2021-03-10T16:11:59.336773+0000 mgr.gibba043.dnkmem (mgr.34373) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:11:59 gibba043 bash[24019]: cluster 2021-03-10T16:11:59.336773+0000 mgr.gibba043.dnkmem (mgr.34373) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:01 gibba003 bash[31385]: cluster 2021-03-10T16:12:01.338548+0000 mgr.gibba043.dnkmem (mgr.34373) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:01 gibba003 bash[32348]: cluster 2021-03-10T16:12:01.338548+0000 mgr.gibba043.dnkmem (mgr.34373) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:01 gibba043 bash[24019]: cluster 2021-03-10T16:12:01.338548+0000 mgr.gibba043.dnkmem (mgr.34373) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:03.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:02 gibba003 bash[31385]: cephadm 2021-03-10T16:12:01.552794+0000 mgr.gibba043.dnkmem (mgr.34373) 7441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:03.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:02 gibba003 bash[32348]: cephadm 2021-03-10T16:12:01.552794+0000 mgr.gibba043.dnkmem (mgr.34373) 7441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:03.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:02 gibba043 bash[24019]: cephadm 2021-03-10T16:12:01.552794+0000 mgr.gibba043.dnkmem (mgr.34373) 7441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:03 gibba003 bash[31385]: cluster 2021-03-10T16:12:03.340303+0000 mgr.gibba043.dnkmem (mgr.34373) 7442 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:04.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:03 gibba003 bash[32348]: cluster 2021-03-10T16:12:03.340303+0000 mgr.gibba043.dnkmem (mgr.34373) 7442 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:03 gibba043 bash[24019]: cluster 2021-03-10T16:12:03.340303+0000 mgr.gibba043.dnkmem (mgr.34373) 7442 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:05.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:05 gibba003 bash[31385]: cluster 2021-03-10T16:12:05.341557+0000 mgr.gibba043.dnkmem (mgr.34373) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:05.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:05 gibba003 bash[32348]: cluster 2021-03-10T16:12:05.341557+0000 mgr.gibba043.dnkmem (mgr.34373) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:05 gibba043 bash[24019]: cluster 2021-03-10T16:12:05.341557+0000 mgr.gibba043.dnkmem (mgr.34373) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:07 gibba003 bash[31385]: cluster 2021-03-10T16:12:07.343253+0000 mgr.gibba043.dnkmem (mgr.34373) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:07 gibba003 bash[32348]: cluster 2021-03-10T16:12:07.343253+0000 mgr.gibba043.dnkmem (mgr.34373) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:07 gibba043 bash[24019]: cluster 2021-03-10T16:12:07.343253+0000 mgr.gibba043.dnkmem (mgr.34373) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:09 gibba003 bash[31385]: cluster 2021-03-10T16:12:09.345065+0000 mgr.gibba043.dnkmem (mgr.34373) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:09 gibba003 bash[32348]: cluster 2021-03-10T16:12:09.345065+0000 mgr.gibba043.dnkmem (mgr.34373) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:09 gibba043 bash[24019]: cluster 2021-03-10T16:12:09.345065+0000 mgr.gibba043.dnkmem (mgr.34373) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:12.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:11 gibba003 bash[31385]: cluster 2021-03-10T16:12:11.346576+0000 mgr.gibba043.dnkmem (mgr.34373) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:12.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:11 gibba003 bash[32348]: cluster 2021-03-10T16:12:11.346576+0000 mgr.gibba043.dnkmem (mgr.34373) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:12.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:11 gibba043 bash[24019]: cluster 2021-03-10T16:12:11.346576+0000 mgr.gibba043.dnkmem (mgr.34373) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:13.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:13 gibba003 bash[31385]: cluster 2021-03-10T16:12:13.348164+0000 mgr.gibba043.dnkmem (mgr.34373) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:13.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:13 gibba003 bash[32348]: cluster 2021-03-10T16:12:13.348164+0000 mgr.gibba043.dnkmem (mgr.34373) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:13 gibba043 bash[24019]: cluster 2021-03-10T16:12:13.348164+0000 mgr.gibba043.dnkmem (mgr.34373) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.631340+0000 mon.c (mon.1) 1923 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.632416+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.803446+0000 mon.c (mon.1) 1924 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.804560+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.968014+0000 mon.c (mon.1) 1925 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:12:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.968863+0000 mon.c (mon.1) 1926 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.969351+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:12:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.969830+0000 mon.c (mon.1) 1927 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.970955+0000 mon.c (mon.1) 1928 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:12:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.971245+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.972791+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[31385]: audit 2021-03-10T16:12:13.973539+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:12:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.631340+0000 mon.c (mon.1) 1923 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.632416+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.803446+0000 mon.c (mon.1) 1924 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.804560+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.968014+0000 mon.c (mon.1) 1925 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:12:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.968863+0000 mon.c (mon.1) 1926 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.969351+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:12:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.969830+0000 mon.c (mon.1) 1927 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.970955+0000 mon.c (mon.1) 1928 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:12:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.971245+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.972791+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:14 gibba003 bash[32348]: audit 2021-03-10T16:12:13.973539+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:12:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.631340+0000 mon.c (mon.1) 1923 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.632416+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.803446+0000 mon.c (mon.1) 1924 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.804560+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.968014+0000 mon.c (mon.1) 1925 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:12:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.968863+0000 mon.c (mon.1) 1926 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.969351+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:12:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.969830+0000 mon.c (mon.1) 1927 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.970955+0000 mon.c (mon.1) 1928 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:12:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.971245+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.972791+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:12:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:14 gibba043 bash[24019]: audit 2021-03-10T16:12:13.973539+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:12:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:15 gibba043 bash[24019]: cluster 2021-03-10T16:12:15.349621+0000 mgr.gibba043.dnkmem (mgr.34373) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:15 gibba003 bash[31385]: cluster 2021-03-10T16:12:15.349621+0000 mgr.gibba043.dnkmem (mgr.34373) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:15 gibba003 bash[32348]: cluster 2021-03-10T16:12:15.349621+0000 mgr.gibba043.dnkmem (mgr.34373) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.557084+0000 mgr.gibba043.dnkmem (mgr.34373) 7449 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:12:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.558638+0000 mgr.gibba043.dnkmem (mgr.34373) 7450 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:12:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.767371+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:12:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.769167+0000 mgr.gibba043.dnkmem (mgr.34373) 7451 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:12:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.771047+0000 mgr.gibba043.dnkmem (mgr.34373) 7452 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:12:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.771239+0000 mon.c (mon.1) 1929 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.772708+0000 mgr.gibba043.dnkmem (mgr.34373) 7453 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:12:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.772755+0000 mgr.gibba043.dnkmem (mgr.34373) 7454 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:12:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.772899+0000 mon.c (mon.1) 1930 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.774240+0000 mgr.gibba043.dnkmem (mgr.34373) 7455 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:12:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.774287+0000 mgr.gibba043.dnkmem (mgr.34373) 7456 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:12:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.774640+0000 mon.c (mon.1) 1931 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.775711+0000 mgr.gibba043.dnkmem (mgr.34373) 7457 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:12:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.775998+0000 mon.c (mon.1) 1932 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.777401+0000 mgr.gibba043.dnkmem (mgr.34373) 7458 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:12:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.777445+0000 mgr.gibba043.dnkmem (mgr.34373) 7459 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:12:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.778930+0000 mgr.gibba043.dnkmem (mgr.34373) 7460 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:12:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.779314+0000 mgr.gibba043.dnkmem (mgr.34373) 7461 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:12:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.779326+0000 mon.c (mon.1) 1933 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.780486+0000 mgr.gibba043.dnkmem (mgr.34373) 7462 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:12:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.780535+0000 mgr.gibba043.dnkmem (mgr.34373) 7463 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:12:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cephadm 2021-03-10T16:12:16.780655+0000 mgr.gibba043.dnkmem (mgr.34373) 7464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: audit 2021-03-10T16:12:16.781023+0000 mon.c (mon.1) 1934 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[31385]: cluster 2021-03-10T16:12:17.351151+0000 mgr.gibba043.dnkmem (mgr.34373) 7465 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:18.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.557084+0000 mgr.gibba043.dnkmem (mgr.34373) 7449 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:12:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.558638+0000 mgr.gibba043.dnkmem (mgr.34373) 7450 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:12:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.767371+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:12:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.769167+0000 mgr.gibba043.dnkmem (mgr.34373) 7451 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:12:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.771047+0000 mgr.gibba043.dnkmem (mgr.34373) 7452 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:12:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.771239+0000 mon.c (mon.1) 1929 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.772708+0000 mgr.gibba043.dnkmem (mgr.34373) 7453 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:12:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.772755+0000 mgr.gibba043.dnkmem (mgr.34373) 7454 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:12:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.772899+0000 mon.c (mon.1) 1930 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.774240+0000 mgr.gibba043.dnkmem (mgr.34373) 7455 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:12:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.774287+0000 mgr.gibba043.dnkmem (mgr.34373) 7456 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:12:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.774640+0000 mon.c (mon.1) 1931 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.775711+0000 mgr.gibba043.dnkmem (mgr.34373) 7457 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:12:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.775998+0000 mon.c (mon.1) 1932 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.777401+0000 mgr.gibba043.dnkmem (mgr.34373) 7458 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:12:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.777445+0000 mgr.gibba043.dnkmem (mgr.34373) 7459 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:12:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.778930+0000 mgr.gibba043.dnkmem (mgr.34373) 7460 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:12:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.779314+0000 mgr.gibba043.dnkmem (mgr.34373) 7461 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:12:18.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.779326+0000 mon.c (mon.1) 1933 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.780486+0000 mgr.gibba043.dnkmem (mgr.34373) 7462 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:12:18.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.780535+0000 mgr.gibba043.dnkmem (mgr.34373) 7463 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:12:18.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cephadm 2021-03-10T16:12:16.780655+0000 mgr.gibba043.dnkmem (mgr.34373) 7464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: audit 2021-03-10T16:12:16.781023+0000 mon.c (mon.1) 1934 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:17 gibba003 bash[32348]: cluster 2021-03-10T16:12:17.351151+0000 mgr.gibba043.dnkmem (mgr.34373) 7465 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.557084+0000 mgr.gibba043.dnkmem (mgr.34373) 7449 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:12:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.558638+0000 mgr.gibba043.dnkmem (mgr.34373) 7450 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:12:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.767371+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:12:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.769167+0000 mgr.gibba043.dnkmem (mgr.34373) 7451 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:12:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.771047+0000 mgr.gibba043.dnkmem (mgr.34373) 7452 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:12:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.771239+0000 mon.c (mon.1) 1929 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.772708+0000 mgr.gibba043.dnkmem (mgr.34373) 7453 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:12:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.772755+0000 mgr.gibba043.dnkmem (mgr.34373) 7454 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:12:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.772899+0000 mon.c (mon.1) 1930 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.774240+0000 mgr.gibba043.dnkmem (mgr.34373) 7455 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:12:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.774287+0000 mgr.gibba043.dnkmem (mgr.34373) 7456 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:12:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.774640+0000 mon.c (mon.1) 1931 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.775711+0000 mgr.gibba043.dnkmem (mgr.34373) 7457 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:12:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.775998+0000 mon.c (mon.1) 1932 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.777401+0000 mgr.gibba043.dnkmem (mgr.34373) 7458 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:12:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.777445+0000 mgr.gibba043.dnkmem (mgr.34373) 7459 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:12:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.778930+0000 mgr.gibba043.dnkmem (mgr.34373) 7460 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:12:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.779314+0000 mgr.gibba043.dnkmem (mgr.34373) 7461 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:12:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.779326+0000 mon.c (mon.1) 1933 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.780486+0000 mgr.gibba043.dnkmem (mgr.34373) 7462 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:12:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.780535+0000 mgr.gibba043.dnkmem (mgr.34373) 7463 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:12:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cephadm 2021-03-10T16:12:16.780655+0000 mgr.gibba043.dnkmem (mgr.34373) 7464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: audit 2021-03-10T16:12:16.781023+0000 mon.c (mon.1) 1934 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:17 gibba043 bash[24019]: cluster 2021-03-10T16:12:17.351151+0000 mgr.gibba043.dnkmem (mgr.34373) 7465 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:19 gibba003 bash[31385]: cluster 2021-03-10T16:12:19.352927+0000 mgr.gibba043.dnkmem (mgr.34373) 7466 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:19 gibba003 bash[32348]: cluster 2021-03-10T16:12:19.352927+0000 mgr.gibba043.dnkmem (mgr.34373) 7466 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:19 gibba043 bash[24019]: cluster 2021-03-10T16:12:19.352927+0000 mgr.gibba043.dnkmem (mgr.34373) 7466 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:21 gibba003 bash[31385]: cluster 2021-03-10T16:12:21.354550+0000 mgr.gibba043.dnkmem (mgr.34373) 7467 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:21 gibba003 bash[32348]: cluster 2021-03-10T16:12:21.354550+0000 mgr.gibba043.dnkmem (mgr.34373) 7467 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:21 gibba043 bash[24019]: cluster 2021-03-10T16:12:21.354550+0000 mgr.gibba043.dnkmem (mgr.34373) 7467 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.540 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:12:22.765 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:12:22.766 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:12:22.766 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:12:22.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:12:22.767 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:12:22.767 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:12:22.767 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:12:22.767 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:12:22.768 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:12:22.768 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:12:22.768 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:12:22.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:12:22.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:12:22.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:12:22.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:12:22.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:12:22.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:12:22.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:12:22.770 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:12:22.771 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:12:22.771 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:12:23.015 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:12:23.015 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:12:23.015 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:23.016 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:12:23.016 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:12:23.016 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:23.016 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:12:23.017 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:12:23.017 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:12:23.017 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:12:23.017 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:12:23.017 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:12:23.018 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:12:23.018 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:12:23.018 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:12:23.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:23 gibba003 bash[31385]: audit 2021-03-10T16:12:23.016998+0000 mon.c (mon.1) 1935 : audit [DBG] from='client.? 172.21.2.103:0/3346909980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:23.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:23 gibba003 bash[32348]: audit 2021-03-10T16:12:23.016998+0000 mon.c (mon.1) 1935 : audit [DBG] from='client.? 172.21.2.103:0/3346909980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:23 gibba043 bash[24019]: audit 2021-03-10T16:12:23.016998+0000 mon.c (mon.1) 1935 : audit [DBG] from='client.? 172.21.2.103:0/3346909980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:24 gibba003 bash[31385]: audit 2021-03-10T16:12:22.532401+0000 mgr.gibba043.dnkmem (mgr.34373) 7468 : audit [DBG] from='client.59044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:24 gibba003 bash[31385]: audit 2021-03-10T16:12:22.754494+0000 mgr.gibba043.dnkmem (mgr.34373) 7469 : audit [DBG] from='client.59050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:24 gibba003 bash[31385]: cluster 2021-03-10T16:12:23.356253+0000 mgr.gibba043.dnkmem (mgr.34373) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:24 gibba003 bash[32348]: audit 2021-03-10T16:12:22.532401+0000 mgr.gibba043.dnkmem (mgr.34373) 7468 : audit [DBG] from='client.59044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:24 gibba003 bash[32348]: audit 2021-03-10T16:12:22.754494+0000 mgr.gibba043.dnkmem (mgr.34373) 7469 : audit [DBG] from='client.59050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:24.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:24 gibba003 bash[32348]: cluster 2021-03-10T16:12:23.356253+0000 mgr.gibba043.dnkmem (mgr.34373) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:24.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:24 gibba043 bash[24019]: audit 2021-03-10T16:12:22.532401+0000 mgr.gibba043.dnkmem (mgr.34373) 7468 : audit [DBG] from='client.59044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:24 gibba043 bash[24019]: audit 2021-03-10T16:12:22.754494+0000 mgr.gibba043.dnkmem (mgr.34373) 7469 : audit [DBG] from='client.59050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:24 gibba043 bash[24019]: cluster 2021-03-10T16:12:23.356253+0000 mgr.gibba043.dnkmem (mgr.34373) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:25.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:25 gibba003 bash[31385]: cluster 2021-03-10T16:12:25.357446+0000 mgr.gibba043.dnkmem (mgr.34373) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:25.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:25 gibba003 bash[32348]: cluster 2021-03-10T16:12:25.357446+0000 mgr.gibba043.dnkmem (mgr.34373) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:25 gibba043 bash[24019]: cluster 2021-03-10T16:12:25.357446+0000 mgr.gibba043.dnkmem (mgr.34373) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:27 gibba003 bash[31385]: cluster 2021-03-10T16:12:27.359190+0000 mgr.gibba043.dnkmem (mgr.34373) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:27 gibba003 bash[32348]: cluster 2021-03-10T16:12:27.359190+0000 mgr.gibba043.dnkmem (mgr.34373) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:27 gibba043 bash[24019]: cluster 2021-03-10T16:12:27.359190+0000 mgr.gibba043.dnkmem (mgr.34373) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:29 gibba003 bash[31385]: cluster 2021-03-10T16:12:29.360895+0000 mgr.gibba043.dnkmem (mgr.34373) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:29 gibba003 bash[32348]: cluster 2021-03-10T16:12:29.360895+0000 mgr.gibba043.dnkmem (mgr.34373) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:29 gibba043 bash[24019]: cluster 2021-03-10T16:12:29.360895+0000 mgr.gibba043.dnkmem (mgr.34373) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:32.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:31 gibba003 bash[31385]: cluster 2021-03-10T16:12:31.362674+0000 mgr.gibba043.dnkmem (mgr.34373) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:31 gibba003 bash[32348]: cluster 2021-03-10T16:12:31.362674+0000 mgr.gibba043.dnkmem (mgr.34373) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:32.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:31 gibba043 bash[24019]: cluster 2021-03-10T16:12:31.362674+0000 mgr.gibba043.dnkmem (mgr.34373) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:33.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:32 gibba003 bash[31385]: cephadm 2021-03-10T16:12:31.796583+0000 mgr.gibba043.dnkmem (mgr.34373) 7475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:33.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:32 gibba003 bash[32348]: cephadm 2021-03-10T16:12:31.796583+0000 mgr.gibba043.dnkmem (mgr.34373) 7475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:33.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:32 gibba043 bash[24019]: cephadm 2021-03-10T16:12:31.796583+0000 mgr.gibba043.dnkmem (mgr.34373) 7475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:33 gibba003 bash[31385]: cluster 2021-03-10T16:12:33.364255+0000 mgr.gibba043.dnkmem (mgr.34373) 7476 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:34.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:33 gibba003 bash[32348]: cluster 2021-03-10T16:12:33.364255+0000 mgr.gibba043.dnkmem (mgr.34373) 7476 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:34.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:33 gibba043 bash[24019]: cluster 2021-03-10T16:12:33.364255+0000 mgr.gibba043.dnkmem (mgr.34373) 7476 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:35 gibba003 bash[31385]: cluster 2021-03-10T16:12:35.365827+0000 mgr.gibba043.dnkmem (mgr.34373) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:35 gibba003 bash[32348]: cluster 2021-03-10T16:12:35.365827+0000 mgr.gibba043.dnkmem (mgr.34373) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:35 gibba043 bash[24019]: cluster 2021-03-10T16:12:35.365827+0000 mgr.gibba043.dnkmem (mgr.34373) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:37 gibba003 bash[31385]: cluster 2021-03-10T16:12:37.367481+0000 mgr.gibba043.dnkmem (mgr.34373) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:37.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:37 gibba003 bash[32348]: cluster 2021-03-10T16:12:37.367481+0000 mgr.gibba043.dnkmem (mgr.34373) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:37 gibba043 bash[24019]: cluster 2021-03-10T16:12:37.367481+0000 mgr.gibba043.dnkmem (mgr.34373) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:39 gibba003 bash[31385]: cluster 2021-03-10T16:12:39.369335+0000 mgr.gibba043.dnkmem (mgr.34373) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:39 gibba003 bash[32348]: cluster 2021-03-10T16:12:39.369335+0000 mgr.gibba043.dnkmem (mgr.34373) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:39 gibba043 bash[24019]: cluster 2021-03-10T16:12:39.369335+0000 mgr.gibba043.dnkmem (mgr.34373) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:42.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:41 gibba003 bash[31385]: cluster 2021-03-10T16:12:41.370818+0000 mgr.gibba043.dnkmem (mgr.34373) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:41 gibba003 bash[32348]: cluster 2021-03-10T16:12:41.370818+0000 mgr.gibba043.dnkmem (mgr.34373) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:41 gibba043 bash[24019]: cluster 2021-03-10T16:12:41.370818+0000 mgr.gibba043.dnkmem (mgr.34373) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:43 gibba003 bash[31385]: cluster 2021-03-10T16:12:43.372483+0000 mgr.gibba043.dnkmem (mgr.34373) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:43 gibba003 bash[32348]: cluster 2021-03-10T16:12:43.372483+0000 mgr.gibba043.dnkmem (mgr.34373) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:43 gibba043 bash[24019]: cluster 2021-03-10T16:12:43.372483+0000 mgr.gibba043.dnkmem (mgr.34373) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:45.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:45 gibba003 bash[31385]: cluster 2021-03-10T16:12:45.373684+0000 mgr.gibba043.dnkmem (mgr.34373) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:45 gibba003 bash[32348]: cluster 2021-03-10T16:12:45.373684+0000 mgr.gibba043.dnkmem (mgr.34373) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:45 gibba043 bash[24019]: cluster 2021-03-10T16:12:45.373684+0000 mgr.gibba043.dnkmem (mgr.34373) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:47 gibba043 bash[24019]: cephadm 2021-03-10T16:12:46.808424+0000 mgr.gibba043.dnkmem (mgr.34373) 7483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:47 gibba043 bash[24019]: cluster 2021-03-10T16:12:47.375249+0000 mgr.gibba043.dnkmem (mgr.34373) 7484 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:47 gibba003 bash[31385]: cephadm 2021-03-10T16:12:46.808424+0000 mgr.gibba043.dnkmem (mgr.34373) 7483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:47 gibba003 bash[31385]: cluster 2021-03-10T16:12:47.375249+0000 mgr.gibba043.dnkmem (mgr.34373) 7484 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:47 gibba003 bash[32348]: cephadm 2021-03-10T16:12:46.808424+0000 mgr.gibba043.dnkmem (mgr.34373) 7483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:12:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:47 gibba003 bash[32348]: cluster 2021-03-10T16:12:47.375249+0000 mgr.gibba043.dnkmem (mgr.34373) 7484 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:49 gibba043 bash[24019]: cluster 2021-03-10T16:12:49.376754+0000 mgr.gibba043.dnkmem (mgr.34373) 7485 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:49 gibba003 bash[31385]: cluster 2021-03-10T16:12:49.376754+0000 mgr.gibba043.dnkmem (mgr.34373) 7485 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:49 gibba003 bash[32348]: cluster 2021-03-10T16:12:49.376754+0000 mgr.gibba043.dnkmem (mgr.34373) 7485 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:52.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:51 gibba003 bash[31385]: cluster 2021-03-10T16:12:51.378426+0000 mgr.gibba043.dnkmem (mgr.34373) 7486 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:52.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:51 gibba003 bash[32348]: cluster 2021-03-10T16:12:51.378426+0000 mgr.gibba043.dnkmem (mgr.34373) 7486 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:52.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:51 gibba043 bash[24019]: cluster 2021-03-10T16:12:51.378426+0000 mgr.gibba043.dnkmem (mgr.34373) 7486 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:53.255 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:12:53.510 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:12:53.510 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:12:53.510 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:12:53.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:12:53.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:12:53.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:12:53.511 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:12:53.512 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:12:53.512 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:12:53.512 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:12:53.512 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:12:53.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:12:53.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:12:53.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:12:53.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:12:53.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:12:53.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:12:53.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:12:53.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:12:53.515 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:12:53.515 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:12:53.758 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:12:53.759 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:12:53.759 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:53.760 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:12:53.760 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:12:53.761 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:53.761 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:12:53.761 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:12:53.762 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:12:53.762 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:12:53.763 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:12:53.763 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:12:53.764 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:12:53.764 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:12:53.765 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:12:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:53 gibba043 bash[24019]: audit 2021-03-10T16:12:53.246662+0000 mgr.gibba043.dnkmem (mgr.34373) 7487 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:53 gibba043 bash[24019]: cluster 2021-03-10T16:12:53.380007+0000 mgr.gibba043.dnkmem (mgr.34373) 7488 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:53 gibba003 bash[31385]: audit 2021-03-10T16:12:53.246662+0000 mgr.gibba043.dnkmem (mgr.34373) 7487 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:53 gibba003 bash[31385]: cluster 2021-03-10T16:12:53.380007+0000 mgr.gibba043.dnkmem (mgr.34373) 7488 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:53 gibba003 bash[32348]: audit 2021-03-10T16:12:53.246662+0000 mgr.gibba043.dnkmem (mgr.34373) 7487 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:53 gibba003 bash[32348]: cluster 2021-03-10T16:12:53.380007+0000 mgr.gibba043.dnkmem (mgr.34373) 7488 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:54 gibba043 bash[24019]: audit 2021-03-10T16:12:53.472622+0000 mgr.gibba043.dnkmem (mgr.34373) 7489 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:54.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:54 gibba043 bash[24019]: audit 2021-03-10T16:12:53.760635+0000 mon.c (mon.1) 1936 : audit [DBG] from='client.? 172.21.2.103:0/2676129472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:54.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:54 gibba003 bash[31385]: audit 2021-03-10T16:12:53.472622+0000 mgr.gibba043.dnkmem (mgr.34373) 7489 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:54.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:54 gibba003 bash[31385]: audit 2021-03-10T16:12:53.760635+0000 mon.c (mon.1) 1936 : audit [DBG] from='client.? 172.21.2.103:0/2676129472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:54.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:54 gibba003 bash[32348]: audit 2021-03-10T16:12:53.472622+0000 mgr.gibba043.dnkmem (mgr.34373) 7489 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:54.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:54 gibba003 bash[32348]: audit 2021-03-10T16:12:53.760635+0000 mon.c (mon.1) 1936 : audit [DBG] from='client.? 172.21.2.103:0/2676129472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:55 gibba043 bash[24019]: cluster 2021-03-10T16:12:55.381273+0000 mgr.gibba043.dnkmem (mgr.34373) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:55.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:55 gibba003 bash[31385]: cluster 2021-03-10T16:12:55.381273+0000 mgr.gibba043.dnkmem (mgr.34373) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:55.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:55 gibba003 bash[32348]: cluster 2021-03-10T16:12:55.381273+0000 mgr.gibba043.dnkmem (mgr.34373) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:57 gibba043 bash[24019]: cluster 2021-03-10T16:12:57.382803+0000 mgr.gibba043.dnkmem (mgr.34373) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:57 gibba003 bash[31385]: cluster 2021-03-10T16:12:57.382803+0000 mgr.gibba043.dnkmem (mgr.34373) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:57.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:57 gibba003 bash[32348]: cluster 2021-03-10T16:12:57.382803+0000 mgr.gibba043.dnkmem (mgr.34373) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:12:59 gibba043 bash[24019]: cluster 2021-03-10T16:12:59.384689+0000 mgr.gibba043.dnkmem (mgr.34373) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:12:59 gibba003 bash[31385]: cluster 2021-03-10T16:12:59.384689+0000 mgr.gibba043.dnkmem (mgr.34373) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:12:59 gibba003 bash[32348]: cluster 2021-03-10T16:12:59.384689+0000 mgr.gibba043.dnkmem (mgr.34373) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:01 gibba003 bash[31385]: cluster 2021-03-10T16:13:01.386205+0000 mgr.gibba043.dnkmem (mgr.34373) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:01 gibba003 bash[32348]: cluster 2021-03-10T16:13:01.386205+0000 mgr.gibba043.dnkmem (mgr.34373) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:01 gibba043 bash[24019]: cluster 2021-03-10T16:13:01.386205+0000 mgr.gibba043.dnkmem (mgr.34373) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:03.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:02 gibba003 bash[31385]: cephadm 2021-03-10T16:13:01.824497+0000 mgr.gibba043.dnkmem (mgr.34373) 7494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:03.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:02 gibba003 bash[32348]: cephadm 2021-03-10T16:13:01.824497+0000 mgr.gibba043.dnkmem (mgr.34373) 7494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:03.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:02 gibba043 bash[24019]: cephadm 2021-03-10T16:13:01.824497+0000 mgr.gibba043.dnkmem (mgr.34373) 7494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:04.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:03 gibba003 bash[31385]: cluster 2021-03-10T16:13:03.387792+0000 mgr.gibba043.dnkmem (mgr.34373) 7495 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:04.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:03 gibba003 bash[32348]: cluster 2021-03-10T16:13:03.387792+0000 mgr.gibba043.dnkmem (mgr.34373) 7495 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:03 gibba043 bash[24019]: cluster 2021-03-10T16:13:03.387792+0000 mgr.gibba043.dnkmem (mgr.34373) 7495 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:05 gibba043 bash[24019]: cluster 2021-03-10T16:13:05.389268+0000 mgr.gibba043.dnkmem (mgr.34373) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:05 gibba003 bash[31385]: cluster 2021-03-10T16:13:05.389268+0000 mgr.gibba043.dnkmem (mgr.34373) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:05 gibba003 bash[32348]: cluster 2021-03-10T16:13:05.389268+0000 mgr.gibba043.dnkmem (mgr.34373) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:07 gibba043 bash[24019]: cluster 2021-03-10T16:13:07.390983+0000 mgr.gibba043.dnkmem (mgr.34373) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:07 gibba003 bash[31385]: cluster 2021-03-10T16:13:07.390983+0000 mgr.gibba043.dnkmem (mgr.34373) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:07 gibba003 bash[32348]: cluster 2021-03-10T16:13:07.390983+0000 mgr.gibba043.dnkmem (mgr.34373) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:09 gibba043 bash[24019]: cluster 2021-03-10T16:13:09.392784+0000 mgr.gibba043.dnkmem (mgr.34373) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:09 gibba003 bash[31385]: cluster 2021-03-10T16:13:09.392784+0000 mgr.gibba043.dnkmem (mgr.34373) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:09 gibba003 bash[32348]: cluster 2021-03-10T16:13:09.392784+0000 mgr.gibba043.dnkmem (mgr.34373) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:11 gibba003 bash[31385]: cluster 2021-03-10T16:13:11.394550+0000 mgr.gibba043.dnkmem (mgr.34373) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:11 gibba003 bash[32348]: cluster 2021-03-10T16:13:11.394550+0000 mgr.gibba043.dnkmem (mgr.34373) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:11 gibba043 bash[24019]: cluster 2021-03-10T16:13:11.394550+0000 mgr.gibba043.dnkmem (mgr.34373) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:13 gibba043 bash[24019]: cluster 2021-03-10T16:13:13.396129+0000 mgr.gibba043.dnkmem (mgr.34373) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:13 gibba003 bash[31385]: cluster 2021-03-10T16:13:13.396129+0000 mgr.gibba043.dnkmem (mgr.34373) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:13 gibba003 bash[32348]: cluster 2021-03-10T16:13:13.396129+0000 mgr.gibba043.dnkmem (mgr.34373) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.637708+0000 mon.c (mon.1) 1937 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.638956+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.811524+0000 mon.c (mon.1) 1938 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.812791+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.978643+0000 mon.c (mon.1) 1939 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:13:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.979490+0000 mon.c (mon.1) 1940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.980098+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:13:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.980186+0000 mon.c (mon.1) 1941 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.980866+0000 mon.c (mon.1) 1942 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.982762+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.984057+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:14 gibba043 bash[24019]: audit 2021-03-10T16:13:13.985387+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.637708+0000 mon.c (mon.1) 1937 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.638956+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.811524+0000 mon.c (mon.1) 1938 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.812791+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.978643+0000 mon.c (mon.1) 1939 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:13:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.979490+0000 mon.c (mon.1) 1940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.980098+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:13:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.980186+0000 mon.c (mon.1) 1941 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.980866+0000 mon.c (mon.1) 1942 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.982762+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.984057+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[31385]: audit 2021-03-10T16:13:13.985387+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.637708+0000 mon.c (mon.1) 1937 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.638956+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.811524+0000 mon.c (mon.1) 1938 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.812791+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.978643+0000 mon.c (mon.1) 1939 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:13:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.979490+0000 mon.c (mon.1) 1940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.980098+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:13:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.980186+0000 mon.c (mon.1) 1941 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.980866+0000 mon.c (mon.1) 1942 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.982762+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.984057+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:14 gibba003 bash[32348]: audit 2021-03-10T16:13:13.985387+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:13:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:15 gibba043 bash[24019]: cluster 2021-03-10T16:13:15.397397+0000 mgr.gibba043.dnkmem (mgr.34373) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:15 gibba003 bash[31385]: cluster 2021-03-10T16:13:15.397397+0000 mgr.gibba043.dnkmem (mgr.34373) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:15 gibba003 bash[32348]: cluster 2021-03-10T16:13:15.397397+0000 mgr.gibba043.dnkmem (mgr.34373) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:16.841327+0000 mgr.gibba043.dnkmem (mgr.34373) 7502 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:13:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:16.842888+0000 mgr.gibba043.dnkmem (mgr.34373) 7503 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:13:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.126352+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:13:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.127988+0000 mgr.gibba043.dnkmem (mgr.34373) 7504 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.130243+0000 mon.c (mon.1) 1943 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.130589+0000 mgr.gibba043.dnkmem (mgr.34373) 7505 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.132526+0000 mon.c (mon.1) 1944 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.132834+0000 mgr.gibba043.dnkmem (mgr.34373) 7506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.132871+0000 mgr.gibba043.dnkmem (mgr.34373) 7507 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.134795+0000 mon.c (mon.1) 1945 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.134928+0000 mgr.gibba043.dnkmem (mgr.34373) 7508 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.134969+0000 mgr.gibba043.dnkmem (mgr.34373) 7509 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.136890+0000 mon.c (mon.1) 1946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.137140+0000 mgr.gibba043.dnkmem (mgr.34373) 7510 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.140276+0000 mgr.gibba043.dnkmem (mgr.34373) 7511 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.140312+0000 mgr.gibba043.dnkmem (mgr.34373) 7512 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.142155+0000 mgr.gibba043.dnkmem (mgr.34373) 7513 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.142217+0000 mon.c (mon.1) 1947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.142471+0000 mgr.gibba043.dnkmem (mgr.34373) 7514 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: audit 2021-03-10T16:13:17.144266+0000 mon.c (mon.1) 1948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.144383+0000 mgr.gibba043.dnkmem (mgr.34373) 7515 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:16.841327+0000 mgr.gibba043.dnkmem (mgr.34373) 7502 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:13:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:16.842888+0000 mgr.gibba043.dnkmem (mgr.34373) 7503 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:13:18.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.126352+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:13:18.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.127988+0000 mgr.gibba043.dnkmem (mgr.34373) 7504 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:18.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.130243+0000 mon.c (mon.1) 1943 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:18.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.130589+0000 mgr.gibba043.dnkmem (mgr.34373) 7505 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:18.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.132526+0000 mon.c (mon.1) 1944 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.132834+0000 mgr.gibba043.dnkmem (mgr.34373) 7506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:18.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.132871+0000 mgr.gibba043.dnkmem (mgr.34373) 7507 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:18.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.134795+0000 mon.c (mon.1) 1945 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.134928+0000 mgr.gibba043.dnkmem (mgr.34373) 7508 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.134969+0000 mgr.gibba043.dnkmem (mgr.34373) 7509 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.136890+0000 mon.c (mon.1) 1946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.137140+0000 mgr.gibba043.dnkmem (mgr.34373) 7510 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.140276+0000 mgr.gibba043.dnkmem (mgr.34373) 7511 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.140312+0000 mgr.gibba043.dnkmem (mgr.34373) 7512 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.142155+0000 mgr.gibba043.dnkmem (mgr.34373) 7513 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.142217+0000 mon.c (mon.1) 1947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.142471+0000 mgr.gibba043.dnkmem (mgr.34373) 7514 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: audit 2021-03-10T16:13:17.144266+0000 mon.c (mon.1) 1948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.144383+0000 mgr.gibba043.dnkmem (mgr.34373) 7515 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.144422+0000 mgr.gibba043.dnkmem (mgr.34373) 7516 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cephadm 2021-03-10T16:13:17.144593+0000 mgr.gibba043.dnkmem (mgr.34373) 7517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:18.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[32348]: cluster 2021-03-10T16:13:17.398918+0000 mgr.gibba043.dnkmem (mgr.34373) 7518 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.144422+0000 mgr.gibba043.dnkmem (mgr.34373) 7516 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:18.451 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cephadm 2021-03-10T16:13:17.144593+0000 mgr.gibba043.dnkmem (mgr.34373) 7517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:18.452 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:18 gibba003 bash[31385]: cluster 2021-03-10T16:13:17.398918+0000 mgr.gibba043.dnkmem (mgr.34373) 7518 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:16.841327+0000 mgr.gibba043.dnkmem (mgr.34373) 7502 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:13:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:16.842888+0000 mgr.gibba043.dnkmem (mgr.34373) 7503 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:13:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.126352+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:13:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.127988+0000 mgr.gibba043.dnkmem (mgr.34373) 7504 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.130243+0000 mon.c (mon.1) 1943 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.130589+0000 mgr.gibba043.dnkmem (mgr.34373) 7505 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.132526+0000 mon.c (mon.1) 1944 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.132834+0000 mgr.gibba043.dnkmem (mgr.34373) 7506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.132871+0000 mgr.gibba043.dnkmem (mgr.34373) 7507 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.134795+0000 mon.c (mon.1) 1945 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.134928+0000 mgr.gibba043.dnkmem (mgr.34373) 7508 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.134969+0000 mgr.gibba043.dnkmem (mgr.34373) 7509 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.136890+0000 mon.c (mon.1) 1946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.137140+0000 mgr.gibba043.dnkmem (mgr.34373) 7510 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.140276+0000 mgr.gibba043.dnkmem (mgr.34373) 7511 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.140312+0000 mgr.gibba043.dnkmem (mgr.34373) 7512 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.142155+0000 mgr.gibba043.dnkmem (mgr.34373) 7513 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.142217+0000 mon.c (mon.1) 1947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.142471+0000 mgr.gibba043.dnkmem (mgr.34373) 7514 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: audit 2021-03-10T16:13:17.144266+0000 mon.c (mon.1) 1948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.144383+0000 mgr.gibba043.dnkmem (mgr.34373) 7515 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.144422+0000 mgr.gibba043.dnkmem (mgr.34373) 7516 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:18.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cephadm 2021-03-10T16:13:17.144593+0000 mgr.gibba043.dnkmem (mgr.34373) 7517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:18.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:18 gibba043 bash[24019]: cluster 2021-03-10T16:13:17.398918+0000 mgr.gibba043.dnkmem (mgr.34373) 7518 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:20 gibba043 bash[24019]: cluster 2021-03-10T16:13:19.400729+0000 mgr.gibba043.dnkmem (mgr.34373) 7519 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:20 gibba003 bash[31385]: cluster 2021-03-10T16:13:19.400729+0000 mgr.gibba043.dnkmem (mgr.34373) 7519 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:20 gibba003 bash[32348]: cluster 2021-03-10T16:13:19.400729+0000 mgr.gibba043.dnkmem (mgr.34373) 7519 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:23.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:22 gibba003 bash[31385]: cluster 2021-03-10T16:13:21.402323+0000 mgr.gibba043.dnkmem (mgr.34373) 7520 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:23.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:22 gibba003 bash[32348]: cluster 2021-03-10T16:13:21.402323+0000 mgr.gibba043.dnkmem (mgr.34373) 7520 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:23.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:22 gibba043 bash[24019]: cluster 2021-03-10T16:13:21.402323+0000 mgr.gibba043.dnkmem (mgr.34373) 7520 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:24.001 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:13:24.227 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:13:24.227 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:13:24.227 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:13:24.228 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:13:24.228 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:13:24.228 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:13:24.228 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:13:24.229 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:13:24.229 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:13:24.229 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:13:24.229 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:13:24.229 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:13:24.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:13:24.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:13:24.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:13:24.230 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:13:24.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:13:24.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:13:24.231 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:13:24.231 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:13:24.232 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:13:24.474 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:13:24.474 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:13:24.475 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:24.475 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:13:24.475 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:13:24.475 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:24.476 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:13:24.476 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:13:24.476 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:13:24.476 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:13:24.476 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:13:24.477 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:13:24.477 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:13:24.477 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:13:24.477 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:13:25.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[31385]: cluster 2021-03-10T16:13:23.403722+0000 mgr.gibba043.dnkmem (mgr.34373) 7521 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:25.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[31385]: audit 2021-03-10T16:13:23.993267+0000 mgr.gibba043.dnkmem (mgr.34373) 7522 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:25.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[31385]: audit 2021-03-10T16:13:24.215606+0000 mgr.gibba043.dnkmem (mgr.34373) 7523 : audit [DBG] from='client.49098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[31385]: audit 2021-03-10T16:13:24.476600+0000 mon.a (mon.0) 1652 : audit [DBG] from='client.? 172.21.2.103:0/3216961697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[32348]: cluster 2021-03-10T16:13:23.403722+0000 mgr.gibba043.dnkmem (mgr.34373) 7521 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[32348]: audit 2021-03-10T16:13:23.993267+0000 mgr.gibba043.dnkmem (mgr.34373) 7522 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[32348]: audit 2021-03-10T16:13:24.215606+0000 mgr.gibba043.dnkmem (mgr.34373) 7523 : audit [DBG] from='client.49098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:24 gibba003 bash[32348]: audit 2021-03-10T16:13:24.476600+0000 mon.a (mon.0) 1652 : audit [DBG] from='client.? 172.21.2.103:0/3216961697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:24 gibba043 bash[24019]: cluster 2021-03-10T16:13:23.403722+0000 mgr.gibba043.dnkmem (mgr.34373) 7521 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:24 gibba043 bash[24019]: audit 2021-03-10T16:13:23.993267+0000 mgr.gibba043.dnkmem (mgr.34373) 7522 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:24 gibba043 bash[24019]: audit 2021-03-10T16:13:24.215606+0000 mgr.gibba043.dnkmem (mgr.34373) 7523 : audit [DBG] from='client.49098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:25.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:24 gibba043 bash[24019]: audit 2021-03-10T16:13:24.476600+0000 mon.a (mon.0) 1652 : audit [DBG] from='client.? 172.21.2.103:0/3216961697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:27.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:26 gibba003 bash[31385]: cluster 2021-03-10T16:13:25.404924+0000 mgr.gibba043.dnkmem (mgr.34373) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:27.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:26 gibba003 bash[32348]: cluster 2021-03-10T16:13:25.404924+0000 mgr.gibba043.dnkmem (mgr.34373) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:26 gibba043 bash[24019]: cluster 2021-03-10T16:13:25.404924+0000 mgr.gibba043.dnkmem (mgr.34373) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:29.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:28 gibba003 bash[31385]: cluster 2021-03-10T16:13:27.406572+0000 mgr.gibba043.dnkmem (mgr.34373) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:29.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:28 gibba003 bash[32348]: cluster 2021-03-10T16:13:27.406572+0000 mgr.gibba043.dnkmem (mgr.34373) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:28 gibba043 bash[24019]: cluster 2021-03-10T16:13:27.406572+0000 mgr.gibba043.dnkmem (mgr.34373) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:31.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:30 gibba003 bash[31385]: cluster 2021-03-10T16:13:29.408243+0000 mgr.gibba043.dnkmem (mgr.34373) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:31.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:30 gibba003 bash[32348]: cluster 2021-03-10T16:13:29.408243+0000 mgr.gibba043.dnkmem (mgr.34373) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:30 gibba043 bash[24019]: cluster 2021-03-10T16:13:29.408243+0000 mgr.gibba043.dnkmem (mgr.34373) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:33.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:32 gibba003 bash[31385]: cluster 2021-03-10T16:13:31.409731+0000 mgr.gibba043.dnkmem (mgr.34373) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:33.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:32 gibba003 bash[31385]: cephadm 2021-03-10T16:13:32.160609+0000 mgr.gibba043.dnkmem (mgr.34373) 7528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:33.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:32 gibba003 bash[32348]: cluster 2021-03-10T16:13:31.409731+0000 mgr.gibba043.dnkmem (mgr.34373) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:33.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:32 gibba003 bash[32348]: cephadm 2021-03-10T16:13:32.160609+0000 mgr.gibba043.dnkmem (mgr.34373) 7528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:33.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:32 gibba043 bash[24019]: cluster 2021-03-10T16:13:31.409731+0000 mgr.gibba043.dnkmem (mgr.34373) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:33.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:32 gibba043 bash[24019]: cephadm 2021-03-10T16:13:32.160609+0000 mgr.gibba043.dnkmem (mgr.34373) 7528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:35.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:34 gibba003 bash[31385]: cluster 2021-03-10T16:13:33.411250+0000 mgr.gibba043.dnkmem (mgr.34373) 7529 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:35.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:34 gibba003 bash[32348]: cluster 2021-03-10T16:13:33.411250+0000 mgr.gibba043.dnkmem (mgr.34373) 7529 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:35.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:34 gibba043 bash[24019]: cluster 2021-03-10T16:13:33.411250+0000 mgr.gibba043.dnkmem (mgr.34373) 7529 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:37.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:36 gibba003 bash[31385]: cluster 2021-03-10T16:13:35.412822+0000 mgr.gibba043.dnkmem (mgr.34373) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:37.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:36 gibba003 bash[32348]: cluster 2021-03-10T16:13:35.412822+0000 mgr.gibba043.dnkmem (mgr.34373) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:37.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:36 gibba043 bash[24019]: cluster 2021-03-10T16:13:35.412822+0000 mgr.gibba043.dnkmem (mgr.34373) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:39.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:38 gibba043 bash[24019]: cluster 2021-03-10T16:13:37.414463+0000 mgr.gibba043.dnkmem (mgr.34373) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:39.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:38 gibba003 bash[31385]: cluster 2021-03-10T16:13:37.414463+0000 mgr.gibba043.dnkmem (mgr.34373) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:39.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:38 gibba003 bash[32348]: cluster 2021-03-10T16:13:37.414463+0000 mgr.gibba043.dnkmem (mgr.34373) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:40 gibba043 bash[24019]: cluster 2021-03-10T16:13:39.416342+0000 mgr.gibba043.dnkmem (mgr.34373) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:41.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:40 gibba003 bash[31385]: cluster 2021-03-10T16:13:39.416342+0000 mgr.gibba043.dnkmem (mgr.34373) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:41.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:40 gibba003 bash[32348]: cluster 2021-03-10T16:13:39.416342+0000 mgr.gibba043.dnkmem (mgr.34373) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:43.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:42 gibba043 bash[24019]: cluster 2021-03-10T16:13:41.418081+0000 mgr.gibba043.dnkmem (mgr.34373) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:43.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:42 gibba003 bash[31385]: cluster 2021-03-10T16:13:41.418081+0000 mgr.gibba043.dnkmem (mgr.34373) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:43.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:42 gibba003 bash[32348]: cluster 2021-03-10T16:13:41.418081+0000 mgr.gibba043.dnkmem (mgr.34373) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:44 gibba043 bash[24019]: cluster 2021-03-10T16:13:43.419494+0000 mgr.gibba043.dnkmem (mgr.34373) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:44 gibba003 bash[31385]: cluster 2021-03-10T16:13:43.419494+0000 mgr.gibba043.dnkmem (mgr.34373) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:44 gibba003 bash[32348]: cluster 2021-03-10T16:13:43.419494+0000 mgr.gibba043.dnkmem (mgr.34373) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:47.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:46 gibba043 bash[24019]: cluster 2021-03-10T16:13:45.420999+0000 mgr.gibba043.dnkmem (mgr.34373) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:46 gibba003 bash[31385]: cluster 2021-03-10T16:13:45.420999+0000 mgr.gibba043.dnkmem (mgr.34373) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:46 gibba003 bash[32348]: cluster 2021-03-10T16:13:45.420999+0000 mgr.gibba043.dnkmem (mgr.34373) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:48.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:48 gibba043 bash[24019]: cephadm 2021-03-10T16:13:47.172601+0000 mgr.gibba043.dnkmem (mgr.34373) 7536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:48 gibba003 bash[31385]: cephadm 2021-03-10T16:13:47.172601+0000 mgr.gibba043.dnkmem (mgr.34373) 7536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:48 gibba003 bash[32348]: cephadm 2021-03-10T16:13:47.172601+0000 mgr.gibba043.dnkmem (mgr.34373) 7536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:13:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:49 gibba043 bash[24019]: cluster 2021-03-10T16:13:47.422654+0000 mgr.gibba043.dnkmem (mgr.34373) 7537 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:49 gibba003 bash[31385]: cluster 2021-03-10T16:13:47.422654+0000 mgr.gibba043.dnkmem (mgr.34373) 7537 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:49 gibba003 bash[32348]: cluster 2021-03-10T16:13:47.422654+0000 mgr.gibba043.dnkmem (mgr.34373) 7537 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:51.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:51 gibba043 bash[24019]: cluster 2021-03-10T16:13:49.424205+0000 mgr.gibba043.dnkmem (mgr.34373) 7538 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:51.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:51 gibba003 bash[31385]: cluster 2021-03-10T16:13:49.424205+0000 mgr.gibba043.dnkmem (mgr.34373) 7538 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:51.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:51 gibba003 bash[32348]: cluster 2021-03-10T16:13:49.424205+0000 mgr.gibba043.dnkmem (mgr.34373) 7538 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:53.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:53 gibba003 bash[31385]: cluster 2021-03-10T16:13:51.426020+0000 mgr.gibba043.dnkmem (mgr.34373) 7539 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:53.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:53 gibba003 bash[32348]: cluster 2021-03-10T16:13:51.426020+0000 mgr.gibba043.dnkmem (mgr.34373) 7539 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:53 gibba043 bash[24019]: cluster 2021-03-10T16:13:51.426020+0000 mgr.gibba043.dnkmem (mgr.34373) 7539 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:54.718 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:13:54.968 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:13:54.969 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:13:54.969 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:13:54.970 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:13:54.970 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:13:54.970 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:13:54.971 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:13:54.971 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:13:54.971 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:13:54.971 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:13:54.972 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:13:54.972 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:13:54.972 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:13:54.972 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:13:54.973 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:13:54.973 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:13:54.973 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:13:54.973 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:13:54.974 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:13:54.974 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:13:54.975 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:13:55.221 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:13:55.222 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:13:55.222 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:55.222 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:13:55.223 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:13:55.223 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:55.223 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:13:55.223 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:13:55.224 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:13:55.224 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:13:55.224 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:13:55.224 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:13:55.225 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:13:55.225 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:13:55.225 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:13:55.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:55 gibba003 bash[31385]: cluster 2021-03-10T16:13:53.426791+0000 mgr.gibba043.dnkmem (mgr.34373) 7540 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:55.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:55 gibba003 bash[32348]: cluster 2021-03-10T16:13:53.426791+0000 mgr.gibba043.dnkmem (mgr.34373) 7540 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:55 gibba043 bash[24019]: cluster 2021-03-10T16:13:53.426791+0000 mgr.gibba043.dnkmem (mgr.34373) 7540 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:56.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:56 gibba003 bash[31385]: audit 2021-03-10T16:13:54.709675+0000 mgr.gibba043.dnkmem (mgr.34373) 7541 : audit [DBG] from='client.59098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:56.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:56 gibba003 bash[31385]: audit 2021-03-10T16:13:54.932002+0000 mgr.gibba043.dnkmem (mgr.34373) 7542 : audit [DBG] from='client.59104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:56.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:56 gibba003 bash[31385]: audit 2021-03-10T16:13:55.223861+0000 mon.a (mon.0) 1653 : audit [DBG] from='client.? 172.21.2.103:0/3183992002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:56.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:56 gibba003 bash[32348]: audit 2021-03-10T16:13:54.709675+0000 mgr.gibba043.dnkmem (mgr.34373) 7541 : audit [DBG] from='client.59098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:56.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:56 gibba003 bash[32348]: audit 2021-03-10T16:13:54.932002+0000 mgr.gibba043.dnkmem (mgr.34373) 7542 : audit [DBG] from='client.59104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:56.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:56 gibba003 bash[32348]: audit 2021-03-10T16:13:55.223861+0000 mon.a (mon.0) 1653 : audit [DBG] from='client.? 172.21.2.103:0/3183992002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:56 gibba043 bash[24019]: audit 2021-03-10T16:13:54.709675+0000 mgr.gibba043.dnkmem (mgr.34373) 7541 : audit [DBG] from='client.59098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:56 gibba043 bash[24019]: audit 2021-03-10T16:13:54.932002+0000 mgr.gibba043.dnkmem (mgr.34373) 7542 : audit [DBG] from='client.59104 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:56.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:56 gibba043 bash[24019]: audit 2021-03-10T16:13:55.223861+0000 mon.a (mon.0) 1653 : audit [DBG] from='client.? 172.21.2.103:0/3183992002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:57.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:57 gibba003 bash[31385]: cluster 2021-03-10T16:13:55.428157+0000 mgr.gibba043.dnkmem (mgr.34373) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:57.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:57 gibba003 bash[32348]: cluster 2021-03-10T16:13:55.428157+0000 mgr.gibba043.dnkmem (mgr.34373) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:57 gibba043 bash[24019]: cluster 2021-03-10T16:13:55.428157+0000 mgr.gibba043.dnkmem (mgr.34373) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:13:59 gibba003 bash[31385]: cluster 2021-03-10T16:13:57.429808+0000 mgr.gibba043.dnkmem (mgr.34373) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:13:59 gibba003 bash[32348]: cluster 2021-03-10T16:13:57.429808+0000 mgr.gibba043.dnkmem (mgr.34373) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:13:59 gibba043 bash[24019]: cluster 2021-03-10T16:13:57.429808+0000 mgr.gibba043.dnkmem (mgr.34373) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:01 gibba003 bash[31385]: cluster 2021-03-10T16:13:59.431582+0000 mgr.gibba043.dnkmem (mgr.34373) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:01 gibba003 bash[32348]: cluster 2021-03-10T16:13:59.431582+0000 mgr.gibba043.dnkmem (mgr.34373) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:01 gibba043 bash[24019]: cluster 2021-03-10T16:13:59.431582+0000 mgr.gibba043.dnkmem (mgr.34373) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:03 gibba003 bash[31385]: cluster 2021-03-10T16:14:01.433226+0000 mgr.gibba043.dnkmem (mgr.34373) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:03 gibba003 bash[31385]: cephadm 2021-03-10T16:14:02.188594+0000 mgr.gibba043.dnkmem (mgr.34373) 7547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:03 gibba003 bash[32348]: cluster 2021-03-10T16:14:01.433226+0000 mgr.gibba043.dnkmem (mgr.34373) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:03 gibba003 bash[32348]: cephadm 2021-03-10T16:14:02.188594+0000 mgr.gibba043.dnkmem (mgr.34373) 7547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:03 gibba043 bash[24019]: cluster 2021-03-10T16:14:01.433226+0000 mgr.gibba043.dnkmem (mgr.34373) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:03 gibba043 bash[24019]: cephadm 2021-03-10T16:14:02.188594+0000 mgr.gibba043.dnkmem (mgr.34373) 7547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:05 gibba003 bash[31385]: cluster 2021-03-10T16:14:03.434926+0000 mgr.gibba043.dnkmem (mgr.34373) 7548 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:05.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:05 gibba003 bash[32348]: cluster 2021-03-10T16:14:03.434926+0000 mgr.gibba043.dnkmem (mgr.34373) 7548 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:05 gibba043 bash[24019]: cluster 2021-03-10T16:14:03.434926+0000 mgr.gibba043.dnkmem (mgr.34373) 7548 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:07.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:07 gibba003 bash[31385]: cluster 2021-03-10T16:14:05.436553+0000 mgr.gibba043.dnkmem (mgr.34373) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:07.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:07 gibba003 bash[32348]: cluster 2021-03-10T16:14:05.436553+0000 mgr.gibba043.dnkmem (mgr.34373) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:07 gibba043 bash[24019]: cluster 2021-03-10T16:14:05.436553+0000 mgr.gibba043.dnkmem (mgr.34373) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:09.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:09 gibba003 bash[31385]: cluster 2021-03-10T16:14:07.438162+0000 mgr.gibba043.dnkmem (mgr.34373) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:09.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:09 gibba003 bash[32348]: cluster 2021-03-10T16:14:07.438162+0000 mgr.gibba043.dnkmem (mgr.34373) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:09 gibba043 bash[24019]: cluster 2021-03-10T16:14:07.438162+0000 mgr.gibba043.dnkmem (mgr.34373) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:11 gibba003 bash[31385]: cluster 2021-03-10T16:14:09.439939+0000 mgr.gibba043.dnkmem (mgr.34373) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:11 gibba003 bash[32348]: cluster 2021-03-10T16:14:09.439939+0000 mgr.gibba043.dnkmem (mgr.34373) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:11 gibba043 bash[24019]: cluster 2021-03-10T16:14:09.439939+0000 mgr.gibba043.dnkmem (mgr.34373) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:13.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:13 gibba003 bash[31385]: cluster 2021-03-10T16:14:11.441727+0000 mgr.gibba043.dnkmem (mgr.34373) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:13 gibba003 bash[32348]: cluster 2021-03-10T16:14:11.441727+0000 mgr.gibba043.dnkmem (mgr.34373) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:13 gibba043 bash[24019]: cluster 2021-03-10T16:14:11.441727+0000 mgr.gibba043.dnkmem (mgr.34373) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.645057+0000 mon.c (mon.1) 1949 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.646215+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.820410+0000 mon.c (mon.1) 1950 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.822410+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.990188+0000 mon.c (mon.1) 1951 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:14:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.991003+0000 mon.c (mon.1) 1952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.991556+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:14:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.991737+0000 mon.c (mon.1) 1953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.992409+0000 mon.c (mon.1) 1954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.993417+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.994628+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[31385]: audit 2021-03-10T16:14:13.995587+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.645057+0000 mon.c (mon.1) 1949 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.646215+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.820410+0000 mon.c (mon.1) 1950 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.822410+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.990188+0000 mon.c (mon.1) 1951 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:14:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.991003+0000 mon.c (mon.1) 1952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.991556+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:14:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.991737+0000 mon.c (mon.1) 1953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.992409+0000 mon.c (mon.1) 1954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.993417+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.994628+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:14 gibba003 bash[32348]: audit 2021-03-10T16:14:13.995587+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.645057+0000 mon.c (mon.1) 1949 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.646215+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.820410+0000 mon.c (mon.1) 1950 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.822410+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.990188+0000 mon.c (mon.1) 1951 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:14:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.991003+0000 mon.c (mon.1) 1952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.991556+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:14:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.991737+0000 mon.c (mon.1) 1953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.992409+0000 mon.c (mon.1) 1954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.993417+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:14:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.994628+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:14 gibba043 bash[24019]: audit 2021-03-10T16:14:13.995587+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:14:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:15 gibba003 bash[31385]: cluster 2021-03-10T16:14:13.443450+0000 mgr.gibba043.dnkmem (mgr.34373) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:15.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:15 gibba003 bash[32348]: cluster 2021-03-10T16:14:13.443450+0000 mgr.gibba043.dnkmem (mgr.34373) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:15 gibba043 bash[24019]: cluster 2021-03-10T16:14:13.443450+0000 mgr.gibba043.dnkmem (mgr.34373) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:17.427 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:17 gibba043 bash[24019]: cluster 2021-03-10T16:14:15.445003+0000 mgr.gibba043.dnkmem (mgr.34373) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:17.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:17 gibba003 bash[31385]: cluster 2021-03-10T16:14:15.445003+0000 mgr.gibba043.dnkmem (mgr.34373) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:17.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:17 gibba003 bash[32348]: cluster 2021-03-10T16:14:15.445003+0000 mgr.gibba043.dnkmem (mgr.34373) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.204592+0000 mgr.gibba043.dnkmem (mgr.34373) 7555 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:14:18.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.205219+0000 mgr.gibba043.dnkmem (mgr.34373) 7556 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:14:18.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.416194+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:14:18.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.417571+0000 mgr.gibba043.dnkmem (mgr.34373) 7557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:18.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.419534+0000 mgr.gibba043.dnkmem (mgr.34373) 7558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:18.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.419734+0000 mon.c (mon.1) 1955 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:18.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.421098+0000 mgr.gibba043.dnkmem (mgr.34373) 7559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:18.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.421134+0000 mgr.gibba043.dnkmem (mgr.34373) 7560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:18.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.421352+0000 mon.c (mon.1) 1956 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.422691+0000 mgr.gibba043.dnkmem (mgr.34373) 7561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:18.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.422728+0000 mgr.gibba043.dnkmem (mgr.34373) 7562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:18.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.422994+0000 mon.c (mon.1) 1957 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.423833+0000 mgr.gibba043.dnkmem (mgr.34373) 7563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.424463+0000 mon.c (mon.1) 1958 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.425315+0000 mgr.gibba043.dnkmem (mgr.34373) 7564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.425349+0000 mgr.gibba043.dnkmem (mgr.34373) 7565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.427189+0000 mon.c (mon.1) 1959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[31385]: audit 2021-03-10T16:14:17.428598+0000 mon.c (mon.1) 1960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.204592+0000 mgr.gibba043.dnkmem (mgr.34373) 7555 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:14:18.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.205219+0000 mgr.gibba043.dnkmem (mgr.34373) 7556 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:14:18.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.416194+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:14:18.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.417571+0000 mgr.gibba043.dnkmem (mgr.34373) 7557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:18.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.419534+0000 mgr.gibba043.dnkmem (mgr.34373) 7558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:18.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.419734+0000 mon.c (mon.1) 1955 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:18.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.421098+0000 mgr.gibba043.dnkmem (mgr.34373) 7559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:18.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.421134+0000 mgr.gibba043.dnkmem (mgr.34373) 7560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:18.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.421352+0000 mon.c (mon.1) 1956 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.422691+0000 mgr.gibba043.dnkmem (mgr.34373) 7561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:18.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.422728+0000 mgr.gibba043.dnkmem (mgr.34373) 7562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:18.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.422994+0000 mon.c (mon.1) 1957 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.423833+0000 mgr.gibba043.dnkmem (mgr.34373) 7563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:18.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.424463+0000 mon.c (mon.1) 1958 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.425315+0000 mgr.gibba043.dnkmem (mgr.34373) 7564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:18.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.425349+0000 mgr.gibba043.dnkmem (mgr.34373) 7565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:18.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.427189+0000 mon.c (mon.1) 1959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:18 gibba003 bash[32348]: audit 2021-03-10T16:14:17.428598+0000 mon.c (mon.1) 1960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.204592+0000 mgr.gibba043.dnkmem (mgr.34373) 7555 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:14:18.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.205219+0000 mgr.gibba043.dnkmem (mgr.34373) 7556 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:14:18.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.416194+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:14:18.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.417571+0000 mgr.gibba043.dnkmem (mgr.34373) 7557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:18.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.419534+0000 mgr.gibba043.dnkmem (mgr.34373) 7558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:18.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.419734+0000 mon.c (mon.1) 1955 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.421098+0000 mgr.gibba043.dnkmem (mgr.34373) 7559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.421134+0000 mgr.gibba043.dnkmem (mgr.34373) 7560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.421352+0000 mon.c (mon.1) 1956 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.422691+0000 mgr.gibba043.dnkmem (mgr.34373) 7561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:18.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.422728+0000 mgr.gibba043.dnkmem (mgr.34373) 7562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.422994+0000 mon.c (mon.1) 1957 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.423833+0000 mgr.gibba043.dnkmem (mgr.34373) 7563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.424463+0000 mon.c (mon.1) 1958 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.425315+0000 mgr.gibba043.dnkmem (mgr.34373) 7564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.425349+0000 mgr.gibba043.dnkmem (mgr.34373) 7565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.427189+0000 mon.c (mon.1) 1959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:18 gibba043 bash[24019]: audit 2021-03-10T16:14:17.428598+0000 mon.c (mon.1) 1960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.426577+0000 mgr.gibba043.dnkmem (mgr.34373) 7566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.426892+0000 mgr.gibba043.dnkmem (mgr.34373) 7567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.428001+0000 mgr.gibba043.dnkmem (mgr.34373) 7568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.428038+0000 mgr.gibba043.dnkmem (mgr.34373) 7569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[31385]: cephadm 2021-03-10T16:14:17.428142+0000 mgr.gibba043.dnkmem (mgr.34373) 7570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[31385]: cluster 2021-03-10T16:14:17.446416+0000 mgr.gibba043.dnkmem (mgr.34373) 7571 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.426577+0000 mgr.gibba043.dnkmem (mgr.34373) 7566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.426892+0000 mgr.gibba043.dnkmem (mgr.34373) 7567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.428001+0000 mgr.gibba043.dnkmem (mgr.34373) 7568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:19.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.428038+0000 mgr.gibba043.dnkmem (mgr.34373) 7569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[32348]: cephadm 2021-03-10T16:14:17.428142+0000 mgr.gibba043.dnkmem (mgr.34373) 7570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:19 gibba003 bash[32348]: cluster 2021-03-10T16:14:17.446416+0000 mgr.gibba043.dnkmem (mgr.34373) 7571 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:19 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.426577+0000 mgr.gibba043.dnkmem (mgr.34373) 7566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:19 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.426892+0000 mgr.gibba043.dnkmem (mgr.34373) 7567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:19 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.428001+0000 mgr.gibba043.dnkmem (mgr.34373) 7568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:19 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.428038+0000 mgr.gibba043.dnkmem (mgr.34373) 7569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:19 gibba043 bash[24019]: cephadm 2021-03-10T16:14:17.428142+0000 mgr.gibba043.dnkmem (mgr.34373) 7570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:19 gibba043 bash[24019]: cluster 2021-03-10T16:14:17.446416+0000 mgr.gibba043.dnkmem (mgr.34373) 7571 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:20.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:20 gibba043 bash[24019]: cluster 2021-03-10T16:14:19.446941+0000 mgr.gibba043.dnkmem (mgr.34373) 7572 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:20.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:20 gibba003 bash[31385]: cluster 2021-03-10T16:14:19.446941+0000 mgr.gibba043.dnkmem (mgr.34373) 7572 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:20.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:20 gibba003 bash[32348]: cluster 2021-03-10T16:14:19.446941+0000 mgr.gibba043.dnkmem (mgr.34373) 7572 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:23.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:22 gibba003 bash[31385]: cluster 2021-03-10T16:14:21.448335+0000 mgr.gibba043.dnkmem (mgr.34373) 7573 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:23.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:22 gibba003 bash[32348]: cluster 2021-03-10T16:14:21.448335+0000 mgr.gibba043.dnkmem (mgr.34373) 7573 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:23.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:22 gibba043 bash[24019]: cluster 2021-03-10T16:14:21.448335+0000 mgr.gibba043.dnkmem (mgr.34373) 7573 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:24 gibba003 bash[31385]: cluster 2021-03-10T16:14:23.450007+0000 mgr.gibba043.dnkmem (mgr.34373) 7574 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:24 gibba003 bash[32348]: cluster 2021-03-10T16:14:23.450007+0000 mgr.gibba043.dnkmem (mgr.34373) 7574 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:24 gibba043 bash[24019]: cluster 2021-03-10T16:14:23.450007+0000 mgr.gibba043.dnkmem (mgr.34373) 7574 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.467 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:14:25.696 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:14:25.697 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:14:25.697 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:14:25.697 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:14:25.697 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:14:25.697 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:14:25.698 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:14:25.698 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:14:25.698 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:14:25.698 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:14:25.699 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:14:25.699 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:14:25.699 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:14:25.699 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:14:25.700 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:14:25.700 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:14:25.700 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:14:25.700 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:14:25.701 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:14:25.701 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:14:25.701 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:14:25.945 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:14:25.945 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:14:25.946 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:25.946 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:14:25.946 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:14:25.946 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:25.947 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:14:25.947 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:14:25.947 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:14:25.947 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:14:25.947 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:14:25.948 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:14:25.948 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:14:25.948 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:14:25.948 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:14:27.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[31385]: cluster 2021-03-10T16:14:25.451523+0000 mgr.gibba043.dnkmem (mgr.34373) 7575 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:27.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[31385]: audit 2021-03-10T16:14:25.458713+0000 mgr.gibba043.dnkmem (mgr.34373) 7576 : audit [DBG] from='client.49128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[31385]: audit 2021-03-10T16:14:25.684822+0000 mgr.gibba043.dnkmem (mgr.34373) 7577 : audit [DBG] from='client.59122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[31385]: audit 2021-03-10T16:14:25.947570+0000 mon.c (mon.1) 1961 : audit [DBG] from='client.? 172.21.2.103:0/287167185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[32348]: cluster 2021-03-10T16:14:25.451523+0000 mgr.gibba043.dnkmem (mgr.34373) 7575 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[32348]: audit 2021-03-10T16:14:25.458713+0000 mgr.gibba043.dnkmem (mgr.34373) 7576 : audit [DBG] from='client.49128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[32348]: audit 2021-03-10T16:14:25.684822+0000 mgr.gibba043.dnkmem (mgr.34373) 7577 : audit [DBG] from='client.59122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:26 gibba003 bash[32348]: audit 2021-03-10T16:14:25.947570+0000 mon.c (mon.1) 1961 : audit [DBG] from='client.? 172.21.2.103:0/287167185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:26 gibba043 bash[24019]: cluster 2021-03-10T16:14:25.451523+0000 mgr.gibba043.dnkmem (mgr.34373) 7575 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:26 gibba043 bash[24019]: audit 2021-03-10T16:14:25.458713+0000 mgr.gibba043.dnkmem (mgr.34373) 7576 : audit [DBG] from='client.49128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:26 gibba043 bash[24019]: audit 2021-03-10T16:14:25.684822+0000 mgr.gibba043.dnkmem (mgr.34373) 7577 : audit [DBG] from='client.59122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:27.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:26 gibba043 bash[24019]: audit 2021-03-10T16:14:25.947570+0000 mon.c (mon.1) 1961 : audit [DBG] from='client.? 172.21.2.103:0/287167185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:29.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:28 gibba003 bash[31385]: cluster 2021-03-10T16:14:27.453226+0000 mgr.gibba043.dnkmem (mgr.34373) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:29.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:28 gibba003 bash[32348]: cluster 2021-03-10T16:14:27.453226+0000 mgr.gibba043.dnkmem (mgr.34373) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:28 gibba043 bash[24019]: cluster 2021-03-10T16:14:27.453226+0000 mgr.gibba043.dnkmem (mgr.34373) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:30 gibba043 bash[24019]: cluster 2021-03-10T16:14:29.455093+0000 mgr.gibba043.dnkmem (mgr.34373) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:31.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:30 gibba003 bash[31385]: cluster 2021-03-10T16:14:29.455093+0000 mgr.gibba043.dnkmem (mgr.34373) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:31.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:30 gibba003 bash[32348]: cluster 2021-03-10T16:14:29.455093+0000 mgr.gibba043.dnkmem (mgr.34373) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:33.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:32 gibba043 bash[24019]: cluster 2021-03-10T16:14:31.457095+0000 mgr.gibba043.dnkmem (mgr.34373) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:33.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:32 gibba003 bash[31385]: cluster 2021-03-10T16:14:31.457095+0000 mgr.gibba043.dnkmem (mgr.34373) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:33.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:32 gibba003 bash[32348]: cluster 2021-03-10T16:14:31.457095+0000 mgr.gibba043.dnkmem (mgr.34373) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:34.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:33 gibba043 bash[24019]: cephadm 2021-03-10T16:14:32.444257+0000 mgr.gibba043.dnkmem (mgr.34373) 7581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:34.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:33 gibba003 bash[31385]: cephadm 2021-03-10T16:14:32.444257+0000 mgr.gibba043.dnkmem (mgr.34373) 7581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:34.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:33 gibba003 bash[32348]: cephadm 2021-03-10T16:14:32.444257+0000 mgr.gibba043.dnkmem (mgr.34373) 7581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:35.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:34 gibba043 bash[24019]: cluster 2021-03-10T16:14:33.458813+0000 mgr.gibba043.dnkmem (mgr.34373) 7582 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:35.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:34 gibba003 bash[31385]: cluster 2021-03-10T16:14:33.458813+0000 mgr.gibba043.dnkmem (mgr.34373) 7582 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:35.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:34 gibba003 bash[32348]: cluster 2021-03-10T16:14:33.458813+0000 mgr.gibba043.dnkmem (mgr.34373) 7582 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:37.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:36 gibba043 bash[24019]: cluster 2021-03-10T16:14:35.460360+0000 mgr.gibba043.dnkmem (mgr.34373) 7583 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:37.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:36 gibba003 bash[31385]: cluster 2021-03-10T16:14:35.460360+0000 mgr.gibba043.dnkmem (mgr.34373) 7583 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:37.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:36 gibba003 bash[32348]: cluster 2021-03-10T16:14:35.460360+0000 mgr.gibba043.dnkmem (mgr.34373) 7583 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:39.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:38 gibba043 bash[24019]: cluster 2021-03-10T16:14:37.461866+0000 mgr.gibba043.dnkmem (mgr.34373) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:39.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:38 gibba003 bash[31385]: cluster 2021-03-10T16:14:37.461866+0000 mgr.gibba043.dnkmem (mgr.34373) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:39.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:38 gibba003 bash[32348]: cluster 2021-03-10T16:14:37.461866+0000 mgr.gibba043.dnkmem (mgr.34373) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:40 gibba043 bash[24019]: cluster 2021-03-10T16:14:39.463602+0000 mgr.gibba043.dnkmem (mgr.34373) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:41.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:40 gibba003 bash[31385]: cluster 2021-03-10T16:14:39.463602+0000 mgr.gibba043.dnkmem (mgr.34373) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:41.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:40 gibba003 bash[32348]: cluster 2021-03-10T16:14:39.463602+0000 mgr.gibba043.dnkmem (mgr.34373) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:43.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:43 gibba043 bash[24019]: cluster 2021-03-10T16:14:41.465150+0000 mgr.gibba043.dnkmem (mgr.34373) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:43.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:43 gibba003 bash[31385]: cluster 2021-03-10T16:14:41.465150+0000 mgr.gibba043.dnkmem (mgr.34373) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:43.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:43 gibba003 bash[32348]: cluster 2021-03-10T16:14:41.465150+0000 mgr.gibba043.dnkmem (mgr.34373) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:45 gibba043 bash[24019]: cluster 2021-03-10T16:14:43.466675+0000 mgr.gibba043.dnkmem (mgr.34373) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:45 gibba003 bash[32348]: cluster 2021-03-10T16:14:43.466675+0000 mgr.gibba043.dnkmem (mgr.34373) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:45 gibba003 bash[31385]: cluster 2021-03-10T16:14:43.466675+0000 mgr.gibba043.dnkmem (mgr.34373) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:47 gibba003 bash[31385]: cluster 2021-03-10T16:14:45.468140+0000 mgr.gibba043.dnkmem (mgr.34373) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:47 gibba003 bash[32348]: cluster 2021-03-10T16:14:45.468140+0000 mgr.gibba043.dnkmem (mgr.34373) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:47.459 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:47 gibba043 bash[24019]: cluster 2021-03-10T16:14:45.468140+0000 mgr.gibba043.dnkmem (mgr.34373) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:49 gibba003 bash[31385]: cephadm 2021-03-10T16:14:47.460383+0000 mgr.gibba043.dnkmem (mgr.34373) 7589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:49 gibba003 bash[31385]: cluster 2021-03-10T16:14:47.469551+0000 mgr.gibba043.dnkmem (mgr.34373) 7590 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:49 gibba003 bash[32348]: cephadm 2021-03-10T16:14:47.460383+0000 mgr.gibba043.dnkmem (mgr.34373) 7589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:49 gibba003 bash[32348]: cluster 2021-03-10T16:14:47.469551+0000 mgr.gibba043.dnkmem (mgr.34373) 7590 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:49 gibba043 bash[24019]: cephadm 2021-03-10T16:14:47.460383+0000 mgr.gibba043.dnkmem (mgr.34373) 7589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:14:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:49 gibba043 bash[24019]: cluster 2021-03-10T16:14:47.469551+0000 mgr.gibba043.dnkmem (mgr.34373) 7590 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:51.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:51 gibba003 bash[31385]: cluster 2021-03-10T16:14:49.471359+0000 mgr.gibba043.dnkmem (mgr.34373) 7591 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:51.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:51 gibba003 bash[32348]: cluster 2021-03-10T16:14:49.471359+0000 mgr.gibba043.dnkmem (mgr.34373) 7591 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:51 gibba043 bash[24019]: cluster 2021-03-10T16:14:49.471359+0000 mgr.gibba043.dnkmem (mgr.34373) 7591 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:53.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:53 gibba003 bash[31385]: cluster 2021-03-10T16:14:51.472909+0000 mgr.gibba043.dnkmem (mgr.34373) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:53.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:53 gibba003 bash[32348]: cluster 2021-03-10T16:14:51.472909+0000 mgr.gibba043.dnkmem (mgr.34373) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:53 gibba043 bash[24019]: cluster 2021-03-10T16:14:51.472909+0000 mgr.gibba043.dnkmem (mgr.34373) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:55.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:55 gibba003 bash[31385]: cluster 2021-03-10T16:14:53.474550+0000 mgr.gibba043.dnkmem (mgr.34373) 7593 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:55.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:55 gibba003 bash[32348]: cluster 2021-03-10T16:14:53.474550+0000 mgr.gibba043.dnkmem (mgr.34373) 7593 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:55 gibba043 bash[24019]: cluster 2021-03-10T16:14:53.474550+0000 mgr.gibba043.dnkmem (mgr.34373) 7593 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:56.186 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:14:56.411 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:14:56.412 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:14:56.412 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:14:56.412 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:14:56.413 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:14:56.413 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:14:56.413 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:14:56.413 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:14:56.414 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:14:56.414 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:14:56.414 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:14:56.414 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:14:56.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:14:56.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:14:56.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:14:56.415 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:14:56.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:14:56.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:14:56.416 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:14:56.416 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:14:56.416 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:14:56.669 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:14:56.670 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:14:56.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:56.670 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:14:56.671 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:14:56.671 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:56.671 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:14:56.671 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:14:56.672 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:14:56.672 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:14:56.672 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:14:56.672 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:14:56.672 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:14:56.673 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:14:56.673 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:14:57.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[31385]: cluster 2021-03-10T16:14:55.476188+0000 mgr.gibba043.dnkmem (mgr.34373) 7594 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:57.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[31385]: audit 2021-03-10T16:14:56.178077+0000 mgr.gibba043.dnkmem (mgr.34373) 7595 : audit [DBG] from='client.59134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:57.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[31385]: audit 2021-03-10T16:14:56.400885+0000 mgr.gibba043.dnkmem (mgr.34373) 7596 : audit [DBG] from='client.59140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:57.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[31385]: audit 2021-03-10T16:14:56.672103+0000 mon.c (mon.1) 1962 : audit [DBG] from='client.? 172.21.2.103:0/539615028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[32348]: cluster 2021-03-10T16:14:55.476188+0000 mgr.gibba043.dnkmem (mgr.34373) 7594 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:57.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[32348]: audit 2021-03-10T16:14:56.178077+0000 mgr.gibba043.dnkmem (mgr.34373) 7595 : audit [DBG] from='client.59134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[32348]: audit 2021-03-10T16:14:56.400885+0000 mgr.gibba043.dnkmem (mgr.34373) 7596 : audit [DBG] from='client.59140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:57.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:57 gibba003 bash[32348]: audit 2021-03-10T16:14:56.672103+0000 mon.c (mon.1) 1962 : audit [DBG] from='client.? 172.21.2.103:0/539615028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:57 gibba043 bash[24019]: cluster 2021-03-10T16:14:55.476188+0000 mgr.gibba043.dnkmem (mgr.34373) 7594 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:57 gibba043 bash[24019]: audit 2021-03-10T16:14:56.178077+0000 mgr.gibba043.dnkmem (mgr.34373) 7595 : audit [DBG] from='client.59134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:57 gibba043 bash[24019]: audit 2021-03-10T16:14:56.400885+0000 mgr.gibba043.dnkmem (mgr.34373) 7596 : audit [DBG] from='client.59140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:57.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:57 gibba043 bash[24019]: audit 2021-03-10T16:14:56.672103+0000 mon.c (mon.1) 1962 : audit [DBG] from='client.? 172.21.2.103:0/539615028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:14:59 gibba003 bash[31385]: cluster 2021-03-10T16:14:57.477827+0000 mgr.gibba043.dnkmem (mgr.34373) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:14:59 gibba003 bash[32348]: cluster 2021-03-10T16:14:57.477827+0000 mgr.gibba043.dnkmem (mgr.34373) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:14:59 gibba043 bash[24019]: cluster 2021-03-10T16:14:57.477827+0000 mgr.gibba043.dnkmem (mgr.34373) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:01.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:01 gibba003 bash[31385]: cluster 2021-03-10T16:14:59.479663+0000 mgr.gibba043.dnkmem (mgr.34373) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:01.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:01 gibba003 bash[32348]: cluster 2021-03-10T16:14:59.479663+0000 mgr.gibba043.dnkmem (mgr.34373) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:01.454 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:01 gibba043 bash[24019]: cluster 2021-03-10T16:14:59.479663+0000 mgr.gibba043.dnkmem (mgr.34373) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:03.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:03 gibba003 bash[31385]: cluster 2021-03-10T16:15:01.481247+0000 mgr.gibba043.dnkmem (mgr.34373) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:03.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:03 gibba003 bash[32348]: cluster 2021-03-10T16:15:01.481247+0000 mgr.gibba043.dnkmem (mgr.34373) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:03 gibba043 bash[24019]: cluster 2021-03-10T16:15:01.481247+0000 mgr.gibba043.dnkmem (mgr.34373) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:04 gibba003 bash[31385]: cephadm 2021-03-10T16:15:02.476472+0000 mgr.gibba043.dnkmem (mgr.34373) 7600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:04.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:04 gibba003 bash[32348]: cephadm 2021-03-10T16:15:02.476472+0000 mgr.gibba043.dnkmem (mgr.34373) 7600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:04 gibba043 bash[24019]: cephadm 2021-03-10T16:15:02.476472+0000 mgr.gibba043.dnkmem (mgr.34373) 7600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:05 gibba003 bash[31385]: cluster 2021-03-10T16:15:03.482627+0000 mgr.gibba043.dnkmem (mgr.34373) 7601 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:05.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:05 gibba003 bash[32348]: cluster 2021-03-10T16:15:03.482627+0000 mgr.gibba043.dnkmem (mgr.34373) 7601 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:05 gibba043 bash[24019]: cluster 2021-03-10T16:15:03.482627+0000 mgr.gibba043.dnkmem (mgr.34373) 7601 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:07.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:07 gibba003 bash[31385]: cluster 2021-03-10T16:15:05.484239+0000 mgr.gibba043.dnkmem (mgr.34373) 7602 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:07.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:07 gibba003 bash[32348]: cluster 2021-03-10T16:15:05.484239+0000 mgr.gibba043.dnkmem (mgr.34373) 7602 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:07 gibba043 bash[24019]: cluster 2021-03-10T16:15:05.484239+0000 mgr.gibba043.dnkmem (mgr.34373) 7602 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:09.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:09 gibba003 bash[31385]: cluster 2021-03-10T16:15:07.485991+0000 mgr.gibba043.dnkmem (mgr.34373) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:09.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:09 gibba003 bash[32348]: cluster 2021-03-10T16:15:07.485991+0000 mgr.gibba043.dnkmem (mgr.34373) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:09 gibba043 bash[24019]: cluster 2021-03-10T16:15:07.485991+0000 mgr.gibba043.dnkmem (mgr.34373) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:11.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:11 gibba003 bash[31385]: cluster 2021-03-10T16:15:09.487821+0000 mgr.gibba043.dnkmem (mgr.34373) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:11.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:11 gibba003 bash[32348]: cluster 2021-03-10T16:15:09.487821+0000 mgr.gibba043.dnkmem (mgr.34373) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:11 gibba043 bash[24019]: cluster 2021-03-10T16:15:09.487821+0000 mgr.gibba043.dnkmem (mgr.34373) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:13.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:13 gibba003 bash[31385]: cluster 2021-03-10T16:15:11.488689+0000 mgr.gibba043.dnkmem (mgr.34373) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:13 gibba003 bash[32348]: cluster 2021-03-10T16:15:11.488689+0000 mgr.gibba043.dnkmem (mgr.34373) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:13 gibba043 bash[24019]: cluster 2021-03-10T16:15:11.488689+0000 mgr.gibba043.dnkmem (mgr.34373) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:13.651775+0000 mon.c (mon.1) 1963 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:13.652895+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:13.829929+0000 mon.c (mon.1) 1964 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:13.831073+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.001255+0000 mon.c (mon.1) 1965 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:15:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.002023+0000 mon.c (mon.1) 1966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.002522+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:15:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.002721+0000 mon.c (mon.1) 1967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.003652+0000 mon.c (mon.1) 1968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.003892+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.005054+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[31385]: audit 2021-03-10T16:15:14.005889+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:13.651775+0000 mon.c (mon.1) 1963 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:13.652895+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:13.829929+0000 mon.c (mon.1) 1964 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:13.831073+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.001255+0000 mon.c (mon.1) 1965 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:15:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.002023+0000 mon.c (mon.1) 1966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.002522+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:15:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.002721+0000 mon.c (mon.1) 1967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.003652+0000 mon.c (mon.1) 1968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.003892+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.005054+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:14 gibba003 bash[32348]: audit 2021-03-10T16:15:14.005889+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:13.651775+0000 mon.c (mon.1) 1963 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:13.652895+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:13.829929+0000 mon.c (mon.1) 1964 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:13.831073+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.001255+0000 mon.c (mon.1) 1965 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:15:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.002023+0000 mon.c (mon.1) 1966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.002522+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:15:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.002721+0000 mon.c (mon.1) 1967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.003652+0000 mon.c (mon.1) 1968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.003892+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.005054+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:14 gibba043 bash[24019]: audit 2021-03-10T16:15:14.005889+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:15 gibba003 bash[31385]: cluster 2021-03-10T16:15:13.490281+0000 mgr.gibba043.dnkmem (mgr.34373) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:15.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:15 gibba003 bash[32348]: cluster 2021-03-10T16:15:13.490281+0000 mgr.gibba043.dnkmem (mgr.34373) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:15 gibba043 bash[24019]: cluster 2021-03-10T16:15:13.490281+0000 mgr.gibba043.dnkmem (mgr.34373) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:17.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:17 gibba003 bash[31385]: cluster 2021-03-10T16:15:15.491568+0000 mgr.gibba043.dnkmem (mgr.34373) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:17.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:17 gibba003 bash[32348]: cluster 2021-03-10T16:15:15.491568+0000 mgr.gibba043.dnkmem (mgr.34373) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:17 gibba043 bash[24019]: cluster 2021-03-10T16:15:15.491568+0000 mgr.gibba043.dnkmem (mgr.34373) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:19.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cluster 2021-03-10T16:15:17.493002+0000 mgr.gibba043.dnkmem (mgr.34373) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.699510+0000 mgr.gibba043.dnkmem (mgr.34373) 7609 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:15:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.699570+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.703295+0000 mgr.gibba043.dnkmem (mgr.34373) 7610 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:15:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.703522+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.910765+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.912497+0000 mgr.gibba043.dnkmem (mgr.34373) 7611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.914189+0000 mgr.gibba043.dnkmem (mgr.34373) 7612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.914524+0000 mon.c (mon.1) 1969 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.915620+0000 mgr.gibba043.dnkmem (mgr.34373) 7613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.915675+0000 mgr.gibba043.dnkmem (mgr.34373) 7614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.916022+0000 mon.c (mon.1) 1970 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.916897+0000 mgr.gibba043.dnkmem (mgr.34373) 7615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.916935+0000 mgr.gibba043.dnkmem (mgr.34373) 7616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.917516+0000 mon.c (mon.1) 1971 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.917824+0000 mgr.gibba043.dnkmem (mgr.34373) 7617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.918551+0000 mon.c (mon.1) 1972 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.919023+0000 mgr.gibba043.dnkmem (mgr.34373) 7618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.919068+0000 mgr.gibba043.dnkmem (mgr.34373) 7619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.920158+0000 mgr.gibba043.dnkmem (mgr.34373) 7620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.920490+0000 mgr.gibba043.dnkmem (mgr.34373) 7621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:19.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.920755+0000 mon.c (mon.1) 1973 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.921324+0000 mgr.gibba043.dnkmem (mgr.34373) 7622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.921368+0000 mgr.gibba043.dnkmem (mgr.34373) 7623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: cephadm 2021-03-10T16:15:17.921476+0000 mgr.gibba043.dnkmem (mgr.34373) 7624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:19.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:18 gibba043 bash[24019]: audit 2021-03-10T16:15:17.922049+0000 mon.c (mon.1) 1974 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cluster 2021-03-10T16:15:17.493002+0000 mgr.gibba043.dnkmem (mgr.34373) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.699510+0000 mgr.gibba043.dnkmem (mgr.34373) 7609 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:15:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.699570+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.703295+0000 mgr.gibba043.dnkmem (mgr.34373) 7610 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:15:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.703522+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.910765+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.912497+0000 mgr.gibba043.dnkmem (mgr.34373) 7611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.914189+0000 mgr.gibba043.dnkmem (mgr.34373) 7612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.914524+0000 mon.c (mon.1) 1969 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.915620+0000 mgr.gibba043.dnkmem (mgr.34373) 7613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.915675+0000 mgr.gibba043.dnkmem (mgr.34373) 7614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.916022+0000 mon.c (mon.1) 1970 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.916897+0000 mgr.gibba043.dnkmem (mgr.34373) 7615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.916935+0000 mgr.gibba043.dnkmem (mgr.34373) 7616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.917516+0000 mon.c (mon.1) 1971 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.917824+0000 mgr.gibba043.dnkmem (mgr.34373) 7617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.918551+0000 mon.c (mon.1) 1972 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.919023+0000 mgr.gibba043.dnkmem (mgr.34373) 7618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.919068+0000 mgr.gibba043.dnkmem (mgr.34373) 7619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.920158+0000 mgr.gibba043.dnkmem (mgr.34373) 7620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.920490+0000 mgr.gibba043.dnkmem (mgr.34373) 7621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:19.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cluster 2021-03-10T16:15:17.493002+0000 mgr.gibba043.dnkmem (mgr.34373) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.699510+0000 mgr.gibba043.dnkmem (mgr.34373) 7609 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:15:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.699570+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.703295+0000 mgr.gibba043.dnkmem (mgr.34373) 7610 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:15:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.703522+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.910765+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:15:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.912497+0000 mgr.gibba043.dnkmem (mgr.34373) 7611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.914189+0000 mgr.gibba043.dnkmem (mgr.34373) 7612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.914524+0000 mon.c (mon.1) 1969 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.915620+0000 mgr.gibba043.dnkmem (mgr.34373) 7613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.915675+0000 mgr.gibba043.dnkmem (mgr.34373) 7614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.916022+0000 mon.c (mon.1) 1970 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.916897+0000 mgr.gibba043.dnkmem (mgr.34373) 7615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.916935+0000 mgr.gibba043.dnkmem (mgr.34373) 7616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.917516+0000 mon.c (mon.1) 1971 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.917824+0000 mgr.gibba043.dnkmem (mgr.34373) 7617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.918551+0000 mon.c (mon.1) 1972 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.919023+0000 mgr.gibba043.dnkmem (mgr.34373) 7618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.919068+0000 mgr.gibba043.dnkmem (mgr.34373) 7619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.920158+0000 mgr.gibba043.dnkmem (mgr.34373) 7620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:19.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.920490+0000 mgr.gibba043.dnkmem (mgr.34373) 7621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:19.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.920755+0000 mon.c (mon.1) 1973 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.921324+0000 mgr.gibba043.dnkmem (mgr.34373) 7622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:19.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.921368+0000 mgr.gibba043.dnkmem (mgr.34373) 7623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:19.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: cephadm 2021-03-10T16:15:17.921476+0000 mgr.gibba043.dnkmem (mgr.34373) 7624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:19.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[31385]: audit 2021-03-10T16:15:17.922049+0000 mon.c (mon.1) 1974 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.920755+0000 mon.c (mon.1) 1973 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:19.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.921324+0000 mgr.gibba043.dnkmem (mgr.34373) 7622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:19.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.921368+0000 mgr.gibba043.dnkmem (mgr.34373) 7623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:19.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: cephadm 2021-03-10T16:15:17.921476+0000 mgr.gibba043.dnkmem (mgr.34373) 7624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:19.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:18 gibba003 bash[32348]: audit 2021-03-10T16:15:17.922049+0000 mon.c (mon.1) 1974 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:21.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:20 gibba043 bash[24019]: cluster 2021-03-10T16:15:19.494919+0000 mgr.gibba043.dnkmem (mgr.34373) 7625 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:21.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:20 gibba003 bash[31385]: cluster 2021-03-10T16:15:19.494919+0000 mgr.gibba043.dnkmem (mgr.34373) 7625 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:21.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:20 gibba003 bash[32348]: cluster 2021-03-10T16:15:19.494919+0000 mgr.gibba043.dnkmem (mgr.34373) 7625 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:23.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:22 gibba043 bash[24019]: cluster 2021-03-10T16:15:21.495978+0000 mgr.gibba043.dnkmem (mgr.34373) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:23.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:22 gibba003 bash[31385]: cluster 2021-03-10T16:15:21.495978+0000 mgr.gibba043.dnkmem (mgr.34373) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:23.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:22 gibba003 bash[32348]: cluster 2021-03-10T16:15:21.495978+0000 mgr.gibba043.dnkmem (mgr.34373) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:25.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:24 gibba043 bash[24019]: cluster 2021-03-10T16:15:23.497658+0000 mgr.gibba043.dnkmem (mgr.34373) 7627 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:25.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:24 gibba003 bash[31385]: cluster 2021-03-10T16:15:23.497658+0000 mgr.gibba043.dnkmem (mgr.34373) 7627 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:25.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:24 gibba003 bash[32348]: cluster 2021-03-10T16:15:23.497658+0000 mgr.gibba043.dnkmem (mgr.34373) 7627 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:26.917 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:15:27.149 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:15:27.149 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:15:27.149 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:15:27.150 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:15:27.150 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:15:27.150 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:15:27.150 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:15:27.150 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:15:27.151 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:15:27.151 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:15:27.151 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:15:27.151 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:15:27.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:15:27.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:15:27.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:15:27.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:15:27.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:15:27.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:15:27.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:15:27.153 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:15:27.154 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:15:27.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:26 gibba043 bash[24019]: cluster 2021-03-10T16:15:25.499228+0000 mgr.gibba043.dnkmem (mgr.34373) 7628 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:27.395 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:15:27.395 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:15:27.396 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:27.396 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:15:27.396 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:15:27.396 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:27.397 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:15:27.397 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:15:27.397 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:15:27.397 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:15:27.397 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:15:27.398 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:15:27.398 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:15:27.398 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:15:27.398 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:15:27.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:26 gibba003 bash[31385]: cluster 2021-03-10T16:15:25.499228+0000 mgr.gibba043.dnkmem (mgr.34373) 7628 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:27.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:26 gibba003 bash[32348]: cluster 2021-03-10T16:15:25.499228+0000 mgr.gibba043.dnkmem (mgr.34373) 7628 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:27 gibba043 bash[24019]: audit 2021-03-10T16:15:26.909955+0000 mgr.gibba043.dnkmem (mgr.34373) 7629 : audit [DBG] from='client.59152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:27 gibba043 bash[24019]: audit 2021-03-10T16:15:27.137582+0000 mgr.gibba043.dnkmem (mgr.34373) 7630 : audit [DBG] from='client.59158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:28.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:27 gibba043 bash[24019]: audit 2021-03-10T16:15:27.397745+0000 mon.c (mon.1) 1975 : audit [DBG] from='client.? 172.21.2.103:0/1165350036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:27 gibba003 bash[31385]: audit 2021-03-10T16:15:26.909955+0000 mgr.gibba043.dnkmem (mgr.34373) 7629 : audit [DBG] from='client.59152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:27 gibba003 bash[31385]: audit 2021-03-10T16:15:27.137582+0000 mgr.gibba043.dnkmem (mgr.34373) 7630 : audit [DBG] from='client.59158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:27 gibba003 bash[31385]: audit 2021-03-10T16:15:27.397745+0000 mon.c (mon.1) 1975 : audit [DBG] from='client.? 172.21.2.103:0/1165350036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:27 gibba003 bash[32348]: audit 2021-03-10T16:15:26.909955+0000 mgr.gibba043.dnkmem (mgr.34373) 7629 : audit [DBG] from='client.59152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:27 gibba003 bash[32348]: audit 2021-03-10T16:15:27.137582+0000 mgr.gibba043.dnkmem (mgr.34373) 7630 : audit [DBG] from='client.59158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:27 gibba003 bash[32348]: audit 2021-03-10T16:15:27.397745+0000 mon.c (mon.1) 1975 : audit [DBG] from='client.? 172.21.2.103:0/1165350036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:29.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:28 gibba043 bash[24019]: cluster 2021-03-10T16:15:27.500965+0000 mgr.gibba043.dnkmem (mgr.34373) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:29.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:28 gibba003 bash[31385]: cluster 2021-03-10T16:15:27.500965+0000 mgr.gibba043.dnkmem (mgr.34373) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:29.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:28 gibba003 bash[32348]: cluster 2021-03-10T16:15:27.500965+0000 mgr.gibba043.dnkmem (mgr.34373) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:30 gibba043 bash[24019]: cluster 2021-03-10T16:15:29.502656+0000 mgr.gibba043.dnkmem (mgr.34373) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:31.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:30 gibba003 bash[31385]: cluster 2021-03-10T16:15:29.502656+0000 mgr.gibba043.dnkmem (mgr.34373) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:31.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:30 gibba003 bash[32348]: cluster 2021-03-10T16:15:29.502656+0000 mgr.gibba043.dnkmem (mgr.34373) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:33.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:32 gibba043 bash[24019]: cluster 2021-03-10T16:15:31.503612+0000 mgr.gibba043.dnkmem (mgr.34373) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:33.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:32 gibba003 bash[31385]: cluster 2021-03-10T16:15:31.503612+0000 mgr.gibba043.dnkmem (mgr.34373) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:33.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:32 gibba003 bash[32348]: cluster 2021-03-10T16:15:31.503612+0000 mgr.gibba043.dnkmem (mgr.34373) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:34.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:34 gibba043 bash[24019]: cephadm 2021-03-10T16:15:32.928715+0000 mgr.gibba043.dnkmem (mgr.34373) 7634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:34.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:34 gibba003 bash[31385]: cephadm 2021-03-10T16:15:32.928715+0000 mgr.gibba043.dnkmem (mgr.34373) 7634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:34.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:34 gibba003 bash[32348]: cephadm 2021-03-10T16:15:32.928715+0000 mgr.gibba043.dnkmem (mgr.34373) 7634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:35.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:35 gibba043 bash[24019]: cluster 2021-03-10T16:15:33.505068+0000 mgr.gibba043.dnkmem (mgr.34373) 7635 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:35.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:35 gibba003 bash[31385]: cluster 2021-03-10T16:15:33.505068+0000 mgr.gibba043.dnkmem (mgr.34373) 7635 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:35.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:35 gibba003 bash[32348]: cluster 2021-03-10T16:15:33.505068+0000 mgr.gibba043.dnkmem (mgr.34373) 7635 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:37.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:37 gibba043 bash[24019]: cluster 2021-03-10T16:15:35.506588+0000 mgr.gibba043.dnkmem (mgr.34373) 7636 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:37.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:37 gibba003 bash[31385]: cluster 2021-03-10T16:15:35.506588+0000 mgr.gibba043.dnkmem (mgr.34373) 7636 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:37.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:37 gibba003 bash[32348]: cluster 2021-03-10T16:15:35.506588+0000 mgr.gibba043.dnkmem (mgr.34373) 7636 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:39.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:39 gibba003 bash[31385]: cluster 2021-03-10T16:15:37.508369+0000 mgr.gibba043.dnkmem (mgr.34373) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:39.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:39 gibba003 bash[32348]: cluster 2021-03-10T16:15:37.508369+0000 mgr.gibba043.dnkmem (mgr.34373) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:39.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:39 gibba043 bash[24019]: cluster 2021-03-10T16:15:37.508369+0000 mgr.gibba043.dnkmem (mgr.34373) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:41.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:41 gibba003 bash[31385]: cluster 2021-03-10T16:15:39.510107+0000 mgr.gibba043.dnkmem (mgr.34373) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:41.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:41 gibba003 bash[32348]: cluster 2021-03-10T16:15:39.510107+0000 mgr.gibba043.dnkmem (mgr.34373) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:41.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:41 gibba043 bash[24019]: cluster 2021-03-10T16:15:39.510107+0000 mgr.gibba043.dnkmem (mgr.34373) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:43 gibba003 bash[31385]: cluster 2021-03-10T16:15:41.511108+0000 mgr.gibba043.dnkmem (mgr.34373) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:43 gibba003 bash[32348]: cluster 2021-03-10T16:15:41.511108+0000 mgr.gibba043.dnkmem (mgr.34373) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:43 gibba043 bash[24019]: cluster 2021-03-10T16:15:41.511108+0000 mgr.gibba043.dnkmem (mgr.34373) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:45.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:45 gibba003 bash[31385]: cluster 2021-03-10T16:15:43.512740+0000 mgr.gibba043.dnkmem (mgr.34373) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:45.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:45 gibba003 bash[32348]: cluster 2021-03-10T16:15:43.512740+0000 mgr.gibba043.dnkmem (mgr.34373) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:45.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:45 gibba043 bash[24019]: cluster 2021-03-10T16:15:43.512740+0000 mgr.gibba043.dnkmem (mgr.34373) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:47 gibba003 bash[31385]: cluster 2021-03-10T16:15:45.514234+0000 mgr.gibba043.dnkmem (mgr.34373) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:47 gibba003 bash[32348]: cluster 2021-03-10T16:15:45.514234+0000 mgr.gibba043.dnkmem (mgr.34373) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:47 gibba043 bash[24019]: cluster 2021-03-10T16:15:45.514234+0000 mgr.gibba043.dnkmem (mgr.34373) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:49 gibba003 bash[31385]: cluster 2021-03-10T16:15:47.515930+0000 mgr.gibba043.dnkmem (mgr.34373) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:49 gibba003 bash[31385]: cephadm 2021-03-10T16:15:47.944773+0000 mgr.gibba043.dnkmem (mgr.34373) 7643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:49 gibba003 bash[32348]: cluster 2021-03-10T16:15:47.515930+0000 mgr.gibba043.dnkmem (mgr.34373) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:49 gibba003 bash[32348]: cephadm 2021-03-10T16:15:47.944773+0000 mgr.gibba043.dnkmem (mgr.34373) 7643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:49 gibba043 bash[24019]: cluster 2021-03-10T16:15:47.515930+0000 mgr.gibba043.dnkmem (mgr.34373) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:49 gibba043 bash[24019]: cephadm 2021-03-10T16:15:47.944773+0000 mgr.gibba043.dnkmem (mgr.34373) 7643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:15:51.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:51 gibba003 bash[31385]: cluster 2021-03-10T16:15:49.517471+0000 mgr.gibba043.dnkmem (mgr.34373) 7644 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:51.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:51 gibba003 bash[32348]: cluster 2021-03-10T16:15:49.517471+0000 mgr.gibba043.dnkmem (mgr.34373) 7644 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:51 gibba043 bash[24019]: cluster 2021-03-10T16:15:49.517471+0000 mgr.gibba043.dnkmem (mgr.34373) 7644 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:53 gibba003 bash[31385]: cluster 2021-03-10T16:15:51.518552+0000 mgr.gibba043.dnkmem (mgr.34373) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:53 gibba003 bash[32348]: cluster 2021-03-10T16:15:51.518552+0000 mgr.gibba043.dnkmem (mgr.34373) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:53 gibba043 bash[24019]: cluster 2021-03-10T16:15:51.518552+0000 mgr.gibba043.dnkmem (mgr.34373) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:55.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:55 gibba003 bash[31385]: cluster 2021-03-10T16:15:53.520025+0000 mgr.gibba043.dnkmem (mgr.34373) 7646 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:55.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:55 gibba003 bash[32348]: cluster 2021-03-10T16:15:53.520025+0000 mgr.gibba043.dnkmem (mgr.34373) 7646 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:55 gibba043 bash[24019]: cluster 2021-03-10T16:15:53.520025+0000 mgr.gibba043.dnkmem (mgr.34373) 7646 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:57 gibba003 bash[31385]: cluster 2021-03-10T16:15:55.521746+0000 mgr.gibba043.dnkmem (mgr.34373) 7647 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:57 gibba003 bash[32348]: cluster 2021-03-10T16:15:55.521746+0000 mgr.gibba043.dnkmem (mgr.34373) 7647 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:57 gibba043 bash[24019]: cluster 2021-03-10T16:15:55.521746+0000 mgr.gibba043.dnkmem (mgr.34373) 7647 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.637 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:15:57.866 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:15:57.867 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:15:57.867 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:15:57.867 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:15:57.867 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:15:57.868 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:15:57.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:15:57.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:15:57.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:15:57.869 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:15:57.869 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:15:57.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:15:57.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:15:57.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:15:57.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:15:57.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:15:57.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:15:57.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:15:57.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:15:57.871 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:15:57.871 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:15:58.115 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:15:58.116 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:15:58.116 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:58.116 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:15:58.116 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:15:58.117 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:58.117 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:15:58.117 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:15:58.117 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:15:58.118 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:15:58.118 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:15:58.118 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:15:58.118 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:15:58.119 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:15:58.119 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:15:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[31385]: cluster 2021-03-10T16:15:57.523139+0000 mgr.gibba043.dnkmem (mgr.34373) 7648 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[31385]: audit 2021-03-10T16:15:57.629715+0000 mgr.gibba043.dnkmem (mgr.34373) 7649 : audit [DBG] from='client.59170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[31385]: audit 2021-03-10T16:15:57.855842+0000 mgr.gibba043.dnkmem (mgr.34373) 7650 : audit [DBG] from='client.59176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[31385]: audit 2021-03-10T16:15:58.117946+0000 mon.a (mon.0) 1670 : audit [DBG] from='client.? 172.21.2.103:0/3780260142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[32348]: cluster 2021-03-10T16:15:57.523139+0000 mgr.gibba043.dnkmem (mgr.34373) 7648 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[32348]: audit 2021-03-10T16:15:57.629715+0000 mgr.gibba043.dnkmem (mgr.34373) 7649 : audit [DBG] from='client.59170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:59.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[32348]: audit 2021-03-10T16:15:57.855842+0000 mgr.gibba043.dnkmem (mgr.34373) 7650 : audit [DBG] from='client.59176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:15:59 gibba003 bash[32348]: audit 2021-03-10T16:15:58.117946+0000 mon.a (mon.0) 1670 : audit [DBG] from='client.? 172.21.2.103:0/3780260142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:59 gibba043 bash[24019]: cluster 2021-03-10T16:15:57.523139+0000 mgr.gibba043.dnkmem (mgr.34373) 7648 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:59 gibba043 bash[24019]: audit 2021-03-10T16:15:57.629715+0000 mgr.gibba043.dnkmem (mgr.34373) 7649 : audit [DBG] from='client.59170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:59 gibba043 bash[24019]: audit 2021-03-10T16:15:57.855842+0000 mgr.gibba043.dnkmem (mgr.34373) 7650 : audit [DBG] from='client.59176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:15:59 gibba043 bash[24019]: audit 2021-03-10T16:15:58.117946+0000 mon.a (mon.0) 1670 : audit [DBG] from='client.? 172.21.2.103:0/3780260142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:01.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:01 gibba003 bash[31385]: cluster 2021-03-10T16:15:59.524829+0000 mgr.gibba043.dnkmem (mgr.34373) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:01.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:01 gibba003 bash[32348]: cluster 2021-03-10T16:15:59.524829+0000 mgr.gibba043.dnkmem (mgr.34373) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:01 gibba043 bash[24019]: cluster 2021-03-10T16:15:59.524829+0000 mgr.gibba043.dnkmem (mgr.34373) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:03.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:03 gibba043 bash[24019]: cluster 2021-03-10T16:16:01.525694+0000 mgr.gibba043.dnkmem (mgr.34373) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:03.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:03 gibba003 bash[31385]: cluster 2021-03-10T16:16:01.525694+0000 mgr.gibba043.dnkmem (mgr.34373) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:03.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:03 gibba003 bash[32348]: cluster 2021-03-10T16:16:01.525694+0000 mgr.gibba043.dnkmem (mgr.34373) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:04 gibba003 bash[31385]: cephadm 2021-03-10T16:16:02.960882+0000 mgr.gibba043.dnkmem (mgr.34373) 7653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:04.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:04 gibba003 bash[32348]: cephadm 2021-03-10T16:16:02.960882+0000 mgr.gibba043.dnkmem (mgr.34373) 7653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:04 gibba043 bash[24019]: cephadm 2021-03-10T16:16:02.960882+0000 mgr.gibba043.dnkmem (mgr.34373) 7653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:05 gibba003 bash[31385]: cluster 2021-03-10T16:16:03.527216+0000 mgr.gibba043.dnkmem (mgr.34373) 7654 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:05.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:05 gibba003 bash[32348]: cluster 2021-03-10T16:16:03.527216+0000 mgr.gibba043.dnkmem (mgr.34373) 7654 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:05 gibba043 bash[24019]: cluster 2021-03-10T16:16:03.527216+0000 mgr.gibba043.dnkmem (mgr.34373) 7654 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:07 gibba003 bash[31385]: cluster 2021-03-10T16:16:05.528529+0000 mgr.gibba043.dnkmem (mgr.34373) 7655 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:07 gibba003 bash[32348]: cluster 2021-03-10T16:16:05.528529+0000 mgr.gibba043.dnkmem (mgr.34373) 7655 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:07 gibba043 bash[24019]: cluster 2021-03-10T16:16:05.528529+0000 mgr.gibba043.dnkmem (mgr.34373) 7655 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:09.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:09 gibba003 bash[31385]: cluster 2021-03-10T16:16:07.530045+0000 mgr.gibba043.dnkmem (mgr.34373) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:09.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:09 gibba003 bash[32348]: cluster 2021-03-10T16:16:07.530045+0000 mgr.gibba043.dnkmem (mgr.34373) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:09 gibba043 bash[24019]: cluster 2021-03-10T16:16:07.530045+0000 mgr.gibba043.dnkmem (mgr.34373) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:11.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:11 gibba003 bash[31385]: cluster 2021-03-10T16:16:09.531771+0000 mgr.gibba043.dnkmem (mgr.34373) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:11.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:11 gibba003 bash[32348]: cluster 2021-03-10T16:16:09.531771+0000 mgr.gibba043.dnkmem (mgr.34373) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:11 gibba043 bash[24019]: cluster 2021-03-10T16:16:09.531771+0000 mgr.gibba043.dnkmem (mgr.34373) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:13.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:13 gibba003 bash[31385]: cluster 2021-03-10T16:16:11.532655+0000 mgr.gibba043.dnkmem (mgr.34373) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:13 gibba003 bash[32348]: cluster 2021-03-10T16:16:11.532655+0000 mgr.gibba043.dnkmem (mgr.34373) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:13 gibba043 bash[24019]: cluster 2021-03-10T16:16:11.532655+0000 mgr.gibba043.dnkmem (mgr.34373) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:13.658595+0000 mon.c (mon.1) 1976 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:13.659745+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:13.838780+0000 mon.c (mon.1) 1977 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:13.839981+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.011452+0000 mon.c (mon.1) 1978 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.012214+0000 mon.c (mon.1) 1979 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.012708+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.013230+0000 mon.c (mon.1) 1980 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:16:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.013903+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.014678+0000 mon.c (mon.1) 1981 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.015662+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:16:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:14 gibba043 bash[24019]: audit 2021-03-10T16:16:14.016745+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:13.658595+0000 mon.c (mon.1) 1976 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:13.659745+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:13.838780+0000 mon.c (mon.1) 1977 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:13.839981+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.011452+0000 mon.c (mon.1) 1978 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.012214+0000 mon.c (mon.1) 1979 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.012708+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.013230+0000 mon.c (mon.1) 1980 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:16:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.013903+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.014678+0000 mon.c (mon.1) 1981 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.015662+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:16:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[31385]: audit 2021-03-10T16:16:14.016745+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:13.658595+0000 mon.c (mon.1) 1976 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:13.659745+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:13.838780+0000 mon.c (mon.1) 1977 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:13.839981+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.011452+0000 mon.c (mon.1) 1978 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.012214+0000 mon.c (mon.1) 1979 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.012708+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.013230+0000 mon.c (mon.1) 1980 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:16:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.013903+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.014678+0000 mon.c (mon.1) 1981 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:16:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.015662+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:16:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:14 gibba003 bash[32348]: audit 2021-03-10T16:16:14.016745+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:16:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:15 gibba043 bash[24019]: cluster 2021-03-10T16:16:13.534097+0000 mgr.gibba043.dnkmem (mgr.34373) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:15 gibba003 bash[31385]: cluster 2021-03-10T16:16:13.534097+0000 mgr.gibba043.dnkmem (mgr.34373) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:15.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:15 gibba003 bash[32348]: cluster 2021-03-10T16:16:13.534097+0000 mgr.gibba043.dnkmem (mgr.34373) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:17 gibba043 bash[24019]: cluster 2021-03-10T16:16:15.535519+0000 mgr.gibba043.dnkmem (mgr.34373) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:17 gibba003 bash[31385]: cluster 2021-03-10T16:16:15.535519+0000 mgr.gibba043.dnkmem (mgr.34373) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:17.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:17 gibba003 bash[32348]: cluster 2021-03-10T16:16:15.535519+0000 mgr.gibba043.dnkmem (mgr.34373) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cluster 2021-03-10T16:16:17.537156+0000 mgr.gibba043.dnkmem (mgr.34373) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:17.977748+0000 mgr.gibba043.dnkmem (mgr.34373) 7662 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:16:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:17.979303+0000 mgr.gibba043.dnkmem (mgr.34373) 7663 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:16:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.199925+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:16:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.201676+0000 mgr.gibba043.dnkmem (mgr.34373) 7664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.203942+0000 mgr.gibba043.dnkmem (mgr.34373) 7665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.203991+0000 mon.c (mon.1) 1982 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.205570+0000 mgr.gibba043.dnkmem (mgr.34373) 7666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.205607+0000 mgr.gibba043.dnkmem (mgr.34373) 7667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.205701+0000 mon.c (mon.1) 1983 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.207106+0000 mgr.gibba043.dnkmem (mgr.34373) 7668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.207144+0000 mgr.gibba043.dnkmem (mgr.34373) 7669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.207510+0000 mon.c (mon.1) 1984 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.208822+0000 mgr.gibba043.dnkmem (mgr.34373) 7670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.208902+0000 mon.c (mon.1) 1985 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.212281+0000 mgr.gibba043.dnkmem (mgr.34373) 7671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.212317+0000 mgr.gibba043.dnkmem (mgr.34373) 7672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.213989+0000 mgr.gibba043.dnkmem (mgr.34373) 7673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.214144+0000 mon.c (mon.1) 1986 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.214297+0000 mgr.gibba043.dnkmem (mgr.34373) 7674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: audit 2021-03-10T16:16:18.216103+0000 mon.c (mon.1) 1987 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.216181+0000 mgr.gibba043.dnkmem (mgr.34373) 7675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.216217+0000 mgr.gibba043.dnkmem (mgr.34373) 7676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:19 gibba043 bash[24019]: cephadm 2021-03-10T16:16:18.216320+0000 mgr.gibba043.dnkmem (mgr.34373) 7677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cluster 2021-03-10T16:16:17.537156+0000 mgr.gibba043.dnkmem (mgr.34373) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:17.977748+0000 mgr.gibba043.dnkmem (mgr.34373) 7662 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:16:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:17.979303+0000 mgr.gibba043.dnkmem (mgr.34373) 7663 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:16:19.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.199925+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:16:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.201676+0000 mgr.gibba043.dnkmem (mgr.34373) 7664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.203942+0000 mgr.gibba043.dnkmem (mgr.34373) 7665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.203991+0000 mon.c (mon.1) 1982 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.205570+0000 mgr.gibba043.dnkmem (mgr.34373) 7666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.205607+0000 mgr.gibba043.dnkmem (mgr.34373) 7667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.205701+0000 mon.c (mon.1) 1983 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.207106+0000 mgr.gibba043.dnkmem (mgr.34373) 7668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.207144+0000 mgr.gibba043.dnkmem (mgr.34373) 7669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.207510+0000 mon.c (mon.1) 1984 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.208822+0000 mgr.gibba043.dnkmem (mgr.34373) 7670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.208902+0000 mon.c (mon.1) 1985 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.212281+0000 mgr.gibba043.dnkmem (mgr.34373) 7671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.212317+0000 mgr.gibba043.dnkmem (mgr.34373) 7672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.213989+0000 mgr.gibba043.dnkmem (mgr.34373) 7673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.214144+0000 mon.c (mon.1) 1986 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.214297+0000 mgr.gibba043.dnkmem (mgr.34373) 7674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:19.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: audit 2021-03-10T16:16:18.216103+0000 mon.c (mon.1) 1987 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cluster 2021-03-10T16:16:17.537156+0000 mgr.gibba043.dnkmem (mgr.34373) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:17.977748+0000 mgr.gibba043.dnkmem (mgr.34373) 7662 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:16:19.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:17.979303+0000 mgr.gibba043.dnkmem (mgr.34373) 7663 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:16:19.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.199925+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:16:19.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.201676+0000 mgr.gibba043.dnkmem (mgr.34373) 7664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:19.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.203942+0000 mgr.gibba043.dnkmem (mgr.34373) 7665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:19.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.203991+0000 mon.c (mon.1) 1982 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:19.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.205570+0000 mgr.gibba043.dnkmem (mgr.34373) 7666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:19.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.205607+0000 mgr.gibba043.dnkmem (mgr.34373) 7667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:19.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.205701+0000 mon.c (mon.1) 1983 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.207106+0000 mgr.gibba043.dnkmem (mgr.34373) 7668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:19.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.207144+0000 mgr.gibba043.dnkmem (mgr.34373) 7669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:19.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.207510+0000 mon.c (mon.1) 1984 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.208822+0000 mgr.gibba043.dnkmem (mgr.34373) 7670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:19.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.208902+0000 mon.c (mon.1) 1985 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.212281+0000 mgr.gibba043.dnkmem (mgr.34373) 7671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.212317+0000 mgr.gibba043.dnkmem (mgr.34373) 7672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.213989+0000 mgr.gibba043.dnkmem (mgr.34373) 7673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.214144+0000 mon.c (mon.1) 1986 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.214297+0000 mgr.gibba043.dnkmem (mgr.34373) 7674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: audit 2021-03-10T16:16:18.216103+0000 mon.c (mon.1) 1987 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.216181+0000 mgr.gibba043.dnkmem (mgr.34373) 7675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.216217+0000 mgr.gibba043.dnkmem (mgr.34373) 7676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:19.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[32348]: cephadm 2021-03-10T16:16:18.216320+0000 mgr.gibba043.dnkmem (mgr.34373) 7677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:19.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.216181+0000 mgr.gibba043.dnkmem (mgr.34373) 7675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:19.701 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.216217+0000 mgr.gibba043.dnkmem (mgr.34373) 7676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:19.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:19 gibba003 bash[31385]: cephadm 2021-03-10T16:16:18.216320+0000 mgr.gibba043.dnkmem (mgr.34373) 7677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:21 gibba043 bash[24019]: cluster 2021-03-10T16:16:19.538930+0000 mgr.gibba043.dnkmem (mgr.34373) 7678 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:21 gibba003 bash[31385]: cluster 2021-03-10T16:16:19.538930+0000 mgr.gibba043.dnkmem (mgr.34373) 7678 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:21.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:21 gibba003 bash[32348]: cluster 2021-03-10T16:16:19.538930+0000 mgr.gibba043.dnkmem (mgr.34373) 7678 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:23 gibba043 bash[24019]: cluster 2021-03-10T16:16:21.540748+0000 mgr.gibba043.dnkmem (mgr.34373) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:23 gibba003 bash[31385]: cluster 2021-03-10T16:16:21.540748+0000 mgr.gibba043.dnkmem (mgr.34373) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:23 gibba003 bash[32348]: cluster 2021-03-10T16:16:21.540748+0000 mgr.gibba043.dnkmem (mgr.34373) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:25 gibba043 bash[24019]: cluster 2021-03-10T16:16:23.542210+0000 mgr.gibba043.dnkmem (mgr.34373) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:25.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:25 gibba003 bash[31385]: cluster 2021-03-10T16:16:23.542210+0000 mgr.gibba043.dnkmem (mgr.34373) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:25.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:25 gibba003 bash[32348]: cluster 2021-03-10T16:16:23.542210+0000 mgr.gibba043.dnkmem (mgr.34373) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:27 gibba043 bash[24019]: cluster 2021-03-10T16:16:25.543458+0000 mgr.gibba043.dnkmem (mgr.34373) 7681 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:27 gibba003 bash[31385]: cluster 2021-03-10T16:16:25.543458+0000 mgr.gibba043.dnkmem (mgr.34373) 7681 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:27 gibba003 bash[32348]: cluster 2021-03-10T16:16:25.543458+0000 mgr.gibba043.dnkmem (mgr.34373) 7681 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:28.360 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:16:28.589 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:16:28.589 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:16:28.589 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:16:28.590 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:16:28.590 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:16:28.590 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:16:28.590 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:16:28.591 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:16:28.591 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:16:28.591 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:16:28.591 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:16:28.592 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:16:28.592 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:16:28.592 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:16:28.592 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:16:28.593 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:16:28.593 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:16:28.593 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:16:28.593 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:16:28.594 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:16:28.594 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:16:28.842 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:16:28.843 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:16:28.843 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:28.843 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:16:28.843 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:16:28.843 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:28.844 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:16:28.844 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:16:28.844 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:16:28.844 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:16:28.845 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:16:28.845 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:16:28.845 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:16:28.845 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:16:28.846 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:16:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:29 gibba043 bash[24019]: cluster 2021-03-10T16:16:27.544786+0000 mgr.gibba043.dnkmem (mgr.34373) 7682 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:29 gibba043 bash[24019]: audit 2021-03-10T16:16:28.351743+0000 mgr.gibba043.dnkmem (mgr.34373) 7683 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:29 gibba043 bash[24019]: audit 2021-03-10T16:16:28.844465+0000 mon.c (mon.1) 1988 : audit [DBG] from='client.? 172.21.2.103:0/1723283434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:29.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:29 gibba003 bash[31385]: cluster 2021-03-10T16:16:27.544786+0000 mgr.gibba043.dnkmem (mgr.34373) 7682 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:29 gibba003 bash[31385]: audit 2021-03-10T16:16:28.351743+0000 mgr.gibba043.dnkmem (mgr.34373) 7683 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:29 gibba003 bash[31385]: audit 2021-03-10T16:16:28.844465+0000 mon.c (mon.1) 1988 : audit [DBG] from='client.? 172.21.2.103:0/1723283434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:29.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:29 gibba003 bash[32348]: cluster 2021-03-10T16:16:27.544786+0000 mgr.gibba043.dnkmem (mgr.34373) 7682 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:29 gibba003 bash[32348]: audit 2021-03-10T16:16:28.351743+0000 mgr.gibba043.dnkmem (mgr.34373) 7683 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:29 gibba003 bash[32348]: audit 2021-03-10T16:16:28.844465+0000 mon.c (mon.1) 1988 : audit [DBG] from='client.? 172.21.2.103:0/1723283434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:30.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:30 gibba043 bash[24019]: audit 2021-03-10T16:16:28.578094+0000 mgr.gibba043.dnkmem (mgr.34373) 7684 : audit [DBG] from='client.49206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:30 gibba003 bash[31385]: audit 2021-03-10T16:16:28.578094+0000 mgr.gibba043.dnkmem (mgr.34373) 7684 : audit [DBG] from='client.49206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:30 gibba003 bash[32348]: audit 2021-03-10T16:16:28.578094+0000 mgr.gibba043.dnkmem (mgr.34373) 7684 : audit [DBG] from='client.49206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:31 gibba043 bash[24019]: cluster 2021-03-10T16:16:29.546310+0000 mgr.gibba043.dnkmem (mgr.34373) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:31.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:31 gibba003 bash[31385]: cluster 2021-03-10T16:16:29.546310+0000 mgr.gibba043.dnkmem (mgr.34373) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:31.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:31 gibba003 bash[32348]: cluster 2021-03-10T16:16:29.546310+0000 mgr.gibba043.dnkmem (mgr.34373) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:33 gibba043 bash[24019]: cluster 2021-03-10T16:16:31.547827+0000 mgr.gibba043.dnkmem (mgr.34373) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:33 gibba003 bash[31385]: cluster 2021-03-10T16:16:31.547827+0000 mgr.gibba043.dnkmem (mgr.34373) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:33 gibba003 bash[32348]: cluster 2021-03-10T16:16:31.547827+0000 mgr.gibba043.dnkmem (mgr.34373) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:34 gibba003 bash[31385]: cephadm 2021-03-10T16:16:33.232052+0000 mgr.gibba043.dnkmem (mgr.34373) 7687 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:34 gibba003 bash[32348]: cephadm 2021-03-10T16:16:33.232052+0000 mgr.gibba043.dnkmem (mgr.34373) 7687 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:34 gibba043 bash[24019]: cephadm 2021-03-10T16:16:33.232052+0000 mgr.gibba043.dnkmem (mgr.34373) 7687 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:35 gibba003 bash[31385]: cluster 2021-03-10T16:16:33.549164+0000 mgr.gibba043.dnkmem (mgr.34373) 7688 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:35 gibba003 bash[32348]: cluster 2021-03-10T16:16:33.549164+0000 mgr.gibba043.dnkmem (mgr.34373) 7688 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:35 gibba043 bash[24019]: cluster 2021-03-10T16:16:33.549164+0000 mgr.gibba043.dnkmem (mgr.34373) 7688 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:37 gibba003 bash[31385]: cluster 2021-03-10T16:16:35.550556+0000 mgr.gibba043.dnkmem (mgr.34373) 7689 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:37 gibba003 bash[32348]: cluster 2021-03-10T16:16:35.550556+0000 mgr.gibba043.dnkmem (mgr.34373) 7689 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:37 gibba043 bash[24019]: cluster 2021-03-10T16:16:35.550556+0000 mgr.gibba043.dnkmem (mgr.34373) 7689 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:39 gibba003 bash[31385]: cluster 2021-03-10T16:16:37.552134+0000 mgr.gibba043.dnkmem (mgr.34373) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:39 gibba003 bash[32348]: cluster 2021-03-10T16:16:37.552134+0000 mgr.gibba043.dnkmem (mgr.34373) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:39 gibba043 bash[24019]: cluster 2021-03-10T16:16:37.552134+0000 mgr.gibba043.dnkmem (mgr.34373) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:41 gibba003 bash[31385]: cluster 2021-03-10T16:16:39.553635+0000 mgr.gibba043.dnkmem (mgr.34373) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:41.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:41 gibba003 bash[32348]: cluster 2021-03-10T16:16:39.553635+0000 mgr.gibba043.dnkmem (mgr.34373) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:41 gibba043 bash[24019]: cluster 2021-03-10T16:16:39.553635+0000 mgr.gibba043.dnkmem (mgr.34373) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:43 gibba003 bash[31385]: cluster 2021-03-10T16:16:41.555111+0000 mgr.gibba043.dnkmem (mgr.34373) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:43 gibba003 bash[32348]: cluster 2021-03-10T16:16:41.555111+0000 mgr.gibba043.dnkmem (mgr.34373) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:43 gibba043 bash[24019]: cluster 2021-03-10T16:16:41.555111+0000 mgr.gibba043.dnkmem (mgr.34373) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:45 gibba003 bash[31385]: cluster 2021-03-10T16:16:43.556680+0000 mgr.gibba043.dnkmem (mgr.34373) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:45 gibba003 bash[32348]: cluster 2021-03-10T16:16:43.556680+0000 mgr.gibba043.dnkmem (mgr.34373) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:45 gibba043 bash[24019]: cluster 2021-03-10T16:16:43.556680+0000 mgr.gibba043.dnkmem (mgr.34373) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:47 gibba003 bash[31385]: cluster 2021-03-10T16:16:45.557977+0000 mgr.gibba043.dnkmem (mgr.34373) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:47 gibba003 bash[32348]: cluster 2021-03-10T16:16:45.557977+0000 mgr.gibba043.dnkmem (mgr.34373) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:47 gibba043 bash[24019]: cluster 2021-03-10T16:16:45.557977+0000 mgr.gibba043.dnkmem (mgr.34373) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:49 gibba003 bash[31385]: cluster 2021-03-10T16:16:47.559528+0000 mgr.gibba043.dnkmem (mgr.34373) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:49 gibba003 bash[31385]: cephadm 2021-03-10T16:16:48.247906+0000 mgr.gibba043.dnkmem (mgr.34373) 7696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:49 gibba003 bash[32348]: cluster 2021-03-10T16:16:47.559528+0000 mgr.gibba043.dnkmem (mgr.34373) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:49 gibba003 bash[32348]: cephadm 2021-03-10T16:16:48.247906+0000 mgr.gibba043.dnkmem (mgr.34373) 7696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:49 gibba043 bash[24019]: cluster 2021-03-10T16:16:47.559528+0000 mgr.gibba043.dnkmem (mgr.34373) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:49 gibba043 bash[24019]: cephadm 2021-03-10T16:16:48.247906+0000 mgr.gibba043.dnkmem (mgr.34373) 7696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:16:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:51 gibba003 bash[31385]: cluster 2021-03-10T16:16:49.561154+0000 mgr.gibba043.dnkmem (mgr.34373) 7697 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:51 gibba003 bash[32348]: cluster 2021-03-10T16:16:49.561154+0000 mgr.gibba043.dnkmem (mgr.34373) 7697 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:51 gibba043 bash[24019]: cluster 2021-03-10T16:16:49.561154+0000 mgr.gibba043.dnkmem (mgr.34373) 7697 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:53 gibba003 bash[31385]: cluster 2021-03-10T16:16:51.562988+0000 mgr.gibba043.dnkmem (mgr.34373) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:53 gibba003 bash[32348]: cluster 2021-03-10T16:16:51.562988+0000 mgr.gibba043.dnkmem (mgr.34373) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:53 gibba043 bash[24019]: cluster 2021-03-10T16:16:51.562988+0000 mgr.gibba043.dnkmem (mgr.34373) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:55 gibba003 bash[31385]: cluster 2021-03-10T16:16:53.564643+0000 mgr.gibba043.dnkmem (mgr.34373) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:55 gibba003 bash[32348]: cluster 2021-03-10T16:16:53.564643+0000 mgr.gibba043.dnkmem (mgr.34373) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:55 gibba043 bash[24019]: cluster 2021-03-10T16:16:53.564643+0000 mgr.gibba043.dnkmem (mgr.34373) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:57 gibba003 bash[31385]: cluster 2021-03-10T16:16:55.566213+0000 mgr.gibba043.dnkmem (mgr.34373) 7700 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:57 gibba003 bash[32348]: cluster 2021-03-10T16:16:55.566213+0000 mgr.gibba043.dnkmem (mgr.34373) 7700 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:57 gibba043 bash[24019]: cluster 2021-03-10T16:16:55.566213+0000 mgr.gibba043.dnkmem (mgr.34373) 7700 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:59.083 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:16:59.312 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:16:59.313 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:16:59.313 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:16:59.313 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:16:59.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:16:59.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:16:59.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:16:59.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:16:59.315 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:16:59.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:16:59.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:16:59.315 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:16:59.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:16:59.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:16:59.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:16:59.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:16:59.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:16:59.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:16:59.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:16:59.317 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:16:59.317 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:16:59.565 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:16:59.566 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:16:59.566 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:59.566 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:16:59.567 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:16:59.567 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:59.567 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:16:59.567 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:16:59.568 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:16:59.568 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:16:59.568 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:16:59.568 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:16:59.569 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:16:59.569 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:16:59.569 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:16:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:16:59 gibba003 bash[31385]: cluster 2021-03-10T16:16:57.567763+0000 mgr.gibba043.dnkmem (mgr.34373) 7701 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:16:59 gibba003 bash[32348]: cluster 2021-03-10T16:16:57.567763+0000 mgr.gibba043.dnkmem (mgr.34373) 7701 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:16:59 gibba043 bash[24019]: cluster 2021-03-10T16:16:57.567763+0000 mgr.gibba043.dnkmem (mgr.34373) 7701 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:00 gibba003 bash[31385]: audit 2021-03-10T16:16:59.075657+0000 mgr.gibba043.dnkmem (mgr.34373) 7702 : audit [DBG] from='client.59206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:00 gibba003 bash[31385]: audit 2021-03-10T16:16:59.301770+0000 mgr.gibba043.dnkmem (mgr.34373) 7703 : audit [DBG] from='client.59212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:00 gibba003 bash[31385]: audit 2021-03-10T16:16:59.568110+0000 mon.c (mon.1) 1989 : audit [DBG] from='client.? 172.21.2.103:0/3384639570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:00 gibba003 bash[32348]: audit 2021-03-10T16:16:59.075657+0000 mgr.gibba043.dnkmem (mgr.34373) 7702 : audit [DBG] from='client.59206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:00 gibba003 bash[32348]: audit 2021-03-10T16:16:59.301770+0000 mgr.gibba043.dnkmem (mgr.34373) 7703 : audit [DBG] from='client.59212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:00 gibba003 bash[32348]: audit 2021-03-10T16:16:59.568110+0000 mon.c (mon.1) 1989 : audit [DBG] from='client.? 172.21.2.103:0/3384639570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:00.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:00 gibba043 bash[24019]: audit 2021-03-10T16:16:59.075657+0000 mgr.gibba043.dnkmem (mgr.34373) 7702 : audit [DBG] from='client.59206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:00 gibba043 bash[24019]: audit 2021-03-10T16:16:59.301770+0000 mgr.gibba043.dnkmem (mgr.34373) 7703 : audit [DBG] from='client.59212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:00 gibba043 bash[24019]: audit 2021-03-10T16:16:59.568110+0000 mon.c (mon.1) 1989 : audit [DBG] from='client.? 172.21.2.103:0/3384639570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:01 gibba003 bash[31385]: cluster 2021-03-10T16:16:59.569559+0000 mgr.gibba043.dnkmem (mgr.34373) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:01.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:01 gibba003 bash[32348]: cluster 2021-03-10T16:16:59.569559+0000 mgr.gibba043.dnkmem (mgr.34373) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:01 gibba043 bash[24019]: cluster 2021-03-10T16:16:59.569559+0000 mgr.gibba043.dnkmem (mgr.34373) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:03 gibba043 bash[24019]: cluster 2021-03-10T16:17:01.571094+0000 mgr.gibba043.dnkmem (mgr.34373) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:03.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:03 gibba003 bash[31385]: cluster 2021-03-10T16:17:01.571094+0000 mgr.gibba043.dnkmem (mgr.34373) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:03.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:03 gibba003 bash[32348]: cluster 2021-03-10T16:17:01.571094+0000 mgr.gibba043.dnkmem (mgr.34373) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:04 gibba043 bash[24019]: cephadm 2021-03-10T16:17:03.263904+0000 mgr.gibba043.dnkmem (mgr.34373) 7706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:04 gibba003 bash[31385]: cephadm 2021-03-10T16:17:03.263904+0000 mgr.gibba043.dnkmem (mgr.34373) 7706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:04.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:04 gibba003 bash[32348]: cephadm 2021-03-10T16:17:03.263904+0000 mgr.gibba043.dnkmem (mgr.34373) 7706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:05 gibba043 bash[24019]: cluster 2021-03-10T16:17:03.572746+0000 mgr.gibba043.dnkmem (mgr.34373) 7707 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:05 gibba003 bash[31385]: cluster 2021-03-10T16:17:03.572746+0000 mgr.gibba043.dnkmem (mgr.34373) 7707 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:05 gibba003 bash[32348]: cluster 2021-03-10T16:17:03.572746+0000 mgr.gibba043.dnkmem (mgr.34373) 7707 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:07 gibba043 bash[24019]: cluster 2021-03-10T16:17:05.574032+0000 mgr.gibba043.dnkmem (mgr.34373) 7708 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:07 gibba003 bash[31385]: cluster 2021-03-10T16:17:05.574032+0000 mgr.gibba043.dnkmem (mgr.34373) 7708 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:07 gibba003 bash[32348]: cluster 2021-03-10T16:17:05.574032+0000 mgr.gibba043.dnkmem (mgr.34373) 7708 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:09 gibba043 bash[24019]: cluster 2021-03-10T16:17:07.575566+0000 mgr.gibba043.dnkmem (mgr.34373) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:09 gibba003 bash[31385]: cluster 2021-03-10T16:17:07.575566+0000 mgr.gibba043.dnkmem (mgr.34373) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:09 gibba003 bash[32348]: cluster 2021-03-10T16:17:07.575566+0000 mgr.gibba043.dnkmem (mgr.34373) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:11 gibba043 bash[24019]: cluster 2021-03-10T16:17:09.577403+0000 mgr.gibba043.dnkmem (mgr.34373) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:11 gibba003 bash[31385]: cluster 2021-03-10T16:17:09.577403+0000 mgr.gibba043.dnkmem (mgr.34373) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:11 gibba003 bash[32348]: cluster 2021-03-10T16:17:09.577403+0000 mgr.gibba043.dnkmem (mgr.34373) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:13 gibba043 bash[24019]: cluster 2021-03-10T16:17:11.579033+0000 mgr.gibba043.dnkmem (mgr.34373) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:13 gibba003 bash[31385]: cluster 2021-03-10T16:17:11.579033+0000 mgr.gibba043.dnkmem (mgr.34373) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:13 gibba003 bash[32348]: cluster 2021-03-10T16:17:11.579033+0000 mgr.gibba043.dnkmem (mgr.34373) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:13.665388+0000 mon.c (mon.1) 1990 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:13.666517+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:13.847246+0000 mon.c (mon.1) 1991 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:13.848369+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.022201+0000 mon.c (mon.1) 1992 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:17:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.022925+0000 mon.c (mon.1) 1993 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.023433+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:17:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.023644+0000 mon.c (mon.1) 1994 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:17:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.024510+0000 mon.c (mon.1) 1995 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.024680+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.025932+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:17:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:14 gibba043 bash[24019]: audit 2021-03-10T16:17:14.026735+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:13.665388+0000 mon.c (mon.1) 1990 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:13.666517+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:13.847246+0000 mon.c (mon.1) 1991 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:13.848369+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.022201+0000 mon.c (mon.1) 1992 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:17:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.022925+0000 mon.c (mon.1) 1993 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.023433+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:17:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.023644+0000 mon.c (mon.1) 1994 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:17:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.024510+0000 mon.c (mon.1) 1995 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.024680+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.025932+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:17:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[31385]: audit 2021-03-10T16:17:14.026735+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:13.665388+0000 mon.c (mon.1) 1990 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:13.666517+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:13.847246+0000 mon.c (mon.1) 1991 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:13.848369+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.022201+0000 mon.c (mon.1) 1992 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:17:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.022925+0000 mon.c (mon.1) 1993 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.023433+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:17:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.023644+0000 mon.c (mon.1) 1994 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:17:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.024510+0000 mon.c (mon.1) 1995 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.024680+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:17:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.025932+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:17:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:14 gibba003 bash[32348]: audit 2021-03-10T16:17:14.026735+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:15 gibba043 bash[24019]: cluster 2021-03-10T16:17:13.580638+0000 mgr.gibba043.dnkmem (mgr.34373) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:15 gibba003 bash[31385]: cluster 2021-03-10T16:17:13.580638+0000 mgr.gibba043.dnkmem (mgr.34373) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:15 gibba003 bash[32348]: cluster 2021-03-10T16:17:13.580638+0000 mgr.gibba043.dnkmem (mgr.34373) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:17 gibba043 bash[24019]: cluster 2021-03-10T16:17:15.581502+0000 mgr.gibba043.dnkmem (mgr.34373) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:17 gibba003 bash[31385]: cluster 2021-03-10T16:17:15.581502+0000 mgr.gibba043.dnkmem (mgr.34373) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:17 gibba003 bash[32348]: cluster 2021-03-10T16:17:15.581502+0000 mgr.gibba043.dnkmem (mgr.34373) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:18.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:18 gibba043 bash[24019]: audit 2021-03-10T16:17:18.283656+0000 mon.c (mon.1) 1996 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:17:18.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:18 gibba003 bash[31385]: audit 2021-03-10T16:17:18.283656+0000 mon.c (mon.1) 1996 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:17:18.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:18 gibba003 bash[32348]: audit 2021-03-10T16:17:18.283656+0000 mon.c (mon.1) 1996 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:17:19.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:19 gibba003 bash[31385]: cluster 2021-03-10T16:17:17.582837+0000 mgr.gibba043.dnkmem (mgr.34373) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:19 gibba003 bash[31385]: cephadm 2021-03-10T16:17:18.281633+0000 mgr.gibba043.dnkmem (mgr.34373) 7715 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:17:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:19 gibba003 bash[32348]: cluster 2021-03-10T16:17:17.582837+0000 mgr.gibba043.dnkmem (mgr.34373) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:19 gibba003 bash[32348]: cephadm 2021-03-10T16:17:18.281633+0000 mgr.gibba043.dnkmem (mgr.34373) 7715 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:17:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:19 gibba043 bash[24019]: cluster 2021-03-10T16:17:17.582837+0000 mgr.gibba043.dnkmem (mgr.34373) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:19 gibba043 bash[24019]: cephadm 2021-03-10T16:17:18.281633+0000 mgr.gibba043.dnkmem (mgr.34373) 7715 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:17:20.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:20 gibba003 bash[31385]: cluster 2021-03-10T16:17:19.583466+0000 mgr.gibba043.dnkmem (mgr.34373) 7716 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:20.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:20 gibba003 bash[32348]: cluster 2021-03-10T16:17:19.583466+0000 mgr.gibba043.dnkmem (mgr.34373) 7716 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:21.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:20 gibba043 bash[24019]: cluster 2021-03-10T16:17:19.583466+0000 mgr.gibba043.dnkmem (mgr.34373) 7716 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:22 gibba043 bash[24019]: cluster 2021-03-10T16:17:21.584935+0000 mgr.gibba043.dnkmem (mgr.34373) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:22 gibba043 bash[24019]: audit 2021-03-10T16:17:22.769978+0000 mon.c (mon.1) 1997 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:23.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:22 gibba043 bash[24019]: audit 2021-03-10T16:17:22.947577+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:17:23.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:22 gibba003 bash[31385]: cluster 2021-03-10T16:17:21.584935+0000 mgr.gibba043.dnkmem (mgr.34373) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:22 gibba003 bash[31385]: audit 2021-03-10T16:17:22.769978+0000 mon.c (mon.1) 1997 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:23.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:22 gibba003 bash[31385]: audit 2021-03-10T16:17:22.947577+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:17:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:22 gibba003 bash[32348]: cluster 2021-03-10T16:17:21.584935+0000 mgr.gibba043.dnkmem (mgr.34373) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:22 gibba003 bash[32348]: audit 2021-03-10T16:17:22.769978+0000 mon.c (mon.1) 1997 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:23.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:22 gibba003 bash[32348]: audit 2021-03-10T16:17:22.947577+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:17:24.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:22.948256+0000 mgr.gibba043.dnkmem (mgr.34373) 7718 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:17:24.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.142766+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:17:24.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.175132+0000 mgr.gibba043.dnkmem (mgr.34373) 7719 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.177306+0000 mgr.gibba043.dnkmem (mgr.34373) 7720 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.177497+0000 mon.c (mon.1) 1998 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.178861+0000 mgr.gibba043.dnkmem (mgr.34373) 7721 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.178898+0000 mgr.gibba043.dnkmem (mgr.34373) 7722 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.179154+0000 mon.c (mon.1) 1999 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.180401+0000 mgr.gibba043.dnkmem (mgr.34373) 7723 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.180437+0000 mgr.gibba043.dnkmem (mgr.34373) 7724 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.180703+0000 mon.c (mon.1) 2000 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.181792+0000 mgr.gibba043.dnkmem (mgr.34373) 7725 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.182166+0000 mon.c (mon.1) 2001 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.183780+0000 mgr.gibba043.dnkmem (mgr.34373) 7726 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.183815+0000 mgr.gibba043.dnkmem (mgr.34373) 7727 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.185308+0000 mgr.gibba043.dnkmem (mgr.34373) 7728 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.185663+0000 mgr.gibba043.dnkmem (mgr.34373) 7729 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:24.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.185686+0000 mon.c (mon.1) 2002 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.186952+0000 mgr.gibba043.dnkmem (mgr.34373) 7730 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.187055+0000 mgr.gibba043.dnkmem (mgr.34373) 7731 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:24.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: cephadm 2021-03-10T16:17:23.187162+0000 mgr.gibba043.dnkmem (mgr.34373) 7732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:24.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[31385]: audit 2021-03-10T16:17:23.187408+0000 mon.c (mon.1) 2003 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:22.948256+0000 mgr.gibba043.dnkmem (mgr.34373) 7718 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:17:24.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.142766+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:17:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.175132+0000 mgr.gibba043.dnkmem (mgr.34373) 7719 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.177306+0000 mgr.gibba043.dnkmem (mgr.34373) 7720 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:24.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.177497+0000 mon.c (mon.1) 1998 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.178861+0000 mgr.gibba043.dnkmem (mgr.34373) 7721 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.178898+0000 mgr.gibba043.dnkmem (mgr.34373) 7722 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.179154+0000 mon.c (mon.1) 1999 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.180401+0000 mgr.gibba043.dnkmem (mgr.34373) 7723 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:24.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.180437+0000 mgr.gibba043.dnkmem (mgr.34373) 7724 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.180703+0000 mon.c (mon.1) 2000 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.181792+0000 mgr.gibba043.dnkmem (mgr.34373) 7725 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:24.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.182166+0000 mon.c (mon.1) 2001 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.183780+0000 mgr.gibba043.dnkmem (mgr.34373) 7726 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:24.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.183815+0000 mgr.gibba043.dnkmem (mgr.34373) 7727 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:24.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.185308+0000 mgr.gibba043.dnkmem (mgr.34373) 7728 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:24.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.185663+0000 mgr.gibba043.dnkmem (mgr.34373) 7729 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.185686+0000 mon.c (mon.1) 2002 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.186952+0000 mgr.gibba043.dnkmem (mgr.34373) 7730 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.187055+0000 mgr.gibba043.dnkmem (mgr.34373) 7731 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:24.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: cephadm 2021-03-10T16:17:23.187162+0000 mgr.gibba043.dnkmem (mgr.34373) 7732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:24.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:24 gibba003 bash[32348]: audit 2021-03-10T16:17:23.187408+0000 mon.c (mon.1) 2003 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:22.948256+0000 mgr.gibba043.dnkmem (mgr.34373) 7718 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:17:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.142766+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:17:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.175132+0000 mgr.gibba043.dnkmem (mgr.34373) 7719 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.177306+0000 mgr.gibba043.dnkmem (mgr.34373) 7720 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.177497+0000 mon.c (mon.1) 1998 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.178861+0000 mgr.gibba043.dnkmem (mgr.34373) 7721 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.178898+0000 mgr.gibba043.dnkmem (mgr.34373) 7722 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.179154+0000 mon.c (mon.1) 1999 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.180401+0000 mgr.gibba043.dnkmem (mgr.34373) 7723 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.180437+0000 mgr.gibba043.dnkmem (mgr.34373) 7724 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.180703+0000 mon.c (mon.1) 2000 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.181792+0000 mgr.gibba043.dnkmem (mgr.34373) 7725 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.182166+0000 mon.c (mon.1) 2001 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.183780+0000 mgr.gibba043.dnkmem (mgr.34373) 7726 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.183815+0000 mgr.gibba043.dnkmem (mgr.34373) 7727 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.185308+0000 mgr.gibba043.dnkmem (mgr.34373) 7728 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.185663+0000 mgr.gibba043.dnkmem (mgr.34373) 7729 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:24.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.185686+0000 mon.c (mon.1) 2002 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:24.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.186952+0000 mgr.gibba043.dnkmem (mgr.34373) 7730 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:24.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.187055+0000 mgr.gibba043.dnkmem (mgr.34373) 7731 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:24.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: cephadm 2021-03-10T16:17:23.187162+0000 mgr.gibba043.dnkmem (mgr.34373) 7732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:24.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:24 gibba043 bash[24019]: audit 2021-03-10T16:17:23.187408+0000 mon.c (mon.1) 2003 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:25.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:25 gibba003 bash[31385]: cluster 2021-03-10T16:17:23.586632+0000 mgr.gibba043.dnkmem (mgr.34373) 7733 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:25.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:25 gibba003 bash[32348]: cluster 2021-03-10T16:17:23.586632+0000 mgr.gibba043.dnkmem (mgr.34373) 7733 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:25 gibba043 bash[24019]: cluster 2021-03-10T16:17:23.586632+0000 mgr.gibba043.dnkmem (mgr.34373) 7733 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:27.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:27 gibba003 bash[31385]: cluster 2021-03-10T16:17:25.587862+0000 mgr.gibba043.dnkmem (mgr.34373) 7734 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:27.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:27 gibba003 bash[32348]: cluster 2021-03-10T16:17:25.587862+0000 mgr.gibba043.dnkmem (mgr.34373) 7734 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:27 gibba043 bash[24019]: cluster 2021-03-10T16:17:25.587862+0000 mgr.gibba043.dnkmem (mgr.34373) 7734 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:29 gibba003 bash[31385]: cluster 2021-03-10T16:17:27.589271+0000 mgr.gibba043.dnkmem (mgr.34373) 7735 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:29 gibba003 bash[32348]: cluster 2021-03-10T16:17:27.589271+0000 mgr.gibba043.dnkmem (mgr.34373) 7735 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:29 gibba043 bash[24019]: cluster 2021-03-10T16:17:27.589271+0000 mgr.gibba043.dnkmem (mgr.34373) 7735 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.808 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:17:30.033 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:17:30.033 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:17:30.034 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:17:30.034 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:17:30.034 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:17:30.034 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:17:30.035 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:17:30.035 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:17:30.035 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:17:30.035 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:17:30.036 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:17:30.036 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:17:30.036 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:17:30.036 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:17:30.037 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:17:30.037 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:17:30.037 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:17:30.037 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:17:30.037 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:17:30.038 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:17:30.038 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:17:30.280 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:17:30.280 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:17:30.280 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:30.281 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:17:30.281 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:17:30.281 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:30.281 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:17:30.282 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:17:30.282 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:17:30.282 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:17:30.282 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:17:30.283 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:17:30.283 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:17:30.283 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:17:30.283 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:17:31.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[32348]: cluster 2021-03-10T16:17:29.589783+0000 mgr.gibba043.dnkmem (mgr.34373) 7736 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:31.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[32348]: audit 2021-03-10T16:17:29.800161+0000 mgr.gibba043.dnkmem (mgr.34373) 7737 : audit [DBG] from='client.59224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[32348]: audit 2021-03-10T16:17:30.025500+0000 mgr.gibba043.dnkmem (mgr.34373) 7738 : audit [DBG] from='client.59230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[32348]: audit 2021-03-10T16:17:30.282854+0000 mon.a (mon.0) 1686 : audit [DBG] from='client.? 172.21.2.103:0/2596044456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[31385]: cluster 2021-03-10T16:17:29.589783+0000 mgr.gibba043.dnkmem (mgr.34373) 7736 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[31385]: audit 2021-03-10T16:17:29.800161+0000 mgr.gibba043.dnkmem (mgr.34373) 7737 : audit [DBG] from='client.59224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[31385]: audit 2021-03-10T16:17:30.025500+0000 mgr.gibba043.dnkmem (mgr.34373) 7738 : audit [DBG] from='client.59230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:31 gibba003 bash[31385]: audit 2021-03-10T16:17:30.282854+0000 mon.a (mon.0) 1686 : audit [DBG] from='client.? 172.21.2.103:0/2596044456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:31 gibba043 bash[24019]: cluster 2021-03-10T16:17:29.589783+0000 mgr.gibba043.dnkmem (mgr.34373) 7736 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:31 gibba043 bash[24019]: audit 2021-03-10T16:17:29.800161+0000 mgr.gibba043.dnkmem (mgr.34373) 7737 : audit [DBG] from='client.59224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:31 gibba043 bash[24019]: audit 2021-03-10T16:17:30.025500+0000 mgr.gibba043.dnkmem (mgr.34373) 7738 : audit [DBG] from='client.59230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:31 gibba043 bash[24019]: audit 2021-03-10T16:17:30.282854+0000 mon.a (mon.0) 1686 : audit [DBG] from='client.? 172.21.2.103:0/2596044456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:33 gibba043 bash[24019]: cluster 2021-03-10T16:17:31.591285+0000 mgr.gibba043.dnkmem (mgr.34373) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:33 gibba003 bash[31385]: cluster 2021-03-10T16:17:31.591285+0000 mgr.gibba043.dnkmem (mgr.34373) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:33 gibba003 bash[32348]: cluster 2021-03-10T16:17:31.591285+0000 mgr.gibba043.dnkmem (mgr.34373) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:35 gibba043 bash[24019]: cluster 2021-03-10T16:17:33.592712+0000 mgr.gibba043.dnkmem (mgr.34373) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:35.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:35 gibba003 bash[31385]: cluster 2021-03-10T16:17:33.592712+0000 mgr.gibba043.dnkmem (mgr.34373) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:35 gibba003 bash[32348]: cluster 2021-03-10T16:17:33.592712+0000 mgr.gibba043.dnkmem (mgr.34373) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:37.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:37 gibba043 bash[24019]: cluster 2021-03-10T16:17:35.593958+0000 mgr.gibba043.dnkmem (mgr.34373) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:37 gibba003 bash[31385]: cluster 2021-03-10T16:17:35.593958+0000 mgr.gibba043.dnkmem (mgr.34373) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:37.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:37 gibba003 bash[32348]: cluster 2021-03-10T16:17:35.593958+0000 mgr.gibba043.dnkmem (mgr.34373) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:39 gibba043 bash[24019]: cluster 2021-03-10T16:17:37.595282+0000 mgr.gibba043.dnkmem (mgr.34373) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:39 gibba043 bash[24019]: cephadm 2021-03-10T16:17:38.202812+0000 mgr.gibba043.dnkmem (mgr.34373) 7743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:39 gibba003 bash[31385]: cluster 2021-03-10T16:17:37.595282+0000 mgr.gibba043.dnkmem (mgr.34373) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:39 gibba003 bash[31385]: cephadm 2021-03-10T16:17:38.202812+0000 mgr.gibba043.dnkmem (mgr.34373) 7743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:39 gibba003 bash[32348]: cluster 2021-03-10T16:17:37.595282+0000 mgr.gibba043.dnkmem (mgr.34373) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:39 gibba003 bash[32348]: cephadm 2021-03-10T16:17:38.202812+0000 mgr.gibba043.dnkmem (mgr.34373) 7743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:41.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:41 gibba043 bash[24019]: cluster 2021-03-10T16:17:39.595828+0000 mgr.gibba043.dnkmem (mgr.34373) 7744 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:41.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:41 gibba003 bash[31385]: cluster 2021-03-10T16:17:39.595828+0000 mgr.gibba043.dnkmem (mgr.34373) 7744 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:41.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:41 gibba003 bash[32348]: cluster 2021-03-10T16:17:39.595828+0000 mgr.gibba043.dnkmem (mgr.34373) 7744 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:43 gibba043 bash[24019]: cluster 2021-03-10T16:17:41.597232+0000 mgr.gibba043.dnkmem (mgr.34373) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:43 gibba003 bash[31385]: cluster 2021-03-10T16:17:41.597232+0000 mgr.gibba043.dnkmem (mgr.34373) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:43 gibba003 bash[32348]: cluster 2021-03-10T16:17:41.597232+0000 mgr.gibba043.dnkmem (mgr.34373) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:45 gibba043 bash[24019]: cluster 2021-03-10T16:17:43.598729+0000 mgr.gibba043.dnkmem (mgr.34373) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:45 gibba003 bash[31385]: cluster 2021-03-10T16:17:43.598729+0000 mgr.gibba043.dnkmem (mgr.34373) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:45 gibba003 bash[32348]: cluster 2021-03-10T16:17:43.598729+0000 mgr.gibba043.dnkmem (mgr.34373) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:47 gibba043 bash[24019]: cluster 2021-03-10T16:17:45.600186+0000 mgr.gibba043.dnkmem (mgr.34373) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:47 gibba003 bash[31385]: cluster 2021-03-10T16:17:45.600186+0000 mgr.gibba043.dnkmem (mgr.34373) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:47 gibba003 bash[32348]: cluster 2021-03-10T16:17:45.600186+0000 mgr.gibba043.dnkmem (mgr.34373) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:49 gibba043 bash[24019]: cluster 2021-03-10T16:17:47.601661+0000 mgr.gibba043.dnkmem (mgr.34373) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:49 gibba003 bash[31385]: cluster 2021-03-10T16:17:47.601661+0000 mgr.gibba043.dnkmem (mgr.34373) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:49 gibba003 bash[32348]: cluster 2021-03-10T16:17:47.601661+0000 mgr.gibba043.dnkmem (mgr.34373) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:51 gibba003 bash[31385]: cluster 2021-03-10T16:17:49.602208+0000 mgr.gibba043.dnkmem (mgr.34373) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:51 gibba003 bash[32348]: cluster 2021-03-10T16:17:49.602208+0000 mgr.gibba043.dnkmem (mgr.34373) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:51 gibba043 bash[24019]: cluster 2021-03-10T16:17:49.602208+0000 mgr.gibba043.dnkmem (mgr.34373) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:53 gibba043 bash[24019]: cluster 2021-03-10T16:17:51.603807+0000 mgr.gibba043.dnkmem (mgr.34373) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:53 gibba003 bash[31385]: cluster 2021-03-10T16:17:51.603807+0000 mgr.gibba043.dnkmem (mgr.34373) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:53 gibba003 bash[32348]: cluster 2021-03-10T16:17:51.603807+0000 mgr.gibba043.dnkmem (mgr.34373) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:54 gibba003 bash[31385]: cephadm 2021-03-10T16:17:53.216328+0000 mgr.gibba043.dnkmem (mgr.34373) 7751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:54.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:54 gibba003 bash[32348]: cephadm 2021-03-10T16:17:53.216328+0000 mgr.gibba043.dnkmem (mgr.34373) 7751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:54 gibba043 bash[24019]: cephadm 2021-03-10T16:17:53.216328+0000 mgr.gibba043.dnkmem (mgr.34373) 7751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:17:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:55 gibba003 bash[31385]: cluster 2021-03-10T16:17:53.605268+0000 mgr.gibba043.dnkmem (mgr.34373) 7752 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:55 gibba003 bash[32348]: cluster 2021-03-10T16:17:53.605268+0000 mgr.gibba043.dnkmem (mgr.34373) 7752 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:55.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:55 gibba043 bash[24019]: cluster 2021-03-10T16:17:53.605268+0000 mgr.gibba043.dnkmem (mgr.34373) 7752 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:57 gibba003 bash[31385]: cluster 2021-03-10T16:17:55.606687+0000 mgr.gibba043.dnkmem (mgr.34373) 7753 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:57 gibba003 bash[32348]: cluster 2021-03-10T16:17:55.606687+0000 mgr.gibba043.dnkmem (mgr.34373) 7753 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:57 gibba043 bash[24019]: cluster 2021-03-10T16:17:55.606687+0000 mgr.gibba043.dnkmem (mgr.34373) 7753 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:17:59 gibba003 bash[31385]: cluster 2021-03-10T16:17:57.608351+0000 mgr.gibba043.dnkmem (mgr.34373) 7754 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:17:59 gibba003 bash[32348]: cluster 2021-03-10T16:17:57.608351+0000 mgr.gibba043.dnkmem (mgr.34373) 7754 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:17:59 gibba043 bash[24019]: cluster 2021-03-10T16:17:57.608351+0000 mgr.gibba043.dnkmem (mgr.34373) 7754 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:00.521 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:18:00.749 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:18:00.750 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:18:00.750 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:18:00.750 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:18:00.751 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:18:00.751 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:18:00.751 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:18:00.751 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:18:00.751 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:18:00.752 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:18:00.752 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:18:00.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:18:00.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:18:00.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:18:00.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:18:00.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:18:00.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:18:00.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:18:00.754 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:18:00.754 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:18:00.754 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:18:00.997 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:18:00.997 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:18:00.998 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:00.998 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:18:00.998 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:18:00.998 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:00.999 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:18:00.999 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:18:00.999 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:18:00.999 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:18:01.000 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:18:01.000 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:18:01.000 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:18:01.000 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:18:01.001 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:18:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:01 gibba003 bash[31385]: cluster 2021-03-10T16:17:59.609843+0000 mgr.gibba043.dnkmem (mgr.34373) 7755 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:01 gibba003 bash[31385]: audit 2021-03-10T16:18:00.513467+0000 mgr.gibba043.dnkmem (mgr.34373) 7756 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:01.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:01 gibba003 bash[31385]: audit 2021-03-10T16:18:00.999891+0000 mon.c (mon.1) 2004 : audit [DBG] from='client.? 172.21.2.103:0/2150854191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:01 gibba003 bash[32348]: cluster 2021-03-10T16:17:59.609843+0000 mgr.gibba043.dnkmem (mgr.34373) 7755 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:01 gibba003 bash[32348]: audit 2021-03-10T16:18:00.513467+0000 mgr.gibba043.dnkmem (mgr.34373) 7756 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:01.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:01 gibba003 bash[32348]: audit 2021-03-10T16:18:00.999891+0000 mon.c (mon.1) 2004 : audit [DBG] from='client.? 172.21.2.103:0/2150854191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:01 gibba043 bash[24019]: cluster 2021-03-10T16:17:59.609843+0000 mgr.gibba043.dnkmem (mgr.34373) 7755 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:01 gibba043 bash[24019]: audit 2021-03-10T16:18:00.513467+0000 mgr.gibba043.dnkmem (mgr.34373) 7756 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:01 gibba043 bash[24019]: audit 2021-03-10T16:18:00.999891+0000 mon.c (mon.1) 2004 : audit [DBG] from='client.? 172.21.2.103:0/2150854191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:02.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:02 gibba003 bash[31385]: audit 2021-03-10T16:18:00.739092+0000 mgr.gibba043.dnkmem (mgr.34373) 7757 : audit [DBG] from='client.59248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:02.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:02 gibba003 bash[32348]: audit 2021-03-10T16:18:00.739092+0000 mgr.gibba043.dnkmem (mgr.34373) 7757 : audit [DBG] from='client.59248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:02.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:02 gibba043 bash[24019]: audit 2021-03-10T16:18:00.739092+0000 mgr.gibba043.dnkmem (mgr.34373) 7757 : audit [DBG] from='client.59248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:03 gibba003 bash[31385]: cluster 2021-03-10T16:18:01.611376+0000 mgr.gibba043.dnkmem (mgr.34373) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:03 gibba003 bash[32348]: cluster 2021-03-10T16:18:01.611376+0000 mgr.gibba043.dnkmem (mgr.34373) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:03.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:03 gibba043 bash[24019]: cluster 2021-03-10T16:18:01.611376+0000 mgr.gibba043.dnkmem (mgr.34373) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:05 gibba003 bash[31385]: cluster 2021-03-10T16:18:03.612935+0000 mgr.gibba043.dnkmem (mgr.34373) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:05.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:05 gibba003 bash[32348]: cluster 2021-03-10T16:18:03.612935+0000 mgr.gibba043.dnkmem (mgr.34373) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:05 gibba043 bash[24019]: cluster 2021-03-10T16:18:03.612935+0000 mgr.gibba043.dnkmem (mgr.34373) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:07 gibba003 bash[31385]: cluster 2021-03-10T16:18:05.614448+0000 mgr.gibba043.dnkmem (mgr.34373) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:07 gibba003 bash[32348]: cluster 2021-03-10T16:18:05.614448+0000 mgr.gibba043.dnkmem (mgr.34373) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:07 gibba043 bash[24019]: cluster 2021-03-10T16:18:05.614448+0000 mgr.gibba043.dnkmem (mgr.34373) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:09 gibba003 bash[31385]: cluster 2021-03-10T16:18:07.615872+0000 mgr.gibba043.dnkmem (mgr.34373) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:09 gibba003 bash[31385]: cephadm 2021-03-10T16:18:08.232076+0000 mgr.gibba043.dnkmem (mgr.34373) 7762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:09 gibba003 bash[32348]: cluster 2021-03-10T16:18:07.615872+0000 mgr.gibba043.dnkmem (mgr.34373) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:09 gibba003 bash[32348]: cephadm 2021-03-10T16:18:08.232076+0000 mgr.gibba043.dnkmem (mgr.34373) 7762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:09 gibba043 bash[24019]: cluster 2021-03-10T16:18:07.615872+0000 mgr.gibba043.dnkmem (mgr.34373) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:09 gibba043 bash[24019]: cephadm 2021-03-10T16:18:08.232076+0000 mgr.gibba043.dnkmem (mgr.34373) 7762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:11.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:11 gibba003 bash[31385]: cluster 2021-03-10T16:18:09.616555+0000 mgr.gibba043.dnkmem (mgr.34373) 7763 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:11.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:11 gibba003 bash[32348]: cluster 2021-03-10T16:18:09.616555+0000 mgr.gibba043.dnkmem (mgr.34373) 7763 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:11 gibba043 bash[24019]: cluster 2021-03-10T16:18:09.616555+0000 mgr.gibba043.dnkmem (mgr.34373) 7763 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:13.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:13 gibba003 bash[31385]: cluster 2021-03-10T16:18:11.617985+0000 mgr.gibba043.dnkmem (mgr.34373) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:13.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:13 gibba003 bash[32348]: cluster 2021-03-10T16:18:11.617985+0000 mgr.gibba043.dnkmem (mgr.34373) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:13 gibba043 bash[24019]: cluster 2021-03-10T16:18:11.617985+0000 mgr.gibba043.dnkmem (mgr.34373) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:13.672418+0000 mon.c (mon.1) 2005 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:13.673551+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:13.860079+0000 mon.c (mon.1) 2006 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:13.861237+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.032845+0000 mon.c (mon.1) 2007 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:18:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.033555+0000 mon.c (mon.1) 2008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.034071+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:18:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.034215+0000 mon.c (mon.1) 2009 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.034875+0000 mon.c (mon.1) 2010 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.035605+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.036575+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[31385]: audit 2021-03-10T16:18:14.037361+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:13.672418+0000 mon.c (mon.1) 2005 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:13.673551+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:13.860079+0000 mon.c (mon.1) 2006 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:13.861237+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.032845+0000 mon.c (mon.1) 2007 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:18:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.033555+0000 mon.c (mon.1) 2008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.034071+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:18:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.034215+0000 mon.c (mon.1) 2009 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.034875+0000 mon.c (mon.1) 2010 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.035605+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.036575+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:14 gibba003 bash[32348]: audit 2021-03-10T16:18:14.037361+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:13.672418+0000 mon.c (mon.1) 2005 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:13.673551+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:13.860079+0000 mon.c (mon.1) 2006 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:13.861237+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.032845+0000 mon.c (mon.1) 2007 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:18:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.033555+0000 mon.c (mon.1) 2008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.034071+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:18:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.034215+0000 mon.c (mon.1) 2009 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.034875+0000 mon.c (mon.1) 2010 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.035605+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.036575+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:14 gibba043 bash[24019]: audit 2021-03-10T16:18:14.037361+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:18:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:15 gibba003 bash[31385]: cluster 2021-03-10T16:18:13.619513+0000 mgr.gibba043.dnkmem (mgr.34373) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:15.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:15 gibba003 bash[32348]: cluster 2021-03-10T16:18:13.619513+0000 mgr.gibba043.dnkmem (mgr.34373) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:15 gibba043 bash[24019]: cluster 2021-03-10T16:18:13.619513+0000 mgr.gibba043.dnkmem (mgr.34373) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:17 gibba003 bash[31385]: cluster 2021-03-10T16:18:15.621106+0000 mgr.gibba043.dnkmem (mgr.34373) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:17 gibba003 bash[32348]: cluster 2021-03-10T16:18:15.621106+0000 mgr.gibba043.dnkmem (mgr.34373) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:17 gibba043 bash[24019]: cluster 2021-03-10T16:18:15.621106+0000 mgr.gibba043.dnkmem (mgr.34373) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:19.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:19 gibba003 bash[31385]: cluster 2021-03-10T16:18:17.622624+0000 mgr.gibba043.dnkmem (mgr.34373) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:19 gibba003 bash[32348]: cluster 2021-03-10T16:18:17.622624+0000 mgr.gibba043.dnkmem (mgr.34373) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:19 gibba043 bash[24019]: cluster 2021-03-10T16:18:17.622624+0000 mgr.gibba043.dnkmem (mgr.34373) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:21 gibba003 bash[31385]: cluster 2021-03-10T16:18:19.624194+0000 mgr.gibba043.dnkmem (mgr.34373) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:21.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:21 gibba003 bash[32348]: cluster 2021-03-10T16:18:19.624194+0000 mgr.gibba043.dnkmem (mgr.34373) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:21 gibba043 bash[24019]: cluster 2021-03-10T16:18:19.624194+0000 mgr.gibba043.dnkmem (mgr.34373) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:23 gibba003 bash[31385]: cluster 2021-03-10T16:18:21.625739+0000 mgr.gibba043.dnkmem (mgr.34373) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:23 gibba003 bash[31385]: audit 2021-03-10T16:18:23.250222+0000 mon.c (mon.1) 2011 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:18:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:23 gibba003 bash[32348]: cluster 2021-03-10T16:18:21.625739+0000 mgr.gibba043.dnkmem (mgr.34373) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:23 gibba003 bash[32348]: audit 2021-03-10T16:18:23.250222+0000 mon.c (mon.1) 2011 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:18:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:23 gibba043 bash[24019]: cluster 2021-03-10T16:18:21.625739+0000 mgr.gibba043.dnkmem (mgr.34373) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:23 gibba043 bash[24019]: audit 2021-03-10T16:18:23.250222+0000 mon.c (mon.1) 2011 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:18:24.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:24 gibba043 bash[24019]: cephadm 2021-03-10T16:18:23.247958+0000 mgr.gibba043.dnkmem (mgr.34373) 7770 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:18:24.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:24 gibba003 bash[31385]: cephadm 2021-03-10T16:18:23.247958+0000 mgr.gibba043.dnkmem (mgr.34373) 7770 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:18:24.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:24 gibba003 bash[32348]: cephadm 2021-03-10T16:18:23.247958+0000 mgr.gibba043.dnkmem (mgr.34373) 7770 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:18:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:25 gibba043 bash[24019]: cluster 2021-03-10T16:18:23.627269+0000 mgr.gibba043.dnkmem (mgr.34373) 7771 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:25 gibba003 bash[31385]: cluster 2021-03-10T16:18:23.627269+0000 mgr.gibba043.dnkmem (mgr.34373) 7771 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:25.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:25 gibba003 bash[32348]: cluster 2021-03-10T16:18:23.627269+0000 mgr.gibba043.dnkmem (mgr.34373) 7771 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: cluster 2021-03-10T16:18:25.628559+0000 mgr.gibba043.dnkmem (mgr.34373) 7772 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:26.810954+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:18:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.054121+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:18:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.062111+0000 mon.c (mon.1) 2012 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.064011+0000 mon.c (mon.1) 2013 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.065473+0000 mon.c (mon.1) 2014 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.066763+0000 mon.c (mon.1) 2015 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.069596+0000 mon.c (mon.1) 2016 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:27 gibba043 bash[24019]: audit 2021-03-10T16:18:27.071063+0000 mon.c (mon.1) 2017 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: cluster 2021-03-10T16:18:25.628559+0000 mgr.gibba043.dnkmem (mgr.34373) 7772 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:26.810954+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:18:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.054121+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:18:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.062111+0000 mon.c (mon.1) 2012 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.064011+0000 mon.c (mon.1) 2013 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.065473+0000 mon.c (mon.1) 2014 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.066763+0000 mon.c (mon.1) 2015 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.069596+0000 mon.c (mon.1) 2016 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[31385]: audit 2021-03-10T16:18:27.071063+0000 mon.c (mon.1) 2017 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: cluster 2021-03-10T16:18:25.628559+0000 mgr.gibba043.dnkmem (mgr.34373) 7772 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:26.810954+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:18:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.054121+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:18:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.062111+0000 mon.c (mon.1) 2012 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.064011+0000 mon.c (mon.1) 2013 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.065473+0000 mon.c (mon.1) 2014 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.066763+0000 mon.c (mon.1) 2015 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.069596+0000 mon.c (mon.1) 2016 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:27 gibba003 bash[32348]: audit 2021-03-10T16:18:27.071063+0000 mon.c (mon.1) 2017 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:28.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:26.810649+0000 mgr.gibba043.dnkmem (mgr.34373) 7773 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:18:28.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.059847+0000 mgr.gibba043.dnkmem (mgr.34373) 7774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:28.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.062026+0000 mgr.gibba043.dnkmem (mgr.34373) 7775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.063574+0000 mgr.gibba043.dnkmem (mgr.34373) 7776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.063612+0000 mgr.gibba043.dnkmem (mgr.34373) 7777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.064963+0000 mgr.gibba043.dnkmem (mgr.34373) 7778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.065004+0000 mgr.gibba043.dnkmem (mgr.34373) 7779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:28.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.066128+0000 mgr.gibba043.dnkmem (mgr.34373) 7780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:28.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.067641+0000 mgr.gibba043.dnkmem (mgr.34373) 7781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:28.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.067697+0000 mgr.gibba043.dnkmem (mgr.34373) 7782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:28.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.068869+0000 mgr.gibba043.dnkmem (mgr.34373) 7783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.069273+0000 mgr.gibba043.dnkmem (mgr.34373) 7784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.070569+0000 mgr.gibba043.dnkmem (mgr.34373) 7785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.070613+0000 mgr.gibba043.dnkmem (mgr.34373) 7786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:28 gibba043 bash[24019]: cephadm 2021-03-10T16:18:27.070735+0000 mgr.gibba043.dnkmem (mgr.34373) 7787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:26.810649+0000 mgr.gibba043.dnkmem (mgr.34373) 7773 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:18:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.059847+0000 mgr.gibba043.dnkmem (mgr.34373) 7774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.062026+0000 mgr.gibba043.dnkmem (mgr.34373) 7775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.063574+0000 mgr.gibba043.dnkmem (mgr.34373) 7776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.063612+0000 mgr.gibba043.dnkmem (mgr.34373) 7777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.064963+0000 mgr.gibba043.dnkmem (mgr.34373) 7778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.065004+0000 mgr.gibba043.dnkmem (mgr.34373) 7779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.066128+0000 mgr.gibba043.dnkmem (mgr.34373) 7780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.067641+0000 mgr.gibba043.dnkmem (mgr.34373) 7781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.067697+0000 mgr.gibba043.dnkmem (mgr.34373) 7782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.068869+0000 mgr.gibba043.dnkmem (mgr.34373) 7783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.069273+0000 mgr.gibba043.dnkmem (mgr.34373) 7784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.070569+0000 mgr.gibba043.dnkmem (mgr.34373) 7785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.070613+0000 mgr.gibba043.dnkmem (mgr.34373) 7786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[31385]: cephadm 2021-03-10T16:18:27.070735+0000 mgr.gibba043.dnkmem (mgr.34373) 7787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:26.810649+0000 mgr.gibba043.dnkmem (mgr.34373) 7773 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:18:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.059847+0000 mgr.gibba043.dnkmem (mgr.34373) 7774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.062026+0000 mgr.gibba043.dnkmem (mgr.34373) 7775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.063574+0000 mgr.gibba043.dnkmem (mgr.34373) 7776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.063612+0000 mgr.gibba043.dnkmem (mgr.34373) 7777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.064963+0000 mgr.gibba043.dnkmem (mgr.34373) 7778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.065004+0000 mgr.gibba043.dnkmem (mgr.34373) 7779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.066128+0000 mgr.gibba043.dnkmem (mgr.34373) 7780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.067641+0000 mgr.gibba043.dnkmem (mgr.34373) 7781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.067697+0000 mgr.gibba043.dnkmem (mgr.34373) 7782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.068869+0000 mgr.gibba043.dnkmem (mgr.34373) 7783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.069273+0000 mgr.gibba043.dnkmem (mgr.34373) 7784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.070569+0000 mgr.gibba043.dnkmem (mgr.34373) 7785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.070613+0000 mgr.gibba043.dnkmem (mgr.34373) 7786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:28 gibba003 bash[32348]: cephadm 2021-03-10T16:18:27.070735+0000 mgr.gibba043.dnkmem (mgr.34373) 7787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:29 gibba043 bash[24019]: cluster 2021-03-10T16:18:27.629888+0000 mgr.gibba043.dnkmem (mgr.34373) 7788 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:29.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:29 gibba003 bash[31385]: cluster 2021-03-10T16:18:27.629888+0000 mgr.gibba043.dnkmem (mgr.34373) 7788 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:29.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:29 gibba003 bash[32348]: cluster 2021-03-10T16:18:27.629888+0000 mgr.gibba043.dnkmem (mgr.34373) 7788 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.239 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:18:31.467 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:18:31.468 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:18:31.468 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:18:31.468 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:18:31.468 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:18:31.469 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:18:31.469 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:18:31.469 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:18:31.469 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:18:31.470 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:18:31.470 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:18:31.470 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:18:31.470 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:18:31.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:18:31.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:18:31.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:18:31.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:18:31.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:18:31.472 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:18:31.472 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:18:31.472 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:18:31.720 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:18:31.721 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:18:31.721 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:31.721 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:18:31.722 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:18:31.722 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:31.722 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:18:31.722 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:18:31.722 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:18:31.723 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:18:31.723 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:18:31.723 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:18:31.723 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:18:31.724 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:18:31.724 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:18:31.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:31 gibba043 bash[24019]: cluster 2021-03-10T16:18:29.630521+0000 mgr.gibba043.dnkmem (mgr.34373) 7789 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:31 gibba003 bash[31385]: cluster 2021-03-10T16:18:29.630521+0000 mgr.gibba043.dnkmem (mgr.34373) 7789 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:31 gibba003 bash[32348]: cluster 2021-03-10T16:18:29.630521+0000 mgr.gibba043.dnkmem (mgr.34373) 7789 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:32.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:32 gibba043 bash[24019]: audit 2021-03-10T16:18:31.231297+0000 mgr.gibba043.dnkmem (mgr.34373) 7790 : audit [DBG] from='client.59260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:32 gibba043 bash[24019]: audit 2021-03-10T16:18:31.457054+0000 mgr.gibba043.dnkmem (mgr.34373) 7791 : audit [DBG] from='client.49278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:32 gibba043 bash[24019]: audit 2021-03-10T16:18:31.723417+0000 mon.a (mon.0) 1695 : audit [DBG] from='client.? 172.21.2.103:0/1802514560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:32.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:32 gibba003 bash[31385]: audit 2021-03-10T16:18:31.231297+0000 mgr.gibba043.dnkmem (mgr.34373) 7790 : audit [DBG] from='client.59260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:32.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:32 gibba003 bash[31385]: audit 2021-03-10T16:18:31.457054+0000 mgr.gibba043.dnkmem (mgr.34373) 7791 : audit [DBG] from='client.49278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:32.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:32 gibba003 bash[31385]: audit 2021-03-10T16:18:31.723417+0000 mon.a (mon.0) 1695 : audit [DBG] from='client.? 172.21.2.103:0/1802514560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:32.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:32 gibba003 bash[32348]: audit 2021-03-10T16:18:31.231297+0000 mgr.gibba043.dnkmem (mgr.34373) 7790 : audit [DBG] from='client.59260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:32.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:32 gibba003 bash[32348]: audit 2021-03-10T16:18:31.457054+0000 mgr.gibba043.dnkmem (mgr.34373) 7791 : audit [DBG] from='client.49278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:32.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:32 gibba003 bash[32348]: audit 2021-03-10T16:18:31.723417+0000 mon.a (mon.0) 1695 : audit [DBG] from='client.? 172.21.2.103:0/1802514560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:33 gibba043 bash[24019]: cluster 2021-03-10T16:18:31.631856+0000 mgr.gibba043.dnkmem (mgr.34373) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:33 gibba003 bash[31385]: cluster 2021-03-10T16:18:31.631856+0000 mgr.gibba043.dnkmem (mgr.34373) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:33 gibba003 bash[32348]: cluster 2021-03-10T16:18:31.631856+0000 mgr.gibba043.dnkmem (mgr.34373) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:35 gibba043 bash[24019]: cluster 2021-03-10T16:18:33.633142+0000 mgr.gibba043.dnkmem (mgr.34373) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:35.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:35 gibba003 bash[31385]: cluster 2021-03-10T16:18:33.633142+0000 mgr.gibba043.dnkmem (mgr.34373) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:35.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:35 gibba003 bash[32348]: cluster 2021-03-10T16:18:33.633142+0000 mgr.gibba043.dnkmem (mgr.34373) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:37 gibba043 bash[24019]: cluster 2021-03-10T16:18:35.634558+0000 mgr.gibba043.dnkmem (mgr.34373) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:37 gibba003 bash[31385]: cluster 2021-03-10T16:18:35.634558+0000 mgr.gibba043.dnkmem (mgr.34373) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:37 gibba003 bash[32348]: cluster 2021-03-10T16:18:35.634558+0000 mgr.gibba043.dnkmem (mgr.34373) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:39.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:39 gibba003 bash[31385]: cluster 2021-03-10T16:18:37.636127+0000 mgr.gibba043.dnkmem (mgr.34373) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:39.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:39 gibba003 bash[32348]: cluster 2021-03-10T16:18:37.636127+0000 mgr.gibba043.dnkmem (mgr.34373) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:39 gibba043 bash[24019]: cluster 2021-03-10T16:18:37.636127+0000 mgr.gibba043.dnkmem (mgr.34373) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:41.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:41 gibba003 bash[31385]: cluster 2021-03-10T16:18:39.636774+0000 mgr.gibba043.dnkmem (mgr.34373) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:41 gibba003 bash[32348]: cluster 2021-03-10T16:18:39.636774+0000 mgr.gibba043.dnkmem (mgr.34373) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:41 gibba043 bash[24019]: cluster 2021-03-10T16:18:39.636774+0000 mgr.gibba043.dnkmem (mgr.34373) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:43.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:43 gibba003 bash[31385]: cluster 2021-03-10T16:18:41.638448+0000 mgr.gibba043.dnkmem (mgr.34373) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:43 gibba003 bash[31385]: cephadm 2021-03-10T16:18:42.086715+0000 mgr.gibba043.dnkmem (mgr.34373) 7798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:43 gibba003 bash[32348]: cluster 2021-03-10T16:18:41.638448+0000 mgr.gibba043.dnkmem (mgr.34373) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:43 gibba003 bash[32348]: cephadm 2021-03-10T16:18:42.086715+0000 mgr.gibba043.dnkmem (mgr.34373) 7798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:44.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:43 gibba043 bash[24019]: cluster 2021-03-10T16:18:41.638448+0000 mgr.gibba043.dnkmem (mgr.34373) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:43 gibba043 bash[24019]: cephadm 2021-03-10T16:18:42.086715+0000 mgr.gibba043.dnkmem (mgr.34373) 7798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:45 gibba003 bash[31385]: cluster 2021-03-10T16:18:43.639803+0000 mgr.gibba043.dnkmem (mgr.34373) 7799 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:45 gibba003 bash[32348]: cluster 2021-03-10T16:18:43.639803+0000 mgr.gibba043.dnkmem (mgr.34373) 7799 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:46.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:45 gibba043 bash[24019]: cluster 2021-03-10T16:18:43.639803+0000 mgr.gibba043.dnkmem (mgr.34373) 7799 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:47 gibba003 bash[31385]: cluster 2021-03-10T16:18:45.640230+0000 mgr.gibba043.dnkmem (mgr.34373) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:47 gibba003 bash[32348]: cluster 2021-03-10T16:18:45.640230+0000 mgr.gibba043.dnkmem (mgr.34373) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:47 gibba043 bash[24019]: cluster 2021-03-10T16:18:45.640230+0000 mgr.gibba043.dnkmem (mgr.34373) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:49 gibba003 bash[31385]: cluster 2021-03-10T16:18:47.641653+0000 mgr.gibba043.dnkmem (mgr.34373) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:49 gibba003 bash[32348]: cluster 2021-03-10T16:18:47.641653+0000 mgr.gibba043.dnkmem (mgr.34373) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:49 gibba043 bash[24019]: cluster 2021-03-10T16:18:47.641653+0000 mgr.gibba043.dnkmem (mgr.34373) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:51.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:51 gibba003 bash[32348]: cluster 2021-03-10T16:18:49.643152+0000 mgr.gibba043.dnkmem (mgr.34373) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:51.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:51 gibba003 bash[31385]: cluster 2021-03-10T16:18:49.643152+0000 mgr.gibba043.dnkmem (mgr.34373) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:51 gibba043 bash[24019]: cluster 2021-03-10T16:18:49.643152+0000 mgr.gibba043.dnkmem (mgr.34373) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:53.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:53 gibba003 bash[31385]: cluster 2021-03-10T16:18:51.644681+0000 mgr.gibba043.dnkmem (mgr.34373) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:53.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:53 gibba003 bash[32348]: cluster 2021-03-10T16:18:51.644681+0000 mgr.gibba043.dnkmem (mgr.34373) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:53 gibba043 bash[24019]: cluster 2021-03-10T16:18:51.644681+0000 mgr.gibba043.dnkmem (mgr.34373) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:55.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:55 gibba003 bash[31385]: cluster 2021-03-10T16:18:53.646207+0000 mgr.gibba043.dnkmem (mgr.34373) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:55.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:55 gibba003 bash[32348]: cluster 2021-03-10T16:18:53.646207+0000 mgr.gibba043.dnkmem (mgr.34373) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:55 gibba043 bash[24019]: cluster 2021-03-10T16:18:53.646207+0000 mgr.gibba043.dnkmem (mgr.34373) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:57.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:57 gibba003 bash[31385]: cluster 2021-03-10T16:18:55.647819+0000 mgr.gibba043.dnkmem (mgr.34373) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:57.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:57 gibba003 bash[32348]: cluster 2021-03-10T16:18:55.647819+0000 mgr.gibba043.dnkmem (mgr.34373) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:57.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:57 gibba043 bash[24019]: cluster 2021-03-10T16:18:55.647819+0000 mgr.gibba043.dnkmem (mgr.34373) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:58 gibba003 bash[31385]: cephadm 2021-03-10T16:18:57.102239+0000 mgr.gibba043.dnkmem (mgr.34373) 7806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:58 gibba003 bash[32348]: cephadm 2021-03-10T16:18:57.102239+0000 mgr.gibba043.dnkmem (mgr.34373) 7806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:58 gibba043 bash[24019]: cephadm 2021-03-10T16:18:57.102239+0000 mgr.gibba043.dnkmem (mgr.34373) 7806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:18:59.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:18:59 gibba003 bash[31385]: cluster 2021-03-10T16:18:57.648444+0000 mgr.gibba043.dnkmem (mgr.34373) 7807 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:59.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:18:59 gibba003 bash[32348]: cluster 2021-03-10T16:18:57.648444+0000 mgr.gibba043.dnkmem (mgr.34373) 7807 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:18:59 gibba043 bash[24019]: cluster 2021-03-10T16:18:57.648444+0000 mgr.gibba043.dnkmem (mgr.34373) 7807 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:01.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:01 gibba003 bash[32348]: cluster 2021-03-10T16:18:59.649704+0000 mgr.gibba043.dnkmem (mgr.34373) 7808 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:01.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:01 gibba003 bash[31385]: cluster 2021-03-10T16:18:59.649704+0000 mgr.gibba043.dnkmem (mgr.34373) 7808 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:01.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:01 gibba043 bash[24019]: cluster 2021-03-10T16:18:59.649704+0000 mgr.gibba043.dnkmem (mgr.34373) 7808 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:01.966 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:19:02.196 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:19:02.197 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 35s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:19:02.197 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:19:02.197 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:19:02.197 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:19:02.198 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:19:02.198 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:19:02.198 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:19:02.198 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:19:02.199 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 35s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:19:02.199 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:19:02.199 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:19:02.199 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:19:02.200 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:19:02.200 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 35s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:19:02.200 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:19:02.200 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:19:02.200 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:19:02.201 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:19:02.201 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:19:02.201 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 35s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:19:02.445 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:19:02.446 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:19:02.446 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:02.446 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:19:02.446 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:19:02.447 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:02.447 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:19:02.447 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:19:02.447 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:19:02.448 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:19:02.448 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:19:02.448 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:19:02.448 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:19:02.448 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:19:02.449 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:19:03.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[31385]: cluster 2021-03-10T16:19:01.651508+0000 mgr.gibba043.dnkmem (mgr.34373) 7809 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[31385]: audit 2021-03-10T16:19:01.958499+0000 mgr.gibba043.dnkmem (mgr.34373) 7810 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:03.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[31385]: audit 2021-03-10T16:19:02.185166+0000 mgr.gibba043.dnkmem (mgr.34373) 7811 : audit [DBG] from='client.59284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:03.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[31385]: audit 2021-03-10T16:19:02.447965+0000 mon.a (mon.0) 1696 : audit [DBG] from='client.? 172.21.2.103:0/965220936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[32348]: cluster 2021-03-10T16:19:01.651508+0000 mgr.gibba043.dnkmem (mgr.34373) 7809 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[32348]: audit 2021-03-10T16:19:01.958499+0000 mgr.gibba043.dnkmem (mgr.34373) 7810 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[32348]: audit 2021-03-10T16:19:02.185166+0000 mgr.gibba043.dnkmem (mgr.34373) 7811 : audit [DBG] from='client.59284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:03.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:03 gibba003 bash[32348]: audit 2021-03-10T16:19:02.447965+0000 mon.a (mon.0) 1696 : audit [DBG] from='client.? 172.21.2.103:0/965220936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:03 gibba043 bash[24019]: cluster 2021-03-10T16:19:01.651508+0000 mgr.gibba043.dnkmem (mgr.34373) 7809 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:03 gibba043 bash[24019]: audit 2021-03-10T16:19:01.958499+0000 mgr.gibba043.dnkmem (mgr.34373) 7810 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:03 gibba043 bash[24019]: audit 2021-03-10T16:19:02.185166+0000 mgr.gibba043.dnkmem (mgr.34373) 7811 : audit [DBG] from='client.59284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:03.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:03 gibba043 bash[24019]: audit 2021-03-10T16:19:02.447965+0000 mon.a (mon.0) 1696 : audit [DBG] from='client.? 172.21.2.103:0/965220936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:05 gibba003 bash[31385]: cluster 2021-03-10T16:19:03.652269+0000 mgr.gibba043.dnkmem (mgr.34373) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:05.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:05 gibba003 bash[32348]: cluster 2021-03-10T16:19:03.652269+0000 mgr.gibba043.dnkmem (mgr.34373) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:05.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:05 gibba043 bash[24019]: cluster 2021-03-10T16:19:03.652269+0000 mgr.gibba043.dnkmem (mgr.34373) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:07 gibba003 bash[31385]: cluster 2021-03-10T16:19:05.653722+0000 mgr.gibba043.dnkmem (mgr.34373) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:07 gibba003 bash[32348]: cluster 2021-03-10T16:19:05.653722+0000 mgr.gibba043.dnkmem (mgr.34373) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:07 gibba043 bash[24019]: cluster 2021-03-10T16:19:05.653722+0000 mgr.gibba043.dnkmem (mgr.34373) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:09.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:09 gibba003 bash[31385]: cluster 2021-03-10T16:19:07.655434+0000 mgr.gibba043.dnkmem (mgr.34373) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:09.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:09 gibba003 bash[32348]: cluster 2021-03-10T16:19:07.655434+0000 mgr.gibba043.dnkmem (mgr.34373) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:09.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:09 gibba043 bash[24019]: cluster 2021-03-10T16:19:07.655434+0000 mgr.gibba043.dnkmem (mgr.34373) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:11 gibba003 bash[32348]: cluster 2021-03-10T16:19:09.656109+0000 mgr.gibba043.dnkmem (mgr.34373) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:11 gibba003 bash[31385]: cluster 2021-03-10T16:19:09.656109+0000 mgr.gibba043.dnkmem (mgr.34373) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:11 gibba043 bash[24019]: cluster 2021-03-10T16:19:09.656109+0000 mgr.gibba043.dnkmem (mgr.34373) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:13.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:13 gibba003 bash[31385]: cluster 2021-03-10T16:19:11.657495+0000 mgr.gibba043.dnkmem (mgr.34373) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:13.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:13 gibba003 bash[31385]: cephadm 2021-03-10T16:19:12.116247+0000 mgr.gibba043.dnkmem (mgr.34373) 7817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:13 gibba003 bash[32348]: cluster 2021-03-10T16:19:11.657495+0000 mgr.gibba043.dnkmem (mgr.34373) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:13 gibba003 bash[32348]: cephadm 2021-03-10T16:19:12.116247+0000 mgr.gibba043.dnkmem (mgr.34373) 7817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:13.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:13 gibba043 bash[24019]: cluster 2021-03-10T16:19:11.657495+0000 mgr.gibba043.dnkmem (mgr.34373) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:13.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:13 gibba043 bash[24019]: cephadm 2021-03-10T16:19:12.116247+0000 mgr.gibba043.dnkmem (mgr.34373) 7817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:13.679329+0000 mon.c (mon.1) 2018 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:13.680479+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:13.874561+0000 mon.c (mon.1) 2019 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:13.875674+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.043657+0000 mon.c (mon.1) 2020 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:19:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.044368+0000 mon.c (mon.1) 2021 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.044894+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:19:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.045120+0000 mon.c (mon.1) 2022 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.045942+0000 mon.c (mon.1) 2023 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.046424+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.047470+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[31385]: audit 2021-03-10T16:19:14.048258+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:13.679329+0000 mon.c (mon.1) 2018 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:13.680479+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:14.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:13.874561+0000 mon.c (mon.1) 2019 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:13.875674+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:14.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.043657+0000 mon.c (mon.1) 2020 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:19:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.044368+0000 mon.c (mon.1) 2021 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.044894+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:19:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.045120+0000 mon.c (mon.1) 2022 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.045942+0000 mon.c (mon.1) 2023 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.046424+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.047470+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:14 gibba003 bash[32348]: audit 2021-03-10T16:19:14.048258+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:13.679329+0000 mon.c (mon.1) 2018 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:13.680479+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:13.874561+0000 mon.c (mon.1) 2019 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:13.875674+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.043657+0000 mon.c (mon.1) 2020 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:19:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.044368+0000 mon.c (mon.1) 2021 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.044894+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:19:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.045120+0000 mon.c (mon.1) 2022 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.045942+0000 mon.c (mon.1) 2023 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.046424+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.047470+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:19:14.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:14 gibba043 bash[24019]: audit 2021-03-10T16:19:14.048258+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:15 gibba003 bash[31385]: cluster 2021-03-10T16:19:13.659042+0000 mgr.gibba043.dnkmem (mgr.34373) 7818 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:15.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:15 gibba003 bash[32348]: cluster 2021-03-10T16:19:13.659042+0000 mgr.gibba043.dnkmem (mgr.34373) 7818 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:15 gibba043 bash[24019]: cluster 2021-03-10T16:19:13.659042+0000 mgr.gibba043.dnkmem (mgr.34373) 7818 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:17 gibba003 bash[31385]: cluster 2021-03-10T16:19:15.660500+0000 mgr.gibba043.dnkmem (mgr.34373) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:17 gibba003 bash[32348]: cluster 2021-03-10T16:19:15.660500+0000 mgr.gibba043.dnkmem (mgr.34373) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:17 gibba043 bash[24019]: cluster 2021-03-10T16:19:15.660500+0000 mgr.gibba043.dnkmem (mgr.34373) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:19 gibba003 bash[31385]: cluster 2021-03-10T16:19:17.661899+0000 mgr.gibba043.dnkmem (mgr.34373) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:19.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:19 gibba003 bash[32348]: cluster 2021-03-10T16:19:17.661899+0000 mgr.gibba043.dnkmem (mgr.34373) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:19.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:19 gibba043 bash[24019]: cluster 2021-03-10T16:19:17.661899+0000 mgr.gibba043.dnkmem (mgr.34373) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:21 gibba043 bash[24019]: cluster 2021-03-10T16:19:19.663534+0000 mgr.gibba043.dnkmem (mgr.34373) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:21 gibba003 bash[31385]: cluster 2021-03-10T16:19:19.663534+0000 mgr.gibba043.dnkmem (mgr.34373) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:21.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:21 gibba003 bash[32348]: cluster 2021-03-10T16:19:19.663534+0000 mgr.gibba043.dnkmem (mgr.34373) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:23 gibba043 bash[24019]: cluster 2021-03-10T16:19:21.664441+0000 mgr.gibba043.dnkmem (mgr.34373) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:23.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:23 gibba003 bash[31385]: cluster 2021-03-10T16:19:21.664441+0000 mgr.gibba043.dnkmem (mgr.34373) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:23 gibba003 bash[32348]: cluster 2021-03-10T16:19:21.664441+0000 mgr.gibba043.dnkmem (mgr.34373) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:25 gibba043 bash[24019]: cluster 2021-03-10T16:19:23.665730+0000 mgr.gibba043.dnkmem (mgr.34373) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:25.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:25 gibba003 bash[31385]: cluster 2021-03-10T16:19:23.665730+0000 mgr.gibba043.dnkmem (mgr.34373) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:25.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:25 gibba003 bash[32348]: cluster 2021-03-10T16:19:23.665730+0000 mgr.gibba043.dnkmem (mgr.34373) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:27 gibba043 bash[24019]: cluster 2021-03-10T16:19:25.667149+0000 mgr.gibba043.dnkmem (mgr.34373) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:27 gibba043 bash[24019]: audit 2021-03-10T16:19:27.130801+0000 mon.c (mon.1) 2024 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:27.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:27 gibba003 bash[31385]: cluster 2021-03-10T16:19:25.667149+0000 mgr.gibba043.dnkmem (mgr.34373) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:27 gibba003 bash[31385]: audit 2021-03-10T16:19:27.130801+0000 mon.c (mon.1) 2024 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:27 gibba003 bash[32348]: cluster 2021-03-10T16:19:25.667149+0000 mgr.gibba043.dnkmem (mgr.34373) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:27 gibba003 bash[32348]: audit 2021-03-10T16:19:27.130801+0000 mon.c (mon.1) 2024 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:28 gibba043 bash[24019]: cephadm 2021-03-10T16:19:27.127476+0000 mgr.gibba043.dnkmem (mgr.34373) 7825 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:19:28.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:28 gibba003 bash[31385]: cephadm 2021-03-10T16:19:27.127476+0000 mgr.gibba043.dnkmem (mgr.34373) 7825 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:19:28.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:28 gibba003 bash[32348]: cephadm 2021-03-10T16:19:27.127476+0000 mgr.gibba043.dnkmem (mgr.34373) 7825 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:19:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:29 gibba043 bash[24019]: cluster 2021-03-10T16:19:27.668735+0000 mgr.gibba043.dnkmem (mgr.34373) 7826 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:29.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:29 gibba003 bash[31385]: cluster 2021-03-10T16:19:27.668735+0000 mgr.gibba043.dnkmem (mgr.34373) 7826 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:29.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:29 gibba003 bash[32348]: cluster 2021-03-10T16:19:27.668735+0000 mgr.gibba043.dnkmem (mgr.34373) 7826 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:31 gibba043 bash[24019]: cluster 2021-03-10T16:19:29.670166+0000 mgr.gibba043.dnkmem (mgr.34373) 7827 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:31 gibba043 bash[24019]: audit 2021-03-10T16:19:31.043685+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:31.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:31 gibba043 bash[24019]: audit 2021-03-10T16:19:31.045259+0000 mon.c (mon.1) 2025 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:19:31.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:31 gibba003 bash[31385]: cluster 2021-03-10T16:19:29.670166+0000 mgr.gibba043.dnkmem (mgr.34373) 7827 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:31 gibba003 bash[31385]: audit 2021-03-10T16:19:31.043685+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:31 gibba003 bash[31385]: audit 2021-03-10T16:19:31.045259+0000 mon.c (mon.1) 2025 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:19:31.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:31 gibba003 bash[32348]: cluster 2021-03-10T16:19:29.670166+0000 mgr.gibba043.dnkmem (mgr.34373) 7827 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:31 gibba003 bash[32348]: audit 2021-03-10T16:19:31.043685+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:31 gibba003 bash[32348]: audit 2021-03-10T16:19:31.045259+0000 mon.c (mon.1) 2025 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:19:32.691 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:19:32.918 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:19:32.919 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 66s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:19:32.919 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 1s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:19:32.919 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:19:32.919 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:19:32.920 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:19:32.920 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:19:32.920 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:19:32.920 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:19:32.920 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 66s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:19:32.921 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 1s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:19:32.921 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:19:32.921 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:19:32.921 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:19:32.922 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 66s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:19:32.922 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:19:32.922 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:19:32.922 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:19:32.923 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:19:32.923 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 1s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:19:32.923 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 66s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:19:33.168 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:19:33.168 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:19:33.168 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:33.168 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:19:33.169 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:19:33.169 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:33.169 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:19:33.169 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:19:33.170 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:19:33.170 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:19:33.170 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:19:33.170 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:19:33.171 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:19:33.171 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:19:33.171 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:19:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:33 gibba043 bash[24019]: cluster 2021-03-10T16:19:31.672043+0000 mgr.gibba043.dnkmem (mgr.34373) 7828 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:33 gibba043 bash[24019]: audit 2021-03-10T16:19:33.170387+0000 mon.c (mon.1) 2026 : audit [DBG] from='client.? 172.21.2.103:0/2102825768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:33 gibba003 bash[31385]: cluster 2021-03-10T16:19:31.672043+0000 mgr.gibba043.dnkmem (mgr.34373) 7828 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:33 gibba003 bash[31385]: audit 2021-03-10T16:19:33.170387+0000 mon.c (mon.1) 2026 : audit [DBG] from='client.? 172.21.2.103:0/2102825768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:33 gibba003 bash[32348]: cluster 2021-03-10T16:19:31.672043+0000 mgr.gibba043.dnkmem (mgr.34373) 7828 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:33 gibba003 bash[32348]: audit 2021-03-10T16:19:33.170387+0000 mon.c (mon.1) 2026 : audit [DBG] from='client.? 172.21.2.103:0/2102825768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:34.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:34 gibba043 bash[24019]: audit 2021-03-10T16:19:32.683929+0000 mgr.gibba043.dnkmem (mgr.34373) 7829 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:34.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:34 gibba043 bash[24019]: audit 2021-03-10T16:19:32.907351+0000 mgr.gibba043.dnkmem (mgr.34373) 7830 : audit [DBG] from='client.49314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:34.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:34 gibba003 bash[31385]: audit 2021-03-10T16:19:32.683929+0000 mgr.gibba043.dnkmem (mgr.34373) 7829 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:34 gibba003 bash[31385]: audit 2021-03-10T16:19:32.907351+0000 mgr.gibba043.dnkmem (mgr.34373) 7830 : audit [DBG] from='client.49314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:34 gibba003 bash[32348]: audit 2021-03-10T16:19:32.683929+0000 mgr.gibba043.dnkmem (mgr.34373) 7829 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:34.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:34 gibba003 bash[32348]: audit 2021-03-10T16:19:32.907351+0000 mgr.gibba043.dnkmem (mgr.34373) 7830 : audit [DBG] from='client.49314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:35 gibba043 bash[24019]: cluster 2021-03-10T16:19:33.672744+0000 mgr.gibba043.dnkmem (mgr.34373) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:35.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:35 gibba003 bash[31385]: cluster 2021-03-10T16:19:33.672744+0000 mgr.gibba043.dnkmem (mgr.34373) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:35 gibba003 bash[32348]: cluster 2021-03-10T16:19:33.672744+0000 mgr.gibba043.dnkmem (mgr.34373) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:35.741524+0000 mon.c (mon.1) 2027 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:35.914408+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.098654+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.102504+0000 mon.c (mon.1) 2028 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.103908+0000 mon.c (mon.1) 2029 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.105219+0000 mon.c (mon.1) 2030 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.106535+0000 mon.c (mon.1) 2031 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.109560+0000 mon.c (mon.1) 2032 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:36 gibba043 bash[24019]: audit 2021-03-10T16:19:36.111121+0000 mon.c (mon.1) 2033 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:35.741524+0000 mon.c (mon.1) 2027 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:36.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:35.914408+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.098654+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.102504+0000 mon.c (mon.1) 2028 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.103908+0000 mon.c (mon.1) 2029 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.105219+0000 mon.c (mon.1) 2030 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.106535+0000 mon.c (mon.1) 2031 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.109560+0000 mon.c (mon.1) 2032 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[31385]: audit 2021-03-10T16:19:36.111121+0000 mon.c (mon.1) 2033 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:35.741524+0000 mon.c (mon.1) 2027 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:36.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:35.914408+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.098654+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:19:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.102504+0000 mon.c (mon.1) 2028 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:36.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.103908+0000 mon.c (mon.1) 2029 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.105219+0000 mon.c (mon.1) 2030 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.106535+0000 mon.c (mon.1) 2031 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.109560+0000 mon.c (mon.1) 2032 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:36.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:36 gibba003 bash[32348]: audit 2021-03-10T16:19:36.111121+0000 mon.c (mon.1) 2033 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cluster 2021-03-10T16:19:35.673921+0000 mgr.gibba043.dnkmem (mgr.34373) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:35.914321+0000 mgr.gibba043.dnkmem (mgr.34373) 7833 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:19:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.100435+0000 mgr.gibba043.dnkmem (mgr.34373) 7834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.102124+0000 mgr.gibba043.dnkmem (mgr.34373) 7835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.103381+0000 mgr.gibba043.dnkmem (mgr.34373) 7836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.103419+0000 mgr.gibba043.dnkmem (mgr.34373) 7837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.104752+0000 mgr.gibba043.dnkmem (mgr.34373) 7838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.104788+0000 mgr.gibba043.dnkmem (mgr.34373) 7839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.106039+0000 mgr.gibba043.dnkmem (mgr.34373) 7840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.107647+0000 mgr.gibba043.dnkmem (mgr.34373) 7841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.107762+0000 mgr.gibba043.dnkmem (mgr.34373) 7842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.109082+0000 mgr.gibba043.dnkmem (mgr.34373) 7843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.109397+0000 mgr.gibba043.dnkmem (mgr.34373) 7844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.110611+0000 mgr.gibba043.dnkmem (mgr.34373) 7845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.110648+0000 mgr.gibba043.dnkmem (mgr.34373) 7846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[31385]: cephadm 2021-03-10T16:19:36.110750+0000 mgr.gibba043.dnkmem (mgr.34373) 7847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cluster 2021-03-10T16:19:35.673921+0000 mgr.gibba043.dnkmem (mgr.34373) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:35.914321+0000 mgr.gibba043.dnkmem (mgr.34373) 7833 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:19:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.100435+0000 mgr.gibba043.dnkmem (mgr.34373) 7834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.102124+0000 mgr.gibba043.dnkmem (mgr.34373) 7835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.103381+0000 mgr.gibba043.dnkmem (mgr.34373) 7836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.103419+0000 mgr.gibba043.dnkmem (mgr.34373) 7837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.104752+0000 mgr.gibba043.dnkmem (mgr.34373) 7838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.104788+0000 mgr.gibba043.dnkmem (mgr.34373) 7839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.106039+0000 mgr.gibba043.dnkmem (mgr.34373) 7840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.107647+0000 mgr.gibba043.dnkmem (mgr.34373) 7841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.107762+0000 mgr.gibba043.dnkmem (mgr.34373) 7842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.109082+0000 mgr.gibba043.dnkmem (mgr.34373) 7843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.109397+0000 mgr.gibba043.dnkmem (mgr.34373) 7844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.110611+0000 mgr.gibba043.dnkmem (mgr.34373) 7845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.110648+0000 mgr.gibba043.dnkmem (mgr.34373) 7846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:37 gibba003 bash[32348]: cephadm 2021-03-10T16:19:36.110750+0000 mgr.gibba043.dnkmem (mgr.34373) 7847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cluster 2021-03-10T16:19:35.673921+0000 mgr.gibba043.dnkmem (mgr.34373) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:35.914321+0000 mgr.gibba043.dnkmem (mgr.34373) 7833 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:19:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.100435+0000 mgr.gibba043.dnkmem (mgr.34373) 7834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.102124+0000 mgr.gibba043.dnkmem (mgr.34373) 7835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.103381+0000 mgr.gibba043.dnkmem (mgr.34373) 7836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.103419+0000 mgr.gibba043.dnkmem (mgr.34373) 7837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.104752+0000 mgr.gibba043.dnkmem (mgr.34373) 7838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.104788+0000 mgr.gibba043.dnkmem (mgr.34373) 7839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.106039+0000 mgr.gibba043.dnkmem (mgr.34373) 7840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.107647+0000 mgr.gibba043.dnkmem (mgr.34373) 7841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.107762+0000 mgr.gibba043.dnkmem (mgr.34373) 7842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.109082+0000 mgr.gibba043.dnkmem (mgr.34373) 7843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.109397+0000 mgr.gibba043.dnkmem (mgr.34373) 7844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.110611+0000 mgr.gibba043.dnkmem (mgr.34373) 7845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.110648+0000 mgr.gibba043.dnkmem (mgr.34373) 7846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:37 gibba043 bash[24019]: cephadm 2021-03-10T16:19:36.110750+0000 mgr.gibba043.dnkmem (mgr.34373) 7847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:39 gibba003 bash[31385]: cluster 2021-03-10T16:19:37.675456+0000 mgr.gibba043.dnkmem (mgr.34373) 7848 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:39 gibba003 bash[32348]: cluster 2021-03-10T16:19:37.675456+0000 mgr.gibba043.dnkmem (mgr.34373) 7848 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:39 gibba043 bash[24019]: cluster 2021-03-10T16:19:37.675456+0000 mgr.gibba043.dnkmem (mgr.34373) 7848 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:41.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:41 gibba003 bash[31385]: cluster 2021-03-10T16:19:39.677082+0000 mgr.gibba043.dnkmem (mgr.34373) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:41.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:41 gibba003 bash[32348]: cluster 2021-03-10T16:19:39.677082+0000 mgr.gibba043.dnkmem (mgr.34373) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:41 gibba043 bash[24019]: cluster 2021-03-10T16:19:39.677082+0000 mgr.gibba043.dnkmem (mgr.34373) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:43 gibba003 bash[31385]: cluster 2021-03-10T16:19:41.678756+0000 mgr.gibba043.dnkmem (mgr.34373) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:43 gibba003 bash[32348]: cluster 2021-03-10T16:19:41.678756+0000 mgr.gibba043.dnkmem (mgr.34373) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:43 gibba043 bash[24019]: cluster 2021-03-10T16:19:41.678756+0000 mgr.gibba043.dnkmem (mgr.34373) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:45 gibba003 bash[31385]: cluster 2021-03-10T16:19:43.680334+0000 mgr.gibba043.dnkmem (mgr.34373) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:45 gibba003 bash[32348]: cluster 2021-03-10T16:19:43.680334+0000 mgr.gibba043.dnkmem (mgr.34373) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:45 gibba043 bash[24019]: cluster 2021-03-10T16:19:43.680334+0000 mgr.gibba043.dnkmem (mgr.34373) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:47 gibba003 bash[31385]: cluster 2021-03-10T16:19:45.680925+0000 mgr.gibba043.dnkmem (mgr.34373) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:47 gibba003 bash[32348]: cluster 2021-03-10T16:19:45.680925+0000 mgr.gibba043.dnkmem (mgr.34373) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:47 gibba043 bash[24019]: cluster 2021-03-10T16:19:45.680925+0000 mgr.gibba043.dnkmem (mgr.34373) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:49.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:49 gibba003 bash[32348]: cluster 2021-03-10T16:19:47.682428+0000 mgr.gibba043.dnkmem (mgr.34373) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:49 gibba003 bash[31385]: cluster 2021-03-10T16:19:47.682428+0000 mgr.gibba043.dnkmem (mgr.34373) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:49 gibba043 bash[24019]: cluster 2021-03-10T16:19:47.682428+0000 mgr.gibba043.dnkmem (mgr.34373) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:51 gibba043 bash[24019]: cluster 2021-03-10T16:19:49.683997+0000 mgr.gibba043.dnkmem (mgr.34373) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:51 gibba003 bash[31385]: cluster 2021-03-10T16:19:49.683997+0000 mgr.gibba043.dnkmem (mgr.34373) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:51 gibba003 bash[32348]: cluster 2021-03-10T16:19:49.683997+0000 mgr.gibba043.dnkmem (mgr.34373) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:52.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:52 gibba003 bash[31385]: cephadm 2021-03-10T16:19:51.124369+0000 mgr.gibba043.dnkmem (mgr.34373) 7855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:52.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:52 gibba003 bash[32348]: cephadm 2021-03-10T16:19:51.124369+0000 mgr.gibba043.dnkmem (mgr.34373) 7855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:52.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:52 gibba043 bash[24019]: cephadm 2021-03-10T16:19:51.124369+0000 mgr.gibba043.dnkmem (mgr.34373) 7855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:19:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:53 gibba003 bash[31385]: cluster 2021-03-10T16:19:51.684939+0000 mgr.gibba043.dnkmem (mgr.34373) 7856 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:53 gibba003 bash[32348]: cluster 2021-03-10T16:19:51.684939+0000 mgr.gibba043.dnkmem (mgr.34373) 7856 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:53 gibba043 bash[24019]: cluster 2021-03-10T16:19:51.684939+0000 mgr.gibba043.dnkmem (mgr.34373) 7856 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:55 gibba003 bash[31385]: cluster 2021-03-10T16:19:53.686456+0000 mgr.gibba043.dnkmem (mgr.34373) 7857 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:55 gibba003 bash[32348]: cluster 2021-03-10T16:19:53.686456+0000 mgr.gibba043.dnkmem (mgr.34373) 7857 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:55 gibba043 bash[24019]: cluster 2021-03-10T16:19:53.686456+0000 mgr.gibba043.dnkmem (mgr.34373) 7857 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:57 gibba003 bash[31385]: cluster 2021-03-10T16:19:55.688053+0000 mgr.gibba043.dnkmem (mgr.34373) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:57 gibba003 bash[32348]: cluster 2021-03-10T16:19:55.688053+0000 mgr.gibba043.dnkmem (mgr.34373) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:57 gibba043 bash[24019]: cluster 2021-03-10T16:19:55.688053+0000 mgr.gibba043.dnkmem (mgr.34373) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:19:59 gibba003 bash[31385]: cluster 2021-03-10T16:19:57.689143+0000 mgr.gibba043.dnkmem (mgr.34373) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:19:59 gibba003 bash[32348]: cluster 2021-03-10T16:19:57.689143+0000 mgr.gibba043.dnkmem (mgr.34373) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:19:59 gibba043 bash[24019]: cluster 2021-03-10T16:19:57.689143+0000 mgr.gibba043.dnkmem (mgr.34373) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:00.398 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:00 gibba003 bash[31385]: debug 2021-03-10T16:19:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:00.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:00 gibba003 bash[31385]: cluster 2021-03-10T16:20:00.000292+0000 mon.a (mon.0) 1706 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:00 gibba003 bash[32348]: cluster 2021-03-10T16:20:00.000292+0000 mon.a (mon.0) 1706 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:00.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:00 gibba043 bash[24019]: cluster 2021-03-10T16:20:00.000292+0000 mon.a (mon.0) 1706 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:01 gibba003 bash[31385]: cluster 2021-03-10T16:19:59.690442+0000 mgr.gibba043.dnkmem (mgr.34373) 7860 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:01.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:01 gibba003 bash[32348]: cluster 2021-03-10T16:19:59.690442+0000 mgr.gibba043.dnkmem (mgr.34373) 7860 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:01 gibba043 bash[24019]: cluster 2021-03-10T16:19:59.690442+0000 mgr.gibba043.dnkmem (mgr.34373) 7860 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.410 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:20:03.638 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:20:03.638 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 96s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:20:03.639 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 32s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:20:03.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:20:03.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:20:03.639 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:20:03.639 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:20:03.640 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:20:03.640 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:20:03.640 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 96s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:20:03.640 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 32s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:20:03.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:20:03.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:20:03.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:20:03.641 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:20:03.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:20:03.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:20:03.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:20:03.642 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:20:03.643 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 32s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:20:03.643 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 96s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:20:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:03 gibba003 bash[31385]: cluster 2021-03-10T16:20:01.692291+0000 mgr.gibba043.dnkmem (mgr.34373) 7861 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:03 gibba003 bash[32348]: cluster 2021-03-10T16:20:01.692291+0000 mgr.gibba043.dnkmem (mgr.34373) 7861 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:03 gibba043 bash[24019]: cluster 2021-03-10T16:20:01.692291+0000 mgr.gibba043.dnkmem (mgr.34373) 7861 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.891 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:20:03.892 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:20:03.892 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:03.892 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:20:03.892 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:20:03.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:03.893 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:20:03.893 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:20:03.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:20:03.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:20:03.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:20:03.894 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:20:03.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:20:03.895 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:20:03.895 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:20:04.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:04 gibba003 bash[31385]: audit 2021-03-10T16:20:03.401938+0000 mgr.gibba043.dnkmem (mgr.34373) 7862 : audit [DBG] from='client.49326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:04.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:04 gibba003 bash[31385]: audit 2021-03-10T16:20:03.894102+0000 mon.a (mon.0) 1707 : audit [DBG] from='client.? 172.21.2.103:0/4000182640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:04 gibba003 bash[32348]: audit 2021-03-10T16:20:03.401938+0000 mgr.gibba043.dnkmem (mgr.34373) 7862 : audit [DBG] from='client.49326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:04 gibba003 bash[32348]: audit 2021-03-10T16:20:03.894102+0000 mon.a (mon.0) 1707 : audit [DBG] from='client.? 172.21.2.103:0/4000182640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:04 gibba043 bash[24019]: audit 2021-03-10T16:20:03.401938+0000 mgr.gibba043.dnkmem (mgr.34373) 7862 : audit [DBG] from='client.49326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:04 gibba043 bash[24019]: audit 2021-03-10T16:20:03.894102+0000 mon.a (mon.0) 1707 : audit [DBG] from='client.? 172.21.2.103:0/4000182640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:05 gibba003 bash[31385]: audit 2021-03-10T16:20:03.627251+0000 mgr.gibba043.dnkmem (mgr.34373) 7863 : audit [DBG] from='client.49332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:05.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:05 gibba003 bash[31385]: cluster 2021-03-10T16:20:03.693895+0000 mgr.gibba043.dnkmem (mgr.34373) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:05.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:05 gibba003 bash[32348]: audit 2021-03-10T16:20:03.627251+0000 mgr.gibba043.dnkmem (mgr.34373) 7863 : audit [DBG] from='client.49332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:05.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:05 gibba003 bash[32348]: cluster 2021-03-10T16:20:03.693895+0000 mgr.gibba043.dnkmem (mgr.34373) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:05 gibba043 bash[24019]: audit 2021-03-10T16:20:03.627251+0000 mgr.gibba043.dnkmem (mgr.34373) 7863 : audit [DBG] from='client.49332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:05 gibba043 bash[24019]: cluster 2021-03-10T16:20:03.693895+0000 mgr.gibba043.dnkmem (mgr.34373) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:07 gibba043 bash[24019]: cluster 2021-03-10T16:20:05.695356+0000 mgr.gibba043.dnkmem (mgr.34373) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:07 gibba043 bash[24019]: cephadm 2021-03-10T16:20:06.130061+0000 mgr.gibba043.dnkmem (mgr.34373) 7866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:07.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:07 gibba003 bash[31385]: cluster 2021-03-10T16:20:05.695356+0000 mgr.gibba043.dnkmem (mgr.34373) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:07 gibba003 bash[31385]: cephadm 2021-03-10T16:20:06.130061+0000 mgr.gibba043.dnkmem (mgr.34373) 7866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:07 gibba003 bash[32348]: cluster 2021-03-10T16:20:05.695356+0000 mgr.gibba043.dnkmem (mgr.34373) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:07 gibba003 bash[32348]: cephadm 2021-03-10T16:20:06.130061+0000 mgr.gibba043.dnkmem (mgr.34373) 7866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:09 gibba043 bash[24019]: cluster 2021-03-10T16:20:07.697075+0000 mgr.gibba043.dnkmem (mgr.34373) 7867 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:09 gibba003 bash[31385]: cluster 2021-03-10T16:20:07.697075+0000 mgr.gibba043.dnkmem (mgr.34373) 7867 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:09 gibba003 bash[32348]: cluster 2021-03-10T16:20:07.697075+0000 mgr.gibba043.dnkmem (mgr.34373) 7867 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:11 gibba043 bash[24019]: cluster 2021-03-10T16:20:09.698455+0000 mgr.gibba043.dnkmem (mgr.34373) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:11 gibba003 bash[31385]: cluster 2021-03-10T16:20:09.698455+0000 mgr.gibba043.dnkmem (mgr.34373) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:11 gibba003 bash[32348]: cluster 2021-03-10T16:20:09.698455+0000 mgr.gibba043.dnkmem (mgr.34373) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:13 gibba043 bash[24019]: cluster 2021-03-10T16:20:11.699977+0000 mgr.gibba043.dnkmem (mgr.34373) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:13 gibba003 bash[31385]: cluster 2021-03-10T16:20:11.699977+0000 mgr.gibba043.dnkmem (mgr.34373) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:13 gibba003 bash[32348]: cluster 2021-03-10T16:20:11.699977+0000 mgr.gibba043.dnkmem (mgr.34373) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:13.686189+0000 mon.c (mon.1) 2034 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:13.687301+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:13.881830+0000 mon.c (mon.1) 2035 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:13.882921+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.053069+0000 mon.c (mon.1) 2036 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:20:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.053809+0000 mon.c (mon.1) 2037 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.054453+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:20:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.054486+0000 mon.c (mon.1) 2038 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.055202+0000 mon.c (mon.1) 2039 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.056679+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.057597+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:14 gibba043 bash[24019]: audit 2021-03-10T16:20:14.058636+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:13.686189+0000 mon.c (mon.1) 2034 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:13.687301+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:13.881830+0000 mon.c (mon.1) 2035 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:13.882921+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.053069+0000 mon.c (mon.1) 2036 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:20:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.053809+0000 mon.c (mon.1) 2037 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.054453+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:20:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.054486+0000 mon.c (mon.1) 2038 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.055202+0000 mon.c (mon.1) 2039 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.056679+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.057597+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[31385]: audit 2021-03-10T16:20:14.058636+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:13.686189+0000 mon.c (mon.1) 2034 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:13.687301+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:13.881830+0000 mon.c (mon.1) 2035 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:13.882921+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.053069+0000 mon.c (mon.1) 2036 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:20:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.053809+0000 mon.c (mon.1) 2037 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.054453+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:20:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.054486+0000 mon.c (mon.1) 2038 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.055202+0000 mon.c (mon.1) 2039 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.056679+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.057597+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:20:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:14 gibba003 bash[32348]: audit 2021-03-10T16:20:14.058636+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:20:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:15 gibba043 bash[24019]: cluster 2021-03-10T16:20:13.701730+0000 mgr.gibba043.dnkmem (mgr.34373) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:15 gibba003 bash[31385]: cluster 2021-03-10T16:20:13.701730+0000 mgr.gibba043.dnkmem (mgr.34373) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:15 gibba003 bash[32348]: cluster 2021-03-10T16:20:13.701730+0000 mgr.gibba043.dnkmem (mgr.34373) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:17 gibba043 bash[24019]: cluster 2021-03-10T16:20:15.702821+0000 mgr.gibba043.dnkmem (mgr.34373) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:17 gibba003 bash[31385]: cluster 2021-03-10T16:20:15.702821+0000 mgr.gibba043.dnkmem (mgr.34373) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:17.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:17 gibba003 bash[32348]: cluster 2021-03-10T16:20:15.702821+0000 mgr.gibba043.dnkmem (mgr.34373) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:19 gibba043 bash[24019]: cluster 2021-03-10T16:20:17.704314+0000 mgr.gibba043.dnkmem (mgr.34373) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:19 gibba003 bash[31385]: cluster 2021-03-10T16:20:17.704314+0000 mgr.gibba043.dnkmem (mgr.34373) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:19 gibba003 bash[32348]: cluster 2021-03-10T16:20:17.704314+0000 mgr.gibba043.dnkmem (mgr.34373) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:21 gibba043 bash[24019]: cluster 2021-03-10T16:20:19.705715+0000 mgr.gibba043.dnkmem (mgr.34373) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:21 gibba003 bash[31385]: cluster 2021-03-10T16:20:19.705715+0000 mgr.gibba043.dnkmem (mgr.34373) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:21 gibba003 bash[32348]: cluster 2021-03-10T16:20:19.705715+0000 mgr.gibba043.dnkmem (mgr.34373) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:22.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:22 gibba043 bash[24019]: cephadm 2021-03-10T16:20:21.145824+0000 mgr.gibba043.dnkmem (mgr.34373) 7874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:22.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:22 gibba003 bash[31385]: cephadm 2021-03-10T16:20:21.145824+0000 mgr.gibba043.dnkmem (mgr.34373) 7874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:22.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:22 gibba003 bash[32348]: cephadm 2021-03-10T16:20:21.145824+0000 mgr.gibba043.dnkmem (mgr.34373) 7874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:23 gibba003 bash[31385]: cluster 2021-03-10T16:20:21.707389+0000 mgr.gibba043.dnkmem (mgr.34373) 7875 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:23 gibba003 bash[32348]: cluster 2021-03-10T16:20:21.707389+0000 mgr.gibba043.dnkmem (mgr.34373) 7875 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:24.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:23 gibba043 bash[24019]: cluster 2021-03-10T16:20:21.707389+0000 mgr.gibba043.dnkmem (mgr.34373) 7875 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:25 gibba003 bash[31385]: cluster 2021-03-10T16:20:23.709052+0000 mgr.gibba043.dnkmem (mgr.34373) 7876 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:25.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:25 gibba003 bash[32348]: cluster 2021-03-10T16:20:23.709052+0000 mgr.gibba043.dnkmem (mgr.34373) 7876 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:25 gibba043 bash[24019]: cluster 2021-03-10T16:20:23.709052+0000 mgr.gibba043.dnkmem (mgr.34373) 7876 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:27.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:27 gibba003 bash[31385]: cluster 2021-03-10T16:20:25.710580+0000 mgr.gibba043.dnkmem (mgr.34373) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:27.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:27 gibba003 bash[32348]: cluster 2021-03-10T16:20:25.710580+0000 mgr.gibba043.dnkmem (mgr.34373) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:28.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:27 gibba043 bash[24019]: cluster 2021-03-10T16:20:25.710580+0000 mgr.gibba043.dnkmem (mgr.34373) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:29.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:29 gibba003 bash[31385]: cluster 2021-03-10T16:20:27.711956+0000 mgr.gibba043.dnkmem (mgr.34373) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:29.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:29 gibba003 bash[32348]: cluster 2021-03-10T16:20:27.711956+0000 mgr.gibba043.dnkmem (mgr.34373) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:29 gibba043 bash[24019]: cluster 2021-03-10T16:20:27.711956+0000 mgr.gibba043.dnkmem (mgr.34373) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:31 gibba003 bash[31385]: cluster 2021-03-10T16:20:29.713399+0000 mgr.gibba043.dnkmem (mgr.34373) 7879 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:31 gibba003 bash[32348]: cluster 2021-03-10T16:20:29.713399+0000 mgr.gibba043.dnkmem (mgr.34373) 7879 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:32.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:31 gibba043 bash[24019]: cluster 2021-03-10T16:20:29.713399+0000 mgr.gibba043.dnkmem (mgr.34373) 7879 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:33 gibba003 bash[31385]: cluster 2021-03-10T16:20:31.715067+0000 mgr.gibba043.dnkmem (mgr.34373) 7880 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:33 gibba003 bash[32348]: cluster 2021-03-10T16:20:31.715067+0000 mgr.gibba043.dnkmem (mgr.34373) 7880 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:34.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:33 gibba043 bash[24019]: cluster 2021-03-10T16:20:31.715067+0000 mgr.gibba043.dnkmem (mgr.34373) 7880 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:34.137 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:20:34.365 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:20:34.366 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:20:34.366 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 63s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:20:34.366 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:20:34.366 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:20:34.367 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:20:34.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:20:34.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:20:34.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:20:34.367 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:20:34.368 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 63s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:20:34.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:20:34.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:20:34.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:20:34.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:20:34.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:20:34.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:20:34.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:20:34.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 63s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:20:34.370 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 63s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:20:34.370 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:20:34.615 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:20:34.615 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:20:34.615 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:34.616 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:20:34.616 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:20:34.616 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:34.616 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:20:34.617 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:20:34.617 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:20:34.617 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:20:34.617 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:20:34.617 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:20:34.618 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:20:34.618 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:20:34.618 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:20:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[31385]: cluster 2021-03-10T16:20:33.716528+0000 mgr.gibba043.dnkmem (mgr.34373) 7881 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[31385]: audit 2021-03-10T16:20:34.129803+0000 mgr.gibba043.dnkmem (mgr.34373) 7882 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[31385]: audit 2021-03-10T16:20:34.354544+0000 mgr.gibba043.dnkmem (mgr.34373) 7883 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[31385]: audit 2021-03-10T16:20:34.617697+0000 mon.a (mon.0) 1714 : audit [DBG] from='client.? 172.21.2.103:0/3667943767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[32348]: cluster 2021-03-10T16:20:33.716528+0000 mgr.gibba043.dnkmem (mgr.34373) 7881 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[32348]: audit 2021-03-10T16:20:34.129803+0000 mgr.gibba043.dnkmem (mgr.34373) 7882 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[32348]: audit 2021-03-10T16:20:34.354544+0000 mgr.gibba043.dnkmem (mgr.34373) 7883 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:35 gibba003 bash[32348]: audit 2021-03-10T16:20:34.617697+0000 mon.a (mon.0) 1714 : audit [DBG] from='client.? 172.21.2.103:0/3667943767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:36.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:35 gibba043 bash[24019]: cluster 2021-03-10T16:20:33.716528+0000 mgr.gibba043.dnkmem (mgr.34373) 7881 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:36.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:35 gibba043 bash[24019]: audit 2021-03-10T16:20:34.129803+0000 mgr.gibba043.dnkmem (mgr.34373) 7882 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:35 gibba043 bash[24019]: audit 2021-03-10T16:20:34.354544+0000 mgr.gibba043.dnkmem (mgr.34373) 7883 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:35 gibba043 bash[24019]: audit 2021-03-10T16:20:34.617697+0000 mon.a (mon.0) 1714 : audit [DBG] from='client.? 172.21.2.103:0/3667943767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cluster 2021-03-10T16:20:35.718048+0000 mgr.gibba043.dnkmem (mgr.34373) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.149138+0000 mgr.gibba043.dnkmem (mgr.34373) 7885 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:20:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.149677+0000 mgr.gibba043.dnkmem (mgr.34373) 7886 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:20:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.366144+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:20:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.367721+0000 mgr.gibba043.dnkmem (mgr.34373) 7887 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.369908+0000 mgr.gibba043.dnkmem (mgr.34373) 7888 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.370173+0000 mon.c (mon.1) 2040 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.371525+0000 mgr.gibba043.dnkmem (mgr.34373) 7889 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:37.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.371579+0000 mgr.gibba043.dnkmem (mgr.34373) 7890 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.371915+0000 mon.c (mon.1) 2041 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.373238+0000 mgr.gibba043.dnkmem (mgr.34373) 7891 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.373284+0000 mgr.gibba043.dnkmem (mgr.34373) 7892 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.373649+0000 mon.c (mon.1) 2042 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.374914+0000 mgr.gibba043.dnkmem (mgr.34373) 7893 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.375115+0000 mon.c (mon.1) 2043 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.376674+0000 mgr.gibba043.dnkmem (mgr.34373) 7894 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.376724+0000 mgr.gibba043.dnkmem (mgr.34373) 7895 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.378347+0000 mgr.gibba043.dnkmem (mgr.34373) 7896 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:37.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.378700+0000 mon.c (mon.1) 2044 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.378759+0000 mgr.gibba043.dnkmem (mgr.34373) 7897 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:37.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.380092+0000 mgr.gibba043.dnkmem (mgr.34373) 7898 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cluster 2021-03-10T16:20:35.718048+0000 mgr.gibba043.dnkmem (mgr.34373) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.149138+0000 mgr.gibba043.dnkmem (mgr.34373) 7885 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:20:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.149677+0000 mgr.gibba043.dnkmem (mgr.34373) 7886 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:20:37.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.366144+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:20:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.367721+0000 mgr.gibba043.dnkmem (mgr.34373) 7887 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.369908+0000 mgr.gibba043.dnkmem (mgr.34373) 7888 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.370173+0000 mon.c (mon.1) 2040 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:37.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.371525+0000 mgr.gibba043.dnkmem (mgr.34373) 7889 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:37.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.371579+0000 mgr.gibba043.dnkmem (mgr.34373) 7890 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:37.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.371915+0000 mon.c (mon.1) 2041 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.373238+0000 mgr.gibba043.dnkmem (mgr.34373) 7891 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:37.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.373284+0000 mgr.gibba043.dnkmem (mgr.34373) 7892 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.373649+0000 mon.c (mon.1) 2042 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.374914+0000 mgr.gibba043.dnkmem (mgr.34373) 7893 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.375115+0000 mon.c (mon.1) 2043 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.376674+0000 mgr.gibba043.dnkmem (mgr.34373) 7894 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:37.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.376724+0000 mgr.gibba043.dnkmem (mgr.34373) 7895 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.378347+0000 mgr.gibba043.dnkmem (mgr.34373) 7896 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.378700+0000 mon.c (mon.1) 2044 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.378759+0000 mgr.gibba043.dnkmem (mgr.34373) 7897 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:37.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.380092+0000 mgr.gibba043.dnkmem (mgr.34373) 7898 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:37.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.380143+0000 mgr.gibba043.dnkmem (mgr.34373) 7899 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:37.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: cephadm 2021-03-10T16:20:36.380279+0000 mgr.gibba043.dnkmem (mgr.34373) 7900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:37.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[31385]: audit 2021-03-10T16:20:36.380551+0000 mon.c (mon.1) 2045 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.380143+0000 mgr.gibba043.dnkmem (mgr.34373) 7899 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:37.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: cephadm 2021-03-10T16:20:36.380279+0000 mgr.gibba043.dnkmem (mgr.34373) 7900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:37.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:37 gibba003 bash[32348]: audit 2021-03-10T16:20:36.380551+0000 mon.c (mon.1) 2045 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cluster 2021-03-10T16:20:35.718048+0000 mgr.gibba043.dnkmem (mgr.34373) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.149138+0000 mgr.gibba043.dnkmem (mgr.34373) 7885 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:20:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.149677+0000 mgr.gibba043.dnkmem (mgr.34373) 7886 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:20:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.366144+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:20:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.367721+0000 mgr.gibba043.dnkmem (mgr.34373) 7887 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.369908+0000 mgr.gibba043.dnkmem (mgr.34373) 7888 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.370173+0000 mon.c (mon.1) 2040 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.371525+0000 mgr.gibba043.dnkmem (mgr.34373) 7889 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.371579+0000 mgr.gibba043.dnkmem (mgr.34373) 7890 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.371915+0000 mon.c (mon.1) 2041 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.373238+0000 mgr.gibba043.dnkmem (mgr.34373) 7891 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.373284+0000 mgr.gibba043.dnkmem (mgr.34373) 7892 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.373649+0000 mon.c (mon.1) 2042 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.374914+0000 mgr.gibba043.dnkmem (mgr.34373) 7893 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.375115+0000 mon.c (mon.1) 2043 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.376674+0000 mgr.gibba043.dnkmem (mgr.34373) 7894 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.376724+0000 mgr.gibba043.dnkmem (mgr.34373) 7895 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.378347+0000 mgr.gibba043.dnkmem (mgr.34373) 7896 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.378700+0000 mon.c (mon.1) 2044 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:37.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.378759+0000 mgr.gibba043.dnkmem (mgr.34373) 7897 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.380092+0000 mgr.gibba043.dnkmem (mgr.34373) 7898 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.380143+0000 mgr.gibba043.dnkmem (mgr.34373) 7899 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: cephadm 2021-03-10T16:20:36.380279+0000 mgr.gibba043.dnkmem (mgr.34373) 7900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:37.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:37 gibba043 bash[24019]: audit 2021-03-10T16:20:36.380551+0000 mon.c (mon.1) 2045 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:39 gibba003 bash[31385]: cluster 2021-03-10T16:20:37.719729+0000 mgr.gibba043.dnkmem (mgr.34373) 7901 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:39 gibba003 bash[32348]: cluster 2021-03-10T16:20:37.719729+0000 mgr.gibba043.dnkmem (mgr.34373) 7901 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:39 gibba043 bash[24019]: cluster 2021-03-10T16:20:37.719729+0000 mgr.gibba043.dnkmem (mgr.34373) 7901 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:41.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:41 gibba003 bash[31385]: cluster 2021-03-10T16:20:39.721141+0000 mgr.gibba043.dnkmem (mgr.34373) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:41.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:41 gibba003 bash[32348]: cluster 2021-03-10T16:20:39.721141+0000 mgr.gibba043.dnkmem (mgr.34373) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:41 gibba043 bash[24019]: cluster 2021-03-10T16:20:39.721141+0000 mgr.gibba043.dnkmem (mgr.34373) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:43 gibba003 bash[31385]: cluster 2021-03-10T16:20:41.722815+0000 mgr.gibba043.dnkmem (mgr.34373) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:43 gibba003 bash[32348]: cluster 2021-03-10T16:20:41.722815+0000 mgr.gibba043.dnkmem (mgr.34373) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:43 gibba043 bash[24019]: cluster 2021-03-10T16:20:41.722815+0000 mgr.gibba043.dnkmem (mgr.34373) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:45 gibba003 bash[31385]: cluster 2021-03-10T16:20:43.724463+0000 mgr.gibba043.dnkmem (mgr.34373) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:45 gibba003 bash[32348]: cluster 2021-03-10T16:20:43.724463+0000 mgr.gibba043.dnkmem (mgr.34373) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:45 gibba043 bash[24019]: cluster 2021-03-10T16:20:43.724463+0000 mgr.gibba043.dnkmem (mgr.34373) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:47 gibba003 bash[31385]: cluster 2021-03-10T16:20:45.725866+0000 mgr.gibba043.dnkmem (mgr.34373) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:47 gibba003 bash[32348]: cluster 2021-03-10T16:20:45.725866+0000 mgr.gibba043.dnkmem (mgr.34373) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:47 gibba043 bash[24019]: cluster 2021-03-10T16:20:45.725866+0000 mgr.gibba043.dnkmem (mgr.34373) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:49 gibba003 bash[31385]: cluster 2021-03-10T16:20:47.727511+0000 mgr.gibba043.dnkmem (mgr.34373) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:49 gibba003 bash[32348]: cluster 2021-03-10T16:20:47.727511+0000 mgr.gibba043.dnkmem (mgr.34373) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:49 gibba043 bash[24019]: cluster 2021-03-10T16:20:47.727511+0000 mgr.gibba043.dnkmem (mgr.34373) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:51 gibba003 bash[31385]: cluster 2021-03-10T16:20:49.729056+0000 mgr.gibba043.dnkmem (mgr.34373) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:51 gibba003 bash[32348]: cluster 2021-03-10T16:20:49.729056+0000 mgr.gibba043.dnkmem (mgr.34373) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:51 gibba043 bash[24019]: cluster 2021-03-10T16:20:49.729056+0000 mgr.gibba043.dnkmem (mgr.34373) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:52.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:52 gibba043 bash[24019]: cephadm 2021-03-10T16:20:51.396365+0000 mgr.gibba043.dnkmem (mgr.34373) 7908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:52.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:52 gibba003 bash[31385]: cephadm 2021-03-10T16:20:51.396365+0000 mgr.gibba043.dnkmem (mgr.34373) 7908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:52.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:52 gibba003 bash[32348]: cephadm 2021-03-10T16:20:51.396365+0000 mgr.gibba043.dnkmem (mgr.34373) 7908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:20:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:53 gibba043 bash[24019]: cluster 2021-03-10T16:20:51.730538+0000 mgr.gibba043.dnkmem (mgr.34373) 7909 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:53.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:53 gibba003 bash[31385]: cluster 2021-03-10T16:20:51.730538+0000 mgr.gibba043.dnkmem (mgr.34373) 7909 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:53 gibba003 bash[32348]: cluster 2021-03-10T16:20:51.730538+0000 mgr.gibba043.dnkmem (mgr.34373) 7909 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:55 gibba043 bash[24019]: cluster 2021-03-10T16:20:53.732164+0000 mgr.gibba043.dnkmem (mgr.34373) 7910 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:55.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:55 gibba003 bash[31385]: cluster 2021-03-10T16:20:53.732164+0000 mgr.gibba043.dnkmem (mgr.34373) 7910 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:55.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:55 gibba003 bash[32348]: cluster 2021-03-10T16:20:53.732164+0000 mgr.gibba043.dnkmem (mgr.34373) 7910 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:57 gibba043 bash[24019]: cluster 2021-03-10T16:20:55.733659+0000 mgr.gibba043.dnkmem (mgr.34373) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:57 gibba003 bash[31385]: cluster 2021-03-10T16:20:55.733659+0000 mgr.gibba043.dnkmem (mgr.34373) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:57.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:57 gibba003 bash[32348]: cluster 2021-03-10T16:20:55.733659+0000 mgr.gibba043.dnkmem (mgr.34373) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:20:59 gibba043 bash[24019]: cluster 2021-03-10T16:20:57.735163+0000 mgr.gibba043.dnkmem (mgr.34373) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:20:59 gibba003 bash[31385]: cluster 2021-03-10T16:20:57.735163+0000 mgr.gibba043.dnkmem (mgr.34373) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:59.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:20:59 gibba003 bash[32348]: cluster 2021-03-10T16:20:57.735163+0000 mgr.gibba043.dnkmem (mgr.34373) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:01 gibba043 bash[24019]: cluster 2021-03-10T16:20:59.736786+0000 mgr.gibba043.dnkmem (mgr.34373) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:01 gibba003 bash[31385]: cluster 2021-03-10T16:20:59.736786+0000 mgr.gibba043.dnkmem (mgr.34373) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:01 gibba003 bash[32348]: cluster 2021-03-10T16:20:59.736786+0000 mgr.gibba043.dnkmem (mgr.34373) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:03 gibba043 bash[24019]: cluster 2021-03-10T16:21:01.738246+0000 mgr.gibba043.dnkmem (mgr.34373) 7914 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:03 gibba003 bash[31385]: cluster 2021-03-10T16:21:01.738246+0000 mgr.gibba043.dnkmem (mgr.34373) 7914 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:03.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:03 gibba003 bash[32348]: cluster 2021-03-10T16:21:01.738246+0000 mgr.gibba043.dnkmem (mgr.34373) 7914 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:04.859 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:21:05.086 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:21:05.087 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:21:05.087 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 94s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:21:05.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:21:05.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:21:05.088 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:21:05.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:21:05.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:21:05.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:21:05.089 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:21:05.089 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 94s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:21:05.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:21:05.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:21:05.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:21:05.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:21:05.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:21:05.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:21:05.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:21:05.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 94s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:21:05.091 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 94s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:21:05.091 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:21:05.332 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:21:05.332 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:21:05.333 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:05.333 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:21:05.333 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:21:05.333 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:05.334 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:21:05.334 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:21:05.334 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:21:05.334 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:21:05.335 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:21:05.335 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:21:05.335 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:21:05.335 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:21:05.335 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:21:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:05 gibba043 bash[24019]: cluster 2021-03-10T16:21:03.739596+0000 mgr.gibba043.dnkmem (mgr.34373) 7915 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:05 gibba043 bash[24019]: audit 2021-03-10T16:21:05.334902+0000 mon.c (mon.1) 2046 : audit [DBG] from='client.? 172.21.2.103:0/1218303113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:05 gibba003 bash[31385]: cluster 2021-03-10T16:21:03.739596+0000 mgr.gibba043.dnkmem (mgr.34373) 7915 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:05 gibba003 bash[31385]: audit 2021-03-10T16:21:05.334902+0000 mon.c (mon.1) 2046 : audit [DBG] from='client.? 172.21.2.103:0/1218303113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:05 gibba003 bash[32348]: cluster 2021-03-10T16:21:03.739596+0000 mgr.gibba043.dnkmem (mgr.34373) 7915 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:05 gibba003 bash[32348]: audit 2021-03-10T16:21:05.334902+0000 mon.c (mon.1) 2046 : audit [DBG] from='client.? 172.21.2.103:0/1218303113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:06 gibba043 bash[24019]: audit 2021-03-10T16:21:04.851792+0000 mgr.gibba043.dnkmem (mgr.34373) 7916 : audit [DBG] from='client.49362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:06 gibba043 bash[24019]: audit 2021-03-10T16:21:05.075587+0000 mgr.gibba043.dnkmem (mgr.34373) 7917 : audit [DBG] from='client.59356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:06.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:06 gibba003 bash[31385]: audit 2021-03-10T16:21:04.851792+0000 mgr.gibba043.dnkmem (mgr.34373) 7916 : audit [DBG] from='client.49362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:06.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:06 gibba003 bash[31385]: audit 2021-03-10T16:21:05.075587+0000 mgr.gibba043.dnkmem (mgr.34373) 7917 : audit [DBG] from='client.59356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:06.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:06 gibba003 bash[32348]: audit 2021-03-10T16:21:04.851792+0000 mgr.gibba043.dnkmem (mgr.34373) 7916 : audit [DBG] from='client.49362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:06.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:06 gibba003 bash[32348]: audit 2021-03-10T16:21:05.075587+0000 mgr.gibba043.dnkmem (mgr.34373) 7917 : audit [DBG] from='client.59356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:07 gibba043 bash[24019]: cluster 2021-03-10T16:21:05.740904+0000 mgr.gibba043.dnkmem (mgr.34373) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:07 gibba043 bash[24019]: cephadm 2021-03-10T16:21:06.404800+0000 mgr.gibba043.dnkmem (mgr.34373) 7919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:07.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:07 gibba003 bash[31385]: cluster 2021-03-10T16:21:05.740904+0000 mgr.gibba043.dnkmem (mgr.34373) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:07 gibba003 bash[31385]: cephadm 2021-03-10T16:21:06.404800+0000 mgr.gibba043.dnkmem (mgr.34373) 7919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:07 gibba003 bash[32348]: cluster 2021-03-10T16:21:05.740904+0000 mgr.gibba043.dnkmem (mgr.34373) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:07 gibba003 bash[32348]: cephadm 2021-03-10T16:21:06.404800+0000 mgr.gibba043.dnkmem (mgr.34373) 7919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:09 gibba003 bash[31385]: cluster 2021-03-10T16:21:07.742443+0000 mgr.gibba043.dnkmem (mgr.34373) 7920 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:09 gibba003 bash[32348]: cluster 2021-03-10T16:21:07.742443+0000 mgr.gibba043.dnkmem (mgr.34373) 7920 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:09 gibba043 bash[24019]: cluster 2021-03-10T16:21:07.742443+0000 mgr.gibba043.dnkmem (mgr.34373) 7920 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:11 gibba003 bash[31385]: cluster 2021-03-10T16:21:09.743950+0000 mgr.gibba043.dnkmem (mgr.34373) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:11 gibba003 bash[32348]: cluster 2021-03-10T16:21:09.743950+0000 mgr.gibba043.dnkmem (mgr.34373) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:11 gibba043 bash[24019]: cluster 2021-03-10T16:21:09.743950+0000 mgr.gibba043.dnkmem (mgr.34373) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:13 gibba003 bash[31385]: cluster 2021-03-10T16:21:11.745471+0000 mgr.gibba043.dnkmem (mgr.34373) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:13 gibba003 bash[32348]: cluster 2021-03-10T16:21:11.745471+0000 mgr.gibba043.dnkmem (mgr.34373) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:14.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:13 gibba043 bash[24019]: cluster 2021-03-10T16:21:11.745471+0000 mgr.gibba043.dnkmem (mgr.34373) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:13.692697+0000 mon.c (mon.1) 2047 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:13.693869+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:13.889261+0000 mon.c (mon.1) 2048 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:13.890427+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.063935+0000 mon.c (mon.1) 2049 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.064697+0000 mon.c (mon.1) 2050 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.065249+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.065383+0000 mon.c (mon.1) 2051 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.066079+0000 mon.c (mon.1) 2052 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.067433+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.068577+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[31385]: audit 2021-03-10T16:21:14.069492+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:13.692697+0000 mon.c (mon.1) 2047 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:13.693869+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:13.889261+0000 mon.c (mon.1) 2048 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:13.890427+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.063935+0000 mon.c (mon.1) 2049 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.064697+0000 mon.c (mon.1) 2050 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.065249+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.065383+0000 mon.c (mon.1) 2051 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.066079+0000 mon.c (mon.1) 2052 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.067433+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.068577+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:14 gibba003 bash[32348]: audit 2021-03-10T16:21:14.069492+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:21:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:13.692697+0000 mon.c (mon.1) 2047 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:13.693869+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:13.889261+0000 mon.c (mon.1) 2048 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:13.890427+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.063935+0000 mon.c (mon.1) 2049 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.064697+0000 mon.c (mon.1) 2050 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.065249+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.065383+0000 mon.c (mon.1) 2051 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.066079+0000 mon.c (mon.1) 2052 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.067433+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.068577+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:14 gibba043 bash[24019]: audit 2021-03-10T16:21:14.069492+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:21:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:15 gibba003 bash[31385]: cluster 2021-03-10T16:21:13.747100+0000 mgr.gibba043.dnkmem (mgr.34373) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:15 gibba003 bash[32348]: cluster 2021-03-10T16:21:13.747100+0000 mgr.gibba043.dnkmem (mgr.34373) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:15 gibba043 bash[24019]: cluster 2021-03-10T16:21:13.747100+0000 mgr.gibba043.dnkmem (mgr.34373) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:17 gibba003 bash[31385]: cluster 2021-03-10T16:21:15.748562+0000 mgr.gibba043.dnkmem (mgr.34373) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:17.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:17 gibba003 bash[32348]: cluster 2021-03-10T16:21:15.748562+0000 mgr.gibba043.dnkmem (mgr.34373) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:17 gibba043 bash[24019]: cluster 2021-03-10T16:21:15.748562+0000 mgr.gibba043.dnkmem (mgr.34373) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:19 gibba003 bash[31385]: cluster 2021-03-10T16:21:17.750093+0000 mgr.gibba043.dnkmem (mgr.34373) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:19 gibba003 bash[32348]: cluster 2021-03-10T16:21:17.750093+0000 mgr.gibba043.dnkmem (mgr.34373) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:19 gibba043 bash[24019]: cluster 2021-03-10T16:21:17.750093+0000 mgr.gibba043.dnkmem (mgr.34373) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:21 gibba043 bash[24019]: cluster 2021-03-10T16:21:19.751786+0000 mgr.gibba043.dnkmem (mgr.34373) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:21 gibba003 bash[31385]: cluster 2021-03-10T16:21:19.751786+0000 mgr.gibba043.dnkmem (mgr.34373) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:21 gibba003 bash[32348]: cluster 2021-03-10T16:21:19.751786+0000 mgr.gibba043.dnkmem (mgr.34373) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:22.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:22 gibba003 bash[31385]: cephadm 2021-03-10T16:21:21.420933+0000 mgr.gibba043.dnkmem (mgr.34373) 7927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:22.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:22 gibba003 bash[32348]: cephadm 2021-03-10T16:21:21.420933+0000 mgr.gibba043.dnkmem (mgr.34373) 7927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:23.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:22 gibba043 bash[24019]: cephadm 2021-03-10T16:21:21.420933+0000 mgr.gibba043.dnkmem (mgr.34373) 7927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:23 gibba003 bash[31385]: cluster 2021-03-10T16:21:21.753569+0000 mgr.gibba043.dnkmem (mgr.34373) 7928 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:23 gibba003 bash[32348]: cluster 2021-03-10T16:21:21.753569+0000 mgr.gibba043.dnkmem (mgr.34373) 7928 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:24.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:23 gibba043 bash[24019]: cluster 2021-03-10T16:21:21.753569+0000 mgr.gibba043.dnkmem (mgr.34373) 7928 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:25 gibba003 bash[31385]: cluster 2021-03-10T16:21:23.755222+0000 mgr.gibba043.dnkmem (mgr.34373) 7929 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:25.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:25 gibba003 bash[32348]: cluster 2021-03-10T16:21:23.755222+0000 mgr.gibba043.dnkmem (mgr.34373) 7929 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:25 gibba043 bash[24019]: cluster 2021-03-10T16:21:23.755222+0000 mgr.gibba043.dnkmem (mgr.34373) 7929 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:27.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:27 gibba003 bash[31385]: cluster 2021-03-10T16:21:25.756831+0000 mgr.gibba043.dnkmem (mgr.34373) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:27.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:27 gibba003 bash[32348]: cluster 2021-03-10T16:21:25.756831+0000 mgr.gibba043.dnkmem (mgr.34373) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:27 gibba043 bash[24019]: cluster 2021-03-10T16:21:25.756831+0000 mgr.gibba043.dnkmem (mgr.34373) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:29.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:29 gibba003 bash[31385]: cluster 2021-03-10T16:21:27.758537+0000 mgr.gibba043.dnkmem (mgr.34373) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:29.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:29 gibba003 bash[32348]: cluster 2021-03-10T16:21:27.758537+0000 mgr.gibba043.dnkmem (mgr.34373) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:29 gibba043 bash[24019]: cluster 2021-03-10T16:21:27.758537+0000 mgr.gibba043.dnkmem (mgr.34373) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:31.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:31 gibba003 bash[32348]: cluster 2021-03-10T16:21:29.760243+0000 mgr.gibba043.dnkmem (mgr.34373) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:31.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:31 gibba003 bash[31385]: cluster 2021-03-10T16:21:29.760243+0000 mgr.gibba043.dnkmem (mgr.34373) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:31.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:31 gibba043 bash[24019]: cluster 2021-03-10T16:21:29.760243+0000 mgr.gibba043.dnkmem (mgr.34373) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:33.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:33 gibba003 bash[31385]: cluster 2021-03-10T16:21:31.761952+0000 mgr.gibba043.dnkmem (mgr.34373) 7933 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:33.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:33 gibba003 bash[32348]: cluster 2021-03-10T16:21:31.761952+0000 mgr.gibba043.dnkmem (mgr.34373) 7933 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:33 gibba043 bash[24019]: cluster 2021-03-10T16:21:31.761952+0000 mgr.gibba043.dnkmem (mgr.34373) 7933 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:35.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:35 gibba003 bash[31385]: cluster 2021-03-10T16:21:33.763360+0000 mgr.gibba043.dnkmem (mgr.34373) 7934 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:35.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:35 gibba003 bash[32348]: cluster 2021-03-10T16:21:33.763360+0000 mgr.gibba043.dnkmem (mgr.34373) 7934 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:35 gibba043 bash[24019]: cluster 2021-03-10T16:21:33.763360+0000 mgr.gibba043.dnkmem (mgr.34373) 7934 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:35.575 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:21:35.803 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:21:35.803 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:21:35.803 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:21:35.804 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:21:35.804 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:21:35.804 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:21:35.804 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:21:35.805 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:21:35.805 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:21:35.805 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:21:35.805 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:21:35.806 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:21:35.806 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:21:35.806 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:21:35.806 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:21:35.807 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:21:35.807 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:21:35.807 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:21:35.807 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:21:35.808 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:21:35.808 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:21:36.048 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:21:36.048 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:21:36.048 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:36.049 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:21:36.049 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:21:36.049 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:36.049 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:21:36.050 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:21:36.050 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:21:36.050 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:21:36.050 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:21:36.051 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:21:36.051 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:21:36.051 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:21:36.051 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:21:36.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:36 gibba003 bash[31385]: audit 2021-03-10T16:21:35.567879+0000 mgr.gibba043.dnkmem (mgr.34373) 7935 : audit [DBG] from='client.49380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:36.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:36 gibba003 bash[31385]: audit 2021-03-10T16:21:36.050711+0000 mon.c (mon.1) 2053 : audit [DBG] from='client.? 172.21.2.103:0/1836651065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:36 gibba003 bash[32348]: audit 2021-03-10T16:21:35.567879+0000 mgr.gibba043.dnkmem (mgr.34373) 7935 : audit [DBG] from='client.49380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:36.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:36 gibba003 bash[32348]: audit 2021-03-10T16:21:36.050711+0000 mon.c (mon.1) 2053 : audit [DBG] from='client.? 172.21.2.103:0/1836651065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:36.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:36 gibba043 bash[24019]: audit 2021-03-10T16:21:35.567879+0000 mgr.gibba043.dnkmem (mgr.34373) 7935 : audit [DBG] from='client.49380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:36 gibba043 bash[24019]: audit 2021-03-10T16:21:36.050711+0000 mon.c (mon.1) 2053 : audit [DBG] from='client.? 172.21.2.103:0/1836651065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: cluster 2021-03-10T16:21:35.764858+0000 mgr.gibba043.dnkmem (mgr.34373) 7936 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:37.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:35.791700+0000 mgr.gibba043.dnkmem (mgr.34373) 7937 : audit [DBG] from='client.59374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:37.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.437770+0000 mgr.gibba043.dnkmem (mgr.34373) 7938 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:21:37.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.439344+0000 mgr.gibba043.dnkmem (mgr.34373) 7939 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:21:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.647682+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:21:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.651243+0000 mon.c (mon.1) 2054 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.652842+0000 mon.c (mon.1) 2055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.654201+0000 mon.c (mon.1) 2056 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.655292+0000 mon.c (mon.1) 2057 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.658214+0000 mon.c (mon.1) 2058 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[31385]: audit 2021-03-10T16:21:36.659690+0000 mon.c (mon.1) 2059 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: cluster 2021-03-10T16:21:35.764858+0000 mgr.gibba043.dnkmem (mgr.34373) 7936 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:35.791700+0000 mgr.gibba043.dnkmem (mgr.34373) 7937 : audit [DBG] from='client.59374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.437770+0000 mgr.gibba043.dnkmem (mgr.34373) 7938 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:21:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.439344+0000 mgr.gibba043.dnkmem (mgr.34373) 7939 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:21:37.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.647682+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:21:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.651243+0000 mon.c (mon.1) 2054 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.652842+0000 mon.c (mon.1) 2055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.654201+0000 mon.c (mon.1) 2056 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.655292+0000 mon.c (mon.1) 2057 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.658214+0000 mon.c (mon.1) 2058 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:37 gibba003 bash[32348]: audit 2021-03-10T16:21:36.659690+0000 mon.c (mon.1) 2059 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: cluster 2021-03-10T16:21:35.764858+0000 mgr.gibba043.dnkmem (mgr.34373) 7936 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:37.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:35.791700+0000 mgr.gibba043.dnkmem (mgr.34373) 7937 : audit [DBG] from='client.59374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.437770+0000 mgr.gibba043.dnkmem (mgr.34373) 7938 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:21:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.439344+0000 mgr.gibba043.dnkmem (mgr.34373) 7939 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:21:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.647682+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:21:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.651243+0000 mon.c (mon.1) 2054 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.652842+0000 mon.c (mon.1) 2055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.654201+0000 mon.c (mon.1) 2056 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.655292+0000 mon.c (mon.1) 2057 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.658214+0000 mon.c (mon.1) 2058 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:37.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:37 gibba043 bash[24019]: audit 2021-03-10T16:21:36.659690+0000 mon.c (mon.1) 2059 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.649167+0000 mgr.gibba043.dnkmem (mgr.34373) 7940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.651005+0000 mgr.gibba043.dnkmem (mgr.34373) 7941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.652328+0000 mgr.gibba043.dnkmem (mgr.34373) 7942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.652366+0000 mgr.gibba043.dnkmem (mgr.34373) 7943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.653661+0000 mgr.gibba043.dnkmem (mgr.34373) 7944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.653700+0000 mgr.gibba043.dnkmem (mgr.34373) 7945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:38.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.654707+0000 mgr.gibba043.dnkmem (mgr.34373) 7946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.656257+0000 mgr.gibba043.dnkmem (mgr.34373) 7947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.656297+0000 mgr.gibba043.dnkmem (mgr.34373) 7948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.657550+0000 mgr.gibba043.dnkmem (mgr.34373) 7949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.657945+0000 mgr.gibba043.dnkmem (mgr.34373) 7950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.659000+0000 mgr.gibba043.dnkmem (mgr.34373) 7951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.659037+0000 mgr.gibba043.dnkmem (mgr.34373) 7952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[31385]: cephadm 2021-03-10T16:21:36.659142+0000 mgr.gibba043.dnkmem (mgr.34373) 7953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:38.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.649167+0000 mgr.gibba043.dnkmem (mgr.34373) 7940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.651005+0000 mgr.gibba043.dnkmem (mgr.34373) 7941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.652328+0000 mgr.gibba043.dnkmem (mgr.34373) 7942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.652366+0000 mgr.gibba043.dnkmem (mgr.34373) 7943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.653661+0000 mgr.gibba043.dnkmem (mgr.34373) 7944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.653700+0000 mgr.gibba043.dnkmem (mgr.34373) 7945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.654707+0000 mgr.gibba043.dnkmem (mgr.34373) 7946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.656257+0000 mgr.gibba043.dnkmem (mgr.34373) 7947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:38.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.656297+0000 mgr.gibba043.dnkmem (mgr.34373) 7948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:38.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.657550+0000 mgr.gibba043.dnkmem (mgr.34373) 7949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:38.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.657945+0000 mgr.gibba043.dnkmem (mgr.34373) 7950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:38.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.659000+0000 mgr.gibba043.dnkmem (mgr.34373) 7951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:38.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.659037+0000 mgr.gibba043.dnkmem (mgr.34373) 7952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:38.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:38 gibba003 bash[32348]: cephadm 2021-03-10T16:21:36.659142+0000 mgr.gibba043.dnkmem (mgr.34373) 7953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:38.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.649167+0000 mgr.gibba043.dnkmem (mgr.34373) 7940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.651005+0000 mgr.gibba043.dnkmem (mgr.34373) 7941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.652328+0000 mgr.gibba043.dnkmem (mgr.34373) 7942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.652366+0000 mgr.gibba043.dnkmem (mgr.34373) 7943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.653661+0000 mgr.gibba043.dnkmem (mgr.34373) 7944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:38.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.653700+0000 mgr.gibba043.dnkmem (mgr.34373) 7945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:38.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.654707+0000 mgr.gibba043.dnkmem (mgr.34373) 7946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:38.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.656257+0000 mgr.gibba043.dnkmem (mgr.34373) 7947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:38.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.656297+0000 mgr.gibba043.dnkmem (mgr.34373) 7948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:38.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.657550+0000 mgr.gibba043.dnkmem (mgr.34373) 7949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.657945+0000 mgr.gibba043.dnkmem (mgr.34373) 7950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.659000+0000 mgr.gibba043.dnkmem (mgr.34373) 7951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.659037+0000 mgr.gibba043.dnkmem (mgr.34373) 7952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:38 gibba043 bash[24019]: cephadm 2021-03-10T16:21:36.659142+0000 mgr.gibba043.dnkmem (mgr.34373) 7953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:39.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:39 gibba043 bash[24019]: cluster 2021-03-10T16:21:37.766465+0000 mgr.gibba043.dnkmem (mgr.34373) 7954 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:39 gibba003 bash[31385]: cluster 2021-03-10T16:21:37.766465+0000 mgr.gibba043.dnkmem (mgr.34373) 7954 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:39.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:39 gibba003 bash[32348]: cluster 2021-03-10T16:21:37.766465+0000 mgr.gibba043.dnkmem (mgr.34373) 7954 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:41.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:41 gibba043 bash[24019]: cluster 2021-03-10T16:21:39.768182+0000 mgr.gibba043.dnkmem (mgr.34373) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:41.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:41 gibba003 bash[31385]: cluster 2021-03-10T16:21:39.768182+0000 mgr.gibba043.dnkmem (mgr.34373) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:41.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:41 gibba003 bash[32348]: cluster 2021-03-10T16:21:39.768182+0000 mgr.gibba043.dnkmem (mgr.34373) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:43 gibba043 bash[24019]: cluster 2021-03-10T16:21:41.769848+0000 mgr.gibba043.dnkmem (mgr.34373) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:43 gibba003 bash[31385]: cluster 2021-03-10T16:21:41.769848+0000 mgr.gibba043.dnkmem (mgr.34373) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:43 gibba003 bash[32348]: cluster 2021-03-10T16:21:41.769848+0000 mgr.gibba043.dnkmem (mgr.34373) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:45.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:45 gibba043 bash[24019]: cluster 2021-03-10T16:21:43.771498+0000 mgr.gibba043.dnkmem (mgr.34373) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:45 gibba003 bash[31385]: cluster 2021-03-10T16:21:43.771498+0000 mgr.gibba043.dnkmem (mgr.34373) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:45 gibba003 bash[32348]: cluster 2021-03-10T16:21:43.771498+0000 mgr.gibba043.dnkmem (mgr.34373) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:47 gibba043 bash[24019]: cluster 2021-03-10T16:21:45.772871+0000 mgr.gibba043.dnkmem (mgr.34373) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:47 gibba003 bash[31385]: cluster 2021-03-10T16:21:45.772871+0000 mgr.gibba043.dnkmem (mgr.34373) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:47 gibba003 bash[32348]: cluster 2021-03-10T16:21:45.772871+0000 mgr.gibba043.dnkmem (mgr.34373) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:49 gibba043 bash[24019]: cluster 2021-03-10T16:21:47.774390+0000 mgr.gibba043.dnkmem (mgr.34373) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:49 gibba003 bash[31385]: cluster 2021-03-10T16:21:47.774390+0000 mgr.gibba043.dnkmem (mgr.34373) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:49 gibba003 bash[32348]: cluster 2021-03-10T16:21:47.774390+0000 mgr.gibba043.dnkmem (mgr.34373) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:51 gibba043 bash[24019]: cluster 2021-03-10T16:21:49.775933+0000 mgr.gibba043.dnkmem (mgr.34373) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:51 gibba003 bash[31385]: cluster 2021-03-10T16:21:49.775933+0000 mgr.gibba043.dnkmem (mgr.34373) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:51.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:51 gibba003 bash[32348]: cluster 2021-03-10T16:21:49.775933+0000 mgr.gibba043.dnkmem (mgr.34373) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:53 gibba043 bash[24019]: cephadm 2021-03-10T16:21:51.674674+0000 mgr.gibba043.dnkmem (mgr.34373) 7961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:53.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:53 gibba043 bash[24019]: cluster 2021-03-10T16:21:51.777719+0000 mgr.gibba043.dnkmem (mgr.34373) 7962 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:53 gibba003 bash[31385]: cephadm 2021-03-10T16:21:51.674674+0000 mgr.gibba043.dnkmem (mgr.34373) 7961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:53 gibba003 bash[31385]: cluster 2021-03-10T16:21:51.777719+0000 mgr.gibba043.dnkmem (mgr.34373) 7962 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:53 gibba003 bash[32348]: cephadm 2021-03-10T16:21:51.674674+0000 mgr.gibba043.dnkmem (mgr.34373) 7961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:21:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:53 gibba003 bash[32348]: cluster 2021-03-10T16:21:51.777719+0000 mgr.gibba043.dnkmem (mgr.34373) 7962 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:55.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:55 gibba043 bash[24019]: cluster 2021-03-10T16:21:53.779254+0000 mgr.gibba043.dnkmem (mgr.34373) 7963 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:55 gibba003 bash[31385]: cluster 2021-03-10T16:21:53.779254+0000 mgr.gibba043.dnkmem (mgr.34373) 7963 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:55 gibba003 bash[32348]: cluster 2021-03-10T16:21:53.779254+0000 mgr.gibba043.dnkmem (mgr.34373) 7963 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:57 gibba003 bash[31385]: cluster 2021-03-10T16:21:55.780739+0000 mgr.gibba043.dnkmem (mgr.34373) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:57 gibba003 bash[32348]: cluster 2021-03-10T16:21:55.780739+0000 mgr.gibba043.dnkmem (mgr.34373) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:57 gibba043 bash[24019]: cluster 2021-03-10T16:21:55.780739+0000 mgr.gibba043.dnkmem (mgr.34373) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:21:59 gibba003 bash[31385]: cluster 2021-03-10T16:21:57.782266+0000 mgr.gibba043.dnkmem (mgr.34373) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:21:59 gibba003 bash[32348]: cluster 2021-03-10T16:21:57.782266+0000 mgr.gibba043.dnkmem (mgr.34373) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:21:59 gibba043 bash[24019]: cluster 2021-03-10T16:21:57.782266+0000 mgr.gibba043.dnkmem (mgr.34373) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:01 gibba003 bash[31385]: cluster 2021-03-10T16:21:59.783819+0000 mgr.gibba043.dnkmem (mgr.34373) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:01.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:01 gibba003 bash[32348]: cluster 2021-03-10T16:21:59.783819+0000 mgr.gibba043.dnkmem (mgr.34373) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:01 gibba043 bash[24019]: cluster 2021-03-10T16:21:59.783819+0000 mgr.gibba043.dnkmem (mgr.34373) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:03 gibba003 bash[31385]: cluster 2021-03-10T16:22:01.785493+0000 mgr.gibba043.dnkmem (mgr.34373) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:03 gibba003 bash[32348]: cluster 2021-03-10T16:22:01.785493+0000 mgr.gibba043.dnkmem (mgr.34373) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:03 gibba043 bash[24019]: cluster 2021-03-10T16:22:01.785493+0000 mgr.gibba043.dnkmem (mgr.34373) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:05 gibba003 bash[31385]: cluster 2021-03-10T16:22:03.787319+0000 mgr.gibba043.dnkmem (mgr.34373) 7968 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:05.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:05 gibba003 bash[32348]: cluster 2021-03-10T16:22:03.787319+0000 mgr.gibba043.dnkmem (mgr.34373) 7968 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:05 gibba043 bash[24019]: cluster 2021-03-10T16:22:03.787319+0000 mgr.gibba043.dnkmem (mgr.34373) 7968 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:06.292 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:22:06.530 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:22:06.531 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:22:06.531 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:22:06.531 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:22:06.532 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:22:06.532 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:22:06.532 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:22:06.532 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:22:06.532 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:22:06.533 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:22:06.533 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:22:06.533 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:22:06.533 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:22:06.534 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:22:06.534 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:22:06.534 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:22:06.534 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:22:06.534 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:22:06.535 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:22:06.535 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:22:06.535 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:22:06.780 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:22:06.780 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:22:06.780 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:06.781 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:22:06.781 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:22:06.781 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:06.781 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:22:06.781 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:22:06.782 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:22:06.782 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:22:06.782 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:22:06.782 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:22:06.783 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:22:06.783 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:22:06.783 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:22:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[31385]: cluster 2021-03-10T16:22:05.788726+0000 mgr.gibba043.dnkmem (mgr.34373) 7969 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[31385]: audit 2021-03-10T16:22:06.284093+0000 mgr.gibba043.dnkmem (mgr.34373) 7970 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:07.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[31385]: audit 2021-03-10T16:22:06.511255+0000 mgr.gibba043.dnkmem (mgr.34373) 7971 : audit [DBG] from='client.49404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:07.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[31385]: audit 2021-03-10T16:22:06.782704+0000 mon.a (mon.0) 1723 : audit [DBG] from='client.? 172.21.2.103:0/4089015227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[32348]: cluster 2021-03-10T16:22:05.788726+0000 mgr.gibba043.dnkmem (mgr.34373) 7969 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[32348]: audit 2021-03-10T16:22:06.284093+0000 mgr.gibba043.dnkmem (mgr.34373) 7970 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[32348]: audit 2021-03-10T16:22:06.511255+0000 mgr.gibba043.dnkmem (mgr.34373) 7971 : audit [DBG] from='client.49404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:07.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:07 gibba003 bash[32348]: audit 2021-03-10T16:22:06.782704+0000 mon.a (mon.0) 1723 : audit [DBG] from='client.? 172.21.2.103:0/4089015227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:07 gibba043 bash[24019]: cluster 2021-03-10T16:22:05.788726+0000 mgr.gibba043.dnkmem (mgr.34373) 7969 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:07 gibba043 bash[24019]: audit 2021-03-10T16:22:06.284093+0000 mgr.gibba043.dnkmem (mgr.34373) 7970 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:07 gibba043 bash[24019]: audit 2021-03-10T16:22:06.511255+0000 mgr.gibba043.dnkmem (mgr.34373) 7971 : audit [DBG] from='client.49404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:07 gibba043 bash[24019]: audit 2021-03-10T16:22:06.782704+0000 mon.a (mon.0) 1723 : audit [DBG] from='client.? 172.21.2.103:0/4089015227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:08.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:08 gibba003 bash[31385]: cephadm 2021-03-10T16:22:06.688190+0000 mgr.gibba043.dnkmem (mgr.34373) 7972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:08.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:08 gibba003 bash[32348]: cephadm 2021-03-10T16:22:06.688190+0000 mgr.gibba043.dnkmem (mgr.34373) 7972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:08.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:08 gibba043 bash[24019]: cephadm 2021-03-10T16:22:06.688190+0000 mgr.gibba043.dnkmem (mgr.34373) 7972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:09.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:09 gibba003 bash[31385]: cluster 2021-03-10T16:22:07.790262+0000 mgr.gibba043.dnkmem (mgr.34373) 7973 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:09 gibba003 bash[32348]: cluster 2021-03-10T16:22:07.790262+0000 mgr.gibba043.dnkmem (mgr.34373) 7973 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:09 gibba043 bash[24019]: cluster 2021-03-10T16:22:07.790262+0000 mgr.gibba043.dnkmem (mgr.34373) 7973 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:11 gibba003 bash[31385]: cluster 2021-03-10T16:22:09.791937+0000 mgr.gibba043.dnkmem (mgr.34373) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:11 gibba003 bash[32348]: cluster 2021-03-10T16:22:09.791937+0000 mgr.gibba043.dnkmem (mgr.34373) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:11 gibba043 bash[24019]: cluster 2021-03-10T16:22:09.791937+0000 mgr.gibba043.dnkmem (mgr.34373) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:13.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:13 gibba003 bash[31385]: cluster 2021-03-10T16:22:11.792430+0000 mgr.gibba043.dnkmem (mgr.34373) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:13.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:13 gibba003 bash[32348]: cluster 2021-03-10T16:22:11.792430+0000 mgr.gibba043.dnkmem (mgr.34373) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:13 gibba043 bash[24019]: cluster 2021-03-10T16:22:11.792430+0000 mgr.gibba043.dnkmem (mgr.34373) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:14.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:13.699240+0000 mon.c (mon.1) 2060 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:13.700481+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:13.896679+0000 mon.c (mon.1) 2061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:13.897890+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.072756+0000 mon.c (mon.1) 2062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:22:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.073564+0000 mon.c (mon.1) 2063 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.074144+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:22:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.074247+0000 mon.c (mon.1) 2064 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.074941+0000 mon.c (mon.1) 2065 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.076547+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.077457+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[31385]: audit 2021-03-10T16:22:14.078413+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:13.699240+0000 mon.c (mon.1) 2060 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:13.700481+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:13.896679+0000 mon.c (mon.1) 2061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:13.897890+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.072756+0000 mon.c (mon.1) 2062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:22:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.073564+0000 mon.c (mon.1) 2063 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.074144+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:22:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.074247+0000 mon.c (mon.1) 2064 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.074941+0000 mon.c (mon.1) 2065 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.076547+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.077457+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:14 gibba003 bash[32348]: audit 2021-03-10T16:22:14.078413+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:13.699240+0000 mon.c (mon.1) 2060 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:13.700481+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:13.896679+0000 mon.c (mon.1) 2061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:13.897890+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.072756+0000 mon.c (mon.1) 2062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:22:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.073564+0000 mon.c (mon.1) 2063 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.074144+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:22:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.074247+0000 mon.c (mon.1) 2064 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.074941+0000 mon.c (mon.1) 2065 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.076547+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:22:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.077457+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:14 gibba043 bash[24019]: audit 2021-03-10T16:22:14.078413+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:22:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:15 gibba003 bash[31385]: cluster 2021-03-10T16:22:13.793830+0000 mgr.gibba043.dnkmem (mgr.34373) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:15.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:15 gibba003 bash[32348]: cluster 2021-03-10T16:22:13.793830+0000 mgr.gibba043.dnkmem (mgr.34373) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:15 gibba043 bash[24019]: cluster 2021-03-10T16:22:13.793830+0000 mgr.gibba043.dnkmem (mgr.34373) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:17 gibba003 bash[31385]: cluster 2021-03-10T16:22:15.795343+0000 mgr.gibba043.dnkmem (mgr.34373) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:17.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:17 gibba003 bash[32348]: cluster 2021-03-10T16:22:15.795343+0000 mgr.gibba043.dnkmem (mgr.34373) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:17 gibba043 bash[24019]: cluster 2021-03-10T16:22:15.795343+0000 mgr.gibba043.dnkmem (mgr.34373) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:19.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:19 gibba003 bash[31385]: cluster 2021-03-10T16:22:17.796944+0000 mgr.gibba043.dnkmem (mgr.34373) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:19 gibba003 bash[32348]: cluster 2021-03-10T16:22:17.796944+0000 mgr.gibba043.dnkmem (mgr.34373) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:19 gibba043 bash[24019]: cluster 2021-03-10T16:22:17.796944+0000 mgr.gibba043.dnkmem (mgr.34373) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:21 gibba003 bash[31385]: cluster 2021-03-10T16:22:19.798332+0000 mgr.gibba043.dnkmem (mgr.34373) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:21.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:21 gibba003 bash[32348]: cluster 2021-03-10T16:22:19.798332+0000 mgr.gibba043.dnkmem (mgr.34373) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:21.702 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:21 gibba043 bash[24019]: cluster 2021-03-10T16:22:19.798332+0000 mgr.gibba043.dnkmem (mgr.34373) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:23 gibba003 bash[31385]: cephadm 2021-03-10T16:22:21.704006+0000 mgr.gibba043.dnkmem (mgr.34373) 7980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:23.747 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:23 gibba003 bash[31385]: cluster 2021-03-10T16:22:21.799781+0000 mgr.gibba043.dnkmem (mgr.34373) 7981 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:23.748 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:23 gibba003 bash[32348]: cephadm 2021-03-10T16:22:21.704006+0000 mgr.gibba043.dnkmem (mgr.34373) 7980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:23.748 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:23 gibba003 bash[32348]: cluster 2021-03-10T16:22:21.799781+0000 mgr.gibba043.dnkmem (mgr.34373) 7981 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:23 gibba043 bash[24019]: cephadm 2021-03-10T16:22:21.704006+0000 mgr.gibba043.dnkmem (mgr.34373) 7980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:23 gibba043 bash[24019]: cluster 2021-03-10T16:22:21.799781+0000 mgr.gibba043.dnkmem (mgr.34373) 7981 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:25.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:25 gibba003 bash[31385]: cluster 2021-03-10T16:22:23.801102+0000 mgr.gibba043.dnkmem (mgr.34373) 7982 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:25.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:25 gibba003 bash[32348]: cluster 2021-03-10T16:22:23.801102+0000 mgr.gibba043.dnkmem (mgr.34373) 7982 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:25 gibba043 bash[24019]: cluster 2021-03-10T16:22:23.801102+0000 mgr.gibba043.dnkmem (mgr.34373) 7982 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:27.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:27 gibba003 bash[31385]: cluster 2021-03-10T16:22:25.802678+0000 mgr.gibba043.dnkmem (mgr.34373) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:27 gibba003 bash[32348]: cluster 2021-03-10T16:22:25.802678+0000 mgr.gibba043.dnkmem (mgr.34373) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:27 gibba043 bash[24019]: cluster 2021-03-10T16:22:25.802678+0000 mgr.gibba043.dnkmem (mgr.34373) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:29.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:29 gibba003 bash[31385]: cluster 2021-03-10T16:22:27.803448+0000 mgr.gibba043.dnkmem (mgr.34373) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:29.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:29 gibba003 bash[32348]: cluster 2021-03-10T16:22:27.803448+0000 mgr.gibba043.dnkmem (mgr.34373) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:29 gibba043 bash[24019]: cluster 2021-03-10T16:22:27.803448+0000 mgr.gibba043.dnkmem (mgr.34373) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:31.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:31 gibba003 bash[31385]: cluster 2021-03-10T16:22:29.804838+0000 mgr.gibba043.dnkmem (mgr.34373) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:31.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:31 gibba003 bash[32348]: cluster 2021-03-10T16:22:29.804838+0000 mgr.gibba043.dnkmem (mgr.34373) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:31.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:31 gibba043 bash[24019]: cluster 2021-03-10T16:22:29.804838+0000 mgr.gibba043.dnkmem (mgr.34373) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:33 gibba043 bash[24019]: cluster 2021-03-10T16:22:31.806384+0000 mgr.gibba043.dnkmem (mgr.34373) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:33 gibba003 bash[31385]: cluster 2021-03-10T16:22:31.806384+0000 mgr.gibba043.dnkmem (mgr.34373) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:33 gibba003 bash[32348]: cluster 2021-03-10T16:22:31.806384+0000 mgr.gibba043.dnkmem (mgr.34373) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:35 gibba043 bash[24019]: cluster 2021-03-10T16:22:33.807975+0000 mgr.gibba043.dnkmem (mgr.34373) 7987 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:35.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:35 gibba003 bash[31385]: cluster 2021-03-10T16:22:33.807975+0000 mgr.gibba043.dnkmem (mgr.34373) 7987 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:35.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:35 gibba003 bash[32348]: cluster 2021-03-10T16:22:33.807975+0000 mgr.gibba043.dnkmem (mgr.34373) 7987 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.023 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:22:37.251 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:22:37.251 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:22:37.252 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:22:37.252 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:22:37.252 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:22:37.252 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:22:37.253 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:22:37.253 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:22:37.253 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:22:37.253 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:22:37.254 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:22:37.254 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:22:37.254 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:22:37.254 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:22:37.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:22:37.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:22:37.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:22:37.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:22:37.255 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:22:37.256 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:22:37.256 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:22:37.498 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:22:37.498 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:22:37.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:37.499 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:22:37.499 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:22:37.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:37.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:22:37.500 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:22:37.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:22:37.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:22:37.500 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:22:37.501 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:22:37.501 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:22:37.501 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:22:37.501 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:22:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: cluster 2021-03-10T16:22:35.808700+0000 mgr.gibba043.dnkmem (mgr.34373) 7988 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.942491+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:22:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.946327+0000 mon.c (mon.1) 2066 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.947567+0000 mon.c (mon.1) 2067 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.948661+0000 mon.c (mon.1) 2068 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.949696+0000 mon.c (mon.1) 2069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.952169+0000 mon.c (mon.1) 2070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:37 gibba043 bash[24019]: audit 2021-03-10T16:22:36.953508+0000 mon.c (mon.1) 2071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: cluster 2021-03-10T16:22:35.808700+0000 mgr.gibba043.dnkmem (mgr.34373) 7988 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.942491+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:22:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.946327+0000 mon.c (mon.1) 2066 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.947567+0000 mon.c (mon.1) 2067 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.948661+0000 mon.c (mon.1) 2068 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.949696+0000 mon.c (mon.1) 2069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.952169+0000 mon.c (mon.1) 2070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[31385]: audit 2021-03-10T16:22:36.953508+0000 mon.c (mon.1) 2071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: cluster 2021-03-10T16:22:35.808700+0000 mgr.gibba043.dnkmem (mgr.34373) 7988 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.942491+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:22:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.946327+0000 mon.c (mon.1) 2066 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.947567+0000 mon.c (mon.1) 2067 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.948661+0000 mon.c (mon.1) 2068 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.949696+0000 mon.c (mon.1) 2069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.952169+0000 mon.c (mon.1) 2070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:37 gibba003 bash[32348]: audit 2021-03-10T16:22:36.953508+0000 mon.c (mon.1) 2071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.720747+0000 mgr.gibba043.dnkmem (mgr.34373) 7989 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:22:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.722298+0000 mgr.gibba043.dnkmem (mgr.34373) 7990 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:22:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.944232+0000 mgr.gibba043.dnkmem (mgr.34373) 7991 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.945856+0000 mgr.gibba043.dnkmem (mgr.34373) 7992 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.946923+0000 mgr.gibba043.dnkmem (mgr.34373) 7993 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.946964+0000 mgr.gibba043.dnkmem (mgr.34373) 7994 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.948023+0000 mgr.gibba043.dnkmem (mgr.34373) 7995 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.948060+0000 mgr.gibba043.dnkmem (mgr.34373) 7996 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.949047+0000 mgr.gibba043.dnkmem (mgr.34373) 7997 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.950357+0000 mgr.gibba043.dnkmem (mgr.34373) 7998 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.950397+0000 mgr.gibba043.dnkmem (mgr.34373) 7999 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.951521+0000 mgr.gibba043.dnkmem (mgr.34373) 8000 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.951883+0000 mgr.gibba043.dnkmem (mgr.34373) 8001 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.952970+0000 mgr.gibba043.dnkmem (mgr.34373) 8002 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.953014+0000 mgr.gibba043.dnkmem (mgr.34373) 8003 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: cephadm 2021-03-10T16:22:36.953131+0000 mgr.gibba043.dnkmem (mgr.34373) 8004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: audit 2021-03-10T16:22:37.015575+0000 mgr.gibba043.dnkmem (mgr.34373) 8005 : audit [DBG] from='client.59404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:38.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: audit 2021-03-10T16:22:37.240254+0000 mgr.gibba043.dnkmem (mgr.34373) 8006 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:38.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:38 gibba043 bash[24019]: audit 2021-03-10T16:22:37.501013+0000 mon.a (mon.0) 1731 : audit [DBG] from='client.? 172.21.2.103:0/353591326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:38.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.720747+0000 mgr.gibba043.dnkmem (mgr.34373) 7989 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:22:38.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.722298+0000 mgr.gibba043.dnkmem (mgr.34373) 7990 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:22:38.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.944232+0000 mgr.gibba043.dnkmem (mgr.34373) 7991 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.945856+0000 mgr.gibba043.dnkmem (mgr.34373) 7992 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.946923+0000 mgr.gibba043.dnkmem (mgr.34373) 7993 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.946964+0000 mgr.gibba043.dnkmem (mgr.34373) 7994 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.948023+0000 mgr.gibba043.dnkmem (mgr.34373) 7995 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.948060+0000 mgr.gibba043.dnkmem (mgr.34373) 7996 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.949047+0000 mgr.gibba043.dnkmem (mgr.34373) 7997 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.950357+0000 mgr.gibba043.dnkmem (mgr.34373) 7998 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.950397+0000 mgr.gibba043.dnkmem (mgr.34373) 7999 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.951521+0000 mgr.gibba043.dnkmem (mgr.34373) 8000 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.951883+0000 mgr.gibba043.dnkmem (mgr.34373) 8001 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.952970+0000 mgr.gibba043.dnkmem (mgr.34373) 8002 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.953014+0000 mgr.gibba043.dnkmem (mgr.34373) 8003 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: cephadm 2021-03-10T16:22:36.953131+0000 mgr.gibba043.dnkmem (mgr.34373) 8004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: audit 2021-03-10T16:22:37.015575+0000 mgr.gibba043.dnkmem (mgr.34373) 8005 : audit [DBG] from='client.59404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: audit 2021-03-10T16:22:37.240254+0000 mgr.gibba043.dnkmem (mgr.34373) 8006 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[31385]: audit 2021-03-10T16:22:37.501013+0000 mon.a (mon.0) 1731 : audit [DBG] from='client.? 172.21.2.103:0/353591326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.720747+0000 mgr.gibba043.dnkmem (mgr.34373) 7989 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:22:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.722298+0000 mgr.gibba043.dnkmem (mgr.34373) 7990 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:22:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.944232+0000 mgr.gibba043.dnkmem (mgr.34373) 7991 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.945856+0000 mgr.gibba043.dnkmem (mgr.34373) 7992 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.946923+0000 mgr.gibba043.dnkmem (mgr.34373) 7993 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.946964+0000 mgr.gibba043.dnkmem (mgr.34373) 7994 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.948023+0000 mgr.gibba043.dnkmem (mgr.34373) 7995 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.948060+0000 mgr.gibba043.dnkmem (mgr.34373) 7996 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.949047+0000 mgr.gibba043.dnkmem (mgr.34373) 7997 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.950357+0000 mgr.gibba043.dnkmem (mgr.34373) 7998 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.950397+0000 mgr.gibba043.dnkmem (mgr.34373) 7999 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.951521+0000 mgr.gibba043.dnkmem (mgr.34373) 8000 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.951883+0000 mgr.gibba043.dnkmem (mgr.34373) 8001 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.952970+0000 mgr.gibba043.dnkmem (mgr.34373) 8002 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.953014+0000 mgr.gibba043.dnkmem (mgr.34373) 8003 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: cephadm 2021-03-10T16:22:36.953131+0000 mgr.gibba043.dnkmem (mgr.34373) 8004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: audit 2021-03-10T16:22:37.015575+0000 mgr.gibba043.dnkmem (mgr.34373) 8005 : audit [DBG] from='client.59404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: audit 2021-03-10T16:22:37.240254+0000 mgr.gibba043.dnkmem (mgr.34373) 8006 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:38 gibba003 bash[32348]: audit 2021-03-10T16:22:37.501013+0000 mon.a (mon.0) 1731 : audit [DBG] from='client.? 172.21.2.103:0/353591326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:39 gibba043 bash[24019]: cluster 2021-03-10T16:22:37.809960+0000 mgr.gibba043.dnkmem (mgr.34373) 8007 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:39.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:39 gibba003 bash[31385]: cluster 2021-03-10T16:22:37.809960+0000 mgr.gibba043.dnkmem (mgr.34373) 8007 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:39.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:39 gibba003 bash[32348]: cluster 2021-03-10T16:22:37.809960+0000 mgr.gibba043.dnkmem (mgr.34373) 8007 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:41 gibba043 bash[24019]: cluster 2021-03-10T16:22:39.811701+0000 mgr.gibba043.dnkmem (mgr.34373) 8008 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:41.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:41 gibba003 bash[31385]: cluster 2021-03-10T16:22:39.811701+0000 mgr.gibba043.dnkmem (mgr.34373) 8008 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:41 gibba003 bash[32348]: cluster 2021-03-10T16:22:39.811701+0000 mgr.gibba043.dnkmem (mgr.34373) 8008 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:43 gibba043 bash[24019]: cluster 2021-03-10T16:22:41.813352+0000 mgr.gibba043.dnkmem (mgr.34373) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:43.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:43 gibba003 bash[31385]: cluster 2021-03-10T16:22:41.813352+0000 mgr.gibba043.dnkmem (mgr.34373) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:43 gibba003 bash[32348]: cluster 2021-03-10T16:22:41.813352+0000 mgr.gibba043.dnkmem (mgr.34373) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:45 gibba043 bash[24019]: cluster 2021-03-10T16:22:43.814178+0000 mgr.gibba043.dnkmem (mgr.34373) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:45 gibba003 bash[31385]: cluster 2021-03-10T16:22:43.814178+0000 mgr.gibba043.dnkmem (mgr.34373) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:45 gibba003 bash[32348]: cluster 2021-03-10T16:22:43.814178+0000 mgr.gibba043.dnkmem (mgr.34373) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:47 gibba003 bash[31385]: cluster 2021-03-10T16:22:45.815630+0000 mgr.gibba043.dnkmem (mgr.34373) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:47.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:47 gibba003 bash[32348]: cluster 2021-03-10T16:22:45.815630+0000 mgr.gibba043.dnkmem (mgr.34373) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:47 gibba043 bash[24019]: cluster 2021-03-10T16:22:45.815630+0000 mgr.gibba043.dnkmem (mgr.34373) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:49 gibba003 bash[31385]: cluster 2021-03-10T16:22:47.817224+0000 mgr.gibba043.dnkmem (mgr.34373) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:49 gibba003 bash[32348]: cluster 2021-03-10T16:22:47.817224+0000 mgr.gibba043.dnkmem (mgr.34373) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:49 gibba043 bash[24019]: cluster 2021-03-10T16:22:47.817224+0000 mgr.gibba043.dnkmem (mgr.34373) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:51.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:51 gibba003 bash[31385]: cluster 2021-03-10T16:22:49.818863+0000 mgr.gibba043.dnkmem (mgr.34373) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:51 gibba003 bash[32348]: cluster 2021-03-10T16:22:49.818863+0000 mgr.gibba043.dnkmem (mgr.34373) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:51.967 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:51 gibba043 bash[24019]: cluster 2021-03-10T16:22:49.818863+0000 mgr.gibba043.dnkmem (mgr.34373) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:53 gibba003 bash[31385]: cluster 2021-03-10T16:22:51.819685+0000 mgr.gibba043.dnkmem (mgr.34373) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:53 gibba003 bash[31385]: cephadm 2021-03-10T16:22:51.968948+0000 mgr.gibba043.dnkmem (mgr.34373) 8015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:53 gibba003 bash[32348]: cluster 2021-03-10T16:22:51.819685+0000 mgr.gibba043.dnkmem (mgr.34373) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:53 gibba003 bash[32348]: cephadm 2021-03-10T16:22:51.968948+0000 mgr.gibba043.dnkmem (mgr.34373) 8015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:54.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:53 gibba043 bash[24019]: cluster 2021-03-10T16:22:51.819685+0000 mgr.gibba043.dnkmem (mgr.34373) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:54.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:53 gibba043 bash[24019]: cephadm 2021-03-10T16:22:51.968948+0000 mgr.gibba043.dnkmem (mgr.34373) 8015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:22:55.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:55 gibba003 bash[31385]: cluster 2021-03-10T16:22:53.821033+0000 mgr.gibba043.dnkmem (mgr.34373) 8016 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:55.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:55 gibba003 bash[32348]: cluster 2021-03-10T16:22:53.821033+0000 mgr.gibba043.dnkmem (mgr.34373) 8016 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:56.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:55 gibba043 bash[24019]: cluster 2021-03-10T16:22:53.821033+0000 mgr.gibba043.dnkmem (mgr.34373) 8016 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:57 gibba003 bash[31385]: cluster 2021-03-10T16:22:55.822780+0000 mgr.gibba043.dnkmem (mgr.34373) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:57.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:57 gibba003 bash[32348]: cluster 2021-03-10T16:22:55.822780+0000 mgr.gibba043.dnkmem (mgr.34373) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:58.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:57 gibba043 bash[24019]: cluster 2021-03-10T16:22:55.822780+0000 mgr.gibba043.dnkmem (mgr.34373) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:22:59 gibba003 bash[31385]: cluster 2021-03-10T16:22:57.824232+0000 mgr.gibba043.dnkmem (mgr.34373) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:59.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:22:59 gibba003 bash[32348]: cluster 2021-03-10T16:22:57.824232+0000 mgr.gibba043.dnkmem (mgr.34373) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:22:59 gibba043 bash[24019]: cluster 2021-03-10T16:22:57.824232+0000 mgr.gibba043.dnkmem (mgr.34373) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:01 gibba003 bash[31385]: cluster 2021-03-10T16:22:59.824832+0000 mgr.gibba043.dnkmem (mgr.34373) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:01 gibba003 bash[32348]: cluster 2021-03-10T16:22:59.824832+0000 mgr.gibba043.dnkmem (mgr.34373) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:01 gibba043 bash[24019]: cluster 2021-03-10T16:22:59.824832+0000 mgr.gibba043.dnkmem (mgr.34373) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:03 gibba003 bash[31385]: cluster 2021-03-10T16:23:01.826341+0000 mgr.gibba043.dnkmem (mgr.34373) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:03.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:03 gibba003 bash[32348]: cluster 2021-03-10T16:23:01.826341+0000 mgr.gibba043.dnkmem (mgr.34373) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:04.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:03 gibba043 bash[24019]: cluster 2021-03-10T16:23:01.826341+0000 mgr.gibba043.dnkmem (mgr.34373) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:05 gibba003 bash[31385]: cluster 2021-03-10T16:23:03.828095+0000 mgr.gibba043.dnkmem (mgr.34373) 8021 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:05 gibba003 bash[32348]: cluster 2021-03-10T16:23:03.828095+0000 mgr.gibba043.dnkmem (mgr.34373) 8021 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:05 gibba043 bash[24019]: cluster 2021-03-10T16:23:03.828095+0000 mgr.gibba043.dnkmem (mgr.34373) 8021 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.740 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:23:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:07 gibba003 bash[31385]: cluster 2021-03-10T16:23:05.829527+0000 mgr.gibba043.dnkmem (mgr.34373) 8022 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:07 gibba003 bash[32348]: cluster 2021-03-10T16:23:05.829527+0000 mgr.gibba043.dnkmem (mgr.34373) 8022 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.998 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:23:07.998 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:23:07.998 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:23:07.999 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:23:07.999 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:23:07.999 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:23:07.999 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:23:08.000 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:23:08.000 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:23:08.000 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:23:08.000 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:23:08.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:23:08.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:23:08.001 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:23:08.002 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:23:08.002 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:23:08.002 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:23:08.002 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:23:08.002 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:23:08.003 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:23:08.003 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:23:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:07 gibba043 bash[24019]: cluster 2021-03-10T16:23:05.829527+0000 mgr.gibba043.dnkmem (mgr.34373) 8022 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:08.254 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:23:08.254 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:23:08.255 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:08.255 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:23:08.255 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:23:08.255 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:08.256 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:23:08.256 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:23:08.256 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:23:08.256 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:23:08.257 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:23:08.257 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:23:08.257 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:23:08.257 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:23:08.258 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:23:08.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:08 gibba003 bash[31385]: cephadm 2021-03-10T16:23:06.985070+0000 mgr.gibba043.dnkmem (mgr.34373) 8023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:08 gibba003 bash[31385]: audit 2021-03-10T16:23:08.256919+0000 mon.c (mon.1) 2072 : audit [DBG] from='client.? 172.21.2.103:0/1165188215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:08.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:08 gibba003 bash[32348]: cephadm 2021-03-10T16:23:06.985070+0000 mgr.gibba043.dnkmem (mgr.34373) 8023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:08.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:08 gibba003 bash[32348]: audit 2021-03-10T16:23:08.256919+0000 mon.c (mon.1) 2072 : audit [DBG] from='client.? 172.21.2.103:0/1165188215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:09.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:08 gibba043 bash[24019]: cephadm 2021-03-10T16:23:06.985070+0000 mgr.gibba043.dnkmem (mgr.34373) 8023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:09.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:08 gibba043 bash[24019]: audit 2021-03-10T16:23:08.256919+0000 mon.c (mon.1) 2072 : audit [DBG] from='client.? 172.21.2.103:0/1165188215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:09 gibba003 bash[31385]: audit 2021-03-10T16:23:07.732957+0000 mgr.gibba043.dnkmem (mgr.34373) 8024 : audit [DBG] from='client.59422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:09 gibba003 bash[31385]: cluster 2021-03-10T16:23:07.830341+0000 mgr.gibba043.dnkmem (mgr.34373) 8025 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:09 gibba003 bash[31385]: audit 2021-03-10T16:23:07.959114+0000 mgr.gibba043.dnkmem (mgr.34373) 8026 : audit [DBG] from='client.49440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:09 gibba003 bash[32348]: audit 2021-03-10T16:23:07.732957+0000 mgr.gibba043.dnkmem (mgr.34373) 8024 : audit [DBG] from='client.59422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:09 gibba003 bash[32348]: cluster 2021-03-10T16:23:07.830341+0000 mgr.gibba043.dnkmem (mgr.34373) 8025 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:09 gibba003 bash[32348]: audit 2021-03-10T16:23:07.959114+0000 mgr.gibba043.dnkmem (mgr.34373) 8026 : audit [DBG] from='client.49440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:09 gibba043 bash[24019]: audit 2021-03-10T16:23:07.732957+0000 mgr.gibba043.dnkmem (mgr.34373) 8024 : audit [DBG] from='client.59422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:10.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:09 gibba043 bash[24019]: cluster 2021-03-10T16:23:07.830341+0000 mgr.gibba043.dnkmem (mgr.34373) 8025 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:09 gibba043 bash[24019]: audit 2021-03-10T16:23:07.959114+0000 mgr.gibba043.dnkmem (mgr.34373) 8026 : audit [DBG] from='client.49440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:11 gibba003 bash[31385]: cluster 2021-03-10T16:23:09.831995+0000 mgr.gibba043.dnkmem (mgr.34373) 8027 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:11 gibba003 bash[32348]: cluster 2021-03-10T16:23:09.831995+0000 mgr.gibba043.dnkmem (mgr.34373) 8027 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:11 gibba043 bash[24019]: cluster 2021-03-10T16:23:09.831995+0000 mgr.gibba043.dnkmem (mgr.34373) 8027 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:13 gibba003 bash[31385]: cluster 2021-03-10T16:23:11.833707+0000 mgr.gibba043.dnkmem (mgr.34373) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:13 gibba003 bash[32348]: cluster 2021-03-10T16:23:11.833707+0000 mgr.gibba043.dnkmem (mgr.34373) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:14.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:13 gibba043 bash[24019]: cluster 2021-03-10T16:23:11.833707+0000 mgr.gibba043.dnkmem (mgr.34373) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:13.705964+0000 mon.c (mon.1) 2073 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:13.707108+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:13.904342+0000 mon.c (mon.1) 2074 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:13.905466+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.082171+0000 mon.c (mon.1) 2075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:23:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.082919+0000 mon.c (mon.1) 2076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.083469+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:23:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.083639+0000 mon.c (mon.1) 2077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.084463+0000 mon.c (mon.1) 2078 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.084659+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.085781+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[31385]: audit 2021-03-10T16:23:14.086570+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:13.705964+0000 mon.c (mon.1) 2073 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:13.707108+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:13.904342+0000 mon.c (mon.1) 2074 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:13.905466+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.082171+0000 mon.c (mon.1) 2075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:23:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.082919+0000 mon.c (mon.1) 2076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.083469+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:23:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.083639+0000 mon.c (mon.1) 2077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:23:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.084463+0000 mon.c (mon.1) 2078 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.084659+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:23:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.085781+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:23:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:14 gibba003 bash[32348]: audit 2021-03-10T16:23:14.086570+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:23:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:13.705964+0000 mon.c (mon.1) 2073 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:13.707108+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:13.904342+0000 mon.c (mon.1) 2074 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:13.905466+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.082171+0000 mon.c (mon.1) 2075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:23:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.082919+0000 mon.c (mon.1) 2076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:23:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.083469+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:23:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.083639+0000 mon.c (mon.1) 2077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:23:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.084463+0000 mon.c (mon.1) 2078 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:23:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.084659+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:23:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.085781+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:23:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:14 gibba043 bash[24019]: audit 2021-03-10T16:23:14.086570+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:23:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:15 gibba003 bash[31385]: cluster 2021-03-10T16:23:13.835470+0000 mgr.gibba043.dnkmem (mgr.34373) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:15 gibba003 bash[32348]: cluster 2021-03-10T16:23:13.835470+0000 mgr.gibba043.dnkmem (mgr.34373) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:15 gibba043 bash[24019]: cluster 2021-03-10T16:23:13.835470+0000 mgr.gibba043.dnkmem (mgr.34373) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:17 gibba003 bash[31385]: cluster 2021-03-10T16:23:15.836206+0000 mgr.gibba043.dnkmem (mgr.34373) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:17 gibba003 bash[32348]: cluster 2021-03-10T16:23:15.836206+0000 mgr.gibba043.dnkmem (mgr.34373) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:17 gibba043 bash[24019]: cluster 2021-03-10T16:23:15.836206+0000 mgr.gibba043.dnkmem (mgr.34373) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:19 gibba043 bash[24019]: cluster 2021-03-10T16:23:17.837648+0000 mgr.gibba043.dnkmem (mgr.34373) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:19 gibba003 bash[31385]: cluster 2021-03-10T16:23:17.837648+0000 mgr.gibba043.dnkmem (mgr.34373) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:19 gibba003 bash[32348]: cluster 2021-03-10T16:23:17.837648+0000 mgr.gibba043.dnkmem (mgr.34373) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:21 gibba043 bash[24019]: cluster 2021-03-10T16:23:19.839307+0000 mgr.gibba043.dnkmem (mgr.34373) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:21 gibba003 bash[31385]: cluster 2021-03-10T16:23:19.839307+0000 mgr.gibba043.dnkmem (mgr.34373) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:21.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:21 gibba003 bash[32348]: cluster 2021-03-10T16:23:19.839307+0000 mgr.gibba043.dnkmem (mgr.34373) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:23 gibba043 bash[24019]: cluster 2021-03-10T16:23:21.841031+0000 mgr.gibba043.dnkmem (mgr.34373) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:23 gibba043 bash[24019]: cephadm 2021-03-10T16:23:22.001068+0000 mgr.gibba043.dnkmem (mgr.34373) 8034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:23.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:23 gibba003 bash[31385]: cluster 2021-03-10T16:23:21.841031+0000 mgr.gibba043.dnkmem (mgr.34373) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:23 gibba003 bash[31385]: cephadm 2021-03-10T16:23:22.001068+0000 mgr.gibba043.dnkmem (mgr.34373) 8034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:23 gibba003 bash[32348]: cluster 2021-03-10T16:23:21.841031+0000 mgr.gibba043.dnkmem (mgr.34373) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:23 gibba003 bash[32348]: cephadm 2021-03-10T16:23:22.001068+0000 mgr.gibba043.dnkmem (mgr.34373) 8034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:25.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:25 gibba043 bash[24019]: cluster 2021-03-10T16:23:23.842615+0000 mgr.gibba043.dnkmem (mgr.34373) 8035 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:25.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:25 gibba003 bash[31385]: cluster 2021-03-10T16:23:23.842615+0000 mgr.gibba043.dnkmem (mgr.34373) 8035 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:25.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:25 gibba003 bash[32348]: cluster 2021-03-10T16:23:23.842615+0000 mgr.gibba043.dnkmem (mgr.34373) 8035 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:27.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:27 gibba043 bash[24019]: cluster 2021-03-10T16:23:25.844389+0000 mgr.gibba043.dnkmem (mgr.34373) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:27.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:27 gibba003 bash[31385]: cluster 2021-03-10T16:23:25.844389+0000 mgr.gibba043.dnkmem (mgr.34373) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:27.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:27 gibba003 bash[32348]: cluster 2021-03-10T16:23:25.844389+0000 mgr.gibba043.dnkmem (mgr.34373) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:29.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:29 gibba043 bash[24019]: cluster 2021-03-10T16:23:27.845648+0000 mgr.gibba043.dnkmem (mgr.34373) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:29.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:29 gibba003 bash[31385]: cluster 2021-03-10T16:23:27.845648+0000 mgr.gibba043.dnkmem (mgr.34373) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:29.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:29 gibba003 bash[32348]: cluster 2021-03-10T16:23:27.845648+0000 mgr.gibba043.dnkmem (mgr.34373) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:31.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:31 gibba043 bash[24019]: cluster 2021-03-10T16:23:29.847202+0000 mgr.gibba043.dnkmem (mgr.34373) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:31.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:31 gibba003 bash[31385]: cluster 2021-03-10T16:23:29.847202+0000 mgr.gibba043.dnkmem (mgr.34373) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:31.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:31 gibba003 bash[32348]: cluster 2021-03-10T16:23:29.847202+0000 mgr.gibba043.dnkmem (mgr.34373) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:33 gibba043 bash[24019]: cluster 2021-03-10T16:23:31.848905+0000 mgr.gibba043.dnkmem (mgr.34373) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:33 gibba003 bash[31385]: cluster 2021-03-10T16:23:31.848905+0000 mgr.gibba043.dnkmem (mgr.34373) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:33 gibba003 bash[32348]: cluster 2021-03-10T16:23:31.848905+0000 mgr.gibba043.dnkmem (mgr.34373) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:35.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:35 gibba043 bash[24019]: cluster 2021-03-10T16:23:33.850328+0000 mgr.gibba043.dnkmem (mgr.34373) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:35.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:35 gibba003 bash[31385]: cluster 2021-03-10T16:23:33.850328+0000 mgr.gibba043.dnkmem (mgr.34373) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:35.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:35 gibba003 bash[32348]: cluster 2021-03-10T16:23:33.850328+0000 mgr.gibba043.dnkmem (mgr.34373) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: cluster 2021-03-10T16:23:35.852050+0000 mgr.gibba043.dnkmem (mgr.34373) 8041 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.225521+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:23:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.229087+0000 mon.c (mon.1) 2079 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.230851+0000 mon.c (mon.1) 2080 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.232436+0000 mon.c (mon.1) 2081 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.233746+0000 mon.c (mon.1) 2082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.237142+0000 mon.c (mon.1) 2083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:37 gibba043 bash[24019]: audit 2021-03-10T16:23:37.238954+0000 mon.c (mon.1) 2084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: cluster 2021-03-10T16:23:35.852050+0000 mgr.gibba043.dnkmem (mgr.34373) 8041 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.225521+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:23:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.229087+0000 mon.c (mon.1) 2079 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.230851+0000 mon.c (mon.1) 2080 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.232436+0000 mon.c (mon.1) 2081 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.233746+0000 mon.c (mon.1) 2082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.237142+0000 mon.c (mon.1) 2083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[31385]: audit 2021-03-10T16:23:37.238954+0000 mon.c (mon.1) 2084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: cluster 2021-03-10T16:23:35.852050+0000 mgr.gibba043.dnkmem (mgr.34373) 8041 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.225521+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:23:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.229087+0000 mon.c (mon.1) 2079 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:37.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.230851+0000 mon.c (mon.1) 2080 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.232436+0000 mon.c (mon.1) 2081 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.233746+0000 mon.c (mon.1) 2082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.237142+0000 mon.c (mon.1) 2083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:37 gibba003 bash[32348]: audit 2021-03-10T16:23:37.238954+0000 mon.c (mon.1) 2084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:38.502 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:23:38.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.017829+0000 mgr.gibba043.dnkmem (mgr.34373) 8042 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:23:38.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.019368+0000 mgr.gibba043.dnkmem (mgr.34373) 8043 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:23:38.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.226921+0000 mgr.gibba043.dnkmem (mgr.34373) 8044 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:38.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.228916+0000 mgr.gibba043.dnkmem (mgr.34373) 8045 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.230495+0000 mgr.gibba043.dnkmem (mgr.34373) 8046 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.230533+0000 mgr.gibba043.dnkmem (mgr.34373) 8047 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.231877+0000 mgr.gibba043.dnkmem (mgr.34373) 8048 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.231923+0000 mgr.gibba043.dnkmem (mgr.34373) 8049 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:38.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.233581+0000 mgr.gibba043.dnkmem (mgr.34373) 8050 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:38.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.235118+0000 mgr.gibba043.dnkmem (mgr.34373) 8051 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:38.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.235157+0000 mgr.gibba043.dnkmem (mgr.34373) 8052 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:38.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.236757+0000 mgr.gibba043.dnkmem (mgr.34373) 8053 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.237124+0000 mgr.gibba043.dnkmem (mgr.34373) 8054 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.238652+0000 mgr.gibba043.dnkmem (mgr.34373) 8055 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.238691+0000 mgr.gibba043.dnkmem (mgr.34373) 8056 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[31385]: cephadm 2021-03-10T16:23:37.238799+0000 mgr.gibba043.dnkmem (mgr.34373) 8057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:38.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.017829+0000 mgr.gibba043.dnkmem (mgr.34373) 8042 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:23:38.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.019368+0000 mgr.gibba043.dnkmem (mgr.34373) 8043 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:23:38.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.226921+0000 mgr.gibba043.dnkmem (mgr.34373) 8044 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:38.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.228916+0000 mgr.gibba043.dnkmem (mgr.34373) 8045 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.230495+0000 mgr.gibba043.dnkmem (mgr.34373) 8046 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.230533+0000 mgr.gibba043.dnkmem (mgr.34373) 8047 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.231877+0000 mgr.gibba043.dnkmem (mgr.34373) 8048 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.231923+0000 mgr.gibba043.dnkmem (mgr.34373) 8049 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.233581+0000 mgr.gibba043.dnkmem (mgr.34373) 8050 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.235118+0000 mgr.gibba043.dnkmem (mgr.34373) 8051 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.235157+0000 mgr.gibba043.dnkmem (mgr.34373) 8052 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.236757+0000 mgr.gibba043.dnkmem (mgr.34373) 8053 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:38.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.237124+0000 mgr.gibba043.dnkmem (mgr.34373) 8054 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.238652+0000 mgr.gibba043.dnkmem (mgr.34373) 8055 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.238691+0000 mgr.gibba043.dnkmem (mgr.34373) 8056 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:38.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:38 gibba003 bash[32348]: cephadm 2021-03-10T16:23:37.238799+0000 mgr.gibba043.dnkmem (mgr.34373) 8057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:38.729 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:23:38.729 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:23:38.730 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:23:38.730 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:23:38.730 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:23:38.730 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:23:38.731 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:23:38.731 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:23:38.731 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:23:38.731 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:23:38.732 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:23:38.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:23:38.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:23:38.732 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:23:38.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:23:38.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:23:38.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:23:38.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:23:38.733 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:23:38.734 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:23:38.734 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:23:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.017829+0000 mgr.gibba043.dnkmem (mgr.34373) 8042 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:23:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.019368+0000 mgr.gibba043.dnkmem (mgr.34373) 8043 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:23:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.226921+0000 mgr.gibba043.dnkmem (mgr.34373) 8044 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:38.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.228916+0000 mgr.gibba043.dnkmem (mgr.34373) 8045 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.230495+0000 mgr.gibba043.dnkmem (mgr.34373) 8046 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.230533+0000 mgr.gibba043.dnkmem (mgr.34373) 8047 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.231877+0000 mgr.gibba043.dnkmem (mgr.34373) 8048 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.231923+0000 mgr.gibba043.dnkmem (mgr.34373) 8049 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.233581+0000 mgr.gibba043.dnkmem (mgr.34373) 8050 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.235118+0000 mgr.gibba043.dnkmem (mgr.34373) 8051 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.235157+0000 mgr.gibba043.dnkmem (mgr.34373) 8052 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.236757+0000 mgr.gibba043.dnkmem (mgr.34373) 8053 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.237124+0000 mgr.gibba043.dnkmem (mgr.34373) 8054 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.238652+0000 mgr.gibba043.dnkmem (mgr.34373) 8055 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.238691+0000 mgr.gibba043.dnkmem (mgr.34373) 8056 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:38.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:38 gibba043 bash[24019]: cephadm 2021-03-10T16:23:37.238799+0000 mgr.gibba043.dnkmem (mgr.34373) 8057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:38.978 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:23:38.979 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:23:38.979 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:38.979 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:23:38.979 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:23:38.980 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:38.980 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:23:38.980 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:23:38.980 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:23:38.981 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:23:38.981 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:23:38.981 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:23:38.981 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:23:38.981 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:23:38.982 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:23:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:39 gibba003 bash[31385]: cluster 2021-03-10T16:23:37.853564+0000 mgr.gibba043.dnkmem (mgr.34373) 8058 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:39 gibba003 bash[31385]: audit 2021-03-10T16:23:38.494965+0000 mgr.gibba043.dnkmem (mgr.34373) 8059 : audit [DBG] from='client.59440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:39 gibba003 bash[31385]: audit 2021-03-10T16:23:38.981514+0000 mon.a (mon.0) 1739 : audit [DBG] from='client.? 172.21.2.103:0/2197049865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:39 gibba003 bash[32348]: cluster 2021-03-10T16:23:37.853564+0000 mgr.gibba043.dnkmem (mgr.34373) 8058 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:39 gibba003 bash[32348]: audit 2021-03-10T16:23:38.494965+0000 mgr.gibba043.dnkmem (mgr.34373) 8059 : audit [DBG] from='client.59440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:39 gibba003 bash[32348]: audit 2021-03-10T16:23:38.981514+0000 mon.a (mon.0) 1739 : audit [DBG] from='client.? 172.21.2.103:0/2197049865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:39 gibba043 bash[24019]: cluster 2021-03-10T16:23:37.853564+0000 mgr.gibba043.dnkmem (mgr.34373) 8058 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:39 gibba043 bash[24019]: audit 2021-03-10T16:23:38.494965+0000 mgr.gibba043.dnkmem (mgr.34373) 8059 : audit [DBG] from='client.59440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:39 gibba043 bash[24019]: audit 2021-03-10T16:23:38.981514+0000 mon.a (mon.0) 1739 : audit [DBG] from='client.? 172.21.2.103:0/2197049865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:40.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:40 gibba003 bash[31385]: audit 2021-03-10T16:23:38.718867+0000 mgr.gibba043.dnkmem (mgr.34373) 8060 : audit [DBG] from='client.49458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:40.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:40 gibba003 bash[32348]: audit 2021-03-10T16:23:38.718867+0000 mgr.gibba043.dnkmem (mgr.34373) 8060 : audit [DBG] from='client.49458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:40.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:40 gibba043 bash[24019]: audit 2021-03-10T16:23:38.718867+0000 mgr.gibba043.dnkmem (mgr.34373) 8060 : audit [DBG] from='client.49458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:41.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:41 gibba003 bash[31385]: cluster 2021-03-10T16:23:39.854699+0000 mgr.gibba043.dnkmem (mgr.34373) 8061 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:41.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:41 gibba003 bash[32348]: cluster 2021-03-10T16:23:39.854699+0000 mgr.gibba043.dnkmem (mgr.34373) 8061 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:41.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:41 gibba043 bash[24019]: cluster 2021-03-10T16:23:39.854699+0000 mgr.gibba043.dnkmem (mgr.34373) 8061 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:43 gibba003 bash[31385]: cluster 2021-03-10T16:23:41.856343+0000 mgr.gibba043.dnkmem (mgr.34373) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:43.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:43 gibba003 bash[32348]: cluster 2021-03-10T16:23:41.856343+0000 mgr.gibba043.dnkmem (mgr.34373) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:43.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:43 gibba043 bash[24019]: cluster 2021-03-10T16:23:41.856343+0000 mgr.gibba043.dnkmem (mgr.34373) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:45 gibba003 bash[31385]: cluster 2021-03-10T16:23:43.857940+0000 mgr.gibba043.dnkmem (mgr.34373) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:45 gibba003 bash[32348]: cluster 2021-03-10T16:23:43.857940+0000 mgr.gibba043.dnkmem (mgr.34373) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:45 gibba043 bash[24019]: cluster 2021-03-10T16:23:43.857940+0000 mgr.gibba043.dnkmem (mgr.34373) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:47 gibba003 bash[31385]: cluster 2021-03-10T16:23:45.859739+0000 mgr.gibba043.dnkmem (mgr.34373) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:47 gibba003 bash[32348]: cluster 2021-03-10T16:23:45.859739+0000 mgr.gibba043.dnkmem (mgr.34373) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:47 gibba043 bash[24019]: cluster 2021-03-10T16:23:45.859739+0000 mgr.gibba043.dnkmem (mgr.34373) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:49 gibba003 bash[31385]: cluster 2021-03-10T16:23:47.860835+0000 mgr.gibba043.dnkmem (mgr.34373) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:49 gibba003 bash[32348]: cluster 2021-03-10T16:23:47.860835+0000 mgr.gibba043.dnkmem (mgr.34373) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:49 gibba043 bash[24019]: cluster 2021-03-10T16:23:47.860835+0000 mgr.gibba043.dnkmem (mgr.34373) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:51 gibba003 bash[31385]: cluster 2021-03-10T16:23:49.862699+0000 mgr.gibba043.dnkmem (mgr.34373) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:51.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:51 gibba003 bash[32348]: cluster 2021-03-10T16:23:49.862699+0000 mgr.gibba043.dnkmem (mgr.34373) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:51.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:51 gibba043 bash[24019]: cluster 2021-03-10T16:23:49.862699+0000 mgr.gibba043.dnkmem (mgr.34373) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:53 gibba003 bash[31385]: cluster 2021-03-10T16:23:51.864469+0000 mgr.gibba043.dnkmem (mgr.34373) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:53 gibba003 bash[31385]: cephadm 2021-03-10T16:23:52.248598+0000 mgr.gibba043.dnkmem (mgr.34373) 8068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:53 gibba003 bash[32348]: cluster 2021-03-10T16:23:51.864469+0000 mgr.gibba043.dnkmem (mgr.34373) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:53 gibba003 bash[32348]: cephadm 2021-03-10T16:23:52.248598+0000 mgr.gibba043.dnkmem (mgr.34373) 8068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:53 gibba043 bash[24019]: cluster 2021-03-10T16:23:51.864469+0000 mgr.gibba043.dnkmem (mgr.34373) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:53 gibba043 bash[24019]: cephadm 2021-03-10T16:23:52.248598+0000 mgr.gibba043.dnkmem (mgr.34373) 8068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:23:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:55 gibba003 bash[31385]: cluster 2021-03-10T16:23:53.865869+0000 mgr.gibba043.dnkmem (mgr.34373) 8069 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:55 gibba003 bash[32348]: cluster 2021-03-10T16:23:53.865869+0000 mgr.gibba043.dnkmem (mgr.34373) 8069 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:55 gibba043 bash[24019]: cluster 2021-03-10T16:23:53.865869+0000 mgr.gibba043.dnkmem (mgr.34373) 8069 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:57 gibba003 bash[31385]: cluster 2021-03-10T16:23:55.867456+0000 mgr.gibba043.dnkmem (mgr.34373) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:57 gibba003 bash[32348]: cluster 2021-03-10T16:23:55.867456+0000 mgr.gibba043.dnkmem (mgr.34373) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:57 gibba043 bash[24019]: cluster 2021-03-10T16:23:55.867456+0000 mgr.gibba043.dnkmem (mgr.34373) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:23:59 gibba003 bash[31385]: cluster 2021-03-10T16:23:57.868993+0000 mgr.gibba043.dnkmem (mgr.34373) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:23:59 gibba003 bash[32348]: cluster 2021-03-10T16:23:57.868993+0000 mgr.gibba043.dnkmem (mgr.34373) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:23:59 gibba043 bash[24019]: cluster 2021-03-10T16:23:57.868993+0000 mgr.gibba043.dnkmem (mgr.34373) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:01 gibba003 bash[31385]: cluster 2021-03-10T16:23:59.870730+0000 mgr.gibba043.dnkmem (mgr.34373) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:01.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:01 gibba003 bash[32348]: cluster 2021-03-10T16:23:59.870730+0000 mgr.gibba043.dnkmem (mgr.34373) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:01 gibba043 bash[24019]: cluster 2021-03-10T16:23:59.870730+0000 mgr.gibba043.dnkmem (mgr.34373) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:03 gibba003 bash[31385]: cluster 2021-03-10T16:24:01.872461+0000 mgr.gibba043.dnkmem (mgr.34373) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:03 gibba003 bash[32348]: cluster 2021-03-10T16:24:01.872461+0000 mgr.gibba043.dnkmem (mgr.34373) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:03 gibba043 bash[24019]: cluster 2021-03-10T16:24:01.872461+0000 mgr.gibba043.dnkmem (mgr.34373) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:05 gibba003 bash[31385]: cluster 2021-03-10T16:24:03.873624+0000 mgr.gibba043.dnkmem (mgr.34373) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:05.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:05 gibba003 bash[32348]: cluster 2021-03-10T16:24:03.873624+0000 mgr.gibba043.dnkmem (mgr.34373) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:05 gibba043 bash[24019]: cluster 2021-03-10T16:24:03.873624+0000 mgr.gibba043.dnkmem (mgr.34373) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:07 gibba043 bash[24019]: cluster 2021-03-10T16:24:05.875315+0000 mgr.gibba043.dnkmem (mgr.34373) 8075 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:07 gibba003 bash[31385]: cluster 2021-03-10T16:24:05.875315+0000 mgr.gibba043.dnkmem (mgr.34373) 8075 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:07 gibba003 bash[32348]: cluster 2021-03-10T16:24:05.875315+0000 mgr.gibba043.dnkmem (mgr.34373) 8075 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:08.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:08 gibba003 bash[31385]: cephadm 2021-03-10T16:24:07.264367+0000 mgr.gibba043.dnkmem (mgr.34373) 8076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:08.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:08 gibba003 bash[32348]: cephadm 2021-03-10T16:24:07.264367+0000 mgr.gibba043.dnkmem (mgr.34373) 8076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:08.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:08 gibba043 bash[24019]: cephadm 2021-03-10T16:24:07.264367+0000 mgr.gibba043.dnkmem (mgr.34373) 8076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:09.222 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:24:09.452 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:24:09.453 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:24:09.453 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:24:09.453 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:24:09.454 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:24:09.454 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:24:09.454 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:24:09.454 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:24:09.455 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:24:09.455 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:24:09.455 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:24:09.455 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:24:09.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:24:09.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:24:09.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:24:09.456 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:24:09.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:24:09.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:24:09.457 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:24:09.457 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:24:09.457 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:24:09.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:09 gibba003 bash[31385]: cluster 2021-03-10T16:24:07.877010+0000 mgr.gibba043.dnkmem (mgr.34373) 8077 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:09.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:09 gibba003 bash[32348]: cluster 2021-03-10T16:24:07.877010+0000 mgr.gibba043.dnkmem (mgr.34373) 8077 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:09.702 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:24:09.702 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:24:09.702 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:09.703 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:24:09.703 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:24:09.703 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:09.703 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:24:09.704 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:24:09.704 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:24:09.704 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:24:09.704 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:24:09.705 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:24:09.705 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:24:09.705 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:24:09.705 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:24:09.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:09 gibba043 bash[24019]: cluster 2021-03-10T16:24:07.877010+0000 mgr.gibba043.dnkmem (mgr.34373) 8077 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:10.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:10 gibba003 bash[31385]: audit 2021-03-10T16:24:09.213818+0000 mgr.gibba043.dnkmem (mgr.34373) 8078 : audit [DBG] from='client.49470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:10 gibba003 bash[31385]: audit 2021-03-10T16:24:09.442145+0000 mgr.gibba043.dnkmem (mgr.34373) 8079 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:10 gibba003 bash[31385]: audit 2021-03-10T16:24:09.705136+0000 mon.c (mon.1) 2085 : audit [DBG] from='client.? 172.21.2.103:0/607723591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:10 gibba003 bash[32348]: audit 2021-03-10T16:24:09.213818+0000 mgr.gibba043.dnkmem (mgr.34373) 8078 : audit [DBG] from='client.49470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:10.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:10 gibba003 bash[32348]: audit 2021-03-10T16:24:09.442145+0000 mgr.gibba043.dnkmem (mgr.34373) 8079 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:10.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:10 gibba003 bash[32348]: audit 2021-03-10T16:24:09.705136+0000 mon.c (mon.1) 2085 : audit [DBG] from='client.? 172.21.2.103:0/607723591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:10.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:10 gibba043 bash[24019]: audit 2021-03-10T16:24:09.213818+0000 mgr.gibba043.dnkmem (mgr.34373) 8078 : audit [DBG] from='client.49470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:10.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:10 gibba043 bash[24019]: audit 2021-03-10T16:24:09.442145+0000 mgr.gibba043.dnkmem (mgr.34373) 8079 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:10.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:10 gibba043 bash[24019]: audit 2021-03-10T16:24:09.705136+0000 mon.c (mon.1) 2085 : audit [DBG] from='client.? 172.21.2.103:0/607723591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:11 gibba043 bash[24019]: cluster 2021-03-10T16:24:09.878858+0000 mgr.gibba043.dnkmem (mgr.34373) 8080 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:11 gibba003 bash[31385]: cluster 2021-03-10T16:24:09.878858+0000 mgr.gibba043.dnkmem (mgr.34373) 8080 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:11 gibba003 bash[32348]: cluster 2021-03-10T16:24:09.878858+0000 mgr.gibba043.dnkmem (mgr.34373) 8080 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:13 gibba043 bash[24019]: cluster 2021-03-10T16:24:11.880617+0000 mgr.gibba043.dnkmem (mgr.34373) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:13 gibba003 bash[31385]: cluster 2021-03-10T16:24:11.880617+0000 mgr.gibba043.dnkmem (mgr.34373) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:13 gibba003 bash[32348]: cluster 2021-03-10T16:24:11.880617+0000 mgr.gibba043.dnkmem (mgr.34373) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:13.711805+0000 mon.c (mon.1) 2086 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:13.712998+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:13.911504+0000 mon.c (mon.1) 2087 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:13.912592+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.092346+0000 mon.c (mon.1) 2088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:24:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.093239+0000 mon.c (mon.1) 2089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:24:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.093593+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:24:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.094131+0000 mon.c (mon.1) 2090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.094966+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:24:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.095350+0000 mon.c (mon.1) 2091 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.096090+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:14 gibba043 bash[24019]: audit 2021-03-10T16:24:14.097041+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:13.711805+0000 mon.c (mon.1) 2086 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:13.712998+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:13.911504+0000 mon.c (mon.1) 2087 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:13.912592+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.092346+0000 mon.c (mon.1) 2088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:24:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.093239+0000 mon.c (mon.1) 2089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:24:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.093593+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.094131+0000 mon.c (mon.1) 2090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.094966+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.095350+0000 mon.c (mon.1) 2091 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.096090+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[31385]: audit 2021-03-10T16:24:14.097041+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:13.711805+0000 mon.c (mon.1) 2086 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:13.712998+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:13.911504+0000 mon.c (mon.1) 2087 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:13.912592+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.092346+0000 mon.c (mon.1) 2088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:24:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.093239+0000 mon.c (mon.1) 2089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:24:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.093593+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:24:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.094131+0000 mon.c (mon.1) 2090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.094966+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:24:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.095350+0000 mon.c (mon.1) 2091 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.096090+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:24:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:14 gibba003 bash[32348]: audit 2021-03-10T16:24:14.097041+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:15 gibba043 bash[24019]: cluster 2021-03-10T16:24:13.882260+0000 mgr.gibba043.dnkmem (mgr.34373) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:15 gibba003 bash[31385]: cluster 2021-03-10T16:24:13.882260+0000 mgr.gibba043.dnkmem (mgr.34373) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:15 gibba003 bash[32348]: cluster 2021-03-10T16:24:13.882260+0000 mgr.gibba043.dnkmem (mgr.34373) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:17 gibba043 bash[24019]: cluster 2021-03-10T16:24:15.884035+0000 mgr.gibba043.dnkmem (mgr.34373) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:17 gibba003 bash[31385]: cluster 2021-03-10T16:24:15.884035+0000 mgr.gibba043.dnkmem (mgr.34373) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:17 gibba003 bash[32348]: cluster 2021-03-10T16:24:15.884035+0000 mgr.gibba043.dnkmem (mgr.34373) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:19 gibba043 bash[24019]: cluster 2021-03-10T16:24:17.885672+0000 mgr.gibba043.dnkmem (mgr.34373) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:19 gibba003 bash[31385]: cluster 2021-03-10T16:24:17.885672+0000 mgr.gibba043.dnkmem (mgr.34373) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:19 gibba003 bash[32348]: cluster 2021-03-10T16:24:17.885672+0000 mgr.gibba043.dnkmem (mgr.34373) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:21 gibba043 bash[24019]: cluster 2021-03-10T16:24:19.887241+0000 mgr.gibba043.dnkmem (mgr.34373) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:21 gibba003 bash[31385]: cluster 2021-03-10T16:24:19.887241+0000 mgr.gibba043.dnkmem (mgr.34373) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:21 gibba003 bash[32348]: cluster 2021-03-10T16:24:19.887241+0000 mgr.gibba043.dnkmem (mgr.34373) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:23 gibba043 bash[24019]: cluster 2021-03-10T16:24:21.888830+0000 mgr.gibba043.dnkmem (mgr.34373) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:23 gibba043 bash[24019]: cephadm 2021-03-10T16:24:22.280535+0000 mgr.gibba043.dnkmem (mgr.34373) 8087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:23 gibba003 bash[31385]: cluster 2021-03-10T16:24:21.888830+0000 mgr.gibba043.dnkmem (mgr.34373) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:23 gibba003 bash[31385]: cephadm 2021-03-10T16:24:22.280535+0000 mgr.gibba043.dnkmem (mgr.34373) 8087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:23 gibba003 bash[32348]: cluster 2021-03-10T16:24:21.888830+0000 mgr.gibba043.dnkmem (mgr.34373) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:23 gibba003 bash[32348]: cephadm 2021-03-10T16:24:22.280535+0000 mgr.gibba043.dnkmem (mgr.34373) 8087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:25 gibba043 bash[24019]: cluster 2021-03-10T16:24:23.890519+0000 mgr.gibba043.dnkmem (mgr.34373) 8088 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:25 gibba003 bash[31385]: cluster 2021-03-10T16:24:23.890519+0000 mgr.gibba043.dnkmem (mgr.34373) 8088 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:25.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:25 gibba003 bash[32348]: cluster 2021-03-10T16:24:23.890519+0000 mgr.gibba043.dnkmem (mgr.34373) 8088 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:27.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:27 gibba003 bash[31385]: cluster 2021-03-10T16:24:25.892272+0000 mgr.gibba043.dnkmem (mgr.34373) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:27.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:27 gibba003 bash[32348]: cluster 2021-03-10T16:24:25.892272+0000 mgr.gibba043.dnkmem (mgr.34373) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:27 gibba043 bash[24019]: cluster 2021-03-10T16:24:25.892272+0000 mgr.gibba043.dnkmem (mgr.34373) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:29.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:29 gibba003 bash[31385]: cluster 2021-03-10T16:24:27.893815+0000 mgr.gibba043.dnkmem (mgr.34373) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:29.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:29 gibba003 bash[32348]: cluster 2021-03-10T16:24:27.893815+0000 mgr.gibba043.dnkmem (mgr.34373) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:29 gibba043 bash[24019]: cluster 2021-03-10T16:24:27.893815+0000 mgr.gibba043.dnkmem (mgr.34373) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:31 gibba003 bash[31385]: cluster 2021-03-10T16:24:29.895404+0000 mgr.gibba043.dnkmem (mgr.34373) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:31.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:31 gibba003 bash[32348]: cluster 2021-03-10T16:24:29.895404+0000 mgr.gibba043.dnkmem (mgr.34373) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:32.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:31 gibba043 bash[24019]: cluster 2021-03-10T16:24:29.895404+0000 mgr.gibba043.dnkmem (mgr.34373) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:33 gibba003 bash[31385]: cluster 2021-03-10T16:24:31.897131+0000 mgr.gibba043.dnkmem (mgr.34373) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:33.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:33 gibba003 bash[32348]: cluster 2021-03-10T16:24:31.897131+0000 mgr.gibba043.dnkmem (mgr.34373) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:34.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:33 gibba043 bash[24019]: cluster 2021-03-10T16:24:31.897131+0000 mgr.gibba043.dnkmem (mgr.34373) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:35.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:35 gibba003 bash[31385]: cluster 2021-03-10T16:24:33.898844+0000 mgr.gibba043.dnkmem (mgr.34373) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:35.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:35 gibba003 bash[32348]: cluster 2021-03-10T16:24:33.898844+0000 mgr.gibba043.dnkmem (mgr.34373) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:36.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:35 gibba043 bash[24019]: cluster 2021-03-10T16:24:33.898844+0000 mgr.gibba043.dnkmem (mgr.34373) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:37.560 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: cluster 2021-03-10T16:24:35.900220+0000 mgr.gibba043.dnkmem (mgr.34373) 8094 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:37.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.524005+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:24:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.527855+0000 mon.c (mon.1) 2092 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.529445+0000 mon.c (mon.1) 2093 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.530871+0000 mon.c (mon.1) 2094 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.532378+0000 mon.c (mon.1) 2095 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.535727+0000 mon.c (mon.1) 2096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[31385]: audit 2021-03-10T16:24:37.537370+0000 mon.c (mon.1) 2097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: cluster 2021-03-10T16:24:35.900220+0000 mgr.gibba043.dnkmem (mgr.34373) 8094 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.524005+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:24:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.527855+0000 mon.c (mon.1) 2092 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.529445+0000 mon.c (mon.1) 2093 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.530871+0000 mon.c (mon.1) 2094 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.532378+0000 mon.c (mon.1) 2095 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.535727+0000 mon.c (mon.1) 2096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:37 gibba003 bash[32348]: audit 2021-03-10T16:24:37.537370+0000 mon.c (mon.1) 2097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: cluster 2021-03-10T16:24:35.900220+0000 mgr.gibba043.dnkmem (mgr.34373) 8094 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.524005+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:24:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.527855+0000 mon.c (mon.1) 2092 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.529445+0000 mon.c (mon.1) 2093 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.530871+0000 mon.c (mon.1) 2094 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:38.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.532378+0000 mon.c (mon.1) 2095 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.535727+0000 mon.c (mon.1) 2096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:37 gibba043 bash[24019]: audit 2021-03-10T16:24:37.537370+0000 mon.c (mon.1) 2097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:38.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.297073+0000 mgr.gibba043.dnkmem (mgr.34373) 8095 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:24:38.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.298608+0000 mgr.gibba043.dnkmem (mgr.34373) 8096 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:24:38.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.525570+0000 mgr.gibba043.dnkmem (mgr.34373) 8097 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.527540+0000 mgr.gibba043.dnkmem (mgr.34373) 8098 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.528939+0000 mgr.gibba043.dnkmem (mgr.34373) 8099 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.528977+0000 mgr.gibba043.dnkmem (mgr.34373) 8100 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.530511+0000 mgr.gibba043.dnkmem (mgr.34373) 8101 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.530549+0000 mgr.gibba043.dnkmem (mgr.34373) 8102 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.531943+0000 mgr.gibba043.dnkmem (mgr.34373) 8103 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.533741+0000 mgr.gibba043.dnkmem (mgr.34373) 8104 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.533779+0000 mgr.gibba043.dnkmem (mgr.34373) 8105 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.535211+0000 mgr.gibba043.dnkmem (mgr.34373) 8106 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.535533+0000 mgr.gibba043.dnkmem (mgr.34373) 8107 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.536860+0000 mgr.gibba043.dnkmem (mgr.34373) 8108 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.536897+0000 mgr.gibba043.dnkmem (mgr.34373) 8109 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[31385]: cephadm 2021-03-10T16:24:37.537004+0000 mgr.gibba043.dnkmem (mgr.34373) 8110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.297073+0000 mgr.gibba043.dnkmem (mgr.34373) 8095 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:24:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.298608+0000 mgr.gibba043.dnkmem (mgr.34373) 8096 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:24:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.525570+0000 mgr.gibba043.dnkmem (mgr.34373) 8097 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.527540+0000 mgr.gibba043.dnkmem (mgr.34373) 8098 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.528939+0000 mgr.gibba043.dnkmem (mgr.34373) 8099 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.528977+0000 mgr.gibba043.dnkmem (mgr.34373) 8100 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.530511+0000 mgr.gibba043.dnkmem (mgr.34373) 8101 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.530549+0000 mgr.gibba043.dnkmem (mgr.34373) 8102 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.531943+0000 mgr.gibba043.dnkmem (mgr.34373) 8103 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.533741+0000 mgr.gibba043.dnkmem (mgr.34373) 8104 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.533779+0000 mgr.gibba043.dnkmem (mgr.34373) 8105 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.535211+0000 mgr.gibba043.dnkmem (mgr.34373) 8106 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.535533+0000 mgr.gibba043.dnkmem (mgr.34373) 8107 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.536860+0000 mgr.gibba043.dnkmem (mgr.34373) 8108 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.536897+0000 mgr.gibba043.dnkmem (mgr.34373) 8109 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:38 gibba003 bash[32348]: cephadm 2021-03-10T16:24:37.537004+0000 mgr.gibba043.dnkmem (mgr.34373) 8110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:39.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.297073+0000 mgr.gibba043.dnkmem (mgr.34373) 8095 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:24:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.298608+0000 mgr.gibba043.dnkmem (mgr.34373) 8096 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:24:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.525570+0000 mgr.gibba043.dnkmem (mgr.34373) 8097 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.527540+0000 mgr.gibba043.dnkmem (mgr.34373) 8098 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:39.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.528939+0000 mgr.gibba043.dnkmem (mgr.34373) 8099 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.528977+0000 mgr.gibba043.dnkmem (mgr.34373) 8100 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.530511+0000 mgr.gibba043.dnkmem (mgr.34373) 8101 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.530549+0000 mgr.gibba043.dnkmem (mgr.34373) 8102 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.531943+0000 mgr.gibba043.dnkmem (mgr.34373) 8103 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.533741+0000 mgr.gibba043.dnkmem (mgr.34373) 8104 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.533779+0000 mgr.gibba043.dnkmem (mgr.34373) 8105 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.535211+0000 mgr.gibba043.dnkmem (mgr.34373) 8106 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.535533+0000 mgr.gibba043.dnkmem (mgr.34373) 8107 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.536860+0000 mgr.gibba043.dnkmem (mgr.34373) 8108 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.536897+0000 mgr.gibba043.dnkmem (mgr.34373) 8109 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:38 gibba043 bash[24019]: cephadm 2021-03-10T16:24:37.537004+0000 mgr.gibba043.dnkmem (mgr.34373) 8110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:39.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:39 gibba003 bash[31385]: cluster 2021-03-10T16:24:37.901550+0000 mgr.gibba043.dnkmem (mgr.34373) 8111 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:39.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:39 gibba003 bash[32348]: cluster 2021-03-10T16:24:37.901550+0000 mgr.gibba043.dnkmem (mgr.34373) 8111 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:39.944 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:24:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:39 gibba043 bash[24019]: cluster 2021-03-10T16:24:37.901550+0000 mgr.gibba043.dnkmem (mgr.34373) 8111 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:40.174 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:24:40.174 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:24:40.174 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:24:40.175 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:24:40.175 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:24:40.175 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:24:40.175 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:24:40.175 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:24:40.176 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:24:40.176 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:24:40.176 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:24:40.176 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:24:40.177 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:24:40.177 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:24:40.177 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:24:40.177 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:24:40.177 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:24:40.178 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:24:40.178 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:24:40.178 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:24:40.178 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:24:40.420 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:24:40.421 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:24:40.421 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:40.421 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:24:40.422 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:24:40.422 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:40.422 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:24:40.422 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:24:40.422 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:24:40.423 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:24:40.423 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:24:40.423 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:24:40.423 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:24:40.424 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:24:40.424 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:24:40.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:40 gibba003 bash[31385]: audit 2021-03-10T16:24:40.423384+0000 mon.a (mon.0) 1747 : audit [DBG] from='client.? 172.21.2.103:0/3209671704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:40.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:40 gibba003 bash[32348]: audit 2021-03-10T16:24:40.423384+0000 mon.a (mon.0) 1747 : audit [DBG] from='client.? 172.21.2.103:0/3209671704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:41.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:40 gibba043 bash[24019]: audit 2021-03-10T16:24:40.423384+0000 mon.a (mon.0) 1747 : audit [DBG] from='client.? 172.21.2.103:0/3209671704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:41.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:41 gibba003 bash[31385]: cluster 2021-03-10T16:24:39.903369+0000 mgr.gibba043.dnkmem (mgr.34373) 8112 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:41.989 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:41 gibba003 bash[31385]: audit 2021-03-10T16:24:39.937733+0000 mgr.gibba043.dnkmem (mgr.34373) 8113 : audit [DBG] from='client.59476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:41.990 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:41 gibba003 bash[31385]: audit 2021-03-10T16:24:40.163311+0000 mgr.gibba043.dnkmem (mgr.34373) 8114 : audit [DBG] from='client.49494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:41.990 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:41 gibba003 bash[32348]: cluster 2021-03-10T16:24:39.903369+0000 mgr.gibba043.dnkmem (mgr.34373) 8112 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:41.991 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:41 gibba003 bash[32348]: audit 2021-03-10T16:24:39.937733+0000 mgr.gibba043.dnkmem (mgr.34373) 8113 : audit [DBG] from='client.59476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:41.991 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:41 gibba003 bash[32348]: audit 2021-03-10T16:24:40.163311+0000 mgr.gibba043.dnkmem (mgr.34373) 8114 : audit [DBG] from='client.49494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:41 gibba043 bash[24019]: cluster 2021-03-10T16:24:39.903369+0000 mgr.gibba043.dnkmem (mgr.34373) 8112 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:41 gibba043 bash[24019]: audit 2021-03-10T16:24:39.937733+0000 mgr.gibba043.dnkmem (mgr.34373) 8113 : audit [DBG] from='client.59476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:41 gibba043 bash[24019]: audit 2021-03-10T16:24:40.163311+0000 mgr.gibba043.dnkmem (mgr.34373) 8114 : audit [DBG] from='client.49494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:43.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:43 gibba003 bash[31385]: cluster 2021-03-10T16:24:41.905054+0000 mgr.gibba043.dnkmem (mgr.34373) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:43 gibba003 bash[32348]: cluster 2021-03-10T16:24:41.905054+0000 mgr.gibba043.dnkmem (mgr.34373) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:44.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:43 gibba043 bash[24019]: cluster 2021-03-10T16:24:41.905054+0000 mgr.gibba043.dnkmem (mgr.34373) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:45 gibba003 bash[31385]: cluster 2021-03-10T16:24:43.906638+0000 mgr.gibba043.dnkmem (mgr.34373) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:45 gibba003 bash[32348]: cluster 2021-03-10T16:24:43.906638+0000 mgr.gibba043.dnkmem (mgr.34373) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:46.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:45 gibba043 bash[24019]: cluster 2021-03-10T16:24:43.906638+0000 mgr.gibba043.dnkmem (mgr.34373) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:47 gibba003 bash[31385]: cluster 2021-03-10T16:24:45.908357+0000 mgr.gibba043.dnkmem (mgr.34373) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:47.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:47 gibba003 bash[32348]: cluster 2021-03-10T16:24:45.908357+0000 mgr.gibba043.dnkmem (mgr.34373) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:47 gibba043 bash[24019]: cluster 2021-03-10T16:24:45.908357+0000 mgr.gibba043.dnkmem (mgr.34373) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:49 gibba003 bash[31385]: cluster 2021-03-10T16:24:47.909847+0000 mgr.gibba043.dnkmem (mgr.34373) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:49 gibba003 bash[32348]: cluster 2021-03-10T16:24:47.909847+0000 mgr.gibba043.dnkmem (mgr.34373) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:49 gibba043 bash[24019]: cluster 2021-03-10T16:24:47.909847+0000 mgr.gibba043.dnkmem (mgr.34373) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:51.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:51 gibba003 bash[31385]: cluster 2021-03-10T16:24:49.911431+0000 mgr.gibba043.dnkmem (mgr.34373) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:51 gibba003 bash[32348]: cluster 2021-03-10T16:24:49.911431+0000 mgr.gibba043.dnkmem (mgr.34373) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:51 gibba043 bash[24019]: cluster 2021-03-10T16:24:49.911431+0000 mgr.gibba043.dnkmem (mgr.34373) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:53.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:53 gibba003 bash[31385]: cluster 2021-03-10T16:24:51.913071+0000 mgr.gibba043.dnkmem (mgr.34373) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:53 gibba003 bash[31385]: cephadm 2021-03-10T16:24:52.552754+0000 mgr.gibba043.dnkmem (mgr.34373) 8121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:53 gibba003 bash[32348]: cluster 2021-03-10T16:24:51.913071+0000 mgr.gibba043.dnkmem (mgr.34373) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:53 gibba003 bash[32348]: cephadm 2021-03-10T16:24:52.552754+0000 mgr.gibba043.dnkmem (mgr.34373) 8121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:54.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:53 gibba043 bash[24019]: cluster 2021-03-10T16:24:51.913071+0000 mgr.gibba043.dnkmem (mgr.34373) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:54.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:53 gibba043 bash[24019]: cephadm 2021-03-10T16:24:52.552754+0000 mgr.gibba043.dnkmem (mgr.34373) 8121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:24:55.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:55 gibba003 bash[31385]: cluster 2021-03-10T16:24:53.914531+0000 mgr.gibba043.dnkmem (mgr.34373) 8122 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:55.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:55 gibba003 bash[32348]: cluster 2021-03-10T16:24:53.914531+0000 mgr.gibba043.dnkmem (mgr.34373) 8122 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:56.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:55 gibba043 bash[24019]: cluster 2021-03-10T16:24:53.914531+0000 mgr.gibba043.dnkmem (mgr.34373) 8122 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:57 gibba003 bash[31385]: cluster 2021-03-10T16:24:55.916168+0000 mgr.gibba043.dnkmem (mgr.34373) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:57.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:57 gibba003 bash[32348]: cluster 2021-03-10T16:24:55.916168+0000 mgr.gibba043.dnkmem (mgr.34373) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:57 gibba043 bash[24019]: cluster 2021-03-10T16:24:55.916168+0000 mgr.gibba043.dnkmem (mgr.34373) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:24:59 gibba003 bash[31385]: cluster 2021-03-10T16:24:57.917508+0000 mgr.gibba043.dnkmem (mgr.34373) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:59.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:24:59 gibba003 bash[32348]: cluster 2021-03-10T16:24:57.917508+0000 mgr.gibba043.dnkmem (mgr.34373) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:24:59 gibba043 bash[24019]: cluster 2021-03-10T16:24:57.917508+0000 mgr.gibba043.dnkmem (mgr.34373) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:01 gibba043 bash[24019]: cluster 2021-03-10T16:24:59.919074+0000 mgr.gibba043.dnkmem (mgr.34373) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:01 gibba003 bash[31385]: cluster 2021-03-10T16:24:59.919074+0000 mgr.gibba043.dnkmem (mgr.34373) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:01.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:01 gibba003 bash[32348]: cluster 2021-03-10T16:24:59.919074+0000 mgr.gibba043.dnkmem (mgr.34373) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:03 gibba043 bash[24019]: cluster 2021-03-10T16:25:01.920713+0000 mgr.gibba043.dnkmem (mgr.34373) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:03 gibba003 bash[31385]: cluster 2021-03-10T16:25:01.920713+0000 mgr.gibba043.dnkmem (mgr.34373) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:03 gibba003 bash[32348]: cluster 2021-03-10T16:25:01.920713+0000 mgr.gibba043.dnkmem (mgr.34373) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:06.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:05 gibba043 bash[24019]: cluster 2021-03-10T16:25:03.922345+0000 mgr.gibba043.dnkmem (mgr.34373) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:06.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:05 gibba003 bash[31385]: cluster 2021-03-10T16:25:03.922345+0000 mgr.gibba043.dnkmem (mgr.34373) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:06.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:05 gibba003 bash[32348]: cluster 2021-03-10T16:25:03.922345+0000 mgr.gibba043.dnkmem (mgr.34373) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:07.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:07 gibba043 bash[24019]: cluster 2021-03-10T16:25:05.923763+0000 mgr.gibba043.dnkmem (mgr.34373) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:07 gibba003 bash[31385]: cluster 2021-03-10T16:25:05.923763+0000 mgr.gibba043.dnkmem (mgr.34373) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:07 gibba003 bash[32348]: cluster 2021-03-10T16:25:05.923763+0000 mgr.gibba043.dnkmem (mgr.34373) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:08 gibba043 bash[24019]: cephadm 2021-03-10T16:25:07.568888+0000 mgr.gibba043.dnkmem (mgr.34373) 8129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:08.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:08 gibba003 bash[31385]: cephadm 2021-03-10T16:25:07.568888+0000 mgr.gibba043.dnkmem (mgr.34373) 8129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:08.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:08 gibba003 bash[32348]: cephadm 2021-03-10T16:25:07.568888+0000 mgr.gibba043.dnkmem (mgr.34373) 8129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:09.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:09 gibba043 bash[24019]: cluster 2021-03-10T16:25:07.925022+0000 mgr.gibba043.dnkmem (mgr.34373) 8130 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:09.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:09 gibba003 bash[31385]: cluster 2021-03-10T16:25:07.925022+0000 mgr.gibba043.dnkmem (mgr.34373) 8130 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:09 gibba003 bash[32348]: cluster 2021-03-10T16:25:07.925022+0000 mgr.gibba043.dnkmem (mgr.34373) 8130 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:10.662 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:25:10.889 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:25:10.889 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:25:10.889 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:25:10.890 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:25:10.890 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:25:10.890 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:25:10.890 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:25:10.891 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:25:10.891 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:25:10.891 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:25:10.891 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:25:10.891 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:25:10.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:25:10.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:25:10.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:25:10.892 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:25:10.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:25:10.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:25:10.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:25:10.893 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:25:10.894 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:25:11.135 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:25:11.136 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:25:11.136 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:11.136 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:25:11.137 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:25:11.137 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:11.137 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:25:11.137 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:25:11.138 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:25:11.138 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:25:11.138 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:25:11.138 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:25:11.138 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:25:11.139 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:25:11.139 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:25:11.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:11 gibba043 bash[24019]: cluster 2021-03-10T16:25:09.926750+0000 mgr.gibba043.dnkmem (mgr.34373) 8131 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:11 gibba043 bash[24019]: audit 2021-03-10T16:25:10.654739+0000 mgr.gibba043.dnkmem (mgr.34373) 8132 : audit [DBG] from='client.49506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:11.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:11 gibba043 bash[24019]: audit 2021-03-10T16:25:11.138471+0000 mon.a (mon.0) 1748 : audit [DBG] from='client.? 172.21.2.103:0/3361232906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:11.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:11 gibba003 bash[31385]: cluster 2021-03-10T16:25:09.926750+0000 mgr.gibba043.dnkmem (mgr.34373) 8131 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:11.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:11 gibba003 bash[31385]: audit 2021-03-10T16:25:10.654739+0000 mgr.gibba043.dnkmem (mgr.34373) 8132 : audit [DBG] from='client.49506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:11.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:11 gibba003 bash[31385]: audit 2021-03-10T16:25:11.138471+0000 mon.a (mon.0) 1748 : audit [DBG] from='client.? 172.21.2.103:0/3361232906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:11.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:11 gibba003 bash[32348]: cluster 2021-03-10T16:25:09.926750+0000 mgr.gibba043.dnkmem (mgr.34373) 8131 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:11.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:11 gibba003 bash[32348]: audit 2021-03-10T16:25:10.654739+0000 mgr.gibba043.dnkmem (mgr.34373) 8132 : audit [DBG] from='client.49506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:11.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:11 gibba003 bash[32348]: audit 2021-03-10T16:25:11.138471+0000 mon.a (mon.0) 1748 : audit [DBG] from='client.? 172.21.2.103:0/3361232906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:12.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:12 gibba003 bash[31385]: audit 2021-03-10T16:25:10.879908+0000 mgr.gibba043.dnkmem (mgr.34373) 8133 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:12.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:12 gibba003 bash[32348]: audit 2021-03-10T16:25:10.879908+0000 mgr.gibba043.dnkmem (mgr.34373) 8133 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:12.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:12 gibba043 bash[24019]: audit 2021-03-10T16:25:10.879908+0000 mgr.gibba043.dnkmem (mgr.34373) 8133 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:13.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:13 gibba003 bash[31385]: cluster 2021-03-10T16:25:11.928461+0000 mgr.gibba043.dnkmem (mgr.34373) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:13.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:13 gibba003 bash[32348]: cluster 2021-03-10T16:25:11.928461+0000 mgr.gibba043.dnkmem (mgr.34373) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:13.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:13 gibba043 bash[24019]: cluster 2021-03-10T16:25:11.928461+0000 mgr.gibba043.dnkmem (mgr.34373) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:13.718207+0000 mon.c (mon.1) 2098 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:13.719353+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:13.918750+0000 mon.c (mon.1) 2099 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:13.919902+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.102524+0000 mon.c (mon.1) 2100 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:25:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.103314+0000 mon.c (mon.1) 2101 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.103935+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:25:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.103983+0000 mon.c (mon.1) 2102 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:25:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.104673+0000 mon.c (mon.1) 2103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.105903+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.107092+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:25:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[31385]: audit 2021-03-10T16:25:14.108033+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:13.718207+0000 mon.c (mon.1) 2098 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:13.719353+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:13.918750+0000 mon.c (mon.1) 2099 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:13.919902+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.102524+0000 mon.c (mon.1) 2100 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:25:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.103314+0000 mon.c (mon.1) 2101 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.103935+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:25:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.103983+0000 mon.c (mon.1) 2102 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:25:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.104673+0000 mon.c (mon.1) 2103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.105903+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.107092+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:25:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:14 gibba003 bash[32348]: audit 2021-03-10T16:25:14.108033+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:13.718207+0000 mon.c (mon.1) 2098 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:13.719353+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:13.918750+0000 mon.c (mon.1) 2099 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:13.919902+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.102524+0000 mon.c (mon.1) 2100 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:25:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.103314+0000 mon.c (mon.1) 2101 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.103935+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:25:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.103983+0000 mon.c (mon.1) 2102 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:25:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.104673+0000 mon.c (mon.1) 2103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.105903+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:25:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.107092+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:25:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:14 gibba043 bash[24019]: audit 2021-03-10T16:25:14.108033+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:25:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:15 gibba003 bash[31385]: cluster 2021-03-10T16:25:13.929325+0000 mgr.gibba043.dnkmem (mgr.34373) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:15.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:15 gibba003 bash[32348]: cluster 2021-03-10T16:25:13.929325+0000 mgr.gibba043.dnkmem (mgr.34373) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:15.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:15 gibba043 bash[24019]: cluster 2021-03-10T16:25:13.929325+0000 mgr.gibba043.dnkmem (mgr.34373) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:17 gibba003 bash[31385]: cluster 2021-03-10T16:25:15.930838+0000 mgr.gibba043.dnkmem (mgr.34373) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:17.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:17 gibba003 bash[32348]: cluster 2021-03-10T16:25:15.930838+0000 mgr.gibba043.dnkmem (mgr.34373) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:17.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:17 gibba043 bash[24019]: cluster 2021-03-10T16:25:15.930838+0000 mgr.gibba043.dnkmem (mgr.34373) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:19 gibba003 bash[31385]: cluster 2021-03-10T16:25:17.932493+0000 mgr.gibba043.dnkmem (mgr.34373) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:19 gibba003 bash[32348]: cluster 2021-03-10T16:25:17.932493+0000 mgr.gibba043.dnkmem (mgr.34373) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:19 gibba043 bash[24019]: cluster 2021-03-10T16:25:17.932493+0000 mgr.gibba043.dnkmem (mgr.34373) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:21 gibba003 bash[31385]: cluster 2021-03-10T16:25:19.934093+0000 mgr.gibba043.dnkmem (mgr.34373) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:21.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:21 gibba003 bash[32348]: cluster 2021-03-10T16:25:19.934093+0000 mgr.gibba043.dnkmem (mgr.34373) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:21 gibba043 bash[24019]: cluster 2021-03-10T16:25:19.934093+0000 mgr.gibba043.dnkmem (mgr.34373) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:23.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:23 gibba003 bash[31385]: cluster 2021-03-10T16:25:21.935735+0000 mgr.gibba043.dnkmem (mgr.34373) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:23 gibba003 bash[31385]: cephadm 2021-03-10T16:25:22.572314+0000 mgr.gibba043.dnkmem (mgr.34373) 8140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:23 gibba003 bash[32348]: cluster 2021-03-10T16:25:21.935735+0000 mgr.gibba043.dnkmem (mgr.34373) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:23.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:23 gibba003 bash[32348]: cephadm 2021-03-10T16:25:22.572314+0000 mgr.gibba043.dnkmem (mgr.34373) 8140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:23 gibba043 bash[24019]: cluster 2021-03-10T16:25:21.935735+0000 mgr.gibba043.dnkmem (mgr.34373) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:23 gibba043 bash[24019]: cephadm 2021-03-10T16:25:22.572314+0000 mgr.gibba043.dnkmem (mgr.34373) 8140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:25.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:25 gibba003 bash[31385]: cluster 2021-03-10T16:25:23.937106+0000 mgr.gibba043.dnkmem (mgr.34373) 8141 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:25.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:25 gibba003 bash[32348]: cluster 2021-03-10T16:25:23.937106+0000 mgr.gibba043.dnkmem (mgr.34373) 8141 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:25 gibba043 bash[24019]: cluster 2021-03-10T16:25:23.937106+0000 mgr.gibba043.dnkmem (mgr.34373) 8141 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:27 gibba003 bash[31385]: cluster 2021-03-10T16:25:25.938467+0000 mgr.gibba043.dnkmem (mgr.34373) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:27 gibba003 bash[32348]: cluster 2021-03-10T16:25:25.938467+0000 mgr.gibba043.dnkmem (mgr.34373) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:27 gibba043 bash[24019]: cluster 2021-03-10T16:25:25.938467+0000 mgr.gibba043.dnkmem (mgr.34373) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:29.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:29 gibba003 bash[31385]: cluster 2021-03-10T16:25:27.940035+0000 mgr.gibba043.dnkmem (mgr.34373) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:29.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:29 gibba003 bash[32348]: cluster 2021-03-10T16:25:27.940035+0000 mgr.gibba043.dnkmem (mgr.34373) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:29 gibba043 bash[24019]: cluster 2021-03-10T16:25:27.940035+0000 mgr.gibba043.dnkmem (mgr.34373) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:31.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:31 gibba003 bash[31385]: cluster 2021-03-10T16:25:29.941592+0000 mgr.gibba043.dnkmem (mgr.34373) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:31.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:31 gibba003 bash[32348]: cluster 2021-03-10T16:25:29.941592+0000 mgr.gibba043.dnkmem (mgr.34373) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:31.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:31 gibba043 bash[24019]: cluster 2021-03-10T16:25:29.941592+0000 mgr.gibba043.dnkmem (mgr.34373) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:33 gibba003 bash[31385]: cluster 2021-03-10T16:25:31.943281+0000 mgr.gibba043.dnkmem (mgr.34373) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:33 gibba003 bash[32348]: cluster 2021-03-10T16:25:31.943281+0000 mgr.gibba043.dnkmem (mgr.34373) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:33 gibba043 bash[24019]: cluster 2021-03-10T16:25:31.943281+0000 mgr.gibba043.dnkmem (mgr.34373) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:35 gibba003 bash[31385]: cluster 2021-03-10T16:25:33.944981+0000 mgr.gibba043.dnkmem (mgr.34373) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:35 gibba003 bash[32348]: cluster 2021-03-10T16:25:33.944981+0000 mgr.gibba043.dnkmem (mgr.34373) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:35 gibba043 bash[24019]: cluster 2021-03-10T16:25:33.944981+0000 mgr.gibba043.dnkmem (mgr.34373) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:37.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:37 gibba003 bash[31385]: cluster 2021-03-10T16:25:35.946702+0000 mgr.gibba043.dnkmem (mgr.34373) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:37.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:37 gibba003 bash[32348]: cluster 2021-03-10T16:25:35.946702+0000 mgr.gibba043.dnkmem (mgr.34373) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:37.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:37 gibba043 bash[24019]: cluster 2021-03-10T16:25:35.946702+0000 mgr.gibba043.dnkmem (mgr.34373) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.779478+0000 mgr.gibba043.dnkmem (mgr.34373) 8148 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:25:39.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.779783+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.791270+0000 mgr.gibba043.dnkmem (mgr.34373) 8149 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:25:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.791698+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cluster 2021-03-10T16:25:37.947235+0000 mgr.gibba043.dnkmem (mgr.34373) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.982567+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.984132+0000 mgr.gibba043.dnkmem (mgr.34373) 8151 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.985868+0000 mgr.gibba043.dnkmem (mgr.34373) 8152 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.986310+0000 mon.c (mon.1) 2104 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.987170+0000 mgr.gibba043.dnkmem (mgr.34373) 8153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.987244+0000 mgr.gibba043.dnkmem (mgr.34373) 8154 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.987674+0000 mon.c (mon.1) 2105 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.988999+0000 mgr.gibba043.dnkmem (mgr.34373) 8155 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.989034+0000 mgr.gibba043.dnkmem (mgr.34373) 8156 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.989196+0000 mon.c (mon.1) 2106 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.990391+0000 mgr.gibba043.dnkmem (mgr.34373) 8157 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.990904+0000 mon.c (mon.1) 2107 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.992310+0000 mgr.gibba043.dnkmem (mgr.34373) 8158 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.992345+0000 mgr.gibba043.dnkmem (mgr.34373) 8159 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.993701+0000 mgr.gibba043.dnkmem (mgr.34373) 8160 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:39.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.994015+0000 mgr.gibba043.dnkmem (mgr.34373) 8161 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:39.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.779478+0000 mgr.gibba043.dnkmem (mgr.34373) 8148 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:25:39.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.779783+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.791270+0000 mgr.gibba043.dnkmem (mgr.34373) 8149 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:25:39.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.791698+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cluster 2021-03-10T16:25:37.947235+0000 mgr.gibba043.dnkmem (mgr.34373) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.982567+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.984132+0000 mgr.gibba043.dnkmem (mgr.34373) 8151 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:39.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.985868+0000 mgr.gibba043.dnkmem (mgr.34373) 8152 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:39.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.986310+0000 mon.c (mon.1) 2104 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:39.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.987170+0000 mgr.gibba043.dnkmem (mgr.34373) 8153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:39.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.987244+0000 mgr.gibba043.dnkmem (mgr.34373) 8154 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:39.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.987674+0000 mon.c (mon.1) 2105 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.988999+0000 mgr.gibba043.dnkmem (mgr.34373) 8155 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:39.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.989034+0000 mgr.gibba043.dnkmem (mgr.34373) 8156 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:39.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.989196+0000 mon.c (mon.1) 2106 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.990391+0000 mgr.gibba043.dnkmem (mgr.34373) 8157 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.990904+0000 mon.c (mon.1) 2107 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.992310+0000 mgr.gibba043.dnkmem (mgr.34373) 8158 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.992345+0000 mgr.gibba043.dnkmem (mgr.34373) 8159 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:39.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.993701+0000 mgr.gibba043.dnkmem (mgr.34373) 8160 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:39.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.994015+0000 mgr.gibba043.dnkmem (mgr.34373) 8161 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:39.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.994350+0000 mon.c (mon.1) 2108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.995609+0000 mgr.gibba043.dnkmem (mgr.34373) 8162 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:39.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.995661+0000 mgr.gibba043.dnkmem (mgr.34373) 8163 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:39.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: audit 2021-03-10T16:25:37.995812+0000 mon.c (mon.1) 2109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[31385]: cephadm 2021-03-10T16:25:37.995821+0000 mgr.gibba043.dnkmem (mgr.34373) 8164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.994350+0000 mon.c (mon.1) 2108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.995609+0000 mgr.gibba043.dnkmem (mgr.34373) 8162 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.995661+0000 mgr.gibba043.dnkmem (mgr.34373) 8163 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: audit 2021-03-10T16:25:37.995812+0000 mon.c (mon.1) 2109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:38 gibba003 bash[32348]: cephadm 2021-03-10T16:25:37.995821+0000 mgr.gibba043.dnkmem (mgr.34373) 8164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:39.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.779478+0000 mgr.gibba043.dnkmem (mgr.34373) 8148 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:25:39.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.779783+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.791270+0000 mgr.gibba043.dnkmem (mgr.34373) 8149 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:25:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.791698+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cluster 2021-03-10T16:25:37.947235+0000 mgr.gibba043.dnkmem (mgr.34373) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.982567+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:25:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.984132+0000 mgr.gibba043.dnkmem (mgr.34373) 8151 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.985868+0000 mgr.gibba043.dnkmem (mgr.34373) 8152 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.986310+0000 mon.c (mon.1) 2104 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.987170+0000 mgr.gibba043.dnkmem (mgr.34373) 8153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.987244+0000 mgr.gibba043.dnkmem (mgr.34373) 8154 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.987674+0000 mon.c (mon.1) 2105 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.988999+0000 mgr.gibba043.dnkmem (mgr.34373) 8155 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.989034+0000 mgr.gibba043.dnkmem (mgr.34373) 8156 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.989196+0000 mon.c (mon.1) 2106 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.990391+0000 mgr.gibba043.dnkmem (mgr.34373) 8157 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.990904+0000 mon.c (mon.1) 2107 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.992310+0000 mgr.gibba043.dnkmem (mgr.34373) 8158 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.992345+0000 mgr.gibba043.dnkmem (mgr.34373) 8159 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:39.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.993701+0000 mgr.gibba043.dnkmem (mgr.34373) 8160 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:39.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.994015+0000 mgr.gibba043.dnkmem (mgr.34373) 8161 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:39.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.994350+0000 mon.c (mon.1) 2108 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.995609+0000 mgr.gibba043.dnkmem (mgr.34373) 8162 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:39.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.995661+0000 mgr.gibba043.dnkmem (mgr.34373) 8163 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:39.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: audit 2021-03-10T16:25:37.995812+0000 mon.c (mon.1) 2109 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:39.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:38 gibba043 bash[24019]: cephadm 2021-03-10T16:25:37.995821+0000 mgr.gibba043.dnkmem (mgr.34373) 8164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:41.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:41 gibba043 bash[24019]: cluster 2021-03-10T16:25:39.948698+0000 mgr.gibba043.dnkmem (mgr.34373) 8165 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:41.382 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:25:41.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:41 gibba003 bash[31385]: cluster 2021-03-10T16:25:39.948698+0000 mgr.gibba043.dnkmem (mgr.34373) 8165 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:41.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:41 gibba003 bash[32348]: cluster 2021-03-10T16:25:39.948698+0000 mgr.gibba043.dnkmem (mgr.34373) 8165 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:41.616 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:25:41.616 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:25:41.616 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:25:41.617 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:25:41.617 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:25:41.617 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:25:41.617 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:25:41.618 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:25:41.618 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:25:41.618 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:25:41.618 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:25:41.619 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:25:41.619 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:25:41.619 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:25:41.619 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:25:41.620 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:25:41.620 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:25:41.620 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:25:41.620 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:25:41.620 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:25:41.621 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:25:41.893 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:25:41.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:25:41.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:41.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:25:41.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:25:41.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:41.895 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:25:41.895 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:25:41.895 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:25:41.896 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:25:41.896 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:25:41.896 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:25:41.896 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:25:41.897 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:25:41.897 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:25:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:42 gibba043 bash[24019]: audit 2021-03-10T16:25:41.375185+0000 mgr.gibba043.dnkmem (mgr.34373) 8166 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:42 gibba043 bash[24019]: audit 2021-03-10T16:25:41.605506+0000 mgr.gibba043.dnkmem (mgr.34373) 8167 : audit [DBG] from='client.49530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:42.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:42 gibba043 bash[24019]: audit 2021-03-10T16:25:41.896235+0000 mon.c (mon.1) 2110 : audit [DBG] from='client.? 172.21.2.103:0/2373547231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:42.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:42 gibba003 bash[31385]: audit 2021-03-10T16:25:41.375185+0000 mgr.gibba043.dnkmem (mgr.34373) 8166 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:42.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:42 gibba003 bash[31385]: audit 2021-03-10T16:25:41.605506+0000 mgr.gibba043.dnkmem (mgr.34373) 8167 : audit [DBG] from='client.49530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:42.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:42 gibba003 bash[31385]: audit 2021-03-10T16:25:41.896235+0000 mon.c (mon.1) 2110 : audit [DBG] from='client.? 172.21.2.103:0/2373547231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:42 gibba003 bash[32348]: audit 2021-03-10T16:25:41.375185+0000 mgr.gibba043.dnkmem (mgr.34373) 8166 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:42 gibba003 bash[32348]: audit 2021-03-10T16:25:41.605506+0000 mgr.gibba043.dnkmem (mgr.34373) 8167 : audit [DBG] from='client.49530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:42 gibba003 bash[32348]: audit 2021-03-10T16:25:41.896235+0000 mon.c (mon.1) 2110 : audit [DBG] from='client.? 172.21.2.103:0/2373547231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:43.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:43 gibba043 bash[24019]: cluster 2021-03-10T16:25:41.950274+0000 mgr.gibba043.dnkmem (mgr.34373) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:43 gibba003 bash[31385]: cluster 2021-03-10T16:25:41.950274+0000 mgr.gibba043.dnkmem (mgr.34373) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:43.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:43 gibba003 bash[32348]: cluster 2021-03-10T16:25:41.950274+0000 mgr.gibba043.dnkmem (mgr.34373) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:45 gibba003 bash[31385]: cluster 2021-03-10T16:25:43.951865+0000 mgr.gibba043.dnkmem (mgr.34373) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:45 gibba003 bash[32348]: cluster 2021-03-10T16:25:43.951865+0000 mgr.gibba043.dnkmem (mgr.34373) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:45.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:45 gibba043 bash[24019]: cluster 2021-03-10T16:25:43.951865+0000 mgr.gibba043.dnkmem (mgr.34373) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:47 gibba003 bash[31385]: cluster 2021-03-10T16:25:45.953213+0000 mgr.gibba043.dnkmem (mgr.34373) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:47 gibba003 bash[32348]: cluster 2021-03-10T16:25:45.953213+0000 mgr.gibba043.dnkmem (mgr.34373) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:47 gibba043 bash[24019]: cluster 2021-03-10T16:25:45.953213+0000 mgr.gibba043.dnkmem (mgr.34373) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:49 gibba003 bash[31385]: cluster 2021-03-10T16:25:47.954652+0000 mgr.gibba043.dnkmem (mgr.34373) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:49 gibba003 bash[32348]: cluster 2021-03-10T16:25:47.954652+0000 mgr.gibba043.dnkmem (mgr.34373) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:49 gibba043 bash[24019]: cluster 2021-03-10T16:25:47.954652+0000 mgr.gibba043.dnkmem (mgr.34373) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:51 gibba003 bash[31385]: cluster 2021-03-10T16:25:49.956269+0000 mgr.gibba043.dnkmem (mgr.34373) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:51.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:51 gibba003 bash[32348]: cluster 2021-03-10T16:25:49.956269+0000 mgr.gibba043.dnkmem (mgr.34373) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:51.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:51 gibba043 bash[24019]: cluster 2021-03-10T16:25:49.956269+0000 mgr.gibba043.dnkmem (mgr.34373) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:53 gibba003 bash[31385]: cluster 2021-03-10T16:25:51.957628+0000 mgr.gibba043.dnkmem (mgr.34373) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:53 gibba003 bash[32348]: cluster 2021-03-10T16:25:51.957628+0000 mgr.gibba043.dnkmem (mgr.34373) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:53 gibba043 bash[24019]: cluster 2021-03-10T16:25:51.957628+0000 mgr.gibba043.dnkmem (mgr.34373) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:54 gibba003 bash[31385]: cephadm 2021-03-10T16:25:53.008583+0000 mgr.gibba043.dnkmem (mgr.34373) 8174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:54.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:54 gibba003 bash[32348]: cephadm 2021-03-10T16:25:53.008583+0000 mgr.gibba043.dnkmem (mgr.34373) 8174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:54.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:54 gibba043 bash[24019]: cephadm 2021-03-10T16:25:53.008583+0000 mgr.gibba043.dnkmem (mgr.34373) 8174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:25:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:55 gibba003 bash[31385]: cluster 2021-03-10T16:25:53.958993+0000 mgr.gibba043.dnkmem (mgr.34373) 8175 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:55 gibba003 bash[32348]: cluster 2021-03-10T16:25:53.958993+0000 mgr.gibba043.dnkmem (mgr.34373) 8175 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:55 gibba043 bash[24019]: cluster 2021-03-10T16:25:53.958993+0000 mgr.gibba043.dnkmem (mgr.34373) 8175 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:57 gibba003 bash[31385]: cluster 2021-03-10T16:25:55.960445+0000 mgr.gibba043.dnkmem (mgr.34373) 8176 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:57 gibba003 bash[32348]: cluster 2021-03-10T16:25:55.960445+0000 mgr.gibba043.dnkmem (mgr.34373) 8176 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:57 gibba043 bash[24019]: cluster 2021-03-10T16:25:55.960445+0000 mgr.gibba043.dnkmem (mgr.34373) 8176 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:25:59 gibba003 bash[31385]: cluster 2021-03-10T16:25:57.961864+0000 mgr.gibba043.dnkmem (mgr.34373) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:25:59 gibba003 bash[32348]: cluster 2021-03-10T16:25:57.961864+0000 mgr.gibba043.dnkmem (mgr.34373) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:25:59 gibba043 bash[24019]: cluster 2021-03-10T16:25:57.961864+0000 mgr.gibba043.dnkmem (mgr.34373) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:01 gibba003 bash[31385]: cluster 2021-03-10T16:25:59.963495+0000 mgr.gibba043.dnkmem (mgr.34373) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:01.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:01 gibba003 bash[32348]: cluster 2021-03-10T16:25:59.963495+0000 mgr.gibba043.dnkmem (mgr.34373) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:01 gibba043 bash[24019]: cluster 2021-03-10T16:25:59.963495+0000 mgr.gibba043.dnkmem (mgr.34373) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:03 gibba003 bash[31385]: cluster 2021-03-10T16:26:01.965018+0000 mgr.gibba043.dnkmem (mgr.34373) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:03 gibba003 bash[32348]: cluster 2021-03-10T16:26:01.965018+0000 mgr.gibba043.dnkmem (mgr.34373) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:03 gibba043 bash[24019]: cluster 2021-03-10T16:26:01.965018+0000 mgr.gibba043.dnkmem (mgr.34373) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:05 gibba003 bash[31385]: cluster 2021-03-10T16:26:03.966520+0000 mgr.gibba043.dnkmem (mgr.34373) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:05 gibba003 bash[32348]: cluster 2021-03-10T16:26:03.966520+0000 mgr.gibba043.dnkmem (mgr.34373) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:05 gibba043 bash[24019]: cluster 2021-03-10T16:26:03.966520+0000 mgr.gibba043.dnkmem (mgr.34373) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:07 gibba003 bash[31385]: cluster 2021-03-10T16:26:05.968083+0000 mgr.gibba043.dnkmem (mgr.34373) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:07 gibba003 bash[32348]: cluster 2021-03-10T16:26:05.968083+0000 mgr.gibba043.dnkmem (mgr.34373) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:07.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:07 gibba043 bash[24019]: cluster 2021-03-10T16:26:05.968083+0000 mgr.gibba043.dnkmem (mgr.34373) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:09 gibba003 bash[31385]: cluster 2021-03-10T16:26:07.969400+0000 mgr.gibba043.dnkmem (mgr.34373) 8182 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:09 gibba003 bash[31385]: cephadm 2021-03-10T16:26:08.024639+0000 mgr.gibba043.dnkmem (mgr.34373) 8183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:09 gibba003 bash[32348]: cluster 2021-03-10T16:26:07.969400+0000 mgr.gibba043.dnkmem (mgr.34373) 8182 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:09 gibba003 bash[32348]: cephadm 2021-03-10T16:26:08.024639+0000 mgr.gibba043.dnkmem (mgr.34373) 8183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:09.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:09 gibba043 bash[24019]: cluster 2021-03-10T16:26:07.969400+0000 mgr.gibba043.dnkmem (mgr.34373) 8182 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:09 gibba043 bash[24019]: cephadm 2021-03-10T16:26:08.024639+0000 mgr.gibba043.dnkmem (mgr.34373) 8183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:11.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:11 gibba003 bash[31385]: cluster 2021-03-10T16:26:09.971116+0000 mgr.gibba043.dnkmem (mgr.34373) 8184 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:11.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:11 gibba003 bash[32348]: cluster 2021-03-10T16:26:09.971116+0000 mgr.gibba043.dnkmem (mgr.34373) 8184 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:11.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:11 gibba043 bash[24019]: cluster 2021-03-10T16:26:09.971116+0000 mgr.gibba043.dnkmem (mgr.34373) 8184 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:12.139 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:26:12.365 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:26:12.365 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:26:12.365 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:26:12.365 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:26:12.366 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:26:12.366 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:26:12.366 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:26:12.366 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:26:12.367 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:26:12.367 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:26:12.367 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:26:12.367 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:26:12.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:26:12.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:26:12.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:26:12.368 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:26:12.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:26:12.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:26:12.369 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:26:12.369 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:26:12.369 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:26:12.613 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:26:12.614 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:26:12.614 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:12.614 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:26:12.615 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:26:12.615 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:12.615 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:26:12.615 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:26:12.615 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:26:12.616 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:26:12.616 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:26:12.616 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:26:12.616 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:26:12.617 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:26:12.617 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:26:13.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[31385]: cluster 2021-03-10T16:26:11.972514+0000 mgr.gibba043.dnkmem (mgr.34373) 8185 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:13.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[31385]: audit 2021-03-10T16:26:12.131877+0000 mgr.gibba043.dnkmem (mgr.34373) 8186 : audit [DBG] from='client.49542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:13.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[31385]: audit 2021-03-10T16:26:12.354874+0000 mgr.gibba043.dnkmem (mgr.34373) 8187 : audit [DBG] from='client.49548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:13.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[31385]: audit 2021-03-10T16:26:12.616743+0000 mon.a (mon.0) 1758 : audit [DBG] from='client.? 172.21.2.103:0/2840800256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:13.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[32348]: cluster 2021-03-10T16:26:11.972514+0000 mgr.gibba043.dnkmem (mgr.34373) 8185 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[32348]: audit 2021-03-10T16:26:12.131877+0000 mgr.gibba043.dnkmem (mgr.34373) 8186 : audit [DBG] from='client.49542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[32348]: audit 2021-03-10T16:26:12.354874+0000 mgr.gibba043.dnkmem (mgr.34373) 8187 : audit [DBG] from='client.49548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:13 gibba003 bash[32348]: audit 2021-03-10T16:26:12.616743+0000 mon.a (mon.0) 1758 : audit [DBG] from='client.? 172.21.2.103:0/2840800256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:13 gibba043 bash[24019]: cluster 2021-03-10T16:26:11.972514+0000 mgr.gibba043.dnkmem (mgr.34373) 8185 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:13 gibba043 bash[24019]: audit 2021-03-10T16:26:12.131877+0000 mgr.gibba043.dnkmem (mgr.34373) 8186 : audit [DBG] from='client.49542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:13 gibba043 bash[24019]: audit 2021-03-10T16:26:12.354874+0000 mgr.gibba043.dnkmem (mgr.34373) 8187 : audit [DBG] from='client.49548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:13 gibba043 bash[24019]: audit 2021-03-10T16:26:12.616743+0000 mon.a (mon.0) 1758 : audit [DBG] from='client.? 172.21.2.103:0/2840800256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:13.724728+0000 mon.c (mon.1) 2111 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:13.725864+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:13.926058+0000 mon.c (mon.1) 2112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:13.927268+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.112339+0000 mon.c (mon.1) 2113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:26:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.113125+0000 mon.c (mon.1) 2114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.113658+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:26:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.113851+0000 mon.c (mon.1) 2115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.114535+0000 mon.c (mon.1) 2116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:26:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.115652+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.116787+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[31385]: audit 2021-03-10T16:26:14.117667+0000 mon.a (mon.0) 1764 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:26:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:13.724728+0000 mon.c (mon.1) 2111 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:13.725864+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:13.926058+0000 mon.c (mon.1) 2112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:13.927268+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.112339+0000 mon.c (mon.1) 2113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:26:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.113125+0000 mon.c (mon.1) 2114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.113658+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:26:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.113851+0000 mon.c (mon.1) 2115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.114535+0000 mon.c (mon.1) 2116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:26:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.115652+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.116787+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:14 gibba003 bash[32348]: audit 2021-03-10T16:26:14.117667+0000 mon.a (mon.0) 1764 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:26:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:13.724728+0000 mon.c (mon.1) 2111 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:13.725864+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:13.926058+0000 mon.c (mon.1) 2112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:13.927268+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.112339+0000 mon.c (mon.1) 2113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:26:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.113125+0000 mon.c (mon.1) 2114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.113658+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:26:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.113851+0000 mon.c (mon.1) 2115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.114535+0000 mon.c (mon.1) 2116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:26:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.115652+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.116787+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:26:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:14 gibba043 bash[24019]: audit 2021-03-10T16:26:14.117667+0000 mon.a (mon.0) 1764 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:26:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:15 gibba003 bash[31385]: cluster 2021-03-10T16:26:13.973454+0000 mgr.gibba043.dnkmem (mgr.34373) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:15.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:15 gibba003 bash[32348]: cluster 2021-03-10T16:26:13.973454+0000 mgr.gibba043.dnkmem (mgr.34373) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:15.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:15 gibba043 bash[24019]: cluster 2021-03-10T16:26:13.973454+0000 mgr.gibba043.dnkmem (mgr.34373) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:17 gibba003 bash[31385]: cluster 2021-03-10T16:26:15.975072+0000 mgr.gibba043.dnkmem (mgr.34373) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:17.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:17 gibba003 bash[32348]: cluster 2021-03-10T16:26:15.975072+0000 mgr.gibba043.dnkmem (mgr.34373) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:17 gibba043 bash[24019]: cluster 2021-03-10T16:26:15.975072+0000 mgr.gibba043.dnkmem (mgr.34373) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:19 gibba003 bash[31385]: cluster 2021-03-10T16:26:17.976603+0000 mgr.gibba043.dnkmem (mgr.34373) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:19 gibba003 bash[32348]: cluster 2021-03-10T16:26:17.976603+0000 mgr.gibba043.dnkmem (mgr.34373) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:19 gibba043 bash[24019]: cluster 2021-03-10T16:26:17.976603+0000 mgr.gibba043.dnkmem (mgr.34373) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:21 gibba043 bash[24019]: cluster 2021-03-10T16:26:19.978110+0000 mgr.gibba043.dnkmem (mgr.34373) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:21 gibba003 bash[31385]: cluster 2021-03-10T16:26:19.978110+0000 mgr.gibba043.dnkmem (mgr.34373) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:21 gibba003 bash[32348]: cluster 2021-03-10T16:26:19.978110+0000 mgr.gibba043.dnkmem (mgr.34373) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:23 gibba043 bash[24019]: cluster 2021-03-10T16:26:21.979776+0000 mgr.gibba043.dnkmem (mgr.34373) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:23 gibba003 bash[31385]: cluster 2021-03-10T16:26:21.979776+0000 mgr.gibba043.dnkmem (mgr.34373) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:23.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:23 gibba003 bash[32348]: cluster 2021-03-10T16:26:21.979776+0000 mgr.gibba043.dnkmem (mgr.34373) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:24.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:24 gibba043 bash[24019]: cephadm 2021-03-10T16:26:23.040709+0000 mgr.gibba043.dnkmem (mgr.34373) 8193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:24.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:24 gibba003 bash[31385]: cephadm 2021-03-10T16:26:23.040709+0000 mgr.gibba043.dnkmem (mgr.34373) 8193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:24.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:24 gibba003 bash[32348]: cephadm 2021-03-10T16:26:23.040709+0000 mgr.gibba043.dnkmem (mgr.34373) 8193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:25.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:25 gibba043 bash[24019]: cluster 2021-03-10T16:26:23.981411+0000 mgr.gibba043.dnkmem (mgr.34373) 8194 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:25 gibba003 bash[31385]: cluster 2021-03-10T16:26:23.981411+0000 mgr.gibba043.dnkmem (mgr.34373) 8194 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:25.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:25 gibba003 bash[32348]: cluster 2021-03-10T16:26:23.981411+0000 mgr.gibba043.dnkmem (mgr.34373) 8194 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:27 gibba043 bash[24019]: cluster 2021-03-10T16:26:25.982923+0000 mgr.gibba043.dnkmem (mgr.34373) 8195 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:27.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:27 gibba003 bash[31385]: cluster 2021-03-10T16:26:25.982923+0000 mgr.gibba043.dnkmem (mgr.34373) 8195 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:27.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:27 gibba003 bash[32348]: cluster 2021-03-10T16:26:25.982923+0000 mgr.gibba043.dnkmem (mgr.34373) 8195 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:29.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:29 gibba043 bash[24019]: cluster 2021-03-10T16:26:27.984412+0000 mgr.gibba043.dnkmem (mgr.34373) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:29.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:29 gibba003 bash[31385]: cluster 2021-03-10T16:26:27.984412+0000 mgr.gibba043.dnkmem (mgr.34373) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:29 gibba003 bash[32348]: cluster 2021-03-10T16:26:27.984412+0000 mgr.gibba043.dnkmem (mgr.34373) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:31.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:31 gibba043 bash[24019]: cluster 2021-03-10T16:26:29.985959+0000 mgr.gibba043.dnkmem (mgr.34373) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:31 gibba003 bash[31385]: cluster 2021-03-10T16:26:29.985959+0000 mgr.gibba043.dnkmem (mgr.34373) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:31.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:31 gibba003 bash[32348]: cluster 2021-03-10T16:26:29.985959+0000 mgr.gibba043.dnkmem (mgr.34373) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:33 gibba043 bash[24019]: cluster 2021-03-10T16:26:31.987596+0000 mgr.gibba043.dnkmem (mgr.34373) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:33 gibba003 bash[31385]: cluster 2021-03-10T16:26:31.987596+0000 mgr.gibba043.dnkmem (mgr.34373) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:33 gibba003 bash[32348]: cluster 2021-03-10T16:26:31.987596+0000 mgr.gibba043.dnkmem (mgr.34373) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:35.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:35 gibba043 bash[24019]: cluster 2021-03-10T16:26:33.988926+0000 mgr.gibba043.dnkmem (mgr.34373) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:35.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:35 gibba003 bash[31385]: cluster 2021-03-10T16:26:33.988926+0000 mgr.gibba043.dnkmem (mgr.34373) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:35.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:35 gibba003 bash[32348]: cluster 2021-03-10T16:26:33.988926+0000 mgr.gibba043.dnkmem (mgr.34373) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:37.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:37 gibba043 bash[24019]: cluster 2021-03-10T16:26:35.990793+0000 mgr.gibba043.dnkmem (mgr.34373) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:37.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:37 gibba003 bash[31385]: cluster 2021-03-10T16:26:35.990793+0000 mgr.gibba043.dnkmem (mgr.34373) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:37.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:37 gibba003 bash[32348]: cluster 2021-03-10T16:26:35.990793+0000 mgr.gibba043.dnkmem (mgr.34373) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cluster 2021-03-10T16:26:37.991975+0000 mgr.gibba043.dnkmem (mgr.34373) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.057507+0000 mgr.gibba043.dnkmem (mgr.34373) 8202 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:26:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.059084+0000 mgr.gibba043.dnkmem (mgr.34373) 8203 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:26:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.254282+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:26:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.255859+0000 mgr.gibba043.dnkmem (mgr.34373) 8204 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.257935+0000 mon.c (mon.1) 2117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.258070+0000 mgr.gibba043.dnkmem (mgr.34373) 8205 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.259588+0000 mgr.gibba043.dnkmem (mgr.34373) 8206 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.259626+0000 mgr.gibba043.dnkmem (mgr.34373) 8207 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.260196+0000 mon.c (mon.1) 2118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.260666+0000 mgr.gibba043.dnkmem (mgr.34373) 8208 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.260706+0000 mgr.gibba043.dnkmem (mgr.34373) 8209 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.261462+0000 mon.c (mon.1) 2119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.261491+0000 mgr.gibba043.dnkmem (mgr.34373) 8210 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.262344+0000 mon.c (mon.1) 2120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.263085+0000 mgr.gibba043.dnkmem (mgr.34373) 8211 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.263122+0000 mgr.gibba043.dnkmem (mgr.34373) 8212 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.264323+0000 mgr.gibba043.dnkmem (mgr.34373) 8213 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.264723+0000 mgr.gibba043.dnkmem (mgr.34373) 8214 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.264972+0000 mon.c (mon.1) 2121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.265750+0000 mgr.gibba043.dnkmem (mgr.34373) 8215 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.265789+0000 mgr.gibba043.dnkmem (mgr.34373) 8216 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: cephadm 2021-03-10T16:26:38.265900+0000 mgr.gibba043.dnkmem (mgr.34373) 8217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:39 gibba043 bash[24019]: audit 2021-03-10T16:26:38.266566+0000 mon.c (mon.1) 2122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cluster 2021-03-10T16:26:37.991975+0000 mgr.gibba043.dnkmem (mgr.34373) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.057507+0000 mgr.gibba043.dnkmem (mgr.34373) 8202 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:26:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.059084+0000 mgr.gibba043.dnkmem (mgr.34373) 8203 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:26:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.254282+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:26:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.255859+0000 mgr.gibba043.dnkmem (mgr.34373) 8204 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.257935+0000 mon.c (mon.1) 2117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.258070+0000 mgr.gibba043.dnkmem (mgr.34373) 8205 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.259588+0000 mgr.gibba043.dnkmem (mgr.34373) 8206 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.259626+0000 mgr.gibba043.dnkmem (mgr.34373) 8207 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.260196+0000 mon.c (mon.1) 2118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.260666+0000 mgr.gibba043.dnkmem (mgr.34373) 8208 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.260706+0000 mgr.gibba043.dnkmem (mgr.34373) 8209 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.261462+0000 mon.c (mon.1) 2119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.261491+0000 mgr.gibba043.dnkmem (mgr.34373) 8210 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.262344+0000 mon.c (mon.1) 2120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.263085+0000 mgr.gibba043.dnkmem (mgr.34373) 8211 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.263122+0000 mgr.gibba043.dnkmem (mgr.34373) 8212 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.264323+0000 mgr.gibba043.dnkmem (mgr.34373) 8213 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.264723+0000 mgr.gibba043.dnkmem (mgr.34373) 8214 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.264972+0000 mon.c (mon.1) 2121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.265750+0000 mgr.gibba043.dnkmem (mgr.34373) 8215 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:39.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cluster 2021-03-10T16:26:37.991975+0000 mgr.gibba043.dnkmem (mgr.34373) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.057507+0000 mgr.gibba043.dnkmem (mgr.34373) 8202 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:26:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.059084+0000 mgr.gibba043.dnkmem (mgr.34373) 8203 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:26:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.254282+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:26:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.255859+0000 mgr.gibba043.dnkmem (mgr.34373) 8204 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.257935+0000 mon.c (mon.1) 2117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.258070+0000 mgr.gibba043.dnkmem (mgr.34373) 8205 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.259588+0000 mgr.gibba043.dnkmem (mgr.34373) 8206 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.259626+0000 mgr.gibba043.dnkmem (mgr.34373) 8207 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.260196+0000 mon.c (mon.1) 2118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.260666+0000 mgr.gibba043.dnkmem (mgr.34373) 8208 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.260706+0000 mgr.gibba043.dnkmem (mgr.34373) 8209 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.261462+0000 mon.c (mon.1) 2119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.261491+0000 mgr.gibba043.dnkmem (mgr.34373) 8210 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.262344+0000 mon.c (mon.1) 2120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.263085+0000 mgr.gibba043.dnkmem (mgr.34373) 8211 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.263122+0000 mgr.gibba043.dnkmem (mgr.34373) 8212 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.264323+0000 mgr.gibba043.dnkmem (mgr.34373) 8213 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.264723+0000 mgr.gibba043.dnkmem (mgr.34373) 8214 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.264972+0000 mon.c (mon.1) 2121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.265750+0000 mgr.gibba043.dnkmem (mgr.34373) 8215 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:39.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.265789+0000 mgr.gibba043.dnkmem (mgr.34373) 8216 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:39.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: cephadm 2021-03-10T16:26:38.265900+0000 mgr.gibba043.dnkmem (mgr.34373) 8217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:39.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[31385]: audit 2021-03-10T16:26:38.266566+0000 mon.c (mon.1) 2122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.265789+0000 mgr.gibba043.dnkmem (mgr.34373) 8216 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: cephadm 2021-03-10T16:26:38.265900+0000 mgr.gibba043.dnkmem (mgr.34373) 8217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:39 gibba003 bash[32348]: audit 2021-03-10T16:26:38.266566+0000 mon.c (mon.1) 2122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:41 gibba043 bash[24019]: cluster 2021-03-10T16:26:39.993559+0000 mgr.gibba043.dnkmem (mgr.34373) 8218 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:41.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:41 gibba003 bash[31385]: cluster 2021-03-10T16:26:39.993559+0000 mgr.gibba043.dnkmem (mgr.34373) 8218 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:41.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:41 gibba003 bash[32348]: cluster 2021-03-10T16:26:39.993559+0000 mgr.gibba043.dnkmem (mgr.34373) 8218 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:42.855 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:26:43.081 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:26:43.081 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:26:43.082 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:26:43.082 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:26:43.082 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:26:43.082 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:26:43.083 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:26:43.083 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:26:43.083 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:26:43.083 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:26:43.084 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:26:43.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:26:43.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:26:43.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:26:43.084 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:26:43.085 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:26:43.085 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:26:43.085 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:26:43.085 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:26:43.086 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:26:43.086 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:26:43.333 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:26:43.334 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:26:43.334 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:43.334 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:26:43.334 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:26:43.334 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:43.335 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:26:43.335 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:26:43.335 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:26:43.335 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:26:43.336 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:26:43.336 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:26:43.336 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:26:43.336 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:26:43.336 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:26:43.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:43 gibba003 bash[31385]: cluster 2021-03-10T16:26:41.995068+0000 mgr.gibba043.dnkmem (mgr.34373) 8219 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:43.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:43 gibba003 bash[32348]: cluster 2021-03-10T16:26:41.995068+0000 mgr.gibba043.dnkmem (mgr.34373) 8219 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:43.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:43 gibba043 bash[24019]: cluster 2021-03-10T16:26:41.995068+0000 mgr.gibba043.dnkmem (mgr.34373) 8219 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:44.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:44 gibba003 bash[31385]: audit 2021-03-10T16:26:42.846880+0000 mgr.gibba043.dnkmem (mgr.34373) 8220 : audit [DBG] from='client.59548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:44.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:44 gibba003 bash[31385]: audit 2021-03-10T16:26:43.070893+0000 mgr.gibba043.dnkmem (mgr.34373) 8221 : audit [DBG] from='client.59554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:44.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:44 gibba003 bash[31385]: audit 2021-03-10T16:26:43.336353+0000 mon.a (mon.0) 1766 : audit [DBG] from='client.? 172.21.2.103:0/115342375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:44.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:44 gibba003 bash[32348]: audit 2021-03-10T16:26:42.846880+0000 mgr.gibba043.dnkmem (mgr.34373) 8220 : audit [DBG] from='client.59548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:44 gibba003 bash[32348]: audit 2021-03-10T16:26:43.070893+0000 mgr.gibba043.dnkmem (mgr.34373) 8221 : audit [DBG] from='client.59554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:44 gibba003 bash[32348]: audit 2021-03-10T16:26:43.336353+0000 mon.a (mon.0) 1766 : audit [DBG] from='client.? 172.21.2.103:0/115342375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:44.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:44 gibba043 bash[24019]: audit 2021-03-10T16:26:42.846880+0000 mgr.gibba043.dnkmem (mgr.34373) 8220 : audit [DBG] from='client.59548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:44 gibba043 bash[24019]: audit 2021-03-10T16:26:43.070893+0000 mgr.gibba043.dnkmem (mgr.34373) 8221 : audit [DBG] from='client.59554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:44 gibba043 bash[24019]: audit 2021-03-10T16:26:43.336353+0000 mon.a (mon.0) 1766 : audit [DBG] from='client.? 172.21.2.103:0/115342375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:45.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:45 gibba003 bash[31385]: cluster 2021-03-10T16:26:43.996721+0000 mgr.gibba043.dnkmem (mgr.34373) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:45 gibba003 bash[32348]: cluster 2021-03-10T16:26:43.996721+0000 mgr.gibba043.dnkmem (mgr.34373) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:45.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:45 gibba043 bash[24019]: cluster 2021-03-10T16:26:43.996721+0000 mgr.gibba043.dnkmem (mgr.34373) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:47.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:47 gibba003 bash[31385]: cluster 2021-03-10T16:26:45.998516+0000 mgr.gibba043.dnkmem (mgr.34373) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:47.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:47 gibba003 bash[32348]: cluster 2021-03-10T16:26:45.998516+0000 mgr.gibba043.dnkmem (mgr.34373) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:47 gibba043 bash[24019]: cluster 2021-03-10T16:26:45.998516+0000 mgr.gibba043.dnkmem (mgr.34373) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:49.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:49 gibba003 bash[31385]: cluster 2021-03-10T16:26:48.000190+0000 mgr.gibba043.dnkmem (mgr.34373) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:49.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:49 gibba003 bash[32348]: cluster 2021-03-10T16:26:48.000190+0000 mgr.gibba043.dnkmem (mgr.34373) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:49.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:49 gibba043 bash[24019]: cluster 2021-03-10T16:26:48.000190+0000 mgr.gibba043.dnkmem (mgr.34373) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:51 gibba003 bash[31385]: cluster 2021-03-10T16:26:50.001742+0000 mgr.gibba043.dnkmem (mgr.34373) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:51.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:51 gibba003 bash[32348]: cluster 2021-03-10T16:26:50.001742+0000 mgr.gibba043.dnkmem (mgr.34373) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:51 gibba043 bash[24019]: cluster 2021-03-10T16:26:50.001742+0000 mgr.gibba043.dnkmem (mgr.34373) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:53 gibba003 bash[31385]: cluster 2021-03-10T16:26:52.003252+0000 mgr.gibba043.dnkmem (mgr.34373) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:53 gibba003 bash[32348]: cluster 2021-03-10T16:26:52.003252+0000 mgr.gibba043.dnkmem (mgr.34373) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:53.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:53 gibba043 bash[24019]: cluster 2021-03-10T16:26:52.003252+0000 mgr.gibba043.dnkmem (mgr.34373) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:54 gibba003 bash[31385]: cephadm 2021-03-10T16:26:53.281466+0000 mgr.gibba043.dnkmem (mgr.34373) 8227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:54.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:54 gibba003 bash[32348]: cephadm 2021-03-10T16:26:53.281466+0000 mgr.gibba043.dnkmem (mgr.34373) 8227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:54.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:54 gibba043 bash[24019]: cephadm 2021-03-10T16:26:53.281466+0000 mgr.gibba043.dnkmem (mgr.34373) 8227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:26:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:55 gibba003 bash[31385]: cluster 2021-03-10T16:26:54.004873+0000 mgr.gibba043.dnkmem (mgr.34373) 8228 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:55.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:55 gibba003 bash[32348]: cluster 2021-03-10T16:26:54.004873+0000 mgr.gibba043.dnkmem (mgr.34373) 8228 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:55.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:55 gibba043 bash[24019]: cluster 2021-03-10T16:26:54.004873+0000 mgr.gibba043.dnkmem (mgr.34373) 8228 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:57 gibba003 bash[31385]: cluster 2021-03-10T16:26:56.006619+0000 mgr.gibba043.dnkmem (mgr.34373) 8229 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:57 gibba003 bash[32348]: cluster 2021-03-10T16:26:56.006619+0000 mgr.gibba043.dnkmem (mgr.34373) 8229 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:57.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:57 gibba043 bash[24019]: cluster 2021-03-10T16:26:56.006619+0000 mgr.gibba043.dnkmem (mgr.34373) 8229 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:26:59 gibba003 bash[31385]: cluster 2021-03-10T16:26:58.008129+0000 mgr.gibba043.dnkmem (mgr.34373) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:26:59 gibba003 bash[32348]: cluster 2021-03-10T16:26:58.008129+0000 mgr.gibba043.dnkmem (mgr.34373) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:26:59 gibba043 bash[24019]: cluster 2021-03-10T16:26:58.008129+0000 mgr.gibba043.dnkmem (mgr.34373) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:01 gibba003 bash[31385]: cluster 2021-03-10T16:27:00.008644+0000 mgr.gibba043.dnkmem (mgr.34373) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:01.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:01 gibba003 bash[32348]: cluster 2021-03-10T16:27:00.008644+0000 mgr.gibba043.dnkmem (mgr.34373) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:01.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:01 gibba043 bash[24019]: cluster 2021-03-10T16:27:00.008644+0000 mgr.gibba043.dnkmem (mgr.34373) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:03 gibba003 bash[31385]: cluster 2021-03-10T16:27:02.010183+0000 mgr.gibba043.dnkmem (mgr.34373) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:03.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:03 gibba003 bash[32348]: cluster 2021-03-10T16:27:02.010183+0000 mgr.gibba043.dnkmem (mgr.34373) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:03 gibba043 bash[24019]: cluster 2021-03-10T16:27:02.010183+0000 mgr.gibba043.dnkmem (mgr.34373) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:05 gibba003 bash[31385]: cluster 2021-03-10T16:27:04.011819+0000 mgr.gibba043.dnkmem (mgr.34373) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:05 gibba003 bash[32348]: cluster 2021-03-10T16:27:04.011819+0000 mgr.gibba043.dnkmem (mgr.34373) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:05 gibba043 bash[24019]: cluster 2021-03-10T16:27:04.011819+0000 mgr.gibba043.dnkmem (mgr.34373) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:07 gibba003 bash[31385]: cluster 2021-03-10T16:27:06.013483+0000 mgr.gibba043.dnkmem (mgr.34373) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:07 gibba003 bash[32348]: cluster 2021-03-10T16:27:06.013483+0000 mgr.gibba043.dnkmem (mgr.34373) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:07 gibba043 bash[24019]: cluster 2021-03-10T16:27:06.013483+0000 mgr.gibba043.dnkmem (mgr.34373) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:09 gibba003 bash[31385]: cluster 2021-03-10T16:27:08.014817+0000 mgr.gibba043.dnkmem (mgr.34373) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:09 gibba003 bash[31385]: cephadm 2021-03-10T16:27:08.297000+0000 mgr.gibba043.dnkmem (mgr.34373) 8236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:09 gibba003 bash[32348]: cluster 2021-03-10T16:27:08.014817+0000 mgr.gibba043.dnkmem (mgr.34373) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:09 gibba003 bash[32348]: cephadm 2021-03-10T16:27:08.297000+0000 mgr.gibba043.dnkmem (mgr.34373) 8236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:09.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:09 gibba043 bash[24019]: cluster 2021-03-10T16:27:08.014817+0000 mgr.gibba043.dnkmem (mgr.34373) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:09 gibba043 bash[24019]: cephadm 2021-03-10T16:27:08.297000+0000 mgr.gibba043.dnkmem (mgr.34373) 8236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:11.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:11 gibba003 bash[31385]: cluster 2021-03-10T16:27:10.015513+0000 mgr.gibba043.dnkmem (mgr.34373) 8237 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:11.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:11 gibba003 bash[32348]: cluster 2021-03-10T16:27:10.015513+0000 mgr.gibba043.dnkmem (mgr.34373) 8237 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:11.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:11 gibba043 bash[24019]: cluster 2021-03-10T16:27:10.015513+0000 mgr.gibba043.dnkmem (mgr.34373) 8237 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.578 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:27:13.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:13 gibba003 bash[31385]: cluster 2021-03-10T16:27:12.017045+0000 mgr.gibba043.dnkmem (mgr.34373) 8238 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:13 gibba003 bash[32348]: cluster 2021-03-10T16:27:12.017045+0000 mgr.gibba043.dnkmem (mgr.34373) 8238 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:13 gibba043 bash[24019]: cluster 2021-03-10T16:27:12.017045+0000 mgr.gibba043.dnkmem (mgr.34373) 8238 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.807 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:27:13.807 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:27:13.808 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:27:13.808 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:27:13.808 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:27:13.808 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:27:13.808 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:27:13.809 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:27:13.809 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:27:13.809 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:27:13.809 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:27:13.810 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:27:13.810 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:27:13.810 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:27:13.810 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:27:13.811 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:27:13.811 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:27:13.811 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:27:13.811 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:27:13.811 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:27:13.812 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:27:14.058 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:27:14.058 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:27:14.059 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:14.059 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:27:14.059 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:27:14.059 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:14.059 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:27:14.060 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:27:14.060 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:27:14.060 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:27:14.060 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:27:14.060 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:27:14.061 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:27:14.061 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:27:14.061 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:27:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:13.571014+0000 mgr.gibba043.dnkmem (mgr.34373) 8239 : audit [DBG] from='client.49578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:13.730785+0000 mon.c (mon.1) 2123 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:13.731138+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:13.932725+0000 mon.c (mon.1) 2124 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:13.933058+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.060978+0000 mon.a (mon.0) 1769 : audit [DBG] from='client.? 172.21.2.103:0/90299210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.120793+0000 mon.c (mon.1) 2125 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:27:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.120973+0000 mon.c (mon.1) 2126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:27:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.121164+0000 mon.c (mon.1) 2127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.121254+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:27:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.121427+0000 mon.c (mon.1) 2128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.121556+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:27:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.121747+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[31385]: audit 2021-03-10T16:27:14.122050+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:13.571014+0000 mgr.gibba043.dnkmem (mgr.34373) 8239 : audit [DBG] from='client.49578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:13.730785+0000 mon.c (mon.1) 2123 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:13.731138+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:13.932725+0000 mon.c (mon.1) 2124 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:13.933058+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.060978+0000 mon.a (mon.0) 1769 : audit [DBG] from='client.? 172.21.2.103:0/90299210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.120793+0000 mon.c (mon.1) 2125 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:27:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.120973+0000 mon.c (mon.1) 2126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:27:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.121164+0000 mon.c (mon.1) 2127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.121254+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:27:14.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.121427+0000 mon.c (mon.1) 2128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.121556+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:27:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.121747+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:14 gibba003 bash[32348]: audit 2021-03-10T16:27:14.122050+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:13.571014+0000 mgr.gibba043.dnkmem (mgr.34373) 8239 : audit [DBG] from='client.49578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:13.730785+0000 mon.c (mon.1) 2123 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:13.731138+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:13.932725+0000 mon.c (mon.1) 2124 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:13.933058+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.060978+0000 mon.a (mon.0) 1769 : audit [DBG] from='client.? 172.21.2.103:0/90299210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.120793+0000 mon.c (mon.1) 2125 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:27:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.120973+0000 mon.c (mon.1) 2126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:27:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.121164+0000 mon.c (mon.1) 2127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.121254+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:27:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.121427+0000 mon.c (mon.1) 2128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.121556+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:27:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.121747+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:27:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:14 gibba043 bash[24019]: audit 2021-03-10T16:27:14.122050+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:27:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:15 gibba043 bash[24019]: audit 2021-03-10T16:27:13.797005+0000 mgr.gibba043.dnkmem (mgr.34373) 8240 : audit [DBG] from='client.49584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:15 gibba043 bash[24019]: cluster 2021-03-10T16:27:14.018542+0000 mgr.gibba043.dnkmem (mgr.34373) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:15 gibba003 bash[31385]: audit 2021-03-10T16:27:13.797005+0000 mgr.gibba043.dnkmem (mgr.34373) 8240 : audit [DBG] from='client.49584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:15 gibba003 bash[31385]: cluster 2021-03-10T16:27:14.018542+0000 mgr.gibba043.dnkmem (mgr.34373) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:15 gibba003 bash[32348]: audit 2021-03-10T16:27:13.797005+0000 mgr.gibba043.dnkmem (mgr.34373) 8240 : audit [DBG] from='client.49584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:15.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:15 gibba003 bash[32348]: cluster 2021-03-10T16:27:14.018542+0000 mgr.gibba043.dnkmem (mgr.34373) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:17 gibba043 bash[24019]: cluster 2021-03-10T16:27:16.020376+0000 mgr.gibba043.dnkmem (mgr.34373) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:17 gibba003 bash[31385]: cluster 2021-03-10T16:27:16.020376+0000 mgr.gibba043.dnkmem (mgr.34373) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:17 gibba003 bash[32348]: cluster 2021-03-10T16:27:16.020376+0000 mgr.gibba043.dnkmem (mgr.34373) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:19.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:19 gibba043 bash[24019]: cluster 2021-03-10T16:27:18.021701+0000 mgr.gibba043.dnkmem (mgr.34373) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:19 gibba003 bash[31385]: cluster 2021-03-10T16:27:18.021701+0000 mgr.gibba043.dnkmem (mgr.34373) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:19 gibba003 bash[32348]: cluster 2021-03-10T16:27:18.021701+0000 mgr.gibba043.dnkmem (mgr.34373) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:21 gibba043 bash[24019]: cluster 2021-03-10T16:27:20.022199+0000 mgr.gibba043.dnkmem (mgr.34373) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:21 gibba003 bash[31385]: cluster 2021-03-10T16:27:20.022199+0000 mgr.gibba043.dnkmem (mgr.34373) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:21 gibba003 bash[32348]: cluster 2021-03-10T16:27:20.022199+0000 mgr.gibba043.dnkmem (mgr.34373) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:23 gibba043 bash[24019]: cluster 2021-03-10T16:27:22.023454+0000 mgr.gibba043.dnkmem (mgr.34373) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:23 gibba003 bash[31385]: cluster 2021-03-10T16:27:22.023454+0000 mgr.gibba043.dnkmem (mgr.34373) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:23 gibba003 bash[32348]: cluster 2021-03-10T16:27:22.023454+0000 mgr.gibba043.dnkmem (mgr.34373) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:24.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:24 gibba043 bash[24019]: cephadm 2021-03-10T16:27:23.312657+0000 mgr.gibba043.dnkmem (mgr.34373) 8246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:24.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:24 gibba003 bash[31385]: cephadm 2021-03-10T16:27:23.312657+0000 mgr.gibba043.dnkmem (mgr.34373) 8246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:24.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:24 gibba003 bash[32348]: cephadm 2021-03-10T16:27:23.312657+0000 mgr.gibba043.dnkmem (mgr.34373) 8246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:25 gibba043 bash[24019]: cluster 2021-03-10T16:27:24.025164+0000 mgr.gibba043.dnkmem (mgr.34373) 8247 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:25 gibba003 bash[31385]: cluster 2021-03-10T16:27:24.025164+0000 mgr.gibba043.dnkmem (mgr.34373) 8247 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:25.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:25 gibba003 bash[32348]: cluster 2021-03-10T16:27:24.025164+0000 mgr.gibba043.dnkmem (mgr.34373) 8247 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:27 gibba043 bash[24019]: cluster 2021-03-10T16:27:26.026938+0000 mgr.gibba043.dnkmem (mgr.34373) 8248 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:27 gibba003 bash[31385]: cluster 2021-03-10T16:27:26.026938+0000 mgr.gibba043.dnkmem (mgr.34373) 8248 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:27 gibba003 bash[32348]: cluster 2021-03-10T16:27:26.026938+0000 mgr.gibba043.dnkmem (mgr.34373) 8248 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:29.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:29 gibba043 bash[24019]: cluster 2021-03-10T16:27:28.028618+0000 mgr.gibba043.dnkmem (mgr.34373) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:29.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:29 gibba003 bash[31385]: cluster 2021-03-10T16:27:28.028618+0000 mgr.gibba043.dnkmem (mgr.34373) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:29 gibba003 bash[32348]: cluster 2021-03-10T16:27:28.028618+0000 mgr.gibba043.dnkmem (mgr.34373) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:31 gibba043 bash[24019]: cluster 2021-03-10T16:27:30.029193+0000 mgr.gibba043.dnkmem (mgr.34373) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:31 gibba003 bash[31385]: cluster 2021-03-10T16:27:30.029193+0000 mgr.gibba043.dnkmem (mgr.34373) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:31 gibba003 bash[32348]: cluster 2021-03-10T16:27:30.029193+0000 mgr.gibba043.dnkmem (mgr.34373) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:33 gibba003 bash[31385]: cluster 2021-03-10T16:27:32.030569+0000 mgr.gibba043.dnkmem (mgr.34373) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:33 gibba003 bash[32348]: cluster 2021-03-10T16:27:32.030569+0000 mgr.gibba043.dnkmem (mgr.34373) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:34.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:33 gibba043 bash[24019]: cluster 2021-03-10T16:27:32.030569+0000 mgr.gibba043.dnkmem (mgr.34373) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:35.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:35 gibba003 bash[31385]: cluster 2021-03-10T16:27:34.032114+0000 mgr.gibba043.dnkmem (mgr.34373) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:35.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:35 gibba003 bash[32348]: cluster 2021-03-10T16:27:34.032114+0000 mgr.gibba043.dnkmem (mgr.34373) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:36.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:35 gibba043 bash[24019]: cluster 2021-03-10T16:27:34.032114+0000 mgr.gibba043.dnkmem (mgr.34373) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:37.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:37 gibba003 bash[31385]: cluster 2021-03-10T16:27:36.033645+0000 mgr.gibba043.dnkmem (mgr.34373) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:37.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:37 gibba003 bash[32348]: cluster 2021-03-10T16:27:36.033645+0000 mgr.gibba043.dnkmem (mgr.34373) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:37 gibba043 bash[24019]: cluster 2021-03-10T16:27:36.033645+0000 mgr.gibba043.dnkmem (mgr.34373) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cluster 2021-03-10T16:27:38.035107+0000 mgr.gibba043.dnkmem (mgr.34373) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.314333+0000 mgr.gibba043.dnkmem (mgr.34373) 8255 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:27:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.314962+0000 mgr.gibba043.dnkmem (mgr.34373) 8256 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:27:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.533007+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:27:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.534540+0000 mgr.gibba043.dnkmem (mgr.34373) 8257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:39.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.536686+0000 mgr.gibba043.dnkmem (mgr.34373) 8258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.537105+0000 mon.c (mon.1) 2129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.538009+0000 mgr.gibba043.dnkmem (mgr.34373) 8259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.538061+0000 mgr.gibba043.dnkmem (mgr.34373) 8260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.538567+0000 mon.c (mon.1) 2130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.539287+0000 mgr.gibba043.dnkmem (mgr.34373) 8261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.539356+0000 mgr.gibba043.dnkmem (mgr.34373) 8262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.540029+0000 mon.c (mon.1) 2131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.540065+0000 mgr.gibba043.dnkmem (mgr.34373) 8263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.541026+0000 mon.c (mon.1) 2132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.541214+0000 mgr.gibba043.dnkmem (mgr.34373) 8264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.541302+0000 mgr.gibba043.dnkmem (mgr.34373) 8265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.542287+0000 mgr.gibba043.dnkmem (mgr.34373) 8266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.542604+0000 mgr.gibba043.dnkmem (mgr.34373) 8267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.543111+0000 mon.c (mon.1) 2133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.543531+0000 mgr.gibba043.dnkmem (mgr.34373) 8268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:39.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cluster 2021-03-10T16:27:38.035107+0000 mgr.gibba043.dnkmem (mgr.34373) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:39.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.314333+0000 mgr.gibba043.dnkmem (mgr.34373) 8255 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:27:39.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.314962+0000 mgr.gibba043.dnkmem (mgr.34373) 8256 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:27:39.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.533007+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:27:39.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.534540+0000 mgr.gibba043.dnkmem (mgr.34373) 8257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:39.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.536686+0000 mgr.gibba043.dnkmem (mgr.34373) 8258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:39.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.537105+0000 mon.c (mon.1) 2129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:39.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.538009+0000 mgr.gibba043.dnkmem (mgr.34373) 8259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:39.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.538061+0000 mgr.gibba043.dnkmem (mgr.34373) 8260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.538567+0000 mon.c (mon.1) 2130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.539287+0000 mgr.gibba043.dnkmem (mgr.34373) 8261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.539356+0000 mgr.gibba043.dnkmem (mgr.34373) 8262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.540029+0000 mon.c (mon.1) 2131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.540065+0000 mgr.gibba043.dnkmem (mgr.34373) 8263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.541026+0000 mon.c (mon.1) 2132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.541214+0000 mgr.gibba043.dnkmem (mgr.34373) 8264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.541302+0000 mgr.gibba043.dnkmem (mgr.34373) 8265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.542287+0000 mgr.gibba043.dnkmem (mgr.34373) 8266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.542604+0000 mgr.gibba043.dnkmem (mgr.34373) 8267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.543111+0000 mon.c (mon.1) 2133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.543531+0000 mgr.gibba043.dnkmem (mgr.34373) 8268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.543580+0000 mgr.gibba043.dnkmem (mgr.34373) 8269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: cephadm 2021-03-10T16:27:38.543723+0000 mgr.gibba043.dnkmem (mgr.34373) 8270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:39.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[32348]: audit 2021-03-10T16:27:38.544252+0000 mon.c (mon.1) 2134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:39.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.543580+0000 mgr.gibba043.dnkmem (mgr.34373) 8269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:39.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: cephadm 2021-03-10T16:27:38.543723+0000 mgr.gibba043.dnkmem (mgr.34373) 8270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:39.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:39 gibba003 bash[31385]: audit 2021-03-10T16:27:38.544252+0000 mon.c (mon.1) 2134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:40.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cluster 2021-03-10T16:27:38.035107+0000 mgr.gibba043.dnkmem (mgr.34373) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:40.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.314333+0000 mgr.gibba043.dnkmem (mgr.34373) 8255 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:27:40.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.314962+0000 mgr.gibba043.dnkmem (mgr.34373) 8256 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:27:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.533007+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:27:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.534540+0000 mgr.gibba043.dnkmem (mgr.34373) 8257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.536686+0000 mgr.gibba043.dnkmem (mgr.34373) 8258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.537105+0000 mon.c (mon.1) 2129 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.538009+0000 mgr.gibba043.dnkmem (mgr.34373) 8259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.538061+0000 mgr.gibba043.dnkmem (mgr.34373) 8260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.538567+0000 mon.c (mon.1) 2130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.539287+0000 mgr.gibba043.dnkmem (mgr.34373) 8261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.539356+0000 mgr.gibba043.dnkmem (mgr.34373) 8262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.540029+0000 mon.c (mon.1) 2131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.540065+0000 mgr.gibba043.dnkmem (mgr.34373) 8263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.541026+0000 mon.c (mon.1) 2132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.541214+0000 mgr.gibba043.dnkmem (mgr.34373) 8264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.541302+0000 mgr.gibba043.dnkmem (mgr.34373) 8265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.542287+0000 mgr.gibba043.dnkmem (mgr.34373) 8266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.542604+0000 mgr.gibba043.dnkmem (mgr.34373) 8267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.543111+0000 mon.c (mon.1) 2133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.543531+0000 mgr.gibba043.dnkmem (mgr.34373) 8268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.543580+0000 mgr.gibba043.dnkmem (mgr.34373) 8269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: cephadm 2021-03-10T16:27:38.543723+0000 mgr.gibba043.dnkmem (mgr.34373) 8270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:39 gibba043 bash[24019]: audit 2021-03-10T16:27:38.544252+0000 mon.c (mon.1) 2134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:41.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:41 gibba003 bash[31385]: cluster 2021-03-10T16:27:40.036655+0000 mgr.gibba043.dnkmem (mgr.34373) 8271 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:41.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:41 gibba003 bash[32348]: cluster 2021-03-10T16:27:40.036655+0000 mgr.gibba043.dnkmem (mgr.34373) 8271 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:41 gibba043 bash[24019]: cluster 2021-03-10T16:27:40.036655+0000 mgr.gibba043.dnkmem (mgr.34373) 8271 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:43.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:43 gibba003 bash[31385]: cluster 2021-03-10T16:27:42.038034+0000 mgr.gibba043.dnkmem (mgr.34373) 8272 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:43 gibba003 bash[32348]: cluster 2021-03-10T16:27:42.038034+0000 mgr.gibba043.dnkmem (mgr.34373) 8272 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:44.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:43 gibba043 bash[24019]: cluster 2021-03-10T16:27:42.038034+0000 mgr.gibba043.dnkmem (mgr.34373) 8272 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:44.301 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:27:44.525 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:27:44.526 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:27:44.526 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:27:44.526 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:27:44.526 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:27:44.527 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:27:44.527 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:27:44.527 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:27:44.527 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:27:44.528 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:27:44.528 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:27:44.528 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:27:44.528 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:27:44.528 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:27:44.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:27:44.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:27:44.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:27:44.529 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:27:44.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:27:44.530 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:27:44.530 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:27:44.775 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:27:44.775 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:27:44.776 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:44.776 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:27:44.776 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:27:44.776 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:44.777 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:27:44.777 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:27:44.777 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:27:44.777 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:27:44.778 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:27:44.778 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:27:44.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:27:44.778 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:27:44.779 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:27:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[31385]: cluster 2021-03-10T16:27:44.039565+0000 mgr.gibba043.dnkmem (mgr.34373) 8273 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[31385]: audit 2021-03-10T16:27:44.293728+0000 mgr.gibba043.dnkmem (mgr.34373) 8274 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[31385]: audit 2021-03-10T16:27:44.514744+0000 mgr.gibba043.dnkmem (mgr.34373) 8275 : audit [DBG] from='client.49602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[31385]: audit 2021-03-10T16:27:44.778457+0000 mon.c (mon.1) 2135 : audit [DBG] from='client.? 172.21.2.103:0/3668912810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[32348]: cluster 2021-03-10T16:27:44.039565+0000 mgr.gibba043.dnkmem (mgr.34373) 8273 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[32348]: audit 2021-03-10T16:27:44.293728+0000 mgr.gibba043.dnkmem (mgr.34373) 8274 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[32348]: audit 2021-03-10T16:27:44.514744+0000 mgr.gibba043.dnkmem (mgr.34373) 8275 : audit [DBG] from='client.49602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:45 gibba003 bash[32348]: audit 2021-03-10T16:27:44.778457+0000 mon.c (mon.1) 2135 : audit [DBG] from='client.? 172.21.2.103:0/3668912810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:45 gibba043 bash[24019]: cluster 2021-03-10T16:27:44.039565+0000 mgr.gibba043.dnkmem (mgr.34373) 8273 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:46.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:45 gibba043 bash[24019]: audit 2021-03-10T16:27:44.293728+0000 mgr.gibba043.dnkmem (mgr.34373) 8274 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:46.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:45 gibba043 bash[24019]: audit 2021-03-10T16:27:44.514744+0000 mgr.gibba043.dnkmem (mgr.34373) 8275 : audit [DBG] from='client.49602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:46.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:45 gibba043 bash[24019]: audit 2021-03-10T16:27:44.778457+0000 mon.c (mon.1) 2135 : audit [DBG] from='client.? 172.21.2.103:0/3668912810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:47 gibba003 bash[31385]: cluster 2021-03-10T16:27:46.041202+0000 mgr.gibba043.dnkmem (mgr.34373) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:47.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:47 gibba003 bash[32348]: cluster 2021-03-10T16:27:46.041202+0000 mgr.gibba043.dnkmem (mgr.34373) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:48.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:47 gibba043 bash[24019]: cluster 2021-03-10T16:27:46.041202+0000 mgr.gibba043.dnkmem (mgr.34373) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:49 gibba003 bash[31385]: cluster 2021-03-10T16:27:48.042796+0000 mgr.gibba043.dnkmem (mgr.34373) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:49.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:49 gibba003 bash[32348]: cluster 2021-03-10T16:27:48.042796+0000 mgr.gibba043.dnkmem (mgr.34373) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:49 gibba043 bash[24019]: cluster 2021-03-10T16:27:48.042796+0000 mgr.gibba043.dnkmem (mgr.34373) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:51.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:51 gibba003 bash[31385]: cluster 2021-03-10T16:27:50.043380+0000 mgr.gibba043.dnkmem (mgr.34373) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:51 gibba003 bash[32348]: cluster 2021-03-10T16:27:50.043380+0000 mgr.gibba043.dnkmem (mgr.34373) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:52.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:51 gibba043 bash[24019]: cluster 2021-03-10T16:27:50.043380+0000 mgr.gibba043.dnkmem (mgr.34373) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:53.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:53 gibba003 bash[31385]: cluster 2021-03-10T16:27:52.044789+0000 mgr.gibba043.dnkmem (mgr.34373) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:53 gibba003 bash[32348]: cluster 2021-03-10T16:27:52.044789+0000 mgr.gibba043.dnkmem (mgr.34373) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:54.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:53 gibba043 bash[24019]: cluster 2021-03-10T16:27:52.044789+0000 mgr.gibba043.dnkmem (mgr.34373) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:54.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:54 gibba003 bash[31385]: cephadm 2021-03-10T16:27:53.559866+0000 mgr.gibba043.dnkmem (mgr.34373) 8280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:54.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:54 gibba003 bash[32348]: cephadm 2021-03-10T16:27:53.559866+0000 mgr.gibba043.dnkmem (mgr.34373) 8280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:55.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:54 gibba043 bash[24019]: cephadm 2021-03-10T16:27:53.559866+0000 mgr.gibba043.dnkmem (mgr.34373) 8280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:27:55.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:55 gibba003 bash[31385]: cluster 2021-03-10T16:27:54.046255+0000 mgr.gibba043.dnkmem (mgr.34373) 8281 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:55.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:55 gibba003 bash[32348]: cluster 2021-03-10T16:27:54.046255+0000 mgr.gibba043.dnkmem (mgr.34373) 8281 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:56.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:55 gibba043 bash[24019]: cluster 2021-03-10T16:27:54.046255+0000 mgr.gibba043.dnkmem (mgr.34373) 8281 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:57 gibba003 bash[31385]: cluster 2021-03-10T16:27:56.047958+0000 mgr.gibba043.dnkmem (mgr.34373) 8282 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:57.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:57 gibba003 bash[32348]: cluster 2021-03-10T16:27:56.047958+0000 mgr.gibba043.dnkmem (mgr.34373) 8282 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:57 gibba043 bash[24019]: cluster 2021-03-10T16:27:56.047958+0000 mgr.gibba043.dnkmem (mgr.34373) 8282 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:27:59 gibba003 bash[31385]: cluster 2021-03-10T16:27:58.049273+0000 mgr.gibba043.dnkmem (mgr.34373) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:27:59 gibba003 bash[32348]: cluster 2021-03-10T16:27:58.049273+0000 mgr.gibba043.dnkmem (mgr.34373) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:27:59 gibba043 bash[24019]: cluster 2021-03-10T16:27:58.049273+0000 mgr.gibba043.dnkmem (mgr.34373) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:01 gibba003 bash[31385]: cluster 2021-03-10T16:28:00.050142+0000 mgr.gibba043.dnkmem (mgr.34373) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:01.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:01 gibba003 bash[32348]: cluster 2021-03-10T16:28:00.050142+0000 mgr.gibba043.dnkmem (mgr.34373) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:02.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:01 gibba043 bash[24019]: cluster 2021-03-10T16:28:00.050142+0000 mgr.gibba043.dnkmem (mgr.34373) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:03 gibba003 bash[31385]: cluster 2021-03-10T16:28:02.051534+0000 mgr.gibba043.dnkmem (mgr.34373) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:03 gibba003 bash[32348]: cluster 2021-03-10T16:28:02.051534+0000 mgr.gibba043.dnkmem (mgr.34373) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:04.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:03 gibba043 bash[24019]: cluster 2021-03-10T16:28:02.051534+0000 mgr.gibba043.dnkmem (mgr.34373) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:05 gibba003 bash[31385]: cluster 2021-03-10T16:28:04.052994+0000 mgr.gibba043.dnkmem (mgr.34373) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:05 gibba003 bash[32348]: cluster 2021-03-10T16:28:04.052994+0000 mgr.gibba043.dnkmem (mgr.34373) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:05 gibba043 bash[24019]: cluster 2021-03-10T16:28:04.052994+0000 mgr.gibba043.dnkmem (mgr.34373) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:07.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:07 gibba003 bash[31385]: cluster 2021-03-10T16:28:06.054656+0000 mgr.gibba043.dnkmem (mgr.34373) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:07 gibba003 bash[32348]: cluster 2021-03-10T16:28:06.054656+0000 mgr.gibba043.dnkmem (mgr.34373) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:07 gibba043 bash[24019]: cluster 2021-03-10T16:28:06.054656+0000 mgr.gibba043.dnkmem (mgr.34373) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:09 gibba003 bash[31385]: cluster 2021-03-10T16:28:08.056159+0000 mgr.gibba043.dnkmem (mgr.34373) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:09 gibba003 bash[31385]: cephadm 2021-03-10T16:28:08.575882+0000 mgr.gibba043.dnkmem (mgr.34373) 8289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:09 gibba003 bash[32348]: cluster 2021-03-10T16:28:08.056159+0000 mgr.gibba043.dnkmem (mgr.34373) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:09.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:09 gibba003 bash[32348]: cephadm 2021-03-10T16:28:08.575882+0000 mgr.gibba043.dnkmem (mgr.34373) 8289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:09 gibba043 bash[24019]: cluster 2021-03-10T16:28:08.056159+0000 mgr.gibba043.dnkmem (mgr.34373) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:09 gibba043 bash[24019]: cephadm 2021-03-10T16:28:08.575882+0000 mgr.gibba043.dnkmem (mgr.34373) 8289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:11 gibba003 bash[31385]: cluster 2021-03-10T16:28:10.056884+0000 mgr.gibba043.dnkmem (mgr.34373) 8290 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:11 gibba003 bash[32348]: cluster 2021-03-10T16:28:10.056884+0000 mgr.gibba043.dnkmem (mgr.34373) 8290 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:11 gibba043 bash[24019]: cluster 2021-03-10T16:28:10.056884+0000 mgr.gibba043.dnkmem (mgr.34373) 8290 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:13.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:13 gibba003 bash[31385]: cluster 2021-03-10T16:28:12.058270+0000 mgr.gibba043.dnkmem (mgr.34373) 8291 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:13 gibba003 bash[32348]: cluster 2021-03-10T16:28:12.058270+0000 mgr.gibba043.dnkmem (mgr.34373) 8291 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:14.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:13 gibba043 bash[24019]: cluster 2021-03-10T16:28:12.058270+0000 mgr.gibba043.dnkmem (mgr.34373) 8291 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:13.735124+0000 mon.c (mon.1) 2136 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:13.735615+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:13.947332+0000 mon.c (mon.1) 2137 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:13.948422+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.128362+0000 mon.c (mon.1) 2138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:28:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.129571+0000 mon.c (mon.1) 2139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.130270+0000 mon.c (mon.1) 2140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:28:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.130521+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:28:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.130947+0000 mon.c (mon.1) 2141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.131956+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.132944+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:28:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:14 gibba043 bash[24019]: audit 2021-03-10T16:28:14.133712+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.022 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:28:15.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:13.735124+0000 mon.c (mon.1) 2136 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:13.735615+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:13.947332+0000 mon.c (mon.1) 2137 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:13.948422+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.128362+0000 mon.c (mon.1) 2138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:28:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.129571+0000 mon.c (mon.1) 2139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.130270+0000 mon.c (mon.1) 2140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:28:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.130521+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:28:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.130947+0000 mon.c (mon.1) 2141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.131956+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.132944+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:28:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[31385]: audit 2021-03-10T16:28:14.133712+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:13.735124+0000 mon.c (mon.1) 2136 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:13.735615+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:13.947332+0000 mon.c (mon.1) 2137 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:13.948422+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.128362+0000 mon.c (mon.1) 2138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:28:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.129571+0000 mon.c (mon.1) 2139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.130270+0000 mon.c (mon.1) 2140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:28:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.130521+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:28:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.130947+0000 mon.c (mon.1) 2141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.131956+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.132944+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:28:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:14 gibba003 bash[32348]: audit 2021-03-10T16:28:14.133712+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:28:15.251 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:28:15.252 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:28:15.252 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:28:15.252 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:28:15.253 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:28:15.253 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:28:15.253 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:28:15.254 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:28:15.254 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:28:15.255 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:28:15.255 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:28:15.256 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:28:15.256 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:28:15.256 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:28:15.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:28:15.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:28:15.257 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:28:15.258 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:28:15.258 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:28:15.259 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:28:15.259 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:28:15.498 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:28:15.499 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:28:15.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:15.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:28:15.500 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:28:15.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:15.501 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:28:15.501 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:28:15.501 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:28:15.501 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:28:15.502 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:28:15.502 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:28:15.503 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:28:15.503 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:28:15.503 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:28:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:15 gibba043 bash[24019]: cluster 2021-03-10T16:28:14.059833+0000 mgr.gibba043.dnkmem (mgr.34373) 8292 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:15 gibba043 bash[24019]: audit 2021-03-10T16:28:15.501668+0000 mon.a (mon.0) 1781 : audit [DBG] from='client.? 172.21.2.103:0/3204720416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:16.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:15 gibba003 bash[31385]: cluster 2021-03-10T16:28:14.059833+0000 mgr.gibba043.dnkmem (mgr.34373) 8292 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:16.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:15 gibba003 bash[31385]: audit 2021-03-10T16:28:15.501668+0000 mon.a (mon.0) 1781 : audit [DBG] from='client.? 172.21.2.103:0/3204720416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:16.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:15 gibba003 bash[32348]: cluster 2021-03-10T16:28:14.059833+0000 mgr.gibba043.dnkmem (mgr.34373) 8292 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:15 gibba003 bash[32348]: audit 2021-03-10T16:28:15.501668+0000 mon.a (mon.0) 1781 : audit [DBG] from='client.? 172.21.2.103:0/3204720416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:17.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:16 gibba043 bash[24019]: audit 2021-03-10T16:28:15.013781+0000 mgr.gibba043.dnkmem (mgr.34373) 8293 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:17.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:16 gibba043 bash[24019]: audit 2021-03-10T16:28:15.240224+0000 mgr.gibba043.dnkmem (mgr.34373) 8294 : audit [DBG] from='client.49620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:17.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:16 gibba003 bash[31385]: audit 2021-03-10T16:28:15.013781+0000 mgr.gibba043.dnkmem (mgr.34373) 8293 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:17.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:16 gibba003 bash[31385]: audit 2021-03-10T16:28:15.240224+0000 mgr.gibba043.dnkmem (mgr.34373) 8294 : audit [DBG] from='client.49620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:17.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:16 gibba003 bash[32348]: audit 2021-03-10T16:28:15.013781+0000 mgr.gibba043.dnkmem (mgr.34373) 8293 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:17.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:16 gibba003 bash[32348]: audit 2021-03-10T16:28:15.240224+0000 mgr.gibba043.dnkmem (mgr.34373) 8294 : audit [DBG] from='client.49620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:18.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:17 gibba043 bash[24019]: cluster 2021-03-10T16:28:16.061282+0000 mgr.gibba043.dnkmem (mgr.34373) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:17 gibba003 bash[31385]: cluster 2021-03-10T16:28:16.061282+0000 mgr.gibba043.dnkmem (mgr.34373) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:18.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:17 gibba003 bash[32348]: cluster 2021-03-10T16:28:16.061282+0000 mgr.gibba043.dnkmem (mgr.34373) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:19 gibba043 bash[24019]: cluster 2021-03-10T16:28:18.062745+0000 mgr.gibba043.dnkmem (mgr.34373) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:19 gibba003 bash[31385]: cluster 2021-03-10T16:28:18.062745+0000 mgr.gibba043.dnkmem (mgr.34373) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:19 gibba003 bash[32348]: cluster 2021-03-10T16:28:18.062745+0000 mgr.gibba043.dnkmem (mgr.34373) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:21 gibba043 bash[24019]: cluster 2021-03-10T16:28:20.063753+0000 mgr.gibba043.dnkmem (mgr.34373) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:22.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:21 gibba003 bash[31385]: cluster 2021-03-10T16:28:20.063753+0000 mgr.gibba043.dnkmem (mgr.34373) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:22.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:21 gibba003 bash[32348]: cluster 2021-03-10T16:28:20.063753+0000 mgr.gibba043.dnkmem (mgr.34373) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:23 gibba043 bash[24019]: cluster 2021-03-10T16:28:22.065000+0000 mgr.gibba043.dnkmem (mgr.34373) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:23 gibba003 bash[31385]: cluster 2021-03-10T16:28:22.065000+0000 mgr.gibba043.dnkmem (mgr.34373) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:23 gibba003 bash[32348]: cluster 2021-03-10T16:28:22.065000+0000 mgr.gibba043.dnkmem (mgr.34373) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:25.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:24 gibba043 bash[24019]: cephadm 2021-03-10T16:28:23.592018+0000 mgr.gibba043.dnkmem (mgr.34373) 8299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:25.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:24 gibba003 bash[31385]: cephadm 2021-03-10T16:28:23.592018+0000 mgr.gibba043.dnkmem (mgr.34373) 8299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:25.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:24 gibba003 bash[32348]: cephadm 2021-03-10T16:28:23.592018+0000 mgr.gibba043.dnkmem (mgr.34373) 8299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:25 gibba043 bash[24019]: cluster 2021-03-10T16:28:24.066489+0000 mgr.gibba043.dnkmem (mgr.34373) 8300 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:26.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:25 gibba003 bash[31385]: cluster 2021-03-10T16:28:24.066489+0000 mgr.gibba043.dnkmem (mgr.34373) 8300 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:25 gibba003 bash[32348]: cluster 2021-03-10T16:28:24.066489+0000 mgr.gibba043.dnkmem (mgr.34373) 8300 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:28.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:27 gibba003 bash[31385]: cluster 2021-03-10T16:28:26.068212+0000 mgr.gibba043.dnkmem (mgr.34373) 8301 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:27 gibba003 bash[32348]: cluster 2021-03-10T16:28:26.068212+0000 mgr.gibba043.dnkmem (mgr.34373) 8301 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:27 gibba043 bash[24019]: cluster 2021-03-10T16:28:26.068212+0000 mgr.gibba043.dnkmem (mgr.34373) 8301 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:30.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:29 gibba003 bash[31385]: cluster 2021-03-10T16:28:28.069889+0000 mgr.gibba043.dnkmem (mgr.34373) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:29 gibba003 bash[32348]: cluster 2021-03-10T16:28:28.069889+0000 mgr.gibba043.dnkmem (mgr.34373) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:29 gibba043 bash[24019]: cluster 2021-03-10T16:28:28.069889+0000 mgr.gibba043.dnkmem (mgr.34373) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:30 gibba003 bash[31385]: cluster 2021-03-10T16:28:30.071064+0000 mgr.gibba043.dnkmem (mgr.34373) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:30 gibba003 bash[32348]: cluster 2021-03-10T16:28:30.071064+0000 mgr.gibba043.dnkmem (mgr.34373) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:30 gibba043 bash[24019]: cluster 2021-03-10T16:28:30.071064+0000 mgr.gibba043.dnkmem (mgr.34373) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:33 gibba003 bash[31385]: cluster 2021-03-10T16:28:32.072591+0000 mgr.gibba043.dnkmem (mgr.34373) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:33 gibba003 bash[32348]: cluster 2021-03-10T16:28:32.072591+0000 mgr.gibba043.dnkmem (mgr.34373) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:33 gibba043 bash[24019]: cluster 2021-03-10T16:28:32.072591+0000 mgr.gibba043.dnkmem (mgr.34373) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:35.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:35 gibba003 bash[31385]: cluster 2021-03-10T16:28:34.074283+0000 mgr.gibba043.dnkmem (mgr.34373) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:35 gibba003 bash[32348]: cluster 2021-03-10T16:28:34.074283+0000 mgr.gibba043.dnkmem (mgr.34373) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:35.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:35 gibba043 bash[24019]: cluster 2021-03-10T16:28:34.074283+0000 mgr.gibba043.dnkmem (mgr.34373) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:37 gibba003 bash[31385]: cluster 2021-03-10T16:28:36.076160+0000 mgr.gibba043.dnkmem (mgr.34373) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:37 gibba003 bash[32348]: cluster 2021-03-10T16:28:36.076160+0000 mgr.gibba043.dnkmem (mgr.34373) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:37 gibba043 bash[24019]: cluster 2021-03-10T16:28:36.076160+0000 mgr.gibba043.dnkmem (mgr.34373) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:39 gibba003 bash[31385]: cluster 2021-03-10T16:28:38.077678+0000 mgr.gibba043.dnkmem (mgr.34373) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:39 gibba003 bash[31385]: cephadm 2021-03-10T16:28:38.609745+0000 mgr.gibba043.dnkmem (mgr.34373) 8308 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:28:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:39 gibba003 bash[31385]: audit 2021-03-10T16:28:38.611947+0000 mon.c (mon.1) 2142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:28:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:39 gibba003 bash[32348]: cluster 2021-03-10T16:28:38.077678+0000 mgr.gibba043.dnkmem (mgr.34373) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:39 gibba003 bash[32348]: cephadm 2021-03-10T16:28:38.609745+0000 mgr.gibba043.dnkmem (mgr.34373) 8308 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:28:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:39 gibba003 bash[32348]: audit 2021-03-10T16:28:38.611947+0000 mon.c (mon.1) 2142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:28:39.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:39 gibba043 bash[24019]: cluster 2021-03-10T16:28:38.077678+0000 mgr.gibba043.dnkmem (mgr.34373) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:39 gibba043 bash[24019]: cephadm 2021-03-10T16:28:38.609745+0000 mgr.gibba043.dnkmem (mgr.34373) 8308 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:28:39.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:39 gibba043 bash[24019]: audit 2021-03-10T16:28:38.611947+0000 mon.c (mon.1) 2142 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:28:41.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:41 gibba003 bash[31385]: cluster 2021-03-10T16:28:40.078973+0000 mgr.gibba043.dnkmem (mgr.34373) 8309 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:41 gibba003 bash[32348]: cluster 2021-03-10T16:28:40.078973+0000 mgr.gibba043.dnkmem (mgr.34373) 8309 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:41 gibba043 bash[24019]: cluster 2021-03-10T16:28:40.078973+0000 mgr.gibba043.dnkmem (mgr.34373) 8309 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cluster 2021-03-10T16:28:42.080625+0000 mgr.gibba043.dnkmem (mgr.34373) 8310 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.124856+0000 mgr.gibba043.dnkmem (mgr.34373) 8311 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:28:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.125362+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:28:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.333968+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:28:43.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.338745+0000 mgr.gibba043.dnkmem (mgr.34373) 8312 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.340917+0000 mgr.gibba043.dnkmem (mgr.34373) 8313 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:43.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.341100+0000 mon.c (mon.1) 2143 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.342805+0000 mgr.gibba043.dnkmem (mgr.34373) 8314 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.342844+0000 mgr.gibba043.dnkmem (mgr.34373) 8315 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.343162+0000 mon.c (mon.1) 2144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.344285+0000 mgr.gibba043.dnkmem (mgr.34373) 8316 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.344441+0000 mgr.gibba043.dnkmem (mgr.34373) 8317 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:43.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.344811+0000 mon.c (mon.1) 2145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.345914+0000 mgr.gibba043.dnkmem (mgr.34373) 8318 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:43.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.346384+0000 mon.c (mon.1) 2146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.347659+0000 mgr.gibba043.dnkmem (mgr.34373) 8319 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:43.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.347739+0000 mgr.gibba043.dnkmem (mgr.34373) 8320 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:43.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.349360+0000 mgr.gibba043.dnkmem (mgr.34373) 8321 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.349761+0000 mon.c (mon.1) 2147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.349801+0000 mgr.gibba043.dnkmem (mgr.34373) 8322 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:43.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.351275+0000 mgr.gibba043.dnkmem (mgr.34373) 8323 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:43.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cluster 2021-03-10T16:28:42.080625+0000 mgr.gibba043.dnkmem (mgr.34373) 8310 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.124856+0000 mgr.gibba043.dnkmem (mgr.34373) 8311 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:28:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.125362+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:28:43.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.333968+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:28:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.338745+0000 mgr.gibba043.dnkmem (mgr.34373) 8312 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:43.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.340917+0000 mgr.gibba043.dnkmem (mgr.34373) 8313 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:43.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.341100+0000 mon.c (mon.1) 2143 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:43.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.342805+0000 mgr.gibba043.dnkmem (mgr.34373) 8314 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:43.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.342844+0000 mgr.gibba043.dnkmem (mgr.34373) 8315 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:43.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.343162+0000 mon.c (mon.1) 2144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.344285+0000 mgr.gibba043.dnkmem (mgr.34373) 8316 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:43.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.344441+0000 mgr.gibba043.dnkmem (mgr.34373) 8317 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:43.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.344811+0000 mon.c (mon.1) 2145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.345914+0000 mgr.gibba043.dnkmem (mgr.34373) 8318 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:43.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.346384+0000 mon.c (mon.1) 2146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.347659+0000 mgr.gibba043.dnkmem (mgr.34373) 8319 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:43.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.347739+0000 mgr.gibba043.dnkmem (mgr.34373) 8320 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:43.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.349360+0000 mgr.gibba043.dnkmem (mgr.34373) 8321 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:43.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.349761+0000 mon.c (mon.1) 2147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.349801+0000 mgr.gibba043.dnkmem (mgr.34373) 8322 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:43.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.351275+0000 mgr.gibba043.dnkmem (mgr.34373) 8323 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:43.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.351316+0000 mgr.gibba043.dnkmem (mgr.34373) 8324 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:43.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: cephadm 2021-03-10T16:28:42.351439+0000 mgr.gibba043.dnkmem (mgr.34373) 8325 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:43.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[32348]: audit 2021-03-10T16:28:42.351734+0000 mon.c (mon.1) 2148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.457 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.351316+0000 mgr.gibba043.dnkmem (mgr.34373) 8324 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:43.457 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: cephadm 2021-03-10T16:28:42.351439+0000 mgr.gibba043.dnkmem (mgr.34373) 8325 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:43.457 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:43 gibba003 bash[31385]: audit 2021-03-10T16:28:42.351734+0000 mon.c (mon.1) 2148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cluster 2021-03-10T16:28:42.080625+0000 mgr.gibba043.dnkmem (mgr.34373) 8310 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.124856+0000 mgr.gibba043.dnkmem (mgr.34373) 8311 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:28:43.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.125362+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:28:43.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.333968+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:28:43.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.338745+0000 mgr.gibba043.dnkmem (mgr.34373) 8312 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.340917+0000 mgr.gibba043.dnkmem (mgr.34373) 8313 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.341100+0000 mon.c (mon.1) 2143 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.342805+0000 mgr.gibba043.dnkmem (mgr.34373) 8314 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.342844+0000 mgr.gibba043.dnkmem (mgr.34373) 8315 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.343162+0000 mon.c (mon.1) 2144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.344285+0000 mgr.gibba043.dnkmem (mgr.34373) 8316 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:43.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.344441+0000 mgr.gibba043.dnkmem (mgr.34373) 8317 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.344811+0000 mon.c (mon.1) 2145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.345914+0000 mgr.gibba043.dnkmem (mgr.34373) 8318 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:43.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.346384+0000 mon.c (mon.1) 2146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.347659+0000 mgr.gibba043.dnkmem (mgr.34373) 8319 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:43.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.347739+0000 mgr.gibba043.dnkmem (mgr.34373) 8320 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.349360+0000 mgr.gibba043.dnkmem (mgr.34373) 8321 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.349761+0000 mon.c (mon.1) 2147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:43.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.349801+0000 mgr.gibba043.dnkmem (mgr.34373) 8322 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.351275+0000 mgr.gibba043.dnkmem (mgr.34373) 8323 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.351316+0000 mgr.gibba043.dnkmem (mgr.34373) 8324 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:43.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: cephadm 2021-03-10T16:28:42.351439+0000 mgr.gibba043.dnkmem (mgr.34373) 8325 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:43.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:43 gibba043 bash[24019]: audit 2021-03-10T16:28:42.351734+0000 mon.c (mon.1) 2148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:45.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:45 gibba003 bash[31385]: cluster 2021-03-10T16:28:44.082289+0000 mgr.gibba043.dnkmem (mgr.34373) 8326 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:45 gibba003 bash[32348]: cluster 2021-03-10T16:28:44.082289+0000 mgr.gibba043.dnkmem (mgr.34373) 8326 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:45 gibba043 bash[24019]: cluster 2021-03-10T16:28:44.082289+0000 mgr.gibba043.dnkmem (mgr.34373) 8326 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.743 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:28:45.973 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:28:45.973 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:28:45.973 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:28:45.973 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:28:45.974 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:28:45.974 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:28:45.974 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:28:45.974 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:28:45.975 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:28:45.975 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:28:45.975 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:28:45.975 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:28:45.975 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:28:45.976 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:28:45.976 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:28:45.976 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:28:45.976 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:28:45.977 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:28:45.977 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:28:45.977 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:28:45.977 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:28:46.222 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:28:46.223 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:28:46.223 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:46.223 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:28:46.223 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:28:46.224 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:46.224 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:28:46.224 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:28:46.224 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:28:46.224 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:28:46.225 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:28:46.225 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:28:46.225 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:28:46.225 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:28:46.225 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:28:46.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:46 gibba003 bash[31385]: audit 2021-03-10T16:28:45.736235+0000 mgr.gibba043.dnkmem (mgr.34373) 8327 : audit [DBG] from='client.59620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:46.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:46 gibba003 bash[32348]: audit 2021-03-10T16:28:45.736235+0000 mgr.gibba043.dnkmem (mgr.34373) 8327 : audit [DBG] from='client.59620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:46 gibba043 bash[24019]: audit 2021-03-10T16:28:45.736235+0000 mgr.gibba043.dnkmem (mgr.34373) 8327 : audit [DBG] from='client.59620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:47 gibba003 bash[31385]: audit 2021-03-10T16:28:45.962057+0000 mgr.gibba043.dnkmem (mgr.34373) 8328 : audit [DBG] from='client.49638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:47 gibba003 bash[31385]: cluster 2021-03-10T16:28:46.084235+0000 mgr.gibba043.dnkmem (mgr.34373) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:47 gibba003 bash[31385]: audit 2021-03-10T16:28:46.225761+0000 mon.a (mon.0) 1784 : audit [DBG] from='client.? 172.21.2.103:0/1054941471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:47 gibba003 bash[32348]: audit 2021-03-10T16:28:45.962057+0000 mgr.gibba043.dnkmem (mgr.34373) 8328 : audit [DBG] from='client.49638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:47 gibba003 bash[32348]: cluster 2021-03-10T16:28:46.084235+0000 mgr.gibba043.dnkmem (mgr.34373) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:47 gibba003 bash[32348]: audit 2021-03-10T16:28:46.225761+0000 mon.a (mon.0) 1784 : audit [DBG] from='client.? 172.21.2.103:0/1054941471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:47.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:47 gibba043 bash[24019]: audit 2021-03-10T16:28:45.962057+0000 mgr.gibba043.dnkmem (mgr.34373) 8328 : audit [DBG] from='client.49638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:47 gibba043 bash[24019]: cluster 2021-03-10T16:28:46.084235+0000 mgr.gibba043.dnkmem (mgr.34373) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:47 gibba043 bash[24019]: audit 2021-03-10T16:28:46.225761+0000 mon.a (mon.0) 1784 : audit [DBG] from='client.? 172.21.2.103:0/1054941471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:49 gibba003 bash[31385]: cluster 2021-03-10T16:28:48.085445+0000 mgr.gibba043.dnkmem (mgr.34373) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:49 gibba003 bash[32348]: cluster 2021-03-10T16:28:48.085445+0000 mgr.gibba043.dnkmem (mgr.34373) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:49 gibba043 bash[24019]: cluster 2021-03-10T16:28:48.085445+0000 mgr.gibba043.dnkmem (mgr.34373) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:51 gibba003 bash[31385]: cluster 2021-03-10T16:28:50.086187+0000 mgr.gibba043.dnkmem (mgr.34373) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:51 gibba003 bash[32348]: cluster 2021-03-10T16:28:50.086187+0000 mgr.gibba043.dnkmem (mgr.34373) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:51 gibba043 bash[24019]: cluster 2021-03-10T16:28:50.086187+0000 mgr.gibba043.dnkmem (mgr.34373) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:53 gibba003 bash[31385]: cluster 2021-03-10T16:28:52.087710+0000 mgr.gibba043.dnkmem (mgr.34373) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:53.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:53 gibba003 bash[32348]: cluster 2021-03-10T16:28:52.087710+0000 mgr.gibba043.dnkmem (mgr.34373) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:53 gibba043 bash[24019]: cluster 2021-03-10T16:28:52.087710+0000 mgr.gibba043.dnkmem (mgr.34373) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:55 gibba003 bash[31385]: cluster 2021-03-10T16:28:54.089370+0000 mgr.gibba043.dnkmem (mgr.34373) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:55 gibba003 bash[32348]: cluster 2021-03-10T16:28:54.089370+0000 mgr.gibba043.dnkmem (mgr.34373) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:55.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:55 gibba043 bash[24019]: cluster 2021-03-10T16:28:54.089370+0000 mgr.gibba043.dnkmem (mgr.34373) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:57 gibba003 bash[31385]: cluster 2021-03-10T16:28:56.091363+0000 mgr.gibba043.dnkmem (mgr.34373) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:57 gibba003 bash[32348]: cluster 2021-03-10T16:28:56.091363+0000 mgr.gibba043.dnkmem (mgr.34373) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:57.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:57 gibba043 bash[24019]: cluster 2021-03-10T16:28:56.091363+0000 mgr.gibba043.dnkmem (mgr.34373) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:58.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:58 gibba003 bash[31385]: cephadm 2021-03-10T16:28:57.367484+0000 mgr.gibba043.dnkmem (mgr.34373) 8335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:58.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:58 gibba003 bash[32348]: cephadm 2021-03-10T16:28:57.367484+0000 mgr.gibba043.dnkmem (mgr.34373) 8335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:58.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:58 gibba043 bash[24019]: cephadm 2021-03-10T16:28:57.367484+0000 mgr.gibba043.dnkmem (mgr.34373) 8335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:28:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:28:59 gibba003 bash[31385]: cluster 2021-03-10T16:28:58.092797+0000 mgr.gibba043.dnkmem (mgr.34373) 8336 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:59.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:28:59 gibba003 bash[32348]: cluster 2021-03-10T16:28:58.092797+0000 mgr.gibba043.dnkmem (mgr.34373) 8336 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:28:59 gibba043 bash[24019]: cluster 2021-03-10T16:28:58.092797+0000 mgr.gibba043.dnkmem (mgr.34373) 8336 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:01.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:01 gibba003 bash[31385]: cluster 2021-03-10T16:29:00.094200+0000 mgr.gibba043.dnkmem (mgr.34373) 8337 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:01.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:01 gibba003 bash[32348]: cluster 2021-03-10T16:29:00.094200+0000 mgr.gibba043.dnkmem (mgr.34373) 8337 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:01.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:01 gibba043 bash[24019]: cluster 2021-03-10T16:29:00.094200+0000 mgr.gibba043.dnkmem (mgr.34373) 8337 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:03 gibba003 bash[31385]: cluster 2021-03-10T16:29:02.095914+0000 mgr.gibba043.dnkmem (mgr.34373) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:03.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:03 gibba003 bash[32348]: cluster 2021-03-10T16:29:02.095914+0000 mgr.gibba043.dnkmem (mgr.34373) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:03 gibba043 bash[24019]: cluster 2021-03-10T16:29:02.095914+0000 mgr.gibba043.dnkmem (mgr.34373) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:05 gibba003 bash[31385]: cluster 2021-03-10T16:29:04.097596+0000 mgr.gibba043.dnkmem (mgr.34373) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:05 gibba003 bash[32348]: cluster 2021-03-10T16:29:04.097596+0000 mgr.gibba043.dnkmem (mgr.34373) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:05 gibba043 bash[24019]: cluster 2021-03-10T16:29:04.097596+0000 mgr.gibba043.dnkmem (mgr.34373) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:07 gibba003 bash[31385]: cluster 2021-03-10T16:29:06.099513+0000 mgr.gibba043.dnkmem (mgr.34373) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:07 gibba003 bash[32348]: cluster 2021-03-10T16:29:06.099513+0000 mgr.gibba043.dnkmem (mgr.34373) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:07 gibba043 bash[24019]: cluster 2021-03-10T16:29:06.099513+0000 mgr.gibba043.dnkmem (mgr.34373) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:09.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:09 gibba043 bash[24019]: cluster 2021-03-10T16:29:08.100957+0000 mgr.gibba043.dnkmem (mgr.34373) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:09 gibba003 bash[31385]: cluster 2021-03-10T16:29:08.100957+0000 mgr.gibba043.dnkmem (mgr.34373) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:09 gibba003 bash[32348]: cluster 2021-03-10T16:29:08.100957+0000 mgr.gibba043.dnkmem (mgr.34373) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:11.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:11 gibba043 bash[24019]: cluster 2021-03-10T16:29:10.102408+0000 mgr.gibba043.dnkmem (mgr.34373) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:11 gibba003 bash[31385]: cluster 2021-03-10T16:29:10.102408+0000 mgr.gibba043.dnkmem (mgr.34373) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:11 gibba003 bash[32348]: cluster 2021-03-10T16:29:10.102408+0000 mgr.gibba043.dnkmem (mgr.34373) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:13 gibba043 bash[24019]: cluster 2021-03-10T16:29:12.104102+0000 mgr.gibba043.dnkmem (mgr.34373) 8343 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:13 gibba043 bash[24019]: cephadm 2021-03-10T16:29:12.383578+0000 mgr.gibba043.dnkmem (mgr.34373) 8344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:13 gibba003 bash[31385]: cluster 2021-03-10T16:29:12.104102+0000 mgr.gibba043.dnkmem (mgr.34373) 8343 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:13 gibba003 bash[31385]: cephadm 2021-03-10T16:29:12.383578+0000 mgr.gibba043.dnkmem (mgr.34373) 8344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:13 gibba003 bash[32348]: cluster 2021-03-10T16:29:12.104102+0000 mgr.gibba043.dnkmem (mgr.34373) 8343 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:13 gibba003 bash[32348]: cephadm 2021-03-10T16:29:12.383578+0000 mgr.gibba043.dnkmem (mgr.34373) 8344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:13.739204+0000 mon.c (mon.1) 2149 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:13.740314+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:13.954791+0000 mon.c (mon.1) 2150 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:13.955974+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.139863+0000 mon.c (mon.1) 2151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.140603+0000 mon.c (mon.1) 2152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.141103+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.141290+0000 mon.c (mon.1) 2153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.141948+0000 mon.c (mon.1) 2154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:29:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.142615+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.144061+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:14 gibba043 bash[24019]: audit 2021-03-10T16:29:14.144993+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:29:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:13.739204+0000 mon.c (mon.1) 2149 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:13.740314+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:13.954791+0000 mon.c (mon.1) 2150 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:13.955974+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.139863+0000 mon.c (mon.1) 2151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.140603+0000 mon.c (mon.1) 2152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.141103+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.141290+0000 mon.c (mon.1) 2153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.141948+0000 mon.c (mon.1) 2154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:29:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.142615+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.144061+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[31385]: audit 2021-03-10T16:29:14.144993+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:29:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:13.739204+0000 mon.c (mon.1) 2149 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:13.740314+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:13.954791+0000 mon.c (mon.1) 2150 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:13.955974+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.139863+0000 mon.c (mon.1) 2151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.140603+0000 mon.c (mon.1) 2152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.141103+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.141290+0000 mon.c (mon.1) 2153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.141948+0000 mon.c (mon.1) 2154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:29:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.142615+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.144061+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:29:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:14 gibba003 bash[32348]: audit 2021-03-10T16:29:14.144993+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:29:15.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:15 gibba043 bash[24019]: cluster 2021-03-10T16:29:14.105622+0000 mgr.gibba043.dnkmem (mgr.34373) 8345 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:15 gibba003 bash[31385]: cluster 2021-03-10T16:29:14.105622+0000 mgr.gibba043.dnkmem (mgr.34373) 8345 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:15.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:15 gibba003 bash[32348]: cluster 2021-03-10T16:29:14.105622+0000 mgr.gibba043.dnkmem (mgr.34373) 8345 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:16.466 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:29:16.698 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:29:16.699 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 34s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:29:16.699 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:29:16.699 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:29:16.700 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:29:16.700 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:29:16.700 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:29:16.700 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:29:16.701 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:29:16.701 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 34s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:29:16.701 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:29:16.701 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:29:16.701 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:29:16.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:29:16.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:29:16.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:29:16.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:29:16.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:29:16.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:29:16.703 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:29:16.703 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 34s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:29:16.951 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:29:16.952 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:29:16.952 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:16.952 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:29:16.953 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:29:16.953 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:16.953 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:29:16.953 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:29:16.953 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:29:16.954 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:29:16.954 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:29:16.954 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:29:16.954 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:29:16.955 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:29:16.955 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:29:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:17 gibba043 bash[24019]: cluster 2021-03-10T16:29:16.107548+0000 mgr.gibba043.dnkmem (mgr.34373) 8346 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:17 gibba043 bash[24019]: audit 2021-03-10T16:29:16.459955+0000 mgr.gibba043.dnkmem (mgr.34373) 8347 : audit [DBG] from='client.59638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:17 gibba043 bash[24019]: audit 2021-03-10T16:29:16.691764+0000 mgr.gibba043.dnkmem (mgr.34373) 8348 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:17 gibba043 bash[24019]: audit 2021-03-10T16:29:16.954889+0000 mon.c (mon.1) 2155 : audit [DBG] from='client.? 172.21.2.103:0/3244015386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[31385]: cluster 2021-03-10T16:29:16.107548+0000 mgr.gibba043.dnkmem (mgr.34373) 8346 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[31385]: audit 2021-03-10T16:29:16.459955+0000 mgr.gibba043.dnkmem (mgr.34373) 8347 : audit [DBG] from='client.59638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:17.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[31385]: audit 2021-03-10T16:29:16.691764+0000 mgr.gibba043.dnkmem (mgr.34373) 8348 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[31385]: audit 2021-03-10T16:29:16.954889+0000 mon.c (mon.1) 2155 : audit [DBG] from='client.? 172.21.2.103:0/3244015386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:17.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[32348]: cluster 2021-03-10T16:29:16.107548+0000 mgr.gibba043.dnkmem (mgr.34373) 8346 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:17.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[32348]: audit 2021-03-10T16:29:16.459955+0000 mgr.gibba043.dnkmem (mgr.34373) 8347 : audit [DBG] from='client.59638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:17.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[32348]: audit 2021-03-10T16:29:16.691764+0000 mgr.gibba043.dnkmem (mgr.34373) 8348 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:17 gibba003 bash[32348]: audit 2021-03-10T16:29:16.954889+0000 mon.c (mon.1) 2155 : audit [DBG] from='client.? 172.21.2.103:0/3244015386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:19.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:19 gibba043 bash[24019]: cluster 2021-03-10T16:29:18.109067+0000 mgr.gibba043.dnkmem (mgr.34373) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:19 gibba003 bash[32348]: cluster 2021-03-10T16:29:18.109067+0000 mgr.gibba043.dnkmem (mgr.34373) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:19 gibba003 bash[31385]: cluster 2021-03-10T16:29:18.109067+0000 mgr.gibba043.dnkmem (mgr.34373) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:21.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:21 gibba043 bash[24019]: cluster 2021-03-10T16:29:20.110580+0000 mgr.gibba043.dnkmem (mgr.34373) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:21.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:21 gibba003 bash[31385]: cluster 2021-03-10T16:29:20.110580+0000 mgr.gibba043.dnkmem (mgr.34373) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:21 gibba003 bash[32348]: cluster 2021-03-10T16:29:20.110580+0000 mgr.gibba043.dnkmem (mgr.34373) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:23 gibba043 bash[24019]: cluster 2021-03-10T16:29:22.112238+0000 mgr.gibba043.dnkmem (mgr.34373) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:23 gibba003 bash[31385]: cluster 2021-03-10T16:29:22.112238+0000 mgr.gibba043.dnkmem (mgr.34373) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:23 gibba003 bash[32348]: cluster 2021-03-10T16:29:22.112238+0000 mgr.gibba043.dnkmem (mgr.34373) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:25 gibba043 bash[24019]: cluster 2021-03-10T16:29:24.113897+0000 mgr.gibba043.dnkmem (mgr.34373) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:25 gibba003 bash[31385]: cluster 2021-03-10T16:29:24.113897+0000 mgr.gibba043.dnkmem (mgr.34373) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:25 gibba003 bash[32348]: cluster 2021-03-10T16:29:24.113897+0000 mgr.gibba043.dnkmem (mgr.34373) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:27.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:27 gibba043 bash[24019]: cluster 2021-03-10T16:29:26.115776+0000 mgr.gibba043.dnkmem (mgr.34373) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:27.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:27 gibba003 bash[31385]: cluster 2021-03-10T16:29:26.115776+0000 mgr.gibba043.dnkmem (mgr.34373) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:27.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:27 gibba003 bash[32348]: cluster 2021-03-10T16:29:26.115776+0000 mgr.gibba043.dnkmem (mgr.34373) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:28.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:28 gibba003 bash[31385]: cephadm 2021-03-10T16:29:27.399544+0000 mgr.gibba043.dnkmem (mgr.34373) 8354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:28.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:28 gibba003 bash[32348]: cephadm 2021-03-10T16:29:27.399544+0000 mgr.gibba043.dnkmem (mgr.34373) 8354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:29.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:28 gibba043 bash[24019]: cephadm 2021-03-10T16:29:27.399544+0000 mgr.gibba043.dnkmem (mgr.34373) 8354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:29.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:29 gibba003 bash[31385]: cluster 2021-03-10T16:29:28.117229+0000 mgr.gibba043.dnkmem (mgr.34373) 8355 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:29 gibba003 bash[32348]: cluster 2021-03-10T16:29:28.117229+0000 mgr.gibba043.dnkmem (mgr.34373) 8355 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:29 gibba043 bash[24019]: cluster 2021-03-10T16:29:28.117229+0000 mgr.gibba043.dnkmem (mgr.34373) 8355 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:31 gibba003 bash[31385]: cluster 2021-03-10T16:29:30.118856+0000 mgr.gibba043.dnkmem (mgr.34373) 8356 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:31.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:31 gibba003 bash[32348]: cluster 2021-03-10T16:29:30.118856+0000 mgr.gibba043.dnkmem (mgr.34373) 8356 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:32.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:31 gibba043 bash[24019]: cluster 2021-03-10T16:29:30.118856+0000 mgr.gibba043.dnkmem (mgr.34373) 8356 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:33 gibba003 bash[31385]: cluster 2021-03-10T16:29:32.120434+0000 mgr.gibba043.dnkmem (mgr.34373) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:33 gibba003 bash[32348]: cluster 2021-03-10T16:29:32.120434+0000 mgr.gibba043.dnkmem (mgr.34373) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:33 gibba043 bash[24019]: cluster 2021-03-10T16:29:32.120434+0000 mgr.gibba043.dnkmem (mgr.34373) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:35.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:35 gibba003 bash[31385]: cluster 2021-03-10T16:29:34.122086+0000 mgr.gibba043.dnkmem (mgr.34373) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:35.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:35 gibba003 bash[32348]: cluster 2021-03-10T16:29:34.122086+0000 mgr.gibba043.dnkmem (mgr.34373) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:36.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:35 gibba043 bash[24019]: cluster 2021-03-10T16:29:34.122086+0000 mgr.gibba043.dnkmem (mgr.34373) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:37.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:37 gibba003 bash[31385]: cluster 2021-03-10T16:29:36.123950+0000 mgr.gibba043.dnkmem (mgr.34373) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:37.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:37 gibba003 bash[32348]: cluster 2021-03-10T16:29:36.123950+0000 mgr.gibba043.dnkmem (mgr.34373) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:37 gibba043 bash[24019]: cluster 2021-03-10T16:29:36.123950+0000 mgr.gibba043.dnkmem (mgr.34373) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:39.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:39 gibba003 bash[31385]: cluster 2021-03-10T16:29:38.125124+0000 mgr.gibba043.dnkmem (mgr.34373) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:39.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:39 gibba003 bash[32348]: cluster 2021-03-10T16:29:38.125124+0000 mgr.gibba043.dnkmem (mgr.34373) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:39 gibba043 bash[24019]: cluster 2021-03-10T16:29:38.125124+0000 mgr.gibba043.dnkmem (mgr.34373) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:41.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:41 gibba003 bash[31385]: cluster 2021-03-10T16:29:40.126834+0000 mgr.gibba043.dnkmem (mgr.34373) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:41.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:41 gibba003 bash[32348]: cluster 2021-03-10T16:29:40.126834+0000 mgr.gibba043.dnkmem (mgr.34373) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:41 gibba043 bash[24019]: cluster 2021-03-10T16:29:40.126834+0000 mgr.gibba043.dnkmem (mgr.34373) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:42.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:42 gibba003 bash[31385]: audit 2021-03-10T16:29:42.420000+0000 mon.c (mon.1) 2156 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:29:42.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:42 gibba003 bash[32348]: audit 2021-03-10T16:29:42.420000+0000 mon.c (mon.1) 2156 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:29:43.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:42 gibba043 bash[24019]: audit 2021-03-10T16:29:42.420000+0000 mon.c (mon.1) 2156 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:29:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:43 gibba003 bash[31385]: cluster 2021-03-10T16:29:42.128267+0000 mgr.gibba043.dnkmem (mgr.34373) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:43 gibba003 bash[31385]: cephadm 2021-03-10T16:29:42.416470+0000 mgr.gibba043.dnkmem (mgr.34373) 8363 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:29:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:43 gibba003 bash[32348]: cluster 2021-03-10T16:29:42.128267+0000 mgr.gibba043.dnkmem (mgr.34373) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:43 gibba003 bash[32348]: cephadm 2021-03-10T16:29:42.416470+0000 mgr.gibba043.dnkmem (mgr.34373) 8363 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:29:44.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:43 gibba043 bash[24019]: cluster 2021-03-10T16:29:42.128267+0000 mgr.gibba043.dnkmem (mgr.34373) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:43 gibba043 bash[24019]: cephadm 2021-03-10T16:29:42.416470+0000 mgr.gibba043.dnkmem (mgr.34373) 8363 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:29:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:45 gibba003 bash[31385]: cluster 2021-03-10T16:29:44.129623+0000 mgr.gibba043.dnkmem (mgr.34373) 8364 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:45 gibba003 bash[32348]: cluster 2021-03-10T16:29:44.129623+0000 mgr.gibba043.dnkmem (mgr.34373) 8364 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:45 gibba043 bash[24019]: cluster 2021-03-10T16:29:44.129623+0000 mgr.gibba043.dnkmem (mgr.34373) 8364 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.198 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:29:47.426 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:29:47.427 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 65s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:29:47.427 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 1s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:29:47.427 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:29:47.427 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:29:47.428 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:29:47.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:29:47.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:29:47.428 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:29:47.428 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 65s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:29:47.429 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 1s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:29:47.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:29:47.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:29:47.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:29:47.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 65s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:29:47.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:29:47.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:29:47.430 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:29:47.431 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 1s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:29:47.431 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 1s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:29:47.431 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 65s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:29:47.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.102689+0000 mgr.gibba043.dnkmem (mgr.34373) 8365 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:29:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.103084+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:29:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cluster 2021-03-10T16:29:46.130168+0000 mgr.gibba043.dnkmem (mgr.34373) 8366 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.298204+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:29:47.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.299714+0000 mgr.gibba043.dnkmem (mgr.34373) 8367 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.302463+0000 mon.c (mon.1) 2157 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.302585+0000 mgr.gibba043.dnkmem (mgr.34373) 8368 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.304530+0000 mgr.gibba043.dnkmem (mgr.34373) 8369 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:47.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.304567+0000 mgr.gibba043.dnkmem (mgr.34373) 8370 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.304831+0000 mon.c (mon.1) 2158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.305990+0000 mgr.gibba043.dnkmem (mgr.34373) 8371 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.306026+0000 mgr.gibba043.dnkmem (mgr.34373) 8372 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.306626+0000 mon.c (mon.1) 2159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.307585+0000 mgr.gibba043.dnkmem (mgr.34373) 8373 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.308131+0000 mon.c (mon.1) 2160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.309910+0000 mgr.gibba043.dnkmem (mgr.34373) 8374 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.309945+0000 mgr.gibba043.dnkmem (mgr.34373) 8375 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.311621+0000 mgr.gibba043.dnkmem (mgr.34373) 8376 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.312085+0000 mgr.gibba043.dnkmem (mgr.34373) 8377 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.312180+0000 mon.c (mon.1) 2161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.313826+0000 mgr.gibba043.dnkmem (mgr.34373) 8378 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.313864+0000 mgr.gibba043.dnkmem (mgr.34373) 8379 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: cephadm 2021-03-10T16:29:46.313972+0000 mgr.gibba043.dnkmem (mgr.34373) 8380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:47.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[31385]: audit 2021-03-10T16:29:46.314191+0000 mon.c (mon.1) 2162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.102689+0000 mgr.gibba043.dnkmem (mgr.34373) 8365 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:29:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.103084+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:29:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cluster 2021-03-10T16:29:46.130168+0000 mgr.gibba043.dnkmem (mgr.34373) 8366 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.298204+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:29:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.299714+0000 mgr.gibba043.dnkmem (mgr.34373) 8367 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.302463+0000 mon.c (mon.1) 2157 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:47.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.302585+0000 mgr.gibba043.dnkmem (mgr.34373) 8368 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:47.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.304530+0000 mgr.gibba043.dnkmem (mgr.34373) 8369 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:47.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.304567+0000 mgr.gibba043.dnkmem (mgr.34373) 8370 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:47.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.304831+0000 mon.c (mon.1) 2158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.305990+0000 mgr.gibba043.dnkmem (mgr.34373) 8371 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:47.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.306026+0000 mgr.gibba043.dnkmem (mgr.34373) 8372 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:47.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.306626+0000 mon.c (mon.1) 2159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.307585+0000 mgr.gibba043.dnkmem (mgr.34373) 8373 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:47.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.308131+0000 mon.c (mon.1) 2160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.309910+0000 mgr.gibba043.dnkmem (mgr.34373) 8374 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:47.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.309945+0000 mgr.gibba043.dnkmem (mgr.34373) 8375 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:47.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.311621+0000 mgr.gibba043.dnkmem (mgr.34373) 8376 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:47.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.312085+0000 mgr.gibba043.dnkmem (mgr.34373) 8377 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:47.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.312180+0000 mon.c (mon.1) 2161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.313826+0000 mgr.gibba043.dnkmem (mgr.34373) 8378 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:47.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.313864+0000 mgr.gibba043.dnkmem (mgr.34373) 8379 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:47.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: cephadm 2021-03-10T16:29:46.313972+0000 mgr.gibba043.dnkmem (mgr.34373) 8380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:47.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:47 gibba003 bash[32348]: audit 2021-03-10T16:29:46.314191+0000 mon.c (mon.1) 2162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.102689+0000 mgr.gibba043.dnkmem (mgr.34373) 8365 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:29:47.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.103084+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:29:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cluster 2021-03-10T16:29:46.130168+0000 mgr.gibba043.dnkmem (mgr.34373) 8366 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.298204+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:29:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.299714+0000 mgr.gibba043.dnkmem (mgr.34373) 8367 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.302463+0000 mon.c (mon.1) 2157 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:47.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.302585+0000 mgr.gibba043.dnkmem (mgr.34373) 8368 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:47.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.304530+0000 mgr.gibba043.dnkmem (mgr.34373) 8369 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:47.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.304567+0000 mgr.gibba043.dnkmem (mgr.34373) 8370 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:47.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.304831+0000 mon.c (mon.1) 2158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.305990+0000 mgr.gibba043.dnkmem (mgr.34373) 8371 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.306026+0000 mgr.gibba043.dnkmem (mgr.34373) 8372 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.306626+0000 mon.c (mon.1) 2159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.307585+0000 mgr.gibba043.dnkmem (mgr.34373) 8373 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.308131+0000 mon.c (mon.1) 2160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.309910+0000 mgr.gibba043.dnkmem (mgr.34373) 8374 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.309945+0000 mgr.gibba043.dnkmem (mgr.34373) 8375 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.311621+0000 mgr.gibba043.dnkmem (mgr.34373) 8376 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.312085+0000 mgr.gibba043.dnkmem (mgr.34373) 8377 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.312180+0000 mon.c (mon.1) 2161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.313826+0000 mgr.gibba043.dnkmem (mgr.34373) 8378 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.313864+0000 mgr.gibba043.dnkmem (mgr.34373) 8379 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:47.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: cephadm 2021-03-10T16:29:46.313972+0000 mgr.gibba043.dnkmem (mgr.34373) 8380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:29:47.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:47 gibba043 bash[24019]: audit 2021-03-10T16:29:46.314191+0000 mon.c (mon.1) 2162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:47.676 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:29:47.676 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:29:47.676 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:47.676 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:29:47.677 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:29:47.677 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:47.677 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:29:47.677 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:29:47.678 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:29:47.678 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:29:47.678 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:29:47.678 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:29:47.678 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:29:47.679 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:29:47.679 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:29:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:48 gibba003 bash[31385]: audit 2021-03-10T16:29:47.191145+0000 mgr.gibba043.dnkmem (mgr.34373) 8381 : audit [DBG] from='client.59656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:48 gibba003 bash[31385]: audit 2021-03-10T16:29:47.415854+0000 mgr.gibba043.dnkmem (mgr.34373) 8382 : audit [DBG] from='client.49674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:48 gibba003 bash[31385]: audit 2021-03-10T16:29:47.679014+0000 mon.a (mon.0) 1793 : audit [DBG] from='client.? 172.21.2.103:0/1583497953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:48 gibba003 bash[32348]: audit 2021-03-10T16:29:47.191145+0000 mgr.gibba043.dnkmem (mgr.34373) 8381 : audit [DBG] from='client.59656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:48 gibba003 bash[32348]: audit 2021-03-10T16:29:47.415854+0000 mgr.gibba043.dnkmem (mgr.34373) 8382 : audit [DBG] from='client.49674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:48.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:48 gibba003 bash[32348]: audit 2021-03-10T16:29:47.679014+0000 mon.a (mon.0) 1793 : audit [DBG] from='client.? 172.21.2.103:0/1583497953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:48 gibba043 bash[24019]: audit 2021-03-10T16:29:47.191145+0000 mgr.gibba043.dnkmem (mgr.34373) 8381 : audit [DBG] from='client.59656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:48 gibba043 bash[24019]: audit 2021-03-10T16:29:47.415854+0000 mgr.gibba043.dnkmem (mgr.34373) 8382 : audit [DBG] from='client.49674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:48 gibba043 bash[24019]: audit 2021-03-10T16:29:47.679014+0000 mon.a (mon.0) 1793 : audit [DBG] from='client.? 172.21.2.103:0/1583497953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:49 gibba003 bash[31385]: cluster 2021-03-10T16:29:48.130796+0000 mgr.gibba043.dnkmem (mgr.34373) 8383 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:49.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:49 gibba003 bash[32348]: cluster 2021-03-10T16:29:48.130796+0000 mgr.gibba043.dnkmem (mgr.34373) 8383 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:49 gibba043 bash[24019]: cluster 2021-03-10T16:29:48.130796+0000 mgr.gibba043.dnkmem (mgr.34373) 8383 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:51 gibba043 bash[24019]: cluster 2021-03-10T16:29:50.131595+0000 mgr.gibba043.dnkmem (mgr.34373) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:51 gibba003 bash[31385]: cluster 2021-03-10T16:29:50.131595+0000 mgr.gibba043.dnkmem (mgr.34373) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:51 gibba003 bash[32348]: cluster 2021-03-10T16:29:50.131595+0000 mgr.gibba043.dnkmem (mgr.34373) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:53 gibba003 bash[31385]: cluster 2021-03-10T16:29:52.133128+0000 mgr.gibba043.dnkmem (mgr.34373) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:53.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:53 gibba003 bash[32348]: cluster 2021-03-10T16:29:52.133128+0000 mgr.gibba043.dnkmem (mgr.34373) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:53 gibba043 bash[24019]: cluster 2021-03-10T16:29:52.133128+0000 mgr.gibba043.dnkmem (mgr.34373) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:55.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:55 gibba003 bash[31385]: cluster 2021-03-10T16:29:54.134630+0000 mgr.gibba043.dnkmem (mgr.34373) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:55.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:55 gibba003 bash[32348]: cluster 2021-03-10T16:29:54.134630+0000 mgr.gibba043.dnkmem (mgr.34373) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:55 gibba043 bash[24019]: cluster 2021-03-10T16:29:54.134630+0000 mgr.gibba043.dnkmem (mgr.34373) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:57 gibba003 bash[31385]: cluster 2021-03-10T16:29:56.136320+0000 mgr.gibba043.dnkmem (mgr.34373) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:57.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:57 gibba003 bash[32348]: cluster 2021-03-10T16:29:56.136320+0000 mgr.gibba043.dnkmem (mgr.34373) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:57 gibba043 bash[24019]: cluster 2021-03-10T16:29:56.136320+0000 mgr.gibba043.dnkmem (mgr.34373) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:29:59 gibba003 bash[31385]: cluster 2021-03-10T16:29:58.137835+0000 mgr.gibba043.dnkmem (mgr.34373) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:59.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:29:59 gibba003 bash[32348]: cluster 2021-03-10T16:29:58.137835+0000 mgr.gibba043.dnkmem (mgr.34373) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:29:59 gibba043 bash[24019]: cluster 2021-03-10T16:29:58.137835+0000 mgr.gibba043.dnkmem (mgr.34373) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:00.432 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:00 gibba003 bash[31385]: debug 2021-03-10T16:29:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:00 gibba003 bash[31385]: cluster 2021-03-10T16:30:00.000480+0000 mon.a (mon.0) 1794 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:00 gibba003 bash[32348]: cluster 2021-03-10T16:30:00.000480+0000 mon.a (mon.0) 1794 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:00 gibba043 bash[24019]: cluster 2021-03-10T16:30:00.000480+0000 mon.a (mon.0) 1794 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:01.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:01 gibba003 bash[31385]: cluster 2021-03-10T16:30:00.139317+0000 mgr.gibba043.dnkmem (mgr.34373) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:01.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:01 gibba003 bash[32348]: cluster 2021-03-10T16:30:00.139317+0000 mgr.gibba043.dnkmem (mgr.34373) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:01.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:01 gibba043 bash[24019]: cluster 2021-03-10T16:30:00.139317+0000 mgr.gibba043.dnkmem (mgr.34373) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:02.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:02 gibba043 bash[24019]: cephadm 2021-03-10T16:30:01.328491+0000 mgr.gibba043.dnkmem (mgr.34373) 8390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:02.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:02 gibba003 bash[31385]: cephadm 2021-03-10T16:30:01.328491+0000 mgr.gibba043.dnkmem (mgr.34373) 8390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:02.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:02 gibba003 bash[32348]: cephadm 2021-03-10T16:30:01.328491+0000 mgr.gibba043.dnkmem (mgr.34373) 8390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:03 gibba043 bash[24019]: cluster 2021-03-10T16:30:02.141000+0000 mgr.gibba043.dnkmem (mgr.34373) 8391 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:03 gibba003 bash[31385]: cluster 2021-03-10T16:30:02.141000+0000 mgr.gibba043.dnkmem (mgr.34373) 8391 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:03 gibba003 bash[32348]: cluster 2021-03-10T16:30:02.141000+0000 mgr.gibba043.dnkmem (mgr.34373) 8391 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:05 gibba043 bash[24019]: cluster 2021-03-10T16:30:04.142327+0000 mgr.gibba043.dnkmem (mgr.34373) 8392 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:05 gibba003 bash[31385]: cluster 2021-03-10T16:30:04.142327+0000 mgr.gibba043.dnkmem (mgr.34373) 8392 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:05 gibba003 bash[32348]: cluster 2021-03-10T16:30:04.142327+0000 mgr.gibba043.dnkmem (mgr.34373) 8392 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:07 gibba043 bash[24019]: cluster 2021-03-10T16:30:06.144308+0000 mgr.gibba043.dnkmem (mgr.34373) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:07 gibba003 bash[31385]: cluster 2021-03-10T16:30:06.144308+0000 mgr.gibba043.dnkmem (mgr.34373) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:07 gibba003 bash[32348]: cluster 2021-03-10T16:30:06.144308+0000 mgr.gibba043.dnkmem (mgr.34373) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:09 gibba043 bash[24019]: cluster 2021-03-10T16:30:08.145738+0000 mgr.gibba043.dnkmem (mgr.34373) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:09 gibba003 bash[31385]: cluster 2021-03-10T16:30:08.145738+0000 mgr.gibba043.dnkmem (mgr.34373) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:09 gibba003 bash[32348]: cluster 2021-03-10T16:30:08.145738+0000 mgr.gibba043.dnkmem (mgr.34373) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:11 gibba043 bash[24019]: cluster 2021-03-10T16:30:10.147401+0000 mgr.gibba043.dnkmem (mgr.34373) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:11 gibba003 bash[31385]: cluster 2021-03-10T16:30:10.147401+0000 mgr.gibba043.dnkmem (mgr.34373) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:11 gibba003 bash[32348]: cluster 2021-03-10T16:30:10.147401+0000 mgr.gibba043.dnkmem (mgr.34373) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:13 gibba043 bash[24019]: cluster 2021-03-10T16:30:12.148941+0000 mgr.gibba043.dnkmem (mgr.34373) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:13 gibba003 bash[31385]: cluster 2021-03-10T16:30:12.148941+0000 mgr.gibba043.dnkmem (mgr.34373) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:13 gibba003 bash[32348]: cluster 2021-03-10T16:30:12.148941+0000 mgr.gibba043.dnkmem (mgr.34373) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:13.745795+0000 mon.c (mon.1) 2163 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:13.746913+0000 mon.a (mon.0) 1795 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:13.962466+0000 mon.c (mon.1) 2164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:13.963585+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.150384+0000 mon.c (mon.1) 2165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.151295+0000 mon.c (mon.1) 2166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.151637+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.152323+0000 mon.c (mon.1) 2167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.152824+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.153474+0000 mon.c (mon.1) 2168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.153616+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:14 gibba043 bash[24019]: audit 2021-03-10T16:30:14.154541+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:13.745795+0000 mon.c (mon.1) 2163 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:13.746913+0000 mon.a (mon.0) 1795 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:13.962466+0000 mon.c (mon.1) 2164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:13.963585+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.150384+0000 mon.c (mon.1) 2165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.151295+0000 mon.c (mon.1) 2166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.151637+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.152323+0000 mon.c (mon.1) 2167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.152824+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.153474+0000 mon.c (mon.1) 2168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.153616+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[31385]: audit 2021-03-10T16:30:14.154541+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:13.745795+0000 mon.c (mon.1) 2163 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:13.746913+0000 mon.a (mon.0) 1795 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:13.962466+0000 mon.c (mon.1) 2164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:13.963585+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.150384+0000 mon.c (mon.1) 2165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.151295+0000 mon.c (mon.1) 2166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.151637+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.152323+0000 mon.c (mon.1) 2167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.152824+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.153474+0000 mon.c (mon.1) 2168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.153616+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:14 gibba003 bash[32348]: audit 2021-03-10T16:30:14.154541+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:30:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:15 gibba043 bash[24019]: cluster 2021-03-10T16:30:14.149428+0000 mgr.gibba043.dnkmem (mgr.34373) 8397 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:15.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:15 gibba003 bash[31385]: cluster 2021-03-10T16:30:14.149428+0000 mgr.gibba043.dnkmem (mgr.34373) 8397 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:15.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:15 gibba003 bash[32348]: cluster 2021-03-10T16:30:14.149428+0000 mgr.gibba043.dnkmem (mgr.34373) 8397 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.922 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:30:17.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:17 gibba003 bash[31385]: cluster 2021-03-10T16:30:16.151234+0000 mgr.gibba043.dnkmem (mgr.34373) 8398 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:17 gibba003 bash[31385]: cephadm 2021-03-10T16:30:16.344598+0000 mgr.gibba043.dnkmem (mgr.34373) 8399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:17 gibba003 bash[32348]: cluster 2021-03-10T16:30:16.151234+0000 mgr.gibba043.dnkmem (mgr.34373) 8398 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:17 gibba003 bash[32348]: cephadm 2021-03-10T16:30:16.344598+0000 mgr.gibba043.dnkmem (mgr.34373) 8399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:17 gibba043 bash[24019]: cluster 2021-03-10T16:30:16.151234+0000 mgr.gibba043.dnkmem (mgr.34373) 8398 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:17 gibba043 bash[24019]: cephadm 2021-03-10T16:30:16.344598+0000 mgr.gibba043.dnkmem (mgr.34373) 8399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:18.149 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:30:18.149 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 96s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:30:18.150 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 32s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:30:18.150 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:30:18.150 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:30:18.150 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:30:18.151 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:30:18.151 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:30:18.151 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:30:18.151 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 96s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:30:18.152 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 32s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:30:18.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:30:18.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:30:18.152 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:30:18.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 96s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:30:18.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:30:18.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:30:18.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:30:18.153 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 32s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:30:18.154 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 32s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:30:18.154 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 96s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:30:18.397 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:30:18.398 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:30:18.398 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:18.398 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:30:18.398 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:30:18.399 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:18.399 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:30:18.399 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:30:18.400 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:30:18.400 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:30:18.400 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:30:18.400 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:30:18.401 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:30:18.401 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:30:18.401 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:30:18.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:18 gibba003 bash[31385]: audit 2021-03-10T16:30:18.400523+0000 mon.c (mon.1) 2169 : audit [DBG] from='client.? 172.21.2.103:0/2906502430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:18.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:18 gibba003 bash[32348]: audit 2021-03-10T16:30:18.400523+0000 mon.c (mon.1) 2169 : audit [DBG] from='client.? 172.21.2.103:0/2906502430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:19.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:18 gibba043 bash[24019]: audit 2021-03-10T16:30:18.400523+0000 mon.c (mon.1) 2169 : audit [DBG] from='client.? 172.21.2.103:0/2906502430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:19 gibba003 bash[31385]: audit 2021-03-10T16:30:17.914888+0000 mgr.gibba043.dnkmem (mgr.34373) 8400 : audit [DBG] from='client.59674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:19 gibba003 bash[31385]: audit 2021-03-10T16:30:18.139874+0000 mgr.gibba043.dnkmem (mgr.34373) 8401 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:19 gibba003 bash[31385]: cluster 2021-03-10T16:30:18.151848+0000 mgr.gibba043.dnkmem (mgr.34373) 8402 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:19 gibba003 bash[32348]: audit 2021-03-10T16:30:17.914888+0000 mgr.gibba043.dnkmem (mgr.34373) 8400 : audit [DBG] from='client.59674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:19 gibba003 bash[32348]: audit 2021-03-10T16:30:18.139874+0000 mgr.gibba043.dnkmem (mgr.34373) 8401 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:19 gibba003 bash[32348]: cluster 2021-03-10T16:30:18.151848+0000 mgr.gibba043.dnkmem (mgr.34373) 8402 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:19 gibba043 bash[24019]: audit 2021-03-10T16:30:17.914888+0000 mgr.gibba043.dnkmem (mgr.34373) 8400 : audit [DBG] from='client.59674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:19 gibba043 bash[24019]: audit 2021-03-10T16:30:18.139874+0000 mgr.gibba043.dnkmem (mgr.34373) 8401 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:19 gibba043 bash[24019]: cluster 2021-03-10T16:30:18.151848+0000 mgr.gibba043.dnkmem (mgr.34373) 8402 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:21 gibba003 bash[31385]: cluster 2021-03-10T16:30:20.153372+0000 mgr.gibba043.dnkmem (mgr.34373) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:21 gibba003 bash[32348]: cluster 2021-03-10T16:30:20.153372+0000 mgr.gibba043.dnkmem (mgr.34373) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:21 gibba043 bash[24019]: cluster 2021-03-10T16:30:20.153372+0000 mgr.gibba043.dnkmem (mgr.34373) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:23 gibba003 bash[31385]: cluster 2021-03-10T16:30:22.154690+0000 mgr.gibba043.dnkmem (mgr.34373) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:23 gibba003 bash[32348]: cluster 2021-03-10T16:30:22.154690+0000 mgr.gibba043.dnkmem (mgr.34373) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:23 gibba043 bash[24019]: cluster 2021-03-10T16:30:22.154690+0000 mgr.gibba043.dnkmem (mgr.34373) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:25.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:25 gibba003 bash[31385]: cluster 2021-03-10T16:30:24.156391+0000 mgr.gibba043.dnkmem (mgr.34373) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:25.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:25 gibba003 bash[32348]: cluster 2021-03-10T16:30:24.156391+0000 mgr.gibba043.dnkmem (mgr.34373) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:26.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:25 gibba043 bash[24019]: cluster 2021-03-10T16:30:24.156391+0000 mgr.gibba043.dnkmem (mgr.34373) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:27.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:27 gibba003 bash[31385]: cluster 2021-03-10T16:30:26.158141+0000 mgr.gibba043.dnkmem (mgr.34373) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:27.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:27 gibba003 bash[32348]: cluster 2021-03-10T16:30:26.158141+0000 mgr.gibba043.dnkmem (mgr.34373) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:27 gibba043 bash[24019]: cluster 2021-03-10T16:30:26.158141+0000 mgr.gibba043.dnkmem (mgr.34373) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:29.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:29 gibba003 bash[31385]: cluster 2021-03-10T16:30:28.159354+0000 mgr.gibba043.dnkmem (mgr.34373) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:29 gibba003 bash[32348]: cluster 2021-03-10T16:30:28.159354+0000 mgr.gibba043.dnkmem (mgr.34373) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:29 gibba043 bash[24019]: cluster 2021-03-10T16:30:28.159354+0000 mgr.gibba043.dnkmem (mgr.34373) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:31.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:31 gibba043 bash[24019]: cluster 2021-03-10T16:30:30.160986+0000 mgr.gibba043.dnkmem (mgr.34373) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:31.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:31 gibba003 bash[31385]: cluster 2021-03-10T16:30:30.160986+0000 mgr.gibba043.dnkmem (mgr.34373) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:31.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:31 gibba003 bash[32348]: cluster 2021-03-10T16:30:30.160986+0000 mgr.gibba043.dnkmem (mgr.34373) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:32.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:32 gibba003 bash[31385]: cephadm 2021-03-10T16:30:31.360695+0000 mgr.gibba043.dnkmem (mgr.34373) 8409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:32.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:32 gibba003 bash[32348]: cephadm 2021-03-10T16:30:31.360695+0000 mgr.gibba043.dnkmem (mgr.34373) 8409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:33.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:32 gibba043 bash[24019]: cephadm 2021-03-10T16:30:31.360695+0000 mgr.gibba043.dnkmem (mgr.34373) 8409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:33 gibba003 bash[31385]: cluster 2021-03-10T16:30:32.162468+0000 mgr.gibba043.dnkmem (mgr.34373) 8410 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:33 gibba003 bash[32348]: cluster 2021-03-10T16:30:32.162468+0000 mgr.gibba043.dnkmem (mgr.34373) 8410 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:33 gibba043 bash[24019]: cluster 2021-03-10T16:30:32.162468+0000 mgr.gibba043.dnkmem (mgr.34373) 8410 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:35.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:35 gibba003 bash[31385]: cluster 2021-03-10T16:30:34.164109+0000 mgr.gibba043.dnkmem (mgr.34373) 8411 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:35.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:35 gibba003 bash[32348]: cluster 2021-03-10T16:30:34.164109+0000 mgr.gibba043.dnkmem (mgr.34373) 8411 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:36.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:35 gibba043 bash[24019]: cluster 2021-03-10T16:30:34.164109+0000 mgr.gibba043.dnkmem (mgr.34373) 8411 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:37.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:37 gibba003 bash[31385]: cluster 2021-03-10T16:30:36.165947+0000 mgr.gibba043.dnkmem (mgr.34373) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:37.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:37 gibba003 bash[32348]: cluster 2021-03-10T16:30:36.165947+0000 mgr.gibba043.dnkmem (mgr.34373) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:37 gibba043 bash[24019]: cluster 2021-03-10T16:30:36.165947+0000 mgr.gibba043.dnkmem (mgr.34373) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:39.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:39 gibba003 bash[31385]: cluster 2021-03-10T16:30:38.167356+0000 mgr.gibba043.dnkmem (mgr.34373) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:39.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:39 gibba003 bash[32348]: cluster 2021-03-10T16:30:38.167356+0000 mgr.gibba043.dnkmem (mgr.34373) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:39 gibba043 bash[24019]: cluster 2021-03-10T16:30:38.167356+0000 mgr.gibba043.dnkmem (mgr.34373) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:41.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:41 gibba003 bash[31385]: cluster 2021-03-10T16:30:40.168902+0000 mgr.gibba043.dnkmem (mgr.34373) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:41.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:41 gibba003 bash[32348]: cluster 2021-03-10T16:30:40.168902+0000 mgr.gibba043.dnkmem (mgr.34373) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:41 gibba043 bash[24019]: cluster 2021-03-10T16:30:40.168902+0000 mgr.gibba043.dnkmem (mgr.34373) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:43.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:43 gibba003 bash[31385]: cluster 2021-03-10T16:30:42.170574+0000 mgr.gibba043.dnkmem (mgr.34373) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:43.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:43 gibba003 bash[32348]: cluster 2021-03-10T16:30:42.170574+0000 mgr.gibba043.dnkmem (mgr.34373) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:44.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:43 gibba043 bash[24019]: cluster 2021-03-10T16:30:42.170574+0000 mgr.gibba043.dnkmem (mgr.34373) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:45.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:45 gibba003 bash[31385]: cluster 2021-03-10T16:30:44.172286+0000 mgr.gibba043.dnkmem (mgr.34373) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:45.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:45 gibba003 bash[32348]: cluster 2021-03-10T16:30:44.172286+0000 mgr.gibba043.dnkmem (mgr.34373) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:45 gibba043 bash[24019]: cluster 2021-03-10T16:30:44.172286+0000 mgr.gibba043.dnkmem (mgr.34373) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cluster 2021-03-10T16:30:46.174041+0000 mgr.gibba043.dnkmem (mgr.34373) 8417 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.377473+0000 mgr.gibba043.dnkmem (mgr.34373) 8418 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:30:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.379036+0000 mgr.gibba043.dnkmem (mgr.34373) 8419 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:30:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.580348+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:30:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.581889+0000 mgr.gibba043.dnkmem (mgr.34373) 8420 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.583368+0000 mgr.gibba043.dnkmem (mgr.34373) 8421 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.584036+0000 mon.c (mon.1) 2170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.584930+0000 mgr.gibba043.dnkmem (mgr.34373) 8422 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.584976+0000 mgr.gibba043.dnkmem (mgr.34373) 8423 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.585270+0000 mon.c (mon.1) 2171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.586197+0000 mgr.gibba043.dnkmem (mgr.34373) 8424 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.586241+0000 mgr.gibba043.dnkmem (mgr.34373) 8425 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:47.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.586954+0000 mon.c (mon.1) 2172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.587336+0000 mgr.gibba043.dnkmem (mgr.34373) 8426 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.588174+0000 mon.c (mon.1) 2173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.588948+0000 mgr.gibba043.dnkmem (mgr.34373) 8427 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.588993+0000 mgr.gibba043.dnkmem (mgr.34373) 8428 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.590262+0000 mgr.gibba043.dnkmem (mgr.34373) 8429 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.590594+0000 mgr.gibba043.dnkmem (mgr.34373) 8430 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.591113+0000 mon.c (mon.1) 2174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.591510+0000 mgr.gibba043.dnkmem (mgr.34373) 8431 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cluster 2021-03-10T16:30:46.174041+0000 mgr.gibba043.dnkmem (mgr.34373) 8417 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.377473+0000 mgr.gibba043.dnkmem (mgr.34373) 8418 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:30:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.379036+0000 mgr.gibba043.dnkmem (mgr.34373) 8419 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:30:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.580348+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:30:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.581889+0000 mgr.gibba043.dnkmem (mgr.34373) 8420 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.583368+0000 mgr.gibba043.dnkmem (mgr.34373) 8421 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:47.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.584036+0000 mon.c (mon.1) 2170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.584930+0000 mgr.gibba043.dnkmem (mgr.34373) 8422 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.584976+0000 mgr.gibba043.dnkmem (mgr.34373) 8423 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.585270+0000 mon.c (mon.1) 2171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.586197+0000 mgr.gibba043.dnkmem (mgr.34373) 8424 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:47.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.586241+0000 mgr.gibba043.dnkmem (mgr.34373) 8425 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.586954+0000 mon.c (mon.1) 2172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.587336+0000 mgr.gibba043.dnkmem (mgr.34373) 8426 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.588174+0000 mon.c (mon.1) 2173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.588948+0000 mgr.gibba043.dnkmem (mgr.34373) 8427 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.588993+0000 mgr.gibba043.dnkmem (mgr.34373) 8428 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.590262+0000 mgr.gibba043.dnkmem (mgr.34373) 8429 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.590594+0000 mgr.gibba043.dnkmem (mgr.34373) 8430 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.591113+0000 mon.c (mon.1) 2174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.591510+0000 mgr.gibba043.dnkmem (mgr.34373) 8431 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:47.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.591555+0000 mgr.gibba043.dnkmem (mgr.34373) 8432 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:47.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: cephadm 2021-03-10T16:30:46.591736+0000 mgr.gibba043.dnkmem (mgr.34373) 8433 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:47.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[32348]: audit 2021-03-10T16:30:46.592402+0000 mon.c (mon.1) 2175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:47.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.591555+0000 mgr.gibba043.dnkmem (mgr.34373) 8432 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:47.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: cephadm 2021-03-10T16:30:46.591736+0000 mgr.gibba043.dnkmem (mgr.34373) 8433 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:47.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:47 gibba003 bash[31385]: audit 2021-03-10T16:30:46.592402+0000 mon.c (mon.1) 2175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cluster 2021-03-10T16:30:46.174041+0000 mgr.gibba043.dnkmem (mgr.34373) 8417 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.377473+0000 mgr.gibba043.dnkmem (mgr.34373) 8418 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:30:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.379036+0000 mgr.gibba043.dnkmem (mgr.34373) 8419 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:30:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.580348+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:30:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.581889+0000 mgr.gibba043.dnkmem (mgr.34373) 8420 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.583368+0000 mgr.gibba043.dnkmem (mgr.34373) 8421 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.584036+0000 mon.c (mon.1) 2170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.584930+0000 mgr.gibba043.dnkmem (mgr.34373) 8422 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.584976+0000 mgr.gibba043.dnkmem (mgr.34373) 8423 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.585270+0000 mon.c (mon.1) 2171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.586197+0000 mgr.gibba043.dnkmem (mgr.34373) 8424 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.586241+0000 mgr.gibba043.dnkmem (mgr.34373) 8425 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:48.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.586954+0000 mon.c (mon.1) 2172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.587336+0000 mgr.gibba043.dnkmem (mgr.34373) 8426 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.588174+0000 mon.c (mon.1) 2173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.588948+0000 mgr.gibba043.dnkmem (mgr.34373) 8427 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:48.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.588993+0000 mgr.gibba043.dnkmem (mgr.34373) 8428 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.590262+0000 mgr.gibba043.dnkmem (mgr.34373) 8429 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.590594+0000 mgr.gibba043.dnkmem (mgr.34373) 8430 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.591113+0000 mon.c (mon.1) 2174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.591510+0000 mgr.gibba043.dnkmem (mgr.34373) 8431 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.591555+0000 mgr.gibba043.dnkmem (mgr.34373) 8432 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:48.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: cephadm 2021-03-10T16:30:46.591736+0000 mgr.gibba043.dnkmem (mgr.34373) 8433 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:30:48.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:47 gibba043 bash[24019]: audit 2021-03-10T16:30:46.592402+0000 mon.c (mon.1) 2175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:48.638 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:30:48.865 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:30:48.866 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:30:48.866 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 62s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:30:48.866 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:30:48.866 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:30:48.867 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:30:48.867 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:30:48.867 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:30:48.867 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:30:48.867 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:30:48.868 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 62s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:30:48.868 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:30:48.868 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:30:48.868 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:30:48.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:30:48.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:30:48.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:30:48.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:30:48.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:30:48.870 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 62s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:30:48.870 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:30:49.117 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:30:49.118 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:30:49.118 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:49.118 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:30:49.118 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:30:49.119 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:49.119 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:30:49.119 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:30:49.119 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:30:49.119 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:30:49.120 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:30:49.120 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:30:49.120 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:30:49.120 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:30:49.121 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:30:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:49 gibba003 bash[31385]: cluster 2021-03-10T16:30:48.175284+0000 mgr.gibba043.dnkmem (mgr.34373) 8434 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:49 gibba003 bash[31385]: audit 2021-03-10T16:30:48.631452+0000 mgr.gibba043.dnkmem (mgr.34373) 8435 : audit [DBG] from='client.49704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:49 gibba003 bash[31385]: audit 2021-03-10T16:30:49.120678+0000 mon.c (mon.1) 2176 : audit [DBG] from='client.? 172.21.2.103:0/4264261351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:49 gibba003 bash[32348]: cluster 2021-03-10T16:30:48.175284+0000 mgr.gibba043.dnkmem (mgr.34373) 8434 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:49 gibba003 bash[32348]: audit 2021-03-10T16:30:48.631452+0000 mgr.gibba043.dnkmem (mgr.34373) 8435 : audit [DBG] from='client.49704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:49 gibba003 bash[32348]: audit 2021-03-10T16:30:49.120678+0000 mon.c (mon.1) 2176 : audit [DBG] from='client.? 172.21.2.103:0/4264261351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:49 gibba043 bash[24019]: cluster 2021-03-10T16:30:48.175284+0000 mgr.gibba043.dnkmem (mgr.34373) 8434 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:49 gibba043 bash[24019]: audit 2021-03-10T16:30:48.631452+0000 mgr.gibba043.dnkmem (mgr.34373) 8435 : audit [DBG] from='client.49704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:49 gibba043 bash[24019]: audit 2021-03-10T16:30:49.120678+0000 mon.c (mon.1) 2176 : audit [DBG] from='client.? 172.21.2.103:0/4264261351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:50.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:50 gibba003 bash[31385]: audit 2021-03-10T16:30:48.854950+0000 mgr.gibba043.dnkmem (mgr.34373) 8436 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:50.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:50 gibba003 bash[32348]: audit 2021-03-10T16:30:48.854950+0000 mgr.gibba043.dnkmem (mgr.34373) 8436 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:51.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:50 gibba043 bash[24019]: audit 2021-03-10T16:30:48.854950+0000 mgr.gibba043.dnkmem (mgr.34373) 8436 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:51.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:51 gibba003 bash[31385]: cluster 2021-03-10T16:30:50.176542+0000 mgr.gibba043.dnkmem (mgr.34373) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:51 gibba003 bash[32348]: cluster 2021-03-10T16:30:50.176542+0000 mgr.gibba043.dnkmem (mgr.34373) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:52.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:51 gibba043 bash[24019]: cluster 2021-03-10T16:30:50.176542+0000 mgr.gibba043.dnkmem (mgr.34373) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:53.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:53 gibba003 bash[31385]: cluster 2021-03-10T16:30:52.178123+0000 mgr.gibba043.dnkmem (mgr.34373) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:53.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:53 gibba003 bash[32348]: cluster 2021-03-10T16:30:52.178123+0000 mgr.gibba043.dnkmem (mgr.34373) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:54.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:53 gibba043 bash[24019]: cluster 2021-03-10T16:30:52.178123+0000 mgr.gibba043.dnkmem (mgr.34373) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:55.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:55 gibba003 bash[31385]: cluster 2021-03-10T16:30:54.179459+0000 mgr.gibba043.dnkmem (mgr.34373) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:55.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:55 gibba003 bash[32348]: cluster 2021-03-10T16:30:54.179459+0000 mgr.gibba043.dnkmem (mgr.34373) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:56.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:55 gibba043 bash[24019]: cluster 2021-03-10T16:30:54.179459+0000 mgr.gibba043.dnkmem (mgr.34373) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:57 gibba003 bash[31385]: cluster 2021-03-10T16:30:56.181363+0000 mgr.gibba043.dnkmem (mgr.34373) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:57.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:57 gibba003 bash[32348]: cluster 2021-03-10T16:30:56.181363+0000 mgr.gibba043.dnkmem (mgr.34373) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:58.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:57 gibba043 bash[24019]: cluster 2021-03-10T16:30:56.181363+0000 mgr.gibba043.dnkmem (mgr.34373) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:30:59 gibba003 bash[31385]: cluster 2021-03-10T16:30:58.182572+0000 mgr.gibba043.dnkmem (mgr.34373) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:30:59 gibba003 bash[32348]: cluster 2021-03-10T16:30:58.182572+0000 mgr.gibba043.dnkmem (mgr.34373) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:30:59 gibba043 bash[24019]: cluster 2021-03-10T16:30:58.182572+0000 mgr.gibba043.dnkmem (mgr.34373) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:01 gibba003 bash[31385]: cluster 2021-03-10T16:31:00.183953+0000 mgr.gibba043.dnkmem (mgr.34373) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:01 gibba003 bash[32348]: cluster 2021-03-10T16:31:00.183953+0000 mgr.gibba043.dnkmem (mgr.34373) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:01 gibba043 bash[24019]: cluster 2021-03-10T16:31:00.183953+0000 mgr.gibba043.dnkmem (mgr.34373) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:02.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:02 gibba003 bash[31385]: cephadm 2021-03-10T16:31:01.607729+0000 mgr.gibba043.dnkmem (mgr.34373) 8443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:02.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:02 gibba003 bash[32348]: cephadm 2021-03-10T16:31:01.607729+0000 mgr.gibba043.dnkmem (mgr.34373) 8443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:03.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:02 gibba043 bash[24019]: cephadm 2021-03-10T16:31:01.607729+0000 mgr.gibba043.dnkmem (mgr.34373) 8443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:03 gibba003 bash[31385]: cluster 2021-03-10T16:31:02.185581+0000 mgr.gibba043.dnkmem (mgr.34373) 8444 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:03 gibba003 bash[32348]: cluster 2021-03-10T16:31:02.185581+0000 mgr.gibba043.dnkmem (mgr.34373) 8444 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:04.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:03 gibba043 bash[24019]: cluster 2021-03-10T16:31:02.185581+0000 mgr.gibba043.dnkmem (mgr.34373) 8444 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:05 gibba003 bash[31385]: cluster 2021-03-10T16:31:04.187206+0000 mgr.gibba043.dnkmem (mgr.34373) 8445 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:05.965 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:05 gibba003 bash[32348]: cluster 2021-03-10T16:31:04.187206+0000 mgr.gibba043.dnkmem (mgr.34373) 8445 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:05 gibba043 bash[24019]: cluster 2021-03-10T16:31:04.187206+0000 mgr.gibba043.dnkmem (mgr.34373) 8445 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:07.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:07 gibba003 bash[31385]: cluster 2021-03-10T16:31:06.189102+0000 mgr.gibba043.dnkmem (mgr.34373) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:07 gibba003 bash[32348]: cluster 2021-03-10T16:31:06.189102+0000 mgr.gibba043.dnkmem (mgr.34373) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:07 gibba043 bash[24019]: cluster 2021-03-10T16:31:06.189102+0000 mgr.gibba043.dnkmem (mgr.34373) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:09 gibba043 bash[24019]: cluster 2021-03-10T16:31:08.190452+0000 mgr.gibba043.dnkmem (mgr.34373) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:10.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:09 gibba003 bash[31385]: cluster 2021-03-10T16:31:08.190452+0000 mgr.gibba043.dnkmem (mgr.34373) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:09 gibba003 bash[32348]: cluster 2021-03-10T16:31:08.190452+0000 mgr.gibba043.dnkmem (mgr.34373) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:12.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:11 gibba043 bash[24019]: cluster 2021-03-10T16:31:10.192180+0000 mgr.gibba043.dnkmem (mgr.34373) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:12.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:11 gibba003 bash[31385]: cluster 2021-03-10T16:31:10.192180+0000 mgr.gibba043.dnkmem (mgr.34373) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:11 gibba003 bash[32348]: cluster 2021-03-10T16:31:10.192180+0000 mgr.gibba043.dnkmem (mgr.34373) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:13 gibba043 bash[24019]: cluster 2021-03-10T16:31:12.193770+0000 mgr.gibba043.dnkmem (mgr.34373) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:13 gibba003 bash[31385]: cluster 2021-03-10T16:31:12.193770+0000 mgr.gibba043.dnkmem (mgr.34373) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:13 gibba003 bash[32348]: cluster 2021-03-10T16:31:12.193770+0000 mgr.gibba043.dnkmem (mgr.34373) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:13.751513+0000 mon.c (mon.1) 2177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:13.751962+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:13.969500+0000 mon.c (mon.1) 2178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:13.970597+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.162521+0000 mon.c (mon.1) 2179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:31:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.163337+0000 mon.c (mon.1) 2180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.163807+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:31:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.164037+0000 mon.c (mon.1) 2181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:31:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.164873+0000 mon.c (mon.1) 2182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.165363+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.166430+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:31:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:14 gibba043 bash[24019]: audit 2021-03-10T16:31:14.167239+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:13.751513+0000 mon.c (mon.1) 2177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:13.751962+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:13.969500+0000 mon.c (mon.1) 2178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:13.970597+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.162521+0000 mon.c (mon.1) 2179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:31:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.163337+0000 mon.c (mon.1) 2180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.163807+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:31:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.164037+0000 mon.c (mon.1) 2181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:31:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.164873+0000 mon.c (mon.1) 2182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.165363+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.166430+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:31:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[31385]: audit 2021-03-10T16:31:14.167239+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:13.751513+0000 mon.c (mon.1) 2177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:13.751962+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:13.969500+0000 mon.c (mon.1) 2178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:13.970597+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.162521+0000 mon.c (mon.1) 2179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:31:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.163337+0000 mon.c (mon.1) 2180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.163807+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:31:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.164037+0000 mon.c (mon.1) 2181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:31:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.164873+0000 mon.c (mon.1) 2182 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.165363+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:31:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.166430+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:31:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:14 gibba003 bash[32348]: audit 2021-03-10T16:31:14.167239+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:31:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:15 gibba043 bash[24019]: cluster 2021-03-10T16:31:14.194588+0000 mgr.gibba043.dnkmem (mgr.34373) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:16.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:15 gibba003 bash[31385]: cluster 2021-03-10T16:31:14.194588+0000 mgr.gibba043.dnkmem (mgr.34373) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:15 gibba003 bash[32348]: cluster 2021-03-10T16:31:14.194588+0000 mgr.gibba043.dnkmem (mgr.34373) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:17 gibba043 bash[24019]: cluster 2021-03-10T16:31:16.196585+0000 mgr.gibba043.dnkmem (mgr.34373) 8451 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:18.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:17 gibba043 bash[24019]: cephadm 2021-03-10T16:31:16.621834+0000 mgr.gibba043.dnkmem (mgr.34373) 8452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:17 gibba003 bash[31385]: cluster 2021-03-10T16:31:16.196585+0000 mgr.gibba043.dnkmem (mgr.34373) 8451 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:17 gibba003 bash[31385]: cephadm 2021-03-10T16:31:16.621834+0000 mgr.gibba043.dnkmem (mgr.34373) 8452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:17 gibba003 bash[32348]: cluster 2021-03-10T16:31:16.196585+0000 mgr.gibba043.dnkmem (mgr.34373) 8451 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:18.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:17 gibba003 bash[32348]: cephadm 2021-03-10T16:31:16.621834+0000 mgr.gibba043.dnkmem (mgr.34373) 8452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:19.358 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:31:19.587 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:31:19.588 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:31:19.588 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 93s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:31:19.588 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:31:19.588 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:31:19.589 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:31:19.589 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:31:19.589 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:31:19.589 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:31:19.589 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:31:19.590 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 93s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:31:19.590 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:31:19.590 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:31:19.590 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:31:19.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:31:19.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:31:19.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:31:19.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:31:19.591 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 93s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:31:19.592 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 93s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:31:19.592 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:31:19.837 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:31:19.838 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:31:19.838 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:19.838 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:31:19.839 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:31:19.839 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:19.839 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:31:19.839 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:31:19.839 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:31:19.840 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:31:19.840 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:31:19.840 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:31:19.840 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:31:19.841 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:31:19.841 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:31:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:19 gibba043 bash[24019]: cluster 2021-03-10T16:31:18.197838+0000 mgr.gibba043.dnkmem (mgr.34373) 8453 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:20.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:19 gibba003 bash[31385]: cluster 2021-03-10T16:31:18.197838+0000 mgr.gibba043.dnkmem (mgr.34373) 8453 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:19 gibba003 bash[32348]: cluster 2021-03-10T16:31:18.197838+0000 mgr.gibba043.dnkmem (mgr.34373) 8453 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:21.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:20 gibba043 bash[24019]: audit 2021-03-10T16:31:19.351098+0000 mgr.gibba043.dnkmem (mgr.34373) 8454 : audit [DBG] from='client.49722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:21.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:20 gibba043 bash[24019]: audit 2021-03-10T16:31:19.575188+0000 mgr.gibba043.dnkmem (mgr.34373) 8455 : audit [DBG] from='client.49728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:21.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:20 gibba043 bash[24019]: audit 2021-03-10T16:31:19.841122+0000 mon.a (mon.0) 1808 : audit [DBG] from='client.? 172.21.2.103:0/3188979057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:21.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:20 gibba003 bash[31385]: audit 2021-03-10T16:31:19.351098+0000 mgr.gibba043.dnkmem (mgr.34373) 8454 : audit [DBG] from='client.49722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:21.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:20 gibba003 bash[31385]: audit 2021-03-10T16:31:19.575188+0000 mgr.gibba043.dnkmem (mgr.34373) 8455 : audit [DBG] from='client.49728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:21.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:20 gibba003 bash[31385]: audit 2021-03-10T16:31:19.841122+0000 mon.a (mon.0) 1808 : audit [DBG] from='client.? 172.21.2.103:0/3188979057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:21.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:20 gibba003 bash[32348]: audit 2021-03-10T16:31:19.351098+0000 mgr.gibba043.dnkmem (mgr.34373) 8454 : audit [DBG] from='client.49722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:21.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:20 gibba003 bash[32348]: audit 2021-03-10T16:31:19.575188+0000 mgr.gibba043.dnkmem (mgr.34373) 8455 : audit [DBG] from='client.49728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:21.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:20 gibba003 bash[32348]: audit 2021-03-10T16:31:19.841122+0000 mon.a (mon.0) 1808 : audit [DBG] from='client.? 172.21.2.103:0/3188979057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:21 gibba043 bash[24019]: cluster 2021-03-10T16:31:20.199539+0000 mgr.gibba043.dnkmem (mgr.34373) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:22.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:21 gibba003 bash[31385]: cluster 2021-03-10T16:31:20.199539+0000 mgr.gibba043.dnkmem (mgr.34373) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:22.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:21 gibba003 bash[32348]: cluster 2021-03-10T16:31:20.199539+0000 mgr.gibba043.dnkmem (mgr.34373) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:23 gibba003 bash[31385]: cluster 2021-03-10T16:31:22.201191+0000 mgr.gibba043.dnkmem (mgr.34373) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:24.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:23 gibba003 bash[32348]: cluster 2021-03-10T16:31:22.201191+0000 mgr.gibba043.dnkmem (mgr.34373) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:23 gibba043 bash[24019]: cluster 2021-03-10T16:31:22.201191+0000 mgr.gibba043.dnkmem (mgr.34373) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:26.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:25 gibba003 bash[31385]: cluster 2021-03-10T16:31:24.202678+0000 mgr.gibba043.dnkmem (mgr.34373) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:25 gibba003 bash[32348]: cluster 2021-03-10T16:31:24.202678+0000 mgr.gibba043.dnkmem (mgr.34373) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:25 gibba043 bash[24019]: cluster 2021-03-10T16:31:24.202678+0000 mgr.gibba043.dnkmem (mgr.34373) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:27 gibba003 bash[31385]: cluster 2021-03-10T16:31:26.204520+0000 mgr.gibba043.dnkmem (mgr.34373) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:27 gibba003 bash[32348]: cluster 2021-03-10T16:31:26.204520+0000 mgr.gibba043.dnkmem (mgr.34373) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:27 gibba043 bash[24019]: cluster 2021-03-10T16:31:26.204520+0000 mgr.gibba043.dnkmem (mgr.34373) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:30.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:29 gibba003 bash[31385]: cluster 2021-03-10T16:31:28.205910+0000 mgr.gibba043.dnkmem (mgr.34373) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:30.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:29 gibba003 bash[32348]: cluster 2021-03-10T16:31:28.205910+0000 mgr.gibba043.dnkmem (mgr.34373) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:30.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:29 gibba043 bash[24019]: cluster 2021-03-10T16:31:28.205910+0000 mgr.gibba043.dnkmem (mgr.34373) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:32.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:31 gibba043 bash[24019]: cluster 2021-03-10T16:31:30.207461+0000 mgr.gibba043.dnkmem (mgr.34373) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:32.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:31 gibba003 bash[31385]: cluster 2021-03-10T16:31:30.207461+0000 mgr.gibba043.dnkmem (mgr.34373) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:31 gibba003 bash[32348]: cluster 2021-03-10T16:31:30.207461+0000 mgr.gibba043.dnkmem (mgr.34373) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:32 gibba003 bash[31385]: cephadm 2021-03-10T16:31:31.637777+0000 mgr.gibba043.dnkmem (mgr.34373) 8462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:33.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:32 gibba003 bash[32348]: cephadm 2021-03-10T16:31:31.637777+0000 mgr.gibba043.dnkmem (mgr.34373) 8462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:33.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:32 gibba043 bash[24019]: cephadm 2021-03-10T16:31:31.637777+0000 mgr.gibba043.dnkmem (mgr.34373) 8462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:33 gibba003 bash[31385]: cluster 2021-03-10T16:31:32.208836+0000 mgr.gibba043.dnkmem (mgr.34373) 8463 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:33 gibba003 bash[32348]: cluster 2021-03-10T16:31:32.208836+0000 mgr.gibba043.dnkmem (mgr.34373) 8463 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:33 gibba043 bash[24019]: cluster 2021-03-10T16:31:32.208836+0000 mgr.gibba043.dnkmem (mgr.34373) 8463 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:36.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:35 gibba003 bash[31385]: cluster 2021-03-10T16:31:34.210304+0000 mgr.gibba043.dnkmem (mgr.34373) 8464 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:35 gibba003 bash[32348]: cluster 2021-03-10T16:31:34.210304+0000 mgr.gibba043.dnkmem (mgr.34373) 8464 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:36.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:35 gibba043 bash[24019]: cluster 2021-03-10T16:31:34.210304+0000 mgr.gibba043.dnkmem (mgr.34373) 8464 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:37 gibba003 bash[31385]: cluster 2021-03-10T16:31:36.212342+0000 mgr.gibba043.dnkmem (mgr.34373) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:37 gibba003 bash[32348]: cluster 2021-03-10T16:31:36.212342+0000 mgr.gibba043.dnkmem (mgr.34373) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:38.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:37 gibba043 bash[24019]: cluster 2021-03-10T16:31:36.212342+0000 mgr.gibba043.dnkmem (mgr.34373) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:40.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:39 gibba003 bash[32348]: cluster 2021-03-10T16:31:38.213706+0000 mgr.gibba043.dnkmem (mgr.34373) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:40.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:39 gibba003 bash[31385]: cluster 2021-03-10T16:31:38.213706+0000 mgr.gibba043.dnkmem (mgr.34373) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:40.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:39 gibba043 bash[24019]: cluster 2021-03-10T16:31:38.213706+0000 mgr.gibba043.dnkmem (mgr.34373) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:42.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:41 gibba003 bash[32348]: cluster 2021-03-10T16:31:40.215179+0000 mgr.gibba043.dnkmem (mgr.34373) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:42.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:41 gibba003 bash[31385]: cluster 2021-03-10T16:31:40.215179+0000 mgr.gibba043.dnkmem (mgr.34373) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:41 gibba043 bash[24019]: cluster 2021-03-10T16:31:40.215179+0000 mgr.gibba043.dnkmem (mgr.34373) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:42 gibba003 bash[31385]: cluster 2021-03-10T16:31:42.216831+0000 mgr.gibba043.dnkmem (mgr.34373) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:42 gibba003 bash[32348]: cluster 2021-03-10T16:31:42.216831+0000 mgr.gibba043.dnkmem (mgr.34373) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:42 gibba043 bash[24019]: cluster 2021-03-10T16:31:42.216831+0000 mgr.gibba043.dnkmem (mgr.34373) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:45 gibba003 bash[31385]: cluster 2021-03-10T16:31:44.218644+0000 mgr.gibba043.dnkmem (mgr.34373) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:45 gibba003 bash[32348]: cluster 2021-03-10T16:31:44.218644+0000 mgr.gibba043.dnkmem (mgr.34373) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:45 gibba043 bash[24019]: cluster 2021-03-10T16:31:44.218644+0000 mgr.gibba043.dnkmem (mgr.34373) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: cluster 2021-03-10T16:31:46.220708+0000 mgr.gibba043.dnkmem (mgr.34373) 8470 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.654697+0000 mgr.gibba043.dnkmem (mgr.34373) 8471 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:31:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.656288+0000 mgr.gibba043.dnkmem (mgr.34373) 8472 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:31:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.872530+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:31:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.876683+0000 mon.c (mon.1) 2183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.878039+0000 mon.c (mon.1) 2184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.879696+0000 mon.c (mon.1) 2185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.881351+0000 mon.c (mon.1) 2186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.884049+0000 mon.c (mon.1) 2187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:47 gibba043 bash[24019]: audit 2021-03-10T16:31:46.885790+0000 mon.c (mon.1) 2188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: cluster 2021-03-10T16:31:46.220708+0000 mgr.gibba043.dnkmem (mgr.34373) 8470 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.654697+0000 mgr.gibba043.dnkmem (mgr.34373) 8471 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:31:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.656288+0000 mgr.gibba043.dnkmem (mgr.34373) 8472 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:31:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.872530+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:31:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.876683+0000 mon.c (mon.1) 2183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.878039+0000 mon.c (mon.1) 2184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.879696+0000 mon.c (mon.1) 2185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.881351+0000 mon.c (mon.1) 2186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.884049+0000 mon.c (mon.1) 2187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[31385]: audit 2021-03-10T16:31:46.885790+0000 mon.c (mon.1) 2188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: cluster 2021-03-10T16:31:46.220708+0000 mgr.gibba043.dnkmem (mgr.34373) 8470 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.654697+0000 mgr.gibba043.dnkmem (mgr.34373) 8471 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:31:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.656288+0000 mgr.gibba043.dnkmem (mgr.34373) 8472 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:31:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.872530+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:31:47.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.876683+0000 mon.c (mon.1) 2183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:47.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.878039+0000 mon.c (mon.1) 2184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.879696+0000 mon.c (mon.1) 2185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.881351+0000 mon.c (mon.1) 2186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.884049+0000 mon.c (mon.1) 2187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:47.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:47 gibba003 bash[32348]: audit 2021-03-10T16:31:46.885790+0000 mon.c (mon.1) 2188 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.874268+0000 mgr.gibba043.dnkmem (mgr.34373) 8473 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.875982+0000 mgr.gibba043.dnkmem (mgr.34373) 8474 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.877605+0000 mgr.gibba043.dnkmem (mgr.34373) 8475 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.877644+0000 mgr.gibba043.dnkmem (mgr.34373) 8476 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.879318+0000 mgr.gibba043.dnkmem (mgr.34373) 8477 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.879357+0000 mgr.gibba043.dnkmem (mgr.34373) 8478 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.880667+0000 mgr.gibba043.dnkmem (mgr.34373) 8479 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:48.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.881931+0000 mgr.gibba043.dnkmem (mgr.34373) 8480 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.881969+0000 mgr.gibba043.dnkmem (mgr.34373) 8481 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.883426+0000 mgr.gibba043.dnkmem (mgr.34373) 8482 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.883805+0000 mgr.gibba043.dnkmem (mgr.34373) 8483 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:48.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.885404+0000 mgr.gibba043.dnkmem (mgr.34373) 8484 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:48.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.885446+0000 mgr.gibba043.dnkmem (mgr.34373) 8485 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:48.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:48 gibba043 bash[24019]: cephadm 2021-03-10T16:31:46.885553+0000 mgr.gibba043.dnkmem (mgr.34373) 8486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:48.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.874268+0000 mgr.gibba043.dnkmem (mgr.34373) 8473 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:48.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.875982+0000 mgr.gibba043.dnkmem (mgr.34373) 8474 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.877605+0000 mgr.gibba043.dnkmem (mgr.34373) 8475 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.877644+0000 mgr.gibba043.dnkmem (mgr.34373) 8476 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.879318+0000 mgr.gibba043.dnkmem (mgr.34373) 8477 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.879357+0000 mgr.gibba043.dnkmem (mgr.34373) 8478 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.880667+0000 mgr.gibba043.dnkmem (mgr.34373) 8479 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.881931+0000 mgr.gibba043.dnkmem (mgr.34373) 8480 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.881969+0000 mgr.gibba043.dnkmem (mgr.34373) 8481 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.883426+0000 mgr.gibba043.dnkmem (mgr.34373) 8482 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.883805+0000 mgr.gibba043.dnkmem (mgr.34373) 8483 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.885404+0000 mgr.gibba043.dnkmem (mgr.34373) 8484 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.885446+0000 mgr.gibba043.dnkmem (mgr.34373) 8485 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[31385]: cephadm 2021-03-10T16:31:46.885553+0000 mgr.gibba043.dnkmem (mgr.34373) 8486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:48.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.874268+0000 mgr.gibba043.dnkmem (mgr.34373) 8473 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:48.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.875982+0000 mgr.gibba043.dnkmem (mgr.34373) 8474 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:48.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.877605+0000 mgr.gibba043.dnkmem (mgr.34373) 8475 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.877644+0000 mgr.gibba043.dnkmem (mgr.34373) 8476 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.879318+0000 mgr.gibba043.dnkmem (mgr.34373) 8477 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.879357+0000 mgr.gibba043.dnkmem (mgr.34373) 8478 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.880667+0000 mgr.gibba043.dnkmem (mgr.34373) 8479 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.881931+0000 mgr.gibba043.dnkmem (mgr.34373) 8480 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.881969+0000 mgr.gibba043.dnkmem (mgr.34373) 8481 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.883426+0000 mgr.gibba043.dnkmem (mgr.34373) 8482 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.883805+0000 mgr.gibba043.dnkmem (mgr.34373) 8483 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.885404+0000 mgr.gibba043.dnkmem (mgr.34373) 8484 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.885446+0000 mgr.gibba043.dnkmem (mgr.34373) 8485 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:48 gibba003 bash[32348]: cephadm 2021-03-10T16:31:46.885553+0000 mgr.gibba043.dnkmem (mgr.34373) 8486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:31:49.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:49 gibba043 bash[24019]: cluster 2021-03-10T16:31:48.222407+0000 mgr.gibba043.dnkmem (mgr.34373) 8487 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:49 gibba003 bash[31385]: cluster 2021-03-10T16:31:48.222407+0000 mgr.gibba043.dnkmem (mgr.34373) 8487 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:49 gibba003 bash[32348]: cluster 2021-03-10T16:31:48.222407+0000 mgr.gibba043.dnkmem (mgr.34373) 8487 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:50.082 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:31:50.313 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:31:50.313 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:31:50.313 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:31:50.313 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:31:50.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:31:50.314 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:31:50.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:31:50.314 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:31:50.315 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:31:50.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:31:50.315 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:31:50.315 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:31:50.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:31:50.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:31:50.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:31:50.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:31:50.316 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:31:50.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:31:50.317 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:31:50.317 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:31:50.317 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:31:50.563 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:31:50.564 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:31:50.564 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:50.564 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:31:50.564 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:31:50.565 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:50.565 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:31:50.565 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:31:50.565 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:31:50.565 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:31:50.566 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:31:50.566 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:31:50.566 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:31:50.566 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:31:50.567 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:31:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:51 gibba043 bash[24019]: audit 2021-03-10T16:31:50.076567+0000 mgr.gibba043.dnkmem (mgr.34373) 8488 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:51 gibba043 bash[24019]: cluster 2021-03-10T16:31:50.223827+0000 mgr.gibba043.dnkmem (mgr.34373) 8489 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:51 gibba043 bash[24019]: audit 2021-03-10T16:31:50.302595+0000 mgr.gibba043.dnkmem (mgr.34373) 8490 : audit [DBG] from='client.59734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:51 gibba043 bash[24019]: audit 2021-03-10T16:31:50.566811+0000 mon.c (mon.1) 2189 : audit [DBG] from='client.? 172.21.2.103:0/3954980359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:51.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[31385]: audit 2021-03-10T16:31:50.076567+0000 mgr.gibba043.dnkmem (mgr.34373) 8488 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:51.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[31385]: cluster 2021-03-10T16:31:50.223827+0000 mgr.gibba043.dnkmem (mgr.34373) 8489 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[31385]: audit 2021-03-10T16:31:50.302595+0000 mgr.gibba043.dnkmem (mgr.34373) 8490 : audit [DBG] from='client.59734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[31385]: audit 2021-03-10T16:31:50.566811+0000 mon.c (mon.1) 2189 : audit [DBG] from='client.? 172.21.2.103:0/3954980359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[32348]: audit 2021-03-10T16:31:50.076567+0000 mgr.gibba043.dnkmem (mgr.34373) 8488 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[32348]: cluster 2021-03-10T16:31:50.223827+0000 mgr.gibba043.dnkmem (mgr.34373) 8489 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[32348]: audit 2021-03-10T16:31:50.302595+0000 mgr.gibba043.dnkmem (mgr.34373) 8490 : audit [DBG] from='client.59734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:51 gibba003 bash[32348]: audit 2021-03-10T16:31:50.566811+0000 mon.c (mon.1) 2189 : audit [DBG] from='client.? 172.21.2.103:0/3954980359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:53.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:53 gibba043 bash[24019]: cluster 2021-03-10T16:31:52.225270+0000 mgr.gibba043.dnkmem (mgr.34373) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:53 gibba003 bash[31385]: cluster 2021-03-10T16:31:52.225270+0000 mgr.gibba043.dnkmem (mgr.34373) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:53 gibba003 bash[32348]: cluster 2021-03-10T16:31:52.225270+0000 mgr.gibba043.dnkmem (mgr.34373) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:55 gibba043 bash[24019]: cluster 2021-03-10T16:31:54.226874+0000 mgr.gibba043.dnkmem (mgr.34373) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:55 gibba003 bash[31385]: cluster 2021-03-10T16:31:54.226874+0000 mgr.gibba043.dnkmem (mgr.34373) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:55 gibba003 bash[32348]: cluster 2021-03-10T16:31:54.226874+0000 mgr.gibba043.dnkmem (mgr.34373) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:57 gibba043 bash[24019]: cluster 2021-03-10T16:31:56.228723+0000 mgr.gibba043.dnkmem (mgr.34373) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:57 gibba003 bash[31385]: cluster 2021-03-10T16:31:56.228723+0000 mgr.gibba043.dnkmem (mgr.34373) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:57 gibba003 bash[32348]: cluster 2021-03-10T16:31:56.228723+0000 mgr.gibba043.dnkmem (mgr.34373) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:31:59 gibba043 bash[24019]: cluster 2021-03-10T16:31:58.230354+0000 mgr.gibba043.dnkmem (mgr.34373) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:31:59 gibba003 bash[31385]: cluster 2021-03-10T16:31:58.230354+0000 mgr.gibba043.dnkmem (mgr.34373) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:31:59 gibba003 bash[32348]: cluster 2021-03-10T16:31:58.230354+0000 mgr.gibba043.dnkmem (mgr.34373) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:01.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:01 gibba043 bash[24019]: cluster 2021-03-10T16:32:00.231603+0000 mgr.gibba043.dnkmem (mgr.34373) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:01 gibba003 bash[31385]: cluster 2021-03-10T16:32:00.231603+0000 mgr.gibba043.dnkmem (mgr.34373) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:01.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:01 gibba003 bash[32348]: cluster 2021-03-10T16:32:00.231603+0000 mgr.gibba043.dnkmem (mgr.34373) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:03.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:03 gibba043 bash[24019]: cephadm 2021-03-10T16:32:01.901554+0000 mgr.gibba043.dnkmem (mgr.34373) 8496 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:03 gibba043 bash[24019]: cluster 2021-03-10T16:32:02.232997+0000 mgr.gibba043.dnkmem (mgr.34373) 8497 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:03.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:03 gibba003 bash[31385]: cephadm 2021-03-10T16:32:01.901554+0000 mgr.gibba043.dnkmem (mgr.34373) 8496 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:03 gibba003 bash[31385]: cluster 2021-03-10T16:32:02.232997+0000 mgr.gibba043.dnkmem (mgr.34373) 8497 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:03 gibba003 bash[32348]: cephadm 2021-03-10T16:32:01.901554+0000 mgr.gibba043.dnkmem (mgr.34373) 8496 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:03.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:03 gibba003 bash[32348]: cluster 2021-03-10T16:32:02.232997+0000 mgr.gibba043.dnkmem (mgr.34373) 8497 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:05 gibba003 bash[31385]: cluster 2021-03-10T16:32:04.234291+0000 mgr.gibba043.dnkmem (mgr.34373) 8498 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:05.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:05 gibba003 bash[32348]: cluster 2021-03-10T16:32:04.234291+0000 mgr.gibba043.dnkmem (mgr.34373) 8498 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:05 gibba043 bash[24019]: cluster 2021-03-10T16:32:04.234291+0000 mgr.gibba043.dnkmem (mgr.34373) 8498 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:07 gibba003 bash[31385]: cluster 2021-03-10T16:32:06.236266+0000 mgr.gibba043.dnkmem (mgr.34373) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:07 gibba003 bash[32348]: cluster 2021-03-10T16:32:06.236266+0000 mgr.gibba043.dnkmem (mgr.34373) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:07 gibba043 bash[24019]: cluster 2021-03-10T16:32:06.236266+0000 mgr.gibba043.dnkmem (mgr.34373) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:09 gibba003 bash[31385]: cluster 2021-03-10T16:32:08.237938+0000 mgr.gibba043.dnkmem (mgr.34373) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:09 gibba003 bash[32348]: cluster 2021-03-10T16:32:08.237938+0000 mgr.gibba043.dnkmem (mgr.34373) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:09 gibba043 bash[24019]: cluster 2021-03-10T16:32:08.237938+0000 mgr.gibba043.dnkmem (mgr.34373) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:11.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:11 gibba003 bash[31385]: cluster 2021-03-10T16:32:10.239493+0000 mgr.gibba043.dnkmem (mgr.34373) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:11 gibba003 bash[32348]: cluster 2021-03-10T16:32:10.239493+0000 mgr.gibba043.dnkmem (mgr.34373) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:12.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:11 gibba043 bash[24019]: cluster 2021-03-10T16:32:10.239493+0000 mgr.gibba043.dnkmem (mgr.34373) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:13.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:13 gibba003 bash[31385]: cluster 2021-03-10T16:32:12.241178+0000 mgr.gibba043.dnkmem (mgr.34373) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:13.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:13 gibba003 bash[32348]: cluster 2021-03-10T16:32:12.241178+0000 mgr.gibba043.dnkmem (mgr.34373) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:13 gibba043 bash[24019]: cluster 2021-03-10T16:32:12.241178+0000 mgr.gibba043.dnkmem (mgr.34373) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:13.755282+0000 mon.c (mon.1) 2190 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:13.756367+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:13.976734+0000 mon.c (mon.1) 2191 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:13.977867+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.172816+0000 mon.c (mon.1) 2192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:32:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.173595+0000 mon.c (mon.1) 2193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.174063+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:32:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.174314+0000 mon.c (mon.1) 2194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.175170+0000 mon.c (mon.1) 2195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.175359+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.176725+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[31385]: audit 2021-03-10T16:32:14.177757+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:13.755282+0000 mon.c (mon.1) 2190 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:13.756367+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:13.976734+0000 mon.c (mon.1) 2191 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:13.977867+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.172816+0000 mon.c (mon.1) 2192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:32:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.173595+0000 mon.c (mon.1) 2193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.174063+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:32:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.174314+0000 mon.c (mon.1) 2194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.175170+0000 mon.c (mon.1) 2195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.175359+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.176725+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:14 gibba003 bash[32348]: audit 2021-03-10T16:32:14.177757+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:13.755282+0000 mon.c (mon.1) 2190 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:13.756367+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:13.976734+0000 mon.c (mon.1) 2191 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:13.977867+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.172816+0000 mon.c (mon.1) 2192 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:32:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.173595+0000 mon.c (mon.1) 2193 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.174063+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:32:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.174314+0000 mon.c (mon.1) 2194 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.175170+0000 mon.c (mon.1) 2195 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.175359+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.176725+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:14 gibba043 bash[24019]: audit 2021-03-10T16:32:14.177757+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:32:15.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:15 gibba003 bash[31385]: cluster 2021-03-10T16:32:14.242365+0000 mgr.gibba043.dnkmem (mgr.34373) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:15.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:15 gibba003 bash[32348]: cluster 2021-03-10T16:32:14.242365+0000 mgr.gibba043.dnkmem (mgr.34373) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:15 gibba043 bash[24019]: cluster 2021-03-10T16:32:14.242365+0000 mgr.gibba043.dnkmem (mgr.34373) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:17.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:17 gibba003 bash[31385]: cluster 2021-03-10T16:32:16.243971+0000 mgr.gibba043.dnkmem (mgr.34373) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:17 gibba003 bash[32348]: cluster 2021-03-10T16:32:16.243971+0000 mgr.gibba043.dnkmem (mgr.34373) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:17 gibba043 bash[24019]: cluster 2021-03-10T16:32:16.243971+0000 mgr.gibba043.dnkmem (mgr.34373) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:18.964 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:18 gibba003 bash[31385]: cephadm 2021-03-10T16:32:16.910629+0000 mgr.gibba043.dnkmem (mgr.34373) 8505 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:18.965 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:18 gibba003 bash[32348]: cephadm 2021-03-10T16:32:16.910629+0000 mgr.gibba043.dnkmem (mgr.34373) 8505 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:19.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:18 gibba043 bash[24019]: cephadm 2021-03-10T16:32:16.910629+0000 mgr.gibba043.dnkmem (mgr.34373) 8505 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:19.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:19 gibba003 bash[31385]: cluster 2021-03-10T16:32:18.245502+0000 mgr.gibba043.dnkmem (mgr.34373) 8506 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:19 gibba003 bash[32348]: cluster 2021-03-10T16:32:18.245502+0000 mgr.gibba043.dnkmem (mgr.34373) 8506 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:19 gibba043 bash[24019]: cluster 2021-03-10T16:32:18.245502+0000 mgr.gibba043.dnkmem (mgr.34373) 8506 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:20.814 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:32:21.069 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:32:21.070 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:32:21.070 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:32:21.070 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:32:21.071 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:32:21.071 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:32:21.071 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:32:21.071 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:32:21.071 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:32:21.072 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:32:21.072 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:32:21.072 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:32:21.072 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:32:21.073 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:32:21.073 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:32:21.073 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:32:21.074 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:32:21.074 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:32:21.074 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:32:21.074 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:32:21.075 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:32:21.318 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:32:21.318 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:32:21.319 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:21.319 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:32:21.319 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:32:21.319 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:21.319 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:32:21.320 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:32:21.320 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:32:21.320 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:32:21.320 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:32:21.320 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:32:21.321 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:32:21.321 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:32:21.321 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:32:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:21 gibba003 bash[31385]: cluster 2021-03-10T16:32:20.246678+0000 mgr.gibba043.dnkmem (mgr.34373) 8507 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:21 gibba003 bash[31385]: audit 2021-03-10T16:32:20.807407+0000 mgr.gibba043.dnkmem (mgr.34373) 8508 : audit [DBG] from='client.59746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:21 gibba003 bash[31385]: audit 2021-03-10T16:32:21.321678+0000 mon.c (mon.1) 2196 : audit [DBG] from='client.? 172.21.2.103:0/3909043251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:21 gibba003 bash[32348]: cluster 2021-03-10T16:32:20.246678+0000 mgr.gibba043.dnkmem (mgr.34373) 8507 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:21 gibba003 bash[32348]: audit 2021-03-10T16:32:20.807407+0000 mgr.gibba043.dnkmem (mgr.34373) 8508 : audit [DBG] from='client.59746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:21 gibba003 bash[32348]: audit 2021-03-10T16:32:21.321678+0000 mon.c (mon.1) 2196 : audit [DBG] from='client.? 172.21.2.103:0/3909043251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:21 gibba043 bash[24019]: cluster 2021-03-10T16:32:20.246678+0000 mgr.gibba043.dnkmem (mgr.34373) 8507 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:21 gibba043 bash[24019]: audit 2021-03-10T16:32:20.807407+0000 mgr.gibba043.dnkmem (mgr.34373) 8508 : audit [DBG] from='client.59746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:22.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:21 gibba043 bash[24019]: audit 2021-03-10T16:32:21.321678+0000 mon.c (mon.1) 2196 : audit [DBG] from='client.? 172.21.2.103:0/3909043251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:22.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:22 gibba003 bash[31385]: audit 2021-03-10T16:32:21.033836+0000 mgr.gibba043.dnkmem (mgr.34373) 8509 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:22.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:22 gibba003 bash[32348]: audit 2021-03-10T16:32:21.033836+0000 mgr.gibba043.dnkmem (mgr.34373) 8509 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:23.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:22 gibba043 bash[24019]: audit 2021-03-10T16:32:21.033836+0000 mgr.gibba043.dnkmem (mgr.34373) 8509 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:23.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:23 gibba003 bash[31385]: cluster 2021-03-10T16:32:22.248231+0000 mgr.gibba043.dnkmem (mgr.34373) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:23.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:23 gibba003 bash[32348]: cluster 2021-03-10T16:32:22.248231+0000 mgr.gibba043.dnkmem (mgr.34373) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:23 gibba043 bash[24019]: cluster 2021-03-10T16:32:22.248231+0000 mgr.gibba043.dnkmem (mgr.34373) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:25.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:25 gibba003 bash[31385]: cluster 2021-03-10T16:32:24.249691+0000 mgr.gibba043.dnkmem (mgr.34373) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:25.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:25 gibba003 bash[32348]: cluster 2021-03-10T16:32:24.249691+0000 mgr.gibba043.dnkmem (mgr.34373) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:25 gibba043 bash[24019]: cluster 2021-03-10T16:32:24.249691+0000 mgr.gibba043.dnkmem (mgr.34373) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:27.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:27 gibba003 bash[31385]: cluster 2021-03-10T16:32:26.251475+0000 mgr.gibba043.dnkmem (mgr.34373) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:27.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:27 gibba003 bash[32348]: cluster 2021-03-10T16:32:26.251475+0000 mgr.gibba043.dnkmem (mgr.34373) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:27 gibba043 bash[24019]: cluster 2021-03-10T16:32:26.251475+0000 mgr.gibba043.dnkmem (mgr.34373) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:29.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:29 gibba003 bash[31385]: cluster 2021-03-10T16:32:28.252992+0000 mgr.gibba043.dnkmem (mgr.34373) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:29 gibba003 bash[32348]: cluster 2021-03-10T16:32:28.252992+0000 mgr.gibba043.dnkmem (mgr.34373) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:29 gibba043 bash[24019]: cluster 2021-03-10T16:32:28.252992+0000 mgr.gibba043.dnkmem (mgr.34373) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:31.925 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:31 gibba043 bash[24019]: cluster 2021-03-10T16:32:30.254370+0000 mgr.gibba043.dnkmem (mgr.34373) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:31.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:31 gibba003 bash[31385]: cluster 2021-03-10T16:32:30.254370+0000 mgr.gibba043.dnkmem (mgr.34373) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:31.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:31 gibba003 bash[32348]: cluster 2021-03-10T16:32:30.254370+0000 mgr.gibba043.dnkmem (mgr.34373) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:33.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:33 gibba003 bash[31385]: cephadm 2021-03-10T16:32:31.926893+0000 mgr.gibba043.dnkmem (mgr.34373) 8515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:33 gibba003 bash[31385]: cluster 2021-03-10T16:32:32.255906+0000 mgr.gibba043.dnkmem (mgr.34373) 8516 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:33 gibba003 bash[32348]: cephadm 2021-03-10T16:32:31.926893+0000 mgr.gibba043.dnkmem (mgr.34373) 8515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:33 gibba003 bash[32348]: cluster 2021-03-10T16:32:32.255906+0000 mgr.gibba043.dnkmem (mgr.34373) 8516 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:33 gibba043 bash[24019]: cephadm 2021-03-10T16:32:31.926893+0000 mgr.gibba043.dnkmem (mgr.34373) 8515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:33 gibba043 bash[24019]: cluster 2021-03-10T16:32:32.255906+0000 mgr.gibba043.dnkmem (mgr.34373) 8516 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:35.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:35 gibba003 bash[31385]: cluster 2021-03-10T16:32:34.257528+0000 mgr.gibba043.dnkmem (mgr.34373) 8517 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:35.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:35 gibba003 bash[32348]: cluster 2021-03-10T16:32:34.257528+0000 mgr.gibba043.dnkmem (mgr.34373) 8517 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:36.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:35 gibba043 bash[24019]: cluster 2021-03-10T16:32:34.257528+0000 mgr.gibba043.dnkmem (mgr.34373) 8517 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:37 gibba043 bash[24019]: cluster 2021-03-10T16:32:36.259404+0000 mgr.gibba043.dnkmem (mgr.34373) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:37 gibba003 bash[31385]: cluster 2021-03-10T16:32:36.259404+0000 mgr.gibba043.dnkmem (mgr.34373) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:37 gibba003 bash[32348]: cluster 2021-03-10T16:32:36.259404+0000 mgr.gibba043.dnkmem (mgr.34373) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:39 gibba043 bash[24019]: cluster 2021-03-10T16:32:38.261060+0000 mgr.gibba043.dnkmem (mgr.34373) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:40.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:39 gibba003 bash[31385]: cluster 2021-03-10T16:32:38.261060+0000 mgr.gibba043.dnkmem (mgr.34373) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:39 gibba003 bash[32348]: cluster 2021-03-10T16:32:38.261060+0000 mgr.gibba043.dnkmem (mgr.34373) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:41 gibba043 bash[24019]: cluster 2021-03-10T16:32:40.262494+0000 mgr.gibba043.dnkmem (mgr.34373) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:42.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:41 gibba003 bash[31385]: cluster 2021-03-10T16:32:40.262494+0000 mgr.gibba043.dnkmem (mgr.34373) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:41 gibba003 bash[32348]: cluster 2021-03-10T16:32:40.262494+0000 mgr.gibba043.dnkmem (mgr.34373) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:44.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:43 gibba043 bash[24019]: cluster 2021-03-10T16:32:42.264220+0000 mgr.gibba043.dnkmem (mgr.34373) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:44.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:43 gibba003 bash[31385]: cluster 2021-03-10T16:32:42.264220+0000 mgr.gibba043.dnkmem (mgr.34373) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:43 gibba003 bash[32348]: cluster 2021-03-10T16:32:42.264220+0000 mgr.gibba043.dnkmem (mgr.34373) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:45 gibba043 bash[24019]: cluster 2021-03-10T16:32:44.265640+0000 mgr.gibba043.dnkmem (mgr.34373) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:45 gibba003 bash[31385]: cluster 2021-03-10T16:32:44.265640+0000 mgr.gibba043.dnkmem (mgr.34373) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:45 gibba003 bash[32348]: cluster 2021-03-10T16:32:44.265640+0000 mgr.gibba043.dnkmem (mgr.34373) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: cluster 2021-03-10T16:32:46.267505+0000 mgr.gibba043.dnkmem (mgr.34373) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.136078+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:32:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.139748+0000 mon.c (mon.1) 2197 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.141091+0000 mon.c (mon.1) 2198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.142296+0000 mon.c (mon.1) 2199 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.143455+0000 mon.c (mon.1) 2200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.146346+0000 mon.c (mon.1) 2201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:47 gibba043 bash[24019]: audit 2021-03-10T16:32:47.147794+0000 mon.c (mon.1) 2202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: cluster 2021-03-10T16:32:46.267505+0000 mgr.gibba043.dnkmem (mgr.34373) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.136078+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:32:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.139748+0000 mon.c (mon.1) 2197 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.141091+0000 mon.c (mon.1) 2198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.142296+0000 mon.c (mon.1) 2199 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.143455+0000 mon.c (mon.1) 2200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.146346+0000 mon.c (mon.1) 2201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[31385]: audit 2021-03-10T16:32:47.147794+0000 mon.c (mon.1) 2202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: cluster 2021-03-10T16:32:46.267505+0000 mgr.gibba043.dnkmem (mgr.34373) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.136078+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:32:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.139748+0000 mon.c (mon.1) 2197 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.141091+0000 mon.c (mon.1) 2198 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.142296+0000 mon.c (mon.1) 2199 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.143455+0000 mon.c (mon.1) 2200 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.146346+0000 mon.c (mon.1) 2201 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:48.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:47 gibba003 bash[32348]: audit 2021-03-10T16:32:47.147794+0000 mon.c (mon.1) 2202 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:49.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:46.934427+0000 mgr.gibba043.dnkmem (mgr.34373) 8524 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:32:49.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:46.935944+0000 mgr.gibba043.dnkmem (mgr.34373) 8525 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:32:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.137461+0000 mgr.gibba043.dnkmem (mgr.34373) 8526 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.139009+0000 mgr.gibba043.dnkmem (mgr.34373) 8527 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.140386+0000 mgr.gibba043.dnkmem (mgr.34373) 8528 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.140422+0000 mgr.gibba043.dnkmem (mgr.34373) 8529 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.141588+0000 mgr.gibba043.dnkmem (mgr.34373) 8530 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.141627+0000 mgr.gibba043.dnkmem (mgr.34373) 8531 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.142677+0000 mgr.gibba043.dnkmem (mgr.34373) 8532 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.144150+0000 mgr.gibba043.dnkmem (mgr.34373) 8533 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.144188+0000 mgr.gibba043.dnkmem (mgr.34373) 8534 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.145633+0000 mgr.gibba043.dnkmem (mgr.34373) 8535 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.145969+0000 mgr.gibba043.dnkmem (mgr.34373) 8536 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.146914+0000 mgr.gibba043.dnkmem (mgr.34373) 8537 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.146951+0000 mgr.gibba043.dnkmem (mgr.34373) 8538 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:48 gibba043 bash[24019]: cephadm 2021-03-10T16:32:47.147052+0000 mgr.gibba043.dnkmem (mgr.34373) 8539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:49.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:46.934427+0000 mgr.gibba043.dnkmem (mgr.34373) 8524 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:32:49.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:46.935944+0000 mgr.gibba043.dnkmem (mgr.34373) 8525 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:32:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.137461+0000 mgr.gibba043.dnkmem (mgr.34373) 8526 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.139009+0000 mgr.gibba043.dnkmem (mgr.34373) 8527 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.140386+0000 mgr.gibba043.dnkmem (mgr.34373) 8528 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.140422+0000 mgr.gibba043.dnkmem (mgr.34373) 8529 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.141588+0000 mgr.gibba043.dnkmem (mgr.34373) 8530 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.141627+0000 mgr.gibba043.dnkmem (mgr.34373) 8531 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.142677+0000 mgr.gibba043.dnkmem (mgr.34373) 8532 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.144150+0000 mgr.gibba043.dnkmem (mgr.34373) 8533 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.144188+0000 mgr.gibba043.dnkmem (mgr.34373) 8534 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.145633+0000 mgr.gibba043.dnkmem (mgr.34373) 8535 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.145969+0000 mgr.gibba043.dnkmem (mgr.34373) 8536 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.146914+0000 mgr.gibba043.dnkmem (mgr.34373) 8537 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.146951+0000 mgr.gibba043.dnkmem (mgr.34373) 8538 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[31385]: cephadm 2021-03-10T16:32:47.147052+0000 mgr.gibba043.dnkmem (mgr.34373) 8539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:46.934427+0000 mgr.gibba043.dnkmem (mgr.34373) 8524 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:32:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:46.935944+0000 mgr.gibba043.dnkmem (mgr.34373) 8525 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:32:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.137461+0000 mgr.gibba043.dnkmem (mgr.34373) 8526 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.139009+0000 mgr.gibba043.dnkmem (mgr.34373) 8527 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.140386+0000 mgr.gibba043.dnkmem (mgr.34373) 8528 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.140422+0000 mgr.gibba043.dnkmem (mgr.34373) 8529 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.141588+0000 mgr.gibba043.dnkmem (mgr.34373) 8530 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.141627+0000 mgr.gibba043.dnkmem (mgr.34373) 8531 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.142677+0000 mgr.gibba043.dnkmem (mgr.34373) 8532 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.144150+0000 mgr.gibba043.dnkmem (mgr.34373) 8533 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.144188+0000 mgr.gibba043.dnkmem (mgr.34373) 8534 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.145633+0000 mgr.gibba043.dnkmem (mgr.34373) 8535 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.145969+0000 mgr.gibba043.dnkmem (mgr.34373) 8536 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.146914+0000 mgr.gibba043.dnkmem (mgr.34373) 8537 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.146951+0000 mgr.gibba043.dnkmem (mgr.34373) 8538 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:48 gibba003 bash[32348]: cephadm 2021-03-10T16:32:47.147052+0000 mgr.gibba043.dnkmem (mgr.34373) 8539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:32:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:49 gibba043 bash[24019]: cluster 2021-03-10T16:32:48.269106+0000 mgr.gibba043.dnkmem (mgr.34373) 8540 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:50.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:49 gibba003 bash[31385]: cluster 2021-03-10T16:32:48.269106+0000 mgr.gibba043.dnkmem (mgr.34373) 8540 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:49 gibba003 bash[32348]: cluster 2021-03-10T16:32:48.269106+0000 mgr.gibba043.dnkmem (mgr.34373) 8540 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:51.568 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:32:51.794 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:32:51.794 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:32:51.794 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:32:51.795 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:32:51.795 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:32:51.795 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:32:51.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:32:51.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:32:51.796 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:32:51.796 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:32:51.796 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:32:51.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:32:51.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:32:51.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:32:51.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:32:51.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:32:51.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:32:51.798 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:32:51.798 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:32:51.798 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:32:51.798 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:32:52.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:51 gibba043 bash[24019]: cluster 2021-03-10T16:32:50.270341+0000 mgr.gibba043.dnkmem (mgr.34373) 8541 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:52.042 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:32:52.043 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:32:52.043 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:52.043 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:32:52.043 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:32:52.044 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:52.044 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:32:52.044 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:32:52.044 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:32:52.044 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:32:52.045 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:32:52.045 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:32:52.045 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:32:52.045 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:32:52.046 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:32:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:51 gibba003 bash[31385]: cluster 2021-03-10T16:32:50.270341+0000 mgr.gibba043.dnkmem (mgr.34373) 8541 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:51 gibba003 bash[32348]: cluster 2021-03-10T16:32:50.270341+0000 mgr.gibba043.dnkmem (mgr.34373) 8541 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:53.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:52 gibba043 bash[24019]: audit 2021-03-10T16:32:51.561948+0000 mgr.gibba043.dnkmem (mgr.34373) 8542 : audit [DBG] from='client.49776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:53.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:52 gibba043 bash[24019]: audit 2021-03-10T16:32:51.786771+0000 mgr.gibba043.dnkmem (mgr.34373) 8543 : audit [DBG] from='client.49782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:53.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:52 gibba043 bash[24019]: audit 2021-03-10T16:32:52.046061+0000 mon.c (mon.1) 2203 : audit [DBG] from='client.? 172.21.2.103:0/645880037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:53.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:52 gibba003 bash[31385]: audit 2021-03-10T16:32:51.561948+0000 mgr.gibba043.dnkmem (mgr.34373) 8542 : audit [DBG] from='client.49776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:53.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:52 gibba003 bash[31385]: audit 2021-03-10T16:32:51.786771+0000 mgr.gibba043.dnkmem (mgr.34373) 8543 : audit [DBG] from='client.49782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:53.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:52 gibba003 bash[31385]: audit 2021-03-10T16:32:52.046061+0000 mon.c (mon.1) 2203 : audit [DBG] from='client.? 172.21.2.103:0/645880037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:53.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:52 gibba003 bash[32348]: audit 2021-03-10T16:32:51.561948+0000 mgr.gibba043.dnkmem (mgr.34373) 8542 : audit [DBG] from='client.49776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:53.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:52 gibba003 bash[32348]: audit 2021-03-10T16:32:51.786771+0000 mgr.gibba043.dnkmem (mgr.34373) 8543 : audit [DBG] from='client.49782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:53.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:52 gibba003 bash[32348]: audit 2021-03-10T16:32:52.046061+0000 mon.c (mon.1) 2203 : audit [DBG] from='client.? 172.21.2.103:0/645880037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:53 gibba003 bash[31385]: cluster 2021-03-10T16:32:52.272032+0000 mgr.gibba043.dnkmem (mgr.34373) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:53 gibba003 bash[32348]: cluster 2021-03-10T16:32:52.272032+0000 mgr.gibba043.dnkmem (mgr.34373) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:53 gibba043 bash[24019]: cluster 2021-03-10T16:32:52.272032+0000 mgr.gibba043.dnkmem (mgr.34373) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:56.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:55 gibba003 bash[31385]: cluster 2021-03-10T16:32:54.273394+0000 mgr.gibba043.dnkmem (mgr.34373) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:56.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:55 gibba003 bash[32348]: cluster 2021-03-10T16:32:54.273394+0000 mgr.gibba043.dnkmem (mgr.34373) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:55 gibba043 bash[24019]: cluster 2021-03-10T16:32:54.273394+0000 mgr.gibba043.dnkmem (mgr.34373) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:57 gibba003 bash[31385]: cluster 2021-03-10T16:32:56.275157+0000 mgr.gibba043.dnkmem (mgr.34373) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:57 gibba003 bash[32348]: cluster 2021-03-10T16:32:56.275157+0000 mgr.gibba043.dnkmem (mgr.34373) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:57 gibba043 bash[24019]: cluster 2021-03-10T16:32:56.275157+0000 mgr.gibba043.dnkmem (mgr.34373) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:00.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:32:59 gibba003 bash[31385]: cluster 2021-03-10T16:32:58.276715+0000 mgr.gibba043.dnkmem (mgr.34373) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:00.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:32:59 gibba003 bash[32348]: cluster 2021-03-10T16:32:58.276715+0000 mgr.gibba043.dnkmem (mgr.34373) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:00.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:32:59 gibba043 bash[24019]: cluster 2021-03-10T16:32:58.276715+0000 mgr.gibba043.dnkmem (mgr.34373) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.161 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:01 gibba043 bash[24019]: cluster 2021-03-10T16:33:00.277966+0000 mgr.gibba043.dnkmem (mgr.34373) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:01 gibba003 bash[31385]: cluster 2021-03-10T16:33:00.277966+0000 mgr.gibba043.dnkmem (mgr.34373) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:01 gibba003 bash[32348]: cluster 2021-03-10T16:33:00.277966+0000 mgr.gibba043.dnkmem (mgr.34373) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:03 gibba003 bash[31385]: cephadm 2021-03-10T16:33:02.162996+0000 mgr.gibba043.dnkmem (mgr.34373) 8549 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:04.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:03 gibba003 bash[31385]: cluster 2021-03-10T16:33:02.279453+0000 mgr.gibba043.dnkmem (mgr.34373) 8550 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:03 gibba003 bash[32348]: cephadm 2021-03-10T16:33:02.162996+0000 mgr.gibba043.dnkmem (mgr.34373) 8549 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:03 gibba003 bash[32348]: cluster 2021-03-10T16:33:02.279453+0000 mgr.gibba043.dnkmem (mgr.34373) 8550 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:03 gibba043 bash[24019]: cephadm 2021-03-10T16:33:02.162996+0000 mgr.gibba043.dnkmem (mgr.34373) 8549 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:03 gibba043 bash[24019]: cluster 2021-03-10T16:33:02.279453+0000 mgr.gibba043.dnkmem (mgr.34373) 8550 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:05 gibba003 bash[31385]: cluster 2021-03-10T16:33:04.281018+0000 mgr.gibba043.dnkmem (mgr.34373) 8551 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:06.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:05 gibba003 bash[32348]: cluster 2021-03-10T16:33:04.281018+0000 mgr.gibba043.dnkmem (mgr.34373) 8551 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:05 gibba043 bash[24019]: cluster 2021-03-10T16:33:04.281018+0000 mgr.gibba043.dnkmem (mgr.34373) 8551 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:07 gibba003 bash[31385]: cluster 2021-03-10T16:33:06.282654+0000 mgr.gibba043.dnkmem (mgr.34373) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:07 gibba003 bash[32348]: cluster 2021-03-10T16:33:06.282654+0000 mgr.gibba043.dnkmem (mgr.34373) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:07 gibba043 bash[24019]: cluster 2021-03-10T16:33:06.282654+0000 mgr.gibba043.dnkmem (mgr.34373) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:09 gibba003 bash[31385]: cluster 2021-03-10T16:33:08.284202+0000 mgr.gibba043.dnkmem (mgr.34373) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:09 gibba003 bash[32348]: cluster 2021-03-10T16:33:08.284202+0000 mgr.gibba043.dnkmem (mgr.34373) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:09 gibba043 bash[24019]: cluster 2021-03-10T16:33:08.284202+0000 mgr.gibba043.dnkmem (mgr.34373) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:11 gibba003 bash[31385]: cluster 2021-03-10T16:33:10.285492+0000 mgr.gibba043.dnkmem (mgr.34373) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:11 gibba003 bash[32348]: cluster 2021-03-10T16:33:10.285492+0000 mgr.gibba043.dnkmem (mgr.34373) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:11 gibba043 bash[24019]: cluster 2021-03-10T16:33:10.285492+0000 mgr.gibba043.dnkmem (mgr.34373) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:13 gibba003 bash[31385]: cluster 2021-03-10T16:33:12.287007+0000 mgr.gibba043.dnkmem (mgr.34373) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:13 gibba003 bash[31385]: audit 2021-03-10T16:33:13.761974+0000 mon.c (mon.1) 2204 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:13 gibba003 bash[31385]: audit 2021-03-10T16:33:13.763094+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:13 gibba003 bash[32348]: cluster 2021-03-10T16:33:12.287007+0000 mgr.gibba043.dnkmem (mgr.34373) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:13 gibba003 bash[32348]: audit 2021-03-10T16:33:13.761974+0000 mon.c (mon.1) 2204 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:13 gibba003 bash[32348]: audit 2021-03-10T16:33:13.763094+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:13 gibba043 bash[24019]: cluster 2021-03-10T16:33:12.287007+0000 mgr.gibba043.dnkmem (mgr.34373) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:13 gibba043 bash[24019]: audit 2021-03-10T16:33:13.761974+0000 mon.c (mon.1) 2204 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:13 gibba043 bash[24019]: audit 2021-03-10T16:33:13.763094+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:13.983595+0000 mon.c (mon.1) 2205 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:13.984721+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.183944+0000 mon.c (mon.1) 2206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:33:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.184738+0000 mon.c (mon.1) 2207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.185220+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:33:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.185771+0000 mon.c (mon.1) 2208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.186558+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.187199+0000 mon.c (mon.1) 2209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.187365+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[31385]: audit 2021-03-10T16:33:14.188296+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:13.983595+0000 mon.c (mon.1) 2205 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:13.984721+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.183944+0000 mon.c (mon.1) 2206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:33:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.184738+0000 mon.c (mon.1) 2207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.185220+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:33:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.185771+0000 mon.c (mon.1) 2208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.186558+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.187199+0000 mon.c (mon.1) 2209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.187365+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:14 gibba003 bash[32348]: audit 2021-03-10T16:33:14.188296+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:13.983595+0000 mon.c (mon.1) 2205 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:13.984721+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.183944+0000 mon.c (mon.1) 2206 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:33:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.184738+0000 mon.c (mon.1) 2207 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.185220+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:33:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.185771+0000 mon.c (mon.1) 2208 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.186558+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.187199+0000 mon.c (mon.1) 2209 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.187365+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:33:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:14 gibba043 bash[24019]: audit 2021-03-10T16:33:14.188296+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:15 gibba003 bash[31385]: cluster 2021-03-10T16:33:14.288507+0000 mgr.gibba043.dnkmem (mgr.34373) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:15 gibba003 bash[32348]: cluster 2021-03-10T16:33:14.288507+0000 mgr.gibba043.dnkmem (mgr.34373) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:15 gibba043 bash[24019]: cluster 2021-03-10T16:33:14.288507+0000 mgr.gibba043.dnkmem (mgr.34373) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:17 gibba003 bash[31385]: cluster 2021-03-10T16:33:16.290145+0000 mgr.gibba043.dnkmem (mgr.34373) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:17 gibba003 bash[32348]: cluster 2021-03-10T16:33:16.290145+0000 mgr.gibba043.dnkmem (mgr.34373) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:17 gibba043 bash[24019]: cluster 2021-03-10T16:33:16.290145+0000 mgr.gibba043.dnkmem (mgr.34373) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:19.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:18 gibba003 bash[31385]: cephadm 2021-03-10T16:33:17.179041+0000 mgr.gibba043.dnkmem (mgr.34373) 8558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:19.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:18 gibba003 bash[32348]: cephadm 2021-03-10T16:33:17.179041+0000 mgr.gibba043.dnkmem (mgr.34373) 8558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:19.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:18 gibba043 bash[24019]: cephadm 2021-03-10T16:33:17.179041+0000 mgr.gibba043.dnkmem (mgr.34373) 8558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:19 gibba003 bash[31385]: cluster 2021-03-10T16:33:18.291712+0000 mgr.gibba043.dnkmem (mgr.34373) 8559 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:19 gibba003 bash[32348]: cluster 2021-03-10T16:33:18.291712+0000 mgr.gibba043.dnkmem (mgr.34373) 8559 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:19 gibba043 bash[24019]: cluster 2021-03-10T16:33:18.291712+0000 mgr.gibba043.dnkmem (mgr.34373) 8559 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:21.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:20 gibba003 bash[31385]: cluster 2021-03-10T16:33:20.292889+0000 mgr.gibba043.dnkmem (mgr.34373) 8560 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:21.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:20 gibba003 bash[32348]: cluster 2021-03-10T16:33:20.292889+0000 mgr.gibba043.dnkmem (mgr.34373) 8560 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:21.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:20 gibba043 bash[24019]: cluster 2021-03-10T16:33:20.292889+0000 mgr.gibba043.dnkmem (mgr.34373) 8560 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:22.283 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:33:22.510 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:33:22.510 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:33:22.511 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:33:22.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:33:22.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:33:22.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:33:22.512 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:33:22.512 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:33:22.512 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:33:22.512 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:33:22.512 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:33:22.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:33:22.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:33:22.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:33:22.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:33:22.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:33:22.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:33:22.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:33:22.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:33:22.514 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:33:22.515 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:33:22.759 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:33:22.760 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:33:22.760 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:22.760 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:33:22.760 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:33:22.760 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:22.761 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:33:22.761 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:33:22.761 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:33:22.761 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:33:22.761 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:33:22.762 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:33:22.762 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:33:22.762 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:33:22.762 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:33:23.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:23 gibba043 bash[24019]: audit 2021-03-10T16:33:22.275777+0000 mgr.gibba043.dnkmem (mgr.34373) 8561 : audit [DBG] from='client.59782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:23 gibba043 bash[24019]: cluster 2021-03-10T16:33:22.294391+0000 mgr.gibba043.dnkmem (mgr.34373) 8562 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:23 gibba043 bash[24019]: audit 2021-03-10T16:33:22.503071+0000 mgr.gibba043.dnkmem (mgr.34373) 8563 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:23 gibba043 bash[24019]: audit 2021-03-10T16:33:22.762955+0000 mon.c (mon.1) 2210 : audit [DBG] from='client.? 172.21.2.103:0/2444128338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:23.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[31385]: audit 2021-03-10T16:33:22.275777+0000 mgr.gibba043.dnkmem (mgr.34373) 8561 : audit [DBG] from='client.59782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[31385]: cluster 2021-03-10T16:33:22.294391+0000 mgr.gibba043.dnkmem (mgr.34373) 8562 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[31385]: audit 2021-03-10T16:33:22.503071+0000 mgr.gibba043.dnkmem (mgr.34373) 8563 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:23.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[31385]: audit 2021-03-10T16:33:22.762955+0000 mon.c (mon.1) 2210 : audit [DBG] from='client.? 172.21.2.103:0/2444128338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:23.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[32348]: audit 2021-03-10T16:33:22.275777+0000 mgr.gibba043.dnkmem (mgr.34373) 8561 : audit [DBG] from='client.59782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[32348]: cluster 2021-03-10T16:33:22.294391+0000 mgr.gibba043.dnkmem (mgr.34373) 8562 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[32348]: audit 2021-03-10T16:33:22.503071+0000 mgr.gibba043.dnkmem (mgr.34373) 8563 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:23.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:23 gibba003 bash[32348]: audit 2021-03-10T16:33:22.762955+0000 mon.c (mon.1) 2210 : audit [DBG] from='client.? 172.21.2.103:0/2444128338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:25.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:25 gibba043 bash[24019]: cluster 2021-03-10T16:33:24.295947+0000 mgr.gibba043.dnkmem (mgr.34373) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:25.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:25 gibba003 bash[31385]: cluster 2021-03-10T16:33:24.295947+0000 mgr.gibba043.dnkmem (mgr.34373) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:25.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:25 gibba003 bash[32348]: cluster 2021-03-10T16:33:24.295947+0000 mgr.gibba043.dnkmem (mgr.34373) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:27.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:27 gibba043 bash[24019]: cluster 2021-03-10T16:33:26.297669+0000 mgr.gibba043.dnkmem (mgr.34373) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:27.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:27 gibba003 bash[31385]: cluster 2021-03-10T16:33:26.297669+0000 mgr.gibba043.dnkmem (mgr.34373) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:27.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:27 gibba003 bash[32348]: cluster 2021-03-10T16:33:26.297669+0000 mgr.gibba043.dnkmem (mgr.34373) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:29 gibba043 bash[24019]: cluster 2021-03-10T16:33:28.303176+0000 mgr.gibba043.dnkmem (mgr.34373) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:29 gibba003 bash[31385]: cluster 2021-03-10T16:33:28.303176+0000 mgr.gibba043.dnkmem (mgr.34373) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:29 gibba003 bash[32348]: cluster 2021-03-10T16:33:28.303176+0000 mgr.gibba043.dnkmem (mgr.34373) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:31.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:31 gibba043 bash[24019]: cluster 2021-03-10T16:33:30.304597+0000 mgr.gibba043.dnkmem (mgr.34373) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:31.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:31 gibba003 bash[31385]: cluster 2021-03-10T16:33:30.304597+0000 mgr.gibba043.dnkmem (mgr.34373) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:31.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:31 gibba003 bash[32348]: cluster 2021-03-10T16:33:30.304597+0000 mgr.gibba043.dnkmem (mgr.34373) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:33.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:33 gibba043 bash[24019]: cephadm 2021-03-10T16:33:32.192447+0000 mgr.gibba043.dnkmem (mgr.34373) 8568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:33.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:33 gibba043 bash[24019]: cluster 2021-03-10T16:33:32.305966+0000 mgr.gibba043.dnkmem (mgr.34373) 8569 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:33.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:33 gibba003 bash[31385]: cephadm 2021-03-10T16:33:32.192447+0000 mgr.gibba043.dnkmem (mgr.34373) 8568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:33 gibba003 bash[31385]: cluster 2021-03-10T16:33:32.305966+0000 mgr.gibba043.dnkmem (mgr.34373) 8569 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:33 gibba003 bash[32348]: cephadm 2021-03-10T16:33:32.192447+0000 mgr.gibba043.dnkmem (mgr.34373) 8568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:33 gibba003 bash[32348]: cluster 2021-03-10T16:33:32.305966+0000 mgr.gibba043.dnkmem (mgr.34373) 8569 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:35.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:35 gibba043 bash[24019]: cluster 2021-03-10T16:33:34.307367+0000 mgr.gibba043.dnkmem (mgr.34373) 8570 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:35.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:35 gibba003 bash[31385]: cluster 2021-03-10T16:33:34.307367+0000 mgr.gibba043.dnkmem (mgr.34373) 8570 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:35.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:35 gibba003 bash[32348]: cluster 2021-03-10T16:33:34.307367+0000 mgr.gibba043.dnkmem (mgr.34373) 8570 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:37.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:37 gibba003 bash[31385]: cluster 2021-03-10T16:33:36.309279+0000 mgr.gibba043.dnkmem (mgr.34373) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:37.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:37 gibba003 bash[32348]: cluster 2021-03-10T16:33:36.309279+0000 mgr.gibba043.dnkmem (mgr.34373) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:37 gibba043 bash[24019]: cluster 2021-03-10T16:33:36.309279+0000 mgr.gibba043.dnkmem (mgr.34373) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:39.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:39 gibba003 bash[31385]: cluster 2021-03-10T16:33:38.309870+0000 mgr.gibba043.dnkmem (mgr.34373) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:39.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:39 gibba003 bash[32348]: cluster 2021-03-10T16:33:38.309870+0000 mgr.gibba043.dnkmem (mgr.34373) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:39 gibba043 bash[24019]: cluster 2021-03-10T16:33:38.309870+0000 mgr.gibba043.dnkmem (mgr.34373) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:41.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:41 gibba003 bash[31385]: cluster 2021-03-10T16:33:40.311126+0000 mgr.gibba043.dnkmem (mgr.34373) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:41.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:41 gibba003 bash[32348]: cluster 2021-03-10T16:33:40.311126+0000 mgr.gibba043.dnkmem (mgr.34373) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:41 gibba043 bash[24019]: cluster 2021-03-10T16:33:40.311126+0000 mgr.gibba043.dnkmem (mgr.34373) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:43.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:43 gibba003 bash[31385]: cluster 2021-03-10T16:33:42.312873+0000 mgr.gibba043.dnkmem (mgr.34373) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:43.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:43 gibba003 bash[32348]: cluster 2021-03-10T16:33:42.312873+0000 mgr.gibba043.dnkmem (mgr.34373) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:44.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:43 gibba043 bash[24019]: cluster 2021-03-10T16:33:42.312873+0000 mgr.gibba043.dnkmem (mgr.34373) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:45.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:45 gibba003 bash[31385]: cluster 2021-03-10T16:33:44.314671+0000 mgr.gibba043.dnkmem (mgr.34373) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:45.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:45 gibba003 bash[32348]: cluster 2021-03-10T16:33:44.314671+0000 mgr.gibba043.dnkmem (mgr.34373) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:45 gibba043 bash[24019]: cluster 2021-03-10T16:33:44.314671+0000 mgr.gibba043.dnkmem (mgr.34373) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: cluster 2021-03-10T16:33:46.316714+0000 mgr.gibba043.dnkmem (mgr.34373) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.407695+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:33:47.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.411203+0000 mon.c (mon.1) 2211 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.412874+0000 mon.c (mon.1) 2212 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.414144+0000 mon.c (mon.1) 2213 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.415524+0000 mon.c (mon.1) 2214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.418938+0000 mon.c (mon.1) 2215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:47 gibba043 bash[24019]: audit 2021-03-10T16:33:47.420290+0000 mon.c (mon.1) 2216 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: cluster 2021-03-10T16:33:46.316714+0000 mgr.gibba043.dnkmem (mgr.34373) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.407695+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:33:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.411203+0000 mon.c (mon.1) 2211 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:47.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.412874+0000 mon.c (mon.1) 2212 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.414144+0000 mon.c (mon.1) 2213 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.415524+0000 mon.c (mon.1) 2214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.418938+0000 mon.c (mon.1) 2215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[31385]: audit 2021-03-10T16:33:47.420290+0000 mon.c (mon.1) 2216 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: cluster 2021-03-10T16:33:46.316714+0000 mgr.gibba043.dnkmem (mgr.34373) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.407695+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:33:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.411203+0000 mon.c (mon.1) 2211 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.412874+0000 mon.c (mon.1) 2212 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.414144+0000 mon.c (mon.1) 2213 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.415524+0000 mon.c (mon.1) 2214 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.418938+0000 mon.c (mon.1) 2215 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:47 gibba003 bash[32348]: audit 2021-03-10T16:33:47.420290+0000 mon.c (mon.1) 2216 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:48.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.209311+0000 mgr.gibba043.dnkmem (mgr.34373) 8577 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:33:48.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.210915+0000 mgr.gibba043.dnkmem (mgr.34373) 8578 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:33:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.408895+0000 mgr.gibba043.dnkmem (mgr.34373) 8579 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.410791+0000 mgr.gibba043.dnkmem (mgr.34373) 8580 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.412033+0000 mgr.gibba043.dnkmem (mgr.34373) 8581 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:48.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.412068+0000 mgr.gibba043.dnkmem (mgr.34373) 8582 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.413550+0000 mgr.gibba043.dnkmem (mgr.34373) 8583 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.413585+0000 mgr.gibba043.dnkmem (mgr.34373) 8584 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.415087+0000 mgr.gibba043.dnkmem (mgr.34373) 8585 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.416781+0000 mgr.gibba043.dnkmem (mgr.34373) 8586 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.416815+0000 mgr.gibba043.dnkmem (mgr.34373) 8587 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.418131+0000 mgr.gibba043.dnkmem (mgr.34373) 8588 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.418441+0000 mgr.gibba043.dnkmem (mgr.34373) 8589 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.419437+0000 mgr.gibba043.dnkmem (mgr.34373) 8590 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.419474+0000 mgr.gibba043.dnkmem (mgr.34373) 8591 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[31385]: cephadm 2021-03-10T16:33:47.419588+0000 mgr.gibba043.dnkmem (mgr.34373) 8592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:48.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.209311+0000 mgr.gibba043.dnkmem (mgr.34373) 8577 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:33:48.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.210915+0000 mgr.gibba043.dnkmem (mgr.34373) 8578 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:33:48.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.408895+0000 mgr.gibba043.dnkmem (mgr.34373) 8579 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.410791+0000 mgr.gibba043.dnkmem (mgr.34373) 8580 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.412033+0000 mgr.gibba043.dnkmem (mgr.34373) 8581 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.412068+0000 mgr.gibba043.dnkmem (mgr.34373) 8582 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.413550+0000 mgr.gibba043.dnkmem (mgr.34373) 8583 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.413585+0000 mgr.gibba043.dnkmem (mgr.34373) 8584 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.415087+0000 mgr.gibba043.dnkmem (mgr.34373) 8585 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.416781+0000 mgr.gibba043.dnkmem (mgr.34373) 8586 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.416815+0000 mgr.gibba043.dnkmem (mgr.34373) 8587 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.418131+0000 mgr.gibba043.dnkmem (mgr.34373) 8588 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.418441+0000 mgr.gibba043.dnkmem (mgr.34373) 8589 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.419437+0000 mgr.gibba043.dnkmem (mgr.34373) 8590 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.419474+0000 mgr.gibba043.dnkmem (mgr.34373) 8591 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:48 gibba003 bash[32348]: cephadm 2021-03-10T16:33:47.419588+0000 mgr.gibba043.dnkmem (mgr.34373) 8592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:49.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.209311+0000 mgr.gibba043.dnkmem (mgr.34373) 8577 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:33:49.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.210915+0000 mgr.gibba043.dnkmem (mgr.34373) 8578 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:33:49.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.408895+0000 mgr.gibba043.dnkmem (mgr.34373) 8579 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.410791+0000 mgr.gibba043.dnkmem (mgr.34373) 8580 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.412033+0000 mgr.gibba043.dnkmem (mgr.34373) 8581 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.412068+0000 mgr.gibba043.dnkmem (mgr.34373) 8582 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.413550+0000 mgr.gibba043.dnkmem (mgr.34373) 8583 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:49.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.413585+0000 mgr.gibba043.dnkmem (mgr.34373) 8584 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.415087+0000 mgr.gibba043.dnkmem (mgr.34373) 8585 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.416781+0000 mgr.gibba043.dnkmem (mgr.34373) 8586 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.416815+0000 mgr.gibba043.dnkmem (mgr.34373) 8587 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.418131+0000 mgr.gibba043.dnkmem (mgr.34373) 8588 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.418441+0000 mgr.gibba043.dnkmem (mgr.34373) 8589 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.419437+0000 mgr.gibba043.dnkmem (mgr.34373) 8590 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.419474+0000 mgr.gibba043.dnkmem (mgr.34373) 8591 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:48 gibba043 bash[24019]: cephadm 2021-03-10T16:33:47.419588+0000 mgr.gibba043.dnkmem (mgr.34373) 8592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:33:49.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:49 gibba003 bash[31385]: cluster 2021-03-10T16:33:48.317504+0000 mgr.gibba043.dnkmem (mgr.34373) 8593 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:49.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:49 gibba003 bash[32348]: cluster 2021-03-10T16:33:48.317504+0000 mgr.gibba043.dnkmem (mgr.34373) 8593 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:49 gibba043 bash[24019]: cluster 2021-03-10T16:33:48.317504+0000 mgr.gibba043.dnkmem (mgr.34373) 8593 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:51.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:51 gibba003 bash[31385]: cluster 2021-03-10T16:33:50.318602+0000 mgr.gibba043.dnkmem (mgr.34373) 8594 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:51 gibba003 bash[32348]: cluster 2021-03-10T16:33:50.318602+0000 mgr.gibba043.dnkmem (mgr.34373) 8594 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:52.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:51 gibba043 bash[24019]: cluster 2021-03-10T16:33:50.318602+0000 mgr.gibba043.dnkmem (mgr.34373) 8594 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:53.003 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:33:53.230 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:33:53.231 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:33:53.231 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:33:53.231 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:33:53.231 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:33:53.232 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:33:53.232 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:33:53.232 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:33:53.232 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:33:53.232 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:33:53.233 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:33:53.233 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:33:53.233 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:33:53.233 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:33:53.233 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:33:53.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:33:53.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:33:53.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:33:53.234 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:33:53.234 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:33:53.235 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:33:53.483 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:33:53.483 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:33:53.483 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:53.484 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:33:53.484 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:33:53.484 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:53.484 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:33:53.484 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:33:53.485 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:33:53.485 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:33:53.485 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:33:53.485 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:33:53.485 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:33:53.486 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:33:53.486 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:33:53.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:53 gibba003 bash[31385]: cluster 2021-03-10T16:33:52.320136+0000 mgr.gibba043.dnkmem (mgr.34373) 8595 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:53.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:53 gibba003 bash[31385]: audit 2021-03-10T16:33:53.486492+0000 mon.c (mon.1) 2217 : audit [DBG] from='client.? 172.21.2.103:0/902364449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:53.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:53 gibba003 bash[32348]: cluster 2021-03-10T16:33:52.320136+0000 mgr.gibba043.dnkmem (mgr.34373) 8595 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:53.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:53 gibba003 bash[32348]: audit 2021-03-10T16:33:53.486492+0000 mon.c (mon.1) 2217 : audit [DBG] from='client.? 172.21.2.103:0/902364449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:54.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:53 gibba043 bash[24019]: cluster 2021-03-10T16:33:52.320136+0000 mgr.gibba043.dnkmem (mgr.34373) 8595 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:54.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:53 gibba043 bash[24019]: audit 2021-03-10T16:33:53.486492+0000 mon.c (mon.1) 2217 : audit [DBG] from='client.? 172.21.2.103:0/902364449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:54.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:54 gibba003 bash[31385]: audit 2021-03-10T16:33:52.996316+0000 mgr.gibba043.dnkmem (mgr.34373) 8596 : audit [DBG] from='client.49812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:54.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:54 gibba003 bash[31385]: audit 2021-03-10T16:33:53.220620+0000 mgr.gibba043.dnkmem (mgr.34373) 8597 : audit [DBG] from='client.59806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:54.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:54 gibba003 bash[32348]: audit 2021-03-10T16:33:52.996316+0000 mgr.gibba043.dnkmem (mgr.34373) 8596 : audit [DBG] from='client.49812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:54.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:54 gibba003 bash[32348]: audit 2021-03-10T16:33:53.220620+0000 mgr.gibba043.dnkmem (mgr.34373) 8597 : audit [DBG] from='client.59806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:55.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:54 gibba043 bash[24019]: audit 2021-03-10T16:33:52.996316+0000 mgr.gibba043.dnkmem (mgr.34373) 8596 : audit [DBG] from='client.49812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:55.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:54 gibba043 bash[24019]: audit 2021-03-10T16:33:53.220620+0000 mgr.gibba043.dnkmem (mgr.34373) 8597 : audit [DBG] from='client.59806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:55.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:55 gibba003 bash[31385]: cluster 2021-03-10T16:33:54.321813+0000 mgr.gibba043.dnkmem (mgr.34373) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:55.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:55 gibba003 bash[32348]: cluster 2021-03-10T16:33:54.321813+0000 mgr.gibba043.dnkmem (mgr.34373) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:56.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:55 gibba043 bash[24019]: cluster 2021-03-10T16:33:54.321813+0000 mgr.gibba043.dnkmem (mgr.34373) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:57.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:57 gibba003 bash[31385]: cluster 2021-03-10T16:33:56.323804+0000 mgr.gibba043.dnkmem (mgr.34373) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:57.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:57 gibba003 bash[32348]: cluster 2021-03-10T16:33:56.323804+0000 mgr.gibba043.dnkmem (mgr.34373) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:57 gibba043 bash[24019]: cluster 2021-03-10T16:33:56.323804+0000 mgr.gibba043.dnkmem (mgr.34373) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:59.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:33:59 gibba003 bash[31385]: cluster 2021-03-10T16:33:58.324652+0000 mgr.gibba043.dnkmem (mgr.34373) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:33:59 gibba003 bash[32348]: cluster 2021-03-10T16:33:58.324652+0000 mgr.gibba043.dnkmem (mgr.34373) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:33:59 gibba043 bash[24019]: cluster 2021-03-10T16:33:58.324652+0000 mgr.gibba043.dnkmem (mgr.34373) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:01.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:01 gibba003 bash[31385]: cluster 2021-03-10T16:34:00.326035+0000 mgr.gibba043.dnkmem (mgr.34373) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:01.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:01 gibba003 bash[32348]: cluster 2021-03-10T16:34:00.326035+0000 mgr.gibba043.dnkmem (mgr.34373) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:02.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:01 gibba043 bash[24019]: cluster 2021-03-10T16:34:00.326035+0000 mgr.gibba043.dnkmem (mgr.34373) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:03.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:03 gibba003 bash[31385]: cluster 2021-03-10T16:34:02.327761+0000 mgr.gibba043.dnkmem (mgr.34373) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:03.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:03 gibba003 bash[31385]: cephadm 2021-03-10T16:34:02.435621+0000 mgr.gibba043.dnkmem (mgr.34373) 8603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:03 gibba003 bash[32348]: cluster 2021-03-10T16:34:02.327761+0000 mgr.gibba043.dnkmem (mgr.34373) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:03 gibba003 bash[32348]: cephadm 2021-03-10T16:34:02.435621+0000 mgr.gibba043.dnkmem (mgr.34373) 8603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:04.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:03 gibba043 bash[24019]: cluster 2021-03-10T16:34:02.327761+0000 mgr.gibba043.dnkmem (mgr.34373) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:04.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:03 gibba043 bash[24019]: cephadm 2021-03-10T16:34:02.435621+0000 mgr.gibba043.dnkmem (mgr.34373) 8603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:05.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:05 gibba003 bash[31385]: cluster 2021-03-10T16:34:04.329370+0000 mgr.gibba043.dnkmem (mgr.34373) 8604 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:05.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:05 gibba003 bash[32348]: cluster 2021-03-10T16:34:04.329370+0000 mgr.gibba043.dnkmem (mgr.34373) 8604 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:05 gibba043 bash[24019]: cluster 2021-03-10T16:34:04.329370+0000 mgr.gibba043.dnkmem (mgr.34373) 8604 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:07 gibba003 bash[31385]: cluster 2021-03-10T16:34:06.331232+0000 mgr.gibba043.dnkmem (mgr.34373) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:07 gibba003 bash[32348]: cluster 2021-03-10T16:34:06.331232+0000 mgr.gibba043.dnkmem (mgr.34373) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:07 gibba043 bash[24019]: cluster 2021-03-10T16:34:06.331232+0000 mgr.gibba043.dnkmem (mgr.34373) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:09.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:09 gibba003 bash[31385]: cluster 2021-03-10T16:34:08.332149+0000 mgr.gibba043.dnkmem (mgr.34373) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:09 gibba003 bash[32348]: cluster 2021-03-10T16:34:08.332149+0000 mgr.gibba043.dnkmem (mgr.34373) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:09 gibba043 bash[24019]: cluster 2021-03-10T16:34:08.332149+0000 mgr.gibba043.dnkmem (mgr.34373) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:11.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:11 gibba003 bash[31385]: cluster 2021-03-10T16:34:10.333258+0000 mgr.gibba043.dnkmem (mgr.34373) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:11.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:11 gibba003 bash[32348]: cluster 2021-03-10T16:34:10.333258+0000 mgr.gibba043.dnkmem (mgr.34373) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:12.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:11 gibba043 bash[24019]: cluster 2021-03-10T16:34:10.333258+0000 mgr.gibba043.dnkmem (mgr.34373) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:13 gibba043 bash[24019]: cluster 2021-03-10T16:34:12.334925+0000 mgr.gibba043.dnkmem (mgr.34373) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:13 gibba003 bash[31385]: cluster 2021-03-10T16:34:12.334925+0000 mgr.gibba043.dnkmem (mgr.34373) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:13 gibba003 bash[32348]: cluster 2021-03-10T16:34:12.334925+0000 mgr.gibba043.dnkmem (mgr.34373) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:13.768179+0000 mon.c (mon.1) 2218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:13.768827+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:13.989415+0000 mon.c (mon.1) 2219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:13.990687+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.195294+0000 mon.c (mon.1) 2220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:34:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.196440+0000 mon.c (mon.1) 2221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.196715+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:34:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.197477+0000 mon.c (mon.1) 2222 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:34:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.197761+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.198717+0000 mon.a (mon.0) 1828 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:34:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.198984+0000 mon.c (mon.1) 2223 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:14 gibba043 bash[24019]: audit 2021-03-10T16:34:14.199629+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:13.768179+0000 mon.c (mon.1) 2218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:13.768827+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:13.989415+0000 mon.c (mon.1) 2219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:13.990687+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.195294+0000 mon.c (mon.1) 2220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:34:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.196440+0000 mon.c (mon.1) 2221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.196715+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:34:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.197477+0000 mon.c (mon.1) 2222 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:34:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.197761+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.198717+0000 mon.a (mon.0) 1828 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:34:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.198984+0000 mon.c (mon.1) 2223 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[31385]: audit 2021-03-10T16:34:14.199629+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:13.768179+0000 mon.c (mon.1) 2218 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:13.768827+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:13.989415+0000 mon.c (mon.1) 2219 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:13.990687+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.195294+0000 mon.c (mon.1) 2220 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:34:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.196440+0000 mon.c (mon.1) 2221 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.196715+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:34:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.197477+0000 mon.c (mon.1) 2222 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:34:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.197761+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.198717+0000 mon.a (mon.0) 1828 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:34:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.198984+0000 mon.c (mon.1) 2223 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:34:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:14 gibba003 bash[32348]: audit 2021-03-10T16:34:14.199629+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:34:16.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:15 gibba043 bash[24019]: cluster 2021-03-10T16:34:14.336628+0000 mgr.gibba043.dnkmem (mgr.34373) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:15 gibba003 bash[31385]: cluster 2021-03-10T16:34:14.336628+0000 mgr.gibba043.dnkmem (mgr.34373) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:15 gibba003 bash[32348]: cluster 2021-03-10T16:34:14.336628+0000 mgr.gibba043.dnkmem (mgr.34373) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:17 gibba043 bash[24019]: cluster 2021-03-10T16:34:16.338495+0000 mgr.gibba043.dnkmem (mgr.34373) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:17 gibba003 bash[31385]: cluster 2021-03-10T16:34:16.338495+0000 mgr.gibba043.dnkmem (mgr.34373) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:17 gibba003 bash[32348]: cluster 2021-03-10T16:34:16.338495+0000 mgr.gibba043.dnkmem (mgr.34373) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:19.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:18 gibba043 bash[24019]: cephadm 2021-03-10T16:34:17.451770+0000 mgr.gibba043.dnkmem (mgr.34373) 8611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:19.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:18 gibba003 bash[31385]: cephadm 2021-03-10T16:34:17.451770+0000 mgr.gibba043.dnkmem (mgr.34373) 8611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:19.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:18 gibba003 bash[32348]: cephadm 2021-03-10T16:34:17.451770+0000 mgr.gibba043.dnkmem (mgr.34373) 8611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:19 gibba043 bash[24019]: cluster 2021-03-10T16:34:18.339362+0000 mgr.gibba043.dnkmem (mgr.34373) 8612 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:19 gibba003 bash[31385]: cluster 2021-03-10T16:34:18.339362+0000 mgr.gibba043.dnkmem (mgr.34373) 8612 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:19 gibba003 bash[32348]: cluster 2021-03-10T16:34:18.339362+0000 mgr.gibba043.dnkmem (mgr.34373) 8612 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:21 gibba043 bash[24019]: cluster 2021-03-10T16:34:20.340756+0000 mgr.gibba043.dnkmem (mgr.34373) 8613 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:21 gibba003 bash[31385]: cluster 2021-03-10T16:34:20.340756+0000 mgr.gibba043.dnkmem (mgr.34373) 8613 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:22.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:21 gibba003 bash[32348]: cluster 2021-03-10T16:34:20.340756+0000 mgr.gibba043.dnkmem (mgr.34373) 8613 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:23.728 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:34:23.957 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:34:23.957 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:34:23.957 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:34:23.958 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:34:23.958 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:34:23.958 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:34:23.958 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:34:23.958 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:34:23.959 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:34:23.959 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:34:23.959 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:34:23.959 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:34:23.959 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:34:23.960 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:34:23.960 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:34:23.960 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:34:23.960 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:34:23.960 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:34:23.961 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:34:23.961 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:34:23.961 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:34:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:23 gibba043 bash[24019]: cluster 2021-03-10T16:34:22.342444+0000 mgr.gibba043.dnkmem (mgr.34373) 8614 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:23 gibba003 bash[31385]: cluster 2021-03-10T16:34:22.342444+0000 mgr.gibba043.dnkmem (mgr.34373) 8614 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:24.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:23 gibba003 bash[32348]: cluster 2021-03-10T16:34:22.342444+0000 mgr.gibba043.dnkmem (mgr.34373) 8614 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:24.211 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:34:24.211 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:34:24.211 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:24.211 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:34:24.212 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:34:24.212 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:24.212 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:34:24.212 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:34:24.212 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:34:24.213 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:34:24.213 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:34:24.213 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:34:24.213 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:34:24.213 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:34:24.214 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:34:25.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:24 gibba043 bash[24019]: audit 2021-03-10T16:34:23.720609+0000 mgr.gibba043.dnkmem (mgr.34373) 8615 : audit [DBG] from='client.49830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:25.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:24 gibba043 bash[24019]: audit 2021-03-10T16:34:24.214765+0000 mon.a (mon.0) 1830 : audit [DBG] from='client.? 172.21.2.103:0/3179736064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:25.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:24 gibba003 bash[31385]: audit 2021-03-10T16:34:23.720609+0000 mgr.gibba043.dnkmem (mgr.34373) 8615 : audit [DBG] from='client.49830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:25.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:24 gibba003 bash[31385]: audit 2021-03-10T16:34:24.214765+0000 mon.a (mon.0) 1830 : audit [DBG] from='client.? 172.21.2.103:0/3179736064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:25.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:24 gibba003 bash[32348]: audit 2021-03-10T16:34:23.720609+0000 mgr.gibba043.dnkmem (mgr.34373) 8615 : audit [DBG] from='client.49830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:25.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:24 gibba003 bash[32348]: audit 2021-03-10T16:34:24.214765+0000 mon.a (mon.0) 1830 : audit [DBG] from='client.? 172.21.2.103:0/3179736064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:26.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:25 gibba043 bash[24019]: audit 2021-03-10T16:34:23.946821+0000 mgr.gibba043.dnkmem (mgr.34373) 8616 : audit [DBG] from='client.49836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:26.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:25 gibba043 bash[24019]: cluster 2021-03-10T16:34:24.344111+0000 mgr.gibba043.dnkmem (mgr.34373) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:25 gibba003 bash[31385]: audit 2021-03-10T16:34:23.946821+0000 mgr.gibba043.dnkmem (mgr.34373) 8616 : audit [DBG] from='client.49836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:26.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:25 gibba003 bash[31385]: cluster 2021-03-10T16:34:24.344111+0000 mgr.gibba043.dnkmem (mgr.34373) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:25 gibba003 bash[32348]: audit 2021-03-10T16:34:23.946821+0000 mgr.gibba043.dnkmem (mgr.34373) 8616 : audit [DBG] from='client.49836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:25 gibba003 bash[32348]: cluster 2021-03-10T16:34:24.344111+0000 mgr.gibba043.dnkmem (mgr.34373) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:27 gibba003 bash[31385]: cluster 2021-03-10T16:34:26.345845+0000 mgr.gibba043.dnkmem (mgr.34373) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:27 gibba003 bash[32348]: cluster 2021-03-10T16:34:26.345845+0000 mgr.gibba043.dnkmem (mgr.34373) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:27 gibba043 bash[24019]: cluster 2021-03-10T16:34:26.345845+0000 mgr.gibba043.dnkmem (mgr.34373) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:29 gibba003 bash[31385]: cluster 2021-03-10T16:34:28.346802+0000 mgr.gibba043.dnkmem (mgr.34373) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:29 gibba003 bash[32348]: cluster 2021-03-10T16:34:28.346802+0000 mgr.gibba043.dnkmem (mgr.34373) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:29 gibba043 bash[24019]: cluster 2021-03-10T16:34:28.346802+0000 mgr.gibba043.dnkmem (mgr.34373) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:31 gibba003 bash[31385]: cluster 2021-03-10T16:34:30.348216+0000 mgr.gibba043.dnkmem (mgr.34373) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:31 gibba003 bash[32348]: cluster 2021-03-10T16:34:30.348216+0000 mgr.gibba043.dnkmem (mgr.34373) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:31 gibba043 bash[24019]: cluster 2021-03-10T16:34:30.348216+0000 mgr.gibba043.dnkmem (mgr.34373) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:33 gibba003 bash[31385]: cluster 2021-03-10T16:34:32.349887+0000 mgr.gibba043.dnkmem (mgr.34373) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:33 gibba003 bash[31385]: cephadm 2021-03-10T16:34:32.467914+0000 mgr.gibba043.dnkmem (mgr.34373) 8622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:33 gibba003 bash[32348]: cluster 2021-03-10T16:34:32.349887+0000 mgr.gibba043.dnkmem (mgr.34373) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:33 gibba003 bash[32348]: cephadm 2021-03-10T16:34:32.467914+0000 mgr.gibba043.dnkmem (mgr.34373) 8622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:33 gibba043 bash[24019]: cluster 2021-03-10T16:34:32.349887+0000 mgr.gibba043.dnkmem (mgr.34373) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:33 gibba043 bash[24019]: cephadm 2021-03-10T16:34:32.467914+0000 mgr.gibba043.dnkmem (mgr.34373) 8622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:35 gibba003 bash[31385]: cluster 2021-03-10T16:34:34.351360+0000 mgr.gibba043.dnkmem (mgr.34373) 8623 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:35 gibba003 bash[32348]: cluster 2021-03-10T16:34:34.351360+0000 mgr.gibba043.dnkmem (mgr.34373) 8623 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:35 gibba043 bash[24019]: cluster 2021-03-10T16:34:34.351360+0000 mgr.gibba043.dnkmem (mgr.34373) 8623 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:37 gibba003 bash[31385]: cluster 2021-03-10T16:34:36.353287+0000 mgr.gibba043.dnkmem (mgr.34373) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:37 gibba003 bash[32348]: cluster 2021-03-10T16:34:36.353287+0000 mgr.gibba043.dnkmem (mgr.34373) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:37 gibba043 bash[24019]: cluster 2021-03-10T16:34:36.353287+0000 mgr.gibba043.dnkmem (mgr.34373) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:39 gibba003 bash[31385]: cluster 2021-03-10T16:34:38.354080+0000 mgr.gibba043.dnkmem (mgr.34373) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:39 gibba003 bash[32348]: cluster 2021-03-10T16:34:38.354080+0000 mgr.gibba043.dnkmem (mgr.34373) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:39 gibba043 bash[24019]: cluster 2021-03-10T16:34:38.354080+0000 mgr.gibba043.dnkmem (mgr.34373) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:41 gibba003 bash[31385]: cluster 2021-03-10T16:34:40.355492+0000 mgr.gibba043.dnkmem (mgr.34373) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:41 gibba003 bash[32348]: cluster 2021-03-10T16:34:40.355492+0000 mgr.gibba043.dnkmem (mgr.34373) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:41 gibba043 bash[24019]: cluster 2021-03-10T16:34:40.355492+0000 mgr.gibba043.dnkmem (mgr.34373) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:43 gibba003 bash[31385]: cluster 2021-03-10T16:34:42.357170+0000 mgr.gibba043.dnkmem (mgr.34373) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:43 gibba003 bash[32348]: cluster 2021-03-10T16:34:42.357170+0000 mgr.gibba043.dnkmem (mgr.34373) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:43 gibba043 bash[24019]: cluster 2021-03-10T16:34:42.357170+0000 mgr.gibba043.dnkmem (mgr.34373) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:45 gibba003 bash[31385]: cluster 2021-03-10T16:34:44.358834+0000 mgr.gibba043.dnkmem (mgr.34373) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:45 gibba003 bash[32348]: cluster 2021-03-10T16:34:44.358834+0000 mgr.gibba043.dnkmem (mgr.34373) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:45 gibba043 bash[24019]: cluster 2021-03-10T16:34:44.358834+0000 mgr.gibba043.dnkmem (mgr.34373) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: cluster 2021-03-10T16:34:46.360674+0000 mgr.gibba043.dnkmem (mgr.34373) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.691538+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:34:48.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.695050+0000 mon.c (mon.1) 2224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.696550+0000 mon.c (mon.1) 2225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.698285+0000 mon.c (mon.1) 2226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.699813+0000 mon.c (mon.1) 2227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.702957+0000 mon.c (mon.1) 2228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:47 gibba043 bash[24019]: audit 2021-03-10T16:34:47.704609+0000 mon.c (mon.1) 2229 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: cluster 2021-03-10T16:34:46.360674+0000 mgr.gibba043.dnkmem (mgr.34373) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.691538+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:34:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.695050+0000 mon.c (mon.1) 2224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.696550+0000 mon.c (mon.1) 2225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.698285+0000 mon.c (mon.1) 2226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.699813+0000 mon.c (mon.1) 2227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.702957+0000 mon.c (mon.1) 2228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[31385]: audit 2021-03-10T16:34:47.704609+0000 mon.c (mon.1) 2229 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: cluster 2021-03-10T16:34:46.360674+0000 mgr.gibba043.dnkmem (mgr.34373) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.691538+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:34:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.695050+0000 mon.c (mon.1) 2224 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.696550+0000 mon.c (mon.1) 2225 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.698285+0000 mon.c (mon.1) 2226 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.699813+0000 mon.c (mon.1) 2227 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.702957+0000 mon.c (mon.1) 2228 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:47 gibba003 bash[32348]: audit 2021-03-10T16:34:47.704609+0000 mon.c (mon.1) 2229 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:49.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.484751+0000 mgr.gibba043.dnkmem (mgr.34373) 8630 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:34:49.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.486324+0000 mgr.gibba043.dnkmem (mgr.34373) 8631 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:34:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.692655+0000 mgr.gibba043.dnkmem (mgr.34373) 8632 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.694415+0000 mgr.gibba043.dnkmem (mgr.34373) 8633 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.696014+0000 mgr.gibba043.dnkmem (mgr.34373) 8634 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.696050+0000 mgr.gibba043.dnkmem (mgr.34373) 8635 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:49.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.697650+0000 mgr.gibba043.dnkmem (mgr.34373) 8636 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.697686+0000 mgr.gibba043.dnkmem (mgr.34373) 8637 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.698953+0000 mgr.gibba043.dnkmem (mgr.34373) 8638 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.700643+0000 mgr.gibba043.dnkmem (mgr.34373) 8639 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.700704+0000 mgr.gibba043.dnkmem (mgr.34373) 8640 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.702142+0000 mgr.gibba043.dnkmem (mgr.34373) 8641 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.702561+0000 mgr.gibba043.dnkmem (mgr.34373) 8642 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.703781+0000 mgr.gibba043.dnkmem (mgr.34373) 8643 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.703853+0000 mgr.gibba043.dnkmem (mgr.34373) 8644 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[31385]: cephadm 2021-03-10T16:34:47.704013+0000 mgr.gibba043.dnkmem (mgr.34373) 8645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.484751+0000 mgr.gibba043.dnkmem (mgr.34373) 8630 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:34:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.486324+0000 mgr.gibba043.dnkmem (mgr.34373) 8631 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:34:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.692655+0000 mgr.gibba043.dnkmem (mgr.34373) 8632 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.694415+0000 mgr.gibba043.dnkmem (mgr.34373) 8633 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.696014+0000 mgr.gibba043.dnkmem (mgr.34373) 8634 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.696050+0000 mgr.gibba043.dnkmem (mgr.34373) 8635 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.697650+0000 mgr.gibba043.dnkmem (mgr.34373) 8636 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.697686+0000 mgr.gibba043.dnkmem (mgr.34373) 8637 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.698953+0000 mgr.gibba043.dnkmem (mgr.34373) 8638 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.700643+0000 mgr.gibba043.dnkmem (mgr.34373) 8639 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.700704+0000 mgr.gibba043.dnkmem (mgr.34373) 8640 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:49.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.702142+0000 mgr.gibba043.dnkmem (mgr.34373) 8641 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.702561+0000 mgr.gibba043.dnkmem (mgr.34373) 8642 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.703781+0000 mgr.gibba043.dnkmem (mgr.34373) 8643 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.703853+0000 mgr.gibba043.dnkmem (mgr.34373) 8644 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:49.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:48 gibba003 bash[32348]: cephadm 2021-03-10T16:34:47.704013+0000 mgr.gibba043.dnkmem (mgr.34373) 8645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.484751+0000 mgr.gibba043.dnkmem (mgr.34373) 8630 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:34:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.486324+0000 mgr.gibba043.dnkmem (mgr.34373) 8631 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:34:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.692655+0000 mgr.gibba043.dnkmem (mgr.34373) 8632 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.694415+0000 mgr.gibba043.dnkmem (mgr.34373) 8633 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.696014+0000 mgr.gibba043.dnkmem (mgr.34373) 8634 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.696050+0000 mgr.gibba043.dnkmem (mgr.34373) 8635 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.697650+0000 mgr.gibba043.dnkmem (mgr.34373) 8636 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.697686+0000 mgr.gibba043.dnkmem (mgr.34373) 8637 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.698953+0000 mgr.gibba043.dnkmem (mgr.34373) 8638 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.700643+0000 mgr.gibba043.dnkmem (mgr.34373) 8639 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.700704+0000 mgr.gibba043.dnkmem (mgr.34373) 8640 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.702142+0000 mgr.gibba043.dnkmem (mgr.34373) 8641 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.702561+0000 mgr.gibba043.dnkmem (mgr.34373) 8642 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.703781+0000 mgr.gibba043.dnkmem (mgr.34373) 8643 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.703853+0000 mgr.gibba043.dnkmem (mgr.34373) 8644 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:48 gibba043 bash[24019]: cephadm 2021-03-10T16:34:47.704013+0000 mgr.gibba043.dnkmem (mgr.34373) 8645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:34:50.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:49 gibba003 bash[31385]: cluster 2021-03-10T16:34:48.361663+0000 mgr.gibba043.dnkmem (mgr.34373) 8646 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:49 gibba003 bash[32348]: cluster 2021-03-10T16:34:48.361663+0000 mgr.gibba043.dnkmem (mgr.34373) 8646 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:49 gibba043 bash[24019]: cluster 2021-03-10T16:34:48.361663+0000 mgr.gibba043.dnkmem (mgr.34373) 8646 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:51 gibba003 bash[31385]: cluster 2021-03-10T16:34:50.363033+0000 mgr.gibba043.dnkmem (mgr.34373) 8647 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:51 gibba003 bash[32348]: cluster 2021-03-10T16:34:50.363033+0000 mgr.gibba043.dnkmem (mgr.34373) 8647 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:51 gibba043 bash[24019]: cluster 2021-03-10T16:34:50.363033+0000 mgr.gibba043.dnkmem (mgr.34373) 8647 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:53 gibba003 bash[31385]: cluster 2021-03-10T16:34:52.364673+0000 mgr.gibba043.dnkmem (mgr.34373) 8648 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:53 gibba003 bash[32348]: cluster 2021-03-10T16:34:52.364673+0000 mgr.gibba043.dnkmem (mgr.34373) 8648 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:53 gibba043 bash[24019]: cluster 2021-03-10T16:34:52.364673+0000 mgr.gibba043.dnkmem (mgr.34373) 8648 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.454 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:34:54.704 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:34:54.704 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:34:54.704 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:34:54.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:34:54.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:34:54.705 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:34:54.705 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:34:54.706 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:34:54.706 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:34:54.706 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:34:54.706 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:34:54.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:34:54.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:34:54.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:34:54.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:34:54.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:34:54.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:34:54.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:34:54.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:34:54.708 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:34:54.708 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:34:54.957 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:34:54.957 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:34:54.957 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:54.957 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:34:54.958 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:34:54.958 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:54.958 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:34:54.958 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:34:54.958 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:34:54.959 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:34:54.959 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:34:54.959 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:34:54.959 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:34:54.959 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:34:54.960 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:34:56.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[31385]: cluster 2021-03-10T16:34:54.366348+0000 mgr.gibba043.dnkmem (mgr.34373) 8649 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:56.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[31385]: audit 2021-03-10T16:34:54.446905+0000 mgr.gibba043.dnkmem (mgr.34373) 8650 : audit [DBG] from='client.59836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:56.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[31385]: audit 2021-03-10T16:34:54.669401+0000 mgr.gibba043.dnkmem (mgr.34373) 8651 : audit [DBG] from='client.59842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:56.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[31385]: audit 2021-03-10T16:34:54.960607+0000 mon.c (mon.1) 2230 : audit [DBG] from='client.? 172.21.2.103:0/3300494708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:56.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[32348]: cluster 2021-03-10T16:34:54.366348+0000 mgr.gibba043.dnkmem (mgr.34373) 8649 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:56.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[32348]: audit 2021-03-10T16:34:54.446905+0000 mgr.gibba043.dnkmem (mgr.34373) 8650 : audit [DBG] from='client.59836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:56.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[32348]: audit 2021-03-10T16:34:54.669401+0000 mgr.gibba043.dnkmem (mgr.34373) 8651 : audit [DBG] from='client.59842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:56.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:55 gibba003 bash[32348]: audit 2021-03-10T16:34:54.960607+0000 mon.c (mon.1) 2230 : audit [DBG] from='client.? 172.21.2.103:0/3300494708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:55 gibba043 bash[24019]: cluster 2021-03-10T16:34:54.366348+0000 mgr.gibba043.dnkmem (mgr.34373) 8649 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:55 gibba043 bash[24019]: audit 2021-03-10T16:34:54.446905+0000 mgr.gibba043.dnkmem (mgr.34373) 8650 : audit [DBG] from='client.59836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:56.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:55 gibba043 bash[24019]: audit 2021-03-10T16:34:54.669401+0000 mgr.gibba043.dnkmem (mgr.34373) 8651 : audit [DBG] from='client.59842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:56.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:55 gibba043 bash[24019]: audit 2021-03-10T16:34:54.960607+0000 mon.c (mon.1) 2230 : audit [DBG] from='client.? 172.21.2.103:0/3300494708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:57 gibba003 bash[31385]: cluster 2021-03-10T16:34:56.368184+0000 mgr.gibba043.dnkmem (mgr.34373) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:57 gibba003 bash[32348]: cluster 2021-03-10T16:34:56.368184+0000 mgr.gibba043.dnkmem (mgr.34373) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:57 gibba043 bash[24019]: cluster 2021-03-10T16:34:56.368184+0000 mgr.gibba043.dnkmem (mgr.34373) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:00.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:34:59 gibba003 bash[31385]: cluster 2021-03-10T16:34:58.368968+0000 mgr.gibba043.dnkmem (mgr.34373) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:00.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:34:59 gibba003 bash[32348]: cluster 2021-03-10T16:34:58.368968+0000 mgr.gibba043.dnkmem (mgr.34373) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:34:59 gibba043 bash[24019]: cluster 2021-03-10T16:34:58.368968+0000 mgr.gibba043.dnkmem (mgr.34373) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:02.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:01 gibba003 bash[31385]: cluster 2021-03-10T16:35:00.370345+0000 mgr.gibba043.dnkmem (mgr.34373) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:02.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:01 gibba003 bash[32348]: cluster 2021-03-10T16:35:00.370345+0000 mgr.gibba043.dnkmem (mgr.34373) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:01 gibba043 bash[24019]: cluster 2021-03-10T16:35:00.370345+0000 mgr.gibba043.dnkmem (mgr.34373) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:03 gibba003 bash[31385]: cluster 2021-03-10T16:35:02.371970+0000 mgr.gibba043.dnkmem (mgr.34373) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:03 gibba003 bash[31385]: cephadm 2021-03-10T16:35:02.719998+0000 mgr.gibba043.dnkmem (mgr.34373) 8656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:03 gibba003 bash[32348]: cluster 2021-03-10T16:35:02.371970+0000 mgr.gibba043.dnkmem (mgr.34373) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:03 gibba003 bash[32348]: cephadm 2021-03-10T16:35:02.719998+0000 mgr.gibba043.dnkmem (mgr.34373) 8656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:03 gibba043 bash[24019]: cluster 2021-03-10T16:35:02.371970+0000 mgr.gibba043.dnkmem (mgr.34373) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:03 gibba043 bash[24019]: cephadm 2021-03-10T16:35:02.719998+0000 mgr.gibba043.dnkmem (mgr.34373) 8656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:04 gibba043 bash[24019]: cluster 2021-03-10T16:35:04.373660+0000 mgr.gibba043.dnkmem (mgr.34373) 8657 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:05.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:04 gibba003 bash[31385]: cluster 2021-03-10T16:35:04.373660+0000 mgr.gibba043.dnkmem (mgr.34373) 8657 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:05.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:04 gibba003 bash[32348]: cluster 2021-03-10T16:35:04.373660+0000 mgr.gibba043.dnkmem (mgr.34373) 8657 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:07 gibba043 bash[24019]: cluster 2021-03-10T16:35:06.375274+0000 mgr.gibba043.dnkmem (mgr.34373) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:07 gibba003 bash[31385]: cluster 2021-03-10T16:35:06.375274+0000 mgr.gibba043.dnkmem (mgr.34373) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:07 gibba003 bash[32348]: cluster 2021-03-10T16:35:06.375274+0000 mgr.gibba043.dnkmem (mgr.34373) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:09 gibba043 bash[24019]: cluster 2021-03-10T16:35:08.376217+0000 mgr.gibba043.dnkmem (mgr.34373) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:09 gibba003 bash[31385]: cluster 2021-03-10T16:35:08.376217+0000 mgr.gibba043.dnkmem (mgr.34373) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:09 gibba003 bash[32348]: cluster 2021-03-10T16:35:08.376217+0000 mgr.gibba043.dnkmem (mgr.34373) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:11 gibba043 bash[24019]: cluster 2021-03-10T16:35:10.377544+0000 mgr.gibba043.dnkmem (mgr.34373) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:11 gibba003 bash[31385]: cluster 2021-03-10T16:35:10.377544+0000 mgr.gibba043.dnkmem (mgr.34373) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:11 gibba003 bash[32348]: cluster 2021-03-10T16:35:10.377544+0000 mgr.gibba043.dnkmem (mgr.34373) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:13.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:13 gibba003 bash[31385]: cluster 2021-03-10T16:35:12.379218+0000 mgr.gibba043.dnkmem (mgr.34373) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:13.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:13 gibba003 bash[32348]: cluster 2021-03-10T16:35:12.379218+0000 mgr.gibba043.dnkmem (mgr.34373) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:13 gibba043 bash[24019]: cluster 2021-03-10T16:35:12.379218+0000 mgr.gibba043.dnkmem (mgr.34373) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:13.773091+0000 mon.c (mon.1) 2231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:13.774242+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:13.995786+0000 mon.c (mon.1) 2232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:13.996887+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.205560+0000 mon.c (mon.1) 2233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:35:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.206279+0000 mon.c (mon.1) 2234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.206959+0000 mon.c (mon.1) 2235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:35:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.206962+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:35:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.207656+0000 mon.c (mon.1) 2236 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.209184+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.210091+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:35:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[31385]: audit 2021-03-10T16:35:14.210972+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:13.773091+0000 mon.c (mon.1) 2231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:13.774242+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:13.995786+0000 mon.c (mon.1) 2232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:13.996887+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.205560+0000 mon.c (mon.1) 2233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:35:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.206279+0000 mon.c (mon.1) 2234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.206959+0000 mon.c (mon.1) 2235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:35:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.206962+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:35:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.207656+0000 mon.c (mon.1) 2236 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.209184+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:35:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.210091+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:35:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:14 gibba003 bash[32348]: audit 2021-03-10T16:35:14.210972+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:35:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:13.773091+0000 mon.c (mon.1) 2231 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:13.774242+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:13.995786+0000 mon.c (mon.1) 2232 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:13.996887+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.205560+0000 mon.c (mon.1) 2233 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:35:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.206279+0000 mon.c (mon.1) 2234 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:35:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.206959+0000 mon.c (mon.1) 2235 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:35:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.206962+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:35:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.207656+0000 mon.c (mon.1) 2236 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:35:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.209184+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:35:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.210091+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:35:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:14 gibba043 bash[24019]: audit 2021-03-10T16:35:14.210972+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:35:15.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:15 gibba003 bash[31385]: cluster 2021-03-10T16:35:14.380616+0000 mgr.gibba043.dnkmem (mgr.34373) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:15.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:15 gibba003 bash[32348]: cluster 2021-03-10T16:35:14.380616+0000 mgr.gibba043.dnkmem (mgr.34373) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:16.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:15 gibba043 bash[24019]: cluster 2021-03-10T16:35:14.380616+0000 mgr.gibba043.dnkmem (mgr.34373) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:17.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:17 gibba003 bash[31385]: cluster 2021-03-10T16:35:16.382584+0000 mgr.gibba043.dnkmem (mgr.34373) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:17 gibba003 bash[32348]: cluster 2021-03-10T16:35:16.382584+0000 mgr.gibba043.dnkmem (mgr.34373) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:17 gibba043 bash[24019]: cluster 2021-03-10T16:35:16.382584+0000 mgr.gibba043.dnkmem (mgr.34373) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:18.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:18 gibba003 bash[31385]: cephadm 2021-03-10T16:35:17.735910+0000 mgr.gibba043.dnkmem (mgr.34373) 8664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:18.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:18 gibba003 bash[32348]: cephadm 2021-03-10T16:35:17.735910+0000 mgr.gibba043.dnkmem (mgr.34373) 8664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:19.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:18 gibba043 bash[24019]: cephadm 2021-03-10T16:35:17.735910+0000 mgr.gibba043.dnkmem (mgr.34373) 8664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:19.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:19 gibba003 bash[31385]: cluster 2021-03-10T16:35:18.383522+0000 mgr.gibba043.dnkmem (mgr.34373) 8665 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:19 gibba003 bash[32348]: cluster 2021-03-10T16:35:18.383522+0000 mgr.gibba043.dnkmem (mgr.34373) 8665 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:19 gibba043 bash[24019]: cluster 2021-03-10T16:35:18.383522+0000 mgr.gibba043.dnkmem (mgr.34373) 8665 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:21.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:21 gibba003 bash[31385]: cluster 2021-03-10T16:35:20.385017+0000 mgr.gibba043.dnkmem (mgr.34373) 8666 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:21 gibba003 bash[32348]: cluster 2021-03-10T16:35:20.385017+0000 mgr.gibba043.dnkmem (mgr.34373) 8666 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:21 gibba043 bash[24019]: cluster 2021-03-10T16:35:20.385017+0000 mgr.gibba043.dnkmem (mgr.34373) 8666 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:23.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:23 gibba003 bash[31385]: cluster 2021-03-10T16:35:22.386667+0000 mgr.gibba043.dnkmem (mgr.34373) 8667 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:23.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:23 gibba003 bash[32348]: cluster 2021-03-10T16:35:22.386667+0000 mgr.gibba043.dnkmem (mgr.34373) 8667 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:23 gibba043 bash[24019]: cluster 2021-03-10T16:35:22.386667+0000 mgr.gibba043.dnkmem (mgr.34373) 8667 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:25.204 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:35:25.432 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:35:25.432 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:35:25.433 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:35:25.433 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:35:25.433 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:35:25.433 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:35:25.433 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:35:25.434 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:35:25.434 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:35:25.434 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:35:25.434 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:35:25.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:35:25.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:35:25.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:35:25.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:35:25.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:35:25.436 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:35:25.436 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:35:25.436 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:35:25.436 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:35:25.437 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:35:25.686 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:35:25.686 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:35:25.687 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:25.687 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:35:25.687 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:35:25.687 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:25.687 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:35:25.688 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:35:25.688 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:35:25.688 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:35:25.688 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:35:25.689 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:35:25.689 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:35:25.689 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:35:25.689 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:35:25.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:25 gibba003 bash[31385]: cluster 2021-03-10T16:35:24.388562+0000 mgr.gibba043.dnkmem (mgr.34373) 8668 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:25.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:25 gibba003 bash[32348]: cluster 2021-03-10T16:35:24.388562+0000 mgr.gibba043.dnkmem (mgr.34373) 8668 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:26.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:25 gibba043 bash[24019]: cluster 2021-03-10T16:35:24.388562+0000 mgr.gibba043.dnkmem (mgr.34373) 8668 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:26.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:26 gibba003 bash[31385]: audit 2021-03-10T16:35:25.196816+0000 mgr.gibba043.dnkmem (mgr.34373) 8669 : audit [DBG] from='client.49866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:26.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:26 gibba003 bash[31385]: audit 2021-03-10T16:35:25.421927+0000 mgr.gibba043.dnkmem (mgr.34373) 8670 : audit [DBG] from='client.59860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:26.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:26 gibba003 bash[31385]: audit 2021-03-10T16:35:25.689905+0000 mon.c (mon.1) 2237 : audit [DBG] from='client.? 172.21.2.103:0/410453781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:26.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:26 gibba003 bash[32348]: audit 2021-03-10T16:35:25.196816+0000 mgr.gibba043.dnkmem (mgr.34373) 8669 : audit [DBG] from='client.49866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:26.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:26 gibba003 bash[32348]: audit 2021-03-10T16:35:25.421927+0000 mgr.gibba043.dnkmem (mgr.34373) 8670 : audit [DBG] from='client.59860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:26.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:26 gibba003 bash[32348]: audit 2021-03-10T16:35:25.689905+0000 mon.c (mon.1) 2237 : audit [DBG] from='client.? 172.21.2.103:0/410453781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:27.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:26 gibba043 bash[24019]: audit 2021-03-10T16:35:25.196816+0000 mgr.gibba043.dnkmem (mgr.34373) 8669 : audit [DBG] from='client.49866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:27.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:26 gibba043 bash[24019]: audit 2021-03-10T16:35:25.421927+0000 mgr.gibba043.dnkmem (mgr.34373) 8670 : audit [DBG] from='client.59860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:27.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:26 gibba043 bash[24019]: audit 2021-03-10T16:35:25.689905+0000 mon.c (mon.1) 2237 : audit [DBG] from='client.? 172.21.2.103:0/410453781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:27.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:27 gibba003 bash[31385]: cluster 2021-03-10T16:35:26.390578+0000 mgr.gibba043.dnkmem (mgr.34373) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:27.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:27 gibba003 bash[32348]: cluster 2021-03-10T16:35:26.390578+0000 mgr.gibba043.dnkmem (mgr.34373) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:27 gibba043 bash[24019]: cluster 2021-03-10T16:35:26.390578+0000 mgr.gibba043.dnkmem (mgr.34373) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:29 gibba003 bash[31385]: cluster 2021-03-10T16:35:28.391856+0000 mgr.gibba043.dnkmem (mgr.34373) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:29 gibba003 bash[32348]: cluster 2021-03-10T16:35:28.391856+0000 mgr.gibba043.dnkmem (mgr.34373) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:29 gibba043 bash[24019]: cluster 2021-03-10T16:35:28.391856+0000 mgr.gibba043.dnkmem (mgr.34373) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:31.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:31 gibba003 bash[31385]: cluster 2021-03-10T16:35:30.393073+0000 mgr.gibba043.dnkmem (mgr.34373) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:31.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:31 gibba003 bash[32348]: cluster 2021-03-10T16:35:30.393073+0000 mgr.gibba043.dnkmem (mgr.34373) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:32.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:31 gibba043 bash[24019]: cluster 2021-03-10T16:35:30.393073+0000 mgr.gibba043.dnkmem (mgr.34373) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:33.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:33 gibba003 bash[31385]: cluster 2021-03-10T16:35:32.394586+0000 mgr.gibba043.dnkmem (mgr.34373) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:33.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:33 gibba003 bash[31385]: cephadm 2021-03-10T16:35:32.751601+0000 mgr.gibba043.dnkmem (mgr.34373) 8675 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:33 gibba003 bash[32348]: cluster 2021-03-10T16:35:32.394586+0000 mgr.gibba043.dnkmem (mgr.34373) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:33.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:33 gibba003 bash[32348]: cephadm 2021-03-10T16:35:32.751601+0000 mgr.gibba043.dnkmem (mgr.34373) 8675 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:33 gibba043 bash[24019]: cluster 2021-03-10T16:35:32.394586+0000 mgr.gibba043.dnkmem (mgr.34373) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:33 gibba043 bash[24019]: cephadm 2021-03-10T16:35:32.751601+0000 mgr.gibba043.dnkmem (mgr.34373) 8675 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:35.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:35 gibba003 bash[31385]: cluster 2021-03-10T16:35:34.396191+0000 mgr.gibba043.dnkmem (mgr.34373) 8676 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:35.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:35 gibba003 bash[32348]: cluster 2021-03-10T16:35:34.396191+0000 mgr.gibba043.dnkmem (mgr.34373) 8676 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:36.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:35 gibba043 bash[24019]: cluster 2021-03-10T16:35:34.396191+0000 mgr.gibba043.dnkmem (mgr.34373) 8676 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:37.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:37 gibba003 bash[31385]: cluster 2021-03-10T16:35:36.397840+0000 mgr.gibba043.dnkmem (mgr.34373) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:37.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:37 gibba003 bash[32348]: cluster 2021-03-10T16:35:36.397840+0000 mgr.gibba043.dnkmem (mgr.34373) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:37 gibba043 bash[24019]: cluster 2021-03-10T16:35:36.397840+0000 mgr.gibba043.dnkmem (mgr.34373) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:39 gibba003 bash[31385]: cluster 2021-03-10T16:35:38.398848+0000 mgr.gibba043.dnkmem (mgr.34373) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:39 gibba003 bash[32348]: cluster 2021-03-10T16:35:38.398848+0000 mgr.gibba043.dnkmem (mgr.34373) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:39 gibba043 bash[24019]: cluster 2021-03-10T16:35:38.398848+0000 mgr.gibba043.dnkmem (mgr.34373) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:41.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:41 gibba003 bash[31385]: cluster 2021-03-10T16:35:40.400227+0000 mgr.gibba043.dnkmem (mgr.34373) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:41.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:41 gibba003 bash[32348]: cluster 2021-03-10T16:35:40.400227+0000 mgr.gibba043.dnkmem (mgr.34373) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:41 gibba043 bash[24019]: cluster 2021-03-10T16:35:40.400227+0000 mgr.gibba043.dnkmem (mgr.34373) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:43.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:43 gibba003 bash[31385]: cluster 2021-03-10T16:35:42.401615+0000 mgr.gibba043.dnkmem (mgr.34373) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:43.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:43 gibba003 bash[32348]: cluster 2021-03-10T16:35:42.401615+0000 mgr.gibba043.dnkmem (mgr.34373) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:44.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:43 gibba043 bash[24019]: cluster 2021-03-10T16:35:42.401615+0000 mgr.gibba043.dnkmem (mgr.34373) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:45.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:45 gibba003 bash[31385]: cluster 2021-03-10T16:35:44.403277+0000 mgr.gibba043.dnkmem (mgr.34373) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:45.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:45 gibba003 bash[32348]: cluster 2021-03-10T16:35:44.403277+0000 mgr.gibba043.dnkmem (mgr.34373) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:45 gibba043 bash[24019]: cluster 2021-03-10T16:35:44.403277+0000 mgr.gibba043.dnkmem (mgr.34373) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:48.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:47 gibba043 bash[24019]: cluster 2021-03-10T16:35:46.404977+0000 mgr.gibba043.dnkmem (mgr.34373) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:47 gibba003 bash[31385]: cluster 2021-03-10T16:35:46.404977+0000 mgr.gibba043.dnkmem (mgr.34373) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:47 gibba003 bash[32348]: cluster 2021-03-10T16:35:46.404977+0000 mgr.gibba043.dnkmem (mgr.34373) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:49.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:47.961457+0000 mgr.gibba043.dnkmem (mgr.34373) 8683 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:35:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:47.962033+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:47.965951+0000 mgr.gibba043.dnkmem (mgr.34373) 8684 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:35:49.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:47.966681+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.171299+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.172994+0000 mgr.gibba043.dnkmem (mgr.34373) 8685 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.175084+0000 mgr.gibba043.dnkmem (mgr.34373) 8686 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.175373+0000 mon.c (mon.1) 2238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.176739+0000 mgr.gibba043.dnkmem (mgr.34373) 8687 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.176778+0000 mgr.gibba043.dnkmem (mgr.34373) 8688 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.177208+0000 mon.c (mon.1) 2239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.178491+0000 mgr.gibba043.dnkmem (mgr.34373) 8689 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.178532+0000 mgr.gibba043.dnkmem (mgr.34373) 8690 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.179088+0000 mon.c (mon.1) 2240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.179758+0000 mgr.gibba043.dnkmem (mgr.34373) 8691 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.180419+0000 mon.c (mon.1) 2241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.181435+0000 mgr.gibba043.dnkmem (mgr.34373) 8692 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.181477+0000 mgr.gibba043.dnkmem (mgr.34373) 8693 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.183027+0000 mgr.gibba043.dnkmem (mgr.34373) 8694 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.183386+0000 mgr.gibba043.dnkmem (mgr.34373) 8695 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:49.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.183671+0000 mon.c (mon.1) 2242 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.184442+0000 mgr.gibba043.dnkmem (mgr.34373) 8696 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:49.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.184482+0000 mgr.gibba043.dnkmem (mgr.34373) 8697 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:49.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cephadm 2021-03-10T16:35:48.184596+0000 mgr.gibba043.dnkmem (mgr.34373) 8698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:49.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: audit 2021-03-10T16:35:48.185279+0000 mon.c (mon.1) 2243 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:48 gibba043 bash[24019]: cluster 2021-03-10T16:35:48.406194+0000 mgr.gibba043.dnkmem (mgr.34373) 8699 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:47.961457+0000 mgr.gibba043.dnkmem (mgr.34373) 8683 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:35:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:47.962033+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:47.965951+0000 mgr.gibba043.dnkmem (mgr.34373) 8684 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:35:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:47.966681+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.171299+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.172994+0000 mgr.gibba043.dnkmem (mgr.34373) 8685 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.175084+0000 mgr.gibba043.dnkmem (mgr.34373) 8686 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.175373+0000 mon.c (mon.1) 2238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.176739+0000 mgr.gibba043.dnkmem (mgr.34373) 8687 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.176778+0000 mgr.gibba043.dnkmem (mgr.34373) 8688 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.177208+0000 mon.c (mon.1) 2239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.178491+0000 mgr.gibba043.dnkmem (mgr.34373) 8689 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.178532+0000 mgr.gibba043.dnkmem (mgr.34373) 8690 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.179088+0000 mon.c (mon.1) 2240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.179758+0000 mgr.gibba043.dnkmem (mgr.34373) 8691 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.180419+0000 mon.c (mon.1) 2241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.181435+0000 mgr.gibba043.dnkmem (mgr.34373) 8692 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.181477+0000 mgr.gibba043.dnkmem (mgr.34373) 8693 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.183027+0000 mgr.gibba043.dnkmem (mgr.34373) 8694 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.183386+0000 mgr.gibba043.dnkmem (mgr.34373) 8695 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.183671+0000 mon.c (mon.1) 2242 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:47.961457+0000 mgr.gibba043.dnkmem (mgr.34373) 8683 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:35:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:47.962033+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:47.965951+0000 mgr.gibba043.dnkmem (mgr.34373) 8684 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:35:49.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:47.966681+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.171299+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:35:49.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.172994+0000 mgr.gibba043.dnkmem (mgr.34373) 8685 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:49.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.175084+0000 mgr.gibba043.dnkmem (mgr.34373) 8686 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:49.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.175373+0000 mon.c (mon.1) 2238 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:49.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.176739+0000 mgr.gibba043.dnkmem (mgr.34373) 8687 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:49.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.176778+0000 mgr.gibba043.dnkmem (mgr.34373) 8688 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:49.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.177208+0000 mon.c (mon.1) 2239 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.178491+0000 mgr.gibba043.dnkmem (mgr.34373) 8689 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:49.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.178532+0000 mgr.gibba043.dnkmem (mgr.34373) 8690 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:49.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.179088+0000 mon.c (mon.1) 2240 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.179758+0000 mgr.gibba043.dnkmem (mgr.34373) 8691 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:49.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.180419+0000 mon.c (mon.1) 2241 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.181435+0000 mgr.gibba043.dnkmem (mgr.34373) 8692 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.181477+0000 mgr.gibba043.dnkmem (mgr.34373) 8693 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.183027+0000 mgr.gibba043.dnkmem (mgr.34373) 8694 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.183386+0000 mgr.gibba043.dnkmem (mgr.34373) 8695 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:49.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.183671+0000 mon.c (mon.1) 2242 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.184442+0000 mgr.gibba043.dnkmem (mgr.34373) 8696 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:49.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.184482+0000 mgr.gibba043.dnkmem (mgr.34373) 8697 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:49.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cephadm 2021-03-10T16:35:48.184596+0000 mgr.gibba043.dnkmem (mgr.34373) 8698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:49.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: audit 2021-03-10T16:35:48.185279+0000 mon.c (mon.1) 2243 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[31385]: cluster 2021-03-10T16:35:48.406194+0000 mgr.gibba043.dnkmem (mgr.34373) 8699 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:49.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.184442+0000 mgr.gibba043.dnkmem (mgr.34373) 8696 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:49.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.184482+0000 mgr.gibba043.dnkmem (mgr.34373) 8697 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:49.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cephadm 2021-03-10T16:35:48.184596+0000 mgr.gibba043.dnkmem (mgr.34373) 8698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:35:49.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: audit 2021-03-10T16:35:48.185279+0000 mon.c (mon.1) 2243 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:49.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:48 gibba003 bash[32348]: cluster 2021-03-10T16:35:48.406194+0000 mgr.gibba043.dnkmem (mgr.34373) 8699 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:51.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:51 gibba043 bash[24019]: cluster 2021-03-10T16:35:50.407531+0000 mgr.gibba043.dnkmem (mgr.34373) 8700 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:51.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:51 gibba003 bash[31385]: cluster 2021-03-10T16:35:50.407531+0000 mgr.gibba043.dnkmem (mgr.34373) 8700 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:51 gibba003 bash[32348]: cluster 2021-03-10T16:35:50.407531+0000 mgr.gibba043.dnkmem (mgr.34373) 8700 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:53 gibba003 bash[31385]: cluster 2021-03-10T16:35:52.408856+0000 mgr.gibba043.dnkmem (mgr.34373) 8701 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:53 gibba003 bash[32348]: cluster 2021-03-10T16:35:52.408856+0000 mgr.gibba043.dnkmem (mgr.34373) 8701 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:54.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:53 gibba043 bash[24019]: cluster 2021-03-10T16:35:52.408856+0000 mgr.gibba043.dnkmem (mgr.34373) 8701 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:55.931 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:35:55.936 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:55 gibba003 bash[32348]: cluster 2021-03-10T16:35:54.410296+0000 mgr.gibba043.dnkmem (mgr.34373) 8702 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:55.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:55 gibba003 bash[31385]: cluster 2021-03-10T16:35:54.410296+0000 mgr.gibba043.dnkmem (mgr.34373) 8702 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:56.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:55 gibba043 bash[24019]: cluster 2021-03-10T16:35:54.410296+0000 mgr.gibba043.dnkmem (mgr.34373) 8702 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:56.186 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:35:56.186 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:35:56.186 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:35:56.187 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:35:56.187 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:35:56.187 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:35:56.187 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:35:56.188 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:35:56.188 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:35:56.188 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:35:56.188 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:35:56.188 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:35:56.189 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:35:56.189 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:35:56.189 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:35:56.189 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:35:56.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:35:56.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:35:56.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:35:56.190 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:35:56.191 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:35:56.437 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:35:56.437 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:35:56.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:56.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:35:56.438 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:35:56.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:56.439 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:35:56.439 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:35:56.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:35:56.439 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:35:56.440 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:35:56.440 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:35:56.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:35:56.440 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:35:56.441 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:35:56.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:56 gibba003 bash[31385]: audit 2021-03-10T16:35:55.924486+0000 mgr.gibba043.dnkmem (mgr.34373) 8703 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:56.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:56 gibba003 bash[31385]: audit 2021-03-10T16:35:56.440654+0000 mon.a (mon.0) 1841 : audit [DBG] from='client.? 172.21.2.103:0/3648856469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:56.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:56 gibba003 bash[32348]: audit 2021-03-10T16:35:55.924486+0000 mgr.gibba043.dnkmem (mgr.34373) 8703 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:56.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:56 gibba003 bash[32348]: audit 2021-03-10T16:35:56.440654+0000 mon.a (mon.0) 1841 : audit [DBG] from='client.? 172.21.2.103:0/3648856469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:57.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:56 gibba043 bash[24019]: audit 2021-03-10T16:35:55.924486+0000 mgr.gibba043.dnkmem (mgr.34373) 8703 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:57.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:56 gibba043 bash[24019]: audit 2021-03-10T16:35:56.440654+0000 mon.a (mon.0) 1841 : audit [DBG] from='client.? 172.21.2.103:0/3648856469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:57.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:57 gibba003 bash[31385]: audit 2021-03-10T16:35:56.149357+0000 mgr.gibba043.dnkmem (mgr.34373) 8704 : audit [DBG] from='client.59878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:57.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:57 gibba003 bash[31385]: cluster 2021-03-10T16:35:56.412078+0000 mgr.gibba043.dnkmem (mgr.34373) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:57.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:57 gibba003 bash[32348]: audit 2021-03-10T16:35:56.149357+0000 mgr.gibba043.dnkmem (mgr.34373) 8704 : audit [DBG] from='client.59878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:57.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:57 gibba003 bash[32348]: cluster 2021-03-10T16:35:56.412078+0000 mgr.gibba043.dnkmem (mgr.34373) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:57 gibba043 bash[24019]: audit 2021-03-10T16:35:56.149357+0000 mgr.gibba043.dnkmem (mgr.34373) 8704 : audit [DBG] from='client.59878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:58.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:57 gibba043 bash[24019]: cluster 2021-03-10T16:35:56.412078+0000 mgr.gibba043.dnkmem (mgr.34373) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:59.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:35:59 gibba003 bash[31385]: cluster 2021-03-10T16:35:58.413269+0000 mgr.gibba043.dnkmem (mgr.34373) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:35:59 gibba003 bash[32348]: cluster 2021-03-10T16:35:58.413269+0000 mgr.gibba043.dnkmem (mgr.34373) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:35:59 gibba043 bash[24019]: cluster 2021-03-10T16:35:58.413269+0000 mgr.gibba043.dnkmem (mgr.34373) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:01.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:01 gibba003 bash[31385]: cluster 2021-03-10T16:36:00.414641+0000 mgr.gibba043.dnkmem (mgr.34373) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:01.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:01 gibba003 bash[32348]: cluster 2021-03-10T16:36:00.414641+0000 mgr.gibba043.dnkmem (mgr.34373) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:02.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:01 gibba043 bash[24019]: cluster 2021-03-10T16:36:00.414641+0000 mgr.gibba043.dnkmem (mgr.34373) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:03 gibba003 bash[31385]: cluster 2021-03-10T16:36:02.416234+0000 mgr.gibba043.dnkmem (mgr.34373) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:03 gibba003 bash[32348]: cluster 2021-03-10T16:36:02.416234+0000 mgr.gibba043.dnkmem (mgr.34373) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:04.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:03 gibba043 bash[24019]: cluster 2021-03-10T16:36:02.416234+0000 mgr.gibba043.dnkmem (mgr.34373) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:04.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:04 gibba003 bash[31385]: cephadm 2021-03-10T16:36:03.200367+0000 mgr.gibba043.dnkmem (mgr.34373) 8709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:04.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:04 gibba003 bash[32348]: cephadm 2021-03-10T16:36:03.200367+0000 mgr.gibba043.dnkmem (mgr.34373) 8709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:05.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:04 gibba043 bash[24019]: cephadm 2021-03-10T16:36:03.200367+0000 mgr.gibba043.dnkmem (mgr.34373) 8709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:05.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:05 gibba003 bash[31385]: cluster 2021-03-10T16:36:04.417754+0000 mgr.gibba043.dnkmem (mgr.34373) 8710 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:05 gibba003 bash[32348]: cluster 2021-03-10T16:36:04.417754+0000 mgr.gibba043.dnkmem (mgr.34373) 8710 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:05 gibba043 bash[24019]: cluster 2021-03-10T16:36:04.417754+0000 mgr.gibba043.dnkmem (mgr.34373) 8710 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:07 gibba003 bash[31385]: cluster 2021-03-10T16:36:06.419561+0000 mgr.gibba043.dnkmem (mgr.34373) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:07 gibba003 bash[32348]: cluster 2021-03-10T16:36:06.419561+0000 mgr.gibba043.dnkmem (mgr.34373) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:07 gibba043 bash[24019]: cluster 2021-03-10T16:36:06.419561+0000 mgr.gibba043.dnkmem (mgr.34373) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:09 gibba003 bash[31385]: cluster 2021-03-10T16:36:08.421313+0000 mgr.gibba043.dnkmem (mgr.34373) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:09 gibba003 bash[32348]: cluster 2021-03-10T16:36:08.421313+0000 mgr.gibba043.dnkmem (mgr.34373) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:09 gibba043 bash[24019]: cluster 2021-03-10T16:36:08.421313+0000 mgr.gibba043.dnkmem (mgr.34373) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:11.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:11 gibba003 bash[31385]: cluster 2021-03-10T16:36:10.422716+0000 mgr.gibba043.dnkmem (mgr.34373) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:11 gibba003 bash[32348]: cluster 2021-03-10T16:36:10.422716+0000 mgr.gibba043.dnkmem (mgr.34373) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:12.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:11 gibba043 bash[24019]: cluster 2021-03-10T16:36:10.422716+0000 mgr.gibba043.dnkmem (mgr.34373) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:13.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:13 gibba003 bash[31385]: cluster 2021-03-10T16:36:12.424365+0000 mgr.gibba043.dnkmem (mgr.34373) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:13.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:13 gibba003 bash[32348]: cluster 2021-03-10T16:36:12.424365+0000 mgr.gibba043.dnkmem (mgr.34373) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:13 gibba043 bash[24019]: cluster 2021-03-10T16:36:12.424365+0000 mgr.gibba043.dnkmem (mgr.34373) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:13.779891+0000 mon.c (mon.1) 2244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:13.780994+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.003577+0000 mon.c (mon.1) 2245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.004850+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.216110+0000 mon.c (mon.1) 2246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:36:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.217269+0000 mon.c (mon.1) 2247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.217591+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:36:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.218301+0000 mon.c (mon.1) 2248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.219132+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.219624+0000 mon.c (mon.1) 2249 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:36:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.220449+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[31385]: audit 2021-03-10T16:36:14.221680+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:36:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:13.779891+0000 mon.c (mon.1) 2244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:13.780994+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.003577+0000 mon.c (mon.1) 2245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.004850+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.216110+0000 mon.c (mon.1) 2246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:36:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.217269+0000 mon.c (mon.1) 2247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.217591+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:36:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.218301+0000 mon.c (mon.1) 2248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.219132+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.219624+0000 mon.c (mon.1) 2249 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:36:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.220449+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:14 gibba003 bash[32348]: audit 2021-03-10T16:36:14.221680+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:36:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:13.779891+0000 mon.c (mon.1) 2244 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:13.780994+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.003577+0000 mon.c (mon.1) 2245 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.004850+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.216110+0000 mon.c (mon.1) 2246 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:36:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.217269+0000 mon.c (mon.1) 2247 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.217591+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:36:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.218301+0000 mon.c (mon.1) 2248 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.219132+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.219624+0000 mon.c (mon.1) 2249 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:36:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.220449+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:14 gibba043 bash[24019]: audit 2021-03-10T16:36:14.221680+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:36:15.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:15 gibba003 bash[32348]: cluster 2021-03-10T16:36:14.426107+0000 mgr.gibba043.dnkmem (mgr.34373) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:15 gibba003 bash[31385]: cluster 2021-03-10T16:36:14.426107+0000 mgr.gibba043.dnkmem (mgr.34373) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:16.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:15 gibba043 bash[24019]: cluster 2021-03-10T16:36:14.426107+0000 mgr.gibba043.dnkmem (mgr.34373) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:17.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:17 gibba003 bash[31385]: cluster 2021-03-10T16:36:16.427939+0000 mgr.gibba043.dnkmem (mgr.34373) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:17 gibba003 bash[32348]: cluster 2021-03-10T16:36:16.427939+0000 mgr.gibba043.dnkmem (mgr.34373) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:17 gibba043 bash[24019]: cluster 2021-03-10T16:36:16.427939+0000 mgr.gibba043.dnkmem (mgr.34373) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:19 gibba003 bash[31385]: cephadm 2021-03-10T16:36:18.212301+0000 mgr.gibba043.dnkmem (mgr.34373) 8717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:19 gibba003 bash[31385]: cluster 2021-03-10T16:36:18.429553+0000 mgr.gibba043.dnkmem (mgr.34373) 8718 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:19 gibba003 bash[32348]: cephadm 2021-03-10T16:36:18.212301+0000 mgr.gibba043.dnkmem (mgr.34373) 8717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:19 gibba003 bash[32348]: cluster 2021-03-10T16:36:18.429553+0000 mgr.gibba043.dnkmem (mgr.34373) 8718 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:19 gibba043 bash[24019]: cephadm 2021-03-10T16:36:18.212301+0000 mgr.gibba043.dnkmem (mgr.34373) 8717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:19 gibba043 bash[24019]: cluster 2021-03-10T16:36:18.429553+0000 mgr.gibba043.dnkmem (mgr.34373) 8718 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:21.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:21 gibba003 bash[31385]: cluster 2021-03-10T16:36:20.430898+0000 mgr.gibba043.dnkmem (mgr.34373) 8719 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:21 gibba003 bash[32348]: cluster 2021-03-10T16:36:20.430898+0000 mgr.gibba043.dnkmem (mgr.34373) 8719 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:21 gibba043 bash[24019]: cluster 2021-03-10T16:36:20.430898+0000 mgr.gibba043.dnkmem (mgr.34373) 8719 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:23.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:23 gibba003 bash[31385]: cluster 2021-03-10T16:36:22.432248+0000 mgr.gibba043.dnkmem (mgr.34373) 8720 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:23.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:23 gibba003 bash[32348]: cluster 2021-03-10T16:36:22.432248+0000 mgr.gibba043.dnkmem (mgr.34373) 8720 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:23 gibba043 bash[24019]: cluster 2021-03-10T16:36:22.432248+0000 mgr.gibba043.dnkmem (mgr.34373) 8720 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:26.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:25 gibba043 bash[24019]: cluster 2021-03-10T16:36:24.433945+0000 mgr.gibba043.dnkmem (mgr.34373) 8721 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:25 gibba003 bash[31385]: cluster 2021-03-10T16:36:24.433945+0000 mgr.gibba043.dnkmem (mgr.34373) 8721 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:25 gibba003 bash[32348]: cluster 2021-03-10T16:36:24.433945+0000 mgr.gibba043.dnkmem (mgr.34373) 8721 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:26.681 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:36:26.909 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:36:26.909 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:36:26.909 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:36:26.909 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:36:26.910 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:36:26.910 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:36:26.910 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:36:26.910 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:36:26.911 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:36:26.911 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:36:26.911 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:36:26.911 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:36:26.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:36:26.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:36:26.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:36:26.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:36:26.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:36:26.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:36:26.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:36:26.913 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:36:26.913 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:36:27.157 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:36:27.158 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:36:27.158 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:27.158 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:36:27.159 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:36:27.159 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:27.160 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:36:27.160 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:36:27.161 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:36:27.161 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:36:27.161 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:36:27.162 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:36:27.162 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:36:27.163 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:36:27.163 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:36:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:27 gibba043 bash[24019]: cluster 2021-03-10T16:36:26.435575+0000 mgr.gibba043.dnkmem (mgr.34373) 8722 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:28.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:27 gibba043 bash[24019]: audit 2021-03-10T16:36:26.674813+0000 mgr.gibba043.dnkmem (mgr.34373) 8723 : audit [DBG] from='client.59890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:28.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:27 gibba043 bash[24019]: audit 2021-03-10T16:36:26.898456+0000 mgr.gibba043.dnkmem (mgr.34373) 8724 : audit [DBG] from='client.59896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:27 gibba043 bash[24019]: audit 2021-03-10T16:36:27.160810+0000 mon.a (mon.0) 1848 : audit [DBG] from='client.? 172.21.2.103:0/3100990782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:28.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[31385]: cluster 2021-03-10T16:36:26.435575+0000 mgr.gibba043.dnkmem (mgr.34373) 8722 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:28.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[31385]: audit 2021-03-10T16:36:26.674813+0000 mgr.gibba043.dnkmem (mgr.34373) 8723 : audit [DBG] from='client.59890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[31385]: audit 2021-03-10T16:36:26.898456+0000 mgr.gibba043.dnkmem (mgr.34373) 8724 : audit [DBG] from='client.59896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[31385]: audit 2021-03-10T16:36:27.160810+0000 mon.a (mon.0) 1848 : audit [DBG] from='client.? 172.21.2.103:0/3100990782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[32348]: cluster 2021-03-10T16:36:26.435575+0000 mgr.gibba043.dnkmem (mgr.34373) 8722 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[32348]: audit 2021-03-10T16:36:26.674813+0000 mgr.gibba043.dnkmem (mgr.34373) 8723 : audit [DBG] from='client.59890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[32348]: audit 2021-03-10T16:36:26.898456+0000 mgr.gibba043.dnkmem (mgr.34373) 8724 : audit [DBG] from='client.59896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:27 gibba003 bash[32348]: audit 2021-03-10T16:36:27.160810+0000 mon.a (mon.0) 1848 : audit [DBG] from='client.? 172.21.2.103:0/3100990782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:29 gibba043 bash[24019]: cluster 2021-03-10T16:36:28.437275+0000 mgr.gibba043.dnkmem (mgr.34373) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:29 gibba003 bash[31385]: cluster 2021-03-10T16:36:28.437275+0000 mgr.gibba043.dnkmem (mgr.34373) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:29 gibba003 bash[32348]: cluster 2021-03-10T16:36:28.437275+0000 mgr.gibba043.dnkmem (mgr.34373) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:32.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:31 gibba043 bash[24019]: cluster 2021-03-10T16:36:30.438667+0000 mgr.gibba043.dnkmem (mgr.34373) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:31 gibba003 bash[31385]: cluster 2021-03-10T16:36:30.438667+0000 mgr.gibba043.dnkmem (mgr.34373) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:31 gibba003 bash[32348]: cluster 2021-03-10T16:36:30.438667+0000 mgr.gibba043.dnkmem (mgr.34373) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:33 gibba043 bash[24019]: cluster 2021-03-10T16:36:32.440319+0000 mgr.gibba043.dnkmem (mgr.34373) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:33 gibba003 bash[31385]: cluster 2021-03-10T16:36:32.440319+0000 mgr.gibba043.dnkmem (mgr.34373) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:33 gibba003 bash[32348]: cluster 2021-03-10T16:36:32.440319+0000 mgr.gibba043.dnkmem (mgr.34373) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:35.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:34 gibba043 bash[24019]: cephadm 2021-03-10T16:36:33.228414+0000 mgr.gibba043.dnkmem (mgr.34373) 8728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:35.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:34 gibba003 bash[31385]: cephadm 2021-03-10T16:36:33.228414+0000 mgr.gibba043.dnkmem (mgr.34373) 8728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:35.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:34 gibba003 bash[32348]: cephadm 2021-03-10T16:36:33.228414+0000 mgr.gibba043.dnkmem (mgr.34373) 8728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:36.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:35 gibba043 bash[24019]: cluster 2021-03-10T16:36:34.442032+0000 mgr.gibba043.dnkmem (mgr.34373) 8729 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:35 gibba003 bash[31385]: cluster 2021-03-10T16:36:34.442032+0000 mgr.gibba043.dnkmem (mgr.34373) 8729 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:35 gibba003 bash[32348]: cluster 2021-03-10T16:36:34.442032+0000 mgr.gibba043.dnkmem (mgr.34373) 8729 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:37 gibba043 bash[24019]: cluster 2021-03-10T16:36:36.443803+0000 mgr.gibba043.dnkmem (mgr.34373) 8730 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:37 gibba003 bash[31385]: cluster 2021-03-10T16:36:36.443803+0000 mgr.gibba043.dnkmem (mgr.34373) 8730 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:37 gibba003 bash[32348]: cluster 2021-03-10T16:36:36.443803+0000 mgr.gibba043.dnkmem (mgr.34373) 8730 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:40.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:39 gibba043 bash[24019]: cluster 2021-03-10T16:36:38.445403+0000 mgr.gibba043.dnkmem (mgr.34373) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:39 gibba003 bash[31385]: cluster 2021-03-10T16:36:38.445403+0000 mgr.gibba043.dnkmem (mgr.34373) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:39 gibba003 bash[32348]: cluster 2021-03-10T16:36:38.445403+0000 mgr.gibba043.dnkmem (mgr.34373) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:42.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:41 gibba043 bash[24019]: cluster 2021-03-10T16:36:40.446589+0000 mgr.gibba043.dnkmem (mgr.34373) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:41 gibba003 bash[31385]: cluster 2021-03-10T16:36:40.446589+0000 mgr.gibba043.dnkmem (mgr.34373) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:41 gibba003 bash[32348]: cluster 2021-03-10T16:36:40.446589+0000 mgr.gibba043.dnkmem (mgr.34373) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:43 gibba003 bash[31385]: cluster 2021-03-10T16:36:42.448292+0000 mgr.gibba043.dnkmem (mgr.34373) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:43 gibba003 bash[32348]: cluster 2021-03-10T16:36:42.448292+0000 mgr.gibba043.dnkmem (mgr.34373) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:43 gibba043 bash[24019]: cluster 2021-03-10T16:36:42.448292+0000 mgr.gibba043.dnkmem (mgr.34373) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:45 gibba003 bash[31385]: cluster 2021-03-10T16:36:44.449772+0000 mgr.gibba043.dnkmem (mgr.34373) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:45 gibba003 bash[32348]: cluster 2021-03-10T16:36:44.449772+0000 mgr.gibba043.dnkmem (mgr.34373) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:45 gibba043 bash[24019]: cluster 2021-03-10T16:36:44.449772+0000 mgr.gibba043.dnkmem (mgr.34373) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:47 gibba003 bash[31385]: cluster 2021-03-10T16:36:46.451525+0000 mgr.gibba043.dnkmem (mgr.34373) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:47 gibba003 bash[32348]: cluster 2021-03-10T16:36:46.451525+0000 mgr.gibba043.dnkmem (mgr.34373) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:47 gibba043 bash[24019]: cluster 2021-03-10T16:36:46.451525+0000 mgr.gibba043.dnkmem (mgr.34373) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.245003+0000 mgr.gibba043.dnkmem (mgr.34373) 8736 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:36:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.246533+0000 mgr.gibba043.dnkmem (mgr.34373) 8737 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:36:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cluster 2021-03-10T16:36:48.452314+0000 mgr.gibba043.dnkmem (mgr.34373) 8738 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.477957+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:36:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.479497+0000 mgr.gibba043.dnkmem (mgr.34373) 8739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.482027+0000 mgr.gibba043.dnkmem (mgr.34373) 8740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.482178+0000 mon.c (mon.1) 2250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.483672+0000 mgr.gibba043.dnkmem (mgr.34373) 8741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:49.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.483753+0000 mgr.gibba043.dnkmem (mgr.34373) 8742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.484194+0000 mon.c (mon.1) 2251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.485070+0000 mgr.gibba043.dnkmem (mgr.34373) 8743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.485109+0000 mgr.gibba043.dnkmem (mgr.34373) 8744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.485717+0000 mon.c (mon.1) 2252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.486662+0000 mgr.gibba043.dnkmem (mgr.34373) 8745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.487261+0000 mon.c (mon.1) 2253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.488319+0000 mgr.gibba043.dnkmem (mgr.34373) 8746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.488359+0000 mgr.gibba043.dnkmem (mgr.34373) 8747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:49.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.489770+0000 mgr.gibba043.dnkmem (mgr.34373) 8748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:49.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.490163+0000 mgr.gibba043.dnkmem (mgr.34373) 8749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:49.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.490566+0000 mon.c (mon.1) 2254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.491510+0000 mgr.gibba043.dnkmem (mgr.34373) 8750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:49.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.491547+0000 mgr.gibba043.dnkmem (mgr.34373) 8751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:49.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: cephadm 2021-03-10T16:36:48.491654+0000 mgr.gibba043.dnkmem (mgr.34373) 8752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:49.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:49 gibba043 bash[24019]: audit 2021-03-10T16:36:48.492215+0000 mon.c (mon.1) 2255 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.245003+0000 mgr.gibba043.dnkmem (mgr.34373) 8736 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:36:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.246533+0000 mgr.gibba043.dnkmem (mgr.34373) 8737 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:36:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cluster 2021-03-10T16:36:48.452314+0000 mgr.gibba043.dnkmem (mgr.34373) 8738 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.477957+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:36:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.479497+0000 mgr.gibba043.dnkmem (mgr.34373) 8739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.482027+0000 mgr.gibba043.dnkmem (mgr.34373) 8740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.482178+0000 mon.c (mon.1) 2250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.483672+0000 mgr.gibba043.dnkmem (mgr.34373) 8741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.483753+0000 mgr.gibba043.dnkmem (mgr.34373) 8742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.484194+0000 mon.c (mon.1) 2251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.485070+0000 mgr.gibba043.dnkmem (mgr.34373) 8743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.485109+0000 mgr.gibba043.dnkmem (mgr.34373) 8744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.485717+0000 mon.c (mon.1) 2252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.486662+0000 mgr.gibba043.dnkmem (mgr.34373) 8745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.487261+0000 mon.c (mon.1) 2253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.488319+0000 mgr.gibba043.dnkmem (mgr.34373) 8746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.488359+0000 mgr.gibba043.dnkmem (mgr.34373) 8747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.489770+0000 mgr.gibba043.dnkmem (mgr.34373) 8748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.490163+0000 mgr.gibba043.dnkmem (mgr.34373) 8749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.490566+0000 mon.c (mon.1) 2254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.491510+0000 mgr.gibba043.dnkmem (mgr.34373) 8750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:49.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.245003+0000 mgr.gibba043.dnkmem (mgr.34373) 8736 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:36:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.246533+0000 mgr.gibba043.dnkmem (mgr.34373) 8737 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:36:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cluster 2021-03-10T16:36:48.452314+0000 mgr.gibba043.dnkmem (mgr.34373) 8738 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.477957+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:36:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.479497+0000 mgr.gibba043.dnkmem (mgr.34373) 8739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.482027+0000 mgr.gibba043.dnkmem (mgr.34373) 8740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.482178+0000 mon.c (mon.1) 2250 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.483672+0000 mgr.gibba043.dnkmem (mgr.34373) 8741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.483753+0000 mgr.gibba043.dnkmem (mgr.34373) 8742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.484194+0000 mon.c (mon.1) 2251 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.485070+0000 mgr.gibba043.dnkmem (mgr.34373) 8743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.485109+0000 mgr.gibba043.dnkmem (mgr.34373) 8744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.485717+0000 mon.c (mon.1) 2252 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.486662+0000 mgr.gibba043.dnkmem (mgr.34373) 8745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.487261+0000 mon.c (mon.1) 2253 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.488319+0000 mgr.gibba043.dnkmem (mgr.34373) 8746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.488359+0000 mgr.gibba043.dnkmem (mgr.34373) 8747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.489770+0000 mgr.gibba043.dnkmem (mgr.34373) 8748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:49.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.490163+0000 mgr.gibba043.dnkmem (mgr.34373) 8749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:49.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.490566+0000 mon.c (mon.1) 2254 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.491510+0000 mgr.gibba043.dnkmem (mgr.34373) 8750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:49.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.491547+0000 mgr.gibba043.dnkmem (mgr.34373) 8751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:49.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: cephadm 2021-03-10T16:36:48.491654+0000 mgr.gibba043.dnkmem (mgr.34373) 8752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:49.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[32348]: audit 2021-03-10T16:36:48.492215+0000 mon.c (mon.1) 2255 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:49.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.491547+0000 mgr.gibba043.dnkmem (mgr.34373) 8751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:49.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: cephadm 2021-03-10T16:36:48.491654+0000 mgr.gibba043.dnkmem (mgr.34373) 8752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:36:49.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:49 gibba003 bash[31385]: audit 2021-03-10T16:36:48.492215+0000 mon.c (mon.1) 2255 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:51.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:51 gibba043 bash[24019]: cluster 2021-03-10T16:36:50.453678+0000 mgr.gibba043.dnkmem (mgr.34373) 8753 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:51.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:51 gibba003 bash[31385]: cluster 2021-03-10T16:36:50.453678+0000 mgr.gibba043.dnkmem (mgr.34373) 8753 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:51 gibba003 bash[32348]: cluster 2021-03-10T16:36:50.453678+0000 mgr.gibba043.dnkmem (mgr.34373) 8753 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:53 gibba003 bash[31385]: cluster 2021-03-10T16:36:52.455030+0000 mgr.gibba043.dnkmem (mgr.34373) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:53 gibba003 bash[32348]: cluster 2021-03-10T16:36:52.455030+0000 mgr.gibba043.dnkmem (mgr.34373) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:54.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:53 gibba043 bash[24019]: cluster 2021-03-10T16:36:52.455030+0000 mgr.gibba043.dnkmem (mgr.34373) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:55.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:55 gibba003 bash[31385]: cluster 2021-03-10T16:36:54.456814+0000 mgr.gibba043.dnkmem (mgr.34373) 8755 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:55.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:55 gibba003 bash[32348]: cluster 2021-03-10T16:36:54.456814+0000 mgr.gibba043.dnkmem (mgr.34373) 8755 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:56.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:55 gibba043 bash[24019]: cluster 2021-03-10T16:36:54.456814+0000 mgr.gibba043.dnkmem (mgr.34373) 8755 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.403 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:36:57.633 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:36:57.633 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:36:57.633 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:36:57.634 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:36:57.634 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:36:57.634 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:36:57.634 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:36:57.635 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:36:57.635 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:36:57.635 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:36:57.635 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:36:57.635 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:36:57.636 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:36:57.636 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:36:57.636 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:36:57.636 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:36:57.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:36:57.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:36:57.637 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:36:57.637 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:36:57.638 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:36:57.883 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:36:57.883 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:36:57.884 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:57.884 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:36:57.884 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:36:57.884 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:57.885 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:36:57.885 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:36:57.885 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:36:57.885 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:36:57.886 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:36:57.886 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:36:57.886 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:36:57.886 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:36:57.886 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:36:57.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:57 gibba003 bash[31385]: cluster 2021-03-10T16:36:56.458607+0000 mgr.gibba043.dnkmem (mgr.34373) 8756 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:57 gibba003 bash[32348]: cluster 2021-03-10T16:36:56.458607+0000 mgr.gibba043.dnkmem (mgr.34373) 8756 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:57 gibba043 bash[24019]: cluster 2021-03-10T16:36:56.458607+0000 mgr.gibba043.dnkmem (mgr.34373) 8756 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:58.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:58 gibba003 bash[31385]: audit 2021-03-10T16:36:57.396184+0000 mgr.gibba043.dnkmem (mgr.34373) 8757 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:58.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:58 gibba003 bash[31385]: audit 2021-03-10T16:36:57.624028+0000 mgr.gibba043.dnkmem (mgr.34373) 8758 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:58.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:58 gibba003 bash[31385]: audit 2021-03-10T16:36:57.886822+0000 mon.c (mon.1) 2256 : audit [DBG] from='client.? 172.21.2.103:0/1795356473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:58.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:58 gibba003 bash[32348]: audit 2021-03-10T16:36:57.396184+0000 mgr.gibba043.dnkmem (mgr.34373) 8757 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:58.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:58 gibba003 bash[32348]: audit 2021-03-10T16:36:57.624028+0000 mgr.gibba043.dnkmem (mgr.34373) 8758 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:58.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:58 gibba003 bash[32348]: audit 2021-03-10T16:36:57.886822+0000 mon.c (mon.1) 2256 : audit [DBG] from='client.? 172.21.2.103:0/1795356473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:59.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:58 gibba043 bash[24019]: audit 2021-03-10T16:36:57.396184+0000 mgr.gibba043.dnkmem (mgr.34373) 8757 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:58 gibba043 bash[24019]: audit 2021-03-10T16:36:57.624028+0000 mgr.gibba043.dnkmem (mgr.34373) 8758 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:58 gibba043 bash[24019]: audit 2021-03-10T16:36:57.886822+0000 mon.c (mon.1) 2256 : audit [DBG] from='client.? 172.21.2.103:0/1795356473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:59.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:36:59 gibba003 bash[31385]: cluster 2021-03-10T16:36:58.460114+0000 mgr.gibba043.dnkmem (mgr.34373) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:36:59 gibba003 bash[32348]: cluster 2021-03-10T16:36:58.460114+0000 mgr.gibba043.dnkmem (mgr.34373) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:36:59 gibba043 bash[24019]: cluster 2021-03-10T16:36:58.460114+0000 mgr.gibba043.dnkmem (mgr.34373) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:01.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:01 gibba003 bash[31385]: cluster 2021-03-10T16:37:00.461384+0000 mgr.gibba043.dnkmem (mgr.34373) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:01.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:01 gibba003 bash[32348]: cluster 2021-03-10T16:37:00.461384+0000 mgr.gibba043.dnkmem (mgr.34373) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:02.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:01 gibba043 bash[24019]: cluster 2021-03-10T16:37:00.461384+0000 mgr.gibba043.dnkmem (mgr.34373) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:03 gibba043 bash[24019]: cluster 2021-03-10T16:37:02.463001+0000 mgr.gibba043.dnkmem (mgr.34373) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:03 gibba003 bash[31385]: cluster 2021-03-10T16:37:02.463001+0000 mgr.gibba043.dnkmem (mgr.34373) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:03 gibba003 bash[32348]: cluster 2021-03-10T16:37:02.463001+0000 mgr.gibba043.dnkmem (mgr.34373) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:04.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:04 gibba003 bash[31385]: cephadm 2021-03-10T16:37:03.507716+0000 mgr.gibba043.dnkmem (mgr.34373) 8762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:04.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:04 gibba003 bash[32348]: cephadm 2021-03-10T16:37:03.507716+0000 mgr.gibba043.dnkmem (mgr.34373) 8762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:05.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:04 gibba043 bash[24019]: cephadm 2021-03-10T16:37:03.507716+0000 mgr.gibba043.dnkmem (mgr.34373) 8762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:05 gibba003 bash[31385]: cluster 2021-03-10T16:37:04.464774+0000 mgr.gibba043.dnkmem (mgr.34373) 8763 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:05.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:05 gibba003 bash[32348]: cluster 2021-03-10T16:37:04.464774+0000 mgr.gibba043.dnkmem (mgr.34373) 8763 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:05 gibba043 bash[24019]: cluster 2021-03-10T16:37:04.464774+0000 mgr.gibba043.dnkmem (mgr.34373) 8763 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:07 gibba003 bash[31385]: cluster 2021-03-10T16:37:06.466316+0000 mgr.gibba043.dnkmem (mgr.34373) 8764 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:07 gibba003 bash[32348]: cluster 2021-03-10T16:37:06.466316+0000 mgr.gibba043.dnkmem (mgr.34373) 8764 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:07 gibba043 bash[24019]: cluster 2021-03-10T16:37:06.466316+0000 mgr.gibba043.dnkmem (mgr.34373) 8764 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:09.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:09 gibba003 bash[31385]: cluster 2021-03-10T16:37:08.467956+0000 mgr.gibba043.dnkmem (mgr.34373) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:09 gibba003 bash[32348]: cluster 2021-03-10T16:37:08.467956+0000 mgr.gibba043.dnkmem (mgr.34373) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:09 gibba043 bash[24019]: cluster 2021-03-10T16:37:08.467956+0000 mgr.gibba043.dnkmem (mgr.34373) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:11.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:11 gibba003 bash[31385]: cluster 2021-03-10T16:37:10.469229+0000 mgr.gibba043.dnkmem (mgr.34373) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:11 gibba003 bash[32348]: cluster 2021-03-10T16:37:10.469229+0000 mgr.gibba043.dnkmem (mgr.34373) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:12.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:11 gibba043 bash[24019]: cluster 2021-03-10T16:37:10.469229+0000 mgr.gibba043.dnkmem (mgr.34373) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:13 gibba003 bash[31385]: cluster 2021-03-10T16:37:12.470835+0000 mgr.gibba043.dnkmem (mgr.34373) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:13 gibba003 bash[32348]: cluster 2021-03-10T16:37:12.470835+0000 mgr.gibba043.dnkmem (mgr.34373) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:13 gibba043 bash[24019]: cluster 2021-03-10T16:37:12.470835+0000 mgr.gibba043.dnkmem (mgr.34373) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:13.786499+0000 mon.c (mon.1) 2257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:14.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:13.787600+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.010948+0000 mon.c (mon.1) 2258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.012005+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.226566+0000 mon.c (mon.1) 2259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:37:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.227333+0000 mon.c (mon.1) 2260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.227788+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:37:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.228020+0000 mon.c (mon.1) 2261 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:37:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.228940+0000 mon.c (mon.1) 2262 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.229353+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.230331+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:37:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[31385]: audit 2021-03-10T16:37:14.231130+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:13.786499+0000 mon.c (mon.1) 2257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:14.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:13.787600+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.010948+0000 mon.c (mon.1) 2258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.012005+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.226566+0000 mon.c (mon.1) 2259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:37:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.227333+0000 mon.c (mon.1) 2260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.227788+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:37:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.228020+0000 mon.c (mon.1) 2261 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:37:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.228940+0000 mon.c (mon.1) 2262 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.229353+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:37:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.230331+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:37:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:14 gibba003 bash[32348]: audit 2021-03-10T16:37:14.231130+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:15.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:13.786499+0000 mon.c (mon.1) 2257 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:13.787600+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.010948+0000 mon.c (mon.1) 2258 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.012005+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.226566+0000 mon.c (mon.1) 2259 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:37:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.227333+0000 mon.c (mon.1) 2260 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:37:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.227788+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:37:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.228020+0000 mon.c (mon.1) 2261 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:37:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.228940+0000 mon.c (mon.1) 2262 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.229353+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:37:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.230331+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:37:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:14 gibba043 bash[24019]: audit 2021-03-10T16:37:14.231130+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:15.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:15 gibba003 bash[31385]: cluster 2021-03-10T16:37:14.472351+0000 mgr.gibba043.dnkmem (mgr.34373) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:15.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:15 gibba003 bash[32348]: cluster 2021-03-10T16:37:14.472351+0000 mgr.gibba043.dnkmem (mgr.34373) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:16.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:15 gibba043 bash[24019]: cluster 2021-03-10T16:37:14.472351+0000 mgr.gibba043.dnkmem (mgr.34373) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:17 gibba003 bash[31385]: cluster 2021-03-10T16:37:16.473135+0000 mgr.gibba043.dnkmem (mgr.34373) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:17 gibba003 bash[32348]: cluster 2021-03-10T16:37:16.473135+0000 mgr.gibba043.dnkmem (mgr.34373) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:17 gibba043 bash[24019]: cluster 2021-03-10T16:37:16.473135+0000 mgr.gibba043.dnkmem (mgr.34373) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:19.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:19 gibba003 bash[31385]: cluster 2021-03-10T16:37:18.474603+0000 mgr.gibba043.dnkmem (mgr.34373) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:19.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:19 gibba003 bash[31385]: cephadm 2021-03-10T16:37:18.523524+0000 mgr.gibba043.dnkmem (mgr.34373) 8771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:19.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:19 gibba003 bash[32348]: cluster 2021-03-10T16:37:18.474603+0000 mgr.gibba043.dnkmem (mgr.34373) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:19.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:19 gibba003 bash[32348]: cephadm 2021-03-10T16:37:18.523524+0000 mgr.gibba043.dnkmem (mgr.34373) 8771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:19 gibba043 bash[24019]: cluster 2021-03-10T16:37:18.474603+0000 mgr.gibba043.dnkmem (mgr.34373) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:20.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:19 gibba043 bash[24019]: cephadm 2021-03-10T16:37:18.523524+0000 mgr.gibba043.dnkmem (mgr.34373) 8771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:21.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:21 gibba003 bash[31385]: cluster 2021-03-10T16:37:20.476083+0000 mgr.gibba043.dnkmem (mgr.34373) 8772 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:21 gibba003 bash[32348]: cluster 2021-03-10T16:37:20.476083+0000 mgr.gibba043.dnkmem (mgr.34373) 8772 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:21 gibba043 bash[24019]: cluster 2021-03-10T16:37:20.476083+0000 mgr.gibba043.dnkmem (mgr.34373) 8772 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:23 gibba043 bash[24019]: cluster 2021-03-10T16:37:22.477731+0000 mgr.gibba043.dnkmem (mgr.34373) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:23 gibba003 bash[31385]: cluster 2021-03-10T16:37:22.477731+0000 mgr.gibba043.dnkmem (mgr.34373) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:24.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:23 gibba003 bash[32348]: cluster 2021-03-10T16:37:22.477731+0000 mgr.gibba043.dnkmem (mgr.34373) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:26.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:25 gibba043 bash[24019]: cluster 2021-03-10T16:37:24.479476+0000 mgr.gibba043.dnkmem (mgr.34373) 8774 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:25 gibba003 bash[31385]: cluster 2021-03-10T16:37:24.479476+0000 mgr.gibba043.dnkmem (mgr.34373) 8774 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:25 gibba003 bash[32348]: cluster 2021-03-10T16:37:24.479476+0000 mgr.gibba043.dnkmem (mgr.34373) 8774 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:27 gibba043 bash[24019]: cluster 2021-03-10T16:37:26.480451+0000 mgr.gibba043.dnkmem (mgr.34373) 8775 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:28.127 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:37:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:27 gibba003 bash[31385]: cluster 2021-03-10T16:37:26.480451+0000 mgr.gibba043.dnkmem (mgr.34373) 8775 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:28.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:27 gibba003 bash[32348]: cluster 2021-03-10T16:37:26.480451+0000 mgr.gibba043.dnkmem (mgr.34373) 8775 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:28.354 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:37:28.355 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:37:28.355 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:37:28.355 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:37:28.356 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:37:28.356 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:37:28.356 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:37:28.356 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:37:28.357 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:37:28.357 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:37:28.357 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:37:28.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:37:28.358 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:37:28.358 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:37:28.358 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:37:28.358 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:37:28.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:37:28.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:37:28.359 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:37:28.359 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:37:28.360 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:37:28.606 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:37:28.607 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:37:28.607 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:28.607 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:37:28.607 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:37:28.608 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:28.608 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:37:28.608 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:37:28.608 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:37:28.608 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:37:28.609 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:37:28.609 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:37:28.609 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:37:28.609 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:37:28.609 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:37:29.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:28 gibba043 bash[24019]: audit 2021-03-10T16:37:28.610110+0000 mon.c (mon.1) 2263 : audit [DBG] from='client.? 172.21.2.103:0/433999538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:29.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:28 gibba003 bash[31385]: audit 2021-03-10T16:37:28.610110+0000 mon.c (mon.1) 2263 : audit [DBG] from='client.? 172.21.2.103:0/433999538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:29.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:28 gibba003 bash[32348]: audit 2021-03-10T16:37:28.610110+0000 mon.c (mon.1) 2263 : audit [DBG] from='client.? 172.21.2.103:0/433999538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:29 gibba043 bash[24019]: audit 2021-03-10T16:37:28.120058+0000 mgr.gibba043.dnkmem (mgr.34373) 8776 : audit [DBG] from='client.49938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:29 gibba043 bash[24019]: audit 2021-03-10T16:37:28.344213+0000 mgr.gibba043.dnkmem (mgr.34373) 8777 : audit [DBG] from='client.59932 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:29 gibba043 bash[24019]: cluster 2021-03-10T16:37:28.481878+0000 mgr.gibba043.dnkmem (mgr.34373) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:29 gibba003 bash[31385]: audit 2021-03-10T16:37:28.120058+0000 mgr.gibba043.dnkmem (mgr.34373) 8776 : audit [DBG] from='client.49938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:30.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:29 gibba003 bash[31385]: audit 2021-03-10T16:37:28.344213+0000 mgr.gibba043.dnkmem (mgr.34373) 8777 : audit [DBG] from='client.59932 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:30.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:29 gibba003 bash[31385]: cluster 2021-03-10T16:37:28.481878+0000 mgr.gibba043.dnkmem (mgr.34373) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:29 gibba003 bash[32348]: audit 2021-03-10T16:37:28.120058+0000 mgr.gibba043.dnkmem (mgr.34373) 8776 : audit [DBG] from='client.49938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:30.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:29 gibba003 bash[32348]: audit 2021-03-10T16:37:28.344213+0000 mgr.gibba043.dnkmem (mgr.34373) 8777 : audit [DBG] from='client.59932 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:30.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:29 gibba003 bash[32348]: cluster 2021-03-10T16:37:28.481878+0000 mgr.gibba043.dnkmem (mgr.34373) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:32.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:31 gibba043 bash[24019]: cluster 2021-03-10T16:37:30.483439+0000 mgr.gibba043.dnkmem (mgr.34373) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:31 gibba003 bash[31385]: cluster 2021-03-10T16:37:30.483439+0000 mgr.gibba043.dnkmem (mgr.34373) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:31 gibba003 bash[32348]: cluster 2021-03-10T16:37:30.483439+0000 mgr.gibba043.dnkmem (mgr.34373) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:34.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:33 gibba043 bash[24019]: cluster 2021-03-10T16:37:32.485105+0000 mgr.gibba043.dnkmem (mgr.34373) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:33 gibba003 bash[31385]: cluster 2021-03-10T16:37:32.485105+0000 mgr.gibba043.dnkmem (mgr.34373) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:33 gibba003 bash[32348]: cluster 2021-03-10T16:37:32.485105+0000 mgr.gibba043.dnkmem (mgr.34373) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:35.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:34 gibba043 bash[24019]: cephadm 2021-03-10T16:37:33.539454+0000 mgr.gibba043.dnkmem (mgr.34373) 8781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:35.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:34 gibba003 bash[31385]: cephadm 2021-03-10T16:37:33.539454+0000 mgr.gibba043.dnkmem (mgr.34373) 8781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:35.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:34 gibba003 bash[32348]: cephadm 2021-03-10T16:37:33.539454+0000 mgr.gibba043.dnkmem (mgr.34373) 8781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:36.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:35 gibba043 bash[24019]: cluster 2021-03-10T16:37:34.486913+0000 mgr.gibba043.dnkmem (mgr.34373) 8782 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:35 gibba003 bash[31385]: cluster 2021-03-10T16:37:34.486913+0000 mgr.gibba043.dnkmem (mgr.34373) 8782 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:35 gibba003 bash[32348]: cluster 2021-03-10T16:37:34.486913+0000 mgr.gibba043.dnkmem (mgr.34373) 8782 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:37 gibba003 bash[31385]: cluster 2021-03-10T16:37:36.487718+0000 mgr.gibba043.dnkmem (mgr.34373) 8783 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:37 gibba003 bash[32348]: cluster 2021-03-10T16:37:36.487718+0000 mgr.gibba043.dnkmem (mgr.34373) 8783 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:37 gibba043 bash[24019]: cluster 2021-03-10T16:37:36.487718+0000 mgr.gibba043.dnkmem (mgr.34373) 8783 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:39 gibba003 bash[31385]: cluster 2021-03-10T16:37:38.489232+0000 mgr.gibba043.dnkmem (mgr.34373) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:39 gibba003 bash[32348]: cluster 2021-03-10T16:37:38.489232+0000 mgr.gibba043.dnkmem (mgr.34373) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:39 gibba043 bash[24019]: cluster 2021-03-10T16:37:38.489232+0000 mgr.gibba043.dnkmem (mgr.34373) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:41 gibba003 bash[31385]: cluster 2021-03-10T16:37:40.490730+0000 mgr.gibba043.dnkmem (mgr.34373) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:41 gibba003 bash[32348]: cluster 2021-03-10T16:37:40.490730+0000 mgr.gibba043.dnkmem (mgr.34373) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:41 gibba043 bash[24019]: cluster 2021-03-10T16:37:40.490730+0000 mgr.gibba043.dnkmem (mgr.34373) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:43 gibba003 bash[31385]: cluster 2021-03-10T16:37:42.492471+0000 mgr.gibba043.dnkmem (mgr.34373) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:43 gibba003 bash[32348]: cluster 2021-03-10T16:37:42.492471+0000 mgr.gibba043.dnkmem (mgr.34373) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:43 gibba043 bash[24019]: cluster 2021-03-10T16:37:42.492471+0000 mgr.gibba043.dnkmem (mgr.34373) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:45 gibba003 bash[31385]: cluster 2021-03-10T16:37:44.494115+0000 mgr.gibba043.dnkmem (mgr.34373) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:45 gibba003 bash[32348]: cluster 2021-03-10T16:37:44.494115+0000 mgr.gibba043.dnkmem (mgr.34373) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:45 gibba043 bash[24019]: cluster 2021-03-10T16:37:44.494115+0000 mgr.gibba043.dnkmem (mgr.34373) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:47 gibba003 bash[31385]: cluster 2021-03-10T16:37:46.495612+0000 mgr.gibba043.dnkmem (mgr.34373) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:47 gibba003 bash[32348]: cluster 2021-03-10T16:37:46.495612+0000 mgr.gibba043.dnkmem (mgr.34373) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:47 gibba043 bash[24019]: cluster 2021-03-10T16:37:46.495612+0000 mgr.gibba043.dnkmem (mgr.34373) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cluster 2021-03-10T16:37:48.496981+0000 mgr.gibba043.dnkmem (mgr.34373) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.549252+0000 mgr.gibba043.dnkmem (mgr.34373) 8790 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:37:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.550556+0000 mgr.gibba043.dnkmem (mgr.34373) 8791 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:37:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.771230+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:37:50.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.772975+0000 mgr.gibba043.dnkmem (mgr.34373) 8792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.774790+0000 mgr.gibba043.dnkmem (mgr.34373) 8793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.775354+0000 mon.c (mon.1) 2264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.776150+0000 mgr.gibba043.dnkmem (mgr.34373) 8794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.776196+0000 mgr.gibba043.dnkmem (mgr.34373) 8795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.776763+0000 mon.c (mon.1) 2265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.777782+0000 mgr.gibba043.dnkmem (mgr.34373) 8796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.777829+0000 mgr.gibba043.dnkmem (mgr.34373) 8797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.778328+0000 mon.c (mon.1) 2266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.779358+0000 mgr.gibba043.dnkmem (mgr.34373) 8798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:50.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.779880+0000 mon.c (mon.1) 2267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.781225+0000 mgr.gibba043.dnkmem (mgr.34373) 8799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:50.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.781273+0000 mgr.gibba043.dnkmem (mgr.34373) 8800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:50.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.782836+0000 mgr.gibba043.dnkmem (mgr.34373) 8801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.783251+0000 mgr.gibba043.dnkmem (mgr.34373) 8802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.783368+0000 mon.c (mon.1) 2268 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.784848+0000 mgr.gibba043.dnkmem (mgr.34373) 8803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:50.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cluster 2021-03-10T16:37:48.496981+0000 mgr.gibba043.dnkmem (mgr.34373) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.549252+0000 mgr.gibba043.dnkmem (mgr.34373) 8790 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:37:50.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.550556+0000 mgr.gibba043.dnkmem (mgr.34373) 8791 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:37:50.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.771230+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:37:50.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.772975+0000 mgr.gibba043.dnkmem (mgr.34373) 8792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.774790+0000 mgr.gibba043.dnkmem (mgr.34373) 8793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.775354+0000 mon.c (mon.1) 2264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.776150+0000 mgr.gibba043.dnkmem (mgr.34373) 8794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:50.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.776196+0000 mgr.gibba043.dnkmem (mgr.34373) 8795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:50.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.776763+0000 mon.c (mon.1) 2265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.777782+0000 mgr.gibba043.dnkmem (mgr.34373) 8796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:50.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.777829+0000 mgr.gibba043.dnkmem (mgr.34373) 8797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:50.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.778328+0000 mon.c (mon.1) 2266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.779358+0000 mgr.gibba043.dnkmem (mgr.34373) 8798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.779880+0000 mon.c (mon.1) 2267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.781225+0000 mgr.gibba043.dnkmem (mgr.34373) 8799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.781273+0000 mgr.gibba043.dnkmem (mgr.34373) 8800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.782836+0000 mgr.gibba043.dnkmem (mgr.34373) 8801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:50.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.783251+0000 mgr.gibba043.dnkmem (mgr.34373) 8802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:50.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.783368+0000 mon.c (mon.1) 2268 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.784848+0000 mgr.gibba043.dnkmem (mgr.34373) 8803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:50.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.784903+0000 mgr.gibba043.dnkmem (mgr.34373) 8804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:50.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: cephadm 2021-03-10T16:37:48.785052+0000 mgr.gibba043.dnkmem (mgr.34373) 8805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:50.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[32348]: audit 2021-03-10T16:37:48.785297+0000 mon.c (mon.1) 2269 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.784903+0000 mgr.gibba043.dnkmem (mgr.34373) 8804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:50.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: cephadm 2021-03-10T16:37:48.785052+0000 mgr.gibba043.dnkmem (mgr.34373) 8805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:50.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:49 gibba003 bash[31385]: audit 2021-03-10T16:37:48.785297+0000 mon.c (mon.1) 2269 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cluster 2021-03-10T16:37:48.496981+0000 mgr.gibba043.dnkmem (mgr.34373) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.549252+0000 mgr.gibba043.dnkmem (mgr.34373) 8790 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:37:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.550556+0000 mgr.gibba043.dnkmem (mgr.34373) 8791 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:37:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.771230+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:37:50.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.772975+0000 mgr.gibba043.dnkmem (mgr.34373) 8792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.774790+0000 mgr.gibba043.dnkmem (mgr.34373) 8793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.775354+0000 mon.c (mon.1) 2264 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.776150+0000 mgr.gibba043.dnkmem (mgr.34373) 8794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.776196+0000 mgr.gibba043.dnkmem (mgr.34373) 8795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.776763+0000 mon.c (mon.1) 2265 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.777782+0000 mgr.gibba043.dnkmem (mgr.34373) 8796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:50.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.777829+0000 mgr.gibba043.dnkmem (mgr.34373) 8797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:50.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.778328+0000 mon.c (mon.1) 2266 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.779358+0000 mgr.gibba043.dnkmem (mgr.34373) 8798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.779880+0000 mon.c (mon.1) 2267 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.781225+0000 mgr.gibba043.dnkmem (mgr.34373) 8799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.781273+0000 mgr.gibba043.dnkmem (mgr.34373) 8800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.782836+0000 mgr.gibba043.dnkmem (mgr.34373) 8801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.783251+0000 mgr.gibba043.dnkmem (mgr.34373) 8802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.783368+0000 mon.c (mon.1) 2268 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.784848+0000 mgr.gibba043.dnkmem (mgr.34373) 8803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:50.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.784903+0000 mgr.gibba043.dnkmem (mgr.34373) 8804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:50.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: cephadm 2021-03-10T16:37:48.785052+0000 mgr.gibba043.dnkmem (mgr.34373) 8805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:37:50.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:49 gibba043 bash[24019]: audit 2021-03-10T16:37:48.785297+0000 mon.c (mon.1) 2269 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:51 gibba003 bash[31385]: cluster 2021-03-10T16:37:50.498512+0000 mgr.gibba043.dnkmem (mgr.34373) 8806 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:51 gibba003 bash[32348]: cluster 2021-03-10T16:37:50.498512+0000 mgr.gibba043.dnkmem (mgr.34373) 8806 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:51 gibba043 bash[24019]: cluster 2021-03-10T16:37:50.498512+0000 mgr.gibba043.dnkmem (mgr.34373) 8806 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:53 gibba003 bash[31385]: cluster 2021-03-10T16:37:52.500157+0000 mgr.gibba043.dnkmem (mgr.34373) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:53 gibba003 bash[32348]: cluster 2021-03-10T16:37:52.500157+0000 mgr.gibba043.dnkmem (mgr.34373) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:53 gibba043 bash[24019]: cluster 2021-03-10T16:37:52.500157+0000 mgr.gibba043.dnkmem (mgr.34373) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:56.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:55 gibba003 bash[31385]: cluster 2021-03-10T16:37:54.501657+0000 mgr.gibba043.dnkmem (mgr.34373) 8808 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:56.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:55 gibba003 bash[32348]: cluster 2021-03-10T16:37:54.501657+0000 mgr.gibba043.dnkmem (mgr.34373) 8808 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:55 gibba043 bash[24019]: cluster 2021-03-10T16:37:54.501657+0000 mgr.gibba043.dnkmem (mgr.34373) 8808 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:57 gibba003 bash[31385]: cluster 2021-03-10T16:37:56.502591+0000 mgr.gibba043.dnkmem (mgr.34373) 8809 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:57 gibba003 bash[32348]: cluster 2021-03-10T16:37:56.502591+0000 mgr.gibba043.dnkmem (mgr.34373) 8809 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:57 gibba043 bash[24019]: cluster 2021-03-10T16:37:56.502591+0000 mgr.gibba043.dnkmem (mgr.34373) 8809 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:58.847 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:37:59.077 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:37:59.077 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:37:59.077 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:37:59.078 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:37:59.078 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:37:59.078 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:37:59.078 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:37:59.079 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:37:59.079 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:37:59.079 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:37:59.079 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:37:59.079 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:37:59.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:37:59.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:37:59.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:37:59.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:37:59.081 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:37:59.081 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:37:59.081 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:37:59.081 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:37:59.082 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:37:59.324 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:37:59.325 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:37:59.325 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:59.325 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:37:59.325 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:37:59.326 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:59.326 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:37:59.326 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:37:59.326 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:37:59.327 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:37:59.327 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:37:59.327 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:37:59.327 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:37:59.327 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:37:59.328 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:38:00.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:59 gibba003 bash[31385]: cluster 2021-03-10T16:37:58.504010+0000 mgr.gibba043.dnkmem (mgr.34373) 8810 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:00.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:59 gibba003 bash[31385]: audit 2021-03-10T16:37:58.841282+0000 mgr.gibba043.dnkmem (mgr.34373) 8811 : audit [DBG] from='client.59944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:00.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:37:59 gibba003 bash[31385]: audit 2021-03-10T16:37:59.328284+0000 mon.c (mon.1) 2270 : audit [DBG] from='client.? 172.21.2.103:0/1660013287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:00.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:59 gibba003 bash[32348]: cluster 2021-03-10T16:37:58.504010+0000 mgr.gibba043.dnkmem (mgr.34373) 8810 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:00.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:59 gibba003 bash[32348]: audit 2021-03-10T16:37:58.841282+0000 mgr.gibba043.dnkmem (mgr.34373) 8811 : audit [DBG] from='client.59944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:00.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:37:59 gibba003 bash[32348]: audit 2021-03-10T16:37:59.328284+0000 mon.c (mon.1) 2270 : audit [DBG] from='client.? 172.21.2.103:0/1660013287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:59 gibba043 bash[24019]: cluster 2021-03-10T16:37:58.504010+0000 mgr.gibba043.dnkmem (mgr.34373) 8810 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:00.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:59 gibba043 bash[24019]: audit 2021-03-10T16:37:58.841282+0000 mgr.gibba043.dnkmem (mgr.34373) 8811 : audit [DBG] from='client.59944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:00.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:37:59 gibba043 bash[24019]: audit 2021-03-10T16:37:59.328284+0000 mon.c (mon.1) 2270 : audit [DBG] from='client.? 172.21.2.103:0/1660013287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:01.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:00 gibba003 bash[31385]: audit 2021-03-10T16:37:59.066413+0000 mgr.gibba043.dnkmem (mgr.34373) 8812 : audit [DBG] from='client.49962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:01.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:00 gibba003 bash[32348]: audit 2021-03-10T16:37:59.066413+0000 mgr.gibba043.dnkmem (mgr.34373) 8812 : audit [DBG] from='client.49962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:01.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:00 gibba043 bash[24019]: audit 2021-03-10T16:37:59.066413+0000 mgr.gibba043.dnkmem (mgr.34373) 8812 : audit [DBG] from='client.49962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:02.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:01 gibba003 bash[31385]: cluster 2021-03-10T16:38:00.505516+0000 mgr.gibba043.dnkmem (mgr.34373) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:02.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:01 gibba003 bash[32348]: cluster 2021-03-10T16:38:00.505516+0000 mgr.gibba043.dnkmem (mgr.34373) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:01 gibba043 bash[24019]: cluster 2021-03-10T16:38:00.505516+0000 mgr.gibba043.dnkmem (mgr.34373) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:04.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:03 gibba003 bash[31385]: cluster 2021-03-10T16:38:02.507207+0000 mgr.gibba043.dnkmem (mgr.34373) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:03 gibba003 bash[32348]: cluster 2021-03-10T16:38:02.507207+0000 mgr.gibba043.dnkmem (mgr.34373) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:03 gibba043 bash[24019]: cluster 2021-03-10T16:38:02.507207+0000 mgr.gibba043.dnkmem (mgr.34373) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:04 gibba003 bash[31385]: cephadm 2021-03-10T16:38:03.799906+0000 mgr.gibba043.dnkmem (mgr.34373) 8815 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:05.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:04 gibba003 bash[32348]: cephadm 2021-03-10T16:38:03.799906+0000 mgr.gibba043.dnkmem (mgr.34373) 8815 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:04 gibba043 bash[24019]: cephadm 2021-03-10T16:38:03.799906+0000 mgr.gibba043.dnkmem (mgr.34373) 8815 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:05 gibba003 bash[31385]: cluster 2021-03-10T16:38:04.508975+0000 mgr.gibba043.dnkmem (mgr.34373) 8816 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:06.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:05 gibba003 bash[32348]: cluster 2021-03-10T16:38:04.508975+0000 mgr.gibba043.dnkmem (mgr.34373) 8816 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:05 gibba043 bash[24019]: cluster 2021-03-10T16:38:04.508975+0000 mgr.gibba043.dnkmem (mgr.34373) 8816 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:07 gibba003 bash[31385]: cluster 2021-03-10T16:38:06.510006+0000 mgr.gibba043.dnkmem (mgr.34373) 8817 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:07 gibba003 bash[32348]: cluster 2021-03-10T16:38:06.510006+0000 mgr.gibba043.dnkmem (mgr.34373) 8817 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:07 gibba043 bash[24019]: cluster 2021-03-10T16:38:06.510006+0000 mgr.gibba043.dnkmem (mgr.34373) 8817 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:09 gibba003 bash[31385]: cluster 2021-03-10T16:38:08.511569+0000 mgr.gibba043.dnkmem (mgr.34373) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:09 gibba003 bash[32348]: cluster 2021-03-10T16:38:08.511569+0000 mgr.gibba043.dnkmem (mgr.34373) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:09 gibba043 bash[24019]: cluster 2021-03-10T16:38:08.511569+0000 mgr.gibba043.dnkmem (mgr.34373) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:11 gibba003 bash[31385]: cluster 2021-03-10T16:38:10.513153+0000 mgr.gibba043.dnkmem (mgr.34373) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:11 gibba003 bash[32348]: cluster 2021-03-10T16:38:10.513153+0000 mgr.gibba043.dnkmem (mgr.34373) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:11 gibba043 bash[24019]: cluster 2021-03-10T16:38:10.513153+0000 mgr.gibba043.dnkmem (mgr.34373) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:13 gibba003 bash[31385]: cluster 2021-03-10T16:38:12.514521+0000 mgr.gibba043.dnkmem (mgr.34373) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:13 gibba003 bash[31385]: audit 2021-03-10T16:38:13.793035+0000 mon.c (mon.1) 2271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:13 gibba003 bash[31385]: audit 2021-03-10T16:38:13.794130+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:13 gibba003 bash[32348]: cluster 2021-03-10T16:38:12.514521+0000 mgr.gibba043.dnkmem (mgr.34373) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:13 gibba003 bash[32348]: audit 2021-03-10T16:38:13.793035+0000 mon.c (mon.1) 2271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:13 gibba003 bash[32348]: audit 2021-03-10T16:38:13.794130+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:13 gibba043 bash[24019]: cluster 2021-03-10T16:38:12.514521+0000 mgr.gibba043.dnkmem (mgr.34373) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:13 gibba043 bash[24019]: audit 2021-03-10T16:38:13.793035+0000 mon.c (mon.1) 2271 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:14.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:13 gibba043 bash[24019]: audit 2021-03-10T16:38:13.794130+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.018579+0000 mon.c (mon.1) 2272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.019760+0000 mon.a (mon.0) 1858 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.237624+0000 mon.c (mon.1) 2273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:38:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.238406+0000 mon.c (mon.1) 2274 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.238860+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:38:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.239163+0000 mon.c (mon.1) 2275 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.240023+0000 mon.c (mon.1) 2276 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.240178+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.241301+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[31385]: audit 2021-03-10T16:38:14.242080+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:15.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.018579+0000 mon.c (mon.1) 2272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.019760+0000 mon.a (mon.0) 1858 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.237624+0000 mon.c (mon.1) 2273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:38:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.238406+0000 mon.c (mon.1) 2274 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.238860+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:38:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.239163+0000 mon.c (mon.1) 2275 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.240023+0000 mon.c (mon.1) 2276 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.240178+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.241301+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:14 gibba003 bash[32348]: audit 2021-03-10T16:38:14.242080+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.018579+0000 mon.c (mon.1) 2272 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.019760+0000 mon.a (mon.0) 1858 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.237624+0000 mon.c (mon.1) 2273 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:38:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.238406+0000 mon.c (mon.1) 2274 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.238860+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:38:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.239163+0000 mon.c (mon.1) 2275 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.240023+0000 mon.c (mon.1) 2276 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.240178+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.241301+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:38:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:14 gibba043 bash[24019]: audit 2021-03-10T16:38:14.242080+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:15 gibba003 bash[31385]: cluster 2021-03-10T16:38:14.516234+0000 mgr.gibba043.dnkmem (mgr.34373) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:15 gibba003 bash[32348]: cluster 2021-03-10T16:38:14.516234+0000 mgr.gibba043.dnkmem (mgr.34373) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:15 gibba043 bash[24019]: cluster 2021-03-10T16:38:14.516234+0000 mgr.gibba043.dnkmem (mgr.34373) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:17 gibba003 bash[31385]: cluster 2021-03-10T16:38:16.517200+0000 mgr.gibba043.dnkmem (mgr.34373) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:17 gibba003 bash[32348]: cluster 2021-03-10T16:38:16.517200+0000 mgr.gibba043.dnkmem (mgr.34373) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:17 gibba043 bash[24019]: cluster 2021-03-10T16:38:16.517200+0000 mgr.gibba043.dnkmem (mgr.34373) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:19 gibba003 bash[31385]: cluster 2021-03-10T16:38:18.518753+0000 mgr.gibba043.dnkmem (mgr.34373) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:19 gibba003 bash[31385]: cephadm 2021-03-10T16:38:18.816004+0000 mgr.gibba043.dnkmem (mgr.34373) 8824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:19 gibba003 bash[32348]: cluster 2021-03-10T16:38:18.518753+0000 mgr.gibba043.dnkmem (mgr.34373) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:19 gibba003 bash[32348]: cephadm 2021-03-10T16:38:18.816004+0000 mgr.gibba043.dnkmem (mgr.34373) 8824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:19 gibba043 bash[24019]: cluster 2021-03-10T16:38:18.518753+0000 mgr.gibba043.dnkmem (mgr.34373) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:19 gibba043 bash[24019]: cephadm 2021-03-10T16:38:18.816004+0000 mgr.gibba043.dnkmem (mgr.34373) 8824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:21 gibba003 bash[31385]: cluster 2021-03-10T16:38:20.520333+0000 mgr.gibba043.dnkmem (mgr.34373) 8825 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:22.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:21 gibba003 bash[32348]: cluster 2021-03-10T16:38:20.520333+0000 mgr.gibba043.dnkmem (mgr.34373) 8825 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:21 gibba043 bash[24019]: cluster 2021-03-10T16:38:20.520333+0000 mgr.gibba043.dnkmem (mgr.34373) 8825 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:23 gibba043 bash[24019]: cluster 2021-03-10T16:38:22.521959+0000 mgr.gibba043.dnkmem (mgr.34373) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:24.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:23 gibba003 bash[31385]: cluster 2021-03-10T16:38:22.521959+0000 mgr.gibba043.dnkmem (mgr.34373) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:24.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:23 gibba003 bash[32348]: cluster 2021-03-10T16:38:22.521959+0000 mgr.gibba043.dnkmem (mgr.34373) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:25 gibba043 bash[24019]: cluster 2021-03-10T16:38:24.523834+0000 mgr.gibba043.dnkmem (mgr.34373) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:25 gibba003 bash[31385]: cluster 2021-03-10T16:38:24.523834+0000 mgr.gibba043.dnkmem (mgr.34373) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:26.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:25 gibba003 bash[32348]: cluster 2021-03-10T16:38:24.523834+0000 mgr.gibba043.dnkmem (mgr.34373) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:27 gibba043 bash[24019]: cluster 2021-03-10T16:38:26.524530+0000 mgr.gibba043.dnkmem (mgr.34373) 8828 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:28.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:27 gibba003 bash[31385]: cluster 2021-03-10T16:38:26.524530+0000 mgr.gibba043.dnkmem (mgr.34373) 8828 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:28.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:27 gibba003 bash[32348]: cluster 2021-03-10T16:38:26.524530+0000 mgr.gibba043.dnkmem (mgr.34373) 8828 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.567 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:38:29.798 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:38:29.798 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:38:29.799 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:38:29.799 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:38:29.799 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:38:29.799 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:38:29.800 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:38:29.800 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:38:29.800 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:38:29.800 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:38:29.800 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:38:29.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:38:29.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:38:29.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:38:29.801 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:38:29.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:38:29.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:38:29.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:38:29.802 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:38:29.802 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:38:29.803 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:38:30.051 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:38:30.051 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:38:30.052 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:30.052 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:38:30.052 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:38:30.052 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:30.053 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:38:30.053 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:38:30.053 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:38:30.053 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:38:30.053 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:38:30.054 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:38:30.054 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:38:30.054 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:38:30.054 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:38:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:29 gibba043 bash[24019]: cluster 2021-03-10T16:38:28.525912+0000 mgr.gibba043.dnkmem (mgr.34373) 8829 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:30.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:29 gibba003 bash[31385]: cluster 2021-03-10T16:38:28.525912+0000 mgr.gibba043.dnkmem (mgr.34373) 8829 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:29 gibba003 bash[32348]: cluster 2021-03-10T16:38:28.525912+0000 mgr.gibba043.dnkmem (mgr.34373) 8829 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:31.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:30 gibba043 bash[24019]: audit 2021-03-10T16:38:29.560707+0000 mgr.gibba043.dnkmem (mgr.34373) 8830 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:30 gibba043 bash[24019]: audit 2021-03-10T16:38:29.787963+0000 mgr.gibba043.dnkmem (mgr.34373) 8831 : audit [DBG] from='client.59968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:31.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:30 gibba043 bash[24019]: audit 2021-03-10T16:38:30.055100+0000 mon.c (mon.1) 2277 : audit [DBG] from='client.? 172.21.2.103:0/3510421150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:31.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:30 gibba003 bash[31385]: audit 2021-03-10T16:38:29.560707+0000 mgr.gibba043.dnkmem (mgr.34373) 8830 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:31.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:30 gibba003 bash[31385]: audit 2021-03-10T16:38:29.787963+0000 mgr.gibba043.dnkmem (mgr.34373) 8831 : audit [DBG] from='client.59968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:31.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:30 gibba003 bash[31385]: audit 2021-03-10T16:38:30.055100+0000 mon.c (mon.1) 2277 : audit [DBG] from='client.? 172.21.2.103:0/3510421150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:31.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:30 gibba003 bash[32348]: audit 2021-03-10T16:38:29.560707+0000 mgr.gibba043.dnkmem (mgr.34373) 8830 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:31.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:30 gibba003 bash[32348]: audit 2021-03-10T16:38:29.787963+0000 mgr.gibba043.dnkmem (mgr.34373) 8831 : audit [DBG] from='client.59968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:31.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:30 gibba003 bash[32348]: audit 2021-03-10T16:38:30.055100+0000 mon.c (mon.1) 2277 : audit [DBG] from='client.? 172.21.2.103:0/3510421150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:31 gibba043 bash[24019]: cluster 2021-03-10T16:38:30.527422+0000 mgr.gibba043.dnkmem (mgr.34373) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:31 gibba003 bash[31385]: cluster 2021-03-10T16:38:30.527422+0000 mgr.gibba043.dnkmem (mgr.34373) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:32.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:31 gibba003 bash[32348]: cluster 2021-03-10T16:38:30.527422+0000 mgr.gibba043.dnkmem (mgr.34373) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:33 gibba043 bash[24019]: cluster 2021-03-10T16:38:32.529033+0000 mgr.gibba043.dnkmem (mgr.34373) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:33 gibba003 bash[31385]: cluster 2021-03-10T16:38:32.529033+0000 mgr.gibba043.dnkmem (mgr.34373) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:34.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:33 gibba003 bash[32348]: cluster 2021-03-10T16:38:32.529033+0000 mgr.gibba043.dnkmem (mgr.34373) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:35.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:35 gibba043 bash[24019]: cephadm 2021-03-10T16:38:33.822703+0000 mgr.gibba043.dnkmem (mgr.34373) 8834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:35.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:35 gibba003 bash[31385]: cephadm 2021-03-10T16:38:33.822703+0000 mgr.gibba043.dnkmem (mgr.34373) 8834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:35.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:35 gibba003 bash[32348]: cephadm 2021-03-10T16:38:33.822703+0000 mgr.gibba043.dnkmem (mgr.34373) 8834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:36 gibba043 bash[24019]: cluster 2021-03-10T16:38:34.530798+0000 mgr.gibba043.dnkmem (mgr.34373) 8835 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:36 gibba003 bash[31385]: cluster 2021-03-10T16:38:34.530798+0000 mgr.gibba043.dnkmem (mgr.34373) 8835 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:36.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:36 gibba003 bash[32348]: cluster 2021-03-10T16:38:34.530798+0000 mgr.gibba043.dnkmem (mgr.34373) 8835 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:38.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:38 gibba003 bash[31385]: cluster 2021-03-10T16:38:36.531926+0000 mgr.gibba043.dnkmem (mgr.34373) 8836 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:38.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:38 gibba003 bash[32348]: cluster 2021-03-10T16:38:36.531926+0000 mgr.gibba043.dnkmem (mgr.34373) 8836 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:38.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:38 gibba043 bash[24019]: cluster 2021-03-10T16:38:36.531926+0000 mgr.gibba043.dnkmem (mgr.34373) 8836 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:40 gibba003 bash[31385]: cluster 2021-03-10T16:38:38.533157+0000 mgr.gibba043.dnkmem (mgr.34373) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:40 gibba003 bash[32348]: cluster 2021-03-10T16:38:38.533157+0000 mgr.gibba043.dnkmem (mgr.34373) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:40 gibba043 bash[24019]: cluster 2021-03-10T16:38:38.533157+0000 mgr.gibba043.dnkmem (mgr.34373) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:41.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:41 gibba003 bash[31385]: cluster 2021-03-10T16:38:40.534548+0000 mgr.gibba043.dnkmem (mgr.34373) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:41.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:41 gibba003 bash[32348]: cluster 2021-03-10T16:38:40.534548+0000 mgr.gibba043.dnkmem (mgr.34373) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:41.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:41 gibba043 bash[24019]: cluster 2021-03-10T16:38:40.534548+0000 mgr.gibba043.dnkmem (mgr.34373) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:43 gibba003 bash[31385]: cluster 2021-03-10T16:38:42.536169+0000 mgr.gibba043.dnkmem (mgr.34373) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:43 gibba003 bash[32348]: cluster 2021-03-10T16:38:42.536169+0000 mgr.gibba043.dnkmem (mgr.34373) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:44.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:43 gibba043 bash[24019]: cluster 2021-03-10T16:38:42.536169+0000 mgr.gibba043.dnkmem (mgr.34373) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:45 gibba003 bash[31385]: cluster 2021-03-10T16:38:44.537685+0000 mgr.gibba043.dnkmem (mgr.34373) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:45 gibba003 bash[32348]: cluster 2021-03-10T16:38:44.537685+0000 mgr.gibba043.dnkmem (mgr.34373) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:46.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:45 gibba043 bash[24019]: cluster 2021-03-10T16:38:44.537685+0000 mgr.gibba043.dnkmem (mgr.34373) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:47 gibba003 bash[31385]: cluster 2021-03-10T16:38:46.539406+0000 mgr.gibba043.dnkmem (mgr.34373) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:47 gibba003 bash[32348]: cluster 2021-03-10T16:38:46.539406+0000 mgr.gibba043.dnkmem (mgr.34373) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:48.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:47 gibba043 bash[24019]: cluster 2021-03-10T16:38:46.539406+0000 mgr.gibba043.dnkmem (mgr.34373) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:49 gibba003 bash[31385]: cluster 2021-03-10T16:38:48.541082+0000 mgr.gibba043.dnkmem (mgr.34373) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:49 gibba003 bash[31385]: cephadm 2021-03-10T16:38:48.840330+0000 mgr.gibba043.dnkmem (mgr.34373) 8843 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:38:49.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:49 gibba003 bash[31385]: audit 2021-03-10T16:38:48.842755+0000 mon.c (mon.1) 2278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:38:49.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:49 gibba003 bash[32348]: cluster 2021-03-10T16:38:48.541082+0000 mgr.gibba043.dnkmem (mgr.34373) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:49 gibba003 bash[32348]: cephadm 2021-03-10T16:38:48.840330+0000 mgr.gibba043.dnkmem (mgr.34373) 8843 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:38:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:49 gibba003 bash[32348]: audit 2021-03-10T16:38:48.842755+0000 mon.c (mon.1) 2278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:38:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:49 gibba043 bash[24019]: cluster 2021-03-10T16:38:48.541082+0000 mgr.gibba043.dnkmem (mgr.34373) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:50.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:49 gibba043 bash[24019]: cephadm 2021-03-10T16:38:48.840330+0000 mgr.gibba043.dnkmem (mgr.34373) 8843 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:38:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:49 gibba043 bash[24019]: audit 2021-03-10T16:38:48.842755+0000 mon.c (mon.1) 2278 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:38:51.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:51 gibba003 bash[31385]: cluster 2021-03-10T16:38:50.542626+0000 mgr.gibba043.dnkmem (mgr.34373) 8844 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:51.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:51 gibba003 bash[32348]: cluster 2021-03-10T16:38:50.542626+0000 mgr.gibba043.dnkmem (mgr.34373) 8844 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:52.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:51 gibba043 bash[24019]: cluster 2021-03-10T16:38:50.542626+0000 mgr.gibba043.dnkmem (mgr.34373) 8844 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.334729+0000 mgr.gibba043.dnkmem (mgr.34373) 8845 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:38:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.335291+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:38:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cluster 2021-03-10T16:38:52.544041+0000 mgr.gibba043.dnkmem (mgr.34373) 8846 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.552353+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:38:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.559332+0000 mgr.gibba043.dnkmem (mgr.34373) 8847 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.561113+0000 mgr.gibba043.dnkmem (mgr.34373) 8848 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.561605+0000 mon.c (mon.1) 2279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.562485+0000 mgr.gibba043.dnkmem (mgr.34373) 8849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:53.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.562521+0000 mgr.gibba043.dnkmem (mgr.34373) 8850 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.563217+0000 mon.c (mon.1) 2280 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.563949+0000 mgr.gibba043.dnkmem (mgr.34373) 8851 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.563987+0000 mgr.gibba043.dnkmem (mgr.34373) 8852 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.564727+0000 mon.c (mon.1) 2281 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.565612+0000 mgr.gibba043.dnkmem (mgr.34373) 8853 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.566004+0000 mon.c (mon.1) 2282 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.568330+0000 mgr.gibba043.dnkmem (mgr.34373) 8854 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.568827+0000 mgr.gibba043.dnkmem (mgr.34373) 8855 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.572393+0000 mon.c (mon.1) 2283 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.573085+0000 mgr.gibba043.dnkmem (mgr.34373) 8856 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.575164+0000 mgr.gibba043.dnkmem (mgr.34373) 8857 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:53.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: audit 2021-03-10T16:38:52.577937+0000 mon.c (mon.1) 2284 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.334729+0000 mgr.gibba043.dnkmem (mgr.34373) 8845 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:38:53.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.335291+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:38:53.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cluster 2021-03-10T16:38:52.544041+0000 mgr.gibba043.dnkmem (mgr.34373) 8846 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.552353+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:38:53.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.559332+0000 mgr.gibba043.dnkmem (mgr.34373) 8847 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:53.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.561113+0000 mgr.gibba043.dnkmem (mgr.34373) 8848 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:53.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.561605+0000 mon.c (mon.1) 2279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:53.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.562485+0000 mgr.gibba043.dnkmem (mgr.34373) 8849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:53.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.562521+0000 mgr.gibba043.dnkmem (mgr.34373) 8850 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:53.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.563217+0000 mon.c (mon.1) 2280 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.563949+0000 mgr.gibba043.dnkmem (mgr.34373) 8851 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:53.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.563987+0000 mgr.gibba043.dnkmem (mgr.34373) 8852 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:53.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.564727+0000 mon.c (mon.1) 2281 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.565612+0000 mgr.gibba043.dnkmem (mgr.34373) 8853 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:53.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.566004+0000 mon.c (mon.1) 2282 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.568330+0000 mgr.gibba043.dnkmem (mgr.34373) 8854 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:53.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.568827+0000 mgr.gibba043.dnkmem (mgr.34373) 8855 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:53.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.572393+0000 mon.c (mon.1) 2283 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.573085+0000 mgr.gibba043.dnkmem (mgr.34373) 8856 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:53.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.575164+0000 mgr.gibba043.dnkmem (mgr.34373) 8857 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:53.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: audit 2021-03-10T16:38:52.577937+0000 mon.c (mon.1) 2284 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.578537+0000 mgr.gibba043.dnkmem (mgr.34373) 8858 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:53.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.578915+0000 mgr.gibba043.dnkmem (mgr.34373) 8859 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:53.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[31385]: cephadm 2021-03-10T16:38:52.579493+0000 mgr.gibba043.dnkmem (mgr.34373) 8860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:53.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.578537+0000 mgr.gibba043.dnkmem (mgr.34373) 8858 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:53.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.578915+0000 mgr.gibba043.dnkmem (mgr.34373) 8859 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:53.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:53 gibba003 bash[32348]: cephadm 2021-03-10T16:38:52.579493+0000 mgr.gibba043.dnkmem (mgr.34373) 8860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.334729+0000 mgr.gibba043.dnkmem (mgr.34373) 8845 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:38:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.335291+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:38:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cluster 2021-03-10T16:38:52.544041+0000 mgr.gibba043.dnkmem (mgr.34373) 8846 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.552353+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:38:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.559332+0000 mgr.gibba043.dnkmem (mgr.34373) 8847 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.561113+0000 mgr.gibba043.dnkmem (mgr.34373) 8848 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.561605+0000 mon.c (mon.1) 2279 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.562485+0000 mgr.gibba043.dnkmem (mgr.34373) 8849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.562521+0000 mgr.gibba043.dnkmem (mgr.34373) 8850 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.563217+0000 mon.c (mon.1) 2280 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.563949+0000 mgr.gibba043.dnkmem (mgr.34373) 8851 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:53.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.563987+0000 mgr.gibba043.dnkmem (mgr.34373) 8852 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.564727+0000 mon.c (mon.1) 2281 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.565612+0000 mgr.gibba043.dnkmem (mgr.34373) 8853 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.566004+0000 mon.c (mon.1) 2282 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.568330+0000 mgr.gibba043.dnkmem (mgr.34373) 8854 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:53.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.568827+0000 mgr.gibba043.dnkmem (mgr.34373) 8855 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:53.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.572393+0000 mon.c (mon.1) 2283 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.573085+0000 mgr.gibba043.dnkmem (mgr.34373) 8856 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:53.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.575164+0000 mgr.gibba043.dnkmem (mgr.34373) 8857 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:53.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: audit 2021-03-10T16:38:52.577937+0000 mon.c (mon.1) 2284 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:53.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.578537+0000 mgr.gibba043.dnkmem (mgr.34373) 8858 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:53.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.578915+0000 mgr.gibba043.dnkmem (mgr.34373) 8859 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:53.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:53 gibba043 bash[24019]: cephadm 2021-03-10T16:38:52.579493+0000 mgr.gibba043.dnkmem (mgr.34373) 8860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:38:55.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:55 gibba003 bash[31385]: cluster 2021-03-10T16:38:54.544894+0000 mgr.gibba043.dnkmem (mgr.34373) 8861 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:55.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:55 gibba003 bash[32348]: cluster 2021-03-10T16:38:54.544894+0000 mgr.gibba043.dnkmem (mgr.34373) 8861 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:56.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:55 gibba043 bash[24019]: cluster 2021-03-10T16:38:54.544894+0000 mgr.gibba043.dnkmem (mgr.34373) 8861 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:57 gibba003 bash[31385]: cluster 2021-03-10T16:38:56.546647+0000 mgr.gibba043.dnkmem (mgr.34373) 8862 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:57 gibba003 bash[32348]: cluster 2021-03-10T16:38:56.546647+0000 mgr.gibba043.dnkmem (mgr.34373) 8862 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:57 gibba043 bash[24019]: cluster 2021-03-10T16:38:56.546647+0000 mgr.gibba043.dnkmem (mgr.34373) 8862 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:38:59 gibba003 bash[31385]: cluster 2021-03-10T16:38:58.548441+0000 mgr.gibba043.dnkmem (mgr.34373) 8863 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:38:59 gibba003 bash[32348]: cluster 2021-03-10T16:38:58.548441+0000 mgr.gibba043.dnkmem (mgr.34373) 8863 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:38:59 gibba043 bash[24019]: cluster 2021-03-10T16:38:58.548441+0000 mgr.gibba043.dnkmem (mgr.34373) 8863 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:00.292 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:39:00.523 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:39:00.523 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:39:00.523 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:39:00.524 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:39:00.524 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:39:00.524 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:39:00.524 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:39:00.524 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:39:00.525 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:39:00.525 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 8s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:39:00.525 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:39:00.525 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:39:00.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:39:00.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:39:00.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:39:00.526 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:39:00.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:39:00.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:39:00.527 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:39:00.527 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:39:00.527 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:39:00.776 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:39:00.777 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:39:00.777 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:00.778 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:39:00.778 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:39:00.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:00.778 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:39:00.779 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:39:00.779 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:39:00.779 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:39:00.780 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:39:00.780 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:39:00.780 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:39:00.781 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:39:00.781 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:39:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[31385]: audit 2021-03-10T16:39:00.285227+0000 mgr.gibba043.dnkmem (mgr.34373) 8864 : audit [DBG] from='client.49992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[31385]: audit 2021-03-10T16:39:00.513193+0000 mgr.gibba043.dnkmem (mgr.34373) 8865 : audit [DBG] from='client.59986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[31385]: cluster 2021-03-10T16:39:00.549213+0000 mgr.gibba043.dnkmem (mgr.34373) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[31385]: audit 2021-03-10T16:39:00.780304+0000 mon.c (mon.1) 2285 : audit [DBG] from='client.? 172.21.2.103:0/3709208235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[32348]: audit 2021-03-10T16:39:00.285227+0000 mgr.gibba043.dnkmem (mgr.34373) 8864 : audit [DBG] from='client.49992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[32348]: audit 2021-03-10T16:39:00.513193+0000 mgr.gibba043.dnkmem (mgr.34373) 8865 : audit [DBG] from='client.59986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[32348]: cluster 2021-03-10T16:39:00.549213+0000 mgr.gibba043.dnkmem (mgr.34373) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:01 gibba003 bash[32348]: audit 2021-03-10T16:39:00.780304+0000 mon.c (mon.1) 2285 : audit [DBG] from='client.? 172.21.2.103:0/3709208235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:02.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:01 gibba043 bash[24019]: audit 2021-03-10T16:39:00.285227+0000 mgr.gibba043.dnkmem (mgr.34373) 8864 : audit [DBG] from='client.49992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:01 gibba043 bash[24019]: audit 2021-03-10T16:39:00.513193+0000 mgr.gibba043.dnkmem (mgr.34373) 8865 : audit [DBG] from='client.59986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:01 gibba043 bash[24019]: cluster 2021-03-10T16:39:00.549213+0000 mgr.gibba043.dnkmem (mgr.34373) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:01 gibba043 bash[24019]: audit 2021-03-10T16:39:00.780304+0000 mon.c (mon.1) 2285 : audit [DBG] from='client.? 172.21.2.103:0/3709208235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:03.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:03 gibba003 bash[31385]: cluster 2021-03-10T16:39:02.550919+0000 mgr.gibba043.dnkmem (mgr.34373) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:03 gibba003 bash[32348]: cluster 2021-03-10T16:39:02.550919+0000 mgr.gibba043.dnkmem (mgr.34373) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:04.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:03 gibba043 bash[24019]: cluster 2021-03-10T16:39:02.550919+0000 mgr.gibba043.dnkmem (mgr.34373) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:05 gibba003 bash[31385]: cluster 2021-03-10T16:39:04.552845+0000 mgr.gibba043.dnkmem (mgr.34373) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:05 gibba003 bash[32348]: cluster 2021-03-10T16:39:04.552845+0000 mgr.gibba043.dnkmem (mgr.34373) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:05 gibba043 bash[24019]: cluster 2021-03-10T16:39:04.552845+0000 mgr.gibba043.dnkmem (mgr.34373) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:07 gibba003 bash[31385]: cluster 2021-03-10T16:39:06.554162+0000 mgr.gibba043.dnkmem (mgr.34373) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:07 gibba003 bash[32348]: cluster 2021-03-10T16:39:06.554162+0000 mgr.gibba043.dnkmem (mgr.34373) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:07 gibba043 bash[24019]: cluster 2021-03-10T16:39:06.554162+0000 mgr.gibba043.dnkmem (mgr.34373) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:08.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:08 gibba003 bash[31385]: cephadm 2021-03-10T16:39:07.580948+0000 mgr.gibba043.dnkmem (mgr.34373) 8870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:08.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:08 gibba003 bash[32348]: cephadm 2021-03-10T16:39:07.580948+0000 mgr.gibba043.dnkmem (mgr.34373) 8870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:09.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:08 gibba043 bash[24019]: cephadm 2021-03-10T16:39:07.580948+0000 mgr.gibba043.dnkmem (mgr.34373) 8870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:09.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:09 gibba003 bash[31385]: cluster 2021-03-10T16:39:08.555567+0000 mgr.gibba043.dnkmem (mgr.34373) 8871 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:09.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:09 gibba003 bash[32348]: cluster 2021-03-10T16:39:08.555567+0000 mgr.gibba043.dnkmem (mgr.34373) 8871 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:09 gibba043 bash[24019]: cluster 2021-03-10T16:39:08.555567+0000 mgr.gibba043.dnkmem (mgr.34373) 8871 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:11.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:11 gibba003 bash[31385]: cluster 2021-03-10T16:39:10.557088+0000 mgr.gibba043.dnkmem (mgr.34373) 8872 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:11.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:11 gibba003 bash[32348]: cluster 2021-03-10T16:39:10.557088+0000 mgr.gibba043.dnkmem (mgr.34373) 8872 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:12.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:11 gibba043 bash[24019]: cluster 2021-03-10T16:39:10.557088+0000 mgr.gibba043.dnkmem (mgr.34373) 8872 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:13 gibba003 bash[31385]: cluster 2021-03-10T16:39:12.558751+0000 mgr.gibba043.dnkmem (mgr.34373) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:13 gibba003 bash[32348]: cluster 2021-03-10T16:39:12.558751+0000 mgr.gibba043.dnkmem (mgr.34373) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:13 gibba043 bash[24019]: cluster 2021-03-10T16:39:12.558751+0000 mgr.gibba043.dnkmem (mgr.34373) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:13.799761+0000 mon.c (mon.1) 2286 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:13.800934+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.025728+0000 mon.c (mon.1) 2287 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.026862+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.248836+0000 mon.c (mon.1) 2288 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:39:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.249666+0000 mon.c (mon.1) 2289 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.250041+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:39:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.250354+0000 mon.c (mon.1) 2290 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.251086+0000 mon.c (mon.1) 2291 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:39:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.251759+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.252848+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:14 gibba043 bash[24019]: audit 2021-03-10T16:39:14.253622+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:39:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:13.799761+0000 mon.c (mon.1) 2286 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:13.800934+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.025728+0000 mon.c (mon.1) 2287 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.026862+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.248836+0000 mon.c (mon.1) 2288 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:39:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.249666+0000 mon.c (mon.1) 2289 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.250041+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:39:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.250354+0000 mon.c (mon.1) 2290 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.251086+0000 mon.c (mon.1) 2291 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:39:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.251759+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.252848+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[31385]: audit 2021-03-10T16:39:14.253622+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:39:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:13.799761+0000 mon.c (mon.1) 2286 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:13.800934+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.025728+0000 mon.c (mon.1) 2287 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.026862+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.248836+0000 mon.c (mon.1) 2288 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:39:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.249666+0000 mon.c (mon.1) 2289 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.250041+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:39:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.250354+0000 mon.c (mon.1) 2290 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.251086+0000 mon.c (mon.1) 2291 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:39:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.251759+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.252848+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:39:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:14 gibba003 bash[32348]: audit 2021-03-10T16:39:14.253622+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:39:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:15 gibba043 bash[24019]: cluster 2021-03-10T16:39:14.560412+0000 mgr.gibba043.dnkmem (mgr.34373) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:15 gibba003 bash[31385]: cluster 2021-03-10T16:39:14.560412+0000 mgr.gibba043.dnkmem (mgr.34373) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:15 gibba003 bash[32348]: cluster 2021-03-10T16:39:14.560412+0000 mgr.gibba043.dnkmem (mgr.34373) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:17 gibba043 bash[24019]: cluster 2021-03-10T16:39:16.562081+0000 mgr.gibba043.dnkmem (mgr.34373) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:17 gibba003 bash[31385]: cluster 2021-03-10T16:39:16.562081+0000 mgr.gibba043.dnkmem (mgr.34373) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:17 gibba003 bash[32348]: cluster 2021-03-10T16:39:16.562081+0000 mgr.gibba043.dnkmem (mgr.34373) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:20.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:19 gibba043 bash[24019]: cluster 2021-03-10T16:39:18.563730+0000 mgr.gibba043.dnkmem (mgr.34373) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:19 gibba003 bash[31385]: cluster 2021-03-10T16:39:18.563730+0000 mgr.gibba043.dnkmem (mgr.34373) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:19 gibba003 bash[32348]: cluster 2021-03-10T16:39:18.563730+0000 mgr.gibba043.dnkmem (mgr.34373) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:21 gibba043 bash[24019]: cluster 2021-03-10T16:39:20.564972+0000 mgr.gibba043.dnkmem (mgr.34373) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:21 gibba003 bash[31385]: cluster 2021-03-10T16:39:20.564972+0000 mgr.gibba043.dnkmem (mgr.34373) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:22.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:21 gibba003 bash[32348]: cluster 2021-03-10T16:39:20.564972+0000 mgr.gibba043.dnkmem (mgr.34373) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:23 gibba043 bash[24019]: cluster 2021-03-10T16:39:22.566484+0000 mgr.gibba043.dnkmem (mgr.34373) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:24.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:23 gibba043 bash[24019]: cephadm 2021-03-10T16:39:22.597051+0000 mgr.gibba043.dnkmem (mgr.34373) 8879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:24.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:23 gibba003 bash[31385]: cluster 2021-03-10T16:39:22.566484+0000 mgr.gibba043.dnkmem (mgr.34373) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:24.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:23 gibba003 bash[31385]: cephadm 2021-03-10T16:39:22.597051+0000 mgr.gibba043.dnkmem (mgr.34373) 8879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:24.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:23 gibba003 bash[32348]: cluster 2021-03-10T16:39:22.566484+0000 mgr.gibba043.dnkmem (mgr.34373) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:24.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:23 gibba003 bash[32348]: cephadm 2021-03-10T16:39:22.597051+0000 mgr.gibba043.dnkmem (mgr.34373) 8879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:26.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:25 gibba043 bash[24019]: cluster 2021-03-10T16:39:24.568154+0000 mgr.gibba043.dnkmem (mgr.34373) 8880 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:25 gibba003 bash[31385]: cluster 2021-03-10T16:39:24.568154+0000 mgr.gibba043.dnkmem (mgr.34373) 8880 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:25 gibba003 bash[32348]: cluster 2021-03-10T16:39:24.568154+0000 mgr.gibba043.dnkmem (mgr.34373) 8880 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:27 gibba043 bash[24019]: cluster 2021-03-10T16:39:26.569958+0000 mgr.gibba043.dnkmem (mgr.34373) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:27 gibba003 bash[31385]: cluster 2021-03-10T16:39:26.569958+0000 mgr.gibba043.dnkmem (mgr.34373) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:27 gibba003 bash[32348]: cluster 2021-03-10T16:39:26.569958+0000 mgr.gibba043.dnkmem (mgr.34373) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:29 gibba043 bash[24019]: cluster 2021-03-10T16:39:28.571638+0000 mgr.gibba043.dnkmem (mgr.34373) 8882 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:29 gibba003 bash[31385]: cluster 2021-03-10T16:39:28.571638+0000 mgr.gibba043.dnkmem (mgr.34373) 8882 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:29 gibba003 bash[32348]: cluster 2021-03-10T16:39:28.571638+0000 mgr.gibba043.dnkmem (mgr.34373) 8882 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:31.016 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:39:31.244 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:39:31.244 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 38s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:39:31.244 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:39:31.245 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:39:31.245 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:39:31.245 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:39:31.246 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:39:31.248 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:39:31.248 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:39:31.248 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 38s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:39:31.249 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:39:31.249 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:39:31.249 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:39:31.250 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:39:31.250 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 38s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:39:31.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:39:31.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:39:31.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:39:31.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:39:31.252 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:39:31.252 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 38s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:39:31.497 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:39:31.498 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:39:31.498 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:31.498 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:39:31.499 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:39:31.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:31.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:39:31.500 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:39:31.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:39:31.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:39:31.501 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:39:31.501 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:39:31.501 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:39:31.501 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:39:31.502 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:39:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:31 gibba003 bash[31385]: cluster 2021-03-10T16:39:30.573197+0000 mgr.gibba043.dnkmem (mgr.34373) 8883 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:32.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:31 gibba003 bash[31385]: audit 2021-03-10T16:39:31.008771+0000 mgr.gibba043.dnkmem (mgr.34373) 8884 : audit [DBG] from='client.50010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:32.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:31 gibba003 bash[31385]: audit 2021-03-10T16:39:31.501322+0000 mon.c (mon.1) 2292 : audit [DBG] from='client.? 172.21.2.103:0/1834596986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:31 gibba003 bash[32348]: cluster 2021-03-10T16:39:30.573197+0000 mgr.gibba043.dnkmem (mgr.34373) 8883 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:31 gibba003 bash[32348]: audit 2021-03-10T16:39:31.008771+0000 mgr.gibba043.dnkmem (mgr.34373) 8884 : audit [DBG] from='client.50010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:32.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:31 gibba003 bash[32348]: audit 2021-03-10T16:39:31.501322+0000 mon.c (mon.1) 2292 : audit [DBG] from='client.? 172.21.2.103:0/1834596986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:31 gibba043 bash[24019]: cluster 2021-03-10T16:39:30.573197+0000 mgr.gibba043.dnkmem (mgr.34373) 8883 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:31 gibba043 bash[24019]: audit 2021-03-10T16:39:31.008771+0000 mgr.gibba043.dnkmem (mgr.34373) 8884 : audit [DBG] from='client.50010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:32.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:31 gibba043 bash[24019]: audit 2021-03-10T16:39:31.501322+0000 mon.c (mon.1) 2292 : audit [DBG] from='client.? 172.21.2.103:0/1834596986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:33.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:32 gibba003 bash[31385]: audit 2021-03-10T16:39:31.233607+0000 mgr.gibba043.dnkmem (mgr.34373) 8885 : audit [DBG] from='client.50016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:33.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:32 gibba003 bash[32348]: audit 2021-03-10T16:39:31.233607+0000 mgr.gibba043.dnkmem (mgr.34373) 8885 : audit [DBG] from='client.50016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:33.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:32 gibba043 bash[24019]: audit 2021-03-10T16:39:31.233607+0000 mgr.gibba043.dnkmem (mgr.34373) 8885 : audit [DBG] from='client.50016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:33 gibba003 bash[31385]: cluster 2021-03-10T16:39:32.574823+0000 mgr.gibba043.dnkmem (mgr.34373) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:33 gibba003 bash[32348]: cluster 2021-03-10T16:39:32.574823+0000 mgr.gibba043.dnkmem (mgr.34373) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:33 gibba043 bash[24019]: cluster 2021-03-10T16:39:32.574823+0000 mgr.gibba043.dnkmem (mgr.34373) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:35 gibba003 bash[31385]: cluster 2021-03-10T16:39:34.576284+0000 mgr.gibba043.dnkmem (mgr.34373) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:35 gibba003 bash[32348]: cluster 2021-03-10T16:39:34.576284+0000 mgr.gibba043.dnkmem (mgr.34373) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:35 gibba043 bash[24019]: cluster 2021-03-10T16:39:34.576284+0000 mgr.gibba043.dnkmem (mgr.34373) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:37 gibba043 bash[24019]: cluster 2021-03-10T16:39:36.577852+0000 mgr.gibba043.dnkmem (mgr.34373) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:37 gibba003 bash[31385]: cluster 2021-03-10T16:39:36.577852+0000 mgr.gibba043.dnkmem (mgr.34373) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:37 gibba003 bash[32348]: cluster 2021-03-10T16:39:36.577852+0000 mgr.gibba043.dnkmem (mgr.34373) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:39.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:38 gibba003 bash[31385]: cephadm 2021-03-10T16:39:37.604451+0000 mgr.gibba043.dnkmem (mgr.34373) 8889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:39.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:38 gibba003 bash[32348]: cephadm 2021-03-10T16:39:37.604451+0000 mgr.gibba043.dnkmem (mgr.34373) 8889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:39.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:38 gibba043 bash[24019]: cephadm 2021-03-10T16:39:37.604451+0000 mgr.gibba043.dnkmem (mgr.34373) 8889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:39 gibba003 bash[31385]: cluster 2021-03-10T16:39:38.579531+0000 mgr.gibba043.dnkmem (mgr.34373) 8890 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:39 gibba003 bash[32348]: cluster 2021-03-10T16:39:38.579531+0000 mgr.gibba043.dnkmem (mgr.34373) 8890 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:39 gibba043 bash[24019]: cluster 2021-03-10T16:39:38.579531+0000 mgr.gibba043.dnkmem (mgr.34373) 8890 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:41 gibba003 bash[31385]: cluster 2021-03-10T16:39:40.580931+0000 mgr.gibba043.dnkmem (mgr.34373) 8891 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:41 gibba003 bash[32348]: cluster 2021-03-10T16:39:40.580931+0000 mgr.gibba043.dnkmem (mgr.34373) 8891 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:41 gibba043 bash[24019]: cluster 2021-03-10T16:39:40.580931+0000 mgr.gibba043.dnkmem (mgr.34373) 8891 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:43 gibba003 bash[31385]: cluster 2021-03-10T16:39:42.582509+0000 mgr.gibba043.dnkmem (mgr.34373) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:43 gibba003 bash[32348]: cluster 2021-03-10T16:39:42.582509+0000 mgr.gibba043.dnkmem (mgr.34373) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:43 gibba043 bash[24019]: cluster 2021-03-10T16:39:42.582509+0000 mgr.gibba043.dnkmem (mgr.34373) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:45 gibba003 bash[31385]: cluster 2021-03-10T16:39:44.584133+0000 mgr.gibba043.dnkmem (mgr.34373) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:45 gibba003 bash[32348]: cluster 2021-03-10T16:39:44.584133+0000 mgr.gibba043.dnkmem (mgr.34373) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:45 gibba043 bash[24019]: cluster 2021-03-10T16:39:44.584133+0000 mgr.gibba043.dnkmem (mgr.34373) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:48.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:47 gibba003 bash[31385]: cluster 2021-03-10T16:39:46.585678+0000 mgr.gibba043.dnkmem (mgr.34373) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:47 gibba003 bash[32348]: cluster 2021-03-10T16:39:46.585678+0000 mgr.gibba043.dnkmem (mgr.34373) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:47 gibba043 bash[24019]: cluster 2021-03-10T16:39:46.585678+0000 mgr.gibba043.dnkmem (mgr.34373) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:50.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:49 gibba003 bash[31385]: cluster 2021-03-10T16:39:48.587408+0000 mgr.gibba043.dnkmem (mgr.34373) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:49 gibba003 bash[32348]: cluster 2021-03-10T16:39:48.587408+0000 mgr.gibba043.dnkmem (mgr.34373) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:49 gibba043 bash[24019]: cluster 2021-03-10T16:39:48.587408+0000 mgr.gibba043.dnkmem (mgr.34373) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:51 gibba003 bash[31385]: cluster 2021-03-10T16:39:50.589080+0000 mgr.gibba043.dnkmem (mgr.34373) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:51 gibba003 bash[32348]: cluster 2021-03-10T16:39:50.589080+0000 mgr.gibba043.dnkmem (mgr.34373) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:51 gibba043 bash[24019]: cluster 2021-03-10T16:39:50.589080+0000 mgr.gibba043.dnkmem (mgr.34373) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:52 gibba003 bash[31385]: audit 2021-03-10T16:39:52.624936+0000 mon.c (mon.1) 2293 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:39:53.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:52 gibba003 bash[32348]: audit 2021-03-10T16:39:52.624936+0000 mon.c (mon.1) 2293 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:39:53.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:52 gibba043 bash[24019]: audit 2021-03-10T16:39:52.624936+0000 mon.c (mon.1) 2293 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:39:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:53 gibba003 bash[31385]: cluster 2021-03-10T16:39:52.590647+0000 mgr.gibba043.dnkmem (mgr.34373) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:54.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:53 gibba003 bash[31385]: cephadm 2021-03-10T16:39:52.621175+0000 mgr.gibba043.dnkmem (mgr.34373) 8898 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:39:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:53 gibba003 bash[32348]: cluster 2021-03-10T16:39:52.590647+0000 mgr.gibba043.dnkmem (mgr.34373) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:54.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:53 gibba003 bash[32348]: cephadm 2021-03-10T16:39:52.621175+0000 mgr.gibba043.dnkmem (mgr.34373) 8898 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:39:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:53 gibba043 bash[24019]: cluster 2021-03-10T16:39:52.590647+0000 mgr.gibba043.dnkmem (mgr.34373) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:53 gibba043 bash[24019]: cephadm 2021-03-10T16:39:52.621175+0000 mgr.gibba043.dnkmem (mgr.34373) 8898 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:39:56.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:55 gibba003 bash[31385]: cluster 2021-03-10T16:39:54.592159+0000 mgr.gibba043.dnkmem (mgr.34373) 8899 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:55 gibba003 bash[32348]: cluster 2021-03-10T16:39:54.592159+0000 mgr.gibba043.dnkmem (mgr.34373) 8899 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:55 gibba043 bash[24019]: cluster 2021-03-10T16:39:54.592159+0000 mgr.gibba043.dnkmem (mgr.34373) 8899 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.334434+0000 mgr.gibba043.dnkmem (mgr.34373) 8900 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:39:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.334757+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:39:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.536131+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:39:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.544340+0000 mgr.gibba043.dnkmem (mgr.34373) 8901 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:57.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.547833+0000 mon.c (mon.1) 2294 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.547847+0000 mgr.gibba043.dnkmem (mgr.34373) 8902 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:57.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.549846+0000 mgr.gibba043.dnkmem (mgr.34373) 8903 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:57.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.550137+0000 mgr.gibba043.dnkmem (mgr.34373) 8904 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:57.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.550143+0000 mon.c (mon.1) 2295 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.552046+0000 mgr.gibba043.dnkmem (mgr.34373) 8905 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.552155+0000 mgr.gibba043.dnkmem (mgr.34373) 8906 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.552479+0000 mon.c (mon.1) 2296 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.553830+0000 mgr.gibba043.dnkmem (mgr.34373) 8907 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:57.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.554115+0000 mon.c (mon.1) 2297 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.556024+0000 mgr.gibba043.dnkmem (mgr.34373) 8908 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:57.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.556308+0000 mgr.gibba043.dnkmem (mgr.34373) 8909 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.558567+0000 mgr.gibba043.dnkmem (mgr.34373) 8910 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.558847+0000 mon.c (mon.1) 2298 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.559561+0000 mgr.gibba043.dnkmem (mgr.34373) 8911 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.561478+0000 mgr.gibba043.dnkmem (mgr.34373) 8912 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:57.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: audit 2021-03-10T16:39:56.561582+0000 mon.c (mon.1) 2299 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.334434+0000 mgr.gibba043.dnkmem (mgr.34373) 8900 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:39:57.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.334757+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:39:57.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.536131+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:39:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.544340+0000 mgr.gibba043.dnkmem (mgr.34373) 8901 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.547833+0000 mon.c (mon.1) 2294 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.547847+0000 mgr.gibba043.dnkmem (mgr.34373) 8902 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:57.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.549846+0000 mgr.gibba043.dnkmem (mgr.34373) 8903 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.550137+0000 mgr.gibba043.dnkmem (mgr.34373) 8904 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.550143+0000 mon.c (mon.1) 2295 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.552046+0000 mgr.gibba043.dnkmem (mgr.34373) 8905 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:57.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.552155+0000 mgr.gibba043.dnkmem (mgr.34373) 8906 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.552479+0000 mon.c (mon.1) 2296 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.553830+0000 mgr.gibba043.dnkmem (mgr.34373) 8907 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.554115+0000 mon.c (mon.1) 2297 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.556024+0000 mgr.gibba043.dnkmem (mgr.34373) 8908 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.556308+0000 mgr.gibba043.dnkmem (mgr.34373) 8909 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.558567+0000 mgr.gibba043.dnkmem (mgr.34373) 8910 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.558847+0000 mon.c (mon.1) 2298 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.559561+0000 mgr.gibba043.dnkmem (mgr.34373) 8911 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:57.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.561478+0000 mgr.gibba043.dnkmem (mgr.34373) 8912 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:57.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: audit 2021-03-10T16:39:56.561582+0000 mon.c (mon.1) 2299 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.561625+0000 mgr.gibba043.dnkmem (mgr.34373) 8913 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:57.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cephadm 2021-03-10T16:39:56.561935+0000 mgr.gibba043.dnkmem (mgr.34373) 8914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:57.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[31385]: cluster 2021-03-10T16:39:56.593743+0000 mgr.gibba043.dnkmem (mgr.34373) 8915 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.561625+0000 mgr.gibba043.dnkmem (mgr.34373) 8913 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:57.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cephadm 2021-03-10T16:39:56.561935+0000 mgr.gibba043.dnkmem (mgr.34373) 8914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:57.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:57 gibba003 bash[32348]: cluster 2021-03-10T16:39:56.593743+0000 mgr.gibba043.dnkmem (mgr.34373) 8915 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.334434+0000 mgr.gibba043.dnkmem (mgr.34373) 8900 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:39:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.334757+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:39:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.536131+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:39:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.544340+0000 mgr.gibba043.dnkmem (mgr.34373) 8901 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.547833+0000 mon.c (mon.1) 2294 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.547847+0000 mgr.gibba043.dnkmem (mgr.34373) 8902 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.549846+0000 mgr.gibba043.dnkmem (mgr.34373) 8903 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.550137+0000 mgr.gibba043.dnkmem (mgr.34373) 8904 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.550143+0000 mon.c (mon.1) 2295 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.552046+0000 mgr.gibba043.dnkmem (mgr.34373) 8905 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.552155+0000 mgr.gibba043.dnkmem (mgr.34373) 8906 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.552479+0000 mon.c (mon.1) 2296 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.553830+0000 mgr.gibba043.dnkmem (mgr.34373) 8907 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:57.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.554115+0000 mon.c (mon.1) 2297 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.556024+0000 mgr.gibba043.dnkmem (mgr.34373) 8908 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.556308+0000 mgr.gibba043.dnkmem (mgr.34373) 8909 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.558567+0000 mgr.gibba043.dnkmem (mgr.34373) 8910 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.558847+0000 mon.c (mon.1) 2298 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.559561+0000 mgr.gibba043.dnkmem (mgr.34373) 8911 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.561478+0000 mgr.gibba043.dnkmem (mgr.34373) 8912 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: audit 2021-03-10T16:39:56.561582+0000 mon.c (mon.1) 2299 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.561625+0000 mgr.gibba043.dnkmem (mgr.34373) 8913 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:57.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cephadm 2021-03-10T16:39:56.561935+0000 mgr.gibba043.dnkmem (mgr.34373) 8914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:39:57.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:57 gibba043 bash[24019]: cluster 2021-03-10T16:39:56.593743+0000 mgr.gibba043.dnkmem (mgr.34373) 8915 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:39:59 gibba003 bash[31385]: cluster 2021-03-10T16:39:58.595248+0000 mgr.gibba043.dnkmem (mgr.34373) 8916 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:39:59 gibba003 bash[32348]: cluster 2021-03-10T16:39:58.595248+0000 mgr.gibba043.dnkmem (mgr.34373) 8916 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:39:59 gibba043 bash[24019]: cluster 2021-03-10T16:39:58.595248+0000 mgr.gibba043.dnkmem (mgr.34373) 8916 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:00 gibba003 bash[31385]: debug 2021-03-10T16:39:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:00 gibba003 bash[31385]: cluster 2021-03-10T16:40:00.000225+0000 mon.a (mon.0) 1873 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:00 gibba003 bash[32348]: cluster 2021-03-10T16:40:00.000225+0000 mon.a (mon.0) 1873 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:01.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:00 gibba043 bash[24019]: cluster 2021-03-10T16:40:00.000225+0000 mon.a (mon.0) 1873 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:01.747 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:40:01.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:01 gibba003 bash[31385]: cluster 2021-03-10T16:40:00.596757+0000 mgr.gibba043.dnkmem (mgr.34373) 8917 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:01.937 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:01 gibba003 bash[32348]: cluster 2021-03-10T16:40:00.596757+0000 mgr.gibba043.dnkmem (mgr.34373) 8917 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:01.977 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:40:01.978 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 69s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:40:01.978 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:40:01.978 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:40:01.979 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:40:01.979 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:40:01.979 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:40:01.980 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:40:01.980 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:40:01.981 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 69s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:40:01.981 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:40:01.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:40:01.982 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:40:01.982 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:40:01.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 69s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:40:01.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:40:01.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:40:01.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:40:01.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:40:01.985 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:40:01.985 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 69s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:40:02.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:01 gibba043 bash[24019]: cluster 2021-03-10T16:40:00.596757+0000 mgr.gibba043.dnkmem (mgr.34373) 8917 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:02.228 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:40:02.229 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:40:02.230 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:02.230 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:40:02.230 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:40:02.231 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:02.231 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:40:02.232 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:40:02.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:40:02.234 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:40:02.235 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:40:02.235 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:40:02.236 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:40:02.236 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:40:02.236 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:40:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:02 gibba003 bash[31385]: audit 2021-03-10T16:40:01.740776+0000 mgr.gibba043.dnkmem (mgr.34373) 8918 : audit [DBG] from='client.60016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:02 gibba003 bash[31385]: audit 2021-03-10T16:40:01.968094+0000 mgr.gibba043.dnkmem (mgr.34373) 8919 : audit [DBG] from='client.50034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:02 gibba003 bash[31385]: audit 2021-03-10T16:40:02.232238+0000 mon.c (mon.1) 2300 : audit [DBG] from='client.? 172.21.2.103:0/1730895654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:02 gibba003 bash[32348]: audit 2021-03-10T16:40:01.740776+0000 mgr.gibba043.dnkmem (mgr.34373) 8918 : audit [DBG] from='client.60016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:02.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:02 gibba003 bash[32348]: audit 2021-03-10T16:40:01.968094+0000 mgr.gibba043.dnkmem (mgr.34373) 8919 : audit [DBG] from='client.50034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:02.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:02 gibba003 bash[32348]: audit 2021-03-10T16:40:02.232238+0000 mon.c (mon.1) 2300 : audit [DBG] from='client.? 172.21.2.103:0/1730895654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:02 gibba043 bash[24019]: audit 2021-03-10T16:40:01.740776+0000 mgr.gibba043.dnkmem (mgr.34373) 8918 : audit [DBG] from='client.60016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:02 gibba043 bash[24019]: audit 2021-03-10T16:40:01.968094+0000 mgr.gibba043.dnkmem (mgr.34373) 8919 : audit [DBG] from='client.50034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:02 gibba043 bash[24019]: audit 2021-03-10T16:40:02.232238+0000 mon.c (mon.1) 2300 : audit [DBG] from='client.? 172.21.2.103:0/1730895654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:03.937 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:03 gibba003 bash[31385]: cluster 2021-03-10T16:40:02.598361+0000 mgr.gibba043.dnkmem (mgr.34373) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:03.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:03 gibba003 bash[32348]: cluster 2021-03-10T16:40:02.598361+0000 mgr.gibba043.dnkmem (mgr.34373) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:04.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:03 gibba043 bash[24019]: cluster 2021-03-10T16:40:02.598361+0000 mgr.gibba043.dnkmem (mgr.34373) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:06.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:05 gibba043 bash[24019]: cluster 2021-03-10T16:40:04.598936+0000 mgr.gibba043.dnkmem (mgr.34373) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:05 gibba003 bash[31385]: cluster 2021-03-10T16:40:04.598936+0000 mgr.gibba043.dnkmem (mgr.34373) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:06.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:05 gibba003 bash[32348]: cluster 2021-03-10T16:40:04.598936+0000 mgr.gibba043.dnkmem (mgr.34373) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:07 gibba043 bash[24019]: cluster 2021-03-10T16:40:06.600652+0000 mgr.gibba043.dnkmem (mgr.34373) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:07 gibba003 bash[31385]: cluster 2021-03-10T16:40:06.600652+0000 mgr.gibba043.dnkmem (mgr.34373) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:07 gibba003 bash[32348]: cluster 2021-03-10T16:40:06.600652+0000 mgr.gibba043.dnkmem (mgr.34373) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:10.032 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:09 gibba043 bash[24019]: cluster 2021-03-10T16:40:08.602289+0000 mgr.gibba043.dnkmem (mgr.34373) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:09 gibba003 bash[31385]: cluster 2021-03-10T16:40:08.602289+0000 mgr.gibba043.dnkmem (mgr.34373) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:09 gibba003 bash[32348]: cluster 2021-03-10T16:40:08.602289+0000 mgr.gibba043.dnkmem (mgr.34373) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:12.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:11 gibba043 bash[24019]: cluster 2021-03-10T16:40:10.603888+0000 mgr.gibba043.dnkmem (mgr.34373) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:11 gibba003 bash[31385]: cluster 2021-03-10T16:40:10.603888+0000 mgr.gibba043.dnkmem (mgr.34373) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:11 gibba003 bash[32348]: cluster 2021-03-10T16:40:10.603888+0000 mgr.gibba043.dnkmem (mgr.34373) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:13.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:12 gibba043 bash[24019]: cephadm 2021-03-10T16:40:11.577689+0000 mgr.gibba043.dnkmem (mgr.34373) 8925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:13.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:12 gibba003 bash[31385]: cephadm 2021-03-10T16:40:11.577689+0000 mgr.gibba043.dnkmem (mgr.34373) 8925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:13.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:12 gibba003 bash[32348]: cephadm 2021-03-10T16:40:11.577689+0000 mgr.gibba043.dnkmem (mgr.34373) 8925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:13 gibba043 bash[24019]: cluster 2021-03-10T16:40:12.605553+0000 mgr.gibba043.dnkmem (mgr.34373) 8926 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:13 gibba003 bash[31385]: cluster 2021-03-10T16:40:12.605553+0000 mgr.gibba043.dnkmem (mgr.34373) 8926 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:13 gibba003 bash[32348]: cluster 2021-03-10T16:40:12.605553+0000 mgr.gibba043.dnkmem (mgr.34373) 8926 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:13.806368+0000 mon.c (mon.1) 2301 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:13.807126+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.031931+0000 mon.c (mon.1) 2302 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.033066+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.257921+0000 mon.c (mon.1) 2303 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:40:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.258680+0000 mon.c (mon.1) 2304 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:40:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.259370+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:40:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.259410+0000 mon.c (mon.1) 2305 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.260039+0000 mon.c (mon.1) 2306 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.261396+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:40:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.262300+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:14 gibba043 bash[24019]: audit 2021-03-10T16:40:14.263246+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:13.806368+0000 mon.c (mon.1) 2301 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:13.807126+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.031931+0000 mon.c (mon.1) 2302 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.033066+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.257921+0000 mon.c (mon.1) 2303 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:40:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.258680+0000 mon.c (mon.1) 2304 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:40:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.259370+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:40:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.259410+0000 mon.c (mon.1) 2305 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.260039+0000 mon.c (mon.1) 2306 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.261396+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:40:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.262300+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[31385]: audit 2021-03-10T16:40:14.263246+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:13.806368+0000 mon.c (mon.1) 2301 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:13.807126+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.031931+0000 mon.c (mon.1) 2302 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.033066+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.257921+0000 mon.c (mon.1) 2303 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:40:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.258680+0000 mon.c (mon.1) 2304 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:40:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.259370+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:40:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.259410+0000 mon.c (mon.1) 2305 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.260039+0000 mon.c (mon.1) 2306 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.261396+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:40:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.262300+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:40:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:14 gibba003 bash[32348]: audit 2021-03-10T16:40:14.263246+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:16.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:15 gibba043 bash[24019]: cluster 2021-03-10T16:40:14.606134+0000 mgr.gibba043.dnkmem (mgr.34373) 8927 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:15 gibba003 bash[31385]: cluster 2021-03-10T16:40:14.606134+0000 mgr.gibba043.dnkmem (mgr.34373) 8927 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:16.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:15 gibba003 bash[32348]: cluster 2021-03-10T16:40:14.606134+0000 mgr.gibba043.dnkmem (mgr.34373) 8927 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:17 gibba043 bash[24019]: cluster 2021-03-10T16:40:16.607461+0000 mgr.gibba043.dnkmem (mgr.34373) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:17 gibba003 bash[31385]: cluster 2021-03-10T16:40:16.607461+0000 mgr.gibba043.dnkmem (mgr.34373) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:18.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:17 gibba003 bash[32348]: cluster 2021-03-10T16:40:16.607461+0000 mgr.gibba043.dnkmem (mgr.34373) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:19 gibba003 bash[31385]: cluster 2021-03-10T16:40:18.609044+0000 mgr.gibba043.dnkmem (mgr.34373) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:19 gibba003 bash[32348]: cluster 2021-03-10T16:40:18.609044+0000 mgr.gibba043.dnkmem (mgr.34373) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:19 gibba043 bash[24019]: cluster 2021-03-10T16:40:18.609044+0000 mgr.gibba043.dnkmem (mgr.34373) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:21 gibba003 bash[31385]: cluster 2021-03-10T16:40:20.610426+0000 mgr.gibba043.dnkmem (mgr.34373) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:22.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:21 gibba003 bash[32348]: cluster 2021-03-10T16:40:20.610426+0000 mgr.gibba043.dnkmem (mgr.34373) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:21 gibba043 bash[24019]: cluster 2021-03-10T16:40:20.610426+0000 mgr.gibba043.dnkmem (mgr.34373) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:24.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:23 gibba003 bash[31385]: cluster 2021-03-10T16:40:22.612219+0000 mgr.gibba043.dnkmem (mgr.34373) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:24.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:23 gibba003 bash[32348]: cluster 2021-03-10T16:40:22.612219+0000 mgr.gibba043.dnkmem (mgr.34373) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:24.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:23 gibba043 bash[24019]: cluster 2021-03-10T16:40:22.612219+0000 mgr.gibba043.dnkmem (mgr.34373) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:25 gibba003 bash[31385]: cluster 2021-03-10T16:40:24.612946+0000 mgr.gibba043.dnkmem (mgr.34373) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:25 gibba003 bash[32348]: cluster 2021-03-10T16:40:24.612946+0000 mgr.gibba043.dnkmem (mgr.34373) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:26.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:25 gibba043 bash[24019]: cluster 2021-03-10T16:40:24.612946+0000 mgr.gibba043.dnkmem (mgr.34373) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:28.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:27 gibba003 bash[31385]: cephadm 2021-03-10T16:40:26.588808+0000 mgr.gibba043.dnkmem (mgr.34373) 8933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:28.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:27 gibba003 bash[31385]: cluster 2021-03-10T16:40:26.614558+0000 mgr.gibba043.dnkmem (mgr.34373) 8934 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:28.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:27 gibba003 bash[32348]: cephadm 2021-03-10T16:40:26.588808+0000 mgr.gibba043.dnkmem (mgr.34373) 8933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:28.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:27 gibba003 bash[32348]: cluster 2021-03-10T16:40:26.614558+0000 mgr.gibba043.dnkmem (mgr.34373) 8934 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:27 gibba043 bash[24019]: cephadm 2021-03-10T16:40:26.588808+0000 mgr.gibba043.dnkmem (mgr.34373) 8933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:27 gibba043 bash[24019]: cluster 2021-03-10T16:40:26.614558+0000 mgr.gibba043.dnkmem (mgr.34373) 8934 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:29 gibba003 bash[31385]: cluster 2021-03-10T16:40:28.616254+0000 mgr.gibba043.dnkmem (mgr.34373) 8935 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:29 gibba003 bash[32348]: cluster 2021-03-10T16:40:28.616254+0000 mgr.gibba043.dnkmem (mgr.34373) 8935 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:29 gibba043 bash[24019]: cluster 2021-03-10T16:40:28.616254+0000 mgr.gibba043.dnkmem (mgr.34373) 8935 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:31 gibba003 bash[31385]: cluster 2021-03-10T16:40:30.617763+0000 mgr.gibba043.dnkmem (mgr.34373) 8936 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:31 gibba003 bash[32348]: cluster 2021-03-10T16:40:30.617763+0000 mgr.gibba043.dnkmem (mgr.34373) 8936 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:31 gibba043 bash[24019]: cluster 2021-03-10T16:40:30.617763+0000 mgr.gibba043.dnkmem (mgr.34373) 8936 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:32.472 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:40:32.700 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:40:32.700 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 100s ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:40:32.701 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 36s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:40:32.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:40:32.702 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:40:32.702 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:40:32.702 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:40:32.703 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:40:32.703 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:40:32.704 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 100s ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:40:32.704 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 36s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:40:32.704 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:40:32.705 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:40:32.705 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:40:32.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 100s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:40:32.706 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:40:32.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:40:32.707 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:40:32.708 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 36s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:40:32.708 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 36s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:40:32.708 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 100s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:40:32.949 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:40:32.949 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:40:32.950 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:32.950 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:40:32.950 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:40:32.951 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:32.951 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:40:32.951 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:40:32.951 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:40:32.952 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:40:32.952 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:40:32.952 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:40:32.952 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:40:32.953 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:40:32.953 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:40:34.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[31385]: audit 2021-03-10T16:40:32.465326+0000 mgr.gibba043.dnkmem (mgr.34373) 8937 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:34.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[31385]: cluster 2021-03-10T16:40:32.619241+0000 mgr.gibba043.dnkmem (mgr.34373) 8938 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[31385]: audit 2021-03-10T16:40:32.689035+0000 mgr.gibba043.dnkmem (mgr.34373) 8939 : audit [DBG] from='client.60040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:34.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[31385]: audit 2021-03-10T16:40:32.953037+0000 mon.a (mon.0) 1880 : audit [DBG] from='client.? 172.21.2.103:0/2125070123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[32348]: audit 2021-03-10T16:40:32.465326+0000 mgr.gibba043.dnkmem (mgr.34373) 8937 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[32348]: cluster 2021-03-10T16:40:32.619241+0000 mgr.gibba043.dnkmem (mgr.34373) 8938 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[32348]: audit 2021-03-10T16:40:32.689035+0000 mgr.gibba043.dnkmem (mgr.34373) 8939 : audit [DBG] from='client.60040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:34.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:33 gibba003 bash[32348]: audit 2021-03-10T16:40:32.953037+0000 mon.a (mon.0) 1880 : audit [DBG] from='client.? 172.21.2.103:0/2125070123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:33 gibba043 bash[24019]: audit 2021-03-10T16:40:32.465326+0000 mgr.gibba043.dnkmem (mgr.34373) 8937 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:34.338 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:33 gibba043 bash[24019]: cluster 2021-03-10T16:40:32.619241+0000 mgr.gibba043.dnkmem (mgr.34373) 8938 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:34.339 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:33 gibba043 bash[24019]: audit 2021-03-10T16:40:32.689035+0000 mgr.gibba043.dnkmem (mgr.34373) 8939 : audit [DBG] from='client.60040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:34.339 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:33 gibba043 bash[24019]: audit 2021-03-10T16:40:32.953037+0000 mon.a (mon.0) 1880 : audit [DBG] from='client.? 172.21.2.103:0/2125070123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:36.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:35 gibba003 bash[31385]: cluster 2021-03-10T16:40:34.620795+0000 mgr.gibba043.dnkmem (mgr.34373) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:36.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:35 gibba003 bash[32348]: cluster 2021-03-10T16:40:34.620795+0000 mgr.gibba043.dnkmem (mgr.34373) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:35 gibba043 bash[24019]: cluster 2021-03-10T16:40:34.620795+0000 mgr.gibba043.dnkmem (mgr.34373) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:37 gibba003 bash[31385]: cluster 2021-03-10T16:40:36.622618+0000 mgr.gibba043.dnkmem (mgr.34373) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:37 gibba003 bash[32348]: cluster 2021-03-10T16:40:36.622618+0000 mgr.gibba043.dnkmem (mgr.34373) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:37 gibba043 bash[24019]: cluster 2021-03-10T16:40:36.622618+0000 mgr.gibba043.dnkmem (mgr.34373) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:39 gibba003 bash[31385]: cluster 2021-03-10T16:40:38.623966+0000 mgr.gibba043.dnkmem (mgr.34373) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:39 gibba003 bash[32348]: cluster 2021-03-10T16:40:38.623966+0000 mgr.gibba043.dnkmem (mgr.34373) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:39 gibba043 bash[24019]: cluster 2021-03-10T16:40:38.623966+0000 mgr.gibba043.dnkmem (mgr.34373) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:41 gibba003 bash[31385]: cluster 2021-03-10T16:40:40.625530+0000 mgr.gibba043.dnkmem (mgr.34373) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:41 gibba003 bash[32348]: cluster 2021-03-10T16:40:40.625530+0000 mgr.gibba043.dnkmem (mgr.34373) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:41 gibba043 bash[24019]: cluster 2021-03-10T16:40:40.625530+0000 mgr.gibba043.dnkmem (mgr.34373) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:43.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:42 gibba003 bash[31385]: cephadm 2021-03-10T16:40:41.604800+0000 mgr.gibba043.dnkmem (mgr.34373) 8944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:43.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:42 gibba003 bash[32348]: cephadm 2021-03-10T16:40:41.604800+0000 mgr.gibba043.dnkmem (mgr.34373) 8944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:43.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:42 gibba043 bash[24019]: cephadm 2021-03-10T16:40:41.604800+0000 mgr.gibba043.dnkmem (mgr.34373) 8944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:43 gibba003 bash[31385]: cluster 2021-03-10T16:40:42.627166+0000 mgr.gibba043.dnkmem (mgr.34373) 8945 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:43 gibba003 bash[32348]: cluster 2021-03-10T16:40:42.627166+0000 mgr.gibba043.dnkmem (mgr.34373) 8945 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:43 gibba043 bash[24019]: cluster 2021-03-10T16:40:42.627166+0000 mgr.gibba043.dnkmem (mgr.34373) 8945 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:45 gibba003 bash[31385]: cluster 2021-03-10T16:40:44.628011+0000 mgr.gibba043.dnkmem (mgr.34373) 8946 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:45 gibba003 bash[32348]: cluster 2021-03-10T16:40:44.628011+0000 mgr.gibba043.dnkmem (mgr.34373) 8946 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:45 gibba043 bash[24019]: cluster 2021-03-10T16:40:44.628011+0000 mgr.gibba043.dnkmem (mgr.34373) 8946 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:47 gibba003 bash[31385]: cluster 2021-03-10T16:40:46.629429+0000 mgr.gibba043.dnkmem (mgr.34373) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:47 gibba003 bash[32348]: cluster 2021-03-10T16:40:46.629429+0000 mgr.gibba043.dnkmem (mgr.34373) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:47 gibba043 bash[24019]: cluster 2021-03-10T16:40:46.629429+0000 mgr.gibba043.dnkmem (mgr.34373) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:50.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:49 gibba003 bash[31385]: cluster 2021-03-10T16:40:48.630878+0000 mgr.gibba043.dnkmem (mgr.34373) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:49 gibba003 bash[32348]: cluster 2021-03-10T16:40:48.630878+0000 mgr.gibba043.dnkmem (mgr.34373) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:49 gibba043 bash[24019]: cluster 2021-03-10T16:40:48.630878+0000 mgr.gibba043.dnkmem (mgr.34373) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:51 gibba003 bash[31385]: cluster 2021-03-10T16:40:50.632338+0000 mgr.gibba043.dnkmem (mgr.34373) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:51 gibba003 bash[32348]: cluster 2021-03-10T16:40:50.632338+0000 mgr.gibba043.dnkmem (mgr.34373) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:51 gibba043 bash[24019]: cluster 2021-03-10T16:40:50.632338+0000 mgr.gibba043.dnkmem (mgr.34373) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:54.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:53 gibba003 bash[31385]: cluster 2021-03-10T16:40:52.633717+0000 mgr.gibba043.dnkmem (mgr.34373) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:53 gibba003 bash[32348]: cluster 2021-03-10T16:40:52.633717+0000 mgr.gibba043.dnkmem (mgr.34373) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:53 gibba043 bash[24019]: cluster 2021-03-10T16:40:52.633717+0000 mgr.gibba043.dnkmem (mgr.34373) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:56.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:55 gibba003 bash[31385]: cluster 2021-03-10T16:40:54.634288+0000 mgr.gibba043.dnkmem (mgr.34373) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:56.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:55 gibba003 bash[32348]: cluster 2021-03-10T16:40:54.634288+0000 mgr.gibba043.dnkmem (mgr.34373) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:55 gibba043 bash[24019]: cluster 2021-03-10T16:40:54.634288+0000 mgr.gibba043.dnkmem (mgr.34373) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.621428+0000 mgr.gibba043.dnkmem (mgr.34373) 8952 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:40:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.623015+0000 mgr.gibba043.dnkmem (mgr.34373) 8953 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:40:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cluster 2021-03-10T16:40:56.635625+0000 mgr.gibba043.dnkmem (mgr.34373) 8954 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.835962+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:40:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.837350+0000 mgr.gibba043.dnkmem (mgr.34373) 8955 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.839854+0000 mon.c (mon.1) 2307 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.839938+0000 mgr.gibba043.dnkmem (mgr.34373) 8956 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.841855+0000 mgr.gibba043.dnkmem (mgr.34373) 8957 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.841892+0000 mgr.gibba043.dnkmem (mgr.34373) 8958 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.842047+0000 mon.c (mon.1) 2308 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.843902+0000 mgr.gibba043.dnkmem (mgr.34373) 8959 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.844000+0000 mgr.gibba043.dnkmem (mgr.34373) 8960 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.844006+0000 mon.c (mon.1) 2309 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.845828+0000 mgr.gibba043.dnkmem (mgr.34373) 8961 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.846035+0000 mon.c (mon.1) 2310 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.848550+0000 mgr.gibba043.dnkmem (mgr.34373) 8962 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.848584+0000 mgr.gibba043.dnkmem (mgr.34373) 8963 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.850636+0000 mgr.gibba043.dnkmem (mgr.34373) 8964 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.850785+0000 mon.c (mon.1) 2311 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.850944+0000 mgr.gibba043.dnkmem (mgr.34373) 8965 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.852863+0000 mgr.gibba043.dnkmem (mgr.34373) 8966 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.621428+0000 mgr.gibba043.dnkmem (mgr.34373) 8952 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:40:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.623015+0000 mgr.gibba043.dnkmem (mgr.34373) 8953 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:40:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cluster 2021-03-10T16:40:56.635625+0000 mgr.gibba043.dnkmem (mgr.34373) 8954 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.835962+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:40:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.837350+0000 mgr.gibba043.dnkmem (mgr.34373) 8955 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:58.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.839854+0000 mon.c (mon.1) 2307 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.839938+0000 mgr.gibba043.dnkmem (mgr.34373) 8956 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:58.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.841855+0000 mgr.gibba043.dnkmem (mgr.34373) 8957 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.841892+0000 mgr.gibba043.dnkmem (mgr.34373) 8958 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.842047+0000 mon.c (mon.1) 2308 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.843902+0000 mgr.gibba043.dnkmem (mgr.34373) 8959 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:58.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.844000+0000 mgr.gibba043.dnkmem (mgr.34373) 8960 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.844006+0000 mon.c (mon.1) 2309 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.845828+0000 mgr.gibba043.dnkmem (mgr.34373) 8961 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.846035+0000 mon.c (mon.1) 2310 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.848550+0000 mgr.gibba043.dnkmem (mgr.34373) 8962 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.848584+0000 mgr.gibba043.dnkmem (mgr.34373) 8963 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.850636+0000 mgr.gibba043.dnkmem (mgr.34373) 8964 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:58.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.850785+0000 mon.c (mon.1) 2311 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.850944+0000 mgr.gibba043.dnkmem (mgr.34373) 8965 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:58.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.852863+0000 mgr.gibba043.dnkmem (mgr.34373) 8966 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:58.201 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.852898+0000 mgr.gibba043.dnkmem (mgr.34373) 8967 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: cephadm 2021-03-10T16:40:56.853007+0000 mgr.gibba043.dnkmem (mgr.34373) 8968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[31385]: audit 2021-03-10T16:40:56.853069+0000 mon.c (mon.1) 2312 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.223 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.852898+0000 mgr.gibba043.dnkmem (mgr.34373) 8967 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:58.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: cephadm 2021-03-10T16:40:56.853007+0000 mgr.gibba043.dnkmem (mgr.34373) 8968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:58.224 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:57 gibba003 bash[32348]: audit 2021-03-10T16:40:56.853069+0000 mon.c (mon.1) 2312 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.621428+0000 mgr.gibba043.dnkmem (mgr.34373) 8952 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:40:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.623015+0000 mgr.gibba043.dnkmem (mgr.34373) 8953 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:40:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cluster 2021-03-10T16:40:56.635625+0000 mgr.gibba043.dnkmem (mgr.34373) 8954 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.835962+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:40:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.837350+0000 mgr.gibba043.dnkmem (mgr.34373) 8955 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.839854+0000 mon.c (mon.1) 2307 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.839938+0000 mgr.gibba043.dnkmem (mgr.34373) 8956 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.841855+0000 mgr.gibba043.dnkmem (mgr.34373) 8957 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.841892+0000 mgr.gibba043.dnkmem (mgr.34373) 8958 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.842047+0000 mon.c (mon.1) 2308 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.843902+0000 mgr.gibba043.dnkmem (mgr.34373) 8959 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.844000+0000 mgr.gibba043.dnkmem (mgr.34373) 8960 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.844006+0000 mon.c (mon.1) 2309 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.845828+0000 mgr.gibba043.dnkmem (mgr.34373) 8961 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.846035+0000 mon.c (mon.1) 2310 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.848550+0000 mgr.gibba043.dnkmem (mgr.34373) 8962 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.848584+0000 mgr.gibba043.dnkmem (mgr.34373) 8963 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.850636+0000 mgr.gibba043.dnkmem (mgr.34373) 8964 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.850785+0000 mon.c (mon.1) 2311 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.850944+0000 mgr.gibba043.dnkmem (mgr.34373) 8965 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.852863+0000 mgr.gibba043.dnkmem (mgr.34373) 8966 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:58.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.852898+0000 mgr.gibba043.dnkmem (mgr.34373) 8967 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: cephadm 2021-03-10T16:40:56.853007+0000 mgr.gibba043.dnkmem (mgr.34373) 8968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:40:58.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:57 gibba043 bash[24019]: audit 2021-03-10T16:40:56.853069+0000 mon.c (mon.1) 2312 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:00.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:40:59 gibba003 bash[31385]: cluster 2021-03-10T16:40:58.637339+0000 mgr.gibba043.dnkmem (mgr.34373) 8969 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:00.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:40:59 gibba003 bash[32348]: cluster 2021-03-10T16:40:58.637339+0000 mgr.gibba043.dnkmem (mgr.34373) 8969 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:40:59 gibba043 bash[24019]: cluster 2021-03-10T16:40:58.637339+0000 mgr.gibba043.dnkmem (mgr.34373) 8969 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:02.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:01 gibba003 bash[31385]: cluster 2021-03-10T16:41:00.638147+0000 mgr.gibba043.dnkmem (mgr.34373) 8970 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:01 gibba003 bash[32348]: cluster 2021-03-10T16:41:00.638147+0000 mgr.gibba043.dnkmem (mgr.34373) 8970 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:02.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:01 gibba043 bash[24019]: cluster 2021-03-10T16:41:00.638147+0000 mgr.gibba043.dnkmem (mgr.34373) 8970 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:03.191 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:41:03.419 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:41:03.420 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:41:03.420 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 67s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:41:03.420 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:41:03.421 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:41:03.421 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:41:03.421 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:41:03.421 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:41:03.422 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:41:03.422 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:41:03.422 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 67s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:41:03.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:41:03.423 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:41:03.424 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:41:03.424 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:41:03.424 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:41:03.425 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:41:03.425 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:41:03.425 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 67s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:41:03.426 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 67s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:41:03.426 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:41:03.668 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:41:03.668 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:41:03.668 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:03.669 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:41:03.669 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:41:03.669 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:03.669 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:41:03.670 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:41:03.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:41:03.670 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:41:03.670 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:41:03.671 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:41:03.671 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:41:03.671 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:41:03.671 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:41:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:03 gibba003 bash[31385]: cluster 2021-03-10T16:41:02.639802+0000 mgr.gibba043.dnkmem (mgr.34373) 8971 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:03 gibba003 bash[31385]: audit 2021-03-10T16:41:03.671839+0000 mon.a (mon.0) 1882 : audit [DBG] from='client.? 172.21.2.103:0/2660271371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:04.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:03 gibba003 bash[32348]: cluster 2021-03-10T16:41:02.639802+0000 mgr.gibba043.dnkmem (mgr.34373) 8971 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:04.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:03 gibba003 bash[32348]: audit 2021-03-10T16:41:03.671839+0000 mon.a (mon.0) 1882 : audit [DBG] from='client.? 172.21.2.103:0/2660271371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:03 gibba043 bash[24019]: cluster 2021-03-10T16:41:02.639802+0000 mgr.gibba043.dnkmem (mgr.34373) 8971 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:03 gibba043 bash[24019]: audit 2021-03-10T16:41:03.671839+0000 mon.a (mon.0) 1882 : audit [DBG] from='client.? 172.21.2.103:0/2660271371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:05.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:04 gibba003 bash[31385]: audit 2021-03-10T16:41:03.183973+0000 mgr.gibba043.dnkmem (mgr.34373) 8972 : audit [DBG] from='client.60052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:05.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:04 gibba003 bash[31385]: audit 2021-03-10T16:41:03.410908+0000 mgr.gibba043.dnkmem (mgr.34373) 8973 : audit [DBG] from='client.60058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:05.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:04 gibba003 bash[32348]: audit 2021-03-10T16:41:03.183973+0000 mgr.gibba043.dnkmem (mgr.34373) 8972 : audit [DBG] from='client.60052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:05.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:04 gibba003 bash[32348]: audit 2021-03-10T16:41:03.410908+0000 mgr.gibba043.dnkmem (mgr.34373) 8973 : audit [DBG] from='client.60058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:05.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:04 gibba043 bash[24019]: audit 2021-03-10T16:41:03.183973+0000 mgr.gibba043.dnkmem (mgr.34373) 8972 : audit [DBG] from='client.60052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:05.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:04 gibba043 bash[24019]: audit 2021-03-10T16:41:03.410908+0000 mgr.gibba043.dnkmem (mgr.34373) 8973 : audit [DBG] from='client.60058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:05 gibba003 bash[31385]: cluster 2021-03-10T16:41:04.641228+0000 mgr.gibba043.dnkmem (mgr.34373) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:06.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:05 gibba003 bash[32348]: cluster 2021-03-10T16:41:04.641228+0000 mgr.gibba043.dnkmem (mgr.34373) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:05 gibba043 bash[24019]: cluster 2021-03-10T16:41:04.641228+0000 mgr.gibba043.dnkmem (mgr.34373) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:07 gibba003 bash[31385]: cluster 2021-03-10T16:41:06.642004+0000 mgr.gibba043.dnkmem (mgr.34373) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:07 gibba003 bash[32348]: cluster 2021-03-10T16:41:06.642004+0000 mgr.gibba043.dnkmem (mgr.34373) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:07 gibba043 bash[24019]: cluster 2021-03-10T16:41:06.642004+0000 mgr.gibba043.dnkmem (mgr.34373) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:09 gibba003 bash[31385]: cluster 2021-03-10T16:41:08.643273+0000 mgr.gibba043.dnkmem (mgr.34373) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:09 gibba003 bash[32348]: cluster 2021-03-10T16:41:08.643273+0000 mgr.gibba043.dnkmem (mgr.34373) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:09 gibba043 bash[24019]: cluster 2021-03-10T16:41:08.643273+0000 mgr.gibba043.dnkmem (mgr.34373) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:11 gibba003 bash[31385]: cluster 2021-03-10T16:41:10.644792+0000 mgr.gibba043.dnkmem (mgr.34373) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:11 gibba003 bash[32348]: cluster 2021-03-10T16:41:10.644792+0000 mgr.gibba043.dnkmem (mgr.34373) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:11 gibba043 bash[24019]: cluster 2021-03-10T16:41:10.644792+0000 mgr.gibba043.dnkmem (mgr.34373) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:13.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:12 gibba003 bash[31385]: cephadm 2021-03-10T16:41:11.859540+0000 mgr.gibba043.dnkmem (mgr.34373) 8978 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:13.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:12 gibba003 bash[32348]: cephadm 2021-03-10T16:41:11.859540+0000 mgr.gibba043.dnkmem (mgr.34373) 8978 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:12 gibba043 bash[24019]: cephadm 2021-03-10T16:41:11.859540+0000 mgr.gibba043.dnkmem (mgr.34373) 8978 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:13 gibba003 bash[31385]: cluster 2021-03-10T16:41:12.645408+0000 mgr.gibba043.dnkmem (mgr.34373) 8979 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:13 gibba003 bash[31385]: audit 2021-03-10T16:41:13.812459+0000 mon.c (mon.1) 2313 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:14.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:13 gibba003 bash[31385]: audit 2021-03-10T16:41:13.813680+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:13 gibba003 bash[32348]: cluster 2021-03-10T16:41:12.645408+0000 mgr.gibba043.dnkmem (mgr.34373) 8979 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:13 gibba003 bash[32348]: audit 2021-03-10T16:41:13.812459+0000 mon.c (mon.1) 2313 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:13 gibba003 bash[32348]: audit 2021-03-10T16:41:13.813680+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:13 gibba043 bash[24019]: cluster 2021-03-10T16:41:12.645408+0000 mgr.gibba043.dnkmem (mgr.34373) 8979 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:13 gibba043 bash[24019]: audit 2021-03-10T16:41:13.812459+0000 mon.c (mon.1) 2313 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:13 gibba043 bash[24019]: audit 2021-03-10T16:41:13.813680+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.039796+0000 mon.c (mon.1) 2314 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.040921+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.267161+0000 mon.c (mon.1) 2315 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:41:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.267943+0000 mon.c (mon.1) 2316 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.268564+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:41:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.268627+0000 mon.c (mon.1) 2317 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.269340+0000 mon.c (mon.1) 2318 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:41:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.271179+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.272017+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[31385]: audit 2021-03-10T16:41:14.272804+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:41:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.039796+0000 mon.c (mon.1) 2314 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.040921+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.267161+0000 mon.c (mon.1) 2315 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:41:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.267943+0000 mon.c (mon.1) 2316 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.268564+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:41:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.268627+0000 mon.c (mon.1) 2317 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.269340+0000 mon.c (mon.1) 2318 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:41:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.271179+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.272017+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:14 gibba003 bash[32348]: audit 2021-03-10T16:41:14.272804+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:41:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.039796+0000 mon.c (mon.1) 2314 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.040921+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.267161+0000 mon.c (mon.1) 2315 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:41:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.267943+0000 mon.c (mon.1) 2316 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.268564+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:41:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.268627+0000 mon.c (mon.1) 2317 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.269340+0000 mon.c (mon.1) 2318 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:41:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.271179+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.272017+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:41:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:14 gibba043 bash[24019]: audit 2021-03-10T16:41:14.272804+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:41:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:15 gibba043 bash[24019]: cluster 2021-03-10T16:41:14.646596+0000 mgr.gibba043.dnkmem (mgr.34373) 8980 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:16.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:15 gibba003 bash[31385]: cluster 2021-03-10T16:41:14.646596+0000 mgr.gibba043.dnkmem (mgr.34373) 8980 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:16.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:15 gibba003 bash[32348]: cluster 2021-03-10T16:41:14.646596+0000 mgr.gibba043.dnkmem (mgr.34373) 8980 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:17 gibba043 bash[24019]: cluster 2021-03-10T16:41:16.648073+0000 mgr.gibba043.dnkmem (mgr.34373) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:18.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:17 gibba003 bash[31385]: cluster 2021-03-10T16:41:16.648073+0000 mgr.gibba043.dnkmem (mgr.34373) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:18.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:17 gibba003 bash[32348]: cluster 2021-03-10T16:41:16.648073+0000 mgr.gibba043.dnkmem (mgr.34373) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:20.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:19 gibba043 bash[24019]: cluster 2021-03-10T16:41:18.649532+0000 mgr.gibba043.dnkmem (mgr.34373) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:20.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:19 gibba003 bash[31385]: cluster 2021-03-10T16:41:18.649532+0000 mgr.gibba043.dnkmem (mgr.34373) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:20.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:19 gibba003 bash[32348]: cluster 2021-03-10T16:41:18.649532+0000 mgr.gibba043.dnkmem (mgr.34373) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:21 gibba043 bash[24019]: cluster 2021-03-10T16:41:20.651082+0000 mgr.gibba043.dnkmem (mgr.34373) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:22.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:21 gibba003 bash[31385]: cluster 2021-03-10T16:41:20.651082+0000 mgr.gibba043.dnkmem (mgr.34373) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:22.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:21 gibba003 bash[32348]: cluster 2021-03-10T16:41:20.651082+0000 mgr.gibba043.dnkmem (mgr.34373) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:23 gibba043 bash[24019]: cluster 2021-03-10T16:41:22.652718+0000 mgr.gibba043.dnkmem (mgr.34373) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:24.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:23 gibba003 bash[31385]: cluster 2021-03-10T16:41:22.652718+0000 mgr.gibba043.dnkmem (mgr.34373) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:24.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:23 gibba003 bash[32348]: cluster 2021-03-10T16:41:22.652718+0000 mgr.gibba043.dnkmem (mgr.34373) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:25 gibba043 bash[24019]: cluster 2021-03-10T16:41:24.653346+0000 mgr.gibba043.dnkmem (mgr.34373) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:26.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:25 gibba003 bash[31385]: cluster 2021-03-10T16:41:24.653346+0000 mgr.gibba043.dnkmem (mgr.34373) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:26.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:25 gibba003 bash[32348]: cluster 2021-03-10T16:41:24.653346+0000 mgr.gibba043.dnkmem (mgr.34373) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:27 gibba043 bash[24019]: cluster 2021-03-10T16:41:26.655074+0000 mgr.gibba043.dnkmem (mgr.34373) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:27 gibba043 bash[24019]: cephadm 2021-03-10T16:41:26.862188+0000 mgr.gibba043.dnkmem (mgr.34373) 8987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:28.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:27 gibba003 bash[31385]: cluster 2021-03-10T16:41:26.655074+0000 mgr.gibba043.dnkmem (mgr.34373) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:28.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:27 gibba003 bash[31385]: cephadm 2021-03-10T16:41:26.862188+0000 mgr.gibba043.dnkmem (mgr.34373) 8987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:28.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:27 gibba003 bash[32348]: cluster 2021-03-10T16:41:26.655074+0000 mgr.gibba043.dnkmem (mgr.34373) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:28.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:27 gibba003 bash[32348]: cephadm 2021-03-10T16:41:26.862188+0000 mgr.gibba043.dnkmem (mgr.34373) 8987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:30 gibba043 bash[24019]: cluster 2021-03-10T16:41:28.656776+0000 mgr.gibba043.dnkmem (mgr.34373) 8988 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:30.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:30 gibba003 bash[31385]: cluster 2021-03-10T16:41:28.656776+0000 mgr.gibba043.dnkmem (mgr.34373) 8988 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:30 gibba003 bash[32348]: cluster 2021-03-10T16:41:28.656776+0000 mgr.gibba043.dnkmem (mgr.34373) 8988 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:32 gibba043 bash[24019]: cluster 2021-03-10T16:41:30.657544+0000 mgr.gibba043.dnkmem (mgr.34373) 8989 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:32 gibba003 bash[31385]: cluster 2021-03-10T16:41:30.657544+0000 mgr.gibba043.dnkmem (mgr.34373) 8989 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:32.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:32 gibba003 bash[32348]: cluster 2021-03-10T16:41:30.657544+0000 mgr.gibba043.dnkmem (mgr.34373) 8989 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:33.911 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:41:34.142 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:41:34.143 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:41:34.143 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 97s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:41:34.144 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:41:34.144 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:41:34.144 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:41:34.145 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:41:34.145 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:41:34.145 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:41:34.146 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:41:34.146 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 97s ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:41:34.146 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:41:34.146 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:41:34.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:41:34.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:41:34.147 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:41:34.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:41:34.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:41:34.148 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 97s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:41:34.148 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 97s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:41:34.149 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:41:34.390 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:41:34.391 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:41:34.391 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:34.391 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:41:34.392 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:41:34.392 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:34.392 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:41:34.392 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:41:34.393 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:41:34.393 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:41:34.393 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:41:34.393 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:41:34.394 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:41:34.394 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:41:34.395 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:41:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:34 gibba003 bash[31385]: cluster 2021-03-10T16:41:32.658784+0000 mgr.gibba043.dnkmem (mgr.34373) 8990 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:34.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:34 gibba003 bash[32348]: cluster 2021-03-10T16:41:32.658784+0000 mgr.gibba043.dnkmem (mgr.34373) 8990 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:34.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:34 gibba043 bash[24019]: cluster 2021-03-10T16:41:32.658784+0000 mgr.gibba043.dnkmem (mgr.34373) 8990 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:35.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:35 gibba003 bash[31385]: audit 2021-03-10T16:41:33.903780+0000 mgr.gibba043.dnkmem (mgr.34373) 8991 : audit [DBG] from='client.60070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:35.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:35 gibba003 bash[31385]: audit 2021-03-10T16:41:34.393885+0000 mon.c (mon.1) 2319 : audit [DBG] from='client.? 172.21.2.103:0/1141020860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:35.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:35 gibba003 bash[32348]: audit 2021-03-10T16:41:33.903780+0000 mgr.gibba043.dnkmem (mgr.34373) 8991 : audit [DBG] from='client.60070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:35.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:35 gibba003 bash[32348]: audit 2021-03-10T16:41:34.393885+0000 mon.c (mon.1) 2319 : audit [DBG] from='client.? 172.21.2.103:0/1141020860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:35.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:35 gibba043 bash[24019]: audit 2021-03-10T16:41:33.903780+0000 mgr.gibba043.dnkmem (mgr.34373) 8991 : audit [DBG] from='client.60070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:35.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:35 gibba043 bash[24019]: audit 2021-03-10T16:41:34.393885+0000 mon.c (mon.1) 2319 : audit [DBG] from='client.? 172.21.2.103:0/1141020860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:36.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:36 gibba003 bash[32348]: audit 2021-03-10T16:41:34.132298+0000 mgr.gibba043.dnkmem (mgr.34373) 8992 : audit [DBG] from='client.60076 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:36.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:36 gibba003 bash[32348]: cluster 2021-03-10T16:41:34.660350+0000 mgr.gibba043.dnkmem (mgr.34373) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:36 gibba003 bash[31385]: audit 2021-03-10T16:41:34.132298+0000 mgr.gibba043.dnkmem (mgr.34373) 8992 : audit [DBG] from='client.60076 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:36.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:36 gibba003 bash[31385]: cluster 2021-03-10T16:41:34.660350+0000 mgr.gibba043.dnkmem (mgr.34373) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:36.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:36 gibba043 bash[24019]: audit 2021-03-10T16:41:34.132298+0000 mgr.gibba043.dnkmem (mgr.34373) 8992 : audit [DBG] from='client.60076 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:36 gibba043 bash[24019]: cluster 2021-03-10T16:41:34.660350+0000 mgr.gibba043.dnkmem (mgr.34373) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:38.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:38 gibba003 bash[31385]: cluster 2021-03-10T16:41:36.661043+0000 mgr.gibba043.dnkmem (mgr.34373) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:38.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:38 gibba003 bash[32348]: cluster 2021-03-10T16:41:36.661043+0000 mgr.gibba043.dnkmem (mgr.34373) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:38.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:38 gibba043 bash[24019]: cluster 2021-03-10T16:41:36.661043+0000 mgr.gibba043.dnkmem (mgr.34373) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:40.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:40 gibba003 bash[31385]: cluster 2021-03-10T16:41:38.662437+0000 mgr.gibba043.dnkmem (mgr.34373) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:40.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:40 gibba003 bash[32348]: cluster 2021-03-10T16:41:38.662437+0000 mgr.gibba043.dnkmem (mgr.34373) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:40.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:40 gibba043 bash[24019]: cluster 2021-03-10T16:41:38.662437+0000 mgr.gibba043.dnkmem (mgr.34373) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:42 gibba043 bash[24019]: cluster 2021-03-10T16:41:40.663911+0000 mgr.gibba043.dnkmem (mgr.34373) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:42.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:42 gibba003 bash[31385]: cluster 2021-03-10T16:41:40.663911+0000 mgr.gibba043.dnkmem (mgr.34373) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:42.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:42 gibba003 bash[32348]: cluster 2021-03-10T16:41:40.663911+0000 mgr.gibba043.dnkmem (mgr.34373) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:43.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:43 gibba003 bash[31385]: cephadm 2021-03-10T16:41:41.878249+0000 mgr.gibba043.dnkmem (mgr.34373) 8997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:43.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:43 gibba003 bash[32348]: cephadm 2021-03-10T16:41:41.878249+0000 mgr.gibba043.dnkmem (mgr.34373) 8997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:43.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:43 gibba043 bash[24019]: cephadm 2021-03-10T16:41:41.878249+0000 mgr.gibba043.dnkmem (mgr.34373) 8997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:44.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:44 gibba003 bash[31385]: cluster 2021-03-10T16:41:42.664609+0000 mgr.gibba043.dnkmem (mgr.34373) 8998 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:44.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:44 gibba003 bash[32348]: cluster 2021-03-10T16:41:42.664609+0000 mgr.gibba043.dnkmem (mgr.34373) 8998 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:44.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:44 gibba043 bash[24019]: cluster 2021-03-10T16:41:42.664609+0000 mgr.gibba043.dnkmem (mgr.34373) 8998 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:46.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:46 gibba003 bash[31385]: cluster 2021-03-10T16:41:44.665874+0000 mgr.gibba043.dnkmem (mgr.34373) 8999 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:46.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:46 gibba003 bash[32348]: cluster 2021-03-10T16:41:44.665874+0000 mgr.gibba043.dnkmem (mgr.34373) 8999 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:46 gibba043 bash[24019]: cluster 2021-03-10T16:41:44.665874+0000 mgr.gibba043.dnkmem (mgr.34373) 8999 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:48.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:48 gibba003 bash[31385]: cluster 2021-03-10T16:41:46.667726+0000 mgr.gibba043.dnkmem (mgr.34373) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:48.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:48 gibba003 bash[32348]: cluster 2021-03-10T16:41:46.667726+0000 mgr.gibba043.dnkmem (mgr.34373) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:48.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:48 gibba043 bash[24019]: cluster 2021-03-10T16:41:46.667726+0000 mgr.gibba043.dnkmem (mgr.34373) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:50.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:50 gibba003 bash[31385]: cluster 2021-03-10T16:41:48.668639+0000 mgr.gibba043.dnkmem (mgr.34373) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:50 gibba003 bash[32348]: cluster 2021-03-10T16:41:48.668639+0000 mgr.gibba043.dnkmem (mgr.34373) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:50.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:50 gibba043 bash[24019]: cluster 2021-03-10T16:41:48.668639+0000 mgr.gibba043.dnkmem (mgr.34373) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:51 gibba003 bash[31385]: cluster 2021-03-10T16:41:50.670010+0000 mgr.gibba043.dnkmem (mgr.34373) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:51 gibba003 bash[32348]: cluster 2021-03-10T16:41:50.670010+0000 mgr.gibba043.dnkmem (mgr.34373) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:51 gibba043 bash[24019]: cluster 2021-03-10T16:41:50.670010+0000 mgr.gibba043.dnkmem (mgr.34373) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:53 gibba043 bash[24019]: cluster 2021-03-10T16:41:52.671591+0000 mgr.gibba043.dnkmem (mgr.34373) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:53 gibba003 bash[31385]: cluster 2021-03-10T16:41:52.671591+0000 mgr.gibba043.dnkmem (mgr.34373) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:53 gibba003 bash[32348]: cluster 2021-03-10T16:41:52.671591+0000 mgr.gibba043.dnkmem (mgr.34373) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:56.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:55 gibba043 bash[24019]: cluster 2021-03-10T16:41:54.672293+0000 mgr.gibba043.dnkmem (mgr.34373) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:55 gibba003 bash[31385]: cluster 2021-03-10T16:41:54.672293+0000 mgr.gibba043.dnkmem (mgr.34373) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:56.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:55 gibba003 bash[32348]: cluster 2021-03-10T16:41:54.672293+0000 mgr.gibba043.dnkmem (mgr.34373) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:58.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: cluster 2021-03-10T16:41:56.674102+0000 mgr.gibba043.dnkmem (mgr.34373) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: cephadm 2021-03-10T16:41:56.895125+0000 mgr.gibba043.dnkmem (mgr.34373) 9006 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:41:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: cephadm 2021-03-10T16:41:56.896767+0000 mgr.gibba043.dnkmem (mgr.34373) 9007 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:41:58.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.102768+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:41:58.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.103866+0000 mgr.gibba043.dnkmem (mgr.34373) 9008 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.106118+0000 mon.c (mon.1) 2320 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.107722+0000 mon.c (mon.1) 2321 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.109059+0000 mon.c (mon.1) 2322 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.110599+0000 mon.c (mon.1) 2323 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.114022+0000 mon.c (mon.1) 2324 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[31385]: audit 2021-03-10T16:41:57.115929+0000 mon.c (mon.1) 2325 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: cluster 2021-03-10T16:41:56.674102+0000 mgr.gibba043.dnkmem (mgr.34373) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:58.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: cephadm 2021-03-10T16:41:56.895125+0000 mgr.gibba043.dnkmem (mgr.34373) 9006 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:41:58.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: cephadm 2021-03-10T16:41:56.896767+0000 mgr.gibba043.dnkmem (mgr.34373) 9007 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:41:58.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.102768+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:41:58.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.103866+0000 mgr.gibba043.dnkmem (mgr.34373) 9008 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:58.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.106118+0000 mon.c (mon.1) 2320 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:58.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.107722+0000 mon.c (mon.1) 2321 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.109059+0000 mon.c (mon.1) 2322 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.110599+0000 mon.c (mon.1) 2323 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.114022+0000 mon.c (mon.1) 2324 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:58 gibba003 bash[32348]: audit 2021-03-10T16:41:57.115929+0000 mon.c (mon.1) 2325 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: cluster 2021-03-10T16:41:56.674102+0000 mgr.gibba043.dnkmem (mgr.34373) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: cephadm 2021-03-10T16:41:56.895125+0000 mgr.gibba043.dnkmem (mgr.34373) 9006 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:41:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: cephadm 2021-03-10T16:41:56.896767+0000 mgr.gibba043.dnkmem (mgr.34373) 9007 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:41:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.102768+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:41:58.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.103866+0000 mgr.gibba043.dnkmem (mgr.34373) 9008 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:58.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.106118+0000 mon.c (mon.1) 2320 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:58.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.107722+0000 mon.c (mon.1) 2321 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.109059+0000 mon.c (mon.1) 2322 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.110599+0000 mon.c (mon.1) 2323 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.114022+0000 mon.c (mon.1) 2324 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:58.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:58 gibba043 bash[24019]: audit 2021-03-10T16:41:57.115929+0000 mon.c (mon.1) 2325 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:59.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.105661+0000 mgr.gibba043.dnkmem (mgr.34373) 9009 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:59.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.106946+0000 mgr.gibba043.dnkmem (mgr.34373) 9010 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.106982+0000 mgr.gibba043.dnkmem (mgr.34373) 9011 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.108484+0000 mgr.gibba043.dnkmem (mgr.34373) 9012 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.108599+0000 mgr.gibba043.dnkmem (mgr.34373) 9013 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.109910+0000 mgr.gibba043.dnkmem (mgr.34373) 9014 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.111763+0000 mgr.gibba043.dnkmem (mgr.34373) 9015 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.111880+0000 mgr.gibba043.dnkmem (mgr.34373) 9016 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.113556+0000 mgr.gibba043.dnkmem (mgr.34373) 9017 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.113873+0000 mgr.gibba043.dnkmem (mgr.34373) 9018 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.115585+0000 mgr.gibba043.dnkmem (mgr.34373) 9019 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.115624+0000 mgr.gibba043.dnkmem (mgr.34373) 9020 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[31385]: cephadm 2021-03-10T16:41:57.115793+0000 mgr.gibba043.dnkmem (mgr.34373) 9021 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.105661+0000 mgr.gibba043.dnkmem (mgr.34373) 9009 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.106946+0000 mgr.gibba043.dnkmem (mgr.34373) 9010 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.106982+0000 mgr.gibba043.dnkmem (mgr.34373) 9011 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.108484+0000 mgr.gibba043.dnkmem (mgr.34373) 9012 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.108599+0000 mgr.gibba043.dnkmem (mgr.34373) 9013 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.109910+0000 mgr.gibba043.dnkmem (mgr.34373) 9014 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.111763+0000 mgr.gibba043.dnkmem (mgr.34373) 9015 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.111880+0000 mgr.gibba043.dnkmem (mgr.34373) 9016 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.113556+0000 mgr.gibba043.dnkmem (mgr.34373) 9017 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.113873+0000 mgr.gibba043.dnkmem (mgr.34373) 9018 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.115585+0000 mgr.gibba043.dnkmem (mgr.34373) 9019 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.115624+0000 mgr.gibba043.dnkmem (mgr.34373) 9020 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:41:59 gibba003 bash[32348]: cephadm 2021-03-10T16:41:57.115793+0000 mgr.gibba043.dnkmem (mgr.34373) 9021 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:41:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.105661+0000 mgr.gibba043.dnkmem (mgr.34373) 9009 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.106946+0000 mgr.gibba043.dnkmem (mgr.34373) 9010 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.106982+0000 mgr.gibba043.dnkmem (mgr.34373) 9011 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:59.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.108484+0000 mgr.gibba043.dnkmem (mgr.34373) 9012 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:59.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.108599+0000 mgr.gibba043.dnkmem (mgr.34373) 9013 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:59.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.109910+0000 mgr.gibba043.dnkmem (mgr.34373) 9014 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:59.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.111763+0000 mgr.gibba043.dnkmem (mgr.34373) 9015 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.111880+0000 mgr.gibba043.dnkmem (mgr.34373) 9016 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.113556+0000 mgr.gibba043.dnkmem (mgr.34373) 9017 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.113873+0000 mgr.gibba043.dnkmem (mgr.34373) 9018 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.115585+0000 mgr.gibba043.dnkmem (mgr.34373) 9019 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.115624+0000 mgr.gibba043.dnkmem (mgr.34373) 9020 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:59.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:41:59 gibba043 bash[24019]: cephadm 2021-03-10T16:41:57.115793+0000 mgr.gibba043.dnkmem (mgr.34373) 9021 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:00.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:00 gibba003 bash[31385]: cluster 2021-03-10T16:41:58.675702+0000 mgr.gibba043.dnkmem (mgr.34373) 9022 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:00.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:00 gibba003 bash[32348]: cluster 2021-03-10T16:41:58.675702+0000 mgr.gibba043.dnkmem (mgr.34373) 9022 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:00 gibba043 bash[24019]: cluster 2021-03-10T16:41:58.675702+0000 mgr.gibba043.dnkmem (mgr.34373) 9022 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:01 gibba003 bash[31385]: cluster 2021-03-10T16:42:00.676297+0000 mgr.gibba043.dnkmem (mgr.34373) 9023 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:01 gibba003 bash[32348]: cluster 2021-03-10T16:42:00.676297+0000 mgr.gibba043.dnkmem (mgr.34373) 9023 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:01 gibba043 bash[24019]: cluster 2021-03-10T16:42:00.676297+0000 mgr.gibba043.dnkmem (mgr.34373) 9023 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:04.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:03 gibba043 bash[24019]: cluster 2021-03-10T16:42:02.677716+0000 mgr.gibba043.dnkmem (mgr.34373) 9024 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:04.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:03 gibba003 bash[31385]: cluster 2021-03-10T16:42:02.677716+0000 mgr.gibba043.dnkmem (mgr.34373) 9024 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:03 gibba003 bash[32348]: cluster 2021-03-10T16:42:02.677716+0000 mgr.gibba043.dnkmem (mgr.34373) 9024 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:04.633 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:42:04.867 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:42:04.867 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:42:04.867 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:42:04.868 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:42:04.868 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:42:04.868 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:42:04.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:42:04.868 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:42:04.869 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:42:04.869 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:42:04.869 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:42:04.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:42:04.869 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:42:04.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:42:04.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:42:04.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:42:04.870 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:42:04.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:42:04.871 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:42:04.871 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:42:04.873 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:42:05.117 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:42:05.117 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:42:05.118 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:05.118 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:42:05.119 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:42:05.119 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:05.119 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:42:05.120 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:42:05.120 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:42:05.121 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:42:05.121 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:42:05.122 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:42:05.122 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:42:05.123 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:42:05.123 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:42:06.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:05 gibba043 bash[24019]: audit 2021-03-10T16:42:04.627105+0000 mgr.gibba043.dnkmem (mgr.34373) 9025 : audit [DBG] from='client.60088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:06.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:05 gibba043 bash[24019]: cluster 2021-03-10T16:42:04.679385+0000 mgr.gibba043.dnkmem (mgr.34373) 9026 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:06.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:05 gibba043 bash[24019]: audit 2021-03-10T16:42:04.858269+0000 mgr.gibba043.dnkmem (mgr.34373) 9027 : audit [DBG] from='client.50106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:05 gibba043 bash[24019]: audit 2021-03-10T16:42:05.120176+0000 mon.a (mon.0) 1890 : audit [DBG] from='client.? 172.21.2.103:0/3635848521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:06.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[31385]: audit 2021-03-10T16:42:04.627105+0000 mgr.gibba043.dnkmem (mgr.34373) 9025 : audit [DBG] from='client.60088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:06.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[31385]: cluster 2021-03-10T16:42:04.679385+0000 mgr.gibba043.dnkmem (mgr.34373) 9026 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[31385]: audit 2021-03-10T16:42:04.858269+0000 mgr.gibba043.dnkmem (mgr.34373) 9027 : audit [DBG] from='client.50106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[31385]: audit 2021-03-10T16:42:05.120176+0000 mon.a (mon.0) 1890 : audit [DBG] from='client.? 172.21.2.103:0/3635848521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[32348]: audit 2021-03-10T16:42:04.627105+0000 mgr.gibba043.dnkmem (mgr.34373) 9025 : audit [DBG] from='client.60088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[32348]: cluster 2021-03-10T16:42:04.679385+0000 mgr.gibba043.dnkmem (mgr.34373) 9026 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:06.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[32348]: audit 2021-03-10T16:42:04.858269+0000 mgr.gibba043.dnkmem (mgr.34373) 9027 : audit [DBG] from='client.50106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:06.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:05 gibba003 bash[32348]: audit 2021-03-10T16:42:05.120176+0000 mon.a (mon.0) 1890 : audit [DBG] from='client.? 172.21.2.103:0/3635848521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:07 gibba043 bash[24019]: cluster 2021-03-10T16:42:06.680314+0000 mgr.gibba043.dnkmem (mgr.34373) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:07 gibba003 bash[31385]: cluster 2021-03-10T16:42:06.680314+0000 mgr.gibba043.dnkmem (mgr.34373) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:07 gibba003 bash[32348]: cluster 2021-03-10T16:42:06.680314+0000 mgr.gibba043.dnkmem (mgr.34373) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:10.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:09 gibba043 bash[24019]: cluster 2021-03-10T16:42:08.681908+0000 mgr.gibba043.dnkmem (mgr.34373) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:09 gibba003 bash[31385]: cluster 2021-03-10T16:42:08.681908+0000 mgr.gibba043.dnkmem (mgr.34373) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:09 gibba003 bash[32348]: cluster 2021-03-10T16:42:08.681908+0000 mgr.gibba043.dnkmem (mgr.34373) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:11 gibba043 bash[24019]: cluster 2021-03-10T16:42:10.683394+0000 mgr.gibba043.dnkmem (mgr.34373) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:11 gibba003 bash[31385]: cluster 2021-03-10T16:42:10.683394+0000 mgr.gibba043.dnkmem (mgr.34373) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:11 gibba003 bash[32348]: cluster 2021-03-10T16:42:10.683394+0000 mgr.gibba043.dnkmem (mgr.34373) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:14.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:13 gibba043 bash[24019]: cephadm 2021-03-10T16:42:12.128735+0000 mgr.gibba043.dnkmem (mgr.34373) 9031 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:14.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:13 gibba043 bash[24019]: cluster 2021-03-10T16:42:12.684428+0000 mgr.gibba043.dnkmem (mgr.34373) 9032 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:13 gibba003 bash[31385]: cephadm 2021-03-10T16:42:12.128735+0000 mgr.gibba043.dnkmem (mgr.34373) 9031 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:13 gibba003 bash[31385]: cluster 2021-03-10T16:42:12.684428+0000 mgr.gibba043.dnkmem (mgr.34373) 9032 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:13 gibba003 bash[32348]: cephadm 2021-03-10T16:42:12.128735+0000 mgr.gibba043.dnkmem (mgr.34373) 9031 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:13 gibba003 bash[32348]: cluster 2021-03-10T16:42:12.684428+0000 mgr.gibba043.dnkmem (mgr.34373) 9032 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:13.819054+0000 mon.c (mon.1) 2326 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:13.819749+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:15.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.046584+0000 mon.c (mon.1) 2327 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.047674+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.278205+0000 mon.c (mon.1) 2328 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.279123+0000 mon.c (mon.1) 2329 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.279429+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.280093+0000 mon.c (mon.1) 2330 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.280699+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.281182+0000 mon.c (mon.1) 2331 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.281677+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:14 gibba043 bash[24019]: audit 2021-03-10T16:42:14.282806+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:13.819054+0000 mon.c (mon.1) 2326 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:13.819749+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.046584+0000 mon.c (mon.1) 2327 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.047674+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.278205+0000 mon.c (mon.1) 2328 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.279123+0000 mon.c (mon.1) 2329 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.279429+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.280093+0000 mon.c (mon.1) 2330 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.280699+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.281182+0000 mon.c (mon.1) 2331 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.281677+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[31385]: audit 2021-03-10T16:42:14.282806+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:13.819054+0000 mon.c (mon.1) 2326 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:13.819749+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.046584+0000 mon.c (mon.1) 2327 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.047674+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.278205+0000 mon.c (mon.1) 2328 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.279123+0000 mon.c (mon.1) 2329 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.279429+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.280093+0000 mon.c (mon.1) 2330 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.280699+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.281182+0000 mon.c (mon.1) 2331 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.281677+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:42:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:14 gibba003 bash[32348]: audit 2021-03-10T16:42:14.282806+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:42:16.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:15 gibba043 bash[24019]: cluster 2021-03-10T16:42:14.685837+0000 mgr.gibba043.dnkmem (mgr.34373) 9033 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:15 gibba003 bash[31385]: cluster 2021-03-10T16:42:14.685837+0000 mgr.gibba043.dnkmem (mgr.34373) 9033 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:15 gibba003 bash[32348]: cluster 2021-03-10T16:42:14.685837+0000 mgr.gibba043.dnkmem (mgr.34373) 9033 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:17 gibba043 bash[24019]: cluster 2021-03-10T16:42:16.687709+0000 mgr.gibba043.dnkmem (mgr.34373) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:17 gibba003 bash[31385]: cluster 2021-03-10T16:42:16.687709+0000 mgr.gibba043.dnkmem (mgr.34373) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:18.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:17 gibba003 bash[32348]: cluster 2021-03-10T16:42:16.687709+0000 mgr.gibba043.dnkmem (mgr.34373) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:20.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:19 gibba003 bash[31385]: cluster 2021-03-10T16:42:18.688689+0000 mgr.gibba043.dnkmem (mgr.34373) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:20.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:19 gibba003 bash[32348]: cluster 2021-03-10T16:42:18.688689+0000 mgr.gibba043.dnkmem (mgr.34373) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:19 gibba043 bash[24019]: cluster 2021-03-10T16:42:18.688689+0000 mgr.gibba043.dnkmem (mgr.34373) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:22.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:21 gibba003 bash[31385]: cluster 2021-03-10T16:42:20.690154+0000 mgr.gibba043.dnkmem (mgr.34373) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:22.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:21 gibba003 bash[32348]: cluster 2021-03-10T16:42:20.690154+0000 mgr.gibba043.dnkmem (mgr.34373) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:21 gibba043 bash[24019]: cluster 2021-03-10T16:42:20.690154+0000 mgr.gibba043.dnkmem (mgr.34373) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:24.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:23 gibba003 bash[31385]: cluster 2021-03-10T16:42:22.691525+0000 mgr.gibba043.dnkmem (mgr.34373) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:24.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:23 gibba003 bash[32348]: cluster 2021-03-10T16:42:22.691525+0000 mgr.gibba043.dnkmem (mgr.34373) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:23 gibba043 bash[24019]: cluster 2021-03-10T16:42:22.691525+0000 mgr.gibba043.dnkmem (mgr.34373) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:25 gibba003 bash[31385]: cluster 2021-03-10T16:42:24.692724+0000 mgr.gibba043.dnkmem (mgr.34373) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:25 gibba003 bash[32348]: cluster 2021-03-10T16:42:24.692724+0000 mgr.gibba043.dnkmem (mgr.34373) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:25 gibba043 bash[24019]: cluster 2021-03-10T16:42:24.692724+0000 mgr.gibba043.dnkmem (mgr.34373) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:27 gibba003 bash[31385]: cluster 2021-03-10T16:42:26.694460+0000 mgr.gibba043.dnkmem (mgr.34373) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:27 gibba003 bash[32348]: cluster 2021-03-10T16:42:26.694460+0000 mgr.gibba043.dnkmem (mgr.34373) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:27 gibba043 bash[24019]: cluster 2021-03-10T16:42:26.694460+0000 mgr.gibba043.dnkmem (mgr.34373) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:29.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:28 gibba003 bash[31385]: cephadm 2021-03-10T16:42:27.144645+0000 mgr.gibba043.dnkmem (mgr.34373) 9040 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:29.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:28 gibba003 bash[32348]: cephadm 2021-03-10T16:42:27.144645+0000 mgr.gibba043.dnkmem (mgr.34373) 9040 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:29.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:28 gibba043 bash[24019]: cephadm 2021-03-10T16:42:27.144645+0000 mgr.gibba043.dnkmem (mgr.34373) 9040 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:29 gibba003 bash[31385]: cluster 2021-03-10T16:42:28.696062+0000 mgr.gibba043.dnkmem (mgr.34373) 9041 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:29 gibba003 bash[32348]: cluster 2021-03-10T16:42:28.696062+0000 mgr.gibba043.dnkmem (mgr.34373) 9041 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:29 gibba043 bash[24019]: cluster 2021-03-10T16:42:28.696062+0000 mgr.gibba043.dnkmem (mgr.34373) 9041 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:31 gibba003 bash[31385]: cluster 2021-03-10T16:42:30.696925+0000 mgr.gibba043.dnkmem (mgr.34373) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:31 gibba003 bash[32348]: cluster 2021-03-10T16:42:30.696925+0000 mgr.gibba043.dnkmem (mgr.34373) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:31 gibba043 bash[24019]: cluster 2021-03-10T16:42:30.696925+0000 mgr.gibba043.dnkmem (mgr.34373) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:33 gibba003 bash[31385]: cluster 2021-03-10T16:42:32.698370+0000 mgr.gibba043.dnkmem (mgr.34373) 9043 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:33 gibba003 bash[32348]: cluster 2021-03-10T16:42:32.698370+0000 mgr.gibba043.dnkmem (mgr.34373) 9043 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:33 gibba043 bash[24019]: cluster 2021-03-10T16:42:32.698370+0000 mgr.gibba043.dnkmem (mgr.34373) 9043 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:35.359 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:42:35.590 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:42:35.590 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:42:35.591 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:42:35.591 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:42:35.592 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:42:35.592 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:42:35.592 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:42:35.593 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:42:35.593 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:42:35.595 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:42:35.600 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:42:35.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:42:35.601 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:42:35.603 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:42:35.603 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:42:35.604 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:42:35.604 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:42:35.605 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:42:35.605 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:42:35.605 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:42:35.623 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:42:35.838 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:42:35.838 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:42:35.839 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:35.839 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:42:35.839 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:42:35.839 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:35.839 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:42:35.840 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:42:35.840 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:42:35.840 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:42:35.840 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:42:35.841 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:42:35.841 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:42:35.841 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:42:35.841 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:42:36.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:35 gibba003 bash[31385]: cluster 2021-03-10T16:42:34.699936+0000 mgr.gibba043.dnkmem (mgr.34373) 9044 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:36.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:35 gibba003 bash[31385]: audit 2021-03-10T16:42:35.841445+0000 mon.c (mon.1) 2332 : audit [DBG] from='client.? 172.21.2.103:0/3445071705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:35 gibba003 bash[32348]: cluster 2021-03-10T16:42:34.699936+0000 mgr.gibba043.dnkmem (mgr.34373) 9044 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:35 gibba003 bash[32348]: audit 2021-03-10T16:42:35.841445+0000 mon.c (mon.1) 2332 : audit [DBG] from='client.? 172.21.2.103:0/3445071705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:35 gibba043 bash[24019]: cluster 2021-03-10T16:42:34.699936+0000 mgr.gibba043.dnkmem (mgr.34373) 9044 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:36.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:35 gibba043 bash[24019]: audit 2021-03-10T16:42:35.841445+0000 mon.c (mon.1) 2332 : audit [DBG] from='client.? 172.21.2.103:0/3445071705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:37.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:36 gibba003 bash[31385]: audit 2021-03-10T16:42:35.352799+0000 mgr.gibba043.dnkmem (mgr.34373) 9045 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:37.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:36 gibba003 bash[31385]: audit 2021-03-10T16:42:35.579939+0000 mgr.gibba043.dnkmem (mgr.34373) 9046 : audit [DBG] from='client.60112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:37.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:36 gibba003 bash[32348]: audit 2021-03-10T16:42:35.352799+0000 mgr.gibba043.dnkmem (mgr.34373) 9045 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:37.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:36 gibba003 bash[32348]: audit 2021-03-10T16:42:35.579939+0000 mgr.gibba043.dnkmem (mgr.34373) 9046 : audit [DBG] from='client.60112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:37.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:36 gibba043 bash[24019]: audit 2021-03-10T16:42:35.352799+0000 mgr.gibba043.dnkmem (mgr.34373) 9045 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:36 gibba043 bash[24019]: audit 2021-03-10T16:42:35.579939+0000 mgr.gibba043.dnkmem (mgr.34373) 9046 : audit [DBG] from='client.60112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:37 gibba003 bash[31385]: cluster 2021-03-10T16:42:36.700866+0000 mgr.gibba043.dnkmem (mgr.34373) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:37 gibba003 bash[32348]: cluster 2021-03-10T16:42:36.700866+0000 mgr.gibba043.dnkmem (mgr.34373) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:37 gibba043 bash[24019]: cluster 2021-03-10T16:42:36.700866+0000 mgr.gibba043.dnkmem (mgr.34373) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:39 gibba003 bash[31385]: cluster 2021-03-10T16:42:38.702317+0000 mgr.gibba043.dnkmem (mgr.34373) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:39 gibba003 bash[32348]: cluster 2021-03-10T16:42:38.702317+0000 mgr.gibba043.dnkmem (mgr.34373) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:39 gibba043 bash[24019]: cluster 2021-03-10T16:42:38.702317+0000 mgr.gibba043.dnkmem (mgr.34373) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:42.159 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:41 gibba043 bash[24019]: cluster 2021-03-10T16:42:40.704040+0000 mgr.gibba043.dnkmem (mgr.34373) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:42.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:41 gibba003 bash[31385]: cluster 2021-03-10T16:42:40.704040+0000 mgr.gibba043.dnkmem (mgr.34373) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:42.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:41 gibba003 bash[32348]: cluster 2021-03-10T16:42:40.704040+0000 mgr.gibba043.dnkmem (mgr.34373) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:43 gibba003 bash[31385]: cephadm 2021-03-10T16:42:42.160625+0000 mgr.gibba043.dnkmem (mgr.34373) 9050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:44.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:43 gibba003 bash[31385]: cluster 2021-03-10T16:42:42.705270+0000 mgr.gibba043.dnkmem (mgr.34373) 9051 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:43 gibba003 bash[32348]: cephadm 2021-03-10T16:42:42.160625+0000 mgr.gibba043.dnkmem (mgr.34373) 9050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:44.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:43 gibba003 bash[32348]: cluster 2021-03-10T16:42:42.705270+0000 mgr.gibba043.dnkmem (mgr.34373) 9051 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:43 gibba043 bash[24019]: cephadm 2021-03-10T16:42:42.160625+0000 mgr.gibba043.dnkmem (mgr.34373) 9050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:43 gibba043 bash[24019]: cluster 2021-03-10T16:42:42.705270+0000 mgr.gibba043.dnkmem (mgr.34373) 9051 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:45 gibba003 bash[31385]: cluster 2021-03-10T16:42:44.706609+0000 mgr.gibba043.dnkmem (mgr.34373) 9052 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:45 gibba003 bash[32348]: cluster 2021-03-10T16:42:44.706609+0000 mgr.gibba043.dnkmem (mgr.34373) 9052 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:45 gibba043 bash[24019]: cluster 2021-03-10T16:42:44.706609+0000 mgr.gibba043.dnkmem (mgr.34373) 9052 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:47 gibba003 bash[31385]: cluster 2021-03-10T16:42:46.708305+0000 mgr.gibba043.dnkmem (mgr.34373) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:47 gibba003 bash[32348]: cluster 2021-03-10T16:42:46.708305+0000 mgr.gibba043.dnkmem (mgr.34373) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:47 gibba043 bash[24019]: cluster 2021-03-10T16:42:46.708305+0000 mgr.gibba043.dnkmem (mgr.34373) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:50.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:49 gibba003 bash[31385]: cluster 2021-03-10T16:42:48.709515+0000 mgr.gibba043.dnkmem (mgr.34373) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:50.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:49 gibba003 bash[32348]: cluster 2021-03-10T16:42:48.709515+0000 mgr.gibba043.dnkmem (mgr.34373) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:49 gibba043 bash[24019]: cluster 2021-03-10T16:42:48.709515+0000 mgr.gibba043.dnkmem (mgr.34373) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:51 gibba003 bash[31385]: cluster 2021-03-10T16:42:50.711319+0000 mgr.gibba043.dnkmem (mgr.34373) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:51 gibba003 bash[32348]: cluster 2021-03-10T16:42:50.711319+0000 mgr.gibba043.dnkmem (mgr.34373) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:51 gibba043 bash[24019]: cluster 2021-03-10T16:42:50.711319+0000 mgr.gibba043.dnkmem (mgr.34373) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:53 gibba003 bash[31385]: cluster 2021-03-10T16:42:52.712981+0000 mgr.gibba043.dnkmem (mgr.34373) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:53 gibba003 bash[32348]: cluster 2021-03-10T16:42:52.712981+0000 mgr.gibba043.dnkmem (mgr.34373) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:53 gibba043 bash[24019]: cluster 2021-03-10T16:42:52.712981+0000 mgr.gibba043.dnkmem (mgr.34373) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:55 gibba043 bash[24019]: cluster 2021-03-10T16:42:54.714646+0000 mgr.gibba043.dnkmem (mgr.34373) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:56.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:55 gibba003 bash[31385]: cluster 2021-03-10T16:42:54.714646+0000 mgr.gibba043.dnkmem (mgr.34373) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:56.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:55 gibba003 bash[32348]: cluster 2021-03-10T16:42:54.714646+0000 mgr.gibba043.dnkmem (mgr.34373) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:58.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: cluster 2021-03-10T16:42:56.716192+0000 mgr.gibba043.dnkmem (mgr.34373) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:58.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.375639+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:42:58.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.379504+0000 mon.c (mon.1) 2333 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.381278+0000 mon.c (mon.1) 2334 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.383137+0000 mon.c (mon.1) 2335 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.384730+0000 mon.c (mon.1) 2336 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.388322+0000 mon.c (mon.1) 2337 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:57 gibba043 bash[24019]: audit 2021-03-10T16:42:57.390256+0000 mon.c (mon.1) 2338 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: cluster 2021-03-10T16:42:56.716192+0000 mgr.gibba043.dnkmem (mgr.34373) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.375639+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:42:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.379504+0000 mon.c (mon.1) 2333 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.381278+0000 mon.c (mon.1) 2334 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.383137+0000 mon.c (mon.1) 2335 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.384730+0000 mon.c (mon.1) 2336 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.388322+0000 mon.c (mon.1) 2337 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[31385]: audit 2021-03-10T16:42:57.390256+0000 mon.c (mon.1) 2338 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: cluster 2021-03-10T16:42:56.716192+0000 mgr.gibba043.dnkmem (mgr.34373) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.375639+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:42:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.379504+0000 mon.c (mon.1) 2333 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.381278+0000 mon.c (mon.1) 2334 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.383137+0000 mon.c (mon.1) 2335 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.384730+0000 mon.c (mon.1) 2336 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.388322+0000 mon.c (mon.1) 2337 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:57 gibba003 bash[32348]: audit 2021-03-10T16:42:57.390256+0000 mon.c (mon.1) 2338 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.177471+0000 mgr.gibba043.dnkmem (mgr.34373) 9059 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:42:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.178766+0000 mgr.gibba043.dnkmem (mgr.34373) 9060 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:42:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.377168+0000 mgr.gibba043.dnkmem (mgr.34373) 9061 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.379166+0000 mgr.gibba043.dnkmem (mgr.34373) 9062 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.380842+0000 mgr.gibba043.dnkmem (mgr.34373) 9063 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.380934+0000 mgr.gibba043.dnkmem (mgr.34373) 9064 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.382644+0000 mgr.gibba043.dnkmem (mgr.34373) 9065 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.382718+0000 mgr.gibba043.dnkmem (mgr.34373) 9066 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.384119+0000 mgr.gibba043.dnkmem (mgr.34373) 9067 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.386033+0000 mgr.gibba043.dnkmem (mgr.34373) 9068 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.386172+0000 mgr.gibba043.dnkmem (mgr.34373) 9069 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.387851+0000 mgr.gibba043.dnkmem (mgr.34373) 9070 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.388228+0000 mgr.gibba043.dnkmem (mgr.34373) 9071 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.389438+0000 mgr.gibba043.dnkmem (mgr.34373) 9072 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.389502+0000 mgr.gibba043.dnkmem (mgr.34373) 9073 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:58 gibba043 bash[24019]: cephadm 2021-03-10T16:42:57.389632+0000 mgr.gibba043.dnkmem (mgr.34373) 9074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:59.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.177471+0000 mgr.gibba043.dnkmem (mgr.34373) 9059 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:42:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.178766+0000 mgr.gibba043.dnkmem (mgr.34373) 9060 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:42:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.377168+0000 mgr.gibba043.dnkmem (mgr.34373) 9061 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.379166+0000 mgr.gibba043.dnkmem (mgr.34373) 9062 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.380842+0000 mgr.gibba043.dnkmem (mgr.34373) 9063 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.380934+0000 mgr.gibba043.dnkmem (mgr.34373) 9064 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.382644+0000 mgr.gibba043.dnkmem (mgr.34373) 9065 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.382718+0000 mgr.gibba043.dnkmem (mgr.34373) 9066 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.384119+0000 mgr.gibba043.dnkmem (mgr.34373) 9067 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.386033+0000 mgr.gibba043.dnkmem (mgr.34373) 9068 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.386172+0000 mgr.gibba043.dnkmem (mgr.34373) 9069 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.387851+0000 mgr.gibba043.dnkmem (mgr.34373) 9070 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.388228+0000 mgr.gibba043.dnkmem (mgr.34373) 9071 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.389438+0000 mgr.gibba043.dnkmem (mgr.34373) 9072 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.389502+0000 mgr.gibba043.dnkmem (mgr.34373) 9073 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[31385]: cephadm 2021-03-10T16:42:57.389632+0000 mgr.gibba043.dnkmem (mgr.34373) 9074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:42:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.177471+0000 mgr.gibba043.dnkmem (mgr.34373) 9059 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:42:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.178766+0000 mgr.gibba043.dnkmem (mgr.34373) 9060 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:42:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.377168+0000 mgr.gibba043.dnkmem (mgr.34373) 9061 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.379166+0000 mgr.gibba043.dnkmem (mgr.34373) 9062 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.380842+0000 mgr.gibba043.dnkmem (mgr.34373) 9063 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.380934+0000 mgr.gibba043.dnkmem (mgr.34373) 9064 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.382644+0000 mgr.gibba043.dnkmem (mgr.34373) 9065 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.382718+0000 mgr.gibba043.dnkmem (mgr.34373) 9066 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.384119+0000 mgr.gibba043.dnkmem (mgr.34373) 9067 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.386033+0000 mgr.gibba043.dnkmem (mgr.34373) 9068 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.386172+0000 mgr.gibba043.dnkmem (mgr.34373) 9069 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.387851+0000 mgr.gibba043.dnkmem (mgr.34373) 9070 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.388228+0000 mgr.gibba043.dnkmem (mgr.34373) 9071 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.389438+0000 mgr.gibba043.dnkmem (mgr.34373) 9072 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.389502+0000 mgr.gibba043.dnkmem (mgr.34373) 9073 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:58 gibba003 bash[32348]: cephadm 2021-03-10T16:42:57.389632+0000 mgr.gibba043.dnkmem (mgr.34373) 9074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:00.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:42:59 gibba043 bash[24019]: cluster 2021-03-10T16:42:58.717886+0000 mgr.gibba043.dnkmem (mgr.34373) 9075 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:00.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:42:59 gibba003 bash[31385]: cluster 2021-03-10T16:42:58.717886+0000 mgr.gibba043.dnkmem (mgr.34373) 9075 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:00.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:42:59 gibba003 bash[32348]: cluster 2021-03-10T16:42:58.717886+0000 mgr.gibba043.dnkmem (mgr.34373) 9075 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:02.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:01 gibba043 bash[24019]: cluster 2021-03-10T16:43:00.719466+0000 mgr.gibba043.dnkmem (mgr.34373) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:02.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:01 gibba003 bash[31385]: cluster 2021-03-10T16:43:00.719466+0000 mgr.gibba043.dnkmem (mgr.34373) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:02.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:01 gibba003 bash[32348]: cluster 2021-03-10T16:43:00.719466+0000 mgr.gibba043.dnkmem (mgr.34373) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:04.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:03 gibba043 bash[24019]: cluster 2021-03-10T16:43:02.720888+0000 mgr.gibba043.dnkmem (mgr.34373) 9077 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:04.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:03 gibba003 bash[31385]: cluster 2021-03-10T16:43:02.720888+0000 mgr.gibba043.dnkmem (mgr.34373) 9077 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:03 gibba003 bash[32348]: cluster 2021-03-10T16:43:02.720888+0000 mgr.gibba043.dnkmem (mgr.34373) 9077 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:06.089 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:43:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:05 gibba003 bash[31385]: cluster 2021-03-10T16:43:04.722530+0000 mgr.gibba043.dnkmem (mgr.34373) 9078 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:06.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:05 gibba003 bash[32348]: cluster 2021-03-10T16:43:04.722530+0000 mgr.gibba043.dnkmem (mgr.34373) 9078 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:05 gibba043 bash[24019]: cluster 2021-03-10T16:43:04.722530+0000 mgr.gibba043.dnkmem (mgr.34373) 9078 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:06.321 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:43:06.322 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:43:06.322 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:43:06.322 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:43:06.322 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:43:06.323 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:43:06.323 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:43:06.323 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:43:06.323 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:43:06.323 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:43:06.324 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:43:06.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:43:06.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:43:06.324 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:43:06.325 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:43:06.326 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:43:06.328 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:43:06.328 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:43:06.329 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:43:06.329 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:43:06.329 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:43:06.581 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:43:06.581 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:43:06.581 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:06.582 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:43:06.582 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:43:06.582 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:06.582 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:43:06.583 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:43:06.583 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:43:06.583 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:43:06.583 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:43:06.583 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:43:06.584 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:43:06.584 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:43:06.584 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:43:07.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:06 gibba003 bash[31385]: audit 2021-03-10T16:43:06.073128+0000 mgr.gibba043.dnkmem (mgr.34373) 9079 : audit [DBG] from='client.60124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:07.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:06 gibba003 bash[31385]: audit 2021-03-10T16:43:06.584902+0000 mon.a (mon.0) 1898 : audit [DBG] from='client.? 172.21.2.103:0/2775820126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:07.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:06 gibba003 bash[32348]: audit 2021-03-10T16:43:06.073128+0000 mgr.gibba043.dnkmem (mgr.34373) 9079 : audit [DBG] from='client.60124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:07.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:06 gibba003 bash[32348]: audit 2021-03-10T16:43:06.584902+0000 mon.a (mon.0) 1898 : audit [DBG] from='client.? 172.21.2.103:0/2775820126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:07.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:06 gibba043 bash[24019]: audit 2021-03-10T16:43:06.073128+0000 mgr.gibba043.dnkmem (mgr.34373) 9079 : audit [DBG] from='client.60124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:07.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:06 gibba043 bash[24019]: audit 2021-03-10T16:43:06.584902+0000 mon.a (mon.0) 1898 : audit [DBG] from='client.? 172.21.2.103:0/2775820126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:07 gibba003 bash[31385]: audit 2021-03-10T16:43:06.311620+0000 mgr.gibba043.dnkmem (mgr.34373) 9080 : audit [DBG] from='client.60130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:08.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:07 gibba003 bash[31385]: cluster 2021-03-10T16:43:06.724070+0000 mgr.gibba043.dnkmem (mgr.34373) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:07 gibba003 bash[32348]: audit 2021-03-10T16:43:06.311620+0000 mgr.gibba043.dnkmem (mgr.34373) 9080 : audit [DBG] from='client.60130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:07 gibba003 bash[32348]: cluster 2021-03-10T16:43:06.724070+0000 mgr.gibba043.dnkmem (mgr.34373) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:07 gibba043 bash[24019]: audit 2021-03-10T16:43:06.311620+0000 mgr.gibba043.dnkmem (mgr.34373) 9080 : audit [DBG] from='client.60130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:08.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:07 gibba043 bash[24019]: cluster 2021-03-10T16:43:06.724070+0000 mgr.gibba043.dnkmem (mgr.34373) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:09 gibba003 bash[31385]: cluster 2021-03-10T16:43:08.725557+0000 mgr.gibba043.dnkmem (mgr.34373) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:09 gibba003 bash[32348]: cluster 2021-03-10T16:43:08.725557+0000 mgr.gibba043.dnkmem (mgr.34373) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:10.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:09 gibba043 bash[24019]: cluster 2021-03-10T16:43:08.725557+0000 mgr.gibba043.dnkmem (mgr.34373) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:11 gibba003 bash[31385]: cluster 2021-03-10T16:43:10.727100+0000 mgr.gibba043.dnkmem (mgr.34373) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:11 gibba003 bash[32348]: cluster 2021-03-10T16:43:10.727100+0000 mgr.gibba043.dnkmem (mgr.34373) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:11 gibba043 bash[24019]: cluster 2021-03-10T16:43:10.727100+0000 mgr.gibba043.dnkmem (mgr.34373) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:13 gibba003 bash[31385]: cephadm 2021-03-10T16:43:12.405738+0000 mgr.gibba043.dnkmem (mgr.34373) 9084 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:13 gibba003 bash[31385]: cluster 2021-03-10T16:43:12.728491+0000 mgr.gibba043.dnkmem (mgr.34373) 9085 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:13 gibba003 bash[32348]: cephadm 2021-03-10T16:43:12.405738+0000 mgr.gibba043.dnkmem (mgr.34373) 9084 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:13 gibba003 bash[32348]: cluster 2021-03-10T16:43:12.728491+0000 mgr.gibba043.dnkmem (mgr.34373) 9085 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:13 gibba043 bash[24019]: cephadm 2021-03-10T16:43:12.405738+0000 mgr.gibba043.dnkmem (mgr.34373) 9084 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:13 gibba043 bash[24019]: cluster 2021-03-10T16:43:12.728491+0000 mgr.gibba043.dnkmem (mgr.34373) 9085 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:13.823400+0000 mon.c (mon.1) 2339 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:13.823769+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.054691+0000 mon.c (mon.1) 2340 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.055944+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.288564+0000 mon.c (mon.1) 2341 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:43:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.289317+0000 mon.c (mon.1) 2342 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:43:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.289764+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:43:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.290052+0000 mon.c (mon.1) 2343 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.290912+0000 mon.c (mon.1) 2344 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.291044+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:43:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.292376+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[31385]: audit 2021-03-10T16:43:14.293311+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:13.823400+0000 mon.c (mon.1) 2339 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:13.823769+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.054691+0000 mon.c (mon.1) 2340 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.055944+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.288564+0000 mon.c (mon.1) 2341 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:43:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.289317+0000 mon.c (mon.1) 2342 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:43:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.289764+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:43:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.290052+0000 mon.c (mon.1) 2343 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.290912+0000 mon.c (mon.1) 2344 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.291044+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:43:15.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.292376+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:14 gibba003 bash[32348]: audit 2021-03-10T16:43:14.293311+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:13.823400+0000 mon.c (mon.1) 2339 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:13.823769+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.054691+0000 mon.c (mon.1) 2340 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.055944+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.288564+0000 mon.c (mon.1) 2341 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:43:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.289317+0000 mon.c (mon.1) 2342 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:43:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.289764+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:43:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.290052+0000 mon.c (mon.1) 2343 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.290912+0000 mon.c (mon.1) 2344 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.291044+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:43:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.292376+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:43:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:14 gibba043 bash[24019]: audit 2021-03-10T16:43:14.293311+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:15 gibba003 bash[31385]: cluster 2021-03-10T16:43:14.729919+0000 mgr.gibba043.dnkmem (mgr.34373) 9086 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:15 gibba003 bash[32348]: cluster 2021-03-10T16:43:14.729919+0000 mgr.gibba043.dnkmem (mgr.34373) 9086 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:15 gibba043 bash[24019]: cluster 2021-03-10T16:43:14.729919+0000 mgr.gibba043.dnkmem (mgr.34373) 9086 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:17 gibba043 bash[24019]: cluster 2021-03-10T16:43:16.731214+0000 mgr.gibba043.dnkmem (mgr.34373) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:17 gibba003 bash[31385]: cluster 2021-03-10T16:43:16.731214+0000 mgr.gibba043.dnkmem (mgr.34373) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:18.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:17 gibba003 bash[32348]: cluster 2021-03-10T16:43:16.731214+0000 mgr.gibba043.dnkmem (mgr.34373) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:20.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:19 gibba043 bash[24019]: cluster 2021-03-10T16:43:18.732438+0000 mgr.gibba043.dnkmem (mgr.34373) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:19 gibba003 bash[31385]: cluster 2021-03-10T16:43:18.732438+0000 mgr.gibba043.dnkmem (mgr.34373) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:19 gibba003 bash[32348]: cluster 2021-03-10T16:43:18.732438+0000 mgr.gibba043.dnkmem (mgr.34373) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:22.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:21 gibba043 bash[24019]: cluster 2021-03-10T16:43:20.734008+0000 mgr.gibba043.dnkmem (mgr.34373) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:21 gibba003 bash[31385]: cluster 2021-03-10T16:43:20.734008+0000 mgr.gibba043.dnkmem (mgr.34373) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:22.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:21 gibba003 bash[32348]: cluster 2021-03-10T16:43:20.734008+0000 mgr.gibba043.dnkmem (mgr.34373) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:24.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:23 gibba043 bash[24019]: cluster 2021-03-10T16:43:22.735397+0000 mgr.gibba043.dnkmem (mgr.34373) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:23 gibba003 bash[31385]: cluster 2021-03-10T16:43:22.735397+0000 mgr.gibba043.dnkmem (mgr.34373) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:24.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:23 gibba003 bash[32348]: cluster 2021-03-10T16:43:22.735397+0000 mgr.gibba043.dnkmem (mgr.34373) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:25 gibba003 bash[31385]: cluster 2021-03-10T16:43:24.736934+0000 mgr.gibba043.dnkmem (mgr.34373) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:25 gibba003 bash[32348]: cluster 2021-03-10T16:43:24.736934+0000 mgr.gibba043.dnkmem (mgr.34373) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:25 gibba043 bash[24019]: cluster 2021-03-10T16:43:24.736934+0000 mgr.gibba043.dnkmem (mgr.34373) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:27 gibba043 bash[24019]: cluster 2021-03-10T16:43:26.738292+0000 mgr.gibba043.dnkmem (mgr.34373) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:27 gibba003 bash[31385]: cluster 2021-03-10T16:43:26.738292+0000 mgr.gibba043.dnkmem (mgr.34373) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:27 gibba003 bash[32348]: cluster 2021-03-10T16:43:26.738292+0000 mgr.gibba043.dnkmem (mgr.34373) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:29.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:28 gibba043 bash[24019]: cephadm 2021-03-10T16:43:27.421742+0000 mgr.gibba043.dnkmem (mgr.34373) 9093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:29.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:28 gibba003 bash[31385]: cephadm 2021-03-10T16:43:27.421742+0000 mgr.gibba043.dnkmem (mgr.34373) 9093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:29.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:28 gibba003 bash[32348]: cephadm 2021-03-10T16:43:27.421742+0000 mgr.gibba043.dnkmem (mgr.34373) 9093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:30.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:29 gibba043 bash[24019]: cluster 2021-03-10T16:43:28.740004+0000 mgr.gibba043.dnkmem (mgr.34373) 9094 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:29 gibba003 bash[31385]: cluster 2021-03-10T16:43:28.740004+0000 mgr.gibba043.dnkmem (mgr.34373) 9094 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:29 gibba003 bash[32348]: cluster 2021-03-10T16:43:28.740004+0000 mgr.gibba043.dnkmem (mgr.34373) 9094 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:31 gibba003 bash[31385]: cluster 2021-03-10T16:43:30.741715+0000 mgr.gibba043.dnkmem (mgr.34373) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:31 gibba003 bash[32348]: cluster 2021-03-10T16:43:30.741715+0000 mgr.gibba043.dnkmem (mgr.34373) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:31 gibba043 bash[24019]: cluster 2021-03-10T16:43:30.741715+0000 mgr.gibba043.dnkmem (mgr.34373) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:33 gibba003 bash[31385]: cluster 2021-03-10T16:43:32.743118+0000 mgr.gibba043.dnkmem (mgr.34373) 9096 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:33 gibba003 bash[32348]: cluster 2021-03-10T16:43:32.743118+0000 mgr.gibba043.dnkmem (mgr.34373) 9096 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:33 gibba043 bash[24019]: cluster 2021-03-10T16:43:32.743118+0000 mgr.gibba043.dnkmem (mgr.34373) 9096 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:35 gibba003 bash[31385]: cluster 2021-03-10T16:43:34.744674+0000 mgr.gibba043.dnkmem (mgr.34373) 9097 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:35 gibba003 bash[32348]: cluster 2021-03-10T16:43:34.744674+0000 mgr.gibba043.dnkmem (mgr.34373) 9097 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:35 gibba043 bash[24019]: cluster 2021-03-10T16:43:34.744674+0000 mgr.gibba043.dnkmem (mgr.34373) 9097 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:36.828 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:43:37.055 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:43:37.055 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:43:37.056 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:43:37.056 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:43:37.056 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:43:37.056 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:43:37.057 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:43:37.057 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:43:37.057 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:43:37.057 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:43:37.058 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:43:37.058 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:43:37.058 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:43:37.058 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:43:37.058 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:43:37.059 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:43:37.059 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:43:37.059 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:43:37.059 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:43:37.060 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:43:37.060 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:43:37.303 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:43:37.303 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:43:37.304 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:37.304 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:43:37.304 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:43:37.304 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:37.304 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:43:37.305 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:43:37.305 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:43:37.305 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:43:37.305 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:43:37.306 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:43:37.306 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:43:37.306 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:43:37.307 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:43:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:37 gibba043 bash[24019]: cluster 2021-03-10T16:43:36.746201+0000 mgr.gibba043.dnkmem (mgr.34373) 9098 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:38.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:37 gibba043 bash[24019]: audit 2021-03-10T16:43:36.821943+0000 mgr.gibba043.dnkmem (mgr.34373) 9099 : audit [DBG] from='client.50151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:37 gibba043 bash[24019]: audit 2021-03-10T16:43:37.045563+0000 mgr.gibba043.dnkmem (mgr.34373) 9100 : audit [DBG] from='client.50157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:38.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:37 gibba043 bash[24019]: audit 2021-03-10T16:43:37.306492+0000 mon.a (mon.0) 1905 : audit [DBG] from='client.? 172.21.2.103:0/173755529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[31385]: cluster 2021-03-10T16:43:36.746201+0000 mgr.gibba043.dnkmem (mgr.34373) 9098 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[31385]: audit 2021-03-10T16:43:36.821943+0000 mgr.gibba043.dnkmem (mgr.34373) 9099 : audit [DBG] from='client.50151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:38.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[31385]: audit 2021-03-10T16:43:37.045563+0000 mgr.gibba043.dnkmem (mgr.34373) 9100 : audit [DBG] from='client.50157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:38.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[31385]: audit 2021-03-10T16:43:37.306492+0000 mon.a (mon.0) 1905 : audit [DBG] from='client.? 172.21.2.103:0/173755529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[32348]: cluster 2021-03-10T16:43:36.746201+0000 mgr.gibba043.dnkmem (mgr.34373) 9098 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:38.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[32348]: audit 2021-03-10T16:43:36.821943+0000 mgr.gibba043.dnkmem (mgr.34373) 9099 : audit [DBG] from='client.50151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:38.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[32348]: audit 2021-03-10T16:43:37.045563+0000 mgr.gibba043.dnkmem (mgr.34373) 9100 : audit [DBG] from='client.50157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:38.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:37 gibba003 bash[32348]: audit 2021-03-10T16:43:37.306492+0000 mon.a (mon.0) 1905 : audit [DBG] from='client.? 172.21.2.103:0/173755529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:39 gibba003 bash[31385]: cluster 2021-03-10T16:43:38.747781+0000 mgr.gibba043.dnkmem (mgr.34373) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:39 gibba003 bash[32348]: cluster 2021-03-10T16:43:38.747781+0000 mgr.gibba043.dnkmem (mgr.34373) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:39 gibba043 bash[24019]: cluster 2021-03-10T16:43:38.747781+0000 mgr.gibba043.dnkmem (mgr.34373) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:41 gibba003 bash[31385]: cluster 2021-03-10T16:43:40.749500+0000 mgr.gibba043.dnkmem (mgr.34373) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:41 gibba003 bash[32348]: cluster 2021-03-10T16:43:40.749500+0000 mgr.gibba043.dnkmem (mgr.34373) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:42.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:41 gibba043 bash[24019]: cluster 2021-03-10T16:43:40.749500+0000 mgr.gibba043.dnkmem (mgr.34373) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:43 gibba003 bash[31385]: cephadm 2021-03-10T16:43:42.437801+0000 mgr.gibba043.dnkmem (mgr.34373) 9103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:43 gibba003 bash[31385]: cluster 2021-03-10T16:43:42.751005+0000 mgr.gibba043.dnkmem (mgr.34373) 9104 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:43 gibba003 bash[32348]: cephadm 2021-03-10T16:43:42.437801+0000 mgr.gibba043.dnkmem (mgr.34373) 9103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:43 gibba003 bash[32348]: cluster 2021-03-10T16:43:42.751005+0000 mgr.gibba043.dnkmem (mgr.34373) 9104 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:43 gibba043 bash[24019]: cephadm 2021-03-10T16:43:42.437801+0000 mgr.gibba043.dnkmem (mgr.34373) 9103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:43 gibba043 bash[24019]: cluster 2021-03-10T16:43:42.751005+0000 mgr.gibba043.dnkmem (mgr.34373) 9104 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:45 gibba003 bash[31385]: cluster 2021-03-10T16:43:44.752702+0000 mgr.gibba043.dnkmem (mgr.34373) 9105 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:46.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:45 gibba003 bash[32348]: cluster 2021-03-10T16:43:44.752702+0000 mgr.gibba043.dnkmem (mgr.34373) 9105 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:45 gibba043 bash[24019]: cluster 2021-03-10T16:43:44.752702+0000 mgr.gibba043.dnkmem (mgr.34373) 9105 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:48.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:47 gibba043 bash[24019]: cluster 2021-03-10T16:43:46.753461+0000 mgr.gibba043.dnkmem (mgr.34373) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:47 gibba003 bash[31385]: cluster 2021-03-10T16:43:46.753461+0000 mgr.gibba043.dnkmem (mgr.34373) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:47 gibba003 bash[32348]: cluster 2021-03-10T16:43:46.753461+0000 mgr.gibba043.dnkmem (mgr.34373) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:50.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:49 gibba003 bash[31385]: cluster 2021-03-10T16:43:48.755026+0000 mgr.gibba043.dnkmem (mgr.34373) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:49 gibba003 bash[32348]: cluster 2021-03-10T16:43:48.755026+0000 mgr.gibba043.dnkmem (mgr.34373) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:49 gibba043 bash[24019]: cluster 2021-03-10T16:43:48.755026+0000 mgr.gibba043.dnkmem (mgr.34373) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:51 gibba003 bash[31385]: cluster 2021-03-10T16:43:50.756454+0000 mgr.gibba043.dnkmem (mgr.34373) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:51 gibba003 bash[32348]: cluster 2021-03-10T16:43:50.756454+0000 mgr.gibba043.dnkmem (mgr.34373) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:51 gibba043 bash[24019]: cluster 2021-03-10T16:43:50.756454+0000 mgr.gibba043.dnkmem (mgr.34373) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:54.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:53 gibba003 bash[31385]: cluster 2021-03-10T16:43:52.757639+0000 mgr.gibba043.dnkmem (mgr.34373) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:53 gibba003 bash[32348]: cluster 2021-03-10T16:43:52.757639+0000 mgr.gibba043.dnkmem (mgr.34373) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:53 gibba043 bash[24019]: cluster 2021-03-10T16:43:52.757639+0000 mgr.gibba043.dnkmem (mgr.34373) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:56.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:55 gibba003 bash[31385]: cluster 2021-03-10T16:43:54.759283+0000 mgr.gibba043.dnkmem (mgr.34373) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:56.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:55 gibba003 bash[32348]: cluster 2021-03-10T16:43:54.759283+0000 mgr.gibba043.dnkmem (mgr.34373) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:55 gibba043 bash[24019]: cluster 2021-03-10T16:43:54.759283+0000 mgr.gibba043.dnkmem (mgr.34373) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: cluster 2021-03-10T16:43:56.759979+0000 mgr.gibba043.dnkmem (mgr.34373) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.669315+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:43:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.672907+0000 mon.c (mon.1) 2345 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.674324+0000 mon.c (mon.1) 2346 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.675955+0000 mon.c (mon.1) 2347 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.677249+0000 mon.c (mon.1) 2348 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.683041+0000 mon.c (mon.1) 2349 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:57 gibba043 bash[24019]: audit 2021-03-10T16:43:57.686061+0000 mon.c (mon.1) 2350 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: cluster 2021-03-10T16:43:56.759979+0000 mgr.gibba043.dnkmem (mgr.34373) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.669315+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:43:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.672907+0000 mon.c (mon.1) 2345 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.674324+0000 mon.c (mon.1) 2346 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.675955+0000 mon.c (mon.1) 2347 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.677249+0000 mon.c (mon.1) 2348 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.683041+0000 mon.c (mon.1) 2349 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[31385]: audit 2021-03-10T16:43:57.686061+0000 mon.c (mon.1) 2350 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: cluster 2021-03-10T16:43:56.759979+0000 mgr.gibba043.dnkmem (mgr.34373) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.669315+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:43:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.672907+0000 mon.c (mon.1) 2345 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.674324+0000 mon.c (mon.1) 2346 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.675955+0000 mon.c (mon.1) 2347 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.677249+0000 mon.c (mon.1) 2348 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.683041+0000 mon.c (mon.1) 2349 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:57 gibba003 bash[32348]: audit 2021-03-10T16:43:57.686061+0000 mon.c (mon.1) 2350 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.454564+0000 mgr.gibba043.dnkmem (mgr.34373) 9112 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:43:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.455941+0000 mgr.gibba043.dnkmem (mgr.34373) 9113 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:43:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.670599+0000 mgr.gibba043.dnkmem (mgr.34373) 9114 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:59.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.672304+0000 mgr.gibba043.dnkmem (mgr.34373) 9115 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.673828+0000 mgr.gibba043.dnkmem (mgr.34373) 9116 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.673867+0000 mgr.gibba043.dnkmem (mgr.34373) 9117 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.675204+0000 mgr.gibba043.dnkmem (mgr.34373) 9118 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:59.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.675241+0000 mgr.gibba043.dnkmem (mgr.34373) 9119 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.676660+0000 mgr.gibba043.dnkmem (mgr.34373) 9120 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.680586+0000 mgr.gibba043.dnkmem (mgr.34373) 9121 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.680631+0000 mgr.gibba043.dnkmem (mgr.34373) 9122 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.683394+0000 mgr.gibba043.dnkmem (mgr.34373) 9123 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.683879+0000 mgr.gibba043.dnkmem (mgr.34373) 9124 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.686177+0000 mgr.gibba043.dnkmem (mgr.34373) 9125 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.686226+0000 mgr.gibba043.dnkmem (mgr.34373) 9126 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:58 gibba043 bash[24019]: cephadm 2021-03-10T16:43:57.686364+0000 mgr.gibba043.dnkmem (mgr.34373) 9127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:59.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.454564+0000 mgr.gibba043.dnkmem (mgr.34373) 9112 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:43:59.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.455941+0000 mgr.gibba043.dnkmem (mgr.34373) 9113 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:43:59.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.670599+0000 mgr.gibba043.dnkmem (mgr.34373) 9114 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.672304+0000 mgr.gibba043.dnkmem (mgr.34373) 9115 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.673828+0000 mgr.gibba043.dnkmem (mgr.34373) 9116 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.673867+0000 mgr.gibba043.dnkmem (mgr.34373) 9117 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:59.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.675204+0000 mgr.gibba043.dnkmem (mgr.34373) 9118 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.675241+0000 mgr.gibba043.dnkmem (mgr.34373) 9119 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.676660+0000 mgr.gibba043.dnkmem (mgr.34373) 9120 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.680586+0000 mgr.gibba043.dnkmem (mgr.34373) 9121 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.680631+0000 mgr.gibba043.dnkmem (mgr.34373) 9122 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.683394+0000 mgr.gibba043.dnkmem (mgr.34373) 9123 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.683879+0000 mgr.gibba043.dnkmem (mgr.34373) 9124 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.686177+0000 mgr.gibba043.dnkmem (mgr.34373) 9125 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.686226+0000 mgr.gibba043.dnkmem (mgr.34373) 9126 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[31385]: cephadm 2021-03-10T16:43:57.686364+0000 mgr.gibba043.dnkmem (mgr.34373) 9127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:43:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.454564+0000 mgr.gibba043.dnkmem (mgr.34373) 9112 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:43:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.455941+0000 mgr.gibba043.dnkmem (mgr.34373) 9113 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:43:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.670599+0000 mgr.gibba043.dnkmem (mgr.34373) 9114 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.672304+0000 mgr.gibba043.dnkmem (mgr.34373) 9115 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.673828+0000 mgr.gibba043.dnkmem (mgr.34373) 9116 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.673867+0000 mgr.gibba043.dnkmem (mgr.34373) 9117 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.675204+0000 mgr.gibba043.dnkmem (mgr.34373) 9118 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.675241+0000 mgr.gibba043.dnkmem (mgr.34373) 9119 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:59.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.676660+0000 mgr.gibba043.dnkmem (mgr.34373) 9120 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:59.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.680586+0000 mgr.gibba043.dnkmem (mgr.34373) 9121 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:59.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.680631+0000 mgr.gibba043.dnkmem (mgr.34373) 9122 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:59.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.683394+0000 mgr.gibba043.dnkmem (mgr.34373) 9123 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.683879+0000 mgr.gibba043.dnkmem (mgr.34373) 9124 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.686177+0000 mgr.gibba043.dnkmem (mgr.34373) 9125 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.686226+0000 mgr.gibba043.dnkmem (mgr.34373) 9126 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:58 gibba003 bash[32348]: cephadm 2021-03-10T16:43:57.686364+0000 mgr.gibba043.dnkmem (mgr.34373) 9127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:00.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:43:59 gibba003 bash[31385]: cluster 2021-03-10T16:43:58.761290+0000 mgr.gibba043.dnkmem (mgr.34373) 9128 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:00.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:43:59 gibba003 bash[32348]: cluster 2021-03-10T16:43:58.761290+0000 mgr.gibba043.dnkmem (mgr.34373) 9128 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:43:59 gibba043 bash[24019]: cluster 2021-03-10T16:43:58.761290+0000 mgr.gibba043.dnkmem (mgr.34373) 9128 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:02.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:01 gibba003 bash[31385]: cluster 2021-03-10T16:44:00.762824+0000 mgr.gibba043.dnkmem (mgr.34373) 9129 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:02.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:01 gibba003 bash[32348]: cluster 2021-03-10T16:44:00.762824+0000 mgr.gibba043.dnkmem (mgr.34373) 9129 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:01 gibba043 bash[24019]: cluster 2021-03-10T16:44:00.762824+0000 mgr.gibba043.dnkmem (mgr.34373) 9129 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:04.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:03 gibba003 bash[31385]: cluster 2021-03-10T16:44:02.764320+0000 mgr.gibba043.dnkmem (mgr.34373) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:04.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:03 gibba003 bash[32348]: cluster 2021-03-10T16:44:02.764320+0000 mgr.gibba043.dnkmem (mgr.34373) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:03 gibba043 bash[24019]: cluster 2021-03-10T16:44:02.764320+0000 mgr.gibba043.dnkmem (mgr.34373) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:05 gibba003 bash[31385]: cluster 2021-03-10T16:44:04.765540+0000 mgr.gibba043.dnkmem (mgr.34373) 9131 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:06.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:05 gibba003 bash[32348]: cluster 2021-03-10T16:44:04.765540+0000 mgr.gibba043.dnkmem (mgr.34373) 9131 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:05 gibba043 bash[24019]: cluster 2021-03-10T16:44:04.765540+0000 mgr.gibba043.dnkmem (mgr.34373) 9131 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.543 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:44:07.765 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:44:07.765 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:44:07.765 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:44:07.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:44:07.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:44:07.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:44:07.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:44:07.766 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:44:07.767 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:44:07.767 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:44:07.767 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:44:07.767 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:44:07.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:44:07.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:44:07.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:44:07.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:44:07.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:44:07.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:44:07.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:44:07.769 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:44:07.769 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:44:08.010 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:44:08.011 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:44:08.011 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:08.011 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:44:08.012 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:44:08.012 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:08.012 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:44:08.012 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:44:08.012 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:44:08.013 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:44:08.013 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:44:08.013 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:44:08.013 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:44:08.014 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:44:08.014 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:44:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:07 gibba043 bash[24019]: cluster 2021-03-10T16:44:06.766271+0000 mgr.gibba043.dnkmem (mgr.34373) 9132 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:07 gibba003 bash[31385]: cluster 2021-03-10T16:44:06.766271+0000 mgr.gibba043.dnkmem (mgr.34373) 9132 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:07 gibba003 bash[32348]: cluster 2021-03-10T16:44:06.766271+0000 mgr.gibba043.dnkmem (mgr.34373) 9132 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:09.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:08 gibba043 bash[24019]: audit 2021-03-10T16:44:07.536484+0000 mgr.gibba043.dnkmem (mgr.34373) 9133 : audit [DBG] from='client.60160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:09.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:08 gibba043 bash[24019]: audit 2021-03-10T16:44:07.759258+0000 mgr.gibba043.dnkmem (mgr.34373) 9134 : audit [DBG] from='client.60166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:09.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:08 gibba043 bash[24019]: audit 2021-03-10T16:44:08.014041+0000 mon.c (mon.1) 2351 : audit [DBG] from='client.? 172.21.2.103:0/4015326268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:09.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:08 gibba003 bash[31385]: audit 2021-03-10T16:44:07.536484+0000 mgr.gibba043.dnkmem (mgr.34373) 9133 : audit [DBG] from='client.60160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:09.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:08 gibba003 bash[31385]: audit 2021-03-10T16:44:07.759258+0000 mgr.gibba043.dnkmem (mgr.34373) 9134 : audit [DBG] from='client.60166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:09.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:08 gibba003 bash[31385]: audit 2021-03-10T16:44:08.014041+0000 mon.c (mon.1) 2351 : audit [DBG] from='client.? 172.21.2.103:0/4015326268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:09.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:08 gibba003 bash[32348]: audit 2021-03-10T16:44:07.536484+0000 mgr.gibba043.dnkmem (mgr.34373) 9133 : audit [DBG] from='client.60160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:09.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:08 gibba003 bash[32348]: audit 2021-03-10T16:44:07.759258+0000 mgr.gibba043.dnkmem (mgr.34373) 9134 : audit [DBG] from='client.60166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:09.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:08 gibba003 bash[32348]: audit 2021-03-10T16:44:08.014041+0000 mon.c (mon.1) 2351 : audit [DBG] from='client.? 172.21.2.103:0/4015326268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:09 gibba003 bash[31385]: cluster 2021-03-10T16:44:08.767504+0000 mgr.gibba043.dnkmem (mgr.34373) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:09 gibba003 bash[32348]: cluster 2021-03-10T16:44:08.767504+0000 mgr.gibba043.dnkmem (mgr.34373) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:09 gibba043 bash[24019]: cluster 2021-03-10T16:44:08.767504+0000 mgr.gibba043.dnkmem (mgr.34373) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:11 gibba003 bash[31385]: cluster 2021-03-10T16:44:10.769162+0000 mgr.gibba043.dnkmem (mgr.34373) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:12.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:11 gibba003 bash[32348]: cluster 2021-03-10T16:44:10.769162+0000 mgr.gibba043.dnkmem (mgr.34373) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:11 gibba043 bash[24019]: cluster 2021-03-10T16:44:10.769162+0000 mgr.gibba043.dnkmem (mgr.34373) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:13 gibba003 bash[31385]: cephadm 2021-03-10T16:44:12.702134+0000 mgr.gibba043.dnkmem (mgr.34373) 9137 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:13 gibba003 bash[31385]: cluster 2021-03-10T16:44:12.769592+0000 mgr.gibba043.dnkmem (mgr.34373) 9138 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:13 gibba003 bash[32348]: cephadm 2021-03-10T16:44:12.702134+0000 mgr.gibba043.dnkmem (mgr.34373) 9137 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:13 gibba003 bash[32348]: cluster 2021-03-10T16:44:12.769592+0000 mgr.gibba043.dnkmem (mgr.34373) 9138 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:13 gibba043 bash[24019]: cephadm 2021-03-10T16:44:12.702134+0000 mgr.gibba043.dnkmem (mgr.34373) 9137 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:13 gibba043 bash[24019]: cluster 2021-03-10T16:44:12.769592+0000 mgr.gibba043.dnkmem (mgr.34373) 9138 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:13.825994+0000 mon.c (mon.1) 2352 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:13.826464+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.060686+0000 mon.c (mon.1) 2353 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.061778+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.300071+0000 mon.c (mon.1) 2354 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:44:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.300879+0000 mon.c (mon.1) 2355 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:44:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.301297+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:44:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.301569+0000 mon.c (mon.1) 2356 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.302532+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:44:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.302663+0000 mon.c (mon.1) 2357 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.303660+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[31385]: audit 2021-03-10T16:44:14.304624+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:13.825994+0000 mon.c (mon.1) 2352 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:13.826464+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.060686+0000 mon.c (mon.1) 2353 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.061778+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.300071+0000 mon.c (mon.1) 2354 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:44:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.300879+0000 mon.c (mon.1) 2355 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.301297+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.301569+0000 mon.c (mon.1) 2356 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.302532+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.302663+0000 mon.c (mon.1) 2357 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.303660+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:14 gibba003 bash[32348]: audit 2021-03-10T16:44:14.304624+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:13.825994+0000 mon.c (mon.1) 2352 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:13.826464+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.060686+0000 mon.c (mon.1) 2353 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.061778+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.300071+0000 mon.c (mon.1) 2354 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:44:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.300879+0000 mon.c (mon.1) 2355 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:44:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.301297+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:44:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.301569+0000 mon.c (mon.1) 2356 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.302532+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:44:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.302663+0000 mon.c (mon.1) 2357 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.303660+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:44:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:14 gibba043 bash[24019]: audit 2021-03-10T16:44:14.304624+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:44:16.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:15 gibba003 bash[31385]: cluster 2021-03-10T16:44:14.771165+0000 mgr.gibba043.dnkmem (mgr.34373) 9139 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:15 gibba003 bash[32348]: cluster 2021-03-10T16:44:14.771165+0000 mgr.gibba043.dnkmem (mgr.34373) 9139 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:16.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:15 gibba043 bash[24019]: cluster 2021-03-10T16:44:14.771165+0000 mgr.gibba043.dnkmem (mgr.34373) 9139 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:18.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:17 gibba043 bash[24019]: cluster 2021-03-10T16:44:16.771959+0000 mgr.gibba043.dnkmem (mgr.34373) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:18.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:17 gibba003 bash[31385]: cluster 2021-03-10T16:44:16.771959+0000 mgr.gibba043.dnkmem (mgr.34373) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:17 gibba003 bash[32348]: cluster 2021-03-10T16:44:16.771959+0000 mgr.gibba043.dnkmem (mgr.34373) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:20.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:19 gibba003 bash[31385]: cluster 2021-03-10T16:44:18.773430+0000 mgr.gibba043.dnkmem (mgr.34373) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:20.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:19 gibba003 bash[32348]: cluster 2021-03-10T16:44:18.773430+0000 mgr.gibba043.dnkmem (mgr.34373) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:19 gibba043 bash[24019]: cluster 2021-03-10T16:44:18.773430+0000 mgr.gibba043.dnkmem (mgr.34373) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:21 gibba003 bash[31385]: cluster 2021-03-10T16:44:20.773941+0000 mgr.gibba043.dnkmem (mgr.34373) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:21 gibba003 bash[32348]: cluster 2021-03-10T16:44:20.773941+0000 mgr.gibba043.dnkmem (mgr.34373) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:21 gibba043 bash[24019]: cluster 2021-03-10T16:44:20.773941+0000 mgr.gibba043.dnkmem (mgr.34373) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:23 gibba003 bash[31385]: cluster 2021-03-10T16:44:22.775351+0000 mgr.gibba043.dnkmem (mgr.34373) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:24.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:23 gibba003 bash[32348]: cluster 2021-03-10T16:44:22.775351+0000 mgr.gibba043.dnkmem (mgr.34373) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:24.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:23 gibba043 bash[24019]: cluster 2021-03-10T16:44:22.775351+0000 mgr.gibba043.dnkmem (mgr.34373) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:25 gibba003 bash[31385]: cluster 2021-03-10T16:44:24.776939+0000 mgr.gibba043.dnkmem (mgr.34373) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:26.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:25 gibba003 bash[32348]: cluster 2021-03-10T16:44:24.776939+0000 mgr.gibba043.dnkmem (mgr.34373) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:25 gibba043 bash[24019]: cluster 2021-03-10T16:44:24.776939+0000 mgr.gibba043.dnkmem (mgr.34373) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:28.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:27 gibba043 bash[24019]: cluster 2021-03-10T16:44:26.778561+0000 mgr.gibba043.dnkmem (mgr.34373) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:28.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:27 gibba003 bash[31385]: cluster 2021-03-10T16:44:26.778561+0000 mgr.gibba043.dnkmem (mgr.34373) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:27 gibba003 bash[32348]: cluster 2021-03-10T16:44:26.778561+0000 mgr.gibba043.dnkmem (mgr.34373) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:29.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:28 gibba003 bash[31385]: cephadm 2021-03-10T16:44:27.718153+0000 mgr.gibba043.dnkmem (mgr.34373) 9146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:29.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:28 gibba003 bash[32348]: cephadm 2021-03-10T16:44:27.718153+0000 mgr.gibba043.dnkmem (mgr.34373) 9146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:29.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:28 gibba043 bash[24019]: cephadm 2021-03-10T16:44:27.718153+0000 mgr.gibba043.dnkmem (mgr.34373) 9146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:29 gibba003 bash[31385]: cluster 2021-03-10T16:44:28.779058+0000 mgr.gibba043.dnkmem (mgr.34373) 9147 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:29 gibba003 bash[32348]: cluster 2021-03-10T16:44:28.779058+0000 mgr.gibba043.dnkmem (mgr.34373) 9147 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:29 gibba043 bash[24019]: cluster 2021-03-10T16:44:28.779058+0000 mgr.gibba043.dnkmem (mgr.34373) 9147 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:31 gibba003 bash[31385]: cluster 2021-03-10T16:44:30.780596+0000 mgr.gibba043.dnkmem (mgr.34373) 9148 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:31 gibba003 bash[32348]: cluster 2021-03-10T16:44:30.780596+0000 mgr.gibba043.dnkmem (mgr.34373) 9148 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:31 gibba043 bash[24019]: cluster 2021-03-10T16:44:30.780596+0000 mgr.gibba043.dnkmem (mgr.34373) 9148 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:33 gibba003 bash[31385]: cluster 2021-03-10T16:44:32.782085+0000 mgr.gibba043.dnkmem (mgr.34373) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:33 gibba003 bash[32348]: cluster 2021-03-10T16:44:32.782085+0000 mgr.gibba043.dnkmem (mgr.34373) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:33 gibba043 bash[24019]: cluster 2021-03-10T16:44:32.782085+0000 mgr.gibba043.dnkmem (mgr.34373) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:35 gibba003 bash[31385]: cluster 2021-03-10T16:44:34.783767+0000 mgr.gibba043.dnkmem (mgr.34373) 9150 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:35 gibba003 bash[32348]: cluster 2021-03-10T16:44:34.783767+0000 mgr.gibba043.dnkmem (mgr.34373) 9150 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:35 gibba043 bash[24019]: cluster 2021-03-10T16:44:34.783767+0000 mgr.gibba043.dnkmem (mgr.34373) 9150 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:37 gibba003 bash[31385]: cluster 2021-03-10T16:44:36.784367+0000 mgr.gibba043.dnkmem (mgr.34373) 9151 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:38.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:37 gibba003 bash[32348]: cluster 2021-03-10T16:44:36.784367+0000 mgr.gibba043.dnkmem (mgr.34373) 9151 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:38.252 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:44:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:37 gibba043 bash[24019]: cluster 2021-03-10T16:44:36.784367+0000 mgr.gibba043.dnkmem (mgr.34373) 9151 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:38.493 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:44:38.493 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:44:38.494 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:44:38.494 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:44:38.494 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:44:38.494 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:44:38.495 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:44:38.495 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:44:38.495 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:44:38.495 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:44:38.495 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:44:38.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:44:38.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:44:38.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:44:38.496 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:44:38.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:44:38.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:44:38.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:44:38.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:44:38.497 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:44:38.498 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:44:38.742 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:44:38.742 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:44:38.742 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:38.743 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:44:38.743 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:44:38.743 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:38.743 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:44:38.744 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:44:38.744 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:44:38.744 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:44:38.744 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:44:38.744 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:44:38.745 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:44:38.745 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:44:38.745 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:44:39.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:38 gibba003 bash[31385]: audit 2021-03-10T16:44:38.745520+0000 mon.c (mon.1) 2358 : audit [DBG] from='client.? 172.21.2.103:0/2486762032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:38 gibba003 bash[32348]: audit 2021-03-10T16:44:38.745520+0000 mon.c (mon.1) 2358 : audit [DBG] from='client.? 172.21.2.103:0/2486762032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:38 gibba043 bash[24019]: audit 2021-03-10T16:44:38.745520+0000 mon.c (mon.1) 2358 : audit [DBG] from='client.? 172.21.2.103:0/2486762032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:39 gibba003 bash[31385]: audit 2021-03-10T16:44:38.246087+0000 mgr.gibba043.dnkmem (mgr.34373) 9152 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:40.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:39 gibba003 bash[31385]: audit 2021-03-10T16:44:38.470720+0000 mgr.gibba043.dnkmem (mgr.34373) 9153 : audit [DBG] from='client.50193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:40.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:39 gibba003 bash[31385]: cluster 2021-03-10T16:44:38.785555+0000 mgr.gibba043.dnkmem (mgr.34373) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:40.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:39 gibba003 bash[32348]: audit 2021-03-10T16:44:38.246087+0000 mgr.gibba043.dnkmem (mgr.34373) 9152 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:40.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:39 gibba003 bash[32348]: audit 2021-03-10T16:44:38.470720+0000 mgr.gibba043.dnkmem (mgr.34373) 9153 : audit [DBG] from='client.50193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:40.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:39 gibba003 bash[32348]: cluster 2021-03-10T16:44:38.785555+0000 mgr.gibba043.dnkmem (mgr.34373) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:39 gibba043 bash[24019]: audit 2021-03-10T16:44:38.246087+0000 mgr.gibba043.dnkmem (mgr.34373) 9152 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:40.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:39 gibba043 bash[24019]: audit 2021-03-10T16:44:38.470720+0000 mgr.gibba043.dnkmem (mgr.34373) 9153 : audit [DBG] from='client.50193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:40.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:39 gibba043 bash[24019]: cluster 2021-03-10T16:44:38.785555+0000 mgr.gibba043.dnkmem (mgr.34373) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:41 gibba003 bash[31385]: cluster 2021-03-10T16:44:40.787215+0000 mgr.gibba043.dnkmem (mgr.34373) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:41 gibba003 bash[32348]: cluster 2021-03-10T16:44:40.787215+0000 mgr.gibba043.dnkmem (mgr.34373) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:41 gibba043 bash[24019]: cluster 2021-03-10T16:44:40.787215+0000 mgr.gibba043.dnkmem (mgr.34373) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:43 gibba003 bash[31385]: cephadm 2021-03-10T16:44:42.734312+0000 mgr.gibba043.dnkmem (mgr.34373) 9156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:44.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:43 gibba003 bash[31385]: cluster 2021-03-10T16:44:42.788604+0000 mgr.gibba043.dnkmem (mgr.34373) 9157 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:43 gibba003 bash[32348]: cephadm 2021-03-10T16:44:42.734312+0000 mgr.gibba043.dnkmem (mgr.34373) 9156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:43 gibba003 bash[32348]: cluster 2021-03-10T16:44:42.788604+0000 mgr.gibba043.dnkmem (mgr.34373) 9157 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:43 gibba043 bash[24019]: cephadm 2021-03-10T16:44:42.734312+0000 mgr.gibba043.dnkmem (mgr.34373) 9156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:43 gibba043 bash[24019]: cluster 2021-03-10T16:44:42.788604+0000 mgr.gibba043.dnkmem (mgr.34373) 9157 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:45 gibba003 bash[31385]: cluster 2021-03-10T16:44:44.789157+0000 mgr.gibba043.dnkmem (mgr.34373) 9158 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:45 gibba003 bash[32348]: cluster 2021-03-10T16:44:44.789157+0000 mgr.gibba043.dnkmem (mgr.34373) 9158 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:45 gibba043 bash[24019]: cluster 2021-03-10T16:44:44.789157+0000 mgr.gibba043.dnkmem (mgr.34373) 9158 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:47 gibba003 bash[31385]: cluster 2021-03-10T16:44:46.789668+0000 mgr.gibba043.dnkmem (mgr.34373) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:48.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:47 gibba003 bash[32348]: cluster 2021-03-10T16:44:46.789668+0000 mgr.gibba043.dnkmem (mgr.34373) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:47 gibba043 bash[24019]: cluster 2021-03-10T16:44:46.789668+0000 mgr.gibba043.dnkmem (mgr.34373) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:50.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:49 gibba003 bash[31385]: cluster 2021-03-10T16:44:48.791151+0000 mgr.gibba043.dnkmem (mgr.34373) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:49 gibba003 bash[32348]: cluster 2021-03-10T16:44:48.791151+0000 mgr.gibba043.dnkmem (mgr.34373) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:49 gibba043 bash[24019]: cluster 2021-03-10T16:44:48.791151+0000 mgr.gibba043.dnkmem (mgr.34373) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:51 gibba003 bash[31385]: cluster 2021-03-10T16:44:50.792806+0000 mgr.gibba043.dnkmem (mgr.34373) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:52.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:51 gibba003 bash[32348]: cluster 2021-03-10T16:44:50.792806+0000 mgr.gibba043.dnkmem (mgr.34373) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:51 gibba043 bash[24019]: cluster 2021-03-10T16:44:50.792806+0000 mgr.gibba043.dnkmem (mgr.34373) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:53 gibba003 bash[31385]: cluster 2021-03-10T16:44:52.793521+0000 mgr.gibba043.dnkmem (mgr.34373) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:53 gibba003 bash[32348]: cluster 2021-03-10T16:44:52.793521+0000 mgr.gibba043.dnkmem (mgr.34373) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:53 gibba043 bash[24019]: cluster 2021-03-10T16:44:52.793521+0000 mgr.gibba043.dnkmem (mgr.34373) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:56.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:55 gibba003 bash[31385]: cluster 2021-03-10T16:44:54.795012+0000 mgr.gibba043.dnkmem (mgr.34373) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:56.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:55 gibba003 bash[32348]: cluster 2021-03-10T16:44:54.795012+0000 mgr.gibba043.dnkmem (mgr.34373) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:55 gibba043 bash[24019]: cluster 2021-03-10T16:44:54.795012+0000 mgr.gibba043.dnkmem (mgr.34373) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:57 gibba003 bash[31385]: cluster 2021-03-10T16:44:56.795984+0000 mgr.gibba043.dnkmem (mgr.34373) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:57 gibba003 bash[32348]: cluster 2021-03-10T16:44:56.795984+0000 mgr.gibba043.dnkmem (mgr.34373) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:57 gibba043 bash[24019]: cluster 2021-03-10T16:44:56.795984+0000 mgr.gibba043.dnkmem (mgr.34373) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:59.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:57.751197+0000 mgr.gibba043.dnkmem (mgr.34373) 9165 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:44:59.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:57.753088+0000 mgr.gibba043.dnkmem (mgr.34373) 9166 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:44:59.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:57.983718+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:44:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:57.995707+0000 mgr.gibba043.dnkmem (mgr.34373) 9167 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:58.000113+0000 mon.c (mon.1) 2359 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:59.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.001950+0000 mgr.gibba043.dnkmem (mgr.34373) 9168 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:58.005051+0000 mon.c (mon.1) 2360 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.005622+0000 mgr.gibba043.dnkmem (mgr.34373) 9169 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.006133+0000 mgr.gibba043.dnkmem (mgr.34373) 9170 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:58.009145+0000 mon.c (mon.1) 2361 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.009536+0000 mgr.gibba043.dnkmem (mgr.34373) 9171 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.009822+0000 mgr.gibba043.dnkmem (mgr.34373) 9172 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:58.012159+0000 mon.c (mon.1) 2362 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.012673+0000 mgr.gibba043.dnkmem (mgr.34373) 9173 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.016150+0000 mgr.gibba043.dnkmem (mgr.34373) 9174 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.017023+0000 mgr.gibba043.dnkmem (mgr.34373) 9175 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:58.020032+0000 mon.c (mon.1) 2363 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.020584+0000 mgr.gibba043.dnkmem (mgr.34373) 9176 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.022824+0000 mgr.gibba043.dnkmem (mgr.34373) 9177 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: audit 2021-03-10T16:44:58.025321+0000 mon.c (mon.1) 2364 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.026257+0000 mgr.gibba043.dnkmem (mgr.34373) 9178 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.026649+0000 mgr.gibba043.dnkmem (mgr.34373) 9179 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:44:58 gibba043 bash[24019]: cephadm 2021-03-10T16:44:58.027229+0000 mgr.gibba043.dnkmem (mgr.34373) 9180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:59.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:57.751197+0000 mgr.gibba043.dnkmem (mgr.34373) 9165 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:44:59.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:57.753088+0000 mgr.gibba043.dnkmem (mgr.34373) 9166 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:44:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:57.983718+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:44:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:57.995707+0000 mgr.gibba043.dnkmem (mgr.34373) 9167 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:58.000113+0000 mon.c (mon.1) 2359 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:59.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.001950+0000 mgr.gibba043.dnkmem (mgr.34373) 9168 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:58.005051+0000 mon.c (mon.1) 2360 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.005622+0000 mgr.gibba043.dnkmem (mgr.34373) 9169 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.006133+0000 mgr.gibba043.dnkmem (mgr.34373) 9170 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:58.009145+0000 mon.c (mon.1) 2361 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.009536+0000 mgr.gibba043.dnkmem (mgr.34373) 9171 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.009822+0000 mgr.gibba043.dnkmem (mgr.34373) 9172 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:58.012159+0000 mon.c (mon.1) 2362 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.012673+0000 mgr.gibba043.dnkmem (mgr.34373) 9173 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.016150+0000 mgr.gibba043.dnkmem (mgr.34373) 9174 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.017023+0000 mgr.gibba043.dnkmem (mgr.34373) 9175 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:58.020032+0000 mon.c (mon.1) 2363 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.020584+0000 mgr.gibba043.dnkmem (mgr.34373) 9176 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.022824+0000 mgr.gibba043.dnkmem (mgr.34373) 9177 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: audit 2021-03-10T16:44:58.025321+0000 mon.c (mon.1) 2364 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.026257+0000 mgr.gibba043.dnkmem (mgr.34373) 9178 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:57.751197+0000 mgr.gibba043.dnkmem (mgr.34373) 9165 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:44:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:57.753088+0000 mgr.gibba043.dnkmem (mgr.34373) 9166 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:44:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:57.983718+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:44:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:57.995707+0000 mgr.gibba043.dnkmem (mgr.34373) 9167 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:58.000113+0000 mon.c (mon.1) 2359 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:59.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.001950+0000 mgr.gibba043.dnkmem (mgr.34373) 9168 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:58.005051+0000 mon.c (mon.1) 2360 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.005622+0000 mgr.gibba043.dnkmem (mgr.34373) 9169 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.006133+0000 mgr.gibba043.dnkmem (mgr.34373) 9170 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:59.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:58.009145+0000 mon.c (mon.1) 2361 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.009536+0000 mgr.gibba043.dnkmem (mgr.34373) 9171 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.009822+0000 mgr.gibba043.dnkmem (mgr.34373) 9172 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:58.012159+0000 mon.c (mon.1) 2362 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.012673+0000 mgr.gibba043.dnkmem (mgr.34373) 9173 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:59.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.016150+0000 mgr.gibba043.dnkmem (mgr.34373) 9174 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:59.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.017023+0000 mgr.gibba043.dnkmem (mgr.34373) 9175 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:59.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:58.020032+0000 mon.c (mon.1) 2363 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.020584+0000 mgr.gibba043.dnkmem (mgr.34373) 9176 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:59.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.022824+0000 mgr.gibba043.dnkmem (mgr.34373) 9177 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:59.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: audit 2021-03-10T16:44:58.025321+0000 mon.c (mon.1) 2364 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:59.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.026257+0000 mgr.gibba043.dnkmem (mgr.34373) 9178 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:59.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.026649+0000 mgr.gibba043.dnkmem (mgr.34373) 9179 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:59.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[32348]: cephadm 2021-03-10T16:44:58.027229+0000 mgr.gibba043.dnkmem (mgr.34373) 9180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:44:59.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.026649+0000 mgr.gibba043.dnkmem (mgr.34373) 9179 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:59.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:44:58 gibba003 bash[31385]: cephadm 2021-03-10T16:44:58.027229+0000 mgr.gibba043.dnkmem (mgr.34373) 9180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:00 gibba043 bash[24019]: cluster 2021-03-10T16:44:58.797427+0000 mgr.gibba043.dnkmem (mgr.34373) 9181 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:00.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:00 gibba003 bash[31385]: cluster 2021-03-10T16:44:58.797427+0000 mgr.gibba043.dnkmem (mgr.34373) 9181 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:00.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:00 gibba003 bash[32348]: cluster 2021-03-10T16:44:58.797427+0000 mgr.gibba043.dnkmem (mgr.34373) 9181 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:02 gibba043 bash[24019]: cluster 2021-03-10T16:45:00.798011+0000 mgr.gibba043.dnkmem (mgr.34373) 9182 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:02.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:02 gibba003 bash[31385]: cluster 2021-03-10T16:45:00.798011+0000 mgr.gibba043.dnkmem (mgr.34373) 9182 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:02.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:02 gibba003 bash[32348]: cluster 2021-03-10T16:45:00.798011+0000 mgr.gibba043.dnkmem (mgr.34373) 9182 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:04 gibba043 bash[24019]: cluster 2021-03-10T16:45:02.799353+0000 mgr.gibba043.dnkmem (mgr.34373) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:04.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:04 gibba003 bash[31385]: cluster 2021-03-10T16:45:02.799353+0000 mgr.gibba043.dnkmem (mgr.34373) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:04.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:04 gibba003 bash[32348]: cluster 2021-03-10T16:45:02.799353+0000 mgr.gibba043.dnkmem (mgr.34373) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:06.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:06 gibba003 bash[31385]: cluster 2021-03-10T16:45:04.800986+0000 mgr.gibba043.dnkmem (mgr.34373) 9184 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:06.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:06 gibba003 bash[32348]: cluster 2021-03-10T16:45:04.800986+0000 mgr.gibba043.dnkmem (mgr.34373) 9184 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:06.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:06 gibba043 bash[24019]: cluster 2021-03-10T16:45:04.800986+0000 mgr.gibba043.dnkmem (mgr.34373) 9184 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:07 gibba003 bash[31385]: cluster 2021-03-10T16:45:06.801850+0000 mgr.gibba043.dnkmem (mgr.34373) 9185 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:07 gibba003 bash[32348]: cluster 2021-03-10T16:45:06.801850+0000 mgr.gibba043.dnkmem (mgr.34373) 9185 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:07 gibba043 bash[24019]: cluster 2021-03-10T16:45:06.801850+0000 mgr.gibba043.dnkmem (mgr.34373) 9185 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:08.988 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:45:09.213 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:45:09.213 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:45:09.213 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:45:09.214 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:45:09.214 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:45:09.214 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:45:09.214 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:45:09.215 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:45:09.215 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:45:09.215 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:45:09.215 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:45:09.216 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:45:09.216 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:45:09.216 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:45:09.216 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:45:09.216 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:45:09.217 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:45:09.217 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:45:09.217 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:45:09.217 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:45:09.218 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:45:09.497 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:45:09.498 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:45:09.498 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:09.498 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:45:09.498 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:45:09.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:09.499 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:45:09.499 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:45:09.500 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:45:09.500 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:45:09.500 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:45:09.501 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:45:09.501 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:45:09.501 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:45:09.502 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:45:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:09 gibba003 bash[31385]: cluster 2021-03-10T16:45:08.803242+0000 mgr.gibba043.dnkmem (mgr.34373) 9186 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:10.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:09 gibba003 bash[31385]: audit 2021-03-10T16:45:08.981960+0000 mgr.gibba043.dnkmem (mgr.34373) 9187 : audit [DBG] from='client.60196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:10.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:09 gibba003 bash[31385]: audit 2021-03-10T16:45:09.501024+0000 mon.a (mon.0) 1914 : audit [DBG] from='client.? 172.21.2.103:0/985239029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:09 gibba003 bash[32348]: cluster 2021-03-10T16:45:08.803242+0000 mgr.gibba043.dnkmem (mgr.34373) 9186 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:10.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:09 gibba003 bash[32348]: audit 2021-03-10T16:45:08.981960+0000 mgr.gibba043.dnkmem (mgr.34373) 9187 : audit [DBG] from='client.60196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:10.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:09 gibba003 bash[32348]: audit 2021-03-10T16:45:09.501024+0000 mon.a (mon.0) 1914 : audit [DBG] from='client.? 172.21.2.103:0/985239029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:09 gibba043 bash[24019]: cluster 2021-03-10T16:45:08.803242+0000 mgr.gibba043.dnkmem (mgr.34373) 9186 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:09 gibba043 bash[24019]: audit 2021-03-10T16:45:08.981960+0000 mgr.gibba043.dnkmem (mgr.34373) 9187 : audit [DBG] from='client.60196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:10.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:09 gibba043 bash[24019]: audit 2021-03-10T16:45:09.501024+0000 mon.a (mon.0) 1914 : audit [DBG] from='client.? 172.21.2.103:0/985239029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:11.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:10 gibba003 bash[31385]: audit 2021-03-10T16:45:09.202769+0000 mgr.gibba043.dnkmem (mgr.34373) 9188 : audit [DBG] from='client.60202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:11.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:10 gibba003 bash[32348]: audit 2021-03-10T16:45:09.202769+0000 mgr.gibba043.dnkmem (mgr.34373) 9188 : audit [DBG] from='client.60202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:11.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:10 gibba043 bash[24019]: audit 2021-03-10T16:45:09.202769+0000 mgr.gibba043.dnkmem (mgr.34373) 9188 : audit [DBG] from='client.60202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:11 gibba003 bash[31385]: cluster 2021-03-10T16:45:10.804903+0000 mgr.gibba043.dnkmem (mgr.34373) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:12.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:11 gibba003 bash[32348]: cluster 2021-03-10T16:45:10.804903+0000 mgr.gibba043.dnkmem (mgr.34373) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:11 gibba043 bash[24019]: cluster 2021-03-10T16:45:10.804903+0000 mgr.gibba043.dnkmem (mgr.34373) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[31385]: cluster 2021-03-10T16:45:12.806416+0000 mgr.gibba043.dnkmem (mgr.34373) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[31385]: cephadm 2021-03-10T16:45:13.043172+0000 mgr.gibba043.dnkmem (mgr.34373) 9191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[31385]: audit 2021-03-10T16:45:13.830190+0000 mon.c (mon.1) 2365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[31385]: audit 2021-03-10T16:45:13.831332+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[32348]: cluster 2021-03-10T16:45:12.806416+0000 mgr.gibba043.dnkmem (mgr.34373) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[32348]: cephadm 2021-03-10T16:45:13.043172+0000 mgr.gibba043.dnkmem (mgr.34373) 9191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[32348]: audit 2021-03-10T16:45:13.830190+0000 mon.c (mon.1) 2365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:13 gibba003 bash[32348]: audit 2021-03-10T16:45:13.831332+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:13 gibba043 bash[24019]: cluster 2021-03-10T16:45:12.806416+0000 mgr.gibba043.dnkmem (mgr.34373) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:13 gibba043 bash[24019]: cephadm 2021-03-10T16:45:13.043172+0000 mgr.gibba043.dnkmem (mgr.34373) 9191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:13 gibba043 bash[24019]: audit 2021-03-10T16:45:13.830190+0000 mon.c (mon.1) 2365 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:13 gibba043 bash[24019]: audit 2021-03-10T16:45:13.831332+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.066754+0000 mon.c (mon.1) 2366 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.068094+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.312950+0000 mon.c (mon.1) 2367 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:45:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.313861+0000 mon.c (mon.1) 2368 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:45:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.314191+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:45:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.314607+0000 mon.c (mon.1) 2369 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.315387+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:45:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.315585+0000 mon.c (mon.1) 2370 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.316391+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[31385]: audit 2021-03-10T16:45:14.317435+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.066754+0000 mon.c (mon.1) 2366 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.068094+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.312950+0000 mon.c (mon.1) 2367 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:45:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.313861+0000 mon.c (mon.1) 2368 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:45:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.314191+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:45:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.314607+0000 mon.c (mon.1) 2369 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.315387+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:45:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.315585+0000 mon.c (mon.1) 2370 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.316391+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:14 gibba003 bash[32348]: audit 2021-03-10T16:45:14.317435+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.066754+0000 mon.c (mon.1) 2366 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.068094+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.312950+0000 mon.c (mon.1) 2367 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:45:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.313861+0000 mon.c (mon.1) 2368 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:45:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.314191+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:45:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.314607+0000 mon.c (mon.1) 2369 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.315387+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:45:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.315585+0000 mon.c (mon.1) 2370 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.316391+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:45:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:14 gibba043 bash[24019]: audit 2021-03-10T16:45:14.317435+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:45:16.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:15 gibba003 bash[31385]: cluster 2021-03-10T16:45:14.808143+0000 mgr.gibba043.dnkmem (mgr.34373) 9192 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:16.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:15 gibba003 bash[32348]: cluster 2021-03-10T16:45:14.808143+0000 mgr.gibba043.dnkmem (mgr.34373) 9192 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:15 gibba043 bash[24019]: cluster 2021-03-10T16:45:14.808143+0000 mgr.gibba043.dnkmem (mgr.34373) 9192 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:17 gibba003 bash[31385]: cluster 2021-03-10T16:45:16.809015+0000 mgr.gibba043.dnkmem (mgr.34373) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:17 gibba003 bash[32348]: cluster 2021-03-10T16:45:16.809015+0000 mgr.gibba043.dnkmem (mgr.34373) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:17 gibba043 bash[24019]: cluster 2021-03-10T16:45:16.809015+0000 mgr.gibba043.dnkmem (mgr.34373) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:19 gibba003 bash[31385]: cluster 2021-03-10T16:45:18.810507+0000 mgr.gibba043.dnkmem (mgr.34373) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:19 gibba003 bash[32348]: cluster 2021-03-10T16:45:18.810507+0000 mgr.gibba043.dnkmem (mgr.34373) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:19 gibba043 bash[24019]: cluster 2021-03-10T16:45:18.810507+0000 mgr.gibba043.dnkmem (mgr.34373) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:21 gibba003 bash[31385]: cluster 2021-03-10T16:45:20.812274+0000 mgr.gibba043.dnkmem (mgr.34373) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:22.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:21 gibba003 bash[32348]: cluster 2021-03-10T16:45:20.812274+0000 mgr.gibba043.dnkmem (mgr.34373) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:21 gibba043 bash[24019]: cluster 2021-03-10T16:45:20.812274+0000 mgr.gibba043.dnkmem (mgr.34373) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:23 gibba003 bash[31385]: cluster 2021-03-10T16:45:22.813508+0000 mgr.gibba043.dnkmem (mgr.34373) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:24.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:23 gibba003 bash[32348]: cluster 2021-03-10T16:45:22.813508+0000 mgr.gibba043.dnkmem (mgr.34373) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:23 gibba043 bash[24019]: cluster 2021-03-10T16:45:22.813508+0000 mgr.gibba043.dnkmem (mgr.34373) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:26.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:25 gibba003 bash[31385]: cluster 2021-03-10T16:45:24.814358+0000 mgr.gibba043.dnkmem (mgr.34373) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:26.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:25 gibba003 bash[32348]: cluster 2021-03-10T16:45:24.814358+0000 mgr.gibba043.dnkmem (mgr.34373) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:25 gibba043 bash[24019]: cluster 2021-03-10T16:45:24.814358+0000 mgr.gibba043.dnkmem (mgr.34373) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:28.050 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:27 gibba043 bash[24019]: cluster 2021-03-10T16:45:26.815200+0000 mgr.gibba043.dnkmem (mgr.34373) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:28.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:27 gibba003 bash[31385]: cluster 2021-03-10T16:45:26.815200+0000 mgr.gibba043.dnkmem (mgr.34373) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:27 gibba003 bash[32348]: cluster 2021-03-10T16:45:26.815200+0000 mgr.gibba043.dnkmem (mgr.34373) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:29.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:28 gibba003 bash[31385]: cephadm 2021-03-10T16:45:28.051720+0000 mgr.gibba043.dnkmem (mgr.34373) 9199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:29.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:28 gibba003 bash[32348]: cephadm 2021-03-10T16:45:28.051720+0000 mgr.gibba043.dnkmem (mgr.34373) 9199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:29.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:28 gibba043 bash[24019]: cephadm 2021-03-10T16:45:28.051720+0000 mgr.gibba043.dnkmem (mgr.34373) 9199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:29 gibba003 bash[31385]: cluster 2021-03-10T16:45:28.815811+0000 mgr.gibba043.dnkmem (mgr.34373) 9200 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:29 gibba003 bash[32348]: cluster 2021-03-10T16:45:28.815811+0000 mgr.gibba043.dnkmem (mgr.34373) 9200 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:29 gibba043 bash[24019]: cluster 2021-03-10T16:45:28.815811+0000 mgr.gibba043.dnkmem (mgr.34373) 9200 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:31 gibba003 bash[31385]: cluster 2021-03-10T16:45:30.817341+0000 mgr.gibba043.dnkmem (mgr.34373) 9201 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:31 gibba003 bash[32348]: cluster 2021-03-10T16:45:30.817341+0000 mgr.gibba043.dnkmem (mgr.34373) 9201 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:31 gibba043 bash[24019]: cluster 2021-03-10T16:45:30.817341+0000 mgr.gibba043.dnkmem (mgr.34373) 9201 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:34.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:33 gibba003 bash[31385]: cluster 2021-03-10T16:45:32.818009+0000 mgr.gibba043.dnkmem (mgr.34373) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:34.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:33 gibba003 bash[32348]: cluster 2021-03-10T16:45:32.818009+0000 mgr.gibba043.dnkmem (mgr.34373) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:33 gibba043 bash[24019]: cluster 2021-03-10T16:45:32.818009+0000 mgr.gibba043.dnkmem (mgr.34373) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:36.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:35 gibba003 bash[31385]: cluster 2021-03-10T16:45:34.819726+0000 mgr.gibba043.dnkmem (mgr.34373) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:36.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:35 gibba003 bash[32348]: cluster 2021-03-10T16:45:34.819726+0000 mgr.gibba043.dnkmem (mgr.34373) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:35 gibba043 bash[24019]: cluster 2021-03-10T16:45:34.819726+0000 mgr.gibba043.dnkmem (mgr.34373) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:37 gibba003 bash[31385]: cluster 2021-03-10T16:45:36.821346+0000 mgr.gibba043.dnkmem (mgr.34373) 9204 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:37 gibba003 bash[32348]: cluster 2021-03-10T16:45:36.821346+0000 mgr.gibba043.dnkmem (mgr.34373) 9204 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:37 gibba043 bash[24019]: cluster 2021-03-10T16:45:36.821346+0000 mgr.gibba043.dnkmem (mgr.34373) 9204 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:39.738 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:45:39.993 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:45:39.993 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:45:39.993 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:45:39.993 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:45:39.994 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:45:39.994 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:45:39.994 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:45:39.994 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:45:39.995 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:45:39.995 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:45:39.995 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:45:39.995 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:45:39.996 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:45:39.996 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:45:39.996 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:45:39.996 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:45:39.996 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:45:39.997 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:45:39.997 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:45:39.997 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:45:39.997 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:45:40.186 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:39 gibba003 bash[31385]: cluster 2021-03-10T16:45:38.822946+0000 mgr.gibba043.dnkmem (mgr.34373) 9205 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:39 gibba003 bash[32348]: cluster 2021-03-10T16:45:38.822946+0000 mgr.gibba043.dnkmem (mgr.34373) 9205 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.241 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:45:40.242 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:45:40.242 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:40.242 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:45:40.243 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:45:40.243 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:40.243 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:45:40.243 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:45:40.243 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:45:40.244 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:45:40.244 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:45:40.244 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:45:40.244 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:45:40.245 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:45:40.245 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:45:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:39 gibba043 bash[24019]: cluster 2021-03-10T16:45:38.822946+0000 mgr.gibba043.dnkmem (mgr.34373) 9205 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:41.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:40 gibba003 bash[31385]: audit 2021-03-10T16:45:39.731622+0000 mgr.gibba043.dnkmem (mgr.34373) 9206 : audit [DBG] from='client.60214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:41.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:40 gibba003 bash[31385]: audit 2021-03-10T16:45:39.958571+0000 mgr.gibba043.dnkmem (mgr.34373) 9207 : audit [DBG] from='client.50229 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:41.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:40 gibba003 bash[31385]: audit 2021-03-10T16:45:40.245636+0000 mon.c (mon.1) 2371 : audit [DBG] from='client.? 172.21.2.103:0/1341188825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:40 gibba003 bash[32348]: audit 2021-03-10T16:45:39.731622+0000 mgr.gibba043.dnkmem (mgr.34373) 9206 : audit [DBG] from='client.60214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:40 gibba003 bash[32348]: audit 2021-03-10T16:45:39.958571+0000 mgr.gibba043.dnkmem (mgr.34373) 9207 : audit [DBG] from='client.50229 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:41.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:40 gibba003 bash[32348]: audit 2021-03-10T16:45:40.245636+0000 mon.c (mon.1) 2371 : audit [DBG] from='client.? 172.21.2.103:0/1341188825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:41.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:40 gibba043 bash[24019]: audit 2021-03-10T16:45:39.731622+0000 mgr.gibba043.dnkmem (mgr.34373) 9206 : audit [DBG] from='client.60214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:41.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:40 gibba043 bash[24019]: audit 2021-03-10T16:45:39.958571+0000 mgr.gibba043.dnkmem (mgr.34373) 9207 : audit [DBG] from='client.50229 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:41.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:40 gibba043 bash[24019]: audit 2021-03-10T16:45:40.245636+0000 mon.c (mon.1) 2371 : audit [DBG] from='client.? 172.21.2.103:0/1341188825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:41 gibba003 bash[31385]: cluster 2021-03-10T16:45:40.823874+0000 mgr.gibba043.dnkmem (mgr.34373) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:42.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:41 gibba003 bash[32348]: cluster 2021-03-10T16:45:40.823874+0000 mgr.gibba043.dnkmem (mgr.34373) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:41 gibba043 bash[24019]: cluster 2021-03-10T16:45:40.823874+0000 mgr.gibba043.dnkmem (mgr.34373) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:44.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:43 gibba003 bash[31385]: cluster 2021-03-10T16:45:42.825242+0000 mgr.gibba043.dnkmem (mgr.34373) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:44.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:43 gibba003 bash[31385]: cephadm 2021-03-10T16:45:43.067855+0000 mgr.gibba043.dnkmem (mgr.34373) 9210 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:43 gibba003 bash[32348]: cluster 2021-03-10T16:45:42.825242+0000 mgr.gibba043.dnkmem (mgr.34373) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:44.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:43 gibba003 bash[32348]: cephadm 2021-03-10T16:45:43.067855+0000 mgr.gibba043.dnkmem (mgr.34373) 9210 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:43 gibba043 bash[24019]: cluster 2021-03-10T16:45:42.825242+0000 mgr.gibba043.dnkmem (mgr.34373) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:43 gibba043 bash[24019]: cephadm 2021-03-10T16:45:43.067855+0000 mgr.gibba043.dnkmem (mgr.34373) 9210 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:46.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:45 gibba003 bash[31385]: cluster 2021-03-10T16:45:44.826835+0000 mgr.gibba043.dnkmem (mgr.34373) 9211 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:46.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:45 gibba003 bash[32348]: cluster 2021-03-10T16:45:44.826835+0000 mgr.gibba043.dnkmem (mgr.34373) 9211 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:45 gibba043 bash[24019]: cluster 2021-03-10T16:45:44.826835+0000 mgr.gibba043.dnkmem (mgr.34373) 9211 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:47 gibba003 bash[31385]: cluster 2021-03-10T16:45:46.828530+0000 mgr.gibba043.dnkmem (mgr.34373) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:47 gibba003 bash[32348]: cluster 2021-03-10T16:45:46.828530+0000 mgr.gibba043.dnkmem (mgr.34373) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:47 gibba043 bash[24019]: cluster 2021-03-10T16:45:46.828530+0000 mgr.gibba043.dnkmem (mgr.34373) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:50.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:49 gibba003 bash[31385]: cluster 2021-03-10T16:45:48.829593+0000 mgr.gibba043.dnkmem (mgr.34373) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:49 gibba003 bash[32348]: cluster 2021-03-10T16:45:48.829593+0000 mgr.gibba043.dnkmem (mgr.34373) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:49 gibba043 bash[24019]: cluster 2021-03-10T16:45:48.829593+0000 mgr.gibba043.dnkmem (mgr.34373) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:52.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:51 gibba003 bash[31385]: cluster 2021-03-10T16:45:50.831221+0000 mgr.gibba043.dnkmem (mgr.34373) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:52.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:51 gibba003 bash[32348]: cluster 2021-03-10T16:45:50.831221+0000 mgr.gibba043.dnkmem (mgr.34373) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:51 gibba043 bash[24019]: cluster 2021-03-10T16:45:50.831221+0000 mgr.gibba043.dnkmem (mgr.34373) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:53 gibba003 bash[31385]: cluster 2021-03-10T16:45:52.832671+0000 mgr.gibba043.dnkmem (mgr.34373) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:53 gibba003 bash[32348]: cluster 2021-03-10T16:45:52.832671+0000 mgr.gibba043.dnkmem (mgr.34373) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:53 gibba043 bash[24019]: cluster 2021-03-10T16:45:52.832671+0000 mgr.gibba043.dnkmem (mgr.34373) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:56.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:55 gibba003 bash[31385]: cluster 2021-03-10T16:45:54.834327+0000 mgr.gibba043.dnkmem (mgr.34373) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:56.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:55 gibba003 bash[32348]: cluster 2021-03-10T16:45:54.834327+0000 mgr.gibba043.dnkmem (mgr.34373) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:55 gibba043 bash[24019]: cluster 2021-03-10T16:45:54.834327+0000 mgr.gibba043.dnkmem (mgr.34373) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:57 gibba003 bash[31385]: cluster 2021-03-10T16:45:56.835738+0000 mgr.gibba043.dnkmem (mgr.34373) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:57 gibba003 bash[32348]: cluster 2021-03-10T16:45:56.835738+0000 mgr.gibba043.dnkmem (mgr.34373) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:58.267 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:57 gibba043 bash[24019]: cluster 2021-03-10T16:45:56.835738+0000 mgr.gibba043.dnkmem (mgr.34373) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.279889+0000 mgr.gibba043.dnkmem (mgr.34373) 9218 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:45:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.280237+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.283500+0000 mgr.gibba043.dnkmem (mgr.34373) 9219 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:45:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.284143+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.486373+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.487648+0000 mgr.gibba043.dnkmem (mgr.34373) 9220 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.489584+0000 mgr.gibba043.dnkmem (mgr.34373) 9221 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.489894+0000 mon.c (mon.1) 2372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.490982+0000 mgr.gibba043.dnkmem (mgr.34373) 9222 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.491020+0000 mgr.gibba043.dnkmem (mgr.34373) 9223 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.491649+0000 mon.c (mon.1) 2373 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.492647+0000 mgr.gibba043.dnkmem (mgr.34373) 9224 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.492685+0000 mgr.gibba043.dnkmem (mgr.34373) 9225 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.493055+0000 mon.c (mon.1) 2374 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.493848+0000 mgr.gibba043.dnkmem (mgr.34373) 9226 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.494702+0000 mon.c (mon.1) 2375 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.495521+0000 mgr.gibba043.dnkmem (mgr.34373) 9227 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.495560+0000 mgr.gibba043.dnkmem (mgr.34373) 9228 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.496943+0000 mgr.gibba043.dnkmem (mgr.34373) 9229 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.497269+0000 mgr.gibba043.dnkmem (mgr.34373) 9230 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.497725+0000 mon.c (mon.1) 2376 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.279889+0000 mgr.gibba043.dnkmem (mgr.34373) 9218 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:45:59.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.280237+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.283500+0000 mgr.gibba043.dnkmem (mgr.34373) 9219 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:45:59.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.284143+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.486373+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.487648+0000 mgr.gibba043.dnkmem (mgr.34373) 9220 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:59.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.489584+0000 mgr.gibba043.dnkmem (mgr.34373) 9221 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:59.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.489894+0000 mon.c (mon.1) 2372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:59.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.490982+0000 mgr.gibba043.dnkmem (mgr.34373) 9222 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:59.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.491020+0000 mgr.gibba043.dnkmem (mgr.34373) 9223 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:59.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.491649+0000 mon.c (mon.1) 2373 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.492647+0000 mgr.gibba043.dnkmem (mgr.34373) 9224 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.492685+0000 mgr.gibba043.dnkmem (mgr.34373) 9225 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.493055+0000 mon.c (mon.1) 2374 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.493848+0000 mgr.gibba043.dnkmem (mgr.34373) 9226 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.494702+0000 mon.c (mon.1) 2375 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.495521+0000 mgr.gibba043.dnkmem (mgr.34373) 9227 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.495560+0000 mgr.gibba043.dnkmem (mgr.34373) 9228 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.496943+0000 mgr.gibba043.dnkmem (mgr.34373) 9229 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.497269+0000 mgr.gibba043.dnkmem (mgr.34373) 9230 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.497725+0000 mon.c (mon.1) 2376 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.498453+0000 mgr.gibba043.dnkmem (mgr.34373) 9231 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:59.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.498494+0000 mgr.gibba043.dnkmem (mgr.34373) 9232 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:59.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cephadm 2021-03-10T16:45:58.498622+0000 mgr.gibba043.dnkmem (mgr.34373) 9233 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:59.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: audit 2021-03-10T16:45:58.499309+0000 mon.c (mon.1) 2377 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[31385]: cluster 2021-03-10T16:45:58.837126+0000 mgr.gibba043.dnkmem (mgr.34373) 9234 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:59.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.498453+0000 mgr.gibba043.dnkmem (mgr.34373) 9231 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.498494+0000 mgr.gibba043.dnkmem (mgr.34373) 9232 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cephadm 2021-03-10T16:45:58.498622+0000 mgr.gibba043.dnkmem (mgr.34373) 9233 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: audit 2021-03-10T16:45:58.499309+0000 mon.c (mon.1) 2377 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:45:59 gibba003 bash[32348]: cluster 2021-03-10T16:45:58.837126+0000 mgr.gibba043.dnkmem (mgr.34373) 9234 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.279889+0000 mgr.gibba043.dnkmem (mgr.34373) 9218 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:45:59.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.280237+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.283500+0000 mgr.gibba043.dnkmem (mgr.34373) 9219 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:45:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.284143+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.486373+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:45:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.487648+0000 mgr.gibba043.dnkmem (mgr.34373) 9220 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.489584+0000 mgr.gibba043.dnkmem (mgr.34373) 9221 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.489894+0000 mon.c (mon.1) 2372 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.490982+0000 mgr.gibba043.dnkmem (mgr.34373) 9222 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.491020+0000 mgr.gibba043.dnkmem (mgr.34373) 9223 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.491649+0000 mon.c (mon.1) 2373 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.492647+0000 mgr.gibba043.dnkmem (mgr.34373) 9224 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.492685+0000 mgr.gibba043.dnkmem (mgr.34373) 9225 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.493055+0000 mon.c (mon.1) 2374 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.493848+0000 mgr.gibba043.dnkmem (mgr.34373) 9226 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.494702+0000 mon.c (mon.1) 2375 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.495521+0000 mgr.gibba043.dnkmem (mgr.34373) 9227 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:59.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.495560+0000 mgr.gibba043.dnkmem (mgr.34373) 9228 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:59.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.496943+0000 mgr.gibba043.dnkmem (mgr.34373) 9229 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:59.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.497269+0000 mgr.gibba043.dnkmem (mgr.34373) 9230 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:59.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.497725+0000 mon.c (mon.1) 2376 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.498453+0000 mgr.gibba043.dnkmem (mgr.34373) 9231 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:59.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.498494+0000 mgr.gibba043.dnkmem (mgr.34373) 9232 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:59.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cephadm 2021-03-10T16:45:58.498622+0000 mgr.gibba043.dnkmem (mgr.34373) 9233 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:45:59.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: audit 2021-03-10T16:45:58.499309+0000 mon.c (mon.1) 2377 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:59.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:45:59 gibba043 bash[24019]: cluster 2021-03-10T16:45:58.837126+0000 mgr.gibba043.dnkmem (mgr.34373) 9234 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:02.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:01 gibba003 bash[31385]: cluster 2021-03-10T16:46:00.838638+0000 mgr.gibba043.dnkmem (mgr.34373) 9235 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:02.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:01 gibba003 bash[32348]: cluster 2021-03-10T16:46:00.838638+0000 mgr.gibba043.dnkmem (mgr.34373) 9235 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:01 gibba043 bash[24019]: cluster 2021-03-10T16:46:00.838638+0000 mgr.gibba043.dnkmem (mgr.34373) 9235 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:04.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:03 gibba003 bash[31385]: cluster 2021-03-10T16:46:02.840179+0000 mgr.gibba043.dnkmem (mgr.34373) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:04.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:03 gibba003 bash[32348]: cluster 2021-03-10T16:46:02.840179+0000 mgr.gibba043.dnkmem (mgr.34373) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:03 gibba043 bash[24019]: cluster 2021-03-10T16:46:02.840179+0000 mgr.gibba043.dnkmem (mgr.34373) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:06.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:05 gibba003 bash[31385]: cluster 2021-03-10T16:46:04.841666+0000 mgr.gibba043.dnkmem (mgr.34373) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:06.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:05 gibba003 bash[32348]: cluster 2021-03-10T16:46:04.841666+0000 mgr.gibba043.dnkmem (mgr.34373) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:05 gibba043 bash[24019]: cluster 2021-03-10T16:46:04.841666+0000 mgr.gibba043.dnkmem (mgr.34373) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:07 gibba003 bash[31385]: cluster 2021-03-10T16:46:06.842626+0000 mgr.gibba043.dnkmem (mgr.34373) 9238 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:07 gibba003 bash[32348]: cluster 2021-03-10T16:46:06.842626+0000 mgr.gibba043.dnkmem (mgr.34373) 9238 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:07 gibba043 bash[24019]: cluster 2021-03-10T16:46:06.842626+0000 mgr.gibba043.dnkmem (mgr.34373) 9238 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:09 gibba003 bash[31385]: cluster 2021-03-10T16:46:08.844180+0000 mgr.gibba043.dnkmem (mgr.34373) 9239 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:09 gibba003 bash[32348]: cluster 2021-03-10T16:46:08.844180+0000 mgr.gibba043.dnkmem (mgr.34373) 9239 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:09 gibba043 bash[24019]: cluster 2021-03-10T16:46:08.844180+0000 mgr.gibba043.dnkmem (mgr.34373) 9239 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.487 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:46:10.712 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:46:10.712 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:46:10.713 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:46:10.713 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:46:10.713 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:46:10.713 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:46:10.714 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:46:10.714 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:46:10.714 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:46:10.715 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (2h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:46:10.715 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:46:10.715 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:46:10.715 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:46:10.716 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:46:10.716 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:46:10.716 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:46:10.716 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:46:10.717 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:46:10.717 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:46:10.717 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:46:10.717 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:46:10.961 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:46:10.961 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:46:10.961 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:10.961 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:46:10.962 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:46:10.962 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:10.962 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:46:10.962 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:46:10.963 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:46:10.963 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:46:10.963 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:46:10.963 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:46:10.964 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:46:10.964 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:46:10.964 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:46:12.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[31385]: audit 2021-03-10T16:46:10.480850+0000 mgr.gibba043.dnkmem (mgr.34373) 9240 : audit [DBG] from='client.60232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:12.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[31385]: audit 2021-03-10T16:46:10.703884+0000 mgr.gibba043.dnkmem (mgr.34373) 9241 : audit [DBG] from='client.60238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[31385]: cluster 2021-03-10T16:46:10.845857+0000 mgr.gibba043.dnkmem (mgr.34373) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:12.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[31385]: audit 2021-03-10T16:46:10.964882+0000 mon.a (mon.0) 1924 : audit [DBG] from='client.? 172.21.2.103:0/1928316541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:12.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[32348]: audit 2021-03-10T16:46:10.480850+0000 mgr.gibba043.dnkmem (mgr.34373) 9240 : audit [DBG] from='client.60232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:12.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[32348]: audit 2021-03-10T16:46:10.703884+0000 mgr.gibba043.dnkmem (mgr.34373) 9241 : audit [DBG] from='client.60238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:12.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[32348]: cluster 2021-03-10T16:46:10.845857+0000 mgr.gibba043.dnkmem (mgr.34373) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:12.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:11 gibba003 bash[32348]: audit 2021-03-10T16:46:10.964882+0000 mon.a (mon.0) 1924 : audit [DBG] from='client.? 172.21.2.103:0/1928316541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:11 gibba043 bash[24019]: audit 2021-03-10T16:46:10.480850+0000 mgr.gibba043.dnkmem (mgr.34373) 9240 : audit [DBG] from='client.60232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:11 gibba043 bash[24019]: audit 2021-03-10T16:46:10.703884+0000 mgr.gibba043.dnkmem (mgr.34373) 9241 : audit [DBG] from='client.60238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:11 gibba043 bash[24019]: cluster 2021-03-10T16:46:10.845857+0000 mgr.gibba043.dnkmem (mgr.34373) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:12.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:11 gibba043 bash[24019]: audit 2021-03-10T16:46:10.964882+0000 mon.a (mon.0) 1924 : audit [DBG] from='client.? 172.21.2.103:0/1928316541' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:14.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:13 gibba003 bash[31385]: cluster 2021-03-10T16:46:12.847289+0000 mgr.gibba043.dnkmem (mgr.34373) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:13 gibba003 bash[31385]: audit 2021-03-10T16:46:13.836816+0000 mon.c (mon.1) 2378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:14.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:13 gibba003 bash[31385]: audit 2021-03-10T16:46:13.837877+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:14.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:13 gibba003 bash[32348]: cluster 2021-03-10T16:46:12.847289+0000 mgr.gibba043.dnkmem (mgr.34373) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:13 gibba003 bash[32348]: audit 2021-03-10T16:46:13.836816+0000 mon.c (mon.1) 2378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:14.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:13 gibba003 bash[32348]: audit 2021-03-10T16:46:13.837877+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:13 gibba043 bash[24019]: cluster 2021-03-10T16:46:12.847289+0000 mgr.gibba043.dnkmem (mgr.34373) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:13 gibba043 bash[24019]: audit 2021-03-10T16:46:13.836816+0000 mon.c (mon.1) 2378 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:13 gibba043 bash[24019]: audit 2021-03-10T16:46:13.837877+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:15.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: cephadm 2021-03-10T16:46:13.514701+0000 mgr.gibba043.dnkmem (mgr.34373) 9244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.072349+0000 mon.c (mon.1) 2379 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.073484+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:15.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.325990+0000 mon.c (mon.1) 2380 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:46:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.326916+0000 mon.c (mon.1) 2381 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:46:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.327334+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:46:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.327892+0000 mon.c (mon.1) 2382 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.328567+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:46:15.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.329184+0000 mon.c (mon.1) 2383 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.329749+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[31385]: audit 2021-03-10T16:46:14.330590+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: cephadm 2021-03-10T16:46:13.514701+0000 mgr.gibba043.dnkmem (mgr.34373) 9244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.072349+0000 mon.c (mon.1) 2379 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.073484+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:15.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.325990+0000 mon.c (mon.1) 2380 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:46:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.326916+0000 mon.c (mon.1) 2381 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:46:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.327334+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:46:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.327892+0000 mon.c (mon.1) 2382 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.328567+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:46:15.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.329184+0000 mon.c (mon.1) 2383 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.329749+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:14 gibba003 bash[32348]: audit 2021-03-10T16:46:14.330590+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: cephadm 2021-03-10T16:46:13.514701+0000 mgr.gibba043.dnkmem (mgr.34373) 9244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:15.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.072349+0000 mon.c (mon.1) 2379 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.073484+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.325990+0000 mon.c (mon.1) 2380 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:46:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.326916+0000 mon.c (mon.1) 2381 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:46:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.327334+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:46:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.327892+0000 mon.c (mon.1) 2382 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.328567+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:46:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.329184+0000 mon.c (mon.1) 2383 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.329749+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:46:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:14 gibba043 bash[24019]: audit 2021-03-10T16:46:14.330590+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:46:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:15 gibba043 bash[24019]: cluster 2021-03-10T16:46:14.848936+0000 mgr.gibba043.dnkmem (mgr.34373) 9245 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:16.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:15 gibba003 bash[31385]: cluster 2021-03-10T16:46:14.848936+0000 mgr.gibba043.dnkmem (mgr.34373) 9245 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:15 gibba003 bash[32348]: cluster 2021-03-10T16:46:14.848936+0000 mgr.gibba043.dnkmem (mgr.34373) 9245 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:17 gibba003 bash[31385]: cluster 2021-03-10T16:46:16.849881+0000 mgr.gibba043.dnkmem (mgr.34373) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:17 gibba003 bash[32348]: cluster 2021-03-10T16:46:16.849881+0000 mgr.gibba043.dnkmem (mgr.34373) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:17 gibba043 bash[24019]: cluster 2021-03-10T16:46:16.849881+0000 mgr.gibba043.dnkmem (mgr.34373) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:20.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:19 gibba003 bash[31385]: cluster 2021-03-10T16:46:18.851298+0000 mgr.gibba043.dnkmem (mgr.34373) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:20.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:19 gibba003 bash[32348]: cluster 2021-03-10T16:46:18.851298+0000 mgr.gibba043.dnkmem (mgr.34373) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:19 gibba043 bash[24019]: cluster 2021-03-10T16:46:18.851298+0000 mgr.gibba043.dnkmem (mgr.34373) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:22.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:21 gibba003 bash[31385]: cluster 2021-03-10T16:46:20.853005+0000 mgr.gibba043.dnkmem (mgr.34373) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:22.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:21 gibba003 bash[32348]: cluster 2021-03-10T16:46:20.853005+0000 mgr.gibba043.dnkmem (mgr.34373) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:21 gibba043 bash[24019]: cluster 2021-03-10T16:46:20.853005+0000 mgr.gibba043.dnkmem (mgr.34373) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:24.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:23 gibba003 bash[31385]: cluster 2021-03-10T16:46:22.854428+0000 mgr.gibba043.dnkmem (mgr.34373) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:24.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:23 gibba003 bash[32348]: cluster 2021-03-10T16:46:22.854428+0000 mgr.gibba043.dnkmem (mgr.34373) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:23 gibba043 bash[24019]: cluster 2021-03-10T16:46:22.854428+0000 mgr.gibba043.dnkmem (mgr.34373) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:25 gibba043 bash[24019]: cluster 2021-03-10T16:46:24.856047+0000 mgr.gibba043.dnkmem (mgr.34373) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:25 gibba003 bash[32348]: cluster 2021-03-10T16:46:24.856047+0000 mgr.gibba043.dnkmem (mgr.34373) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:25 gibba003 bash[31385]: cluster 2021-03-10T16:46:24.856047+0000 mgr.gibba043.dnkmem (mgr.34373) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:27 gibba003 bash[31385]: cluster 2021-03-10T16:46:26.856995+0000 mgr.gibba043.dnkmem (mgr.34373) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:27 gibba003 bash[32348]: cluster 2021-03-10T16:46:26.856995+0000 mgr.gibba043.dnkmem (mgr.34373) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:27 gibba043 bash[24019]: cluster 2021-03-10T16:46:26.856995+0000 mgr.gibba043.dnkmem (mgr.34373) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:30.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:29 gibba003 bash[31385]: cephadm 2021-03-10T16:46:28.530835+0000 mgr.gibba043.dnkmem (mgr.34373) 9252 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:30.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:29 gibba003 bash[31385]: cluster 2021-03-10T16:46:28.858361+0000 mgr.gibba043.dnkmem (mgr.34373) 9253 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:30.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:29 gibba003 bash[32348]: cephadm 2021-03-10T16:46:28.530835+0000 mgr.gibba043.dnkmem (mgr.34373) 9252 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:30.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:29 gibba003 bash[32348]: cluster 2021-03-10T16:46:28.858361+0000 mgr.gibba043.dnkmem (mgr.34373) 9253 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:29 gibba043 bash[24019]: cephadm 2021-03-10T16:46:28.530835+0000 mgr.gibba043.dnkmem (mgr.34373) 9252 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:29 gibba043 bash[24019]: cluster 2021-03-10T16:46:28.858361+0000 mgr.gibba043.dnkmem (mgr.34373) 9253 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:32.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:31 gibba003 bash[31385]: cluster 2021-03-10T16:46:30.860074+0000 mgr.gibba043.dnkmem (mgr.34373) 9254 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:32.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:31 gibba003 bash[32348]: cluster 2021-03-10T16:46:30.860074+0000 mgr.gibba043.dnkmem (mgr.34373) 9254 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:31 gibba043 bash[24019]: cluster 2021-03-10T16:46:30.860074+0000 mgr.gibba043.dnkmem (mgr.34373) 9254 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:33 gibba043 bash[24019]: cluster 2021-03-10T16:46:32.861525+0000 mgr.gibba043.dnkmem (mgr.34373) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:33 gibba003 bash[31385]: cluster 2021-03-10T16:46:32.861525+0000 mgr.gibba043.dnkmem (mgr.34373) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:34.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:33 gibba003 bash[32348]: cluster 2021-03-10T16:46:32.861525+0000 mgr.gibba043.dnkmem (mgr.34373) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:35 gibba043 bash[24019]: cluster 2021-03-10T16:46:34.863184+0000 mgr.gibba043.dnkmem (mgr.34373) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:36.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:35 gibba003 bash[31385]: cluster 2021-03-10T16:46:34.863184+0000 mgr.gibba043.dnkmem (mgr.34373) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:36.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:35 gibba003 bash[32348]: cluster 2021-03-10T16:46:34.863184+0000 mgr.gibba043.dnkmem (mgr.34373) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:37 gibba003 bash[31385]: cluster 2021-03-10T16:46:36.864811+0000 mgr.gibba043.dnkmem (mgr.34373) 9257 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:37 gibba003 bash[32348]: cluster 2021-03-10T16:46:36.864811+0000 mgr.gibba043.dnkmem (mgr.34373) 9257 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:37 gibba043 bash[24019]: cluster 2021-03-10T16:46:36.864811+0000 mgr.gibba043.dnkmem (mgr.34373) 9257 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:40.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:39 gibba003 bash[31385]: cluster 2021-03-10T16:46:38.866582+0000 mgr.gibba043.dnkmem (mgr.34373) 9258 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:40.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:39 gibba003 bash[32348]: cluster 2021-03-10T16:46:38.866582+0000 mgr.gibba043.dnkmem (mgr.34373) 9258 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:39 gibba043 bash[24019]: cluster 2021-03-10T16:46:38.866582+0000 mgr.gibba043.dnkmem (mgr.34373) 9258 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:41.203 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:46:41.430 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:46:41.431 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:46:41.431 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:46:41.431 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:46:41.431 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:46:41.432 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:46:41.432 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:46:41.432 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:46:41.433 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:46:41.433 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:46:41.434 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:46:41.434 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:46:41.434 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:46:41.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:46:41.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:46:41.435 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:46:41.436 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:46:41.436 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:46:41.436 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:46:41.437 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (2h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:46:41.437 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:46:41.687 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:46:41.687 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:46:41.688 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:41.689 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:46:41.689 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:46:41.690 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:41.690 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:46:41.691 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:46:41.691 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:46:41.692 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:46:41.692 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:46:41.692 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:46:41.692 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:46:41.693 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:46:41.693 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:46:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:41 gibba003 bash[31385]: cluster 2021-03-10T16:46:40.868262+0000 mgr.gibba043.dnkmem (mgr.34373) 9259 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:42.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:41 gibba003 bash[31385]: audit 2021-03-10T16:46:41.195082+0000 mgr.gibba043.dnkmem (mgr.34373) 9260 : audit [DBG] from='client.60250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:42.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:41 gibba003 bash[31385]: audit 2021-03-10T16:46:41.690591+0000 mon.c (mon.1) 2384 : audit [DBG] from='client.? 172.21.2.103:0/2184590937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:41 gibba003 bash[32348]: cluster 2021-03-10T16:46:40.868262+0000 mgr.gibba043.dnkmem (mgr.34373) 9259 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:41 gibba003 bash[32348]: audit 2021-03-10T16:46:41.195082+0000 mgr.gibba043.dnkmem (mgr.34373) 9260 : audit [DBG] from='client.60250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:42.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:41 gibba003 bash[32348]: audit 2021-03-10T16:46:41.690591+0000 mon.c (mon.1) 2384 : audit [DBG] from='client.? 172.21.2.103:0/2184590937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:41 gibba043 bash[24019]: cluster 2021-03-10T16:46:40.868262+0000 mgr.gibba043.dnkmem (mgr.34373) 9259 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:41 gibba043 bash[24019]: audit 2021-03-10T16:46:41.195082+0000 mgr.gibba043.dnkmem (mgr.34373) 9260 : audit [DBG] from='client.60250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:42.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:41 gibba043 bash[24019]: audit 2021-03-10T16:46:41.690591+0000 mon.c (mon.1) 2384 : audit [DBG] from='client.? 172.21.2.103:0/2184590937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:43.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:42 gibba043 bash[24019]: audit 2021-03-10T16:46:41.420415+0000 mgr.gibba043.dnkmem (mgr.34373) 9261 : audit [DBG] from='client.50265 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:43.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:42 gibba003 bash[31385]: audit 2021-03-10T16:46:41.420415+0000 mgr.gibba043.dnkmem (mgr.34373) 9261 : audit [DBG] from='client.50265 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:43.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:42 gibba003 bash[32348]: audit 2021-03-10T16:46:41.420415+0000 mgr.gibba043.dnkmem (mgr.34373) 9261 : audit [DBG] from='client.50265 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:43 gibba043 bash[24019]: cluster 2021-03-10T16:46:42.869809+0000 mgr.gibba043.dnkmem (mgr.34373) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:44.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:43 gibba003 bash[31385]: cluster 2021-03-10T16:46:42.869809+0000 mgr.gibba043.dnkmem (mgr.34373) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:44.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:43 gibba003 bash[32348]: cluster 2021-03-10T16:46:42.869809+0000 mgr.gibba043.dnkmem (mgr.34373) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:45.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:44 gibba043 bash[24019]: cephadm 2021-03-10T16:46:43.542781+0000 mgr.gibba043.dnkmem (mgr.34373) 9263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:45.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:44 gibba003 bash[31385]: cephadm 2021-03-10T16:46:43.542781+0000 mgr.gibba043.dnkmem (mgr.34373) 9263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:45.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:44 gibba003 bash[32348]: cephadm 2021-03-10T16:46:43.542781+0000 mgr.gibba043.dnkmem (mgr.34373) 9263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:46:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:45 gibba043 bash[24019]: cluster 2021-03-10T16:46:44.871367+0000 mgr.gibba043.dnkmem (mgr.34373) 9264 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:46.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:45 gibba003 bash[32348]: cluster 2021-03-10T16:46:44.871367+0000 mgr.gibba043.dnkmem (mgr.34373) 9264 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:46.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:45 gibba003 bash[31385]: cluster 2021-03-10T16:46:44.871367+0000 mgr.gibba043.dnkmem (mgr.34373) 9264 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:47 gibba003 bash[31385]: cluster 2021-03-10T16:46:46.872352+0000 mgr.gibba043.dnkmem (mgr.34373) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:47 gibba003 bash[32348]: cluster 2021-03-10T16:46:46.872352+0000 mgr.gibba043.dnkmem (mgr.34373) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:47 gibba043 bash[24019]: cluster 2021-03-10T16:46:46.872352+0000 mgr.gibba043.dnkmem (mgr.34373) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:50.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:49 gibba003 bash[31385]: cluster 2021-03-10T16:46:48.873810+0000 mgr.gibba043.dnkmem (mgr.34373) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:50.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:49 gibba003 bash[32348]: cluster 2021-03-10T16:46:48.873810+0000 mgr.gibba043.dnkmem (mgr.34373) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:49 gibba043 bash[24019]: cluster 2021-03-10T16:46:48.873810+0000 mgr.gibba043.dnkmem (mgr.34373) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:51 gibba043 bash[24019]: cluster 2021-03-10T16:46:50.875529+0000 mgr.gibba043.dnkmem (mgr.34373) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:52.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:51 gibba003 bash[31385]: cluster 2021-03-10T16:46:50.875529+0000 mgr.gibba043.dnkmem (mgr.34373) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:52.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:51 gibba003 bash[32348]: cluster 2021-03-10T16:46:50.875529+0000 mgr.gibba043.dnkmem (mgr.34373) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:53 gibba043 bash[24019]: cluster 2021-03-10T16:46:52.876935+0000 mgr.gibba043.dnkmem (mgr.34373) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:54.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:53 gibba003 bash[31385]: cluster 2021-03-10T16:46:52.876935+0000 mgr.gibba043.dnkmem (mgr.34373) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:54.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:53 gibba003 bash[32348]: cluster 2021-03-10T16:46:52.876935+0000 mgr.gibba043.dnkmem (mgr.34373) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:55 gibba043 bash[24019]: cluster 2021-03-10T16:46:54.878533+0000 mgr.gibba043.dnkmem (mgr.34373) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:56.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:55 gibba003 bash[32348]: cluster 2021-03-10T16:46:54.878533+0000 mgr.gibba043.dnkmem (mgr.34373) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:56.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:55 gibba003 bash[31385]: cluster 2021-03-10T16:46:54.878533+0000 mgr.gibba043.dnkmem (mgr.34373) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:56.768 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 16:46:56 gibba043 bash[19809]: level=info ts=2021-03-10T16:46:56.470Z caller=compact.go:507 component=tsdb msg="write block" mint=1615384014576 maxt=1615384800000 ulid=01F0EGHGE6Q28P3VDFE14QFSWD duration=16.03597ms 2021-03-10T16:46:56.768 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 16:46:56 gibba043 bash[19809]: level=info ts=2021-03-10T16:46:56.472Z caller=head.go:847 component=tsdb msg="Head GC completed" duration=1.31088ms 2021-03-10T16:46:58.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:57 gibba003 bash[31385]: cluster 2021-03-10T16:46:56.879374+0000 mgr.gibba043.dnkmem (mgr.34373) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:58.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:57 gibba003 bash[32348]: cluster 2021-03-10T16:46:56.879374+0000 mgr.gibba043.dnkmem (mgr.34373) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:58.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:57 gibba043 bash[24019]: cluster 2021-03-10T16:46:56.879374+0000 mgr.gibba043.dnkmem (mgr.34373) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:00.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.559598+0000 mgr.gibba043.dnkmem (mgr.34373) 9271 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:47:00.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.561219+0000 mgr.gibba043.dnkmem (mgr.34373) 9272 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:47:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.786076+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:47:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.787424+0000 mgr.gibba043.dnkmem (mgr.34373) 9273 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.789482+0000 mgr.gibba043.dnkmem (mgr.34373) 9274 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:00.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.789922+0000 mon.c (mon.1) 2385 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.791011+0000 mgr.gibba043.dnkmem (mgr.34373) 9275 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.791068+0000 mgr.gibba043.dnkmem (mgr.34373) 9276 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.791547+0000 mon.c (mon.1) 2386 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.792744+0000 mgr.gibba043.dnkmem (mgr.34373) 9277 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.792803+0000 mgr.gibba043.dnkmem (mgr.34373) 9278 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.793128+0000 mon.c (mon.1) 2387 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.794020+0000 mgr.gibba043.dnkmem (mgr.34373) 9279 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.794814+0000 mon.c (mon.1) 2388 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.795415+0000 mgr.gibba043.dnkmem (mgr.34373) 9280 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.795476+0000 mgr.gibba043.dnkmem (mgr.34373) 9281 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.796841+0000 mgr.gibba043.dnkmem (mgr.34373) 9282 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.797209+0000 mgr.gibba043.dnkmem (mgr.34373) 9283 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.797725+0000 mon.c (mon.1) 2389 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.798281+0000 mgr.gibba043.dnkmem (mgr.34373) 9284 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.798347+0000 mgr.gibba043.dnkmem (mgr.34373) 9285 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:00.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.559598+0000 mgr.gibba043.dnkmem (mgr.34373) 9271 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:47:00.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.561219+0000 mgr.gibba043.dnkmem (mgr.34373) 9272 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:47:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.786076+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:47:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.787424+0000 mgr.gibba043.dnkmem (mgr.34373) 9273 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.789482+0000 mgr.gibba043.dnkmem (mgr.34373) 9274 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:00.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.789922+0000 mon.c (mon.1) 2385 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.791011+0000 mgr.gibba043.dnkmem (mgr.34373) 9275 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.791068+0000 mgr.gibba043.dnkmem (mgr.34373) 9276 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.791547+0000 mon.c (mon.1) 2386 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.792744+0000 mgr.gibba043.dnkmem (mgr.34373) 9277 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.792803+0000 mgr.gibba043.dnkmem (mgr.34373) 9278 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.793128+0000 mon.c (mon.1) 2387 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.794020+0000 mgr.gibba043.dnkmem (mgr.34373) 9279 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.794814+0000 mon.c (mon.1) 2388 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.795415+0000 mgr.gibba043.dnkmem (mgr.34373) 9280 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.795476+0000 mgr.gibba043.dnkmem (mgr.34373) 9281 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.796841+0000 mgr.gibba043.dnkmem (mgr.34373) 9282 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.797209+0000 mgr.gibba043.dnkmem (mgr.34373) 9283 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.797725+0000 mon.c (mon.1) 2389 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.798281+0000 mgr.gibba043.dnkmem (mgr.34373) 9284 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.798347+0000 mgr.gibba043.dnkmem (mgr.34373) 9285 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:00.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cephadm 2021-03-10T16:46:58.798498+0000 mgr.gibba043.dnkmem (mgr.34373) 9286 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:00.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: audit 2021-03-10T16:46:58.799082+0000 mon.c (mon.1) 2390 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[31385]: cluster 2021-03-10T16:46:58.880960+0000 mgr.gibba043.dnkmem (mgr.34373) 9287 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:00.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cephadm 2021-03-10T16:46:58.798498+0000 mgr.gibba043.dnkmem (mgr.34373) 9286 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:00.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: audit 2021-03-10T16:46:58.799082+0000 mon.c (mon.1) 2390 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:46:59 gibba003 bash[32348]: cluster 2021-03-10T16:46:58.880960+0000 mgr.gibba043.dnkmem (mgr.34373) 9287 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:00.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.559598+0000 mgr.gibba043.dnkmem (mgr.34373) 9271 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:47:00.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.561219+0000 mgr.gibba043.dnkmem (mgr.34373) 9272 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:47:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.786076+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:47:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.787424+0000 mgr.gibba043.dnkmem (mgr.34373) 9273 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.789482+0000 mgr.gibba043.dnkmem (mgr.34373) 9274 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:00.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.789922+0000 mon.c (mon.1) 2385 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.791011+0000 mgr.gibba043.dnkmem (mgr.34373) 9275 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.791068+0000 mgr.gibba043.dnkmem (mgr.34373) 9276 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.791547+0000 mon.c (mon.1) 2386 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.792744+0000 mgr.gibba043.dnkmem (mgr.34373) 9277 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.792803+0000 mgr.gibba043.dnkmem (mgr.34373) 9278 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.793128+0000 mon.c (mon.1) 2387 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.794020+0000 mgr.gibba043.dnkmem (mgr.34373) 9279 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.794814+0000 mon.c (mon.1) 2388 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.795415+0000 mgr.gibba043.dnkmem (mgr.34373) 9280 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.795476+0000 mgr.gibba043.dnkmem (mgr.34373) 9281 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.796841+0000 mgr.gibba043.dnkmem (mgr.34373) 9282 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.797209+0000 mgr.gibba043.dnkmem (mgr.34373) 9283 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.797725+0000 mon.c (mon.1) 2389 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.798281+0000 mgr.gibba043.dnkmem (mgr.34373) 9284 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.798347+0000 mgr.gibba043.dnkmem (mgr.34373) 9285 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cephadm 2021-03-10T16:46:58.798498+0000 mgr.gibba043.dnkmem (mgr.34373) 9286 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: audit 2021-03-10T16:46:58.799082+0000 mon.c (mon.1) 2390 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:46:59 gibba043 bash[24019]: cluster 2021-03-10T16:46:58.880960+0000 mgr.gibba043.dnkmem (mgr.34373) 9287 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:01 gibba043 bash[24019]: cluster 2021-03-10T16:47:00.882517+0000 mgr.gibba043.dnkmem (mgr.34373) 9288 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:02.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:01 gibba003 bash[31385]: cluster 2021-03-10T16:47:00.882517+0000 mgr.gibba043.dnkmem (mgr.34373) 9288 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:02.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:01 gibba003 bash[32348]: cluster 2021-03-10T16:47:00.882517+0000 mgr.gibba043.dnkmem (mgr.34373) 9288 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:03 gibba043 bash[24019]: cluster 2021-03-10T16:47:02.883951+0000 mgr.gibba043.dnkmem (mgr.34373) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:04.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:03 gibba003 bash[31385]: cluster 2021-03-10T16:47:02.883951+0000 mgr.gibba043.dnkmem (mgr.34373) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:04.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:03 gibba003 bash[32348]: cluster 2021-03-10T16:47:02.883951+0000 mgr.gibba043.dnkmem (mgr.34373) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:05 gibba043 bash[24019]: cluster 2021-03-10T16:47:04.885587+0000 mgr.gibba043.dnkmem (mgr.34373) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:06.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:05 gibba003 bash[32348]: cluster 2021-03-10T16:47:04.885587+0000 mgr.gibba043.dnkmem (mgr.34373) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:06.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:05 gibba003 bash[31385]: cluster 2021-03-10T16:47:04.885587+0000 mgr.gibba043.dnkmem (mgr.34373) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:07 gibba003 bash[31385]: cluster 2021-03-10T16:47:06.886407+0000 mgr.gibba043.dnkmem (mgr.34373) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:07 gibba003 bash[32348]: cluster 2021-03-10T16:47:06.886407+0000 mgr.gibba043.dnkmem (mgr.34373) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:07 gibba043 bash[24019]: cluster 2021-03-10T16:47:06.886407+0000 mgr.gibba043.dnkmem (mgr.34373) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:09 gibba043 bash[24019]: cluster 2021-03-10T16:47:08.887882+0000 mgr.gibba043.dnkmem (mgr.34373) 9292 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:10.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:09 gibba003 bash[31385]: cluster 2021-03-10T16:47:08.887882+0000 mgr.gibba043.dnkmem (mgr.34373) 9292 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:10.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:09 gibba003 bash[32348]: cluster 2021-03-10T16:47:08.887882+0000 mgr.gibba043.dnkmem (mgr.34373) 9292 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:11.930 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:47:12.159 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:47:12.159 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:47:12.160 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:47:12.160 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:47:12.161 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:47:12.161 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:47:12.161 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:47:12.162 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:47:12.162 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:47:12.162 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:47:12.163 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:47:12.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:47:12.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:47:12.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:47:12.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:47:12.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:47:12.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:47:12.165 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:47:12.166 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:47:12.166 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:47:12.166 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:47:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:11 gibba043 bash[24019]: cluster 2021-03-10T16:47:10.889550+0000 mgr.gibba043.dnkmem (mgr.34373) 9293 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:12.407 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:47:12.408 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:47:12.408 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:12.408 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:47:12.409 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:47:12.409 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:12.409 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:47:12.409 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:47:12.409 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:47:12.410 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:47:12.410 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:47:12.410 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:47:12.410 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:47:12.411 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:47:12.411 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:47:12.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:11 gibba003 bash[31385]: cluster 2021-03-10T16:47:10.889550+0000 mgr.gibba043.dnkmem (mgr.34373) 9293 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:12.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:11 gibba003 bash[32348]: cluster 2021-03-10T16:47:10.889550+0000 mgr.gibba043.dnkmem (mgr.34373) 9293 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:13.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:12 gibba043 bash[24019]: audit 2021-03-10T16:47:11.924075+0000 mgr.gibba043.dnkmem (mgr.34373) 9294 : audit [DBG] from='client.60268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:13.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:12 gibba043 bash[24019]: audit 2021-03-10T16:47:12.149429+0000 mgr.gibba043.dnkmem (mgr.34373) 9295 : audit [DBG] from='client.50283 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:13.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:12 gibba043 bash[24019]: audit 2021-03-10T16:47:12.411637+0000 mon.c (mon.1) 2391 : audit [DBG] from='client.? 172.21.2.103:0/2215996329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:13.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:12 gibba003 bash[31385]: audit 2021-03-10T16:47:11.924075+0000 mgr.gibba043.dnkmem (mgr.34373) 9294 : audit [DBG] from='client.60268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:13.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:12 gibba003 bash[31385]: audit 2021-03-10T16:47:12.149429+0000 mgr.gibba043.dnkmem (mgr.34373) 9295 : audit [DBG] from='client.50283 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:13.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:12 gibba003 bash[31385]: audit 2021-03-10T16:47:12.411637+0000 mon.c (mon.1) 2391 : audit [DBG] from='client.? 172.21.2.103:0/2215996329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:12 gibba003 bash[32348]: audit 2021-03-10T16:47:11.924075+0000 mgr.gibba043.dnkmem (mgr.34373) 9294 : audit [DBG] from='client.60268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:12 gibba003 bash[32348]: audit 2021-03-10T16:47:12.149429+0000 mgr.gibba043.dnkmem (mgr.34373) 9295 : audit [DBG] from='client.50283 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:13.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:12 gibba003 bash[32348]: audit 2021-03-10T16:47:12.411637+0000 mon.c (mon.1) 2391 : audit [DBG] from='client.? 172.21.2.103:0/2215996329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:13 gibba043 bash[24019]: cluster 2021-03-10T16:47:12.891027+0000 mgr.gibba043.dnkmem (mgr.34373) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:13 gibba043 bash[24019]: audit 2021-03-10T16:47:13.843436+0000 mon.c (mon.1) 2392 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:13 gibba043 bash[24019]: audit 2021-03-10T16:47:13.844539+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:13 gibba003 bash[31385]: cluster 2021-03-10T16:47:12.891027+0000 mgr.gibba043.dnkmem (mgr.34373) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:14.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:13 gibba003 bash[31385]: audit 2021-03-10T16:47:13.843436+0000 mon.c (mon.1) 2392 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:14.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:13 gibba003 bash[31385]: audit 2021-03-10T16:47:13.844539+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:13 gibba003 bash[32348]: cluster 2021-03-10T16:47:12.891027+0000 mgr.gibba043.dnkmem (mgr.34373) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:14.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:13 gibba003 bash[32348]: audit 2021-03-10T16:47:13.843436+0000 mon.c (mon.1) 2392 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:14.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:13 gibba003 bash[32348]: audit 2021-03-10T16:47:13.844539+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: cephadm 2021-03-10T16:47:13.814547+0000 mgr.gibba043.dnkmem (mgr.34373) 9297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:15.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.079804+0000 mon.c (mon.1) 2393 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.080948+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:15.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.339382+0000 mon.c (mon.1) 2394 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:47:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.340204+0000 mon.c (mon.1) 2395 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.340685+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:47:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.340904+0000 mon.c (mon.1) 2396 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:47:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.341574+0000 mon.c (mon.1) 2397 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.342275+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.343373+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:47:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:14 gibba043 bash[24019]: audit 2021-03-10T16:47:14.344184+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: cephadm 2021-03-10T16:47:13.814547+0000 mgr.gibba043.dnkmem (mgr.34373) 9297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.079804+0000 mon.c (mon.1) 2393 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.080948+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.339382+0000 mon.c (mon.1) 2394 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:47:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.340204+0000 mon.c (mon.1) 2395 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.340685+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:47:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.340904+0000 mon.c (mon.1) 2396 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:47:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.341574+0000 mon.c (mon.1) 2397 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.342275+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.343373+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:47:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[31385]: audit 2021-03-10T16:47:14.344184+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: cephadm 2021-03-10T16:47:13.814547+0000 mgr.gibba043.dnkmem (mgr.34373) 9297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.079804+0000 mon.c (mon.1) 2393 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.080948+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.339382+0000 mon.c (mon.1) 2394 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:47:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.340204+0000 mon.c (mon.1) 2395 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.340685+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:47:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.340904+0000 mon.c (mon.1) 2396 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:47:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.341574+0000 mon.c (mon.1) 2397 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.342275+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:47:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.343373+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:47:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:14 gibba003 bash[32348]: audit 2021-03-10T16:47:14.344184+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:16.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:15 gibba043 bash[24019]: cluster 2021-03-10T16:47:14.892954+0000 mgr.gibba043.dnkmem (mgr.34373) 9298 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:15 gibba003 bash[31385]: cluster 2021-03-10T16:47:14.892954+0000 mgr.gibba043.dnkmem (mgr.34373) 9298 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:15 gibba003 bash[32348]: cluster 2021-03-10T16:47:14.892954+0000 mgr.gibba043.dnkmem (mgr.34373) 9298 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:17 gibba003 bash[31385]: cluster 2021-03-10T16:47:16.894442+0000 mgr.gibba043.dnkmem (mgr.34373) 9299 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:18.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:17 gibba003 bash[32348]: cluster 2021-03-10T16:47:16.894442+0000 mgr.gibba043.dnkmem (mgr.34373) 9299 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:17 gibba043 bash[24019]: cluster 2021-03-10T16:47:16.894442+0000 mgr.gibba043.dnkmem (mgr.34373) 9299 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:19 gibba043 bash[24019]: cluster 2021-03-10T16:47:18.896104+0000 mgr.gibba043.dnkmem (mgr.34373) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:20.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:19 gibba003 bash[31385]: cluster 2021-03-10T16:47:18.896104+0000 mgr.gibba043.dnkmem (mgr.34373) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:20.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:19 gibba003 bash[32348]: cluster 2021-03-10T16:47:18.896104+0000 mgr.gibba043.dnkmem (mgr.34373) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:21 gibba043 bash[24019]: cluster 2021-03-10T16:47:20.897600+0000 mgr.gibba043.dnkmem (mgr.34373) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:22.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:21 gibba003 bash[31385]: cluster 2021-03-10T16:47:20.897600+0000 mgr.gibba043.dnkmem (mgr.34373) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:22.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:21 gibba003 bash[32348]: cluster 2021-03-10T16:47:20.897600+0000 mgr.gibba043.dnkmem (mgr.34373) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:24.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:23 gibba043 bash[24019]: cluster 2021-03-10T16:47:22.898979+0000 mgr.gibba043.dnkmem (mgr.34373) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:24.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:23 gibba003 bash[31385]: cluster 2021-03-10T16:47:22.898979+0000 mgr.gibba043.dnkmem (mgr.34373) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:24.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:23 gibba003 bash[32348]: cluster 2021-03-10T16:47:22.898979+0000 mgr.gibba043.dnkmem (mgr.34373) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:25 gibba043 bash[24019]: cluster 2021-03-10T16:47:24.900672+0000 mgr.gibba043.dnkmem (mgr.34373) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:25 gibba003 bash[31385]: cluster 2021-03-10T16:47:24.900672+0000 mgr.gibba043.dnkmem (mgr.34373) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:25 gibba003 bash[32348]: cluster 2021-03-10T16:47:24.900672+0000 mgr.gibba043.dnkmem (mgr.34373) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:27 gibba003 bash[31385]: cluster 2021-03-10T16:47:26.902148+0000 mgr.gibba043.dnkmem (mgr.34373) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:27 gibba003 bash[32348]: cluster 2021-03-10T16:47:26.902148+0000 mgr.gibba043.dnkmem (mgr.34373) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:27 gibba043 bash[24019]: cluster 2021-03-10T16:47:26.902148+0000 mgr.gibba043.dnkmem (mgr.34373) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:29 gibba043 bash[24019]: cephadm 2021-03-10T16:47:28.830283+0000 mgr.gibba043.dnkmem (mgr.34373) 9305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:30.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:29 gibba043 bash[24019]: cluster 2021-03-10T16:47:28.903747+0000 mgr.gibba043.dnkmem (mgr.34373) 9306 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:30.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:29 gibba003 bash[31385]: cephadm 2021-03-10T16:47:28.830283+0000 mgr.gibba043.dnkmem (mgr.34373) 9305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:30.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:29 gibba003 bash[31385]: cluster 2021-03-10T16:47:28.903747+0000 mgr.gibba043.dnkmem (mgr.34373) 9306 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:29 gibba003 bash[32348]: cephadm 2021-03-10T16:47:28.830283+0000 mgr.gibba043.dnkmem (mgr.34373) 9305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:29 gibba003 bash[32348]: cluster 2021-03-10T16:47:28.903747+0000 mgr.gibba043.dnkmem (mgr.34373) 9306 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:31 gibba043 bash[24019]: cluster 2021-03-10T16:47:30.905129+0000 mgr.gibba043.dnkmem (mgr.34373) 9307 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:31 gibba003 bash[31385]: cluster 2021-03-10T16:47:30.905129+0000 mgr.gibba043.dnkmem (mgr.34373) 9307 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:32.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:31 gibba003 bash[32348]: cluster 2021-03-10T16:47:30.905129+0000 mgr.gibba043.dnkmem (mgr.34373) 9307 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:34.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:33 gibba043 bash[24019]: cluster 2021-03-10T16:47:32.906491+0000 mgr.gibba043.dnkmem (mgr.34373) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:33 gibba003 bash[31385]: cluster 2021-03-10T16:47:32.906491+0000 mgr.gibba043.dnkmem (mgr.34373) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:34.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:33 gibba003 bash[32348]: cluster 2021-03-10T16:47:32.906491+0000 mgr.gibba043.dnkmem (mgr.34373) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:35 gibba043 bash[24019]: cluster 2021-03-10T16:47:34.908109+0000 mgr.gibba043.dnkmem (mgr.34373) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:35 gibba003 bash[32348]: cluster 2021-03-10T16:47:34.908109+0000 mgr.gibba043.dnkmem (mgr.34373) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:35 gibba003 bash[31385]: cluster 2021-03-10T16:47:34.908109+0000 mgr.gibba043.dnkmem (mgr.34373) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:37 gibba003 bash[31385]: cluster 2021-03-10T16:47:36.908873+0000 mgr.gibba043.dnkmem (mgr.34373) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:37 gibba003 bash[32348]: cluster 2021-03-10T16:47:36.908873+0000 mgr.gibba043.dnkmem (mgr.34373) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:37 gibba043 bash[24019]: cluster 2021-03-10T16:47:36.908873+0000 mgr.gibba043.dnkmem (mgr.34373) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:39 gibba043 bash[24019]: cluster 2021-03-10T16:47:38.910452+0000 mgr.gibba043.dnkmem (mgr.34373) 9311 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:40.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:39 gibba003 bash[31385]: cluster 2021-03-10T16:47:38.910452+0000 mgr.gibba043.dnkmem (mgr.34373) 9311 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:40.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:39 gibba003 bash[32348]: cluster 2021-03-10T16:47:38.910452+0000 mgr.gibba043.dnkmem (mgr.34373) 9311 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:41 gibba043 bash[24019]: cluster 2021-03-10T16:47:40.912022+0000 mgr.gibba043.dnkmem (mgr.34373) 9312 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:41 gibba003 bash[31385]: cluster 2021-03-10T16:47:40.912022+0000 mgr.gibba043.dnkmem (mgr.34373) 9312 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:41 gibba003 bash[32348]: cluster 2021-03-10T16:47:40.912022+0000 mgr.gibba043.dnkmem (mgr.34373) 9312 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.649 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:47:42.881 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:47:42.882 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:47:42.882 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:47:42.883 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:47:42.883 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:47:42.883 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:47:42.884 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:47:42.884 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:47:42.885 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:47:42.885 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:47:42.886 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:47:42.886 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:47:42.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:47:42.888 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:47:42.888 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:47:42.889 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:47:42.889 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:47:42.889 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:47:42.890 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:47:42.890 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:47:42.890 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:47:43.130 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:47:43.130 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:47:43.131 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:43.131 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:47:43.131 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:47:43.131 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:43.132 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:47:43.132 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:47:43.132 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:47:43.132 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:47:43.133 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:47:43.133 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:47:43.133 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:47:43.133 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:47:43.133 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:47:44.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:43 gibba043 bash[24019]: audit 2021-03-10T16:47:42.643698+0000 mgr.gibba043.dnkmem (mgr.34373) 9313 : audit [DBG] from='client.60286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:43 gibba043 bash[24019]: audit 2021-03-10T16:47:42.870739+0000 mgr.gibba043.dnkmem (mgr.34373) 9314 : audit [DBG] from='client.60292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:43 gibba043 bash[24019]: cluster 2021-03-10T16:47:42.912541+0000 mgr.gibba043.dnkmem (mgr.34373) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:44.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:44 gibba043 bash[24019]: audit 2021-03-10T16:47:43.134048+0000 mon.a (mon.0) 1938 : audit [DBG] from='client.? 172.21.2.103:0/2237192887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:44.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:43 gibba003 bash[31385]: audit 2021-03-10T16:47:42.643698+0000 mgr.gibba043.dnkmem (mgr.34373) 9313 : audit [DBG] from='client.60286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:44.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:43 gibba003 bash[31385]: audit 2021-03-10T16:47:42.870739+0000 mgr.gibba043.dnkmem (mgr.34373) 9314 : audit [DBG] from='client.60292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:44.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:43 gibba003 bash[31385]: cluster 2021-03-10T16:47:42.912541+0000 mgr.gibba043.dnkmem (mgr.34373) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:44.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:44 gibba003 bash[31385]: audit 2021-03-10T16:47:43.134048+0000 mon.a (mon.0) 1938 : audit [DBG] from='client.? 172.21.2.103:0/2237192887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:44.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:44 gibba003 bash[32348]: audit 2021-03-10T16:47:42.643698+0000 mgr.gibba043.dnkmem (mgr.34373) 9313 : audit [DBG] from='client.60286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:44.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:44 gibba003 bash[32348]: audit 2021-03-10T16:47:42.870739+0000 mgr.gibba043.dnkmem (mgr.34373) 9314 : audit [DBG] from='client.60292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:44 gibba003 bash[32348]: cluster 2021-03-10T16:47:42.912541+0000 mgr.gibba043.dnkmem (mgr.34373) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:44.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:44 gibba003 bash[32348]: audit 2021-03-10T16:47:43.134048+0000 mon.a (mon.0) 1938 : audit [DBG] from='client.? 172.21.2.103:0/2237192887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:45.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:45 gibba043 bash[24019]: cephadm 2021-03-10T16:47:43.846412+0000 mgr.gibba043.dnkmem (mgr.34373) 9316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:45.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:45 gibba003 bash[31385]: cephadm 2021-03-10T16:47:43.846412+0000 mgr.gibba043.dnkmem (mgr.34373) 9316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:45.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:45 gibba003 bash[32348]: cephadm 2021-03-10T16:47:43.846412+0000 mgr.gibba043.dnkmem (mgr.34373) 9316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:47:46.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:46 gibba043 bash[24019]: cluster 2021-03-10T16:47:44.914121+0000 mgr.gibba043.dnkmem (mgr.34373) 9317 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:46 gibba003 bash[31385]: cluster 2021-03-10T16:47:44.914121+0000 mgr.gibba043.dnkmem (mgr.34373) 9317 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:46 gibba003 bash[32348]: cluster 2021-03-10T16:47:44.914121+0000 mgr.gibba043.dnkmem (mgr.34373) 9317 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:47 gibba003 bash[31385]: cluster 2021-03-10T16:47:46.914982+0000 mgr.gibba043.dnkmem (mgr.34373) 9318 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:47 gibba003 bash[32348]: cluster 2021-03-10T16:47:46.914982+0000 mgr.gibba043.dnkmem (mgr.34373) 9318 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:47 gibba043 bash[24019]: cluster 2021-03-10T16:47:46.914982+0000 mgr.gibba043.dnkmem (mgr.34373) 9318 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:49 gibba043 bash[24019]: cluster 2021-03-10T16:47:48.916597+0000 mgr.gibba043.dnkmem (mgr.34373) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:50.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:49 gibba003 bash[31385]: cluster 2021-03-10T16:47:48.916597+0000 mgr.gibba043.dnkmem (mgr.34373) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:50.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:49 gibba003 bash[32348]: cluster 2021-03-10T16:47:48.916597+0000 mgr.gibba043.dnkmem (mgr.34373) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:51 gibba043 bash[24019]: cluster 2021-03-10T16:47:50.917986+0000 mgr.gibba043.dnkmem (mgr.34373) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:51 gibba003 bash[31385]: cluster 2021-03-10T16:47:50.917986+0000 mgr.gibba043.dnkmem (mgr.34373) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:51 gibba003 bash[32348]: cluster 2021-03-10T16:47:50.917986+0000 mgr.gibba043.dnkmem (mgr.34373) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:53 gibba043 bash[24019]: cluster 2021-03-10T16:47:52.919480+0000 mgr.gibba043.dnkmem (mgr.34373) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:53 gibba003 bash[31385]: cluster 2021-03-10T16:47:52.919480+0000 mgr.gibba043.dnkmem (mgr.34373) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:54 gibba003 bash[32348]: cluster 2021-03-10T16:47:52.919480+0000 mgr.gibba043.dnkmem (mgr.34373) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:56.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:56 gibba043 bash[24019]: cluster 2021-03-10T16:47:54.921006+0000 mgr.gibba043.dnkmem (mgr.34373) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:56.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:56 gibba003 bash[31385]: cluster 2021-03-10T16:47:54.921006+0000 mgr.gibba043.dnkmem (mgr.34373) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:56.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:56 gibba003 bash[32348]: cluster 2021-03-10T16:47:54.921006+0000 mgr.gibba043.dnkmem (mgr.34373) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:57 gibba003 bash[31385]: cluster 2021-03-10T16:47:56.922626+0000 mgr.gibba043.dnkmem (mgr.34373) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:57 gibba003 bash[32348]: cluster 2021-03-10T16:47:56.922626+0000 mgr.gibba043.dnkmem (mgr.34373) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:57 gibba043 bash[24019]: cluster 2021-03-10T16:47:56.922626+0000 mgr.gibba043.dnkmem (mgr.34373) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:59.161 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:58 gibba003 bash[31385]: audit 2021-03-10T16:47:58.856517+0000 mon.c (mon.1) 2398 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:47:59.162 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:58 gibba003 bash[32348]: audit 2021-03-10T16:47:58.856517+0000 mon.c (mon.1) 2398 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:47:59.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:58 gibba043 bash[24019]: audit 2021-03-10T16:47:58.856517+0000 mon.c (mon.1) 2398 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:48:00.163 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:59 gibba003 bash[31385]: cephadm 2021-03-10T16:47:58.854207+0000 mgr.gibba043.dnkmem (mgr.34373) 9324 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:48:00.164 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:47:59 gibba003 bash[31385]: cluster 2021-03-10T16:47:58.923129+0000 mgr.gibba043.dnkmem (mgr.34373) 9325 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:00.164 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:59 gibba003 bash[32348]: cephadm 2021-03-10T16:47:58.854207+0000 mgr.gibba043.dnkmem (mgr.34373) 9324 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:48:00.164 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:47:59 gibba003 bash[32348]: cluster 2021-03-10T16:47:58.923129+0000 mgr.gibba043.dnkmem (mgr.34373) 9325 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:59 gibba043 bash[24019]: cephadm 2021-03-10T16:47:58.854207+0000 mgr.gibba043.dnkmem (mgr.34373) 9324 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:48:00.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:47:59 gibba043 bash[24019]: cluster 2021-03-10T16:47:58.923129+0000 mgr.gibba043.dnkmem (mgr.34373) 9325 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:02.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:01 gibba043 bash[24019]: cluster 2021-03-10T16:48:00.924632+0000 mgr.gibba043.dnkmem (mgr.34373) 9326 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:02.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:01 gibba003 bash[31385]: cluster 2021-03-10T16:48:00.924632+0000 mgr.gibba043.dnkmem (mgr.34373) 9326 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:02.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:01 gibba003 bash[32348]: cluster 2021-03-10T16:48:00.924632+0000 mgr.gibba043.dnkmem (mgr.34373) 9326 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: cluster 2021-03-10T16:48:02.926091+0000 mgr.gibba043.dnkmem (mgr.34373) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.323431+0000 mon.c (mon.1) 2399 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:48:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.500036+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:48:04.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.695422+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:48:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.702709+0000 mon.c (mon.1) 2400 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.704816+0000 mon.c (mon.1) 2401 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.706671+0000 mon.c (mon.1) 2402 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.707999+0000 mon.c (mon.1) 2403 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.711347+0000 mon.c (mon.1) 2404 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:03 gibba043 bash[24019]: audit 2021-03-10T16:48:03.713229+0000 mon.c (mon.1) 2405 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: cluster 2021-03-10T16:48:02.926091+0000 mgr.gibba043.dnkmem (mgr.34373) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.323431+0000 mon.c (mon.1) 2399 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:48:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.500036+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:48:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.695422+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:48:04.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.702709+0000 mon.c (mon.1) 2400 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:04.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.704816+0000 mon.c (mon.1) 2401 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.706671+0000 mon.c (mon.1) 2402 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.707999+0000 mon.c (mon.1) 2403 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.711347+0000 mon.c (mon.1) 2404 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[31385]: audit 2021-03-10T16:48:03.713229+0000 mon.c (mon.1) 2405 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: cluster 2021-03-10T16:48:02.926091+0000 mgr.gibba043.dnkmem (mgr.34373) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.323431+0000 mon.c (mon.1) 2399 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:48:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.500036+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:48:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.695422+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:48:04.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.702709+0000 mon.c (mon.1) 2400 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:04.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.704816+0000 mon.c (mon.1) 2401 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.706671+0000 mon.c (mon.1) 2402 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.707999+0000 mon.c (mon.1) 2403 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.711347+0000 mon.c (mon.1) 2404 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:04.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:03 gibba003 bash[32348]: audit 2021-03-10T16:48:03.713229+0000 mon.c (mon.1) 2405 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:05.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.500601+0000 mgr.gibba043.dnkmem (mgr.34373) 9328 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:48:05.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.700279+0000 mgr.gibba043.dnkmem (mgr.34373) 9329 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.702595+0000 mgr.gibba043.dnkmem (mgr.34373) 9330 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.704473+0000 mgr.gibba043.dnkmem (mgr.34373) 9331 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:05.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.704510+0000 mgr.gibba043.dnkmem (mgr.34373) 9332 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.705988+0000 mgr.gibba043.dnkmem (mgr.34373) 9333 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.706026+0000 mgr.gibba043.dnkmem (mgr.34373) 9334 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.707332+0000 mgr.gibba043.dnkmem (mgr.34373) 9335 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.709203+0000 mgr.gibba043.dnkmem (mgr.34373) 9336 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.709243+0000 mgr.gibba043.dnkmem (mgr.34373) 9337 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.710871+0000 mgr.gibba043.dnkmem (mgr.34373) 9338 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.711236+0000 mgr.gibba043.dnkmem (mgr.34373) 9339 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.712751+0000 mgr.gibba043.dnkmem (mgr.34373) 9340 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.712798+0000 mgr.gibba043.dnkmem (mgr.34373) 9341 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:05 gibba043 bash[24019]: cephadm 2021-03-10T16:48:03.712920+0000 mgr.gibba043.dnkmem (mgr.34373) 9342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.500601+0000 mgr.gibba043.dnkmem (mgr.34373) 9328 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:48:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.700279+0000 mgr.gibba043.dnkmem (mgr.34373) 9329 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.702595+0000 mgr.gibba043.dnkmem (mgr.34373) 9330 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:05.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.704473+0000 mgr.gibba043.dnkmem (mgr.34373) 9331 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:05.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.704510+0000 mgr.gibba043.dnkmem (mgr.34373) 9332 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:05.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.705988+0000 mgr.gibba043.dnkmem (mgr.34373) 9333 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:05.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.706026+0000 mgr.gibba043.dnkmem (mgr.34373) 9334 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:05.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.707332+0000 mgr.gibba043.dnkmem (mgr.34373) 9335 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.709203+0000 mgr.gibba043.dnkmem (mgr.34373) 9336 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.709243+0000 mgr.gibba043.dnkmem (mgr.34373) 9337 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.710871+0000 mgr.gibba043.dnkmem (mgr.34373) 9338 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:05.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.711236+0000 mgr.gibba043.dnkmem (mgr.34373) 9339 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.712751+0000 mgr.gibba043.dnkmem (mgr.34373) 9340 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.712798+0000 mgr.gibba043.dnkmem (mgr.34373) 9341 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[31385]: cephadm 2021-03-10T16:48:03.712920+0000 mgr.gibba043.dnkmem (mgr.34373) 9342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:05.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.500601+0000 mgr.gibba043.dnkmem (mgr.34373) 9328 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:48:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.700279+0000 mgr.gibba043.dnkmem (mgr.34373) 9329 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.702595+0000 mgr.gibba043.dnkmem (mgr.34373) 9330 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.704473+0000 mgr.gibba043.dnkmem (mgr.34373) 9331 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.704510+0000 mgr.gibba043.dnkmem (mgr.34373) 9332 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.705988+0000 mgr.gibba043.dnkmem (mgr.34373) 9333 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.706026+0000 mgr.gibba043.dnkmem (mgr.34373) 9334 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.707332+0000 mgr.gibba043.dnkmem (mgr.34373) 9335 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.709203+0000 mgr.gibba043.dnkmem (mgr.34373) 9336 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.709243+0000 mgr.gibba043.dnkmem (mgr.34373) 9337 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.710871+0000 mgr.gibba043.dnkmem (mgr.34373) 9338 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.711236+0000 mgr.gibba043.dnkmem (mgr.34373) 9339 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.712751+0000 mgr.gibba043.dnkmem (mgr.34373) 9340 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.712798+0000 mgr.gibba043.dnkmem (mgr.34373) 9341 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:05 gibba003 bash[32348]: cephadm 2021-03-10T16:48:03.712920+0000 mgr.gibba043.dnkmem (mgr.34373) 9342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:06.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:06 gibba043 bash[24019]: cluster 2021-03-10T16:48:04.927586+0000 mgr.gibba043.dnkmem (mgr.34373) 9343 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:06 gibba003 bash[31385]: cluster 2021-03-10T16:48:04.927586+0000 mgr.gibba043.dnkmem (mgr.34373) 9343 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:06 gibba003 bash[32348]: cluster 2021-03-10T16:48:04.927586+0000 mgr.gibba043.dnkmem (mgr.34373) 9343 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:07 gibba003 bash[31385]: cluster 2021-03-10T16:48:06.928682+0000 mgr.gibba043.dnkmem (mgr.34373) 9344 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:08.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:07 gibba003 bash[32348]: cluster 2021-03-10T16:48:06.928682+0000 mgr.gibba043.dnkmem (mgr.34373) 9344 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:07 gibba043 bash[24019]: cluster 2021-03-10T16:48:06.928682+0000 mgr.gibba043.dnkmem (mgr.34373) 9344 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:09 gibba043 bash[24019]: cluster 2021-03-10T16:48:08.930094+0000 mgr.gibba043.dnkmem (mgr.34373) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:10.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:09 gibba003 bash[31385]: cluster 2021-03-10T16:48:08.930094+0000 mgr.gibba043.dnkmem (mgr.34373) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:10.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:09 gibba003 bash[32348]: cluster 2021-03-10T16:48:08.930094+0000 mgr.gibba043.dnkmem (mgr.34373) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:12 gibba043 bash[24019]: cluster 2021-03-10T16:48:10.931523+0000 mgr.gibba043.dnkmem (mgr.34373) 9346 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:12 gibba003 bash[31385]: cluster 2021-03-10T16:48:10.931523+0000 mgr.gibba043.dnkmem (mgr.34373) 9346 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:12 gibba003 bash[32348]: cluster 2021-03-10T16:48:10.931523+0000 mgr.gibba043.dnkmem (mgr.34373) 9346 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:13.371 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:48:13.625 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:48:13.625 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:48:13.626 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:48:13.626 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:48:13.627 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:48:13.627 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:48:13.627 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:48:13.628 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:48:13.628 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:48:13.629 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:48:13.629 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:48:13.630 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:48:13.630 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:48:13.630 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:48:13.631 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:48:13.631 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:48:13.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:48:13.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:48:13.633 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:48:13.633 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:48:13.633 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:48:13.875 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:48:13.876 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:48:13.876 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:13.876 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:48:13.876 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:48:13.877 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:13.877 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:48:13.877 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:48:13.877 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:48:13.877 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:48:13.878 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:48:13.878 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:48:13.878 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:48:13.878 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:48:13.879 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:48:14.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:14 gibba043 bash[24019]: cluster 2021-03-10T16:48:12.932841+0000 mgr.gibba043.dnkmem (mgr.34373) 9347 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:14 gibba043 bash[24019]: audit 2021-03-10T16:48:13.849815+0000 mon.c (mon.1) 2406 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:14 gibba043 bash[24019]: audit 2021-03-10T16:48:13.850241+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:14.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:14 gibba043 bash[24019]: audit 2021-03-10T16:48:13.879494+0000 mon.c (mon.1) 2407 : audit [DBG] from='client.? 172.21.2.103:0/807697472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[31385]: cluster 2021-03-10T16:48:12.932841+0000 mgr.gibba043.dnkmem (mgr.34373) 9347 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[31385]: audit 2021-03-10T16:48:13.849815+0000 mon.c (mon.1) 2406 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:14.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[31385]: audit 2021-03-10T16:48:13.850241+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:14.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[31385]: audit 2021-03-10T16:48:13.879494+0000 mon.c (mon.1) 2407 : audit [DBG] from='client.? 172.21.2.103:0/807697472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[32348]: cluster 2021-03-10T16:48:12.932841+0000 mgr.gibba043.dnkmem (mgr.34373) 9347 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[32348]: audit 2021-03-10T16:48:13.849815+0000 mon.c (mon.1) 2406 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:14.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[32348]: audit 2021-03-10T16:48:13.850241+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:14.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:14 gibba003 bash[32348]: audit 2021-03-10T16:48:13.879494+0000 mon.c (mon.1) 2407 : audit [DBG] from='client.? 172.21.2.103:0/807697472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:13.365312+0000 mgr.gibba043.dnkmem (mgr.34373) 9348 : audit [DBG] from='client.50313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:13.587522+0000 mgr.gibba043.dnkmem (mgr.34373) 9349 : audit [DBG] from='client.60310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.086687+0000 mon.c (mon.1) 2408 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.087625+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.352945+0000 mon.c (mon.1) 2409 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:48:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.353713+0000 mon.c (mon.1) 2410 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.354189+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:48:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.354430+0000 mon.c (mon.1) 2411 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:48:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.355408+0000 mon.c (mon.1) 2412 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.355731+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.356694+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:48:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[31385]: audit 2021-03-10T16:48:14.357532+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:13.365312+0000 mgr.gibba043.dnkmem (mgr.34373) 9348 : audit [DBG] from='client.50313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:13.587522+0000 mgr.gibba043.dnkmem (mgr.34373) 9349 : audit [DBG] from='client.60310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.086687+0000 mon.c (mon.1) 2408 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.087625+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.352945+0000 mon.c (mon.1) 2409 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:48:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.353713+0000 mon.c (mon.1) 2410 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.354189+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:48:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.354430+0000 mon.c (mon.1) 2411 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:48:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.355408+0000 mon.c (mon.1) 2412 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.355731+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.356694+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:48:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:15 gibba003 bash[32348]: audit 2021-03-10T16:48:14.357532+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:13.365312+0000 mgr.gibba043.dnkmem (mgr.34373) 9348 : audit [DBG] from='client.50313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:13.587522+0000 mgr.gibba043.dnkmem (mgr.34373) 9349 : audit [DBG] from='client.60310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.086687+0000 mon.c (mon.1) 2408 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.087625+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.352945+0000 mon.c (mon.1) 2409 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:48:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.353713+0000 mon.c (mon.1) 2410 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.354189+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:48:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.354430+0000 mon.c (mon.1) 2411 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:48:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.355408+0000 mon.c (mon.1) 2412 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.355731+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:48:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.356694+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:48:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:15 gibba043 bash[24019]: audit 2021-03-10T16:48:14.357532+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:16.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:16 gibba003 bash[31385]: cluster 2021-03-10T16:48:14.934427+0000 mgr.gibba043.dnkmem (mgr.34373) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:16 gibba003 bash[32348]: cluster 2021-03-10T16:48:14.934427+0000 mgr.gibba043.dnkmem (mgr.34373) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:16 gibba043 bash[24019]: cluster 2021-03-10T16:48:14.934427+0000 mgr.gibba043.dnkmem (mgr.34373) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:17 gibba003 bash[31385]: cluster 2021-03-10T16:48:16.935400+0000 mgr.gibba043.dnkmem (mgr.34373) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:17 gibba003 bash[32348]: cluster 2021-03-10T16:48:16.935400+0000 mgr.gibba043.dnkmem (mgr.34373) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:17 gibba043 bash[24019]: cluster 2021-03-10T16:48:16.935400+0000 mgr.gibba043.dnkmem (mgr.34373) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:20 gibba043 bash[24019]: cephadm 2021-03-10T16:48:18.728680+0000 mgr.gibba043.dnkmem (mgr.34373) 9352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:20.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:20 gibba043 bash[24019]: cluster 2021-03-10T16:48:18.936851+0000 mgr.gibba043.dnkmem (mgr.34373) 9353 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:20.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:20 gibba003 bash[31385]: cephadm 2021-03-10T16:48:18.728680+0000 mgr.gibba043.dnkmem (mgr.34373) 9352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:20.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:20 gibba003 bash[31385]: cluster 2021-03-10T16:48:18.936851+0000 mgr.gibba043.dnkmem (mgr.34373) 9353 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:20.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:20 gibba003 bash[32348]: cephadm 2021-03-10T16:48:18.728680+0000 mgr.gibba043.dnkmem (mgr.34373) 9352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:20.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:20 gibba003 bash[32348]: cluster 2021-03-10T16:48:18.936851+0000 mgr.gibba043.dnkmem (mgr.34373) 9353 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:22 gibba043 bash[24019]: cluster 2021-03-10T16:48:20.938410+0000 mgr.gibba043.dnkmem (mgr.34373) 9354 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:22 gibba003 bash[31385]: cluster 2021-03-10T16:48:20.938410+0000 mgr.gibba043.dnkmem (mgr.34373) 9354 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:22 gibba003 bash[32348]: cluster 2021-03-10T16:48:20.938410+0000 mgr.gibba043.dnkmem (mgr.34373) 9354 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:24 gibba043 bash[24019]: cluster 2021-03-10T16:48:22.939839+0000 mgr.gibba043.dnkmem (mgr.34373) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:24 gibba003 bash[31385]: cluster 2021-03-10T16:48:22.939839+0000 mgr.gibba043.dnkmem (mgr.34373) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:24 gibba003 bash[32348]: cluster 2021-03-10T16:48:22.939839+0000 mgr.gibba043.dnkmem (mgr.34373) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:26.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:26 gibba003 bash[31385]: cluster 2021-03-10T16:48:24.941502+0000 mgr.gibba043.dnkmem (mgr.34373) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:26.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:26 gibba003 bash[32348]: cluster 2021-03-10T16:48:24.941502+0000 mgr.gibba043.dnkmem (mgr.34373) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:26 gibba043 bash[24019]: cluster 2021-03-10T16:48:24.941502+0000 mgr.gibba043.dnkmem (mgr.34373) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:27 gibba003 bash[31385]: cluster 2021-03-10T16:48:26.942398+0000 mgr.gibba043.dnkmem (mgr.34373) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:27 gibba003 bash[32348]: cluster 2021-03-10T16:48:26.942398+0000 mgr.gibba043.dnkmem (mgr.34373) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:27 gibba043 bash[24019]: cluster 2021-03-10T16:48:26.942398+0000 mgr.gibba043.dnkmem (mgr.34373) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:30.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:30 gibba043 bash[24019]: cluster 2021-03-10T16:48:28.943854+0000 mgr.gibba043.dnkmem (mgr.34373) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:30.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:30 gibba003 bash[31385]: cluster 2021-03-10T16:48:28.943854+0000 mgr.gibba043.dnkmem (mgr.34373) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:30.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:30 gibba003 bash[32348]: cluster 2021-03-10T16:48:28.943854+0000 mgr.gibba043.dnkmem (mgr.34373) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:32.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:32 gibba043 bash[24019]: cluster 2021-03-10T16:48:30.945220+0000 mgr.gibba043.dnkmem (mgr.34373) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:32 gibba003 bash[31385]: cluster 2021-03-10T16:48:30.945220+0000 mgr.gibba043.dnkmem (mgr.34373) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:32.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:32 gibba003 bash[32348]: cluster 2021-03-10T16:48:30.945220+0000 mgr.gibba043.dnkmem (mgr.34373) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:34 gibba003 bash[31385]: cluster 2021-03-10T16:48:32.946712+0000 mgr.gibba043.dnkmem (mgr.34373) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:34 gibba003 bash[32348]: cluster 2021-03-10T16:48:32.946712+0000 mgr.gibba043.dnkmem (mgr.34373) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:34 gibba043 bash[24019]: cluster 2021-03-10T16:48:32.946712+0000 mgr.gibba043.dnkmem (mgr.34373) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:35.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:35 gibba003 bash[31385]: cephadm 2021-03-10T16:48:33.744756+0000 mgr.gibba043.dnkmem (mgr.34373) 9361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:35.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:35 gibba003 bash[32348]: cephadm 2021-03-10T16:48:33.744756+0000 mgr.gibba043.dnkmem (mgr.34373) 9361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:35.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:35 gibba043 bash[24019]: cephadm 2021-03-10T16:48:33.744756+0000 mgr.gibba043.dnkmem (mgr.34373) 9361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:36 gibba003 bash[31385]: cluster 2021-03-10T16:48:34.948639+0000 mgr.gibba043.dnkmem (mgr.34373) 9362 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:36 gibba003 bash[32348]: cluster 2021-03-10T16:48:34.948639+0000 mgr.gibba043.dnkmem (mgr.34373) 9362 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:36 gibba043 bash[24019]: cluster 2021-03-10T16:48:34.948639+0000 mgr.gibba043.dnkmem (mgr.34373) 9362 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:37 gibba003 bash[31385]: cluster 2021-03-10T16:48:36.950042+0000 mgr.gibba043.dnkmem (mgr.34373) 9363 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:37 gibba003 bash[32348]: cluster 2021-03-10T16:48:36.950042+0000 mgr.gibba043.dnkmem (mgr.34373) 9363 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:37 gibba043 bash[24019]: cluster 2021-03-10T16:48:36.950042+0000 mgr.gibba043.dnkmem (mgr.34373) 9363 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:40 gibba043 bash[24019]: cluster 2021-03-10T16:48:38.951621+0000 mgr.gibba043.dnkmem (mgr.34373) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:40.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:40 gibba003 bash[31385]: cluster 2021-03-10T16:48:38.951621+0000 mgr.gibba043.dnkmem (mgr.34373) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:40.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:40 gibba003 bash[32348]: cluster 2021-03-10T16:48:38.951621+0000 mgr.gibba043.dnkmem (mgr.34373) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:42 gibba003 bash[31385]: cluster 2021-03-10T16:48:40.953334+0000 mgr.gibba043.dnkmem (mgr.34373) 9365 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:42 gibba003 bash[32348]: cluster 2021-03-10T16:48:40.953334+0000 mgr.gibba043.dnkmem (mgr.34373) 9365 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:42 gibba043 bash[24019]: cluster 2021-03-10T16:48:40.953334+0000 mgr.gibba043.dnkmem (mgr.34373) 9365 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.122 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:48:44.349 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:48:44.350 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:48:44.350 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:48:44.351 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:48:44.351 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:48:44.351 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:48:44.352 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:48:44.352 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:48:44.353 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:48:44.353 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:48:44.354 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:48:44.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:48:44.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:48:44.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:48:44.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:48:44.356 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:48:44.356 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:48:44.356 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:48:44.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:48:44.357 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:48:44.358 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:48:44.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:44 gibba003 bash[31385]: cluster 2021-03-10T16:48:42.954581+0000 mgr.gibba043.dnkmem (mgr.34373) 9366 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:44 gibba003 bash[32348]: cluster 2021-03-10T16:48:42.954581+0000 mgr.gibba043.dnkmem (mgr.34373) 9366 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:44 gibba043 bash[24019]: cluster 2021-03-10T16:48:42.954581+0000 mgr.gibba043.dnkmem (mgr.34373) 9366 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.601 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:48:44.601 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:48:44.601 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:44.602 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:48:44.602 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:48:44.602 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:44.602 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:48:44.603 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:48:44.603 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:48:44.603 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:48:44.603 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:48:44.604 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:48:44.604 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:48:44.604 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:48:44.604 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:48:45.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:45 gibba003 bash[31385]: audit 2021-03-10T16:48:44.116180+0000 mgr.gibba043.dnkmem (mgr.34373) 9367 : audit [DBG] from='client.50331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:45.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:45 gibba003 bash[31385]: audit 2021-03-10T16:48:44.604940+0000 mon.c (mon.1) 2413 : audit [DBG] from='client.? 172.21.2.103:0/3844731309' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:45.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:45 gibba003 bash[32348]: audit 2021-03-10T16:48:44.116180+0000 mgr.gibba043.dnkmem (mgr.34373) 9367 : audit [DBG] from='client.50331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:45.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:45 gibba003 bash[32348]: audit 2021-03-10T16:48:44.604940+0000 mon.c (mon.1) 2413 : audit [DBG] from='client.? 172.21.2.103:0/3844731309' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:45.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:45 gibba043 bash[24019]: audit 2021-03-10T16:48:44.116180+0000 mgr.gibba043.dnkmem (mgr.34373) 9367 : audit [DBG] from='client.50331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:45.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:45 gibba043 bash[24019]: audit 2021-03-10T16:48:44.604940+0000 mon.c (mon.1) 2413 : audit [DBG] from='client.? 172.21.2.103:0/3844731309' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:46.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:46 gibba003 bash[32348]: audit 2021-03-10T16:48:44.339605+0000 mgr.gibba043.dnkmem (mgr.34373) 9368 : audit [DBG] from='client.60328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:46.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:46 gibba003 bash[32348]: cluster 2021-03-10T16:48:44.956492+0000 mgr.gibba043.dnkmem (mgr.34373) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:46 gibba003 bash[31385]: audit 2021-03-10T16:48:44.339605+0000 mgr.gibba043.dnkmem (mgr.34373) 9368 : audit [DBG] from='client.60328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:46 gibba003 bash[31385]: cluster 2021-03-10T16:48:44.956492+0000 mgr.gibba043.dnkmem (mgr.34373) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:46 gibba043 bash[24019]: audit 2021-03-10T16:48:44.339605+0000 mgr.gibba043.dnkmem (mgr.34373) 9368 : audit [DBG] from='client.60328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:46 gibba043 bash[24019]: cluster 2021-03-10T16:48:44.956492+0000 mgr.gibba043.dnkmem (mgr.34373) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:47 gibba003 bash[31385]: cluster 2021-03-10T16:48:46.957163+0000 mgr.gibba043.dnkmem (mgr.34373) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:47 gibba003 bash[32348]: cluster 2021-03-10T16:48:46.957163+0000 mgr.gibba043.dnkmem (mgr.34373) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:47 gibba043 bash[24019]: cluster 2021-03-10T16:48:46.957163+0000 mgr.gibba043.dnkmem (mgr.34373) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:50 gibba043 bash[24019]: cephadm 2021-03-10T16:48:48.760832+0000 mgr.gibba043.dnkmem (mgr.34373) 9371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:50.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:50 gibba043 bash[24019]: cluster 2021-03-10T16:48:48.958644+0000 mgr.gibba043.dnkmem (mgr.34373) 9372 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:50.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:50 gibba003 bash[31385]: cephadm 2021-03-10T16:48:48.760832+0000 mgr.gibba043.dnkmem (mgr.34373) 9371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:50.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:50 gibba003 bash[31385]: cluster 2021-03-10T16:48:48.958644+0000 mgr.gibba043.dnkmem (mgr.34373) 9372 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:50.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:50 gibba003 bash[32348]: cephadm 2021-03-10T16:48:48.760832+0000 mgr.gibba043.dnkmem (mgr.34373) 9371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:48:50.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:50 gibba003 bash[32348]: cluster 2021-03-10T16:48:48.958644+0000 mgr.gibba043.dnkmem (mgr.34373) 9372 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:52 gibba003 bash[31385]: cluster 2021-03-10T16:48:50.960418+0000 mgr.gibba043.dnkmem (mgr.34373) 9373 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:52 gibba003 bash[32348]: cluster 2021-03-10T16:48:50.960418+0000 mgr.gibba043.dnkmem (mgr.34373) 9373 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:52 gibba043 bash[24019]: cluster 2021-03-10T16:48:50.960418+0000 mgr.gibba043.dnkmem (mgr.34373) 9373 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:54 gibba003 bash[31385]: cluster 2021-03-10T16:48:52.961769+0000 mgr.gibba043.dnkmem (mgr.34373) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:54 gibba003 bash[32348]: cluster 2021-03-10T16:48:52.961769+0000 mgr.gibba043.dnkmem (mgr.34373) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:54 gibba043 bash[24019]: cluster 2021-03-10T16:48:52.961769+0000 mgr.gibba043.dnkmem (mgr.34373) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:56.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:56 gibba003 bash[31385]: cluster 2021-03-10T16:48:54.963410+0000 mgr.gibba043.dnkmem (mgr.34373) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:56.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:56 gibba003 bash[32348]: cluster 2021-03-10T16:48:54.963410+0000 mgr.gibba043.dnkmem (mgr.34373) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:56.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:56 gibba043 bash[24019]: cluster 2021-03-10T16:48:54.963410+0000 mgr.gibba043.dnkmem (mgr.34373) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:48:57 gibba003 bash[31385]: cluster 2021-03-10T16:48:56.964340+0000 mgr.gibba043.dnkmem (mgr.34373) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:48:57 gibba003 bash[32348]: cluster 2021-03-10T16:48:56.964340+0000 mgr.gibba043.dnkmem (mgr.34373) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:48:57 gibba043 bash[24019]: cluster 2021-03-10T16:48:56.964340+0000 mgr.gibba043.dnkmem (mgr.34373) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:00.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:00 gibba003 bash[31385]: cluster 2021-03-10T16:48:58.966031+0000 mgr.gibba043.dnkmem (mgr.34373) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:00.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:00 gibba003 bash[32348]: cluster 2021-03-10T16:48:58.966031+0000 mgr.gibba043.dnkmem (mgr.34373) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:00.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:00 gibba043 bash[24019]: cluster 2021-03-10T16:48:58.966031+0000 mgr.gibba043.dnkmem (mgr.34373) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:02 gibba003 bash[31385]: cluster 2021-03-10T16:49:00.967614+0000 mgr.gibba043.dnkmem (mgr.34373) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:02 gibba003 bash[32348]: cluster 2021-03-10T16:49:00.967614+0000 mgr.gibba043.dnkmem (mgr.34373) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:02 gibba043 bash[24019]: cluster 2021-03-10T16:49:00.967614+0000 mgr.gibba043.dnkmem (mgr.34373) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:04 gibba003 bash[31385]: cluster 2021-03-10T16:49:02.968999+0000 mgr.gibba043.dnkmem (mgr.34373) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:04 gibba003 bash[31385]: audit 2021-03-10T16:49:03.780611+0000 mon.c (mon.1) 2414 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:49:04.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:04 gibba003 bash[32348]: cluster 2021-03-10T16:49:02.968999+0000 mgr.gibba043.dnkmem (mgr.34373) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:04 gibba003 bash[32348]: audit 2021-03-10T16:49:03.780611+0000 mon.c (mon.1) 2414 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:49:04.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:04 gibba043 bash[24019]: cluster 2021-03-10T16:49:02.968999+0000 mgr.gibba043.dnkmem (mgr.34373) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:04 gibba043 bash[24019]: audit 2021-03-10T16:49:03.780611+0000 mon.c (mon.1) 2414 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:49:05.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:05 gibba003 bash[31385]: cephadm 2021-03-10T16:49:03.778233+0000 mgr.gibba043.dnkmem (mgr.34373) 9380 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:49:05.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:05 gibba003 bash[32348]: cephadm 2021-03-10T16:49:03.778233+0000 mgr.gibba043.dnkmem (mgr.34373) 9380 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:49:05.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:05 gibba043 bash[24019]: cephadm 2021-03-10T16:49:03.778233+0000 mgr.gibba043.dnkmem (mgr.34373) 9380 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:49:06.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:06 gibba003 bash[31385]: cluster 2021-03-10T16:49:04.970641+0000 mgr.gibba043.dnkmem (mgr.34373) 9381 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:06 gibba003 bash[32348]: cluster 2021-03-10T16:49:04.970641+0000 mgr.gibba043.dnkmem (mgr.34373) 9381 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:06 gibba043 bash[24019]: cluster 2021-03-10T16:49:04.970641+0000 mgr.gibba043.dnkmem (mgr.34373) 9381 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.018 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: cluster 2021-03-10T16:49:06.971993+0000 mgr.gibba043.dnkmem (mgr.34373) 9382 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.435535+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:49:08.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.678049+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:49:08.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.695403+0000 mon.c (mon.1) 2415 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:08.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.698084+0000 mon.c (mon.1) 2416 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.700434+0000 mon.c (mon.1) 2417 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.702052+0000 mon.c (mon.1) 2418 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.705771+0000 mon.c (mon.1) 2419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:07 gibba043 bash[24019]: audit 2021-03-10T16:49:07.707581+0000 mon.c (mon.1) 2420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: cluster 2021-03-10T16:49:06.971993+0000 mgr.gibba043.dnkmem (mgr.34373) 9382 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.435535+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:49:08.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.678049+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:49:08.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.695403+0000 mon.c (mon.1) 2415 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:08.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.698084+0000 mon.c (mon.1) 2416 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.700434+0000 mon.c (mon.1) 2417 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.702052+0000 mon.c (mon.1) 2418 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.705771+0000 mon.c (mon.1) 2419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[31385]: audit 2021-03-10T16:49:07.707581+0000 mon.c (mon.1) 2420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: cluster 2021-03-10T16:49:06.971993+0000 mgr.gibba043.dnkmem (mgr.34373) 9382 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.435535+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:49:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.678049+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:49:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.695403+0000 mon.c (mon.1) 2415 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.698084+0000 mon.c (mon.1) 2416 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.700434+0000 mon.c (mon.1) 2417 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.702052+0000 mon.c (mon.1) 2418 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.705771+0000 mon.c (mon.1) 2419 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:07 gibba003 bash[32348]: audit 2021-03-10T16:49:07.707581+0000 mon.c (mon.1) 2420 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:09.188 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.434879+0000 mgr.gibba043.dnkmem (mgr.34373) 9383 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:49:09.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.691283+0000 mgr.gibba043.dnkmem (mgr.34373) 9384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:49:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.695821+0000 mgr.gibba043.dnkmem (mgr.34373) 9385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:49:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.698102+0000 mgr.gibba043.dnkmem (mgr.34373) 9386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:49:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.698143+0000 mgr.gibba043.dnkmem (mgr.34373) 9387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:49:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.699984+0000 mgr.gibba043.dnkmem (mgr.34373) 9388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:49:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.700051+0000 mgr.gibba043.dnkmem (mgr.34373) 9389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:49:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.701701+0000 mgr.gibba043.dnkmem (mgr.34373) 9390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:49:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.703540+0000 mgr.gibba043.dnkmem (mgr.34373) 9391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:49:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.703578+0000 mgr.gibba043.dnkmem (mgr.34373) 9392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:49:09.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.705255+0000 mgr.gibba043.dnkmem (mgr.34373) 9393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:49:09.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.705676+0000 mgr.gibba043.dnkmem (mgr.34373) 9394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:49:09.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.707133+0000 mgr.gibba043.dnkmem (mgr.34373) 9395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:49:09.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.707173+0000 mgr.gibba043.dnkmem (mgr.34373) 9396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:49:09.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[31385]: cephadm 2021-03-10T16:49:07.707285+0000 mgr.gibba043.dnkmem (mgr.34373) 9397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:09.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.434879+0000 mgr.gibba043.dnkmem (mgr.34373) 9383 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:49:09.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.691283+0000 mgr.gibba043.dnkmem (mgr.34373) 9384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:49:09.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.695821+0000 mgr.gibba043.dnkmem (mgr.34373) 9385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:49:09.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.698102+0000 mgr.gibba043.dnkmem (mgr.34373) 9386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:49:09.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.698143+0000 mgr.gibba043.dnkmem (mgr.34373) 9387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:49:09.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.699984+0000 mgr.gibba043.dnkmem (mgr.34373) 9388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:49:09.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.700051+0000 mgr.gibba043.dnkmem (mgr.34373) 9389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:49:09.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.701701+0000 mgr.gibba043.dnkmem (mgr.34373) 9390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:49:09.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.703540+0000 mgr.gibba043.dnkmem (mgr.34373) 9391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:49:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.703578+0000 mgr.gibba043.dnkmem (mgr.34373) 9392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:49:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.705255+0000 mgr.gibba043.dnkmem (mgr.34373) 9393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:49:09.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.705676+0000 mgr.gibba043.dnkmem (mgr.34373) 9394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:49:09.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.707133+0000 mgr.gibba043.dnkmem (mgr.34373) 9395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:49:09.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.707173+0000 mgr.gibba043.dnkmem (mgr.34373) 9396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:49:09.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:08 gibba003 bash[32348]: cephadm 2021-03-10T16:49:07.707285+0000 mgr.gibba043.dnkmem (mgr.34373) 9397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:09.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.434879+0000 mgr.gibba043.dnkmem (mgr.34373) 9383 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:49:09.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.691283+0000 mgr.gibba043.dnkmem (mgr.34373) 9384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:49:09.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.695821+0000 mgr.gibba043.dnkmem (mgr.34373) 9385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:49:09.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.698102+0000 mgr.gibba043.dnkmem (mgr.34373) 9386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:49:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.698143+0000 mgr.gibba043.dnkmem (mgr.34373) 9387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:49:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.699984+0000 mgr.gibba043.dnkmem (mgr.34373) 9388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:49:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.700051+0000 mgr.gibba043.dnkmem (mgr.34373) 9389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:49:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.701701+0000 mgr.gibba043.dnkmem (mgr.34373) 9390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:49:09.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.703540+0000 mgr.gibba043.dnkmem (mgr.34373) 9391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:49:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.703578+0000 mgr.gibba043.dnkmem (mgr.34373) 9392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:49:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.705255+0000 mgr.gibba043.dnkmem (mgr.34373) 9393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:49:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.705676+0000 mgr.gibba043.dnkmem (mgr.34373) 9394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:49:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.707133+0000 mgr.gibba043.dnkmem (mgr.34373) 9395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:49:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.707173+0000 mgr.gibba043.dnkmem (mgr.34373) 9396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:49:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:08 gibba043 bash[24019]: cephadm 2021-03-10T16:49:07.707285+0000 mgr.gibba043.dnkmem (mgr.34373) 9397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:09 gibba043 bash[24019]: cluster 2021-03-10T16:49:08.973369+0000 mgr.gibba043.dnkmem (mgr.34373) 9398 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:10.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:09 gibba003 bash[31385]: cluster 2021-03-10T16:49:08.973369+0000 mgr.gibba043.dnkmem (mgr.34373) 9398 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:10.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:09 gibba003 bash[32348]: cluster 2021-03-10T16:49:08.973369+0000 mgr.gibba043.dnkmem (mgr.34373) 9398 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:12 gibba003 bash[31385]: cluster 2021-03-10T16:49:10.974806+0000 mgr.gibba043.dnkmem (mgr.34373) 9399 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:12 gibba003 bash[32348]: cluster 2021-03-10T16:49:10.974806+0000 mgr.gibba043.dnkmem (mgr.34373) 9399 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:12 gibba043 bash[24019]: cluster 2021-03-10T16:49:10.974806+0000 mgr.gibba043.dnkmem (mgr.34373) 9399 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:14 gibba003 bash[31385]: cluster 2021-03-10T16:49:12.976362+0000 mgr.gibba043.dnkmem (mgr.34373) 9400 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:14 gibba003 bash[31385]: audit 2021-03-10T16:49:13.855499+0000 mon.c (mon.1) 2421 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:14 gibba003 bash[31385]: audit 2021-03-10T16:49:13.856617+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:14 gibba003 bash[32348]: cluster 2021-03-10T16:49:12.976362+0000 mgr.gibba043.dnkmem (mgr.34373) 9400 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:14 gibba003 bash[32348]: audit 2021-03-10T16:49:13.855499+0000 mon.c (mon.1) 2421 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:14 gibba003 bash[32348]: audit 2021-03-10T16:49:13.856617+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:14.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:14 gibba043 bash[24019]: cluster 2021-03-10T16:49:12.976362+0000 mgr.gibba043.dnkmem (mgr.34373) 9400 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:14 gibba043 bash[24019]: audit 2021-03-10T16:49:13.855499+0000 mon.c (mon.1) 2421 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:14.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:14 gibba043 bash[24019]: audit 2021-03-10T16:49:13.856617+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:14.845 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:49:15.068 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:49:15.069 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 7s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:49:15.069 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:49:15.069 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:49:15.069 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:49:15.070 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:49:15.070 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:49:15.070 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:49:15.071 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:49:15.071 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:49:15.071 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:49:15.072 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:49:15.072 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:49:15.072 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:49:15.073 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:49:15.073 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:49:15.073 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:49:15.074 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:49:15.074 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:49:15.074 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:49:15.074 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:49:15.316 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:49:15.317 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:49:15.317 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:15.317 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:49:15.318 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:49:15.318 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:15.318 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:49:15.319 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:49:15.319 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:49:15.319 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:49:15.320 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:49:15.320 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:49:15.320 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:49:15.320 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:49:15.320 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:49:15.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.090782+0000 mon.c (mon.1) 2422 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:15.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.091278+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.364901+0000 mon.c (mon.1) 2423 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:49:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.365613+0000 mon.c (mon.1) 2424 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:49:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.366153+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:49:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.366332+0000 mon.c (mon.1) 2425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.366998+0000 mon.c (mon.1) 2426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.367406+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:49:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.368554+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[31385]: audit 2021-03-10T16:49:14.369341+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.090782+0000 mon.c (mon.1) 2422 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.091278+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.364901+0000 mon.c (mon.1) 2423 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:49:15.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.365613+0000 mon.c (mon.1) 2424 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:49:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.366153+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:49:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.366332+0000 mon.c (mon.1) 2425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.366998+0000 mon.c (mon.1) 2426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.367406+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:49:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.368554+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:15 gibba003 bash[32348]: audit 2021-03-10T16:49:14.369341+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.090782+0000 mon.c (mon.1) 2422 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.091278+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.364901+0000 mon.c (mon.1) 2423 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:49:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.365613+0000 mon.c (mon.1) 2424 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:49:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.366153+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:49:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.366332+0000 mon.c (mon.1) 2425 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.366998+0000 mon.c (mon.1) 2426 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.367406+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:49:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.368554+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:15 gibba043 bash[24019]: audit 2021-03-10T16:49:14.369341+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:16.436 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[32348]: audit 2021-03-10T16:49:14.839096+0000 mgr.gibba043.dnkmem (mgr.34373) 9401 : audit [DBG] from='client.60340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[32348]: cluster 2021-03-10T16:49:14.978066+0000 mgr.gibba043.dnkmem (mgr.34373) 9402 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[32348]: audit 2021-03-10T16:49:15.062618+0000 mgr.gibba043.dnkmem (mgr.34373) 9403 : audit [DBG] from='client.60346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[32348]: audit 2021-03-10T16:49:15.320473+0000 mon.a (mon.0) 1955 : audit [DBG] from='client.? 172.21.2.103:0/1972825461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[31385]: audit 2021-03-10T16:49:14.839096+0000 mgr.gibba043.dnkmem (mgr.34373) 9401 : audit [DBG] from='client.60340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[31385]: cluster 2021-03-10T16:49:14.978066+0000 mgr.gibba043.dnkmem (mgr.34373) 9402 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[31385]: audit 2021-03-10T16:49:15.062618+0000 mgr.gibba043.dnkmem (mgr.34373) 9403 : audit [DBG] from='client.60346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:16 gibba003 bash[31385]: audit 2021-03-10T16:49:15.320473+0000 mon.a (mon.0) 1955 : audit [DBG] from='client.? 172.21.2.103:0/1972825461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:16.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:16 gibba043 bash[24019]: audit 2021-03-10T16:49:14.839096+0000 mgr.gibba043.dnkmem (mgr.34373) 9401 : audit [DBG] from='client.60340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:16.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:16 gibba043 bash[24019]: cluster 2021-03-10T16:49:14.978066+0000 mgr.gibba043.dnkmem (mgr.34373) 9402 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:16 gibba043 bash[24019]: audit 2021-03-10T16:49:15.062618+0000 mgr.gibba043.dnkmem (mgr.34373) 9403 : audit [DBG] from='client.60346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:16.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:16 gibba043 bash[24019]: audit 2021-03-10T16:49:15.320473+0000 mon.a (mon.0) 1955 : audit [DBG] from='client.? 172.21.2.103:0/1972825461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:18.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:17 gibba003 bash[31385]: cluster 2021-03-10T16:49:16.979748+0000 mgr.gibba043.dnkmem (mgr.34373) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:17 gibba003 bash[32348]: cluster 2021-03-10T16:49:16.979748+0000 mgr.gibba043.dnkmem (mgr.34373) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:17 gibba043 bash[24019]: cluster 2021-03-10T16:49:16.979748+0000 mgr.gibba043.dnkmem (mgr.34373) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:20.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:20 gibba003 bash[31385]: cluster 2021-03-10T16:49:18.981452+0000 mgr.gibba043.dnkmem (mgr.34373) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:20.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:20 gibba003 bash[32348]: cluster 2021-03-10T16:49:18.981452+0000 mgr.gibba043.dnkmem (mgr.34373) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:20.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:20 gibba043 bash[24019]: cluster 2021-03-10T16:49:18.981452+0000 mgr.gibba043.dnkmem (mgr.34373) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:22 gibba003 bash[31385]: cluster 2021-03-10T16:49:20.983291+0000 mgr.gibba043.dnkmem (mgr.34373) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:22 gibba003 bash[32348]: cluster 2021-03-10T16:49:20.983291+0000 mgr.gibba043.dnkmem (mgr.34373) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:22 gibba043 bash[24019]: cluster 2021-03-10T16:49:20.983291+0000 mgr.gibba043.dnkmem (mgr.34373) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:24 gibba003 bash[31385]: cephadm 2021-03-10T16:49:22.723268+0000 mgr.gibba043.dnkmem (mgr.34373) 9407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:24.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:24 gibba003 bash[31385]: cluster 2021-03-10T16:49:22.984732+0000 mgr.gibba043.dnkmem (mgr.34373) 9408 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:24 gibba003 bash[32348]: cephadm 2021-03-10T16:49:22.723268+0000 mgr.gibba043.dnkmem (mgr.34373) 9407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:24.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:24 gibba003 bash[32348]: cluster 2021-03-10T16:49:22.984732+0000 mgr.gibba043.dnkmem (mgr.34373) 9408 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:24 gibba043 bash[24019]: cephadm 2021-03-10T16:49:22.723268+0000 mgr.gibba043.dnkmem (mgr.34373) 9407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:24.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:24 gibba043 bash[24019]: cluster 2021-03-10T16:49:22.984732+0000 mgr.gibba043.dnkmem (mgr.34373) 9408 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.436 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:26 gibba003 bash[31385]: cluster 2021-03-10T16:49:24.986597+0000 mgr.gibba043.dnkmem (mgr.34373) 9409 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:26 gibba003 bash[32348]: cluster 2021-03-10T16:49:24.986597+0000 mgr.gibba043.dnkmem (mgr.34373) 9409 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:26 gibba043 bash[24019]: cluster 2021-03-10T16:49:24.986597+0000 mgr.gibba043.dnkmem (mgr.34373) 9409 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:27 gibba003 bash[31385]: cluster 2021-03-10T16:49:26.987664+0000 mgr.gibba043.dnkmem (mgr.34373) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.187 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:27 gibba003 bash[32348]: cluster 2021-03-10T16:49:26.987664+0000 mgr.gibba043.dnkmem (mgr.34373) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:27 gibba043 bash[24019]: cluster 2021-03-10T16:49:26.987664+0000 mgr.gibba043.dnkmem (mgr.34373) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:30.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:30 gibba003 bash[31385]: cluster 2021-03-10T16:49:28.988898+0000 mgr.gibba043.dnkmem (mgr.34373) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:30 gibba003 bash[32348]: cluster 2021-03-10T16:49:28.988898+0000 mgr.gibba043.dnkmem (mgr.34373) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:30.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:30 gibba043 bash[24019]: cluster 2021-03-10T16:49:28.988898+0000 mgr.gibba043.dnkmem (mgr.34373) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:32 gibba003 bash[31385]: cluster 2021-03-10T16:49:30.990667+0000 mgr.gibba043.dnkmem (mgr.34373) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:32.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:32 gibba003 bash[32348]: cluster 2021-03-10T16:49:30.990667+0000 mgr.gibba043.dnkmem (mgr.34373) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:32.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:32 gibba043 bash[24019]: cluster 2021-03-10T16:49:30.990667+0000 mgr.gibba043.dnkmem (mgr.34373) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:34 gibba003 bash[31385]: cluster 2021-03-10T16:49:32.992211+0000 mgr.gibba043.dnkmem (mgr.34373) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:34 gibba003 bash[32348]: cluster 2021-03-10T16:49:32.992211+0000 mgr.gibba043.dnkmem (mgr.34373) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:34 gibba043 bash[24019]: cluster 2021-03-10T16:49:32.992211+0000 mgr.gibba043.dnkmem (mgr.34373) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:36 gibba003 bash[31385]: cluster 2021-03-10T16:49:34.993917+0000 mgr.gibba043.dnkmem (mgr.34373) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:36 gibba003 bash[32348]: cluster 2021-03-10T16:49:34.993917+0000 mgr.gibba043.dnkmem (mgr.34373) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:36 gibba043 bash[24019]: cluster 2021-03-10T16:49:34.993917+0000 mgr.gibba043.dnkmem (mgr.34373) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.017 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:37 gibba043 bash[24019]: cluster 2021-03-10T16:49:36.995623+0000 mgr.gibba043.dnkmem (mgr.34373) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:37 gibba003 bash[31385]: cluster 2021-03-10T16:49:36.995623+0000 mgr.gibba043.dnkmem (mgr.34373) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:37 gibba003 bash[32348]: cluster 2021-03-10T16:49:36.995623+0000 mgr.gibba043.dnkmem (mgr.34373) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:39.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:38 gibba043 bash[24019]: cephadm 2021-03-10T16:49:37.739334+0000 mgr.gibba043.dnkmem (mgr.34373) 9416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:39.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:38 gibba003 bash[31385]: cephadm 2021-03-10T16:49:37.739334+0000 mgr.gibba043.dnkmem (mgr.34373) 9416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:39.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:38 gibba003 bash[32348]: cephadm 2021-03-10T16:49:37.739334+0000 mgr.gibba043.dnkmem (mgr.34373) 9416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:40.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:39 gibba043 bash[24019]: cluster 2021-03-10T16:49:38.996615+0000 mgr.gibba043.dnkmem (mgr.34373) 9417 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:40.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:39 gibba003 bash[31385]: cluster 2021-03-10T16:49:38.996615+0000 mgr.gibba043.dnkmem (mgr.34373) 9417 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:40.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:39 gibba003 bash[32348]: cluster 2021-03-10T16:49:38.996615+0000 mgr.gibba043.dnkmem (mgr.34373) 9417 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:42 gibba003 bash[31385]: cluster 2021-03-10T16:49:40.997925+0000 mgr.gibba043.dnkmem (mgr.34373) 9418 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:42 gibba003 bash[32348]: cluster 2021-03-10T16:49:40.997925+0000 mgr.gibba043.dnkmem (mgr.34373) 9418 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:42 gibba043 bash[24019]: cluster 2021-03-10T16:49:40.997925+0000 mgr.gibba043.dnkmem (mgr.34373) 9418 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:44 gibba003 bash[31385]: cluster 2021-03-10T16:49:42.999178+0000 mgr.gibba043.dnkmem (mgr.34373) 9419 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:44 gibba003 bash[32348]: cluster 2021-03-10T16:49:42.999178+0000 mgr.gibba043.dnkmem (mgr.34373) 9419 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:44 gibba043 bash[24019]: cluster 2021-03-10T16:49:42.999178+0000 mgr.gibba043.dnkmem (mgr.34373) 9419 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:45.558 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:49:45.784 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:49:45.784 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 38s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:49:45.784 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:49:45.785 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:49:45.785 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:49:45.785 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:49:45.785 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:49:45.785 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:49:45.786 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:49:45.786 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 38s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:49:45.786 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:49:45.786 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:49:45.787 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:49:45.787 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:49:45.787 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:49:45.787 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:49:45.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:49:45.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:49:45.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:49:45.788 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:49:45.789 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 38s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:49:46.029 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:49:46.030 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:49:46.030 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:46.030 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:49:46.031 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:49:46.031 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:46.031 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:49:46.031 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:49:46.032 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:49:46.032 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:49:46.032 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:49:46.032 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:49:46.032 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:49:46.033 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:49:46.033 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:49:46.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:46 gibba003 bash[31385]: cluster 2021-03-10T16:49:45.000852+0000 mgr.gibba043.dnkmem (mgr.34373) 9420 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:46 gibba003 bash[31385]: audit 2021-03-10T16:49:46.033438+0000 mon.a (mon.0) 1956 : audit [DBG] from='client.? 172.21.2.103:0/4228974248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:46.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:46 gibba003 bash[32348]: cluster 2021-03-10T16:49:45.000852+0000 mgr.gibba043.dnkmem (mgr.34373) 9420 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:46 gibba003 bash[32348]: audit 2021-03-10T16:49:46.033438+0000 mon.a (mon.0) 1956 : audit [DBG] from='client.? 172.21.2.103:0/4228974248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:46 gibba043 bash[24019]: cluster 2021-03-10T16:49:45.000852+0000 mgr.gibba043.dnkmem (mgr.34373) 9420 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:46 gibba043 bash[24019]: audit 2021-03-10T16:49:46.033438+0000 mon.a (mon.0) 1956 : audit [DBG] from='client.? 172.21.2.103:0/4228974248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:47.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:47 gibba003 bash[31385]: audit 2021-03-10T16:49:45.552501+0000 mgr.gibba043.dnkmem (mgr.34373) 9421 : audit [DBG] from='client.50367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:47.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:47 gibba003 bash[31385]: audit 2021-03-10T16:49:45.774490+0000 mgr.gibba043.dnkmem (mgr.34373) 9422 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:47.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:47 gibba003 bash[32348]: audit 2021-03-10T16:49:45.552501+0000 mgr.gibba043.dnkmem (mgr.34373) 9421 : audit [DBG] from='client.50367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:47.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:47 gibba003 bash[32348]: audit 2021-03-10T16:49:45.774490+0000 mgr.gibba043.dnkmem (mgr.34373) 9422 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:47.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:47 gibba043 bash[24019]: audit 2021-03-10T16:49:45.552501+0000 mgr.gibba043.dnkmem (mgr.34373) 9421 : audit [DBG] from='client.50367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:47.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:47 gibba043 bash[24019]: audit 2021-03-10T16:49:45.774490+0000 mgr.gibba043.dnkmem (mgr.34373) 9422 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:48.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:48 gibba003 bash[31385]: cluster 2021-03-10T16:49:47.001950+0000 mgr.gibba043.dnkmem (mgr.34373) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:48 gibba003 bash[32348]: cluster 2021-03-10T16:49:47.001950+0000 mgr.gibba043.dnkmem (mgr.34373) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.517 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:48 gibba043 bash[24019]: cluster 2021-03-10T16:49:47.001950+0000 mgr.gibba043.dnkmem (mgr.34373) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:50.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:50 gibba003 bash[31385]: cluster 2021-03-10T16:49:49.003168+0000 mgr.gibba043.dnkmem (mgr.34373) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:50.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:50 gibba003 bash[32348]: cluster 2021-03-10T16:49:49.003168+0000 mgr.gibba043.dnkmem (mgr.34373) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:50.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:50 gibba043 bash[24019]: cluster 2021-03-10T16:49:49.003168+0000 mgr.gibba043.dnkmem (mgr.34373) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:52 gibba003 bash[31385]: cluster 2021-03-10T16:49:51.004857+0000 mgr.gibba043.dnkmem (mgr.34373) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:52 gibba003 bash[32348]: cluster 2021-03-10T16:49:51.004857+0000 mgr.gibba043.dnkmem (mgr.34373) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:52 gibba043 bash[24019]: cluster 2021-03-10T16:49:51.004857+0000 mgr.gibba043.dnkmem (mgr.34373) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:54 gibba003 bash[31385]: cephadm 2021-03-10T16:49:52.755477+0000 mgr.gibba043.dnkmem (mgr.34373) 9426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:54.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:54 gibba003 bash[31385]: cluster 2021-03-10T16:49:53.006196+0000 mgr.gibba043.dnkmem (mgr.34373) 9427 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:54 gibba003 bash[32348]: cephadm 2021-03-10T16:49:52.755477+0000 mgr.gibba043.dnkmem (mgr.34373) 9426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:54.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:54 gibba003 bash[32348]: cluster 2021-03-10T16:49:53.006196+0000 mgr.gibba043.dnkmem (mgr.34373) 9427 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:54 gibba043 bash[24019]: cephadm 2021-03-10T16:49:52.755477+0000 mgr.gibba043.dnkmem (mgr.34373) 9426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:49:54.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:54 gibba043 bash[24019]: cluster 2021-03-10T16:49:53.006196+0000 mgr.gibba043.dnkmem (mgr.34373) 9427 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:56 gibba003 bash[31385]: cluster 2021-03-10T16:49:55.008171+0000 mgr.gibba043.dnkmem (mgr.34373) 9428 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:56 gibba003 bash[32348]: cluster 2021-03-10T16:49:55.008171+0000 mgr.gibba043.dnkmem (mgr.34373) 9428 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:56 gibba043 bash[24019]: cluster 2021-03-10T16:49:55.008171+0000 mgr.gibba043.dnkmem (mgr.34373) 9428 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:49:57 gibba043 bash[24019]: cluster 2021-03-10T16:49:57.009902+0000 mgr.gibba043.dnkmem (mgr.34373) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:49:57 gibba003 bash[31385]: cluster 2021-03-10T16:49:57.009902+0000 mgr.gibba043.dnkmem (mgr.34373) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:49:57 gibba003 bash[32348]: cluster 2021-03-10T16:49:57.009902+0000 mgr.gibba043.dnkmem (mgr.34373) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:00 gibba003 bash[31385]: debug 2021-03-10T16:49:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:00.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:00 gibba003 bash[31385]: cluster 2021-03-10T16:49:59.011573+0000 mgr.gibba043.dnkmem (mgr.34373) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:00 gibba003 bash[31385]: cluster 2021-03-10T16:50:00.000298+0000 mon.a (mon.0) 1957 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:00.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:00 gibba003 bash[32348]: cluster 2021-03-10T16:49:59.011573+0000 mgr.gibba043.dnkmem (mgr.34373) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:00 gibba003 bash[32348]: cluster 2021-03-10T16:50:00.000298+0000 mon.a (mon.0) 1957 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:00.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:00 gibba043 bash[24019]: cluster 2021-03-10T16:49:59.011573+0000 mgr.gibba043.dnkmem (mgr.34373) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:00 gibba043 bash[24019]: cluster 2021-03-10T16:50:00.000298+0000 mon.a (mon.0) 1957 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:02 gibba003 bash[31385]: cluster 2021-03-10T16:50:01.013086+0000 mgr.gibba043.dnkmem (mgr.34373) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:02 gibba003 bash[32348]: cluster 2021-03-10T16:50:01.013086+0000 mgr.gibba043.dnkmem (mgr.34373) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:02.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:02 gibba043 bash[24019]: cluster 2021-03-10T16:50:01.013086+0000 mgr.gibba043.dnkmem (mgr.34373) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:04.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:04 gibba003 bash[31385]: cluster 2021-03-10T16:50:03.014632+0000 mgr.gibba043.dnkmem (mgr.34373) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:04.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:04 gibba003 bash[32348]: cluster 2021-03-10T16:50:03.014632+0000 mgr.gibba043.dnkmem (mgr.34373) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:04.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:04 gibba043 bash[24019]: cluster 2021-03-10T16:50:03.014632+0000 mgr.gibba043.dnkmem (mgr.34373) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:06.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:06 gibba003 bash[31385]: cluster 2021-03-10T16:50:05.016022+0000 mgr.gibba043.dnkmem (mgr.34373) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:06.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:06 gibba003 bash[32348]: cluster 2021-03-10T16:50:05.016022+0000 mgr.gibba043.dnkmem (mgr.34373) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:06.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:06 gibba043 bash[24019]: cluster 2021-03-10T16:50:05.016022+0000 mgr.gibba043.dnkmem (mgr.34373) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:07 gibba043 bash[24019]: cluster 2021-03-10T16:50:07.017163+0000 mgr.gibba043.dnkmem (mgr.34373) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:07 gibba043 bash[24019]: audit 2021-03-10T16:50:07.768827+0000 mon.c (mon.1) 2427 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:08.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:07 gibba003 bash[31385]: cluster 2021-03-10T16:50:07.017163+0000 mgr.gibba043.dnkmem (mgr.34373) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:07 gibba003 bash[31385]: audit 2021-03-10T16:50:07.768827+0000 mon.c (mon.1) 2427 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:08.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:07 gibba003 bash[32348]: cluster 2021-03-10T16:50:07.017163+0000 mgr.gibba043.dnkmem (mgr.34373) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:07 gibba003 bash[32348]: audit 2021-03-10T16:50:07.768827+0000 mon.c (mon.1) 2427 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:09.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:08 gibba043 bash[24019]: cephadm 2021-03-10T16:50:07.765372+0000 mgr.gibba043.dnkmem (mgr.34373) 9435 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:50:09.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:08 gibba003 bash[31385]: cephadm 2021-03-10T16:50:07.765372+0000 mgr.gibba043.dnkmem (mgr.34373) 9435 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:50:09.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:08 gibba003 bash[32348]: cephadm 2021-03-10T16:50:07.765372+0000 mgr.gibba043.dnkmem (mgr.34373) 9435 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:50:10.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:09 gibba043 bash[24019]: cluster 2021-03-10T16:50:09.018320+0000 mgr.gibba043.dnkmem (mgr.34373) 9436 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:10.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:09 gibba003 bash[31385]: cluster 2021-03-10T16:50:09.018320+0000 mgr.gibba043.dnkmem (mgr.34373) 9436 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:10.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:09 gibba003 bash[32348]: cluster 2021-03-10T16:50:09.018320+0000 mgr.gibba043.dnkmem (mgr.34373) 9436 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.428 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:12 gibba043 bash[24019]: cluster 2021-03-10T16:50:11.018834+0000 mgr.gibba043.dnkmem (mgr.34373) 9437 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:12 gibba043 bash[24019]: audit 2021-03-10T16:50:11.353730+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:12.429 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:12 gibba043 bash[24019]: audit 2021-03-10T16:50:11.355224+0000 mon.c (mon.1) 2428 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:50:12.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:12 gibba003 bash[31385]: cluster 2021-03-10T16:50:11.018834+0000 mgr.gibba043.dnkmem (mgr.34373) 9437 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:12 gibba003 bash[31385]: audit 2021-03-10T16:50:11.353730+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:12.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:12 gibba003 bash[31385]: audit 2021-03-10T16:50:11.355224+0000 mon.c (mon.1) 2428 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:50:12.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:12 gibba003 bash[32348]: cluster 2021-03-10T16:50:11.018834+0000 mgr.gibba043.dnkmem (mgr.34373) 9437 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:12 gibba003 bash[32348]: audit 2021-03-10T16:50:11.353730+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:12.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:12 gibba003 bash[32348]: audit 2021-03-10T16:50:11.355224+0000 mon.c (mon.1) 2428 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:50:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:14 gibba003 bash[31385]: cluster 2021-03-10T16:50:13.020211+0000 mgr.gibba043.dnkmem (mgr.34373) 9438 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:14 gibba003 bash[31385]: audit 2021-03-10T16:50:13.861766+0000 mon.c (mon.1) 2429 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:14.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:14 gibba003 bash[31385]: audit 2021-03-10T16:50:13.862785+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:14 gibba003 bash[32348]: cluster 2021-03-10T16:50:13.020211+0000 mgr.gibba043.dnkmem (mgr.34373) 9438 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:14 gibba003 bash[32348]: audit 2021-03-10T16:50:13.861766+0000 mon.c (mon.1) 2429 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:14.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:14 gibba003 bash[32348]: audit 2021-03-10T16:50:13.862785+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:14.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:14 gibba043 bash[24019]: cluster 2021-03-10T16:50:13.020211+0000 mgr.gibba043.dnkmem (mgr.34373) 9438 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:14 gibba043 bash[24019]: audit 2021-03-10T16:50:13.861766+0000 mon.c (mon.1) 2429 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:14 gibba043 bash[24019]: audit 2021-03-10T16:50:13.862785+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:15.347 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.096268+0000 mon.c (mon.1) 2430 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:15.348 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.096572+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:15.348 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.372058+0000 mon.c (mon.1) 2431 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:50:15.348 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.373018+0000 mon.c (mon.1) 2432 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.349 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.373210+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:50:15.349 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.373997+0000 mon.c (mon.1) 2433 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.349 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.374484+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.349 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.375038+0000 mon.c (mon.1) 2434 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:50:15.349 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.375494+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.350 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:15 gibba043 bash[24019]: audit 2021-03-10T16:50:14.376441+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:50:15.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.096268+0000 mon.c (mon.1) 2430 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.096572+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.372058+0000 mon.c (mon.1) 2431 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:50:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.373018+0000 mon.c (mon.1) 2432 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.373210+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:50:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.373997+0000 mon.c (mon.1) 2433 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.374484+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.375038+0000 mon.c (mon.1) 2434 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:50:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.375494+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[31385]: audit 2021-03-10T16:50:14.376441+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:50:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.096268+0000 mon.c (mon.1) 2430 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:15.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.096572+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.372058+0000 mon.c (mon.1) 2431 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:50:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.373018+0000 mon.c (mon.1) 2432 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.373210+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:50:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.373997+0000 mon.c (mon.1) 2433 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.374484+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.375038+0000 mon.c (mon.1) 2434 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:50:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.375494+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:50:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:15 gibba003 bash[32348]: audit 2021-03-10T16:50:14.376441+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:50:16.273 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:50:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:16 gibba003 bash[32348]: cluster 2021-03-10T16:50:15.020781+0000 mgr.gibba043.dnkmem (mgr.34373) 9439 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:16 gibba003 bash[32348]: audit 2021-03-10T16:50:15.922924+0000 mon.c (mon.1) 2435 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:16.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:16 gibba003 bash[32348]: audit 2021-03-10T16:50:16.085378+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:16 gibba003 bash[31385]: cluster 2021-03-10T16:50:15.020781+0000 mgr.gibba043.dnkmem (mgr.34373) 9439 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:16 gibba003 bash[31385]: audit 2021-03-10T16:50:15.922924+0000 mon.c (mon.1) 2435 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:16.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:16 gibba003 bash[31385]: audit 2021-03-10T16:50:16.085378+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:16.503 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:50:16.503 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 69s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:50:16.504 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:50:16.504 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:50:16.505 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:50:16.505 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:50:16.505 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:50:16.506 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:50:16.506 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:50:16.507 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 69s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:50:16.507 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:50:16.508 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:50:16.508 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:50:16.508 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:50:16.509 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:50:16.509 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:50:16.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:50:16.510 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:50:16.511 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:50:16.511 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:50:16.511 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 69s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:50:16.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:16 gibba043 bash[24019]: cluster 2021-03-10T16:50:15.020781+0000 mgr.gibba043.dnkmem (mgr.34373) 9439 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:16 gibba043 bash[24019]: audit 2021-03-10T16:50:15.922924+0000 mon.c (mon.1) 2435 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:16.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:16 gibba043 bash[24019]: audit 2021-03-10T16:50:16.085378+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:16.756 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:50:16.756 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:50:16.757 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:16.757 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:50:16.758 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:50:16.758 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:16.759 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:50:16.759 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:50:16.759 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:50:16.760 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:50:16.760 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:50:16.761 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:50:16.761 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:50:16.762 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:50:16.762 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:50:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.084996+0000 mgr.gibba043.dnkmem (mgr.34373) 9440 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:50:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.267371+0000 mgr.gibba043.dnkmem (mgr.34373) 9441 : audit [DBG] from='client.50385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:17.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.270529+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.272075+0000 mgr.gibba043.dnkmem (mgr.34373) 9442 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.273780+0000 mgr.gibba043.dnkmem (mgr.34373) 9443 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.274340+0000 mon.c (mon.1) 2436 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.275089+0000 mgr.gibba043.dnkmem (mgr.34373) 9444 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:17.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.275244+0000 mgr.gibba043.dnkmem (mgr.34373) 9445 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.275730+0000 mon.c (mon.1) 2437 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.276667+0000 mgr.gibba043.dnkmem (mgr.34373) 9446 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.276706+0000 mgr.gibba043.dnkmem (mgr.34373) 9447 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:17.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.277233+0000 mon.c (mon.1) 2438 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.277853+0000 mgr.gibba043.dnkmem (mgr.34373) 9448 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.278568+0000 mon.c (mon.1) 2439 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.279615+0000 mgr.gibba043.dnkmem (mgr.34373) 9449 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:17.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.279674+0000 mgr.gibba043.dnkmem (mgr.34373) 9450 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.281002+0000 mgr.gibba043.dnkmem (mgr.34373) 9451 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.281365+0000 mgr.gibba043.dnkmem (mgr.34373) 9452 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.281763+0000 mon.c (mon.1) 2440 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.282574+0000 mgr.gibba043.dnkmem (mgr.34373) 9453 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.282612+0000 mgr.gibba043.dnkmem (mgr.34373) 9454 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.084996+0000 mgr.gibba043.dnkmem (mgr.34373) 9440 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:50:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.267371+0000 mgr.gibba043.dnkmem (mgr.34373) 9441 : audit [DBG] from='client.50385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.270529+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.272075+0000 mgr.gibba043.dnkmem (mgr.34373) 9442 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.273780+0000 mgr.gibba043.dnkmem (mgr.34373) 9443 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.274340+0000 mon.c (mon.1) 2436 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:17.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.275089+0000 mgr.gibba043.dnkmem (mgr.34373) 9444 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.275244+0000 mgr.gibba043.dnkmem (mgr.34373) 9445 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.275730+0000 mon.c (mon.1) 2437 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.276667+0000 mgr.gibba043.dnkmem (mgr.34373) 9446 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.276706+0000 mgr.gibba043.dnkmem (mgr.34373) 9447 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:17.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.277233+0000 mon.c (mon.1) 2438 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.277853+0000 mgr.gibba043.dnkmem (mgr.34373) 9448 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.278568+0000 mon.c (mon.1) 2439 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.279615+0000 mgr.gibba043.dnkmem (mgr.34373) 9449 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:17.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.279674+0000 mgr.gibba043.dnkmem (mgr.34373) 9450 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.281002+0000 mgr.gibba043.dnkmem (mgr.34373) 9451 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.281365+0000 mgr.gibba043.dnkmem (mgr.34373) 9452 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.281763+0000 mon.c (mon.1) 2440 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.282574+0000 mgr.gibba043.dnkmem (mgr.34373) 9453 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:17.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.282612+0000 mgr.gibba043.dnkmem (mgr.34373) 9454 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: cephadm 2021-03-10T16:50:16.282720+0000 mgr.gibba043.dnkmem (mgr.34373) 9455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:17.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.283168+0000 mon.c (mon.1) 2441 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[32348]: audit 2021-03-10T16:50:16.759883+0000 mon.c (mon.1) 2442 : audit [DBG] from='client.? 172.21.2.103:0/982633476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: cephadm 2021-03-10T16:50:16.282720+0000 mgr.gibba043.dnkmem (mgr.34373) 9455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:17.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.283168+0000 mon.c (mon.1) 2441 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:17 gibba003 bash[31385]: audit 2021-03-10T16:50:16.759883+0000 mon.c (mon.1) 2442 : audit [DBG] from='client.? 172.21.2.103:0/982633476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.084996+0000 mgr.gibba043.dnkmem (mgr.34373) 9440 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:50:17.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.267371+0000 mgr.gibba043.dnkmem (mgr.34373) 9441 : audit [DBG] from='client.50385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.270529+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:50:17.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.272075+0000 mgr.gibba043.dnkmem (mgr.34373) 9442 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.273780+0000 mgr.gibba043.dnkmem (mgr.34373) 9443 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.274340+0000 mon.c (mon.1) 2436 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.275089+0000 mgr.gibba043.dnkmem (mgr.34373) 9444 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.275244+0000 mgr.gibba043.dnkmem (mgr.34373) 9445 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.275730+0000 mon.c (mon.1) 2437 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.276667+0000 mgr.gibba043.dnkmem (mgr.34373) 9446 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.276706+0000 mgr.gibba043.dnkmem (mgr.34373) 9447 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:17.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.277233+0000 mon.c (mon.1) 2438 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.277853+0000 mgr.gibba043.dnkmem (mgr.34373) 9448 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:17.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.278568+0000 mon.c (mon.1) 2439 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.279615+0000 mgr.gibba043.dnkmem (mgr.34373) 9449 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:17.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.279674+0000 mgr.gibba043.dnkmem (mgr.34373) 9450 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:17.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.281002+0000 mgr.gibba043.dnkmem (mgr.34373) 9451 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:17.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.281365+0000 mgr.gibba043.dnkmem (mgr.34373) 9452 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:17.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.281763+0000 mon.c (mon.1) 2440 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.282574+0000 mgr.gibba043.dnkmem (mgr.34373) 9453 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:17.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.282612+0000 mgr.gibba043.dnkmem (mgr.34373) 9454 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:17.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: cephadm 2021-03-10T16:50:16.282720+0000 mgr.gibba043.dnkmem (mgr.34373) 9455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:17.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.283168+0000 mon.c (mon.1) 2441 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:17.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:17 gibba043 bash[24019]: audit 2021-03-10T16:50:16.759883+0000 mon.c (mon.1) 2442 : audit [DBG] from='client.? 172.21.2.103:0/982633476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:18.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:18 gibba003 bash[31385]: audit 2021-03-10T16:50:16.496305+0000 mgr.gibba043.dnkmem (mgr.34373) 9456 : audit [DBG] from='client.50391 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:18.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:18 gibba003 bash[31385]: cluster 2021-03-10T16:50:17.021595+0000 mgr.gibba043.dnkmem (mgr.34373) 9457 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:18 gibba003 bash[32348]: audit 2021-03-10T16:50:16.496305+0000 mgr.gibba043.dnkmem (mgr.34373) 9456 : audit [DBG] from='client.50391 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:18.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:18 gibba003 bash[32348]: cluster 2021-03-10T16:50:17.021595+0000 mgr.gibba043.dnkmem (mgr.34373) 9457 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:18 gibba043 bash[24019]: audit 2021-03-10T16:50:16.496305+0000 mgr.gibba043.dnkmem (mgr.34373) 9456 : audit [DBG] from='client.50391 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:18.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:18 gibba043 bash[24019]: cluster 2021-03-10T16:50:17.021595+0000 mgr.gibba043.dnkmem (mgr.34373) 9457 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:20.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:20 gibba003 bash[31385]: cluster 2021-03-10T16:50:19.022919+0000 mgr.gibba043.dnkmem (mgr.34373) 9458 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:20.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:20 gibba003 bash[32348]: cluster 2021-03-10T16:50:19.022919+0000 mgr.gibba043.dnkmem (mgr.34373) 9458 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:20.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:20 gibba043 bash[24019]: cluster 2021-03-10T16:50:19.022919+0000 mgr.gibba043.dnkmem (mgr.34373) 9458 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:22 gibba003 bash[31385]: cluster 2021-03-10T16:50:21.024274+0000 mgr.gibba043.dnkmem (mgr.34373) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.687 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:22 gibba003 bash[32348]: cluster 2021-03-10T16:50:21.024274+0000 mgr.gibba043.dnkmem (mgr.34373) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:22 gibba043 bash[24019]: cluster 2021-03-10T16:50:21.024274+0000 mgr.gibba043.dnkmem (mgr.34373) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:24 gibba003 bash[31385]: cluster 2021-03-10T16:50:23.025790+0000 mgr.gibba043.dnkmem (mgr.34373) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:24 gibba003 bash[32348]: cluster 2021-03-10T16:50:23.025790+0000 mgr.gibba043.dnkmem (mgr.34373) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:24 gibba043 bash[24019]: cluster 2021-03-10T16:50:23.025790+0000 mgr.gibba043.dnkmem (mgr.34373) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:26.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:26 gibba003 bash[31385]: cluster 2021-03-10T16:50:25.027425+0000 mgr.gibba043.dnkmem (mgr.34373) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:26.687 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:26 gibba003 bash[32348]: cluster 2021-03-10T16:50:25.027425+0000 mgr.gibba043.dnkmem (mgr.34373) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:26.768 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:26 gibba043 bash[24019]: cluster 2021-03-10T16:50:25.027425+0000 mgr.gibba043.dnkmem (mgr.34373) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:27 gibba043 bash[24019]: cluster 2021-03-10T16:50:27.028910+0000 mgr.gibba043.dnkmem (mgr.34373) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:28.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:27 gibba003 bash[31385]: cluster 2021-03-10T16:50:27.028910+0000 mgr.gibba043.dnkmem (mgr.34373) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:28.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:27 gibba003 bash[32348]: cluster 2021-03-10T16:50:27.028910+0000 mgr.gibba043.dnkmem (mgr.34373) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:30.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:30 gibba003 bash[31385]: cluster 2021-03-10T16:50:29.030405+0000 mgr.gibba043.dnkmem (mgr.34373) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:30 gibba003 bash[32348]: cluster 2021-03-10T16:50:29.030405+0000 mgr.gibba043.dnkmem (mgr.34373) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:30.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:30 gibba043 bash[24019]: cluster 2021-03-10T16:50:29.030405+0000 mgr.gibba043.dnkmem (mgr.34373) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:32 gibba003 bash[31385]: cluster 2021-03-10T16:50:31.032194+0000 mgr.gibba043.dnkmem (mgr.34373) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:32 gibba003 bash[31385]: cephadm 2021-03-10T16:50:31.291081+0000 mgr.gibba043.dnkmem (mgr.34373) 9465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:32.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:32 gibba003 bash[32348]: cluster 2021-03-10T16:50:31.032194+0000 mgr.gibba043.dnkmem (mgr.34373) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:32 gibba003 bash[32348]: cephadm 2021-03-10T16:50:31.291081+0000 mgr.gibba043.dnkmem (mgr.34373) 9465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:32.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:32 gibba043 bash[24019]: cluster 2021-03-10T16:50:31.032194+0000 mgr.gibba043.dnkmem (mgr.34373) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:32 gibba043 bash[24019]: cephadm 2021-03-10T16:50:31.291081+0000 mgr.gibba043.dnkmem (mgr.34373) 9465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:34 gibba003 bash[31385]: cluster 2021-03-10T16:50:33.033577+0000 mgr.gibba043.dnkmem (mgr.34373) 9466 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:34 gibba003 bash[32348]: cluster 2021-03-10T16:50:33.033577+0000 mgr.gibba043.dnkmem (mgr.34373) 9466 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:34 gibba043 bash[24019]: cluster 2021-03-10T16:50:33.033577+0000 mgr.gibba043.dnkmem (mgr.34373) 9466 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:36 gibba003 bash[31385]: cluster 2021-03-10T16:50:35.035123+0000 mgr.gibba043.dnkmem (mgr.34373) 9467 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:36.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:36 gibba003 bash[32348]: cluster 2021-03-10T16:50:35.035123+0000 mgr.gibba043.dnkmem (mgr.34373) 9467 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:36.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:36 gibba043 bash[24019]: cluster 2021-03-10T16:50:35.035123+0000 mgr.gibba043.dnkmem (mgr.34373) 9467 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:37 gibba043 bash[24019]: cluster 2021-03-10T16:50:37.036805+0000 mgr.gibba043.dnkmem (mgr.34373) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:37 gibba003 bash[31385]: cluster 2021-03-10T16:50:37.036805+0000 mgr.gibba043.dnkmem (mgr.34373) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:37 gibba003 bash[32348]: cluster 2021-03-10T16:50:37.036805+0000 mgr.gibba043.dnkmem (mgr.34373) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:40 gibba003 bash[31385]: cluster 2021-03-10T16:50:39.038436+0000 mgr.gibba043.dnkmem (mgr.34373) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:40 gibba003 bash[32348]: cluster 2021-03-10T16:50:39.038436+0000 mgr.gibba043.dnkmem (mgr.34373) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:40 gibba043 bash[24019]: cluster 2021-03-10T16:50:39.038436+0000 mgr.gibba043.dnkmem (mgr.34373) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:42 gibba003 bash[31385]: cluster 2021-03-10T16:50:41.040125+0000 mgr.gibba043.dnkmem (mgr.34373) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:42 gibba003 bash[32348]: cluster 2021-03-10T16:50:41.040125+0000 mgr.gibba043.dnkmem (mgr.34373) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:42 gibba043 bash[24019]: cluster 2021-03-10T16:50:41.040125+0000 mgr.gibba043.dnkmem (mgr.34373) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:44 gibba003 bash[31385]: cluster 2021-03-10T16:50:43.041664+0000 mgr.gibba043.dnkmem (mgr.34373) 9471 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:44 gibba003 bash[32348]: cluster 2021-03-10T16:50:43.041664+0000 mgr.gibba043.dnkmem (mgr.34373) 9471 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:44 gibba043 bash[24019]: cluster 2021-03-10T16:50:43.041664+0000 mgr.gibba043.dnkmem (mgr.34373) 9471 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:46 gibba003 bash[31385]: cluster 2021-03-10T16:50:45.043207+0000 mgr.gibba043.dnkmem (mgr.34373) 9472 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:46 gibba003 bash[32348]: cluster 2021-03-10T16:50:45.043207+0000 mgr.gibba043.dnkmem (mgr.34373) 9472 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:46 gibba043 bash[24019]: cluster 2021-03-10T16:50:45.043207+0000 mgr.gibba043.dnkmem (mgr.34373) 9472 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.998 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:50:47.232 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:50:47.232 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 99s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:50:47.233 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 35s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:50:47.233 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:50:47.234 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:50:47.234 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:50:47.234 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:50:47.235 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:50:47.235 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:50:47.235 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 99s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:50:47.236 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 35s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:50:47.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:50:47.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:50:47.236 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:50:47.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:50:47.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:50:47.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:50:47.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:50:47.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:50:47.238 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 35s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:50:47.238 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 99s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:50:47.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:47 gibba003 bash[31385]: cephadm 2021-03-10T16:50:46.304618+0000 mgr.gibba043.dnkmem (mgr.34373) 9473 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:47.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:47 gibba003 bash[32348]: cephadm 2021-03-10T16:50:46.304618+0000 mgr.gibba043.dnkmem (mgr.34373) 9473 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:47.480 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:50:47.480 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:50:47.481 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:47.481 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:50:47.481 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:50:47.482 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:47.482 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:50:47.483 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:50:47.483 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:50:47.495 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:50:47.496 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:50:47.496 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:50:47.496 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:50:47.497 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:50:47.497 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:50:47.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:47 gibba043 bash[24019]: cephadm 2021-03-10T16:50:46.304618+0000 mgr.gibba043.dnkmem (mgr.34373) 9473 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:50:48.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[31385]: audit 2021-03-10T16:50:46.991588+0000 mgr.gibba043.dnkmem (mgr.34373) 9474 : audit [DBG] from='client.60394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[31385]: cluster 2021-03-10T16:50:47.044844+0000 mgr.gibba043.dnkmem (mgr.34373) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[31385]: audit 2021-03-10T16:50:47.217659+0000 mgr.gibba043.dnkmem (mgr.34373) 9476 : audit [DBG] from='client.50409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[31385]: audit 2021-03-10T16:50:47.482958+0000 mon.c (mon.1) 2443 : audit [DBG] from='client.? 172.21.2.103:0/3771078037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[32348]: audit 2021-03-10T16:50:46.991588+0000 mgr.gibba043.dnkmem (mgr.34373) 9474 : audit [DBG] from='client.60394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[32348]: cluster 2021-03-10T16:50:47.044844+0000 mgr.gibba043.dnkmem (mgr.34373) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[32348]: audit 2021-03-10T16:50:47.217659+0000 mgr.gibba043.dnkmem (mgr.34373) 9476 : audit [DBG] from='client.50409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:48 gibba003 bash[32348]: audit 2021-03-10T16:50:47.482958+0000 mon.c (mon.1) 2443 : audit [DBG] from='client.? 172.21.2.103:0/3771078037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:48.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:48 gibba043 bash[24019]: audit 2021-03-10T16:50:46.991588+0000 mgr.gibba043.dnkmem (mgr.34373) 9474 : audit [DBG] from='client.60394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:48 gibba043 bash[24019]: cluster 2021-03-10T16:50:47.044844+0000 mgr.gibba043.dnkmem (mgr.34373) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:48 gibba043 bash[24019]: audit 2021-03-10T16:50:47.217659+0000 mgr.gibba043.dnkmem (mgr.34373) 9476 : audit [DBG] from='client.50409 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:48 gibba043 bash[24019]: audit 2021-03-10T16:50:47.482958+0000 mon.c (mon.1) 2443 : audit [DBG] from='client.? 172.21.2.103:0/3771078037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:50.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:50 gibba003 bash[31385]: cluster 2021-03-10T16:50:49.046430+0000 mgr.gibba043.dnkmem (mgr.34373) 9477 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:50 gibba003 bash[32348]: cluster 2021-03-10T16:50:49.046430+0000 mgr.gibba043.dnkmem (mgr.34373) 9477 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:50 gibba043 bash[24019]: cluster 2021-03-10T16:50:49.046430+0000 mgr.gibba043.dnkmem (mgr.34373) 9477 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:52 gibba003 bash[31385]: cluster 2021-03-10T16:50:51.047863+0000 mgr.gibba043.dnkmem (mgr.34373) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:52 gibba003 bash[32348]: cluster 2021-03-10T16:50:51.047863+0000 mgr.gibba043.dnkmem (mgr.34373) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:52 gibba043 bash[24019]: cluster 2021-03-10T16:50:51.047863+0000 mgr.gibba043.dnkmem (mgr.34373) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:54 gibba003 bash[31385]: cluster 2021-03-10T16:50:53.049165+0000 mgr.gibba043.dnkmem (mgr.34373) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:54 gibba003 bash[32348]: cluster 2021-03-10T16:50:53.049165+0000 mgr.gibba043.dnkmem (mgr.34373) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:54 gibba043 bash[24019]: cluster 2021-03-10T16:50:53.049165+0000 mgr.gibba043.dnkmem (mgr.34373) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:56 gibba003 bash[31385]: cluster 2021-03-10T16:50:55.050702+0000 mgr.gibba043.dnkmem (mgr.34373) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:56 gibba003 bash[32348]: cluster 2021-03-10T16:50:55.050702+0000 mgr.gibba043.dnkmem (mgr.34373) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:56 gibba043 bash[24019]: cluster 2021-03-10T16:50:55.050702+0000 mgr.gibba043.dnkmem (mgr.34373) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:50:57 gibba043 bash[24019]: cluster 2021-03-10T16:50:57.052189+0000 mgr.gibba043.dnkmem (mgr.34373) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:50:57 gibba003 bash[31385]: cluster 2021-03-10T16:50:57.052189+0000 mgr.gibba043.dnkmem (mgr.34373) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:50:57 gibba003 bash[32348]: cluster 2021-03-10T16:50:57.052189+0000 mgr.gibba043.dnkmem (mgr.34373) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:00 gibba003 bash[31385]: cluster 2021-03-10T16:50:59.053823+0000 mgr.gibba043.dnkmem (mgr.34373) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:00 gibba003 bash[32348]: cluster 2021-03-10T16:50:59.053823+0000 mgr.gibba043.dnkmem (mgr.34373) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:00 gibba043 bash[24019]: cluster 2021-03-10T16:50:59.053823+0000 mgr.gibba043.dnkmem (mgr.34373) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:02 gibba003 bash[31385]: cluster 2021-03-10T16:51:01.055505+0000 mgr.gibba043.dnkmem (mgr.34373) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:02 gibba003 bash[31385]: cephadm 2021-03-10T16:51:01.320669+0000 mgr.gibba043.dnkmem (mgr.34373) 9484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:02.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:02 gibba003 bash[32348]: cluster 2021-03-10T16:51:01.055505+0000 mgr.gibba043.dnkmem (mgr.34373) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:02 gibba003 bash[32348]: cephadm 2021-03-10T16:51:01.320669+0000 mgr.gibba043.dnkmem (mgr.34373) 9484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:02 gibba043 bash[24019]: cluster 2021-03-10T16:51:01.055505+0000 mgr.gibba043.dnkmem (mgr.34373) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:02 gibba043 bash[24019]: cephadm 2021-03-10T16:51:01.320669+0000 mgr.gibba043.dnkmem (mgr.34373) 9484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:04.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:04 gibba003 bash[31385]: cluster 2021-03-10T16:51:03.057168+0000 mgr.gibba043.dnkmem (mgr.34373) 9485 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:04 gibba003 bash[32348]: cluster 2021-03-10T16:51:03.057168+0000 mgr.gibba043.dnkmem (mgr.34373) 9485 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:04 gibba043 bash[24019]: cluster 2021-03-10T16:51:03.057168+0000 mgr.gibba043.dnkmem (mgr.34373) 9485 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:06 gibba003 bash[31385]: cluster 2021-03-10T16:51:05.058737+0000 mgr.gibba043.dnkmem (mgr.34373) 9486 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:06 gibba003 bash[32348]: cluster 2021-03-10T16:51:05.058737+0000 mgr.gibba043.dnkmem (mgr.34373) 9486 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:06 gibba043 bash[24019]: cluster 2021-03-10T16:51:05.058737+0000 mgr.gibba043.dnkmem (mgr.34373) 9486 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:07 gibba043 bash[24019]: cluster 2021-03-10T16:51:07.060370+0000 mgr.gibba043.dnkmem (mgr.34373) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:07 gibba003 bash[31385]: cluster 2021-03-10T16:51:07.060370+0000 mgr.gibba043.dnkmem (mgr.34373) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:07 gibba003 bash[32348]: cluster 2021-03-10T16:51:07.060370+0000 mgr.gibba043.dnkmem (mgr.34373) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:10.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:10 gibba003 bash[31385]: cluster 2021-03-10T16:51:09.062024+0000 mgr.gibba043.dnkmem (mgr.34373) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:10.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:10 gibba003 bash[32348]: cluster 2021-03-10T16:51:09.062024+0000 mgr.gibba043.dnkmem (mgr.34373) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:10.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:10 gibba043 bash[24019]: cluster 2021-03-10T16:51:09.062024+0000 mgr.gibba043.dnkmem (mgr.34373) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:12 gibba003 bash[31385]: cluster 2021-03-10T16:51:11.063575+0000 mgr.gibba043.dnkmem (mgr.34373) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:12 gibba003 bash[32348]: cluster 2021-03-10T16:51:11.063575+0000 mgr.gibba043.dnkmem (mgr.34373) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:12 gibba043 bash[24019]: cluster 2021-03-10T16:51:11.063575+0000 mgr.gibba043.dnkmem (mgr.34373) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[31385]: cluster 2021-03-10T16:51:13.064971+0000 mgr.gibba043.dnkmem (mgr.34373) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[31385]: audit 2021-03-10T16:51:13.868325+0000 mon.c (mon.1) 2444 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[31385]: audit 2021-03-10T16:51:13.869546+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:14.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[31385]: audit 2021-03-10T16:51:14.102085+0000 mon.c (mon.1) 2445 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:14.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[31385]: audit 2021-03-10T16:51:14.103357+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:14.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[32348]: cluster 2021-03-10T16:51:13.064971+0000 mgr.gibba043.dnkmem (mgr.34373) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[32348]: audit 2021-03-10T16:51:13.868325+0000 mon.c (mon.1) 2444 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[32348]: audit 2021-03-10T16:51:13.869546+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[32348]: audit 2021-03-10T16:51:14.102085+0000 mon.c (mon.1) 2445 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:14.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:14 gibba003 bash[32348]: audit 2021-03-10T16:51:14.103357+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:14 gibba043 bash[24019]: cluster 2021-03-10T16:51:13.064971+0000 mgr.gibba043.dnkmem (mgr.34373) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:14 gibba043 bash[24019]: audit 2021-03-10T16:51:13.868325+0000 mon.c (mon.1) 2444 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:14 gibba043 bash[24019]: audit 2021-03-10T16:51:13.869546+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:14 gibba043 bash[24019]: audit 2021-03-10T16:51:14.102085+0000 mon.c (mon.1) 2445 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:14 gibba043 bash[24019]: audit 2021-03-10T16:51:14.103357+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:15.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.382920+0000 mon.c (mon.1) 2446 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:51:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.383745+0000 mon.c (mon.1) 2447 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.384230+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:51:15.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.384454+0000 mon.c (mon.1) 2448 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.385166+0000 mon.c (mon.1) 2449 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.386321+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.387465+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[31385]: audit 2021-03-10T16:51:14.388385+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.382920+0000 mon.c (mon.1) 2446 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:51:15.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.383745+0000 mon.c (mon.1) 2447 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.384230+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:51:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.384454+0000 mon.c (mon.1) 2448 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.385166+0000 mon.c (mon.1) 2449 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.386321+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.387465+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:15 gibba003 bash[32348]: audit 2021-03-10T16:51:14.388385+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.382920+0000 mon.c (mon.1) 2446 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:51:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.383745+0000 mon.c (mon.1) 2447 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.384230+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:51:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.384454+0000 mon.c (mon.1) 2448 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.385166+0000 mon.c (mon.1) 2449 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.386321+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.387465+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:51:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:15 gibba043 bash[24019]: audit 2021-03-10T16:51:14.388385+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:16.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:16 gibba003 bash[31385]: cluster 2021-03-10T16:51:15.066576+0000 mgr.gibba043.dnkmem (mgr.34373) 9491 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:16 gibba003 bash[32348]: cluster 2021-03-10T16:51:15.066576+0000 mgr.gibba043.dnkmem (mgr.34373) 9491 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:16 gibba043 bash[24019]: cluster 2021-03-10T16:51:15.066576+0000 mgr.gibba043.dnkmem (mgr.34373) 9491 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:17.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.333737+0000 mgr.gibba043.dnkmem (mgr.34373) 9492 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:51:17.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.335344+0000 mgr.gibba043.dnkmem (mgr.34373) 9493 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:51:17.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.547293+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:51:17.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.550980+0000 mon.c (mon.1) 2450 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:17.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.552653+0000 mon.c (mon.1) 2451 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.553989+0000 mon.c (mon.1) 2452 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.555304+0000 mon.c (mon.1) 2453 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.557778+0000 mon.c (mon.1) 2454 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[31385]: audit 2021-03-10T16:51:16.558996+0000 mon.c (mon.1) 2455 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.333737+0000 mgr.gibba043.dnkmem (mgr.34373) 9492 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:51:17.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.335344+0000 mgr.gibba043.dnkmem (mgr.34373) 9493 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:51:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.547293+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:51:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.550980+0000 mon.c (mon.1) 2450 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.552653+0000 mon.c (mon.1) 2451 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.553989+0000 mon.c (mon.1) 2452 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.555304+0000 mon.c (mon.1) 2453 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.557778+0000 mon.c (mon.1) 2454 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:17 gibba003 bash[32348]: audit 2021-03-10T16:51:16.558996+0000 mon.c (mon.1) 2455 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.333737+0000 mgr.gibba043.dnkmem (mgr.34373) 9492 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:51:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.335344+0000 mgr.gibba043.dnkmem (mgr.34373) 9493 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:51:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.547293+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:51:17.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.550980+0000 mon.c (mon.1) 2450 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.552653+0000 mon.c (mon.1) 2451 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.553989+0000 mon.c (mon.1) 2452 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.555304+0000 mon.c (mon.1) 2453 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.557778+0000 mon.c (mon.1) 2454 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:17 gibba043 bash[24019]: audit 2021-03-10T16:51:16.558996+0000 mon.c (mon.1) 2455 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:17.722 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:51:17.949 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:51:17.949 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (2h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:51:17.949 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 66s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:51:17.950 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:51:17.951 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:51:17.951 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:51:17.951 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:51:17.952 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:51:17.952 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:51:17.952 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:51:17.952 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 66s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:51:17.953 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:51:17.953 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:51:17.953 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:51:17.954 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:51:17.954 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:51:17.954 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:51:17.955 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:51:17.955 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:51:17.955 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 66s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:51:17.955 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:51:18.201 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:51:18.201 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:51:18.202 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:18.202 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:51:18.203 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:51:18.203 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:18.204 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:51:18.204 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:51:18.204 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:51:18.205 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:51:18.205 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:51:18.205 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:51:18.206 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:51:18.206 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:51:18.206 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:51:18.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.548576+0000 mgr.gibba043.dnkmem (mgr.34373) 9494 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.550559+0000 mgr.gibba043.dnkmem (mgr.34373) 9495 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.551846+0000 mgr.gibba043.dnkmem (mgr.34373) 9496 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.551882+0000 mgr.gibba043.dnkmem (mgr.34373) 9497 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.553236+0000 mgr.gibba043.dnkmem (mgr.34373) 9498 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.553275+0000 mgr.gibba043.dnkmem (mgr.34373) 9499 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.554542+0000 mgr.gibba043.dnkmem (mgr.34373) 9500 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.555775+0000 mgr.gibba043.dnkmem (mgr.34373) 9501 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.555815+0000 mgr.gibba043.dnkmem (mgr.34373) 9502 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.556831+0000 mgr.gibba043.dnkmem (mgr.34373) 9503 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.557176+0000 mgr.gibba043.dnkmem (mgr.34373) 9504 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.558172+0000 mgr.gibba043.dnkmem (mgr.34373) 9505 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:18.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.558216+0000 mgr.gibba043.dnkmem (mgr.34373) 9506 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cephadm 2021-03-10T16:51:16.558335+0000 mgr.gibba043.dnkmem (mgr.34373) 9507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:18.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[31385]: cluster 2021-03-10T16:51:17.068151+0000 mgr.gibba043.dnkmem (mgr.34373) 9508 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.548576+0000 mgr.gibba043.dnkmem (mgr.34373) 9494 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.550559+0000 mgr.gibba043.dnkmem (mgr.34373) 9495 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:18.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.551846+0000 mgr.gibba043.dnkmem (mgr.34373) 9496 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:18.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.551882+0000 mgr.gibba043.dnkmem (mgr.34373) 9497 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:18.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.553236+0000 mgr.gibba043.dnkmem (mgr.34373) 9498 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:18.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.553275+0000 mgr.gibba043.dnkmem (mgr.34373) 9499 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.554542+0000 mgr.gibba043.dnkmem (mgr.34373) 9500 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:18.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.555775+0000 mgr.gibba043.dnkmem (mgr.34373) 9501 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.555815+0000 mgr.gibba043.dnkmem (mgr.34373) 9502 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:18.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.556831+0000 mgr.gibba043.dnkmem (mgr.34373) 9503 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:18.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.557176+0000 mgr.gibba043.dnkmem (mgr.34373) 9504 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:18.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.558172+0000 mgr.gibba043.dnkmem (mgr.34373) 9505 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:18.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.558216+0000 mgr.gibba043.dnkmem (mgr.34373) 9506 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:18.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cephadm 2021-03-10T16:51:16.558335+0000 mgr.gibba043.dnkmem (mgr.34373) 9507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:18.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:18 gibba003 bash[32348]: cluster 2021-03-10T16:51:17.068151+0000 mgr.gibba043.dnkmem (mgr.34373) 9508 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.548576+0000 mgr.gibba043.dnkmem (mgr.34373) 9494 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:18.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.550559+0000 mgr.gibba043.dnkmem (mgr.34373) 9495 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:18.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.551846+0000 mgr.gibba043.dnkmem (mgr.34373) 9496 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.551882+0000 mgr.gibba043.dnkmem (mgr.34373) 9497 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.553236+0000 mgr.gibba043.dnkmem (mgr.34373) 9498 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.553275+0000 mgr.gibba043.dnkmem (mgr.34373) 9499 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.554542+0000 mgr.gibba043.dnkmem (mgr.34373) 9500 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.555775+0000 mgr.gibba043.dnkmem (mgr.34373) 9501 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.555815+0000 mgr.gibba043.dnkmem (mgr.34373) 9502 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.556831+0000 mgr.gibba043.dnkmem (mgr.34373) 9503 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.557176+0000 mgr.gibba043.dnkmem (mgr.34373) 9504 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.558172+0000 mgr.gibba043.dnkmem (mgr.34373) 9505 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.558216+0000 mgr.gibba043.dnkmem (mgr.34373) 9506 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cephadm 2021-03-10T16:51:16.558335+0000 mgr.gibba043.dnkmem (mgr.34373) 9507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:18 gibba043 bash[24019]: cluster 2021-03-10T16:51:17.068151+0000 mgr.gibba043.dnkmem (mgr.34373) 9508 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:19 gibba003 bash[31385]: audit 2021-03-10T16:51:17.714172+0000 mgr.gibba043.dnkmem (mgr.34373) 9509 : audit [DBG] from='client.50421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:19 gibba003 bash[31385]: audit 2021-03-10T16:51:17.938316+0000 mgr.gibba043.dnkmem (mgr.34373) 9510 : audit [DBG] from='client.60418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:19 gibba003 bash[31385]: audit 2021-03-10T16:51:18.204527+0000 mon.a (mon.0) 1974 : audit [DBG] from='client.? 172.21.2.103:0/2471828696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:19 gibba003 bash[32348]: audit 2021-03-10T16:51:17.714172+0000 mgr.gibba043.dnkmem (mgr.34373) 9509 : audit [DBG] from='client.50421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:19 gibba003 bash[32348]: audit 2021-03-10T16:51:17.938316+0000 mgr.gibba043.dnkmem (mgr.34373) 9510 : audit [DBG] from='client.60418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:19 gibba003 bash[32348]: audit 2021-03-10T16:51:18.204527+0000 mon.a (mon.0) 1974 : audit [DBG] from='client.? 172.21.2.103:0/2471828696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:19.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:19 gibba043 bash[24019]: audit 2021-03-10T16:51:17.714172+0000 mgr.gibba043.dnkmem (mgr.34373) 9509 : audit [DBG] from='client.50421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:19.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:19 gibba043 bash[24019]: audit 2021-03-10T16:51:17.938316+0000 mgr.gibba043.dnkmem (mgr.34373) 9510 : audit [DBG] from='client.60418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:19.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:19 gibba043 bash[24019]: audit 2021-03-10T16:51:18.204527+0000 mon.a (mon.0) 1974 : audit [DBG] from='client.? 172.21.2.103:0/2471828696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:20.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:20 gibba003 bash[31385]: cluster 2021-03-10T16:51:19.069812+0000 mgr.gibba043.dnkmem (mgr.34373) 9511 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:20 gibba003 bash[32348]: cluster 2021-03-10T16:51:19.069812+0000 mgr.gibba043.dnkmem (mgr.34373) 9511 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:20 gibba043 bash[24019]: cluster 2021-03-10T16:51:19.069812+0000 mgr.gibba043.dnkmem (mgr.34373) 9511 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:22 gibba043 bash[24019]: cluster 2021-03-10T16:51:21.071539+0000 mgr.gibba043.dnkmem (mgr.34373) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:22 gibba003 bash[31385]: cluster 2021-03-10T16:51:21.071539+0000 mgr.gibba043.dnkmem (mgr.34373) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:22 gibba003 bash[32348]: cluster 2021-03-10T16:51:21.071539+0000 mgr.gibba043.dnkmem (mgr.34373) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:24 gibba043 bash[24019]: cluster 2021-03-10T16:51:23.072947+0000 mgr.gibba043.dnkmem (mgr.34373) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:24 gibba003 bash[31385]: cluster 2021-03-10T16:51:23.072947+0000 mgr.gibba043.dnkmem (mgr.34373) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:24 gibba003 bash[32348]: cluster 2021-03-10T16:51:23.072947+0000 mgr.gibba043.dnkmem (mgr.34373) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:26 gibba043 bash[24019]: cluster 2021-03-10T16:51:25.074384+0000 mgr.gibba043.dnkmem (mgr.34373) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:26 gibba003 bash[31385]: cluster 2021-03-10T16:51:25.074384+0000 mgr.gibba043.dnkmem (mgr.34373) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:26 gibba003 bash[32348]: cluster 2021-03-10T16:51:25.074384+0000 mgr.gibba043.dnkmem (mgr.34373) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:27 gibba043 bash[24019]: cluster 2021-03-10T16:51:27.076087+0000 mgr.gibba043.dnkmem (mgr.34373) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:27 gibba003 bash[31385]: cluster 2021-03-10T16:51:27.076087+0000 mgr.gibba043.dnkmem (mgr.34373) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:27 gibba003 bash[32348]: cluster 2021-03-10T16:51:27.076087+0000 mgr.gibba043.dnkmem (mgr.34373) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:30 gibba003 bash[31385]: cluster 2021-03-10T16:51:29.077587+0000 mgr.gibba043.dnkmem (mgr.34373) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:30 gibba003 bash[32348]: cluster 2021-03-10T16:51:29.077587+0000 mgr.gibba043.dnkmem (mgr.34373) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:30 gibba043 bash[24019]: cluster 2021-03-10T16:51:29.077587+0000 mgr.gibba043.dnkmem (mgr.34373) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:32 gibba003 bash[31385]: cluster 2021-03-10T16:51:31.079270+0000 mgr.gibba043.dnkmem (mgr.34373) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:32 gibba003 bash[32348]: cluster 2021-03-10T16:51:31.079270+0000 mgr.gibba043.dnkmem (mgr.34373) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:32 gibba043 bash[24019]: cluster 2021-03-10T16:51:31.079270+0000 mgr.gibba043.dnkmem (mgr.34373) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:33.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:33 gibba003 bash[31385]: cephadm 2021-03-10T16:51:31.574358+0000 mgr.gibba043.dnkmem (mgr.34373) 9518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:33.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:33 gibba003 bash[32348]: cephadm 2021-03-10T16:51:31.574358+0000 mgr.gibba043.dnkmem (mgr.34373) 9518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:33 gibba043 bash[24019]: cephadm 2021-03-10T16:51:31.574358+0000 mgr.gibba043.dnkmem (mgr.34373) 9518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:34.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:34 gibba003 bash[31385]: cluster 2021-03-10T16:51:33.080941+0000 mgr.gibba043.dnkmem (mgr.34373) 9519 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:34 gibba003 bash[32348]: cluster 2021-03-10T16:51:33.080941+0000 mgr.gibba043.dnkmem (mgr.34373) 9519 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:34 gibba043 bash[24019]: cluster 2021-03-10T16:51:33.080941+0000 mgr.gibba043.dnkmem (mgr.34373) 9519 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:36 gibba003 bash[31385]: cluster 2021-03-10T16:51:35.082707+0000 mgr.gibba043.dnkmem (mgr.34373) 9520 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:36 gibba003 bash[32348]: cluster 2021-03-10T16:51:35.082707+0000 mgr.gibba043.dnkmem (mgr.34373) 9520 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:36 gibba043 bash[24019]: cluster 2021-03-10T16:51:35.082707+0000 mgr.gibba043.dnkmem (mgr.34373) 9520 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:37 gibba043 bash[24019]: cluster 2021-03-10T16:51:37.084426+0000 mgr.gibba043.dnkmem (mgr.34373) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:37 gibba003 bash[31385]: cluster 2021-03-10T16:51:37.084426+0000 mgr.gibba043.dnkmem (mgr.34373) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:37 gibba003 bash[32348]: cluster 2021-03-10T16:51:37.084426+0000 mgr.gibba043.dnkmem (mgr.34373) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:40 gibba003 bash[31385]: cluster 2021-03-10T16:51:39.086204+0000 mgr.gibba043.dnkmem (mgr.34373) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:40 gibba003 bash[32348]: cluster 2021-03-10T16:51:39.086204+0000 mgr.gibba043.dnkmem (mgr.34373) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:40 gibba043 bash[24019]: cluster 2021-03-10T16:51:39.086204+0000 mgr.gibba043.dnkmem (mgr.34373) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:42 gibba003 bash[31385]: cluster 2021-03-10T16:51:41.088075+0000 mgr.gibba043.dnkmem (mgr.34373) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:42 gibba003 bash[32348]: cluster 2021-03-10T16:51:41.088075+0000 mgr.gibba043.dnkmem (mgr.34373) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:42 gibba043 bash[24019]: cluster 2021-03-10T16:51:41.088075+0000 mgr.gibba043.dnkmem (mgr.34373) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:44 gibba003 bash[31385]: cluster 2021-03-10T16:51:43.089636+0000 mgr.gibba043.dnkmem (mgr.34373) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:44 gibba003 bash[32348]: cluster 2021-03-10T16:51:43.089636+0000 mgr.gibba043.dnkmem (mgr.34373) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:44 gibba043 bash[24019]: cluster 2021-03-10T16:51:43.089636+0000 mgr.gibba043.dnkmem (mgr.34373) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:46.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:46 gibba003 bash[32348]: cluster 2021-03-10T16:51:45.091144+0000 mgr.gibba043.dnkmem (mgr.34373) 9525 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:46.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:46 gibba003 bash[31385]: cluster 2021-03-10T16:51:45.091144+0000 mgr.gibba043.dnkmem (mgr.34373) 9525 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:46.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:46 gibba043 bash[24019]: cluster 2021-03-10T16:51:45.091144+0000 mgr.gibba043.dnkmem (mgr.34373) 9525 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:47 gibba043 bash[24019]: cephadm 2021-03-10T16:51:46.590288+0000 mgr.gibba043.dnkmem (mgr.34373) 9526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:48.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:47 gibba043 bash[24019]: cluster 2021-03-10T16:51:47.092526+0000 mgr.gibba043.dnkmem (mgr.34373) 9527 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:47 gibba003 bash[31385]: cephadm 2021-03-10T16:51:46.590288+0000 mgr.gibba043.dnkmem (mgr.34373) 9526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:47 gibba003 bash[31385]: cluster 2021-03-10T16:51:47.092526+0000 mgr.gibba043.dnkmem (mgr.34373) 9527 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:47 gibba003 bash[32348]: cephadm 2021-03-10T16:51:46.590288+0000 mgr.gibba043.dnkmem (mgr.34373) 9526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:51:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:47 gibba003 bash[32348]: cluster 2021-03-10T16:51:47.092526+0000 mgr.gibba043.dnkmem (mgr.34373) 9527 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.441 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:51:48.666 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:51:48.666 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:51:48.667 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 97s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:51:48.667 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:51:48.667 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:51:48.667 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:51:48.667 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:51:48.668 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:51:48.668 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:51:48.668 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:51:48.668 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 97s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:51:48.669 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:51:48.669 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:51:48.669 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:51:48.669 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:51:48.669 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:51:48.670 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:51:48.670 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:51:48.671 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:51:48.672 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 97s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:51:48.674 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:51:48.915 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:51:48.916 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:51:48.916 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:48.916 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:51:48.916 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:51:48.917 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:48.917 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:51:48.917 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:51:48.917 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:51:48.918 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:51:48.918 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:51:48.918 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:51:48.918 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:51:48.919 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:51:48.919 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:51:49.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:49 gibba043 bash[24019]: audit 2021-03-10T16:51:48.918977+0000 mon.a (mon.0) 1975 : audit [DBG] from='client.? 172.21.2.103:0/2832853564' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:49.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:49 gibba003 bash[31385]: audit 2021-03-10T16:51:48.918977+0000 mon.a (mon.0) 1975 : audit [DBG] from='client.? 172.21.2.103:0/2832853564' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:49.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:49 gibba003 bash[32348]: audit 2021-03-10T16:51:48.918977+0000 mon.a (mon.0) 1975 : audit [DBG] from='client.? 172.21.2.103:0/2832853564' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:50.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:50 gibba043 bash[24019]: audit 2021-03-10T16:51:48.434533+0000 mgr.gibba043.dnkmem (mgr.34373) 9528 : audit [DBG] from='client.50439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:50.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:50 gibba043 bash[24019]: audit 2021-03-10T16:51:48.656292+0000 mgr.gibba043.dnkmem (mgr.34373) 9529 : audit [DBG] from='client.60436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:50.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:50 gibba043 bash[24019]: cluster 2021-03-10T16:51:49.093902+0000 mgr.gibba043.dnkmem (mgr.34373) 9530 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:50 gibba003 bash[31385]: audit 2021-03-10T16:51:48.434533+0000 mgr.gibba043.dnkmem (mgr.34373) 9528 : audit [DBG] from='client.50439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:50.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:50 gibba003 bash[31385]: audit 2021-03-10T16:51:48.656292+0000 mgr.gibba043.dnkmem (mgr.34373) 9529 : audit [DBG] from='client.60436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:50.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:50 gibba003 bash[31385]: cluster 2021-03-10T16:51:49.093902+0000 mgr.gibba043.dnkmem (mgr.34373) 9530 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:50 gibba003 bash[32348]: audit 2021-03-10T16:51:48.434533+0000 mgr.gibba043.dnkmem (mgr.34373) 9528 : audit [DBG] from='client.50439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:50 gibba003 bash[32348]: audit 2021-03-10T16:51:48.656292+0000 mgr.gibba043.dnkmem (mgr.34373) 9529 : audit [DBG] from='client.60436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:50 gibba003 bash[32348]: cluster 2021-03-10T16:51:49.093902+0000 mgr.gibba043.dnkmem (mgr.34373) 9530 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:52 gibba003 bash[31385]: cluster 2021-03-10T16:51:51.095607+0000 mgr.gibba043.dnkmem (mgr.34373) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:52 gibba003 bash[32348]: cluster 2021-03-10T16:51:51.095607+0000 mgr.gibba043.dnkmem (mgr.34373) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:52 gibba043 bash[24019]: cluster 2021-03-10T16:51:51.095607+0000 mgr.gibba043.dnkmem (mgr.34373) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:54 gibba003 bash[31385]: cluster 2021-03-10T16:51:53.097276+0000 mgr.gibba043.dnkmem (mgr.34373) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:54 gibba003 bash[32348]: cluster 2021-03-10T16:51:53.097276+0000 mgr.gibba043.dnkmem (mgr.34373) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:54 gibba043 bash[24019]: cluster 2021-03-10T16:51:53.097276+0000 mgr.gibba043.dnkmem (mgr.34373) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:56.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:56 gibba003 bash[31385]: cluster 2021-03-10T16:51:55.099124+0000 mgr.gibba043.dnkmem (mgr.34373) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:56.437 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:56 gibba003 bash[32348]: cluster 2021-03-10T16:51:55.099124+0000 mgr.gibba043.dnkmem (mgr.34373) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:56.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:56 gibba043 bash[24019]: cluster 2021-03-10T16:51:55.099124+0000 mgr.gibba043.dnkmem (mgr.34373) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.268 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:51:58 gibba043 bash[24019]: cluster 2021-03-10T16:51:57.100757+0000 mgr.gibba043.dnkmem (mgr.34373) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:51:58 gibba003 bash[31385]: cluster 2021-03-10T16:51:57.100757+0000 mgr.gibba043.dnkmem (mgr.34373) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:51:58 gibba003 bash[32348]: cluster 2021-03-10T16:51:57.100757+0000 mgr.gibba043.dnkmem (mgr.34373) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:00 gibba003 bash[31385]: cluster 2021-03-10T16:51:59.102416+0000 mgr.gibba043.dnkmem (mgr.34373) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:00 gibba003 bash[32348]: cluster 2021-03-10T16:51:59.102416+0000 mgr.gibba043.dnkmem (mgr.34373) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:00 gibba043 bash[24019]: cluster 2021-03-10T16:51:59.102416+0000 mgr.gibba043.dnkmem (mgr.34373) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:02 gibba003 bash[31385]: cluster 2021-03-10T16:52:01.103913+0000 mgr.gibba043.dnkmem (mgr.34373) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:02 gibba003 bash[32348]: cluster 2021-03-10T16:52:01.103913+0000 mgr.gibba043.dnkmem (mgr.34373) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:02 gibba043 bash[24019]: cluster 2021-03-10T16:52:01.103913+0000 mgr.gibba043.dnkmem (mgr.34373) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:03.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:03 gibba003 bash[31385]: cephadm 2021-03-10T16:52:01.606230+0000 mgr.gibba043.dnkmem (mgr.34373) 9537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:03.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:03 gibba003 bash[32348]: cephadm 2021-03-10T16:52:01.606230+0000 mgr.gibba043.dnkmem (mgr.34373) 9537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:03.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:03 gibba043 bash[24019]: cephadm 2021-03-10T16:52:01.606230+0000 mgr.gibba043.dnkmem (mgr.34373) 9537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:04.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:04 gibba043 bash[24019]: cluster 2021-03-10T16:52:03.105540+0000 mgr.gibba043.dnkmem (mgr.34373) 9538 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:04 gibba003 bash[31385]: cluster 2021-03-10T16:52:03.105540+0000 mgr.gibba043.dnkmem (mgr.34373) 9538 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:04 gibba003 bash[32348]: cluster 2021-03-10T16:52:03.105540+0000 mgr.gibba043.dnkmem (mgr.34373) 9538 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:06.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:06 gibba043 bash[24019]: cluster 2021-03-10T16:52:05.107089+0000 mgr.gibba043.dnkmem (mgr.34373) 9539 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:06.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:06 gibba003 bash[31385]: cluster 2021-03-10T16:52:05.107089+0000 mgr.gibba043.dnkmem (mgr.34373) 9539 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:06.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:06 gibba003 bash[32348]: cluster 2021-03-10T16:52:05.107089+0000 mgr.gibba043.dnkmem (mgr.34373) 9539 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:08 gibba043 bash[24019]: cluster 2021-03-10T16:52:07.108512+0000 mgr.gibba043.dnkmem (mgr.34373) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:08 gibba003 bash[31385]: cluster 2021-03-10T16:52:07.108512+0000 mgr.gibba043.dnkmem (mgr.34373) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:08 gibba003 bash[32348]: cluster 2021-03-10T16:52:07.108512+0000 mgr.gibba043.dnkmem (mgr.34373) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:10 gibba003 bash[31385]: cluster 2021-03-10T16:52:09.110017+0000 mgr.gibba043.dnkmem (mgr.34373) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:10 gibba003 bash[32348]: cluster 2021-03-10T16:52:09.110017+0000 mgr.gibba043.dnkmem (mgr.34373) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:10 gibba043 bash[24019]: cluster 2021-03-10T16:52:09.110017+0000 mgr.gibba043.dnkmem (mgr.34373) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:12.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:12 gibba003 bash[31385]: cluster 2021-03-10T16:52:11.111618+0000 mgr.gibba043.dnkmem (mgr.34373) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:12.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:12 gibba003 bash[32348]: cluster 2021-03-10T16:52:11.111618+0000 mgr.gibba043.dnkmem (mgr.34373) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:12.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:12 gibba043 bash[24019]: cluster 2021-03-10T16:52:11.111618+0000 mgr.gibba043.dnkmem (mgr.34373) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:14 gibba043 bash[24019]: cluster 2021-03-10T16:52:13.112942+0000 mgr.gibba043.dnkmem (mgr.34373) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:14 gibba043 bash[24019]: audit 2021-03-10T16:52:13.875672+0000 mon.c (mon.1) 2456 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:14 gibba043 bash[24019]: audit 2021-03-10T16:52:13.876740+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:14 gibba043 bash[24019]: audit 2021-03-10T16:52:14.109624+0000 mon.c (mon.1) 2457 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:14 gibba043 bash[24019]: audit 2021-03-10T16:52:14.110720+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:14.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[31385]: cluster 2021-03-10T16:52:13.112942+0000 mgr.gibba043.dnkmem (mgr.34373) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[31385]: audit 2021-03-10T16:52:13.875672+0000 mon.c (mon.1) 2456 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[31385]: audit 2021-03-10T16:52:13.876740+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[31385]: audit 2021-03-10T16:52:14.109624+0000 mon.c (mon.1) 2457 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[31385]: audit 2021-03-10T16:52:14.110720+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:14.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[32348]: cluster 2021-03-10T16:52:13.112942+0000 mgr.gibba043.dnkmem (mgr.34373) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[32348]: audit 2021-03-10T16:52:13.875672+0000 mon.c (mon.1) 2456 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[32348]: audit 2021-03-10T16:52:13.876740+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[32348]: audit 2021-03-10T16:52:14.109624+0000 mon.c (mon.1) 2457 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:14 gibba003 bash[32348]: audit 2021-03-10T16:52:14.110720+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.394263+0000 mon.c (mon.1) 2458 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:52:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.395056+0000 mon.c (mon.1) 2459 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.395492+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:52:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.395798+0000 mon.c (mon.1) 2460 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.396614+0000 mon.c (mon.1) 2461 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:52:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.396862+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.397987+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:15 gibba043 bash[24019]: audit 2021-03-10T16:52:14.398766+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:52:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.394263+0000 mon.c (mon.1) 2458 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:52:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.395056+0000 mon.c (mon.1) 2459 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.395492+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:52:15.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.395798+0000 mon.c (mon.1) 2460 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.396614+0000 mon.c (mon.1) 2461 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:52:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.396862+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.397987+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[31385]: audit 2021-03-10T16:52:14.398766+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:52:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.394263+0000 mon.c (mon.1) 2458 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:52:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.395056+0000 mon.c (mon.1) 2459 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.395492+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:52:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.395798+0000 mon.c (mon.1) 2460 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.396614+0000 mon.c (mon.1) 2461 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:52:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.396862+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.397987+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:15 gibba003 bash[32348]: audit 2021-03-10T16:52:14.398766+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:52:16.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:16 gibba043 bash[24019]: cluster 2021-03-10T16:52:15.114488+0000 mgr.gibba043.dnkmem (mgr.34373) 9544 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:16.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:16 gibba003 bash[31385]: cluster 2021-03-10T16:52:15.114488+0000 mgr.gibba043.dnkmem (mgr.34373) 9544 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:16.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:16 gibba003 bash[32348]: cluster 2021-03-10T16:52:15.114488+0000 mgr.gibba043.dnkmem (mgr.34373) 9544 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.622904+0000 mgr.gibba043.dnkmem (mgr.34373) 9545 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:52:18.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.624495+0000 mgr.gibba043.dnkmem (mgr.34373) 9546 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:52:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.831059+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:52:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.832262+0000 mgr.gibba043.dnkmem (mgr.34373) 9547 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.833575+0000 mgr.gibba043.dnkmem (mgr.34373) 9548 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.834493+0000 mon.c (mon.1) 2462 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.834576+0000 mgr.gibba043.dnkmem (mgr.34373) 9549 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.834613+0000 mgr.gibba043.dnkmem (mgr.34373) 9550 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:18.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.835582+0000 mon.c (mon.1) 2463 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.835626+0000 mgr.gibba043.dnkmem (mgr.34373) 9551 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.835671+0000 mgr.gibba043.dnkmem (mgr.34373) 9552 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.836620+0000 mon.c (mon.1) 2464 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.836651+0000 mgr.gibba043.dnkmem (mgr.34373) 9553 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.837662+0000 mon.c (mon.1) 2465 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.837976+0000 mgr.gibba043.dnkmem (mgr.34373) 9554 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.838013+0000 mgr.gibba043.dnkmem (mgr.34373) 9555 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.838852+0000 mgr.gibba043.dnkmem (mgr.34373) 9556 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.839160+0000 mgr.gibba043.dnkmem (mgr.34373) 9557 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.839927+0000 mon.c (mon.1) 2466 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.840045+0000 mgr.gibba043.dnkmem (mgr.34373) 9558 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:18.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.840081+0000 mgr.gibba043.dnkmem (mgr.34373) 9559 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:18.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.622904+0000 mgr.gibba043.dnkmem (mgr.34373) 9545 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:52:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.624495+0000 mgr.gibba043.dnkmem (mgr.34373) 9546 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:52:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.831059+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:52:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.832262+0000 mgr.gibba043.dnkmem (mgr.34373) 9547 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:18.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.833575+0000 mgr.gibba043.dnkmem (mgr.34373) 9548 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.834493+0000 mon.c (mon.1) 2462 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.834576+0000 mgr.gibba043.dnkmem (mgr.34373) 9549 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.834613+0000 mgr.gibba043.dnkmem (mgr.34373) 9550 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:18.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.835582+0000 mon.c (mon.1) 2463 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.835626+0000 mgr.gibba043.dnkmem (mgr.34373) 9551 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.835671+0000 mgr.gibba043.dnkmem (mgr.34373) 9552 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.836620+0000 mon.c (mon.1) 2464 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.836651+0000 mgr.gibba043.dnkmem (mgr.34373) 9553 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:18.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.837662+0000 mon.c (mon.1) 2465 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.837976+0000 mgr.gibba043.dnkmem (mgr.34373) 9554 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.838013+0000 mgr.gibba043.dnkmem (mgr.34373) 9555 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.838852+0000 mgr.gibba043.dnkmem (mgr.34373) 9556 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:18.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.839160+0000 mgr.gibba043.dnkmem (mgr.34373) 9557 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:18.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.839927+0000 mon.c (mon.1) 2466 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.840045+0000 mgr.gibba043.dnkmem (mgr.34373) 9558 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:18.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.840081+0000 mgr.gibba043.dnkmem (mgr.34373) 9559 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:18.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cephadm 2021-03-10T16:52:16.840184+0000 mgr.gibba043.dnkmem (mgr.34373) 9560 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:18.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: audit 2021-03-10T16:52:16.841046+0000 mon.c (mon.1) 2467 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[32348]: cluster 2021-03-10T16:52:17.116036+0000 mgr.gibba043.dnkmem (mgr.34373) 9561 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cephadm 2021-03-10T16:52:16.840184+0000 mgr.gibba043.dnkmem (mgr.34373) 9560 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:18.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: audit 2021-03-10T16:52:16.841046+0000 mon.c (mon.1) 2467 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.212 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:17 gibba003 bash[31385]: cluster 2021-03-10T16:52:17.116036+0000 mgr.gibba043.dnkmem (mgr.34373) 9561 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.622904+0000 mgr.gibba043.dnkmem (mgr.34373) 9545 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:52:18.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.624495+0000 mgr.gibba043.dnkmem (mgr.34373) 9546 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:52:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.831059+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:52:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.832262+0000 mgr.gibba043.dnkmem (mgr.34373) 9547 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.833575+0000 mgr.gibba043.dnkmem (mgr.34373) 9548 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.834493+0000 mon.c (mon.1) 2462 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.834576+0000 mgr.gibba043.dnkmem (mgr.34373) 9549 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.834613+0000 mgr.gibba043.dnkmem (mgr.34373) 9550 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:18.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.835582+0000 mon.c (mon.1) 2463 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.835626+0000 mgr.gibba043.dnkmem (mgr.34373) 9551 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.835671+0000 mgr.gibba043.dnkmem (mgr.34373) 9552 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:18.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.836620+0000 mon.c (mon.1) 2464 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.836651+0000 mgr.gibba043.dnkmem (mgr.34373) 9553 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.837662+0000 mon.c (mon.1) 2465 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.837976+0000 mgr.gibba043.dnkmem (mgr.34373) 9554 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.838013+0000 mgr.gibba043.dnkmem (mgr.34373) 9555 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:18.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.838852+0000 mgr.gibba043.dnkmem (mgr.34373) 9556 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.839160+0000 mgr.gibba043.dnkmem (mgr.34373) 9557 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.839927+0000 mon.c (mon.1) 2466 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.840045+0000 mgr.gibba043.dnkmem (mgr.34373) 9558 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:18.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.840081+0000 mgr.gibba043.dnkmem (mgr.34373) 9559 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:18.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cephadm 2021-03-10T16:52:16.840184+0000 mgr.gibba043.dnkmem (mgr.34373) 9560 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:18.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: audit 2021-03-10T16:52:16.841046+0000 mon.c (mon.1) 2467 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:18.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:17 gibba043 bash[24019]: cluster 2021-03-10T16:52:17.116036+0000 mgr.gibba043.dnkmem (mgr.34373) 9561 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:19.157 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:52:19.388 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:52:19.388 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:52:19.388 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:52:19.389 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:52:19.389 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:52:19.389 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:52:19.389 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:52:19.390 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:52:19.390 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:52:19.391 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:52:19.391 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:52:19.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:52:19.391 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:52:19.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:52:19.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:52:19.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:52:19.392 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:52:19.393 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:52:19.393 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:52:19.393 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:52:19.393 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:52:19.635 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:52:19.635 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:52:19.636 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:19.637 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:52:19.637 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:52:19.637 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:19.638 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:52:19.638 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:52:19.638 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:52:19.638 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:52:19.639 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:52:19.639 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:52:19.639 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:52:19.639 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:52:19.639 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:52:20.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:20 gibba003 bash[31385]: cluster 2021-03-10T16:52:19.117655+0000 mgr.gibba043.dnkmem (mgr.34373) 9562 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:20 gibba003 bash[31385]: audit 2021-03-10T16:52:19.150193+0000 mgr.gibba043.dnkmem (mgr.34373) 9563 : audit [DBG] from='client.50457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:20.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:20 gibba003 bash[31385]: audit 2021-03-10T16:52:19.638481+0000 mon.a (mon.0) 1983 : audit [DBG] from='client.? 172.21.2.103:0/3650440954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:20 gibba003 bash[32348]: cluster 2021-03-10T16:52:19.117655+0000 mgr.gibba043.dnkmem (mgr.34373) 9562 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:20 gibba003 bash[32348]: audit 2021-03-10T16:52:19.150193+0000 mgr.gibba043.dnkmem (mgr.34373) 9563 : audit [DBG] from='client.50457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:20 gibba003 bash[32348]: audit 2021-03-10T16:52:19.638481+0000 mon.a (mon.0) 1983 : audit [DBG] from='client.? 172.21.2.103:0/3650440954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:20.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:20 gibba043 bash[24019]: cluster 2021-03-10T16:52:19.117655+0000 mgr.gibba043.dnkmem (mgr.34373) 9562 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:20 gibba043 bash[24019]: audit 2021-03-10T16:52:19.150193+0000 mgr.gibba043.dnkmem (mgr.34373) 9563 : audit [DBG] from='client.50457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:20 gibba043 bash[24019]: audit 2021-03-10T16:52:19.638481+0000 mon.a (mon.0) 1983 : audit [DBG] from='client.? 172.21.2.103:0/3650440954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:21.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:21 gibba003 bash[31385]: audit 2021-03-10T16:52:19.377143+0000 mgr.gibba043.dnkmem (mgr.34373) 9564 : audit [DBG] from='client.60454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:21.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:21 gibba003 bash[32348]: audit 2021-03-10T16:52:19.377143+0000 mgr.gibba043.dnkmem (mgr.34373) 9564 : audit [DBG] from='client.60454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:21 gibba043 bash[24019]: audit 2021-03-10T16:52:19.377143+0000 mgr.gibba043.dnkmem (mgr.34373) 9564 : audit [DBG] from='client.60454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:22.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:22 gibba043 bash[24019]: cluster 2021-03-10T16:52:21.119063+0000 mgr.gibba043.dnkmem (mgr.34373) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:22.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:22 gibba003 bash[31385]: cluster 2021-03-10T16:52:21.119063+0000 mgr.gibba043.dnkmem (mgr.34373) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:22.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:22 gibba003 bash[32348]: cluster 2021-03-10T16:52:21.119063+0000 mgr.gibba043.dnkmem (mgr.34373) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:24.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:24 gibba043 bash[24019]: cluster 2021-03-10T16:52:23.120712+0000 mgr.gibba043.dnkmem (mgr.34373) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:24.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:24 gibba003 bash[31385]: cluster 2021-03-10T16:52:23.120712+0000 mgr.gibba043.dnkmem (mgr.34373) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:24.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:24 gibba003 bash[32348]: cluster 2021-03-10T16:52:23.120712+0000 mgr.gibba043.dnkmem (mgr.34373) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:26.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:26 gibba043 bash[24019]: cluster 2021-03-10T16:52:25.122319+0000 mgr.gibba043.dnkmem (mgr.34373) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:26.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:26 gibba003 bash[31385]: cluster 2021-03-10T16:52:25.122319+0000 mgr.gibba043.dnkmem (mgr.34373) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:26.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:26 gibba003 bash[32348]: cluster 2021-03-10T16:52:25.122319+0000 mgr.gibba043.dnkmem (mgr.34373) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.269 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:28 gibba043 bash[24019]: cluster 2021-03-10T16:52:27.123980+0000 mgr.gibba043.dnkmem (mgr.34373) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:28 gibba003 bash[31385]: cluster 2021-03-10T16:52:27.123980+0000 mgr.gibba043.dnkmem (mgr.34373) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:28 gibba003 bash[32348]: cluster 2021-03-10T16:52:27.123980+0000 mgr.gibba043.dnkmem (mgr.34373) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:30 gibba003 bash[31385]: cluster 2021-03-10T16:52:29.125591+0000 mgr.gibba043.dnkmem (mgr.34373) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:30 gibba003 bash[32348]: cluster 2021-03-10T16:52:29.125591+0000 mgr.gibba043.dnkmem (mgr.34373) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:30 gibba043 bash[24019]: cluster 2021-03-10T16:52:29.125591+0000 mgr.gibba043.dnkmem (mgr.34373) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:32.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:32 gibba043 bash[24019]: cluster 2021-03-10T16:52:31.127141+0000 mgr.gibba043.dnkmem (mgr.34373) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:32.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:32 gibba003 bash[31385]: cluster 2021-03-10T16:52:31.127141+0000 mgr.gibba043.dnkmem (mgr.34373) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:32.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:32 gibba003 bash[32348]: cluster 2021-03-10T16:52:31.127141+0000 mgr.gibba043.dnkmem (mgr.34373) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:33.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:33 gibba043 bash[24019]: cephadm 2021-03-10T16:52:31.852622+0000 mgr.gibba043.dnkmem (mgr.34373) 9571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:33.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:33 gibba003 bash[31385]: cephadm 2021-03-10T16:52:31.852622+0000 mgr.gibba043.dnkmem (mgr.34373) 9571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:33.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:33 gibba003 bash[32348]: cephadm 2021-03-10T16:52:31.852622+0000 mgr.gibba043.dnkmem (mgr.34373) 9571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:34.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:34 gibba043 bash[24019]: cluster 2021-03-10T16:52:33.128705+0000 mgr.gibba043.dnkmem (mgr.34373) 9572 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:34.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:34 gibba003 bash[31385]: cluster 2021-03-10T16:52:33.128705+0000 mgr.gibba043.dnkmem (mgr.34373) 9572 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:34 gibba003 bash[32348]: cluster 2021-03-10T16:52:33.128705+0000 mgr.gibba043.dnkmem (mgr.34373) 9572 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:36 gibba043 bash[24019]: cluster 2021-03-10T16:52:35.130305+0000 mgr.gibba043.dnkmem (mgr.34373) 9573 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:36 gibba003 bash[31385]: cluster 2021-03-10T16:52:35.130305+0000 mgr.gibba043.dnkmem (mgr.34373) 9573 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:36 gibba003 bash[32348]: cluster 2021-03-10T16:52:35.130305+0000 mgr.gibba043.dnkmem (mgr.34373) 9573 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.437 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:38 gibba003 bash[31385]: cluster 2021-03-10T16:52:37.131942+0000 mgr.gibba043.dnkmem (mgr.34373) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:38 gibba003 bash[32348]: cluster 2021-03-10T16:52:37.131942+0000 mgr.gibba043.dnkmem (mgr.34373) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:38 gibba043 bash[24019]: cluster 2021-03-10T16:52:37.131942+0000 mgr.gibba043.dnkmem (mgr.34373) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:40.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:40 gibba043 bash[24019]: cluster 2021-03-10T16:52:39.133538+0000 mgr.gibba043.dnkmem (mgr.34373) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:40.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:40 gibba003 bash[31385]: cluster 2021-03-10T16:52:39.133538+0000 mgr.gibba043.dnkmem (mgr.34373) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:40.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:40 gibba003 bash[32348]: cluster 2021-03-10T16:52:39.133538+0000 mgr.gibba043.dnkmem (mgr.34373) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:42 gibba043 bash[24019]: cluster 2021-03-10T16:52:41.135196+0000 mgr.gibba043.dnkmem (mgr.34373) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:42.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:42 gibba003 bash[31385]: cluster 2021-03-10T16:52:41.135196+0000 mgr.gibba043.dnkmem (mgr.34373) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:42.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:42 gibba003 bash[32348]: cluster 2021-03-10T16:52:41.135196+0000 mgr.gibba043.dnkmem (mgr.34373) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:44 gibba043 bash[24019]: cluster 2021-03-10T16:52:43.136764+0000 mgr.gibba043.dnkmem (mgr.34373) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:44 gibba003 bash[31385]: cluster 2021-03-10T16:52:43.136764+0000 mgr.gibba043.dnkmem (mgr.34373) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:44 gibba003 bash[32348]: cluster 2021-03-10T16:52:43.136764+0000 mgr.gibba043.dnkmem (mgr.34373) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:46.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:46 gibba043 bash[24019]: cluster 2021-03-10T16:52:45.138333+0000 mgr.gibba043.dnkmem (mgr.34373) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:46.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:46 gibba003 bash[31385]: cluster 2021-03-10T16:52:45.138333+0000 mgr.gibba043.dnkmem (mgr.34373) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:46 gibba003 bash[32348]: cluster 2021-03-10T16:52:45.138333+0000 mgr.gibba043.dnkmem (mgr.34373) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:48 gibba003 bash[31385]: cephadm 2021-03-10T16:52:46.868638+0000 mgr.gibba043.dnkmem (mgr.34373) 9579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:48 gibba003 bash[31385]: cluster 2021-03-10T16:52:47.139707+0000 mgr.gibba043.dnkmem (mgr.34373) 9580 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:48 gibba003 bash[32348]: cephadm 2021-03-10T16:52:46.868638+0000 mgr.gibba043.dnkmem (mgr.34373) 9579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:48 gibba003 bash[32348]: cluster 2021-03-10T16:52:47.139707+0000 mgr.gibba043.dnkmem (mgr.34373) 9580 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:48 gibba043 bash[24019]: cephadm 2021-03-10T16:52:46.868638+0000 mgr.gibba043.dnkmem (mgr.34373) 9579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:52:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:48 gibba043 bash[24019]: cluster 2021-03-10T16:52:47.139707+0000 mgr.gibba043.dnkmem (mgr.34373) 9580 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:49.876 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:52:50.100 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:52:50.100 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:52:50.100 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:52:50.101 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:52:50.101 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:52:50.101 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:52:50.101 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:52:50.102 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:52:50.102 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:52:50.102 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:52:50.102 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:52:50.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:52:50.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:52:50.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:52:50.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:52:50.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:52:50.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:52:50.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:52:50.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:52:50.104 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:52:50.104 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:52:50.348 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:52:50.348 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:52:50.348 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:50.349 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:52:50.349 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:52:50.349 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:50.349 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:52:50.350 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:52:50.350 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:52:50.350 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:52:50.350 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:52:50.350 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:52:50.351 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:52:50.351 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:52:50.351 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:52:50.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:50 gibba043 bash[24019]: cluster 2021-03-10T16:52:49.141333+0000 mgr.gibba043.dnkmem (mgr.34373) 9581 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:50.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:50 gibba003 bash[31385]: cluster 2021-03-10T16:52:49.141333+0000 mgr.gibba043.dnkmem (mgr.34373) 9581 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:50.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:50 gibba003 bash[32348]: cluster 2021-03-10T16:52:49.141333+0000 mgr.gibba043.dnkmem (mgr.34373) 9581 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:51 gibba043 bash[24019]: audit 2021-03-10T16:52:49.868841+0000 mgr.gibba043.dnkmem (mgr.34373) 9582 : audit [DBG] from='client.60466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:51 gibba043 bash[24019]: audit 2021-03-10T16:52:50.093698+0000 mgr.gibba043.dnkmem (mgr.34373) 9583 : audit [DBG] from='client.50481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:51.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:51 gibba043 bash[24019]: audit 2021-03-10T16:52:50.351324+0000 mon.c (mon.1) 2468 : audit [DBG] from='client.? 172.21.2.103:0/1226143010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:51.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:51 gibba003 bash[31385]: audit 2021-03-10T16:52:49.868841+0000 mgr.gibba043.dnkmem (mgr.34373) 9582 : audit [DBG] from='client.60466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:51 gibba003 bash[31385]: audit 2021-03-10T16:52:50.093698+0000 mgr.gibba043.dnkmem (mgr.34373) 9583 : audit [DBG] from='client.50481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:51.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:51 gibba003 bash[31385]: audit 2021-03-10T16:52:50.351324+0000 mon.c (mon.1) 2468 : audit [DBG] from='client.? 172.21.2.103:0/1226143010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:51 gibba003 bash[32348]: audit 2021-03-10T16:52:49.868841+0000 mgr.gibba043.dnkmem (mgr.34373) 9582 : audit [DBG] from='client.60466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:51 gibba003 bash[32348]: audit 2021-03-10T16:52:50.093698+0000 mgr.gibba043.dnkmem (mgr.34373) 9583 : audit [DBG] from='client.50481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:51.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:51 gibba003 bash[32348]: audit 2021-03-10T16:52:50.351324+0000 mon.c (mon.1) 2468 : audit [DBG] from='client.? 172.21.2.103:0/1226143010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:52.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:52 gibba043 bash[24019]: cluster 2021-03-10T16:52:51.143028+0000 mgr.gibba043.dnkmem (mgr.34373) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:52.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:52 gibba003 bash[31385]: cluster 2021-03-10T16:52:51.143028+0000 mgr.gibba043.dnkmem (mgr.34373) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:52.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:52 gibba003 bash[32348]: cluster 2021-03-10T16:52:51.143028+0000 mgr.gibba043.dnkmem (mgr.34373) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:54 gibba043 bash[24019]: cluster 2021-03-10T16:52:53.144640+0000 mgr.gibba043.dnkmem (mgr.34373) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:54 gibba003 bash[32348]: cluster 2021-03-10T16:52:53.144640+0000 mgr.gibba043.dnkmem (mgr.34373) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:54 gibba003 bash[31385]: cluster 2021-03-10T16:52:53.144640+0000 mgr.gibba043.dnkmem (mgr.34373) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:56.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:56 gibba043 bash[24019]: cluster 2021-03-10T16:52:55.146208+0000 mgr.gibba043.dnkmem (mgr.34373) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:56.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:56 gibba003 bash[31385]: cluster 2021-03-10T16:52:55.146208+0000 mgr.gibba043.dnkmem (mgr.34373) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:56.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:56 gibba003 bash[32348]: cluster 2021-03-10T16:52:55.146208+0000 mgr.gibba043.dnkmem (mgr.34373) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:52:58 gibba003 bash[31385]: cluster 2021-03-10T16:52:57.147758+0000 mgr.gibba043.dnkmem (mgr.34373) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:52:58 gibba003 bash[32348]: cluster 2021-03-10T16:52:57.147758+0000 mgr.gibba043.dnkmem (mgr.34373) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:52:58 gibba043 bash[24019]: cluster 2021-03-10T16:52:57.147758+0000 mgr.gibba043.dnkmem (mgr.34373) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:00 gibba043 bash[24019]: cluster 2021-03-10T16:52:59.149112+0000 mgr.gibba043.dnkmem (mgr.34373) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:00 gibba003 bash[31385]: cluster 2021-03-10T16:52:59.149112+0000 mgr.gibba043.dnkmem (mgr.34373) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:00 gibba003 bash[32348]: cluster 2021-03-10T16:52:59.149112+0000 mgr.gibba043.dnkmem (mgr.34373) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:02 gibba043 bash[24019]: cluster 2021-03-10T16:53:01.150777+0000 mgr.gibba043.dnkmem (mgr.34373) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:02 gibba003 bash[31385]: cluster 2021-03-10T16:53:01.150777+0000 mgr.gibba043.dnkmem (mgr.34373) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:02 gibba003 bash[32348]: cluster 2021-03-10T16:53:01.150777+0000 mgr.gibba043.dnkmem (mgr.34373) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:03.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:03 gibba043 bash[24019]: cephadm 2021-03-10T16:53:01.884742+0000 mgr.gibba043.dnkmem (mgr.34373) 9590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:03 gibba003 bash[31385]: cephadm 2021-03-10T16:53:01.884742+0000 mgr.gibba043.dnkmem (mgr.34373) 9590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:03 gibba003 bash[32348]: cephadm 2021-03-10T16:53:01.884742+0000 mgr.gibba043.dnkmem (mgr.34373) 9590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:04.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:04 gibba043 bash[24019]: cluster 2021-03-10T16:53:03.152291+0000 mgr.gibba043.dnkmem (mgr.34373) 9591 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:04 gibba003 bash[31385]: cluster 2021-03-10T16:53:03.152291+0000 mgr.gibba043.dnkmem (mgr.34373) 9591 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:04 gibba003 bash[32348]: cluster 2021-03-10T16:53:03.152291+0000 mgr.gibba043.dnkmem (mgr.34373) 9591 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:06 gibba043 bash[24019]: cluster 2021-03-10T16:53:05.153849+0000 mgr.gibba043.dnkmem (mgr.34373) 9592 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:06 gibba003 bash[31385]: cluster 2021-03-10T16:53:05.153849+0000 mgr.gibba043.dnkmem (mgr.34373) 9592 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:06 gibba003 bash[32348]: cluster 2021-03-10T16:53:05.153849+0000 mgr.gibba043.dnkmem (mgr.34373) 9592 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:08 gibba003 bash[31385]: cluster 2021-03-10T16:53:07.155478+0000 mgr.gibba043.dnkmem (mgr.34373) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:08 gibba003 bash[32348]: cluster 2021-03-10T16:53:07.155478+0000 mgr.gibba043.dnkmem (mgr.34373) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.518 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:08 gibba043 bash[24019]: cluster 2021-03-10T16:53:07.155478+0000 mgr.gibba043.dnkmem (mgr.34373) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:10.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:10 gibba043 bash[24019]: cluster 2021-03-10T16:53:09.157013+0000 mgr.gibba043.dnkmem (mgr.34373) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:10.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:10 gibba003 bash[31385]: cluster 2021-03-10T16:53:09.157013+0000 mgr.gibba043.dnkmem (mgr.34373) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:10.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:10 gibba003 bash[32348]: cluster 2021-03-10T16:53:09.157013+0000 mgr.gibba043.dnkmem (mgr.34373) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:12.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:12 gibba043 bash[24019]: cluster 2021-03-10T16:53:11.158715+0000 mgr.gibba043.dnkmem (mgr.34373) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:12.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:12 gibba003 bash[31385]: cluster 2021-03-10T16:53:11.158715+0000 mgr.gibba043.dnkmem (mgr.34373) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:12.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:12 gibba003 bash[32348]: cluster 2021-03-10T16:53:11.158715+0000 mgr.gibba043.dnkmem (mgr.34373) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:14 gibba043 bash[24019]: cluster 2021-03-10T16:53:13.160209+0000 mgr.gibba043.dnkmem (mgr.34373) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:14 gibba043 bash[24019]: audit 2021-03-10T16:53:13.882857+0000 mon.c (mon.1) 2469 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:14 gibba043 bash[24019]: audit 2021-03-10T16:53:13.884164+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:14.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:14 gibba043 bash[24019]: audit 2021-03-10T16:53:14.117554+0000 mon.c (mon.1) 2470 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:14 gibba043 bash[24019]: audit 2021-03-10T16:53:14.118837+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[31385]: cluster 2021-03-10T16:53:13.160209+0000 mgr.gibba043.dnkmem (mgr.34373) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[31385]: audit 2021-03-10T16:53:13.882857+0000 mon.c (mon.1) 2469 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[31385]: audit 2021-03-10T16:53:13.884164+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[31385]: audit 2021-03-10T16:53:14.117554+0000 mon.c (mon.1) 2470 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:14.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[31385]: audit 2021-03-10T16:53:14.118837+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[32348]: cluster 2021-03-10T16:53:13.160209+0000 mgr.gibba043.dnkmem (mgr.34373) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[32348]: audit 2021-03-10T16:53:13.882857+0000 mon.c (mon.1) 2469 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[32348]: audit 2021-03-10T16:53:13.884164+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[32348]: audit 2021-03-10T16:53:14.117554+0000 mon.c (mon.1) 2470 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:14 gibba003 bash[32348]: audit 2021-03-10T16:53:14.118837+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:15.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.404156+0000 mon.c (mon.1) 2471 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:53:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.405036+0000 mon.c (mon.1) 2472 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:53:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.405367+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:53:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.405939+0000 mon.c (mon.1) 2473 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.406590+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:53:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.407058+0000 mon.c (mon.1) 2474 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.407755+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:15 gibba043 bash[24019]: audit 2021-03-10T16:53:14.408716+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.404156+0000 mon.c (mon.1) 2471 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:53:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.405036+0000 mon.c (mon.1) 2472 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:53:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.405367+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:53:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.405939+0000 mon.c (mon.1) 2473 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.406590+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:53:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.407058+0000 mon.c (mon.1) 2474 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.407755+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[31385]: audit 2021-03-10T16:53:14.408716+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.404156+0000 mon.c (mon.1) 2471 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:53:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.405036+0000 mon.c (mon.1) 2472 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:53:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.405367+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:53:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.405939+0000 mon.c (mon.1) 2473 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.406590+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:53:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.407058+0000 mon.c (mon.1) 2474 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.407755+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:15 gibba003 bash[32348]: audit 2021-03-10T16:53:14.408716+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:53:16.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:16 gibba043 bash[24019]: cluster 2021-03-10T16:53:15.162129+0000 mgr.gibba043.dnkmem (mgr.34373) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:16.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:16 gibba003 bash[31385]: cluster 2021-03-10T16:53:15.162129+0000 mgr.gibba043.dnkmem (mgr.34373) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:16.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:16 gibba003 bash[32348]: cluster 2021-03-10T16:53:15.162129+0000 mgr.gibba043.dnkmem (mgr.34373) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:16.901392+0000 mgr.gibba043.dnkmem (mgr.34373) 9598 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:53:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:16.902605+0000 mgr.gibba043.dnkmem (mgr.34373) 9599 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:53:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.148545+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:53:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.149732+0000 mgr.gibba043.dnkmem (mgr.34373) 9600 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.151524+0000 mgr.gibba043.dnkmem (mgr.34373) 9601 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.152142+0000 mon.c (mon.1) 2475 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:18.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.153097+0000 mgr.gibba043.dnkmem (mgr.34373) 9602 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:18.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.153135+0000 mgr.gibba043.dnkmem (mgr.34373) 9603 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:18.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.153576+0000 mon.c (mon.1) 2476 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.457 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.154633+0000 mgr.gibba043.dnkmem (mgr.34373) 9604 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:18.458 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.154669+0000 mgr.gibba043.dnkmem (mgr.34373) 9605 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:18.458 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.155307+0000 mon.c (mon.1) 2477 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.459 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.156501+0000 mgr.gibba043.dnkmem (mgr.34373) 9606 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:18.459 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.156648+0000 mon.c (mon.1) 2478 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.459 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.158228+0000 mgr.gibba043.dnkmem (mgr.34373) 9607 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:18.462 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.158267+0000 mgr.gibba043.dnkmem (mgr.34373) 9608 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:18.463 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.159544+0000 mgr.gibba043.dnkmem (mgr.34373) 9609 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:18.463 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.160000+0000 mgr.gibba043.dnkmem (mgr.34373) 9610 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:18.464 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.160385+0000 mon.c (mon.1) 2479 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.464 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.161608+0000 mgr.gibba043.dnkmem (mgr.34373) 9611 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:18.465 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.161645+0000 mgr.gibba043.dnkmem (mgr.34373) 9612 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:18.481 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:16.901392+0000 mgr.gibba043.dnkmem (mgr.34373) 9598 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:53:18.498 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:16.902605+0000 mgr.gibba043.dnkmem (mgr.34373) 9599 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:53:18.499 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.148545+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:53:18.499 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.149732+0000 mgr.gibba043.dnkmem (mgr.34373) 9600 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:18.500 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.151524+0000 mgr.gibba043.dnkmem (mgr.34373) 9601 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:18.500 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.152142+0000 mon.c (mon.1) 2475 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:18.500 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.153097+0000 mgr.gibba043.dnkmem (mgr.34373) 9602 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:18.501 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.153135+0000 mgr.gibba043.dnkmem (mgr.34373) 9603 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:18.501 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.153576+0000 mon.c (mon.1) 2476 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.501 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.154633+0000 mgr.gibba043.dnkmem (mgr.34373) 9604 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:18.513 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.154669+0000 mgr.gibba043.dnkmem (mgr.34373) 9605 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:18.514 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.155307+0000 mon.c (mon.1) 2477 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.514 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.156501+0000 mgr.gibba043.dnkmem (mgr.34373) 9606 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:18.515 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.156648+0000 mon.c (mon.1) 2478 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.515 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.158228+0000 mgr.gibba043.dnkmem (mgr.34373) 9607 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:18.515 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.158267+0000 mgr.gibba043.dnkmem (mgr.34373) 9608 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:18.516 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.159544+0000 mgr.gibba043.dnkmem (mgr.34373) 9609 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:18.516 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.160000+0000 mgr.gibba043.dnkmem (mgr.34373) 9610 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:18.516 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.160385+0000 mon.c (mon.1) 2479 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.517 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.161608+0000 mgr.gibba043.dnkmem (mgr.34373) 9611 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:18.517 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.161645+0000 mgr.gibba043.dnkmem (mgr.34373) 9612 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:18.518 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cephadm 2021-03-10T16:53:17.161756+0000 mgr.gibba043.dnkmem (mgr.34373) 9613 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:18.519 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: audit 2021-03-10T16:53:17.161970+0000 mon.c (mon.1) 2480 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.519 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[31385]: cluster 2021-03-10T16:53:17.162613+0000 mgr.gibba043.dnkmem (mgr.34373) 9614 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:18.520 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cephadm 2021-03-10T16:53:17.161756+0000 mgr.gibba043.dnkmem (mgr.34373) 9613 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:18.520 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: audit 2021-03-10T16:53:17.161970+0000 mon.c (mon.1) 2480 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.520 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:18 gibba003 bash[32348]: cluster 2021-03-10T16:53:17.162613+0000 mgr.gibba043.dnkmem (mgr.34373) 9614 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:16.901392+0000 mgr.gibba043.dnkmem (mgr.34373) 9598 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:53:18.533 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:16.902605+0000 mgr.gibba043.dnkmem (mgr.34373) 9599 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:53:18.534 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.148545+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:53:18.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.149732+0000 mgr.gibba043.dnkmem (mgr.34373) 9600 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:18.535 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.151524+0000 mgr.gibba043.dnkmem (mgr.34373) 9601 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:18.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.152142+0000 mon.c (mon.1) 2475 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:18.536 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.153097+0000 mgr.gibba043.dnkmem (mgr.34373) 9602 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:18.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.153135+0000 mgr.gibba043.dnkmem (mgr.34373) 9603 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:18.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.153576+0000 mon.c (mon.1) 2476 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.537 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.154633+0000 mgr.gibba043.dnkmem (mgr.34373) 9604 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:18.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.154669+0000 mgr.gibba043.dnkmem (mgr.34373) 9605 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:18.538 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.155307+0000 mon.c (mon.1) 2477 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.156501+0000 mgr.gibba043.dnkmem (mgr.34373) 9606 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:18.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.156648+0000 mon.c (mon.1) 2478 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.158228+0000 mgr.gibba043.dnkmem (mgr.34373) 9607 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:18.540 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.158267+0000 mgr.gibba043.dnkmem (mgr.34373) 9608 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:18.541 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.159544+0000 mgr.gibba043.dnkmem (mgr.34373) 9609 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:18.566 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.160000+0000 mgr.gibba043.dnkmem (mgr.34373) 9610 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:18.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.160385+0000 mon.c (mon.1) 2479 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.569 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.161608+0000 mgr.gibba043.dnkmem (mgr.34373) 9611 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:18.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.161645+0000 mgr.gibba043.dnkmem (mgr.34373) 9612 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:18.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cephadm 2021-03-10T16:53:17.161756+0000 mgr.gibba043.dnkmem (mgr.34373) 9613 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:18.571 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: audit 2021-03-10T16:53:17.161970+0000 mon.c (mon.1) 2480 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:18.572 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:18 gibba043 bash[24019]: cluster 2021-03-10T16:53:17.162613+0000 mgr.gibba043.dnkmem (mgr.34373) 9614 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:20 gibba043 bash[24019]: cluster 2021-03-10T16:53:19.164009+0000 mgr.gibba043.dnkmem (mgr.34373) 9615 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:20.593 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:53:20.687 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:20 gibba003 bash[31385]: cluster 2021-03-10T16:53:19.164009+0000 mgr.gibba043.dnkmem (mgr.34373) 9615 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:20.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:20 gibba003 bash[32348]: cluster 2021-03-10T16:53:19.164009+0000 mgr.gibba043.dnkmem (mgr.34373) 9615 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:20.822 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:53:20.822 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:53:20.822 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:53:20.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:53:20.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:53:20.823 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:53:20.823 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:53:20.823 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:53:20.824 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:53:20.824 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:53:20.824 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:53:20.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:53:20.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:53:20.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:53:20.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:53:20.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:53:20.825 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:53:20.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:53:20.826 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:53:20.826 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:53:20.826 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:53:21.069 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:53:21.070 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:53:21.070 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:21.070 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:53:21.070 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:53:21.071 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:21.071 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:53:21.071 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:53:21.071 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:53:21.072 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:53:21.072 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:53:21.072 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:53:21.072 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:53:21.073 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:53:21.073 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:53:21.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:21 gibba043 bash[24019]: audit 2021-03-10T16:53:21.072421+0000 mon.a (mon.0) 1991 : audit [DBG] from='client.? 172.21.2.103:0/196637571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:21.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:21 gibba003 bash[31385]: audit 2021-03-10T16:53:21.072421+0000 mon.a (mon.0) 1991 : audit [DBG] from='client.? 172.21.2.103:0/196637571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:21.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:21 gibba003 bash[32348]: audit 2021-03-10T16:53:21.072421+0000 mon.a (mon.0) 1991 : audit [DBG] from='client.? 172.21.2.103:0/196637571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:22.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:22 gibba043 bash[24019]: audit 2021-03-10T16:53:20.585771+0000 mgr.gibba043.dnkmem (mgr.34373) 9616 : audit [DBG] from='client.60484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:22.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:22 gibba043 bash[24019]: audit 2021-03-10T16:53:20.811323+0000 mgr.gibba043.dnkmem (mgr.34373) 9617 : audit [DBG] from='client.60490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:22.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:22 gibba043 bash[24019]: cluster 2021-03-10T16:53:21.165533+0000 mgr.gibba043.dnkmem (mgr.34373) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:22.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:22 gibba003 bash[31385]: audit 2021-03-10T16:53:20.585771+0000 mgr.gibba043.dnkmem (mgr.34373) 9616 : audit [DBG] from='client.60484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:22.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:22 gibba003 bash[31385]: audit 2021-03-10T16:53:20.811323+0000 mgr.gibba043.dnkmem (mgr.34373) 9617 : audit [DBG] from='client.60490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:22.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:22 gibba003 bash[31385]: cluster 2021-03-10T16:53:21.165533+0000 mgr.gibba043.dnkmem (mgr.34373) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:22.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:22 gibba003 bash[32348]: audit 2021-03-10T16:53:20.585771+0000 mgr.gibba043.dnkmem (mgr.34373) 9616 : audit [DBG] from='client.60484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:22.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:22 gibba003 bash[32348]: audit 2021-03-10T16:53:20.811323+0000 mgr.gibba043.dnkmem (mgr.34373) 9617 : audit [DBG] from='client.60490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:22.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:22 gibba003 bash[32348]: cluster 2021-03-10T16:53:21.165533+0000 mgr.gibba043.dnkmem (mgr.34373) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:24.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:24 gibba043 bash[24019]: cluster 2021-03-10T16:53:23.167030+0000 mgr.gibba043.dnkmem (mgr.34373) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:24.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:24 gibba003 bash[31385]: cluster 2021-03-10T16:53:23.167030+0000 mgr.gibba043.dnkmem (mgr.34373) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:24.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:24 gibba003 bash[32348]: cluster 2021-03-10T16:53:23.167030+0000 mgr.gibba043.dnkmem (mgr.34373) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:26.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:26 gibba043 bash[24019]: cluster 2021-03-10T16:53:25.168934+0000 mgr.gibba043.dnkmem (mgr.34373) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:26.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:26 gibba003 bash[31385]: cluster 2021-03-10T16:53:25.168934+0000 mgr.gibba043.dnkmem (mgr.34373) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:26.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:26 gibba003 bash[32348]: cluster 2021-03-10T16:53:25.168934+0000 mgr.gibba043.dnkmem (mgr.34373) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:28 gibba003 bash[31385]: cluster 2021-03-10T16:53:27.170463+0000 mgr.gibba043.dnkmem (mgr.34373) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.438 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:28 gibba003 bash[32348]: cluster 2021-03-10T16:53:27.170463+0000 mgr.gibba043.dnkmem (mgr.34373) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:28 gibba043 bash[24019]: cluster 2021-03-10T16:53:27.170463+0000 mgr.gibba043.dnkmem (mgr.34373) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:30 gibba043 bash[24019]: cluster 2021-03-10T16:53:29.171930+0000 mgr.gibba043.dnkmem (mgr.34373) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:30 gibba003 bash[31385]: cluster 2021-03-10T16:53:29.171930+0000 mgr.gibba043.dnkmem (mgr.34373) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:30 gibba003 bash[32348]: cluster 2021-03-10T16:53:29.171930+0000 mgr.gibba043.dnkmem (mgr.34373) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:32.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:32 gibba043 bash[24019]: cluster 2021-03-10T16:53:31.173423+0000 mgr.gibba043.dnkmem (mgr.34373) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:32.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:32 gibba003 bash[31385]: cluster 2021-03-10T16:53:31.173423+0000 mgr.gibba043.dnkmem (mgr.34373) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:32.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:32 gibba003 bash[32348]: cluster 2021-03-10T16:53:31.173423+0000 mgr.gibba043.dnkmem (mgr.34373) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:33.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:33 gibba043 bash[24019]: cephadm 2021-03-10T16:53:32.177666+0000 mgr.gibba043.dnkmem (mgr.34373) 9624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:33.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:33 gibba003 bash[31385]: cephadm 2021-03-10T16:53:32.177666+0000 mgr.gibba043.dnkmem (mgr.34373) 9624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:33.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:33 gibba003 bash[32348]: cephadm 2021-03-10T16:53:32.177666+0000 mgr.gibba043.dnkmem (mgr.34373) 9624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:34.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:34 gibba043 bash[24019]: cluster 2021-03-10T16:53:33.174908+0000 mgr.gibba043.dnkmem (mgr.34373) 9625 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:34.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:34 gibba003 bash[31385]: cluster 2021-03-10T16:53:33.174908+0000 mgr.gibba043.dnkmem (mgr.34373) 9625 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:34.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:34 gibba003 bash[32348]: cluster 2021-03-10T16:53:33.174908+0000 mgr.gibba043.dnkmem (mgr.34373) 9625 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:36.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:36 gibba003 bash[31385]: cluster 2021-03-10T16:53:35.176698+0000 mgr.gibba043.dnkmem (mgr.34373) 9626 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:36.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:36 gibba003 bash[32348]: cluster 2021-03-10T16:53:35.176698+0000 mgr.gibba043.dnkmem (mgr.34373) 9626 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:36.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:36 gibba043 bash[24019]: cluster 2021-03-10T16:53:35.176698+0000 mgr.gibba043.dnkmem (mgr.34373) 9626 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:38 gibba003 bash[31385]: cluster 2021-03-10T16:53:37.178463+0000 mgr.gibba043.dnkmem (mgr.34373) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:38 gibba003 bash[32348]: cluster 2021-03-10T16:53:37.178463+0000 mgr.gibba043.dnkmem (mgr.34373) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:38 gibba043 bash[24019]: cluster 2021-03-10T16:53:37.178463+0000 mgr.gibba043.dnkmem (mgr.34373) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:40.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:40 gibba043 bash[24019]: cluster 2021-03-10T16:53:39.180077+0000 mgr.gibba043.dnkmem (mgr.34373) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:40.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:40 gibba003 bash[31385]: cluster 2021-03-10T16:53:39.180077+0000 mgr.gibba043.dnkmem (mgr.34373) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:40 gibba003 bash[32348]: cluster 2021-03-10T16:53:39.180077+0000 mgr.gibba043.dnkmem (mgr.34373) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:42.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:42 gibba043 bash[24019]: cluster 2021-03-10T16:53:41.181584+0000 mgr.gibba043.dnkmem (mgr.34373) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:42.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:42 gibba003 bash[31385]: cluster 2021-03-10T16:53:41.181584+0000 mgr.gibba043.dnkmem (mgr.34373) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:42 gibba003 bash[32348]: cluster 2021-03-10T16:53:41.181584+0000 mgr.gibba043.dnkmem (mgr.34373) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:44 gibba043 bash[24019]: cluster 2021-03-10T16:53:43.182769+0000 mgr.gibba043.dnkmem (mgr.34373) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:44 gibba003 bash[31385]: cluster 2021-03-10T16:53:43.182769+0000 mgr.gibba043.dnkmem (mgr.34373) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:44 gibba003 bash[32348]: cluster 2021-03-10T16:53:43.182769+0000 mgr.gibba043.dnkmem (mgr.34373) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:46.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:46 gibba003 bash[31385]: cluster 2021-03-10T16:53:45.184597+0000 mgr.gibba043.dnkmem (mgr.34373) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:46.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:46 gibba003 bash[32348]: cluster 2021-03-10T16:53:45.184597+0000 mgr.gibba043.dnkmem (mgr.34373) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:46.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:46 gibba043 bash[24019]: cluster 2021-03-10T16:53:45.184597+0000 mgr.gibba043.dnkmem (mgr.34373) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:48 gibba003 bash[31385]: cluster 2021-03-10T16:53:47.186095+0000 mgr.gibba043.dnkmem (mgr.34373) 9632 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:48 gibba003 bash[31385]: cephadm 2021-03-10T16:53:47.193406+0000 mgr.gibba043.dnkmem (mgr.34373) 9633 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:48 gibba003 bash[32348]: cluster 2021-03-10T16:53:47.186095+0000 mgr.gibba043.dnkmem (mgr.34373) 9632 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:48 gibba003 bash[32348]: cephadm 2021-03-10T16:53:47.193406+0000 mgr.gibba043.dnkmem (mgr.34373) 9633 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:48 gibba043 bash[24019]: cluster 2021-03-10T16:53:47.186095+0000 mgr.gibba043.dnkmem (mgr.34373) 9632 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:48 gibba043 bash[24019]: cephadm 2021-03-10T16:53:47.193406+0000 mgr.gibba043.dnkmem (mgr.34373) 9633 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:53:50.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:50 gibba043 bash[24019]: cluster 2021-03-10T16:53:49.187756+0000 mgr.gibba043.dnkmem (mgr.34373) 9634 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:50.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:50 gibba003 bash[31385]: cluster 2021-03-10T16:53:49.187756+0000 mgr.gibba043.dnkmem (mgr.34373) 9634 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:50.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:50 gibba003 bash[32348]: cluster 2021-03-10T16:53:49.187756+0000 mgr.gibba043.dnkmem (mgr.34373) 9634 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:51.312 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:53:51.545 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:53:51.545 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:53:51.545 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:53:51.546 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:53:51.546 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:53:51.547 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:53:51.547 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:53:51.547 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:53:51.548 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:53:51.548 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:53:51.549 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:53:51.549 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:53:51.550 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:53:51.550 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:53:51.550 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:53:51.551 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:53:51.551 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:53:51.552 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:53:51.552 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:53:51.552 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:53:51.553 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:53:51.796 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:53:51.796 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:53:51.796 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:51.796 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:53:51.797 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:53:51.797 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:51.797 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:53:51.797 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:53:51.798 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:53:51.798 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:53:51.798 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:53:51.798 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:53:51.798 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:53:51.799 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:53:51.799 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:53:52.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:52 gibba043 bash[24019]: cluster 2021-03-10T16:53:51.189513+0000 mgr.gibba043.dnkmem (mgr.34373) 9635 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:52.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:52 gibba043 bash[24019]: audit 2021-03-10T16:53:51.304320+0000 mgr.gibba043.dnkmem (mgr.34373) 9636 : audit [DBG] from='client.50511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:52.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:52 gibba043 bash[24019]: audit 2021-03-10T16:53:51.798757+0000 mon.c (mon.1) 2481 : audit [DBG] from='client.? 172.21.2.103:0/231449895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:52.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:52 gibba003 bash[31385]: cluster 2021-03-10T16:53:51.189513+0000 mgr.gibba043.dnkmem (mgr.34373) 9635 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:52.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:52 gibba003 bash[31385]: audit 2021-03-10T16:53:51.304320+0000 mgr.gibba043.dnkmem (mgr.34373) 9636 : audit [DBG] from='client.50511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:52.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:52 gibba003 bash[31385]: audit 2021-03-10T16:53:51.798757+0000 mon.c (mon.1) 2481 : audit [DBG] from='client.? 172.21.2.103:0/231449895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:52.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:52 gibba003 bash[32348]: cluster 2021-03-10T16:53:51.189513+0000 mgr.gibba043.dnkmem (mgr.34373) 9635 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:52.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:52 gibba003 bash[32348]: audit 2021-03-10T16:53:51.304320+0000 mgr.gibba043.dnkmem (mgr.34373) 9636 : audit [DBG] from='client.50511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:52.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:52 gibba003 bash[32348]: audit 2021-03-10T16:53:51.798757+0000 mon.c (mon.1) 2481 : audit [DBG] from='client.? 172.21.2.103:0/231449895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:53 gibba003 bash[31385]: audit 2021-03-10T16:53:51.534372+0000 mgr.gibba043.dnkmem (mgr.34373) 9637 : audit [DBG] from='client.60508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:53 gibba003 bash[32348]: audit 2021-03-10T16:53:51.534372+0000 mgr.gibba043.dnkmem (mgr.34373) 9637 : audit [DBG] from='client.60508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:53 gibba043 bash[24019]: audit 2021-03-10T16:53:51.534372+0000 mgr.gibba043.dnkmem (mgr.34373) 9637 : audit [DBG] from='client.60508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:54 gibba003 bash[31385]: cluster 2021-03-10T16:53:53.190636+0000 mgr.gibba043.dnkmem (mgr.34373) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:54.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:54 gibba003 bash[32348]: cluster 2021-03-10T16:53:53.190636+0000 mgr.gibba043.dnkmem (mgr.34373) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:54 gibba043 bash[24019]: cluster 2021-03-10T16:53:53.190636+0000 mgr.gibba043.dnkmem (mgr.34373) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:56.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:56 gibba003 bash[31385]: cluster 2021-03-10T16:53:55.192153+0000 mgr.gibba043.dnkmem (mgr.34373) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:56.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:56 gibba003 bash[32348]: cluster 2021-03-10T16:53:55.192153+0000 mgr.gibba043.dnkmem (mgr.34373) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:56.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:56 gibba043 bash[24019]: cluster 2021-03-10T16:53:55.192153+0000 mgr.gibba043.dnkmem (mgr.34373) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:53:58 gibba003 bash[31385]: cluster 2021-03-10T16:53:57.193834+0000 mgr.gibba043.dnkmem (mgr.34373) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:53:58 gibba003 bash[32348]: cluster 2021-03-10T16:53:57.193834+0000 mgr.gibba043.dnkmem (mgr.34373) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:53:58 gibba043 bash[24019]: cluster 2021-03-10T16:53:57.193834+0000 mgr.gibba043.dnkmem (mgr.34373) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:00 gibba043 bash[24019]: cluster 2021-03-10T16:53:59.195513+0000 mgr.gibba043.dnkmem (mgr.34373) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:00 gibba003 bash[31385]: cluster 2021-03-10T16:53:59.195513+0000 mgr.gibba043.dnkmem (mgr.34373) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:00 gibba003 bash[32348]: cluster 2021-03-10T16:53:59.195513+0000 mgr.gibba043.dnkmem (mgr.34373) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:02.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:02 gibba043 bash[24019]: cluster 2021-03-10T16:54:01.197185+0000 mgr.gibba043.dnkmem (mgr.34373) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:02.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:02 gibba003 bash[31385]: cluster 2021-03-10T16:54:01.197185+0000 mgr.gibba043.dnkmem (mgr.34373) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:02.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:02 gibba003 bash[32348]: cluster 2021-03-10T16:54:01.197185+0000 mgr.gibba043.dnkmem (mgr.34373) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:03.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:03 gibba003 bash[31385]: cephadm 2021-03-10T16:54:02.209389+0000 mgr.gibba043.dnkmem (mgr.34373) 9643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:03.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:03 gibba003 bash[32348]: cephadm 2021-03-10T16:54:02.209389+0000 mgr.gibba043.dnkmem (mgr.34373) 9643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:03.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:03 gibba043 bash[24019]: cephadm 2021-03-10T16:54:02.209389+0000 mgr.gibba043.dnkmem (mgr.34373) 9643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:04.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:04 gibba003 bash[31385]: cluster 2021-03-10T16:54:03.198361+0000 mgr.gibba043.dnkmem (mgr.34373) 9644 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:04 gibba003 bash[32348]: cluster 2021-03-10T16:54:03.198361+0000 mgr.gibba043.dnkmem (mgr.34373) 9644 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:04.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:04 gibba043 bash[24019]: cluster 2021-03-10T16:54:03.198361+0000 mgr.gibba043.dnkmem (mgr.34373) 9644 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:06.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:06 gibba003 bash[31385]: cluster 2021-03-10T16:54:05.200282+0000 mgr.gibba043.dnkmem (mgr.34373) 9645 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:06.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:06 gibba003 bash[32348]: cluster 2021-03-10T16:54:05.200282+0000 mgr.gibba043.dnkmem (mgr.34373) 9645 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:06 gibba043 bash[24019]: cluster 2021-03-10T16:54:05.200282+0000 mgr.gibba043.dnkmem (mgr.34373) 9645 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:08 gibba003 bash[31385]: cluster 2021-03-10T16:54:07.201981+0000 mgr.gibba043.dnkmem (mgr.34373) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:08 gibba003 bash[32348]: cluster 2021-03-10T16:54:07.201981+0000 mgr.gibba043.dnkmem (mgr.34373) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:08 gibba043 bash[24019]: cluster 2021-03-10T16:54:07.201981+0000 mgr.gibba043.dnkmem (mgr.34373) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:10.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:10 gibba043 bash[24019]: cluster 2021-03-10T16:54:09.203569+0000 mgr.gibba043.dnkmem (mgr.34373) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:10.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:10 gibba003 bash[31385]: cluster 2021-03-10T16:54:09.203569+0000 mgr.gibba043.dnkmem (mgr.34373) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:10 gibba003 bash[32348]: cluster 2021-03-10T16:54:09.203569+0000 mgr.gibba043.dnkmem (mgr.34373) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:12.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:12 gibba003 bash[31385]: cluster 2021-03-10T16:54:11.205071+0000 mgr.gibba043.dnkmem (mgr.34373) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:12.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:12 gibba003 bash[32348]: cluster 2021-03-10T16:54:11.205071+0000 mgr.gibba043.dnkmem (mgr.34373) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:12.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:12 gibba043 bash[24019]: cluster 2021-03-10T16:54:11.205071+0000 mgr.gibba043.dnkmem (mgr.34373) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[31385]: cluster 2021-03-10T16:54:13.206268+0000 mgr.gibba043.dnkmem (mgr.34373) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[31385]: audit 2021-03-10T16:54:13.890005+0000 mon.c (mon.1) 2482 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[31385]: audit 2021-03-10T16:54:13.891165+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[31385]: audit 2021-03-10T16:54:14.124841+0000 mon.c (mon.1) 2483 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[31385]: audit 2021-03-10T16:54:14.125947+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[32348]: cluster 2021-03-10T16:54:13.206268+0000 mgr.gibba043.dnkmem (mgr.34373) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[32348]: audit 2021-03-10T16:54:13.890005+0000 mon.c (mon.1) 2482 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[32348]: audit 2021-03-10T16:54:13.891165+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[32348]: audit 2021-03-10T16:54:14.124841+0000 mon.c (mon.1) 2483 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:14 gibba003 bash[32348]: audit 2021-03-10T16:54:14.125947+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:14 gibba043 bash[24019]: cluster 2021-03-10T16:54:13.206268+0000 mgr.gibba043.dnkmem (mgr.34373) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:14 gibba043 bash[24019]: audit 2021-03-10T16:54:13.890005+0000 mon.c (mon.1) 2482 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:14 gibba043 bash[24019]: audit 2021-03-10T16:54:13.891165+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:14 gibba043 bash[24019]: audit 2021-03-10T16:54:14.124841+0000 mon.c (mon.1) 2483 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:14 gibba043 bash[24019]: audit 2021-03-10T16:54:14.125947+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.415619+0000 mon.c (mon.1) 2484 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:54:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.416439+0000 mon.c (mon.1) 2485 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:54:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.416948+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:54:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.417095+0000 mon.c (mon.1) 2486 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.417784+0000 mon.c (mon.1) 2487 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.419509+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:54:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.420716+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[31385]: audit 2021-03-10T16:54:14.421912+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.415619+0000 mon.c (mon.1) 2484 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:54:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.416439+0000 mon.c (mon.1) 2485 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:54:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.416948+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:54:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.417095+0000 mon.c (mon.1) 2486 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.417784+0000 mon.c (mon.1) 2487 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.419509+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:54:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.420716+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:15 gibba003 bash[32348]: audit 2021-03-10T16:54:14.421912+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.415619+0000 mon.c (mon.1) 2484 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:54:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.416439+0000 mon.c (mon.1) 2485 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:54:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.416948+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:54:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.417095+0000 mon.c (mon.1) 2486 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.417784+0000 mon.c (mon.1) 2487 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.419509+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:54:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.420716+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:54:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:15 gibba043 bash[24019]: audit 2021-03-10T16:54:14.421912+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:54:16.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:16 gibba003 bash[31385]: cluster 2021-03-10T16:54:15.207902+0000 mgr.gibba043.dnkmem (mgr.34373) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:16.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:16 gibba003 bash[32348]: cluster 2021-03-10T16:54:15.207902+0000 mgr.gibba043.dnkmem (mgr.34373) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:16 gibba043 bash[24019]: cluster 2021-03-10T16:54:15.207902+0000 mgr.gibba043.dnkmem (mgr.34373) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: cluster 2021-03-10T16:54:17.209491+0000 mgr.gibba043.dnkmem (mgr.34373) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.226046+0000 mgr.gibba043.dnkmem (mgr.34373) 9652 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:54:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.227359+0000 mgr.gibba043.dnkmem (mgr.34373) 9653 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:54:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.424992+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:54:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.428591+0000 mon.c (mon.1) 2488 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.430306+0000 mon.c (mon.1) 2489 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.431762+0000 mon.c (mon.1) 2490 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.432927+0000 mon.c (mon.1) 2491 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.436050+0000 mon.c (mon.1) 2492 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[31385]: audit 2021-03-10T16:54:17.437771+0000 mon.c (mon.1) 2493 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: cluster 2021-03-10T16:54:17.209491+0000 mgr.gibba043.dnkmem (mgr.34373) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.226046+0000 mgr.gibba043.dnkmem (mgr.34373) 9652 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:54:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.227359+0000 mgr.gibba043.dnkmem (mgr.34373) 9653 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:54:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.424992+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:54:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.428591+0000 mon.c (mon.1) 2488 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.430306+0000 mon.c (mon.1) 2489 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.431762+0000 mon.c (mon.1) 2490 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.432927+0000 mon.c (mon.1) 2491 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.436050+0000 mon.c (mon.1) 2492 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:18 gibba003 bash[32348]: audit 2021-03-10T16:54:17.437771+0000 mon.c (mon.1) 2493 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: cluster 2021-03-10T16:54:17.209491+0000 mgr.gibba043.dnkmem (mgr.34373) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.226046+0000 mgr.gibba043.dnkmem (mgr.34373) 9652 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:54:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.227359+0000 mgr.gibba043.dnkmem (mgr.34373) 9653 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:54:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.424992+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:54:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.428591+0000 mon.c (mon.1) 2488 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.430306+0000 mon.c (mon.1) 2489 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.431762+0000 mon.c (mon.1) 2490 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.432927+0000 mon.c (mon.1) 2491 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.436050+0000 mon.c (mon.1) 2492 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:18 gibba043 bash[24019]: audit 2021-03-10T16:54:17.437771+0000 mon.c (mon.1) 2493 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.426278+0000 mgr.gibba043.dnkmem (mgr.34373) 9654 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.428205+0000 mgr.gibba043.dnkmem (mgr.34373) 9655 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.429587+0000 mgr.gibba043.dnkmem (mgr.34373) 9656 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.429621+0000 mgr.gibba043.dnkmem (mgr.34373) 9657 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.431004+0000 mgr.gibba043.dnkmem (mgr.34373) 9658 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.431038+0000 mgr.gibba043.dnkmem (mgr.34373) 9659 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.432112+0000 mgr.gibba043.dnkmem (mgr.34373) 9660 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.433823+0000 mgr.gibba043.dnkmem (mgr.34373) 9661 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.433856+0000 mgr.gibba043.dnkmem (mgr.34373) 9662 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.435452+0000 mgr.gibba043.dnkmem (mgr.34373) 9663 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.435806+0000 mgr.gibba043.dnkmem (mgr.34373) 9664 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.437453+0000 mgr.gibba043.dnkmem (mgr.34373) 9665 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.437492+0000 mgr.gibba043.dnkmem (mgr.34373) 9666 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[31385]: cephadm 2021-03-10T16:54:17.437596+0000 mgr.gibba043.dnkmem (mgr.34373) 9667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.426278+0000 mgr.gibba043.dnkmem (mgr.34373) 9654 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.428205+0000 mgr.gibba043.dnkmem (mgr.34373) 9655 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:19.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.429587+0000 mgr.gibba043.dnkmem (mgr.34373) 9656 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:19.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.429621+0000 mgr.gibba043.dnkmem (mgr.34373) 9657 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.431004+0000 mgr.gibba043.dnkmem (mgr.34373) 9658 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.431038+0000 mgr.gibba043.dnkmem (mgr.34373) 9659 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.432112+0000 mgr.gibba043.dnkmem (mgr.34373) 9660 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.433823+0000 mgr.gibba043.dnkmem (mgr.34373) 9661 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.433856+0000 mgr.gibba043.dnkmem (mgr.34373) 9662 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.435452+0000 mgr.gibba043.dnkmem (mgr.34373) 9663 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.435806+0000 mgr.gibba043.dnkmem (mgr.34373) 9664 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.437453+0000 mgr.gibba043.dnkmem (mgr.34373) 9665 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.437492+0000 mgr.gibba043.dnkmem (mgr.34373) 9666 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:19.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:19 gibba003 bash[32348]: cephadm 2021-03-10T16:54:17.437596+0000 mgr.gibba043.dnkmem (mgr.34373) 9667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:19.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.426278+0000 mgr.gibba043.dnkmem (mgr.34373) 9654 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.428205+0000 mgr.gibba043.dnkmem (mgr.34373) 9655 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.429587+0000 mgr.gibba043.dnkmem (mgr.34373) 9656 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.429621+0000 mgr.gibba043.dnkmem (mgr.34373) 9657 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.431004+0000 mgr.gibba043.dnkmem (mgr.34373) 9658 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.431038+0000 mgr.gibba043.dnkmem (mgr.34373) 9659 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.432112+0000 mgr.gibba043.dnkmem (mgr.34373) 9660 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.433823+0000 mgr.gibba043.dnkmem (mgr.34373) 9661 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.433856+0000 mgr.gibba043.dnkmem (mgr.34373) 9662 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.435452+0000 mgr.gibba043.dnkmem (mgr.34373) 9663 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.435806+0000 mgr.gibba043.dnkmem (mgr.34373) 9664 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.437453+0000 mgr.gibba043.dnkmem (mgr.34373) 9665 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.437492+0000 mgr.gibba043.dnkmem (mgr.34373) 9666 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:19 gibba043 bash[24019]: cephadm 2021-03-10T16:54:17.437596+0000 mgr.gibba043.dnkmem (mgr.34373) 9667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:20.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:20 gibba003 bash[31385]: cluster 2021-03-10T16:54:19.211165+0000 mgr.gibba043.dnkmem (mgr.34373) 9668 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:20 gibba003 bash[32348]: cluster 2021-03-10T16:54:19.211165+0000 mgr.gibba043.dnkmem (mgr.34373) 9668 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:20 gibba043 bash[24019]: cluster 2021-03-10T16:54:19.211165+0000 mgr.gibba043.dnkmem (mgr.34373) 9668 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:22.053 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:54:22.284 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:54:22.284 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:54:22.284 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:54:22.285 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:54:22.285 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:54:22.285 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:54:22.285 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:54:22.286 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:54:22.286 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:54:22.286 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:54:22.286 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:54:22.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:54:22.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:54:22.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:54:22.287 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:54:22.288 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:54:22.288 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:54:22.288 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:54:22.289 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:54:22.289 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:54:22.290 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:54:22.533 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:54:22.533 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:54:22.533 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:22.534 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:54:22.534 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:54:22.535 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:22.535 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:54:22.535 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:54:22.535 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:54:22.536 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:54:22.536 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:54:22.536 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:54:22.536 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:54:22.536 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:54:22.537 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:54:22.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:22 gibba003 bash[31385]: cluster 2021-03-10T16:54:21.213000+0000 mgr.gibba043.dnkmem (mgr.34373) 9669 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:22.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:22 gibba003 bash[32348]: cluster 2021-03-10T16:54:21.213000+0000 mgr.gibba043.dnkmem (mgr.34373) 9669 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:22.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:22 gibba043 bash[24019]: cluster 2021-03-10T16:54:21.213000+0000 mgr.gibba043.dnkmem (mgr.34373) 9669 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:23 gibba003 bash[31385]: audit 2021-03-10T16:54:22.036601+0000 mgr.gibba043.dnkmem (mgr.34373) 9670 : audit [DBG] from='client.60520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:23 gibba003 bash[31385]: audit 2021-03-10T16:54:22.273401+0000 mgr.gibba043.dnkmem (mgr.34373) 9671 : audit [DBG] from='client.50535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:23 gibba003 bash[31385]: audit 2021-03-10T16:54:22.535384+0000 mon.a (mon.0) 1999 : audit [DBG] from='client.? 172.21.2.103:0/1102135680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:23.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:23 gibba003 bash[32348]: audit 2021-03-10T16:54:22.036601+0000 mgr.gibba043.dnkmem (mgr.34373) 9670 : audit [DBG] from='client.60520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:23 gibba003 bash[32348]: audit 2021-03-10T16:54:22.273401+0000 mgr.gibba043.dnkmem (mgr.34373) 9671 : audit [DBG] from='client.50535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:23 gibba003 bash[32348]: audit 2021-03-10T16:54:22.535384+0000 mon.a (mon.0) 1999 : audit [DBG] from='client.? 172.21.2.103:0/1102135680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:23 gibba043 bash[24019]: audit 2021-03-10T16:54:22.036601+0000 mgr.gibba043.dnkmem (mgr.34373) 9670 : audit [DBG] from='client.60520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:23.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:23 gibba043 bash[24019]: audit 2021-03-10T16:54:22.273401+0000 mgr.gibba043.dnkmem (mgr.34373) 9671 : audit [DBG] from='client.50535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:23 gibba043 bash[24019]: audit 2021-03-10T16:54:22.535384+0000 mon.a (mon.0) 1999 : audit [DBG] from='client.? 172.21.2.103:0/1102135680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:24.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:24 gibba003 bash[31385]: cluster 2021-03-10T16:54:23.214318+0000 mgr.gibba043.dnkmem (mgr.34373) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:24.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:24 gibba003 bash[32348]: cluster 2021-03-10T16:54:23.214318+0000 mgr.gibba043.dnkmem (mgr.34373) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:24.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:24 gibba043 bash[24019]: cluster 2021-03-10T16:54:23.214318+0000 mgr.gibba043.dnkmem (mgr.34373) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:26.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:26 gibba003 bash[31385]: cluster 2021-03-10T16:54:25.215933+0000 mgr.gibba043.dnkmem (mgr.34373) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:26.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:26 gibba003 bash[32348]: cluster 2021-03-10T16:54:25.215933+0000 mgr.gibba043.dnkmem (mgr.34373) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:26.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:26 gibba043 bash[24019]: cluster 2021-03-10T16:54:25.215933+0000 mgr.gibba043.dnkmem (mgr.34373) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:28 gibba003 bash[31385]: cluster 2021-03-10T16:54:27.217549+0000 mgr.gibba043.dnkmem (mgr.34373) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:28 gibba003 bash[32348]: cluster 2021-03-10T16:54:27.217549+0000 mgr.gibba043.dnkmem (mgr.34373) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:28 gibba043 bash[24019]: cluster 2021-03-10T16:54:27.217549+0000 mgr.gibba043.dnkmem (mgr.34373) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:30 gibba003 bash[31385]: cluster 2021-03-10T16:54:29.219198+0000 mgr.gibba043.dnkmem (mgr.34373) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:30 gibba003 bash[32348]: cluster 2021-03-10T16:54:29.219198+0000 mgr.gibba043.dnkmem (mgr.34373) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:30 gibba043 bash[24019]: cluster 2021-03-10T16:54:29.219198+0000 mgr.gibba043.dnkmem (mgr.34373) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:32.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:32 gibba003 bash[31385]: cluster 2021-03-10T16:54:31.220913+0000 mgr.gibba043.dnkmem (mgr.34373) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:32.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:32 gibba003 bash[32348]: cluster 2021-03-10T16:54:31.220913+0000 mgr.gibba043.dnkmem (mgr.34373) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:32.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:32 gibba043 bash[24019]: cluster 2021-03-10T16:54:31.220913+0000 mgr.gibba043.dnkmem (mgr.34373) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:34 gibba003 bash[31385]: cephadm 2021-03-10T16:54:32.453651+0000 mgr.gibba043.dnkmem (mgr.34373) 9677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:34 gibba003 bash[31385]: cluster 2021-03-10T16:54:33.222062+0000 mgr.gibba043.dnkmem (mgr.34373) 9678 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:34 gibba003 bash[32348]: cephadm 2021-03-10T16:54:32.453651+0000 mgr.gibba043.dnkmem (mgr.34373) 9677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:34 gibba003 bash[32348]: cluster 2021-03-10T16:54:33.222062+0000 mgr.gibba043.dnkmem (mgr.34373) 9678 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:34 gibba043 bash[24019]: cephadm 2021-03-10T16:54:32.453651+0000 mgr.gibba043.dnkmem (mgr.34373) 9677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:34 gibba043 bash[24019]: cluster 2021-03-10T16:54:33.222062+0000 mgr.gibba043.dnkmem (mgr.34373) 9678 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:36.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:36 gibba003 bash[31385]: cluster 2021-03-10T16:54:35.223885+0000 mgr.gibba043.dnkmem (mgr.34373) 9679 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:36.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:36 gibba003 bash[32348]: cluster 2021-03-10T16:54:35.223885+0000 mgr.gibba043.dnkmem (mgr.34373) 9679 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:36.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:36 gibba043 bash[24019]: cluster 2021-03-10T16:54:35.223885+0000 mgr.gibba043.dnkmem (mgr.34373) 9679 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:38 gibba003 bash[31385]: cluster 2021-03-10T16:54:37.225556+0000 mgr.gibba043.dnkmem (mgr.34373) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:38 gibba003 bash[32348]: cluster 2021-03-10T16:54:37.225556+0000 mgr.gibba043.dnkmem (mgr.34373) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:38 gibba043 bash[24019]: cluster 2021-03-10T16:54:37.225556+0000 mgr.gibba043.dnkmem (mgr.34373) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:40.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:40 gibba003 bash[31385]: cluster 2021-03-10T16:54:39.227158+0000 mgr.gibba043.dnkmem (mgr.34373) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:40 gibba003 bash[32348]: cluster 2021-03-10T16:54:39.227158+0000 mgr.gibba043.dnkmem (mgr.34373) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:40.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:40 gibba043 bash[24019]: cluster 2021-03-10T16:54:39.227158+0000 mgr.gibba043.dnkmem (mgr.34373) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:42.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:42 gibba003 bash[31385]: cluster 2021-03-10T16:54:41.229130+0000 mgr.gibba043.dnkmem (mgr.34373) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:42 gibba003 bash[32348]: cluster 2021-03-10T16:54:41.229130+0000 mgr.gibba043.dnkmem (mgr.34373) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:42.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:42 gibba043 bash[24019]: cluster 2021-03-10T16:54:41.229130+0000 mgr.gibba043.dnkmem (mgr.34373) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:44 gibba003 bash[31385]: cluster 2021-03-10T16:54:43.230508+0000 mgr.gibba043.dnkmem (mgr.34373) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:44 gibba003 bash[32348]: cluster 2021-03-10T16:54:43.230508+0000 mgr.gibba043.dnkmem (mgr.34373) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:44 gibba043 bash[24019]: cluster 2021-03-10T16:54:43.230508+0000 mgr.gibba043.dnkmem (mgr.34373) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:46 gibba003 bash[31385]: cluster 2021-03-10T16:54:45.231881+0000 mgr.gibba043.dnkmem (mgr.34373) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:46 gibba003 bash[32348]: cluster 2021-03-10T16:54:45.231881+0000 mgr.gibba043.dnkmem (mgr.34373) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:46 gibba043 bash[24019]: cluster 2021-03-10T16:54:45.231881+0000 mgr.gibba043.dnkmem (mgr.34373) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:48 gibba003 bash[31385]: cluster 2021-03-10T16:54:47.233425+0000 mgr.gibba043.dnkmem (mgr.34373) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:48 gibba003 bash[32348]: cluster 2021-03-10T16:54:47.233425+0000 mgr.gibba043.dnkmem (mgr.34373) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:48.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:48 gibba043 bash[24019]: cluster 2021-03-10T16:54:47.233425+0000 mgr.gibba043.dnkmem (mgr.34373) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:49.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:49 gibba003 bash[31385]: cephadm 2021-03-10T16:54:47.469659+0000 mgr.gibba043.dnkmem (mgr.34373) 9686 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:49 gibba003 bash[32348]: cephadm 2021-03-10T16:54:47.469659+0000 mgr.gibba043.dnkmem (mgr.34373) 9686 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:49 gibba043 bash[24019]: cephadm 2021-03-10T16:54:47.469659+0000 mgr.gibba043.dnkmem (mgr.34373) 9686 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:54:50.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:50 gibba003 bash[31385]: cluster 2021-03-10T16:54:49.235087+0000 mgr.gibba043.dnkmem (mgr.34373) 9687 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:50 gibba003 bash[32348]: cluster 2021-03-10T16:54:49.235087+0000 mgr.gibba043.dnkmem (mgr.34373) 9687 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:50.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:50 gibba043 bash[24019]: cluster 2021-03-10T16:54:49.235087+0000 mgr.gibba043.dnkmem (mgr.34373) 9687 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:52 gibba003 bash[31385]: cluster 2021-03-10T16:54:51.237031+0000 mgr.gibba043.dnkmem (mgr.34373) 9688 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:52 gibba003 bash[32348]: cluster 2021-03-10T16:54:51.237031+0000 mgr.gibba043.dnkmem (mgr.34373) 9688 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:52 gibba043 bash[24019]: cluster 2021-03-10T16:54:51.237031+0000 mgr.gibba043.dnkmem (mgr.34373) 9688 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.780 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:54:53.014 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:54:53.014 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:54:53.015 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:54:53.015 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:54:53.015 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:54:53.015 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:54:53.015 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:54:53.016 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:54:53.016 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:54:53.016 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:54:53.016 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:54:53.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:54:53.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:54:53.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:54:53.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:54:53.018 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:54:53.019 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:54:53.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:54:53.021 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:54:53.021 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:54:53.021 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:54:53.261 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:54:53.262 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:54:53.262 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:53.262 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:54:53.262 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:54:53.263 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:53.263 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:54:53.263 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:54:53.263 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:54:53.263 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:54:53.264 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:54:53.264 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:54:53.264 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:54:53.264 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:54:53.265 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:54:53.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:53 gibba003 bash[31385]: audit 2021-03-10T16:54:53.264315+0000 mon.a (mon.0) 2000 : audit [DBG] from='client.? 172.21.2.103:0/4018695753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:53.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:53 gibba003 bash[32348]: audit 2021-03-10T16:54:53.264315+0000 mon.a (mon.0) 2000 : audit [DBG] from='client.? 172.21.2.103:0/4018695753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:53.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:53 gibba043 bash[24019]: audit 2021-03-10T16:54:53.264315+0000 mon.a (mon.0) 2000 : audit [DBG] from='client.? 172.21.2.103:0/4018695753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:54 gibba003 bash[31385]: audit 2021-03-10T16:54:52.772596+0000 mgr.gibba043.dnkmem (mgr.34373) 9689 : audit [DBG] from='client.60538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:54 gibba003 bash[31385]: audit 2021-03-10T16:54:53.004388+0000 mgr.gibba043.dnkmem (mgr.34373) 9690 : audit [DBG] from='client.60544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:54 gibba003 bash[31385]: cluster 2021-03-10T16:54:53.238551+0000 mgr.gibba043.dnkmem (mgr.34373) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:54.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:54 gibba003 bash[32348]: audit 2021-03-10T16:54:52.772596+0000 mgr.gibba043.dnkmem (mgr.34373) 9689 : audit [DBG] from='client.60538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:54.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:54 gibba003 bash[32348]: audit 2021-03-10T16:54:53.004388+0000 mgr.gibba043.dnkmem (mgr.34373) 9690 : audit [DBG] from='client.60544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:54.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:54 gibba003 bash[32348]: cluster 2021-03-10T16:54:53.238551+0000 mgr.gibba043.dnkmem (mgr.34373) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:54 gibba043 bash[24019]: audit 2021-03-10T16:54:52.772596+0000 mgr.gibba043.dnkmem (mgr.34373) 9689 : audit [DBG] from='client.60538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:54.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:54 gibba043 bash[24019]: audit 2021-03-10T16:54:53.004388+0000 mgr.gibba043.dnkmem (mgr.34373) 9690 : audit [DBG] from='client.60544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:54.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:54 gibba043 bash[24019]: cluster 2021-03-10T16:54:53.238551+0000 mgr.gibba043.dnkmem (mgr.34373) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:56.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:56 gibba003 bash[31385]: cluster 2021-03-10T16:54:55.240221+0000 mgr.gibba043.dnkmem (mgr.34373) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:56 gibba003 bash[32348]: cluster 2021-03-10T16:54:55.240221+0000 mgr.gibba043.dnkmem (mgr.34373) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:56.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:56 gibba043 bash[24019]: cluster 2021-03-10T16:54:55.240221+0000 mgr.gibba043.dnkmem (mgr.34373) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:54:58 gibba003 bash[31385]: cluster 2021-03-10T16:54:57.241855+0000 mgr.gibba043.dnkmem (mgr.34373) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:58.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:54:58 gibba003 bash[32348]: cluster 2021-03-10T16:54:57.241855+0000 mgr.gibba043.dnkmem (mgr.34373) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:54:58 gibba043 bash[24019]: cluster 2021-03-10T16:54:57.241855+0000 mgr.gibba043.dnkmem (mgr.34373) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:00 gibba003 bash[31385]: cluster 2021-03-10T16:54:59.243224+0000 mgr.gibba043.dnkmem (mgr.34373) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:00 gibba003 bash[32348]: cluster 2021-03-10T16:54:59.243224+0000 mgr.gibba043.dnkmem (mgr.34373) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:00 gibba043 bash[24019]: cluster 2021-03-10T16:54:59.243224+0000 mgr.gibba043.dnkmem (mgr.34373) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:02.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:02 gibba003 bash[31385]: cluster 2021-03-10T16:55:01.245197+0000 mgr.gibba043.dnkmem (mgr.34373) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:02.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:02 gibba003 bash[32348]: cluster 2021-03-10T16:55:01.245197+0000 mgr.gibba043.dnkmem (mgr.34373) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:02.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:02 gibba043 bash[24019]: cluster 2021-03-10T16:55:01.245197+0000 mgr.gibba043.dnkmem (mgr.34373) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:04.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:04 gibba003 bash[31385]: cephadm 2021-03-10T16:55:02.485761+0000 mgr.gibba043.dnkmem (mgr.34373) 9696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:04.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:04 gibba003 bash[31385]: cluster 2021-03-10T16:55:03.246682+0000 mgr.gibba043.dnkmem (mgr.34373) 9697 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:04.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:04 gibba003 bash[32348]: cephadm 2021-03-10T16:55:02.485761+0000 mgr.gibba043.dnkmem (mgr.34373) 9696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:04.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:04 gibba003 bash[32348]: cluster 2021-03-10T16:55:03.246682+0000 mgr.gibba043.dnkmem (mgr.34373) 9697 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:04 gibba043 bash[24019]: cephadm 2021-03-10T16:55:02.485761+0000 mgr.gibba043.dnkmem (mgr.34373) 9696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:04 gibba043 bash[24019]: cluster 2021-03-10T16:55:03.246682+0000 mgr.gibba043.dnkmem (mgr.34373) 9697 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:06.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:06 gibba003 bash[31385]: cluster 2021-03-10T16:55:05.248282+0000 mgr.gibba043.dnkmem (mgr.34373) 9698 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:06.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:06 gibba003 bash[32348]: cluster 2021-03-10T16:55:05.248282+0000 mgr.gibba043.dnkmem (mgr.34373) 9698 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:06 gibba043 bash[24019]: cluster 2021-03-10T16:55:05.248282+0000 mgr.gibba043.dnkmem (mgr.34373) 9698 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:08.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:08 gibba003 bash[31385]: cluster 2021-03-10T16:55:07.249983+0000 mgr.gibba043.dnkmem (mgr.34373) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:08.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:08 gibba003 bash[32348]: cluster 2021-03-10T16:55:07.249983+0000 mgr.gibba043.dnkmem (mgr.34373) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:08 gibba043 bash[24019]: cluster 2021-03-10T16:55:07.249983+0000 mgr.gibba043.dnkmem (mgr.34373) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:10.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:10 gibba003 bash[31385]: cluster 2021-03-10T16:55:09.251447+0000 mgr.gibba043.dnkmem (mgr.34373) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:10 gibba003 bash[32348]: cluster 2021-03-10T16:55:09.251447+0000 mgr.gibba043.dnkmem (mgr.34373) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:10.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:10 gibba043 bash[24019]: cluster 2021-03-10T16:55:09.251447+0000 mgr.gibba043.dnkmem (mgr.34373) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:12.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:12 gibba003 bash[31385]: cluster 2021-03-10T16:55:11.253224+0000 mgr.gibba043.dnkmem (mgr.34373) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:12.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:12 gibba003 bash[32348]: cluster 2021-03-10T16:55:11.253224+0000 mgr.gibba043.dnkmem (mgr.34373) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:12.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:12 gibba043 bash[24019]: cluster 2021-03-10T16:55:11.253224+0000 mgr.gibba043.dnkmem (mgr.34373) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[31385]: cluster 2021-03-10T16:55:13.254764+0000 mgr.gibba043.dnkmem (mgr.34373) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[31385]: audit 2021-03-10T16:55:13.897179+0000 mon.c (mon.1) 2494 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[31385]: audit 2021-03-10T16:55:13.898277+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[31385]: audit 2021-03-10T16:55:14.131329+0000 mon.c (mon.1) 2495 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[31385]: audit 2021-03-10T16:55:14.132469+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[32348]: cluster 2021-03-10T16:55:13.254764+0000 mgr.gibba043.dnkmem (mgr.34373) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[32348]: audit 2021-03-10T16:55:13.897179+0000 mon.c (mon.1) 2494 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[32348]: audit 2021-03-10T16:55:13.898277+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[32348]: audit 2021-03-10T16:55:14.131329+0000 mon.c (mon.1) 2495 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:14 gibba003 bash[32348]: audit 2021-03-10T16:55:14.132469+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:14 gibba043 bash[24019]: cluster 2021-03-10T16:55:13.254764+0000 mgr.gibba043.dnkmem (mgr.34373) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:14 gibba043 bash[24019]: audit 2021-03-10T16:55:13.897179+0000 mon.c (mon.1) 2494 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:14 gibba043 bash[24019]: audit 2021-03-10T16:55:13.898277+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:14 gibba043 bash[24019]: audit 2021-03-10T16:55:14.131329+0000 mon.c (mon.1) 2495 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:14 gibba043 bash[24019]: audit 2021-03-10T16:55:14.132469+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.426122+0000 mon.c (mon.1) 2496 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:55:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.426809+0000 mon.c (mon.1) 2497 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.427475+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:55:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.427530+0000 mon.c (mon.1) 2498 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:55:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.428196+0000 mon.c (mon.1) 2499 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.429445+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.430576+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:55:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[31385]: audit 2021-03-10T16:55:14.431530+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.426122+0000 mon.c (mon.1) 2496 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:55:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.426809+0000 mon.c (mon.1) 2497 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.427475+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:55:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.427530+0000 mon.c (mon.1) 2498 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:55:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.428196+0000 mon.c (mon.1) 2499 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.429445+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.430576+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:55:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:15 gibba003 bash[32348]: audit 2021-03-10T16:55:14.431530+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.426122+0000 mon.c (mon.1) 2496 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:55:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.426809+0000 mon.c (mon.1) 2497 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.427475+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:55:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.427530+0000 mon.c (mon.1) 2498 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:55:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.428196+0000 mon.c (mon.1) 2499 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.429445+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.430576+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:55:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:15 gibba043 bash[24019]: audit 2021-03-10T16:55:14.431530+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:16.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:16 gibba003 bash[31385]: cluster 2021-03-10T16:55:15.255940+0000 mgr.gibba043.dnkmem (mgr.34373) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:16.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:16 gibba003 bash[32348]: cluster 2021-03-10T16:55:15.255940+0000 mgr.gibba043.dnkmem (mgr.34373) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:16.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:16 gibba043 bash[24019]: cluster 2021-03-10T16:55:15.255940+0000 mgr.gibba043.dnkmem (mgr.34373) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: cluster 2021-03-10T16:55:17.257520+0000 mgr.gibba043.dnkmem (mgr.34373) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.706845+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:55:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.712924+0000 mon.c (mon.1) 2500 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.714305+0000 mon.c (mon.1) 2501 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.715606+0000 mon.c (mon.1) 2502 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.716795+0000 mon.c (mon.1) 2503 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.719232+0000 mon.c (mon.1) 2504 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[31385]: audit 2021-03-10T16:55:17.720698+0000 mon.c (mon.1) 2505 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: cluster 2021-03-10T16:55:17.257520+0000 mgr.gibba043.dnkmem (mgr.34373) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.706845+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:55:18.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.712924+0000 mon.c (mon.1) 2500 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.714305+0000 mon.c (mon.1) 2501 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.715606+0000 mon.c (mon.1) 2502 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.716795+0000 mon.c (mon.1) 2503 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.719232+0000 mon.c (mon.1) 2504 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:18 gibba003 bash[32348]: audit 2021-03-10T16:55:17.720698+0000 mon.c (mon.1) 2505 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: cluster 2021-03-10T16:55:17.257520+0000 mgr.gibba043.dnkmem (mgr.34373) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.706845+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:55:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.712924+0000 mon.c (mon.1) 2500 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.714305+0000 mon.c (mon.1) 2501 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.715606+0000 mon.c (mon.1) 2502 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.716795+0000 mon.c (mon.1) 2503 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.719232+0000 mon.c (mon.1) 2504 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:18 gibba043 bash[24019]: audit 2021-03-10T16:55:17.720698+0000 mon.c (mon.1) 2505 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.495214+0000 mgr.gibba043.dnkmem (mgr.34373) 9705 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:55:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.496810+0000 mgr.gibba043.dnkmem (mgr.34373) 9706 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:55:19.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.708429+0000 mgr.gibba043.dnkmem (mgr.34373) 9707 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.712256+0000 mgr.gibba043.dnkmem (mgr.34373) 9708 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.713517+0000 mgr.gibba043.dnkmem (mgr.34373) 9709 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.713573+0000 mgr.gibba043.dnkmem (mgr.34373) 9710 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.714769+0000 mgr.gibba043.dnkmem (mgr.34373) 9711 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.714847+0000 mgr.gibba043.dnkmem (mgr.34373) 9712 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.715928+0000 mgr.gibba043.dnkmem (mgr.34373) 9713 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.717155+0000 mgr.gibba043.dnkmem (mgr.34373) 9714 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.717196+0000 mgr.gibba043.dnkmem (mgr.34373) 9715 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.718345+0000 mgr.gibba043.dnkmem (mgr.34373) 9716 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.718852+0000 mgr.gibba043.dnkmem (mgr.34373) 9717 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.719734+0000 mgr.gibba043.dnkmem (mgr.34373) 9718 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.719771+0000 mgr.gibba043.dnkmem (mgr.34373) 9719 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[31385]: cephadm 2021-03-10T16:55:17.719883+0000 mgr.gibba043.dnkmem (mgr.34373) 9720 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.495214+0000 mgr.gibba043.dnkmem (mgr.34373) 9705 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:55:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.496810+0000 mgr.gibba043.dnkmem (mgr.34373) 9706 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:55:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.708429+0000 mgr.gibba043.dnkmem (mgr.34373) 9707 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:19.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.712256+0000 mgr.gibba043.dnkmem (mgr.34373) 9708 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.713517+0000 mgr.gibba043.dnkmem (mgr.34373) 9709 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.713573+0000 mgr.gibba043.dnkmem (mgr.34373) 9710 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.714769+0000 mgr.gibba043.dnkmem (mgr.34373) 9711 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.714847+0000 mgr.gibba043.dnkmem (mgr.34373) 9712 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.715928+0000 mgr.gibba043.dnkmem (mgr.34373) 9713 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.717155+0000 mgr.gibba043.dnkmem (mgr.34373) 9714 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.717196+0000 mgr.gibba043.dnkmem (mgr.34373) 9715 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.718345+0000 mgr.gibba043.dnkmem (mgr.34373) 9716 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.718852+0000 mgr.gibba043.dnkmem (mgr.34373) 9717 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.719734+0000 mgr.gibba043.dnkmem (mgr.34373) 9718 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.719771+0000 mgr.gibba043.dnkmem (mgr.34373) 9719 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:19 gibba003 bash[32348]: cephadm 2021-03-10T16:55:17.719883+0000 mgr.gibba043.dnkmem (mgr.34373) 9720 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.495214+0000 mgr.gibba043.dnkmem (mgr.34373) 9705 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:55:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.496810+0000 mgr.gibba043.dnkmem (mgr.34373) 9706 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:55:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.708429+0000 mgr.gibba043.dnkmem (mgr.34373) 9707 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.712256+0000 mgr.gibba043.dnkmem (mgr.34373) 9708 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.713517+0000 mgr.gibba043.dnkmem (mgr.34373) 9709 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.713573+0000 mgr.gibba043.dnkmem (mgr.34373) 9710 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.714769+0000 mgr.gibba043.dnkmem (mgr.34373) 9711 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.714847+0000 mgr.gibba043.dnkmem (mgr.34373) 9712 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.715928+0000 mgr.gibba043.dnkmem (mgr.34373) 9713 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.717155+0000 mgr.gibba043.dnkmem (mgr.34373) 9714 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.717196+0000 mgr.gibba043.dnkmem (mgr.34373) 9715 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.718345+0000 mgr.gibba043.dnkmem (mgr.34373) 9716 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.718852+0000 mgr.gibba043.dnkmem (mgr.34373) 9717 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.719734+0000 mgr.gibba043.dnkmem (mgr.34373) 9718 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.719771+0000 mgr.gibba043.dnkmem (mgr.34373) 9719 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:19 gibba043 bash[24019]: cephadm 2021-03-10T16:55:17.719883+0000 mgr.gibba043.dnkmem (mgr.34373) 9720 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:20.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:20 gibba003 bash[31385]: cluster 2021-03-10T16:55:19.259208+0000 mgr.gibba043.dnkmem (mgr.34373) 9721 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:20 gibba003 bash[32348]: cluster 2021-03-10T16:55:19.259208+0000 mgr.gibba043.dnkmem (mgr.34373) 9721 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:20.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:20 gibba043 bash[24019]: cluster 2021-03-10T16:55:19.259208+0000 mgr.gibba043.dnkmem (mgr.34373) 9721 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:22.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:22 gibba003 bash[31385]: cluster 2021-03-10T16:55:21.261102+0000 mgr.gibba043.dnkmem (mgr.34373) 9722 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:22.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:22 gibba003 bash[32348]: cluster 2021-03-10T16:55:21.261102+0000 mgr.gibba043.dnkmem (mgr.34373) 9722 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:22.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:22 gibba043 bash[24019]: cluster 2021-03-10T16:55:21.261102+0000 mgr.gibba043.dnkmem (mgr.34373) 9722 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:23.512 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:55:23.765 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:55:23.766 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:55:23.766 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:55:23.766 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:55:23.767 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:55:23.767 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:55:23.767 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:55:23.767 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:55:23.768 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:55:23.768 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:55:23.768 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:55:23.768 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:55:23.769 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:55:23.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:55:23.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:55:23.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:55:23.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:55:23.771 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:55:23.772 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:55:23.772 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:55:23.772 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:55:24.016 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:55:24.016 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:55:24.016 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:24.017 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:55:24.017 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:55:24.017 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:24.017 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:55:24.018 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:55:24.018 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:55:24.018 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:55:24.018 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:55:24.019 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:55:24.019 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:55:24.019 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:55:24.019 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:55:24.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:24 gibba003 bash[31385]: cluster 2021-03-10T16:55:23.262736+0000 mgr.gibba043.dnkmem (mgr.34373) 9723 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:24.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:24 gibba003 bash[31385]: audit 2021-03-10T16:55:24.018778+0000 mon.c (mon.1) 2506 : audit [DBG] from='client.? 172.21.2.103:0/3368666424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:24.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:24 gibba003 bash[32348]: cluster 2021-03-10T16:55:23.262736+0000 mgr.gibba043.dnkmem (mgr.34373) 9723 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:24.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:24 gibba003 bash[32348]: audit 2021-03-10T16:55:24.018778+0000 mon.c (mon.1) 2506 : audit [DBG] from='client.? 172.21.2.103:0/3368666424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:24 gibba043 bash[24019]: cluster 2021-03-10T16:55:23.262736+0000 mgr.gibba043.dnkmem (mgr.34373) 9723 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:24 gibba043 bash[24019]: audit 2021-03-10T16:55:24.018778+0000 mon.c (mon.1) 2506 : audit [DBG] from='client.? 172.21.2.103:0/3368666424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:25.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:25 gibba003 bash[31385]: audit 2021-03-10T16:55:23.504458+0000 mgr.gibba043.dnkmem (mgr.34373) 9724 : audit [DBG] from='client.50565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:25.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:25 gibba003 bash[31385]: audit 2021-03-10T16:55:23.725584+0000 mgr.gibba043.dnkmem (mgr.34373) 9725 : audit [DBG] from='client.50571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:25.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:25 gibba003 bash[32348]: audit 2021-03-10T16:55:23.504458+0000 mgr.gibba043.dnkmem (mgr.34373) 9724 : audit [DBG] from='client.50565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:25.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:25 gibba003 bash[32348]: audit 2021-03-10T16:55:23.725584+0000 mgr.gibba043.dnkmem (mgr.34373) 9725 : audit [DBG] from='client.50571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:25.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:25 gibba043 bash[24019]: audit 2021-03-10T16:55:23.504458+0000 mgr.gibba043.dnkmem (mgr.34373) 9724 : audit [DBG] from='client.50565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:25.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:25 gibba043 bash[24019]: audit 2021-03-10T16:55:23.725584+0000 mgr.gibba043.dnkmem (mgr.34373) 9725 : audit [DBG] from='client.50571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:26.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:26 gibba003 bash[31385]: cluster 2021-03-10T16:55:25.264162+0000 mgr.gibba043.dnkmem (mgr.34373) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:26 gibba003 bash[32348]: cluster 2021-03-10T16:55:25.264162+0000 mgr.gibba043.dnkmem (mgr.34373) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:26.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:26 gibba043 bash[24019]: cluster 2021-03-10T16:55:25.264162+0000 mgr.gibba043.dnkmem (mgr.34373) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:28.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:28 gibba003 bash[31385]: cluster 2021-03-10T16:55:27.265736+0000 mgr.gibba043.dnkmem (mgr.34373) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:28.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:28 gibba003 bash[32348]: cluster 2021-03-10T16:55:27.265736+0000 mgr.gibba043.dnkmem (mgr.34373) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:28 gibba043 bash[24019]: cluster 2021-03-10T16:55:27.265736+0000 mgr.gibba043.dnkmem (mgr.34373) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:30 gibba003 bash[31385]: cluster 2021-03-10T16:55:29.267413+0000 mgr.gibba043.dnkmem (mgr.34373) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:30 gibba003 bash[32348]: cluster 2021-03-10T16:55:29.267413+0000 mgr.gibba043.dnkmem (mgr.34373) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:30 gibba043 bash[24019]: cluster 2021-03-10T16:55:29.267413+0000 mgr.gibba043.dnkmem (mgr.34373) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:32.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:32 gibba003 bash[31385]: cluster 2021-03-10T16:55:31.269269+0000 mgr.gibba043.dnkmem (mgr.34373) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:32.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:32 gibba003 bash[32348]: cluster 2021-03-10T16:55:31.269269+0000 mgr.gibba043.dnkmem (mgr.34373) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:32.735 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:32 gibba043 bash[24019]: cluster 2021-03-10T16:55:31.269269+0000 mgr.gibba043.dnkmem (mgr.34373) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:34.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:34 gibba003 bash[31385]: cephadm 2021-03-10T16:55:32.735977+0000 mgr.gibba043.dnkmem (mgr.34373) 9730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:34 gibba003 bash[31385]: cluster 2021-03-10T16:55:33.270952+0000 mgr.gibba043.dnkmem (mgr.34373) 9731 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:34 gibba003 bash[32348]: cephadm 2021-03-10T16:55:32.735977+0000 mgr.gibba043.dnkmem (mgr.34373) 9730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:34 gibba003 bash[32348]: cluster 2021-03-10T16:55:33.270952+0000 mgr.gibba043.dnkmem (mgr.34373) 9731 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:34 gibba043 bash[24019]: cephadm 2021-03-10T16:55:32.735977+0000 mgr.gibba043.dnkmem (mgr.34373) 9730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:34 gibba043 bash[24019]: cluster 2021-03-10T16:55:33.270952+0000 mgr.gibba043.dnkmem (mgr.34373) 9731 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:36.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:36 gibba003 bash[31385]: cluster 2021-03-10T16:55:35.272108+0000 mgr.gibba043.dnkmem (mgr.34373) 9732 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:36.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:36 gibba003 bash[32348]: cluster 2021-03-10T16:55:35.272108+0000 mgr.gibba043.dnkmem (mgr.34373) 9732 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:36.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:36 gibba043 bash[24019]: cluster 2021-03-10T16:55:35.272108+0000 mgr.gibba043.dnkmem (mgr.34373) 9732 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:38.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:38 gibba003 bash[31385]: cluster 2021-03-10T16:55:37.273468+0000 mgr.gibba043.dnkmem (mgr.34373) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:38.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:38 gibba003 bash[32348]: cluster 2021-03-10T16:55:37.273468+0000 mgr.gibba043.dnkmem (mgr.34373) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:38.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:38 gibba043 bash[24019]: cluster 2021-03-10T16:55:37.273468+0000 mgr.gibba043.dnkmem (mgr.34373) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:40 gibba003 bash[31385]: cluster 2021-03-10T16:55:39.274989+0000 mgr.gibba043.dnkmem (mgr.34373) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:40 gibba003 bash[32348]: cluster 2021-03-10T16:55:39.274989+0000 mgr.gibba043.dnkmem (mgr.34373) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:40 gibba043 bash[24019]: cluster 2021-03-10T16:55:39.274989+0000 mgr.gibba043.dnkmem (mgr.34373) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:42.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:42 gibba003 bash[31385]: cluster 2021-03-10T16:55:41.276973+0000 mgr.gibba043.dnkmem (mgr.34373) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:42 gibba003 bash[32348]: cluster 2021-03-10T16:55:41.276973+0000 mgr.gibba043.dnkmem (mgr.34373) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:42.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:42 gibba043 bash[24019]: cluster 2021-03-10T16:55:41.276973+0000 mgr.gibba043.dnkmem (mgr.34373) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:44.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:44 gibba003 bash[31385]: cluster 2021-03-10T16:55:43.278590+0000 mgr.gibba043.dnkmem (mgr.34373) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:44 gibba003 bash[32348]: cluster 2021-03-10T16:55:43.278590+0000 mgr.gibba043.dnkmem (mgr.34373) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:44 gibba043 bash[24019]: cluster 2021-03-10T16:55:43.278590+0000 mgr.gibba043.dnkmem (mgr.34373) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:46.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:46 gibba003 bash[31385]: cluster 2021-03-10T16:55:45.280140+0000 mgr.gibba043.dnkmem (mgr.34373) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:46 gibba003 bash[32348]: cluster 2021-03-10T16:55:45.280140+0000 mgr.gibba043.dnkmem (mgr.34373) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:46.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:46 gibba043 bash[24019]: cluster 2021-03-10T16:55:45.280140+0000 mgr.gibba043.dnkmem (mgr.34373) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:48.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:48 gibba003 bash[31385]: cluster 2021-03-10T16:55:47.281518+0000 mgr.gibba043.dnkmem (mgr.34373) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:48 gibba003 bash[32348]: cluster 2021-03-10T16:55:47.281518+0000 mgr.gibba043.dnkmem (mgr.34373) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:48.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:48 gibba043 bash[24019]: cluster 2021-03-10T16:55:47.281518+0000 mgr.gibba043.dnkmem (mgr.34373) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:49 gibba003 bash[31385]: cephadm 2021-03-10T16:55:47.752122+0000 mgr.gibba043.dnkmem (mgr.34373) 9739 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:49 gibba003 bash[32348]: cephadm 2021-03-10T16:55:47.752122+0000 mgr.gibba043.dnkmem (mgr.34373) 9739 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:49.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:49 gibba043 bash[24019]: cephadm 2021-03-10T16:55:47.752122+0000 mgr.gibba043.dnkmem (mgr.34373) 9739 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:55:50.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:50 gibba003 bash[31385]: cluster 2021-03-10T16:55:49.283021+0000 mgr.gibba043.dnkmem (mgr.34373) 9740 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:50 gibba003 bash[32348]: cluster 2021-03-10T16:55:49.283021+0000 mgr.gibba043.dnkmem (mgr.34373) 9740 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:50.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:50 gibba043 bash[24019]: cluster 2021-03-10T16:55:49.283021+0000 mgr.gibba043.dnkmem (mgr.34373) 9740 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:52.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:52 gibba003 bash[31385]: cluster 2021-03-10T16:55:51.284969+0000 mgr.gibba043.dnkmem (mgr.34373) 9741 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:52.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:52 gibba003 bash[32348]: cluster 2021-03-10T16:55:51.284969+0000 mgr.gibba043.dnkmem (mgr.34373) 9741 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:52.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:52 gibba043 bash[24019]: cluster 2021-03-10T16:55:51.284969+0000 mgr.gibba043.dnkmem (mgr.34373) 9741 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.258 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:55:54.489 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:55:54.489 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:55:54.490 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:55:54.490 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:55:54.490 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:55:54.490 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:55:54.491 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:55:54.491 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:55:54.491 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:55:54.491 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:55:54.492 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:55:54.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:55:54.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:55:54.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:55:54.492 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:55:54.493 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:55:54.493 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:55:54.493 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:55:54.493 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:55:54.493 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:55:54.494 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:55:54.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:54 gibba003 bash[31385]: cluster 2021-03-10T16:55:53.286298+0000 mgr.gibba043.dnkmem (mgr.34373) 9742 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.688 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:54 gibba003 bash[32348]: cluster 2021-03-10T16:55:53.286298+0000 mgr.gibba043.dnkmem (mgr.34373) 9742 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.738 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:55:54.738 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:55:54.739 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:54.739 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:55:54.739 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:55:54.739 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:54.739 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:55:54.740 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:55:54.740 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:55:54.740 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:55:54.740 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:55:54.741 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:55:54.741 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:55:54.741 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:55:54.741 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:55:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:54 gibba043 bash[24019]: cluster 2021-03-10T16:55:53.286298+0000 mgr.gibba043.dnkmem (mgr.34373) 9742 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:55 gibba003 bash[31385]: audit 2021-03-10T16:55:54.250650+0000 mgr.gibba043.dnkmem (mgr.34373) 9743 : audit [DBG] from='client.60574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:55 gibba003 bash[31385]: audit 2021-03-10T16:55:54.740215+0000 mon.a (mon.0) 2008 : audit [DBG] from='client.? 172.21.2.103:0/2776309077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:55.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:55 gibba003 bash[32348]: audit 2021-03-10T16:55:54.250650+0000 mgr.gibba043.dnkmem (mgr.34373) 9743 : audit [DBG] from='client.60574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:55 gibba003 bash[32348]: audit 2021-03-10T16:55:54.740215+0000 mon.a (mon.0) 2008 : audit [DBG] from='client.? 172.21.2.103:0/2776309077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:55.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:55 gibba043 bash[24019]: audit 2021-03-10T16:55:54.250650+0000 mgr.gibba043.dnkmem (mgr.34373) 9743 : audit [DBG] from='client.60574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:55.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:55 gibba043 bash[24019]: audit 2021-03-10T16:55:54.740215+0000 mon.a (mon.0) 2008 : audit [DBG] from='client.? 172.21.2.103:0/2776309077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:56.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:56 gibba003 bash[31385]: audit 2021-03-10T16:55:54.477612+0000 mgr.gibba043.dnkmem (mgr.34373) 9744 : audit [DBG] from='client.50589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:56.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:56 gibba003 bash[31385]: cluster 2021-03-10T16:55:55.287722+0000 mgr.gibba043.dnkmem (mgr.34373) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:56 gibba003 bash[32348]: audit 2021-03-10T16:55:54.477612+0000 mgr.gibba043.dnkmem (mgr.34373) 9744 : audit [DBG] from='client.50589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:56 gibba003 bash[32348]: cluster 2021-03-10T16:55:55.287722+0000 mgr.gibba043.dnkmem (mgr.34373) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:56.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:56 gibba043 bash[24019]: audit 2021-03-10T16:55:54.477612+0000 mgr.gibba043.dnkmem (mgr.34373) 9744 : audit [DBG] from='client.50589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:56.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:56 gibba043 bash[24019]: cluster 2021-03-10T16:55:55.287722+0000 mgr.gibba043.dnkmem (mgr.34373) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:58.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:55:58 gibba003 bash[31385]: cluster 2021-03-10T16:55:57.289031+0000 mgr.gibba043.dnkmem (mgr.34373) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:58.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:55:58 gibba003 bash[32348]: cluster 2021-03-10T16:55:57.289031+0000 mgr.gibba043.dnkmem (mgr.34373) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:55:58 gibba043 bash[24019]: cluster 2021-03-10T16:55:57.289031+0000 mgr.gibba043.dnkmem (mgr.34373) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:00 gibba003 bash[31385]: cluster 2021-03-10T16:55:59.290520+0000 mgr.gibba043.dnkmem (mgr.34373) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:00 gibba003 bash[32348]: cluster 2021-03-10T16:55:59.290520+0000 mgr.gibba043.dnkmem (mgr.34373) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:00 gibba043 bash[24019]: cluster 2021-03-10T16:55:59.290520+0000 mgr.gibba043.dnkmem (mgr.34373) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:02.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:02 gibba003 bash[31385]: cluster 2021-03-10T16:56:01.292366+0000 mgr.gibba043.dnkmem (mgr.34373) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:02.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:02 gibba003 bash[32348]: cluster 2021-03-10T16:56:01.292366+0000 mgr.gibba043.dnkmem (mgr.34373) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:02.767 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:02 gibba043 bash[24019]: cluster 2021-03-10T16:56:01.292366+0000 mgr.gibba043.dnkmem (mgr.34373) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:04.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:04 gibba003 bash[31385]: cephadm 2021-03-10T16:56:02.768105+0000 mgr.gibba043.dnkmem (mgr.34373) 9749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:04.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:04 gibba003 bash[31385]: cluster 2021-03-10T16:56:03.293747+0000 mgr.gibba043.dnkmem (mgr.34373) 9750 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:04.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:04 gibba003 bash[32348]: cephadm 2021-03-10T16:56:02.768105+0000 mgr.gibba043.dnkmem (mgr.34373) 9749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:04.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:04 gibba003 bash[32348]: cluster 2021-03-10T16:56:03.293747+0000 mgr.gibba043.dnkmem (mgr.34373) 9750 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:04 gibba043 bash[24019]: cephadm 2021-03-10T16:56:02.768105+0000 mgr.gibba043.dnkmem (mgr.34373) 9749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:04 gibba043 bash[24019]: cluster 2021-03-10T16:56:03.293747+0000 mgr.gibba043.dnkmem (mgr.34373) 9750 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:06.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:06 gibba003 bash[31385]: cluster 2021-03-10T16:56:05.295329+0000 mgr.gibba043.dnkmem (mgr.34373) 9751 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:06.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:06 gibba003 bash[32348]: cluster 2021-03-10T16:56:05.295329+0000 mgr.gibba043.dnkmem (mgr.34373) 9751 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:06.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:06 gibba043 bash[24019]: cluster 2021-03-10T16:56:05.295329+0000 mgr.gibba043.dnkmem (mgr.34373) 9751 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:08.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:08 gibba003 bash[31385]: cluster 2021-03-10T16:56:07.296775+0000 mgr.gibba043.dnkmem (mgr.34373) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:08.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:08 gibba003 bash[32348]: cluster 2021-03-10T16:56:07.296775+0000 mgr.gibba043.dnkmem (mgr.34373) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:08 gibba043 bash[24019]: cluster 2021-03-10T16:56:07.296775+0000 mgr.gibba043.dnkmem (mgr.34373) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:10 gibba003 bash[31385]: cluster 2021-03-10T16:56:09.298158+0000 mgr.gibba043.dnkmem (mgr.34373) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:10 gibba003 bash[32348]: cluster 2021-03-10T16:56:09.298158+0000 mgr.gibba043.dnkmem (mgr.34373) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:10 gibba043 bash[24019]: cluster 2021-03-10T16:56:09.298158+0000 mgr.gibba043.dnkmem (mgr.34373) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:12.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:12 gibba003 bash[31385]: cluster 2021-03-10T16:56:11.300045+0000 mgr.gibba043.dnkmem (mgr.34373) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:12.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:12 gibba003 bash[32348]: cluster 2021-03-10T16:56:11.300045+0000 mgr.gibba043.dnkmem (mgr.34373) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:12 gibba043 bash[24019]: cluster 2021-03-10T16:56:11.300045+0000 mgr.gibba043.dnkmem (mgr.34373) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[31385]: cluster 2021-03-10T16:56:13.301716+0000 mgr.gibba043.dnkmem (mgr.34373) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[31385]: audit 2021-03-10T16:56:13.903876+0000 mon.c (mon.1) 2507 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[31385]: audit 2021-03-10T16:56:13.904987+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[31385]: audit 2021-03-10T16:56:14.137757+0000 mon.c (mon.1) 2508 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[31385]: audit 2021-03-10T16:56:14.138879+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[32348]: cluster 2021-03-10T16:56:13.301716+0000 mgr.gibba043.dnkmem (mgr.34373) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[32348]: audit 2021-03-10T16:56:13.903876+0000 mon.c (mon.1) 2507 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[32348]: audit 2021-03-10T16:56:13.904987+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[32348]: audit 2021-03-10T16:56:14.137757+0000 mon.c (mon.1) 2508 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:14 gibba003 bash[32348]: audit 2021-03-10T16:56:14.138879+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:14 gibba043 bash[24019]: cluster 2021-03-10T16:56:13.301716+0000 mgr.gibba043.dnkmem (mgr.34373) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:14 gibba043 bash[24019]: audit 2021-03-10T16:56:13.903876+0000 mon.c (mon.1) 2507 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:14 gibba043 bash[24019]: audit 2021-03-10T16:56:13.904987+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:14 gibba043 bash[24019]: audit 2021-03-10T16:56:14.137757+0000 mon.c (mon.1) 2508 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:14 gibba043 bash[24019]: audit 2021-03-10T16:56:14.138879+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.432363+0000 mon.c (mon.1) 2509 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:56:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.432630+0000 mon.c (mon.1) 2510 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:56:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.432934+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:56:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.432951+0000 mon.c (mon.1) 2511 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.433332+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:56:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.433434+0000 mon.c (mon.1) 2512 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.433699+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[31385]: audit 2021-03-10T16:56:14.434080+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.432363+0000 mon.c (mon.1) 2509 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:56:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.432630+0000 mon.c (mon.1) 2510 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:56:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.432934+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:56:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.432951+0000 mon.c (mon.1) 2511 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.433332+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:56:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.433434+0000 mon.c (mon.1) 2512 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.433699+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:15 gibba003 bash[32348]: audit 2021-03-10T16:56:14.434080+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.432363+0000 mon.c (mon.1) 2509 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:56:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.432630+0000 mon.c (mon.1) 2510 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:56:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.432934+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:56:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.432951+0000 mon.c (mon.1) 2511 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.433332+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:56:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.433434+0000 mon.c (mon.1) 2512 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.433699+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:56:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:15 gibba043 bash[24019]: audit 2021-03-10T16:56:14.434080+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:16.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:16 gibba003 bash[31385]: cluster 2021-03-10T16:56:15.303211+0000 mgr.gibba043.dnkmem (mgr.34373) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:16.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:16 gibba003 bash[32348]: cluster 2021-03-10T16:56:15.303211+0000 mgr.gibba043.dnkmem (mgr.34373) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:16.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:16 gibba043 bash[24019]: cluster 2021-03-10T16:56:15.303211+0000 mgr.gibba043.dnkmem (mgr.34373) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:18 gibba003 bash[31385]: cluster 2021-03-10T16:56:17.304916+0000 mgr.gibba043.dnkmem (mgr.34373) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:18 gibba003 bash[31385]: audit 2021-03-10T16:56:17.981188+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:18.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:18 gibba003 bash[31385]: audit 2021-03-10T16:56:17.984026+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:18 gibba003 bash[32348]: cluster 2021-03-10T16:56:17.304916+0000 mgr.gibba043.dnkmem (mgr.34373) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:18 gibba003 bash[32348]: audit 2021-03-10T16:56:17.981188+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:18.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:18 gibba003 bash[32348]: audit 2021-03-10T16:56:17.984026+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:18 gibba043 bash[24019]: cluster 2021-03-10T16:56:17.304916+0000 mgr.gibba043.dnkmem (mgr.34373) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:18 gibba043 bash[24019]: audit 2021-03-10T16:56:17.981188+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:18.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:18 gibba043 bash[24019]: audit 2021-03-10T16:56:17.984026+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:17.980619+0000 mgr.gibba043.dnkmem (mgr.34373) 9758 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:56:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:17.983841+0000 mgr.gibba043.dnkmem (mgr.34373) 9759 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:56:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.170903+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.172242+0000 mgr.gibba043.dnkmem (mgr.34373) 9760 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.173938+0000 mgr.gibba043.dnkmem (mgr.34373) 9761 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.174542+0000 mon.c (mon.1) 2513 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.175316+0000 mgr.gibba043.dnkmem (mgr.34373) 9762 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.175354+0000 mgr.gibba043.dnkmem (mgr.34373) 9763 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.176030+0000 mon.c (mon.1) 2514 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.176676+0000 mgr.gibba043.dnkmem (mgr.34373) 9764 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.176711+0000 mgr.gibba043.dnkmem (mgr.34373) 9765 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.177470+0000 mon.c (mon.1) 2515 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.178004+0000 mgr.gibba043.dnkmem (mgr.34373) 9766 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.178688+0000 mon.c (mon.1) 2516 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.179625+0000 mgr.gibba043.dnkmem (mgr.34373) 9767 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.179679+0000 mgr.gibba043.dnkmem (mgr.34373) 9768 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.181029+0000 mgr.gibba043.dnkmem (mgr.34373) 9769 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.181337+0000 mgr.gibba043.dnkmem (mgr.34373) 9770 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.181907+0000 mon.c (mon.1) 2517 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.182354+0000 mgr.gibba043.dnkmem (mgr.34373) 9771 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.182390+0000 mgr.gibba043.dnkmem (mgr.34373) 9772 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: cephadm 2021-03-10T16:56:18.182492+0000 mgr.gibba043.dnkmem (mgr.34373) 9773 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:19.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[31385]: audit 2021-03-10T16:56:18.183247+0000 mon.c (mon.1) 2518 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:17.980619+0000 mgr.gibba043.dnkmem (mgr.34373) 9758 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:56:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:17.983841+0000 mgr.gibba043.dnkmem (mgr.34373) 9759 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:56:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.170903+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.172242+0000 mgr.gibba043.dnkmem (mgr.34373) 9760 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.173938+0000 mgr.gibba043.dnkmem (mgr.34373) 9761 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:19.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.174542+0000 mon.c (mon.1) 2513 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:19.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.175316+0000 mgr.gibba043.dnkmem (mgr.34373) 9762 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:19.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.175354+0000 mgr.gibba043.dnkmem (mgr.34373) 9763 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:19.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.176030+0000 mon.c (mon.1) 2514 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.176676+0000 mgr.gibba043.dnkmem (mgr.34373) 9764 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:19.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.176711+0000 mgr.gibba043.dnkmem (mgr.34373) 9765 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:19.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.177470+0000 mon.c (mon.1) 2515 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.178004+0000 mgr.gibba043.dnkmem (mgr.34373) 9766 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.178688+0000 mon.c (mon.1) 2516 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.179625+0000 mgr.gibba043.dnkmem (mgr.34373) 9767 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.179679+0000 mgr.gibba043.dnkmem (mgr.34373) 9768 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:19.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.181029+0000 mgr.gibba043.dnkmem (mgr.34373) 9769 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.181337+0000 mgr.gibba043.dnkmem (mgr.34373) 9770 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.181907+0000 mon.c (mon.1) 2517 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.182354+0000 mgr.gibba043.dnkmem (mgr.34373) 9771 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:19.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.182390+0000 mgr.gibba043.dnkmem (mgr.34373) 9772 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:19.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: cephadm 2021-03-10T16:56:18.182492+0000 mgr.gibba043.dnkmem (mgr.34373) 9773 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:19.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:19 gibba003 bash[32348]: audit 2021-03-10T16:56:18.183247+0000 mon.c (mon.1) 2518 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:17.980619+0000 mgr.gibba043.dnkmem (mgr.34373) 9758 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:56:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:17.983841+0000 mgr.gibba043.dnkmem (mgr.34373) 9759 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:56:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.170903+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:56:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.172242+0000 mgr.gibba043.dnkmem (mgr.34373) 9760 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.173938+0000 mgr.gibba043.dnkmem (mgr.34373) 9761 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.174542+0000 mon.c (mon.1) 2513 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.175316+0000 mgr.gibba043.dnkmem (mgr.34373) 9762 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.175354+0000 mgr.gibba043.dnkmem (mgr.34373) 9763 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.176030+0000 mon.c (mon.1) 2514 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.176676+0000 mgr.gibba043.dnkmem (mgr.34373) 9764 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.176711+0000 mgr.gibba043.dnkmem (mgr.34373) 9765 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.177470+0000 mon.c (mon.1) 2515 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.178004+0000 mgr.gibba043.dnkmem (mgr.34373) 9766 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.178688+0000 mon.c (mon.1) 2516 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.179625+0000 mgr.gibba043.dnkmem (mgr.34373) 9767 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.179679+0000 mgr.gibba043.dnkmem (mgr.34373) 9768 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.181029+0000 mgr.gibba043.dnkmem (mgr.34373) 9769 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.181337+0000 mgr.gibba043.dnkmem (mgr.34373) 9770 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.181907+0000 mon.c (mon.1) 2517 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:19.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.182354+0000 mgr.gibba043.dnkmem (mgr.34373) 9771 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:19.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.182390+0000 mgr.gibba043.dnkmem (mgr.34373) 9772 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:19.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: cephadm 2021-03-10T16:56:18.182492+0000 mgr.gibba043.dnkmem (mgr.34373) 9773 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:19.539 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:19 gibba043 bash[24019]: audit 2021-03-10T16:56:18.183247+0000 mon.c (mon.1) 2518 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:20.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:20 gibba003 bash[31385]: cluster 2021-03-10T16:56:19.306555+0000 mgr.gibba043.dnkmem (mgr.34373) 9774 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:20.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:20 gibba003 bash[32348]: cluster 2021-03-10T16:56:19.306555+0000 mgr.gibba043.dnkmem (mgr.34373) 9774 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:20 gibba043 bash[24019]: cluster 2021-03-10T16:56:19.306555+0000 mgr.gibba043.dnkmem (mgr.34373) 9774 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:22.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:22 gibba003 bash[31385]: cluster 2021-03-10T16:56:21.308226+0000 mgr.gibba043.dnkmem (mgr.34373) 9775 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:22.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:22 gibba003 bash[32348]: cluster 2021-03-10T16:56:21.308226+0000 mgr.gibba043.dnkmem (mgr.34373) 9775 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:22.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:22 gibba043 bash[24019]: cluster 2021-03-10T16:56:21.308226+0000 mgr.gibba043.dnkmem (mgr.34373) 9775 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:24 gibba003 bash[31385]: cluster 2021-03-10T16:56:23.309603+0000 mgr.gibba043.dnkmem (mgr.34373) 9776 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:24 gibba003 bash[32348]: cluster 2021-03-10T16:56:23.309603+0000 mgr.gibba043.dnkmem (mgr.34373) 9776 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:24 gibba043 bash[24019]: cluster 2021-03-10T16:56:23.309603+0000 mgr.gibba043.dnkmem (mgr.34373) 9776 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.979 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:56:25.208 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:56:25.209 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:56:25.209 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:56:25.209 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:56:25.210 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:56:25.210 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:56:25.210 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:56:25.210 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:56:25.211 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:56:25.211 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:56:25.211 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:56:25.211 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:56:25.212 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:56:25.212 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:56:25.212 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:56:25.212 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:56:25.212 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:56:25.213 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:56:25.213 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:56:25.213 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:56:25.213 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:56:25.455 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:56:25.456 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:56:25.456 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:25.456 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:56:25.456 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:56:25.457 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:25.457 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:56:25.457 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:56:25.457 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:56:25.458 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:56:25.458 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:56:25.459 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:56:25.459 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:56:25.460 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:56:25.460 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:56:26.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[31385]: audit 2021-03-10T16:56:24.971765+0000 mgr.gibba043.dnkmem (mgr.34373) 9777 : audit [DBG] from='client.60592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:26.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[31385]: audit 2021-03-10T16:56:25.195614+0000 mgr.gibba043.dnkmem (mgr.34373) 9778 : audit [DBG] from='client.60598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:26.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[31385]: cluster 2021-03-10T16:56:25.311115+0000 mgr.gibba043.dnkmem (mgr.34373) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:26.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[31385]: audit 2021-03-10T16:56:25.457772+0000 mon.c (mon.1) 2519 : audit [DBG] from='client.? 172.21.2.103:0/1837358746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[32348]: audit 2021-03-10T16:56:24.971765+0000 mgr.gibba043.dnkmem (mgr.34373) 9777 : audit [DBG] from='client.60592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[32348]: audit 2021-03-10T16:56:25.195614+0000 mgr.gibba043.dnkmem (mgr.34373) 9778 : audit [DBG] from='client.60598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:26.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[32348]: cluster 2021-03-10T16:56:25.311115+0000 mgr.gibba043.dnkmem (mgr.34373) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:26.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:26 gibba003 bash[32348]: audit 2021-03-10T16:56:25.457772+0000 mon.c (mon.1) 2519 : audit [DBG] from='client.? 172.21.2.103:0/1837358746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:26 gibba043 bash[24019]: audit 2021-03-10T16:56:24.971765+0000 mgr.gibba043.dnkmem (mgr.34373) 9777 : audit [DBG] from='client.60592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:26 gibba043 bash[24019]: audit 2021-03-10T16:56:25.195614+0000 mgr.gibba043.dnkmem (mgr.34373) 9778 : audit [DBG] from='client.60598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:26 gibba043 bash[24019]: cluster 2021-03-10T16:56:25.311115+0000 mgr.gibba043.dnkmem (mgr.34373) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:26.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:26 gibba043 bash[24019]: audit 2021-03-10T16:56:25.457772+0000 mon.c (mon.1) 2519 : audit [DBG] from='client.? 172.21.2.103:0/1837358746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:28.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:28 gibba003 bash[31385]: cluster 2021-03-10T16:56:27.312747+0000 mgr.gibba043.dnkmem (mgr.34373) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:28.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:28 gibba003 bash[32348]: cluster 2021-03-10T16:56:27.312747+0000 mgr.gibba043.dnkmem (mgr.34373) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:28.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:28 gibba043 bash[24019]: cluster 2021-03-10T16:56:27.312747+0000 mgr.gibba043.dnkmem (mgr.34373) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:30 gibba003 bash[31385]: cluster 2021-03-10T16:56:29.314548+0000 mgr.gibba043.dnkmem (mgr.34373) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:30 gibba003 bash[32348]: cluster 2021-03-10T16:56:29.314548+0000 mgr.gibba043.dnkmem (mgr.34373) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:30.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:30 gibba043 bash[24019]: cluster 2021-03-10T16:56:29.314548+0000 mgr.gibba043.dnkmem (mgr.34373) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:32.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:32 gibba003 bash[31385]: cluster 2021-03-10T16:56:31.316174+0000 mgr.gibba043.dnkmem (mgr.34373) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:32.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:32 gibba003 bash[32348]: cluster 2021-03-10T16:56:31.316174+0000 mgr.gibba043.dnkmem (mgr.34373) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:32.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:32 gibba043 bash[24019]: cluster 2021-03-10T16:56:31.316174+0000 mgr.gibba043.dnkmem (mgr.34373) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:34 gibba003 bash[31385]: cephadm 2021-03-10T16:56:33.196391+0000 mgr.gibba043.dnkmem (mgr.34373) 9783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:34 gibba003 bash[31385]: cluster 2021-03-10T16:56:33.317739+0000 mgr.gibba043.dnkmem (mgr.34373) 9784 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:34 gibba003 bash[32348]: cephadm 2021-03-10T16:56:33.196391+0000 mgr.gibba043.dnkmem (mgr.34373) 9783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:34.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:34 gibba003 bash[32348]: cluster 2021-03-10T16:56:33.317739+0000 mgr.gibba043.dnkmem (mgr.34373) 9784 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:34 gibba043 bash[24019]: cephadm 2021-03-10T16:56:33.196391+0000 mgr.gibba043.dnkmem (mgr.34373) 9783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:34.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:34 gibba043 bash[24019]: cluster 2021-03-10T16:56:33.317739+0000 mgr.gibba043.dnkmem (mgr.34373) 9784 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:36.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:36 gibba003 bash[31385]: cluster 2021-03-10T16:56:35.319168+0000 mgr.gibba043.dnkmem (mgr.34373) 9785 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:36.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:36 gibba003 bash[32348]: cluster 2021-03-10T16:56:35.319168+0000 mgr.gibba043.dnkmem (mgr.34373) 9785 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:36.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:36 gibba043 bash[24019]: cluster 2021-03-10T16:56:35.319168+0000 mgr.gibba043.dnkmem (mgr.34373) 9785 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:38 gibba003 bash[31385]: cluster 2021-03-10T16:56:37.320613+0000 mgr.gibba043.dnkmem (mgr.34373) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:38.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:38 gibba003 bash[32348]: cluster 2021-03-10T16:56:37.320613+0000 mgr.gibba043.dnkmem (mgr.34373) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:38.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:38 gibba043 bash[24019]: cluster 2021-03-10T16:56:37.320613+0000 mgr.gibba043.dnkmem (mgr.34373) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:40.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:40 gibba003 bash[31385]: cluster 2021-03-10T16:56:39.322371+0000 mgr.gibba043.dnkmem (mgr.34373) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:40 gibba003 bash[32348]: cluster 2021-03-10T16:56:39.322371+0000 mgr.gibba043.dnkmem (mgr.34373) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:40.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:40 gibba043 bash[24019]: cluster 2021-03-10T16:56:39.322371+0000 mgr.gibba043.dnkmem (mgr.34373) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:42.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:42 gibba003 bash[31385]: cluster 2021-03-10T16:56:41.324159+0000 mgr.gibba043.dnkmem (mgr.34373) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:42.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:42 gibba003 bash[32348]: cluster 2021-03-10T16:56:41.324159+0000 mgr.gibba043.dnkmem (mgr.34373) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:42.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:42 gibba043 bash[24019]: cluster 2021-03-10T16:56:41.324159+0000 mgr.gibba043.dnkmem (mgr.34373) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:44.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:44 gibba003 bash[31385]: cluster 2021-03-10T16:56:43.325833+0000 mgr.gibba043.dnkmem (mgr.34373) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:44.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:44 gibba003 bash[32348]: cluster 2021-03-10T16:56:43.325833+0000 mgr.gibba043.dnkmem (mgr.34373) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:44 gibba043 bash[24019]: cluster 2021-03-10T16:56:43.325833+0000 mgr.gibba043.dnkmem (mgr.34373) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:46 gibba003 bash[31385]: cluster 2021-03-10T16:56:45.327235+0000 mgr.gibba043.dnkmem (mgr.34373) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:46 gibba003 bash[32348]: cluster 2021-03-10T16:56:45.327235+0000 mgr.gibba043.dnkmem (mgr.34373) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:46 gibba043 bash[24019]: cluster 2021-03-10T16:56:45.327235+0000 mgr.gibba043.dnkmem (mgr.34373) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:48 gibba003 bash[31385]: cluster 2021-03-10T16:56:47.328835+0000 mgr.gibba043.dnkmem (mgr.34373) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:48 gibba003 bash[32348]: cluster 2021-03-10T16:56:47.328835+0000 mgr.gibba043.dnkmem (mgr.34373) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:48 gibba043 bash[24019]: cluster 2021-03-10T16:56:47.328835+0000 mgr.gibba043.dnkmem (mgr.34373) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:49.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:49 gibba003 bash[31385]: cephadm 2021-03-10T16:56:48.211879+0000 mgr.gibba043.dnkmem (mgr.34373) 9792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:49.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:49 gibba003 bash[32348]: cephadm 2021-03-10T16:56:48.211879+0000 mgr.gibba043.dnkmem (mgr.34373) 9792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:49.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:49 gibba043 bash[24019]: cephadm 2021-03-10T16:56:48.211879+0000 mgr.gibba043.dnkmem (mgr.34373) 9792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:56:50.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:50 gibba003 bash[31385]: cluster 2021-03-10T16:56:49.330644+0000 mgr.gibba043.dnkmem (mgr.34373) 9793 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:50.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:50 gibba003 bash[32348]: cluster 2021-03-10T16:56:49.330644+0000 mgr.gibba043.dnkmem (mgr.34373) 9793 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:50.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:50 gibba043 bash[24019]: cluster 2021-03-10T16:56:49.330644+0000 mgr.gibba043.dnkmem (mgr.34373) 9793 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:52.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:52 gibba003 bash[31385]: cluster 2021-03-10T16:56:51.332279+0000 mgr.gibba043.dnkmem (mgr.34373) 9794 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:52.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:52 gibba003 bash[32348]: cluster 2021-03-10T16:56:51.332279+0000 mgr.gibba043.dnkmem (mgr.34373) 9794 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:52.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:52 gibba043 bash[24019]: cluster 2021-03-10T16:56:51.332279+0000 mgr.gibba043.dnkmem (mgr.34373) 9794 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:54 gibba003 bash[31385]: cluster 2021-03-10T16:56:53.333648+0000 mgr.gibba043.dnkmem (mgr.34373) 9795 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:54 gibba003 bash[32348]: cluster 2021-03-10T16:56:53.333648+0000 mgr.gibba043.dnkmem (mgr.34373) 9795 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:54 gibba043 bash[24019]: cluster 2021-03-10T16:56:53.333648+0000 mgr.gibba043.dnkmem (mgr.34373) 9795 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:55.694 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:56:55.921 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:56:55.922 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:56:55.922 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:56:55.922 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:56:55.923 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:56:55.923 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:56:55.924 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:56:55.924 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:56:55.924 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:56:55.925 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:56:55.925 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:56:55.926 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:56:55.926 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:56:55.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:56:55.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:56:55.927 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:56:55.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:56:55.928 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:56:55.929 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:56:55.929 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:56:55.929 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:56:56.172 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:56:56.172 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:56:56.173 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:56.173 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:56:56.173 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:56:56.173 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:56.174 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:56:56.174 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:56:56.174 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:56:56.174 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:56:56.175 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:56:56.175 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:56:56.175 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:56:56.175 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:56:56.175 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:56:56.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:56 gibba003 bash[31385]: cluster 2021-03-10T16:56:55.335076+0000 mgr.gibba043.dnkmem (mgr.34373) 9796 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:56 gibba003 bash[31385]: audit 2021-03-10T16:56:56.174613+0000 mon.a (mon.0) 2018 : audit [DBG] from='client.? 172.21.2.103:0/3046856813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:56 gibba003 bash[32348]: cluster 2021-03-10T16:56:55.335076+0000 mgr.gibba043.dnkmem (mgr.34373) 9796 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:56 gibba003 bash[32348]: audit 2021-03-10T16:56:56.174613+0000 mon.a (mon.0) 2018 : audit [DBG] from='client.? 172.21.2.103:0/3046856813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:56.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:56 gibba043 bash[24019]: cluster 2021-03-10T16:56:55.335076+0000 mgr.gibba043.dnkmem (mgr.34373) 9796 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:56 gibba043 bash[24019]: audit 2021-03-10T16:56:56.174613+0000 mon.a (mon.0) 2018 : audit [DBG] from='client.? 172.21.2.103:0/3046856813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:57 gibba003 bash[31385]: audit 2021-03-10T16:56:55.686542+0000 mgr.gibba043.dnkmem (mgr.34373) 9797 : audit [DBG] from='client.50619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:57 gibba003 bash[31385]: audit 2021-03-10T16:56:55.909886+0000 mgr.gibba043.dnkmem (mgr.34373) 9798 : audit [DBG] from='client.50625 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:57 gibba003 bash[32348]: audit 2021-03-10T16:56:55.686542+0000 mgr.gibba043.dnkmem (mgr.34373) 9797 : audit [DBG] from='client.50619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:57 gibba003 bash[32348]: audit 2021-03-10T16:56:55.909886+0000 mgr.gibba043.dnkmem (mgr.34373) 9798 : audit [DBG] from='client.50625 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:57 gibba043 bash[24019]: audit 2021-03-10T16:56:55.686542+0000 mgr.gibba043.dnkmem (mgr.34373) 9797 : audit [DBG] from='client.50619 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:57 gibba043 bash[24019]: audit 2021-03-10T16:56:55.909886+0000 mgr.gibba043.dnkmem (mgr.34373) 9798 : audit [DBG] from='client.50625 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:58.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:56:58 gibba003 bash[31385]: cluster 2021-03-10T16:56:57.336701+0000 mgr.gibba043.dnkmem (mgr.34373) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:58.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:56:58 gibba003 bash[32348]: cluster 2021-03-10T16:56:57.336701+0000 mgr.gibba043.dnkmem (mgr.34373) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:58.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:56:58 gibba043 bash[24019]: cluster 2021-03-10T16:56:57.336701+0000 mgr.gibba043.dnkmem (mgr.34373) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:00 gibba003 bash[31385]: cluster 2021-03-10T16:56:59.338519+0000 mgr.gibba043.dnkmem (mgr.34373) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:00.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:00 gibba003 bash[32348]: cluster 2021-03-10T16:56:59.338519+0000 mgr.gibba043.dnkmem (mgr.34373) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:00 gibba043 bash[24019]: cluster 2021-03-10T16:56:59.338519+0000 mgr.gibba043.dnkmem (mgr.34373) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:02.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:02 gibba043 bash[24019]: cluster 2021-03-10T16:57:01.340327+0000 mgr.gibba043.dnkmem (mgr.34373) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:02.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:02 gibba003 bash[31385]: cluster 2021-03-10T16:57:01.340327+0000 mgr.gibba043.dnkmem (mgr.34373) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:02.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:02 gibba003 bash[32348]: cluster 2021-03-10T16:57:01.340327+0000 mgr.gibba043.dnkmem (mgr.34373) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:04 gibba043 bash[24019]: cephadm 2021-03-10T16:57:03.227918+0000 mgr.gibba043.dnkmem (mgr.34373) 9802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:04 gibba043 bash[24019]: cluster 2021-03-10T16:57:03.341820+0000 mgr.gibba043.dnkmem (mgr.34373) 9803 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:04 gibba003 bash[31385]: cephadm 2021-03-10T16:57:03.227918+0000 mgr.gibba043.dnkmem (mgr.34373) 9802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:04 gibba003 bash[31385]: cluster 2021-03-10T16:57:03.341820+0000 mgr.gibba043.dnkmem (mgr.34373) 9803 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:04 gibba003 bash[32348]: cephadm 2021-03-10T16:57:03.227918+0000 mgr.gibba043.dnkmem (mgr.34373) 9802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:04.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:04 gibba003 bash[32348]: cluster 2021-03-10T16:57:03.341820+0000 mgr.gibba043.dnkmem (mgr.34373) 9803 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:06 gibba043 bash[24019]: cluster 2021-03-10T16:57:05.343296+0000 mgr.gibba043.dnkmem (mgr.34373) 9804 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:06 gibba003 bash[31385]: cluster 2021-03-10T16:57:05.343296+0000 mgr.gibba043.dnkmem (mgr.34373) 9804 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:06 gibba003 bash[32348]: cluster 2021-03-10T16:57:05.343296+0000 mgr.gibba043.dnkmem (mgr.34373) 9804 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:08.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:08 gibba003 bash[31385]: cluster 2021-03-10T16:57:07.345028+0000 mgr.gibba043.dnkmem (mgr.34373) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:08.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:08 gibba003 bash[32348]: cluster 2021-03-10T16:57:07.345028+0000 mgr.gibba043.dnkmem (mgr.34373) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:08 gibba043 bash[24019]: cluster 2021-03-10T16:57:07.345028+0000 mgr.gibba043.dnkmem (mgr.34373) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:10 gibba003 bash[31385]: cluster 2021-03-10T16:57:09.346742+0000 mgr.gibba043.dnkmem (mgr.34373) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:10.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:10 gibba003 bash[32348]: cluster 2021-03-10T16:57:09.346742+0000 mgr.gibba043.dnkmem (mgr.34373) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:10.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:10 gibba043 bash[24019]: cluster 2021-03-10T16:57:09.346742+0000 mgr.gibba043.dnkmem (mgr.34373) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:12 gibba003 bash[31385]: cluster 2021-03-10T16:57:11.348550+0000 mgr.gibba043.dnkmem (mgr.34373) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:12 gibba003 bash[32348]: cluster 2021-03-10T16:57:11.348550+0000 mgr.gibba043.dnkmem (mgr.34373) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:12 gibba043 bash[24019]: cluster 2021-03-10T16:57:11.348550+0000 mgr.gibba043.dnkmem (mgr.34373) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[31385]: cluster 2021-03-10T16:57:13.350224+0000 mgr.gibba043.dnkmem (mgr.34373) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[31385]: audit 2021-03-10T16:57:13.910891+0000 mon.c (mon.1) 2520 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[31385]: audit 2021-03-10T16:57:13.912165+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[31385]: audit 2021-03-10T16:57:14.143977+0000 mon.c (mon.1) 2521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[31385]: audit 2021-03-10T16:57:14.145211+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:14.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[32348]: cluster 2021-03-10T16:57:13.350224+0000 mgr.gibba043.dnkmem (mgr.34373) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[32348]: audit 2021-03-10T16:57:13.910891+0000 mon.c (mon.1) 2520 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[32348]: audit 2021-03-10T16:57:13.912165+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[32348]: audit 2021-03-10T16:57:14.143977+0000 mon.c (mon.1) 2521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:14 gibba003 bash[32348]: audit 2021-03-10T16:57:14.145211+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:14.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:14 gibba043 bash[24019]: cluster 2021-03-10T16:57:13.350224+0000 mgr.gibba043.dnkmem (mgr.34373) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:14 gibba043 bash[24019]: audit 2021-03-10T16:57:13.910891+0000 mon.c (mon.1) 2520 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:14 gibba043 bash[24019]: audit 2021-03-10T16:57:13.912165+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:14 gibba043 bash[24019]: audit 2021-03-10T16:57:14.143977+0000 mon.c (mon.1) 2521 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:14 gibba043 bash[24019]: audit 2021-03-10T16:57:14.145211+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.437885+0000 mon.c (mon.1) 2522 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:57:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.438019+0000 mon.c (mon.1) 2523 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.438195+0000 mon.c (mon.1) 2524 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:57:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.438322+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:57:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.438390+0000 mon.c (mon.1) 2525 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.438762+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.438992+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:57:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[31385]: audit 2021-03-10T16:57:14.439287+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.437885+0000 mon.c (mon.1) 2522 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:57:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.438019+0000 mon.c (mon.1) 2523 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.438195+0000 mon.c (mon.1) 2524 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:57:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.438322+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:57:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.438390+0000 mon.c (mon.1) 2525 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.438762+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.438992+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:57:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:15 gibba003 bash[32348]: audit 2021-03-10T16:57:14.439287+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.437885+0000 mon.c (mon.1) 2522 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:57:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.438019+0000 mon.c (mon.1) 2523 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.438195+0000 mon.c (mon.1) 2524 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:57:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.438322+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:57:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.438390+0000 mon.c (mon.1) 2525 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.438762+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:57:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.438992+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:57:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:15 gibba043 bash[24019]: audit 2021-03-10T16:57:14.439287+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:57:16.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:16 gibba043 bash[24019]: cluster 2021-03-10T16:57:15.351724+0000 mgr.gibba043.dnkmem (mgr.34373) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:16.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:16 gibba003 bash[31385]: cluster 2021-03-10T16:57:15.351724+0000 mgr.gibba043.dnkmem (mgr.34373) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:16.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:16 gibba003 bash[32348]: cluster 2021-03-10T16:57:15.351724+0000 mgr.gibba043.dnkmem (mgr.34373) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:18.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:18 gibba003 bash[31385]: cluster 2021-03-10T16:57:17.353404+0000 mgr.gibba043.dnkmem (mgr.34373) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:18.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:18 gibba003 bash[32348]: cluster 2021-03-10T16:57:17.353404+0000 mgr.gibba043.dnkmem (mgr.34373) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:18.474 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:18 gibba043 bash[24019]: cluster 2021-03-10T16:57:17.353404+0000 mgr.gibba043.dnkmem (mgr.34373) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.244044+0000 mgr.gibba043.dnkmem (mgr.34373) 9811 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:57:19.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.244923+0000 mgr.gibba043.dnkmem (mgr.34373) 9812 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:57:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.458082+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:57:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.464359+0000 mgr.gibba043.dnkmem (mgr.34373) 9813 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.466778+0000 mgr.gibba043.dnkmem (mgr.34373) 9814 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:19.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.467055+0000 mon.c (mon.1) 2526 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.468161+0000 mgr.gibba043.dnkmem (mgr.34373) 9815 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.468200+0000 mgr.gibba043.dnkmem (mgr.34373) 9816 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.468908+0000 mon.c (mon.1) 2527 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.469297+0000 mgr.gibba043.dnkmem (mgr.34373) 9817 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.469334+0000 mgr.gibba043.dnkmem (mgr.34373) 9818 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.470209+0000 mon.c (mon.1) 2528 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.470661+0000 mgr.gibba043.dnkmem (mgr.34373) 9819 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.471273+0000 mon.c (mon.1) 2529 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.474397+0000 mon.c (mon.1) 2530 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:19 gibba043 bash[24019]: audit 2021-03-10T16:57:18.475697+0000 mon.c (mon.1) 2531 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.244044+0000 mgr.gibba043.dnkmem (mgr.34373) 9811 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:57:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.244923+0000 mgr.gibba043.dnkmem (mgr.34373) 9812 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:57:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.458082+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:57:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.464359+0000 mgr.gibba043.dnkmem (mgr.34373) 9813 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:19.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.466778+0000 mgr.gibba043.dnkmem (mgr.34373) 9814 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:19.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.467055+0000 mon.c (mon.1) 2526 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:19.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.468161+0000 mgr.gibba043.dnkmem (mgr.34373) 9815 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:19.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.468200+0000 mgr.gibba043.dnkmem (mgr.34373) 9816 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.468908+0000 mon.c (mon.1) 2527 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.469297+0000 mgr.gibba043.dnkmem (mgr.34373) 9817 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.469334+0000 mgr.gibba043.dnkmem (mgr.34373) 9818 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:19.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.470209+0000 mon.c (mon.1) 2528 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.470661+0000 mgr.gibba043.dnkmem (mgr.34373) 9819 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.471273+0000 mon.c (mon.1) 2529 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.474397+0000 mon.c (mon.1) 2530 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[31385]: audit 2021-03-10T16:57:18.475697+0000 mon.c (mon.1) 2531 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.244044+0000 mgr.gibba043.dnkmem (mgr.34373) 9811 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:57:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.244923+0000 mgr.gibba043.dnkmem (mgr.34373) 9812 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:57:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.458082+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:57:19.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.464359+0000 mgr.gibba043.dnkmem (mgr.34373) 9813 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:19.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.466778+0000 mgr.gibba043.dnkmem (mgr.34373) 9814 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:19.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.467055+0000 mon.c (mon.1) 2526 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:19.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.468161+0000 mgr.gibba043.dnkmem (mgr.34373) 9815 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:19.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.468200+0000 mgr.gibba043.dnkmem (mgr.34373) 9816 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:19.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.468908+0000 mon.c (mon.1) 2527 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.469297+0000 mgr.gibba043.dnkmem (mgr.34373) 9817 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:19.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.469334+0000 mgr.gibba043.dnkmem (mgr.34373) 9818 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:19.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.470209+0000 mon.c (mon.1) 2528 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.470661+0000 mgr.gibba043.dnkmem (mgr.34373) 9819 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:19.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.471273+0000 mon.c (mon.1) 2529 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.474397+0000 mon.c (mon.1) 2530 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:19.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:19 gibba003 bash[32348]: audit 2021-03-10T16:57:18.475697+0000 mon.c (mon.1) 2531 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:20.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.472289+0000 mgr.gibba043.dnkmem (mgr.34373) 9820 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:20.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.472327+0000 mgr.gibba043.dnkmem (mgr.34373) 9821 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:20.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.473464+0000 mgr.gibba043.dnkmem (mgr.34373) 9822 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:20.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.473807+0000 mgr.gibba043.dnkmem (mgr.34373) 9823 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:20.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.474745+0000 mgr.gibba043.dnkmem (mgr.34373) 9824 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:20.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.474786+0000 mgr.gibba043.dnkmem (mgr.34373) 9825 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:20.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cephadm 2021-03-10T16:57:18.474898+0000 mgr.gibba043.dnkmem (mgr.34373) 9826 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:20.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:20 gibba043 bash[24019]: cluster 2021-03-10T16:57:19.355228+0000 mgr.gibba043.dnkmem (mgr.34373) 9827 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:20.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.472289+0000 mgr.gibba043.dnkmem (mgr.34373) 9820 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:20.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.472327+0000 mgr.gibba043.dnkmem (mgr.34373) 9821 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:20.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.473464+0000 mgr.gibba043.dnkmem (mgr.34373) 9822 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.473807+0000 mgr.gibba043.dnkmem (mgr.34373) 9823 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.474745+0000 mgr.gibba043.dnkmem (mgr.34373) 9824 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.474786+0000 mgr.gibba043.dnkmem (mgr.34373) 9825 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cephadm 2021-03-10T16:57:18.474898+0000 mgr.gibba043.dnkmem (mgr.34373) 9826 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:20.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[31385]: cluster 2021-03-10T16:57:19.355228+0000 mgr.gibba043.dnkmem (mgr.34373) 9827 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:20.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.472289+0000 mgr.gibba043.dnkmem (mgr.34373) 9820 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:20.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.472327+0000 mgr.gibba043.dnkmem (mgr.34373) 9821 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:20.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.473464+0000 mgr.gibba043.dnkmem (mgr.34373) 9822 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:20.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.473807+0000 mgr.gibba043.dnkmem (mgr.34373) 9823 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:20.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.474745+0000 mgr.gibba043.dnkmem (mgr.34373) 9824 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:20.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.474786+0000 mgr.gibba043.dnkmem (mgr.34373) 9825 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:20.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cephadm 2021-03-10T16:57:18.474898+0000 mgr.gibba043.dnkmem (mgr.34373) 9826 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:20.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:20 gibba003 bash[32348]: cluster 2021-03-10T16:57:19.355228+0000 mgr.gibba043.dnkmem (mgr.34373) 9827 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:21.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:21 gibba003 bash[31385]: cluster 2021-03-10T16:57:21.356950+0000 mgr.gibba043.dnkmem (mgr.34373) 9828 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:21 gibba003 bash[32348]: cluster 2021-03-10T16:57:21.356950+0000 mgr.gibba043.dnkmem (mgr.34373) 9828 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:21 gibba043 bash[24019]: cluster 2021-03-10T16:57:21.356950+0000 mgr.gibba043.dnkmem (mgr.34373) 9828 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:24.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:24 gibba003 bash[31385]: cluster 2021-03-10T16:57:23.358499+0000 mgr.gibba043.dnkmem (mgr.34373) 9829 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:24.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:24 gibba003 bash[32348]: cluster 2021-03-10T16:57:23.358499+0000 mgr.gibba043.dnkmem (mgr.34373) 9829 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:24.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:24 gibba043 bash[24019]: cluster 2021-03-10T16:57:23.358499+0000 mgr.gibba043.dnkmem (mgr.34373) 9829 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.415 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:57:26.656 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:57:26.657 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:57:26.657 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:57:26.657 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:57:26.657 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:57:26.658 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:57:26.658 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:57:26.658 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:57:26.658 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:57:26.659 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:57:26.659 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:57:26.659 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:57:26.659 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:57:26.659 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:57:26.660 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:57:26.660 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:57:26.660 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:57:26.660 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:57:26.660 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:57:26.661 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:57:26.661 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:57:26.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:26 gibba003 bash[31385]: cluster 2021-03-10T16:57:25.360027+0000 mgr.gibba043.dnkmem (mgr.34373) 9830 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:26 gibba003 bash[32348]: cluster 2021-03-10T16:57:25.360027+0000 mgr.gibba043.dnkmem (mgr.34373) 9830 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:26 gibba043 bash[24019]: cluster 2021-03-10T16:57:25.360027+0000 mgr.gibba043.dnkmem (mgr.34373) 9830 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.906 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:57:26.907 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:57:26.907 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:26.907 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:57:26.907 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:57:26.908 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:26.908 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:57:26.908 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:57:26.908 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:57:26.909 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:57:26.909 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:57:26.909 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:57:26.909 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:57:26.909 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:57:26.910 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:57:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:27 gibba003 bash[31385]: audit 2021-03-10T16:57:26.407061+0000 mgr.gibba043.dnkmem (mgr.34373) 9831 : audit [DBG] from='client.60628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:27 gibba003 bash[31385]: audit 2021-03-10T16:57:26.908805+0000 mon.c (mon.1) 2532 : audit [DBG] from='client.? 172.21.2.103:0/829331021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:27.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:27 gibba003 bash[32348]: audit 2021-03-10T16:57:26.407061+0000 mgr.gibba043.dnkmem (mgr.34373) 9831 : audit [DBG] from='client.60628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:27 gibba003 bash[32348]: audit 2021-03-10T16:57:26.908805+0000 mon.c (mon.1) 2532 : audit [DBG] from='client.? 172.21.2.103:0/829331021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:27 gibba043 bash[24019]: audit 2021-03-10T16:57:26.407061+0000 mgr.gibba043.dnkmem (mgr.34373) 9831 : audit [DBG] from='client.60628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:27 gibba043 bash[24019]: audit 2021-03-10T16:57:26.908805+0000 mon.c (mon.1) 2532 : audit [DBG] from='client.? 172.21.2.103:0/829331021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:28.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:28 gibba043 bash[24019]: audit 2021-03-10T16:57:26.645259+0000 mgr.gibba043.dnkmem (mgr.34373) 9832 : audit [DBG] from='client.50643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:28.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:28 gibba043 bash[24019]: cluster 2021-03-10T16:57:27.361737+0000 mgr.gibba043.dnkmem (mgr.34373) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:28 gibba003 bash[31385]: audit 2021-03-10T16:57:26.645259+0000 mgr.gibba043.dnkmem (mgr.34373) 9832 : audit [DBG] from='client.50643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:28 gibba003 bash[31385]: cluster 2021-03-10T16:57:27.361737+0000 mgr.gibba043.dnkmem (mgr.34373) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:28.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:28 gibba003 bash[32348]: audit 2021-03-10T16:57:26.645259+0000 mgr.gibba043.dnkmem (mgr.34373) 9832 : audit [DBG] from='client.50643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:28.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:28 gibba003 bash[32348]: cluster 2021-03-10T16:57:27.361737+0000 mgr.gibba043.dnkmem (mgr.34373) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:30.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:30 gibba043 bash[24019]: cluster 2021-03-10T16:57:29.363453+0000 mgr.gibba043.dnkmem (mgr.34373) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:30.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:30 gibba003 bash[31385]: cluster 2021-03-10T16:57:29.363453+0000 mgr.gibba043.dnkmem (mgr.34373) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:30.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:30 gibba003 bash[32348]: cluster 2021-03-10T16:57:29.363453+0000 mgr.gibba043.dnkmem (mgr.34373) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:32 gibba043 bash[24019]: cluster 2021-03-10T16:57:31.365231+0000 mgr.gibba043.dnkmem (mgr.34373) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:32.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:32 gibba003 bash[31385]: cluster 2021-03-10T16:57:31.365231+0000 mgr.gibba043.dnkmem (mgr.34373) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:32.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:32 gibba003 bash[32348]: cluster 2021-03-10T16:57:31.365231+0000 mgr.gibba043.dnkmem (mgr.34373) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:34.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:34 gibba043 bash[24019]: cluster 2021-03-10T16:57:33.366737+0000 mgr.gibba043.dnkmem (mgr.34373) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:34.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:34 gibba003 bash[31385]: cluster 2021-03-10T16:57:33.366737+0000 mgr.gibba043.dnkmem (mgr.34373) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:34.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:34 gibba003 bash[32348]: cluster 2021-03-10T16:57:33.366737+0000 mgr.gibba043.dnkmem (mgr.34373) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:35 gibba043 bash[24019]: cephadm 2021-03-10T16:57:33.490367+0000 mgr.gibba043.dnkmem (mgr.34373) 9837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:35 gibba003 bash[31385]: cephadm 2021-03-10T16:57:33.490367+0000 mgr.gibba043.dnkmem (mgr.34373) 9837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:35.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:35 gibba003 bash[32348]: cephadm 2021-03-10T16:57:33.490367+0000 mgr.gibba043.dnkmem (mgr.34373) 9837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:36 gibba043 bash[24019]: cluster 2021-03-10T16:57:35.368325+0000 mgr.gibba043.dnkmem (mgr.34373) 9838 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:36.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:36 gibba003 bash[31385]: cluster 2021-03-10T16:57:35.368325+0000 mgr.gibba043.dnkmem (mgr.34373) 9838 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:36.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:36 gibba003 bash[32348]: cluster 2021-03-10T16:57:35.368325+0000 mgr.gibba043.dnkmem (mgr.34373) 9838 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:38.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:38 gibba003 bash[31385]: cluster 2021-03-10T16:57:37.369941+0000 mgr.gibba043.dnkmem (mgr.34373) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:38.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:38 gibba003 bash[32348]: cluster 2021-03-10T16:57:37.369941+0000 mgr.gibba043.dnkmem (mgr.34373) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:38.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:38 gibba043 bash[24019]: cluster 2021-03-10T16:57:37.369941+0000 mgr.gibba043.dnkmem (mgr.34373) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:40.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:40 gibba003 bash[31385]: cluster 2021-03-10T16:57:39.371823+0000 mgr.gibba043.dnkmem (mgr.34373) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:40 gibba003 bash[32348]: cluster 2021-03-10T16:57:39.371823+0000 mgr.gibba043.dnkmem (mgr.34373) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:40.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:40 gibba043 bash[24019]: cluster 2021-03-10T16:57:39.371823+0000 mgr.gibba043.dnkmem (mgr.34373) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:42.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:42 gibba043 bash[24019]: cluster 2021-03-10T16:57:41.373554+0000 mgr.gibba043.dnkmem (mgr.34373) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:42.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:42 gibba003 bash[31385]: cluster 2021-03-10T16:57:41.373554+0000 mgr.gibba043.dnkmem (mgr.34373) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:42.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:42 gibba003 bash[32348]: cluster 2021-03-10T16:57:41.373554+0000 mgr.gibba043.dnkmem (mgr.34373) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:44.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:44 gibba043 bash[24019]: cluster 2021-03-10T16:57:43.375165+0000 mgr.gibba043.dnkmem (mgr.34373) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:44.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:44 gibba003 bash[31385]: cluster 2021-03-10T16:57:43.375165+0000 mgr.gibba043.dnkmem (mgr.34373) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:44.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:44 gibba003 bash[32348]: cluster 2021-03-10T16:57:43.375165+0000 mgr.gibba043.dnkmem (mgr.34373) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:46.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:46 gibba043 bash[24019]: cluster 2021-03-10T16:57:45.376690+0000 mgr.gibba043.dnkmem (mgr.34373) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:46.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:46 gibba003 bash[31385]: cluster 2021-03-10T16:57:45.376690+0000 mgr.gibba043.dnkmem (mgr.34373) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:46.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:46 gibba003 bash[32348]: cluster 2021-03-10T16:57:45.376690+0000 mgr.gibba043.dnkmem (mgr.34373) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:48.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:48 gibba003 bash[31385]: cluster 2021-03-10T16:57:47.378329+0000 mgr.gibba043.dnkmem (mgr.34373) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:48.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:48 gibba003 bash[32348]: cluster 2021-03-10T16:57:47.378329+0000 mgr.gibba043.dnkmem (mgr.34373) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:48.506 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:48 gibba043 bash[24019]: cluster 2021-03-10T16:57:47.378329+0000 mgr.gibba043.dnkmem (mgr.34373) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:50 gibba043 bash[24019]: cephadm 2021-03-10T16:57:48.506475+0000 mgr.gibba043.dnkmem (mgr.34373) 9845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:50.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:50 gibba043 bash[24019]: cluster 2021-03-10T16:57:49.380112+0000 mgr.gibba043.dnkmem (mgr.34373) 9846 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:50 gibba003 bash[31385]: cephadm 2021-03-10T16:57:48.506475+0000 mgr.gibba043.dnkmem (mgr.34373) 9845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:50.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:50 gibba003 bash[31385]: cluster 2021-03-10T16:57:49.380112+0000 mgr.gibba043.dnkmem (mgr.34373) 9846 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:50 gibba003 bash[32348]: cephadm 2021-03-10T16:57:48.506475+0000 mgr.gibba043.dnkmem (mgr.34373) 9845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:57:50.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:50 gibba003 bash[32348]: cluster 2021-03-10T16:57:49.380112+0000 mgr.gibba043.dnkmem (mgr.34373) 9846 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:52.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:52 gibba043 bash[24019]: cluster 2021-03-10T16:57:51.381705+0000 mgr.gibba043.dnkmem (mgr.34373) 9847 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:52.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:52 gibba003 bash[31385]: cluster 2021-03-10T16:57:51.381705+0000 mgr.gibba043.dnkmem (mgr.34373) 9847 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:52.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:52 gibba003 bash[32348]: cluster 2021-03-10T16:57:51.381705+0000 mgr.gibba043.dnkmem (mgr.34373) 9847 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:54 gibba043 bash[24019]: cluster 2021-03-10T16:57:53.383208+0000 mgr.gibba043.dnkmem (mgr.34373) 9848 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:54 gibba003 bash[31385]: cluster 2021-03-10T16:57:53.383208+0000 mgr.gibba043.dnkmem (mgr.34373) 9848 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:54 gibba003 bash[32348]: cluster 2021-03-10T16:57:53.383208+0000 mgr.gibba043.dnkmem (mgr.34373) 9848 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:56.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:56 gibba043 bash[24019]: cluster 2021-03-10T16:57:55.384727+0000 mgr.gibba043.dnkmem (mgr.34373) 9849 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:56.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:56 gibba003 bash[31385]: cluster 2021-03-10T16:57:55.384727+0000 mgr.gibba043.dnkmem (mgr.34373) 9849 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:56.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:56 gibba003 bash[32348]: cluster 2021-03-10T16:57:55.384727+0000 mgr.gibba043.dnkmem (mgr.34373) 9849 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:57.189 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:57:57.416 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:57:57.417 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:57:57.417 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:57:57.417 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:57:57.417 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:57:57.418 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:57:57.418 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:57:57.418 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:57:57.418 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:57:57.419 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:57:57.419 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:57:57.419 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:57:57.419 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:57:57.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:57:57.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:57:57.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:57:57.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:57:57.421 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:57:57.421 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:57:57.421 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:57:57.421 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:57:57.664 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:57:57.664 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:57:57.664 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:57.665 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:57:57.665 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:57:57.665 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:57.665 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:57:57.665 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:57:57.666 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:57:57.666 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:57:57.666 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:57:57.666 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:57:57.667 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:57:57.667 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:57:57.667 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:57:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[31385]: audit 2021-03-10T16:57:57.181058+0000 mgr.gibba043.dnkmem (mgr.34373) 9850 : audit [DBG] from='client.60646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[31385]: cluster 2021-03-10T16:57:57.386139+0000 mgr.gibba043.dnkmem (mgr.34373) 9851 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:58.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[31385]: audit 2021-03-10T16:57:57.404888+0000 mgr.gibba043.dnkmem (mgr.34373) 9852 : audit [DBG] from='client.60652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:58.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[31385]: audit 2021-03-10T16:57:57.666176+0000 mon.c (mon.1) 2533 : audit [DBG] from='client.? 172.21.2.103:0/1313754500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:58.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[32348]: audit 2021-03-10T16:57:57.181058+0000 mgr.gibba043.dnkmem (mgr.34373) 9850 : audit [DBG] from='client.60646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:58.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[32348]: cluster 2021-03-10T16:57:57.386139+0000 mgr.gibba043.dnkmem (mgr.34373) 9851 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:58.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[32348]: audit 2021-03-10T16:57:57.404888+0000 mgr.gibba043.dnkmem (mgr.34373) 9852 : audit [DBG] from='client.60652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:58.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:57:58 gibba003 bash[32348]: audit 2021-03-10T16:57:57.666176+0000 mon.c (mon.1) 2533 : audit [DBG] from='client.? 172.21.2.103:0/1313754500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:58.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:58 gibba043 bash[24019]: audit 2021-03-10T16:57:57.181058+0000 mgr.gibba043.dnkmem (mgr.34373) 9850 : audit [DBG] from='client.60646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:58 gibba043 bash[24019]: cluster 2021-03-10T16:57:57.386139+0000 mgr.gibba043.dnkmem (mgr.34373) 9851 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:58 gibba043 bash[24019]: audit 2021-03-10T16:57:57.404888+0000 mgr.gibba043.dnkmem (mgr.34373) 9852 : audit [DBG] from='client.60652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:57:58 gibba043 bash[24019]: audit 2021-03-10T16:57:57.666176+0000 mon.c (mon.1) 2533 : audit [DBG] from='client.? 172.21.2.103:0/1313754500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:00.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:00 gibba043 bash[24019]: cluster 2021-03-10T16:57:59.387987+0000 mgr.gibba043.dnkmem (mgr.34373) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:00 gibba003 bash[31385]: cluster 2021-03-10T16:57:59.387987+0000 mgr.gibba043.dnkmem (mgr.34373) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:00.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:00 gibba003 bash[32348]: cluster 2021-03-10T16:57:59.387987+0000 mgr.gibba043.dnkmem (mgr.34373) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:02.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:02 gibba043 bash[24019]: cluster 2021-03-10T16:58:01.389511+0000 mgr.gibba043.dnkmem (mgr.34373) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:02.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:02 gibba003 bash[31385]: cluster 2021-03-10T16:58:01.389511+0000 mgr.gibba043.dnkmem (mgr.34373) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:02.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:02 gibba003 bash[32348]: cluster 2021-03-10T16:58:01.389511+0000 mgr.gibba043.dnkmem (mgr.34373) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:04.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:04 gibba043 bash[24019]: cluster 2021-03-10T16:58:03.391253+0000 mgr.gibba043.dnkmem (mgr.34373) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:04 gibba003 bash[31385]: cluster 2021-03-10T16:58:03.391253+0000 mgr.gibba043.dnkmem (mgr.34373) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:04.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:04 gibba003 bash[32348]: cluster 2021-03-10T16:58:03.391253+0000 mgr.gibba043.dnkmem (mgr.34373) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:05 gibba043 bash[24019]: cephadm 2021-03-10T16:58:03.513886+0000 mgr.gibba043.dnkmem (mgr.34373) 9856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:05 gibba003 bash[31385]: cephadm 2021-03-10T16:58:03.513886+0000 mgr.gibba043.dnkmem (mgr.34373) 9856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:05 gibba003 bash[32348]: cephadm 2021-03-10T16:58:03.513886+0000 mgr.gibba043.dnkmem (mgr.34373) 9856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:06.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:06 gibba043 bash[24019]: cluster 2021-03-10T16:58:05.392905+0000 mgr.gibba043.dnkmem (mgr.34373) 9857 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:06.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:06 gibba003 bash[31385]: cluster 2021-03-10T16:58:05.392905+0000 mgr.gibba043.dnkmem (mgr.34373) 9857 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:06.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:06 gibba003 bash[32348]: cluster 2021-03-10T16:58:05.392905+0000 mgr.gibba043.dnkmem (mgr.34373) 9857 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:08.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:08 gibba043 bash[24019]: cluster 2021-03-10T16:58:07.394674+0000 mgr.gibba043.dnkmem (mgr.34373) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:08 gibba003 bash[31385]: cluster 2021-03-10T16:58:07.394674+0000 mgr.gibba043.dnkmem (mgr.34373) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:08.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:08 gibba003 bash[32348]: cluster 2021-03-10T16:58:07.394674+0000 mgr.gibba043.dnkmem (mgr.34373) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:10.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:10 gibba043 bash[24019]: cluster 2021-03-10T16:58:09.396647+0000 mgr.gibba043.dnkmem (mgr.34373) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:10.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:10 gibba003 bash[31385]: cluster 2021-03-10T16:58:09.396647+0000 mgr.gibba043.dnkmem (mgr.34373) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:10.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:10 gibba003 bash[32348]: cluster 2021-03-10T16:58:09.396647+0000 mgr.gibba043.dnkmem (mgr.34373) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:12.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:12 gibba043 bash[24019]: cluster 2021-03-10T16:58:11.398445+0000 mgr.gibba043.dnkmem (mgr.34373) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:12.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:12 gibba003 bash[31385]: cluster 2021-03-10T16:58:11.398445+0000 mgr.gibba043.dnkmem (mgr.34373) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:12.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:12 gibba003 bash[32348]: cluster 2021-03-10T16:58:11.398445+0000 mgr.gibba043.dnkmem (mgr.34373) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: cluster 2021-03-10T16:58:13.400100+0000 mgr.gibba043.dnkmem (mgr.34373) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:13.918384+0000 mon.c (mon.1) 2534 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:13.919513+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.150662+0000 mon.c (mon.1) 2535 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.151782+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.445969+0000 mon.c (mon.1) 2536 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:58:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.446932+0000 mon.c (mon.1) 2537 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.447211+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:58:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.447924+0000 mon.c (mon.1) 2538 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.448472+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.448977+0000 mon.c (mon.1) 2539 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.449547+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:14 gibba043 bash[24019]: audit 2021-03-10T16:58:14.450630+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: cluster 2021-03-10T16:58:13.400100+0000 mgr.gibba043.dnkmem (mgr.34373) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:13.918384+0000 mon.c (mon.1) 2534 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:13.919513+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.150662+0000 mon.c (mon.1) 2535 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.151782+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.445969+0000 mon.c (mon.1) 2536 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:58:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.446932+0000 mon.c (mon.1) 2537 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.447211+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:58:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.447924+0000 mon.c (mon.1) 2538 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.448472+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.448977+0000 mon.c (mon.1) 2539 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.449547+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[31385]: audit 2021-03-10T16:58:14.450630+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: cluster 2021-03-10T16:58:13.400100+0000 mgr.gibba043.dnkmem (mgr.34373) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:13.918384+0000 mon.c (mon.1) 2534 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:13.919513+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.150662+0000 mon.c (mon.1) 2535 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.151782+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.445969+0000 mon.c (mon.1) 2536 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:58:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.446932+0000 mon.c (mon.1) 2537 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.447211+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:58:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.447924+0000 mon.c (mon.1) 2538 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.448472+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.448977+0000 mon.c (mon.1) 2539 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.449547+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:14 gibba003 bash[32348]: audit 2021-03-10T16:58:14.450630+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:16.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:16 gibba043 bash[24019]: cluster 2021-03-10T16:58:15.401726+0000 mgr.gibba043.dnkmem (mgr.34373) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:16.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:16 gibba003 bash[31385]: cluster 2021-03-10T16:58:15.401726+0000 mgr.gibba043.dnkmem (mgr.34373) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:16.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:16 gibba003 bash[32348]: cluster 2021-03-10T16:58:15.401726+0000 mgr.gibba043.dnkmem (mgr.34373) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:18.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:18 gibba043 bash[24019]: cluster 2021-03-10T16:58:17.403281+0000 mgr.gibba043.dnkmem (mgr.34373) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:18.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:18 gibba003 bash[31385]: cluster 2021-03-10T16:58:17.403281+0000 mgr.gibba043.dnkmem (mgr.34373) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:18.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:18 gibba003 bash[32348]: cluster 2021-03-10T16:58:17.403281+0000 mgr.gibba043.dnkmem (mgr.34373) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:20.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.528004+0000 mgr.gibba043.dnkmem (mgr.34373) 9864 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:58:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.528316+0000 mgr.gibba043.dnkmem (mgr.34373) 9865 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:58:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.738129+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:58:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.739446+0000 mgr.gibba043.dnkmem (mgr.34373) 9866 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.741242+0000 mgr.gibba043.dnkmem (mgr.34373) 9867 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.741791+0000 mon.c (mon.1) 2540 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.742510+0000 mgr.gibba043.dnkmem (mgr.34373) 9868 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.742573+0000 mgr.gibba043.dnkmem (mgr.34373) 9869 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.743361+0000 mon.c (mon.1) 2541 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.743755+0000 mgr.gibba043.dnkmem (mgr.34373) 9870 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.743815+0000 mgr.gibba043.dnkmem (mgr.34373) 9871 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.744707+0000 mon.c (mon.1) 2542 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.744744+0000 mgr.gibba043.dnkmem (mgr.34373) 9872 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.745683+0000 mon.c (mon.1) 2543 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.745958+0000 mgr.gibba043.dnkmem (mgr.34373) 9873 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.746019+0000 mgr.gibba043.dnkmem (mgr.34373) 9874 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.747434+0000 mgr.gibba043.dnkmem (mgr.34373) 9875 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.747815+0000 mgr.gibba043.dnkmem (mgr.34373) 9876 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.748197+0000 mon.c (mon.1) 2544 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.749302+0000 mgr.gibba043.dnkmem (mgr.34373) 9877 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.749369+0000 mgr.gibba043.dnkmem (mgr.34373) 9878 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cephadm 2021-03-10T16:58:18.749513+0000 mgr.gibba043.dnkmem (mgr.34373) 9879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: audit 2021-03-10T16:58:18.749911+0000 mon.c (mon.1) 2545 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:19 gibba043 bash[24019]: cluster 2021-03-10T16:58:19.405172+0000 mgr.gibba043.dnkmem (mgr.34373) 9880 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.528004+0000 mgr.gibba043.dnkmem (mgr.34373) 9864 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:58:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.528316+0000 mgr.gibba043.dnkmem (mgr.34373) 9865 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:58:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.738129+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:58:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.739446+0000 mgr.gibba043.dnkmem (mgr.34373) 9866 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.741242+0000 mgr.gibba043.dnkmem (mgr.34373) 9867 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.741791+0000 mon.c (mon.1) 2540 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.742510+0000 mgr.gibba043.dnkmem (mgr.34373) 9868 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.742573+0000 mgr.gibba043.dnkmem (mgr.34373) 9869 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.743361+0000 mon.c (mon.1) 2541 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.743755+0000 mgr.gibba043.dnkmem (mgr.34373) 9870 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.743815+0000 mgr.gibba043.dnkmem (mgr.34373) 9871 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:20.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.744707+0000 mon.c (mon.1) 2542 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.744744+0000 mgr.gibba043.dnkmem (mgr.34373) 9872 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.745683+0000 mon.c (mon.1) 2543 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.745958+0000 mgr.gibba043.dnkmem (mgr.34373) 9873 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.746019+0000 mgr.gibba043.dnkmem (mgr.34373) 9874 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.747434+0000 mgr.gibba043.dnkmem (mgr.34373) 9875 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.747815+0000 mgr.gibba043.dnkmem (mgr.34373) 9876 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.748197+0000 mon.c (mon.1) 2544 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.749302+0000 mgr.gibba043.dnkmem (mgr.34373) 9877 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.749369+0000 mgr.gibba043.dnkmem (mgr.34373) 9878 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:20.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.528004+0000 mgr.gibba043.dnkmem (mgr.34373) 9864 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:58:20.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.528316+0000 mgr.gibba043.dnkmem (mgr.34373) 9865 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:58:20.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.738129+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:58:20.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.739446+0000 mgr.gibba043.dnkmem (mgr.34373) 9866 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:20.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.741242+0000 mgr.gibba043.dnkmem (mgr.34373) 9867 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:20.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.741791+0000 mon.c (mon.1) 2540 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:20.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.742510+0000 mgr.gibba043.dnkmem (mgr.34373) 9868 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.742573+0000 mgr.gibba043.dnkmem (mgr.34373) 9869 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.743361+0000 mon.c (mon.1) 2541 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.743755+0000 mgr.gibba043.dnkmem (mgr.34373) 9870 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.743815+0000 mgr.gibba043.dnkmem (mgr.34373) 9871 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.744707+0000 mon.c (mon.1) 2542 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.744744+0000 mgr.gibba043.dnkmem (mgr.34373) 9872 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.745683+0000 mon.c (mon.1) 2543 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.745958+0000 mgr.gibba043.dnkmem (mgr.34373) 9873 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.746019+0000 mgr.gibba043.dnkmem (mgr.34373) 9874 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.747434+0000 mgr.gibba043.dnkmem (mgr.34373) 9875 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.747815+0000 mgr.gibba043.dnkmem (mgr.34373) 9876 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.748197+0000 mon.c (mon.1) 2544 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.749302+0000 mgr.gibba043.dnkmem (mgr.34373) 9877 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:20.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.749369+0000 mgr.gibba043.dnkmem (mgr.34373) 9878 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:20.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cephadm 2021-03-10T16:58:18.749513+0000 mgr.gibba043.dnkmem (mgr.34373) 9879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:20.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: audit 2021-03-10T16:58:18.749911+0000 mon.c (mon.1) 2545 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[31385]: cluster 2021-03-10T16:58:19.405172+0000 mgr.gibba043.dnkmem (mgr.34373) 9880 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:20.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cephadm 2021-03-10T16:58:18.749513+0000 mgr.gibba043.dnkmem (mgr.34373) 9879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:20.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: audit 2021-03-10T16:58:18.749911+0000 mon.c (mon.1) 2545 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:20.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:19 gibba003 bash[32348]: cluster 2021-03-10T16:58:19.405172+0000 mgr.gibba043.dnkmem (mgr.34373) 9880 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:22.769 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:22 gibba043 bash[24019]: cluster 2021-03-10T16:58:21.406950+0000 mgr.gibba043.dnkmem (mgr.34373) 9881 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:22.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:22 gibba003 bash[31385]: cluster 2021-03-10T16:58:21.406950+0000 mgr.gibba043.dnkmem (mgr.34373) 9881 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:22.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:22 gibba003 bash[32348]: cluster 2021-03-10T16:58:21.406950+0000 mgr.gibba043.dnkmem (mgr.34373) 9881 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:24 gibba043 bash[24019]: cluster 2021-03-10T16:58:23.408745+0000 mgr.gibba043.dnkmem (mgr.34373) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:24 gibba003 bash[31385]: cluster 2021-03-10T16:58:23.408745+0000 mgr.gibba043.dnkmem (mgr.34373) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:24 gibba003 bash[32348]: cluster 2021-03-10T16:58:23.408745+0000 mgr.gibba043.dnkmem (mgr.34373) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:26.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:26 gibba043 bash[24019]: cluster 2021-03-10T16:58:25.410077+0000 mgr.gibba043.dnkmem (mgr.34373) 9883 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:26.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:26 gibba003 bash[31385]: cluster 2021-03-10T16:58:25.410077+0000 mgr.gibba043.dnkmem (mgr.34373) 9883 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:26.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:26 gibba003 bash[32348]: cluster 2021-03-10T16:58:25.410077+0000 mgr.gibba043.dnkmem (mgr.34373) 9883 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:27.904 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:58:28.160 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:58:28.160 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:58:28.160 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:58:28.161 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:58:28.161 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:58:28.161 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:58:28.161 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:58:28.162 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:58:28.162 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:58:28.162 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:58:28.162 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:58:28.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:58:28.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:58:28.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:58:28.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:58:28.163 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:58:28.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:58:28.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:58:28.164 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:58:28.164 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:58:28.165 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:58:28.419 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:58:28.419 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:58:28.420 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:28.420 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:58:28.420 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:58:28.420 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:28.421 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:58:28.421 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:58:28.421 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:58:28.421 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:58:28.422 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:58:28.422 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:58:28.422 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:58:28.422 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:58:28.423 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:58:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:28 gibba043 bash[24019]: cluster 2021-03-10T16:58:27.411758+0000 mgr.gibba043.dnkmem (mgr.34373) 9884 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:28.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:28 gibba003 bash[31385]: cluster 2021-03-10T16:58:27.411758+0000 mgr.gibba043.dnkmem (mgr.34373) 9884 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:28.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:28 gibba003 bash[32348]: cluster 2021-03-10T16:58:27.411758+0000 mgr.gibba043.dnkmem (mgr.34373) 9884 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:29 gibba043 bash[24019]: audit 2021-03-10T16:58:27.896240+0000 mgr.gibba043.dnkmem (mgr.34373) 9885 : audit [DBG] from='client.60664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:29.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:29 gibba043 bash[24019]: audit 2021-03-10T16:58:28.121028+0000 mgr.gibba043.dnkmem (mgr.34373) 9886 : audit [DBG] from='client.60670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:29.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:29 gibba043 bash[24019]: audit 2021-03-10T16:58:28.421281+0000 mon.c (mon.1) 2546 : audit [DBG] from='client.? 172.21.2.103:0/1504846603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:29 gibba003 bash[31385]: audit 2021-03-10T16:58:27.896240+0000 mgr.gibba043.dnkmem (mgr.34373) 9885 : audit [DBG] from='client.60664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:29 gibba003 bash[31385]: audit 2021-03-10T16:58:28.121028+0000 mgr.gibba043.dnkmem (mgr.34373) 9886 : audit [DBG] from='client.60670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:29 gibba003 bash[31385]: audit 2021-03-10T16:58:28.421281+0000 mon.c (mon.1) 2546 : audit [DBG] from='client.? 172.21.2.103:0/1504846603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:29 gibba003 bash[32348]: audit 2021-03-10T16:58:27.896240+0000 mgr.gibba043.dnkmem (mgr.34373) 9885 : audit [DBG] from='client.60664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:29 gibba003 bash[32348]: audit 2021-03-10T16:58:28.121028+0000 mgr.gibba043.dnkmem (mgr.34373) 9886 : audit [DBG] from='client.60670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:29.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:29 gibba003 bash[32348]: audit 2021-03-10T16:58:28.421281+0000 mon.c (mon.1) 2546 : audit [DBG] from='client.? 172.21.2.103:0/1504846603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:30.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:30 gibba043 bash[24019]: cluster 2021-03-10T16:58:29.413255+0000 mgr.gibba043.dnkmem (mgr.34373) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:30 gibba003 bash[31385]: cluster 2021-03-10T16:58:29.413255+0000 mgr.gibba043.dnkmem (mgr.34373) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:30 gibba003 bash[32348]: cluster 2021-03-10T16:58:29.413255+0000 mgr.gibba043.dnkmem (mgr.34373) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:32 gibba043 bash[24019]: cluster 2021-03-10T16:58:31.415056+0000 mgr.gibba043.dnkmem (mgr.34373) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:32.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:32 gibba003 bash[31385]: cluster 2021-03-10T16:58:31.415056+0000 mgr.gibba043.dnkmem (mgr.34373) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:32.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:32 gibba003 bash[32348]: cluster 2021-03-10T16:58:31.415056+0000 mgr.gibba043.dnkmem (mgr.34373) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:34 gibba043 bash[24019]: cluster 2021-03-10T16:58:33.416709+0000 mgr.gibba043.dnkmem (mgr.34373) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:34.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:34 gibba003 bash[31385]: cluster 2021-03-10T16:58:33.416709+0000 mgr.gibba043.dnkmem (mgr.34373) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:34.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:34 gibba003 bash[32348]: cluster 2021-03-10T16:58:33.416709+0000 mgr.gibba043.dnkmem (mgr.34373) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:35 gibba043 bash[24019]: cephadm 2021-03-10T16:58:33.764635+0000 mgr.gibba043.dnkmem (mgr.34373) 9890 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:35 gibba003 bash[31385]: cephadm 2021-03-10T16:58:33.764635+0000 mgr.gibba043.dnkmem (mgr.34373) 9890 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:35.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:35 gibba003 bash[32348]: cephadm 2021-03-10T16:58:33.764635+0000 mgr.gibba043.dnkmem (mgr.34373) 9890 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:36.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:36 gibba043 bash[24019]: cluster 2021-03-10T16:58:35.417982+0000 mgr.gibba043.dnkmem (mgr.34373) 9891 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:36.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:36 gibba003 bash[31385]: cluster 2021-03-10T16:58:35.417982+0000 mgr.gibba043.dnkmem (mgr.34373) 9891 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:36.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:36 gibba003 bash[32348]: cluster 2021-03-10T16:58:35.417982+0000 mgr.gibba043.dnkmem (mgr.34373) 9891 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:38 gibba043 bash[24019]: cluster 2021-03-10T16:58:37.419480+0000 mgr.gibba043.dnkmem (mgr.34373) 9892 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:38 gibba003 bash[31385]: cluster 2021-03-10T16:58:37.419480+0000 mgr.gibba043.dnkmem (mgr.34373) 9892 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:38.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:38 gibba003 bash[32348]: cluster 2021-03-10T16:58:37.419480+0000 mgr.gibba043.dnkmem (mgr.34373) 9892 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:40.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:40 gibba043 bash[24019]: cluster 2021-03-10T16:58:39.421232+0000 mgr.gibba043.dnkmem (mgr.34373) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:40.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:40 gibba003 bash[31385]: cluster 2021-03-10T16:58:39.421232+0000 mgr.gibba043.dnkmem (mgr.34373) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:40.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:40 gibba003 bash[32348]: cluster 2021-03-10T16:58:39.421232+0000 mgr.gibba043.dnkmem (mgr.34373) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:42.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:42 gibba043 bash[24019]: cluster 2021-03-10T16:58:41.422988+0000 mgr.gibba043.dnkmem (mgr.34373) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:42.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:42 gibba003 bash[31385]: cluster 2021-03-10T16:58:41.422988+0000 mgr.gibba043.dnkmem (mgr.34373) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:42.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:42 gibba003 bash[32348]: cluster 2021-03-10T16:58:41.422988+0000 mgr.gibba043.dnkmem (mgr.34373) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:44 gibba043 bash[24019]: cluster 2021-03-10T16:58:43.424734+0000 mgr.gibba043.dnkmem (mgr.34373) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:44 gibba003 bash[31385]: cluster 2021-03-10T16:58:43.424734+0000 mgr.gibba043.dnkmem (mgr.34373) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:44 gibba003 bash[32348]: cluster 2021-03-10T16:58:43.424734+0000 mgr.gibba043.dnkmem (mgr.34373) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:45 gibba043 bash[24019]: cluster 2021-03-10T16:58:45.426391+0000 mgr.gibba043.dnkmem (mgr.34373) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:45 gibba003 bash[31385]: cluster 2021-03-10T16:58:45.426391+0000 mgr.gibba043.dnkmem (mgr.34373) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:45 gibba003 bash[32348]: cluster 2021-03-10T16:58:45.426391+0000 mgr.gibba043.dnkmem (mgr.34373) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:48 gibba043 bash[24019]: cluster 2021-03-10T16:58:47.428133+0000 mgr.gibba043.dnkmem (mgr.34373) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:48.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:48 gibba003 bash[31385]: cluster 2021-03-10T16:58:47.428133+0000 mgr.gibba043.dnkmem (mgr.34373) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:48.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:48 gibba003 bash[32348]: cluster 2021-03-10T16:58:47.428133+0000 mgr.gibba043.dnkmem (mgr.34373) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:50.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:50 gibba043 bash[24019]: cephadm 2021-03-10T16:58:48.780622+0000 mgr.gibba043.dnkmem (mgr.34373) 9898 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:50.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:50 gibba043 bash[24019]: cluster 2021-03-10T16:58:49.429924+0000 mgr.gibba043.dnkmem (mgr.34373) 9899 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:50.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:50 gibba003 bash[31385]: cephadm 2021-03-10T16:58:48.780622+0000 mgr.gibba043.dnkmem (mgr.34373) 9898 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:50.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:50 gibba003 bash[31385]: cluster 2021-03-10T16:58:49.429924+0000 mgr.gibba043.dnkmem (mgr.34373) 9899 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:50.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:50 gibba003 bash[32348]: cephadm 2021-03-10T16:58:48.780622+0000 mgr.gibba043.dnkmem (mgr.34373) 9898 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:58:50.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:50 gibba003 bash[32348]: cluster 2021-03-10T16:58:49.429924+0000 mgr.gibba043.dnkmem (mgr.34373) 9899 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:52.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:52 gibba043 bash[24019]: cluster 2021-03-10T16:58:51.431717+0000 mgr.gibba043.dnkmem (mgr.34373) 9900 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:52.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:52 gibba003 bash[31385]: cluster 2021-03-10T16:58:51.431717+0000 mgr.gibba043.dnkmem (mgr.34373) 9900 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:52.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:52 gibba003 bash[32348]: cluster 2021-03-10T16:58:51.431717+0000 mgr.gibba043.dnkmem (mgr.34373) 9900 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:53 gibba043 bash[24019]: cluster 2021-03-10T16:58:53.433394+0000 mgr.gibba043.dnkmem (mgr.34373) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:53 gibba003 bash[31385]: cluster 2021-03-10T16:58:53.433394+0000 mgr.gibba043.dnkmem (mgr.34373) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:53 gibba003 bash[32348]: cluster 2021-03-10T16:58:53.433394+0000 mgr.gibba043.dnkmem (mgr.34373) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:56.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:56 gibba043 bash[24019]: cluster 2021-03-10T16:58:55.434657+0000 mgr.gibba043.dnkmem (mgr.34373) 9902 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:56.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:56 gibba003 bash[31385]: cluster 2021-03-10T16:58:55.434657+0000 mgr.gibba043.dnkmem (mgr.34373) 9902 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:56.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:56 gibba003 bash[32348]: cluster 2021-03-10T16:58:55.434657+0000 mgr.gibba043.dnkmem (mgr.34373) 9902 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:58 gibba043 bash[24019]: cluster 2021-03-10T16:58:57.436086+0000 mgr.gibba043.dnkmem (mgr.34373) 9903 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.661 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:58:58.688 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:58 gibba003 bash[31385]: cluster 2021-03-10T16:58:57.436086+0000 mgr.gibba043.dnkmem (mgr.34373) 9903 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:58 gibba003 bash[32348]: cluster 2021-03-10T16:58:57.436086+0000 mgr.gibba043.dnkmem (mgr.34373) 9903 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.890 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:58:58.891 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:58:58.891 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:58:58.891 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:58:58.892 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:58:58.892 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:58:58.892 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:58:58.892 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:58:58.892 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:58:58.893 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:58:58.893 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:58:58.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:58:58.893 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:58:58.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:58:58.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:58:58.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:58:58.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:58:58.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:58:58.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:58:58.895 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:58:58.895 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:58:59.139 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:58:59.139 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:58:59.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:59.140 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:58:59.140 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:58:59.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:59.141 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:58:59.141 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:58:59.141 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:58:59.141 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:58:59.142 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:58:59.142 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:58:59.142 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:58:59.142 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:58:59.142 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:58:59.519 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:58:59 gibba043 bash[24019]: audit 2021-03-10T16:58:59.141319+0000 mon.c (mon.1) 2547 : audit [DBG] from='client.? 172.21.2.103:0/842430593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:58:59 gibba003 bash[31385]: audit 2021-03-10T16:58:59.141319+0000 mon.c (mon.1) 2547 : audit [DBG] from='client.? 172.21.2.103:0/842430593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:59.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:58:59 gibba003 bash[32348]: audit 2021-03-10T16:58:59.141319+0000 mon.c (mon.1) 2547 : audit [DBG] from='client.? 172.21.2.103:0/842430593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:00 gibba043 bash[24019]: audit 2021-03-10T16:58:58.653163+0000 mgr.gibba043.dnkmem (mgr.34373) 9904 : audit [DBG] from='client.60682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:00.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:00 gibba043 bash[24019]: audit 2021-03-10T16:58:58.878997+0000 mgr.gibba043.dnkmem (mgr.34373) 9905 : audit [DBG] from='client.60688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:00.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:00 gibba043 bash[24019]: cluster 2021-03-10T16:58:59.437913+0000 mgr.gibba043.dnkmem (mgr.34373) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:00 gibba003 bash[31385]: audit 2021-03-10T16:58:58.653163+0000 mgr.gibba043.dnkmem (mgr.34373) 9904 : audit [DBG] from='client.60682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:00 gibba003 bash[31385]: audit 2021-03-10T16:58:58.878997+0000 mgr.gibba043.dnkmem (mgr.34373) 9905 : audit [DBG] from='client.60688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:00.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:00 gibba003 bash[31385]: cluster 2021-03-10T16:58:59.437913+0000 mgr.gibba043.dnkmem (mgr.34373) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:00 gibba003 bash[32348]: audit 2021-03-10T16:58:58.653163+0000 mgr.gibba043.dnkmem (mgr.34373) 9904 : audit [DBG] from='client.60682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:00 gibba003 bash[32348]: audit 2021-03-10T16:58:58.878997+0000 mgr.gibba043.dnkmem (mgr.34373) 9905 : audit [DBG] from='client.60688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:00.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:00 gibba003 bash[32348]: cluster 2021-03-10T16:58:59.437913+0000 mgr.gibba043.dnkmem (mgr.34373) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:02.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:02 gibba043 bash[24019]: cluster 2021-03-10T16:59:01.439760+0000 mgr.gibba043.dnkmem (mgr.34373) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:02.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:02 gibba003 bash[31385]: cluster 2021-03-10T16:59:01.439760+0000 mgr.gibba043.dnkmem (mgr.34373) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:02.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:02 gibba003 bash[32348]: cluster 2021-03-10T16:59:01.439760+0000 mgr.gibba043.dnkmem (mgr.34373) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:03 gibba003 bash[31385]: cluster 2021-03-10T16:59:03.441366+0000 mgr.gibba043.dnkmem (mgr.34373) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:03 gibba003 bash[32348]: cluster 2021-03-10T16:59:03.441366+0000 mgr.gibba043.dnkmem (mgr.34373) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:03 gibba043 bash[24019]: cluster 2021-03-10T16:59:03.441366+0000 mgr.gibba043.dnkmem (mgr.34373) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:04 gibba003 bash[31385]: cephadm 2021-03-10T16:59:03.796744+0000 mgr.gibba043.dnkmem (mgr.34373) 9909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:04.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:04 gibba003 bash[32348]: cephadm 2021-03-10T16:59:03.796744+0000 mgr.gibba043.dnkmem (mgr.34373) 9909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:05.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:04 gibba043 bash[24019]: cephadm 2021-03-10T16:59:03.796744+0000 mgr.gibba043.dnkmem (mgr.34373) 9909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:05 gibba003 bash[31385]: cluster 2021-03-10T16:59:05.442873+0000 mgr.gibba043.dnkmem (mgr.34373) 9910 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:05 gibba003 bash[32348]: cluster 2021-03-10T16:59:05.442873+0000 mgr.gibba043.dnkmem (mgr.34373) 9910 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:05 gibba043 bash[24019]: cluster 2021-03-10T16:59:05.442873+0000 mgr.gibba043.dnkmem (mgr.34373) 9910 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:08 gibba043 bash[24019]: cluster 2021-03-10T16:59:07.444593+0000 mgr.gibba043.dnkmem (mgr.34373) 9911 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:08 gibba003 bash[31385]: cluster 2021-03-10T16:59:07.444593+0000 mgr.gibba043.dnkmem (mgr.34373) 9911 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:08.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:08 gibba003 bash[32348]: cluster 2021-03-10T16:59:07.444593+0000 mgr.gibba043.dnkmem (mgr.34373) 9911 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:10 gibba043 bash[24019]: cluster 2021-03-10T16:59:09.446317+0000 mgr.gibba043.dnkmem (mgr.34373) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:10 gibba003 bash[31385]: cluster 2021-03-10T16:59:09.446317+0000 mgr.gibba043.dnkmem (mgr.34373) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:10 gibba003 bash[32348]: cluster 2021-03-10T16:59:09.446317+0000 mgr.gibba043.dnkmem (mgr.34373) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:11 gibba043 bash[24019]: cluster 2021-03-10T16:59:11.448191+0000 mgr.gibba043.dnkmem (mgr.34373) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:11 gibba003 bash[31385]: cluster 2021-03-10T16:59:11.448191+0000 mgr.gibba043.dnkmem (mgr.34373) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:11 gibba003 bash[32348]: cluster 2021-03-10T16:59:11.448191+0000 mgr.gibba043.dnkmem (mgr.34373) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:13 gibba003 bash[31385]: cluster 2021-03-10T16:59:13.449851+0000 mgr.gibba043.dnkmem (mgr.34373) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:13 gibba003 bash[32348]: cluster 2021-03-10T16:59:13.449851+0000 mgr.gibba043.dnkmem (mgr.34373) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:13 gibba043 bash[24019]: cluster 2021-03-10T16:59:13.449851+0000 mgr.gibba043.dnkmem (mgr.34373) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:13.924801+0000 mon.c (mon.1) 2548 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:13.925974+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.157039+0000 mon.c (mon.1) 2549 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.158077+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.456831+0000 mon.c (mon.1) 2550 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:59:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.457624+0000 mon.c (mon.1) 2551 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.458047+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:59:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.458326+0000 mon.c (mon.1) 2552 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.459215+0000 mon.c (mon.1) 2553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.459315+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.460280+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[31385]: audit 2021-03-10T16:59:14.461270+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:13.924801+0000 mon.c (mon.1) 2548 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:13.925974+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.157039+0000 mon.c (mon.1) 2549 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.158077+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.456831+0000 mon.c (mon.1) 2550 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:59:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.457624+0000 mon.c (mon.1) 2551 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.458047+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:59:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.458326+0000 mon.c (mon.1) 2552 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.459215+0000 mon.c (mon.1) 2553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.459315+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.460280+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:59:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:14 gibba003 bash[32348]: audit 2021-03-10T16:59:14.461270+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:13.924801+0000 mon.c (mon.1) 2548 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:13.925974+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.157039+0000 mon.c (mon.1) 2549 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.158077+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.456831+0000 mon.c (mon.1) 2550 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:59:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.457624+0000 mon.c (mon.1) 2551 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:59:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.458047+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:59:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.458326+0000 mon.c (mon.1) 2552 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:59:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.459215+0000 mon.c (mon.1) 2553 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.459315+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:59:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.460280+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:59:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:14 gibba043 bash[24019]: audit 2021-03-10T16:59:14.461270+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:15 gibba003 bash[31385]: cluster 2021-03-10T16:59:15.451215+0000 mgr.gibba043.dnkmem (mgr.34373) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:15 gibba003 bash[32348]: cluster 2021-03-10T16:59:15.451215+0000 mgr.gibba043.dnkmem (mgr.34373) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:15 gibba043 bash[24019]: cluster 2021-03-10T16:59:15.451215+0000 mgr.gibba043.dnkmem (mgr.34373) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:18 gibba043 bash[24019]: cluster 2021-03-10T16:59:17.452902+0000 mgr.gibba043.dnkmem (mgr.34373) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:18 gibba003 bash[31385]: cluster 2021-03-10T16:59:17.452902+0000 mgr.gibba043.dnkmem (mgr.34373) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:18.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:18 gibba003 bash[32348]: cluster 2021-03-10T16:59:17.452902+0000 mgr.gibba043.dnkmem (mgr.34373) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:19.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:19 gibba043 bash[24019]: audit 2021-03-10T16:59:18.815699+0000 mon.c (mon.1) 2554 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:59:19.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:19 gibba003 bash[31385]: audit 2021-03-10T16:59:18.815699+0000 mon.c (mon.1) 2554 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:59:19.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:19 gibba003 bash[32348]: audit 2021-03-10T16:59:18.815699+0000 mon.c (mon.1) 2554 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:59:20.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:20 gibba043 bash[24019]: cephadm 2021-03-10T16:59:18.813192+0000 mgr.gibba043.dnkmem (mgr.34373) 9917 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:59:20.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:20 gibba043 bash[24019]: cluster 2021-03-10T16:59:19.454405+0000 mgr.gibba043.dnkmem (mgr.34373) 9918 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:20.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:20 gibba003 bash[31385]: cephadm 2021-03-10T16:59:18.813192+0000 mgr.gibba043.dnkmem (mgr.34373) 9917 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:59:20.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:20 gibba003 bash[31385]: cluster 2021-03-10T16:59:19.454405+0000 mgr.gibba043.dnkmem (mgr.34373) 9918 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:20.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:20 gibba003 bash[32348]: cephadm 2021-03-10T16:59:18.813192+0000 mgr.gibba043.dnkmem (mgr.34373) 9917 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T16:59:20.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:20 gibba003 bash[32348]: cluster 2021-03-10T16:59:19.454405+0000 mgr.gibba043.dnkmem (mgr.34373) 9918 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:21.938 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:21 gibba003 bash[32348]: cluster 2021-03-10T16:59:21.455504+0000 mgr.gibba043.dnkmem (mgr.34373) 9919 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:21 gibba003 bash[31385]: cluster 2021-03-10T16:59:21.455504+0000 mgr.gibba043.dnkmem (mgr.34373) 9919 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:21 gibba043 bash[24019]: cluster 2021-03-10T16:59:21.455504+0000 mgr.gibba043.dnkmem (mgr.34373) 9919 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.318563+0000 mgr.gibba043.dnkmem (mgr.34373) 9920 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:59:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.319308+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:59:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.522054+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:59:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.530360+0000 mon.c (mon.1) 2555 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.531969+0000 mon.c (mon.1) 2556 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.533436+0000 mon.c (mon.1) 2557 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.534754+0000 mon.c (mon.1) 2558 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.537995+0000 mon.c (mon.1) 2559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[31385]: audit 2021-03-10T16:59:22.539867+0000 mon.c (mon.1) 2560 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.318563+0000 mgr.gibba043.dnkmem (mgr.34373) 9920 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:59:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.319308+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:59:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.522054+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:59:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.530360+0000 mon.c (mon.1) 2555 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.531969+0000 mon.c (mon.1) 2556 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.533436+0000 mon.c (mon.1) 2557 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.534754+0000 mon.c (mon.1) 2558 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.537995+0000 mon.c (mon.1) 2559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:23 gibba003 bash[32348]: audit 2021-03-10T16:59:22.539867+0000 mon.c (mon.1) 2560 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.318563+0000 mgr.gibba043.dnkmem (mgr.34373) 9920 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T16:59:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.319308+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:59:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.522054+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T16:59:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.530360+0000 mon.c (mon.1) 2555 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.531969+0000 mon.c (mon.1) 2556 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.533436+0000 mon.c (mon.1) 2557 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.534754+0000 mon.c (mon.1) 2558 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.537995+0000 mon.c (mon.1) 2559 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:23.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:23 gibba043 bash[24019]: audit 2021-03-10T16:59:22.539867+0000 mon.c (mon.1) 2560 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:24.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.527882+0000 mgr.gibba043.dnkmem (mgr.34373) 9921 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:24.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.529830+0000 mgr.gibba043.dnkmem (mgr.34373) 9922 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.531180+0000 mgr.gibba043.dnkmem (mgr.34373) 9923 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:24.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.531239+0000 mgr.gibba043.dnkmem (mgr.34373) 9924 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:24.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.532729+0000 mgr.gibba043.dnkmem (mgr.34373) 9925 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:24.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.532789+0000 mgr.gibba043.dnkmem (mgr.34373) 9926 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:24.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.533955+0000 mgr.gibba043.dnkmem (mgr.34373) 9927 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:24.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.535715+0000 mgr.gibba043.dnkmem (mgr.34373) 9928 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:24.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.535754+0000 mgr.gibba043.dnkmem (mgr.34373) 9929 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:24.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.537425+0000 mgr.gibba043.dnkmem (mgr.34373) 9930 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:24.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.537889+0000 mgr.gibba043.dnkmem (mgr.34373) 9931 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:24.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.539624+0000 mgr.gibba043.dnkmem (mgr.34373) 9932 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:24.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.539680+0000 mgr.gibba043.dnkmem (mgr.34373) 9933 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:24.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cephadm 2021-03-10T16:59:22.539911+0000 mgr.gibba043.dnkmem (mgr.34373) 9934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:24.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[31385]: cluster 2021-03-10T16:59:23.457039+0000 mgr.gibba043.dnkmem (mgr.34373) 9935 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:24.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.527882+0000 mgr.gibba043.dnkmem (mgr.34373) 9921 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:24.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.529830+0000 mgr.gibba043.dnkmem (mgr.34373) 9922 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:24.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.531180+0000 mgr.gibba043.dnkmem (mgr.34373) 9923 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:24.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.531239+0000 mgr.gibba043.dnkmem (mgr.34373) 9924 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:24.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.532729+0000 mgr.gibba043.dnkmem (mgr.34373) 9925 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:24.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.532789+0000 mgr.gibba043.dnkmem (mgr.34373) 9926 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:24.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.533955+0000 mgr.gibba043.dnkmem (mgr.34373) 9927 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:24.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.535715+0000 mgr.gibba043.dnkmem (mgr.34373) 9928 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:24.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.535754+0000 mgr.gibba043.dnkmem (mgr.34373) 9929 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:24.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.537425+0000 mgr.gibba043.dnkmem (mgr.34373) 9930 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:24.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.537889+0000 mgr.gibba043.dnkmem (mgr.34373) 9931 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:24.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.539624+0000 mgr.gibba043.dnkmem (mgr.34373) 9932 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:24.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.539680+0000 mgr.gibba043.dnkmem (mgr.34373) 9933 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:24.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cephadm 2021-03-10T16:59:22.539911+0000 mgr.gibba043.dnkmem (mgr.34373) 9934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:24.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:24 gibba003 bash[32348]: cluster 2021-03-10T16:59:23.457039+0000 mgr.gibba043.dnkmem (mgr.34373) 9935 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:24.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.527882+0000 mgr.gibba043.dnkmem (mgr.34373) 9921 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:24.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.529830+0000 mgr.gibba043.dnkmem (mgr.34373) 9922 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:24.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.531180+0000 mgr.gibba043.dnkmem (mgr.34373) 9923 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:24.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.531239+0000 mgr.gibba043.dnkmem (mgr.34373) 9924 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.532729+0000 mgr.gibba043.dnkmem (mgr.34373) 9925 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.532789+0000 mgr.gibba043.dnkmem (mgr.34373) 9926 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.533955+0000 mgr.gibba043.dnkmem (mgr.34373) 9927 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.535715+0000 mgr.gibba043.dnkmem (mgr.34373) 9928 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.535754+0000 mgr.gibba043.dnkmem (mgr.34373) 9929 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.537425+0000 mgr.gibba043.dnkmem (mgr.34373) 9930 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.537889+0000 mgr.gibba043.dnkmem (mgr.34373) 9931 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.539624+0000 mgr.gibba043.dnkmem (mgr.34373) 9932 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.539680+0000 mgr.gibba043.dnkmem (mgr.34373) 9933 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:24.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cephadm 2021-03-10T16:59:22.539911+0000 mgr.gibba043.dnkmem (mgr.34373) 9934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:24.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:24 gibba043 bash[24019]: cluster 2021-03-10T16:59:23.457039+0000 mgr.gibba043.dnkmem (mgr.34373) 9935 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:25 gibba003 bash[31385]: cluster 2021-03-10T16:59:25.458436+0000 mgr.gibba043.dnkmem (mgr.34373) 9936 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:25 gibba003 bash[32348]: cluster 2021-03-10T16:59:25.458436+0000 mgr.gibba043.dnkmem (mgr.34373) 9936 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:25 gibba043 bash[24019]: cluster 2021-03-10T16:59:25.458436+0000 mgr.gibba043.dnkmem (mgr.34373) 9936 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:28.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:28 gibba043 bash[24019]: cluster 2021-03-10T16:59:27.460018+0000 mgr.gibba043.dnkmem (mgr.34373) 9937 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:28.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:28 gibba003 bash[31385]: cluster 2021-03-10T16:59:27.460018+0000 mgr.gibba043.dnkmem (mgr.34373) 9937 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:28.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:28 gibba003 bash[32348]: cluster 2021-03-10T16:59:27.460018+0000 mgr.gibba043.dnkmem (mgr.34373) 9937 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:29.385 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T16:59:29.611 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:59:29.611 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T16:59:29.612 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T16:59:29.612 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T16:59:29.612 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T16:59:29.612 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T16:59:29.613 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T16:59:29.613 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T16:59:29.613 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T16:59:29.613 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T16:59:29.614 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T16:59:29.614 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T16:59:29.614 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T16:59:29.614 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T16:59:29.614 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T16:59:29.615 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T16:59:29.615 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T16:59:29.615 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T16:59:29.615 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T16:59:29.616 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T16:59:29.616 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:59:29.864 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T16:59:29.864 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T16:59:29.865 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:29.865 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:59:29.865 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T16:59:29.865 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:29.865 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:59:29.866 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T16:59:29.866 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:59:29.866 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T16:59:29.866 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T16:59:29.867 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T16:59:29.867 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:59:29.867 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T16:59:29.867 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T16:59:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:29 gibba003 bash[31385]: audit 2021-03-10T16:59:29.375993+0000 mgr.gibba043.dnkmem (mgr.34373) 9938 : audit [DBG] from='client.60700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:29 gibba003 bash[31385]: cluster 2021-03-10T16:59:29.461548+0000 mgr.gibba043.dnkmem (mgr.34373) 9939 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:29.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:29 gibba003 bash[32348]: audit 2021-03-10T16:59:29.375993+0000 mgr.gibba043.dnkmem (mgr.34373) 9938 : audit [DBG] from='client.60700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:29 gibba003 bash[32348]: cluster 2021-03-10T16:59:29.461548+0000 mgr.gibba043.dnkmem (mgr.34373) 9939 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:30.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:29 gibba043 bash[24019]: audit 2021-03-10T16:59:29.375993+0000 mgr.gibba043.dnkmem (mgr.34373) 9938 : audit [DBG] from='client.60700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:29 gibba043 bash[24019]: cluster 2021-03-10T16:59:29.461548+0000 mgr.gibba043.dnkmem (mgr.34373) 9939 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:30.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:30 gibba003 bash[31385]: audit 2021-03-10T16:59:29.602924+0000 mgr.gibba043.dnkmem (mgr.34373) 9940 : audit [DBG] from='client.50715 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:30.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:30 gibba003 bash[31385]: audit 2021-03-10T16:59:29.865995+0000 mon.c (mon.1) 2561 : audit [DBG] from='client.? 172.21.2.103:0/3992034206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:30.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:30 gibba003 bash[32348]: audit 2021-03-10T16:59:29.602924+0000 mgr.gibba043.dnkmem (mgr.34373) 9940 : audit [DBG] from='client.50715 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:30.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:30 gibba003 bash[32348]: audit 2021-03-10T16:59:29.865995+0000 mon.c (mon.1) 2561 : audit [DBG] from='client.? 172.21.2.103:0/3992034206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:30 gibba043 bash[24019]: audit 2021-03-10T16:59:29.602924+0000 mgr.gibba043.dnkmem (mgr.34373) 9940 : audit [DBG] from='client.50715 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:30 gibba043 bash[24019]: audit 2021-03-10T16:59:29.865995+0000 mon.c (mon.1) 2561 : audit [DBG] from='client.? 172.21.2.103:0/3992034206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:31 gibba003 bash[31385]: cluster 2021-03-10T16:59:31.463247+0000 mgr.gibba043.dnkmem (mgr.34373) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:31 gibba003 bash[32348]: cluster 2021-03-10T16:59:31.463247+0000 mgr.gibba043.dnkmem (mgr.34373) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:32.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:31 gibba043 bash[24019]: cluster 2021-03-10T16:59:31.463247+0000 mgr.gibba043.dnkmem (mgr.34373) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:33 gibba003 bash[31385]: cluster 2021-03-10T16:59:33.464935+0000 mgr.gibba043.dnkmem (mgr.34373) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:33 gibba003 bash[32348]: cluster 2021-03-10T16:59:33.464935+0000 mgr.gibba043.dnkmem (mgr.34373) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:33 gibba043 bash[24019]: cluster 2021-03-10T16:59:33.464935+0000 mgr.gibba043.dnkmem (mgr.34373) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:35 gibba003 bash[31385]: cluster 2021-03-10T16:59:35.466218+0000 mgr.gibba043.dnkmem (mgr.34373) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:35 gibba003 bash[32348]: cluster 2021-03-10T16:59:35.466218+0000 mgr.gibba043.dnkmem (mgr.34373) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:35 gibba043 bash[24019]: cluster 2021-03-10T16:59:35.466218+0000 mgr.gibba043.dnkmem (mgr.34373) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:38 gibba043 bash[24019]: cluster 2021-03-10T16:59:37.467898+0000 mgr.gibba043.dnkmem (mgr.34373) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:38 gibba003 bash[31385]: cluster 2021-03-10T16:59:37.467898+0000 mgr.gibba043.dnkmem (mgr.34373) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:38 gibba003 bash[32348]: cluster 2021-03-10T16:59:37.467898+0000 mgr.gibba043.dnkmem (mgr.34373) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:39.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:39 gibba043 bash[24019]: cephadm 2021-03-10T16:59:37.555771+0000 mgr.gibba043.dnkmem (mgr.34373) 9945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:39 gibba003 bash[31385]: cephadm 2021-03-10T16:59:37.555771+0000 mgr.gibba043.dnkmem (mgr.34373) 9945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:39.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:39 gibba003 bash[32348]: cephadm 2021-03-10T16:59:37.555771+0000 mgr.gibba043.dnkmem (mgr.34373) 9945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:40.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:40 gibba043 bash[24019]: cluster 2021-03-10T16:59:39.469657+0000 mgr.gibba043.dnkmem (mgr.34373) 9946 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:40.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:40 gibba003 bash[31385]: cluster 2021-03-10T16:59:39.469657+0000 mgr.gibba043.dnkmem (mgr.34373) 9946 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:40.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:40 gibba003 bash[32348]: cluster 2021-03-10T16:59:39.469657+0000 mgr.gibba043.dnkmem (mgr.34373) 9946 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:41 gibba003 bash[31385]: cluster 2021-03-10T16:59:41.471191+0000 mgr.gibba043.dnkmem (mgr.34373) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:41 gibba003 bash[32348]: cluster 2021-03-10T16:59:41.471191+0000 mgr.gibba043.dnkmem (mgr.34373) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:42.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:41 gibba043 bash[24019]: cluster 2021-03-10T16:59:41.471191+0000 mgr.gibba043.dnkmem (mgr.34373) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:43 gibba003 bash[31385]: cluster 2021-03-10T16:59:43.472608+0000 mgr.gibba043.dnkmem (mgr.34373) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:43 gibba003 bash[32348]: cluster 2021-03-10T16:59:43.472608+0000 mgr.gibba043.dnkmem (mgr.34373) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:44.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:43 gibba043 bash[24019]: cluster 2021-03-10T16:59:43.472608+0000 mgr.gibba043.dnkmem (mgr.34373) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:45 gibba003 bash[31385]: cluster 2021-03-10T16:59:45.474128+0000 mgr.gibba043.dnkmem (mgr.34373) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:45 gibba003 bash[32348]: cluster 2021-03-10T16:59:45.474128+0000 mgr.gibba043.dnkmem (mgr.34373) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:45 gibba043 bash[24019]: cluster 2021-03-10T16:59:45.474128+0000 mgr.gibba043.dnkmem (mgr.34373) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:48.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:48 gibba043 bash[24019]: cluster 2021-03-10T16:59:47.475702+0000 mgr.gibba043.dnkmem (mgr.34373) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:48.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:48 gibba003 bash[31385]: cluster 2021-03-10T16:59:47.475702+0000 mgr.gibba043.dnkmem (mgr.34373) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:48.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:48 gibba003 bash[32348]: cluster 2021-03-10T16:59:47.475702+0000 mgr.gibba043.dnkmem (mgr.34373) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:49 gibba003 bash[31385]: cluster 2021-03-10T16:59:49.477233+0000 mgr.gibba043.dnkmem (mgr.34373) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:49.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:49 gibba003 bash[32348]: cluster 2021-03-10T16:59:49.477233+0000 mgr.gibba043.dnkmem (mgr.34373) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:49 gibba043 bash[24019]: cluster 2021-03-10T16:59:49.477233+0000 mgr.gibba043.dnkmem (mgr.34373) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:51 gibba003 bash[31385]: cluster 2021-03-10T16:59:51.478011+0000 mgr.gibba043.dnkmem (mgr.34373) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:51 gibba003 bash[32348]: cluster 2021-03-10T16:59:51.478011+0000 mgr.gibba043.dnkmem (mgr.34373) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:51 gibba043 bash[24019]: cluster 2021-03-10T16:59:51.478011+0000 mgr.gibba043.dnkmem (mgr.34373) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:53 gibba003 bash[31385]: cephadm 2021-03-10T16:59:52.571913+0000 mgr.gibba043.dnkmem (mgr.34373) 9953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:53 gibba003 bash[31385]: cluster 2021-03-10T16:59:53.479574+0000 mgr.gibba043.dnkmem (mgr.34373) 9954 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:53 gibba003 bash[32348]: cephadm 2021-03-10T16:59:52.571913+0000 mgr.gibba043.dnkmem (mgr.34373) 9953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:53 gibba003 bash[32348]: cluster 2021-03-10T16:59:53.479574+0000 mgr.gibba043.dnkmem (mgr.34373) 9954 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:53 gibba043 bash[24019]: cephadm 2021-03-10T16:59:52.571913+0000 mgr.gibba043.dnkmem (mgr.34373) 9953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T16:59:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:53 gibba043 bash[24019]: cluster 2021-03-10T16:59:53.479574+0000 mgr.gibba043.dnkmem (mgr.34373) 9954 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:55 gibba003 bash[31385]: cluster 2021-03-10T16:59:55.480806+0000 mgr.gibba043.dnkmem (mgr.34373) 9955 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:55 gibba003 bash[32348]: cluster 2021-03-10T16:59:55.480806+0000 mgr.gibba043.dnkmem (mgr.34373) 9955 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:55 gibba043 bash[24019]: cluster 2021-03-10T16:59:55.480806+0000 mgr.gibba043.dnkmem (mgr.34373) 9955 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:58.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:58 gibba043 bash[24019]: cluster 2021-03-10T16:59:57.482198+0000 mgr.gibba043.dnkmem (mgr.34373) 9956 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:58 gibba003 bash[31385]: cluster 2021-03-10T16:59:57.482198+0000 mgr.gibba043.dnkmem (mgr.34373) 9956 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:58.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:58 gibba003 bash[32348]: cluster 2021-03-10T16:59:57.482198+0000 mgr.gibba043.dnkmem (mgr.34373) 9956 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 16:59:59 gibba003 bash[31385]: cluster 2021-03-10T16:59:59.483980+0000 mgr.gibba043.dnkmem (mgr.34373) 9957 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:59.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 16:59:59 gibba003 bash[32348]: cluster 2021-03-10T16:59:59.483980+0000 mgr.gibba043.dnkmem (mgr.34373) 9957 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 16:59:59 gibba043 bash[24019]: cluster 2021-03-10T16:59:59.483980+0000 mgr.gibba043.dnkmem (mgr.34373) 9957 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.109 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:00:00.335 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:00:00.335 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 38s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:00:00.335 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:00:00.335 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:00:00.336 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:00:00.336 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:00:00.336 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:00:00.336 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:00:00.337 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:00:00.337 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 38s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:00:00.337 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:00:00.337 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:00:00.338 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:00:00.338 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:00:00.338 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:00:00.338 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:00:00.339 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:00:00.339 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:00:00.339 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:00:00.339 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:00:00.339 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 38s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:00:00.438 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[31385]: debug 2021-03-10T16:59:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.585 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:00:00.586 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:00:00.586 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:00.586 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:00:00.587 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:00:00.587 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:00.587 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:00:00.587 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:00:00.588 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:00:00.588 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:00:00.588 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:00:00.588 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:00:00.589 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:00:00.589 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:00:00.589 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:00:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[31385]: cluster 2021-03-10T17:00:00.000112+0000 mon.a (mon.0) 2041 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[31385]: audit 2021-03-10T17:00:00.100298+0000 mgr.gibba043.dnkmem (mgr.34373) 9958 : audit [DBG] from='client.50727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:00.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[31385]: audit 2021-03-10T17:00:00.323121+0000 mgr.gibba043.dnkmem (mgr.34373) 9959 : audit [DBG] from='client.60724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:00.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[32348]: cluster 2021-03-10T17:00:00.000112+0000 mon.a (mon.0) 2041 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[32348]: audit 2021-03-10T17:00:00.100298+0000 mgr.gibba043.dnkmem (mgr.34373) 9958 : audit [DBG] from='client.50727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:00.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:00 gibba003 bash[32348]: audit 2021-03-10T17:00:00.323121+0000 mgr.gibba043.dnkmem (mgr.34373) 9959 : audit [DBG] from='client.60724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:01.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:00 gibba043 bash[24019]: cluster 2021-03-10T17:00:00.000112+0000 mon.a (mon.0) 2041 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:01.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:00 gibba043 bash[24019]: audit 2021-03-10T17:00:00.100298+0000 mgr.gibba043.dnkmem (mgr.34373) 9958 : audit [DBG] from='client.50727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:00 gibba043 bash[24019]: audit 2021-03-10T17:00:00.323121+0000 mgr.gibba043.dnkmem (mgr.34373) 9959 : audit [DBG] from='client.60724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:01 gibba003 bash[31385]: audit 2021-03-10T17:00:00.587770+0000 mon.a (mon.0) 2042 : audit [DBG] from='client.? 172.21.2.103:0/34650906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:01 gibba003 bash[31385]: cluster 2021-03-10T17:00:01.484819+0000 mgr.gibba043.dnkmem (mgr.34373) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:01 gibba003 bash[32348]: audit 2021-03-10T17:00:00.587770+0000 mon.a (mon.0) 2042 : audit [DBG] from='client.? 172.21.2.103:0/34650906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:01 gibba003 bash[32348]: cluster 2021-03-10T17:00:01.484819+0000 mgr.gibba043.dnkmem (mgr.34373) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:01 gibba043 bash[24019]: audit 2021-03-10T17:00:00.587770+0000 mon.a (mon.0) 2042 : audit [DBG] from='client.? 172.21.2.103:0/34650906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:01 gibba043 bash[24019]: cluster 2021-03-10T17:00:01.484819+0000 mgr.gibba043.dnkmem (mgr.34373) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:03 gibba003 bash[31385]: cluster 2021-03-10T17:00:03.486314+0000 mgr.gibba043.dnkmem (mgr.34373) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:03 gibba003 bash[32348]: cluster 2021-03-10T17:00:03.486314+0000 mgr.gibba043.dnkmem (mgr.34373) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:03 gibba043 bash[24019]: cluster 2021-03-10T17:00:03.486314+0000 mgr.gibba043.dnkmem (mgr.34373) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:05.020 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 17:00:04 gibba043 bash[19809]: level=info ts=2021-03-10T17:00:04.655Z caller=compact.go:507 component=tsdb msg="write block" mint=1615384801431 maxt=1615392000000 ulid=01F0EH9J450AGJP5K09ZH7HBTZ duration=42.155186ms 2021-03-10T17:00:05.021 INFO:journalctl@ceph.prometheus.a.gibba043.stdout:Mar 10 17:00:04 gibba043 bash[19809]: level=info ts=2021-03-10T17:00:04.657Z caller=head.go:847 component=tsdb msg="Head GC completed" duration=1.422945ms 2021-03-10T17:00:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:05 gibba003 bash[31385]: cluster 2021-03-10T17:00:05.487725+0000 mgr.gibba043.dnkmem (mgr.34373) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:05 gibba003 bash[32348]: cluster 2021-03-10T17:00:05.487725+0000 mgr.gibba043.dnkmem (mgr.34373) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:05 gibba043 bash[24019]: cluster 2021-03-10T17:00:05.487725+0000 mgr.gibba043.dnkmem (mgr.34373) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:08.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:08 gibba043 bash[24019]: cluster 2021-03-10T17:00:07.489443+0000 mgr.gibba043.dnkmem (mgr.34373) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:08.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:08 gibba003 bash[31385]: cluster 2021-03-10T17:00:07.489443+0000 mgr.gibba043.dnkmem (mgr.34373) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:08.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:08 gibba003 bash[32348]: cluster 2021-03-10T17:00:07.489443+0000 mgr.gibba043.dnkmem (mgr.34373) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:09.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:09 gibba043 bash[24019]: cephadm 2021-03-10T17:00:07.587878+0000 mgr.gibba043.dnkmem (mgr.34373) 9964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:09.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:09 gibba003 bash[31385]: cephadm 2021-03-10T17:00:07.587878+0000 mgr.gibba043.dnkmem (mgr.34373) 9964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:09.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:09 gibba003 bash[32348]: cephadm 2021-03-10T17:00:07.587878+0000 mgr.gibba043.dnkmem (mgr.34373) 9964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:10.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:10 gibba043 bash[24019]: cluster 2021-03-10T17:00:09.491280+0000 mgr.gibba043.dnkmem (mgr.34373) 9965 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:10.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:10 gibba003 bash[31385]: cluster 2021-03-10T17:00:09.491280+0000 mgr.gibba043.dnkmem (mgr.34373) 9965 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:10.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:10 gibba003 bash[32348]: cluster 2021-03-10T17:00:09.491280+0000 mgr.gibba043.dnkmem (mgr.34373) 9965 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:11 gibba003 bash[31385]: cluster 2021-03-10T17:00:11.492851+0000 mgr.gibba043.dnkmem (mgr.34373) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:11 gibba003 bash[32348]: cluster 2021-03-10T17:00:11.492851+0000 mgr.gibba043.dnkmem (mgr.34373) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:11 gibba043 bash[24019]: cluster 2021-03-10T17:00:11.492851+0000 mgr.gibba043.dnkmem (mgr.34373) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:13 gibba003 bash[31385]: cluster 2021-03-10T17:00:13.494244+0000 mgr.gibba043.dnkmem (mgr.34373) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:13.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:13 gibba003 bash[32348]: cluster 2021-03-10T17:00:13.494244+0000 mgr.gibba043.dnkmem (mgr.34373) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:13 gibba043 bash[24019]: cluster 2021-03-10T17:00:13.494244+0000 mgr.gibba043.dnkmem (mgr.34373) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:13.931479+0000 mon.c (mon.1) 2562 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:13.932586+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.167004+0000 mon.c (mon.1) 2563 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.168155+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.465477+0000 mon.c (mon.1) 2564 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:00:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.466250+0000 mon.c (mon.1) 2565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.466690+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:00:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.466941+0000 mon.c (mon.1) 2566 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.467952+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.468060+0000 mon.c (mon.1) 2567 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.468960+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[31385]: audit 2021-03-10T17:00:14.469931+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:13.931479+0000 mon.c (mon.1) 2562 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:13.932586+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.167004+0000 mon.c (mon.1) 2563 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.168155+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.465477+0000 mon.c (mon.1) 2564 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:00:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.466250+0000 mon.c (mon.1) 2565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.466690+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:00:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.466941+0000 mon.c (mon.1) 2566 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.467952+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.468060+0000 mon.c (mon.1) 2567 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.468960+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:14 gibba003 bash[32348]: audit 2021-03-10T17:00:14.469931+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:13.931479+0000 mon.c (mon.1) 2562 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:13.932586+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.167004+0000 mon.c (mon.1) 2563 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.168155+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.465477+0000 mon.c (mon.1) 2564 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:00:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.466250+0000 mon.c (mon.1) 2565 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.466690+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:00:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.466941+0000 mon.c (mon.1) 2566 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.467952+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.468060+0000 mon.c (mon.1) 2567 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.468960+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:14 gibba043 bash[24019]: audit 2021-03-10T17:00:14.469931+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:00:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:15 gibba003 bash[31385]: cluster 2021-03-10T17:00:15.495707+0000 mgr.gibba043.dnkmem (mgr.34373) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:15 gibba003 bash[32348]: cluster 2021-03-10T17:00:15.495707+0000 mgr.gibba043.dnkmem (mgr.34373) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:15 gibba043 bash[24019]: cluster 2021-03-10T17:00:15.495707+0000 mgr.gibba043.dnkmem (mgr.34373) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:18.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:18 gibba043 bash[24019]: cluster 2021-03-10T17:00:17.497166+0000 mgr.gibba043.dnkmem (mgr.34373) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:18 gibba003 bash[31385]: cluster 2021-03-10T17:00:17.497166+0000 mgr.gibba043.dnkmem (mgr.34373) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:18.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:18 gibba003 bash[32348]: cluster 2021-03-10T17:00:17.497166+0000 mgr.gibba043.dnkmem (mgr.34373) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:19 gibba003 bash[31385]: cluster 2021-03-10T17:00:19.498952+0000 mgr.gibba043.dnkmem (mgr.34373) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:19 gibba003 bash[32348]: cluster 2021-03-10T17:00:19.498952+0000 mgr.gibba043.dnkmem (mgr.34373) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:19 gibba043 bash[24019]: cluster 2021-03-10T17:00:19.498952+0000 mgr.gibba043.dnkmem (mgr.34373) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:21 gibba003 bash[31385]: cluster 2021-03-10T17:00:21.500960+0000 mgr.gibba043.dnkmem (mgr.34373) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:21.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:21 gibba003 bash[32348]: cluster 2021-03-10T17:00:21.500960+0000 mgr.gibba043.dnkmem (mgr.34373) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:21 gibba043 bash[24019]: cluster 2021-03-10T17:00:21.500960+0000 mgr.gibba043.dnkmem (mgr.34373) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:23.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:23 gibba043 bash[24019]: audit 2021-03-10T17:00:22.605835+0000 mon.c (mon.1) 2568 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:00:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:23 gibba003 bash[31385]: audit 2021-03-10T17:00:22.605835+0000 mon.c (mon.1) 2568 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:00:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:23 gibba003 bash[32348]: audit 2021-03-10T17:00:22.605835+0000 mon.c (mon.1) 2568 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:00:24.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:24 gibba043 bash[24019]: cephadm 2021-03-10T17:00:22.602102+0000 mgr.gibba043.dnkmem (mgr.34373) 9972 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:00:24.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:24 gibba043 bash[24019]: cluster 2021-03-10T17:00:23.502499+0000 mgr.gibba043.dnkmem (mgr.34373) 9973 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:24.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:24 gibba003 bash[31385]: cephadm 2021-03-10T17:00:22.602102+0000 mgr.gibba043.dnkmem (mgr.34373) 9972 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:00:24.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:24 gibba003 bash[31385]: cluster 2021-03-10T17:00:23.502499+0000 mgr.gibba043.dnkmem (mgr.34373) 9973 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:24.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:24 gibba003 bash[32348]: cephadm 2021-03-10T17:00:22.602102+0000 mgr.gibba043.dnkmem (mgr.34373) 9972 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:00:24.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:24 gibba003 bash[32348]: cluster 2021-03-10T17:00:23.502499+0000 mgr.gibba043.dnkmem (mgr.34373) 9973 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:25 gibba003 bash[31385]: cluster 2021-03-10T17:00:25.503036+0000 mgr.gibba043.dnkmem (mgr.34373) 9974 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:25 gibba003 bash[32348]: cluster 2021-03-10T17:00:25.503036+0000 mgr.gibba043.dnkmem (mgr.34373) 9974 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:25 gibba043 bash[24019]: cluster 2021-03-10T17:00:25.503036+0000 mgr.gibba043.dnkmem (mgr.34373) 9974 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.310656+0000 mgr.gibba043.dnkmem (mgr.34373) 9975 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:00:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.311151+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:00:27.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.512203+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:00:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.514040+0000 mgr.gibba043.dnkmem (mgr.34373) 9976 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.516793+0000 mon.c (mon.1) 2569 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.517189+0000 mgr.gibba043.dnkmem (mgr.34373) 9977 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:27.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.519467+0000 mon.c (mon.1) 2570 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.519783+0000 mgr.gibba043.dnkmem (mgr.34373) 9978 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.519821+0000 mgr.gibba043.dnkmem (mgr.34373) 9979 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.522174+0000 mgr.gibba043.dnkmem (mgr.34373) 9980 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.522194+0000 mon.c (mon.1) 2571 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.522212+0000 mgr.gibba043.dnkmem (mgr.34373) 9981 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.524464+0000 mon.c (mon.1) 2572 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.524833+0000 mgr.gibba043.dnkmem (mgr.34373) 9982 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:27.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.528449+0000 mgr.gibba043.dnkmem (mgr.34373) 9983 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.528485+0000 mgr.gibba043.dnkmem (mgr.34373) 9984 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.530869+0000 mon.c (mon.1) 2573 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[31385]: audit 2021-03-10T17:00:26.534270+0000 mon.c (mon.1) 2574 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.310656+0000 mgr.gibba043.dnkmem (mgr.34373) 9975 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:00:27.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.311151+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:00:27.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.512203+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:00:27.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.514040+0000 mgr.gibba043.dnkmem (mgr.34373) 9976 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:27.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.516793+0000 mon.c (mon.1) 2569 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:27.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.517189+0000 mgr.gibba043.dnkmem (mgr.34373) 9977 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:27.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.519467+0000 mon.c (mon.1) 2570 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.519783+0000 mgr.gibba043.dnkmem (mgr.34373) 9978 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:27.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.519821+0000 mgr.gibba043.dnkmem (mgr.34373) 9979 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.522174+0000 mgr.gibba043.dnkmem (mgr.34373) 9980 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.522194+0000 mon.c (mon.1) 2571 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.522212+0000 mgr.gibba043.dnkmem (mgr.34373) 9981 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.524464+0000 mon.c (mon.1) 2572 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.524833+0000 mgr.gibba043.dnkmem (mgr.34373) 9982 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.528449+0000 mgr.gibba043.dnkmem (mgr.34373) 9983 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:27.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.528485+0000 mgr.gibba043.dnkmem (mgr.34373) 9984 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.530869+0000 mon.c (mon.1) 2573 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:27 gibba003 bash[32348]: audit 2021-03-10T17:00:26.534270+0000 mon.c (mon.1) 2574 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.310656+0000 mgr.gibba043.dnkmem (mgr.34373) 9975 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:00:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.311151+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:00:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.512203+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:00:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.514040+0000 mgr.gibba043.dnkmem (mgr.34373) 9976 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.516793+0000 mon.c (mon.1) 2569 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.517189+0000 mgr.gibba043.dnkmem (mgr.34373) 9977 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.519467+0000 mon.c (mon.1) 2570 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.519783+0000 mgr.gibba043.dnkmem (mgr.34373) 9978 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.519821+0000 mgr.gibba043.dnkmem (mgr.34373) 9979 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:27.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.522174+0000 mgr.gibba043.dnkmem (mgr.34373) 9980 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.522194+0000 mon.c (mon.1) 2571 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.522212+0000 mgr.gibba043.dnkmem (mgr.34373) 9981 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.524464+0000 mon.c (mon.1) 2572 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.524833+0000 mgr.gibba043.dnkmem (mgr.34373) 9982 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.528449+0000 mgr.gibba043.dnkmem (mgr.34373) 9983 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.528485+0000 mgr.gibba043.dnkmem (mgr.34373) 9984 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.530869+0000 mon.c (mon.1) 2573 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:27.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:27 gibba043 bash[24019]: audit 2021-03-10T17:00:26.534270+0000 mon.c (mon.1) 2574 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:28.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.531535+0000 mgr.gibba043.dnkmem (mgr.34373) 9985 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:28.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.531998+0000 mgr.gibba043.dnkmem (mgr.34373) 9986 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:28.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.534258+0000 mgr.gibba043.dnkmem (mgr.34373) 9987 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:28.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.534298+0000 mgr.gibba043.dnkmem (mgr.34373) 9988 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:28.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[31385]: cephadm 2021-03-10T17:00:26.534416+0000 mgr.gibba043.dnkmem (mgr.34373) 9989 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:28.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[31385]: cluster 2021-03-10T17:00:27.504593+0000 mgr.gibba043.dnkmem (mgr.34373) 9990 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:28.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.531535+0000 mgr.gibba043.dnkmem (mgr.34373) 9985 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:28.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.531998+0000 mgr.gibba043.dnkmem (mgr.34373) 9986 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:28.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.534258+0000 mgr.gibba043.dnkmem (mgr.34373) 9987 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:28.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.534298+0000 mgr.gibba043.dnkmem (mgr.34373) 9988 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:28.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[32348]: cephadm 2021-03-10T17:00:26.534416+0000 mgr.gibba043.dnkmem (mgr.34373) 9989 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:28.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:28 gibba003 bash[32348]: cluster 2021-03-10T17:00:27.504593+0000 mgr.gibba043.dnkmem (mgr.34373) 9990 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:28.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:28 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.531535+0000 mgr.gibba043.dnkmem (mgr.34373) 9985 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:28 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.531998+0000 mgr.gibba043.dnkmem (mgr.34373) 9986 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:28 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.534258+0000 mgr.gibba043.dnkmem (mgr.34373) 9987 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:28 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.534298+0000 mgr.gibba043.dnkmem (mgr.34373) 9988 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:28.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:28 gibba043 bash[24019]: cephadm 2021-03-10T17:00:26.534416+0000 mgr.gibba043.dnkmem (mgr.34373) 9989 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:28.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:28 gibba043 bash[24019]: cluster 2021-03-10T17:00:27.504593+0000 mgr.gibba043.dnkmem (mgr.34373) 9990 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:29 gibba003 bash[31385]: cluster 2021-03-10T17:00:29.506315+0000 mgr.gibba043.dnkmem (mgr.34373) 9991 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:29 gibba003 bash[32348]: cluster 2021-03-10T17:00:29.506315+0000 mgr.gibba043.dnkmem (mgr.34373) 9991 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:29 gibba043 bash[24019]: cluster 2021-03-10T17:00:29.506315+0000 mgr.gibba043.dnkmem (mgr.34373) 9991 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:30.830 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:00:31.059 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:00:31.060 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 68s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:00:31.060 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:00:31.060 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:00:31.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:00:31.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:00:31.061 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:00:31.061 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:00:31.062 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:00:31.062 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 68s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:00:31.062 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:00:31.062 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:00:31.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:00:31.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:00:31.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 68s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:00:31.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:00:31.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:00:31.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:00:31.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:00:31.064 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:00:31.064 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 68s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:00:31.309 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:00:31.309 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:00:31.309 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:31.310 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:00:31.310 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:00:31.310 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:31.310 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:00:31.311 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:00:31.311 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:00:31.311 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:00:31.312 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:00:31.312 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:00:31.312 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:00:31.312 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:00:31.313 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:00:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:31 gibba003 bash[31385]: audit 2021-03-10T17:00:31.310749+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.103:0/4027288647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:31.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:31 gibba003 bash[32348]: audit 2021-03-10T17:00:31.310749+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.103:0/4027288647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:31 gibba043 bash[24019]: audit 2021-03-10T17:00:31.310749+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.103:0/4027288647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:32.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:32 gibba003 bash[31385]: audit 2021-03-10T17:00:30.821327+0000 mgr.gibba043.dnkmem (mgr.34373) 9992 : audit [DBG] from='client.50745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:32.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:32 gibba003 bash[31385]: audit 2021-03-10T17:00:31.046711+0000 mgr.gibba043.dnkmem (mgr.34373) 9993 : audit [DBG] from='client.50751 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:32.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:32 gibba003 bash[31385]: cluster 2021-03-10T17:00:31.508064+0000 mgr.gibba043.dnkmem (mgr.34373) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:32.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:32 gibba003 bash[32348]: audit 2021-03-10T17:00:30.821327+0000 mgr.gibba043.dnkmem (mgr.34373) 9992 : audit [DBG] from='client.50745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:32.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:32 gibba003 bash[32348]: audit 2021-03-10T17:00:31.046711+0000 mgr.gibba043.dnkmem (mgr.34373) 9993 : audit [DBG] from='client.50751 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:32.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:32 gibba003 bash[32348]: cluster 2021-03-10T17:00:31.508064+0000 mgr.gibba043.dnkmem (mgr.34373) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:32 gibba043 bash[24019]: audit 2021-03-10T17:00:30.821327+0000 mgr.gibba043.dnkmem (mgr.34373) 9992 : audit [DBG] from='client.50745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:32.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:32 gibba043 bash[24019]: audit 2021-03-10T17:00:31.046711+0000 mgr.gibba043.dnkmem (mgr.34373) 9993 : audit [DBG] from='client.50751 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:32.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:32 gibba043 bash[24019]: cluster 2021-03-10T17:00:31.508064+0000 mgr.gibba043.dnkmem (mgr.34373) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:33 gibba003 bash[31385]: cluster 2021-03-10T17:00:33.509597+0000 mgr.gibba043.dnkmem (mgr.34373) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:33 gibba003 bash[32348]: cluster 2021-03-10T17:00:33.509597+0000 mgr.gibba043.dnkmem (mgr.34373) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:33 gibba043 bash[24019]: cluster 2021-03-10T17:00:33.509597+0000 mgr.gibba043.dnkmem (mgr.34373) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:35 gibba003 bash[31385]: cluster 2021-03-10T17:00:35.511039+0000 mgr.gibba043.dnkmem (mgr.34373) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:35 gibba003 bash[32348]: cluster 2021-03-10T17:00:35.511039+0000 mgr.gibba043.dnkmem (mgr.34373) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:35 gibba043 bash[24019]: cluster 2021-03-10T17:00:35.511039+0000 mgr.gibba043.dnkmem (mgr.34373) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:38.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:38 gibba043 bash[24019]: cluster 2021-03-10T17:00:37.512757+0000 mgr.gibba043.dnkmem (mgr.34373) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:38.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:38 gibba003 bash[31385]: cluster 2021-03-10T17:00:37.512757+0000 mgr.gibba043.dnkmem (mgr.34373) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:38.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:38 gibba003 bash[32348]: cluster 2021-03-10T17:00:37.512757+0000 mgr.gibba043.dnkmem (mgr.34373) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:39 gibba003 bash[31385]: cluster 2021-03-10T17:00:39.514404+0000 mgr.gibba043.dnkmem (mgr.34373) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:39 gibba003 bash[32348]: cluster 2021-03-10T17:00:39.514404+0000 mgr.gibba043.dnkmem (mgr.34373) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:39 gibba043 bash[24019]: cluster 2021-03-10T17:00:39.514404+0000 mgr.gibba043.dnkmem (mgr.34373) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:41 gibba003 bash[31385]: cluster 2021-03-10T17:00:41.515406+0000 mgr.gibba043.dnkmem (mgr.34373) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:41.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:41 gibba003 bash[32348]: cluster 2021-03-10T17:00:41.515406+0000 mgr.gibba043.dnkmem (mgr.34373) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:42.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:41 gibba043 bash[24019]: cluster 2021-03-10T17:00:41.515406+0000 mgr.gibba043.dnkmem (mgr.34373) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:43.520 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:43 gibba043 bash[24019]: cephadm 2021-03-10T17:00:41.550092+0000 mgr.gibba043.dnkmem (mgr.34373) 10000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:43 gibba003 bash[31385]: cephadm 2021-03-10T17:00:41.550092+0000 mgr.gibba043.dnkmem (mgr.34373) 10000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:43 gibba003 bash[32348]: cephadm 2021-03-10T17:00:41.550092+0000 mgr.gibba043.dnkmem (mgr.34373) 10000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:44.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:44 gibba003 bash[31385]: cluster 2021-03-10T17:00:43.516991+0000 mgr.gibba043.dnkmem (mgr.34373) 10001 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:44.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:44 gibba003 bash[32348]: cluster 2021-03-10T17:00:43.516991+0000 mgr.gibba043.dnkmem (mgr.34373) 10001 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:44.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:44 gibba043 bash[24019]: cluster 2021-03-10T17:00:43.516991+0000 mgr.gibba043.dnkmem (mgr.34373) 10001 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:45 gibba003 bash[31385]: cluster 2021-03-10T17:00:45.518325+0000 mgr.gibba043.dnkmem (mgr.34373) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:45 gibba003 bash[32348]: cluster 2021-03-10T17:00:45.518325+0000 mgr.gibba043.dnkmem (mgr.34373) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:46.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:45 gibba043 bash[24019]: cluster 2021-03-10T17:00:45.518325+0000 mgr.gibba043.dnkmem (mgr.34373) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:48.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:48 gibba003 bash[31385]: cluster 2021-03-10T17:00:47.519975+0000 mgr.gibba043.dnkmem (mgr.34373) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:48.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:48 gibba003 bash[32348]: cluster 2021-03-10T17:00:47.519975+0000 mgr.gibba043.dnkmem (mgr.34373) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:48.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:48 gibba043 bash[24019]: cluster 2021-03-10T17:00:47.519975+0000 mgr.gibba043.dnkmem (mgr.34373) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:49 gibba003 bash[31385]: cluster 2021-03-10T17:00:49.521710+0000 mgr.gibba043.dnkmem (mgr.34373) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:49 gibba003 bash[32348]: cluster 2021-03-10T17:00:49.521710+0000 mgr.gibba043.dnkmem (mgr.34373) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:50.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:49 gibba043 bash[24019]: cluster 2021-03-10T17:00:49.521710+0000 mgr.gibba043.dnkmem (mgr.34373) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:51 gibba003 bash[31385]: cluster 2021-03-10T17:00:51.522349+0000 mgr.gibba043.dnkmem (mgr.34373) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:51.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:51 gibba003 bash[32348]: cluster 2021-03-10T17:00:51.522349+0000 mgr.gibba043.dnkmem (mgr.34373) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:51 gibba043 bash[24019]: cluster 2021-03-10T17:00:51.522349+0000 mgr.gibba043.dnkmem (mgr.34373) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:53 gibba003 bash[31385]: cluster 2021-03-10T17:00:53.523927+0000 mgr.gibba043.dnkmem (mgr.34373) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:53.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:53 gibba003 bash[32348]: cluster 2021-03-10T17:00:53.523927+0000 mgr.gibba043.dnkmem (mgr.34373) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:53 gibba043 bash[24019]: cluster 2021-03-10T17:00:53.523927+0000 mgr.gibba043.dnkmem (mgr.34373) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:55 gibba003 bash[31385]: cluster 2021-03-10T17:00:55.525265+0000 mgr.gibba043.dnkmem (mgr.34373) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:55 gibba003 bash[32348]: cluster 2021-03-10T17:00:55.525265+0000 mgr.gibba043.dnkmem (mgr.34373) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:55 gibba043 bash[24019]: cluster 2021-03-10T17:00:55.525265+0000 mgr.gibba043.dnkmem (mgr.34373) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:58 gibba003 bash[31385]: cephadm 2021-03-10T17:00:56.557078+0000 mgr.gibba043.dnkmem (mgr.34373) 10008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:58 gibba003 bash[31385]: cluster 2021-03-10T17:00:57.526983+0000 mgr.gibba043.dnkmem (mgr.34373) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:58.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:58 gibba003 bash[32348]: cephadm 2021-03-10T17:00:56.557078+0000 mgr.gibba043.dnkmem (mgr.34373) 10008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:58.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:58 gibba003 bash[32348]: cluster 2021-03-10T17:00:57.526983+0000 mgr.gibba043.dnkmem (mgr.34373) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:58 gibba043 bash[24019]: cephadm 2021-03-10T17:00:56.557078+0000 mgr.gibba043.dnkmem (mgr.34373) 10008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:00:58.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:58 gibba043 bash[24019]: cluster 2021-03-10T17:00:57.526983+0000 mgr.gibba043.dnkmem (mgr.34373) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:00:59 gibba003 bash[31385]: cluster 2021-03-10T17:00:59.528704+0000 mgr.gibba043.dnkmem (mgr.34373) 10010 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:00:59 gibba003 bash[32348]: cluster 2021-03-10T17:00:59.528704+0000 mgr.gibba043.dnkmem (mgr.34373) 10010 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:00:59 gibba043 bash[24019]: cluster 2021-03-10T17:00:59.528704+0000 mgr.gibba043.dnkmem (mgr.34373) 10010 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:01.560 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:01:01.793 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:01:01.793 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 99s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:01:01.793 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 35s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:01:01.794 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:01:01.794 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:01:01.794 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:01:01.794 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:01:01.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:01:01.795 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:01:01.795 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 99s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:01:01.795 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 35s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:01:01.795 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:01:01.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:01:01.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:01:01.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:01:01.796 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:01:01.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:01:01.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:01:01.797 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:01:01.797 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 35s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:01:01.798 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 99s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:01:01.938 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:01 gibba003 bash[31385]: cluster 2021-03-10T17:01:01.529938+0000 mgr.gibba043.dnkmem (mgr.34373) 10011 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:01.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:01 gibba003 bash[32348]: cluster 2021-03-10T17:01:01.529938+0000 mgr.gibba043.dnkmem (mgr.34373) 10011 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:01 gibba043 bash[24019]: cluster 2021-03-10T17:01:01.529938+0000 mgr.gibba043.dnkmem (mgr.34373) 10011 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:02.044 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:01:02.044 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:01:02.044 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:02.044 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:01:02.045 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:01:02.045 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:02.045 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:01:02.045 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:01:02.046 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:01:02.046 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:01:02.046 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:01:02.046 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:01:02.047 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:01:02.047 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:01:02.047 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:01:02.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:02 gibba003 bash[31385]: audit 2021-03-10T17:01:01.551948+0000 mgr.gibba043.dnkmem (mgr.34373) 10012 : audit [DBG] from='client.60754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:02 gibba003 bash[31385]: audit 2021-03-10T17:01:01.780373+0000 mgr.gibba043.dnkmem (mgr.34373) 10013 : audit [DBG] from='client.60760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:02 gibba003 bash[31385]: audit 2021-03-10T17:01:02.045748+0000 mon.c (mon.1) 2575 : audit [DBG] from='client.? 172.21.2.103:0/3779553711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:02.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:02 gibba003 bash[32348]: audit 2021-03-10T17:01:01.551948+0000 mgr.gibba043.dnkmem (mgr.34373) 10012 : audit [DBG] from='client.60754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:02.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:02 gibba003 bash[32348]: audit 2021-03-10T17:01:01.780373+0000 mgr.gibba043.dnkmem (mgr.34373) 10013 : audit [DBG] from='client.60760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:02.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:02 gibba003 bash[32348]: audit 2021-03-10T17:01:02.045748+0000 mon.c (mon.1) 2575 : audit [DBG] from='client.? 172.21.2.103:0/3779553711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:03.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:02 gibba043 bash[24019]: audit 2021-03-10T17:01:01.551948+0000 mgr.gibba043.dnkmem (mgr.34373) 10012 : audit [DBG] from='client.60754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:02 gibba043 bash[24019]: audit 2021-03-10T17:01:01.780373+0000 mgr.gibba043.dnkmem (mgr.34373) 10013 : audit [DBG] from='client.60760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:02 gibba043 bash[24019]: audit 2021-03-10T17:01:02.045748+0000 mon.c (mon.1) 2575 : audit [DBG] from='client.? 172.21.2.103:0/3779553711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:03 gibba003 bash[31385]: cluster 2021-03-10T17:01:03.531522+0000 mgr.gibba043.dnkmem (mgr.34373) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:03 gibba003 bash[32348]: cluster 2021-03-10T17:01:03.531522+0000 mgr.gibba043.dnkmem (mgr.34373) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:03 gibba043 bash[24019]: cluster 2021-03-10T17:01:03.531522+0000 mgr.gibba043.dnkmem (mgr.34373) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:05 gibba003 bash[31385]: cluster 2021-03-10T17:01:05.533107+0000 mgr.gibba043.dnkmem (mgr.34373) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:05 gibba003 bash[32348]: cluster 2021-03-10T17:01:05.533107+0000 mgr.gibba043.dnkmem (mgr.34373) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:05 gibba043 bash[24019]: cluster 2021-03-10T17:01:05.533107+0000 mgr.gibba043.dnkmem (mgr.34373) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:08.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:08 gibba003 bash[31385]: cluster 2021-03-10T17:01:07.534807+0000 mgr.gibba043.dnkmem (mgr.34373) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:08.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:08 gibba003 bash[32348]: cluster 2021-03-10T17:01:07.534807+0000 mgr.gibba043.dnkmem (mgr.34373) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:08.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:08 gibba043 bash[24019]: cluster 2021-03-10T17:01:07.534807+0000 mgr.gibba043.dnkmem (mgr.34373) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:09 gibba003 bash[31385]: cluster 2021-03-10T17:01:09.536370+0000 mgr.gibba043.dnkmem (mgr.34373) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:09 gibba003 bash[32348]: cluster 2021-03-10T17:01:09.536370+0000 mgr.gibba043.dnkmem (mgr.34373) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:09 gibba043 bash[24019]: cluster 2021-03-10T17:01:09.536370+0000 mgr.gibba043.dnkmem (mgr.34373) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:11 gibba003 bash[31385]: cluster 2021-03-10T17:01:11.537419+0000 mgr.gibba043.dnkmem (mgr.34373) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:11 gibba003 bash[32348]: cluster 2021-03-10T17:01:11.537419+0000 mgr.gibba043.dnkmem (mgr.34373) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:11 gibba043 bash[24019]: cluster 2021-03-10T17:01:11.537419+0000 mgr.gibba043.dnkmem (mgr.34373) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:13.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:13 gibba003 bash[31385]: cephadm 2021-03-10T17:01:11.573060+0000 mgr.gibba043.dnkmem (mgr.34373) 10019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:13.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:13 gibba003 bash[32348]: cephadm 2021-03-10T17:01:11.573060+0000 mgr.gibba043.dnkmem (mgr.34373) 10019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:13 gibba043 bash[24019]: cephadm 2021-03-10T17:01:11.573060+0000 mgr.gibba043.dnkmem (mgr.34373) 10019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:14.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[31385]: cluster 2021-03-10T17:01:13.538781+0000 mgr.gibba043.dnkmem (mgr.34373) 10020 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[31385]: audit 2021-03-10T17:01:13.938630+0000 mon.c (mon.1) 2576 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[31385]: audit 2021-03-10T17:01:13.939765+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[31385]: audit 2021-03-10T17:01:14.173319+0000 mon.c (mon.1) 2577 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:14.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[31385]: audit 2021-03-10T17:01:14.174434+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[32348]: cluster 2021-03-10T17:01:13.538781+0000 mgr.gibba043.dnkmem (mgr.34373) 10020 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[32348]: audit 2021-03-10T17:01:13.938630+0000 mon.c (mon.1) 2576 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[32348]: audit 2021-03-10T17:01:13.939765+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:14.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[32348]: audit 2021-03-10T17:01:14.173319+0000 mon.c (mon.1) 2577 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:14.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:14 gibba003 bash[32348]: audit 2021-03-10T17:01:14.174434+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:14 gibba043 bash[24019]: cluster 2021-03-10T17:01:13.538781+0000 mgr.gibba043.dnkmem (mgr.34373) 10020 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:14 gibba043 bash[24019]: audit 2021-03-10T17:01:13.938630+0000 mon.c (mon.1) 2576 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:14 gibba043 bash[24019]: audit 2021-03-10T17:01:13.939765+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:14 gibba043 bash[24019]: audit 2021-03-10T17:01:14.173319+0000 mon.c (mon.1) 2577 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:14 gibba043 bash[24019]: audit 2021-03-10T17:01:14.174434+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:15.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.476614+0000 mon.c (mon.1) 2578 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:01:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.477379+0000 mon.c (mon.1) 2579 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.477985+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:01:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.478525+0000 mon.c (mon.1) 2580 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.480008+0000 mon.c (mon.1) 2581 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:01:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.480241+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.481804+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[31385]: audit 2021-03-10T17:01:14.481990+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:01:15.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.476614+0000 mon.c (mon.1) 2578 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:01:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.477379+0000 mon.c (mon.1) 2579 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.477985+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:01:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.478525+0000 mon.c (mon.1) 2580 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.480008+0000 mon.c (mon.1) 2581 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:01:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.480241+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.481804+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:15 gibba003 bash[32348]: audit 2021-03-10T17:01:14.481990+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:01:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.476614+0000 mon.c (mon.1) 2578 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:01:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.477379+0000 mon.c (mon.1) 2579 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.477985+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:01:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.478525+0000 mon.c (mon.1) 2580 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.480008+0000 mon.c (mon.1) 2581 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:01:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.480241+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.481804+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:15.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:15 gibba043 bash[24019]: audit 2021-03-10T17:01:14.481990+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:01:16.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:16 gibba003 bash[31385]: cluster 2021-03-10T17:01:15.540114+0000 mgr.gibba043.dnkmem (mgr.34373) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:16.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:16 gibba003 bash[32348]: cluster 2021-03-10T17:01:15.540114+0000 mgr.gibba043.dnkmem (mgr.34373) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:16.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:16 gibba043 bash[24019]: cluster 2021-03-10T17:01:15.540114+0000 mgr.gibba043.dnkmem (mgr.34373) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:18 gibba003 bash[31385]: cluster 2021-03-10T17:01:17.541761+0000 mgr.gibba043.dnkmem (mgr.34373) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:18 gibba003 bash[32348]: cluster 2021-03-10T17:01:17.541761+0000 mgr.gibba043.dnkmem (mgr.34373) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:18 gibba043 bash[24019]: cluster 2021-03-10T17:01:17.541761+0000 mgr.gibba043.dnkmem (mgr.34373) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:19 gibba003 bash[31385]: cluster 2021-03-10T17:01:19.543431+0000 mgr.gibba043.dnkmem (mgr.34373) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:19 gibba003 bash[32348]: cluster 2021-03-10T17:01:19.543431+0000 mgr.gibba043.dnkmem (mgr.34373) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:19 gibba043 bash[24019]: cluster 2021-03-10T17:01:19.543431+0000 mgr.gibba043.dnkmem (mgr.34373) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:21 gibba003 bash[31385]: cluster 2021-03-10T17:01:21.544616+0000 mgr.gibba043.dnkmem (mgr.34373) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:21 gibba003 bash[32348]: cluster 2021-03-10T17:01:21.544616+0000 mgr.gibba043.dnkmem (mgr.34373) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:21 gibba043 bash[24019]: cluster 2021-03-10T17:01:21.544616+0000 mgr.gibba043.dnkmem (mgr.34373) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:23 gibba003 bash[31385]: cluster 2021-03-10T17:01:23.545928+0000 mgr.gibba043.dnkmem (mgr.34373) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:23 gibba003 bash[32348]: cluster 2021-03-10T17:01:23.545928+0000 mgr.gibba043.dnkmem (mgr.34373) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:24.019 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:23 gibba043 bash[24019]: cluster 2021-03-10T17:01:23.545928+0000 mgr.gibba043.dnkmem (mgr.34373) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:26.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:26 gibba003 bash[31385]: cluster 2021-03-10T17:01:25.547523+0000 mgr.gibba043.dnkmem (mgr.34373) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:26.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:26 gibba003 bash[32348]: cluster 2021-03-10T17:01:25.547523+0000 mgr.gibba043.dnkmem (mgr.34373) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:27.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:26 gibba043 bash[24019]: cluster 2021-03-10T17:01:25.547523+0000 mgr.gibba043.dnkmem (mgr.34373) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.589921+0000 mgr.gibba043.dnkmem (mgr.34373) 10027 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:01:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.591497+0000 mgr.gibba043.dnkmem (mgr.34373) 10028 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:01:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.815881+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:01:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.817087+0000 mgr.gibba043.dnkmem (mgr.34373) 10029 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.818960+0000 mgr.gibba043.dnkmem (mgr.34373) 10030 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:28.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.819609+0000 mon.c (mon.1) 2582 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:28.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.820158+0000 mgr.gibba043.dnkmem (mgr.34373) 10031 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:28.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.820196+0000 mgr.gibba043.dnkmem (mgr.34373) 10032 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:28.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.821149+0000 mon.c (mon.1) 2583 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.821251+0000 mgr.gibba043.dnkmem (mgr.34373) 10033 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.821285+0000 mgr.gibba043.dnkmem (mgr.34373) 10034 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:28.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.822181+0000 mon.c (mon.1) 2584 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.822224+0000 mgr.gibba043.dnkmem (mgr.34373) 10035 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:28.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.823243+0000 mon.c (mon.1) 2585 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.823537+0000 mgr.gibba043.dnkmem (mgr.34373) 10036 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:28.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.823580+0000 mgr.gibba043.dnkmem (mgr.34373) 10037 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:28.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.824920+0000 mgr.gibba043.dnkmem (mgr.34373) 10038 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.825231+0000 mgr.gibba043.dnkmem (mgr.34373) 10039 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.825908+0000 mon.c (mon.1) 2586 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.826312+0000 mgr.gibba043.dnkmem (mgr.34373) 10040 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:28.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.826356+0000 mgr.gibba043.dnkmem (mgr.34373) 10041 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:28.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: cephadm 2021-03-10T17:01:26.826459+0000 mgr.gibba043.dnkmem (mgr.34373) 10042 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:28.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[31385]: audit 2021-03-10T17:01:26.827325+0000 mon.c (mon.1) 2587 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.589921+0000 mgr.gibba043.dnkmem (mgr.34373) 10027 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:01:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.591497+0000 mgr.gibba043.dnkmem (mgr.34373) 10028 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:01:28.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.815881+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:01:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.817087+0000 mgr.gibba043.dnkmem (mgr.34373) 10029 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.818960+0000 mgr.gibba043.dnkmem (mgr.34373) 10030 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:28.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.819609+0000 mon.c (mon.1) 2582 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.820158+0000 mgr.gibba043.dnkmem (mgr.34373) 10031 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.820196+0000 mgr.gibba043.dnkmem (mgr.34373) 10032 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.821149+0000 mon.c (mon.1) 2583 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.821251+0000 mgr.gibba043.dnkmem (mgr.34373) 10033 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:28.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.821285+0000 mgr.gibba043.dnkmem (mgr.34373) 10034 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:28.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.822181+0000 mon.c (mon.1) 2584 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.822224+0000 mgr.gibba043.dnkmem (mgr.34373) 10035 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:28.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.823243+0000 mon.c (mon.1) 2585 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.823537+0000 mgr.gibba043.dnkmem (mgr.34373) 10036 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:28.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.823580+0000 mgr.gibba043.dnkmem (mgr.34373) 10037 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:28.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.824920+0000 mgr.gibba043.dnkmem (mgr.34373) 10038 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:28.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.825231+0000 mgr.gibba043.dnkmem (mgr.34373) 10039 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:28.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.825908+0000 mon.c (mon.1) 2586 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.826312+0000 mgr.gibba043.dnkmem (mgr.34373) 10040 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:28.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.826356+0000 mgr.gibba043.dnkmem (mgr.34373) 10041 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:28.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: cephadm 2021-03-10T17:01:26.826459+0000 mgr.gibba043.dnkmem (mgr.34373) 10042 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:28.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:27 gibba003 bash[32348]: audit 2021-03-10T17:01:26.827325+0000 mon.c (mon.1) 2587 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.589921+0000 mgr.gibba043.dnkmem (mgr.34373) 10027 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:01:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.591497+0000 mgr.gibba043.dnkmem (mgr.34373) 10028 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:01:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.815881+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:01:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.817087+0000 mgr.gibba043.dnkmem (mgr.34373) 10029 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.818960+0000 mgr.gibba043.dnkmem (mgr.34373) 10030 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.819609+0000 mon.c (mon.1) 2582 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.820158+0000 mgr.gibba043.dnkmem (mgr.34373) 10031 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.820196+0000 mgr.gibba043.dnkmem (mgr.34373) 10032 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.821149+0000 mon.c (mon.1) 2583 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.821251+0000 mgr.gibba043.dnkmem (mgr.34373) 10033 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:28.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.821285+0000 mgr.gibba043.dnkmem (mgr.34373) 10034 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.822181+0000 mon.c (mon.1) 2584 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.822224+0000 mgr.gibba043.dnkmem (mgr.34373) 10035 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.823243+0000 mon.c (mon.1) 2585 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.823537+0000 mgr.gibba043.dnkmem (mgr.34373) 10036 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.823580+0000 mgr.gibba043.dnkmem (mgr.34373) 10037 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.824920+0000 mgr.gibba043.dnkmem (mgr.34373) 10038 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.825231+0000 mgr.gibba043.dnkmem (mgr.34373) 10039 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.825908+0000 mon.c (mon.1) 2586 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:28.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.826312+0000 mgr.gibba043.dnkmem (mgr.34373) 10040 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.826356+0000 mgr.gibba043.dnkmem (mgr.34373) 10041 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: cephadm 2021-03-10T17:01:26.826459+0000 mgr.gibba043.dnkmem (mgr.34373) 10042 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:28.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:27 gibba043 bash[24019]: audit 2021-03-10T17:01:26.827325+0000 mon.c (mon.1) 2587 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:29.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:29 gibba003 bash[31385]: cluster 2021-03-10T17:01:27.549100+0000 mgr.gibba043.dnkmem (mgr.34373) 10043 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:29.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:29 gibba003 bash[32348]: cluster 2021-03-10T17:01:27.549100+0000 mgr.gibba043.dnkmem (mgr.34373) 10043 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:29.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:29 gibba043 bash[24019]: cluster 2021-03-10T17:01:27.549100+0000 mgr.gibba043.dnkmem (mgr.34373) 10043 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:31 gibba003 bash[31385]: cluster 2021-03-10T17:01:29.550597+0000 mgr.gibba043.dnkmem (mgr.34373) 10044 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:31 gibba003 bash[32348]: cluster 2021-03-10T17:01:29.550597+0000 mgr.gibba043.dnkmem (mgr.34373) 10044 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:31 gibba043 bash[24019]: cluster 2021-03-10T17:01:29.550597+0000 mgr.gibba043.dnkmem (mgr.34373) 10044 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:32.288 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:01:32.520 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:01:32.521 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:01:32.521 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 66s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:01:32.521 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:01:32.521 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:01:32.522 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:01:32.522 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:01:32.522 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:01:32.522 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:01:32.522 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:01:32.523 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 66s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:01:32.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:01:32.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:01:32.523 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:01:32.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:01:32.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:01:32.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:01:32.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:01:32.524 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:01:32.525 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 66s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:01:32.525 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:01:32.769 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:01:32.769 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:01:32.769 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:32.770 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:01:32.770 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:01:32.770 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:32.771 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:01:32.771 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:01:32.771 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:01:32.771 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:01:32.772 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:01:32.772 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:01:32.772 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:01:32.772 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:01:32.772 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:01:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[31385]: cluster 2021-03-10T17:01:31.551883+0000 mgr.gibba043.dnkmem (mgr.34373) 10045 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[31385]: audit 2021-03-10T17:01:32.279526+0000 mgr.gibba043.dnkmem (mgr.34373) 10046 : audit [DBG] from='client.50781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:33.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[31385]: audit 2021-03-10T17:01:32.508145+0000 mgr.gibba043.dnkmem (mgr.34373) 10047 : audit [DBG] from='client.60778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:33.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[31385]: audit 2021-03-10T17:01:32.770717+0000 mon.c (mon.1) 2588 : audit [DBG] from='client.? 172.21.2.103:0/23139311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[32348]: cluster 2021-03-10T17:01:31.551883+0000 mgr.gibba043.dnkmem (mgr.34373) 10045 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:33.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[32348]: audit 2021-03-10T17:01:32.279526+0000 mgr.gibba043.dnkmem (mgr.34373) 10046 : audit [DBG] from='client.50781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:33.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[32348]: audit 2021-03-10T17:01:32.508145+0000 mgr.gibba043.dnkmem (mgr.34373) 10047 : audit [DBG] from='client.60778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:33.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:33 gibba003 bash[32348]: audit 2021-03-10T17:01:32.770717+0000 mon.c (mon.1) 2588 : audit [DBG] from='client.? 172.21.2.103:0/23139311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:33 gibba043 bash[24019]: cluster 2021-03-10T17:01:31.551883+0000 mgr.gibba043.dnkmem (mgr.34373) 10045 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:33 gibba043 bash[24019]: audit 2021-03-10T17:01:32.279526+0000 mgr.gibba043.dnkmem (mgr.34373) 10046 : audit [DBG] from='client.50781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:33 gibba043 bash[24019]: audit 2021-03-10T17:01:32.508145+0000 mgr.gibba043.dnkmem (mgr.34373) 10047 : audit [DBG] from='client.60778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:33.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:33 gibba043 bash[24019]: audit 2021-03-10T17:01:32.770717+0000 mon.c (mon.1) 2588 : audit [DBG] from='client.? 172.21.2.103:0/23139311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:35 gibba003 bash[31385]: cluster 2021-03-10T17:01:33.555712+0000 mgr.gibba043.dnkmem (mgr.34373) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:35.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:35 gibba003 bash[32348]: cluster 2021-03-10T17:01:33.555712+0000 mgr.gibba043.dnkmem (mgr.34373) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:35 gibba043 bash[24019]: cluster 2021-03-10T17:01:33.555712+0000 mgr.gibba043.dnkmem (mgr.34373) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:37 gibba003 bash[31385]: cluster 2021-03-10T17:01:35.557079+0000 mgr.gibba043.dnkmem (mgr.34373) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:37 gibba003 bash[32348]: cluster 2021-03-10T17:01:35.557079+0000 mgr.gibba043.dnkmem (mgr.34373) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:37 gibba043 bash[24019]: cluster 2021-03-10T17:01:35.557079+0000 mgr.gibba043.dnkmem (mgr.34373) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:39 gibba003 bash[31385]: cluster 2021-03-10T17:01:37.558718+0000 mgr.gibba043.dnkmem (mgr.34373) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:39 gibba003 bash[32348]: cluster 2021-03-10T17:01:37.558718+0000 mgr.gibba043.dnkmem (mgr.34373) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:39 gibba043 bash[24019]: cluster 2021-03-10T17:01:37.558718+0000 mgr.gibba043.dnkmem (mgr.34373) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:41 gibba003 bash[31385]: cluster 2021-03-10T17:01:39.560394+0000 mgr.gibba043.dnkmem (mgr.34373) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:41 gibba003 bash[32348]: cluster 2021-03-10T17:01:39.560394+0000 mgr.gibba043.dnkmem (mgr.34373) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:41 gibba043 bash[24019]: cluster 2021-03-10T17:01:39.560394+0000 mgr.gibba043.dnkmem (mgr.34373) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:43 gibba003 bash[31385]: cluster 2021-03-10T17:01:41.562195+0000 mgr.gibba043.dnkmem (mgr.34373) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:43 gibba003 bash[31385]: cephadm 2021-03-10T17:01:41.842544+0000 mgr.gibba043.dnkmem (mgr.34373) 10053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:43 gibba003 bash[32348]: cluster 2021-03-10T17:01:41.562195+0000 mgr.gibba043.dnkmem (mgr.34373) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:43 gibba003 bash[32348]: cephadm 2021-03-10T17:01:41.842544+0000 mgr.gibba043.dnkmem (mgr.34373) 10053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:43.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:43 gibba043 bash[24019]: cluster 2021-03-10T17:01:41.562195+0000 mgr.gibba043.dnkmem (mgr.34373) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:43 gibba043 bash[24019]: cephadm 2021-03-10T17:01:41.842544+0000 mgr.gibba043.dnkmem (mgr.34373) 10053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:45.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:45 gibba003 bash[31385]: cluster 2021-03-10T17:01:43.562957+0000 mgr.gibba043.dnkmem (mgr.34373) 10054 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:45.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:45 gibba003 bash[32348]: cluster 2021-03-10T17:01:43.562957+0000 mgr.gibba043.dnkmem (mgr.34373) 10054 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:45 gibba043 bash[24019]: cluster 2021-03-10T17:01:43.562957+0000 mgr.gibba043.dnkmem (mgr.34373) 10054 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:47 gibba003 bash[31385]: cluster 2021-03-10T17:01:45.564589+0000 mgr.gibba043.dnkmem (mgr.34373) 10055 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:47 gibba003 bash[32348]: cluster 2021-03-10T17:01:45.564589+0000 mgr.gibba043.dnkmem (mgr.34373) 10055 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:47 gibba043 bash[24019]: cluster 2021-03-10T17:01:45.564589+0000 mgr.gibba043.dnkmem (mgr.34373) 10055 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:49 gibba003 bash[31385]: cluster 2021-03-10T17:01:47.566276+0000 mgr.gibba043.dnkmem (mgr.34373) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:49 gibba003 bash[32348]: cluster 2021-03-10T17:01:47.566276+0000 mgr.gibba043.dnkmem (mgr.34373) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:49 gibba043 bash[24019]: cluster 2021-03-10T17:01:47.566276+0000 mgr.gibba043.dnkmem (mgr.34373) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:51 gibba003 bash[31385]: cluster 2021-03-10T17:01:49.567998+0000 mgr.gibba043.dnkmem (mgr.34373) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:51 gibba003 bash[32348]: cluster 2021-03-10T17:01:49.567998+0000 mgr.gibba043.dnkmem (mgr.34373) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:51 gibba043 bash[24019]: cluster 2021-03-10T17:01:49.567998+0000 mgr.gibba043.dnkmem (mgr.34373) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:53 gibba003 bash[31385]: cluster 2021-03-10T17:01:51.569640+0000 mgr.gibba043.dnkmem (mgr.34373) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:53.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:53 gibba003 bash[32348]: cluster 2021-03-10T17:01:51.569640+0000 mgr.gibba043.dnkmem (mgr.34373) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:53 gibba043 bash[24019]: cluster 2021-03-10T17:01:51.569640+0000 mgr.gibba043.dnkmem (mgr.34373) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:55 gibba003 bash[31385]: cluster 2021-03-10T17:01:53.570561+0000 mgr.gibba043.dnkmem (mgr.34373) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:55 gibba003 bash[32348]: cluster 2021-03-10T17:01:53.570561+0000 mgr.gibba043.dnkmem (mgr.34373) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:55.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:55 gibba043 bash[24019]: cluster 2021-03-10T17:01:53.570561+0000 mgr.gibba043.dnkmem (mgr.34373) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:57 gibba003 bash[31385]: cluster 2021-03-10T17:01:55.571885+0000 mgr.gibba043.dnkmem (mgr.34373) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:57 gibba003 bash[32348]: cluster 2021-03-10T17:01:55.571885+0000 mgr.gibba043.dnkmem (mgr.34373) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:57 gibba043 bash[24019]: cluster 2021-03-10T17:01:55.571885+0000 mgr.gibba043.dnkmem (mgr.34373) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:58.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:58 gibba003 bash[31385]: cephadm 2021-03-10T17:01:56.858592+0000 mgr.gibba043.dnkmem (mgr.34373) 10061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:58.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:58 gibba003 bash[32348]: cephadm 2021-03-10T17:01:56.858592+0000 mgr.gibba043.dnkmem (mgr.34373) 10061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:58 gibba043 bash[24019]: cephadm 2021-03-10T17:01:56.858592+0000 mgr.gibba043.dnkmem (mgr.34373) 10061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:01:59.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:01:59 gibba003 bash[31385]: cluster 2021-03-10T17:01:57.573605+0000 mgr.gibba043.dnkmem (mgr.34373) 10062 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:59.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:01:59 gibba003 bash[32348]: cluster 2021-03-10T17:01:57.573605+0000 mgr.gibba043.dnkmem (mgr.34373) 10062 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:01:59 gibba043 bash[24019]: cluster 2021-03-10T17:01:57.573605+0000 mgr.gibba043.dnkmem (mgr.34373) 10062 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:01 gibba043 bash[24019]: cluster 2021-03-10T17:01:59.575369+0000 mgr.gibba043.dnkmem (mgr.34373) 10063 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:01 gibba003 bash[31385]: cluster 2021-03-10T17:01:59.575369+0000 mgr.gibba043.dnkmem (mgr.34373) 10063 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:01 gibba003 bash[32348]: cluster 2021-03-10T17:01:59.575369+0000 mgr.gibba043.dnkmem (mgr.34373) 10063 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:03.014 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:02:03.242 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:02:03.243 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:02:03.243 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 96s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:02:03.243 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:02:03.244 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:02:03.244 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:02:03.244 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:02:03.244 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:02:03.244 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:02:03.245 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:02:03.245 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 96s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:02:03.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:02:03.245 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:02:03.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:02:03.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:02:03.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:02:03.246 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:02:03.247 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:02:03.247 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:02:03.247 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 96s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:02:03.247 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:02:03.490 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:02:03.491 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:02:03.491 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:03.491 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:02:03.492 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:02:03.492 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:03.492 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:02:03.492 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:02:03.493 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:02:03.493 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:02:03.493 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:02:03.493 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:02:03.494 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:02:03.494 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:02:03.494 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:02:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:03 gibba043 bash[24019]: cluster 2021-03-10T17:02:01.577169+0000 mgr.gibba043.dnkmem (mgr.34373) 10064 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:03 gibba003 bash[31385]: cluster 2021-03-10T17:02:01.577169+0000 mgr.gibba043.dnkmem (mgr.34373) 10064 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:03 gibba003 bash[32348]: cluster 2021-03-10T17:02:01.577169+0000 mgr.gibba043.dnkmem (mgr.34373) 10064 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:04.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:04 gibba043 bash[24019]: audit 2021-03-10T17:02:03.005098+0000 mgr.gibba043.dnkmem (mgr.34373) 10065 : audit [DBG] from='client.50799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:04.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:04 gibba043 bash[24019]: audit 2021-03-10T17:02:03.230700+0000 mgr.gibba043.dnkmem (mgr.34373) 10066 : audit [DBG] from='client.50805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:04.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:04 gibba043 bash[24019]: audit 2021-03-10T17:02:03.492295+0000 mon.c (mon.1) 2589 : audit [DBG] from='client.? 172.21.2.103:0/2136513345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:04 gibba003 bash[31385]: audit 2021-03-10T17:02:03.005098+0000 mgr.gibba043.dnkmem (mgr.34373) 10065 : audit [DBG] from='client.50799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:04.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:04 gibba003 bash[31385]: audit 2021-03-10T17:02:03.230700+0000 mgr.gibba043.dnkmem (mgr.34373) 10066 : audit [DBG] from='client.50805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:04.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:04 gibba003 bash[31385]: audit 2021-03-10T17:02:03.492295+0000 mon.c (mon.1) 2589 : audit [DBG] from='client.? 172.21.2.103:0/2136513345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:04.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:04 gibba003 bash[32348]: audit 2021-03-10T17:02:03.005098+0000 mgr.gibba043.dnkmem (mgr.34373) 10065 : audit [DBG] from='client.50799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:04.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:04 gibba003 bash[32348]: audit 2021-03-10T17:02:03.230700+0000 mgr.gibba043.dnkmem (mgr.34373) 10066 : audit [DBG] from='client.50805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:04.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:04 gibba003 bash[32348]: audit 2021-03-10T17:02:03.492295+0000 mon.c (mon.1) 2589 : audit [DBG] from='client.? 172.21.2.103:0/2136513345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:05 gibba043 bash[24019]: cluster 2021-03-10T17:02:03.578825+0000 mgr.gibba043.dnkmem (mgr.34373) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:05 gibba003 bash[31385]: cluster 2021-03-10T17:02:03.578825+0000 mgr.gibba043.dnkmem (mgr.34373) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:05 gibba003 bash[32348]: cluster 2021-03-10T17:02:03.578825+0000 mgr.gibba043.dnkmem (mgr.34373) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:07 gibba043 bash[24019]: cluster 2021-03-10T17:02:05.580068+0000 mgr.gibba043.dnkmem (mgr.34373) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:07 gibba003 bash[31385]: cluster 2021-03-10T17:02:05.580068+0000 mgr.gibba043.dnkmem (mgr.34373) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:07 gibba003 bash[32348]: cluster 2021-03-10T17:02:05.580068+0000 mgr.gibba043.dnkmem (mgr.34373) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:09 gibba043 bash[24019]: cluster 2021-03-10T17:02:07.581480+0000 mgr.gibba043.dnkmem (mgr.34373) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:09 gibba003 bash[31385]: cluster 2021-03-10T17:02:07.581480+0000 mgr.gibba043.dnkmem (mgr.34373) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:09 gibba003 bash[32348]: cluster 2021-03-10T17:02:07.581480+0000 mgr.gibba043.dnkmem (mgr.34373) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:11 gibba043 bash[24019]: cluster 2021-03-10T17:02:09.583208+0000 mgr.gibba043.dnkmem (mgr.34373) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:11 gibba003 bash[31385]: cluster 2021-03-10T17:02:09.583208+0000 mgr.gibba043.dnkmem (mgr.34373) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:11 gibba003 bash[32348]: cluster 2021-03-10T17:02:09.583208+0000 mgr.gibba043.dnkmem (mgr.34373) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:13 gibba043 bash[24019]: cluster 2021-03-10T17:02:11.584996+0000 mgr.gibba043.dnkmem (mgr.34373) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:13 gibba043 bash[24019]: cephadm 2021-03-10T17:02:11.869405+0000 mgr.gibba043.dnkmem (mgr.34373) 10072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:13 gibba003 bash[31385]: cluster 2021-03-10T17:02:11.584996+0000 mgr.gibba043.dnkmem (mgr.34373) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:13 gibba003 bash[31385]: cephadm 2021-03-10T17:02:11.869405+0000 mgr.gibba043.dnkmem (mgr.34373) 10072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:13 gibba003 bash[32348]: cluster 2021-03-10T17:02:11.584996+0000 mgr.gibba043.dnkmem (mgr.34373) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:13 gibba003 bash[32348]: cephadm 2021-03-10T17:02:11.869405+0000 mgr.gibba043.dnkmem (mgr.34373) 10072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:13.945708+0000 mon.c (mon.1) 2590 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:13.946841+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.180658+0000 mon.c (mon.1) 2591 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.181729+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.487895+0000 mon.c (mon.1) 2592 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.488662+0000 mon.c (mon.1) 2593 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:02:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.489084+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.489384+0000 mon.c (mon.1) 2594 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.490224+0000 mon.c (mon.1) 2595 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.490345+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:02:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.491564+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:14 gibba043 bash[24019]: audit 2021-03-10T17:02:14.492379+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:13.945708+0000 mon.c (mon.1) 2590 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:13.946841+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.180658+0000 mon.c (mon.1) 2591 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.181729+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.487895+0000 mon.c (mon.1) 2592 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.488662+0000 mon.c (mon.1) 2593 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:02:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.489084+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.489384+0000 mon.c (mon.1) 2594 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.490224+0000 mon.c (mon.1) 2595 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.490345+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:02:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.491564+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[31385]: audit 2021-03-10T17:02:14.492379+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:13.945708+0000 mon.c (mon.1) 2590 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:13.946841+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.180658+0000 mon.c (mon.1) 2591 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.181729+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.487895+0000 mon.c (mon.1) 2592 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.488662+0000 mon.c (mon.1) 2593 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:02:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.489084+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.489384+0000 mon.c (mon.1) 2594 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.490224+0000 mon.c (mon.1) 2595 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.490345+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:02:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.491564+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:02:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:14 gibba003 bash[32348]: audit 2021-03-10T17:02:14.492379+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:15 gibba003 bash[31385]: cluster 2021-03-10T17:02:13.585770+0000 mgr.gibba043.dnkmem (mgr.34373) 10073 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:15 gibba003 bash[32348]: cluster 2021-03-10T17:02:13.585770+0000 mgr.gibba043.dnkmem (mgr.34373) 10073 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:15 gibba043 bash[24019]: cluster 2021-03-10T17:02:13.585770+0000 mgr.gibba043.dnkmem (mgr.34373) 10073 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:17 gibba003 bash[31385]: cluster 2021-03-10T17:02:15.587047+0000 mgr.gibba043.dnkmem (mgr.34373) 10074 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:17 gibba003 bash[32348]: cluster 2021-03-10T17:02:15.587047+0000 mgr.gibba043.dnkmem (mgr.34373) 10074 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:17 gibba043 bash[24019]: cluster 2021-03-10T17:02:15.587047+0000 mgr.gibba043.dnkmem (mgr.34373) 10074 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:19 gibba003 bash[31385]: cluster 2021-03-10T17:02:17.588629+0000 mgr.gibba043.dnkmem (mgr.34373) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:19 gibba003 bash[32348]: cluster 2021-03-10T17:02:17.588629+0000 mgr.gibba043.dnkmem (mgr.34373) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:19 gibba043 bash[24019]: cluster 2021-03-10T17:02:17.588629+0000 mgr.gibba043.dnkmem (mgr.34373) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:21 gibba003 bash[31385]: cluster 2021-03-10T17:02:19.589319+0000 mgr.gibba043.dnkmem (mgr.34373) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:21 gibba003 bash[32348]: cluster 2021-03-10T17:02:19.589319+0000 mgr.gibba043.dnkmem (mgr.34373) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:21 gibba043 bash[24019]: cluster 2021-03-10T17:02:19.589319+0000 mgr.gibba043.dnkmem (mgr.34373) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:23 gibba003 bash[31385]: cluster 2021-03-10T17:02:21.590229+0000 mgr.gibba043.dnkmem (mgr.34373) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:23 gibba003 bash[32348]: cluster 2021-03-10T17:02:21.590229+0000 mgr.gibba043.dnkmem (mgr.34373) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:23 gibba043 bash[24019]: cluster 2021-03-10T17:02:21.590229+0000 mgr.gibba043.dnkmem (mgr.34373) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:25 gibba003 bash[31385]: cluster 2021-03-10T17:02:23.590913+0000 mgr.gibba043.dnkmem (mgr.34373) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:25 gibba003 bash[32348]: cluster 2021-03-10T17:02:23.590913+0000 mgr.gibba043.dnkmem (mgr.34373) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:25 gibba043 bash[24019]: cluster 2021-03-10T17:02:23.590913+0000 mgr.gibba043.dnkmem (mgr.34373) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cluster 2021-03-10T17:02:25.591490+0000 mgr.gibba043.dnkmem (mgr.34373) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:26.886395+0000 mgr.gibba043.dnkmem (mgr.34373) 10080 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:02:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:26.888009+0000 mgr.gibba043.dnkmem (mgr.34373) 10081 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:02:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.111976+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:02:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.113113+0000 mgr.gibba043.dnkmem (mgr.34373) 10082 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:27.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.114987+0000 mgr.gibba043.dnkmem (mgr.34373) 10083 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:27.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.115520+0000 mon.c (mon.1) 2596 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:27.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.116742+0000 mgr.gibba043.dnkmem (mgr.34373) 10084 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:27.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.116778+0000 mgr.gibba043.dnkmem (mgr.34373) 10085 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:27.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.117182+0000 mon.c (mon.1) 2597 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.118442+0000 mgr.gibba043.dnkmem (mgr.34373) 10086 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:27.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.118478+0000 mgr.gibba043.dnkmem (mgr.34373) 10087 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:27.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.118992+0000 mon.c (mon.1) 2598 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.120041+0000 mgr.gibba043.dnkmem (mgr.34373) 10088 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:27.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.120632+0000 mon.c (mon.1) 2599 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.122010+0000 mgr.gibba043.dnkmem (mgr.34373) 10089 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:27.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.122047+0000 mgr.gibba043.dnkmem (mgr.34373) 10090 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:27.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.123402+0000 mgr.gibba043.dnkmem (mgr.34373) 10091 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:27.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.123778+0000 mgr.gibba043.dnkmem (mgr.34373) 10092 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:27.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.124317+0000 mon.c (mon.1) 2600 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.125008+0000 mgr.gibba043.dnkmem (mgr.34373) 10093 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:27.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cluster 2021-03-10T17:02:25.591490+0000 mgr.gibba043.dnkmem (mgr.34373) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:27.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:26.886395+0000 mgr.gibba043.dnkmem (mgr.34373) 10080 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:02:27.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:26.888009+0000 mgr.gibba043.dnkmem (mgr.34373) 10081 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:02:27.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.111976+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:02:27.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.113113+0000 mgr.gibba043.dnkmem (mgr.34373) 10082 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:27.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.114987+0000 mgr.gibba043.dnkmem (mgr.34373) 10083 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:27.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.115520+0000 mon.c (mon.1) 2596 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:27.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.116742+0000 mgr.gibba043.dnkmem (mgr.34373) 10084 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:27.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.116778+0000 mgr.gibba043.dnkmem (mgr.34373) 10085 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:27.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.117182+0000 mon.c (mon.1) 2597 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.118442+0000 mgr.gibba043.dnkmem (mgr.34373) 10086 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:27.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.118478+0000 mgr.gibba043.dnkmem (mgr.34373) 10087 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:27.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.118992+0000 mon.c (mon.1) 2598 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.120041+0000 mgr.gibba043.dnkmem (mgr.34373) 10088 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:27.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.120632+0000 mon.c (mon.1) 2599 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.122010+0000 mgr.gibba043.dnkmem (mgr.34373) 10089 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:27.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.122047+0000 mgr.gibba043.dnkmem (mgr.34373) 10090 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:27.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.123402+0000 mgr.gibba043.dnkmem (mgr.34373) 10091 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:27.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.123778+0000 mgr.gibba043.dnkmem (mgr.34373) 10092 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:27.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.124317+0000 mon.c (mon.1) 2600 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.125008+0000 mgr.gibba043.dnkmem (mgr.34373) 10093 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:27.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.125044+0000 mgr.gibba043.dnkmem (mgr.34373) 10094 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:27.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: cephadm 2021-03-10T17:02:27.125145+0000 mgr.gibba043.dnkmem (mgr.34373) 10095 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:27.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[32348]: audit 2021-03-10T17:02:27.125911+0000 mon.c (mon.1) 2601 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:27.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.125044+0000 mgr.gibba043.dnkmem (mgr.34373) 10094 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:27.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: cephadm 2021-03-10T17:02:27.125145+0000 mgr.gibba043.dnkmem (mgr.34373) 10095 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:27.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:27 gibba003 bash[31385]: audit 2021-03-10T17:02:27.125911+0000 mon.c (mon.1) 2601 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cluster 2021-03-10T17:02:25.591490+0000 mgr.gibba043.dnkmem (mgr.34373) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:26.886395+0000 mgr.gibba043.dnkmem (mgr.34373) 10080 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:02:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:26.888009+0000 mgr.gibba043.dnkmem (mgr.34373) 10081 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:02:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.111976+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:02:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.113113+0000 mgr.gibba043.dnkmem (mgr.34373) 10082 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.114987+0000 mgr.gibba043.dnkmem (mgr.34373) 10083 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.115520+0000 mon.c (mon.1) 2596 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.116742+0000 mgr.gibba043.dnkmem (mgr.34373) 10084 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.116778+0000 mgr.gibba043.dnkmem (mgr.34373) 10085 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.117182+0000 mon.c (mon.1) 2597 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:28.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.118442+0000 mgr.gibba043.dnkmem (mgr.34373) 10086 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:28.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.118478+0000 mgr.gibba043.dnkmem (mgr.34373) 10087 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:28.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.118992+0000 mon.c (mon.1) 2598 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:28.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.120041+0000 mgr.gibba043.dnkmem (mgr.34373) 10088 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:28.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.120632+0000 mon.c (mon.1) 2599 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:28.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.122010+0000 mgr.gibba043.dnkmem (mgr.34373) 10089 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:28.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.122047+0000 mgr.gibba043.dnkmem (mgr.34373) 10090 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:28.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.123402+0000 mgr.gibba043.dnkmem (mgr.34373) 10091 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:28.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.123778+0000 mgr.gibba043.dnkmem (mgr.34373) 10092 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:28.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.124317+0000 mon.c (mon.1) 2600 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:28.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.125008+0000 mgr.gibba043.dnkmem (mgr.34373) 10093 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:28.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.125044+0000 mgr.gibba043.dnkmem (mgr.34373) 10094 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:28.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: cephadm 2021-03-10T17:02:27.125145+0000 mgr.gibba043.dnkmem (mgr.34373) 10095 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:28.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:27 gibba043 bash[24019]: audit 2021-03-10T17:02:27.125911+0000 mon.c (mon.1) 2601 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:28 gibba003 bash[31385]: cluster 2021-03-10T17:02:27.592147+0000 mgr.gibba043.dnkmem (mgr.34373) 10096 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:28.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:28 gibba003 bash[32348]: cluster 2021-03-10T17:02:27.592147+0000 mgr.gibba043.dnkmem (mgr.34373) 10096 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:28 gibba043 bash[24019]: cluster 2021-03-10T17:02:27.592147+0000 mgr.gibba043.dnkmem (mgr.34373) 10096 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:30.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:30 gibba003 bash[31385]: cluster 2021-03-10T17:02:29.592595+0000 mgr.gibba043.dnkmem (mgr.34373) 10097 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:30.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:30 gibba003 bash[32348]: cluster 2021-03-10T17:02:29.592595+0000 mgr.gibba043.dnkmem (mgr.34373) 10097 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:30 gibba043 bash[24019]: cluster 2021-03-10T17:02:29.592595+0000 mgr.gibba043.dnkmem (mgr.34373) 10097 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:33 gibba003 bash[31385]: cluster 2021-03-10T17:02:31.593976+0000 mgr.gibba043.dnkmem (mgr.34373) 10098 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:33 gibba003 bash[32348]: cluster 2021-03-10T17:02:31.593976+0000 mgr.gibba043.dnkmem (mgr.34373) 10098 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.733 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:02:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:33 gibba043 bash[24019]: cluster 2021-03-10T17:02:31.593976+0000 mgr.gibba043.dnkmem (mgr.34373) 10098 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.961 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:02:33.961 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:02:33.962 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:02:33.962 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:02:33.962 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:02:33.962 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:02:33.963 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:02:33.963 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:02:33.963 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:02:33.963 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:02:33.964 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:02:33.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:02:33.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:02:33.964 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:02:33.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:02:33.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:02:33.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:02:33.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:02:33.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:02:33.966 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:02:33.966 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:02:34.210 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:02:34.211 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:02:34.211 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:34.212 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:02:34.212 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:02:34.213 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:34.213 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:02:34.213 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:02:34.214 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:02:34.214 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:02:34.215 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:02:34.215 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:02:34.216 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:02:34.216 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:02:34.216 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:02:34.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:34 gibba003 bash[31385]: audit 2021-03-10T17:02:34.211989+0000 mon.a (mon.0) 2066 : audit [DBG] from='client.? 172.21.2.103:0/2464400743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:34.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:34 gibba003 bash[32348]: audit 2021-03-10T17:02:34.211989+0000 mon.a (mon.0) 2066 : audit [DBG] from='client.? 172.21.2.103:0/2464400743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:34.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:34 gibba043 bash[24019]: audit 2021-03-10T17:02:34.211989+0000 mon.a (mon.0) 2066 : audit [DBG] from='client.? 172.21.2.103:0/2464400743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:35 gibba003 bash[31385]: cluster 2021-03-10T17:02:33.594927+0000 mgr.gibba043.dnkmem (mgr.34373) 10099 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:35 gibba003 bash[31385]: audit 2021-03-10T17:02:33.723843+0000 mgr.gibba043.dnkmem (mgr.34373) 10100 : audit [DBG] from='client.50817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:35.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:35 gibba003 bash[31385]: audit 2021-03-10T17:02:33.949411+0000 mgr.gibba043.dnkmem (mgr.34373) 10101 : audit [DBG] from='client.50823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:35.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:35 gibba003 bash[32348]: cluster 2021-03-10T17:02:33.594927+0000 mgr.gibba043.dnkmem (mgr.34373) 10099 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:35 gibba003 bash[32348]: audit 2021-03-10T17:02:33.723843+0000 mgr.gibba043.dnkmem (mgr.34373) 10100 : audit [DBG] from='client.50817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:35 gibba003 bash[32348]: audit 2021-03-10T17:02:33.949411+0000 mgr.gibba043.dnkmem (mgr.34373) 10101 : audit [DBG] from='client.50823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:35 gibba043 bash[24019]: cluster 2021-03-10T17:02:33.594927+0000 mgr.gibba043.dnkmem (mgr.34373) 10099 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:35 gibba043 bash[24019]: audit 2021-03-10T17:02:33.723843+0000 mgr.gibba043.dnkmem (mgr.34373) 10100 : audit [DBG] from='client.50817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:35 gibba043 bash[24019]: audit 2021-03-10T17:02:33.949411+0000 mgr.gibba043.dnkmem (mgr.34373) 10101 : audit [DBG] from='client.50823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:37 gibba003 bash[31385]: cluster 2021-03-10T17:02:35.596386+0000 mgr.gibba043.dnkmem (mgr.34373) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:37 gibba003 bash[32348]: cluster 2021-03-10T17:02:35.596386+0000 mgr.gibba043.dnkmem (mgr.34373) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:37 gibba043 bash[24019]: cluster 2021-03-10T17:02:35.596386+0000 mgr.gibba043.dnkmem (mgr.34373) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:39 gibba003 bash[31385]: cluster 2021-03-10T17:02:37.598002+0000 mgr.gibba043.dnkmem (mgr.34373) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:39 gibba003 bash[32348]: cluster 2021-03-10T17:02:37.598002+0000 mgr.gibba043.dnkmem (mgr.34373) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:39 gibba043 bash[24019]: cluster 2021-03-10T17:02:37.598002+0000 mgr.gibba043.dnkmem (mgr.34373) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:41 gibba003 bash[31385]: cluster 2021-03-10T17:02:39.598499+0000 mgr.gibba043.dnkmem (mgr.34373) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:41 gibba003 bash[32348]: cluster 2021-03-10T17:02:39.598499+0000 mgr.gibba043.dnkmem (mgr.34373) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:41 gibba043 bash[24019]: cluster 2021-03-10T17:02:39.598499+0000 mgr.gibba043.dnkmem (mgr.34373) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:43 gibba003 bash[31385]: cluster 2021-03-10T17:02:41.600153+0000 mgr.gibba043.dnkmem (mgr.34373) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:43 gibba003 bash[31385]: cephadm 2021-03-10T17:02:42.141177+0000 mgr.gibba043.dnkmem (mgr.34373) 10106 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:43 gibba003 bash[32348]: cluster 2021-03-10T17:02:41.600153+0000 mgr.gibba043.dnkmem (mgr.34373) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:43 gibba003 bash[32348]: cephadm 2021-03-10T17:02:42.141177+0000 mgr.gibba043.dnkmem (mgr.34373) 10106 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:43.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:43 gibba043 bash[24019]: cluster 2021-03-10T17:02:41.600153+0000 mgr.gibba043.dnkmem (mgr.34373) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:43 gibba043 bash[24019]: cephadm 2021-03-10T17:02:42.141177+0000 mgr.gibba043.dnkmem (mgr.34373) 10106 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:45.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:45 gibba003 bash[31385]: cluster 2021-03-10T17:02:43.601132+0000 mgr.gibba043.dnkmem (mgr.34373) 10107 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:45 gibba003 bash[32348]: cluster 2021-03-10T17:02:43.601132+0000 mgr.gibba043.dnkmem (mgr.34373) 10107 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:45 gibba043 bash[24019]: cluster 2021-03-10T17:02:43.601132+0000 mgr.gibba043.dnkmem (mgr.34373) 10107 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:47.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:47 gibba003 bash[31385]: cluster 2021-03-10T17:02:45.602496+0000 mgr.gibba043.dnkmem (mgr.34373) 10108 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:47 gibba003 bash[32348]: cluster 2021-03-10T17:02:45.602496+0000 mgr.gibba043.dnkmem (mgr.34373) 10108 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:47 gibba043 bash[24019]: cluster 2021-03-10T17:02:45.602496+0000 mgr.gibba043.dnkmem (mgr.34373) 10108 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:49 gibba003 bash[31385]: cluster 2021-03-10T17:02:47.604140+0000 mgr.gibba043.dnkmem (mgr.34373) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:49 gibba003 bash[32348]: cluster 2021-03-10T17:02:47.604140+0000 mgr.gibba043.dnkmem (mgr.34373) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:49 gibba043 bash[24019]: cluster 2021-03-10T17:02:47.604140+0000 mgr.gibba043.dnkmem (mgr.34373) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:51 gibba003 bash[31385]: cluster 2021-03-10T17:02:49.604819+0000 mgr.gibba043.dnkmem (mgr.34373) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:51 gibba003 bash[32348]: cluster 2021-03-10T17:02:49.604819+0000 mgr.gibba043.dnkmem (mgr.34373) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:51 gibba043 bash[24019]: cluster 2021-03-10T17:02:49.604819+0000 mgr.gibba043.dnkmem (mgr.34373) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:53.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:53 gibba003 bash[31385]: cluster 2021-03-10T17:02:51.606491+0000 mgr.gibba043.dnkmem (mgr.34373) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:53.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:53 gibba003 bash[32348]: cluster 2021-03-10T17:02:51.606491+0000 mgr.gibba043.dnkmem (mgr.34373) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:53 gibba043 bash[24019]: cluster 2021-03-10T17:02:51.606491+0000 mgr.gibba043.dnkmem (mgr.34373) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:55 gibba003 bash[31385]: cluster 2021-03-10T17:02:53.607354+0000 mgr.gibba043.dnkmem (mgr.34373) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:55 gibba003 bash[32348]: cluster 2021-03-10T17:02:53.607354+0000 mgr.gibba043.dnkmem (mgr.34373) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:55 gibba043 bash[24019]: cluster 2021-03-10T17:02:53.607354+0000 mgr.gibba043.dnkmem (mgr.34373) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:57.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:57 gibba003 bash[31385]: cluster 2021-03-10T17:02:55.608526+0000 mgr.gibba043.dnkmem (mgr.34373) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:57.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:57 gibba003 bash[32348]: cluster 2021-03-10T17:02:55.608526+0000 mgr.gibba043.dnkmem (mgr.34373) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:57.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:57 gibba043 bash[24019]: cluster 2021-03-10T17:02:55.608526+0000 mgr.gibba043.dnkmem (mgr.34373) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:58 gibba043 bash[24019]: cephadm 2021-03-10T17:02:57.145245+0000 mgr.gibba043.dnkmem (mgr.34373) 10114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:58.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:58 gibba003 bash[31385]: cephadm 2021-03-10T17:02:57.145245+0000 mgr.gibba043.dnkmem (mgr.34373) 10114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:58.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:58 gibba003 bash[32348]: cephadm 2021-03-10T17:02:57.145245+0000 mgr.gibba043.dnkmem (mgr.34373) 10114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:02:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:02:59 gibba043 bash[24019]: cluster 2021-03-10T17:02:57.610048+0000 mgr.gibba043.dnkmem (mgr.34373) 10115 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:02:59 gibba003 bash[31385]: cluster 2021-03-10T17:02:57.610048+0000 mgr.gibba043.dnkmem (mgr.34373) 10115 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:02:59 gibba003 bash[32348]: cluster 2021-03-10T17:02:57.610048+0000 mgr.gibba043.dnkmem (mgr.34373) 10115 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:01.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:01 gibba043 bash[24019]: cluster 2021-03-10T17:02:59.610571+0000 mgr.gibba043.dnkmem (mgr.34373) 10116 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:01 gibba003 bash[31385]: cluster 2021-03-10T17:02:59.610571+0000 mgr.gibba043.dnkmem (mgr.34373) 10116 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:01 gibba003 bash[32348]: cluster 2021-03-10T17:02:59.610571+0000 mgr.gibba043.dnkmem (mgr.34373) 10116 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:03 gibba043 bash[24019]: cluster 2021-03-10T17:03:01.611997+0000 mgr.gibba043.dnkmem (mgr.34373) 10117 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:03 gibba003 bash[31385]: cluster 2021-03-10T17:03:01.611997+0000 mgr.gibba043.dnkmem (mgr.34373) 10117 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:03 gibba003 bash[32348]: cluster 2021-03-10T17:03:01.611997+0000 mgr.gibba043.dnkmem (mgr.34373) 10117 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:04.452 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:03:04.706 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:03:04.707 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:03:04.707 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:03:04.707 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:03:04.707 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:03:04.708 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:03:04.708 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:03:04.708 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:03:04.708 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:03:04.708 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:03:04.709 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:03:04.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:03:04.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:03:04.709 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:03:04.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:03:04.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:03:04.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:03:04.710 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:03:04.711 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:03:04.711 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:03:04.711 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:03:04.955 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:03:04.956 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:03:04.956 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:04.956 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:03:04.957 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:03:04.957 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:04.957 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:03:04.957 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:03:04.958 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:03:04.958 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:03:04.958 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:03:04.958 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:03:04.959 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:03:04.959 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:03:04.959 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:03:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:05 gibba043 bash[24019]: cluster 2021-03-10T17:03:03.613667+0000 mgr.gibba043.dnkmem (mgr.34373) 10118 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:05 gibba043 bash[24019]: audit 2021-03-10T17:03:04.442880+0000 mgr.gibba043.dnkmem (mgr.34373) 10119 : audit [DBG] from='client.60826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:05 gibba043 bash[24019]: audit 2021-03-10T17:03:04.957257+0000 mon.a (mon.0) 2067 : audit [DBG] from='client.? 172.21.2.103:0/2851892458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:05 gibba003 bash[31385]: cluster 2021-03-10T17:03:03.613667+0000 mgr.gibba043.dnkmem (mgr.34373) 10118 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:05 gibba003 bash[31385]: audit 2021-03-10T17:03:04.442880+0000 mgr.gibba043.dnkmem (mgr.34373) 10119 : audit [DBG] from='client.60826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:05 gibba003 bash[31385]: audit 2021-03-10T17:03:04.957257+0000 mon.a (mon.0) 2067 : audit [DBG] from='client.? 172.21.2.103:0/2851892458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:05 gibba003 bash[32348]: cluster 2021-03-10T17:03:03.613667+0000 mgr.gibba043.dnkmem (mgr.34373) 10118 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:05 gibba003 bash[32348]: audit 2021-03-10T17:03:04.442880+0000 mgr.gibba043.dnkmem (mgr.34373) 10119 : audit [DBG] from='client.60826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:05 gibba003 bash[32348]: audit 2021-03-10T17:03:04.957257+0000 mon.a (mon.0) 2067 : audit [DBG] from='client.? 172.21.2.103:0/2851892458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:06.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:06 gibba043 bash[24019]: audit 2021-03-10T17:03:04.667707+0000 mgr.gibba043.dnkmem (mgr.34373) 10120 : audit [DBG] from='client.60832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:06.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:06 gibba003 bash[31385]: audit 2021-03-10T17:03:04.667707+0000 mgr.gibba043.dnkmem (mgr.34373) 10120 : audit [DBG] from='client.60832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:06.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:06 gibba003 bash[32348]: audit 2021-03-10T17:03:04.667707+0000 mgr.gibba043.dnkmem (mgr.34373) 10120 : audit [DBG] from='client.60832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:07 gibba043 bash[24019]: cluster 2021-03-10T17:03:05.614874+0000 mgr.gibba043.dnkmem (mgr.34373) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:07 gibba003 bash[31385]: cluster 2021-03-10T17:03:05.614874+0000 mgr.gibba043.dnkmem (mgr.34373) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:07 gibba003 bash[32348]: cluster 2021-03-10T17:03:05.614874+0000 mgr.gibba043.dnkmem (mgr.34373) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:09 gibba043 bash[24019]: cluster 2021-03-10T17:03:07.616429+0000 mgr.gibba043.dnkmem (mgr.34373) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:09 gibba003 bash[31385]: cluster 2021-03-10T17:03:07.616429+0000 mgr.gibba043.dnkmem (mgr.34373) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:09 gibba003 bash[32348]: cluster 2021-03-10T17:03:07.616429+0000 mgr.gibba043.dnkmem (mgr.34373) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:11.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:11 gibba043 bash[24019]: cluster 2021-03-10T17:03:09.617881+0000 mgr.gibba043.dnkmem (mgr.34373) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:11 gibba003 bash[31385]: cluster 2021-03-10T17:03:09.617881+0000 mgr.gibba043.dnkmem (mgr.34373) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:11 gibba003 bash[32348]: cluster 2021-03-10T17:03:09.617881+0000 mgr.gibba043.dnkmem (mgr.34373) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:13 gibba043 bash[24019]: cluster 2021-03-10T17:03:11.619361+0000 mgr.gibba043.dnkmem (mgr.34373) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:13 gibba043 bash[24019]: cephadm 2021-03-10T17:03:12.161268+0000 mgr.gibba043.dnkmem (mgr.34373) 10125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:13 gibba003 bash[31385]: cluster 2021-03-10T17:03:11.619361+0000 mgr.gibba043.dnkmem (mgr.34373) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:13 gibba003 bash[31385]: cephadm 2021-03-10T17:03:12.161268+0000 mgr.gibba043.dnkmem (mgr.34373) 10125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:13 gibba003 bash[32348]: cluster 2021-03-10T17:03:11.619361+0000 mgr.gibba043.dnkmem (mgr.34373) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:13 gibba003 bash[32348]: cephadm 2021-03-10T17:03:12.161268+0000 mgr.gibba043.dnkmem (mgr.34373) 10125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:14.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:13.952122+0000 mon.c (mon.1) 2602 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:13.953211+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.187136+0000 mon.c (mon.1) 2603 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.188217+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.497853+0000 mon.c (mon.1) 2604 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.498814+0000 mon.c (mon.1) 2605 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:03:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.499103+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.499780+0000 mon.c (mon.1) 2606 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.500296+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:03:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.500964+0000 mon.c (mon.1) 2607 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.501197+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:14 gibba043 bash[24019]: audit 2021-03-10T17:03:14.502194+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:13.952122+0000 mon.c (mon.1) 2602 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:13.953211+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.187136+0000 mon.c (mon.1) 2603 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.188217+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.497853+0000 mon.c (mon.1) 2604 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.498814+0000 mon.c (mon.1) 2605 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:03:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.499103+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.499780+0000 mon.c (mon.1) 2606 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.500296+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:03:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.500964+0000 mon.c (mon.1) 2607 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.501197+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[31385]: audit 2021-03-10T17:03:14.502194+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:13.952122+0000 mon.c (mon.1) 2602 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:13.953211+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.187136+0000 mon.c (mon.1) 2603 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.188217+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.497853+0000 mon.c (mon.1) 2604 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.498814+0000 mon.c (mon.1) 2605 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:03:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.499103+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.499780+0000 mon.c (mon.1) 2606 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.500296+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:03:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.500964+0000 mon.c (mon.1) 2607 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.501197+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:14.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:14 gibba003 bash[32348]: audit 2021-03-10T17:03:14.502194+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:03:15.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:15 gibba043 bash[24019]: cluster 2021-03-10T17:03:13.620187+0000 mgr.gibba043.dnkmem (mgr.34373) 10126 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:15 gibba003 bash[31385]: cluster 2021-03-10T17:03:13.620187+0000 mgr.gibba043.dnkmem (mgr.34373) 10126 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:15 gibba003 bash[32348]: cluster 2021-03-10T17:03:13.620187+0000 mgr.gibba043.dnkmem (mgr.34373) 10126 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:17 gibba003 bash[31385]: cluster 2021-03-10T17:03:15.621431+0000 mgr.gibba043.dnkmem (mgr.34373) 10127 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:17 gibba003 bash[32348]: cluster 2021-03-10T17:03:15.621431+0000 mgr.gibba043.dnkmem (mgr.34373) 10127 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:17 gibba043 bash[24019]: cluster 2021-03-10T17:03:15.621431+0000 mgr.gibba043.dnkmem (mgr.34373) 10127 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:19 gibba003 bash[31385]: cluster 2021-03-10T17:03:17.622685+0000 mgr.gibba043.dnkmem (mgr.34373) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:19 gibba003 bash[32348]: cluster 2021-03-10T17:03:17.622685+0000 mgr.gibba043.dnkmem (mgr.34373) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:19 gibba043 bash[24019]: cluster 2021-03-10T17:03:17.622685+0000 mgr.gibba043.dnkmem (mgr.34373) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:21 gibba003 bash[31385]: cluster 2021-03-10T17:03:19.623414+0000 mgr.gibba043.dnkmem (mgr.34373) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:21 gibba003 bash[32348]: cluster 2021-03-10T17:03:19.623414+0000 mgr.gibba043.dnkmem (mgr.34373) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:21 gibba043 bash[24019]: cluster 2021-03-10T17:03:19.623414+0000 mgr.gibba043.dnkmem (mgr.34373) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:23 gibba003 bash[31385]: cluster 2021-03-10T17:03:21.625162+0000 mgr.gibba043.dnkmem (mgr.34373) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:23 gibba003 bash[32348]: cluster 2021-03-10T17:03:21.625162+0000 mgr.gibba043.dnkmem (mgr.34373) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:24.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:23 gibba043 bash[24019]: cluster 2021-03-10T17:03:21.625162+0000 mgr.gibba043.dnkmem (mgr.34373) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:25 gibba003 bash[31385]: cluster 2021-03-10T17:03:23.626195+0000 mgr.gibba043.dnkmem (mgr.34373) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:25 gibba003 bash[32348]: cluster 2021-03-10T17:03:23.626195+0000 mgr.gibba043.dnkmem (mgr.34373) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:25 gibba043 bash[24019]: cluster 2021-03-10T17:03:23.626195+0000 mgr.gibba043.dnkmem (mgr.34373) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: cluster 2021-03-10T17:03:25.627012+0000 mgr.gibba043.dnkmem (mgr.34373) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.404664+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:03:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.408207+0000 mon.c (mon.1) 2608 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.410063+0000 mon.c (mon.1) 2609 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.411902+0000 mon.c (mon.1) 2610 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.413219+0000 mon.c (mon.1) 2611 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.416250+0000 mon.c (mon.1) 2612 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:27 gibba043 bash[24019]: audit 2021-03-10T17:03:27.417730+0000 mon.c (mon.1) 2613 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: cluster 2021-03-10T17:03:25.627012+0000 mgr.gibba043.dnkmem (mgr.34373) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.404664+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:03:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.408207+0000 mon.c (mon.1) 2608 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.410063+0000 mon.c (mon.1) 2609 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.411902+0000 mon.c (mon.1) 2610 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.413219+0000 mon.c (mon.1) 2611 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.416250+0000 mon.c (mon.1) 2612 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[31385]: audit 2021-03-10T17:03:27.417730+0000 mon.c (mon.1) 2613 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: cluster 2021-03-10T17:03:25.627012+0000 mgr.gibba043.dnkmem (mgr.34373) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.404664+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:03:27.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.408207+0000 mon.c (mon.1) 2608 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.410063+0000 mon.c (mon.1) 2609 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.411902+0000 mon.c (mon.1) 2610 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.413219+0000 mon.c (mon.1) 2611 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.416250+0000 mon.c (mon.1) 2612 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:27.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:27 gibba003 bash[32348]: audit 2021-03-10T17:03:27.417730+0000 mon.c (mon.1) 2613 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.178159+0000 mgr.gibba043.dnkmem (mgr.34373) 10133 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:03:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.179716+0000 mgr.gibba043.dnkmem (mgr.34373) 10134 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:03:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.405779+0000 mgr.gibba043.dnkmem (mgr.34373) 10135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.407827+0000 mgr.gibba043.dnkmem (mgr.34373) 10136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.409608+0000 mgr.gibba043.dnkmem (mgr.34373) 10137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.409648+0000 mgr.gibba043.dnkmem (mgr.34373) 10138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.411012+0000 mgr.gibba043.dnkmem (mgr.34373) 10139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.411048+0000 mgr.gibba043.dnkmem (mgr.34373) 10140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.412307+0000 mgr.gibba043.dnkmem (mgr.34373) 10141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.414098+0000 mgr.gibba043.dnkmem (mgr.34373) 10142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.414136+0000 mgr.gibba043.dnkmem (mgr.34373) 10143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.415366+0000 mgr.gibba043.dnkmem (mgr.34373) 10144 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.415719+0000 mgr.gibba043.dnkmem (mgr.34373) 10145 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.417087+0000 mgr.gibba043.dnkmem (mgr.34373) 10146 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:28.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.417123+0000 mgr.gibba043.dnkmem (mgr.34373) 10147 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:28.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[31385]: cephadm 2021-03-10T17:03:27.417228+0000 mgr.gibba043.dnkmem (mgr.34373) 10148 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.178159+0000 mgr.gibba043.dnkmem (mgr.34373) 10133 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:03:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.179716+0000 mgr.gibba043.dnkmem (mgr.34373) 10134 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:03:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.405779+0000 mgr.gibba043.dnkmem (mgr.34373) 10135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.407827+0000 mgr.gibba043.dnkmem (mgr.34373) 10136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.409608+0000 mgr.gibba043.dnkmem (mgr.34373) 10137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:28.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.409648+0000 mgr.gibba043.dnkmem (mgr.34373) 10138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.411012+0000 mgr.gibba043.dnkmem (mgr.34373) 10139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.411048+0000 mgr.gibba043.dnkmem (mgr.34373) 10140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:28.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.412307+0000 mgr.gibba043.dnkmem (mgr.34373) 10141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:28.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.414098+0000 mgr.gibba043.dnkmem (mgr.34373) 10142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:28.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.414136+0000 mgr.gibba043.dnkmem (mgr.34373) 10143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:28.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.415366+0000 mgr.gibba043.dnkmem (mgr.34373) 10144 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:28.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.415719+0000 mgr.gibba043.dnkmem (mgr.34373) 10145 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:28.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.417087+0000 mgr.gibba043.dnkmem (mgr.34373) 10146 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:28.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.417123+0000 mgr.gibba043.dnkmem (mgr.34373) 10147 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:28.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:28 gibba003 bash[32348]: cephadm 2021-03-10T17:03:27.417228+0000 mgr.gibba043.dnkmem (mgr.34373) 10148 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.178159+0000 mgr.gibba043.dnkmem (mgr.34373) 10133 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:03:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.179716+0000 mgr.gibba043.dnkmem (mgr.34373) 10134 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:03:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.405779+0000 mgr.gibba043.dnkmem (mgr.34373) 10135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.407827+0000 mgr.gibba043.dnkmem (mgr.34373) 10136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.409608+0000 mgr.gibba043.dnkmem (mgr.34373) 10137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.409648+0000 mgr.gibba043.dnkmem (mgr.34373) 10138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.411012+0000 mgr.gibba043.dnkmem (mgr.34373) 10139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.411048+0000 mgr.gibba043.dnkmem (mgr.34373) 10140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.412307+0000 mgr.gibba043.dnkmem (mgr.34373) 10141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.414098+0000 mgr.gibba043.dnkmem (mgr.34373) 10142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:29.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.414136+0000 mgr.gibba043.dnkmem (mgr.34373) 10143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:29.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.415366+0000 mgr.gibba043.dnkmem (mgr.34373) 10144 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:29.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.415719+0000 mgr.gibba043.dnkmem (mgr.34373) 10145 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:29.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.417087+0000 mgr.gibba043.dnkmem (mgr.34373) 10146 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:29.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.417123+0000 mgr.gibba043.dnkmem (mgr.34373) 10147 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:29.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:28 gibba043 bash[24019]: cephadm 2021-03-10T17:03:27.417228+0000 mgr.gibba043.dnkmem (mgr.34373) 10148 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:29 gibba003 bash[31385]: cluster 2021-03-10T17:03:27.628364+0000 mgr.gibba043.dnkmem (mgr.34373) 10149 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:29 gibba003 bash[32348]: cluster 2021-03-10T17:03:27.628364+0000 mgr.gibba043.dnkmem (mgr.34373) 10149 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:29 gibba043 bash[24019]: cluster 2021-03-10T17:03:27.628364+0000 mgr.gibba043.dnkmem (mgr.34373) 10149 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:30.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:30 gibba003 bash[31385]: cluster 2021-03-10T17:03:29.629100+0000 mgr.gibba043.dnkmem (mgr.34373) 10150 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:30.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:30 gibba003 bash[32348]: cluster 2021-03-10T17:03:29.629100+0000 mgr.gibba043.dnkmem (mgr.34373) 10150 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:30 gibba043 bash[24019]: cluster 2021-03-10T17:03:29.629100+0000 mgr.gibba043.dnkmem (mgr.34373) 10150 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:33 gibba003 bash[31385]: cluster 2021-03-10T17:03:31.630634+0000 mgr.gibba043.dnkmem (mgr.34373) 10151 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:33 gibba003 bash[32348]: cluster 2021-03-10T17:03:31.630634+0000 mgr.gibba043.dnkmem (mgr.34373) 10151 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:33 gibba043 bash[24019]: cluster 2021-03-10T17:03:31.630634+0000 mgr.gibba043.dnkmem (mgr.34373) 10151 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:35.199 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:03:35.425 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:03:35.425 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:03:35.425 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:03:35.426 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:03:35.426 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:03:35.426 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:03:35.426 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:03:35.427 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:03:35.427 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:03:35.427 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:03:35.427 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:03:35.427 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:03:35.428 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:03:35.428 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:03:35.428 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:03:35.428 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:03:35.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:03:35.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:03:35.429 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:03:35.429 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:03:35.429 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:03:35.677 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:03:35.678 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:03:35.678 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:35.678 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:03:35.679 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:03:35.679 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:35.679 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:03:35.679 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:03:35.680 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:03:35.680 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:03:35.680 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:03:35.680 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:03:35.681 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:03:35.681 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:03:35.681 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:03:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:35 gibba003 bash[31385]: cluster 2021-03-10T17:03:33.631441+0000 mgr.gibba043.dnkmem (mgr.34373) 10152 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:35.689 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:35 gibba003 bash[32348]: cluster 2021-03-10T17:03:33.631441+0000 mgr.gibba043.dnkmem (mgr.34373) 10152 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:35 gibba043 bash[24019]: cluster 2021-03-10T17:03:33.631441+0000 mgr.gibba043.dnkmem (mgr.34373) 10152 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:36.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:36 gibba003 bash[31385]: audit 2021-03-10T17:03:35.189784+0000 mgr.gibba043.dnkmem (mgr.34373) 10153 : audit [DBG] from='client.50853 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:36 gibba003 bash[31385]: audit 2021-03-10T17:03:35.414874+0000 mgr.gibba043.dnkmem (mgr.34373) 10154 : audit [DBG] from='client.50859 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:36.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:36 gibba003 bash[31385]: audit 2021-03-10T17:03:35.679316+0000 mon.c (mon.1) 2614 : audit [DBG] from='client.? 172.21.2.103:0/1075861220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:36.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:36 gibba003 bash[32348]: audit 2021-03-10T17:03:35.189784+0000 mgr.gibba043.dnkmem (mgr.34373) 10153 : audit [DBG] from='client.50853 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:36.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:36 gibba003 bash[32348]: audit 2021-03-10T17:03:35.414874+0000 mgr.gibba043.dnkmem (mgr.34373) 10154 : audit [DBG] from='client.50859 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:36.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:36 gibba003 bash[32348]: audit 2021-03-10T17:03:35.679316+0000 mon.c (mon.1) 2614 : audit [DBG] from='client.? 172.21.2.103:0/1075861220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:36 gibba043 bash[24019]: audit 2021-03-10T17:03:35.189784+0000 mgr.gibba043.dnkmem (mgr.34373) 10153 : audit [DBG] from='client.50853 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:36 gibba043 bash[24019]: audit 2021-03-10T17:03:35.414874+0000 mgr.gibba043.dnkmem (mgr.34373) 10154 : audit [DBG] from='client.50859 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:36.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:36 gibba043 bash[24019]: audit 2021-03-10T17:03:35.679316+0000 mon.c (mon.1) 2614 : audit [DBG] from='client.? 172.21.2.103:0/1075861220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:37 gibba003 bash[31385]: cluster 2021-03-10T17:03:35.632768+0000 mgr.gibba043.dnkmem (mgr.34373) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:37 gibba003 bash[32348]: cluster 2021-03-10T17:03:35.632768+0000 mgr.gibba043.dnkmem (mgr.34373) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:37 gibba043 bash[24019]: cluster 2021-03-10T17:03:35.632768+0000 mgr.gibba043.dnkmem (mgr.34373) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:39 gibba003 bash[31385]: cluster 2021-03-10T17:03:37.634272+0000 mgr.gibba043.dnkmem (mgr.34373) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:39 gibba003 bash[32348]: cluster 2021-03-10T17:03:37.634272+0000 mgr.gibba043.dnkmem (mgr.34373) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:39 gibba043 bash[24019]: cluster 2021-03-10T17:03:37.634272+0000 mgr.gibba043.dnkmem (mgr.34373) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:41 gibba003 bash[31385]: cluster 2021-03-10T17:03:39.634948+0000 mgr.gibba043.dnkmem (mgr.34373) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:41 gibba003 bash[32348]: cluster 2021-03-10T17:03:39.634948+0000 mgr.gibba043.dnkmem (mgr.34373) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:41 gibba043 bash[24019]: cluster 2021-03-10T17:03:39.634948+0000 mgr.gibba043.dnkmem (mgr.34373) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:43 gibba003 bash[31385]: cluster 2021-03-10T17:03:41.636626+0000 mgr.gibba043.dnkmem (mgr.34373) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:43 gibba003 bash[31385]: cephadm 2021-03-10T17:03:42.432815+0000 mgr.gibba043.dnkmem (mgr.34373) 10159 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:43 gibba003 bash[32348]: cluster 2021-03-10T17:03:41.636626+0000 mgr.gibba043.dnkmem (mgr.34373) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:43 gibba003 bash[32348]: cephadm 2021-03-10T17:03:42.432815+0000 mgr.gibba043.dnkmem (mgr.34373) 10159 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:43.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:43 gibba043 bash[24019]: cluster 2021-03-10T17:03:41.636626+0000 mgr.gibba043.dnkmem (mgr.34373) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:43 gibba043 bash[24019]: cephadm 2021-03-10T17:03:42.432815+0000 mgr.gibba043.dnkmem (mgr.34373) 10159 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:45.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:45 gibba003 bash[31385]: cluster 2021-03-10T17:03:43.637655+0000 mgr.gibba043.dnkmem (mgr.34373) 10160 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:45.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:45 gibba003 bash[32348]: cluster 2021-03-10T17:03:43.637655+0000 mgr.gibba043.dnkmem (mgr.34373) 10160 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:45 gibba043 bash[24019]: cluster 2021-03-10T17:03:43.637655+0000 mgr.gibba043.dnkmem (mgr.34373) 10160 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:47.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:47 gibba003 bash[31385]: cluster 2021-03-10T17:03:45.638307+0000 mgr.gibba043.dnkmem (mgr.34373) 10161 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:47.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:47 gibba003 bash[32348]: cluster 2021-03-10T17:03:45.638307+0000 mgr.gibba043.dnkmem (mgr.34373) 10161 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:47 gibba043 bash[24019]: cluster 2021-03-10T17:03:45.638307+0000 mgr.gibba043.dnkmem (mgr.34373) 10161 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:49.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:49 gibba003 bash[31385]: cluster 2021-03-10T17:03:47.639843+0000 mgr.gibba043.dnkmem (mgr.34373) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:49.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:49 gibba003 bash[32348]: cluster 2021-03-10T17:03:47.639843+0000 mgr.gibba043.dnkmem (mgr.34373) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:49 gibba043 bash[24019]: cluster 2021-03-10T17:03:47.639843+0000 mgr.gibba043.dnkmem (mgr.34373) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:51.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:51 gibba003 bash[31385]: cluster 2021-03-10T17:03:49.641371+0000 mgr.gibba043.dnkmem (mgr.34373) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:51.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:51 gibba003 bash[32348]: cluster 2021-03-10T17:03:49.641371+0000 mgr.gibba043.dnkmem (mgr.34373) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:51 gibba043 bash[24019]: cluster 2021-03-10T17:03:49.641371+0000 mgr.gibba043.dnkmem (mgr.34373) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:53 gibba043 bash[24019]: cluster 2021-03-10T17:03:51.642153+0000 mgr.gibba043.dnkmem (mgr.34373) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:53 gibba003 bash[31385]: cluster 2021-03-10T17:03:51.642153+0000 mgr.gibba043.dnkmem (mgr.34373) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:53 gibba003 bash[32348]: cluster 2021-03-10T17:03:51.642153+0000 mgr.gibba043.dnkmem (mgr.34373) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:55 gibba043 bash[24019]: cluster 2021-03-10T17:03:53.643050+0000 mgr.gibba043.dnkmem (mgr.34373) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:55 gibba003 bash[31385]: cluster 2021-03-10T17:03:53.643050+0000 mgr.gibba043.dnkmem (mgr.34373) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:55 gibba003 bash[32348]: cluster 2021-03-10T17:03:53.643050+0000 mgr.gibba043.dnkmem (mgr.34373) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:57 gibba043 bash[24019]: cluster 2021-03-10T17:03:55.644509+0000 mgr.gibba043.dnkmem (mgr.34373) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:57 gibba003 bash[31385]: cluster 2021-03-10T17:03:55.644509+0000 mgr.gibba043.dnkmem (mgr.34373) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:57 gibba003 bash[32348]: cluster 2021-03-10T17:03:55.644509+0000 mgr.gibba043.dnkmem (mgr.34373) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:58.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:58 gibba043 bash[24019]: cephadm 2021-03-10T17:03:57.448954+0000 mgr.gibba043.dnkmem (mgr.34373) 10167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:58.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:58 gibba003 bash[31385]: cephadm 2021-03-10T17:03:57.448954+0000 mgr.gibba043.dnkmem (mgr.34373) 10167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:58.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:58 gibba003 bash[32348]: cephadm 2021-03-10T17:03:57.448954+0000 mgr.gibba043.dnkmem (mgr.34373) 10167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:03:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:03:59 gibba043 bash[24019]: cluster 2021-03-10T17:03:57.645243+0000 mgr.gibba043.dnkmem (mgr.34373) 10168 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:03:59 gibba003 bash[31385]: cluster 2021-03-10T17:03:57.645243+0000 mgr.gibba043.dnkmem (mgr.34373) 10168 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:03:59 gibba003 bash[32348]: cluster 2021-03-10T17:03:57.645243+0000 mgr.gibba043.dnkmem (mgr.34373) 10168 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:01 gibba043 bash[24019]: cluster 2021-03-10T17:03:59.646327+0000 mgr.gibba043.dnkmem (mgr.34373) 10169 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:01 gibba003 bash[31385]: cluster 2021-03-10T17:03:59.646327+0000 mgr.gibba043.dnkmem (mgr.34373) 10169 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:01 gibba003 bash[32348]: cluster 2021-03-10T17:03:59.646327+0000 mgr.gibba043.dnkmem (mgr.34373) 10169 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:03.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:03 gibba043 bash[24019]: cluster 2021-03-10T17:04:01.647771+0000 mgr.gibba043.dnkmem (mgr.34373) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:03 gibba003 bash[31385]: cluster 2021-03-10T17:04:01.647771+0000 mgr.gibba043.dnkmem (mgr.34373) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:03 gibba003 bash[32348]: cluster 2021-03-10T17:04:01.647771+0000 mgr.gibba043.dnkmem (mgr.34373) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:05 gibba043 bash[24019]: cluster 2021-03-10T17:04:03.648455+0000 mgr.gibba043.dnkmem (mgr.34373) 10171 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:05 gibba003 bash[31385]: cluster 2021-03-10T17:04:03.648455+0000 mgr.gibba043.dnkmem (mgr.34373) 10171 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:05 gibba003 bash[32348]: cluster 2021-03-10T17:04:03.648455+0000 mgr.gibba043.dnkmem (mgr.34373) 10171 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.964 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:04:06.192 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:04:06.192 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:04:06.192 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:04:06.193 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:04:06.193 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:04:06.193 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:04:06.193 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:04:06.193 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:04:06.194 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:04:06.194 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:04:06.194 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:04:06.194 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:04:06.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:04:06.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:04:06.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:04:06.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:04:06.195 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:04:06.196 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:04:06.196 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:04:06.196 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:04:06.196 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:04:06.440 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:04:06.440 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:04:06.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:06.441 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:04:06.441 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:04:06.441 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:06.441 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:04:06.442 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:04:06.442 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:04:06.442 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:04:06.442 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:04:06.442 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:04:06.443 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:04:06.443 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:04:06.443 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:04:06.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:06 gibba043 bash[24019]: audit 2021-03-10T17:04:06.441586+0000 mon.c (mon.1) 2615 : audit [DBG] from='client.? 172.21.2.103:0/2869175482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:06.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:06 gibba003 bash[31385]: audit 2021-03-10T17:04:06.441586+0000 mon.c (mon.1) 2615 : audit [DBG] from='client.? 172.21.2.103:0/2869175482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:06.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:06 gibba003 bash[32348]: audit 2021-03-10T17:04:06.441586+0000 mon.c (mon.1) 2615 : audit [DBG] from='client.? 172.21.2.103:0/2869175482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:07.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:07 gibba043 bash[24019]: cluster 2021-03-10T17:04:05.649936+0000 mgr.gibba043.dnkmem (mgr.34373) 10172 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:07 gibba043 bash[24019]: audit 2021-03-10T17:04:05.954560+0000 mgr.gibba043.dnkmem (mgr.34373) 10173 : audit [DBG] from='client.50871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:07 gibba043 bash[24019]: audit 2021-03-10T17:04:06.179355+0000 mgr.gibba043.dnkmem (mgr.34373) 10174 : audit [DBG] from='client.50877 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:07 gibba003 bash[31385]: cluster 2021-03-10T17:04:05.649936+0000 mgr.gibba043.dnkmem (mgr.34373) 10172 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:07 gibba003 bash[31385]: audit 2021-03-10T17:04:05.954560+0000 mgr.gibba043.dnkmem (mgr.34373) 10173 : audit [DBG] from='client.50871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:07 gibba003 bash[31385]: audit 2021-03-10T17:04:06.179355+0000 mgr.gibba043.dnkmem (mgr.34373) 10174 : audit [DBG] from='client.50877 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:07 gibba003 bash[32348]: cluster 2021-03-10T17:04:05.649936+0000 mgr.gibba043.dnkmem (mgr.34373) 10172 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:07 gibba003 bash[32348]: audit 2021-03-10T17:04:05.954560+0000 mgr.gibba043.dnkmem (mgr.34373) 10173 : audit [DBG] from='client.50871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:07 gibba003 bash[32348]: audit 2021-03-10T17:04:06.179355+0000 mgr.gibba043.dnkmem (mgr.34373) 10174 : audit [DBG] from='client.50877 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:09 gibba003 bash[31385]: cluster 2021-03-10T17:04:07.651610+0000 mgr.gibba043.dnkmem (mgr.34373) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:09 gibba003 bash[32348]: cluster 2021-03-10T17:04:07.651610+0000 mgr.gibba043.dnkmem (mgr.34373) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:09 gibba043 bash[24019]: cluster 2021-03-10T17:04:07.651610+0000 mgr.gibba043.dnkmem (mgr.34373) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:11 gibba003 bash[31385]: cluster 2021-03-10T17:04:09.652201+0000 mgr.gibba043.dnkmem (mgr.34373) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:11 gibba003 bash[32348]: cluster 2021-03-10T17:04:09.652201+0000 mgr.gibba043.dnkmem (mgr.34373) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:11 gibba043 bash[24019]: cluster 2021-03-10T17:04:09.652201+0000 mgr.gibba043.dnkmem (mgr.34373) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:13 gibba003 bash[31385]: cluster 2021-03-10T17:04:11.653885+0000 mgr.gibba043.dnkmem (mgr.34373) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:13 gibba003 bash[31385]: cephadm 2021-03-10T17:04:12.464624+0000 mgr.gibba043.dnkmem (mgr.34373) 10178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:13 gibba003 bash[32348]: cluster 2021-03-10T17:04:11.653885+0000 mgr.gibba043.dnkmem (mgr.34373) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:13 gibba003 bash[32348]: cephadm 2021-03-10T17:04:12.464624+0000 mgr.gibba043.dnkmem (mgr.34373) 10178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:13 gibba043 bash[24019]: cluster 2021-03-10T17:04:11.653885+0000 mgr.gibba043.dnkmem (mgr.34373) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:13 gibba043 bash[24019]: cephadm 2021-03-10T17:04:12.464624+0000 mgr.gibba043.dnkmem (mgr.34373) 10178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:13.959098+0000 mon.c (mon.1) 2616 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:13.960274+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.194898+0000 mon.c (mon.1) 2617 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.196031+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.509234+0000 mon.c (mon.1) 2618 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:04:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.510190+0000 mon.c (mon.1) 2619 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.510415+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:04:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.511142+0000 mon.c (mon.1) 2620 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:04:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.511775+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.512185+0000 mon.c (mon.1) 2621 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.512701+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:04:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[31385]: audit 2021-03-10T17:04:14.513551+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:13.959098+0000 mon.c (mon.1) 2616 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:13.960274+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.194898+0000 mon.c (mon.1) 2617 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.196031+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.509234+0000 mon.c (mon.1) 2618 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:04:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.510190+0000 mon.c (mon.1) 2619 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.510415+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:04:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.511142+0000 mon.c (mon.1) 2620 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:04:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.511775+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.512185+0000 mon.c (mon.1) 2621 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.512701+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:04:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:14 gibba003 bash[32348]: audit 2021-03-10T17:04:14.513551+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:13.959098+0000 mon.c (mon.1) 2616 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:13.960274+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.194898+0000 mon.c (mon.1) 2617 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.196031+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.509234+0000 mon.c (mon.1) 2618 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:04:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.510190+0000 mon.c (mon.1) 2619 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:04:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.510415+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:04:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.511142+0000 mon.c (mon.1) 2620 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:04:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.511775+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:04:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.512185+0000 mon.c (mon.1) 2621 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.512701+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:04:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:14 gibba043 bash[24019]: audit 2021-03-10T17:04:14.513551+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:15 gibba003 bash[31385]: cluster 2021-03-10T17:04:13.655480+0000 mgr.gibba043.dnkmem (mgr.34373) 10179 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:15 gibba003 bash[32348]: cluster 2021-03-10T17:04:13.655480+0000 mgr.gibba043.dnkmem (mgr.34373) 10179 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:15 gibba043 bash[24019]: cluster 2021-03-10T17:04:13.655480+0000 mgr.gibba043.dnkmem (mgr.34373) 10179 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:17 gibba003 bash[31385]: cluster 2021-03-10T17:04:15.656733+0000 mgr.gibba043.dnkmem (mgr.34373) 10180 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:17 gibba003 bash[32348]: cluster 2021-03-10T17:04:15.656733+0000 mgr.gibba043.dnkmem (mgr.34373) 10180 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:17 gibba043 bash[24019]: cluster 2021-03-10T17:04:15.656733+0000 mgr.gibba043.dnkmem (mgr.34373) 10180 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:19 gibba003 bash[31385]: cluster 2021-03-10T17:04:17.658346+0000 mgr.gibba043.dnkmem (mgr.34373) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:19 gibba003 bash[32348]: cluster 2021-03-10T17:04:17.658346+0000 mgr.gibba043.dnkmem (mgr.34373) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:19 gibba043 bash[24019]: cluster 2021-03-10T17:04:17.658346+0000 mgr.gibba043.dnkmem (mgr.34373) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:21 gibba003 bash[31385]: cluster 2021-03-10T17:04:19.659205+0000 mgr.gibba043.dnkmem (mgr.34373) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:21 gibba003 bash[32348]: cluster 2021-03-10T17:04:19.659205+0000 mgr.gibba043.dnkmem (mgr.34373) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:21 gibba043 bash[24019]: cluster 2021-03-10T17:04:19.659205+0000 mgr.gibba043.dnkmem (mgr.34373) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:23 gibba003 bash[31385]: cluster 2021-03-10T17:04:21.659898+0000 mgr.gibba043.dnkmem (mgr.34373) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:23 gibba003 bash[32348]: cluster 2021-03-10T17:04:21.659898+0000 mgr.gibba043.dnkmem (mgr.34373) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:23 gibba043 bash[24019]: cluster 2021-03-10T17:04:21.659898+0000 mgr.gibba043.dnkmem (mgr.34373) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:25 gibba003 bash[31385]: cluster 2021-03-10T17:04:23.660929+0000 mgr.gibba043.dnkmem (mgr.34373) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:25 gibba003 bash[32348]: cluster 2021-03-10T17:04:23.660929+0000 mgr.gibba043.dnkmem (mgr.34373) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:26.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:25 gibba043 bash[24019]: cluster 2021-03-10T17:04:23.660929+0000 mgr.gibba043.dnkmem (mgr.34373) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:27 gibba003 bash[31385]: cluster 2021-03-10T17:04:25.661662+0000 mgr.gibba043.dnkmem (mgr.34373) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:27 gibba003 bash[32348]: cluster 2021-03-10T17:04:25.661662+0000 mgr.gibba043.dnkmem (mgr.34373) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:27 gibba043 bash[24019]: cluster 2021-03-10T17:04:25.661662+0000 mgr.gibba043.dnkmem (mgr.34373) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.481158+0000 mgr.gibba043.dnkmem (mgr.34373) 10186 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:04:28.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.482613+0000 mgr.gibba043.dnkmem (mgr.34373) 10187 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:04:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.714892+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:04:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.718400+0000 mon.c (mon.1) 2622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.719552+0000 mon.c (mon.1) 2623 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.720930+0000 mon.c (mon.1) 2624 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.722242+0000 mon.c (mon.1) 2625 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.725710+0000 mon.c (mon.1) 2626 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[31385]: audit 2021-03-10T17:04:27.727131+0000 mon.c (mon.1) 2627 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.481158+0000 mgr.gibba043.dnkmem (mgr.34373) 10186 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:04:28.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.482613+0000 mgr.gibba043.dnkmem (mgr.34373) 10187 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:04:28.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.714892+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:04:28.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.718400+0000 mon.c (mon.1) 2622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:28.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.719552+0000 mon.c (mon.1) 2623 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.720930+0000 mon.c (mon.1) 2624 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.722242+0000 mon.c (mon.1) 2625 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.725710+0000 mon.c (mon.1) 2626 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:28.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:28 gibba003 bash[32348]: audit 2021-03-10T17:04:27.727131+0000 mon.c (mon.1) 2627 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.481158+0000 mgr.gibba043.dnkmem (mgr.34373) 10186 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:04:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.482613+0000 mgr.gibba043.dnkmem (mgr.34373) 10187 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:04:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.714892+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:04:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.718400+0000 mon.c (mon.1) 2622 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.719552+0000 mon.c (mon.1) 2623 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.720930+0000 mon.c (mon.1) 2624 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.722242+0000 mon.c (mon.1) 2625 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.725710+0000 mon.c (mon.1) 2626 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:28 gibba043 bash[24019]: audit 2021-03-10T17:04:27.727131+0000 mon.c (mon.1) 2627 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cluster 2021-03-10T17:04:27.662191+0000 mgr.gibba043.dnkmem (mgr.34373) 10188 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.716024+0000 mgr.gibba043.dnkmem (mgr.34373) 10189 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.717503+0000 mgr.gibba043.dnkmem (mgr.34373) 10190 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.718909+0000 mgr.gibba043.dnkmem (mgr.34373) 10191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.718948+0000 mgr.gibba043.dnkmem (mgr.34373) 10192 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.720079+0000 mgr.gibba043.dnkmem (mgr.34373) 10193 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.720116+0000 mgr.gibba043.dnkmem (mgr.34373) 10194 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.721609+0000 mgr.gibba043.dnkmem (mgr.34373) 10195 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.723428+0000 mgr.gibba043.dnkmem (mgr.34373) 10196 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.723466+0000 mgr.gibba043.dnkmem (mgr.34373) 10197 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.724880+0000 mgr.gibba043.dnkmem (mgr.34373) 10198 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.725193+0000 mgr.gibba043.dnkmem (mgr.34373) 10199 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.726485+0000 mgr.gibba043.dnkmem (mgr.34373) 10200 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.726526+0000 mgr.gibba043.dnkmem (mgr.34373) 10201 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[31385]: cephadm 2021-03-10T17:04:27.726636+0000 mgr.gibba043.dnkmem (mgr.34373) 10202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cluster 2021-03-10T17:04:27.662191+0000 mgr.gibba043.dnkmem (mgr.34373) 10188 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.716024+0000 mgr.gibba043.dnkmem (mgr.34373) 10189 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.717503+0000 mgr.gibba043.dnkmem (mgr.34373) 10190 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.718909+0000 mgr.gibba043.dnkmem (mgr.34373) 10191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.718948+0000 mgr.gibba043.dnkmem (mgr.34373) 10192 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.720079+0000 mgr.gibba043.dnkmem (mgr.34373) 10193 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.720116+0000 mgr.gibba043.dnkmem (mgr.34373) 10194 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.721609+0000 mgr.gibba043.dnkmem (mgr.34373) 10195 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:29.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.723428+0000 mgr.gibba043.dnkmem (mgr.34373) 10196 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:29.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.723466+0000 mgr.gibba043.dnkmem (mgr.34373) 10197 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:29.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.724880+0000 mgr.gibba043.dnkmem (mgr.34373) 10198 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:29.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.725193+0000 mgr.gibba043.dnkmem (mgr.34373) 10199 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:29.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.726485+0000 mgr.gibba043.dnkmem (mgr.34373) 10200 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:29.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.726526+0000 mgr.gibba043.dnkmem (mgr.34373) 10201 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:29.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:29 gibba003 bash[32348]: cephadm 2021-03-10T17:04:27.726636+0000 mgr.gibba043.dnkmem (mgr.34373) 10202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cluster 2021-03-10T17:04:27.662191+0000 mgr.gibba043.dnkmem (mgr.34373) 10188 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.716024+0000 mgr.gibba043.dnkmem (mgr.34373) 10189 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.717503+0000 mgr.gibba043.dnkmem (mgr.34373) 10190 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.718909+0000 mgr.gibba043.dnkmem (mgr.34373) 10191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.718948+0000 mgr.gibba043.dnkmem (mgr.34373) 10192 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.720079+0000 mgr.gibba043.dnkmem (mgr.34373) 10193 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.720116+0000 mgr.gibba043.dnkmem (mgr.34373) 10194 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.721609+0000 mgr.gibba043.dnkmem (mgr.34373) 10195 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.723428+0000 mgr.gibba043.dnkmem (mgr.34373) 10196 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.723466+0000 mgr.gibba043.dnkmem (mgr.34373) 10197 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.724880+0000 mgr.gibba043.dnkmem (mgr.34373) 10198 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.725193+0000 mgr.gibba043.dnkmem (mgr.34373) 10199 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.726485+0000 mgr.gibba043.dnkmem (mgr.34373) 10200 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.726526+0000 mgr.gibba043.dnkmem (mgr.34373) 10201 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:30.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:29 gibba043 bash[24019]: cephadm 2021-03-10T17:04:27.726636+0000 mgr.gibba043.dnkmem (mgr.34373) 10202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:30.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:30 gibba003 bash[31385]: cluster 2021-03-10T17:04:29.663572+0000 mgr.gibba043.dnkmem (mgr.34373) 10203 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:30.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:30 gibba003 bash[32348]: cluster 2021-03-10T17:04:29.663572+0000 mgr.gibba043.dnkmem (mgr.34373) 10203 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:31.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:30 gibba043 bash[24019]: cluster 2021-03-10T17:04:29.663572+0000 mgr.gibba043.dnkmem (mgr.34373) 10203 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:33 gibba003 bash[31385]: cluster 2021-03-10T17:04:31.665362+0000 mgr.gibba043.dnkmem (mgr.34373) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:33 gibba003 bash[32348]: cluster 2021-03-10T17:04:31.665362+0000 mgr.gibba043.dnkmem (mgr.34373) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:33.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:33 gibba043 bash[24019]: cluster 2021-03-10T17:04:31.665362+0000 mgr.gibba043.dnkmem (mgr.34373) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:35.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:35 gibba003 bash[31385]: cluster 2021-03-10T17:04:33.666714+0000 mgr.gibba043.dnkmem (mgr.34373) 10205 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:35.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:35 gibba003 bash[32348]: cluster 2021-03-10T17:04:33.666714+0000 mgr.gibba043.dnkmem (mgr.34373) 10205 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:35 gibba043 bash[24019]: cluster 2021-03-10T17:04:33.666714+0000 mgr.gibba043.dnkmem (mgr.34373) 10205 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:36.684 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:04:36.913 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:04:36.914 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:04:36.914 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:04:36.914 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:04:36.914 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:04:36.915 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:04:36.915 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:04:36.915 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:04:36.915 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:04:36.916 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:04:36.916 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:04:36.916 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:04:36.916 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:04:36.916 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:04:36.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:04:36.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:04:36.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:04:36.917 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:04:36.918 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:04:36.918 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:04:36.918 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:04:37.163 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:04:37.164 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:04:37.164 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:37.164 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:04:37.164 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:04:37.165 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:37.165 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:04:37.165 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:04:37.165 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:04:37.166 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:04:37.166 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:04:37.166 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:04:37.166 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:04:37.167 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:04:37.167 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:04:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:37 gibba003 bash[31385]: cluster 2021-03-10T17:04:35.668099+0000 mgr.gibba043.dnkmem (mgr.34373) 10206 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:37.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:37 gibba003 bash[31385]: audit 2021-03-10T17:04:37.164873+0000 mon.c (mon.1) 2628 : audit [DBG] from='client.? 172.21.2.103:0/3802929671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:37 gibba003 bash[32348]: cluster 2021-03-10T17:04:35.668099+0000 mgr.gibba043.dnkmem (mgr.34373) 10206 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:37 gibba003 bash[32348]: audit 2021-03-10T17:04:37.164873+0000 mon.c (mon.1) 2628 : audit [DBG] from='client.? 172.21.2.103:0/3802929671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:37 gibba043 bash[24019]: cluster 2021-03-10T17:04:35.668099+0000 mgr.gibba043.dnkmem (mgr.34373) 10206 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:37 gibba043 bash[24019]: audit 2021-03-10T17:04:37.164873+0000 mon.c (mon.1) 2628 : audit [DBG] from='client.? 172.21.2.103:0/3802929671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:38.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:38 gibba003 bash[31385]: audit 2021-03-10T17:04:36.676114+0000 mgr.gibba043.dnkmem (mgr.34373) 10207 : audit [DBG] from='client.50889 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:38.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:38 gibba003 bash[31385]: audit 2021-03-10T17:04:36.900751+0000 mgr.gibba043.dnkmem (mgr.34373) 10208 : audit [DBG] from='client.60886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:38.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:38 gibba003 bash[32348]: audit 2021-03-10T17:04:36.676114+0000 mgr.gibba043.dnkmem (mgr.34373) 10207 : audit [DBG] from='client.50889 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:38.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:38 gibba003 bash[32348]: audit 2021-03-10T17:04:36.900751+0000 mgr.gibba043.dnkmem (mgr.34373) 10208 : audit [DBG] from='client.60886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:38.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:38 gibba043 bash[24019]: audit 2021-03-10T17:04:36.676114+0000 mgr.gibba043.dnkmem (mgr.34373) 10207 : audit [DBG] from='client.50889 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:38.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:38 gibba043 bash[24019]: audit 2021-03-10T17:04:36.900751+0000 mgr.gibba043.dnkmem (mgr.34373) 10208 : audit [DBG] from='client.60886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:39 gibba003 bash[31385]: cluster 2021-03-10T17:04:37.669716+0000 mgr.gibba043.dnkmem (mgr.34373) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:39.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:39 gibba003 bash[32348]: cluster 2021-03-10T17:04:37.669716+0000 mgr.gibba043.dnkmem (mgr.34373) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:39 gibba043 bash[24019]: cluster 2021-03-10T17:04:37.669716+0000 mgr.gibba043.dnkmem (mgr.34373) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:41 gibba003 bash[31385]: cluster 2021-03-10T17:04:39.670325+0000 mgr.gibba043.dnkmem (mgr.34373) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:41 gibba003 bash[32348]: cluster 2021-03-10T17:04:39.670325+0000 mgr.gibba043.dnkmem (mgr.34373) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:41 gibba043 bash[24019]: cluster 2021-03-10T17:04:39.670325+0000 mgr.gibba043.dnkmem (mgr.34373) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:43.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:43 gibba003 bash[31385]: cluster 2021-03-10T17:04:41.672072+0000 mgr.gibba043.dnkmem (mgr.34373) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:43.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:43 gibba003 bash[32348]: cluster 2021-03-10T17:04:41.672072+0000 mgr.gibba043.dnkmem (mgr.34373) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:43 gibba043 bash[24019]: cluster 2021-03-10T17:04:41.672072+0000 mgr.gibba043.dnkmem (mgr.34373) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:44.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:44 gibba043 bash[24019]: cephadm 2021-03-10T17:04:42.740639+0000 mgr.gibba043.dnkmem (mgr.34373) 10212 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:44.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:44 gibba003 bash[31385]: cephadm 2021-03-10T17:04:42.740639+0000 mgr.gibba043.dnkmem (mgr.34373) 10212 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:44.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:44 gibba003 bash[32348]: cephadm 2021-03-10T17:04:42.740639+0000 mgr.gibba043.dnkmem (mgr.34373) 10212 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:45 gibba043 bash[24019]: cluster 2021-03-10T17:04:43.673343+0000 mgr.gibba043.dnkmem (mgr.34373) 10213 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:45 gibba003 bash[31385]: cluster 2021-03-10T17:04:43.673343+0000 mgr.gibba043.dnkmem (mgr.34373) 10213 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:45 gibba003 bash[32348]: cluster 2021-03-10T17:04:43.673343+0000 mgr.gibba043.dnkmem (mgr.34373) 10213 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:47 gibba043 bash[24019]: cluster 2021-03-10T17:04:45.674212+0000 mgr.gibba043.dnkmem (mgr.34373) 10214 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:47 gibba003 bash[31385]: cluster 2021-03-10T17:04:45.674212+0000 mgr.gibba043.dnkmem (mgr.34373) 10214 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:47 gibba003 bash[32348]: cluster 2021-03-10T17:04:45.674212+0000 mgr.gibba043.dnkmem (mgr.34373) 10214 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:49 gibba043 bash[24019]: cluster 2021-03-10T17:04:47.675653+0000 mgr.gibba043.dnkmem (mgr.34373) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:49 gibba003 bash[31385]: cluster 2021-03-10T17:04:47.675653+0000 mgr.gibba043.dnkmem (mgr.34373) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:49 gibba003 bash[32348]: cluster 2021-03-10T17:04:47.675653+0000 mgr.gibba043.dnkmem (mgr.34373) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:51.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:51 gibba043 bash[24019]: cluster 2021-03-10T17:04:49.677208+0000 mgr.gibba043.dnkmem (mgr.34373) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:51 gibba003 bash[31385]: cluster 2021-03-10T17:04:49.677208+0000 mgr.gibba043.dnkmem (mgr.34373) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:51 gibba003 bash[32348]: cluster 2021-03-10T17:04:49.677208+0000 mgr.gibba043.dnkmem (mgr.34373) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:53 gibba043 bash[24019]: cluster 2021-03-10T17:04:51.678079+0000 mgr.gibba043.dnkmem (mgr.34373) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:53 gibba003 bash[31385]: cluster 2021-03-10T17:04:51.678079+0000 mgr.gibba043.dnkmem (mgr.34373) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:53 gibba003 bash[32348]: cluster 2021-03-10T17:04:51.678079+0000 mgr.gibba043.dnkmem (mgr.34373) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:55.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:55 gibba043 bash[24019]: cluster 2021-03-10T17:04:53.679476+0000 mgr.gibba043.dnkmem (mgr.34373) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:55 gibba003 bash[31385]: cluster 2021-03-10T17:04:53.679476+0000 mgr.gibba043.dnkmem (mgr.34373) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:55 gibba003 bash[32348]: cluster 2021-03-10T17:04:53.679476+0000 mgr.gibba043.dnkmem (mgr.34373) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:57.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:57 gibba043 bash[24019]: cluster 2021-03-10T17:04:55.680881+0000 mgr.gibba043.dnkmem (mgr.34373) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:57 gibba003 bash[31385]: cluster 2021-03-10T17:04:55.680881+0000 mgr.gibba043.dnkmem (mgr.34373) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:57 gibba003 bash[32348]: cluster 2021-03-10T17:04:55.680881+0000 mgr.gibba043.dnkmem (mgr.34373) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:59 gibba043 bash[24019]: cluster 2021-03-10T17:04:57.681754+0000 mgr.gibba043.dnkmem (mgr.34373) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:04:59 gibba043 bash[24019]: cephadm 2021-03-10T17:04:57.750874+0000 mgr.gibba043.dnkmem (mgr.34373) 10221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:59 gibba003 bash[31385]: cluster 2021-03-10T17:04:57.681754+0000 mgr.gibba043.dnkmem (mgr.34373) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:04:59 gibba003 bash[31385]: cephadm 2021-03-10T17:04:57.750874+0000 mgr.gibba043.dnkmem (mgr.34373) 10221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:04:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:59 gibba003 bash[32348]: cluster 2021-03-10T17:04:57.681754+0000 mgr.gibba043.dnkmem (mgr.34373) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:04:59 gibba003 bash[32348]: cephadm 2021-03-10T17:04:57.750874+0000 mgr.gibba043.dnkmem (mgr.34373) 10221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:01.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:01 gibba043 bash[24019]: cluster 2021-03-10T17:04:59.683004+0000 mgr.gibba043.dnkmem (mgr.34373) 10222 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:01 gibba003 bash[31385]: cluster 2021-03-10T17:04:59.683004+0000 mgr.gibba043.dnkmem (mgr.34373) 10222 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:01 gibba003 bash[32348]: cluster 2021-03-10T17:04:59.683004+0000 mgr.gibba043.dnkmem (mgr.34373) 10222 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:03 gibba003 bash[31385]: cluster 2021-03-10T17:05:01.684678+0000 mgr.gibba043.dnkmem (mgr.34373) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:03 gibba003 bash[32348]: cluster 2021-03-10T17:05:01.684678+0000 mgr.gibba043.dnkmem (mgr.34373) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:03 gibba043 bash[24019]: cluster 2021-03-10T17:05:01.684678+0000 mgr.gibba043.dnkmem (mgr.34373) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:05 gibba003 bash[31385]: cluster 2021-03-10T17:05:03.685999+0000 mgr.gibba043.dnkmem (mgr.34373) 10224 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:05 gibba003 bash[32348]: cluster 2021-03-10T17:05:03.685999+0000 mgr.gibba043.dnkmem (mgr.34373) 10224 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:05 gibba043 bash[24019]: cluster 2021-03-10T17:05:03.685999+0000 mgr.gibba043.dnkmem (mgr.34373) 10224 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:07.406 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:05:07.651 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:05:07.651 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:05:07.652 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:05:07.652 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:05:07.652 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:05:07.652 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:05:07.653 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:05:07.653 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:05:07.653 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:05:07.653 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:05:07.654 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:05:07.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:05:07.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:05:07.654 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:05:07.655 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:05:07.655 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:05:07.655 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:05:07.655 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:05:07.655 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:05:07.656 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:05:07.656 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:05:07.900 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:05:07.900 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:05:07.900 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:07.901 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:05:07.901 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:05:07.901 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:07.901 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:05:07.902 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:05:07.902 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:05:07.902 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:05:07.902 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:05:07.903 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:05:07.903 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:05:07.903 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:05:07.903 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:05:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:07 gibba003 bash[31385]: cluster 2021-03-10T17:05:05.687351+0000 mgr.gibba043.dnkmem (mgr.34373) 10225 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:07.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:07 gibba003 bash[32348]: cluster 2021-03-10T17:05:05.687351+0000 mgr.gibba043.dnkmem (mgr.34373) 10225 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:07 gibba043 bash[24019]: cluster 2021-03-10T17:05:05.687351+0000 mgr.gibba043.dnkmem (mgr.34373) 10225 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:08 gibba003 bash[31385]: audit 2021-03-10T17:05:07.396865+0000 mgr.gibba043.dnkmem (mgr.34373) 10226 : audit [DBG] from='client.50907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:08.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:08 gibba003 bash[31385]: audit 2021-03-10T17:05:07.901331+0000 mon.a (mon.0) 2082 : audit [DBG] from='client.? 172.21.2.103:0/876770871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:08 gibba003 bash[32348]: audit 2021-03-10T17:05:07.396865+0000 mgr.gibba043.dnkmem (mgr.34373) 10226 : audit [DBG] from='client.50907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:08 gibba003 bash[32348]: audit 2021-03-10T17:05:07.901331+0000 mon.a (mon.0) 2082 : audit [DBG] from='client.? 172.21.2.103:0/876770871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:09.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:08 gibba043 bash[24019]: audit 2021-03-10T17:05:07.396865+0000 mgr.gibba043.dnkmem (mgr.34373) 10226 : audit [DBG] from='client.50907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:08 gibba043 bash[24019]: audit 2021-03-10T17:05:07.901331+0000 mon.a (mon.0) 2082 : audit [DBG] from='client.? 172.21.2.103:0/876770871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:09 gibba003 bash[31385]: audit 2021-03-10T17:05:07.622525+0000 mgr.gibba043.dnkmem (mgr.34373) 10227 : audit [DBG] from='client.60904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:09 gibba003 bash[31385]: cluster 2021-03-10T17:05:07.688771+0000 mgr.gibba043.dnkmem (mgr.34373) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:09 gibba003 bash[32348]: audit 2021-03-10T17:05:07.622525+0000 mgr.gibba043.dnkmem (mgr.34373) 10227 : audit [DBG] from='client.60904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:09 gibba003 bash[32348]: cluster 2021-03-10T17:05:07.688771+0000 mgr.gibba043.dnkmem (mgr.34373) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:09 gibba043 bash[24019]: audit 2021-03-10T17:05:07.622525+0000 mgr.gibba043.dnkmem (mgr.34373) 10227 : audit [DBG] from='client.60904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:09 gibba043 bash[24019]: cluster 2021-03-10T17:05:07.688771+0000 mgr.gibba043.dnkmem (mgr.34373) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:11 gibba003 bash[31385]: cluster 2021-03-10T17:05:09.690280+0000 mgr.gibba043.dnkmem (mgr.34373) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:11 gibba003 bash[32348]: cluster 2021-03-10T17:05:09.690280+0000 mgr.gibba043.dnkmem (mgr.34373) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:11 gibba043 bash[24019]: cluster 2021-03-10T17:05:09.690280+0000 mgr.gibba043.dnkmem (mgr.34373) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:13 gibba003 bash[31385]: cluster 2021-03-10T17:05:11.691842+0000 mgr.gibba043.dnkmem (mgr.34373) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:13 gibba003 bash[32348]: cluster 2021-03-10T17:05:11.691842+0000 mgr.gibba043.dnkmem (mgr.34373) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:13 gibba043 bash[24019]: cluster 2021-03-10T17:05:11.691842+0000 mgr.gibba043.dnkmem (mgr.34373) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: cephadm 2021-03-10T17:05:12.766878+0000 mgr.gibba043.dnkmem (mgr.34373) 10231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:13.965858+0000 mon.c (mon.1) 2629 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:13.966923+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.202101+0000 mon.c (mon.1) 2630 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.203247+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.520822+0000 mon.c (mon.1) 2631 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.521592+0000 mon.c (mon.1) 2632 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:05:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.522020+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.522256+0000 mon.c (mon.1) 2633 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.523133+0000 mon.c (mon.1) 2634 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.523531+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:05:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.524532+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[31385]: audit 2021-03-10T17:05:14.525384+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: cephadm 2021-03-10T17:05:12.766878+0000 mgr.gibba043.dnkmem (mgr.34373) 10231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:13.965858+0000 mon.c (mon.1) 2629 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:13.966923+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.202101+0000 mon.c (mon.1) 2630 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.203247+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.520822+0000 mon.c (mon.1) 2631 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.521592+0000 mon.c (mon.1) 2632 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:05:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.522020+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.522256+0000 mon.c (mon.1) 2633 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.523133+0000 mon.c (mon.1) 2634 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.523531+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:05:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.524532+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:14 gibba003 bash[32348]: audit 2021-03-10T17:05:14.525384+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:05:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: cephadm 2021-03-10T17:05:12.766878+0000 mgr.gibba043.dnkmem (mgr.34373) 10231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:13.965858+0000 mon.c (mon.1) 2629 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:13.966923+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.202101+0000 mon.c (mon.1) 2630 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.203247+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.520822+0000 mon.c (mon.1) 2631 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.521592+0000 mon.c (mon.1) 2632 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:05:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.522020+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.522256+0000 mon.c (mon.1) 2633 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.523133+0000 mon.c (mon.1) 2634 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:05:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.523531+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:05:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.524532+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:14 gibba043 bash[24019]: audit 2021-03-10T17:05:14.525384+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:05:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:15 gibba003 bash[31385]: cluster 2021-03-10T17:05:13.693166+0000 mgr.gibba043.dnkmem (mgr.34373) 10232 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:15 gibba003 bash[32348]: cluster 2021-03-10T17:05:13.693166+0000 mgr.gibba043.dnkmem (mgr.34373) 10232 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:15 gibba043 bash[24019]: cluster 2021-03-10T17:05:13.693166+0000 mgr.gibba043.dnkmem (mgr.34373) 10232 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:17 gibba003 bash[31385]: cluster 2021-03-10T17:05:15.694534+0000 mgr.gibba043.dnkmem (mgr.34373) 10233 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:17 gibba003 bash[32348]: cluster 2021-03-10T17:05:15.694534+0000 mgr.gibba043.dnkmem (mgr.34373) 10233 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:17 gibba043 bash[24019]: cluster 2021-03-10T17:05:15.694534+0000 mgr.gibba043.dnkmem (mgr.34373) 10233 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:19.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:19 gibba003 bash[31385]: cluster 2021-03-10T17:05:17.695964+0000 mgr.gibba043.dnkmem (mgr.34373) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:19.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:19 gibba003 bash[32348]: cluster 2021-03-10T17:05:17.695964+0000 mgr.gibba043.dnkmem (mgr.34373) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:19 gibba043 bash[24019]: cluster 2021-03-10T17:05:17.695964+0000 mgr.gibba043.dnkmem (mgr.34373) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:21 gibba003 bash[31385]: cluster 2021-03-10T17:05:19.697343+0000 mgr.gibba043.dnkmem (mgr.34373) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:21 gibba003 bash[32348]: cluster 2021-03-10T17:05:19.697343+0000 mgr.gibba043.dnkmem (mgr.34373) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:21 gibba043 bash[24019]: cluster 2021-03-10T17:05:19.697343+0000 mgr.gibba043.dnkmem (mgr.34373) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:23.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:23 gibba003 bash[31385]: cluster 2021-03-10T17:05:21.698274+0000 mgr.gibba043.dnkmem (mgr.34373) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:23 gibba003 bash[32348]: cluster 2021-03-10T17:05:21.698274+0000 mgr.gibba043.dnkmem (mgr.34373) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:23 gibba043 bash[24019]: cluster 2021-03-10T17:05:21.698274+0000 mgr.gibba043.dnkmem (mgr.34373) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:25.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:25 gibba003 bash[31385]: cluster 2021-03-10T17:05:23.699785+0000 mgr.gibba043.dnkmem (mgr.34373) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:25.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:25 gibba003 bash[32348]: cluster 2021-03-10T17:05:23.699785+0000 mgr.gibba043.dnkmem (mgr.34373) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:25 gibba043 bash[24019]: cluster 2021-03-10T17:05:23.699785+0000 mgr.gibba043.dnkmem (mgr.34373) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:27 gibba003 bash[31385]: cluster 2021-03-10T17:05:25.701057+0000 mgr.gibba043.dnkmem (mgr.34373) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:27 gibba003 bash[32348]: cluster 2021-03-10T17:05:25.701057+0000 mgr.gibba043.dnkmem (mgr.34373) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:27 gibba043 bash[24019]: cluster 2021-03-10T17:05:25.701057+0000 mgr.gibba043.dnkmem (mgr.34373) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cluster 2021-03-10T17:05:27.702031+0000 mgr.gibba043.dnkmem (mgr.34373) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:27.781294+0000 mgr.gibba043.dnkmem (mgr.34373) 10240 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:05:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:27.782830+0000 mgr.gibba043.dnkmem (mgr.34373) 10241 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:05:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: audit 2021-03-10T17:05:27.993730+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:05:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:27.995064+0000 mgr.gibba043.dnkmem (mgr.34373) 10242 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:27.997477+0000 mgr.gibba043.dnkmem (mgr.34373) 10243 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: audit 2021-03-10T17:05:27.997929+0000 mon.c (mon.1) 2635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:27.999142+0000 mgr.gibba043.dnkmem (mgr.34373) 10244 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:27.999180+0000 mgr.gibba043.dnkmem (mgr.34373) 10245 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: audit 2021-03-10T17:05:27.999791+0000 mon.c (mon.1) 2636 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.000593+0000 mgr.gibba043.dnkmem (mgr.34373) 10246 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:29.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.000626+0000 mgr.gibba043.dnkmem (mgr.34373) 10247 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: audit 2021-03-10T17:05:28.001434+0000 mon.c (mon.1) 2637 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.002066+0000 mgr.gibba043.dnkmem (mgr.34373) 10248 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: audit 2021-03-10T17:05:28.002893+0000 mon.c (mon.1) 2638 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:28 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.004012+0000 mgr.gibba043.dnkmem (mgr.34373) 10249 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:29.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.004047+0000 mgr.gibba043.dnkmem (mgr.34373) 10250 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:29.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.005764+0000 mgr.gibba043.dnkmem (mgr.34373) 10251 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.006198+0000 mgr.gibba043.dnkmem (mgr.34373) 10252 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: audit 2021-03-10T17:05:28.006390+0000 mon.c (mon.1) 2639 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.007988+0000 mgr.gibba043.dnkmem (mgr.34373) 10253 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:29.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.008032+0000 mgr.gibba043.dnkmem (mgr.34373) 10254 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:29.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: cephadm 2021-03-10T17:05:28.008228+0000 mgr.gibba043.dnkmem (mgr.34373) 10255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:29.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:29 gibba043 bash[24019]: audit 2021-03-10T17:05:28.008395+0000 mon.c (mon.1) 2640 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cluster 2021-03-10T17:05:27.702031+0000 mgr.gibba043.dnkmem (mgr.34373) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:27.781294+0000 mgr.gibba043.dnkmem (mgr.34373) 10240 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:05:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:27.782830+0000 mgr.gibba043.dnkmem (mgr.34373) 10241 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:05:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: audit 2021-03-10T17:05:27.993730+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:05:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:27.995064+0000 mgr.gibba043.dnkmem (mgr.34373) 10242 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:27.997477+0000 mgr.gibba043.dnkmem (mgr.34373) 10243 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: audit 2021-03-10T17:05:27.997929+0000 mon.c (mon.1) 2635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:27.999142+0000 mgr.gibba043.dnkmem (mgr.34373) 10244 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:27.999180+0000 mgr.gibba043.dnkmem (mgr.34373) 10245 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:29.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: audit 2021-03-10T17:05:27.999791+0000 mon.c (mon.1) 2636 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.000593+0000 mgr.gibba043.dnkmem (mgr.34373) 10246 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:29.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.000626+0000 mgr.gibba043.dnkmem (mgr.34373) 10247 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: audit 2021-03-10T17:05:28.001434+0000 mon.c (mon.1) 2637 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.002066+0000 mgr.gibba043.dnkmem (mgr.34373) 10248 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: audit 2021-03-10T17:05:28.002893+0000 mon.c (mon.1) 2638 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.004012+0000 mgr.gibba043.dnkmem (mgr.34373) 10249 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:29.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.004047+0000 mgr.gibba043.dnkmem (mgr.34373) 10250 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:29.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.005764+0000 mgr.gibba043.dnkmem (mgr.34373) 10251 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:29.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.006198+0000 mgr.gibba043.dnkmem (mgr.34373) 10252 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:29.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:28 gibba003 bash[31385]: audit 2021-03-10T17:05:28.006390+0000 mon.c (mon.1) 2639 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.449 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.007988+0000 mgr.gibba043.dnkmem (mgr.34373) 10253 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:29.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cluster 2021-03-10T17:05:27.702031+0000 mgr.gibba043.dnkmem (mgr.34373) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:27.781294+0000 mgr.gibba043.dnkmem (mgr.34373) 10240 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:05:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:27.782830+0000 mgr.gibba043.dnkmem (mgr.34373) 10241 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:05:29.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:27.993730+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:05:29.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:27.995064+0000 mgr.gibba043.dnkmem (mgr.34373) 10242 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:29.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:27.997477+0000 mgr.gibba043.dnkmem (mgr.34373) 10243 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:29.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:27.997929+0000 mon.c (mon.1) 2635 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:29.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:27.999142+0000 mgr.gibba043.dnkmem (mgr.34373) 10244 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:29.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:27.999180+0000 mgr.gibba043.dnkmem (mgr.34373) 10245 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:29.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:27.999791+0000 mon.c (mon.1) 2636 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.000593+0000 mgr.gibba043.dnkmem (mgr.34373) 10246 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:29.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.000626+0000 mgr.gibba043.dnkmem (mgr.34373) 10247 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:29.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:28.001434+0000 mon.c (mon.1) 2637 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.002066+0000 mgr.gibba043.dnkmem (mgr.34373) 10248 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:29.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:28.002893+0000 mon.c (mon.1) 2638 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.004012+0000 mgr.gibba043.dnkmem (mgr.34373) 10249 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:29.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.004047+0000 mgr.gibba043.dnkmem (mgr.34373) 10250 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:29.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.005764+0000 mgr.gibba043.dnkmem (mgr.34373) 10251 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:29.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.006198+0000 mgr.gibba043.dnkmem (mgr.34373) 10252 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:29.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:28.006390+0000 mon.c (mon.1) 2639 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.007988+0000 mgr.gibba043.dnkmem (mgr.34373) 10253 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:29.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.008032+0000 mgr.gibba043.dnkmem (mgr.34373) 10254 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:29.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[31385]: cephadm 2021-03-10T17:05:28.008228+0000 mgr.gibba043.dnkmem (mgr.34373) 10255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:29.455 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[31385]: audit 2021-03-10T17:05:28.008395+0000 mon.c (mon.1) 2640 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:29.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.008032+0000 mgr.gibba043.dnkmem (mgr.34373) 10254 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:29.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: cephadm 2021-03-10T17:05:28.008228+0000 mgr.gibba043.dnkmem (mgr.34373) 10255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:29.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:29 gibba003 bash[32348]: audit 2021-03-10T17:05:28.008395+0000 mon.c (mon.1) 2640 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:31.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:31 gibba043 bash[24019]: cluster 2021-03-10T17:05:29.703414+0000 mgr.gibba043.dnkmem (mgr.34373) 10256 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:31.439 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:31 gibba003 bash[31385]: cluster 2021-03-10T17:05:29.703414+0000 mgr.gibba043.dnkmem (mgr.34373) 10256 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:31.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:31 gibba003 bash[32348]: cluster 2021-03-10T17:05:29.703414+0000 mgr.gibba043.dnkmem (mgr.34373) 10256 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:33.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:33 gibba003 bash[31385]: cluster 2021-03-10T17:05:31.705224+0000 mgr.gibba043.dnkmem (mgr.34373) 10257 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:33.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:33 gibba003 bash[32348]: cluster 2021-03-10T17:05:31.705224+0000 mgr.gibba043.dnkmem (mgr.34373) 10257 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:33 gibba043 bash[24019]: cluster 2021-03-10T17:05:31.705224+0000 mgr.gibba043.dnkmem (mgr.34373) 10257 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:35.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:35 gibba003 bash[31385]: cluster 2021-03-10T17:05:33.706643+0000 mgr.gibba043.dnkmem (mgr.34373) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:35.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:35 gibba003 bash[32348]: cluster 2021-03-10T17:05:33.706643+0000 mgr.gibba043.dnkmem (mgr.34373) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:35.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:35 gibba043 bash[24019]: cluster 2021-03-10T17:05:33.706643+0000 mgr.gibba043.dnkmem (mgr.34373) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:37.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:37 gibba003 bash[31385]: cluster 2021-03-10T17:05:35.708109+0000 mgr.gibba043.dnkmem (mgr.34373) 10259 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:37.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:37 gibba003 bash[32348]: cluster 2021-03-10T17:05:35.708109+0000 mgr.gibba043.dnkmem (mgr.34373) 10259 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:37 gibba043 bash[24019]: cluster 2021-03-10T17:05:35.708109+0000 mgr.gibba043.dnkmem (mgr.34373) 10259 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.140 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:05:38.369 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:05:38.370 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:05:38.370 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:05:38.370 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:05:38.370 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:05:38.371 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:05:38.371 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:05:38.371 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:05:38.371 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:05:38.372 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:05:38.372 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:05:38.372 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:05:38.372 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:05:38.373 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:05:38.373 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:05:38.373 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:05:38.373 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:05:38.373 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:05:38.374 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:05:38.374 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:05:38.374 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:05:38.620 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:05:38.620 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:05:38.621 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:38.621 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:05:38.621 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:05:38.621 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:38.622 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:05:38.622 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:05:38.622 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:05:38.623 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:05:38.623 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:05:38.623 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:05:38.623 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:05:38.624 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:05:38.624 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:05:39.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[31385]: cluster 2021-03-10T17:05:37.709635+0000 mgr.gibba043.dnkmem (mgr.34373) 10260 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[31385]: audit 2021-03-10T17:05:38.130956+0000 mgr.gibba043.dnkmem (mgr.34373) 10261 : audit [DBG] from='client.50925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[31385]: audit 2021-03-10T17:05:38.357158+0000 mgr.gibba043.dnkmem (mgr.34373) 10262 : audit [DBG] from='client.60922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:39.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[31385]: audit 2021-03-10T17:05:38.621767+0000 mon.a (mon.0) 2090 : audit [DBG] from='client.? 172.21.2.103:0/4196079122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[32348]: cluster 2021-03-10T17:05:37.709635+0000 mgr.gibba043.dnkmem (mgr.34373) 10260 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[32348]: audit 2021-03-10T17:05:38.130956+0000 mgr.gibba043.dnkmem (mgr.34373) 10261 : audit [DBG] from='client.50925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[32348]: audit 2021-03-10T17:05:38.357158+0000 mgr.gibba043.dnkmem (mgr.34373) 10262 : audit [DBG] from='client.60922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:39.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:39 gibba003 bash[32348]: audit 2021-03-10T17:05:38.621767+0000 mon.a (mon.0) 2090 : audit [DBG] from='client.? 172.21.2.103:0/4196079122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:39 gibba043 bash[24019]: cluster 2021-03-10T17:05:37.709635+0000 mgr.gibba043.dnkmem (mgr.34373) 10260 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:39 gibba043 bash[24019]: audit 2021-03-10T17:05:38.130956+0000 mgr.gibba043.dnkmem (mgr.34373) 10261 : audit [DBG] from='client.50925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:39 gibba043 bash[24019]: audit 2021-03-10T17:05:38.357158+0000 mgr.gibba043.dnkmem (mgr.34373) 10262 : audit [DBG] from='client.60922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:39.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:39 gibba043 bash[24019]: audit 2021-03-10T17:05:38.621767+0000 mon.a (mon.0) 2090 : audit [DBG] from='client.? 172.21.2.103:0/4196079122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:41 gibba043 bash[24019]: cluster 2021-03-10T17:05:39.710994+0000 mgr.gibba043.dnkmem (mgr.34373) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:41 gibba003 bash[31385]: cluster 2021-03-10T17:05:39.710994+0000 mgr.gibba043.dnkmem (mgr.34373) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:41 gibba003 bash[32348]: cluster 2021-03-10T17:05:39.710994+0000 mgr.gibba043.dnkmem (mgr.34373) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:43 gibba043 bash[24019]: cluster 2021-03-10T17:05:41.712815+0000 mgr.gibba043.dnkmem (mgr.34373) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:43 gibba003 bash[31385]: cluster 2021-03-10T17:05:41.712815+0000 mgr.gibba043.dnkmem (mgr.34373) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:43 gibba003 bash[32348]: cluster 2021-03-10T17:05:41.712815+0000 mgr.gibba043.dnkmem (mgr.34373) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:44.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:44 gibba043 bash[24019]: cephadm 2021-03-10T17:05:43.024204+0000 mgr.gibba043.dnkmem (mgr.34373) 10265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:44.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:44 gibba003 bash[31385]: cephadm 2021-03-10T17:05:43.024204+0000 mgr.gibba043.dnkmem (mgr.34373) 10265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:44.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:44 gibba003 bash[32348]: cephadm 2021-03-10T17:05:43.024204+0000 mgr.gibba043.dnkmem (mgr.34373) 10265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:45 gibba043 bash[24019]: cluster 2021-03-10T17:05:43.714312+0000 mgr.gibba043.dnkmem (mgr.34373) 10266 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:45 gibba003 bash[31385]: cluster 2021-03-10T17:05:43.714312+0000 mgr.gibba043.dnkmem (mgr.34373) 10266 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:45 gibba003 bash[32348]: cluster 2021-03-10T17:05:43.714312+0000 mgr.gibba043.dnkmem (mgr.34373) 10266 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:47 gibba043 bash[24019]: cluster 2021-03-10T17:05:45.715761+0000 mgr.gibba043.dnkmem (mgr.34373) 10267 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:47 gibba003 bash[31385]: cluster 2021-03-10T17:05:45.715761+0000 mgr.gibba043.dnkmem (mgr.34373) 10267 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:47 gibba003 bash[32348]: cluster 2021-03-10T17:05:45.715761+0000 mgr.gibba043.dnkmem (mgr.34373) 10267 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:49.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:49 gibba043 bash[24019]: cluster 2021-03-10T17:05:47.717177+0000 mgr.gibba043.dnkmem (mgr.34373) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:49 gibba003 bash[31385]: cluster 2021-03-10T17:05:47.717177+0000 mgr.gibba043.dnkmem (mgr.34373) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:49 gibba003 bash[32348]: cluster 2021-03-10T17:05:47.717177+0000 mgr.gibba043.dnkmem (mgr.34373) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:51 gibba043 bash[24019]: cluster 2021-03-10T17:05:49.718717+0000 mgr.gibba043.dnkmem (mgr.34373) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:51 gibba003 bash[31385]: cluster 2021-03-10T17:05:49.718717+0000 mgr.gibba043.dnkmem (mgr.34373) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:51 gibba003 bash[32348]: cluster 2021-03-10T17:05:49.718717+0000 mgr.gibba043.dnkmem (mgr.34373) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:53.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:53 gibba043 bash[24019]: cluster 2021-03-10T17:05:51.720379+0000 mgr.gibba043.dnkmem (mgr.34373) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:53 gibba003 bash[31385]: cluster 2021-03-10T17:05:51.720379+0000 mgr.gibba043.dnkmem (mgr.34373) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:53 gibba003 bash[32348]: cluster 2021-03-10T17:05:51.720379+0000 mgr.gibba043.dnkmem (mgr.34373) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:55.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:55 gibba043 bash[24019]: cluster 2021-03-10T17:05:53.721782+0000 mgr.gibba043.dnkmem (mgr.34373) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:55.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:55 gibba003 bash[31385]: cluster 2021-03-10T17:05:53.721782+0000 mgr.gibba043.dnkmem (mgr.34373) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:55 gibba003 bash[32348]: cluster 2021-03-10T17:05:53.721782+0000 mgr.gibba043.dnkmem (mgr.34373) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:57 gibba003 bash[31385]: cluster 2021-03-10T17:05:55.723191+0000 mgr.gibba043.dnkmem (mgr.34373) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:57 gibba003 bash[32348]: cluster 2021-03-10T17:05:55.723191+0000 mgr.gibba043.dnkmem (mgr.34373) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:57 gibba043 bash[24019]: cluster 2021-03-10T17:05:55.723191+0000 mgr.gibba043.dnkmem (mgr.34373) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:59 gibba003 bash[31385]: cluster 2021-03-10T17:05:57.724778+0000 mgr.gibba043.dnkmem (mgr.34373) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:05:59 gibba003 bash[31385]: cephadm 2021-03-10T17:05:58.036624+0000 mgr.gibba043.dnkmem (mgr.34373) 10274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:05:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:59 gibba003 bash[32348]: cluster 2021-03-10T17:05:57.724778+0000 mgr.gibba043.dnkmem (mgr.34373) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:05:59 gibba003 bash[32348]: cephadm 2021-03-10T17:05:58.036624+0000 mgr.gibba043.dnkmem (mgr.34373) 10274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:59 gibba043 bash[24019]: cluster 2021-03-10T17:05:57.724778+0000 mgr.gibba043.dnkmem (mgr.34373) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:05:59 gibba043 bash[24019]: cephadm 2021-03-10T17:05:58.036624+0000 mgr.gibba043.dnkmem (mgr.34373) 10274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:01 gibba003 bash[31385]: cluster 2021-03-10T17:05:59.726209+0000 mgr.gibba043.dnkmem (mgr.34373) 10275 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:01 gibba003 bash[32348]: cluster 2021-03-10T17:05:59.726209+0000 mgr.gibba043.dnkmem (mgr.34373) 10275 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:01 gibba043 bash[24019]: cluster 2021-03-10T17:05:59.726209+0000 mgr.gibba043.dnkmem (mgr.34373) 10275 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:03 gibba003 bash[31385]: cluster 2021-03-10T17:06:01.727780+0000 mgr.gibba043.dnkmem (mgr.34373) 10276 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:03 gibba003 bash[32348]: cluster 2021-03-10T17:06:01.727780+0000 mgr.gibba043.dnkmem (mgr.34373) 10276 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:03 gibba043 bash[24019]: cluster 2021-03-10T17:06:01.727780+0000 mgr.gibba043.dnkmem (mgr.34373) 10276 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:05 gibba003 bash[31385]: cluster 2021-03-10T17:06:03.729459+0000 mgr.gibba043.dnkmem (mgr.34373) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:05 gibba003 bash[32348]: cluster 2021-03-10T17:06:03.729459+0000 mgr.gibba043.dnkmem (mgr.34373) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:05 gibba043 bash[24019]: cluster 2021-03-10T17:06:03.729459+0000 mgr.gibba043.dnkmem (mgr.34373) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:07 gibba003 bash[31385]: cluster 2021-03-10T17:06:05.730869+0000 mgr.gibba043.dnkmem (mgr.34373) 10278 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:07 gibba003 bash[32348]: cluster 2021-03-10T17:06:05.730869+0000 mgr.gibba043.dnkmem (mgr.34373) 10278 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:08.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:07 gibba043 bash[24019]: cluster 2021-03-10T17:06:05.730869+0000 mgr.gibba043.dnkmem (mgr.34373) 10278 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:08.864 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:06:09.093 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:06:09.093 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:06:09.093 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:06:09.094 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:06:09.094 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:06:09.094 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:06:09.094 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:06:09.095 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:06:09.095 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:06:09.095 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:06:09.095 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:06:09.096 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:06:09.096 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:06:09.096 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:06:09.096 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:06:09.097 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:06:09.097 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:06:09.097 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:06:09.097 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:06:09.098 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:06:09.098 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:06:09.342 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:06:09.343 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:06:09.343 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:09.343 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:06:09.343 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:06:09.344 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:09.344 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:06:09.344 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:06:09.344 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:06:09.345 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:06:09.345 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:06:09.345 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:06:09.345 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:06:09.345 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:06:09.346 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:06:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:09 gibba003 bash[31385]: cluster 2021-03-10T17:06:07.732477+0000 mgr.gibba043.dnkmem (mgr.34373) 10279 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:09.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:09 gibba003 bash[31385]: audit 2021-03-10T17:06:09.344046+0000 mon.a (mon.0) 2091 : audit [DBG] from='client.? 172.21.2.103:0/2281487244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:09 gibba003 bash[32348]: cluster 2021-03-10T17:06:07.732477+0000 mgr.gibba043.dnkmem (mgr.34373) 10279 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:09.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:09 gibba003 bash[32348]: audit 2021-03-10T17:06:09.344046+0000 mon.a (mon.0) 2091 : audit [DBG] from='client.? 172.21.2.103:0/2281487244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:09 gibba043 bash[24019]: cluster 2021-03-10T17:06:07.732477+0000 mgr.gibba043.dnkmem (mgr.34373) 10279 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:09 gibba043 bash[24019]: audit 2021-03-10T17:06:09.344046+0000 mon.a (mon.0) 2091 : audit [DBG] from='client.? 172.21.2.103:0/2281487244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:10.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:10 gibba003 bash[31385]: audit 2021-03-10T17:06:08.854864+0000 mgr.gibba043.dnkmem (mgr.34373) 10280 : audit [DBG] from='client.50943 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:10.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:10 gibba003 bash[31385]: audit 2021-03-10T17:06:09.080313+0000 mgr.gibba043.dnkmem (mgr.34373) 10281 : audit [DBG] from='client.50949 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:10.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:10 gibba003 bash[32348]: audit 2021-03-10T17:06:08.854864+0000 mgr.gibba043.dnkmem (mgr.34373) 10280 : audit [DBG] from='client.50943 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:10.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:10 gibba003 bash[32348]: audit 2021-03-10T17:06:09.080313+0000 mgr.gibba043.dnkmem (mgr.34373) 10281 : audit [DBG] from='client.50949 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:11.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:10 gibba043 bash[24019]: audit 2021-03-10T17:06:08.854864+0000 mgr.gibba043.dnkmem (mgr.34373) 10280 : audit [DBG] from='client.50943 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:11.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:10 gibba043 bash[24019]: audit 2021-03-10T17:06:09.080313+0000 mgr.gibba043.dnkmem (mgr.34373) 10281 : audit [DBG] from='client.50949 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:11.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:11 gibba003 bash[31385]: cluster 2021-03-10T17:06:09.734118+0000 mgr.gibba043.dnkmem (mgr.34373) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:11 gibba003 bash[32348]: cluster 2021-03-10T17:06:09.734118+0000 mgr.gibba043.dnkmem (mgr.34373) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:12.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:11 gibba043 bash[24019]: cluster 2021-03-10T17:06:09.734118+0000 mgr.gibba043.dnkmem (mgr.34373) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:13 gibba003 bash[31385]: cluster 2021-03-10T17:06:11.735953+0000 mgr.gibba043.dnkmem (mgr.34373) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:13 gibba003 bash[32348]: cluster 2021-03-10T17:06:11.735953+0000 mgr.gibba043.dnkmem (mgr.34373) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:13 gibba043 bash[24019]: cluster 2021-03-10T17:06:11.735953+0000 mgr.gibba043.dnkmem (mgr.34373) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: cephadm 2021-03-10T17:06:13.052801+0000 mgr.gibba043.dnkmem (mgr.34373) 10284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:13.972519+0000 mon.c (mon.1) 2641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:13.973600+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.208373+0000 mon.c (mon.1) 2642 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.209449+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.531911+0000 mon.c (mon.1) 2643 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:06:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.532733+0000 mon.c (mon.1) 2644 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:06:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.533151+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:06:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.533697+0000 mon.c (mon.1) 2645 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.534561+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:06:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.534883+0000 mon.c (mon.1) 2646 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.535636+0000 mon.a (mon.0) 2096 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[31385]: audit 2021-03-10T17:06:14.536601+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: cephadm 2021-03-10T17:06:13.052801+0000 mgr.gibba043.dnkmem (mgr.34373) 10284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:13.972519+0000 mon.c (mon.1) 2641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:13.973600+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.208373+0000 mon.c (mon.1) 2642 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.209449+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.531911+0000 mon.c (mon.1) 2643 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:06:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.532733+0000 mon.c (mon.1) 2644 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:06:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.533151+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:06:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.533697+0000 mon.c (mon.1) 2645 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.534561+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:06:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.534883+0000 mon.c (mon.1) 2646 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.535636+0000 mon.a (mon.0) 2096 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:06:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:14 gibba003 bash[32348]: audit 2021-03-10T17:06:14.536601+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:06:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: cephadm 2021-03-10T17:06:13.052801+0000 mgr.gibba043.dnkmem (mgr.34373) 10284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:13.972519+0000 mon.c (mon.1) 2641 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:13.973600+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.208373+0000 mon.c (mon.1) 2642 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.209449+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.531911+0000 mon.c (mon.1) 2643 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:06:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.532733+0000 mon.c (mon.1) 2644 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:06:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.533151+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:06:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.533697+0000 mon.c (mon.1) 2645 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:06:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.534561+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:06:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.534883+0000 mon.c (mon.1) 2646 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:06:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.535636+0000 mon.a (mon.0) 2096 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:06:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:14 gibba043 bash[24019]: audit 2021-03-10T17:06:14.536601+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:06:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:15 gibba003 bash[31385]: cluster 2021-03-10T17:06:13.737508+0000 mgr.gibba043.dnkmem (mgr.34373) 10285 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:15 gibba003 bash[32348]: cluster 2021-03-10T17:06:13.737508+0000 mgr.gibba043.dnkmem (mgr.34373) 10285 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:15 gibba043 bash[24019]: cluster 2021-03-10T17:06:13.737508+0000 mgr.gibba043.dnkmem (mgr.34373) 10285 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:17 gibba003 bash[31385]: cluster 2021-03-10T17:06:15.739021+0000 mgr.gibba043.dnkmem (mgr.34373) 10286 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:17 gibba003 bash[32348]: cluster 2021-03-10T17:06:15.739021+0000 mgr.gibba043.dnkmem (mgr.34373) 10286 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:18.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:17 gibba043 bash[24019]: cluster 2021-03-10T17:06:15.739021+0000 mgr.gibba043.dnkmem (mgr.34373) 10286 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:19 gibba003 bash[31385]: cluster 2021-03-10T17:06:17.740724+0000 mgr.gibba043.dnkmem (mgr.34373) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:19 gibba003 bash[32348]: cluster 2021-03-10T17:06:17.740724+0000 mgr.gibba043.dnkmem (mgr.34373) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:19 gibba043 bash[24019]: cluster 2021-03-10T17:06:17.740724+0000 mgr.gibba043.dnkmem (mgr.34373) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:21 gibba003 bash[31385]: cluster 2021-03-10T17:06:19.742205+0000 mgr.gibba043.dnkmem (mgr.34373) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:21 gibba003 bash[32348]: cluster 2021-03-10T17:06:19.742205+0000 mgr.gibba043.dnkmem (mgr.34373) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:21 gibba043 bash[24019]: cluster 2021-03-10T17:06:19.742205+0000 mgr.gibba043.dnkmem (mgr.34373) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:23.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:23 gibba003 bash[31385]: cluster 2021-03-10T17:06:21.743808+0000 mgr.gibba043.dnkmem (mgr.34373) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:23.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:23 gibba003 bash[32348]: cluster 2021-03-10T17:06:21.743808+0000 mgr.gibba043.dnkmem (mgr.34373) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:23 gibba043 bash[24019]: cluster 2021-03-10T17:06:21.743808+0000 mgr.gibba043.dnkmem (mgr.34373) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:25 gibba043 bash[24019]: cluster 2021-03-10T17:06:23.745215+0000 mgr.gibba043.dnkmem (mgr.34373) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:25 gibba003 bash[31385]: cluster 2021-03-10T17:06:23.745215+0000 mgr.gibba043.dnkmem (mgr.34373) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:25 gibba003 bash[32348]: cluster 2021-03-10T17:06:23.745215+0000 mgr.gibba043.dnkmem (mgr.34373) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:27.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:27 gibba043 bash[24019]: cluster 2021-03-10T17:06:25.746654+0000 mgr.gibba043.dnkmem (mgr.34373) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:27 gibba003 bash[31385]: cluster 2021-03-10T17:06:25.746654+0000 mgr.gibba043.dnkmem (mgr.34373) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:27 gibba003 bash[32348]: cluster 2021-03-10T17:06:25.746654+0000 mgr.gibba043.dnkmem (mgr.34373) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cluster 2021-03-10T17:06:27.748253+0000 mgr.gibba043.dnkmem (mgr.34373) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.258551+0000 mgr.gibba043.dnkmem (mgr.34373) 10293 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:06:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.259119+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.267081+0000 mgr.gibba043.dnkmem (mgr.34373) 10294 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:06:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.267861+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.470474+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.471703+0000 mgr.gibba043.dnkmem (mgr.34373) 10295 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.474004+0000 mgr.gibba043.dnkmem (mgr.34373) 10296 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.474236+0000 mon.c (mon.1) 2647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.475679+0000 mgr.gibba043.dnkmem (mgr.34373) 10297 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:29.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.475763+0000 mgr.gibba043.dnkmem (mgr.34373) 10298 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:29.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.476293+0000 mon.c (mon.1) 2648 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.476987+0000 mgr.gibba043.dnkmem (mgr.34373) 10299 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:29.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.477029+0000 mgr.gibba043.dnkmem (mgr.34373) 10300 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:29.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.478009+0000 mon.c (mon.1) 2649 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.478432+0000 mgr.gibba043.dnkmem (mgr.34373) 10301 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:29.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.479285+0000 mon.c (mon.1) 2650 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.479976+0000 mgr.gibba043.dnkmem (mgr.34373) 10302 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:29.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.480014+0000 mgr.gibba043.dnkmem (mgr.34373) 10303 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:29.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.481578+0000 mgr.gibba043.dnkmem (mgr.34373) 10304 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:29.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.482016+0000 mgr.gibba043.dnkmem (mgr.34373) 10305 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:29.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.482324+0000 mon.c (mon.1) 2651 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.483440+0000 mgr.gibba043.dnkmem (mgr.34373) 10306 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:29.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.483481+0000 mgr.gibba043.dnkmem (mgr.34373) 10307 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:29.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: cephadm 2021-03-10T17:06:28.483597+0000 mgr.gibba043.dnkmem (mgr.34373) 10308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:29.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:29 gibba043 bash[24019]: audit 2021-03-10T17:06:28.484172+0000 mon.c (mon.1) 2652 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cluster 2021-03-10T17:06:27.748253+0000 mgr.gibba043.dnkmem (mgr.34373) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.258551+0000 mgr.gibba043.dnkmem (mgr.34373) 10293 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:06:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.259119+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.267081+0000 mgr.gibba043.dnkmem (mgr.34373) 10294 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:06:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.267861+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.470474+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.471703+0000 mgr.gibba043.dnkmem (mgr.34373) 10295 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.474004+0000 mgr.gibba043.dnkmem (mgr.34373) 10296 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:29.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.474236+0000 mon.c (mon.1) 2647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:29.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.475679+0000 mgr.gibba043.dnkmem (mgr.34373) 10297 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:29.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.475763+0000 mgr.gibba043.dnkmem (mgr.34373) 10298 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:29.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.476293+0000 mon.c (mon.1) 2648 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.476987+0000 mgr.gibba043.dnkmem (mgr.34373) 10299 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:29.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.477029+0000 mgr.gibba043.dnkmem (mgr.34373) 10300 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:29.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.478009+0000 mon.c (mon.1) 2649 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.478432+0000 mgr.gibba043.dnkmem (mgr.34373) 10301 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:29.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.479285+0000 mon.c (mon.1) 2650 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.479976+0000 mgr.gibba043.dnkmem (mgr.34373) 10302 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:29.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.480014+0000 mgr.gibba043.dnkmem (mgr.34373) 10303 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:29.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.481578+0000 mgr.gibba043.dnkmem (mgr.34373) 10304 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:29.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.482016+0000 mgr.gibba043.dnkmem (mgr.34373) 10305 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:29.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cluster 2021-03-10T17:06:27.748253+0000 mgr.gibba043.dnkmem (mgr.34373) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.258551+0000 mgr.gibba043.dnkmem (mgr.34373) 10293 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:06:29.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.259119+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.267081+0000 mgr.gibba043.dnkmem (mgr.34373) 10294 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:06:29.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.267861+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.470474+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:06:29.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.471703+0000 mgr.gibba043.dnkmem (mgr.34373) 10295 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:29.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.474004+0000 mgr.gibba043.dnkmem (mgr.34373) 10296 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:29.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.474236+0000 mon.c (mon.1) 2647 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:29.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.475679+0000 mgr.gibba043.dnkmem (mgr.34373) 10297 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:29.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.475763+0000 mgr.gibba043.dnkmem (mgr.34373) 10298 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:29.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.476293+0000 mon.c (mon.1) 2648 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.476987+0000 mgr.gibba043.dnkmem (mgr.34373) 10299 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:29.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.477029+0000 mgr.gibba043.dnkmem (mgr.34373) 10300 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:29.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.478009+0000 mon.c (mon.1) 2649 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.478432+0000 mgr.gibba043.dnkmem (mgr.34373) 10301 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:29.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.479285+0000 mon.c (mon.1) 2650 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.479976+0000 mgr.gibba043.dnkmem (mgr.34373) 10302 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:29.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.480014+0000 mgr.gibba043.dnkmem (mgr.34373) 10303 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:29.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.481578+0000 mgr.gibba043.dnkmem (mgr.34373) 10304 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:29.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.482016+0000 mgr.gibba043.dnkmem (mgr.34373) 10305 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:29.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.482324+0000 mon.c (mon.1) 2651 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.483440+0000 mgr.gibba043.dnkmem (mgr.34373) 10306 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:29.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.483481+0000 mgr.gibba043.dnkmem (mgr.34373) 10307 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:29.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: cephadm 2021-03-10T17:06:28.483597+0000 mgr.gibba043.dnkmem (mgr.34373) 10308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:29.707 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[31385]: audit 2021-03-10T17:06:28.484172+0000 mon.c (mon.1) 2652 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.482324+0000 mon.c (mon.1) 2651 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:29.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.483440+0000 mgr.gibba043.dnkmem (mgr.34373) 10306 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:29.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.483481+0000 mgr.gibba043.dnkmem (mgr.34373) 10307 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:29.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: cephadm 2021-03-10T17:06:28.483597+0000 mgr.gibba043.dnkmem (mgr.34373) 10308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:29.708 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:29 gibba003 bash[32348]: audit 2021-03-10T17:06:28.484172+0000 mon.c (mon.1) 2652 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:31.689 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:31 gibba003 bash[31385]: cluster 2021-03-10T17:06:29.749666+0000 mgr.gibba043.dnkmem (mgr.34373) 10309 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:31.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:31 gibba003 bash[32348]: cluster 2021-03-10T17:06:29.749666+0000 mgr.gibba043.dnkmem (mgr.34373) 10309 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:31 gibba043 bash[24019]: cluster 2021-03-10T17:06:29.749666+0000 mgr.gibba043.dnkmem (mgr.34373) 10309 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:33 gibba043 bash[24019]: cluster 2021-03-10T17:06:31.751184+0000 mgr.gibba043.dnkmem (mgr.34373) 10310 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:33 gibba003 bash[31385]: cluster 2021-03-10T17:06:31.751184+0000 mgr.gibba043.dnkmem (mgr.34373) 10310 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:33 gibba003 bash[32348]: cluster 2021-03-10T17:06:31.751184+0000 mgr.gibba043.dnkmem (mgr.34373) 10310 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:35 gibba043 bash[24019]: cluster 2021-03-10T17:06:33.752827+0000 mgr.gibba043.dnkmem (mgr.34373) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:35 gibba003 bash[31385]: cluster 2021-03-10T17:06:33.752827+0000 mgr.gibba043.dnkmem (mgr.34373) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:35 gibba003 bash[32348]: cluster 2021-03-10T17:06:33.752827+0000 mgr.gibba043.dnkmem (mgr.34373) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:37.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:37 gibba043 bash[24019]: cluster 2021-03-10T17:06:35.754182+0000 mgr.gibba043.dnkmem (mgr.34373) 10312 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:37 gibba003 bash[31385]: cluster 2021-03-10T17:06:35.754182+0000 mgr.gibba043.dnkmem (mgr.34373) 10312 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:37 gibba003 bash[32348]: cluster 2021-03-10T17:06:35.754182+0000 mgr.gibba043.dnkmem (mgr.34373) 10312 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:39.588 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:06:39.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:39 gibba043 bash[24019]: cluster 2021-03-10T17:06:37.755914+0000 mgr.gibba043.dnkmem (mgr.34373) 10313 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:39.817 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:06:39.817 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:06:39.817 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:06:39.818 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:06:39.818 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:06:39.818 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:06:39.818 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:06:39.819 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:06:39.819 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:06:39.819 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:06:39.819 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:06:39.820 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:06:39.820 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:06:39.820 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:06:39.820 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:06:39.820 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:06:39.821 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:06:39.821 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:06:39.821 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:06:39.821 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:06:39.822 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:06:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:39 gibba003 bash[31385]: cluster 2021-03-10T17:06:37.755914+0000 mgr.gibba043.dnkmem (mgr.34373) 10313 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:39 gibba003 bash[32348]: cluster 2021-03-10T17:06:37.755914+0000 mgr.gibba043.dnkmem (mgr.34373) 10313 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:40.065 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:06:40.066 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:06:40.066 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:40.066 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:06:40.066 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:06:40.067 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:40.067 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:06:40.067 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:06:40.067 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:06:40.068 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:06:40.068 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:06:40.068 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:06:40.068 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:06:40.068 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:06:40.069 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:06:40.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:40 gibba043 bash[24019]: audit 2021-03-10T17:06:39.578615+0000 mgr.gibba043.dnkmem (mgr.34373) 10314 : audit [DBG] from='client.50961 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:40.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:40 gibba043 bash[24019]: audit 2021-03-10T17:06:40.067130+0000 mon.c (mon.1) 2653 : audit [DBG] from='client.? 172.21.2.103:0/1138366547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:40.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:40 gibba003 bash[31385]: audit 2021-03-10T17:06:39.578615+0000 mgr.gibba043.dnkmem (mgr.34373) 10314 : audit [DBG] from='client.50961 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:40.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:40 gibba003 bash[31385]: audit 2021-03-10T17:06:40.067130+0000 mon.c (mon.1) 2653 : audit [DBG] from='client.? 172.21.2.103:0/1138366547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:40.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:40 gibba003 bash[32348]: audit 2021-03-10T17:06:39.578615+0000 mgr.gibba043.dnkmem (mgr.34373) 10314 : audit [DBG] from='client.50961 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:40.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:40 gibba003 bash[32348]: audit 2021-03-10T17:06:40.067130+0000 mon.c (mon.1) 2653 : audit [DBG] from='client.? 172.21.2.103:0/1138366547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:41 gibba043 bash[24019]: cluster 2021-03-10T17:06:39.757490+0000 mgr.gibba043.dnkmem (mgr.34373) 10315 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:41 gibba043 bash[24019]: audit 2021-03-10T17:06:39.804151+0000 mgr.gibba043.dnkmem (mgr.34373) 10316 : audit [DBG] from='client.60958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:41 gibba003 bash[31385]: cluster 2021-03-10T17:06:39.757490+0000 mgr.gibba043.dnkmem (mgr.34373) 10315 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:41 gibba003 bash[31385]: audit 2021-03-10T17:06:39.804151+0000 mgr.gibba043.dnkmem (mgr.34373) 10316 : audit [DBG] from='client.60958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:41 gibba003 bash[32348]: cluster 2021-03-10T17:06:39.757490+0000 mgr.gibba043.dnkmem (mgr.34373) 10315 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:41 gibba003 bash[32348]: audit 2021-03-10T17:06:39.804151+0000 mgr.gibba043.dnkmem (mgr.34373) 10316 : audit [DBG] from='client.60958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:43.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:43 gibba043 bash[24019]: cluster 2021-03-10T17:06:41.759318+0000 mgr.gibba043.dnkmem (mgr.34373) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:43 gibba003 bash[31385]: cluster 2021-03-10T17:06:41.759318+0000 mgr.gibba043.dnkmem (mgr.34373) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:43 gibba003 bash[32348]: cluster 2021-03-10T17:06:41.759318+0000 mgr.gibba043.dnkmem (mgr.34373) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:44.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:44 gibba043 bash[24019]: cephadm 2021-03-10T17:06:43.495918+0000 mgr.gibba043.dnkmem (mgr.34373) 10318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:44.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:44 gibba003 bash[32348]: cephadm 2021-03-10T17:06:43.495918+0000 mgr.gibba043.dnkmem (mgr.34373) 10318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:44.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:44 gibba003 bash[31385]: cephadm 2021-03-10T17:06:43.495918+0000 mgr.gibba043.dnkmem (mgr.34373) 10318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:45.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:45 gibba043 bash[24019]: cluster 2021-03-10T17:06:43.761026+0000 mgr.gibba043.dnkmem (mgr.34373) 10319 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:45 gibba003 bash[31385]: cluster 2021-03-10T17:06:43.761026+0000 mgr.gibba043.dnkmem (mgr.34373) 10319 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:45.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:45 gibba003 bash[32348]: cluster 2021-03-10T17:06:43.761026+0000 mgr.gibba043.dnkmem (mgr.34373) 10319 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:47 gibba043 bash[24019]: cluster 2021-03-10T17:06:45.762450+0000 mgr.gibba043.dnkmem (mgr.34373) 10320 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:47 gibba003 bash[31385]: cluster 2021-03-10T17:06:45.762450+0000 mgr.gibba043.dnkmem (mgr.34373) 10320 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:47 gibba003 bash[32348]: cluster 2021-03-10T17:06:45.762450+0000 mgr.gibba043.dnkmem (mgr.34373) 10320 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:49 gibba003 bash[31385]: cluster 2021-03-10T17:06:47.763902+0000 mgr.gibba043.dnkmem (mgr.34373) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:49 gibba003 bash[32348]: cluster 2021-03-10T17:06:47.763902+0000 mgr.gibba043.dnkmem (mgr.34373) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:49 gibba043 bash[24019]: cluster 2021-03-10T17:06:47.763902+0000 mgr.gibba043.dnkmem (mgr.34373) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:51 gibba003 bash[31385]: cluster 2021-03-10T17:06:49.765405+0000 mgr.gibba043.dnkmem (mgr.34373) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:51 gibba003 bash[32348]: cluster 2021-03-10T17:06:49.765405+0000 mgr.gibba043.dnkmem (mgr.34373) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:51 gibba043 bash[24019]: cluster 2021-03-10T17:06:49.765405+0000 mgr.gibba043.dnkmem (mgr.34373) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:53 gibba003 bash[31385]: cluster 2021-03-10T17:06:51.767136+0000 mgr.gibba043.dnkmem (mgr.34373) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:53 gibba003 bash[32348]: cluster 2021-03-10T17:06:51.767136+0000 mgr.gibba043.dnkmem (mgr.34373) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:54.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:53 gibba043 bash[24019]: cluster 2021-03-10T17:06:51.767136+0000 mgr.gibba043.dnkmem (mgr.34373) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:55 gibba003 bash[31385]: cluster 2021-03-10T17:06:53.768723+0000 mgr.gibba043.dnkmem (mgr.34373) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:55 gibba003 bash[32348]: cluster 2021-03-10T17:06:53.768723+0000 mgr.gibba043.dnkmem (mgr.34373) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:56.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:55 gibba043 bash[24019]: cluster 2021-03-10T17:06:53.768723+0000 mgr.gibba043.dnkmem (mgr.34373) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:57 gibba003 bash[31385]: cluster 2021-03-10T17:06:55.769979+0000 mgr.gibba043.dnkmem (mgr.34373) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:57 gibba003 bash[32348]: cluster 2021-03-10T17:06:55.769979+0000 mgr.gibba043.dnkmem (mgr.34373) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:57 gibba043 bash[24019]: cluster 2021-03-10T17:06:55.769979+0000 mgr.gibba043.dnkmem (mgr.34373) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:59 gibba003 bash[31385]: cluster 2021-03-10T17:06:57.771755+0000 mgr.gibba043.dnkmem (mgr.34373) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:06:59 gibba003 bash[31385]: cephadm 2021-03-10T17:06:58.512009+0000 mgr.gibba043.dnkmem (mgr.34373) 10327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:06:59.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:59 gibba003 bash[32348]: cluster 2021-03-10T17:06:57.771755+0000 mgr.gibba043.dnkmem (mgr.34373) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:59.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:06:59 gibba003 bash[32348]: cephadm 2021-03-10T17:06:58.512009+0000 mgr.gibba043.dnkmem (mgr.34373) 10327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:59 gibba043 bash[24019]: cluster 2021-03-10T17:06:57.771755+0000 mgr.gibba043.dnkmem (mgr.34373) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:06:59 gibba043 bash[24019]: cephadm 2021-03-10T17:06:58.512009+0000 mgr.gibba043.dnkmem (mgr.34373) 10327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:01 gibba003 bash[31385]: cluster 2021-03-10T17:06:59.773131+0000 mgr.gibba043.dnkmem (mgr.34373) 10328 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:01 gibba003 bash[32348]: cluster 2021-03-10T17:06:59.773131+0000 mgr.gibba043.dnkmem (mgr.34373) 10328 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:01 gibba043 bash[24019]: cluster 2021-03-10T17:06:59.773131+0000 mgr.gibba043.dnkmem (mgr.34373) 10328 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:03 gibba003 bash[31385]: cluster 2021-03-10T17:07:01.774799+0000 mgr.gibba043.dnkmem (mgr.34373) 10329 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:03 gibba003 bash[32348]: cluster 2021-03-10T17:07:01.774799+0000 mgr.gibba043.dnkmem (mgr.34373) 10329 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:03 gibba043 bash[24019]: cluster 2021-03-10T17:07:01.774799+0000 mgr.gibba043.dnkmem (mgr.34373) 10329 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:05 gibba003 bash[31385]: cluster 2021-03-10T17:07:03.776218+0000 mgr.gibba043.dnkmem (mgr.34373) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:05 gibba003 bash[32348]: cluster 2021-03-10T17:07:03.776218+0000 mgr.gibba043.dnkmem (mgr.34373) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:05 gibba043 bash[24019]: cluster 2021-03-10T17:07:03.776218+0000 mgr.gibba043.dnkmem (mgr.34373) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:07 gibba003 bash[31385]: cluster 2021-03-10T17:07:05.777688+0000 mgr.gibba043.dnkmem (mgr.34373) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:07 gibba003 bash[32348]: cluster 2021-03-10T17:07:05.777688+0000 mgr.gibba043.dnkmem (mgr.34373) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:07 gibba043 bash[24019]: cluster 2021-03-10T17:07:05.777688+0000 mgr.gibba043.dnkmem (mgr.34373) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:09 gibba003 bash[31385]: cluster 2021-03-10T17:07:07.779184+0000 mgr.gibba043.dnkmem (mgr.34373) 10332 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:09 gibba003 bash[32348]: cluster 2021-03-10T17:07:07.779184+0000 mgr.gibba043.dnkmem (mgr.34373) 10332 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:09 gibba043 bash[24019]: cluster 2021-03-10T17:07:07.779184+0000 mgr.gibba043.dnkmem (mgr.34373) 10332 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:10.307 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:07:10.533 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:07:10.533 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:07:10.533 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:07:10.534 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:07:10.534 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:07:10.534 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:07:10.534 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:07:10.535 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:07:10.535 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:07:10.535 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:07:10.535 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:07:10.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:07:10.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:07:10.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:07:10.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:07:10.536 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:07:10.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:07:10.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:07:10.537 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:07:10.537 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:07:10.538 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:07:10.784 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:07:10.784 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:07:10.784 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:10.785 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:07:10.785 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:07:10.785 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:10.785 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:07:10.786 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:07:10.786 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:07:10.786 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:07:10.786 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:07:10.787 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:07:10.787 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:07:10.787 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:07:10.787 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:07:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[31385]: cluster 2021-03-10T17:07:09.780761+0000 mgr.gibba043.dnkmem (mgr.34373) 10333 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[31385]: audit 2021-03-10T17:07:10.297694+0000 mgr.gibba043.dnkmem (mgr.34373) 10334 : audit [DBG] from='client.50979 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[31385]: audit 2021-03-10T17:07:10.520606+0000 mgr.gibba043.dnkmem (mgr.34373) 10335 : audit [DBG] from='client.60976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:11.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[31385]: audit 2021-03-10T17:07:10.785488+0000 mon.c (mon.1) 2654 : audit [DBG] from='client.? 172.21.2.103:0/1766196404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[32348]: cluster 2021-03-10T17:07:09.780761+0000 mgr.gibba043.dnkmem (mgr.34373) 10333 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[32348]: audit 2021-03-10T17:07:10.297694+0000 mgr.gibba043.dnkmem (mgr.34373) 10334 : audit [DBG] from='client.50979 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:11.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[32348]: audit 2021-03-10T17:07:10.520606+0000 mgr.gibba043.dnkmem (mgr.34373) 10335 : audit [DBG] from='client.60976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:11.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:11 gibba003 bash[32348]: audit 2021-03-10T17:07:10.785488+0000 mon.c (mon.1) 2654 : audit [DBG] from='client.? 172.21.2.103:0/1766196404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:11 gibba043 bash[24019]: cluster 2021-03-10T17:07:09.780761+0000 mgr.gibba043.dnkmem (mgr.34373) 10333 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:11 gibba043 bash[24019]: audit 2021-03-10T17:07:10.297694+0000 mgr.gibba043.dnkmem (mgr.34373) 10334 : audit [DBG] from='client.50979 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:11 gibba043 bash[24019]: audit 2021-03-10T17:07:10.520606+0000 mgr.gibba043.dnkmem (mgr.34373) 10335 : audit [DBG] from='client.60976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:11 gibba043 bash[24019]: audit 2021-03-10T17:07:10.785488+0000 mon.c (mon.1) 2654 : audit [DBG] from='client.? 172.21.2.103:0/1766196404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:13 gibba003 bash[31385]: cluster 2021-03-10T17:07:11.782270+0000 mgr.gibba043.dnkmem (mgr.34373) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:13 gibba003 bash[32348]: cluster 2021-03-10T17:07:11.782270+0000 mgr.gibba043.dnkmem (mgr.34373) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:14.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:13 gibba043 bash[24019]: cluster 2021-03-10T17:07:11.782270+0000 mgr.gibba043.dnkmem (mgr.34373) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: cephadm 2021-03-10T17:07:13.527963+0000 mgr.gibba043.dnkmem (mgr.34373) 10337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:13.979570+0000 mon.c (mon.1) 2655 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:13.980738+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.215373+0000 mon.c (mon.1) 2656 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.216463+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.542014+0000 mon.c (mon.1) 2657 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:07:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.542797+0000 mon.c (mon.1) 2658 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.543270+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:07:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.543518+0000 mon.c (mon.1) 2659 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.544325+0000 mon.c (mon.1) 2660 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.544454+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.545612+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[31385]: audit 2021-03-10T17:07:14.546395+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: cephadm 2021-03-10T17:07:13.527963+0000 mgr.gibba043.dnkmem (mgr.34373) 10337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:13.979570+0000 mon.c (mon.1) 2655 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:13.980738+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.215373+0000 mon.c (mon.1) 2656 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.216463+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.542014+0000 mon.c (mon.1) 2657 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:07:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.542797+0000 mon.c (mon.1) 2658 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.543270+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:07:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.543518+0000 mon.c (mon.1) 2659 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.544325+0000 mon.c (mon.1) 2660 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.544454+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.545612+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:14.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:14 gibba003 bash[32348]: audit 2021-03-10T17:07:14.546395+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: cephadm 2021-03-10T17:07:13.527963+0000 mgr.gibba043.dnkmem (mgr.34373) 10337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:13.979570+0000 mon.c (mon.1) 2655 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:13.980738+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.215373+0000 mon.c (mon.1) 2656 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.216463+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.542014+0000 mon.c (mon.1) 2657 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:07:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.542797+0000 mon.c (mon.1) 2658 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.543270+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:07:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.543518+0000 mon.c (mon.1) 2659 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.544325+0000 mon.c (mon.1) 2660 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.544454+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.545612+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:14 gibba043 bash[24019]: audit 2021-03-10T17:07:14.546395+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:07:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:15 gibba003 bash[31385]: cluster 2021-03-10T17:07:13.783861+0000 mgr.gibba043.dnkmem (mgr.34373) 10338 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:15 gibba003 bash[32348]: cluster 2021-03-10T17:07:13.783861+0000 mgr.gibba043.dnkmem (mgr.34373) 10338 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:16.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:15 gibba043 bash[24019]: cluster 2021-03-10T17:07:13.783861+0000 mgr.gibba043.dnkmem (mgr.34373) 10338 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:17 gibba003 bash[31385]: cluster 2021-03-10T17:07:15.785114+0000 mgr.gibba043.dnkmem (mgr.34373) 10339 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:17 gibba003 bash[32348]: cluster 2021-03-10T17:07:15.785114+0000 mgr.gibba043.dnkmem (mgr.34373) 10339 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:17 gibba043 bash[24019]: cluster 2021-03-10T17:07:15.785114+0000 mgr.gibba043.dnkmem (mgr.34373) 10339 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:19 gibba003 bash[31385]: cluster 2021-03-10T17:07:17.786738+0000 mgr.gibba043.dnkmem (mgr.34373) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:19 gibba003 bash[32348]: cluster 2021-03-10T17:07:17.786738+0000 mgr.gibba043.dnkmem (mgr.34373) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:19 gibba043 bash[24019]: cluster 2021-03-10T17:07:17.786738+0000 mgr.gibba043.dnkmem (mgr.34373) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:20.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:20 gibba003 bash[31385]: cluster 2021-03-10T17:07:19.788156+0000 mgr.gibba043.dnkmem (mgr.34373) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:20.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:20 gibba003 bash[32348]: cluster 2021-03-10T17:07:19.788156+0000 mgr.gibba043.dnkmem (mgr.34373) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:21.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:20 gibba043 bash[24019]: cluster 2021-03-10T17:07:19.788156+0000 mgr.gibba043.dnkmem (mgr.34373) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:23.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:23 gibba043 bash[24019]: cluster 2021-03-10T17:07:21.789624+0000 mgr.gibba043.dnkmem (mgr.34373) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:23 gibba003 bash[31385]: cluster 2021-03-10T17:07:21.789624+0000 mgr.gibba043.dnkmem (mgr.34373) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:23 gibba003 bash[32348]: cluster 2021-03-10T17:07:21.789624+0000 mgr.gibba043.dnkmem (mgr.34373) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:25.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:25 gibba043 bash[24019]: cluster 2021-03-10T17:07:23.791007+0000 mgr.gibba043.dnkmem (mgr.34373) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:25 gibba003 bash[31385]: cluster 2021-03-10T17:07:23.791007+0000 mgr.gibba043.dnkmem (mgr.34373) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:25 gibba003 bash[32348]: cluster 2021-03-10T17:07:23.791007+0000 mgr.gibba043.dnkmem (mgr.34373) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:27 gibba043 bash[24019]: cluster 2021-03-10T17:07:25.792509+0000 mgr.gibba043.dnkmem (mgr.34373) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:27 gibba003 bash[31385]: cluster 2021-03-10T17:07:25.792509+0000 mgr.gibba043.dnkmem (mgr.34373) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:27 gibba003 bash[32348]: cluster 2021-03-10T17:07:25.792509+0000 mgr.gibba043.dnkmem (mgr.34373) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: cluster 2021-03-10T17:07:27.794060+0000 mgr.gibba043.dnkmem (mgr.34373) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.544016+0000 mgr.gibba043.dnkmem (mgr.34373) 10346 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:07:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.544571+0000 mgr.gibba043.dnkmem (mgr.34373) 10347 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:07:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.774293+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:07:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.778068+0000 mon.c (mon.1) 2661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.779806+0000 mon.c (mon.1) 2662 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.781284+0000 mon.c (mon.1) 2663 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.782771+0000 mon.c (mon.1) 2664 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.786075+0000 mon.c (mon.1) 2665 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:29 gibba043 bash[24019]: audit 2021-03-10T17:07:28.787764+0000 mon.c (mon.1) 2666 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: cluster 2021-03-10T17:07:27.794060+0000 mgr.gibba043.dnkmem (mgr.34373) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.544016+0000 mgr.gibba043.dnkmem (mgr.34373) 10346 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:07:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.544571+0000 mgr.gibba043.dnkmem (mgr.34373) 10347 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:07:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.774293+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:07:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.778068+0000 mon.c (mon.1) 2661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.779806+0000 mon.c (mon.1) 2662 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.781284+0000 mon.c (mon.1) 2663 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.782771+0000 mon.c (mon.1) 2664 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.786075+0000 mon.c (mon.1) 2665 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[31385]: audit 2021-03-10T17:07:28.787764+0000 mon.c (mon.1) 2666 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: cluster 2021-03-10T17:07:27.794060+0000 mgr.gibba043.dnkmem (mgr.34373) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.544016+0000 mgr.gibba043.dnkmem (mgr.34373) 10346 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:07:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.544571+0000 mgr.gibba043.dnkmem (mgr.34373) 10347 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:07:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.774293+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:07:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.778068+0000 mon.c (mon.1) 2661 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.779806+0000 mon.c (mon.1) 2662 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.781284+0000 mon.c (mon.1) 2663 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.782771+0000 mon.c (mon.1) 2664 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.786075+0000 mon.c (mon.1) 2665 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:29 gibba003 bash[32348]: audit 2021-03-10T17:07:28.787764+0000 mon.c (mon.1) 2666 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:30.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.775581+0000 mgr.gibba043.dnkmem (mgr.34373) 10348 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:30.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.777545+0000 mgr.gibba043.dnkmem (mgr.34373) 10349 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:30.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.778977+0000 mgr.gibba043.dnkmem (mgr.34373) 10350 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:30.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.779020+0000 mgr.gibba043.dnkmem (mgr.34373) 10351 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:30.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.780541+0000 mgr.gibba043.dnkmem (mgr.34373) 10352 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:30.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.780584+0000 mgr.gibba043.dnkmem (mgr.34373) 10353 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:30.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.781818+0000 mgr.gibba043.dnkmem (mgr.34373) 10354 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:30.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.783615+0000 mgr.gibba043.dnkmem (mgr.34373) 10355 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:30.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.783677+0000 mgr.gibba043.dnkmem (mgr.34373) 10356 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:30.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.785359+0000 mgr.gibba043.dnkmem (mgr.34373) 10357 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:30.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.785747+0000 mgr.gibba043.dnkmem (mgr.34373) 10358 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:30.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.787020+0000 mgr.gibba043.dnkmem (mgr.34373) 10359 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:30.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.787067+0000 mgr.gibba043.dnkmem (mgr.34373) 10360 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:30.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:30 gibba043 bash[24019]: cephadm 2021-03-10T17:07:28.787191+0000 mgr.gibba043.dnkmem (mgr.34373) 10361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:30.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.775581+0000 mgr.gibba043.dnkmem (mgr.34373) 10348 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.777545+0000 mgr.gibba043.dnkmem (mgr.34373) 10349 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.778977+0000 mgr.gibba043.dnkmem (mgr.34373) 10350 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.779020+0000 mgr.gibba043.dnkmem (mgr.34373) 10351 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.780541+0000 mgr.gibba043.dnkmem (mgr.34373) 10352 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.780584+0000 mgr.gibba043.dnkmem (mgr.34373) 10353 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.781818+0000 mgr.gibba043.dnkmem (mgr.34373) 10354 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.783615+0000 mgr.gibba043.dnkmem (mgr.34373) 10355 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.783677+0000 mgr.gibba043.dnkmem (mgr.34373) 10356 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.785359+0000 mgr.gibba043.dnkmem (mgr.34373) 10357 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.785747+0000 mgr.gibba043.dnkmem (mgr.34373) 10358 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.787020+0000 mgr.gibba043.dnkmem (mgr.34373) 10359 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.787067+0000 mgr.gibba043.dnkmem (mgr.34373) 10360 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[31385]: cephadm 2021-03-10T17:07:28.787191+0000 mgr.gibba043.dnkmem (mgr.34373) 10361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.775581+0000 mgr.gibba043.dnkmem (mgr.34373) 10348 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.777545+0000 mgr.gibba043.dnkmem (mgr.34373) 10349 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.778977+0000 mgr.gibba043.dnkmem (mgr.34373) 10350 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.779020+0000 mgr.gibba043.dnkmem (mgr.34373) 10351 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.780541+0000 mgr.gibba043.dnkmem (mgr.34373) 10352 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.780584+0000 mgr.gibba043.dnkmem (mgr.34373) 10353 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.781818+0000 mgr.gibba043.dnkmem (mgr.34373) 10354 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.783615+0000 mgr.gibba043.dnkmem (mgr.34373) 10355 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.783677+0000 mgr.gibba043.dnkmem (mgr.34373) 10356 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.785359+0000 mgr.gibba043.dnkmem (mgr.34373) 10357 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.785747+0000 mgr.gibba043.dnkmem (mgr.34373) 10358 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.787020+0000 mgr.gibba043.dnkmem (mgr.34373) 10359 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.787067+0000 mgr.gibba043.dnkmem (mgr.34373) 10360 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:30 gibba003 bash[32348]: cephadm 2021-03-10T17:07:28.787191+0000 mgr.gibba043.dnkmem (mgr.34373) 10361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:31 gibba043 bash[24019]: cluster 2021-03-10T17:07:29.795541+0000 mgr.gibba043.dnkmem (mgr.34373) 10362 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:31 gibba003 bash[31385]: cluster 2021-03-10T17:07:29.795541+0000 mgr.gibba043.dnkmem (mgr.34373) 10362 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:31 gibba003 bash[32348]: cluster 2021-03-10T17:07:29.795541+0000 mgr.gibba043.dnkmem (mgr.34373) 10362 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:33 gibba003 bash[31385]: cluster 2021-03-10T17:07:31.797128+0000 mgr.gibba043.dnkmem (mgr.34373) 10363 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:33 gibba003 bash[32348]: cluster 2021-03-10T17:07:31.797128+0000 mgr.gibba043.dnkmem (mgr.34373) 10363 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:33 gibba043 bash[24019]: cluster 2021-03-10T17:07:31.797128+0000 mgr.gibba043.dnkmem (mgr.34373) 10363 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:35 gibba003 bash[31385]: cluster 2021-03-10T17:07:33.798630+0000 mgr.gibba043.dnkmem (mgr.34373) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:35 gibba003 bash[32348]: cluster 2021-03-10T17:07:33.798630+0000 mgr.gibba043.dnkmem (mgr.34373) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:35 gibba043 bash[24019]: cluster 2021-03-10T17:07:33.798630+0000 mgr.gibba043.dnkmem (mgr.34373) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:37 gibba003 bash[31385]: cluster 2021-03-10T17:07:35.800190+0000 mgr.gibba043.dnkmem (mgr.34373) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:37 gibba003 bash[32348]: cluster 2021-03-10T17:07:35.800190+0000 mgr.gibba043.dnkmem (mgr.34373) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:37 gibba043 bash[24019]: cluster 2021-03-10T17:07:35.800190+0000 mgr.gibba043.dnkmem (mgr.34373) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:39 gibba003 bash[31385]: cluster 2021-03-10T17:07:37.801866+0000 mgr.gibba043.dnkmem (mgr.34373) 10366 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:39 gibba003 bash[32348]: cluster 2021-03-10T17:07:37.801866+0000 mgr.gibba043.dnkmem (mgr.34373) 10366 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:39 gibba043 bash[24019]: cluster 2021-03-10T17:07:37.801866+0000 mgr.gibba043.dnkmem (mgr.34373) 10366 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:41.033 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:07:41.288 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:07:41.289 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:07:41.289 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:07:41.289 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:07:41.289 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:07:41.290 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:07:41.290 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:07:41.290 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:07:41.290 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:07:41.290 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:07:41.291 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:07:41.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:07:41.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:07:41.291 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:07:41.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:07:41.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:07:41.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:07:41.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:07:41.292 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:07:41.293 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:07:41.293 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:07:41.554 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:07:41.554 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:07:41.554 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:41.555 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:07:41.555 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:07:41.555 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:41.555 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:07:41.556 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:07:41.556 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:07:41.556 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:07:41.556 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:07:41.556 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:07:41.557 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:07:41.557 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:07:41.557 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:07:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:41 gibba003 bash[31385]: cluster 2021-03-10T17:07:39.803306+0000 mgr.gibba043.dnkmem (mgr.34373) 10367 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:41 gibba003 bash[32348]: cluster 2021-03-10T17:07:39.803306+0000 mgr.gibba043.dnkmem (mgr.34373) 10367 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:41 gibba043 bash[24019]: cluster 2021-03-10T17:07:39.803306+0000 mgr.gibba043.dnkmem (mgr.34373) 10367 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:42 gibba003 bash[31385]: audit 2021-03-10T17:07:41.022525+0000 mgr.gibba043.dnkmem (mgr.34373) 10368 : audit [DBG] from='client.60988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:42 gibba003 bash[31385]: audit 2021-03-10T17:07:41.247603+0000 mgr.gibba043.dnkmem (mgr.34373) 10369 : audit [DBG] from='client.51003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:42 gibba003 bash[31385]: audit 2021-03-10T17:07:41.555347+0000 mon.c (mon.1) 2667 : audit [DBG] from='client.? 172.21.2.103:0/1354088729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:42 gibba003 bash[32348]: audit 2021-03-10T17:07:41.022525+0000 mgr.gibba043.dnkmem (mgr.34373) 10368 : audit [DBG] from='client.60988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:42 gibba003 bash[32348]: audit 2021-03-10T17:07:41.247603+0000 mgr.gibba043.dnkmem (mgr.34373) 10369 : audit [DBG] from='client.51003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:42.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:42 gibba003 bash[32348]: audit 2021-03-10T17:07:41.555347+0000 mon.c (mon.1) 2667 : audit [DBG] from='client.? 172.21.2.103:0/1354088729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:42 gibba043 bash[24019]: audit 2021-03-10T17:07:41.022525+0000 mgr.gibba043.dnkmem (mgr.34373) 10368 : audit [DBG] from='client.60988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:42 gibba043 bash[24019]: audit 2021-03-10T17:07:41.247603+0000 mgr.gibba043.dnkmem (mgr.34373) 10369 : audit [DBG] from='client.51003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:42 gibba043 bash[24019]: audit 2021-03-10T17:07:41.555347+0000 mon.c (mon.1) 2667 : audit [DBG] from='client.? 172.21.2.103:0/1354088729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:43 gibba003 bash[31385]: cluster 2021-03-10T17:07:41.805030+0000 mgr.gibba043.dnkmem (mgr.34373) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:43 gibba003 bash[32348]: cluster 2021-03-10T17:07:41.805030+0000 mgr.gibba043.dnkmem (mgr.34373) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:43 gibba043 bash[24019]: cluster 2021-03-10T17:07:41.805030+0000 mgr.gibba043.dnkmem (mgr.34373) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:45 gibba003 bash[31385]: cephadm 2021-03-10T17:07:43.791901+0000 mgr.gibba043.dnkmem (mgr.34373) 10371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:45 gibba003 bash[31385]: cluster 2021-03-10T17:07:43.806569+0000 mgr.gibba043.dnkmem (mgr.34373) 10372 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:45 gibba003 bash[32348]: cephadm 2021-03-10T17:07:43.791901+0000 mgr.gibba043.dnkmem (mgr.34373) 10371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:45 gibba003 bash[32348]: cluster 2021-03-10T17:07:43.806569+0000 mgr.gibba043.dnkmem (mgr.34373) 10372 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:45 gibba043 bash[24019]: cephadm 2021-03-10T17:07:43.791901+0000 mgr.gibba043.dnkmem (mgr.34373) 10371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:07:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:45 gibba043 bash[24019]: cluster 2021-03-10T17:07:43.806569+0000 mgr.gibba043.dnkmem (mgr.34373) 10372 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:47.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:47 gibba003 bash[31385]: cluster 2021-03-10T17:07:45.808041+0000 mgr.gibba043.dnkmem (mgr.34373) 10373 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:47 gibba003 bash[32348]: cluster 2021-03-10T17:07:45.808041+0000 mgr.gibba043.dnkmem (mgr.34373) 10373 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:47 gibba043 bash[24019]: cluster 2021-03-10T17:07:45.808041+0000 mgr.gibba043.dnkmem (mgr.34373) 10373 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:49 gibba003 bash[31385]: cluster 2021-03-10T17:07:47.809441+0000 mgr.gibba043.dnkmem (mgr.34373) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:49 gibba003 bash[32348]: cluster 2021-03-10T17:07:47.809441+0000 mgr.gibba043.dnkmem (mgr.34373) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:49 gibba043 bash[24019]: cluster 2021-03-10T17:07:47.809441+0000 mgr.gibba043.dnkmem (mgr.34373) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:51 gibba003 bash[31385]: cluster 2021-03-10T17:07:49.810903+0000 mgr.gibba043.dnkmem (mgr.34373) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:51 gibba003 bash[32348]: cluster 2021-03-10T17:07:49.810903+0000 mgr.gibba043.dnkmem (mgr.34373) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:51 gibba043 bash[24019]: cluster 2021-03-10T17:07:49.810903+0000 mgr.gibba043.dnkmem (mgr.34373) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:53 gibba003 bash[31385]: cluster 2021-03-10T17:07:51.812503+0000 mgr.gibba043.dnkmem (mgr.34373) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:53 gibba003 bash[32348]: cluster 2021-03-10T17:07:51.812503+0000 mgr.gibba043.dnkmem (mgr.34373) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:53 gibba043 bash[24019]: cluster 2021-03-10T17:07:51.812503+0000 mgr.gibba043.dnkmem (mgr.34373) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:55 gibba003 bash[31385]: cluster 2021-03-10T17:07:53.814007+0000 mgr.gibba043.dnkmem (mgr.34373) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:55 gibba003 bash[32348]: cluster 2021-03-10T17:07:53.814007+0000 mgr.gibba043.dnkmem (mgr.34373) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:55 gibba043 bash[24019]: cluster 2021-03-10T17:07:53.814007+0000 mgr.gibba043.dnkmem (mgr.34373) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:57 gibba003 bash[31385]: cluster 2021-03-10T17:07:55.815459+0000 mgr.gibba043.dnkmem (mgr.34373) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:57 gibba003 bash[32348]: cluster 2021-03-10T17:07:55.815459+0000 mgr.gibba043.dnkmem (mgr.34373) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:57 gibba043 bash[24019]: cluster 2021-03-10T17:07:55.815459+0000 mgr.gibba043.dnkmem (mgr.34373) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:07:59 gibba003 bash[31385]: cluster 2021-03-10T17:07:57.817138+0000 mgr.gibba043.dnkmem (mgr.34373) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:07:59 gibba003 bash[32348]: cluster 2021-03-10T17:07:57.817138+0000 mgr.gibba043.dnkmem (mgr.34373) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:07:59 gibba043 bash[24019]: cluster 2021-03-10T17:07:57.817138+0000 mgr.gibba043.dnkmem (mgr.34373) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:00 gibba003 bash[31385]: cephadm 2021-03-10T17:07:58.800649+0000 mgr.gibba043.dnkmem (mgr.34373) 10380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:00.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:00 gibba003 bash[32348]: cephadm 2021-03-10T17:07:58.800649+0000 mgr.gibba043.dnkmem (mgr.34373) 10380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:00 gibba043 bash[24019]: cephadm 2021-03-10T17:07:58.800649+0000 mgr.gibba043.dnkmem (mgr.34373) 10380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:01 gibba003 bash[31385]: cluster 2021-03-10T17:07:59.818625+0000 mgr.gibba043.dnkmem (mgr.34373) 10381 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:01 gibba003 bash[32348]: cluster 2021-03-10T17:07:59.818625+0000 mgr.gibba043.dnkmem (mgr.34373) 10381 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:01 gibba043 bash[24019]: cluster 2021-03-10T17:07:59.818625+0000 mgr.gibba043.dnkmem (mgr.34373) 10381 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:03 gibba003 bash[31385]: cluster 2021-03-10T17:08:01.820420+0000 mgr.gibba043.dnkmem (mgr.34373) 10382 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:03 gibba003 bash[32348]: cluster 2021-03-10T17:08:01.820420+0000 mgr.gibba043.dnkmem (mgr.34373) 10382 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:03 gibba043 bash[24019]: cluster 2021-03-10T17:08:01.820420+0000 mgr.gibba043.dnkmem (mgr.34373) 10382 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:05.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:05 gibba003 bash[31385]: cluster 2021-03-10T17:08:03.822019+0000 mgr.gibba043.dnkmem (mgr.34373) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:05 gibba003 bash[32348]: cluster 2021-03-10T17:08:03.822019+0000 mgr.gibba043.dnkmem (mgr.34373) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:05 gibba043 bash[24019]: cluster 2021-03-10T17:08:03.822019+0000 mgr.gibba043.dnkmem (mgr.34373) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:06.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:06 gibba003 bash[31385]: cluster 2021-03-10T17:08:05.823435+0000 mgr.gibba043.dnkmem (mgr.34373) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:06.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:06 gibba003 bash[32348]: cluster 2021-03-10T17:08:05.823435+0000 mgr.gibba043.dnkmem (mgr.34373) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:07.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:06 gibba043 bash[24019]: cluster 2021-03-10T17:08:05.823435+0000 mgr.gibba043.dnkmem (mgr.34373) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:09.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:09 gibba043 bash[24019]: cluster 2021-03-10T17:08:07.825030+0000 mgr.gibba043.dnkmem (mgr.34373) 10385 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:09 gibba003 bash[31385]: cluster 2021-03-10T17:08:07.825030+0000 mgr.gibba043.dnkmem (mgr.34373) 10385 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:09 gibba003 bash[32348]: cluster 2021-03-10T17:08:07.825030+0000 mgr.gibba043.dnkmem (mgr.34373) 10385 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:11 gibba043 bash[24019]: cluster 2021-03-10T17:08:09.826535+0000 mgr.gibba043.dnkmem (mgr.34373) 10386 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.799 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:08:11.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:11 gibba003 bash[32348]: cluster 2021-03-10T17:08:09.826535+0000 mgr.gibba043.dnkmem (mgr.34373) 10386 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:11 gibba003 bash[31385]: cluster 2021-03-10T17:08:09.826535+0000 mgr.gibba043.dnkmem (mgr.34373) 10386 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:12.028 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:08:12.029 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:08:12.029 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:08:12.029 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:08:12.029 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:08:12.030 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:08:12.030 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:08:12.030 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:08:12.030 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:08:12.031 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:08:12.031 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:08:12.031 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:08:12.031 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:08:12.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:08:12.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:08:12.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:08:12.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:08:12.032 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:08:12.033 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:08:12.033 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:08:12.033 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:08:12.277 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:08:12.278 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:08:12.278 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:12.278 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:08:12.279 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:08:12.279 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:12.279 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:08:12.279 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:08:12.280 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:08:12.280 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:08:12.280 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:08:12.280 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:08:12.281 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:08:12.281 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:08:12.281 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:08:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:12 gibba043 bash[24019]: audit 2021-03-10T17:08:12.278766+0000 mon.c (mon.1) 2668 : audit [DBG] from='client.? 172.21.2.103:0/2109440004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:12.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:12 gibba003 bash[31385]: audit 2021-03-10T17:08:12.278766+0000 mon.c (mon.1) 2668 : audit [DBG] from='client.? 172.21.2.103:0/2109440004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:12.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:12 gibba003 bash[32348]: audit 2021-03-10T17:08:12.278766+0000 mon.c (mon.1) 2668 : audit [DBG] from='client.? 172.21.2.103:0/2109440004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:13.770 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:13 gibba043 bash[24019]: audit 2021-03-10T17:08:11.789936+0000 mgr.gibba043.dnkmem (mgr.34373) 10387 : audit [DBG] from='client.61006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:13 gibba043 bash[24019]: cluster 2021-03-10T17:08:11.828270+0000 mgr.gibba043.dnkmem (mgr.34373) 10388 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:13 gibba043 bash[24019]: audit 2021-03-10T17:08:12.016060+0000 mgr.gibba043.dnkmem (mgr.34373) 10389 : audit [DBG] from='client.51021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:13 gibba003 bash[31385]: audit 2021-03-10T17:08:11.789936+0000 mgr.gibba043.dnkmem (mgr.34373) 10387 : audit [DBG] from='client.61006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:13 gibba003 bash[31385]: cluster 2021-03-10T17:08:11.828270+0000 mgr.gibba043.dnkmem (mgr.34373) 10388 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:13 gibba003 bash[31385]: audit 2021-03-10T17:08:12.016060+0000 mgr.gibba043.dnkmem (mgr.34373) 10389 : audit [DBG] from='client.51021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:13 gibba003 bash[32348]: audit 2021-03-10T17:08:11.789936+0000 mgr.gibba043.dnkmem (mgr.34373) 10387 : audit [DBG] from='client.61006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:13 gibba003 bash[32348]: cluster 2021-03-10T17:08:11.828270+0000 mgr.gibba043.dnkmem (mgr.34373) 10388 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:13 gibba003 bash[32348]: audit 2021-03-10T17:08:12.016060+0000 mgr.gibba043.dnkmem (mgr.34373) 10389 : audit [DBG] from='client.51021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[31385]: audit 2021-03-10T17:08:13.986093+0000 mon.c (mon.1) 2669 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[31385]: audit 2021-03-10T17:08:13.987255+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[31385]: audit 2021-03-10T17:08:14.223149+0000 mon.c (mon.1) 2670 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[31385]: audit 2021-03-10T17:08:14.224249+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[32348]: audit 2021-03-10T17:08:13.986093+0000 mon.c (mon.1) 2669 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[32348]: audit 2021-03-10T17:08:13.987255+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[32348]: audit 2021-03-10T17:08:14.223149+0000 mon.c (mon.1) 2670 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:14 gibba003 bash[32348]: audit 2021-03-10T17:08:14.224249+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:14 gibba043 bash[24019]: audit 2021-03-10T17:08:13.986093+0000 mon.c (mon.1) 2669 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:14 gibba043 bash[24019]: audit 2021-03-10T17:08:13.987255+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:14 gibba043 bash[24019]: audit 2021-03-10T17:08:14.223149+0000 mon.c (mon.1) 2670 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:14 gibba043 bash[24019]: audit 2021-03-10T17:08:14.224249+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: cephadm 2021-03-10T17:08:13.804651+0000 mgr.gibba043.dnkmem (mgr.34373) 10390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: cluster 2021-03-10T17:08:13.829675+0000 mgr.gibba043.dnkmem (mgr.34373) 10391 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.547549+0000 mon.c (mon.1) 2671 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:08:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.547732+0000 mon.c (mon.1) 2672 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.547889+0000 mon.c (mon.1) 2673 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.548050+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:08:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.548055+0000 mon.c (mon.1) 2674 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.548309+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.548544+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[31385]: audit 2021-03-10T17:08:14.548740+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: cephadm 2021-03-10T17:08:13.804651+0000 mgr.gibba043.dnkmem (mgr.34373) 10390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: cluster 2021-03-10T17:08:13.829675+0000 mgr.gibba043.dnkmem (mgr.34373) 10391 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.547549+0000 mon.c (mon.1) 2671 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:08:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.547732+0000 mon.c (mon.1) 2672 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.547889+0000 mon.c (mon.1) 2673 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.548050+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:08:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.548055+0000 mon.c (mon.1) 2674 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.548309+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.548544+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:08:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:15 gibba003 bash[32348]: audit 2021-03-10T17:08:14.548740+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:08:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: cephadm 2021-03-10T17:08:13.804651+0000 mgr.gibba043.dnkmem (mgr.34373) 10390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: cluster 2021-03-10T17:08:13.829675+0000 mgr.gibba043.dnkmem (mgr.34373) 10391 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.547549+0000 mon.c (mon.1) 2671 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:08:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.547732+0000 mon.c (mon.1) 2672 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.547889+0000 mon.c (mon.1) 2673 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:08:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.548050+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:08:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.548055+0000 mon.c (mon.1) 2674 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:08:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.548309+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.548544+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:08:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:15 gibba043 bash[24019]: audit 2021-03-10T17:08:14.548740+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:08:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:17 gibba003 bash[31385]: cluster 2021-03-10T17:08:15.831231+0000 mgr.gibba043.dnkmem (mgr.34373) 10392 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:17 gibba003 bash[32348]: cluster 2021-03-10T17:08:15.831231+0000 mgr.gibba043.dnkmem (mgr.34373) 10392 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:17 gibba043 bash[24019]: cluster 2021-03-10T17:08:15.831231+0000 mgr.gibba043.dnkmem (mgr.34373) 10392 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:19 gibba003 bash[31385]: cluster 2021-03-10T17:08:17.832766+0000 mgr.gibba043.dnkmem (mgr.34373) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:19 gibba003 bash[32348]: cluster 2021-03-10T17:08:17.832766+0000 mgr.gibba043.dnkmem (mgr.34373) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:19 gibba043 bash[24019]: cluster 2021-03-10T17:08:17.832766+0000 mgr.gibba043.dnkmem (mgr.34373) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:21 gibba003 bash[31385]: cluster 2021-03-10T17:08:19.834293+0000 mgr.gibba043.dnkmem (mgr.34373) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:21 gibba003 bash[32348]: cluster 2021-03-10T17:08:19.834293+0000 mgr.gibba043.dnkmem (mgr.34373) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:21 gibba043 bash[24019]: cluster 2021-03-10T17:08:19.834293+0000 mgr.gibba043.dnkmem (mgr.34373) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:23 gibba003 bash[31385]: cluster 2021-03-10T17:08:21.835943+0000 mgr.gibba043.dnkmem (mgr.34373) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:23 gibba003 bash[32348]: cluster 2021-03-10T17:08:21.835943+0000 mgr.gibba043.dnkmem (mgr.34373) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:23 gibba043 bash[24019]: cluster 2021-03-10T17:08:21.835943+0000 mgr.gibba043.dnkmem (mgr.34373) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:25 gibba003 bash[31385]: cluster 2021-03-10T17:08:23.837526+0000 mgr.gibba043.dnkmem (mgr.34373) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:25 gibba003 bash[32348]: cluster 2021-03-10T17:08:23.837526+0000 mgr.gibba043.dnkmem (mgr.34373) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:25 gibba043 bash[24019]: cluster 2021-03-10T17:08:23.837526+0000 mgr.gibba043.dnkmem (mgr.34373) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:27 gibba003 bash[31385]: cluster 2021-03-10T17:08:25.839070+0000 mgr.gibba043.dnkmem (mgr.34373) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:27 gibba003 bash[32348]: cluster 2021-03-10T17:08:25.839070+0000 mgr.gibba043.dnkmem (mgr.34373) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:27 gibba043 bash[24019]: cluster 2021-03-10T17:08:25.839070+0000 mgr.gibba043.dnkmem (mgr.34373) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: cluster 2021-03-10T17:08:27.840811+0000 mgr.gibba043.dnkmem (mgr.34373) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.050207+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:08:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.064929+0000 mon.c (mon.1) 2675 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.068641+0000 mon.c (mon.1) 2676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.072030+0000 mon.c (mon.1) 2677 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.074991+0000 mon.c (mon.1) 2678 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.081307+0000 mon.c (mon.1) 2679 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[31385]: audit 2021-03-10T17:08:29.085652+0000 mon.c (mon.1) 2680 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: cluster 2021-03-10T17:08:27.840811+0000 mgr.gibba043.dnkmem (mgr.34373) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.050207+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:08:29.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.064929+0000 mon.c (mon.1) 2675 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:29.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.068641+0000 mon.c (mon.1) 2676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.072030+0000 mon.c (mon.1) 2677 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.074991+0000 mon.c (mon.1) 2678 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.081307+0000 mon.c (mon.1) 2679 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:29 gibba003 bash[32348]: audit 2021-03-10T17:08:29.085652+0000 mon.c (mon.1) 2680 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: cluster 2021-03-10T17:08:27.840811+0000 mgr.gibba043.dnkmem (mgr.34373) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.050207+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:08:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.064929+0000 mon.c (mon.1) 2675 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.068641+0000 mon.c (mon.1) 2676 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.072030+0000 mon.c (mon.1) 2677 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.074991+0000 mon.c (mon.1) 2678 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.081307+0000 mon.c (mon.1) 2679 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:29 gibba043 bash[24019]: audit 2021-03-10T17:08:29.085652+0000 mon.c (mon.1) 2680 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:28.821380+0000 mgr.gibba043.dnkmem (mgr.34373) 10399 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:08:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:28.822985+0000 mgr.gibba043.dnkmem (mgr.34373) 10400 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:08:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.060751+0000 mgr.gibba043.dnkmem (mgr.34373) 10401 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.065636+0000 mgr.gibba043.dnkmem (mgr.34373) 10402 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:30.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.068827+0000 mgr.gibba043.dnkmem (mgr.34373) 10403 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.069321+0000 mgr.gibba043.dnkmem (mgr.34373) 10404 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.072357+0000 mgr.gibba043.dnkmem (mgr.34373) 10405 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.072612+0000 mgr.gibba043.dnkmem (mgr.34373) 10406 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.074960+0000 mgr.gibba043.dnkmem (mgr.34373) 10407 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.077755+0000 mgr.gibba043.dnkmem (mgr.34373) 10408 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.077939+0000 mgr.gibba043.dnkmem (mgr.34373) 10409 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.081558+0000 mgr.gibba043.dnkmem (mgr.34373) 10410 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.083342+0000 mgr.gibba043.dnkmem (mgr.34373) 10411 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:30.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.086055+0000 mgr.gibba043.dnkmem (mgr.34373) 10412 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:30.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.086595+0000 mgr.gibba043.dnkmem (mgr.34373) 10413 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:30.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[31385]: cephadm 2021-03-10T17:08:29.087142+0000 mgr.gibba043.dnkmem (mgr.34373) 10414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:28.821380+0000 mgr.gibba043.dnkmem (mgr.34373) 10399 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:08:30.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:28.822985+0000 mgr.gibba043.dnkmem (mgr.34373) 10400 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:08:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.060751+0000 mgr.gibba043.dnkmem (mgr.34373) 10401 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.065636+0000 mgr.gibba043.dnkmem (mgr.34373) 10402 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.068827+0000 mgr.gibba043.dnkmem (mgr.34373) 10403 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:30.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.069321+0000 mgr.gibba043.dnkmem (mgr.34373) 10404 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.072357+0000 mgr.gibba043.dnkmem (mgr.34373) 10405 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.072612+0000 mgr.gibba043.dnkmem (mgr.34373) 10406 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.074960+0000 mgr.gibba043.dnkmem (mgr.34373) 10407 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:30.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.077755+0000 mgr.gibba043.dnkmem (mgr.34373) 10408 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.077939+0000 mgr.gibba043.dnkmem (mgr.34373) 10409 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.081558+0000 mgr.gibba043.dnkmem (mgr.34373) 10410 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.083342+0000 mgr.gibba043.dnkmem (mgr.34373) 10411 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.086055+0000 mgr.gibba043.dnkmem (mgr.34373) 10412 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:30.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.086595+0000 mgr.gibba043.dnkmem (mgr.34373) 10413 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:30.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:30 gibba003 bash[32348]: cephadm 2021-03-10T17:08:29.087142+0000 mgr.gibba043.dnkmem (mgr.34373) 10414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:31.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:28.821380+0000 mgr.gibba043.dnkmem (mgr.34373) 10399 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:08:31.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:28.822985+0000 mgr.gibba043.dnkmem (mgr.34373) 10400 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:08:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.060751+0000 mgr.gibba043.dnkmem (mgr.34373) 10401 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.065636+0000 mgr.gibba043.dnkmem (mgr.34373) 10402 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.068827+0000 mgr.gibba043.dnkmem (mgr.34373) 10403 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:31.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.069321+0000 mgr.gibba043.dnkmem (mgr.34373) 10404 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.072357+0000 mgr.gibba043.dnkmem (mgr.34373) 10405 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.072612+0000 mgr.gibba043.dnkmem (mgr.34373) 10406 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.074960+0000 mgr.gibba043.dnkmem (mgr.34373) 10407 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.077755+0000 mgr.gibba043.dnkmem (mgr.34373) 10408 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.077939+0000 mgr.gibba043.dnkmem (mgr.34373) 10409 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.081558+0000 mgr.gibba043.dnkmem (mgr.34373) 10410 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.083342+0000 mgr.gibba043.dnkmem (mgr.34373) 10411 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.086055+0000 mgr.gibba043.dnkmem (mgr.34373) 10412 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.086595+0000 mgr.gibba043.dnkmem (mgr.34373) 10413 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:31.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:30 gibba043 bash[24019]: cephadm 2021-03-10T17:08:29.087142+0000 mgr.gibba043.dnkmem (mgr.34373) 10414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:31 gibba003 bash[31385]: cluster 2021-03-10T17:08:29.842348+0000 mgr.gibba043.dnkmem (mgr.34373) 10415 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:31 gibba003 bash[32348]: cluster 2021-03-10T17:08:29.842348+0000 mgr.gibba043.dnkmem (mgr.34373) 10415 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:31 gibba043 bash[24019]: cluster 2021-03-10T17:08:29.842348+0000 mgr.gibba043.dnkmem (mgr.34373) 10415 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:33 gibba003 bash[31385]: cluster 2021-03-10T17:08:31.843860+0000 mgr.gibba043.dnkmem (mgr.34373) 10416 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:33 gibba003 bash[32348]: cluster 2021-03-10T17:08:31.843860+0000 mgr.gibba043.dnkmem (mgr.34373) 10416 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:33 gibba043 bash[24019]: cluster 2021-03-10T17:08:31.843860+0000 mgr.gibba043.dnkmem (mgr.34373) 10416 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:35 gibba003 bash[31385]: cluster 2021-03-10T17:08:33.845272+0000 mgr.gibba043.dnkmem (mgr.34373) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:35 gibba003 bash[32348]: cluster 2021-03-10T17:08:33.845272+0000 mgr.gibba043.dnkmem (mgr.34373) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:35 gibba043 bash[24019]: cluster 2021-03-10T17:08:33.845272+0000 mgr.gibba043.dnkmem (mgr.34373) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:37 gibba003 bash[31385]: cluster 2021-03-10T17:08:35.846846+0000 mgr.gibba043.dnkmem (mgr.34373) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:37 gibba003 bash[32348]: cluster 2021-03-10T17:08:35.846846+0000 mgr.gibba043.dnkmem (mgr.34373) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:37 gibba043 bash[24019]: cluster 2021-03-10T17:08:35.846846+0000 mgr.gibba043.dnkmem (mgr.34373) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:39 gibba003 bash[31385]: cluster 2021-03-10T17:08:37.848397+0000 mgr.gibba043.dnkmem (mgr.34373) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:39 gibba003 bash[32348]: cluster 2021-03-10T17:08:37.848397+0000 mgr.gibba043.dnkmem (mgr.34373) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:39 gibba043 bash[24019]: cluster 2021-03-10T17:08:37.848397+0000 mgr.gibba043.dnkmem (mgr.34373) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:41 gibba003 bash[31385]: cluster 2021-03-10T17:08:39.849868+0000 mgr.gibba043.dnkmem (mgr.34373) 10420 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:41 gibba003 bash[32348]: cluster 2021-03-10T17:08:39.849868+0000 mgr.gibba043.dnkmem (mgr.34373) 10420 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:41 gibba043 bash[24019]: cluster 2021-03-10T17:08:39.849868+0000 mgr.gibba043.dnkmem (mgr.34373) 10420 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:42.519 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:08:42.774 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:08:42.774 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:08:42.774 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:08:42.775 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:08:42.775 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:08:42.775 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:08:42.776 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:08:42.776 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:08:42.776 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:08:42.776 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:08:42.777 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:08:42.777 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:08:42.777 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:08:42.777 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:08:42.778 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:08:42.778 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:08:42.778 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:08:42.778 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:08:42.779 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:08:42.779 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:08:42.780 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:08:43.023 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:08:43.023 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:08:43.024 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:43.024 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:08:43.024 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:08:43.024 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:43.025 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:08:43.025 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:08:43.025 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:08:43.025 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:08:43.026 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:08:43.026 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:08:43.026 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:08:43.026 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:08:43.027 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:08:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:43 gibba003 bash[31385]: cluster 2021-03-10T17:08:41.851744+0000 mgr.gibba043.dnkmem (mgr.34373) 10421 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:43 gibba003 bash[31385]: audit 2021-03-10T17:08:42.510567+0000 mgr.gibba043.dnkmem (mgr.34373) 10422 : audit [DBG] from='client.61024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:43.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:43 gibba003 bash[31385]: audit 2021-03-10T17:08:43.024591+0000 mon.c (mon.1) 2681 : audit [DBG] from='client.? 172.21.2.103:0/3788481653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:43 gibba003 bash[32348]: cluster 2021-03-10T17:08:41.851744+0000 mgr.gibba043.dnkmem (mgr.34373) 10421 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:43 gibba003 bash[32348]: audit 2021-03-10T17:08:42.510567+0000 mgr.gibba043.dnkmem (mgr.34373) 10422 : audit [DBG] from='client.61024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:43.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:43 gibba003 bash[32348]: audit 2021-03-10T17:08:43.024591+0000 mon.c (mon.1) 2681 : audit [DBG] from='client.? 172.21.2.103:0/3788481653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:43 gibba043 bash[24019]: cluster 2021-03-10T17:08:41.851744+0000 mgr.gibba043.dnkmem (mgr.34373) 10421 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:43 gibba043 bash[24019]: audit 2021-03-10T17:08:42.510567+0000 mgr.gibba043.dnkmem (mgr.34373) 10422 : audit [DBG] from='client.61024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:43 gibba043 bash[24019]: audit 2021-03-10T17:08:43.024591+0000 mon.c (mon.1) 2681 : audit [DBG] from='client.? 172.21.2.103:0/3788481653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:44.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:44 gibba003 bash[31385]: audit 2021-03-10T17:08:42.733542+0000 mgr.gibba043.dnkmem (mgr.34373) 10423 : audit [DBG] from='client.61030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:44.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:44 gibba003 bash[32348]: audit 2021-03-10T17:08:42.733542+0000 mgr.gibba043.dnkmem (mgr.34373) 10423 : audit [DBG] from='client.61030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:45.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:44 gibba043 bash[24019]: audit 2021-03-10T17:08:42.733542+0000 mgr.gibba043.dnkmem (mgr.34373) 10423 : audit [DBG] from='client.61030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:45 gibba003 bash[31385]: cluster 2021-03-10T17:08:43.853413+0000 mgr.gibba043.dnkmem (mgr.34373) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:45 gibba003 bash[31385]: cephadm 2021-03-10T17:08:44.102856+0000 mgr.gibba043.dnkmem (mgr.34373) 10425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:45 gibba003 bash[32348]: cluster 2021-03-10T17:08:43.853413+0000 mgr.gibba043.dnkmem (mgr.34373) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:45 gibba003 bash[32348]: cephadm 2021-03-10T17:08:44.102856+0000 mgr.gibba043.dnkmem (mgr.34373) 10425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:45 gibba043 bash[24019]: cluster 2021-03-10T17:08:43.853413+0000 mgr.gibba043.dnkmem (mgr.34373) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:45 gibba043 bash[24019]: cephadm 2021-03-10T17:08:44.102856+0000 mgr.gibba043.dnkmem (mgr.34373) 10425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:08:47.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:46 gibba043 bash[24019]: cluster 2021-03-10T17:08:45.854969+0000 mgr.gibba043.dnkmem (mgr.34373) 10426 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:46 gibba003 bash[31385]: cluster 2021-03-10T17:08:45.854969+0000 mgr.gibba043.dnkmem (mgr.34373) 10426 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:47.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:46 gibba003 bash[32348]: cluster 2021-03-10T17:08:45.854969+0000 mgr.gibba043.dnkmem (mgr.34373) 10426 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:49 gibba043 bash[24019]: cluster 2021-03-10T17:08:47.856350+0000 mgr.gibba043.dnkmem (mgr.34373) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:49 gibba003 bash[31385]: cluster 2021-03-10T17:08:47.856350+0000 mgr.gibba043.dnkmem (mgr.34373) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:49 gibba003 bash[32348]: cluster 2021-03-10T17:08:47.856350+0000 mgr.gibba043.dnkmem (mgr.34373) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:51 gibba003 bash[31385]: cluster 2021-03-10T17:08:49.857852+0000 mgr.gibba043.dnkmem (mgr.34373) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:51 gibba003 bash[32348]: cluster 2021-03-10T17:08:49.857852+0000 mgr.gibba043.dnkmem (mgr.34373) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:52.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:51 gibba043 bash[24019]: cluster 2021-03-10T17:08:49.857852+0000 mgr.gibba043.dnkmem (mgr.34373) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:53.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:53 gibba003 bash[31385]: cluster 2021-03-10T17:08:51.859824+0000 mgr.gibba043.dnkmem (mgr.34373) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:53 gibba003 bash[32348]: cluster 2021-03-10T17:08:51.859824+0000 mgr.gibba043.dnkmem (mgr.34373) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:53 gibba043 bash[24019]: cluster 2021-03-10T17:08:51.859824+0000 mgr.gibba043.dnkmem (mgr.34373) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:55 gibba003 bash[31385]: cluster 2021-03-10T17:08:53.861181+0000 mgr.gibba043.dnkmem (mgr.34373) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:55 gibba003 bash[32348]: cluster 2021-03-10T17:08:53.861181+0000 mgr.gibba043.dnkmem (mgr.34373) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:55 gibba043 bash[24019]: cluster 2021-03-10T17:08:53.861181+0000 mgr.gibba043.dnkmem (mgr.34373) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:57.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:57 gibba003 bash[31385]: cluster 2021-03-10T17:08:55.862730+0000 mgr.gibba043.dnkmem (mgr.34373) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:57.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:57 gibba003 bash[32348]: cluster 2021-03-10T17:08:55.862730+0000 mgr.gibba043.dnkmem (mgr.34373) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:58.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:57 gibba043 bash[24019]: cluster 2021-03-10T17:08:55.862730+0000 mgr.gibba043.dnkmem (mgr.34373) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:08:59 gibba003 bash[31385]: cluster 2021-03-10T17:08:57.864195+0000 mgr.gibba043.dnkmem (mgr.34373) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:08:59 gibba003 bash[32348]: cluster 2021-03-10T17:08:57.864195+0000 mgr.gibba043.dnkmem (mgr.34373) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:08:59 gibba043 bash[24019]: cluster 2021-03-10T17:08:57.864195+0000 mgr.gibba043.dnkmem (mgr.34373) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:00.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:00 gibba003 bash[31385]: cephadm 2021-03-10T17:08:59.118938+0000 mgr.gibba043.dnkmem (mgr.34373) 10433 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:00.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:00 gibba003 bash[32348]: cephadm 2021-03-10T17:08:59.118938+0000 mgr.gibba043.dnkmem (mgr.34373) 10433 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:00 gibba043 bash[24019]: cephadm 2021-03-10T17:08:59.118938+0000 mgr.gibba043.dnkmem (mgr.34373) 10433 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:01 gibba003 bash[31385]: cluster 2021-03-10T17:08:59.865705+0000 mgr.gibba043.dnkmem (mgr.34373) 10434 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:01 gibba003 bash[32348]: cluster 2021-03-10T17:08:59.865705+0000 mgr.gibba043.dnkmem (mgr.34373) 10434 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:02.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:01 gibba043 bash[24019]: cluster 2021-03-10T17:08:59.865705+0000 mgr.gibba043.dnkmem (mgr.34373) 10434 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:03 gibba003 bash[31385]: cluster 2021-03-10T17:09:01.867517+0000 mgr.gibba043.dnkmem (mgr.34373) 10435 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:03 gibba003 bash[32348]: cluster 2021-03-10T17:09:01.867517+0000 mgr.gibba043.dnkmem (mgr.34373) 10435 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:03 gibba043 bash[24019]: cluster 2021-03-10T17:09:01.867517+0000 mgr.gibba043.dnkmem (mgr.34373) 10435 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:05 gibba003 bash[31385]: cluster 2021-03-10T17:09:03.869193+0000 mgr.gibba043.dnkmem (mgr.34373) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:05 gibba003 bash[32348]: cluster 2021-03-10T17:09:03.869193+0000 mgr.gibba043.dnkmem (mgr.34373) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:06.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:05 gibba043 bash[24019]: cluster 2021-03-10T17:09:03.869193+0000 mgr.gibba043.dnkmem (mgr.34373) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:07 gibba003 bash[31385]: cluster 2021-03-10T17:09:05.870566+0000 mgr.gibba043.dnkmem (mgr.34373) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:07 gibba003 bash[32348]: cluster 2021-03-10T17:09:05.870566+0000 mgr.gibba043.dnkmem (mgr.34373) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:07 gibba043 bash[24019]: cluster 2021-03-10T17:09:05.870566+0000 mgr.gibba043.dnkmem (mgr.34373) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:09 gibba003 bash[31385]: cluster 2021-03-10T17:09:07.872291+0000 mgr.gibba043.dnkmem (mgr.34373) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:09 gibba003 bash[32348]: cluster 2021-03-10T17:09:07.872291+0000 mgr.gibba043.dnkmem (mgr.34373) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:09 gibba043 bash[24019]: cluster 2021-03-10T17:09:07.872291+0000 mgr.gibba043.dnkmem (mgr.34373) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:11 gibba003 bash[31385]: cluster 2021-03-10T17:09:09.873721+0000 mgr.gibba043.dnkmem (mgr.34373) 10439 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:11 gibba003 bash[32348]: cluster 2021-03-10T17:09:09.873721+0000 mgr.gibba043.dnkmem (mgr.34373) 10439 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:11 gibba043 bash[24019]: cluster 2021-03-10T17:09:09.873721+0000 mgr.gibba043.dnkmem (mgr.34373) 10439 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:13.265 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:09:13.494 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:09:13.495 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:09:13.495 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:09:13.495 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:09:13.496 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:09:13.496 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:09:13.496 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:09:13.496 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:09:13.497 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:09:13.497 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:09:13.497 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:09:13.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:09:13.497 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:09:13.498 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:09:13.498 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:09:13.498 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:09:13.498 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:09:13.499 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:09:13.499 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:09:13.499 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:09:13.499 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:09:13.743 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:09:13.743 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:09:13.744 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:13.744 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:09:13.744 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:09:13.744 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:13.745 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:09:13.745 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:09:13.745 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:09:13.745 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:09:13.746 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:09:13.746 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:09:13.746 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:09:13.746 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:09:13.747 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:09:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:13 gibba003 bash[31385]: cluster 2021-03-10T17:09:11.875511+0000 mgr.gibba043.dnkmem (mgr.34373) 10440 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:13 gibba003 bash[32348]: cluster 2021-03-10T17:09:11.875511+0000 mgr.gibba043.dnkmem (mgr.34373) 10440 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:13 gibba043 bash[24019]: cluster 2021-03-10T17:09:11.875511+0000 mgr.gibba043.dnkmem (mgr.34373) 10440 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:13.255878+0000 mgr.gibba043.dnkmem (mgr.34373) 10441 : audit [DBG] from='client.51051 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:13.481305+0000 mgr.gibba043.dnkmem (mgr.34373) 10442 : audit [DBG] from='client.51057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:13.744665+0000 mon.a (mon.0) 2115 : audit [DBG] from='client.? 172.21.2.103:0/845270147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:13.992725+0000 mon.c (mon.1) 2682 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:13.993867+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.230794+0000 mon.c (mon.1) 2683 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.231971+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.556415+0000 mon.c (mon.1) 2684 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:09:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.557155+0000 mon.c (mon.1) 2685 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.557625+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:09:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.557846+0000 mon.c (mon.1) 2686 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:09:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.558679+0000 mon.c (mon.1) 2687 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.558805+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.560107+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:09:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[31385]: audit 2021-03-10T17:09:14.560953+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:13.255878+0000 mgr.gibba043.dnkmem (mgr.34373) 10441 : audit [DBG] from='client.51051 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:13.481305+0000 mgr.gibba043.dnkmem (mgr.34373) 10442 : audit [DBG] from='client.51057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:13.744665+0000 mon.a (mon.0) 2115 : audit [DBG] from='client.? 172.21.2.103:0/845270147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:13.992725+0000 mon.c (mon.1) 2682 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:13.993867+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.230794+0000 mon.c (mon.1) 2683 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.231971+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.556415+0000 mon.c (mon.1) 2684 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:09:14.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.557155+0000 mon.c (mon.1) 2685 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.557625+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:09:14.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.557846+0000 mon.c (mon.1) 2686 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:09:14.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.558679+0000 mon.c (mon.1) 2687 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.558805+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:09:14.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.560107+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:09:14.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:14 gibba003 bash[32348]: audit 2021-03-10T17:09:14.560953+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:09:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:13.255878+0000 mgr.gibba043.dnkmem (mgr.34373) 10441 : audit [DBG] from='client.51051 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:13.481305+0000 mgr.gibba043.dnkmem (mgr.34373) 10442 : audit [DBG] from='client.51057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:13.744665+0000 mon.a (mon.0) 2115 : audit [DBG] from='client.? 172.21.2.103:0/845270147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:13.992725+0000 mon.c (mon.1) 2682 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:13.993867+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.230794+0000 mon.c (mon.1) 2683 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.231971+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.556415+0000 mon.c (mon.1) 2684 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:09:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.557155+0000 mon.c (mon.1) 2685 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:09:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.557625+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:09:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.557846+0000 mon.c (mon.1) 2686 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:09:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.558679+0000 mon.c (mon.1) 2687 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:09:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.558805+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:09:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.560107+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:09:15.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:14 gibba043 bash[24019]: audit 2021-03-10T17:09:14.560953+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:09:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:15 gibba003 bash[31385]: cluster 2021-03-10T17:09:13.877132+0000 mgr.gibba043.dnkmem (mgr.34373) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:15 gibba003 bash[31385]: cephadm 2021-03-10T17:09:14.134953+0000 mgr.gibba043.dnkmem (mgr.34373) 10444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:15 gibba003 bash[32348]: cluster 2021-03-10T17:09:13.877132+0000 mgr.gibba043.dnkmem (mgr.34373) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:15.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:15 gibba003 bash[32348]: cephadm 2021-03-10T17:09:14.134953+0000 mgr.gibba043.dnkmem (mgr.34373) 10444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:15 gibba043 bash[24019]: cluster 2021-03-10T17:09:13.877132+0000 mgr.gibba043.dnkmem (mgr.34373) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:15 gibba043 bash[24019]: cephadm 2021-03-10T17:09:14.134953+0000 mgr.gibba043.dnkmem (mgr.34373) 10444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:17 gibba003 bash[31385]: cluster 2021-03-10T17:09:15.878671+0000 mgr.gibba043.dnkmem (mgr.34373) 10445 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:17 gibba003 bash[32348]: cluster 2021-03-10T17:09:15.878671+0000 mgr.gibba043.dnkmem (mgr.34373) 10445 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:17 gibba043 bash[24019]: cluster 2021-03-10T17:09:15.878671+0000 mgr.gibba043.dnkmem (mgr.34373) 10445 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:19.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:19 gibba003 bash[31385]: cluster 2021-03-10T17:09:17.880251+0000 mgr.gibba043.dnkmem (mgr.34373) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:19 gibba003 bash[32348]: cluster 2021-03-10T17:09:17.880251+0000 mgr.gibba043.dnkmem (mgr.34373) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:19 gibba043 bash[24019]: cluster 2021-03-10T17:09:17.880251+0000 mgr.gibba043.dnkmem (mgr.34373) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:21.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:21 gibba003 bash[31385]: cluster 2021-03-10T17:09:19.881632+0000 mgr.gibba043.dnkmem (mgr.34373) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:21 gibba003 bash[32348]: cluster 2021-03-10T17:09:19.881632+0000 mgr.gibba043.dnkmem (mgr.34373) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:22.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:21 gibba043 bash[24019]: cluster 2021-03-10T17:09:19.881632+0000 mgr.gibba043.dnkmem (mgr.34373) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:23 gibba003 bash[31385]: cluster 2021-03-10T17:09:21.883424+0000 mgr.gibba043.dnkmem (mgr.34373) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:23 gibba003 bash[32348]: cluster 2021-03-10T17:09:21.883424+0000 mgr.gibba043.dnkmem (mgr.34373) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:23 gibba043 bash[24019]: cluster 2021-03-10T17:09:21.883424+0000 mgr.gibba043.dnkmem (mgr.34373) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:25 gibba003 bash[31385]: cluster 2021-03-10T17:09:23.885078+0000 mgr.gibba043.dnkmem (mgr.34373) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:25 gibba003 bash[32348]: cluster 2021-03-10T17:09:23.885078+0000 mgr.gibba043.dnkmem (mgr.34373) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:25 gibba043 bash[24019]: cluster 2021-03-10T17:09:23.885078+0000 mgr.gibba043.dnkmem (mgr.34373) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:27 gibba003 bash[31385]: cluster 2021-03-10T17:09:25.886790+0000 mgr.gibba043.dnkmem (mgr.34373) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:27 gibba003 bash[32348]: cluster 2021-03-10T17:09:25.886790+0000 mgr.gibba043.dnkmem (mgr.34373) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:28.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:27 gibba043 bash[24019]: cluster 2021-03-10T17:09:25.886790+0000 mgr.gibba043.dnkmem (mgr.34373) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:29.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:28 gibba043 bash[24019]: cluster 2021-03-10T17:09:27.888442+0000 mgr.gibba043.dnkmem (mgr.34373) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:29.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:28 gibba003 bash[31385]: cluster 2021-03-10T17:09:27.888442+0000 mgr.gibba043.dnkmem (mgr.34373) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:29.189 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:28 gibba003 bash[32348]: cluster 2021-03-10T17:09:27.888442+0000 mgr.gibba043.dnkmem (mgr.34373) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:29 gibba043 bash[24019]: cephadm 2021-03-10T17:09:29.140479+0000 mgr.gibba043.dnkmem (mgr.34373) 10452 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:09:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:29 gibba043 bash[24019]: audit 2021-03-10T17:09:29.142965+0000 mon.c (mon.1) 2688 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:09:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:29 gibba003 bash[31385]: cephadm 2021-03-10T17:09:29.140479+0000 mgr.gibba043.dnkmem (mgr.34373) 10452 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:09:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:29 gibba003 bash[31385]: audit 2021-03-10T17:09:29.142965+0000 mon.c (mon.1) 2688 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:09:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:29 gibba003 bash[32348]: cephadm 2021-03-10T17:09:29.140479+0000 mgr.gibba043.dnkmem (mgr.34373) 10452 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:09:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:29 gibba003 bash[32348]: audit 2021-03-10T17:09:29.142965+0000 mon.c (mon.1) 2688 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:09:31.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:30 gibba043 bash[24019]: cluster 2021-03-10T17:09:29.889865+0000 mgr.gibba043.dnkmem (mgr.34373) 10453 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:30 gibba003 bash[31385]: cluster 2021-03-10T17:09:29.889865+0000 mgr.gibba043.dnkmem (mgr.34373) 10453 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:31.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:30 gibba003 bash[32348]: cluster 2021-03-10T17:09:29.889865+0000 mgr.gibba043.dnkmem (mgr.34373) 10453 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: cluster 2021-03-10T17:09:31.891350+0000 mgr.gibba043.dnkmem (mgr.34373) 10454 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.689481+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:09:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.887533+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:09:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.896462+0000 mon.c (mon.1) 2689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.898404+0000 mon.c (mon.1) 2690 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.900071+0000 mon.c (mon.1) 2691 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.901235+0000 mon.c (mon.1) 2692 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.903295+0000 mon.c (mon.1) 2693 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[31385]: audit 2021-03-10T17:09:32.904702+0000 mon.c (mon.1) 2694 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: cluster 2021-03-10T17:09:31.891350+0000 mgr.gibba043.dnkmem (mgr.34373) 10454 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.689481+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:09:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.887533+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:09:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.896462+0000 mon.c (mon.1) 2689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.898404+0000 mon.c (mon.1) 2690 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.900071+0000 mon.c (mon.1) 2691 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.901235+0000 mon.c (mon.1) 2692 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.903295+0000 mon.c (mon.1) 2693 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:33.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:33 gibba003 bash[32348]: audit 2021-03-10T17:09:32.904702+0000 mon.c (mon.1) 2694 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: cluster 2021-03-10T17:09:31.891350+0000 mgr.gibba043.dnkmem (mgr.34373) 10454 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.689481+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:09:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.887533+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:09:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.896462+0000 mon.c (mon.1) 2689 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.898404+0000 mon.c (mon.1) 2690 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.900071+0000 mon.c (mon.1) 2691 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.901235+0000 mon.c (mon.1) 2692 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.903295+0000 mon.c (mon.1) 2693 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:33 gibba043 bash[24019]: audit 2021-03-10T17:09:32.904702+0000 mon.c (mon.1) 2694 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:34.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.688741+0000 mgr.gibba043.dnkmem (mgr.34373) 10455 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:09:34.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.893609+0000 mgr.gibba043.dnkmem (mgr.34373) 10456 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.896006+0000 mgr.gibba043.dnkmem (mgr.34373) 10457 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.897774+0000 mgr.gibba043.dnkmem (mgr.34373) 10458 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.897815+0000 mgr.gibba043.dnkmem (mgr.34373) 10459 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.899146+0000 mgr.gibba043.dnkmem (mgr.34373) 10460 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.899205+0000 mgr.gibba043.dnkmem (mgr.34373) 10461 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.899909+0000 mgr.gibba043.dnkmem (mgr.34373) 10462 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.900878+0000 mgr.gibba043.dnkmem (mgr.34373) 10463 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.900962+0000 mgr.gibba043.dnkmem (mgr.34373) 10464 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.902145+0000 mgr.gibba043.dnkmem (mgr.34373) 10465 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.902621+0000 mgr.gibba043.dnkmem (mgr.34373) 10466 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.903404+0000 mgr.gibba043.dnkmem (mgr.34373) 10467 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.903470+0000 mgr.gibba043.dnkmem (mgr.34373) 10468 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:34.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[31385]: cephadm 2021-03-10T17:09:32.903610+0000 mgr.gibba043.dnkmem (mgr.34373) 10469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:34.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.688741+0000 mgr.gibba043.dnkmem (mgr.34373) 10455 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:09:34.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.893609+0000 mgr.gibba043.dnkmem (mgr.34373) 10456 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:34.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.896006+0000 mgr.gibba043.dnkmem (mgr.34373) 10457 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:34.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.897774+0000 mgr.gibba043.dnkmem (mgr.34373) 10458 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:34.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.897815+0000 mgr.gibba043.dnkmem (mgr.34373) 10459 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:34.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.899146+0000 mgr.gibba043.dnkmem (mgr.34373) 10460 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:34.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.899205+0000 mgr.gibba043.dnkmem (mgr.34373) 10461 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:34.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.899909+0000 mgr.gibba043.dnkmem (mgr.34373) 10462 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:34.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.900878+0000 mgr.gibba043.dnkmem (mgr.34373) 10463 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:34.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.900962+0000 mgr.gibba043.dnkmem (mgr.34373) 10464 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:34.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.902145+0000 mgr.gibba043.dnkmem (mgr.34373) 10465 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:34.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.902621+0000 mgr.gibba043.dnkmem (mgr.34373) 10466 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:34.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.903404+0000 mgr.gibba043.dnkmem (mgr.34373) 10467 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:34.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.903470+0000 mgr.gibba043.dnkmem (mgr.34373) 10468 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:34.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:34 gibba003 bash[32348]: cephadm 2021-03-10T17:09:32.903610+0000 mgr.gibba043.dnkmem (mgr.34373) 10469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:35.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.688741+0000 mgr.gibba043.dnkmem (mgr.34373) 10455 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:09:35.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.893609+0000 mgr.gibba043.dnkmem (mgr.34373) 10456 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.896006+0000 mgr.gibba043.dnkmem (mgr.34373) 10457 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.897774+0000 mgr.gibba043.dnkmem (mgr.34373) 10458 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.897815+0000 mgr.gibba043.dnkmem (mgr.34373) 10459 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.899146+0000 mgr.gibba043.dnkmem (mgr.34373) 10460 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.899205+0000 mgr.gibba043.dnkmem (mgr.34373) 10461 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.899909+0000 mgr.gibba043.dnkmem (mgr.34373) 10462 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.900878+0000 mgr.gibba043.dnkmem (mgr.34373) 10463 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.900962+0000 mgr.gibba043.dnkmem (mgr.34373) 10464 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.902145+0000 mgr.gibba043.dnkmem (mgr.34373) 10465 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:35.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.902621+0000 mgr.gibba043.dnkmem (mgr.34373) 10466 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:35.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.903404+0000 mgr.gibba043.dnkmem (mgr.34373) 10467 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:35.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.903470+0000 mgr.gibba043.dnkmem (mgr.34373) 10468 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:35.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:34 gibba043 bash[24019]: cephadm 2021-03-10T17:09:32.903610+0000 mgr.gibba043.dnkmem (mgr.34373) 10469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:35.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:35 gibba003 bash[31385]: cluster 2021-03-10T17:09:33.892747+0000 mgr.gibba043.dnkmem (mgr.34373) 10470 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:35 gibba003 bash[32348]: cluster 2021-03-10T17:09:33.892747+0000 mgr.gibba043.dnkmem (mgr.34373) 10470 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:35 gibba043 bash[24019]: cluster 2021-03-10T17:09:33.892747+0000 mgr.gibba043.dnkmem (mgr.34373) 10470 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:37.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:37 gibba003 bash[31385]: cluster 2021-03-10T17:09:35.894351+0000 mgr.gibba043.dnkmem (mgr.34373) 10471 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:37 gibba003 bash[32348]: cluster 2021-03-10T17:09:35.894351+0000 mgr.gibba043.dnkmem (mgr.34373) 10471 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:37 gibba043 bash[24019]: cluster 2021-03-10T17:09:35.894351+0000 mgr.gibba043.dnkmem (mgr.34373) 10471 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:39 gibba003 bash[31385]: cluster 2021-03-10T17:09:37.895953+0000 mgr.gibba043.dnkmem (mgr.34373) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:39 gibba003 bash[32348]: cluster 2021-03-10T17:09:37.895953+0000 mgr.gibba043.dnkmem (mgr.34373) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:39 gibba043 bash[24019]: cluster 2021-03-10T17:09:37.895953+0000 mgr.gibba043.dnkmem (mgr.34373) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:41 gibba003 bash[31385]: cluster 2021-03-10T17:09:39.897427+0000 mgr.gibba043.dnkmem (mgr.34373) 10473 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:41 gibba003 bash[32348]: cluster 2021-03-10T17:09:39.897427+0000 mgr.gibba043.dnkmem (mgr.34373) 10473 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:42.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:41 gibba043 bash[24019]: cluster 2021-03-10T17:09:39.897427+0000 mgr.gibba043.dnkmem (mgr.34373) 10473 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:43 gibba003 bash[31385]: cluster 2021-03-10T17:09:41.899069+0000 mgr.gibba043.dnkmem (mgr.34373) 10474 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:43 gibba003 bash[32348]: cluster 2021-03-10T17:09:41.899069+0000 mgr.gibba043.dnkmem (mgr.34373) 10474 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.991 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:09:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:43 gibba043 bash[24019]: cluster 2021-03-10T17:09:41.899069+0000 mgr.gibba043.dnkmem (mgr.34373) 10474 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:44.216 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:09:44.217 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 11s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:09:44.217 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:09:44.217 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:09:44.218 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:09:44.218 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:09:44.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:09:44.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:09:44.218 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:09:44.219 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 11s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:09:44.219 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:09:44.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:09:44.219 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:09:44.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:09:44.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:09:44.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:09:44.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:09:44.220 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:09:44.221 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:09:44.221 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:09:44.221 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 11s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:09:44.462 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:09:44.462 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:09:44.462 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:44.463 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:09:44.463 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:09:44.463 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:44.463 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:09:44.464 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:09:44.464 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:09:44.464 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:09:44.464 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:09:44.464 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:09:44.465 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:09:44.465 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:09:44.465 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:09:44.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:44 gibba003 bash[31385]: audit 2021-03-10T17:09:44.463332+0000 mon.c (mon.1) 2695 : audit [DBG] from='client.? 172.21.2.103:0/1003256094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:44.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:44 gibba003 bash[32348]: audit 2021-03-10T17:09:44.463332+0000 mon.c (mon.1) 2695 : audit [DBG] from='client.? 172.21.2.103:0/1003256094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:45.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:44 gibba043 bash[24019]: audit 2021-03-10T17:09:44.463332+0000 mon.c (mon.1) 2695 : audit [DBG] from='client.? 172.21.2.103:0/1003256094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:45 gibba003 bash[31385]: cluster 2021-03-10T17:09:43.900743+0000 mgr.gibba043.dnkmem (mgr.34373) 10475 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:45 gibba003 bash[31385]: audit 2021-03-10T17:09:43.981689+0000 mgr.gibba043.dnkmem (mgr.34373) 10476 : audit [DBG] from='client.51069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:45 gibba003 bash[31385]: audit 2021-03-10T17:09:44.204146+0000 mgr.gibba043.dnkmem (mgr.34373) 10477 : audit [DBG] from='client.61066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:45 gibba003 bash[32348]: cluster 2021-03-10T17:09:43.900743+0000 mgr.gibba043.dnkmem (mgr.34373) 10475 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:45 gibba003 bash[32348]: audit 2021-03-10T17:09:43.981689+0000 mgr.gibba043.dnkmem (mgr.34373) 10476 : audit [DBG] from='client.51069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:45 gibba003 bash[32348]: audit 2021-03-10T17:09:44.204146+0000 mgr.gibba043.dnkmem (mgr.34373) 10477 : audit [DBG] from='client.61066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:45 gibba043 bash[24019]: cluster 2021-03-10T17:09:43.900743+0000 mgr.gibba043.dnkmem (mgr.34373) 10475 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:45 gibba043 bash[24019]: audit 2021-03-10T17:09:43.981689+0000 mgr.gibba043.dnkmem (mgr.34373) 10476 : audit [DBG] from='client.51069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:45 gibba043 bash[24019]: audit 2021-03-10T17:09:44.204146+0000 mgr.gibba043.dnkmem (mgr.34373) 10477 : audit [DBG] from='client.61066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:47.920 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:47 gibba043 bash[24019]: cluster 2021-03-10T17:09:45.902200+0000 mgr.gibba043.dnkmem (mgr.34373) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:47 gibba003 bash[31385]: cluster 2021-03-10T17:09:45.902200+0000 mgr.gibba043.dnkmem (mgr.34373) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:47 gibba003 bash[32348]: cluster 2021-03-10T17:09:45.902200+0000 mgr.gibba043.dnkmem (mgr.34373) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:49 gibba003 bash[31385]: cluster 2021-03-10T17:09:47.903911+0000 mgr.gibba043.dnkmem (mgr.34373) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:49 gibba003 bash[31385]: cephadm 2021-03-10T17:09:47.919649+0000 mgr.gibba043.dnkmem (mgr.34373) 10480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:49 gibba003 bash[32348]: cluster 2021-03-10T17:09:47.903911+0000 mgr.gibba043.dnkmem (mgr.34373) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:49 gibba003 bash[32348]: cephadm 2021-03-10T17:09:47.919649+0000 mgr.gibba043.dnkmem (mgr.34373) 10480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:49 gibba043 bash[24019]: cluster 2021-03-10T17:09:47.903911+0000 mgr.gibba043.dnkmem (mgr.34373) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:49 gibba043 bash[24019]: cephadm 2021-03-10T17:09:47.919649+0000 mgr.gibba043.dnkmem (mgr.34373) 10480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:09:51.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:51 gibba003 bash[31385]: cluster 2021-03-10T17:09:49.905262+0000 mgr.gibba043.dnkmem (mgr.34373) 10481 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:51.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:51 gibba003 bash[32348]: cluster 2021-03-10T17:09:49.905262+0000 mgr.gibba043.dnkmem (mgr.34373) 10481 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:51 gibba043 bash[24019]: cluster 2021-03-10T17:09:49.905262+0000 mgr.gibba043.dnkmem (mgr.34373) 10481 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:53 gibba003 bash[31385]: cluster 2021-03-10T17:09:51.906960+0000 mgr.gibba043.dnkmem (mgr.34373) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:53.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:53 gibba003 bash[32348]: cluster 2021-03-10T17:09:51.906960+0000 mgr.gibba043.dnkmem (mgr.34373) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:53 gibba043 bash[24019]: cluster 2021-03-10T17:09:51.906960+0000 mgr.gibba043.dnkmem (mgr.34373) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:55 gibba003 bash[31385]: cluster 2021-03-10T17:09:53.908703+0000 mgr.gibba043.dnkmem (mgr.34373) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:55.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:55 gibba003 bash[32348]: cluster 2021-03-10T17:09:53.908703+0000 mgr.gibba043.dnkmem (mgr.34373) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:55 gibba043 bash[24019]: cluster 2021-03-10T17:09:53.908703+0000 mgr.gibba043.dnkmem (mgr.34373) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:57 gibba003 bash[31385]: cluster 2021-03-10T17:09:55.910229+0000 mgr.gibba043.dnkmem (mgr.34373) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:57.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:57 gibba003 bash[32348]: cluster 2021-03-10T17:09:55.910229+0000 mgr.gibba043.dnkmem (mgr.34373) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:57 gibba043 bash[24019]: cluster 2021-03-10T17:09:55.910229+0000 mgr.gibba043.dnkmem (mgr.34373) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:59.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:09:59 gibba003 bash[31385]: cluster 2021-03-10T17:09:57.911705+0000 mgr.gibba043.dnkmem (mgr.34373) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:09:59 gibba003 bash[32348]: cluster 2021-03-10T17:09:57.911705+0000 mgr.gibba043.dnkmem (mgr.34373) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:09:59 gibba043 bash[24019]: cluster 2021-03-10T17:09:57.911705+0000 mgr.gibba043.dnkmem (mgr.34373) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:00 gibba003 bash[31385]: debug 2021-03-10T17:09:59.996+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:00.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:00 gibba003 bash[31385]: cluster 2021-03-10T17:10:00.000394+0000 mon.a (mon.0) 2124 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:00.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:00 gibba003 bash[32348]: cluster 2021-03-10T17:10:00.000394+0000 mon.a (mon.0) 2124 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:01.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:00 gibba043 bash[24019]: cluster 2021-03-10T17:10:00.000394+0000 mon.a (mon.0) 2124 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:01 gibba003 bash[31385]: cluster 2021-03-10T17:09:59.913152+0000 mgr.gibba043.dnkmem (mgr.34373) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:01 gibba003 bash[32348]: cluster 2021-03-10T17:09:59.913152+0000 mgr.gibba043.dnkmem (mgr.34373) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:01 gibba043 bash[24019]: cluster 2021-03-10T17:09:59.913152+0000 mgr.gibba043.dnkmem (mgr.34373) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:03 gibba003 bash[31385]: cluster 2021-03-10T17:10:01.914810+0000 mgr.gibba043.dnkmem (mgr.34373) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:03 gibba003 bash[32348]: cluster 2021-03-10T17:10:01.914810+0000 mgr.gibba043.dnkmem (mgr.34373) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:03 gibba043 bash[24019]: cluster 2021-03-10T17:10:01.914810+0000 mgr.gibba043.dnkmem (mgr.34373) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:04.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:04 gibba003 bash[31385]: cephadm 2021-03-10T17:10:02.935817+0000 mgr.gibba043.dnkmem (mgr.34373) 10488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:04.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:04 gibba003 bash[32348]: cephadm 2021-03-10T17:10:02.935817+0000 mgr.gibba043.dnkmem (mgr.34373) 10488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:05.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:04 gibba043 bash[24019]: cephadm 2021-03-10T17:10:02.935817+0000 mgr.gibba043.dnkmem (mgr.34373) 10488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:05 gibba043 bash[24019]: cluster 2021-03-10T17:10:03.916194+0000 mgr.gibba043.dnkmem (mgr.34373) 10489 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:05 gibba003 bash[31385]: cluster 2021-03-10T17:10:03.916194+0000 mgr.gibba043.dnkmem (mgr.34373) 10489 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:05 gibba003 bash[32348]: cluster 2021-03-10T17:10:03.916194+0000 mgr.gibba043.dnkmem (mgr.34373) 10489 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:06 gibba043 bash[24019]: cluster 2021-03-10T17:10:05.917950+0000 mgr.gibba043.dnkmem (mgr.34373) 10490 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:06 gibba003 bash[31385]: cluster 2021-03-10T17:10:05.917950+0000 mgr.gibba043.dnkmem (mgr.34373) 10490 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:06 gibba003 bash[32348]: cluster 2021-03-10T17:10:05.917950+0000 mgr.gibba043.dnkmem (mgr.34373) 10490 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:09 gibba003 bash[31385]: cluster 2021-03-10T17:10:07.919499+0000 mgr.gibba043.dnkmem (mgr.34373) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:09 gibba003 bash[32348]: cluster 2021-03-10T17:10:07.919499+0000 mgr.gibba043.dnkmem (mgr.34373) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:09 gibba043 bash[24019]: cluster 2021-03-10T17:10:07.919499+0000 mgr.gibba043.dnkmem (mgr.34373) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:11 gibba003 bash[31385]: cluster 2021-03-10T17:10:09.920943+0000 mgr.gibba043.dnkmem (mgr.34373) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:11 gibba003 bash[32348]: cluster 2021-03-10T17:10:09.920943+0000 mgr.gibba043.dnkmem (mgr.34373) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:11 gibba043 bash[24019]: cluster 2021-03-10T17:10:09.920943+0000 mgr.gibba043.dnkmem (mgr.34373) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:13 gibba003 bash[31385]: cluster 2021-03-10T17:10:11.922764+0000 mgr.gibba043.dnkmem (mgr.34373) 10493 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:13 gibba003 bash[32348]: cluster 2021-03-10T17:10:11.922764+0000 mgr.gibba043.dnkmem (mgr.34373) 10493 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:13 gibba043 bash[24019]: cluster 2021-03-10T17:10:11.922764+0000 mgr.gibba043.dnkmem (mgr.34373) 10493 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.705 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:10:14.932 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:10:14.932 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 42s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:10:14.932 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:10:14.933 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:10:14.933 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:10:14.933 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:10:14.933 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:10:14.934 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:10:14.934 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:10:14.934 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 42s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:10:14.934 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:10:14.934 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:10:14.935 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:10:14.935 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:10:14.935 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:10:14.935 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:10:14.936 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:10:14.936 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:10:14.936 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:10:14.936 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:10:14.937 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 42s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:10:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:13.999578+0000 mon.c (mon.1) 2696 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:14.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.000836+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.238375+0000 mon.c (mon.1) 2697 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.239655+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.564756+0000 mon.c (mon.1) 2698 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.564962+0000 mon.c (mon.1) 2699 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.565052+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.565184+0000 mon.c (mon.1) 2700 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.565366+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.565566+0000 mon.c (mon.1) 2701 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:10:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.565644+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[31385]: audit 2021-03-10T17:10:14.565824+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:10:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:13.999578+0000 mon.c (mon.1) 2696 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.000836+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.238375+0000 mon.c (mon.1) 2697 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.239655+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.564756+0000 mon.c (mon.1) 2698 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.564962+0000 mon.c (mon.1) 2699 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.565052+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.565184+0000 mon.c (mon.1) 2700 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.565366+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.565566+0000 mon.c (mon.1) 2701 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:10:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.565644+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:10:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:14 gibba003 bash[32348]: audit 2021-03-10T17:10:14.565824+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:10:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:13.999578+0000 mon.c (mon.1) 2696 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.000836+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.238375+0000 mon.c (mon.1) 2697 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.239655+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.564756+0000 mon.c (mon.1) 2698 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.564962+0000 mon.c (mon.1) 2699 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.565052+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.565184+0000 mon.c (mon.1) 2700 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:10:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.565366+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.565566+0000 mon.c (mon.1) 2701 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:10:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.565644+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:10:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:14 gibba043 bash[24019]: audit 2021-03-10T17:10:14.565824+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:10:15.181 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:10:15.181 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:10:15.181 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:15.182 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:10:15.182 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:10:15.182 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:15.182 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:10:15.183 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:10:15.183 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:10:15.183 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:10:15.183 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:10:15.183 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:10:15.184 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:10:15.184 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:10:15.184 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:10:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:15 gibba003 bash[31385]: cluster 2021-03-10T17:10:13.924422+0000 mgr.gibba043.dnkmem (mgr.34373) 10494 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:15 gibba003 bash[31385]: audit 2021-03-10T17:10:14.695995+0000 mgr.gibba043.dnkmem (mgr.34373) 10495 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:15 gibba003 bash[31385]: audit 2021-03-10T17:10:15.182331+0000 mon.c (mon.1) 2702 : audit [DBG] from='client.? 172.21.2.103:0/2521206970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:15.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:15 gibba003 bash[32348]: cluster 2021-03-10T17:10:13.924422+0000 mgr.gibba043.dnkmem (mgr.34373) 10494 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:15.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:15 gibba003 bash[32348]: audit 2021-03-10T17:10:14.695995+0000 mgr.gibba043.dnkmem (mgr.34373) 10495 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:15.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:15 gibba003 bash[32348]: audit 2021-03-10T17:10:15.182331+0000 mon.c (mon.1) 2702 : audit [DBG] from='client.? 172.21.2.103:0/2521206970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:15 gibba043 bash[24019]: cluster 2021-03-10T17:10:13.924422+0000 mgr.gibba043.dnkmem (mgr.34373) 10494 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:15 gibba043 bash[24019]: audit 2021-03-10T17:10:14.695995+0000 mgr.gibba043.dnkmem (mgr.34373) 10495 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:15 gibba043 bash[24019]: audit 2021-03-10T17:10:15.182331+0000 mon.c (mon.1) 2702 : audit [DBG] from='client.? 172.21.2.103:0/2521206970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:16.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:16 gibba003 bash[31385]: audit 2021-03-10T17:10:14.918752+0000 mgr.gibba043.dnkmem (mgr.34373) 10496 : audit [DBG] from='client.61084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:16.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:16 gibba003 bash[32348]: audit 2021-03-10T17:10:14.918752+0000 mgr.gibba043.dnkmem (mgr.34373) 10496 : audit [DBG] from='client.61084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:17.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:16 gibba043 bash[24019]: audit 2021-03-10T17:10:14.918752+0000 mgr.gibba043.dnkmem (mgr.34373) 10496 : audit [DBG] from='client.61084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:17.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:17 gibba003 bash[31385]: cluster 2021-03-10T17:10:15.925928+0000 mgr.gibba043.dnkmem (mgr.34373) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:17 gibba003 bash[32348]: cluster 2021-03-10T17:10:15.925928+0000 mgr.gibba043.dnkmem (mgr.34373) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:17.953 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:17 gibba043 bash[24019]: cluster 2021-03-10T17:10:15.925928+0000 mgr.gibba043.dnkmem (mgr.34373) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:19 gibba003 bash[31385]: cluster 2021-03-10T17:10:17.927437+0000 mgr.gibba043.dnkmem (mgr.34373) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:19.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:19 gibba003 bash[31385]: cephadm 2021-03-10T17:10:17.951865+0000 mgr.gibba043.dnkmem (mgr.34373) 10499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:19.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:19 gibba003 bash[32348]: cluster 2021-03-10T17:10:17.927437+0000 mgr.gibba043.dnkmem (mgr.34373) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:19.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:19 gibba003 bash[32348]: cephadm 2021-03-10T17:10:17.951865+0000 mgr.gibba043.dnkmem (mgr.34373) 10499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:19 gibba043 bash[24019]: cluster 2021-03-10T17:10:17.927437+0000 mgr.gibba043.dnkmem (mgr.34373) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:19 gibba043 bash[24019]: cephadm 2021-03-10T17:10:17.951865+0000 mgr.gibba043.dnkmem (mgr.34373) 10499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:21 gibba003 bash[31385]: cluster 2021-03-10T17:10:19.929101+0000 mgr.gibba043.dnkmem (mgr.34373) 10500 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:21 gibba003 bash[32348]: cluster 2021-03-10T17:10:19.929101+0000 mgr.gibba043.dnkmem (mgr.34373) 10500 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:21 gibba043 bash[24019]: cluster 2021-03-10T17:10:19.929101+0000 mgr.gibba043.dnkmem (mgr.34373) 10500 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:23 gibba003 bash[31385]: cluster 2021-03-10T17:10:21.930856+0000 mgr.gibba043.dnkmem (mgr.34373) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:23 gibba003 bash[32348]: cluster 2021-03-10T17:10:21.930856+0000 mgr.gibba043.dnkmem (mgr.34373) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:23 gibba043 bash[24019]: cluster 2021-03-10T17:10:21.930856+0000 mgr.gibba043.dnkmem (mgr.34373) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:25.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:25 gibba003 bash[31385]: cluster 2021-03-10T17:10:23.932553+0000 mgr.gibba043.dnkmem (mgr.34373) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:25.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:25 gibba003 bash[32348]: cluster 2021-03-10T17:10:23.932553+0000 mgr.gibba043.dnkmem (mgr.34373) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:25 gibba043 bash[24019]: cluster 2021-03-10T17:10:23.932553+0000 mgr.gibba043.dnkmem (mgr.34373) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:27.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:27 gibba003 bash[31385]: cluster 2021-03-10T17:10:25.934229+0000 mgr.gibba043.dnkmem (mgr.34373) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:27 gibba003 bash[32348]: cluster 2021-03-10T17:10:25.934229+0000 mgr.gibba043.dnkmem (mgr.34373) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:27 gibba043 bash[24019]: cluster 2021-03-10T17:10:25.934229+0000 mgr.gibba043.dnkmem (mgr.34373) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:29.939 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:29 gibba003 bash[32348]: cluster 2021-03-10T17:10:27.935947+0000 mgr.gibba043.dnkmem (mgr.34373) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:29 gibba003 bash[31385]: cluster 2021-03-10T17:10:27.935947+0000 mgr.gibba043.dnkmem (mgr.34373) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:29 gibba043 bash[24019]: cluster 2021-03-10T17:10:27.935947+0000 mgr.gibba043.dnkmem (mgr.34373) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:31.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:31 gibba003 bash[31385]: cluster 2021-03-10T17:10:29.937582+0000 mgr.gibba043.dnkmem (mgr.34373) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:31 gibba003 bash[32348]: cluster 2021-03-10T17:10:29.937582+0000 mgr.gibba043.dnkmem (mgr.34373) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:31 gibba043 bash[24019]: cluster 2021-03-10T17:10:29.937582+0000 mgr.gibba043.dnkmem (mgr.34373) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:33 gibba003 bash[31385]: cluster 2021-03-10T17:10:31.939513+0000 mgr.gibba043.dnkmem (mgr.34373) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:33 gibba003 bash[31385]: audit 2021-03-10T17:10:32.972639+0000 mon.c (mon.1) 2703 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:10:33.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:33 gibba003 bash[32348]: cluster 2021-03-10T17:10:31.939513+0000 mgr.gibba043.dnkmem (mgr.34373) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:33.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:33 gibba003 bash[32348]: audit 2021-03-10T17:10:32.972639+0000 mon.c (mon.1) 2703 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:10:34.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:33 gibba043 bash[24019]: cluster 2021-03-10T17:10:31.939513+0000 mgr.gibba043.dnkmem (mgr.34373) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:33 gibba043 bash[24019]: audit 2021-03-10T17:10:32.972639+0000 mon.c (mon.1) 2703 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:10:34.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:34 gibba003 bash[31385]: cephadm 2021-03-10T17:10:32.968705+0000 mgr.gibba043.dnkmem (mgr.34373) 10507 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:10:34.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:34 gibba003 bash[32348]: cephadm 2021-03-10T17:10:32.968705+0000 mgr.gibba043.dnkmem (mgr.34373) 10507 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:10:35.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:34 gibba043 bash[24019]: cephadm 2021-03-10T17:10:32.968705+0000 mgr.gibba043.dnkmem (mgr.34373) 10507 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:10:36.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:35 gibba043 bash[24019]: cluster 2021-03-10T17:10:33.941278+0000 mgr.gibba043.dnkmem (mgr.34373) 10508 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:35 gibba003 bash[31385]: cluster 2021-03-10T17:10:33.941278+0000 mgr.gibba043.dnkmem (mgr.34373) 10508 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:35 gibba003 bash[32348]: cluster 2021-03-10T17:10:33.941278+0000 mgr.gibba043.dnkmem (mgr.34373) 10508 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:37.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: cluster 2021-03-10T17:10:35.941781+0000 mgr.gibba043.dnkmem (mgr.34373) 10509 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:37.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.622396+0000 mgr.gibba043.dnkmem (mgr.34373) 10510 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:10:37.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.623075+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:10:37.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.826967+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:10:37.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.831251+0000 mon.c (mon.1) 2704 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:37.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.832548+0000 mon.c (mon.1) 2705 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.835739+0000 mon.c (mon.1) 2706 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.838656+0000 mon.c (mon.1) 2707 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.846262+0000 mon.c (mon.1) 2708 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.953 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[31385]: audit 2021-03-10T17:10:36.851084+0000 mon.c (mon.1) 2709 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: cluster 2021-03-10T17:10:35.941781+0000 mgr.gibba043.dnkmem (mgr.34373) 10509 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:37.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.622396+0000 mgr.gibba043.dnkmem (mgr.34373) 10510 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:10:37.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.623075+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:10:37.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.826967+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:10:37.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.831251+0000 mon.c (mon.1) 2704 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:37.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.832548+0000 mon.c (mon.1) 2705 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.835739+0000 mon.c (mon.1) 2706 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.838656+0000 mon.c (mon.1) 2707 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.846262+0000 mon.c (mon.1) 2708 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:37.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:37 gibba003 bash[32348]: audit 2021-03-10T17:10:36.851084+0000 mon.c (mon.1) 2709 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: cluster 2021-03-10T17:10:35.941781+0000 mgr.gibba043.dnkmem (mgr.34373) 10509 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.622396+0000 mgr.gibba043.dnkmem (mgr.34373) 10510 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:10:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.623075+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:10:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.826967+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:10:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.831251+0000 mon.c (mon.1) 2704 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.832548+0000 mon.c (mon.1) 2705 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.835739+0000 mon.c (mon.1) 2706 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.838656+0000 mon.c (mon.1) 2707 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.846262+0000 mon.c (mon.1) 2708 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:37 gibba043 bash[24019]: audit 2021-03-10T17:10:36.851084+0000 mon.c (mon.1) 2709 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.828693+0000 mgr.gibba043.dnkmem (mgr.34373) 10511 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.830377+0000 mgr.gibba043.dnkmem (mgr.34373) 10512 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.832555+0000 mgr.gibba043.dnkmem (mgr.34373) 10513 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.832859+0000 mgr.gibba043.dnkmem (mgr.34373) 10514 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.835657+0000 mgr.gibba043.dnkmem (mgr.34373) 10515 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.836179+0000 mgr.gibba043.dnkmem (mgr.34373) 10516 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.838892+0000 mgr.gibba043.dnkmem (mgr.34373) 10517 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.842428+0000 mgr.gibba043.dnkmem (mgr.34373) 10518 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.842914+0000 mgr.gibba043.dnkmem (mgr.34373) 10519 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.846334+0000 mgr.gibba043.dnkmem (mgr.34373) 10520 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.848349+0000 mgr.gibba043.dnkmem (mgr.34373) 10521 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.851300+0000 mgr.gibba043.dnkmem (mgr.34373) 10522 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.851602+0000 mgr.gibba043.dnkmem (mgr.34373) 10523 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[31385]: cephadm 2021-03-10T17:10:36.852243+0000 mgr.gibba043.dnkmem (mgr.34373) 10524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.828693+0000 mgr.gibba043.dnkmem (mgr.34373) 10511 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.830377+0000 mgr.gibba043.dnkmem (mgr.34373) 10512 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.832555+0000 mgr.gibba043.dnkmem (mgr.34373) 10513 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:38.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.832859+0000 mgr.gibba043.dnkmem (mgr.34373) 10514 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.835657+0000 mgr.gibba043.dnkmem (mgr.34373) 10515 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.836179+0000 mgr.gibba043.dnkmem (mgr.34373) 10516 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.838892+0000 mgr.gibba043.dnkmem (mgr.34373) 10517 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.842428+0000 mgr.gibba043.dnkmem (mgr.34373) 10518 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.842914+0000 mgr.gibba043.dnkmem (mgr.34373) 10519 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.846334+0000 mgr.gibba043.dnkmem (mgr.34373) 10520 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.848349+0000 mgr.gibba043.dnkmem (mgr.34373) 10521 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.851300+0000 mgr.gibba043.dnkmem (mgr.34373) 10522 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.851602+0000 mgr.gibba043.dnkmem (mgr.34373) 10523 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:38 gibba003 bash[32348]: cephadm 2021-03-10T17:10:36.852243+0000 mgr.gibba043.dnkmem (mgr.34373) 10524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.828693+0000 mgr.gibba043.dnkmem (mgr.34373) 10511 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.830377+0000 mgr.gibba043.dnkmem (mgr.34373) 10512 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.832555+0000 mgr.gibba043.dnkmem (mgr.34373) 10513 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.832859+0000 mgr.gibba043.dnkmem (mgr.34373) 10514 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.835657+0000 mgr.gibba043.dnkmem (mgr.34373) 10515 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.836179+0000 mgr.gibba043.dnkmem (mgr.34373) 10516 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.838892+0000 mgr.gibba043.dnkmem (mgr.34373) 10517 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.842428+0000 mgr.gibba043.dnkmem (mgr.34373) 10518 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.842914+0000 mgr.gibba043.dnkmem (mgr.34373) 10519 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.846334+0000 mgr.gibba043.dnkmem (mgr.34373) 10520 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:39.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.848349+0000 mgr.gibba043.dnkmem (mgr.34373) 10521 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:39.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.851300+0000 mgr.gibba043.dnkmem (mgr.34373) 10522 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:39.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.851602+0000 mgr.gibba043.dnkmem (mgr.34373) 10523 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:39.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:38 gibba043 bash[24019]: cephadm 2021-03-10T17:10:36.852243+0000 mgr.gibba043.dnkmem (mgr.34373) 10524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:39 gibba003 bash[31385]: cluster 2021-03-10T17:10:37.943283+0000 mgr.gibba043.dnkmem (mgr.34373) 10525 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:39 gibba003 bash[32348]: cluster 2021-03-10T17:10:37.943283+0000 mgr.gibba043.dnkmem (mgr.34373) 10525 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:39 gibba043 bash[24019]: cluster 2021-03-10T17:10:37.943283+0000 mgr.gibba043.dnkmem (mgr.34373) 10525 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:41 gibba003 bash[31385]: cluster 2021-03-10T17:10:39.945091+0000 mgr.gibba043.dnkmem (mgr.34373) 10526 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:41 gibba003 bash[32348]: cluster 2021-03-10T17:10:39.945091+0000 mgr.gibba043.dnkmem (mgr.34373) 10526 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:41 gibba043 bash[24019]: cluster 2021-03-10T17:10:39.945091+0000 mgr.gibba043.dnkmem (mgr.34373) 10526 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:43 gibba003 bash[31385]: cluster 2021-03-10T17:10:41.946818+0000 mgr.gibba043.dnkmem (mgr.34373) 10527 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:43.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:43 gibba003 bash[32348]: cluster 2021-03-10T17:10:41.946818+0000 mgr.gibba043.dnkmem (mgr.34373) 10527 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:43 gibba043 bash[24019]: cluster 2021-03-10T17:10:41.946818+0000 mgr.gibba043.dnkmem (mgr.34373) 10527 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:45.423 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:10:45.642 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:10:45.642 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 72s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:10:45.643 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:10:45.643 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:10:45.643 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:10:45.643 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:10:45.644 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:10:45.644 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:10:45.644 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:10:45.644 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 72s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:10:45.645 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:10:45.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:10:45.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:10:45.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:10:45.645 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:10:45.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:10:45.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:10:45.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:10:45.646 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:10:45.647 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:10:45.647 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 72s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:10:45.892 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:10:45.892 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:10:45.892 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:45.892 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:10:45.893 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:10:45.893 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:45.893 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:10:45.893 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:10:45.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:10:45.894 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:10:45.894 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:10:45.894 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:10:45.894 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:10:45.895 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:10:45.895 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:10:45.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:45 gibba003 bash[31385]: cluster 2021-03-10T17:10:43.948579+0000 mgr.gibba043.dnkmem (mgr.34373) 10528 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:45 gibba003 bash[32348]: cluster 2021-03-10T17:10:43.948579+0000 mgr.gibba043.dnkmem (mgr.34373) 10528 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:45 gibba043 bash[24019]: cluster 2021-03-10T17:10:43.948579+0000 mgr.gibba043.dnkmem (mgr.34373) 10528 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:46.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:46 gibba003 bash[31385]: audit 2021-03-10T17:10:45.413007+0000 mgr.gibba043.dnkmem (mgr.34373) 10529 : audit [DBG] from='client.61096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:46.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:46 gibba003 bash[31385]: audit 2021-03-10T17:10:45.634206+0000 mgr.gibba043.dnkmem (mgr.34373) 10530 : audit [DBG] from='client.61102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:46.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:46 gibba003 bash[31385]: audit 2021-03-10T17:10:45.893235+0000 mon.a (mon.0) 2133 : audit [DBG] from='client.? 172.21.2.103:0/2362835538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:46 gibba003 bash[32348]: audit 2021-03-10T17:10:45.413007+0000 mgr.gibba043.dnkmem (mgr.34373) 10529 : audit [DBG] from='client.61096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:46 gibba003 bash[32348]: audit 2021-03-10T17:10:45.634206+0000 mgr.gibba043.dnkmem (mgr.34373) 10530 : audit [DBG] from='client.61102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:46.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:46 gibba003 bash[32348]: audit 2021-03-10T17:10:45.893235+0000 mon.a (mon.0) 2133 : audit [DBG] from='client.? 172.21.2.103:0/2362835538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:47.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:46 gibba043 bash[24019]: audit 2021-03-10T17:10:45.413007+0000 mgr.gibba043.dnkmem (mgr.34373) 10529 : audit [DBG] from='client.61096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:47.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:46 gibba043 bash[24019]: audit 2021-03-10T17:10:45.634206+0000 mgr.gibba043.dnkmem (mgr.34373) 10530 : audit [DBG] from='client.61102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:47.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:46 gibba043 bash[24019]: audit 2021-03-10T17:10:45.893235+0000 mon.a (mon.0) 2133 : audit [DBG] from='client.? 172.21.2.103:0/2362835538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:47 gibba003 bash[31385]: cluster 2021-03-10T17:10:45.950187+0000 mgr.gibba043.dnkmem (mgr.34373) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:47 gibba003 bash[32348]: cluster 2021-03-10T17:10:45.950187+0000 mgr.gibba043.dnkmem (mgr.34373) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:47 gibba043 bash[24019]: cluster 2021-03-10T17:10:45.950187+0000 mgr.gibba043.dnkmem (mgr.34373) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:49 gibba003 bash[31385]: cluster 2021-03-10T17:10:47.951642+0000 mgr.gibba043.dnkmem (mgr.34373) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:49.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:49 gibba003 bash[32348]: cluster 2021-03-10T17:10:47.951642+0000 mgr.gibba043.dnkmem (mgr.34373) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:49 gibba043 bash[24019]: cluster 2021-03-10T17:10:47.951642+0000 mgr.gibba043.dnkmem (mgr.34373) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:51 gibba043 bash[24019]: cluster 2021-03-10T17:10:49.953205+0000 mgr.gibba043.dnkmem (mgr.34373) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:51 gibba003 bash[31385]: cluster 2021-03-10T17:10:49.953205+0000 mgr.gibba043.dnkmem (mgr.34373) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:51 gibba003 bash[32348]: cluster 2021-03-10T17:10:49.953205+0000 mgr.gibba043.dnkmem (mgr.34373) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:53 gibba043 bash[24019]: cephadm 2021-03-10T17:10:51.868426+0000 mgr.gibba043.dnkmem (mgr.34373) 10534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:53 gibba043 bash[24019]: cluster 2021-03-10T17:10:51.954701+0000 mgr.gibba043.dnkmem (mgr.34373) 10535 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:53 gibba003 bash[31385]: cephadm 2021-03-10T17:10:51.868426+0000 mgr.gibba043.dnkmem (mgr.34373) 10534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:53 gibba003 bash[31385]: cluster 2021-03-10T17:10:51.954701+0000 mgr.gibba043.dnkmem (mgr.34373) 10535 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:53 gibba003 bash[32348]: cephadm 2021-03-10T17:10:51.868426+0000 mgr.gibba043.dnkmem (mgr.34373) 10534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:10:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:53 gibba003 bash[32348]: cluster 2021-03-10T17:10:51.954701+0000 mgr.gibba043.dnkmem (mgr.34373) 10535 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:55 gibba043 bash[24019]: cluster 2021-03-10T17:10:53.956540+0000 mgr.gibba043.dnkmem (mgr.34373) 10536 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:55 gibba003 bash[31385]: cluster 2021-03-10T17:10:53.956540+0000 mgr.gibba043.dnkmem (mgr.34373) 10536 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:55 gibba003 bash[32348]: cluster 2021-03-10T17:10:53.956540+0000 mgr.gibba043.dnkmem (mgr.34373) 10536 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:57.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:56 gibba043 bash[24019]: cluster 2021-03-10T17:10:55.958233+0000 mgr.gibba043.dnkmem (mgr.34373) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:57.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:56 gibba003 bash[31385]: cluster 2021-03-10T17:10:55.958233+0000 mgr.gibba043.dnkmem (mgr.34373) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:57.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:56 gibba003 bash[32348]: cluster 2021-03-10T17:10:55.958233+0000 mgr.gibba043.dnkmem (mgr.34373) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:10:59 gibba003 bash[31385]: cluster 2021-03-10T17:10:57.959525+0000 mgr.gibba043.dnkmem (mgr.34373) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:59.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:10:59 gibba003 bash[32348]: cluster 2021-03-10T17:10:57.959525+0000 mgr.gibba043.dnkmem (mgr.34373) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:10:59 gibba043 bash[24019]: cluster 2021-03-10T17:10:57.959525+0000 mgr.gibba043.dnkmem (mgr.34373) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:01.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:01 gibba003 bash[31385]: cluster 2021-03-10T17:10:59.961064+0000 mgr.gibba043.dnkmem (mgr.34373) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:01.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:01 gibba003 bash[32348]: cluster 2021-03-10T17:10:59.961064+0000 mgr.gibba043.dnkmem (mgr.34373) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:01 gibba043 bash[24019]: cluster 2021-03-10T17:10:59.961064+0000 mgr.gibba043.dnkmem (mgr.34373) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:03 gibba003 bash[31385]: cluster 2021-03-10T17:11:01.962752+0000 mgr.gibba043.dnkmem (mgr.34373) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:03 gibba003 bash[32348]: cluster 2021-03-10T17:11:01.962752+0000 mgr.gibba043.dnkmem (mgr.34373) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:03 gibba043 bash[24019]: cluster 2021-03-10T17:11:01.962752+0000 mgr.gibba043.dnkmem (mgr.34373) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:05 gibba003 bash[31385]: cluster 2021-03-10T17:11:03.964491+0000 mgr.gibba043.dnkmem (mgr.34373) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:05 gibba003 bash[32348]: cluster 2021-03-10T17:11:03.964491+0000 mgr.gibba043.dnkmem (mgr.34373) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:05 gibba043 bash[24019]: cluster 2021-03-10T17:11:03.964491+0000 mgr.gibba043.dnkmem (mgr.34373) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:07 gibba003 bash[31385]: cluster 2021-03-10T17:11:05.966156+0000 mgr.gibba043.dnkmem (mgr.34373) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:07 gibba003 bash[32348]: cluster 2021-03-10T17:11:05.966156+0000 mgr.gibba043.dnkmem (mgr.34373) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:07 gibba043 bash[24019]: cluster 2021-03-10T17:11:05.966156+0000 mgr.gibba043.dnkmem (mgr.34373) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:08 gibba003 bash[31385]: cephadm 2021-03-10T17:11:06.871118+0000 mgr.gibba043.dnkmem (mgr.34373) 10543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:08 gibba003 bash[32348]: cephadm 2021-03-10T17:11:06.871118+0000 mgr.gibba043.dnkmem (mgr.34373) 10543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:08 gibba043 bash[24019]: cephadm 2021-03-10T17:11:06.871118+0000 mgr.gibba043.dnkmem (mgr.34373) 10543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:09 gibba003 bash[31385]: cluster 2021-03-10T17:11:07.967827+0000 mgr.gibba043.dnkmem (mgr.34373) 10544 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:09 gibba003 bash[32348]: cluster 2021-03-10T17:11:07.967827+0000 mgr.gibba043.dnkmem (mgr.34373) 10544 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:09 gibba043 bash[24019]: cluster 2021-03-10T17:11:07.967827+0000 mgr.gibba043.dnkmem (mgr.34373) 10544 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:11 gibba003 bash[31385]: cluster 2021-03-10T17:11:09.969410+0000 mgr.gibba043.dnkmem (mgr.34373) 10545 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:11 gibba003 bash[32348]: cluster 2021-03-10T17:11:09.969410+0000 mgr.gibba043.dnkmem (mgr.34373) 10545 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:11 gibba043 bash[24019]: cluster 2021-03-10T17:11:09.969410+0000 mgr.gibba043.dnkmem (mgr.34373) 10545 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:13.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:13 gibba003 bash[31385]: cluster 2021-03-10T17:11:11.971018+0000 mgr.gibba043.dnkmem (mgr.34373) 10546 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:13 gibba003 bash[32348]: cluster 2021-03-10T17:11:11.971018+0000 mgr.gibba043.dnkmem (mgr.34373) 10546 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:13 gibba043 bash[24019]: cluster 2021-03-10T17:11:11.971018+0000 mgr.gibba043.dnkmem (mgr.34373) 10546 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.006648+0000 mon.c (mon.1) 2710 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.007947+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.245948+0000 mon.c (mon.1) 2711 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.247152+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.573105+0000 mon.c (mon.1) 2712 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:11:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.573841+0000 mon.c (mon.1) 2713 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.574471+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:11:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.574532+0000 mon.c (mon.1) 2714 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.575224+0000 mon.c (mon.1) 2715 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:11:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.577126+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.578424+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[31385]: audit 2021-03-10T17:11:14.579783+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:11:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.006648+0000 mon.c (mon.1) 2710 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.007947+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.245948+0000 mon.c (mon.1) 2711 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.247152+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.573105+0000 mon.c (mon.1) 2712 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:11:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.573841+0000 mon.c (mon.1) 2713 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.574471+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:11:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.574532+0000 mon.c (mon.1) 2714 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.575224+0000 mon.c (mon.1) 2715 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:11:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.577126+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.578424+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:11:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:14 gibba003 bash[32348]: audit 2021-03-10T17:11:14.579783+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:11:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.006648+0000 mon.c (mon.1) 2710 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.007947+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.245948+0000 mon.c (mon.1) 2711 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.247152+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.573105+0000 mon.c (mon.1) 2712 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:11:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.573841+0000 mon.c (mon.1) 2713 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.574471+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:11:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.574532+0000 mon.c (mon.1) 2714 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:11:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.575224+0000 mon.c (mon.1) 2715 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:11:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.577126+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.578424+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:11:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:14 gibba043 bash[24019]: audit 2021-03-10T17:11:14.579783+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:11:15.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:15 gibba003 bash[31385]: cluster 2021-03-10T17:11:13.972774+0000 mgr.gibba043.dnkmem (mgr.34373) 10547 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:15 gibba003 bash[32348]: cluster 2021-03-10T17:11:13.972774+0000 mgr.gibba043.dnkmem (mgr.34373) 10547 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:15 gibba043 bash[24019]: cluster 2021-03-10T17:11:13.972774+0000 mgr.gibba043.dnkmem (mgr.34373) 10547 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:16.139 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:11:16.367 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:11:16.367 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 103s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:11:16.367 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 39s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:11:16.367 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:11:16.368 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:11:16.368 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:11:16.368 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:11:16.369 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:11:16.369 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:11:16.369 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 103s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:11:16.369 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 39s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:11:16.370 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:11:16.370 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:11:16.370 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:11:16.370 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:11:16.371 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:11:16.371 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:11:16.371 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:11:16.371 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:11:16.372 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 39s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:11:16.372 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 103s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:11:16.618 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:11:16.619 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:11:16.619 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:16.619 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:11:16.620 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:11:16.620 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:16.621 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:11:16.621 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:11:16.621 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:11:16.622 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:11:16.622 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:11:16.622 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:11:16.623 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:11:16.623 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:11:16.623 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:11:16.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:16 gibba003 bash[31385]: audit 2021-03-10T17:11:16.619604+0000 mon.c (mon.1) 2716 : audit [DBG] from='client.? 172.21.2.103:0/685921106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:16.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:16 gibba003 bash[32348]: audit 2021-03-10T17:11:16.619604+0000 mon.c (mon.1) 2716 : audit [DBG] from='client.? 172.21.2.103:0/685921106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:17.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:16 gibba043 bash[24019]: audit 2021-03-10T17:11:16.619604+0000 mon.c (mon.1) 2716 : audit [DBG] from='client.? 172.21.2.103:0/685921106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:17 gibba043 bash[24019]: cluster 2021-03-10T17:11:15.974186+0000 mgr.gibba043.dnkmem (mgr.34373) 10548 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:17 gibba043 bash[24019]: audit 2021-03-10T17:11:16.129457+0000 mgr.gibba043.dnkmem (mgr.34373) 10549 : audit [DBG] from='client.51123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:17 gibba043 bash[24019]: audit 2021-03-10T17:11:16.353532+0000 mgr.gibba043.dnkmem (mgr.34373) 10550 : audit [DBG] from='client.51129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:17 gibba003 bash[31385]: cluster 2021-03-10T17:11:15.974186+0000 mgr.gibba043.dnkmem (mgr.34373) 10548 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:17 gibba003 bash[31385]: audit 2021-03-10T17:11:16.129457+0000 mgr.gibba043.dnkmem (mgr.34373) 10549 : audit [DBG] from='client.51123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:17 gibba003 bash[31385]: audit 2021-03-10T17:11:16.353532+0000 mgr.gibba043.dnkmem (mgr.34373) 10550 : audit [DBG] from='client.51129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:17 gibba003 bash[32348]: cluster 2021-03-10T17:11:15.974186+0000 mgr.gibba043.dnkmem (mgr.34373) 10548 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:17 gibba003 bash[32348]: audit 2021-03-10T17:11:16.129457+0000 mgr.gibba043.dnkmem (mgr.34373) 10549 : audit [DBG] from='client.51123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:17 gibba003 bash[32348]: audit 2021-03-10T17:11:16.353532+0000 mgr.gibba043.dnkmem (mgr.34373) 10550 : audit [DBG] from='client.51129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:19 gibba043 bash[24019]: cluster 2021-03-10T17:11:17.975890+0000 mgr.gibba043.dnkmem (mgr.34373) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:19 gibba003 bash[31385]: cluster 2021-03-10T17:11:17.975890+0000 mgr.gibba043.dnkmem (mgr.34373) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:19 gibba003 bash[32348]: cluster 2021-03-10T17:11:17.975890+0000 mgr.gibba043.dnkmem (mgr.34373) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:21 gibba043 bash[24019]: cluster 2021-03-10T17:11:19.977333+0000 mgr.gibba043.dnkmem (mgr.34373) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:22.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:21 gibba003 bash[31385]: cluster 2021-03-10T17:11:19.977333+0000 mgr.gibba043.dnkmem (mgr.34373) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:21 gibba003 bash[32348]: cluster 2021-03-10T17:11:19.977333+0000 mgr.gibba043.dnkmem (mgr.34373) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:23 gibba043 bash[24019]: cephadm 2021-03-10T17:11:21.887206+0000 mgr.gibba043.dnkmem (mgr.34373) 10553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:23 gibba043 bash[24019]: cluster 2021-03-10T17:11:21.979007+0000 mgr.gibba043.dnkmem (mgr.34373) 10554 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:23 gibba003 bash[31385]: cephadm 2021-03-10T17:11:21.887206+0000 mgr.gibba043.dnkmem (mgr.34373) 10553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:23 gibba003 bash[31385]: cluster 2021-03-10T17:11:21.979007+0000 mgr.gibba043.dnkmem (mgr.34373) 10554 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:23 gibba003 bash[32348]: cephadm 2021-03-10T17:11:21.887206+0000 mgr.gibba043.dnkmem (mgr.34373) 10553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:23 gibba003 bash[32348]: cluster 2021-03-10T17:11:21.979007+0000 mgr.gibba043.dnkmem (mgr.34373) 10554 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:25 gibba043 bash[24019]: cluster 2021-03-10T17:11:23.980712+0000 mgr.gibba043.dnkmem (mgr.34373) 10555 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:25 gibba003 bash[31385]: cluster 2021-03-10T17:11:23.980712+0000 mgr.gibba043.dnkmem (mgr.34373) 10555 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:25 gibba003 bash[32348]: cluster 2021-03-10T17:11:23.980712+0000 mgr.gibba043.dnkmem (mgr.34373) 10555 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:27.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:26 gibba043 bash[24019]: cluster 2021-03-10T17:11:25.982258+0000 mgr.gibba043.dnkmem (mgr.34373) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:27.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:26 gibba003 bash[31385]: cluster 2021-03-10T17:11:25.982258+0000 mgr.gibba043.dnkmem (mgr.34373) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:26 gibba003 bash[32348]: cluster 2021-03-10T17:11:25.982258+0000 mgr.gibba043.dnkmem (mgr.34373) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:29 gibba003 bash[31385]: cluster 2021-03-10T17:11:27.983763+0000 mgr.gibba043.dnkmem (mgr.34373) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:29 gibba003 bash[32348]: cluster 2021-03-10T17:11:27.983763+0000 mgr.gibba043.dnkmem (mgr.34373) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:29 gibba043 bash[24019]: cluster 2021-03-10T17:11:27.983763+0000 mgr.gibba043.dnkmem (mgr.34373) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:31 gibba003 bash[31385]: cluster 2021-03-10T17:11:29.985283+0000 mgr.gibba043.dnkmem (mgr.34373) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:31 gibba003 bash[32348]: cluster 2021-03-10T17:11:29.985283+0000 mgr.gibba043.dnkmem (mgr.34373) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:31 gibba043 bash[24019]: cluster 2021-03-10T17:11:29.985283+0000 mgr.gibba043.dnkmem (mgr.34373) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:33.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:33 gibba003 bash[31385]: cluster 2021-03-10T17:11:31.986676+0000 mgr.gibba043.dnkmem (mgr.34373) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:33 gibba003 bash[32348]: cluster 2021-03-10T17:11:31.986676+0000 mgr.gibba043.dnkmem (mgr.34373) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:33 gibba043 bash[24019]: cluster 2021-03-10T17:11:31.986676+0000 mgr.gibba043.dnkmem (mgr.34373) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:35 gibba003 bash[31385]: cluster 2021-03-10T17:11:33.988271+0000 mgr.gibba043.dnkmem (mgr.34373) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:35 gibba003 bash[32348]: cluster 2021-03-10T17:11:33.988271+0000 mgr.gibba043.dnkmem (mgr.34373) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:35 gibba043 bash[24019]: cluster 2021-03-10T17:11:33.988271+0000 mgr.gibba043.dnkmem (mgr.34373) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: cluster 2021-03-10T17:11:35.989814+0000 mgr.gibba043.dnkmem (mgr.34373) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.128852+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:11:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.132610+0000 mon.c (mon.1) 2717 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.134150+0000 mon.c (mon.1) 2718 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.135723+0000 mon.c (mon.1) 2719 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.137149+0000 mon.c (mon.1) 2720 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.140587+0000 mon.c (mon.1) 2721 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[31385]: audit 2021-03-10T17:11:37.142325+0000 mon.c (mon.1) 2722 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: cluster 2021-03-10T17:11:35.989814+0000 mgr.gibba043.dnkmem (mgr.34373) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.128852+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:11:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.132610+0000 mon.c (mon.1) 2717 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.134150+0000 mon.c (mon.1) 2718 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.135723+0000 mon.c (mon.1) 2719 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.137149+0000 mon.c (mon.1) 2720 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.140587+0000 mon.c (mon.1) 2721 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:37 gibba003 bash[32348]: audit 2021-03-10T17:11:37.142325+0000 mon.c (mon.1) 2722 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: cluster 2021-03-10T17:11:35.989814+0000 mgr.gibba043.dnkmem (mgr.34373) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.128852+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:11:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.132610+0000 mon.c (mon.1) 2717 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.134150+0000 mon.c (mon.1) 2718 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.135723+0000 mon.c (mon.1) 2719 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.137149+0000 mon.c (mon.1) 2720 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.140587+0000 mon.c (mon.1) 2721 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:38.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:37 gibba043 bash[24019]: audit 2021-03-10T17:11:37.142325+0000 mon.c (mon.1) 2722 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:36.903291+0000 mgr.gibba043.dnkmem (mgr.34373) 10562 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:11:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:36.904894+0000 mgr.gibba043.dnkmem (mgr.34373) 10563 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:11:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.129923+0000 mgr.gibba043.dnkmem (mgr.34373) 10564 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:38.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.131854+0000 mgr.gibba043.dnkmem (mgr.34373) 10565 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.133373+0000 mgr.gibba043.dnkmem (mgr.34373) 10566 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.133410+0000 mgr.gibba043.dnkmem (mgr.34373) 10567 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.134869+0000 mgr.gibba043.dnkmem (mgr.34373) 10568 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.134905+0000 mgr.gibba043.dnkmem (mgr.34373) 10569 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.136187+0000 mgr.gibba043.dnkmem (mgr.34373) 10570 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.138189+0000 mgr.gibba043.dnkmem (mgr.34373) 10571 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.138227+0000 mgr.gibba043.dnkmem (mgr.34373) 10572 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:38.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.139789+0000 mgr.gibba043.dnkmem (mgr.34373) 10573 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.140110+0000 mgr.gibba043.dnkmem (mgr.34373) 10574 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.141233+0000 mgr.gibba043.dnkmem (mgr.34373) 10575 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.141271+0000 mgr.gibba043.dnkmem (mgr.34373) 10576 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:38.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[31385]: cephadm 2021-03-10T17:11:37.141375+0000 mgr.gibba043.dnkmem (mgr.34373) 10577 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:36.903291+0000 mgr.gibba043.dnkmem (mgr.34373) 10562 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:11:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:36.904894+0000 mgr.gibba043.dnkmem (mgr.34373) 10563 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:11:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.129923+0000 mgr.gibba043.dnkmem (mgr.34373) 10564 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:38.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.131854+0000 mgr.gibba043.dnkmem (mgr.34373) 10565 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.133373+0000 mgr.gibba043.dnkmem (mgr.34373) 10566 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.133410+0000 mgr.gibba043.dnkmem (mgr.34373) 10567 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.134869+0000 mgr.gibba043.dnkmem (mgr.34373) 10568 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:38.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.134905+0000 mgr.gibba043.dnkmem (mgr.34373) 10569 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.136187+0000 mgr.gibba043.dnkmem (mgr.34373) 10570 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.138189+0000 mgr.gibba043.dnkmem (mgr.34373) 10571 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.138227+0000 mgr.gibba043.dnkmem (mgr.34373) 10572 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:38.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.139789+0000 mgr.gibba043.dnkmem (mgr.34373) 10573 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.140110+0000 mgr.gibba043.dnkmem (mgr.34373) 10574 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.141233+0000 mgr.gibba043.dnkmem (mgr.34373) 10575 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.141271+0000 mgr.gibba043.dnkmem (mgr.34373) 10576 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:38.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:38 gibba003 bash[32348]: cephadm 2021-03-10T17:11:37.141375+0000 mgr.gibba043.dnkmem (mgr.34373) 10577 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:36.903291+0000 mgr.gibba043.dnkmem (mgr.34373) 10562 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:11:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:36.904894+0000 mgr.gibba043.dnkmem (mgr.34373) 10563 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:11:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.129923+0000 mgr.gibba043.dnkmem (mgr.34373) 10564 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.131854+0000 mgr.gibba043.dnkmem (mgr.34373) 10565 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.133373+0000 mgr.gibba043.dnkmem (mgr.34373) 10566 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.133410+0000 mgr.gibba043.dnkmem (mgr.34373) 10567 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.134869+0000 mgr.gibba043.dnkmem (mgr.34373) 10568 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.134905+0000 mgr.gibba043.dnkmem (mgr.34373) 10569 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.136187+0000 mgr.gibba043.dnkmem (mgr.34373) 10570 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.138189+0000 mgr.gibba043.dnkmem (mgr.34373) 10571 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.138227+0000 mgr.gibba043.dnkmem (mgr.34373) 10572 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.139789+0000 mgr.gibba043.dnkmem (mgr.34373) 10573 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.140110+0000 mgr.gibba043.dnkmem (mgr.34373) 10574 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.141233+0000 mgr.gibba043.dnkmem (mgr.34373) 10575 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.141271+0000 mgr.gibba043.dnkmem (mgr.34373) 10576 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:38 gibba043 bash[24019]: cephadm 2021-03-10T17:11:37.141375+0000 mgr.gibba043.dnkmem (mgr.34373) 10577 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:39.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:39 gibba003 bash[31385]: cluster 2021-03-10T17:11:37.991130+0000 mgr.gibba043.dnkmem (mgr.34373) 10578 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:39.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:39 gibba003 bash[32348]: cluster 2021-03-10T17:11:37.991130+0000 mgr.gibba043.dnkmem (mgr.34373) 10578 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:39 gibba043 bash[24019]: cluster 2021-03-10T17:11:37.991130+0000 mgr.gibba043.dnkmem (mgr.34373) 10578 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:41.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:41 gibba003 bash[31385]: cluster 2021-03-10T17:11:39.992968+0000 mgr.gibba043.dnkmem (mgr.34373) 10579 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:41 gibba003 bash[32348]: cluster 2021-03-10T17:11:39.992968+0000 mgr.gibba043.dnkmem (mgr.34373) 10579 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:41 gibba043 bash[24019]: cluster 2021-03-10T17:11:39.992968+0000 mgr.gibba043.dnkmem (mgr.34373) 10579 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:43 gibba003 bash[31385]: cluster 2021-03-10T17:11:41.994654+0000 mgr.gibba043.dnkmem (mgr.34373) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:43 gibba003 bash[32348]: cluster 2021-03-10T17:11:41.994654+0000 mgr.gibba043.dnkmem (mgr.34373) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:43 gibba043 bash[24019]: cluster 2021-03-10T17:11:41.994654+0000 mgr.gibba043.dnkmem (mgr.34373) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:45 gibba003 bash[31385]: cluster 2021-03-10T17:11:43.996049+0000 mgr.gibba043.dnkmem (mgr.34373) 10581 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:45 gibba003 bash[32348]: cluster 2021-03-10T17:11:43.996049+0000 mgr.gibba043.dnkmem (mgr.34373) 10581 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:46.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:45 gibba043 bash[24019]: cluster 2021-03-10T17:11:43.996049+0000 mgr.gibba043.dnkmem (mgr.34373) 10581 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:46.861 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:11:47.086 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:11:47.087 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:11:47.087 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 70s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:11:47.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:11:47.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:11:47.087 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:11:47.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:11:47.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:11:47.088 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:11:47.089 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:11:47.089 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 70s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:11:47.089 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:11:47.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:11:47.090 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:11:47.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:11:47.091 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:11:47.092 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:11:47.092 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:11:47.093 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 70s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:11:47.093 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 70s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:11:47.093 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:11:47.335 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:11:47.335 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:11:47.335 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:47.336 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:11:47.336 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:11:47.336 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:47.336 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:11:47.336 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:11:47.337 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:11:47.337 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:11:47.337 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:11:47.337 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:11:47.338 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:11:47.338 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:11:47.338 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:11:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:47 gibba003 bash[31385]: cluster 2021-03-10T17:11:45.997889+0000 mgr.gibba043.dnkmem (mgr.34373) 10582 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:47 gibba003 bash[31385]: audit 2021-03-10T17:11:47.336192+0000 mon.c (mon.1) 2723 : audit [DBG] from='client.? 172.21.2.103:0/1993745955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:47 gibba003 bash[32348]: cluster 2021-03-10T17:11:45.997889+0000 mgr.gibba043.dnkmem (mgr.34373) 10582 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:47 gibba003 bash[32348]: audit 2021-03-10T17:11:47.336192+0000 mon.c (mon.1) 2723 : audit [DBG] from='client.? 172.21.2.103:0/1993745955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:47 gibba043 bash[24019]: cluster 2021-03-10T17:11:45.997889+0000 mgr.gibba043.dnkmem (mgr.34373) 10582 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:47 gibba043 bash[24019]: audit 2021-03-10T17:11:47.336192+0000 mon.c (mon.1) 2723 : audit [DBG] from='client.? 172.21.2.103:0/1993745955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:48 gibba043 bash[24019]: audit 2021-03-10T17:11:46.851513+0000 mgr.gibba043.dnkmem (mgr.34373) 10583 : audit [DBG] from='client.51141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:48 gibba043 bash[24019]: audit 2021-03-10T17:11:47.073214+0000 mgr.gibba043.dnkmem (mgr.34373) 10584 : audit [DBG] from='client.61138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:48 gibba003 bash[31385]: audit 2021-03-10T17:11:46.851513+0000 mgr.gibba043.dnkmem (mgr.34373) 10583 : audit [DBG] from='client.51141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:48 gibba003 bash[31385]: audit 2021-03-10T17:11:47.073214+0000 mgr.gibba043.dnkmem (mgr.34373) 10584 : audit [DBG] from='client.61138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:49.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:48 gibba003 bash[32348]: audit 2021-03-10T17:11:46.851513+0000 mgr.gibba043.dnkmem (mgr.34373) 10583 : audit [DBG] from='client.51141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:48 gibba003 bash[32348]: audit 2021-03-10T17:11:47.073214+0000 mgr.gibba043.dnkmem (mgr.34373) 10584 : audit [DBG] from='client.61138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:49 gibba043 bash[24019]: cluster 2021-03-10T17:11:47.999194+0000 mgr.gibba043.dnkmem (mgr.34373) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:49 gibba003 bash[31385]: cluster 2021-03-10T17:11:47.999194+0000 mgr.gibba043.dnkmem (mgr.34373) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:49 gibba003 bash[32348]: cluster 2021-03-10T17:11:47.999194+0000 mgr.gibba043.dnkmem (mgr.34373) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:51 gibba043 bash[24019]: cluster 2021-03-10T17:11:50.000860+0000 mgr.gibba043.dnkmem (mgr.34373) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:51 gibba003 bash[31385]: cluster 2021-03-10T17:11:50.000860+0000 mgr.gibba043.dnkmem (mgr.34373) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:51 gibba003 bash[32348]: cluster 2021-03-10T17:11:50.000860+0000 mgr.gibba043.dnkmem (mgr.34373) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:53 gibba043 bash[24019]: cluster 2021-03-10T17:11:52.002451+0000 mgr.gibba043.dnkmem (mgr.34373) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:53 gibba043 bash[24019]: cephadm 2021-03-10T17:11:52.157466+0000 mgr.gibba043.dnkmem (mgr.34373) 10588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:53 gibba003 bash[31385]: cluster 2021-03-10T17:11:52.002451+0000 mgr.gibba043.dnkmem (mgr.34373) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:53 gibba003 bash[31385]: cephadm 2021-03-10T17:11:52.157466+0000 mgr.gibba043.dnkmem (mgr.34373) 10588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:53 gibba003 bash[32348]: cluster 2021-03-10T17:11:52.002451+0000 mgr.gibba043.dnkmem (mgr.34373) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:53 gibba003 bash[32348]: cephadm 2021-03-10T17:11:52.157466+0000 mgr.gibba043.dnkmem (mgr.34373) 10588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:11:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:55 gibba043 bash[24019]: cluster 2021-03-10T17:11:54.004010+0000 mgr.gibba043.dnkmem (mgr.34373) 10589 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:55 gibba003 bash[31385]: cluster 2021-03-10T17:11:54.004010+0000 mgr.gibba043.dnkmem (mgr.34373) 10589 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:55 gibba003 bash[32348]: cluster 2021-03-10T17:11:54.004010+0000 mgr.gibba043.dnkmem (mgr.34373) 10589 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:57 gibba043 bash[24019]: cluster 2021-03-10T17:11:56.005645+0000 mgr.gibba043.dnkmem (mgr.34373) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:57 gibba003 bash[31385]: cluster 2021-03-10T17:11:56.005645+0000 mgr.gibba043.dnkmem (mgr.34373) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:57 gibba003 bash[32348]: cluster 2021-03-10T17:11:56.005645+0000 mgr.gibba043.dnkmem (mgr.34373) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:11:58 gibba043 bash[24019]: cluster 2021-03-10T17:11:58.006740+0000 mgr.gibba043.dnkmem (mgr.34373) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:11:58 gibba003 bash[31385]: cluster 2021-03-10T17:11:58.006740+0000 mgr.gibba043.dnkmem (mgr.34373) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:59.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:11:58 gibba003 bash[32348]: cluster 2021-03-10T17:11:58.006740+0000 mgr.gibba043.dnkmem (mgr.34373) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:01 gibba003 bash[32348]: cluster 2021-03-10T17:12:00.008331+0000 mgr.gibba043.dnkmem (mgr.34373) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:01 gibba003 bash[31385]: cluster 2021-03-10T17:12:00.008331+0000 mgr.gibba043.dnkmem (mgr.34373) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:01 gibba043 bash[24019]: cluster 2021-03-10T17:12:00.008331+0000 mgr.gibba043.dnkmem (mgr.34373) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:03 gibba003 bash[31385]: cluster 2021-03-10T17:12:02.010053+0000 mgr.gibba043.dnkmem (mgr.34373) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:03 gibba003 bash[32348]: cluster 2021-03-10T17:12:02.010053+0000 mgr.gibba043.dnkmem (mgr.34373) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:03 gibba043 bash[24019]: cluster 2021-03-10T17:12:02.010053+0000 mgr.gibba043.dnkmem (mgr.34373) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:05 gibba003 bash[31385]: cluster 2021-03-10T17:12:04.011433+0000 mgr.gibba043.dnkmem (mgr.34373) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:05 gibba003 bash[32348]: cluster 2021-03-10T17:12:04.011433+0000 mgr.gibba043.dnkmem (mgr.34373) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:05 gibba043 bash[24019]: cluster 2021-03-10T17:12:04.011433+0000 mgr.gibba043.dnkmem (mgr.34373) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:07.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:07 gibba003 bash[31385]: cluster 2021-03-10T17:12:06.013192+0000 mgr.gibba043.dnkmem (mgr.34373) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:07 gibba003 bash[32348]: cluster 2021-03-10T17:12:06.013192+0000 mgr.gibba043.dnkmem (mgr.34373) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:07 gibba043 bash[24019]: cluster 2021-03-10T17:12:06.013192+0000 mgr.gibba043.dnkmem (mgr.34373) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:08 gibba003 bash[31385]: cephadm 2021-03-10T17:12:07.164538+0000 mgr.gibba043.dnkmem (mgr.34373) 10596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:08 gibba003 bash[32348]: cephadm 2021-03-10T17:12:07.164538+0000 mgr.gibba043.dnkmem (mgr.34373) 10596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:08 gibba043 bash[24019]: cephadm 2021-03-10T17:12:07.164538+0000 mgr.gibba043.dnkmem (mgr.34373) 10596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:09.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:09 gibba003 bash[31385]: cluster 2021-03-10T17:12:08.014868+0000 mgr.gibba043.dnkmem (mgr.34373) 10597 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:09 gibba003 bash[32348]: cluster 2021-03-10T17:12:08.014868+0000 mgr.gibba043.dnkmem (mgr.34373) 10597 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:09 gibba043 bash[24019]: cluster 2021-03-10T17:12:08.014868+0000 mgr.gibba043.dnkmem (mgr.34373) 10597 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:11 gibba003 bash[31385]: cluster 2021-03-10T17:12:10.016166+0000 mgr.gibba043.dnkmem (mgr.34373) 10598 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:11 gibba003 bash[32348]: cluster 2021-03-10T17:12:10.016166+0000 mgr.gibba043.dnkmem (mgr.34373) 10598 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:11 gibba043 bash[24019]: cluster 2021-03-10T17:12:10.016166+0000 mgr.gibba043.dnkmem (mgr.34373) 10598 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:13 gibba003 bash[31385]: cluster 2021-03-10T17:12:12.017608+0000 mgr.gibba043.dnkmem (mgr.34373) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:13.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:13 gibba003 bash[32348]: cluster 2021-03-10T17:12:12.017608+0000 mgr.gibba043.dnkmem (mgr.34373) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:13 gibba043 bash[24019]: cluster 2021-03-10T17:12:12.017608+0000 mgr.gibba043.dnkmem (mgr.34373) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.013639+0000 mon.c (mon.1) 2724 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.014754+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.253988+0000 mon.c (mon.1) 2725 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.255203+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.583045+0000 mon.c (mon.1) 2726 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:12:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.583806+0000 mon.c (mon.1) 2727 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.584308+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:12:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.584509+0000 mon.c (mon.1) 2728 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.585315+0000 mon.c (mon.1) 2729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.585517+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.586651+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[31385]: audit 2021-03-10T17:12:14.587453+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.013639+0000 mon.c (mon.1) 2724 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.014754+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.253988+0000 mon.c (mon.1) 2725 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.255203+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.583045+0000 mon.c (mon.1) 2726 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:12:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.583806+0000 mon.c (mon.1) 2727 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.584308+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:12:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.584509+0000 mon.c (mon.1) 2728 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.585315+0000 mon.c (mon.1) 2729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.585517+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:12:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.586651+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:14 gibba003 bash[32348]: audit 2021-03-10T17:12:14.587453+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:12:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.013639+0000 mon.c (mon.1) 2724 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.014754+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.253988+0000 mon.c (mon.1) 2725 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.255203+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.583045+0000 mon.c (mon.1) 2726 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:12:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.583806+0000 mon.c (mon.1) 2727 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:12:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.584308+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:12:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.584509+0000 mon.c (mon.1) 2728 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.585315+0000 mon.c (mon.1) 2729 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:12:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.585517+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:12:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.586651+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:14 gibba043 bash[24019]: audit 2021-03-10T17:12:14.587453+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:12:15.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:15 gibba003 bash[31385]: cluster 2021-03-10T17:12:14.019202+0000 mgr.gibba043.dnkmem (mgr.34373) 10600 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:15.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:15 gibba003 bash[32348]: cluster 2021-03-10T17:12:14.019202+0000 mgr.gibba043.dnkmem (mgr.34373) 10600 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:15 gibba043 bash[24019]: cluster 2021-03-10T17:12:14.019202+0000 mgr.gibba043.dnkmem (mgr.34373) 10600 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:17.577 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:12:17.809 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:12:17.810 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:12:17.811 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 101s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:12:17.811 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:12:17.811 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:12:17.812 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:12:17.812 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:12:17.813 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:12:17.813 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:12:17.813 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:12:17.813 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 101s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:12:17.813 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:12:17.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:12:17.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:12:17.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:12:17.814 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:12:17.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:12:17.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:12:17.815 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 101s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:12:17.815 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 101s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:12:17.816 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:12:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:17 gibba003 bash[31385]: cluster 2021-03-10T17:12:16.020974+0000 mgr.gibba043.dnkmem (mgr.34373) 10601 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:17 gibba003 bash[32348]: cluster 2021-03-10T17:12:16.020974+0000 mgr.gibba043.dnkmem (mgr.34373) 10601 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:17 gibba043 bash[24019]: cluster 2021-03-10T17:12:16.020974+0000 mgr.gibba043.dnkmem (mgr.34373) 10601 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.061 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:12:18.062 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:12:18.062 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:18.062 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:12:18.062 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:12:18.063 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:18.063 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:12:18.063 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:12:18.063 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:12:18.064 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:12:18.064 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:12:18.064 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:12:18.064 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:12:18.064 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:12:18.065 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:12:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:18 gibba043 bash[24019]: audit 2021-03-10T17:12:17.568488+0000 mgr.gibba043.dnkmem (mgr.34373) 10602 : audit [DBG] from='client.61150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:19.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:18 gibba043 bash[24019]: audit 2021-03-10T17:12:18.062629+0000 mon.c (mon.1) 2730 : audit [DBG] from='client.? 172.21.2.103:0/3550603351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:19.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:18 gibba003 bash[31385]: audit 2021-03-10T17:12:17.568488+0000 mgr.gibba043.dnkmem (mgr.34373) 10602 : audit [DBG] from='client.61150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:19.277 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:18 gibba003 bash[31385]: audit 2021-03-10T17:12:18.062629+0000 mon.c (mon.1) 2730 : audit [DBG] from='client.? 172.21.2.103:0/3550603351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:19.278 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:18 gibba003 bash[32348]: audit 2021-03-10T17:12:17.568488+0000 mgr.gibba043.dnkmem (mgr.34373) 10602 : audit [DBG] from='client.61150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:19.278 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:18 gibba003 bash[32348]: audit 2021-03-10T17:12:18.062629+0000 mon.c (mon.1) 2730 : audit [DBG] from='client.? 172.21.2.103:0/3550603351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:19 gibba043 bash[24019]: audit 2021-03-10T17:12:17.796317+0000 mgr.gibba043.dnkmem (mgr.34373) 10603 : audit [DBG] from='client.61156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:19 gibba043 bash[24019]: cluster 2021-03-10T17:12:18.022307+0000 mgr.gibba043.dnkmem (mgr.34373) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:19 gibba003 bash[31385]: audit 2021-03-10T17:12:17.796317+0000 mgr.gibba043.dnkmem (mgr.34373) 10603 : audit [DBG] from='client.61156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:19 gibba003 bash[31385]: cluster 2021-03-10T17:12:18.022307+0000 mgr.gibba043.dnkmem (mgr.34373) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:19 gibba003 bash[32348]: audit 2021-03-10T17:12:17.796317+0000 mgr.gibba043.dnkmem (mgr.34373) 10603 : audit [DBG] from='client.61156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:20.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:19 gibba003 bash[32348]: cluster 2021-03-10T17:12:18.022307+0000 mgr.gibba043.dnkmem (mgr.34373) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:21 gibba043 bash[24019]: cluster 2021-03-10T17:12:20.023076+0000 mgr.gibba043.dnkmem (mgr.34373) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:21 gibba003 bash[31385]: cluster 2021-03-10T17:12:20.023076+0000 mgr.gibba043.dnkmem (mgr.34373) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:22.429 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:21 gibba003 bash[32348]: cluster 2021-03-10T17:12:20.023076+0000 mgr.gibba043.dnkmem (mgr.34373) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:23 gibba043 bash[24019]: cluster 2021-03-10T17:12:22.024347+0000 mgr.gibba043.dnkmem (mgr.34373) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:23 gibba043 bash[24019]: cephadm 2021-03-10T17:12:22.180566+0000 mgr.gibba043.dnkmem (mgr.34373) 10607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:23 gibba003 bash[31385]: cluster 2021-03-10T17:12:22.024347+0000 mgr.gibba043.dnkmem (mgr.34373) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:23 gibba003 bash[31385]: cephadm 2021-03-10T17:12:22.180566+0000 mgr.gibba043.dnkmem (mgr.34373) 10607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:24.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:23 gibba003 bash[32348]: cluster 2021-03-10T17:12:22.024347+0000 mgr.gibba043.dnkmem (mgr.34373) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:23 gibba003 bash[32348]: cephadm 2021-03-10T17:12:22.180566+0000 mgr.gibba043.dnkmem (mgr.34373) 10607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:25 gibba043 bash[24019]: cluster 2021-03-10T17:12:24.025716+0000 mgr.gibba043.dnkmem (mgr.34373) 10608 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:25 gibba003 bash[31385]: cluster 2021-03-10T17:12:24.025716+0000 mgr.gibba043.dnkmem (mgr.34373) 10608 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:25 gibba003 bash[32348]: cluster 2021-03-10T17:12:24.025716+0000 mgr.gibba043.dnkmem (mgr.34373) 10608 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:27 gibba043 bash[24019]: cluster 2021-03-10T17:12:26.027431+0000 mgr.gibba043.dnkmem (mgr.34373) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:27 gibba003 bash[31385]: cluster 2021-03-10T17:12:26.027431+0000 mgr.gibba043.dnkmem (mgr.34373) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:27 gibba003 bash[32348]: cluster 2021-03-10T17:12:26.027431+0000 mgr.gibba043.dnkmem (mgr.34373) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:28 gibba043 bash[24019]: cluster 2021-03-10T17:12:28.028774+0000 mgr.gibba043.dnkmem (mgr.34373) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:28 gibba003 bash[31385]: cluster 2021-03-10T17:12:28.028774+0000 mgr.gibba043.dnkmem (mgr.34373) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:28 gibba003 bash[32348]: cluster 2021-03-10T17:12:28.028774+0000 mgr.gibba043.dnkmem (mgr.34373) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:31.439 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:31 gibba003 bash[32348]: cluster 2021-03-10T17:12:30.029563+0000 mgr.gibba043.dnkmem (mgr.34373) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:31.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:31 gibba003 bash[31385]: cluster 2021-03-10T17:12:30.029563+0000 mgr.gibba043.dnkmem (mgr.34373) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:31 gibba043 bash[24019]: cluster 2021-03-10T17:12:30.029563+0000 mgr.gibba043.dnkmem (mgr.34373) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:33 gibba003 bash[31385]: cluster 2021-03-10T17:12:32.030959+0000 mgr.gibba043.dnkmem (mgr.34373) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:33 gibba003 bash[32348]: cluster 2021-03-10T17:12:32.030959+0000 mgr.gibba043.dnkmem (mgr.34373) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:33 gibba043 bash[24019]: cluster 2021-03-10T17:12:32.030959+0000 mgr.gibba043.dnkmem (mgr.34373) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:35 gibba003 bash[31385]: cluster 2021-03-10T17:12:34.032511+0000 mgr.gibba043.dnkmem (mgr.34373) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:35 gibba003 bash[32348]: cluster 2021-03-10T17:12:34.032511+0000 mgr.gibba043.dnkmem (mgr.34373) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:35 gibba043 bash[24019]: cluster 2021-03-10T17:12:34.032511+0000 mgr.gibba043.dnkmem (mgr.34373) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: cluster 2021-03-10T17:12:36.034164+0000 mgr.gibba043.dnkmem (mgr.34373) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.428325+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:12:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.432206+0000 mon.c (mon.1) 2731 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.433844+0000 mon.c (mon.1) 2732 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.435327+0000 mon.c (mon.1) 2733 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.437717+0000 mon.c (mon.1) 2734 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.444790+0000 mon.c (mon.1) 2735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:37 gibba043 bash[24019]: audit 2021-03-10T17:12:37.448076+0000 mon.c (mon.1) 2736 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: cluster 2021-03-10T17:12:36.034164+0000 mgr.gibba043.dnkmem (mgr.34373) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.428325+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:12:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.432206+0000 mon.c (mon.1) 2731 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.433844+0000 mon.c (mon.1) 2732 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.435327+0000 mon.c (mon.1) 2733 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.437717+0000 mon.c (mon.1) 2734 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.444790+0000 mon.c (mon.1) 2735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[31385]: audit 2021-03-10T17:12:37.448076+0000 mon.c (mon.1) 2736 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: cluster 2021-03-10T17:12:36.034164+0000 mgr.gibba043.dnkmem (mgr.34373) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.428325+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:12:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.432206+0000 mon.c (mon.1) 2731 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.433844+0000 mon.c (mon.1) 2732 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.435327+0000 mon.c (mon.1) 2733 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.437717+0000 mon.c (mon.1) 2734 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.444790+0000 mon.c (mon.1) 2735 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:37.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:37 gibba003 bash[32348]: audit 2021-03-10T17:12:37.448076+0000 mon.c (mon.1) 2736 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:38.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.197316+0000 mgr.gibba043.dnkmem (mgr.34373) 10615 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:12:38.970 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.198873+0000 mgr.gibba043.dnkmem (mgr.34373) 10616 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:12:38.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.429701+0000 mgr.gibba043.dnkmem (mgr.34373) 10617 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:38.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.431557+0000 mgr.gibba043.dnkmem (mgr.34373) 10618 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:38.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.432911+0000 mgr.gibba043.dnkmem (mgr.34373) 10619 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:38.971 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.432946+0000 mgr.gibba043.dnkmem (mgr.34373) 10620 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:38.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.435299+0000 mgr.gibba043.dnkmem (mgr.34373) 10621 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:38.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.435335+0000 mgr.gibba043.dnkmem (mgr.34373) 10622 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:38.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.437834+0000 mgr.gibba043.dnkmem (mgr.34373) 10623 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:38.972 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.442182+0000 mgr.gibba043.dnkmem (mgr.34373) 10624 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:38.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.442221+0000 mgr.gibba043.dnkmem (mgr.34373) 10625 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:38.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.445220+0000 mgr.gibba043.dnkmem (mgr.34373) 10626 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:38.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.445652+0000 mgr.gibba043.dnkmem (mgr.34373) 10627 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:38.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.448151+0000 mgr.gibba043.dnkmem (mgr.34373) 10628 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:38.973 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.448191+0000 mgr.gibba043.dnkmem (mgr.34373) 10629 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:38.974 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[31385]: cephadm 2021-03-10T17:12:37.448389+0000 mgr.gibba043.dnkmem (mgr.34373) 10630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:38.974 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.197316+0000 mgr.gibba043.dnkmem (mgr.34373) 10615 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:12:38.974 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.198873+0000 mgr.gibba043.dnkmem (mgr.34373) 10616 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:12:38.975 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.429701+0000 mgr.gibba043.dnkmem (mgr.34373) 10617 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:38.975 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.431557+0000 mgr.gibba043.dnkmem (mgr.34373) 10618 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:38.975 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.432911+0000 mgr.gibba043.dnkmem (mgr.34373) 10619 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:38.975 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.432946+0000 mgr.gibba043.dnkmem (mgr.34373) 10620 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:38.975 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.435299+0000 mgr.gibba043.dnkmem (mgr.34373) 10621 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:38.976 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.435335+0000 mgr.gibba043.dnkmem (mgr.34373) 10622 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:38.976 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.437834+0000 mgr.gibba043.dnkmem (mgr.34373) 10623 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:38.976 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.442182+0000 mgr.gibba043.dnkmem (mgr.34373) 10624 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:38.976 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.442221+0000 mgr.gibba043.dnkmem (mgr.34373) 10625 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:38.977 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.445220+0000 mgr.gibba043.dnkmem (mgr.34373) 10626 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:38.977 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.445652+0000 mgr.gibba043.dnkmem (mgr.34373) 10627 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:38.977 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.448151+0000 mgr.gibba043.dnkmem (mgr.34373) 10628 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:38.977 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.448191+0000 mgr.gibba043.dnkmem (mgr.34373) 10629 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:38.977 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:38 gibba003 bash[32348]: cephadm 2021-03-10T17:12:37.448389+0000 mgr.gibba043.dnkmem (mgr.34373) 10630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.197316+0000 mgr.gibba043.dnkmem (mgr.34373) 10615 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:12:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.198873+0000 mgr.gibba043.dnkmem (mgr.34373) 10616 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:12:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.429701+0000 mgr.gibba043.dnkmem (mgr.34373) 10617 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.431557+0000 mgr.gibba043.dnkmem (mgr.34373) 10618 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.432911+0000 mgr.gibba043.dnkmem (mgr.34373) 10619 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.432946+0000 mgr.gibba043.dnkmem (mgr.34373) 10620 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.435299+0000 mgr.gibba043.dnkmem (mgr.34373) 10621 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.435335+0000 mgr.gibba043.dnkmem (mgr.34373) 10622 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.437834+0000 mgr.gibba043.dnkmem (mgr.34373) 10623 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.442182+0000 mgr.gibba043.dnkmem (mgr.34373) 10624 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.442221+0000 mgr.gibba043.dnkmem (mgr.34373) 10625 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.445220+0000 mgr.gibba043.dnkmem (mgr.34373) 10626 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.445652+0000 mgr.gibba043.dnkmem (mgr.34373) 10627 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.448151+0000 mgr.gibba043.dnkmem (mgr.34373) 10628 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.448191+0000 mgr.gibba043.dnkmem (mgr.34373) 10629 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:38 gibba043 bash[24019]: cephadm 2021-03-10T17:12:37.448389+0000 mgr.gibba043.dnkmem (mgr.34373) 10630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:39 gibba003 bash[31385]: cluster 2021-03-10T17:12:38.035783+0000 mgr.gibba043.dnkmem (mgr.34373) 10631 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:39.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:39 gibba003 bash[32348]: cluster 2021-03-10T17:12:38.035783+0000 mgr.gibba043.dnkmem (mgr.34373) 10631 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:39 gibba043 bash[24019]: cluster 2021-03-10T17:12:38.035783+0000 mgr.gibba043.dnkmem (mgr.34373) 10631 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:41 gibba003 bash[31385]: cluster 2021-03-10T17:12:40.036306+0000 mgr.gibba043.dnkmem (mgr.34373) 10632 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:41 gibba003 bash[32348]: cluster 2021-03-10T17:12:40.036306+0000 mgr.gibba043.dnkmem (mgr.34373) 10632 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:41 gibba043 bash[24019]: cluster 2021-03-10T17:12:40.036306+0000 mgr.gibba043.dnkmem (mgr.34373) 10632 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:43 gibba003 bash[31385]: cluster 2021-03-10T17:12:42.037596+0000 mgr.gibba043.dnkmem (mgr.34373) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:43 gibba003 bash[32348]: cluster 2021-03-10T17:12:42.037596+0000 mgr.gibba043.dnkmem (mgr.34373) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:44.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:43 gibba043 bash[24019]: cluster 2021-03-10T17:12:42.037596+0000 mgr.gibba043.dnkmem (mgr.34373) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:45 gibba003 bash[31385]: cluster 2021-03-10T17:12:44.039103+0000 mgr.gibba043.dnkmem (mgr.34373) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:45 gibba003 bash[32348]: cluster 2021-03-10T17:12:44.039103+0000 mgr.gibba043.dnkmem (mgr.34373) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:45 gibba043 bash[24019]: cluster 2021-03-10T17:12:44.039103+0000 mgr.gibba043.dnkmem (mgr.34373) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:47 gibba043 bash[24019]: cluster 2021-03-10T17:12:46.040843+0000 mgr.gibba043.dnkmem (mgr.34373) 10635 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:47 gibba003 bash[31385]: cluster 2021-03-10T17:12:46.040843+0000 mgr.gibba043.dnkmem (mgr.34373) 10635 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:47 gibba003 bash[32348]: cluster 2021-03-10T17:12:46.040843+0000 mgr.gibba043.dnkmem (mgr.34373) 10635 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.303 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:12:48.527 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:12:48.528 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:12:48.528 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:12:48.528 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:12:48.528 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:12:48.529 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:12:48.529 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:12:48.529 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:12:48.529 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:12:48.530 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:12:48.530 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:12:48.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:12:48.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:12:48.530 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:12:48.531 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:12:48.531 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:12:48.531 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:12:48.531 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:12:48.532 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:12:48.532 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:12:48.532 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:12:48.777 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:12:48.778 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:12:48.778 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:48.778 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:12:48.779 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:12:48.779 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:48.779 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:12:48.779 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:12:48.780 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:12:48.780 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:12:48.780 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:12:48.780 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:12:48.781 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:12:48.781 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:12:48.781 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:12:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:49 gibba043 bash[24019]: cluster 2021-03-10T17:12:48.042303+0000 mgr.gibba043.dnkmem (mgr.34373) 10636 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:49 gibba043 bash[24019]: audit 2021-03-10T17:12:48.293341+0000 mgr.gibba043.dnkmem (mgr.34373) 10637 : audit [DBG] from='client.61168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:49 gibba043 bash[24019]: audit 2021-03-10T17:12:48.514841+0000 mgr.gibba043.dnkmem (mgr.34373) 10638 : audit [DBG] from='client.61174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:49 gibba043 bash[24019]: audit 2021-03-10T17:12:48.778909+0000 mon.a (mon.0) 2148 : audit [DBG] from='client.? 172.21.2.103:0/836085883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[31385]: cluster 2021-03-10T17:12:48.042303+0000 mgr.gibba043.dnkmem (mgr.34373) 10636 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[31385]: audit 2021-03-10T17:12:48.293341+0000 mgr.gibba043.dnkmem (mgr.34373) 10637 : audit [DBG] from='client.61168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[31385]: audit 2021-03-10T17:12:48.514841+0000 mgr.gibba043.dnkmem (mgr.34373) 10638 : audit [DBG] from='client.61174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:50.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[31385]: audit 2021-03-10T17:12:48.778909+0000 mon.a (mon.0) 2148 : audit [DBG] from='client.? 172.21.2.103:0/836085883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[32348]: cluster 2021-03-10T17:12:48.042303+0000 mgr.gibba043.dnkmem (mgr.34373) 10636 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[32348]: audit 2021-03-10T17:12:48.293341+0000 mgr.gibba043.dnkmem (mgr.34373) 10637 : audit [DBG] from='client.61168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:50.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[32348]: audit 2021-03-10T17:12:48.514841+0000 mgr.gibba043.dnkmem (mgr.34373) 10638 : audit [DBG] from='client.61174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:50.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:49 gibba003 bash[32348]: audit 2021-03-10T17:12:48.778909+0000 mon.a (mon.0) 2148 : audit [DBG] from='client.? 172.21.2.103:0/836085883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:51 gibba043 bash[24019]: cluster 2021-03-10T17:12:50.042818+0000 mgr.gibba043.dnkmem (mgr.34373) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:51 gibba003 bash[31385]: cluster 2021-03-10T17:12:50.042818+0000 mgr.gibba043.dnkmem (mgr.34373) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:51 gibba003 bash[32348]: cluster 2021-03-10T17:12:50.042818+0000 mgr.gibba043.dnkmem (mgr.34373) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:53 gibba043 bash[24019]: cluster 2021-03-10T17:12:52.044271+0000 mgr.gibba043.dnkmem (mgr.34373) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:53 gibba043 bash[24019]: cephadm 2021-03-10T17:12:52.452963+0000 mgr.gibba043.dnkmem (mgr.34373) 10641 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:53 gibba003 bash[31385]: cluster 2021-03-10T17:12:52.044271+0000 mgr.gibba043.dnkmem (mgr.34373) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:53 gibba003 bash[31385]: cephadm 2021-03-10T17:12:52.452963+0000 mgr.gibba043.dnkmem (mgr.34373) 10641 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:53 gibba003 bash[32348]: cluster 2021-03-10T17:12:52.044271+0000 mgr.gibba043.dnkmem (mgr.34373) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:53 gibba003 bash[32348]: cephadm 2021-03-10T17:12:52.452963+0000 mgr.gibba043.dnkmem (mgr.34373) 10641 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:12:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:55 gibba043 bash[24019]: cluster 2021-03-10T17:12:54.045752+0000 mgr.gibba043.dnkmem (mgr.34373) 10642 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:55 gibba003 bash[31385]: cluster 2021-03-10T17:12:54.045752+0000 mgr.gibba043.dnkmem (mgr.34373) 10642 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:55 gibba003 bash[32348]: cluster 2021-03-10T17:12:54.045752+0000 mgr.gibba043.dnkmem (mgr.34373) 10642 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:57 gibba043 bash[24019]: cluster 2021-03-10T17:12:56.047425+0000 mgr.gibba043.dnkmem (mgr.34373) 10643 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:57 gibba003 bash[31385]: cluster 2021-03-10T17:12:56.047425+0000 mgr.gibba043.dnkmem (mgr.34373) 10643 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:57 gibba003 bash[32348]: cluster 2021-03-10T17:12:56.047425+0000 mgr.gibba043.dnkmem (mgr.34373) 10643 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:12:59 gibba043 bash[24019]: cluster 2021-03-10T17:12:58.048954+0000 mgr.gibba043.dnkmem (mgr.34373) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:12:59 gibba003 bash[31385]: cluster 2021-03-10T17:12:58.048954+0000 mgr.gibba043.dnkmem (mgr.34373) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:12:59 gibba003 bash[32348]: cluster 2021-03-10T17:12:58.048954+0000 mgr.gibba043.dnkmem (mgr.34373) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:00 gibba003 bash[31385]: cluster 2021-03-10T17:13:00.049822+0000 mgr.gibba043.dnkmem (mgr.34373) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:01.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:00 gibba003 bash[32348]: cluster 2021-03-10T17:13:00.049822+0000 mgr.gibba043.dnkmem (mgr.34373) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:00 gibba043 bash[24019]: cluster 2021-03-10T17:13:00.049822+0000 mgr.gibba043.dnkmem (mgr.34373) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:03 gibba003 bash[31385]: cluster 2021-03-10T17:13:02.051078+0000 mgr.gibba043.dnkmem (mgr.34373) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:03.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:03 gibba003 bash[32348]: cluster 2021-03-10T17:13:02.051078+0000 mgr.gibba043.dnkmem (mgr.34373) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:03 gibba043 bash[24019]: cluster 2021-03-10T17:13:02.051078+0000 mgr.gibba043.dnkmem (mgr.34373) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:05 gibba003 bash[31385]: cluster 2021-03-10T17:13:04.052649+0000 mgr.gibba043.dnkmem (mgr.34373) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:05 gibba003 bash[32348]: cluster 2021-03-10T17:13:04.052649+0000 mgr.gibba043.dnkmem (mgr.34373) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:05 gibba043 bash[24019]: cluster 2021-03-10T17:13:04.052649+0000 mgr.gibba043.dnkmem (mgr.34373) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:07 gibba043 bash[24019]: cluster 2021-03-10T17:13:06.054171+0000 mgr.gibba043.dnkmem (mgr.34373) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:07 gibba003 bash[31385]: cluster 2021-03-10T17:13:06.054171+0000 mgr.gibba043.dnkmem (mgr.34373) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:07.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:07 gibba003 bash[32348]: cluster 2021-03-10T17:13:06.054171+0000 mgr.gibba043.dnkmem (mgr.34373) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:08.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:08 gibba003 bash[31385]: cephadm 2021-03-10T17:13:07.469062+0000 mgr.gibba043.dnkmem (mgr.34373) 10649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:08.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:08 gibba003 bash[32348]: cephadm 2021-03-10T17:13:07.469062+0000 mgr.gibba043.dnkmem (mgr.34373) 10649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:09.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:08 gibba043 bash[24019]: cephadm 2021-03-10T17:13:07.469062+0000 mgr.gibba043.dnkmem (mgr.34373) 10649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:09.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:09 gibba003 bash[31385]: cluster 2021-03-10T17:13:08.055933+0000 mgr.gibba043.dnkmem (mgr.34373) 10650 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:09.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:09 gibba003 bash[32348]: cluster 2021-03-10T17:13:08.055933+0000 mgr.gibba043.dnkmem (mgr.34373) 10650 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:09 gibba043 bash[24019]: cluster 2021-03-10T17:13:08.055933+0000 mgr.gibba043.dnkmem (mgr.34373) 10650 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:11 gibba003 bash[31385]: cluster 2021-03-10T17:13:10.056905+0000 mgr.gibba043.dnkmem (mgr.34373) 10651 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:11 gibba003 bash[32348]: cluster 2021-03-10T17:13:10.056905+0000 mgr.gibba043.dnkmem (mgr.34373) 10651 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:11 gibba043 bash[24019]: cluster 2021-03-10T17:13:10.056905+0000 mgr.gibba043.dnkmem (mgr.34373) 10651 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:13 gibba043 bash[24019]: cluster 2021-03-10T17:13:12.058441+0000 mgr.gibba043.dnkmem (mgr.34373) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:13 gibba003 bash[31385]: cluster 2021-03-10T17:13:12.058441+0000 mgr.gibba043.dnkmem (mgr.34373) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:13 gibba003 bash[32348]: cluster 2021-03-10T17:13:12.058441+0000 mgr.gibba043.dnkmem (mgr.34373) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.020705+0000 mon.c (mon.1) 2737 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.021816+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.261300+0000 mon.c (mon.1) 2738 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.262510+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.589590+0000 mon.c (mon.1) 2739 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:13:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.590318+0000 mon.c (mon.1) 2740 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:13:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.590797+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:13:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.591367+0000 mon.c (mon.1) 2741 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.592033+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:13:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.592802+0000 mon.c (mon.1) 2742 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.592813+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:14 gibba043 bash[24019]: audit 2021-03-10T17:13:14.594055+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.020705+0000 mon.c (mon.1) 2737 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.021816+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.261300+0000 mon.c (mon.1) 2738 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.262510+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.589590+0000 mon.c (mon.1) 2739 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:13:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.590318+0000 mon.c (mon.1) 2740 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:13:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.590797+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:13:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.591367+0000 mon.c (mon.1) 2741 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.592033+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:13:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.592802+0000 mon.c (mon.1) 2742 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.592813+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[31385]: audit 2021-03-10T17:13:14.594055+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.020705+0000 mon.c (mon.1) 2737 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.021816+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.261300+0000 mon.c (mon.1) 2738 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.262510+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.589590+0000 mon.c (mon.1) 2739 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:13:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.590318+0000 mon.c (mon.1) 2740 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:13:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.590797+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:13:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.591367+0000 mon.c (mon.1) 2741 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.592033+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:13:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.592802+0000 mon.c (mon.1) 2742 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.592813+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:13:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:14 gibba003 bash[32348]: audit 2021-03-10T17:13:14.594055+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:13:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:15 gibba043 bash[24019]: cluster 2021-03-10T17:13:14.060027+0000 mgr.gibba043.dnkmem (mgr.34373) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:15 gibba003 bash[31385]: cluster 2021-03-10T17:13:14.060027+0000 mgr.gibba043.dnkmem (mgr.34373) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:15 gibba003 bash[32348]: cluster 2021-03-10T17:13:14.060027+0000 mgr.gibba043.dnkmem (mgr.34373) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:17 gibba043 bash[24019]: cluster 2021-03-10T17:13:16.061474+0000 mgr.gibba043.dnkmem (mgr.34373) 10654 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:17 gibba003 bash[31385]: cluster 2021-03-10T17:13:16.061474+0000 mgr.gibba043.dnkmem (mgr.34373) 10654 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:17 gibba003 bash[32348]: cluster 2021-03-10T17:13:16.061474+0000 mgr.gibba043.dnkmem (mgr.34373) 10654 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:19.019 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:13:19.248 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:13:19.248 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:13:19.249 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:13:19.249 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:13:19.249 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:13:19.249 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:13:19.249 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:13:19.250 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:13:19.250 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:13:19.250 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:13:19.250 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:13:19.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:13:19.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:13:19.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:13:19.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:13:19.251 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:13:19.252 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:13:19.252 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:13:19.252 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:13:19.252 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:13:19.253 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:13:19.494 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:13:19.494 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:13:19.495 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:19.495 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:13:19.496 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:13:19.496 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:19.496 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:13:19.497 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:13:19.497 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:13:19.499 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:13:19.499 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:13:19.499 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:13:19.499 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:13:19.500 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:13:19.500 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:13:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:19 gibba043 bash[24019]: cluster 2021-03-10T17:13:18.062985+0000 mgr.gibba043.dnkmem (mgr.34373) 10655 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:19 gibba043 bash[24019]: audit 2021-03-10T17:13:19.494844+0000 mon.c (mon.1) 2743 : audit [DBG] from='client.? 172.21.2.103:0/779819681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:19 gibba003 bash[31385]: cluster 2021-03-10T17:13:18.062985+0000 mgr.gibba043.dnkmem (mgr.34373) 10655 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:19 gibba003 bash[31385]: audit 2021-03-10T17:13:19.494844+0000 mon.c (mon.1) 2743 : audit [DBG] from='client.? 172.21.2.103:0/779819681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:20.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:19 gibba003 bash[32348]: cluster 2021-03-10T17:13:18.062985+0000 mgr.gibba043.dnkmem (mgr.34373) 10655 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:19 gibba003 bash[32348]: audit 2021-03-10T17:13:19.494844+0000 mon.c (mon.1) 2743 : audit [DBG] from='client.? 172.21.2.103:0/779819681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:20 gibba043 bash[24019]: audit 2021-03-10T17:13:19.009904+0000 mgr.gibba043.dnkmem (mgr.34373) 10656 : audit [DBG] from='client.61186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:21.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:20 gibba043 bash[24019]: audit 2021-03-10T17:13:19.235115+0000 mgr.gibba043.dnkmem (mgr.34373) 10657 : audit [DBG] from='client.61192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:20 gibba003 bash[31385]: audit 2021-03-10T17:13:19.009904+0000 mgr.gibba043.dnkmem (mgr.34373) 10656 : audit [DBG] from='client.61186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:21.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:20 gibba003 bash[31385]: audit 2021-03-10T17:13:19.235115+0000 mgr.gibba043.dnkmem (mgr.34373) 10657 : audit [DBG] from='client.61192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:20 gibba003 bash[32348]: audit 2021-03-10T17:13:19.009904+0000 mgr.gibba043.dnkmem (mgr.34373) 10656 : audit [DBG] from='client.61186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:21.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:20 gibba003 bash[32348]: audit 2021-03-10T17:13:19.235115+0000 mgr.gibba043.dnkmem (mgr.34373) 10657 : audit [DBG] from='client.61192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:21 gibba043 bash[24019]: cluster 2021-03-10T17:13:20.064115+0000 mgr.gibba043.dnkmem (mgr.34373) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:21 gibba003 bash[31385]: cluster 2021-03-10T17:13:20.064115+0000 mgr.gibba043.dnkmem (mgr.34373) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:21 gibba003 bash[32348]: cluster 2021-03-10T17:13:20.064115+0000 mgr.gibba043.dnkmem (mgr.34373) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:23 gibba043 bash[24019]: cluster 2021-03-10T17:13:22.065498+0000 mgr.gibba043.dnkmem (mgr.34373) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:23 gibba043 bash[24019]: cephadm 2021-03-10T17:13:22.485115+0000 mgr.gibba043.dnkmem (mgr.34373) 10660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:23 gibba003 bash[31385]: cluster 2021-03-10T17:13:22.065498+0000 mgr.gibba043.dnkmem (mgr.34373) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:23 gibba003 bash[31385]: cephadm 2021-03-10T17:13:22.485115+0000 mgr.gibba043.dnkmem (mgr.34373) 10660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:23 gibba003 bash[32348]: cluster 2021-03-10T17:13:22.065498+0000 mgr.gibba043.dnkmem (mgr.34373) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:23 gibba003 bash[32348]: cephadm 2021-03-10T17:13:22.485115+0000 mgr.gibba043.dnkmem (mgr.34373) 10660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:24 gibba003 bash[31385]: cluster 2021-03-10T17:13:24.065951+0000 mgr.gibba043.dnkmem (mgr.34373) 10661 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:24 gibba003 bash[32348]: cluster 2021-03-10T17:13:24.065951+0000 mgr.gibba043.dnkmem (mgr.34373) 10661 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:24 gibba043 bash[24019]: cluster 2021-03-10T17:13:24.065951+0000 mgr.gibba043.dnkmem (mgr.34373) 10661 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:27.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:27 gibba003 bash[31385]: cluster 2021-03-10T17:13:26.067350+0000 mgr.gibba043.dnkmem (mgr.34373) 10662 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:27.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:27 gibba003 bash[32348]: cluster 2021-03-10T17:13:26.067350+0000 mgr.gibba043.dnkmem (mgr.34373) 10662 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:27.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:27 gibba043 bash[24019]: cluster 2021-03-10T17:13:26.067350+0000 mgr.gibba043.dnkmem (mgr.34373) 10662 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:29 gibba003 bash[31385]: cluster 2021-03-10T17:13:28.068718+0000 mgr.gibba043.dnkmem (mgr.34373) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:29.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:29 gibba003 bash[32348]: cluster 2021-03-10T17:13:28.068718+0000 mgr.gibba043.dnkmem (mgr.34373) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:29 gibba043 bash[24019]: cluster 2021-03-10T17:13:28.068718+0000 mgr.gibba043.dnkmem (mgr.34373) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:31 gibba003 bash[31385]: cluster 2021-03-10T17:13:30.070237+0000 mgr.gibba043.dnkmem (mgr.34373) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:31.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:31 gibba003 bash[32348]: cluster 2021-03-10T17:13:30.070237+0000 mgr.gibba043.dnkmem (mgr.34373) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:31 gibba043 bash[24019]: cluster 2021-03-10T17:13:30.070237+0000 mgr.gibba043.dnkmem (mgr.34373) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:33 gibba003 bash[31385]: cluster 2021-03-10T17:13:32.070737+0000 mgr.gibba043.dnkmem (mgr.34373) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:33 gibba003 bash[32348]: cluster 2021-03-10T17:13:32.070737+0000 mgr.gibba043.dnkmem (mgr.34373) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:33 gibba043 bash[24019]: cluster 2021-03-10T17:13:32.070737+0000 mgr.gibba043.dnkmem (mgr.34373) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:35 gibba003 bash[31385]: cluster 2021-03-10T17:13:34.072173+0000 mgr.gibba043.dnkmem (mgr.34373) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:35.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:35 gibba003 bash[32348]: cluster 2021-03-10T17:13:34.072173+0000 mgr.gibba043.dnkmem (mgr.34373) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:35 gibba043 bash[24019]: cluster 2021-03-10T17:13:34.072173+0000 mgr.gibba043.dnkmem (mgr.34373) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:37 gibba043 bash[24019]: cluster 2021-03-10T17:13:36.074041+0000 mgr.gibba043.dnkmem (mgr.34373) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:37 gibba003 bash[31385]: cluster 2021-03-10T17:13:36.074041+0000 mgr.gibba043.dnkmem (mgr.34373) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:37 gibba003 bash[32348]: cluster 2021-03-10T17:13:36.074041+0000 mgr.gibba043.dnkmem (mgr.34373) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.501785+0000 mgr.gibba043.dnkmem (mgr.34373) 10668 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:13:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.503336+0000 mgr.gibba043.dnkmem (mgr.34373) 10669 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:13:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.735171+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:13:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.736499+0000 mgr.gibba043.dnkmem (mgr.34373) 10670 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.738530+0000 mgr.gibba043.dnkmem (mgr.34373) 10671 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.739142+0000 mon.c (mon.1) 2744 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.739924+0000 mgr.gibba043.dnkmem (mgr.34373) 10672 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.739958+0000 mgr.gibba043.dnkmem (mgr.34373) 10673 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.740776+0000 mon.c (mon.1) 2745 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.741445+0000 mgr.gibba043.dnkmem (mgr.34373) 10674 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.741478+0000 mgr.gibba043.dnkmem (mgr.34373) 10675 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:39.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.742209+0000 mon.c (mon.1) 2746 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.742940+0000 mgr.gibba043.dnkmem (mgr.34373) 10676 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.743684+0000 mon.c (mon.1) 2747 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.744482+0000 mgr.gibba043.dnkmem (mgr.34373) 10677 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.744513+0000 mgr.gibba043.dnkmem (mgr.34373) 10678 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:39.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.745933+0000 mgr.gibba043.dnkmem (mgr.34373) 10679 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:39.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.746251+0000 mgr.gibba043.dnkmem (mgr.34373) 10680 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:39.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.746871+0000 mon.c (mon.1) 2748 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.747551+0000 mgr.gibba043.dnkmem (mgr.34373) 10681 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:39.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.747596+0000 mgr.gibba043.dnkmem (mgr.34373) 10682 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:39.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: cephadm 2021-03-10T17:13:37.747764+0000 mgr.gibba043.dnkmem (mgr.34373) 10683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:39.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:38 gibba043 bash[24019]: audit 2021-03-10T17:13:37.748380+0000 mon.c (mon.1) 2749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.501785+0000 mgr.gibba043.dnkmem (mgr.34373) 10668 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:13:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.503336+0000 mgr.gibba043.dnkmem (mgr.34373) 10669 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:13:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.735171+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:13:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.736499+0000 mgr.gibba043.dnkmem (mgr.34373) 10670 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.738530+0000 mgr.gibba043.dnkmem (mgr.34373) 10671 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.739142+0000 mon.c (mon.1) 2744 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.739924+0000 mgr.gibba043.dnkmem (mgr.34373) 10672 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.739958+0000 mgr.gibba043.dnkmem (mgr.34373) 10673 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.740776+0000 mon.c (mon.1) 2745 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.741445+0000 mgr.gibba043.dnkmem (mgr.34373) 10674 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.741478+0000 mgr.gibba043.dnkmem (mgr.34373) 10675 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:39.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.742209+0000 mon.c (mon.1) 2746 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.742940+0000 mgr.gibba043.dnkmem (mgr.34373) 10676 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:39.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.743684+0000 mon.c (mon.1) 2747 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.744482+0000 mgr.gibba043.dnkmem (mgr.34373) 10677 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:39.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.744513+0000 mgr.gibba043.dnkmem (mgr.34373) 10678 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:39.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.745933+0000 mgr.gibba043.dnkmem (mgr.34373) 10679 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:39.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.746251+0000 mgr.gibba043.dnkmem (mgr.34373) 10680 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:39.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.746871+0000 mon.c (mon.1) 2748 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.747551+0000 mgr.gibba043.dnkmem (mgr.34373) 10681 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:39.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.747596+0000 mgr.gibba043.dnkmem (mgr.34373) 10682 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:39.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: cephadm 2021-03-10T17:13:37.747764+0000 mgr.gibba043.dnkmem (mgr.34373) 10683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:39.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[31385]: audit 2021-03-10T17:13:37.748380+0000 mon.c (mon.1) 2749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.501785+0000 mgr.gibba043.dnkmem (mgr.34373) 10668 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:13:39.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.503336+0000 mgr.gibba043.dnkmem (mgr.34373) 10669 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:13:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.735171+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:13:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.736499+0000 mgr.gibba043.dnkmem (mgr.34373) 10670 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.738530+0000 mgr.gibba043.dnkmem (mgr.34373) 10671 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.739142+0000 mon.c (mon.1) 2744 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:39.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.739924+0000 mgr.gibba043.dnkmem (mgr.34373) 10672 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:39.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.739958+0000 mgr.gibba043.dnkmem (mgr.34373) 10673 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:39.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.740776+0000 mon.c (mon.1) 2745 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.741445+0000 mgr.gibba043.dnkmem (mgr.34373) 10674 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:39.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.741478+0000 mgr.gibba043.dnkmem (mgr.34373) 10675 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:39.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.742209+0000 mon.c (mon.1) 2746 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.742940+0000 mgr.gibba043.dnkmem (mgr.34373) 10676 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:39.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.743684+0000 mon.c (mon.1) 2747 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.744482+0000 mgr.gibba043.dnkmem (mgr.34373) 10677 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:39.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.744513+0000 mgr.gibba043.dnkmem (mgr.34373) 10678 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.745933+0000 mgr.gibba043.dnkmem (mgr.34373) 10679 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.746251+0000 mgr.gibba043.dnkmem (mgr.34373) 10680 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:39.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.746871+0000 mon.c (mon.1) 2748 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:39.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.747551+0000 mgr.gibba043.dnkmem (mgr.34373) 10681 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:39.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.747596+0000 mgr.gibba043.dnkmem (mgr.34373) 10682 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:39.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: cephadm 2021-03-10T17:13:37.747764+0000 mgr.gibba043.dnkmem (mgr.34373) 10683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:39.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:38 gibba003 bash[32348]: audit 2021-03-10T17:13:37.748380+0000 mon.c (mon.1) 2749 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:39 gibba043 bash[24019]: cluster 2021-03-10T17:13:38.075752+0000 mgr.gibba043.dnkmem (mgr.34373) 10684 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:39 gibba003 bash[31385]: cluster 2021-03-10T17:13:38.075752+0000 mgr.gibba043.dnkmem (mgr.34373) 10684 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:40.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:39 gibba003 bash[32348]: cluster 2021-03-10T17:13:38.075752+0000 mgr.gibba043.dnkmem (mgr.34373) 10684 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:42.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:41 gibba043 bash[24019]: cluster 2021-03-10T17:13:40.077190+0000 mgr.gibba043.dnkmem (mgr.34373) 10685 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:41 gibba003 bash[31385]: cluster 2021-03-10T17:13:40.077190+0000 mgr.gibba043.dnkmem (mgr.34373) 10685 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:42.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:41 gibba003 bash[32348]: cluster 2021-03-10T17:13:40.077190+0000 mgr.gibba043.dnkmem (mgr.34373) 10685 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:43.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:43 gibba003 bash[31385]: cluster 2021-03-10T17:13:42.078798+0000 mgr.gibba043.dnkmem (mgr.34373) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:43.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:43 gibba003 bash[32348]: cluster 2021-03-10T17:13:42.078798+0000 mgr.gibba043.dnkmem (mgr.34373) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:43 gibba043 bash[24019]: cluster 2021-03-10T17:13:42.078798+0000 mgr.gibba043.dnkmem (mgr.34373) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:45 gibba003 bash[31385]: cluster 2021-03-10T17:13:44.080361+0000 mgr.gibba043.dnkmem (mgr.34373) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:45 gibba003 bash[32348]: cluster 2021-03-10T17:13:44.080361+0000 mgr.gibba043.dnkmem (mgr.34373) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:45 gibba043 bash[24019]: cluster 2021-03-10T17:13:44.080361+0000 mgr.gibba043.dnkmem (mgr.34373) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:47 gibba003 bash[31385]: cluster 2021-03-10T17:13:46.082135+0000 mgr.gibba043.dnkmem (mgr.34373) 10688 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:47 gibba003 bash[32348]: cluster 2021-03-10T17:13:46.082135+0000 mgr.gibba043.dnkmem (mgr.34373) 10688 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:47 gibba043 bash[24019]: cluster 2021-03-10T17:13:46.082135+0000 mgr.gibba043.dnkmem (mgr.34373) 10688 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:49.737 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:13:49.939 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:49 gibba003 bash[31385]: cluster 2021-03-10T17:13:48.082691+0000 mgr.gibba043.dnkmem (mgr.34373) 10689 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:49.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:49 gibba003 bash[32348]: cluster 2021-03-10T17:13:48.082691+0000 mgr.gibba043.dnkmem (mgr.34373) 10689 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:49.966 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:13:49.967 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:13:49.967 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:13:49.967 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:13:49.967 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:13:49.968 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:13:49.968 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:13:49.968 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:13:49.968 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:13:49.968 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:13:49.969 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:13:49.969 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:13:49.969 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:13:49.969 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:13:49.970 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:13:49.970 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:13:49.970 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:13:49.970 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:13:49.970 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:13:49.971 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:13:49.971 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:13:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:49 gibba043 bash[24019]: cluster 2021-03-10T17:13:48.082691+0000 mgr.gibba043.dnkmem (mgr.34373) 10689 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:50.215 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:13:50.215 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:13:50.216 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:50.216 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:13:50.216 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:13:50.216 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:50.216 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:13:50.217 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:13:50.217 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:13:50.217 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:13:50.217 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:13:50.218 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:13:50.218 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:13:50.218 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:13:50.218 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:13:51.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:50 gibba043 bash[24019]: audit 2021-03-10T17:13:49.727824+0000 mgr.gibba043.dnkmem (mgr.34373) 10690 : audit [DBG] from='client.61204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:51.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:50 gibba043 bash[24019]: audit 2021-03-10T17:13:50.216256+0000 mon.c (mon.1) 2750 : audit [DBG] from='client.? 172.21.2.103:0/1088686446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:50 gibba003 bash[31385]: audit 2021-03-10T17:13:49.727824+0000 mgr.gibba043.dnkmem (mgr.34373) 10690 : audit [DBG] from='client.61204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:50 gibba003 bash[31385]: audit 2021-03-10T17:13:50.216256+0000 mon.c (mon.1) 2750 : audit [DBG] from='client.? 172.21.2.103:0/1088686446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:51.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:50 gibba003 bash[32348]: audit 2021-03-10T17:13:49.727824+0000 mgr.gibba043.dnkmem (mgr.34373) 10690 : audit [DBG] from='client.61204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:50 gibba003 bash[32348]: audit 2021-03-10T17:13:50.216256+0000 mon.c (mon.1) 2750 : audit [DBG] from='client.? 172.21.2.103:0/1088686446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:51 gibba043 bash[24019]: audit 2021-03-10T17:13:49.953432+0000 mgr.gibba043.dnkmem (mgr.34373) 10691 : audit [DBG] from='client.61210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:51 gibba043 bash[24019]: cluster 2021-03-10T17:13:50.083305+0000 mgr.gibba043.dnkmem (mgr.34373) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:51 gibba003 bash[31385]: audit 2021-03-10T17:13:49.953432+0000 mgr.gibba043.dnkmem (mgr.34373) 10691 : audit [DBG] from='client.61210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:51 gibba003 bash[31385]: cluster 2021-03-10T17:13:50.083305+0000 mgr.gibba043.dnkmem (mgr.34373) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:51 gibba003 bash[32348]: audit 2021-03-10T17:13:49.953432+0000 mgr.gibba043.dnkmem (mgr.34373) 10691 : audit [DBG] from='client.61210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:51 gibba003 bash[32348]: cluster 2021-03-10T17:13:50.083305+0000 mgr.gibba043.dnkmem (mgr.34373) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:53 gibba043 bash[24019]: cluster 2021-03-10T17:13:52.084855+0000 mgr.gibba043.dnkmem (mgr.34373) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:53 gibba003 bash[31385]: cluster 2021-03-10T17:13:52.084855+0000 mgr.gibba043.dnkmem (mgr.34373) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:53 gibba003 bash[32348]: cluster 2021-03-10T17:13:52.084855+0000 mgr.gibba043.dnkmem (mgr.34373) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:55.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:54 gibba043 bash[24019]: cephadm 2021-03-10T17:13:52.760484+0000 mgr.gibba043.dnkmem (mgr.34373) 10694 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:54 gibba003 bash[31385]: cephadm 2021-03-10T17:13:52.760484+0000 mgr.gibba043.dnkmem (mgr.34373) 10694 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:55.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:54 gibba003 bash[32348]: cephadm 2021-03-10T17:13:52.760484+0000 mgr.gibba043.dnkmem (mgr.34373) 10694 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:13:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:55 gibba043 bash[24019]: cluster 2021-03-10T17:13:54.086367+0000 mgr.gibba043.dnkmem (mgr.34373) 10695 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:55 gibba003 bash[31385]: cluster 2021-03-10T17:13:54.086367+0000 mgr.gibba043.dnkmem (mgr.34373) 10695 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:55 gibba003 bash[32348]: cluster 2021-03-10T17:13:54.086367+0000 mgr.gibba043.dnkmem (mgr.34373) 10695 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:57 gibba043 bash[24019]: cluster 2021-03-10T17:13:56.087125+0000 mgr.gibba043.dnkmem (mgr.34373) 10696 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:57 gibba003 bash[31385]: cluster 2021-03-10T17:13:56.087125+0000 mgr.gibba043.dnkmem (mgr.34373) 10696 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:57 gibba003 bash[32348]: cluster 2021-03-10T17:13:56.087125+0000 mgr.gibba043.dnkmem (mgr.34373) 10696 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:13:59 gibba043 bash[24019]: cluster 2021-03-10T17:13:58.088528+0000 mgr.gibba043.dnkmem (mgr.34373) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:13:59 gibba003 bash[31385]: cluster 2021-03-10T17:13:58.088528+0000 mgr.gibba043.dnkmem (mgr.34373) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:13:59 gibba003 bash[32348]: cluster 2021-03-10T17:13:58.088528+0000 mgr.gibba043.dnkmem (mgr.34373) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:01 gibba043 bash[24019]: cluster 2021-03-10T17:14:00.090225+0000 mgr.gibba043.dnkmem (mgr.34373) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:02.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:01 gibba003 bash[31385]: cluster 2021-03-10T17:14:00.090225+0000 mgr.gibba043.dnkmem (mgr.34373) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:01 gibba003 bash[32348]: cluster 2021-03-10T17:14:00.090225+0000 mgr.gibba043.dnkmem (mgr.34373) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:03 gibba043 bash[24019]: cluster 2021-03-10T17:14:02.091921+0000 mgr.gibba043.dnkmem (mgr.34373) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:03 gibba003 bash[31385]: cluster 2021-03-10T17:14:02.091921+0000 mgr.gibba043.dnkmem (mgr.34373) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:03 gibba003 bash[32348]: cluster 2021-03-10T17:14:02.091921+0000 mgr.gibba043.dnkmem (mgr.34373) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:05 gibba043 bash[24019]: cluster 2021-03-10T17:14:04.092842+0000 mgr.gibba043.dnkmem (mgr.34373) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:05 gibba003 bash[31385]: cluster 2021-03-10T17:14:04.092842+0000 mgr.gibba043.dnkmem (mgr.34373) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:05 gibba003 bash[32348]: cluster 2021-03-10T17:14:04.092842+0000 mgr.gibba043.dnkmem (mgr.34373) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:06 gibba003 bash[31385]: cluster 2021-03-10T17:14:06.094614+0000 mgr.gibba043.dnkmem (mgr.34373) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:07.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:06 gibba003 bash[32348]: cluster 2021-03-10T17:14:06.094614+0000 mgr.gibba043.dnkmem (mgr.34373) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:06 gibba043 bash[24019]: cluster 2021-03-10T17:14:06.094614+0000 mgr.gibba043.dnkmem (mgr.34373) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:09 gibba003 bash[31385]: cephadm 2021-03-10T17:14:07.776412+0000 mgr.gibba043.dnkmem (mgr.34373) 10702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:09.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:09 gibba003 bash[31385]: cluster 2021-03-10T17:14:08.096164+0000 mgr.gibba043.dnkmem (mgr.34373) 10703 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:09.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:09 gibba003 bash[32348]: cephadm 2021-03-10T17:14:07.776412+0000 mgr.gibba043.dnkmem (mgr.34373) 10702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:09.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:09 gibba003 bash[32348]: cluster 2021-03-10T17:14:08.096164+0000 mgr.gibba043.dnkmem (mgr.34373) 10703 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:10.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:09 gibba043 bash[24019]: cephadm 2021-03-10T17:14:07.776412+0000 mgr.gibba043.dnkmem (mgr.34373) 10702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:09 gibba043 bash[24019]: cluster 2021-03-10T17:14:08.096164+0000 mgr.gibba043.dnkmem (mgr.34373) 10703 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:11 gibba043 bash[24019]: cluster 2021-03-10T17:14:10.097494+0000 mgr.gibba043.dnkmem (mgr.34373) 10704 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:11 gibba003 bash[31385]: cluster 2021-03-10T17:14:10.097494+0000 mgr.gibba043.dnkmem (mgr.34373) 10704 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:11 gibba003 bash[32348]: cluster 2021-03-10T17:14:10.097494+0000 mgr.gibba043.dnkmem (mgr.34373) 10704 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:13 gibba043 bash[24019]: cluster 2021-03-10T17:14:12.098309+0000 mgr.gibba043.dnkmem (mgr.34373) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:13 gibba003 bash[31385]: cluster 2021-03-10T17:14:12.098309+0000 mgr.gibba043.dnkmem (mgr.34373) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:13 gibba003 bash[32348]: cluster 2021-03-10T17:14:12.098309+0000 mgr.gibba043.dnkmem (mgr.34373) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.027537+0000 mon.c (mon.1) 2751 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.028797+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.269080+0000 mon.c (mon.1) 2752 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.270377+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.596923+0000 mon.c (mon.1) 2753 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:14:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.597650+0000 mon.c (mon.1) 2754 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.598280+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:14:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.598319+0000 mon.c (mon.1) 2755 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.599046+0000 mon.c (mon.1) 2756 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.600791+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.602044+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:14 gibba043 bash[24019]: audit 2021-03-10T17:14:14.603269+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.027537+0000 mon.c (mon.1) 2751 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.028797+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.269080+0000 mon.c (mon.1) 2752 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.270377+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.596923+0000 mon.c (mon.1) 2753 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:14:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.597650+0000 mon.c (mon.1) 2754 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.598280+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:14:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.598319+0000 mon.c (mon.1) 2755 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.599046+0000 mon.c (mon.1) 2756 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.600791+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.602044+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[31385]: audit 2021-03-10T17:14:14.603269+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.027537+0000 mon.c (mon.1) 2751 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.028797+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.269080+0000 mon.c (mon.1) 2752 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.270377+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.596923+0000 mon.c (mon.1) 2753 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:14:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.597650+0000 mon.c (mon.1) 2754 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.598280+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:14:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.598319+0000 mon.c (mon.1) 2755 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.599046+0000 mon.c (mon.1) 2756 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.600791+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:14:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.602044+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:14 gibba003 bash[32348]: audit 2021-03-10T17:14:14.603269+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:15 gibba043 bash[24019]: cluster 2021-03-10T17:14:14.099853+0000 mgr.gibba043.dnkmem (mgr.34373) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:15 gibba003 bash[31385]: cluster 2021-03-10T17:14:14.099853+0000 mgr.gibba043.dnkmem (mgr.34373) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:15 gibba003 bash[32348]: cluster 2021-03-10T17:14:14.099853+0000 mgr.gibba043.dnkmem (mgr.34373) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:17 gibba043 bash[24019]: cluster 2021-03-10T17:14:16.101582+0000 mgr.gibba043.dnkmem (mgr.34373) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:17 gibba003 bash[31385]: cluster 2021-03-10T17:14:16.101582+0000 mgr.gibba043.dnkmem (mgr.34373) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:17 gibba003 bash[32348]: cluster 2021-03-10T17:14:16.101582+0000 mgr.gibba043.dnkmem (mgr.34373) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:19 gibba043 bash[24019]: cluster 2021-03-10T17:14:18.102794+0000 mgr.gibba043.dnkmem (mgr.34373) 10708 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:19 gibba003 bash[31385]: cluster 2021-03-10T17:14:18.102794+0000 mgr.gibba043.dnkmem (mgr.34373) 10708 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:19 gibba003 bash[32348]: cluster 2021-03-10T17:14:18.102794+0000 mgr.gibba043.dnkmem (mgr.34373) 10708 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.456 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:14:20.682 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:14:20.682 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:14:20.683 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:14:20.683 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:14:20.683 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:14:20.683 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:14:20.683 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:14:20.684 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:14:20.684 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:14:20.684 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:14:20.684 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:14:20.685 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:14:20.685 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:14:20.685 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:14:20.685 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:14:20.685 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:14:20.687 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:14:20.687 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:14:20.687 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:14:20.687 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:14:20.688 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:14:20.933 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:14:20.933 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:14:20.933 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:20.934 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:14:20.934 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:14:20.934 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:20.934 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:14:20.935 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:14:20.935 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:14:20.935 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:14:20.935 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:14:20.935 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:14:20.936 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:14:20.936 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:14:20.936 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:14:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:21 gibba043 bash[24019]: cluster 2021-03-10T17:14:20.104231+0000 mgr.gibba043.dnkmem (mgr.34373) 10709 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:21 gibba043 bash[24019]: audit 2021-03-10T17:14:20.446457+0000 mgr.gibba043.dnkmem (mgr.34373) 10710 : audit [DBG] from='client.51231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:22.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:21 gibba043 bash[24019]: audit 2021-03-10T17:14:20.668866+0000 mgr.gibba043.dnkmem (mgr.34373) 10711 : audit [DBG] from='client.61228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:22.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:21 gibba043 bash[24019]: audit 2021-03-10T17:14:20.934464+0000 mon.c (mon.1) 2757 : audit [DBG] from='client.? 172.21.2.103:0/1783217229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[31385]: cluster 2021-03-10T17:14:20.104231+0000 mgr.gibba043.dnkmem (mgr.34373) 10709 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[31385]: audit 2021-03-10T17:14:20.446457+0000 mgr.gibba043.dnkmem (mgr.34373) 10710 : audit [DBG] from='client.51231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[31385]: audit 2021-03-10T17:14:20.668866+0000 mgr.gibba043.dnkmem (mgr.34373) 10711 : audit [DBG] from='client.61228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[31385]: audit 2021-03-10T17:14:20.934464+0000 mon.c (mon.1) 2757 : audit [DBG] from='client.? 172.21.2.103:0/1783217229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[32348]: cluster 2021-03-10T17:14:20.104231+0000 mgr.gibba043.dnkmem (mgr.34373) 10709 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[32348]: audit 2021-03-10T17:14:20.446457+0000 mgr.gibba043.dnkmem (mgr.34373) 10710 : audit [DBG] from='client.51231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[32348]: audit 2021-03-10T17:14:20.668866+0000 mgr.gibba043.dnkmem (mgr.34373) 10711 : audit [DBG] from='client.61228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:21 gibba003 bash[32348]: audit 2021-03-10T17:14:20.934464+0000 mon.c (mon.1) 2757 : audit [DBG] from='client.? 172.21.2.103:0/1783217229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:23 gibba043 bash[24019]: cluster 2021-03-10T17:14:22.105881+0000 mgr.gibba043.dnkmem (mgr.34373) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:23 gibba003 bash[31385]: cluster 2021-03-10T17:14:22.105881+0000 mgr.gibba043.dnkmem (mgr.34373) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:23 gibba003 bash[32348]: cluster 2021-03-10T17:14:22.105881+0000 mgr.gibba043.dnkmem (mgr.34373) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:24 gibba043 bash[24019]: cephadm 2021-03-10T17:14:22.784705+0000 mgr.gibba043.dnkmem (mgr.34373) 10713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:24 gibba003 bash[31385]: cephadm 2021-03-10T17:14:22.784705+0000 mgr.gibba043.dnkmem (mgr.34373) 10713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:25.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:24 gibba003 bash[32348]: cephadm 2021-03-10T17:14:22.784705+0000 mgr.gibba043.dnkmem (mgr.34373) 10713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:25 gibba043 bash[24019]: cluster 2021-03-10T17:14:24.107499+0000 mgr.gibba043.dnkmem (mgr.34373) 10714 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:25 gibba003 bash[31385]: cluster 2021-03-10T17:14:24.107499+0000 mgr.gibba043.dnkmem (mgr.34373) 10714 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:25 gibba003 bash[32348]: cluster 2021-03-10T17:14:24.107499+0000 mgr.gibba043.dnkmem (mgr.34373) 10714 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:26 gibba003 bash[31385]: cluster 2021-03-10T17:14:26.109131+0000 mgr.gibba043.dnkmem (mgr.34373) 10715 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:26 gibba003 bash[32348]: cluster 2021-03-10T17:14:26.109131+0000 mgr.gibba043.dnkmem (mgr.34373) 10715 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:26 gibba043 bash[24019]: cluster 2021-03-10T17:14:26.109131+0000 mgr.gibba043.dnkmem (mgr.34373) 10715 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:29 gibba043 bash[24019]: cluster 2021-03-10T17:14:28.110598+0000 mgr.gibba043.dnkmem (mgr.34373) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:29 gibba003 bash[31385]: cluster 2021-03-10T17:14:28.110598+0000 mgr.gibba043.dnkmem (mgr.34373) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:29 gibba003 bash[32348]: cluster 2021-03-10T17:14:28.110598+0000 mgr.gibba043.dnkmem (mgr.34373) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:31 gibba043 bash[24019]: cluster 2021-03-10T17:14:30.112363+0000 mgr.gibba043.dnkmem (mgr.34373) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:31 gibba003 bash[31385]: cluster 2021-03-10T17:14:30.112363+0000 mgr.gibba043.dnkmem (mgr.34373) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:31 gibba003 bash[32348]: cluster 2021-03-10T17:14:30.112363+0000 mgr.gibba043.dnkmem (mgr.34373) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:33 gibba043 bash[24019]: cluster 2021-03-10T17:14:32.113969+0000 mgr.gibba043.dnkmem (mgr.34373) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:33 gibba003 bash[31385]: cluster 2021-03-10T17:14:32.113969+0000 mgr.gibba043.dnkmem (mgr.34373) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:33 gibba003 bash[32348]: cluster 2021-03-10T17:14:32.113969+0000 mgr.gibba043.dnkmem (mgr.34373) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:35 gibba043 bash[24019]: cluster 2021-03-10T17:14:34.115599+0000 mgr.gibba043.dnkmem (mgr.34373) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:35 gibba003 bash[31385]: cluster 2021-03-10T17:14:34.115599+0000 mgr.gibba043.dnkmem (mgr.34373) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:35 gibba003 bash[32348]: cluster 2021-03-10T17:14:34.115599+0000 mgr.gibba043.dnkmem (mgr.34373) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:37 gibba043 bash[24019]: cluster 2021-03-10T17:14:36.116812+0000 mgr.gibba043.dnkmem (mgr.34373) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:37 gibba003 bash[31385]: cluster 2021-03-10T17:14:36.116812+0000 mgr.gibba043.dnkmem (mgr.34373) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:37 gibba003 bash[32348]: cluster 2021-03-10T17:14:36.116812+0000 mgr.gibba043.dnkmem (mgr.34373) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:37.801530+0000 mgr.gibba043.dnkmem (mgr.34373) 10721 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:14:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:37.803084+0000 mgr.gibba043.dnkmem (mgr.34373) 10722 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:14:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.024402+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:14:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.025426+0000 mgr.gibba043.dnkmem (mgr.34373) 10723 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.027560+0000 mgr.gibba043.dnkmem (mgr.34373) 10724 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.027957+0000 mon.c (mon.1) 2758 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.028922+0000 mgr.gibba043.dnkmem (mgr.34373) 10725 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.028959+0000 mgr.gibba043.dnkmem (mgr.34373) 10726 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.029614+0000 mon.c (mon.1) 2759 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.030570+0000 mgr.gibba043.dnkmem (mgr.34373) 10727 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.030606+0000 mgr.gibba043.dnkmem (mgr.34373) 10728 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:39.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.031289+0000 mon.c (mon.1) 2760 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.032162+0000 mgr.gibba043.dnkmem (mgr.34373) 10729 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.032759+0000 mon.c (mon.1) 2761 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.034178+0000 mgr.gibba043.dnkmem (mgr.34373) 10730 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.034215+0000 mgr.gibba043.dnkmem (mgr.34373) 10731 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:39.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.035909+0000 mgr.gibba043.dnkmem (mgr.34373) 10732 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:39.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.036279+0000 mgr.gibba043.dnkmem (mgr.34373) 10733 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:39.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.036521+0000 mon.c (mon.1) 2762 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.037652+0000 mgr.gibba043.dnkmem (mgr.34373) 10734 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:39.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.037695+0000 mgr.gibba043.dnkmem (mgr.34373) 10735 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:39.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cephadm 2021-03-10T17:14:38.037885+0000 mgr.gibba043.dnkmem (mgr.34373) 10736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:39.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: audit 2021-03-10T17:14:38.038440+0000 mon.c (mon.1) 2763 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[31385]: cluster 2021-03-10T17:14:38.117642+0000 mgr.gibba043.dnkmem (mgr.34373) 10737 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:39.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:37.801530+0000 mgr.gibba043.dnkmem (mgr.34373) 10721 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:14:39.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:37.803084+0000 mgr.gibba043.dnkmem (mgr.34373) 10722 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:14:39.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.024402+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:14:39.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.025426+0000 mgr.gibba043.dnkmem (mgr.34373) 10723 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:39.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.027560+0000 mgr.gibba043.dnkmem (mgr.34373) 10724 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:39.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.027957+0000 mon.c (mon.1) 2758 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:39.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.028922+0000 mgr.gibba043.dnkmem (mgr.34373) 10725 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:39.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.028959+0000 mgr.gibba043.dnkmem (mgr.34373) 10726 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:39.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.029614+0000 mon.c (mon.1) 2759 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.030570+0000 mgr.gibba043.dnkmem (mgr.34373) 10727 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:39.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.030606+0000 mgr.gibba043.dnkmem (mgr.34373) 10728 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:39.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.031289+0000 mon.c (mon.1) 2760 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.032162+0000 mgr.gibba043.dnkmem (mgr.34373) 10729 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:39.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.032759+0000 mon.c (mon.1) 2761 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.034178+0000 mgr.gibba043.dnkmem (mgr.34373) 10730 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:39.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.034215+0000 mgr.gibba043.dnkmem (mgr.34373) 10731 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:39.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.035909+0000 mgr.gibba043.dnkmem (mgr.34373) 10732 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:39.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.036279+0000 mgr.gibba043.dnkmem (mgr.34373) 10733 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:39.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.036521+0000 mon.c (mon.1) 2762 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.037652+0000 mgr.gibba043.dnkmem (mgr.34373) 10734 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:39.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.037695+0000 mgr.gibba043.dnkmem (mgr.34373) 10735 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:39.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cephadm 2021-03-10T17:14:38.037885+0000 mgr.gibba043.dnkmem (mgr.34373) 10736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:39.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: audit 2021-03-10T17:14:38.038440+0000 mon.c (mon.1) 2763 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:39 gibba003 bash[32348]: cluster 2021-03-10T17:14:38.117642+0000 mgr.gibba043.dnkmem (mgr.34373) 10737 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:37.801530+0000 mgr.gibba043.dnkmem (mgr.34373) 10721 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:14:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:37.803084+0000 mgr.gibba043.dnkmem (mgr.34373) 10722 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:14:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.024402+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:14:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.025426+0000 mgr.gibba043.dnkmem (mgr.34373) 10723 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.027560+0000 mgr.gibba043.dnkmem (mgr.34373) 10724 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.027957+0000 mon.c (mon.1) 2758 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.028922+0000 mgr.gibba043.dnkmem (mgr.34373) 10725 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.028959+0000 mgr.gibba043.dnkmem (mgr.34373) 10726 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.029614+0000 mon.c (mon.1) 2759 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.030570+0000 mgr.gibba043.dnkmem (mgr.34373) 10727 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.030606+0000 mgr.gibba043.dnkmem (mgr.34373) 10728 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.031289+0000 mon.c (mon.1) 2760 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.032162+0000 mgr.gibba043.dnkmem (mgr.34373) 10729 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.032759+0000 mon.c (mon.1) 2761 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.034178+0000 mgr.gibba043.dnkmem (mgr.34373) 10730 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.034215+0000 mgr.gibba043.dnkmem (mgr.34373) 10731 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:39.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.035909+0000 mgr.gibba043.dnkmem (mgr.34373) 10732 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.036279+0000 mgr.gibba043.dnkmem (mgr.34373) 10733 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.036521+0000 mon.c (mon.1) 2762 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.037652+0000 mgr.gibba043.dnkmem (mgr.34373) 10734 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.037695+0000 mgr.gibba043.dnkmem (mgr.34373) 10735 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:39.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cephadm 2021-03-10T17:14:38.037885+0000 mgr.gibba043.dnkmem (mgr.34373) 10736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:39.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: audit 2021-03-10T17:14:38.038440+0000 mon.c (mon.1) 2763 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:39.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:39 gibba043 bash[24019]: cluster 2021-03-10T17:14:38.117642+0000 mgr.gibba043.dnkmem (mgr.34373) 10737 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:41 gibba003 bash[32348]: cluster 2021-03-10T17:14:40.118987+0000 mgr.gibba043.dnkmem (mgr.34373) 10738 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:41 gibba003 bash[31385]: cluster 2021-03-10T17:14:40.118987+0000 mgr.gibba043.dnkmem (mgr.34373) 10738 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:41 gibba043 bash[24019]: cluster 2021-03-10T17:14:40.118987+0000 mgr.gibba043.dnkmem (mgr.34373) 10738 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:43 gibba043 bash[24019]: cluster 2021-03-10T17:14:42.120527+0000 mgr.gibba043.dnkmem (mgr.34373) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:43 gibba003 bash[31385]: cluster 2021-03-10T17:14:42.120527+0000 mgr.gibba043.dnkmem (mgr.34373) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:43 gibba003 bash[32348]: cluster 2021-03-10T17:14:42.120527+0000 mgr.gibba043.dnkmem (mgr.34373) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:45 gibba043 bash[24019]: cluster 2021-03-10T17:14:44.122199+0000 mgr.gibba043.dnkmem (mgr.34373) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:45 gibba003 bash[31385]: cluster 2021-03-10T17:14:44.122199+0000 mgr.gibba043.dnkmem (mgr.34373) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:45 gibba003 bash[32348]: cluster 2021-03-10T17:14:44.122199+0000 mgr.gibba043.dnkmem (mgr.34373) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:47 gibba043 bash[24019]: cluster 2021-03-10T17:14:46.124033+0000 mgr.gibba043.dnkmem (mgr.34373) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:47 gibba003 bash[31385]: cluster 2021-03-10T17:14:46.124033+0000 mgr.gibba043.dnkmem (mgr.34373) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:47 gibba003 bash[32348]: cluster 2021-03-10T17:14:46.124033+0000 mgr.gibba043.dnkmem (mgr.34373) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:49 gibba043 bash[24019]: cluster 2021-03-10T17:14:48.125447+0000 mgr.gibba043.dnkmem (mgr.34373) 10742 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:49 gibba003 bash[31385]: cluster 2021-03-10T17:14:48.125447+0000 mgr.gibba043.dnkmem (mgr.34373) 10742 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:49 gibba003 bash[32348]: cluster 2021-03-10T17:14:48.125447+0000 mgr.gibba043.dnkmem (mgr.34373) 10742 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:51.175 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:14:51.400 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:14:51.400 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:14:51.401 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:14:51.401 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:14:51.401 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:14:51.401 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:14:51.402 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:14:51.402 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:14:51.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:14:51.404 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:14:51.404 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:14:51.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:14:51.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:14:51.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:14:51.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:14:51.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:14:51.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:14:51.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:14:51.406 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:14:51.406 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:14:51.406 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:14:51.654 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:14:51.655 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:14:51.655 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:51.655 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:14:51.655 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:14:51.656 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:51.656 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:14:51.656 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:14:51.656 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:14:51.657 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:14:51.657 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:14:51.657 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:14:51.657 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:14:51.657 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:14:51.658 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:14:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:51 gibba043 bash[24019]: cluster 2021-03-10T17:14:50.126264+0000 mgr.gibba043.dnkmem (mgr.34373) 10743 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:51 gibba043 bash[24019]: audit 2021-03-10T17:14:51.655785+0000 mon.a (mon.0) 2163 : audit [DBG] from='client.? 172.21.2.103:0/415305464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:51 gibba003 bash[31385]: cluster 2021-03-10T17:14:50.126264+0000 mgr.gibba043.dnkmem (mgr.34373) 10743 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:51 gibba003 bash[31385]: audit 2021-03-10T17:14:51.655785+0000 mon.a (mon.0) 2163 : audit [DBG] from='client.? 172.21.2.103:0/415305464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:51 gibba003 bash[32348]: cluster 2021-03-10T17:14:50.126264+0000 mgr.gibba043.dnkmem (mgr.34373) 10743 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:51 gibba003 bash[32348]: audit 2021-03-10T17:14:51.655785+0000 mon.a (mon.0) 2163 : audit [DBG] from='client.? 172.21.2.103:0/415305464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:53.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:52 gibba043 bash[24019]: audit 2021-03-10T17:14:51.165537+0000 mgr.gibba043.dnkmem (mgr.34373) 10744 : audit [DBG] from='client.51249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:53.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:52 gibba043 bash[24019]: audit 2021-03-10T17:14:51.387864+0000 mgr.gibba043.dnkmem (mgr.34373) 10745 : audit [DBG] from='client.61246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:52 gibba003 bash[31385]: audit 2021-03-10T17:14:51.165537+0000 mgr.gibba043.dnkmem (mgr.34373) 10744 : audit [DBG] from='client.51249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:53.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:52 gibba003 bash[31385]: audit 2021-03-10T17:14:51.387864+0000 mgr.gibba043.dnkmem (mgr.34373) 10745 : audit [DBG] from='client.61246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:52 gibba003 bash[32348]: audit 2021-03-10T17:14:51.165537+0000 mgr.gibba043.dnkmem (mgr.34373) 10744 : audit [DBG] from='client.51249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:53.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:52 gibba003 bash[32348]: audit 2021-03-10T17:14:51.387864+0000 mgr.gibba043.dnkmem (mgr.34373) 10745 : audit [DBG] from='client.61246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:53 gibba043 bash[24019]: cluster 2021-03-10T17:14:52.127070+0000 mgr.gibba043.dnkmem (mgr.34373) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:53 gibba003 bash[31385]: cluster 2021-03-10T17:14:52.127070+0000 mgr.gibba043.dnkmem (mgr.34373) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:53 gibba003 bash[32348]: cluster 2021-03-10T17:14:52.127070+0000 mgr.gibba043.dnkmem (mgr.34373) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:54 gibba043 bash[24019]: cephadm 2021-03-10T17:14:53.052629+0000 mgr.gibba043.dnkmem (mgr.34373) 10747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:55.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:54 gibba003 bash[32348]: cephadm 2021-03-10T17:14:53.052629+0000 mgr.gibba043.dnkmem (mgr.34373) 10747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:54 gibba003 bash[31385]: cephadm 2021-03-10T17:14:53.052629+0000 mgr.gibba043.dnkmem (mgr.34373) 10747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:14:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:55 gibba043 bash[24019]: cluster 2021-03-10T17:14:54.128554+0000 mgr.gibba043.dnkmem (mgr.34373) 10748 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:55 gibba003 bash[31385]: cluster 2021-03-10T17:14:54.128554+0000 mgr.gibba043.dnkmem (mgr.34373) 10748 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:56.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:55 gibba003 bash[32348]: cluster 2021-03-10T17:14:54.128554+0000 mgr.gibba043.dnkmem (mgr.34373) 10748 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:57 gibba043 bash[24019]: cluster 2021-03-10T17:14:56.130204+0000 mgr.gibba043.dnkmem (mgr.34373) 10749 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:57 gibba003 bash[31385]: cluster 2021-03-10T17:14:56.130204+0000 mgr.gibba043.dnkmem (mgr.34373) 10749 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:57 gibba003 bash[32348]: cluster 2021-03-10T17:14:56.130204+0000 mgr.gibba043.dnkmem (mgr.34373) 10749 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:14:59 gibba043 bash[24019]: cluster 2021-03-10T17:14:58.131741+0000 mgr.gibba043.dnkmem (mgr.34373) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:14:59 gibba003 bash[31385]: cluster 2021-03-10T17:14:58.131741+0000 mgr.gibba043.dnkmem (mgr.34373) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:14:59 gibba003 bash[32348]: cluster 2021-03-10T17:14:58.131741+0000 mgr.gibba043.dnkmem (mgr.34373) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:01 gibba003 bash[31385]: cluster 2021-03-10T17:15:00.133164+0000 mgr.gibba043.dnkmem (mgr.34373) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:01 gibba003 bash[32348]: cluster 2021-03-10T17:15:00.133164+0000 mgr.gibba043.dnkmem (mgr.34373) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:01 gibba043 bash[24019]: cluster 2021-03-10T17:15:00.133164+0000 mgr.gibba043.dnkmem (mgr.34373) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:03 gibba003 bash[31385]: cluster 2021-03-10T17:15:02.134882+0000 mgr.gibba043.dnkmem (mgr.34373) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:04.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:03 gibba003 bash[32348]: cluster 2021-03-10T17:15:02.134882+0000 mgr.gibba043.dnkmem (mgr.34373) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:03 gibba043 bash[24019]: cluster 2021-03-10T17:15:02.134882+0000 mgr.gibba043.dnkmem (mgr.34373) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:04 gibba003 bash[31385]: cluster 2021-03-10T17:15:04.136748+0000 mgr.gibba043.dnkmem (mgr.34373) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:04 gibba003 bash[32348]: cluster 2021-03-10T17:15:04.136748+0000 mgr.gibba043.dnkmem (mgr.34373) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:04 gibba043 bash[24019]: cluster 2021-03-10T17:15:04.136748+0000 mgr.gibba043.dnkmem (mgr.34373) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:07.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:07 gibba043 bash[24019]: cluster 2021-03-10T17:15:06.138651+0000 mgr.gibba043.dnkmem (mgr.34373) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:07.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:07 gibba003 bash[31385]: cluster 2021-03-10T17:15:06.138651+0000 mgr.gibba043.dnkmem (mgr.34373) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:07.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:07 gibba003 bash[32348]: cluster 2021-03-10T17:15:06.138651+0000 mgr.gibba043.dnkmem (mgr.34373) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:09 gibba043 bash[24019]: cephadm 2021-03-10T17:15:08.068599+0000 mgr.gibba043.dnkmem (mgr.34373) 10755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:09 gibba043 bash[24019]: cluster 2021-03-10T17:15:08.140061+0000 mgr.gibba043.dnkmem (mgr.34373) 10756 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:09 gibba003 bash[31385]: cephadm 2021-03-10T17:15:08.068599+0000 mgr.gibba043.dnkmem (mgr.34373) 10755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:09 gibba003 bash[31385]: cluster 2021-03-10T17:15:08.140061+0000 mgr.gibba043.dnkmem (mgr.34373) 10756 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:09 gibba003 bash[32348]: cephadm 2021-03-10T17:15:08.068599+0000 mgr.gibba043.dnkmem (mgr.34373) 10755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:09 gibba003 bash[32348]: cluster 2021-03-10T17:15:08.140061+0000 mgr.gibba043.dnkmem (mgr.34373) 10756 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:11 gibba043 bash[24019]: cluster 2021-03-10T17:15:10.141622+0000 mgr.gibba043.dnkmem (mgr.34373) 10757 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:12.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:11 gibba003 bash[32348]: cluster 2021-03-10T17:15:10.141622+0000 mgr.gibba043.dnkmem (mgr.34373) 10757 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:11 gibba003 bash[31385]: cluster 2021-03-10T17:15:10.141622+0000 mgr.gibba043.dnkmem (mgr.34373) 10757 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:13 gibba043 bash[24019]: cluster 2021-03-10T17:15:12.143133+0000 mgr.gibba043.dnkmem (mgr.34373) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:13 gibba003 bash[31385]: cluster 2021-03-10T17:15:12.143133+0000 mgr.gibba043.dnkmem (mgr.34373) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:13 gibba003 bash[32348]: cluster 2021-03-10T17:15:12.143133+0000 mgr.gibba043.dnkmem (mgr.34373) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.034438+0000 mon.c (mon.1) 2764 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.035614+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.276680+0000 mon.c (mon.1) 2765 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.277800+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.603383+0000 mon.c (mon.1) 2766 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:15:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.604227+0000 mon.c (mon.1) 2767 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.604637+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:15:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.605172+0000 mon.c (mon.1) 2768 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.605872+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.606443+0000 mon.c (mon.1) 2769 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.606863+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:14 gibba043 bash[24019]: audit 2021-03-10T17:15:14.607446+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.034438+0000 mon.c (mon.1) 2764 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.035614+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.276680+0000 mon.c (mon.1) 2765 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.277800+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.603383+0000 mon.c (mon.1) 2766 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:15:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.604227+0000 mon.c (mon.1) 2767 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.604637+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:15:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.605172+0000 mon.c (mon.1) 2768 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.605872+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.606443+0000 mon.c (mon.1) 2769 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.606863+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[31385]: audit 2021-03-10T17:15:14.607446+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.034438+0000 mon.c (mon.1) 2764 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.035614+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.276680+0000 mon.c (mon.1) 2765 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.277800+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.603383+0000 mon.c (mon.1) 2766 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:15:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.604227+0000 mon.c (mon.1) 2767 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.604637+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:15:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.605172+0000 mon.c (mon.1) 2768 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.605872+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.606443+0000 mon.c (mon.1) 2769 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.606863+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:15:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:14 gibba003 bash[32348]: audit 2021-03-10T17:15:14.607446+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:15 gibba043 bash[24019]: cluster 2021-03-10T17:15:14.144702+0000 mgr.gibba043.dnkmem (mgr.34373) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:15 gibba003 bash[31385]: cluster 2021-03-10T17:15:14.144702+0000 mgr.gibba043.dnkmem (mgr.34373) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:15 gibba003 bash[32348]: cluster 2021-03-10T17:15:14.144702+0000 mgr.gibba043.dnkmem (mgr.34373) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:17 gibba043 bash[24019]: cluster 2021-03-10T17:15:16.146202+0000 mgr.gibba043.dnkmem (mgr.34373) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:17 gibba003 bash[31385]: cluster 2021-03-10T17:15:16.146202+0000 mgr.gibba043.dnkmem (mgr.34373) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:17 gibba003 bash[32348]: cluster 2021-03-10T17:15:16.146202+0000 mgr.gibba043.dnkmem (mgr.34373) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:19 gibba043 bash[24019]: cluster 2021-03-10T17:15:18.147708+0000 mgr.gibba043.dnkmem (mgr.34373) 10761 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:19 gibba003 bash[31385]: cluster 2021-03-10T17:15:18.147708+0000 mgr.gibba043.dnkmem (mgr.34373) 10761 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:19 gibba003 bash[32348]: cluster 2021-03-10T17:15:18.147708+0000 mgr.gibba043.dnkmem (mgr.34373) 10761 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:21.902 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:15:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:21 gibba043 bash[24019]: cluster 2021-03-10T17:15:20.149405+0000 mgr.gibba043.dnkmem (mgr.34373) 10762 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:22.129 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:15:22.130 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:15:22.130 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:15:22.130 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:15:22.130 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:15:22.131 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:15:22.131 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:15:22.131 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:15:22.131 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:15:22.132 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:15:22.132 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:15:22.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:15:22.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:15:22.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:15:22.133 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:15:22.133 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:15:22.133 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:15:22.133 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:15:22.134 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:15:22.134 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:15:22.134 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:15:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:21 gibba003 bash[31385]: cluster 2021-03-10T17:15:20.149405+0000 mgr.gibba043.dnkmem (mgr.34373) 10762 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:22.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:21 gibba003 bash[32348]: cluster 2021-03-10T17:15:20.149405+0000 mgr.gibba043.dnkmem (mgr.34373) 10762 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:22.380 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:15:22.381 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:15:22.381 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:22.381 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:15:22.381 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:15:22.382 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:22.382 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:15:22.382 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:15:22.383 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:15:22.383 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:15:22.383 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:15:22.383 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:15:22.384 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:15:22.384 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:15:22.385 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:15:23.073 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:22 gibba043 bash[24019]: audit 2021-03-10T17:15:22.381577+0000 mon.c (mon.1) 2770 : audit [DBG] from='client.? 172.21.2.103:0/169183275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:23.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:22 gibba003 bash[31385]: audit 2021-03-10T17:15:22.381577+0000 mon.c (mon.1) 2770 : audit [DBG] from='client.? 172.21.2.103:0/169183275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:23.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:22 gibba003 bash[32348]: audit 2021-03-10T17:15:22.381577+0000 mon.c (mon.1) 2770 : audit [DBG] from='client.? 172.21.2.103:0/169183275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:23 gibba003 bash[31385]: audit 2021-03-10T17:15:21.893121+0000 mgr.gibba043.dnkmem (mgr.34373) 10763 : audit [DBG] from='client.51267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:23 gibba003 bash[31385]: audit 2021-03-10T17:15:22.116233+0000 mgr.gibba043.dnkmem (mgr.34373) 10764 : audit [DBG] from='client.61264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:23 gibba003 bash[31385]: cluster 2021-03-10T17:15:22.150182+0000 mgr.gibba043.dnkmem (mgr.34373) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:23 gibba003 bash[32348]: audit 2021-03-10T17:15:21.893121+0000 mgr.gibba043.dnkmem (mgr.34373) 10763 : audit [DBG] from='client.51267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:23 gibba003 bash[32348]: audit 2021-03-10T17:15:22.116233+0000 mgr.gibba043.dnkmem (mgr.34373) 10764 : audit [DBG] from='client.61264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:24.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:23 gibba003 bash[32348]: cluster 2021-03-10T17:15:22.150182+0000 mgr.gibba043.dnkmem (mgr.34373) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:23 gibba043 bash[24019]: audit 2021-03-10T17:15:21.893121+0000 mgr.gibba043.dnkmem (mgr.34373) 10763 : audit [DBG] from='client.51267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:23 gibba043 bash[24019]: audit 2021-03-10T17:15:22.116233+0000 mgr.gibba043.dnkmem (mgr.34373) 10764 : audit [DBG] from='client.61264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:23 gibba043 bash[24019]: cluster 2021-03-10T17:15:22.150182+0000 mgr.gibba043.dnkmem (mgr.34373) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:24 gibba003 bash[31385]: cephadm 2021-03-10T17:15:23.071981+0000 mgr.gibba043.dnkmem (mgr.34373) 10766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:25.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:24 gibba003 bash[32348]: cephadm 2021-03-10T17:15:23.071981+0000 mgr.gibba043.dnkmem (mgr.34373) 10766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:24 gibba043 bash[24019]: cephadm 2021-03-10T17:15:23.071981+0000 mgr.gibba043.dnkmem (mgr.34373) 10766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:25 gibba003 bash[31385]: cluster 2021-03-10T17:15:24.151461+0000 mgr.gibba043.dnkmem (mgr.34373) 10767 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:25 gibba003 bash[32348]: cluster 2021-03-10T17:15:24.151461+0000 mgr.gibba043.dnkmem (mgr.34373) 10767 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:25 gibba043 bash[24019]: cluster 2021-03-10T17:15:24.151461+0000 mgr.gibba043.dnkmem (mgr.34373) 10767 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:26 gibba003 bash[31385]: cluster 2021-03-10T17:15:26.153121+0000 mgr.gibba043.dnkmem (mgr.34373) 10768 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:26 gibba003 bash[32348]: cluster 2021-03-10T17:15:26.153121+0000 mgr.gibba043.dnkmem (mgr.34373) 10768 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:26 gibba043 bash[24019]: cluster 2021-03-10T17:15:26.153121+0000 mgr.gibba043.dnkmem (mgr.34373) 10768 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:29 gibba043 bash[24019]: cluster 2021-03-10T17:15:28.154335+0000 mgr.gibba043.dnkmem (mgr.34373) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:29 gibba003 bash[31385]: cluster 2021-03-10T17:15:28.154335+0000 mgr.gibba043.dnkmem (mgr.34373) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:30.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:29 gibba003 bash[32348]: cluster 2021-03-10T17:15:28.154335+0000 mgr.gibba043.dnkmem (mgr.34373) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:31 gibba043 bash[24019]: cluster 2021-03-10T17:15:30.155763+0000 mgr.gibba043.dnkmem (mgr.34373) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:31 gibba003 bash[31385]: cluster 2021-03-10T17:15:30.155763+0000 mgr.gibba043.dnkmem (mgr.34373) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:31 gibba003 bash[32348]: cluster 2021-03-10T17:15:30.155763+0000 mgr.gibba043.dnkmem (mgr.34373) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:33 gibba043 bash[24019]: cluster 2021-03-10T17:15:32.157159+0000 mgr.gibba043.dnkmem (mgr.34373) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:33 gibba003 bash[31385]: cluster 2021-03-10T17:15:32.157159+0000 mgr.gibba043.dnkmem (mgr.34373) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:33 gibba003 bash[32348]: cluster 2021-03-10T17:15:32.157159+0000 mgr.gibba043.dnkmem (mgr.34373) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:35 gibba043 bash[24019]: cluster 2021-03-10T17:15:34.158491+0000 mgr.gibba043.dnkmem (mgr.34373) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:35 gibba003 bash[31385]: cluster 2021-03-10T17:15:34.158491+0000 mgr.gibba043.dnkmem (mgr.34373) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:35 gibba003 bash[32348]: cluster 2021-03-10T17:15:34.158491+0000 mgr.gibba043.dnkmem (mgr.34373) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:37 gibba043 bash[24019]: cluster 2021-03-10T17:15:36.160346+0000 mgr.gibba043.dnkmem (mgr.34373) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:37 gibba003 bash[31385]: cluster 2021-03-10T17:15:36.160346+0000 mgr.gibba043.dnkmem (mgr.34373) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:37 gibba003 bash[32348]: cluster 2021-03-10T17:15:36.160346+0000 mgr.gibba043.dnkmem (mgr.34373) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.088860+0000 mgr.gibba043.dnkmem (mgr.34373) 10774 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:15:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.090416+0000 mgr.gibba043.dnkmem (mgr.34373) 10775 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:15:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cluster 2021-03-10T17:15:38.160810+0000 mgr.gibba043.dnkmem (mgr.34373) 10776 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:39.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.308458+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:15:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.309675+0000 mgr.gibba043.dnkmem (mgr.34373) 10777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.311585+0000 mgr.gibba043.dnkmem (mgr.34373) 10778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.312168+0000 mon.c (mon.1) 2771 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.313219+0000 mgr.gibba043.dnkmem (mgr.34373) 10779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.313256+0000 mgr.gibba043.dnkmem (mgr.34373) 10780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.313866+0000 mon.c (mon.1) 2772 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.314699+0000 mgr.gibba043.dnkmem (mgr.34373) 10781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.314736+0000 mgr.gibba043.dnkmem (mgr.34373) 10782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.315321+0000 mon.c (mon.1) 2773 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.316011+0000 mgr.gibba043.dnkmem (mgr.34373) 10783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.316831+0000 mon.c (mon.1) 2774 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.318076+0000 mgr.gibba043.dnkmem (mgr.34373) 10784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.318113+0000 mgr.gibba043.dnkmem (mgr.34373) 10785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.319779+0000 mgr.gibba043.dnkmem (mgr.34373) 10786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.320102+0000 mgr.gibba043.dnkmem (mgr.34373) 10787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.320387+0000 mon.c (mon.1) 2775 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.321690+0000 mgr.gibba043.dnkmem (mgr.34373) 10788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:39.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.088860+0000 mgr.gibba043.dnkmem (mgr.34373) 10774 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:15:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.090416+0000 mgr.gibba043.dnkmem (mgr.34373) 10775 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:15:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cluster 2021-03-10T17:15:38.160810+0000 mgr.gibba043.dnkmem (mgr.34373) 10776 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.308458+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:15:39.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.309675+0000 mgr.gibba043.dnkmem (mgr.34373) 10777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.311585+0000 mgr.gibba043.dnkmem (mgr.34373) 10778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.312168+0000 mon.c (mon.1) 2771 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.313219+0000 mgr.gibba043.dnkmem (mgr.34373) 10779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:39.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.313256+0000 mgr.gibba043.dnkmem (mgr.34373) 10780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.313866+0000 mon.c (mon.1) 2772 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.314699+0000 mgr.gibba043.dnkmem (mgr.34373) 10781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.314736+0000 mgr.gibba043.dnkmem (mgr.34373) 10782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:39.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.315321+0000 mon.c (mon.1) 2773 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.316011+0000 mgr.gibba043.dnkmem (mgr.34373) 10783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.316831+0000 mon.c (mon.1) 2774 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.318076+0000 mgr.gibba043.dnkmem (mgr.34373) 10784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.318113+0000 mgr.gibba043.dnkmem (mgr.34373) 10785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:39.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.319779+0000 mgr.gibba043.dnkmem (mgr.34373) 10786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.320102+0000 mgr.gibba043.dnkmem (mgr.34373) 10787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.320387+0000 mon.c (mon.1) 2775 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.321690+0000 mgr.gibba043.dnkmem (mgr.34373) 10788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.321729+0000 mgr.gibba043.dnkmem (mgr.34373) 10789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:39.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: cephadm 2021-03-10T17:15:38.321833+0000 mgr.gibba043.dnkmem (mgr.34373) 10790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:39.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[32348]: audit 2021-03-10T17:15:38.322223+0000 mon.c (mon.1) 2776 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.321729+0000 mgr.gibba043.dnkmem (mgr.34373) 10789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:39.702 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: cephadm 2021-03-10T17:15:38.321833+0000 mgr.gibba043.dnkmem (mgr.34373) 10790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:39.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:39 gibba003 bash[31385]: audit 2021-03-10T17:15:38.322223+0000 mon.c (mon.1) 2776 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.088860+0000 mgr.gibba043.dnkmem (mgr.34373) 10774 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:15:39.902 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.090416+0000 mgr.gibba043.dnkmem (mgr.34373) 10775 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:15:39.903 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cluster 2021-03-10T17:15:38.160810+0000 mgr.gibba043.dnkmem (mgr.34373) 10776 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:39.903 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.308458+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:15:39.904 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.309675+0000 mgr.gibba043.dnkmem (mgr.34373) 10777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:39.904 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.311585+0000 mgr.gibba043.dnkmem (mgr.34373) 10778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:39.905 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.312168+0000 mon.c (mon.1) 2771 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:39.905 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.313219+0000 mgr.gibba043.dnkmem (mgr.34373) 10779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:39.906 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.313256+0000 mgr.gibba043.dnkmem (mgr.34373) 10780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:39.906 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.313866+0000 mon.c (mon.1) 2772 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.907 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.314699+0000 mgr.gibba043.dnkmem (mgr.34373) 10781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:39.908 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.314736+0000 mgr.gibba043.dnkmem (mgr.34373) 10782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:39.908 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.315321+0000 mon.c (mon.1) 2773 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.909 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.316011+0000 mgr.gibba043.dnkmem (mgr.34373) 10783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:39.910 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.316831+0000 mon.c (mon.1) 2774 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.911 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.318076+0000 mgr.gibba043.dnkmem (mgr.34373) 10784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:39.911 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.318113+0000 mgr.gibba043.dnkmem (mgr.34373) 10785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:39.911 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.319779+0000 mgr.gibba043.dnkmem (mgr.34373) 10786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:39.912 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.320102+0000 mgr.gibba043.dnkmem (mgr.34373) 10787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:39.912 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.320387+0000 mon.c (mon.1) 2775 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.913 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.321690+0000 mgr.gibba043.dnkmem (mgr.34373) 10788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:39.913 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.321729+0000 mgr.gibba043.dnkmem (mgr.34373) 10789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:39.913 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: cephadm 2021-03-10T17:15:38.321833+0000 mgr.gibba043.dnkmem (mgr.34373) 10790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:39.914 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:39 gibba043 bash[24019]: audit 2021-03-10T17:15:38.322223+0000 mon.c (mon.1) 2776 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:41.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:41 gibba003 bash[31385]: cluster 2021-03-10T17:15:40.162235+0000 mgr.gibba043.dnkmem (mgr.34373) 10791 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:41 gibba003 bash[32348]: cluster 2021-03-10T17:15:40.162235+0000 mgr.gibba043.dnkmem (mgr.34373) 10791 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:41 gibba043 bash[24019]: cluster 2021-03-10T17:15:40.162235+0000 mgr.gibba043.dnkmem (mgr.34373) 10791 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:43 gibba043 bash[24019]: cluster 2021-03-10T17:15:42.163753+0000 mgr.gibba043.dnkmem (mgr.34373) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:43 gibba003 bash[31385]: cluster 2021-03-10T17:15:42.163753+0000 mgr.gibba043.dnkmem (mgr.34373) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:43 gibba003 bash[32348]: cluster 2021-03-10T17:15:42.163753+0000 mgr.gibba043.dnkmem (mgr.34373) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:46.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:45 gibba043 bash[24019]: cluster 2021-03-10T17:15:44.165344+0000 mgr.gibba043.dnkmem (mgr.34373) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:45 gibba003 bash[31385]: cluster 2021-03-10T17:15:44.165344+0000 mgr.gibba043.dnkmem (mgr.34373) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:46.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:45 gibba003 bash[32348]: cluster 2021-03-10T17:15:44.165344+0000 mgr.gibba043.dnkmem (mgr.34373) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:47 gibba043 bash[24019]: cluster 2021-03-10T17:15:46.167218+0000 mgr.gibba043.dnkmem (mgr.34373) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:47 gibba003 bash[31385]: cluster 2021-03-10T17:15:46.167218+0000 mgr.gibba043.dnkmem (mgr.34373) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:47 gibba003 bash[32348]: cluster 2021-03-10T17:15:46.167218+0000 mgr.gibba043.dnkmem (mgr.34373) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:49 gibba043 bash[24019]: cluster 2021-03-10T17:15:48.168751+0000 mgr.gibba043.dnkmem (mgr.34373) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:49 gibba003 bash[31385]: cluster 2021-03-10T17:15:48.168751+0000 mgr.gibba043.dnkmem (mgr.34373) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:49 gibba003 bash[32348]: cluster 2021-03-10T17:15:48.168751+0000 mgr.gibba043.dnkmem (mgr.34373) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:51 gibba043 bash[24019]: cluster 2021-03-10T17:15:50.170304+0000 mgr.gibba043.dnkmem (mgr.34373) 10796 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:51 gibba003 bash[31385]: cluster 2021-03-10T17:15:50.170304+0000 mgr.gibba043.dnkmem (mgr.34373) 10796 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:51 gibba003 bash[32348]: cluster 2021-03-10T17:15:50.170304+0000 mgr.gibba043.dnkmem (mgr.34373) 10796 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.620 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:15:52.848 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:15:52.849 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:15:52.849 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:15:52.850 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:15:52.850 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:15:52.851 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:15:52.851 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:15:52.852 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:15:52.852 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:15:52.852 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:15:52.853 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:15:52.853 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:15:52.860 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:15:52.861 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:15:52.861 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:15:52.861 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:15:52.862 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:15:52.862 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:15:52.863 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:15:52.863 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:15:52.864 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:15:53.100 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:15:53.101 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:15:53.101 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:53.101 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:15:53.101 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:15:53.102 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:53.102 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:15:53.102 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:15:53.103 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:15:53.103 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:15:53.104 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:15:53.104 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:15:53.105 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:15:53.105 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:15:53.105 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:15:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:53 gibba043 bash[24019]: cluster 2021-03-10T17:15:52.171859+0000 mgr.gibba043.dnkmem (mgr.34373) 10797 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:53 gibba043 bash[24019]: audit 2021-03-10T17:15:52.610538+0000 mgr.gibba043.dnkmem (mgr.34373) 10798 : audit [DBG] from='client.51285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:54.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:53 gibba043 bash[24019]: audit 2021-03-10T17:15:53.101341+0000 mon.c (mon.1) 2777 : audit [DBG] from='client.? 172.21.2.103:0/1601708683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:53 gibba003 bash[31385]: cluster 2021-03-10T17:15:52.171859+0000 mgr.gibba043.dnkmem (mgr.34373) 10797 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:53 gibba003 bash[31385]: audit 2021-03-10T17:15:52.610538+0000 mgr.gibba043.dnkmem (mgr.34373) 10798 : audit [DBG] from='client.51285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:53 gibba003 bash[31385]: audit 2021-03-10T17:15:53.101341+0000 mon.c (mon.1) 2777 : audit [DBG] from='client.? 172.21.2.103:0/1601708683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:54.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:53 gibba003 bash[32348]: cluster 2021-03-10T17:15:52.171859+0000 mgr.gibba043.dnkmem (mgr.34373) 10797 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:53 gibba003 bash[32348]: audit 2021-03-10T17:15:52.610538+0000 mgr.gibba043.dnkmem (mgr.34373) 10798 : audit [DBG] from='client.51285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:54.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:53 gibba003 bash[32348]: audit 2021-03-10T17:15:53.101341+0000 mon.c (mon.1) 2777 : audit [DBG] from='client.? 172.21.2.103:0/1601708683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:55.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:54 gibba043 bash[24019]: audit 2021-03-10T17:15:52.835593+0000 mgr.gibba043.dnkmem (mgr.34373) 10799 : audit [DBG] from='client.51291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:54 gibba043 bash[24019]: cephadm 2021-03-10T17:15:53.337857+0000 mgr.gibba043.dnkmem (mgr.34373) 10800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:54 gibba003 bash[31385]: audit 2021-03-10T17:15:52.835593+0000 mgr.gibba043.dnkmem (mgr.34373) 10799 : audit [DBG] from='client.51291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:55.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:54 gibba003 bash[31385]: cephadm 2021-03-10T17:15:53.337857+0000 mgr.gibba043.dnkmem (mgr.34373) 10800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:54 gibba003 bash[32348]: audit 2021-03-10T17:15:52.835593+0000 mgr.gibba043.dnkmem (mgr.34373) 10799 : audit [DBG] from='client.51291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:54 gibba003 bash[32348]: cephadm 2021-03-10T17:15:53.337857+0000 mgr.gibba043.dnkmem (mgr.34373) 10800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:15:56.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:55 gibba003 bash[31385]: cluster 2021-03-10T17:15:54.173198+0000 mgr.gibba043.dnkmem (mgr.34373) 10801 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:56.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:55 gibba003 bash[32348]: cluster 2021-03-10T17:15:54.173198+0000 mgr.gibba043.dnkmem (mgr.34373) 10801 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:55 gibba043 bash[24019]: cluster 2021-03-10T17:15:54.173198+0000 mgr.gibba043.dnkmem (mgr.34373) 10801 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:57 gibba003 bash[31385]: cluster 2021-03-10T17:15:56.175040+0000 mgr.gibba043.dnkmem (mgr.34373) 10802 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:57 gibba003 bash[32348]: cluster 2021-03-10T17:15:56.175040+0000 mgr.gibba043.dnkmem (mgr.34373) 10802 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:57 gibba043 bash[24019]: cluster 2021-03-10T17:15:56.175040+0000 mgr.gibba043.dnkmem (mgr.34373) 10802 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:15:59 gibba003 bash[31385]: cluster 2021-03-10T17:15:58.176629+0000 mgr.gibba043.dnkmem (mgr.34373) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:15:59 gibba003 bash[32348]: cluster 2021-03-10T17:15:58.176629+0000 mgr.gibba043.dnkmem (mgr.34373) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:15:59 gibba043 bash[24019]: cluster 2021-03-10T17:15:58.176629+0000 mgr.gibba043.dnkmem (mgr.34373) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:00 gibba003 bash[31385]: cluster 2021-03-10T17:16:00.177986+0000 mgr.gibba043.dnkmem (mgr.34373) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:00 gibba003 bash[32348]: cluster 2021-03-10T17:16:00.177986+0000 mgr.gibba043.dnkmem (mgr.34373) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:00 gibba043 bash[24019]: cluster 2021-03-10T17:16:00.177986+0000 mgr.gibba043.dnkmem (mgr.34373) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:03 gibba043 bash[24019]: cluster 2021-03-10T17:16:02.179630+0000 mgr.gibba043.dnkmem (mgr.34373) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:03 gibba003 bash[31385]: cluster 2021-03-10T17:16:02.179630+0000 mgr.gibba043.dnkmem (mgr.34373) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:03 gibba003 bash[32348]: cluster 2021-03-10T17:16:02.179630+0000 mgr.gibba043.dnkmem (mgr.34373) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:05 gibba043 bash[24019]: cluster 2021-03-10T17:16:04.181007+0000 mgr.gibba043.dnkmem (mgr.34373) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:05 gibba003 bash[31385]: cluster 2021-03-10T17:16:04.181007+0000 mgr.gibba043.dnkmem (mgr.34373) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:05 gibba003 bash[32348]: cluster 2021-03-10T17:16:04.181007+0000 mgr.gibba043.dnkmem (mgr.34373) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:07 gibba043 bash[24019]: cluster 2021-03-10T17:16:06.182775+0000 mgr.gibba043.dnkmem (mgr.34373) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:07 gibba003 bash[31385]: cluster 2021-03-10T17:16:06.182775+0000 mgr.gibba043.dnkmem (mgr.34373) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:07 gibba003 bash[32348]: cluster 2021-03-10T17:16:06.182775+0000 mgr.gibba043.dnkmem (mgr.34373) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:09 gibba043 bash[24019]: cluster 2021-03-10T17:16:08.184197+0000 mgr.gibba043.dnkmem (mgr.34373) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:09 gibba043 bash[24019]: cephadm 2021-03-10T17:16:08.353895+0000 mgr.gibba043.dnkmem (mgr.34373) 10809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:09 gibba003 bash[31385]: cluster 2021-03-10T17:16:08.184197+0000 mgr.gibba043.dnkmem (mgr.34373) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:09 gibba003 bash[31385]: cephadm 2021-03-10T17:16:08.353895+0000 mgr.gibba043.dnkmem (mgr.34373) 10809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:09 gibba003 bash[32348]: cluster 2021-03-10T17:16:08.184197+0000 mgr.gibba043.dnkmem (mgr.34373) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:09 gibba003 bash[32348]: cephadm 2021-03-10T17:16:08.353895+0000 mgr.gibba043.dnkmem (mgr.34373) 10809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:11 gibba043 bash[24019]: cluster 2021-03-10T17:16:10.185687+0000 mgr.gibba043.dnkmem (mgr.34373) 10810 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:11 gibba003 bash[31385]: cluster 2021-03-10T17:16:10.185687+0000 mgr.gibba043.dnkmem (mgr.34373) 10810 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:12.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:11 gibba003 bash[32348]: cluster 2021-03-10T17:16:10.185687+0000 mgr.gibba043.dnkmem (mgr.34373) 10810 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:13 gibba003 bash[31385]: cluster 2021-03-10T17:16:12.187366+0000 mgr.gibba043.dnkmem (mgr.34373) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:13 gibba003 bash[32348]: cluster 2021-03-10T17:16:12.187366+0000 mgr.gibba043.dnkmem (mgr.34373) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:13 gibba043 bash[24019]: cluster 2021-03-10T17:16:12.187366+0000 mgr.gibba043.dnkmem (mgr.34373) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.041607+0000 mon.c (mon.1) 2778 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.042730+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.283792+0000 mon.c (mon.1) 2779 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.284933+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.610017+0000 mon.c (mon.1) 2780 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:16:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.610807+0000 mon.c (mon.1) 2781 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.611283+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:16:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.611633+0000 mon.c (mon.1) 2782 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.612523+0000 mon.c (mon.1) 2783 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.612632+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.613731+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[31385]: audit 2021-03-10T17:16:14.614500+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.041607+0000 mon.c (mon.1) 2778 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.042730+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.283792+0000 mon.c (mon.1) 2779 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.284933+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.610017+0000 mon.c (mon.1) 2780 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:16:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.610807+0000 mon.c (mon.1) 2781 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.611283+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:16:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.611633+0000 mon.c (mon.1) 2782 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.612523+0000 mon.c (mon.1) 2783 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.612632+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.613731+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:14 gibba003 bash[32348]: audit 2021-03-10T17:16:14.614500+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.041607+0000 mon.c (mon.1) 2778 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.042730+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.283792+0000 mon.c (mon.1) 2779 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.284933+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.610017+0000 mon.c (mon.1) 2780 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:16:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.610807+0000 mon.c (mon.1) 2781 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.611283+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:16:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.611633+0000 mon.c (mon.1) 2782 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.612523+0000 mon.c (mon.1) 2783 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.612632+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.613731+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:16:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:14 gibba043 bash[24019]: audit 2021-03-10T17:16:14.614500+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:16:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:15 gibba003 bash[31385]: cluster 2021-03-10T17:16:14.188731+0000 mgr.gibba043.dnkmem (mgr.34373) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:15 gibba003 bash[32348]: cluster 2021-03-10T17:16:14.188731+0000 mgr.gibba043.dnkmem (mgr.34373) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:15 gibba043 bash[24019]: cluster 2021-03-10T17:16:14.188731+0000 mgr.gibba043.dnkmem (mgr.34373) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:17 gibba003 bash[31385]: cluster 2021-03-10T17:16:16.190662+0000 mgr.gibba043.dnkmem (mgr.34373) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:17 gibba003 bash[32348]: cluster 2021-03-10T17:16:16.190662+0000 mgr.gibba043.dnkmem (mgr.34373) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:17 gibba043 bash[24019]: cluster 2021-03-10T17:16:16.190662+0000 mgr.gibba043.dnkmem (mgr.34373) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:18 gibba003 bash[31385]: cluster 2021-03-10T17:16:18.192242+0000 mgr.gibba043.dnkmem (mgr.34373) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:19.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:18 gibba003 bash[32348]: cluster 2021-03-10T17:16:18.192242+0000 mgr.gibba043.dnkmem (mgr.34373) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:18 gibba043 bash[24019]: cluster 2021-03-10T17:16:18.192242+0000 mgr.gibba043.dnkmem (mgr.34373) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:21 gibba043 bash[24019]: cluster 2021-03-10T17:16:20.193840+0000 mgr.gibba043.dnkmem (mgr.34373) 10815 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:21 gibba003 bash[31385]: cluster 2021-03-10T17:16:20.193840+0000 mgr.gibba043.dnkmem (mgr.34373) 10815 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.690 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:21 gibba003 bash[32348]: cluster 2021-03-10T17:16:20.193840+0000 mgr.gibba043.dnkmem (mgr.34373) 10815 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:23.344 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:16:23.570 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:16:23.571 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:16:23.571 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:16:23.571 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:16:23.572 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:16:23.572 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:16:23.572 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:16:23.572 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:16:23.572 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:16:23.573 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:16:23.573 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:16:23.573 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:16:23.573 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:16:23.574 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:16:23.574 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:16:23.574 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:16:23.574 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:16:23.574 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:16:23.575 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:16:23.575 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:16:23.576 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:16:23.825 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:16:23.825 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:16:23.825 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:23.826 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:16:23.826 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:16:23.826 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:23.826 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:16:23.827 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:16:23.827 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:16:23.827 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:16:23.827 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:16:23.828 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:16:23.828 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:16:23.828 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:16:23.828 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:16:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:23 gibba043 bash[24019]: cluster 2021-03-10T17:16:22.195616+0000 mgr.gibba043.dnkmem (mgr.34373) 10816 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:23 gibba003 bash[31385]: cluster 2021-03-10T17:16:22.195616+0000 mgr.gibba043.dnkmem (mgr.34373) 10816 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:23 gibba003 bash[32348]: cluster 2021-03-10T17:16:22.195616+0000 mgr.gibba043.dnkmem (mgr.34373) 10816 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:24 gibba043 bash[24019]: audit 2021-03-10T17:16:23.334543+0000 mgr.gibba043.dnkmem (mgr.34373) 10817 : audit [DBG] from='client.51303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:24 gibba043 bash[24019]: cephadm 2021-03-10T17:16:23.369926+0000 mgr.gibba043.dnkmem (mgr.34373) 10818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:25.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:24 gibba043 bash[24019]: audit 2021-03-10T17:16:23.557526+0000 mgr.gibba043.dnkmem (mgr.34373) 10819 : audit [DBG] from='client.61300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:25.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:24 gibba043 bash[24019]: audit 2021-03-10T17:16:23.825765+0000 mon.a (mon.0) 2177 : audit [DBG] from='client.? 172.21.2.103:0/1271438163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[31385]: audit 2021-03-10T17:16:23.334543+0000 mgr.gibba043.dnkmem (mgr.34373) 10817 : audit [DBG] from='client.51303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[31385]: cephadm 2021-03-10T17:16:23.369926+0000 mgr.gibba043.dnkmem (mgr.34373) 10818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[31385]: audit 2021-03-10T17:16:23.557526+0000 mgr.gibba043.dnkmem (mgr.34373) 10819 : audit [DBG] from='client.61300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:25.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[31385]: audit 2021-03-10T17:16:23.825765+0000 mon.a (mon.0) 2177 : audit [DBG] from='client.? 172.21.2.103:0/1271438163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[32348]: audit 2021-03-10T17:16:23.334543+0000 mgr.gibba043.dnkmem (mgr.34373) 10817 : audit [DBG] from='client.51303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:25.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[32348]: cephadm 2021-03-10T17:16:23.369926+0000 mgr.gibba043.dnkmem (mgr.34373) 10818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:25.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[32348]: audit 2021-03-10T17:16:23.557526+0000 mgr.gibba043.dnkmem (mgr.34373) 10819 : audit [DBG] from='client.61300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:25.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:24 gibba003 bash[32348]: audit 2021-03-10T17:16:23.825765+0000 mon.a (mon.0) 2177 : audit [DBG] from='client.? 172.21.2.103:0/1271438163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:25 gibba043 bash[24019]: cluster 2021-03-10T17:16:24.197309+0000 mgr.gibba043.dnkmem (mgr.34373) 10820 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:25 gibba003 bash[31385]: cluster 2021-03-10T17:16:24.197309+0000 mgr.gibba043.dnkmem (mgr.34373) 10820 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:25 gibba003 bash[32348]: cluster 2021-03-10T17:16:24.197309+0000 mgr.gibba043.dnkmem (mgr.34373) 10820 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:27 gibba043 bash[24019]: cluster 2021-03-10T17:16:26.199289+0000 mgr.gibba043.dnkmem (mgr.34373) 10821 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:27 gibba003 bash[31385]: cluster 2021-03-10T17:16:26.199289+0000 mgr.gibba043.dnkmem (mgr.34373) 10821 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:27 gibba003 bash[32348]: cluster 2021-03-10T17:16:26.199289+0000 mgr.gibba043.dnkmem (mgr.34373) 10821 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:29 gibba003 bash[31385]: cluster 2021-03-10T17:16:28.200719+0000 mgr.gibba043.dnkmem (mgr.34373) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:29 gibba003 bash[32348]: cluster 2021-03-10T17:16:28.200719+0000 mgr.gibba043.dnkmem (mgr.34373) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:29 gibba043 bash[24019]: cluster 2021-03-10T17:16:28.200719+0000 mgr.gibba043.dnkmem (mgr.34373) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:31 gibba003 bash[31385]: cluster 2021-03-10T17:16:30.202414+0000 mgr.gibba043.dnkmem (mgr.34373) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:31 gibba003 bash[32348]: cluster 2021-03-10T17:16:30.202414+0000 mgr.gibba043.dnkmem (mgr.34373) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:31 gibba043 bash[24019]: cluster 2021-03-10T17:16:30.202414+0000 mgr.gibba043.dnkmem (mgr.34373) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:33 gibba003 bash[31385]: cluster 2021-03-10T17:16:32.203993+0000 mgr.gibba043.dnkmem (mgr.34373) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:33 gibba003 bash[32348]: cluster 2021-03-10T17:16:32.203993+0000 mgr.gibba043.dnkmem (mgr.34373) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:33 gibba043 bash[24019]: cluster 2021-03-10T17:16:32.203993+0000 mgr.gibba043.dnkmem (mgr.34373) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:35 gibba003 bash[31385]: cluster 2021-03-10T17:16:34.205481+0000 mgr.gibba043.dnkmem (mgr.34373) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:35 gibba003 bash[32348]: cluster 2021-03-10T17:16:34.205481+0000 mgr.gibba043.dnkmem (mgr.34373) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:35 gibba043 bash[24019]: cluster 2021-03-10T17:16:34.205481+0000 mgr.gibba043.dnkmem (mgr.34373) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:37 gibba003 bash[31385]: cluster 2021-03-10T17:16:36.207389+0000 mgr.gibba043.dnkmem (mgr.34373) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:37 gibba003 bash[32348]: cluster 2021-03-10T17:16:36.207389+0000 mgr.gibba043.dnkmem (mgr.34373) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:37 gibba043 bash[24019]: cluster 2021-03-10T17:16:36.207389+0000 mgr.gibba043.dnkmem (mgr.34373) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cluster 2021-03-10T17:16:38.208635+0000 mgr.gibba043.dnkmem (mgr.34373) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.578460+0000 mgr.gibba043.dnkmem (mgr.34373) 10828 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:16:39.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.578829+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.581828+0000 mgr.gibba043.dnkmem (mgr.34373) 10829 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:16:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.582090+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.785249+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:39.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.786277+0000 mgr.gibba043.dnkmem (mgr.34373) 10830 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.788415+0000 mgr.gibba043.dnkmem (mgr.34373) 10831 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.789046+0000 mon.c (mon.1) 2784 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.790031+0000 mgr.gibba043.dnkmem (mgr.34373) 10832 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:39.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.790068+0000 mgr.gibba043.dnkmem (mgr.34373) 10833 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.790492+0000 mon.c (mon.1) 2785 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.791406+0000 mgr.gibba043.dnkmem (mgr.34373) 10834 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.791439+0000 mgr.gibba043.dnkmem (mgr.34373) 10835 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.792249+0000 mon.c (mon.1) 2786 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.792780+0000 mgr.gibba043.dnkmem (mgr.34373) 10836 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:39.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.793467+0000 mon.c (mon.1) 2787 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.794470+0000 mgr.gibba043.dnkmem (mgr.34373) 10837 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:39.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.794505+0000 mgr.gibba043.dnkmem (mgr.34373) 10838 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:39.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.796156+0000 mgr.gibba043.dnkmem (mgr.34373) 10839 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:39.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.796478+0000 mgr.gibba043.dnkmem (mgr.34373) 10840 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cluster 2021-03-10T17:16:38.208635+0000 mgr.gibba043.dnkmem (mgr.34373) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.578460+0000 mgr.gibba043.dnkmem (mgr.34373) 10828 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:16:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.578829+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.581828+0000 mgr.gibba043.dnkmem (mgr.34373) 10829 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:16:39.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.582090+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.785249+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.786277+0000 mgr.gibba043.dnkmem (mgr.34373) 10830 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.788415+0000 mgr.gibba043.dnkmem (mgr.34373) 10831 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:39.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.789046+0000 mon.c (mon.1) 2784 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.790031+0000 mgr.gibba043.dnkmem (mgr.34373) 10832 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.790068+0000 mgr.gibba043.dnkmem (mgr.34373) 10833 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.790492+0000 mon.c (mon.1) 2785 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.791406+0000 mgr.gibba043.dnkmem (mgr.34373) 10834 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:39.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.791439+0000 mgr.gibba043.dnkmem (mgr.34373) 10835 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:39.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.792249+0000 mon.c (mon.1) 2786 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.792780+0000 mgr.gibba043.dnkmem (mgr.34373) 10836 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:39.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.793467+0000 mon.c (mon.1) 2787 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.794470+0000 mgr.gibba043.dnkmem (mgr.34373) 10837 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:39.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.794505+0000 mgr.gibba043.dnkmem (mgr.34373) 10838 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:39.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.796156+0000 mgr.gibba043.dnkmem (mgr.34373) 10839 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:39.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.796478+0000 mgr.gibba043.dnkmem (mgr.34373) 10840 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:39.951 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.796763+0000 mon.c (mon.1) 2788 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.797782+0000 mgr.gibba043.dnkmem (mgr.34373) 10841 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:39.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.797828+0000 mgr.gibba043.dnkmem (mgr.34373) 10842 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:39.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: cephadm 2021-03-10T17:16:38.797927+0000 mgr.gibba043.dnkmem (mgr.34373) 10843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:39.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[31385]: audit 2021-03-10T17:16:38.798611+0000 mon.c (mon.1) 2789 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.796763+0000 mon.c (mon.1) 2788 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:39.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.797782+0000 mgr.gibba043.dnkmem (mgr.34373) 10841 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:39.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.797828+0000 mgr.gibba043.dnkmem (mgr.34373) 10842 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:39.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: cephadm 2021-03-10T17:16:38.797927+0000 mgr.gibba043.dnkmem (mgr.34373) 10843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:39.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:39 gibba003 bash[32348]: audit 2021-03-10T17:16:38.798611+0000 mon.c (mon.1) 2789 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:40.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cluster 2021-03-10T17:16:38.208635+0000 mgr.gibba043.dnkmem (mgr.34373) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.578460+0000 mgr.gibba043.dnkmem (mgr.34373) 10828 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:16:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.578829+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.581828+0000 mgr.gibba043.dnkmem (mgr.34373) 10829 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:16:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.582090+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.785249+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:16:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.786277+0000 mgr.gibba043.dnkmem (mgr.34373) 10830 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.788415+0000 mgr.gibba043.dnkmem (mgr.34373) 10831 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.789046+0000 mon.c (mon.1) 2784 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.790031+0000 mgr.gibba043.dnkmem (mgr.34373) 10832 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.790068+0000 mgr.gibba043.dnkmem (mgr.34373) 10833 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.790492+0000 mon.c (mon.1) 2785 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:40.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.791406+0000 mgr.gibba043.dnkmem (mgr.34373) 10834 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.791439+0000 mgr.gibba043.dnkmem (mgr.34373) 10835 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.792249+0000 mon.c (mon.1) 2786 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.792780+0000 mgr.gibba043.dnkmem (mgr.34373) 10836 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.793467+0000 mon.c (mon.1) 2787 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:40.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.794470+0000 mgr.gibba043.dnkmem (mgr.34373) 10837 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:40.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.794505+0000 mgr.gibba043.dnkmem (mgr.34373) 10838 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:40.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.796156+0000 mgr.gibba043.dnkmem (mgr.34373) 10839 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:40.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.796478+0000 mgr.gibba043.dnkmem (mgr.34373) 10840 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:40.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.796763+0000 mon.c (mon.1) 2788 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:40.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.797782+0000 mgr.gibba043.dnkmem (mgr.34373) 10841 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:40.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.797828+0000 mgr.gibba043.dnkmem (mgr.34373) 10842 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:40.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: cephadm 2021-03-10T17:16:38.797927+0000 mgr.gibba043.dnkmem (mgr.34373) 10843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:40.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:39 gibba043 bash[24019]: audit 2021-03-10T17:16:38.798611+0000 mon.c (mon.1) 2789 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:41 gibba003 bash[31385]: cluster 2021-03-10T17:16:40.210023+0000 mgr.gibba043.dnkmem (mgr.34373) 10844 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:41.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:41 gibba003 bash[32348]: cluster 2021-03-10T17:16:40.210023+0000 mgr.gibba043.dnkmem (mgr.34373) 10844 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:41 gibba043 bash[24019]: cluster 2021-03-10T17:16:40.210023+0000 mgr.gibba043.dnkmem (mgr.34373) 10844 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:43 gibba043 bash[24019]: cluster 2021-03-10T17:16:42.211631+0000 mgr.gibba043.dnkmem (mgr.34373) 10845 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:43 gibba003 bash[31385]: cluster 2021-03-10T17:16:42.211631+0000 mgr.gibba043.dnkmem (mgr.34373) 10845 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:43 gibba003 bash[32348]: cluster 2021-03-10T17:16:42.211631+0000 mgr.gibba043.dnkmem (mgr.34373) 10845 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:45 gibba043 bash[24019]: cluster 2021-03-10T17:16:44.213006+0000 mgr.gibba043.dnkmem (mgr.34373) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:45 gibba003 bash[31385]: cluster 2021-03-10T17:16:44.213006+0000 mgr.gibba043.dnkmem (mgr.34373) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:45 gibba003 bash[32348]: cluster 2021-03-10T17:16:44.213006+0000 mgr.gibba043.dnkmem (mgr.34373) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:47 gibba043 bash[24019]: cluster 2021-03-10T17:16:46.214913+0000 mgr.gibba043.dnkmem (mgr.34373) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:47 gibba003 bash[31385]: cluster 2021-03-10T17:16:46.214913+0000 mgr.gibba043.dnkmem (mgr.34373) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:47 gibba003 bash[32348]: cluster 2021-03-10T17:16:46.214913+0000 mgr.gibba043.dnkmem (mgr.34373) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:49 gibba003 bash[31385]: cluster 2021-03-10T17:16:48.216419+0000 mgr.gibba043.dnkmem (mgr.34373) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:49 gibba003 bash[32348]: cluster 2021-03-10T17:16:48.216419+0000 mgr.gibba043.dnkmem (mgr.34373) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:49 gibba043 bash[24019]: cluster 2021-03-10T17:16:48.216419+0000 mgr.gibba043.dnkmem (mgr.34373) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:51 gibba003 bash[31385]: cluster 2021-03-10T17:16:50.218086+0000 mgr.gibba043.dnkmem (mgr.34373) 10849 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:51 gibba003 bash[32348]: cluster 2021-03-10T17:16:50.218086+0000 mgr.gibba043.dnkmem (mgr.34373) 10849 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:52.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:51 gibba043 bash[24019]: cluster 2021-03-10T17:16:50.218086+0000 mgr.gibba043.dnkmem (mgr.34373) 10849 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.066 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:16:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:53 gibba003 bash[31385]: cluster 2021-03-10T17:16:52.219609+0000 mgr.gibba043.dnkmem (mgr.34373) 10850 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:53 gibba003 bash[32348]: cluster 2021-03-10T17:16:52.219609+0000 mgr.gibba043.dnkmem (mgr.34373) 10850 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:53 gibba043 bash[24019]: cluster 2021-03-10T17:16:52.219609+0000 mgr.gibba043.dnkmem (mgr.34373) 10850 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.292 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:16:54.292 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:16:54.292 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:16:54.293 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:16:54.293 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:16:54.293 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:16:54.293 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:16:54.293 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:16:54.294 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:16:54.294 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:16:54.294 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:16:54.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:16:54.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:16:54.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:16:54.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:16:54.295 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:16:54.296 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:16:54.296 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:16:54.296 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:16:54.296 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:16:54.296 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:16:54.541 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:16:54.541 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:16:54.541 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:54.542 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:16:54.542 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:16:54.542 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:54.542 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:16:54.543 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:16:54.543 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:16:54.543 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:16:54.543 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:16:54.543 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:16:54.544 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:16:54.544 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:16:54.544 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:16:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:54 gibba003 bash[31385]: audit 2021-03-10T17:16:54.542097+0000 mon.c (mon.1) 2790 : audit [DBG] from='client.? 172.21.2.103:0/2215126106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:55.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:54 gibba003 bash[32348]: audit 2021-03-10T17:16:54.542097+0000 mon.c (mon.1) 2790 : audit [DBG] from='client.? 172.21.2.103:0/2215126106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:55.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:54 gibba043 bash[24019]: audit 2021-03-10T17:16:54.542097+0000 mon.c (mon.1) 2790 : audit [DBG] from='client.? 172.21.2.103:0/2215126106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[31385]: cephadm 2021-03-10T17:16:53.812583+0000 mgr.gibba043.dnkmem (mgr.34373) 10851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[31385]: audit 2021-03-10T17:16:54.056677+0000 mgr.gibba043.dnkmem (mgr.34373) 10852 : audit [DBG] from='client.61312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[31385]: cluster 2021-03-10T17:16:54.221267+0000 mgr.gibba043.dnkmem (mgr.34373) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:56.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[31385]: audit 2021-03-10T17:16:54.278934+0000 mgr.gibba043.dnkmem (mgr.34373) 10854 : audit [DBG] from='client.61318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:56.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[32348]: cephadm 2021-03-10T17:16:53.812583+0000 mgr.gibba043.dnkmem (mgr.34373) 10851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:56.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[32348]: audit 2021-03-10T17:16:54.056677+0000 mgr.gibba043.dnkmem (mgr.34373) 10852 : audit [DBG] from='client.61312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:56.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[32348]: cluster 2021-03-10T17:16:54.221267+0000 mgr.gibba043.dnkmem (mgr.34373) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:56.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:55 gibba003 bash[32348]: audit 2021-03-10T17:16:54.278934+0000 mgr.gibba043.dnkmem (mgr.34373) 10854 : audit [DBG] from='client.61318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:55 gibba043 bash[24019]: cephadm 2021-03-10T17:16:53.812583+0000 mgr.gibba043.dnkmem (mgr.34373) 10851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:16:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:55 gibba043 bash[24019]: audit 2021-03-10T17:16:54.056677+0000 mgr.gibba043.dnkmem (mgr.34373) 10852 : audit [DBG] from='client.61312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:55 gibba043 bash[24019]: cluster 2021-03-10T17:16:54.221267+0000 mgr.gibba043.dnkmem (mgr.34373) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:55 gibba043 bash[24019]: audit 2021-03-10T17:16:54.278934+0000 mgr.gibba043.dnkmem (mgr.34373) 10854 : audit [DBG] from='client.61318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:57.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:56 gibba003 bash[31385]: cluster 2021-03-10T17:16:56.223192+0000 mgr.gibba043.dnkmem (mgr.34373) 10855 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:56 gibba003 bash[32348]: cluster 2021-03-10T17:16:56.223192+0000 mgr.gibba043.dnkmem (mgr.34373) 10855 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:56 gibba043 bash[24019]: cluster 2021-03-10T17:16:56.223192+0000 mgr.gibba043.dnkmem (mgr.34373) 10855 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:16:59 gibba043 bash[24019]: cluster 2021-03-10T17:16:58.224795+0000 mgr.gibba043.dnkmem (mgr.34373) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:16:59 gibba003 bash[31385]: cluster 2021-03-10T17:16:58.224795+0000 mgr.gibba043.dnkmem (mgr.34373) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:16:59 gibba003 bash[32348]: cluster 2021-03-10T17:16:58.224795+0000 mgr.gibba043.dnkmem (mgr.34373) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:01 gibba003 bash[31385]: cluster 2021-03-10T17:17:00.226037+0000 mgr.gibba043.dnkmem (mgr.34373) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:01 gibba003 bash[32348]: cluster 2021-03-10T17:17:00.226037+0000 mgr.gibba043.dnkmem (mgr.34373) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:01 gibba043 bash[24019]: cluster 2021-03-10T17:17:00.226037+0000 mgr.gibba043.dnkmem (mgr.34373) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:03 gibba003 bash[31385]: cluster 2021-03-10T17:17:02.227894+0000 mgr.gibba043.dnkmem (mgr.34373) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:03 gibba003 bash[32348]: cluster 2021-03-10T17:17:02.227894+0000 mgr.gibba043.dnkmem (mgr.34373) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:03 gibba043 bash[24019]: cluster 2021-03-10T17:17:02.227894+0000 mgr.gibba043.dnkmem (mgr.34373) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:05 gibba003 bash[31385]: cluster 2021-03-10T17:17:04.229746+0000 mgr.gibba043.dnkmem (mgr.34373) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:05 gibba003 bash[32348]: cluster 2021-03-10T17:17:04.229746+0000 mgr.gibba043.dnkmem (mgr.34373) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:05 gibba043 bash[24019]: cluster 2021-03-10T17:17:04.229746+0000 mgr.gibba043.dnkmem (mgr.34373) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:07 gibba003 bash[31385]: cluster 2021-03-10T17:17:06.231632+0000 mgr.gibba043.dnkmem (mgr.34373) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:07 gibba003 bash[32348]: cluster 2021-03-10T17:17:06.231632+0000 mgr.gibba043.dnkmem (mgr.34373) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:07 gibba043 bash[24019]: cluster 2021-03-10T17:17:06.231632+0000 mgr.gibba043.dnkmem (mgr.34373) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:09 gibba003 bash[31385]: cluster 2021-03-10T17:17:08.232914+0000 mgr.gibba043.dnkmem (mgr.34373) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:10.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:09 gibba003 bash[32348]: cluster 2021-03-10T17:17:08.232914+0000 mgr.gibba043.dnkmem (mgr.34373) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:10.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:09 gibba043 bash[24019]: cluster 2021-03-10T17:17:08.232914+0000 mgr.gibba043.dnkmem (mgr.34373) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:10 gibba003 bash[31385]: cephadm 2021-03-10T17:17:08.828249+0000 mgr.gibba043.dnkmem (mgr.34373) 10862 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:10 gibba003 bash[32348]: cephadm 2021-03-10T17:17:08.828249+0000 mgr.gibba043.dnkmem (mgr.34373) 10862 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:10 gibba043 bash[24019]: cephadm 2021-03-10T17:17:08.828249+0000 mgr.gibba043.dnkmem (mgr.34373) 10862 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:11 gibba003 bash[31385]: cluster 2021-03-10T17:17:10.234289+0000 mgr.gibba043.dnkmem (mgr.34373) 10863 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:12.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:11 gibba003 bash[32348]: cluster 2021-03-10T17:17:10.234289+0000 mgr.gibba043.dnkmem (mgr.34373) 10863 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:11 gibba043 bash[24019]: cluster 2021-03-10T17:17:10.234289+0000 mgr.gibba043.dnkmem (mgr.34373) 10863 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:13 gibba043 bash[24019]: cluster 2021-03-10T17:17:12.235931+0000 mgr.gibba043.dnkmem (mgr.34373) 10864 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:13 gibba003 bash[31385]: cluster 2021-03-10T17:17:12.235931+0000 mgr.gibba043.dnkmem (mgr.34373) 10864 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:13 gibba003 bash[32348]: cluster 2021-03-10T17:17:12.235931+0000 mgr.gibba043.dnkmem (mgr.34373) 10864 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.048330+0000 mon.c (mon.1) 2791 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.049462+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.291317+0000 mon.c (mon.1) 2792 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.292460+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.620485+0000 mon.c (mon.1) 2793 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:17:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.621188+0000 mon.c (mon.1) 2794 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.621691+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:17:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.621889+0000 mon.c (mon.1) 2795 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.622704+0000 mon.c (mon.1) 2796 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.622942+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.624264+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[31385]: audit 2021-03-10T17:17:14.625086+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.048330+0000 mon.c (mon.1) 2791 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.049462+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.291317+0000 mon.c (mon.1) 2792 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.292460+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.620485+0000 mon.c (mon.1) 2793 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:17:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.621188+0000 mon.c (mon.1) 2794 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.621691+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:17:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.621889+0000 mon.c (mon.1) 2795 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.622704+0000 mon.c (mon.1) 2796 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.622942+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.624264+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:14 gibba003 bash[32348]: audit 2021-03-10T17:17:14.625086+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.048330+0000 mon.c (mon.1) 2791 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.049462+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.291317+0000 mon.c (mon.1) 2792 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.292460+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.620485+0000 mon.c (mon.1) 2793 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:17:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.621188+0000 mon.c (mon.1) 2794 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.621691+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:17:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.621889+0000 mon.c (mon.1) 2795 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.622704+0000 mon.c (mon.1) 2796 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.622942+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.624264+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:14 gibba043 bash[24019]: audit 2021-03-10T17:17:14.625086+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:17:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:15 gibba003 bash[31385]: cluster 2021-03-10T17:17:14.237619+0000 mgr.gibba043.dnkmem (mgr.34373) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:16.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:15 gibba003 bash[32348]: cluster 2021-03-10T17:17:14.237619+0000 mgr.gibba043.dnkmem (mgr.34373) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:15 gibba043 bash[24019]: cluster 2021-03-10T17:17:14.237619+0000 mgr.gibba043.dnkmem (mgr.34373) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:17 gibba003 bash[31385]: cluster 2021-03-10T17:17:16.239510+0000 mgr.gibba043.dnkmem (mgr.34373) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:17 gibba003 bash[32348]: cluster 2021-03-10T17:17:16.239510+0000 mgr.gibba043.dnkmem (mgr.34373) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:17 gibba043 bash[24019]: cluster 2021-03-10T17:17:16.239510+0000 mgr.gibba043.dnkmem (mgr.34373) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:19 gibba003 bash[31385]: cluster 2021-03-10T17:17:18.241279+0000 mgr.gibba043.dnkmem (mgr.34373) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:20.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:19 gibba003 bash[32348]: cluster 2021-03-10T17:17:18.241279+0000 mgr.gibba043.dnkmem (mgr.34373) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:20.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:19 gibba043 bash[24019]: cluster 2021-03-10T17:17:18.241279+0000 mgr.gibba043.dnkmem (mgr.34373) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:21 gibba003 bash[31385]: cluster 2021-03-10T17:17:20.242714+0000 mgr.gibba043.dnkmem (mgr.34373) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:21 gibba003 bash[32348]: cluster 2021-03-10T17:17:20.242714+0000 mgr.gibba043.dnkmem (mgr.34373) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:21 gibba043 bash[24019]: cluster 2021-03-10T17:17:20.242714+0000 mgr.gibba043.dnkmem (mgr.34373) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:23 gibba003 bash[31385]: cluster 2021-03-10T17:17:22.244276+0000 mgr.gibba043.dnkmem (mgr.34373) 10869 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:23 gibba003 bash[32348]: cluster 2021-03-10T17:17:22.244276+0000 mgr.gibba043.dnkmem (mgr.34373) 10869 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:23 gibba043 bash[24019]: cluster 2021-03-10T17:17:22.244276+0000 mgr.gibba043.dnkmem (mgr.34373) 10869 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.784 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:17:25.036 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:17:25.037 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:17:25.037 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:17:25.037 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:17:25.037 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:17:25.038 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:17:25.038 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:17:25.038 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:17:25.038 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:17:25.038 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:17:25.039 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:17:25.039 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:17:25.039 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:17:25.039 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:17:25.040 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:17:25.040 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:17:25.040 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:17:25.040 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:17:25.040 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:17:25.041 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:17:25.041 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:17:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:24 gibba003 bash[31385]: cephadm 2021-03-10T17:17:23.840166+0000 mgr.gibba043.dnkmem (mgr.34373) 10870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:24 gibba003 bash[31385]: cluster 2021-03-10T17:17:24.245883+0000 mgr.gibba043.dnkmem (mgr.34373) 10871 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:24 gibba003 bash[31385]: audit 2021-03-10T17:17:24.774637+0000 mgr.gibba043.dnkmem (mgr.34373) 10872 : audit [DBG] from='client.51339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:24 gibba003 bash[32348]: cephadm 2021-03-10T17:17:23.840166+0000 mgr.gibba043.dnkmem (mgr.34373) 10870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:24 gibba003 bash[32348]: cluster 2021-03-10T17:17:24.245883+0000 mgr.gibba043.dnkmem (mgr.34373) 10871 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:24 gibba003 bash[32348]: audit 2021-03-10T17:17:24.774637+0000 mgr.gibba043.dnkmem (mgr.34373) 10872 : audit [DBG] from='client.51339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:24 gibba043 bash[24019]: cephadm 2021-03-10T17:17:23.840166+0000 mgr.gibba043.dnkmem (mgr.34373) 10870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:24 gibba043 bash[24019]: cluster 2021-03-10T17:17:24.245883+0000 mgr.gibba043.dnkmem (mgr.34373) 10871 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:25.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:24 gibba043 bash[24019]: audit 2021-03-10T17:17:24.774637+0000 mgr.gibba043.dnkmem (mgr.34373) 10872 : audit [DBG] from='client.51339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:25.284 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:17:25.284 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:17:25.284 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:25.285 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:17:25.285 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:17:25.285 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:25.285 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:17:25.286 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:17:25.286 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:17:25.286 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:17:25.286 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:17:25.286 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:17:25.287 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:17:25.287 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:17:25.287 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:17:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:25 gibba003 bash[31385]: audit 2021-03-10T17:17:25.003417+0000 mgr.gibba043.dnkmem (mgr.34373) 10873 : audit [DBG] from='client.51345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:25 gibba003 bash[31385]: audit 2021-03-10T17:17:25.285055+0000 mon.c (mon.1) 2797 : audit [DBG] from='client.? 172.21.2.103:0/3043506263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:25 gibba003 bash[32348]: audit 2021-03-10T17:17:25.003417+0000 mgr.gibba043.dnkmem (mgr.34373) 10873 : audit [DBG] from='client.51345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:25 gibba003 bash[32348]: audit 2021-03-10T17:17:25.285055+0000 mon.c (mon.1) 2797 : audit [DBG] from='client.? 172.21.2.103:0/3043506263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:25 gibba043 bash[24019]: audit 2021-03-10T17:17:25.003417+0000 mgr.gibba043.dnkmem (mgr.34373) 10873 : audit [DBG] from='client.51345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:25 gibba043 bash[24019]: audit 2021-03-10T17:17:25.285055+0000 mon.c (mon.1) 2797 : audit [DBG] from='client.? 172.21.2.103:0/3043506263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:26 gibba003 bash[31385]: cluster 2021-03-10T17:17:26.247831+0000 mgr.gibba043.dnkmem (mgr.34373) 10874 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:26 gibba003 bash[32348]: cluster 2021-03-10T17:17:26.247831+0000 mgr.gibba043.dnkmem (mgr.34373) 10874 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:26 gibba043 bash[24019]: cluster 2021-03-10T17:17:26.247831+0000 mgr.gibba043.dnkmem (mgr.34373) 10874 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:29 gibba003 bash[31385]: cluster 2021-03-10T17:17:28.249464+0000 mgr.gibba043.dnkmem (mgr.34373) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:29 gibba003 bash[32348]: cluster 2021-03-10T17:17:28.249464+0000 mgr.gibba043.dnkmem (mgr.34373) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:29 gibba043 bash[24019]: cluster 2021-03-10T17:17:28.249464+0000 mgr.gibba043.dnkmem (mgr.34373) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:32.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:31 gibba003 bash[31385]: cluster 2021-03-10T17:17:30.250961+0000 mgr.gibba043.dnkmem (mgr.34373) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:32.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:31 gibba003 bash[32348]: cluster 2021-03-10T17:17:30.250961+0000 mgr.gibba043.dnkmem (mgr.34373) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:32.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:31 gibba043 bash[24019]: cluster 2021-03-10T17:17:30.250961+0000 mgr.gibba043.dnkmem (mgr.34373) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:33 gibba003 bash[31385]: cluster 2021-03-10T17:17:32.252671+0000 mgr.gibba043.dnkmem (mgr.34373) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:33 gibba003 bash[32348]: cluster 2021-03-10T17:17:32.252671+0000 mgr.gibba043.dnkmem (mgr.34373) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:33 gibba043 bash[24019]: cluster 2021-03-10T17:17:32.252671+0000 mgr.gibba043.dnkmem (mgr.34373) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:36.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:35 gibba003 bash[31385]: cluster 2021-03-10T17:17:34.254323+0000 mgr.gibba043.dnkmem (mgr.34373) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:36.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:35 gibba003 bash[32348]: cluster 2021-03-10T17:17:34.254323+0000 mgr.gibba043.dnkmem (mgr.34373) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:35 gibba043 bash[24019]: cluster 2021-03-10T17:17:34.254323+0000 mgr.gibba043.dnkmem (mgr.34373) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:37 gibba003 bash[31385]: cluster 2021-03-10T17:17:36.256334+0000 mgr.gibba043.dnkmem (mgr.34373) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:37 gibba003 bash[32348]: cluster 2021-03-10T17:17:36.256334+0000 mgr.gibba043.dnkmem (mgr.34373) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:37 gibba043 bash[24019]: cluster 2021-03-10T17:17:36.256334+0000 mgr.gibba043.dnkmem (mgr.34373) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: cluster 2021-03-10T17:17:38.257716+0000 mgr.gibba043.dnkmem (mgr.34373) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.068941+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:17:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.072543+0000 mon.c (mon.1) 2798 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.074212+0000 mon.c (mon.1) 2799 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.075630+0000 mon.c (mon.1) 2800 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.077109+0000 mon.c (mon.1) 2801 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.080703+0000 mon.c (mon.1) 2802 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[31385]: audit 2021-03-10T17:17:39.083498+0000 mon.c (mon.1) 2803 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: cluster 2021-03-10T17:17:38.257716+0000 mgr.gibba043.dnkmem (mgr.34373) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.068941+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:17:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.072543+0000 mon.c (mon.1) 2798 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.074212+0000 mon.c (mon.1) 2799 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.075630+0000 mon.c (mon.1) 2800 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.077109+0000 mon.c (mon.1) 2801 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.080703+0000 mon.c (mon.1) 2802 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:39 gibba003 bash[32348]: audit 2021-03-10T17:17:39.083498+0000 mon.c (mon.1) 2803 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: cluster 2021-03-10T17:17:38.257716+0000 mgr.gibba043.dnkmem (mgr.34373) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.068941+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:17:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.072543+0000 mon.c (mon.1) 2798 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.074212+0000 mon.c (mon.1) 2799 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.075630+0000 mon.c (mon.1) 2800 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.077109+0000 mon.c (mon.1) 2801 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.080703+0000 mon.c (mon.1) 2802 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:40.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:39 gibba043 bash[24019]: audit 2021-03-10T17:17:39.083498+0000 mon.c (mon.1) 2803 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:38.855602+0000 mgr.gibba043.dnkmem (mgr.34373) 10881 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:17:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:38.855909+0000 mgr.gibba043.dnkmem (mgr.34373) 10882 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:17:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.070164+0000 mgr.gibba043.dnkmem (mgr.34373) 10883 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:41.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.072011+0000 mgr.gibba043.dnkmem (mgr.34373) 10884 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.073445+0000 mgr.gibba043.dnkmem (mgr.34373) 10885 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.073480+0000 mgr.gibba043.dnkmem (mgr.34373) 10886 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.074988+0000 mgr.gibba043.dnkmem (mgr.34373) 10887 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.075024+0000 mgr.gibba043.dnkmem (mgr.34373) 10888 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.076525+0000 mgr.gibba043.dnkmem (mgr.34373) 10889 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.078360+0000 mgr.gibba043.dnkmem (mgr.34373) 10890 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.078397+0000 mgr.gibba043.dnkmem (mgr.34373) 10891 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.080919+0000 mgr.gibba043.dnkmem (mgr.34373) 10892 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.081232+0000 mgr.gibba043.dnkmem (mgr.34373) 10893 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.083676+0000 mgr.gibba043.dnkmem (mgr.34373) 10894 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.083779+0000 mgr.gibba043.dnkmem (mgr.34373) 10895 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cephadm 2021-03-10T17:17:39.083881+0000 mgr.gibba043.dnkmem (mgr.34373) 10896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:41.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[31385]: cluster 2021-03-10T17:17:40.259215+0000 mgr.gibba043.dnkmem (mgr.34373) 10897 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:38.855602+0000 mgr.gibba043.dnkmem (mgr.34373) 10881 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:17:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:38.855909+0000 mgr.gibba043.dnkmem (mgr.34373) 10882 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:17:41.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.070164+0000 mgr.gibba043.dnkmem (mgr.34373) 10883 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.072011+0000 mgr.gibba043.dnkmem (mgr.34373) 10884 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.073445+0000 mgr.gibba043.dnkmem (mgr.34373) 10885 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.073480+0000 mgr.gibba043.dnkmem (mgr.34373) 10886 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.074988+0000 mgr.gibba043.dnkmem (mgr.34373) 10887 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:41.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.075024+0000 mgr.gibba043.dnkmem (mgr.34373) 10888 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.076525+0000 mgr.gibba043.dnkmem (mgr.34373) 10889 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.078360+0000 mgr.gibba043.dnkmem (mgr.34373) 10890 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.078397+0000 mgr.gibba043.dnkmem (mgr.34373) 10891 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:41.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.080919+0000 mgr.gibba043.dnkmem (mgr.34373) 10892 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:41.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.081232+0000 mgr.gibba043.dnkmem (mgr.34373) 10893 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:41.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.083676+0000 mgr.gibba043.dnkmem (mgr.34373) 10894 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:41.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.083779+0000 mgr.gibba043.dnkmem (mgr.34373) 10895 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:41.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cephadm 2021-03-10T17:17:39.083881+0000 mgr.gibba043.dnkmem (mgr.34373) 10896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:41.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:40 gibba003 bash[32348]: cluster 2021-03-10T17:17:40.259215+0000 mgr.gibba043.dnkmem (mgr.34373) 10897 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:38.855602+0000 mgr.gibba043.dnkmem (mgr.34373) 10881 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:17:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:38.855909+0000 mgr.gibba043.dnkmem (mgr.34373) 10882 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:17:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.070164+0000 mgr.gibba043.dnkmem (mgr.34373) 10883 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.072011+0000 mgr.gibba043.dnkmem (mgr.34373) 10884 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.073445+0000 mgr.gibba043.dnkmem (mgr.34373) 10885 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.073480+0000 mgr.gibba043.dnkmem (mgr.34373) 10886 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.074988+0000 mgr.gibba043.dnkmem (mgr.34373) 10887 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.075024+0000 mgr.gibba043.dnkmem (mgr.34373) 10888 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.076525+0000 mgr.gibba043.dnkmem (mgr.34373) 10889 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.078360+0000 mgr.gibba043.dnkmem (mgr.34373) 10890 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.078397+0000 mgr.gibba043.dnkmem (mgr.34373) 10891 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.080919+0000 mgr.gibba043.dnkmem (mgr.34373) 10892 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.081232+0000 mgr.gibba043.dnkmem (mgr.34373) 10893 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.083676+0000 mgr.gibba043.dnkmem (mgr.34373) 10894 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.083779+0000 mgr.gibba043.dnkmem (mgr.34373) 10895 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:41.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cephadm 2021-03-10T17:17:39.083881+0000 mgr.gibba043.dnkmem (mgr.34373) 10896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:41.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:40 gibba043 bash[24019]: cluster 2021-03-10T17:17:40.259215+0000 mgr.gibba043.dnkmem (mgr.34373) 10897 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:43 gibba003 bash[31385]: cluster 2021-03-10T17:17:42.260918+0000 mgr.gibba043.dnkmem (mgr.34373) 10898 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:43 gibba003 bash[32348]: cluster 2021-03-10T17:17:42.260918+0000 mgr.gibba043.dnkmem (mgr.34373) 10898 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:44.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:43 gibba043 bash[24019]: cluster 2021-03-10T17:17:42.260918+0000 mgr.gibba043.dnkmem (mgr.34373) 10898 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:45 gibba003 bash[31385]: cluster 2021-03-10T17:17:44.262618+0000 mgr.gibba043.dnkmem (mgr.34373) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:45 gibba003 bash[32348]: cluster 2021-03-10T17:17:44.262618+0000 mgr.gibba043.dnkmem (mgr.34373) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:45 gibba043 bash[24019]: cluster 2021-03-10T17:17:44.262618+0000 mgr.gibba043.dnkmem (mgr.34373) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:47 gibba003 bash[31385]: cluster 2021-03-10T17:17:46.264605+0000 mgr.gibba043.dnkmem (mgr.34373) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:47 gibba003 bash[32348]: cluster 2021-03-10T17:17:46.264605+0000 mgr.gibba043.dnkmem (mgr.34373) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:47 gibba043 bash[24019]: cluster 2021-03-10T17:17:46.264605+0000 mgr.gibba043.dnkmem (mgr.34373) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:49 gibba003 bash[31385]: cluster 2021-03-10T17:17:48.265944+0000 mgr.gibba043.dnkmem (mgr.34373) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:49 gibba003 bash[32348]: cluster 2021-03-10T17:17:48.265944+0000 mgr.gibba043.dnkmem (mgr.34373) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:49 gibba043 bash[24019]: cluster 2021-03-10T17:17:48.265944+0000 mgr.gibba043.dnkmem (mgr.34373) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:51 gibba003 bash[31385]: cluster 2021-03-10T17:17:50.267424+0000 mgr.gibba043.dnkmem (mgr.34373) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:51 gibba003 bash[32348]: cluster 2021-03-10T17:17:50.267424+0000 mgr.gibba043.dnkmem (mgr.34373) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:52.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:51 gibba043 bash[24019]: cluster 2021-03-10T17:17:50.267424+0000 mgr.gibba043.dnkmem (mgr.34373) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.090 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:53 gibba043 bash[24019]: cluster 2021-03-10T17:17:52.269057+0000 mgr.gibba043.dnkmem (mgr.34373) 10903 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:53 gibba003 bash[31385]: cluster 2021-03-10T17:17:52.269057+0000 mgr.gibba043.dnkmem (mgr.34373) 10903 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:53 gibba003 bash[32348]: cluster 2021-03-10T17:17:52.269057+0000 mgr.gibba043.dnkmem (mgr.34373) 10903 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:55.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:54 gibba003 bash[31385]: cephadm 2021-03-10T17:17:54.088681+0000 mgr.gibba043.dnkmem (mgr.34373) 10904 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:55.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:54 gibba003 bash[31385]: cluster 2021-03-10T17:17:54.270748+0000 mgr.gibba043.dnkmem (mgr.34373) 10905 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:54 gibba003 bash[32348]: cephadm 2021-03-10T17:17:54.088681+0000 mgr.gibba043.dnkmem (mgr.34373) 10904 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:55.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:54 gibba003 bash[32348]: cluster 2021-03-10T17:17:54.270748+0000 mgr.gibba043.dnkmem (mgr.34373) 10905 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:55.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:54 gibba043 bash[24019]: cephadm 2021-03-10T17:17:54.088681+0000 mgr.gibba043.dnkmem (mgr.34373) 10904 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:17:55.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:54 gibba043 bash[24019]: cluster 2021-03-10T17:17:54.270748+0000 mgr.gibba043.dnkmem (mgr.34373) 10905 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:55.527 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:17:55.754 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:17:55.755 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:17:55.755 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:17:55.755 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:17:55.755 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:17:55.755 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:17:55.756 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:17:55.756 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:17:55.756 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:17:55.756 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:17:55.757 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:17:55.757 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:17:55.757 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:17:55.757 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:17:55.757 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:17:55.758 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:17:55.758 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:17:55.758 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:17:55.759 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:17:55.759 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:17:55.759 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:17:56.000 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:17:56.000 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:17:56.000 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:56.001 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:17:56.001 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:17:56.001 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:56.001 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:17:56.001 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:17:56.002 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:17:56.002 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:17:56.002 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:17:56.002 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:17:56.003 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:17:56.003 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:17:56.003 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:17:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:55 gibba003 bash[31385]: audit 2021-03-10T17:17:55.517631+0000 mgr.gibba043.dnkmem (mgr.34373) 10906 : audit [DBG] from='client.61348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:55 gibba003 bash[31385]: audit 2021-03-10T17:17:55.741381+0000 mgr.gibba043.dnkmem (mgr.34373) 10907 : audit [DBG] from='client.51363 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:55 gibba003 bash[32348]: audit 2021-03-10T17:17:55.517631+0000 mgr.gibba043.dnkmem (mgr.34373) 10906 : audit [DBG] from='client.61348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:55 gibba003 bash[32348]: audit 2021-03-10T17:17:55.741381+0000 mgr.gibba043.dnkmem (mgr.34373) 10907 : audit [DBG] from='client.51363 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:55 gibba043 bash[24019]: audit 2021-03-10T17:17:55.517631+0000 mgr.gibba043.dnkmem (mgr.34373) 10906 : audit [DBG] from='client.61348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:55 gibba043 bash[24019]: audit 2021-03-10T17:17:55.741381+0000 mgr.gibba043.dnkmem (mgr.34373) 10907 : audit [DBG] from='client.51363 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:56 gibba003 bash[31385]: audit 2021-03-10T17:17:56.000669+0000 mon.a (mon.0) 2188 : audit [DBG] from='client.? 172.21.2.103:0/1068379071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:56 gibba003 bash[31385]: cluster 2021-03-10T17:17:56.272468+0000 mgr.gibba043.dnkmem (mgr.34373) 10908 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:56 gibba003 bash[32348]: audit 2021-03-10T17:17:56.000669+0000 mon.a (mon.0) 2188 : audit [DBG] from='client.? 172.21.2.103:0/1068379071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:56 gibba003 bash[32348]: cluster 2021-03-10T17:17:56.272468+0000 mgr.gibba043.dnkmem (mgr.34373) 10908 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:56 gibba043 bash[24019]: audit 2021-03-10T17:17:56.000669+0000 mon.a (mon.0) 2188 : audit [DBG] from='client.? 172.21.2.103:0/1068379071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:56 gibba043 bash[24019]: cluster 2021-03-10T17:17:56.272468+0000 mgr.gibba043.dnkmem (mgr.34373) 10908 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:17:59 gibba003 bash[31385]: cluster 2021-03-10T17:17:58.274046+0000 mgr.gibba043.dnkmem (mgr.34373) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:17:59 gibba003 bash[32348]: cluster 2021-03-10T17:17:58.274046+0000 mgr.gibba043.dnkmem (mgr.34373) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:17:59 gibba043 bash[24019]: cluster 2021-03-10T17:17:58.274046+0000 mgr.gibba043.dnkmem (mgr.34373) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:01 gibba003 bash[31385]: cluster 2021-03-10T17:18:00.275424+0000 mgr.gibba043.dnkmem (mgr.34373) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:01 gibba003 bash[32348]: cluster 2021-03-10T17:18:00.275424+0000 mgr.gibba043.dnkmem (mgr.34373) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:01 gibba043 bash[24019]: cluster 2021-03-10T17:18:00.275424+0000 mgr.gibba043.dnkmem (mgr.34373) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:03 gibba003 bash[31385]: cluster 2021-03-10T17:18:02.277043+0000 mgr.gibba043.dnkmem (mgr.34373) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:03 gibba003 bash[32348]: cluster 2021-03-10T17:18:02.277043+0000 mgr.gibba043.dnkmem (mgr.34373) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:03 gibba043 bash[24019]: cluster 2021-03-10T17:18:02.277043+0000 mgr.gibba043.dnkmem (mgr.34373) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:05 gibba003 bash[31385]: cluster 2021-03-10T17:18:04.278571+0000 mgr.gibba043.dnkmem (mgr.34373) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:05 gibba003 bash[32348]: cluster 2021-03-10T17:18:04.278571+0000 mgr.gibba043.dnkmem (mgr.34373) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:05 gibba043 bash[24019]: cluster 2021-03-10T17:18:04.278571+0000 mgr.gibba043.dnkmem (mgr.34373) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:07 gibba003 bash[31385]: cluster 2021-03-10T17:18:06.280422+0000 mgr.gibba043.dnkmem (mgr.34373) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:07 gibba003 bash[32348]: cluster 2021-03-10T17:18:06.280422+0000 mgr.gibba043.dnkmem (mgr.34373) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:07 gibba043 bash[24019]: cluster 2021-03-10T17:18:06.280422+0000 mgr.gibba043.dnkmem (mgr.34373) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:09.106 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:08 gibba043 bash[24019]: cluster 2021-03-10T17:18:08.281936+0000 mgr.gibba043.dnkmem (mgr.34373) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:08 gibba003 bash[31385]: cluster 2021-03-10T17:18:08.281936+0000 mgr.gibba043.dnkmem (mgr.34373) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:08 gibba003 bash[32348]: cluster 2021-03-10T17:18:08.281936+0000 mgr.gibba043.dnkmem (mgr.34373) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:09 gibba003 bash[31385]: cephadm 2021-03-10T17:18:09.104765+0000 mgr.gibba043.dnkmem (mgr.34373) 10915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:09 gibba003 bash[32348]: cephadm 2021-03-10T17:18:09.104765+0000 mgr.gibba043.dnkmem (mgr.34373) 10915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:10.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:09 gibba043 bash[24019]: cephadm 2021-03-10T17:18:09.104765+0000 mgr.gibba043.dnkmem (mgr.34373) 10915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:11.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:10 gibba003 bash[31385]: cluster 2021-03-10T17:18:10.283365+0000 mgr.gibba043.dnkmem (mgr.34373) 10916 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:10 gibba003 bash[32348]: cluster 2021-03-10T17:18:10.283365+0000 mgr.gibba043.dnkmem (mgr.34373) 10916 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:10 gibba043 bash[24019]: cluster 2021-03-10T17:18:10.283365+0000 mgr.gibba043.dnkmem (mgr.34373) 10916 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:13 gibba003 bash[31385]: cluster 2021-03-10T17:18:12.285073+0000 mgr.gibba043.dnkmem (mgr.34373) 10917 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:13 gibba003 bash[32348]: cluster 2021-03-10T17:18:12.285073+0000 mgr.gibba043.dnkmem (mgr.34373) 10917 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:13 gibba043 bash[24019]: cluster 2021-03-10T17:18:12.285073+0000 mgr.gibba043.dnkmem (mgr.34373) 10917 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:15.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.054864+0000 mon.c (mon.1) 2804 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.056070+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.298402+0000 mon.c (mon.1) 2805 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.299614+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.627850+0000 mon.c (mon.1) 2806 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:18:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.628598+0000 mon.c (mon.1) 2807 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.629262+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:18:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.629297+0000 mon.c (mon.1) 2808 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.629996+0000 mon.c (mon.1) 2809 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:18:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.631339+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.632250+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[31385]: audit 2021-03-10T17:18:14.633203+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:18:15.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.054864+0000 mon.c (mon.1) 2804 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.056070+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.298402+0000 mon.c (mon.1) 2805 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.299614+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.627850+0000 mon.c (mon.1) 2806 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:18:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.628598+0000 mon.c (mon.1) 2807 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.629262+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:18:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.629297+0000 mon.c (mon.1) 2808 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.629996+0000 mon.c (mon.1) 2809 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:18:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.631339+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.632250+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:14 gibba003 bash[32348]: audit 2021-03-10T17:18:14.633203+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:18:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.054864+0000 mon.c (mon.1) 2804 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.056070+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.298402+0000 mon.c (mon.1) 2805 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.299614+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.627850+0000 mon.c (mon.1) 2806 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:18:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.628598+0000 mon.c (mon.1) 2807 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.629262+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:18:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.629297+0000 mon.c (mon.1) 2808 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.629996+0000 mon.c (mon.1) 2809 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:18:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.631339+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.632250+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:18:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:14 gibba043 bash[24019]: audit 2021-03-10T17:18:14.633203+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:18:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:15 gibba003 bash[31385]: cluster 2021-03-10T17:18:14.286501+0000 mgr.gibba043.dnkmem (mgr.34373) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:15 gibba003 bash[32348]: cluster 2021-03-10T17:18:14.286501+0000 mgr.gibba043.dnkmem (mgr.34373) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:15 gibba043 bash[24019]: cluster 2021-03-10T17:18:14.286501+0000 mgr.gibba043.dnkmem (mgr.34373) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:17 gibba003 bash[31385]: cluster 2021-03-10T17:18:16.288251+0000 mgr.gibba043.dnkmem (mgr.34373) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:17 gibba003 bash[32348]: cluster 2021-03-10T17:18:16.288251+0000 mgr.gibba043.dnkmem (mgr.34373) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:17 gibba043 bash[24019]: cluster 2021-03-10T17:18:16.288251+0000 mgr.gibba043.dnkmem (mgr.34373) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:19 gibba003 bash[31385]: cluster 2021-03-10T17:18:18.289729+0000 mgr.gibba043.dnkmem (mgr.34373) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:20.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:19 gibba003 bash[32348]: cluster 2021-03-10T17:18:18.289729+0000 mgr.gibba043.dnkmem (mgr.34373) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:20.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:19 gibba043 bash[24019]: cluster 2021-03-10T17:18:18.289729+0000 mgr.gibba043.dnkmem (mgr.34373) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:20 gibba003 bash[31385]: cluster 2021-03-10T17:18:20.291141+0000 mgr.gibba043.dnkmem (mgr.34373) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:20 gibba003 bash[32348]: cluster 2021-03-10T17:18:20.291141+0000 mgr.gibba043.dnkmem (mgr.34373) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:20 gibba043 bash[24019]: cluster 2021-03-10T17:18:20.291141+0000 mgr.gibba043.dnkmem (mgr.34373) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:24.122 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:23 gibba043 bash[24019]: cluster 2021-03-10T17:18:22.292802+0000 mgr.gibba043.dnkmem (mgr.34373) 10922 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:23 gibba003 bash[31385]: cluster 2021-03-10T17:18:22.292802+0000 mgr.gibba043.dnkmem (mgr.34373) 10922 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:23 gibba003 bash[32348]: cluster 2021-03-10T17:18:22.292802+0000 mgr.gibba043.dnkmem (mgr.34373) 10922 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:25 gibba003 bash[31385]: cephadm 2021-03-10T17:18:24.120860+0000 mgr.gibba043.dnkmem (mgr.34373) 10923 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:25 gibba003 bash[31385]: cluster 2021-03-10T17:18:24.294209+0000 mgr.gibba043.dnkmem (mgr.34373) 10924 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:25 gibba003 bash[32348]: cephadm 2021-03-10T17:18:24.120860+0000 mgr.gibba043.dnkmem (mgr.34373) 10923 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:25 gibba003 bash[32348]: cluster 2021-03-10T17:18:24.294209+0000 mgr.gibba043.dnkmem (mgr.34373) 10924 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.246 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:18:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:25 gibba043 bash[24019]: cephadm 2021-03-10T17:18:24.120860+0000 mgr.gibba043.dnkmem (mgr.34373) 10923 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:25 gibba043 bash[24019]: cluster 2021-03-10T17:18:24.294209+0000 mgr.gibba043.dnkmem (mgr.34373) 10924 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.471 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:18:26.471 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:18:26.471 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:18:26.472 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:18:26.472 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:18:26.472 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:18:26.472 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:18:26.473 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:18:26.473 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:18:26.473 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:18:26.473 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:18:26.474 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:18:26.474 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:18:26.474 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:18:26.475 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:18:26.475 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:18:26.475 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:18:26.476 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:18:26.476 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:18:26.476 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:18:26.476 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:18:26.726 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:18:26.727 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:18:26.727 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:26.727 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:18:26.728 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:18:26.728 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:26.728 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:18:26.728 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:18:26.729 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:18:26.729 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:18:26.729 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:18:26.729 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:18:26.729 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:18:26.730 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:18:26.730 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:18:27.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:26 gibba003 bash[31385]: audit 2021-03-10T17:18:26.727690+0000 mon.c (mon.1) 2810 : audit [DBG] from='client.? 172.21.2.103:0/332118939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:27.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:26 gibba003 bash[32348]: audit 2021-03-10T17:18:26.727690+0000 mon.c (mon.1) 2810 : audit [DBG] from='client.? 172.21.2.103:0/332118939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:26 gibba043 bash[24019]: audit 2021-03-10T17:18:26.727690+0000 mon.c (mon.1) 2810 : audit [DBG] from='client.? 172.21.2.103:0/332118939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:27 gibba003 bash[31385]: audit 2021-03-10T17:18:26.236748+0000 mgr.gibba043.dnkmem (mgr.34373) 10925 : audit [DBG] from='client.61366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:27 gibba003 bash[31385]: cluster 2021-03-10T17:18:26.296081+0000 mgr.gibba043.dnkmem (mgr.34373) 10926 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:27 gibba003 bash[31385]: audit 2021-03-10T17:18:26.462268+0000 mgr.gibba043.dnkmem (mgr.34373) 10927 : audit [DBG] from='client.51381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:27 gibba003 bash[32348]: audit 2021-03-10T17:18:26.236748+0000 mgr.gibba043.dnkmem (mgr.34373) 10925 : audit [DBG] from='client.61366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:27 gibba003 bash[32348]: cluster 2021-03-10T17:18:26.296081+0000 mgr.gibba043.dnkmem (mgr.34373) 10926 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:27 gibba003 bash[32348]: audit 2021-03-10T17:18:26.462268+0000 mgr.gibba043.dnkmem (mgr.34373) 10927 : audit [DBG] from='client.51381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:28.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:27 gibba043 bash[24019]: audit 2021-03-10T17:18:26.236748+0000 mgr.gibba043.dnkmem (mgr.34373) 10925 : audit [DBG] from='client.61366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:27 gibba043 bash[24019]: cluster 2021-03-10T17:18:26.296081+0000 mgr.gibba043.dnkmem (mgr.34373) 10926 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:27 gibba043 bash[24019]: audit 2021-03-10T17:18:26.462268+0000 mgr.gibba043.dnkmem (mgr.34373) 10927 : audit [DBG] from='client.51381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:28 gibba003 bash[31385]: cluster 2021-03-10T17:18:28.297575+0000 mgr.gibba043.dnkmem (mgr.34373) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:28 gibba003 bash[32348]: cluster 2021-03-10T17:18:28.297575+0000 mgr.gibba043.dnkmem (mgr.34373) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:28 gibba043 bash[24019]: cluster 2021-03-10T17:18:28.297575+0000 mgr.gibba043.dnkmem (mgr.34373) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:31.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:31 gibba003 bash[31385]: cluster 2021-03-10T17:18:30.299176+0000 mgr.gibba043.dnkmem (mgr.34373) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:31.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:31 gibba003 bash[32348]: cluster 2021-03-10T17:18:30.299176+0000 mgr.gibba043.dnkmem (mgr.34373) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:31 gibba043 bash[24019]: cluster 2021-03-10T17:18:30.299176+0000 mgr.gibba043.dnkmem (mgr.34373) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:33 gibba003 bash[31385]: cluster 2021-03-10T17:18:32.300943+0000 mgr.gibba043.dnkmem (mgr.34373) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:33 gibba003 bash[32348]: cluster 2021-03-10T17:18:32.300943+0000 mgr.gibba043.dnkmem (mgr.34373) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:33 gibba043 bash[24019]: cluster 2021-03-10T17:18:32.300943+0000 mgr.gibba043.dnkmem (mgr.34373) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:35 gibba003 bash[31385]: cluster 2021-03-10T17:18:34.302593+0000 mgr.gibba043.dnkmem (mgr.34373) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:35 gibba003 bash[32348]: cluster 2021-03-10T17:18:34.302593+0000 mgr.gibba043.dnkmem (mgr.34373) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:35 gibba043 bash[24019]: cluster 2021-03-10T17:18:34.302593+0000 mgr.gibba043.dnkmem (mgr.34373) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:37 gibba003 bash[31385]: cluster 2021-03-10T17:18:36.304448+0000 mgr.gibba043.dnkmem (mgr.34373) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:37 gibba003 bash[32348]: cluster 2021-03-10T17:18:36.304448+0000 mgr.gibba043.dnkmem (mgr.34373) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:37 gibba043 bash[24019]: cluster 2021-03-10T17:18:36.304448+0000 mgr.gibba043.dnkmem (mgr.34373) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:39 gibba003 bash[31385]: cluster 2021-03-10T17:18:38.306140+0000 mgr.gibba043.dnkmem (mgr.34373) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:39 gibba003 bash[31385]: audit 2021-03-10T17:18:39.131841+0000 mon.c (mon.1) 2811 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:18:40.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:39 gibba003 bash[32348]: cluster 2021-03-10T17:18:38.306140+0000 mgr.gibba043.dnkmem (mgr.34373) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:39 gibba003 bash[32348]: audit 2021-03-10T17:18:39.131841+0000 mon.c (mon.1) 2811 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:18:40.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:39 gibba043 bash[24019]: cluster 2021-03-10T17:18:38.306140+0000 mgr.gibba043.dnkmem (mgr.34373) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:39 gibba043 bash[24019]: audit 2021-03-10T17:18:39.131841+0000 mon.c (mon.1) 2811 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:18:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:40 gibba003 bash[31385]: cephadm 2021-03-10T17:18:39.129700+0000 mgr.gibba043.dnkmem (mgr.34373) 10934 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:18:41.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:40 gibba003 bash[31385]: cluster 2021-03-10T17:18:40.307507+0000 mgr.gibba043.dnkmem (mgr.34373) 10935 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:40 gibba003 bash[32348]: cephadm 2021-03-10T17:18:39.129700+0000 mgr.gibba043.dnkmem (mgr.34373) 10934 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:18:41.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:40 gibba003 bash[32348]: cluster 2021-03-10T17:18:40.307507+0000 mgr.gibba043.dnkmem (mgr.34373) 10935 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:41.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:40 gibba043 bash[24019]: cephadm 2021-03-10T17:18:39.129700+0000 mgr.gibba043.dnkmem (mgr.34373) 10934 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:18:41.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:40 gibba043 bash[24019]: cluster 2021-03-10T17:18:40.307507+0000 mgr.gibba043.dnkmem (mgr.34373) 10935 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:43 gibba003 bash[31385]: cluster 2021-03-10T17:18:42.309217+0000 mgr.gibba043.dnkmem (mgr.34373) 10936 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:43 gibba003 bash[31385]: audit 2021-03-10T17:18:43.608152+0000 mon.c (mon.1) 2812 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:43 gibba003 bash[31385]: audit 2021-03-10T17:18:43.784032+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:18:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:43 gibba003 bash[32348]: cluster 2021-03-10T17:18:42.309217+0000 mgr.gibba043.dnkmem (mgr.34373) 10936 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:43 gibba003 bash[32348]: audit 2021-03-10T17:18:43.608152+0000 mon.c (mon.1) 2812 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:44.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:43 gibba003 bash[32348]: audit 2021-03-10T17:18:43.784032+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:18:44.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:43 gibba043 bash[24019]: cluster 2021-03-10T17:18:42.309217+0000 mgr.gibba043.dnkmem (mgr.34373) 10936 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:43 gibba043 bash[24019]: audit 2021-03-10T17:18:43.608152+0000 mon.c (mon.1) 2812 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:43 gibba043 bash[24019]: audit 2021-03-10T17:18:43.784032+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:18:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: cephadm 2021-03-10T17:18:43.783862+0000 mgr.gibba043.dnkmem (mgr.34373) 10937 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:18:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.021151+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:18:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.028622+0000 mon.c (mon.1) 2813 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.030469+0000 mon.c (mon.1) 2814 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.032067+0000 mon.c (mon.1) 2815 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.033462+0000 mon.c (mon.1) 2816 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.036749+0000 mon.c (mon.1) 2817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[31385]: audit 2021-03-10T17:18:44.038197+0000 mon.c (mon.1) 2818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: cephadm 2021-03-10T17:18:43.783862+0000 mgr.gibba043.dnkmem (mgr.34373) 10937 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:18:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.021151+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:18:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.028622+0000 mon.c (mon.1) 2813 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.030469+0000 mon.c (mon.1) 2814 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.032067+0000 mon.c (mon.1) 2815 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.033462+0000 mon.c (mon.1) 2816 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.036749+0000 mon.c (mon.1) 2817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:44 gibba003 bash[32348]: audit 2021-03-10T17:18:44.038197+0000 mon.c (mon.1) 2818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: cephadm 2021-03-10T17:18:43.783862+0000 mgr.gibba043.dnkmem (mgr.34373) 10937 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:18:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.021151+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:18:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.028622+0000 mon.c (mon.1) 2813 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.030469+0000 mon.c (mon.1) 2814 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.032067+0000 mon.c (mon.1) 2815 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.033462+0000 mon.c (mon.1) 2816 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.036749+0000 mon.c (mon.1) 2817 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:44 gibba043 bash[24019]: audit 2021-03-10T17:18:44.038197+0000 mon.c (mon.1) 2818 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.026145+0000 mgr.gibba043.dnkmem (mgr.34373) 10938 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.028316+0000 mgr.gibba043.dnkmem (mgr.34373) 10939 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.029763+0000 mgr.gibba043.dnkmem (mgr.34373) 10940 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:46.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.029802+0000 mgr.gibba043.dnkmem (mgr.34373) 10941 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:46.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.031318+0000 mgr.gibba043.dnkmem (mgr.34373) 10942 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:46.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.031355+0000 mgr.gibba043.dnkmem (mgr.34373) 10943 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:46.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.032665+0000 mgr.gibba043.dnkmem (mgr.34373) 10944 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.034557+0000 mgr.gibba043.dnkmem (mgr.34373) 10945 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.034596+0000 mgr.gibba043.dnkmem (mgr.34373) 10946 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.035967+0000 mgr.gibba043.dnkmem (mgr.34373) 10947 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.036308+0000 mgr.gibba043.dnkmem (mgr.34373) 10948 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:46.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.037724+0000 mgr.gibba043.dnkmem (mgr.34373) 10949 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:46.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.037766+0000 mgr.gibba043.dnkmem (mgr.34373) 10950 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:46.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cephadm 2021-03-10T17:18:44.037878+0000 mgr.gibba043.dnkmem (mgr.34373) 10951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:46.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[31385]: cluster 2021-03-10T17:18:44.310592+0000 mgr.gibba043.dnkmem (mgr.34373) 10952 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:46.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.026145+0000 mgr.gibba043.dnkmem (mgr.34373) 10938 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:46.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.028316+0000 mgr.gibba043.dnkmem (mgr.34373) 10939 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:46.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.029763+0000 mgr.gibba043.dnkmem (mgr.34373) 10940 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:46.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.029802+0000 mgr.gibba043.dnkmem (mgr.34373) 10941 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:46.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.031318+0000 mgr.gibba043.dnkmem (mgr.34373) 10942 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:46.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.031355+0000 mgr.gibba043.dnkmem (mgr.34373) 10943 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:46.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.032665+0000 mgr.gibba043.dnkmem (mgr.34373) 10944 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:46.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.034557+0000 mgr.gibba043.dnkmem (mgr.34373) 10945 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:46.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.034596+0000 mgr.gibba043.dnkmem (mgr.34373) 10946 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:46.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.035967+0000 mgr.gibba043.dnkmem (mgr.34373) 10947 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:46.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.036308+0000 mgr.gibba043.dnkmem (mgr.34373) 10948 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:46.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.037724+0000 mgr.gibba043.dnkmem (mgr.34373) 10949 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:46.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.037766+0000 mgr.gibba043.dnkmem (mgr.34373) 10950 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:46.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cephadm 2021-03-10T17:18:44.037878+0000 mgr.gibba043.dnkmem (mgr.34373) 10951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:46.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:45 gibba003 bash[32348]: cluster 2021-03-10T17:18:44.310592+0000 mgr.gibba043.dnkmem (mgr.34373) 10952 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.026145+0000 mgr.gibba043.dnkmem (mgr.34373) 10938 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.028316+0000 mgr.gibba043.dnkmem (mgr.34373) 10939 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.029763+0000 mgr.gibba043.dnkmem (mgr.34373) 10940 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.029802+0000 mgr.gibba043.dnkmem (mgr.34373) 10941 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.031318+0000 mgr.gibba043.dnkmem (mgr.34373) 10942 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.031355+0000 mgr.gibba043.dnkmem (mgr.34373) 10943 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.032665+0000 mgr.gibba043.dnkmem (mgr.34373) 10944 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.034557+0000 mgr.gibba043.dnkmem (mgr.34373) 10945 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.034596+0000 mgr.gibba043.dnkmem (mgr.34373) 10946 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.035967+0000 mgr.gibba043.dnkmem (mgr.34373) 10947 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.036308+0000 mgr.gibba043.dnkmem (mgr.34373) 10948 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:46.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.037724+0000 mgr.gibba043.dnkmem (mgr.34373) 10949 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:46.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.037766+0000 mgr.gibba043.dnkmem (mgr.34373) 10950 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:46.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cephadm 2021-03-10T17:18:44.037878+0000 mgr.gibba043.dnkmem (mgr.34373) 10951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:18:46.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:45 gibba043 bash[24019]: cluster 2021-03-10T17:18:44.310592+0000 mgr.gibba043.dnkmem (mgr.34373) 10952 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:47 gibba003 bash[31385]: cluster 2021-03-10T17:18:46.312311+0000 mgr.gibba043.dnkmem (mgr.34373) 10953 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:47 gibba003 bash[32348]: cluster 2021-03-10T17:18:46.312311+0000 mgr.gibba043.dnkmem (mgr.34373) 10953 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:47 gibba043 bash[24019]: cluster 2021-03-10T17:18:46.312311+0000 mgr.gibba043.dnkmem (mgr.34373) 10953 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:50.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:49 gibba003 bash[31385]: cluster 2021-03-10T17:18:48.313694+0000 mgr.gibba043.dnkmem (mgr.34373) 10954 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:50.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:49 gibba003 bash[32348]: cluster 2021-03-10T17:18:48.313694+0000 mgr.gibba043.dnkmem (mgr.34373) 10954 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:50.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:49 gibba043 bash[24019]: cluster 2021-03-10T17:18:48.313694+0000 mgr.gibba043.dnkmem (mgr.34373) 10954 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:51.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:50 gibba003 bash[31385]: cluster 2021-03-10T17:18:50.315280+0000 mgr.gibba043.dnkmem (mgr.34373) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:51.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:50 gibba003 bash[32348]: cluster 2021-03-10T17:18:50.315280+0000 mgr.gibba043.dnkmem (mgr.34373) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:51.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:50 gibba043 bash[24019]: cluster 2021-03-10T17:18:50.315280+0000 mgr.gibba043.dnkmem (mgr.34373) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:53 gibba003 bash[31385]: cluster 2021-03-10T17:18:52.316643+0000 mgr.gibba043.dnkmem (mgr.34373) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:53 gibba003 bash[32348]: cluster 2021-03-10T17:18:52.316643+0000 mgr.gibba043.dnkmem (mgr.34373) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:53 gibba043 bash[24019]: cluster 2021-03-10T17:18:52.316643+0000 mgr.gibba043.dnkmem (mgr.34373) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:55 gibba003 bash[31385]: cluster 2021-03-10T17:18:54.318231+0000 mgr.gibba043.dnkmem (mgr.34373) 10957 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:55 gibba003 bash[32348]: cluster 2021-03-10T17:18:54.318231+0000 mgr.gibba043.dnkmem (mgr.34373) 10957 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:55 gibba043 bash[24019]: cluster 2021-03-10T17:18:54.318231+0000 mgr.gibba043.dnkmem (mgr.34373) 10957 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.970 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:18:57.199 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:18:57.199 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:18:57.200 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:18:57.200 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:18:57.200 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:18:57.200 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:18:57.200 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:18:57.201 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:18:57.201 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:18:57.201 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:18:57.201 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:18:57.202 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:18:57.202 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:18:57.202 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:18:57.202 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:18:57.202 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:18:57.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:18:57.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:18:57.203 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:18:57.203 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:18:57.204 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:18:57.447 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:18:57.447 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:18:57.447 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:57.448 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:18:57.448 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:18:57.448 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:57.448 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:18:57.449 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:18:57.449 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:18:57.449 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:18:57.449 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:18:57.449 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:18:57.450 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:18:57.450 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:18:57.450 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:18:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:57 gibba003 bash[31385]: cluster 2021-03-10T17:18:56.320087+0000 mgr.gibba043.dnkmem (mgr.34373) 10958 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:57 gibba003 bash[31385]: audit 2021-03-10T17:18:57.448058+0000 mon.a (mon.0) 2197 : audit [DBG] from='client.? 172.21.2.103:0/3590169979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:57 gibba003 bash[32348]: cluster 2021-03-10T17:18:56.320087+0000 mgr.gibba043.dnkmem (mgr.34373) 10958 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:57 gibba003 bash[32348]: audit 2021-03-10T17:18:57.448058+0000 mon.a (mon.0) 2197 : audit [DBG] from='client.? 172.21.2.103:0/3590169979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:58.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:57 gibba043 bash[24019]: cluster 2021-03-10T17:18:56.320087+0000 mgr.gibba043.dnkmem (mgr.34373) 10958 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:57 gibba043 bash[24019]: audit 2021-03-10T17:18:57.448058+0000 mon.a (mon.0) 2197 : audit [DBG] from='client.? 172.21.2.103:0/3590169979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:58 gibba003 bash[31385]: audit 2021-03-10T17:18:56.960878+0000 mgr.gibba043.dnkmem (mgr.34373) 10959 : audit [DBG] from='client.61384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:58 gibba003 bash[31385]: audit 2021-03-10T17:18:57.186461+0000 mgr.gibba043.dnkmem (mgr.34373) 10960 : audit [DBG] from='client.61390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:58 gibba003 bash[32348]: audit 2021-03-10T17:18:56.960878+0000 mgr.gibba043.dnkmem (mgr.34373) 10959 : audit [DBG] from='client.61384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:59.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:58 gibba003 bash[32348]: audit 2021-03-10T17:18:57.186461+0000 mgr.gibba043.dnkmem (mgr.34373) 10960 : audit [DBG] from='client.61390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:58 gibba043 bash[24019]: audit 2021-03-10T17:18:56.960878+0000 mgr.gibba043.dnkmem (mgr.34373) 10959 : audit [DBG] from='client.61384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:58 gibba043 bash[24019]: audit 2021-03-10T17:18:57.186461+0000 mgr.gibba043.dnkmem (mgr.34373) 10960 : audit [DBG] from='client.61390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:59 gibba003 bash[31385]: cluster 2021-03-10T17:18:58.321465+0000 mgr.gibba043.dnkmem (mgr.34373) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:18:59 gibba003 bash[31385]: cephadm 2021-03-10T17:18:59.053736+0000 mgr.gibba043.dnkmem (mgr.34373) 10962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:59 gibba003 bash[32348]: cluster 2021-03-10T17:18:58.321465+0000 mgr.gibba043.dnkmem (mgr.34373) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:18:59 gibba003 bash[32348]: cephadm 2021-03-10T17:18:59.053736+0000 mgr.gibba043.dnkmem (mgr.34373) 10962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:59 gibba043 bash[24019]: cluster 2021-03-10T17:18:58.321465+0000 mgr.gibba043.dnkmem (mgr.34373) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:18:59 gibba043 bash[24019]: cephadm 2021-03-10T17:18:59.053736+0000 mgr.gibba043.dnkmem (mgr.34373) 10962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:00 gibba003 bash[31385]: cluster 2021-03-10T17:19:00.322869+0000 mgr.gibba043.dnkmem (mgr.34373) 10963 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:00 gibba003 bash[32348]: cluster 2021-03-10T17:19:00.322869+0000 mgr.gibba043.dnkmem (mgr.34373) 10963 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:00 gibba043 bash[24019]: cluster 2021-03-10T17:19:00.322869+0000 mgr.gibba043.dnkmem (mgr.34373) 10963 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:03 gibba003 bash[31385]: cluster 2021-03-10T17:19:02.324271+0000 mgr.gibba043.dnkmem (mgr.34373) 10964 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:03 gibba003 bash[32348]: cluster 2021-03-10T17:19:02.324271+0000 mgr.gibba043.dnkmem (mgr.34373) 10964 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:03 gibba043 bash[24019]: cluster 2021-03-10T17:19:02.324271+0000 mgr.gibba043.dnkmem (mgr.34373) 10964 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:05 gibba003 bash[31385]: cluster 2021-03-10T17:19:04.325754+0000 mgr.gibba043.dnkmem (mgr.34373) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:05 gibba003 bash[32348]: cluster 2021-03-10T17:19:04.325754+0000 mgr.gibba043.dnkmem (mgr.34373) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:05 gibba043 bash[24019]: cluster 2021-03-10T17:19:04.325754+0000 mgr.gibba043.dnkmem (mgr.34373) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:07 gibba003 bash[31385]: cluster 2021-03-10T17:19:06.327570+0000 mgr.gibba043.dnkmem (mgr.34373) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:07 gibba003 bash[32348]: cluster 2021-03-10T17:19:06.327570+0000 mgr.gibba043.dnkmem (mgr.34373) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:07 gibba043 bash[24019]: cluster 2021-03-10T17:19:06.327570+0000 mgr.gibba043.dnkmem (mgr.34373) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:08 gibba003 bash[31385]: cluster 2021-03-10T17:19:08.329280+0000 mgr.gibba043.dnkmem (mgr.34373) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:08 gibba003 bash[32348]: cluster 2021-03-10T17:19:08.329280+0000 mgr.gibba043.dnkmem (mgr.34373) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:08 gibba043 bash[24019]: cluster 2021-03-10T17:19:08.329280+0000 mgr.gibba043.dnkmem (mgr.34373) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:11.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:11 gibba003 bash[31385]: cluster 2021-03-10T17:19:10.330840+0000 mgr.gibba043.dnkmem (mgr.34373) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:11.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:11 gibba003 bash[32348]: cluster 2021-03-10T17:19:10.330840+0000 mgr.gibba043.dnkmem (mgr.34373) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:11.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:11 gibba043 bash[24019]: cluster 2021-03-10T17:19:10.330840+0000 mgr.gibba043.dnkmem (mgr.34373) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:13 gibba003 bash[31385]: cluster 2021-03-10T17:19:12.332249+0000 mgr.gibba043.dnkmem (mgr.34373) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:14.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:13 gibba003 bash[32348]: cluster 2021-03-10T17:19:12.332249+0000 mgr.gibba043.dnkmem (mgr.34373) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:13 gibba043 bash[24019]: cluster 2021-03-10T17:19:12.332249+0000 mgr.gibba043.dnkmem (mgr.34373) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.061869+0000 mon.c (mon.1) 2819 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.063105+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.304144+0000 mon.c (mon.1) 2820 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.305310+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.639184+0000 mon.c (mon.1) 2821 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:19:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.639928+0000 mon.c (mon.1) 2822 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:19:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.640398+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:19:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.640619+0000 mon.c (mon.1) 2823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.641442+0000 mon.c (mon.1) 2824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.641579+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:19:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.642762+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[31385]: audit 2021-03-10T17:19:14.643595+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.061869+0000 mon.c (mon.1) 2819 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.063105+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.304144+0000 mon.c (mon.1) 2820 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.305310+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.639184+0000 mon.c (mon.1) 2821 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:19:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.639928+0000 mon.c (mon.1) 2822 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:19:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.640398+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:19:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.640619+0000 mon.c (mon.1) 2823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.641442+0000 mon.c (mon.1) 2824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.641579+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:19:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.642762+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:14 gibba003 bash[32348]: audit 2021-03-10T17:19:14.643595+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.061869+0000 mon.c (mon.1) 2819 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.063105+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.304144+0000 mon.c (mon.1) 2820 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.305310+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.639184+0000 mon.c (mon.1) 2821 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:19:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.639928+0000 mon.c (mon.1) 2822 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:19:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.640398+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:19:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.640619+0000 mon.c (mon.1) 2823 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.641442+0000 mon.c (mon.1) 2824 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.641579+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:19:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.642762+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:14 gibba043 bash[24019]: audit 2021-03-10T17:19:14.643595+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:15 gibba003 bash[31385]: cephadm 2021-03-10T17:19:14.069655+0000 mgr.gibba043.dnkmem (mgr.34373) 10970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:15 gibba003 bash[31385]: cluster 2021-03-10T17:19:14.333177+0000 mgr.gibba043.dnkmem (mgr.34373) 10971 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:15 gibba003 bash[32348]: cephadm 2021-03-10T17:19:14.069655+0000 mgr.gibba043.dnkmem (mgr.34373) 10970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:15 gibba003 bash[32348]: cluster 2021-03-10T17:19:14.333177+0000 mgr.gibba043.dnkmem (mgr.34373) 10971 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:15 gibba043 bash[24019]: cephadm 2021-03-10T17:19:14.069655+0000 mgr.gibba043.dnkmem (mgr.34373) 10970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:16.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:15 gibba043 bash[24019]: cluster 2021-03-10T17:19:14.333177+0000 mgr.gibba043.dnkmem (mgr.34373) 10971 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:17.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:16 gibba003 bash[31385]: cluster 2021-03-10T17:19:16.334866+0000 mgr.gibba043.dnkmem (mgr.34373) 10972 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:17.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:16 gibba003 bash[32348]: cluster 2021-03-10T17:19:16.334866+0000 mgr.gibba043.dnkmem (mgr.34373) 10972 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:17.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:16 gibba043 bash[24019]: cluster 2021-03-10T17:19:16.334866+0000 mgr.gibba043.dnkmem (mgr.34373) 10972 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:20.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:19 gibba003 bash[31385]: cluster 2021-03-10T17:19:18.336533+0000 mgr.gibba043.dnkmem (mgr.34373) 10973 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:20.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:19 gibba003 bash[32348]: cluster 2021-03-10T17:19:18.336533+0000 mgr.gibba043.dnkmem (mgr.34373) 10973 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:20.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:19 gibba043 bash[24019]: cluster 2021-03-10T17:19:18.336533+0000 mgr.gibba043.dnkmem (mgr.34373) 10973 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:21 gibba003 bash[31385]: cluster 2021-03-10T17:19:20.338113+0000 mgr.gibba043.dnkmem (mgr.34373) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:21 gibba003 bash[32348]: cluster 2021-03-10T17:19:20.338113+0000 mgr.gibba043.dnkmem (mgr.34373) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:22.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:21 gibba043 bash[24019]: cluster 2021-03-10T17:19:20.338113+0000 mgr.gibba043.dnkmem (mgr.34373) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:23 gibba003 bash[31385]: cluster 2021-03-10T17:19:22.339660+0000 mgr.gibba043.dnkmem (mgr.34373) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:23 gibba003 bash[32348]: cluster 2021-03-10T17:19:22.339660+0000 mgr.gibba043.dnkmem (mgr.34373) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:23 gibba043 bash[24019]: cluster 2021-03-10T17:19:22.339660+0000 mgr.gibba043.dnkmem (mgr.34373) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:26.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:25 gibba003 bash[31385]: cluster 2021-03-10T17:19:24.341048+0000 mgr.gibba043.dnkmem (mgr.34373) 10976 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:25 gibba003 bash[32348]: cluster 2021-03-10T17:19:24.341048+0000 mgr.gibba043.dnkmem (mgr.34373) 10976 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:26.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:25 gibba043 bash[24019]: cluster 2021-03-10T17:19:24.341048+0000 mgr.gibba043.dnkmem (mgr.34373) 10976 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:26 gibba003 bash[31385]: cluster 2021-03-10T17:19:26.342841+0000 mgr.gibba043.dnkmem (mgr.34373) 10977 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:26 gibba003 bash[32348]: cluster 2021-03-10T17:19:26.342841+0000 mgr.gibba043.dnkmem (mgr.34373) 10977 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:26 gibba043 bash[24019]: cluster 2021-03-10T17:19:26.342841+0000 mgr.gibba043.dnkmem (mgr.34373) 10977 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.685 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:19:27.911 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:19:27.912 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:19:27.912 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:19:27.912 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:19:27.912 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:19:27.913 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:19:27.913 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:19:27.913 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:19:27.913 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:19:27.914 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:19:27.914 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:19:27.914 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:19:27.914 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:19:27.914 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:19:27.915 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:19:27.915 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:19:27.915 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:19:27.915 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:19:27.916 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:19:27.916 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:19:27.916 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:19:28.159 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:19:28.159 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:19:28.159 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:28.160 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:19:28.160 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:19:28.160 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:28.160 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:19:28.161 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:19:28.161 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:19:28.161 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:19:28.161 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:19:28.161 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:19:28.162 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:19:28.162 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:19:28.162 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:19:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:28 gibba003 bash[31385]: audit 2021-03-10T17:19:27.676419+0000 mgr.gibba043.dnkmem (mgr.34373) 10978 : audit [DBG] from='client.51411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:29.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:28 gibba003 bash[31385]: audit 2021-03-10T17:19:28.159848+0000 mon.c (mon.1) 2825 : audit [DBG] from='client.? 172.21.2.103:0/893712376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:28 gibba003 bash[32348]: audit 2021-03-10T17:19:27.676419+0000 mgr.gibba043.dnkmem (mgr.34373) 10978 : audit [DBG] from='client.51411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:28 gibba003 bash[32348]: audit 2021-03-10T17:19:28.159848+0000 mon.c (mon.1) 2825 : audit [DBG] from='client.? 172.21.2.103:0/893712376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:28 gibba043 bash[24019]: audit 2021-03-10T17:19:27.676419+0000 mgr.gibba043.dnkmem (mgr.34373) 10978 : audit [DBG] from='client.51411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:28 gibba043 bash[24019]: audit 2021-03-10T17:19:28.159848+0000 mon.c (mon.1) 2825 : audit [DBG] from='client.? 172.21.2.103:0/893712376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:29 gibba003 bash[31385]: audit 2021-03-10T17:19:27.900368+0000 mgr.gibba043.dnkmem (mgr.34373) 10979 : audit [DBG] from='client.51417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:30.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:29 gibba003 bash[31385]: cluster 2021-03-10T17:19:28.344398+0000 mgr.gibba043.dnkmem (mgr.34373) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:30.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:29 gibba003 bash[32348]: audit 2021-03-10T17:19:27.900368+0000 mgr.gibba043.dnkmem (mgr.34373) 10979 : audit [DBG] from='client.51417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:30.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:29 gibba003 bash[32348]: cluster 2021-03-10T17:19:28.344398+0000 mgr.gibba043.dnkmem (mgr.34373) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:29 gibba043 bash[24019]: audit 2021-03-10T17:19:27.900368+0000 mgr.gibba043.dnkmem (mgr.34373) 10979 : audit [DBG] from='client.51417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:29 gibba043 bash[24019]: cluster 2021-03-10T17:19:28.344398+0000 mgr.gibba043.dnkmem (mgr.34373) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:30 gibba003 bash[31385]: cephadm 2021-03-10T17:19:29.080538+0000 mgr.gibba043.dnkmem (mgr.34373) 10981 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:31.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:30 gibba003 bash[31385]: cluster 2021-03-10T17:19:30.345976+0000 mgr.gibba043.dnkmem (mgr.34373) 10982 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:31.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:30 gibba003 bash[32348]: cephadm 2021-03-10T17:19:29.080538+0000 mgr.gibba043.dnkmem (mgr.34373) 10981 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:31.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:30 gibba003 bash[32348]: cluster 2021-03-10T17:19:30.345976+0000 mgr.gibba043.dnkmem (mgr.34373) 10982 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:30 gibba043 bash[24019]: cephadm 2021-03-10T17:19:29.080538+0000 mgr.gibba043.dnkmem (mgr.34373) 10981 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:31.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:30 gibba043 bash[24019]: cluster 2021-03-10T17:19:30.345976+0000 mgr.gibba043.dnkmem (mgr.34373) 10982 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:34.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:33 gibba003 bash[31385]: cluster 2021-03-10T17:19:32.347712+0000 mgr.gibba043.dnkmem (mgr.34373) 10983 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:33 gibba003 bash[32348]: cluster 2021-03-10T17:19:32.347712+0000 mgr.gibba043.dnkmem (mgr.34373) 10983 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:33 gibba043 bash[24019]: cluster 2021-03-10T17:19:32.347712+0000 mgr.gibba043.dnkmem (mgr.34373) 10983 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:35 gibba003 bash[31385]: cluster 2021-03-10T17:19:34.349121+0000 mgr.gibba043.dnkmem (mgr.34373) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:35 gibba003 bash[32348]: cluster 2021-03-10T17:19:34.349121+0000 mgr.gibba043.dnkmem (mgr.34373) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:35 gibba043 bash[24019]: cluster 2021-03-10T17:19:34.349121+0000 mgr.gibba043.dnkmem (mgr.34373) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:36 gibba003 bash[31385]: cluster 2021-03-10T17:19:36.351107+0000 mgr.gibba043.dnkmem (mgr.34373) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:36 gibba003 bash[32348]: cluster 2021-03-10T17:19:36.351107+0000 mgr.gibba043.dnkmem (mgr.34373) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:37.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:36 gibba043 bash[24019]: cluster 2021-03-10T17:19:36.351107+0000 mgr.gibba043.dnkmem (mgr.34373) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:38 gibba003 bash[31385]: cluster 2021-03-10T17:19:38.352772+0000 mgr.gibba043.dnkmem (mgr.34373) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:38 gibba003 bash[32348]: cluster 2021-03-10T17:19:38.352772+0000 mgr.gibba043.dnkmem (mgr.34373) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:38 gibba043 bash[24019]: cluster 2021-03-10T17:19:38.352772+0000 mgr.gibba043.dnkmem (mgr.34373) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:41.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:41 gibba003 bash[31385]: cluster 2021-03-10T17:19:40.354193+0000 mgr.gibba043.dnkmem (mgr.34373) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:41.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:41 gibba003 bash[32348]: cluster 2021-03-10T17:19:40.354193+0000 mgr.gibba043.dnkmem (mgr.34373) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:41 gibba043 bash[24019]: cluster 2021-03-10T17:19:40.354193+0000 mgr.gibba043.dnkmem (mgr.34373) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:44.189 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:43 gibba003 bash[31385]: cluster 2021-03-10T17:19:42.355925+0000 mgr.gibba043.dnkmem (mgr.34373) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:44.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:43 gibba003 bash[32348]: cluster 2021-03-10T17:19:42.355925+0000 mgr.gibba043.dnkmem (mgr.34373) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:44.270 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:43 gibba043 bash[24019]: cluster 2021-03-10T17:19:42.355925+0000 mgr.gibba043.dnkmem (mgr.34373) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:45.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:44 gibba003 bash[31385]: audit 2021-03-10T17:19:44.092268+0000 mon.c (mon.1) 2826 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:19:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:44 gibba003 bash[32348]: audit 2021-03-10T17:19:44.092268+0000 mon.c (mon.1) 2826 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:19:45.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:44 gibba043 bash[24019]: audit 2021-03-10T17:19:44.092268+0000 mon.c (mon.1) 2826 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:19:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:45 gibba003 bash[31385]: cephadm 2021-03-10T17:19:44.090229+0000 mgr.gibba043.dnkmem (mgr.34373) 10989 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:19:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:45 gibba003 bash[31385]: cluster 2021-03-10T17:19:44.356585+0000 mgr.gibba043.dnkmem (mgr.34373) 10990 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:45 gibba003 bash[32348]: cephadm 2021-03-10T17:19:44.090229+0000 mgr.gibba043.dnkmem (mgr.34373) 10989 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:19:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:45 gibba003 bash[32348]: cluster 2021-03-10T17:19:44.356585+0000 mgr.gibba043.dnkmem (mgr.34373) 10990 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:46.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:45 gibba043 bash[24019]: cephadm 2021-03-10T17:19:44.090229+0000 mgr.gibba043.dnkmem (mgr.34373) 10989 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:19:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:45 gibba043 bash[24019]: cluster 2021-03-10T17:19:44.356585+0000 mgr.gibba043.dnkmem (mgr.34373) 10990 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:47.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:46 gibba003 bash[31385]: cluster 2021-03-10T17:19:46.358331+0000 mgr.gibba043.dnkmem (mgr.34373) 10991 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:47.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:46 gibba003 bash[32348]: cluster 2021-03-10T17:19:46.358331+0000 mgr.gibba043.dnkmem (mgr.34373) 10991 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:47.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:46 gibba043 bash[24019]: cluster 2021-03-10T17:19:46.358331+0000 mgr.gibba043.dnkmem (mgr.34373) 10991 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:48.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.653582+0000 mgr.gibba043.dnkmem (mgr.34373) 10992 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:19:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.654054+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:19:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.857148+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:19:48.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.861308+0000 mon.c (mon.1) 2827 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.864439+0000 mon.c (mon.1) 2828 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.867111+0000 mon.c (mon.1) 2829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.869611+0000 mon.c (mon.1) 2830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.877478+0000 mon.c (mon.1) 2831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[31385]: audit 2021-03-10T17:19:47.880702+0000 mon.c (mon.1) 2832 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.653582+0000 mgr.gibba043.dnkmem (mgr.34373) 10992 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:19:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.654054+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:19:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.857148+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:19:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.861308+0000 mon.c (mon.1) 2827 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.864439+0000 mon.c (mon.1) 2828 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.867111+0000 mon.c (mon.1) 2829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.869611+0000 mon.c (mon.1) 2830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.877478+0000 mon.c (mon.1) 2831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:48.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:48 gibba003 bash[32348]: audit 2021-03-10T17:19:47.880702+0000 mon.c (mon.1) 2832 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.653582+0000 mgr.gibba043.dnkmem (mgr.34373) 10992 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:19:49.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.654054+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:19:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.857148+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:19:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.861308+0000 mon.c (mon.1) 2827 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:49.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.864439+0000 mon.c (mon.1) 2828 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.867111+0000 mon.c (mon.1) 2829 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.869611+0000 mon.c (mon.1) 2830 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.877478+0000 mon.c (mon.1) 2831 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:48 gibba043 bash[24019]: audit 2021-03-10T17:19:47.880702+0000 mon.c (mon.1) 2832 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:49.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.858670+0000 mgr.gibba043.dnkmem (mgr.34373) 10993 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.862071+0000 mgr.gibba043.dnkmem (mgr.34373) 10994 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.864668+0000 mgr.gibba043.dnkmem (mgr.34373) 10995 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:49.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.864721+0000 mgr.gibba043.dnkmem (mgr.34373) 10996 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.867323+0000 mgr.gibba043.dnkmem (mgr.34373) 10997 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.867375+0000 mgr.gibba043.dnkmem (mgr.34373) 10998 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.870220+0000 mgr.gibba043.dnkmem (mgr.34373) 10999 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:49.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.874810+0000 mgr.gibba043.dnkmem (mgr.34373) 11000 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.874874+0000 mgr.gibba043.dnkmem (mgr.34373) 11001 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.877858+0000 mgr.gibba043.dnkmem (mgr.34373) 11002 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.878382+0000 mgr.gibba043.dnkmem (mgr.34373) 11003 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.881108+0000 mgr.gibba043.dnkmem (mgr.34373) 11004 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:49.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.881178+0000 mgr.gibba043.dnkmem (mgr.34373) 11005 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:49.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cephadm 2021-03-10T17:19:47.881354+0000 mgr.gibba043.dnkmem (mgr.34373) 11006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:49.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[31385]: cluster 2021-03-10T17:19:48.360032+0000 mgr.gibba043.dnkmem (mgr.34373) 11007 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:49.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.858670+0000 mgr.gibba043.dnkmem (mgr.34373) 10993 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.862071+0000 mgr.gibba043.dnkmem (mgr.34373) 10994 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.864668+0000 mgr.gibba043.dnkmem (mgr.34373) 10995 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.864721+0000 mgr.gibba043.dnkmem (mgr.34373) 10996 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.867323+0000 mgr.gibba043.dnkmem (mgr.34373) 10997 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:49.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.867375+0000 mgr.gibba043.dnkmem (mgr.34373) 10998 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.870220+0000 mgr.gibba043.dnkmem (mgr.34373) 10999 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.874810+0000 mgr.gibba043.dnkmem (mgr.34373) 11000 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.874874+0000 mgr.gibba043.dnkmem (mgr.34373) 11001 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:49.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.877858+0000 mgr.gibba043.dnkmem (mgr.34373) 11002 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.878382+0000 mgr.gibba043.dnkmem (mgr.34373) 11003 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.881108+0000 mgr.gibba043.dnkmem (mgr.34373) 11004 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.881178+0000 mgr.gibba043.dnkmem (mgr.34373) 11005 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cephadm 2021-03-10T17:19:47.881354+0000 mgr.gibba043.dnkmem (mgr.34373) 11006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:49.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:49 gibba003 bash[32348]: cluster 2021-03-10T17:19:48.360032+0000 mgr.gibba043.dnkmem (mgr.34373) 11007 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:50.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.858670+0000 mgr.gibba043.dnkmem (mgr.34373) 10993 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.862071+0000 mgr.gibba043.dnkmem (mgr.34373) 10994 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.864668+0000 mgr.gibba043.dnkmem (mgr.34373) 10995 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:50.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.864721+0000 mgr.gibba043.dnkmem (mgr.34373) 10996 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.867323+0000 mgr.gibba043.dnkmem (mgr.34373) 10997 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.867375+0000 mgr.gibba043.dnkmem (mgr.34373) 10998 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.870220+0000 mgr.gibba043.dnkmem (mgr.34373) 10999 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.874810+0000 mgr.gibba043.dnkmem (mgr.34373) 11000 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:50.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.874874+0000 mgr.gibba043.dnkmem (mgr.34373) 11001 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:50.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.877858+0000 mgr.gibba043.dnkmem (mgr.34373) 11002 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:50.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.878382+0000 mgr.gibba043.dnkmem (mgr.34373) 11003 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:50.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.881108+0000 mgr.gibba043.dnkmem (mgr.34373) 11004 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:50.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.881178+0000 mgr.gibba043.dnkmem (mgr.34373) 11005 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:50.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cephadm 2021-03-10T17:19:47.881354+0000 mgr.gibba043.dnkmem (mgr.34373) 11006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:19:50.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:49 gibba043 bash[24019]: cluster 2021-03-10T17:19:48.360032+0000 mgr.gibba043.dnkmem (mgr.34373) 11007 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:51 gibba003 bash[31385]: cluster 2021-03-10T17:19:50.361470+0000 mgr.gibba043.dnkmem (mgr.34373) 11008 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:51 gibba003 bash[32348]: cluster 2021-03-10T17:19:50.361470+0000 mgr.gibba043.dnkmem (mgr.34373) 11008 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:51 gibba043 bash[24019]: cluster 2021-03-10T17:19:50.361470+0000 mgr.gibba043.dnkmem (mgr.34373) 11008 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:53 gibba003 bash[31385]: cluster 2021-03-10T17:19:52.363156+0000 mgr.gibba043.dnkmem (mgr.34373) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:53 gibba003 bash[32348]: cluster 2021-03-10T17:19:52.363156+0000 mgr.gibba043.dnkmem (mgr.34373) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:53 gibba043 bash[24019]: cluster 2021-03-10T17:19:52.363156+0000 mgr.gibba043.dnkmem (mgr.34373) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:55 gibba003 bash[31385]: cluster 2021-03-10T17:19:54.364743+0000 mgr.gibba043.dnkmem (mgr.34373) 11010 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:55 gibba003 bash[32348]: cluster 2021-03-10T17:19:54.364743+0000 mgr.gibba043.dnkmem (mgr.34373) 11010 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:56.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:55 gibba043 bash[24019]: cluster 2021-03-10T17:19:54.364743+0000 mgr.gibba043.dnkmem (mgr.34373) 11010 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:56 gibba003 bash[31385]: cluster 2021-03-10T17:19:56.366667+0000 mgr.gibba043.dnkmem (mgr.34373) 11011 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:56 gibba003 bash[32348]: cluster 2021-03-10T17:19:56.366667+0000 mgr.gibba043.dnkmem (mgr.34373) 11011 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:57.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:56 gibba043 bash[24019]: cluster 2021-03-10T17:19:56.366667+0000 mgr.gibba043.dnkmem (mgr.34373) 11011 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:58.401 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:19:58.628 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:19:58.629 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 10s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:19:58.629 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:19:58.629 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:19:58.629 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:19:58.630 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:19:58.630 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:19:58.630 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:19:58.630 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:19:58.630 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 10s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:19:58.631 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:19:58.631 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:19:58.631 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:19:58.631 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:19:58.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:19:58.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:19:58.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:19:58.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:19:58.632 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:19:58.633 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:19:58.633 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:19:58.880 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:19:58.880 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:19:58.880 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:58.881 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:19:58.881 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:19:58.881 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:58.881 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:19:58.882 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:19:58.882 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:19:58.882 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:19:58.882 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:19:58.882 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:19:58.883 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:19:58.883 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:19:58.883 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:20:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[31385]: cluster 2021-03-10T17:19:58.368331+0000 mgr.gibba043.dnkmem (mgr.34373) 11012 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[31385]: audit 2021-03-10T17:19:58.391158+0000 mgr.gibba043.dnkmem (mgr.34373) 11013 : audit [DBG] from='client.61420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[31385]: audit 2021-03-10T17:19:58.615271+0000 mgr.gibba043.dnkmem (mgr.34373) 11014 : audit [DBG] from='client.61426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[31385]: audit 2021-03-10T17:19:58.880747+0000 mon.c (mon.1) 2833 : audit [DBG] from='client.? 172.21.2.103:0/3679870459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:00 gibba003 bash[31385]: debug 2021-03-10T17:19:59.998+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[32348]: cluster 2021-03-10T17:19:58.368331+0000 mgr.gibba043.dnkmem (mgr.34373) 11012 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[32348]: audit 2021-03-10T17:19:58.391158+0000 mgr.gibba043.dnkmem (mgr.34373) 11013 : audit [DBG] from='client.61420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:00.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[32348]: audit 2021-03-10T17:19:58.615271+0000 mgr.gibba043.dnkmem (mgr.34373) 11014 : audit [DBG] from='client.61426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:00.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:19:59 gibba003 bash[32348]: audit 2021-03-10T17:19:58.880747+0000 mon.c (mon.1) 2833 : audit [DBG] from='client.? 172.21.2.103:0/3679870459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:59 gibba043 bash[24019]: cluster 2021-03-10T17:19:58.368331+0000 mgr.gibba043.dnkmem (mgr.34373) 11012 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:59 gibba043 bash[24019]: audit 2021-03-10T17:19:58.391158+0000 mgr.gibba043.dnkmem (mgr.34373) 11013 : audit [DBG] from='client.61420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:59 gibba043 bash[24019]: audit 2021-03-10T17:19:58.615271+0000 mgr.gibba043.dnkmem (mgr.34373) 11014 : audit [DBG] from='client.61426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:19:59 gibba043 bash[24019]: audit 2021-03-10T17:19:58.880747+0000 mon.c (mon.1) 2833 : audit [DBG] from='client.? 172.21.2.103:0/3679870459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:00 gibba003 bash[31385]: cluster 2021-03-10T17:20:00.000204+0000 mon.a (mon.0) 2206 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:00 gibba003 bash[32348]: cluster 2021-03-10T17:20:00.000204+0000 mon.a (mon.0) 2206 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:00 gibba043 bash[24019]: cluster 2021-03-10T17:20:00.000204+0000 mon.a (mon.0) 2206 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:01 gibba003 bash[31385]: cluster 2021-03-10T17:20:00.369912+0000 mgr.gibba043.dnkmem (mgr.34373) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:02.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:01 gibba003 bash[32348]: cluster 2021-03-10T17:20:00.369912+0000 mgr.gibba043.dnkmem (mgr.34373) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:01 gibba043 bash[24019]: cluster 2021-03-10T17:20:00.369912+0000 mgr.gibba043.dnkmem (mgr.34373) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:03 gibba003 bash[31385]: cluster 2021-03-10T17:20:02.371401+0000 mgr.gibba043.dnkmem (mgr.34373) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:03 gibba003 bash[32348]: cluster 2021-03-10T17:20:02.371401+0000 mgr.gibba043.dnkmem (mgr.34373) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:03 gibba043 bash[24019]: cluster 2021-03-10T17:20:02.371401+0000 mgr.gibba043.dnkmem (mgr.34373) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:05.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:04 gibba003 bash[31385]: cephadm 2021-03-10T17:20:02.897014+0000 mgr.gibba043.dnkmem (mgr.34373) 11017 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:05.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:04 gibba003 bash[32348]: cephadm 2021-03-10T17:20:02.897014+0000 mgr.gibba043.dnkmem (mgr.34373) 11017 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:05.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:04 gibba043 bash[24019]: cephadm 2021-03-10T17:20:02.897014+0000 mgr.gibba043.dnkmem (mgr.34373) 11017 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:05 gibba003 bash[31385]: cluster 2021-03-10T17:20:04.372940+0000 mgr.gibba043.dnkmem (mgr.34373) 11018 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:05 gibba003 bash[32348]: cluster 2021-03-10T17:20:04.372940+0000 mgr.gibba043.dnkmem (mgr.34373) 11018 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:05 gibba043 bash[24019]: cluster 2021-03-10T17:20:04.372940+0000 mgr.gibba043.dnkmem (mgr.34373) 11018 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:06 gibba003 bash[31385]: cluster 2021-03-10T17:20:06.374544+0000 mgr.gibba043.dnkmem (mgr.34373) 11019 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:06 gibba003 bash[32348]: cluster 2021-03-10T17:20:06.374544+0000 mgr.gibba043.dnkmem (mgr.34373) 11019 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:06 gibba043 bash[24019]: cluster 2021-03-10T17:20:06.374544+0000 mgr.gibba043.dnkmem (mgr.34373) 11019 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:10.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:09 gibba003 bash[31385]: cluster 2021-03-10T17:20:08.376208+0000 mgr.gibba043.dnkmem (mgr.34373) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:09 gibba003 bash[32348]: cluster 2021-03-10T17:20:08.376208+0000 mgr.gibba043.dnkmem (mgr.34373) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:10.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:09 gibba043 bash[24019]: cluster 2021-03-10T17:20:08.376208+0000 mgr.gibba043.dnkmem (mgr.34373) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:11.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:10 gibba003 bash[31385]: cluster 2021-03-10T17:20:10.377552+0000 mgr.gibba043.dnkmem (mgr.34373) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:11.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:10 gibba003 bash[32348]: cluster 2021-03-10T17:20:10.377552+0000 mgr.gibba043.dnkmem (mgr.34373) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:11.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:10 gibba043 bash[24019]: cluster 2021-03-10T17:20:10.377552+0000 mgr.gibba043.dnkmem (mgr.34373) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:13 gibba003 bash[31385]: cluster 2021-03-10T17:20:12.379511+0000 mgr.gibba043.dnkmem (mgr.34373) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:13 gibba003 bash[32348]: cluster 2021-03-10T17:20:12.379511+0000 mgr.gibba043.dnkmem (mgr.34373) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:13 gibba043 bash[24019]: cluster 2021-03-10T17:20:12.379511+0000 mgr.gibba043.dnkmem (mgr.34373) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.069099+0000 mon.c (mon.1) 2834 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.070259+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.310073+0000 mon.c (mon.1) 2835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.311218+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: cluster 2021-03-10T17:20:14.380434+0000 mgr.gibba043.dnkmem (mgr.34373) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.645192+0000 mon.c (mon.1) 2836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.645908+0000 mon.c (mon.1) 2837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:20:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.646552+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.646592+0000 mon.c (mon.1) 2838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.647384+0000 mon.c (mon.1) 2839 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.648814+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:20:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.649623+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[31385]: audit 2021-03-10T17:20:14.650475+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.069099+0000 mon.c (mon.1) 2834 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.070259+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.310073+0000 mon.c (mon.1) 2835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.311218+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: cluster 2021-03-10T17:20:14.380434+0000 mgr.gibba043.dnkmem (mgr.34373) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.645192+0000 mon.c (mon.1) 2836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.645908+0000 mon.c (mon.1) 2837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:20:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.646552+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.646592+0000 mon.c (mon.1) 2838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.647384+0000 mon.c (mon.1) 2839 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.648814+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:20:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.649623+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:14 gibba003 bash[32348]: audit 2021-03-10T17:20:14.650475+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.069099+0000 mon.c (mon.1) 2834 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.070259+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.310073+0000 mon.c (mon.1) 2835 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.311218+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: cluster 2021-03-10T17:20:14.380434+0000 mgr.gibba043.dnkmem (mgr.34373) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.645192+0000 mon.c (mon.1) 2836 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.645908+0000 mon.c (mon.1) 2837 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:20:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.646552+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.646592+0000 mon.c (mon.1) 2838 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.647384+0000 mon.c (mon.1) 2839 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.648814+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:20:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.649623+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:20:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:14 gibba043 bash[24019]: audit 2021-03-10T17:20:14.650475+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:20:17.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:17 gibba043 bash[24019]: cluster 2021-03-10T17:20:16.382188+0000 mgr.gibba043.dnkmem (mgr.34373) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:17 gibba003 bash[31385]: cluster 2021-03-10T17:20:16.382188+0000 mgr.gibba043.dnkmem (mgr.34373) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:17.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:17 gibba003 bash[32348]: cluster 2021-03-10T17:20:16.382188+0000 mgr.gibba043.dnkmem (mgr.34373) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:18 gibba003 bash[31385]: cephadm 2021-03-10T17:20:17.912625+0000 mgr.gibba043.dnkmem (mgr.34373) 11025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:19.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:18 gibba003 bash[31385]: cluster 2021-03-10T17:20:18.383780+0000 mgr.gibba043.dnkmem (mgr.34373) 11026 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:18 gibba003 bash[32348]: cephadm 2021-03-10T17:20:17.912625+0000 mgr.gibba043.dnkmem (mgr.34373) 11025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:19.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:18 gibba003 bash[32348]: cluster 2021-03-10T17:20:18.383780+0000 mgr.gibba043.dnkmem (mgr.34373) 11026 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:18 gibba043 bash[24019]: cephadm 2021-03-10T17:20:17.912625+0000 mgr.gibba043.dnkmem (mgr.34373) 11025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:18 gibba043 bash[24019]: cluster 2021-03-10T17:20:18.383780+0000 mgr.gibba043.dnkmem (mgr.34373) 11026 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:21 gibba043 bash[24019]: cluster 2021-03-10T17:20:20.385367+0000 mgr.gibba043.dnkmem (mgr.34373) 11027 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:21 gibba003 bash[31385]: cluster 2021-03-10T17:20:20.385367+0000 mgr.gibba043.dnkmem (mgr.34373) 11027 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:21 gibba003 bash[32348]: cluster 2021-03-10T17:20:20.385367+0000 mgr.gibba043.dnkmem (mgr.34373) 11027 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:24.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:23 gibba003 bash[31385]: cluster 2021-03-10T17:20:22.387016+0000 mgr.gibba043.dnkmem (mgr.34373) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:23 gibba003 bash[32348]: cluster 2021-03-10T17:20:22.387016+0000 mgr.gibba043.dnkmem (mgr.34373) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:24.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:23 gibba043 bash[24019]: cluster 2021-03-10T17:20:22.387016+0000 mgr.gibba043.dnkmem (mgr.34373) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:25.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:24 gibba003 bash[31385]: cluster 2021-03-10T17:20:24.388705+0000 mgr.gibba043.dnkmem (mgr.34373) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:25.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:24 gibba003 bash[32348]: cluster 2021-03-10T17:20:24.388705+0000 mgr.gibba043.dnkmem (mgr.34373) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:25.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:24 gibba043 bash[24019]: cluster 2021-03-10T17:20:24.388705+0000 mgr.gibba043.dnkmem (mgr.34373) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:27.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:27 gibba043 bash[24019]: cluster 2021-03-10T17:20:26.390503+0000 mgr.gibba043.dnkmem (mgr.34373) 11030 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:27 gibba003 bash[31385]: cluster 2021-03-10T17:20:26.390503+0000 mgr.gibba043.dnkmem (mgr.34373) 11030 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:27 gibba003 bash[32348]: cluster 2021-03-10T17:20:26.390503+0000 mgr.gibba043.dnkmem (mgr.34373) 11030 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:29.122 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:20:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:28 gibba003 bash[31385]: cluster 2021-03-10T17:20:28.392150+0000 mgr.gibba043.dnkmem (mgr.34373) 11031 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:29.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:28 gibba003 bash[32348]: cluster 2021-03-10T17:20:28.392150+0000 mgr.gibba043.dnkmem (mgr.34373) 11031 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:28 gibba043 bash[24019]: cluster 2021-03-10T17:20:28.392150+0000 mgr.gibba043.dnkmem (mgr.34373) 11031 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:29.347 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:20:29.347 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 41s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:20:29.348 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:20:29.348 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:20:29.348 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:20:29.348 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:20:29.348 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:20:29.349 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:20:29.349 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:20:29.349 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 41s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:20:29.349 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:20:29.350 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:20:29.350 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:20:29.350 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:20:29.350 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 41s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:20:29.350 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:20:29.351 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:20:29.351 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:20:29.351 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:20:29.351 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:20:29.352 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 41s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:20:29.596 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:20:29.597 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:20:29.597 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:29.597 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:20:29.598 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:20:29.598 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:29.599 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:20:29.599 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:20:29.599 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:20:29.600 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:20:29.600 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:20:29.600 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:20:29.601 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:20:29.601 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:20:29.601 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:20:30.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:29 gibba003 bash[31385]: audit 2021-03-10T17:20:29.112511+0000 mgr.gibba043.dnkmem (mgr.34373) 11032 : audit [DBG] from='client.51447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:30.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:29 gibba003 bash[31385]: audit 2021-03-10T17:20:29.334027+0000 mgr.gibba043.dnkmem (mgr.34373) 11033 : audit [DBG] from='client.51453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:30.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:29 gibba003 bash[31385]: audit 2021-03-10T17:20:29.596850+0000 mon.c (mon.1) 2840 : audit [DBG] from='client.? 172.21.2.103:0/599782248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:30.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:29 gibba003 bash[32348]: audit 2021-03-10T17:20:29.112511+0000 mgr.gibba043.dnkmem (mgr.34373) 11032 : audit [DBG] from='client.51447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:30.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:29 gibba003 bash[32348]: audit 2021-03-10T17:20:29.334027+0000 mgr.gibba043.dnkmem (mgr.34373) 11033 : audit [DBG] from='client.51453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:30.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:29 gibba003 bash[32348]: audit 2021-03-10T17:20:29.596850+0000 mon.c (mon.1) 2840 : audit [DBG] from='client.? 172.21.2.103:0/599782248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:30.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:29 gibba043 bash[24019]: audit 2021-03-10T17:20:29.112511+0000 mgr.gibba043.dnkmem (mgr.34373) 11032 : audit [DBG] from='client.51447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:30.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:29 gibba043 bash[24019]: audit 2021-03-10T17:20:29.334027+0000 mgr.gibba043.dnkmem (mgr.34373) 11033 : audit [DBG] from='client.51453 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:30.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:29 gibba043 bash[24019]: audit 2021-03-10T17:20:29.596850+0000 mon.c (mon.1) 2840 : audit [DBG] from='client.? 172.21.2.103:0/599782248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:31.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:30 gibba003 bash[31385]: cluster 2021-03-10T17:20:30.393432+0000 mgr.gibba043.dnkmem (mgr.34373) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:30 gibba003 bash[32348]: cluster 2021-03-10T17:20:30.393432+0000 mgr.gibba043.dnkmem (mgr.34373) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:30 gibba043 bash[24019]: cluster 2021-03-10T17:20:30.393432+0000 mgr.gibba043.dnkmem (mgr.34373) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:33 gibba003 bash[31385]: cluster 2021-03-10T17:20:32.395153+0000 mgr.gibba043.dnkmem (mgr.34373) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:33 gibba003 bash[31385]: cephadm 2021-03-10T17:20:32.924389+0000 mgr.gibba043.dnkmem (mgr.34373) 11036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:33 gibba003 bash[32348]: cluster 2021-03-10T17:20:32.395153+0000 mgr.gibba043.dnkmem (mgr.34373) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:33 gibba003 bash[32348]: cephadm 2021-03-10T17:20:32.924389+0000 mgr.gibba043.dnkmem (mgr.34373) 11036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:34.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:33 gibba043 bash[24019]: cluster 2021-03-10T17:20:32.395153+0000 mgr.gibba043.dnkmem (mgr.34373) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:33 gibba043 bash[24019]: cephadm 2021-03-10T17:20:32.924389+0000 mgr.gibba043.dnkmem (mgr.34373) 11036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:35.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:34 gibba003 bash[31385]: cluster 2021-03-10T17:20:34.396790+0000 mgr.gibba043.dnkmem (mgr.34373) 11037 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:35.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:34 gibba003 bash[32348]: cluster 2021-03-10T17:20:34.396790+0000 mgr.gibba043.dnkmem (mgr.34373) 11037 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:35.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:34 gibba043 bash[24019]: cluster 2021-03-10T17:20:34.396790+0000 mgr.gibba043.dnkmem (mgr.34373) 11037 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:37.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:37 gibba043 bash[24019]: cluster 2021-03-10T17:20:36.398609+0000 mgr.gibba043.dnkmem (mgr.34373) 11038 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:37 gibba003 bash[31385]: cluster 2021-03-10T17:20:36.398609+0000 mgr.gibba043.dnkmem (mgr.34373) 11038 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:37 gibba003 bash[32348]: cluster 2021-03-10T17:20:36.398609+0000 mgr.gibba043.dnkmem (mgr.34373) 11038 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:38 gibba003 bash[31385]: cluster 2021-03-10T17:20:38.400281+0000 mgr.gibba043.dnkmem (mgr.34373) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:39.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:38 gibba003 bash[32348]: cluster 2021-03-10T17:20:38.400281+0000 mgr.gibba043.dnkmem (mgr.34373) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:38 gibba043 bash[24019]: cluster 2021-03-10T17:20:38.400281+0000 mgr.gibba043.dnkmem (mgr.34373) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:41.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:41 gibba043 bash[24019]: cluster 2021-03-10T17:20:40.401655+0000 mgr.gibba043.dnkmem (mgr.34373) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:41 gibba003 bash[31385]: cluster 2021-03-10T17:20:40.401655+0000 mgr.gibba043.dnkmem (mgr.34373) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:41 gibba003 bash[32348]: cluster 2021-03-10T17:20:40.401655+0000 mgr.gibba043.dnkmem (mgr.34373) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:43.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:43 gibba043 bash[24019]: cluster 2021-03-10T17:20:42.403297+0000 mgr.gibba043.dnkmem (mgr.34373) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:43 gibba003 bash[31385]: cluster 2021-03-10T17:20:42.403297+0000 mgr.gibba043.dnkmem (mgr.34373) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:43 gibba003 bash[32348]: cluster 2021-03-10T17:20:42.403297+0000 mgr.gibba043.dnkmem (mgr.34373) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:45.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:45 gibba043 bash[24019]: cluster 2021-03-10T17:20:44.404736+0000 mgr.gibba043.dnkmem (mgr.34373) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:45 gibba003 bash[31385]: cluster 2021-03-10T17:20:44.404736+0000 mgr.gibba043.dnkmem (mgr.34373) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:45 gibba003 bash[32348]: cluster 2021-03-10T17:20:44.404736+0000 mgr.gibba043.dnkmem (mgr.34373) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:47 gibba043 bash[24019]: cluster 2021-03-10T17:20:46.406699+0000 mgr.gibba043.dnkmem (mgr.34373) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:47 gibba003 bash[31385]: cluster 2021-03-10T17:20:46.406699+0000 mgr.gibba043.dnkmem (mgr.34373) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:47 gibba003 bash[32348]: cluster 2021-03-10T17:20:46.406699+0000 mgr.gibba043.dnkmem (mgr.34373) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:48 gibba003 bash[31385]: cephadm 2021-03-10T17:20:47.940318+0000 mgr.gibba043.dnkmem (mgr.34373) 11044 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:20:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:48 gibba003 bash[31385]: audit 2021-03-10T17:20:47.942858+0000 mon.c (mon.1) 2841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:49.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:48 gibba003 bash[31385]: cluster 2021-03-10T17:20:48.408438+0000 mgr.gibba043.dnkmem (mgr.34373) 11045 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:48 gibba003 bash[32348]: cephadm 2021-03-10T17:20:47.940318+0000 mgr.gibba043.dnkmem (mgr.34373) 11044 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:20:49.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:48 gibba003 bash[32348]: audit 2021-03-10T17:20:47.942858+0000 mon.c (mon.1) 2841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:48 gibba003 bash[32348]: cluster 2021-03-10T17:20:48.408438+0000 mgr.gibba043.dnkmem (mgr.34373) 11045 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:48 gibba043 bash[24019]: cephadm 2021-03-10T17:20:47.940318+0000 mgr.gibba043.dnkmem (mgr.34373) 11044 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:20:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:48 gibba043 bash[24019]: audit 2021-03-10T17:20:47.942858+0000 mon.c (mon.1) 2841 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:48 gibba043 bash[24019]: cluster 2021-03-10T17:20:48.408438+0000 mgr.gibba043.dnkmem (mgr.34373) 11045 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:51 gibba043 bash[24019]: cluster 2021-03-10T17:20:50.409731+0000 mgr.gibba043.dnkmem (mgr.34373) 11046 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:51 gibba003 bash[31385]: cluster 2021-03-10T17:20:50.409731+0000 mgr.gibba043.dnkmem (mgr.34373) 11046 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:51 gibba003 bash[32348]: cluster 2021-03-10T17:20:50.409731+0000 mgr.gibba043.dnkmem (mgr.34373) 11046 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:52.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:52 gibba003 bash[31385]: audit 2021-03-10T17:20:51.660684+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:52.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:52 gibba003 bash[31385]: audit 2021-03-10T17:20:51.662630+0000 mon.c (mon.1) 2842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:20:52.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:52 gibba003 bash[32348]: audit 2021-03-10T17:20:51.660684+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:52.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:52 gibba003 bash[32348]: audit 2021-03-10T17:20:51.662630+0000 mon.c (mon.1) 2842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:20:52.951 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:52 gibba043 bash[24019]: audit 2021-03-10T17:20:51.660684+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:52.952 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:52 gibba043 bash[24019]: audit 2021-03-10T17:20:51.662630+0000 mon.c (mon.1) 2842 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:20:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:53 gibba003 bash[31385]: cluster 2021-03-10T17:20:52.411193+0000 mgr.gibba043.dnkmem (mgr.34373) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:53 gibba003 bash[32348]: cluster 2021-03-10T17:20:52.411193+0000 mgr.gibba043.dnkmem (mgr.34373) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:53 gibba043 bash[24019]: cluster 2021-03-10T17:20:52.411193+0000 mgr.gibba043.dnkmem (mgr.34373) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:55 gibba003 bash[31385]: cluster 2021-03-10T17:20:54.411981+0000 mgr.gibba043.dnkmem (mgr.34373) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:55 gibba003 bash[32348]: cluster 2021-03-10T17:20:54.411981+0000 mgr.gibba043.dnkmem (mgr.34373) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:55 gibba043 bash[24019]: cluster 2021-03-10T17:20:54.411981+0000 mgr.gibba043.dnkmem (mgr.34373) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:56 gibba043 bash[24019]: audit 2021-03-10T17:20:56.373631+0000 mon.c (mon.1) 2843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:56 gibba043 bash[24019]: audit 2021-03-10T17:20:56.547226+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:57.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:56 gibba003 bash[31385]: audit 2021-03-10T17:20:56.373631+0000 mon.c (mon.1) 2843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:56 gibba003 bash[31385]: audit 2021-03-10T17:20:56.547226+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:56 gibba003 bash[32348]: audit 2021-03-10T17:20:56.373631+0000 mon.c (mon.1) 2843 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:57.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:56 gibba003 bash[32348]: audit 2021-03-10T17:20:56.547226+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cluster 2021-03-10T17:20:56.412422+0000 mgr.gibba043.dnkmem (mgr.34373) 11049 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.546597+0000 mgr.gibba043.dnkmem (mgr.34373) 11050 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:20:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.732617+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.733701+0000 mgr.gibba043.dnkmem (mgr.34373) 11051 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.735541+0000 mgr.gibba043.dnkmem (mgr.34373) 11052 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.736068+0000 mon.c (mon.1) 2844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.736928+0000 mgr.gibba043.dnkmem (mgr.34373) 11053 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.736964+0000 mgr.gibba043.dnkmem (mgr.34373) 11054 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.737565+0000 mon.c (mon.1) 2845 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.738409+0000 mgr.gibba043.dnkmem (mgr.34373) 11055 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.738446+0000 mgr.gibba043.dnkmem (mgr.34373) 11056 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.739077+0000 mon.c (mon.1) 2846 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.740150+0000 mgr.gibba043.dnkmem (mgr.34373) 11057 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.740634+0000 mon.c (mon.1) 2847 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.742768+0000 mgr.gibba043.dnkmem (mgr.34373) 11058 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.742806+0000 mgr.gibba043.dnkmem (mgr.34373) 11059 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.744859+0000 mgr.gibba043.dnkmem (mgr.34373) 11060 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.745180+0000 mgr.gibba043.dnkmem (mgr.34373) 11061 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:58.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.745186+0000 mon.c (mon.1) 2848 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.747468+0000 mgr.gibba043.dnkmem (mgr.34373) 11062 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.747510+0000 mgr.gibba043.dnkmem (mgr.34373) 11063 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: audit 2021-03-10T17:20:56.747511+0000 mon.c (mon.1) 2849 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:57 gibba043 bash[24019]: cephadm 2021-03-10T17:20:56.747618+0000 mgr.gibba043.dnkmem (mgr.34373) 11064 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cluster 2021-03-10T17:20:56.412422+0000 mgr.gibba043.dnkmem (mgr.34373) 11049 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.546597+0000 mgr.gibba043.dnkmem (mgr.34373) 11050 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:20:58.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.732617+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.733701+0000 mgr.gibba043.dnkmem (mgr.34373) 11051 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.735541+0000 mgr.gibba043.dnkmem (mgr.34373) 11052 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.736068+0000 mon.c (mon.1) 2844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.736928+0000 mgr.gibba043.dnkmem (mgr.34373) 11053 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.736964+0000 mgr.gibba043.dnkmem (mgr.34373) 11054 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.737565+0000 mon.c (mon.1) 2845 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.738409+0000 mgr.gibba043.dnkmem (mgr.34373) 11055 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.738446+0000 mgr.gibba043.dnkmem (mgr.34373) 11056 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:58.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.739077+0000 mon.c (mon.1) 2846 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.740150+0000 mgr.gibba043.dnkmem (mgr.34373) 11057 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:58.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.740634+0000 mon.c (mon.1) 2847 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.742768+0000 mgr.gibba043.dnkmem (mgr.34373) 11058 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:58.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.742806+0000 mgr.gibba043.dnkmem (mgr.34373) 11059 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:58.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.744859+0000 mgr.gibba043.dnkmem (mgr.34373) 11060 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:58.199 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.745180+0000 mgr.gibba043.dnkmem (mgr.34373) 11061 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:58.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.745186+0000 mon.c (mon.1) 2848 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.200 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.747468+0000 mgr.gibba043.dnkmem (mgr.34373) 11062 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.747510+0000 mgr.gibba043.dnkmem (mgr.34373) 11063 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:58.202 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: audit 2021-03-10T17:20:56.747511+0000 mon.c (mon.1) 2849 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[31385]: cephadm 2021-03-10T17:20:56.747618+0000 mgr.gibba043.dnkmem (mgr.34373) 11064 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:58.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cluster 2021-03-10T17:20:56.412422+0000 mgr.gibba043.dnkmem (mgr.34373) 11049 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:58.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.546597+0000 mgr.gibba043.dnkmem (mgr.34373) 11050 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:20:58.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.732617+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:20:58.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.733701+0000 mgr.gibba043.dnkmem (mgr.34373) 11051 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:58.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.735541+0000 mgr.gibba043.dnkmem (mgr.34373) 11052 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:58.206 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.736068+0000 mon.c (mon.1) 2844 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:58.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.736928+0000 mgr.gibba043.dnkmem (mgr.34373) 11053 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:58.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.736964+0000 mgr.gibba043.dnkmem (mgr.34373) 11054 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:58.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.737565+0000 mon.c (mon.1) 2845 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.738409+0000 mgr.gibba043.dnkmem (mgr.34373) 11055 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:58.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.738446+0000 mgr.gibba043.dnkmem (mgr.34373) 11056 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:58.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.739077+0000 mon.c (mon.1) 2846 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.740150+0000 mgr.gibba043.dnkmem (mgr.34373) 11057 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:58.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.740634+0000 mon.c (mon.1) 2847 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.742768+0000 mgr.gibba043.dnkmem (mgr.34373) 11058 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:58.209 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.742806+0000 mgr.gibba043.dnkmem (mgr.34373) 11059 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:58.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.744859+0000 mgr.gibba043.dnkmem (mgr.34373) 11060 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:58.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.745180+0000 mgr.gibba043.dnkmem (mgr.34373) 11061 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:58.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.745186+0000 mon.c (mon.1) 2848 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.210 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.747468+0000 mgr.gibba043.dnkmem (mgr.34373) 11062 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:58.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.747510+0000 mgr.gibba043.dnkmem (mgr.34373) 11063 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:58.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: audit 2021-03-10T17:20:56.747511+0000 mon.c (mon.1) 2849 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:58.211 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:57 gibba003 bash[32348]: cephadm 2021-03-10T17:20:56.747618+0000 mgr.gibba043.dnkmem (mgr.34373) 11064 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:20:59.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:58 gibba003 bash[31385]: cluster 2021-03-10T17:20:58.414010+0000 mgr.gibba043.dnkmem (mgr.34373) 11065 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:59.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:58 gibba003 bash[32348]: cluster 2021-03-10T17:20:58.414010+0000 mgr.gibba043.dnkmem (mgr.34373) 11065 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:59.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:58 gibba043 bash[24019]: cluster 2021-03-10T17:20:58.414010+0000 mgr.gibba043.dnkmem (mgr.34373) 11065 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:59.838 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:21:00.101 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:21:00.101 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 72s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:21:00.101 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:21:00.102 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:21:00.102 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:21:00.102 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:21:00.102 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:21:00.103 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:21:00.103 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:21:00.103 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 72s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:21:00.103 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:21:00.103 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:21:00.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:21:00.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:21:00.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 72s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:21:00.104 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:21:00.105 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:21:00.105 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:21:00.105 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:21:00.105 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:21:00.105 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 72s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:21:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:20:59 gibba003 bash[31385]: audit 2021-03-10T17:20:59.828201+0000 mgr.gibba043.dnkmem (mgr.34373) 11066 : audit [DBG] from='client.51465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:00.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:20:59 gibba003 bash[32348]: audit 2021-03-10T17:20:59.828201+0000 mgr.gibba043.dnkmem (mgr.34373) 11066 : audit [DBG] from='client.51465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:20:59 gibba043 bash[24019]: audit 2021-03-10T17:20:59.828201+0000 mgr.gibba043.dnkmem (mgr.34373) 11066 : audit [DBG] from='client.51465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:00.380 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:21:00.381 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:21:00.381 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:00.381 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:21:00.382 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:21:00.382 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:00.382 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:21:00.382 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:21:00.382 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:21:00.383 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:21:00.383 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:21:00.383 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:21:00.383 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:21:00.383 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:21:00.384 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:21:01.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:00 gibba003 bash[31385]: audit 2021-03-10T17:21:00.058234+0000 mgr.gibba043.dnkmem (mgr.34373) 11067 : audit [DBG] from='client.61462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:00 gibba003 bash[31385]: audit 2021-03-10T17:21:00.381516+0000 mon.a (mon.0) 2216 : audit [DBG] from='client.? 172.21.2.103:0/3649598844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:01.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:00 gibba003 bash[31385]: cluster 2021-03-10T17:21:00.415353+0000 mgr.gibba043.dnkmem (mgr.34373) 11068 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:00 gibba003 bash[32348]: audit 2021-03-10T17:21:00.058234+0000 mgr.gibba043.dnkmem (mgr.34373) 11067 : audit [DBG] from='client.61462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:01.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:00 gibba003 bash[32348]: audit 2021-03-10T17:21:00.381516+0000 mon.a (mon.0) 2216 : audit [DBG] from='client.? 172.21.2.103:0/3649598844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:01.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:00 gibba003 bash[32348]: cluster 2021-03-10T17:21:00.415353+0000 mgr.gibba043.dnkmem (mgr.34373) 11068 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:00 gibba043 bash[24019]: audit 2021-03-10T17:21:00.058234+0000 mgr.gibba043.dnkmem (mgr.34373) 11067 : audit [DBG] from='client.61462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:00 gibba043 bash[24019]: audit 2021-03-10T17:21:00.381516+0000 mon.a (mon.0) 2216 : audit [DBG] from='client.? 172.21.2.103:0/3649598844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:00 gibba043 bash[24019]: cluster 2021-03-10T17:21:00.415353+0000 mgr.gibba043.dnkmem (mgr.34373) 11068 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:03.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:03 gibba043 bash[24019]: cluster 2021-03-10T17:21:02.416951+0000 mgr.gibba043.dnkmem (mgr.34373) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:03 gibba003 bash[31385]: cluster 2021-03-10T17:21:02.416951+0000 mgr.gibba043.dnkmem (mgr.34373) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:03 gibba003 bash[32348]: cluster 2021-03-10T17:21:02.416951+0000 mgr.gibba043.dnkmem (mgr.34373) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:05 gibba043 bash[24019]: cluster 2021-03-10T17:21:04.418326+0000 mgr.gibba043.dnkmem (mgr.34373) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:05 gibba003 bash[31385]: cluster 2021-03-10T17:21:04.418326+0000 mgr.gibba043.dnkmem (mgr.34373) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:05 gibba003 bash[32348]: cluster 2021-03-10T17:21:04.418326+0000 mgr.gibba043.dnkmem (mgr.34373) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:07 gibba043 bash[24019]: cluster 2021-03-10T17:21:06.420325+0000 mgr.gibba043.dnkmem (mgr.34373) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:07 gibba003 bash[31385]: cluster 2021-03-10T17:21:06.420325+0000 mgr.gibba043.dnkmem (mgr.34373) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:07 gibba003 bash[32348]: cluster 2021-03-10T17:21:06.420325+0000 mgr.gibba043.dnkmem (mgr.34373) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:08 gibba003 bash[31385]: cluster 2021-03-10T17:21:08.421854+0000 mgr.gibba043.dnkmem (mgr.34373) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:08 gibba003 bash[32348]: cluster 2021-03-10T17:21:08.421854+0000 mgr.gibba043.dnkmem (mgr.34373) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:08 gibba043 bash[24019]: cluster 2021-03-10T17:21:08.421854+0000 mgr.gibba043.dnkmem (mgr.34373) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.765 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:11 gibba043 bash[24019]: cluster 2021-03-10T17:21:10.423260+0000 mgr.gibba043.dnkmem (mgr.34373) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:11 gibba003 bash[31385]: cluster 2021-03-10T17:21:10.423260+0000 mgr.gibba043.dnkmem (mgr.34373) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:11 gibba003 bash[32348]: cluster 2021-03-10T17:21:10.423260+0000 mgr.gibba043.dnkmem (mgr.34373) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:12.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:12 gibba043 bash[24019]: cephadm 2021-03-10T17:21:11.763781+0000 mgr.gibba043.dnkmem (mgr.34373) 11074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:12.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:12 gibba003 bash[31385]: cephadm 2021-03-10T17:21:11.763781+0000 mgr.gibba043.dnkmem (mgr.34373) 11074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:12.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:12 gibba003 bash[32348]: cephadm 2021-03-10T17:21:11.763781+0000 mgr.gibba043.dnkmem (mgr.34373) 11074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:13.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:13 gibba043 bash[24019]: cluster 2021-03-10T17:21:12.424845+0000 mgr.gibba043.dnkmem (mgr.34373) 11075 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:13 gibba003 bash[31385]: cluster 2021-03-10T17:21:12.424845+0000 mgr.gibba043.dnkmem (mgr.34373) 11075 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:13 gibba003 bash[32348]: cluster 2021-03-10T17:21:12.424845+0000 mgr.gibba043.dnkmem (mgr.34373) 11075 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:14 gibba043 bash[24019]: audit 2021-03-10T17:21:14.075570+0000 mon.c (mon.1) 2850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:14.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:14 gibba043 bash[24019]: audit 2021-03-10T17:21:14.076654+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:14 gibba043 bash[24019]: audit 2021-03-10T17:21:14.316584+0000 mon.c (mon.1) 2851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:14 gibba043 bash[24019]: audit 2021-03-10T17:21:14.317746+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[31385]: audit 2021-03-10T17:21:14.075570+0000 mon.c (mon.1) 2850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[31385]: audit 2021-03-10T17:21:14.076654+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[31385]: audit 2021-03-10T17:21:14.316584+0000 mon.c (mon.1) 2851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[31385]: audit 2021-03-10T17:21:14.317746+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[32348]: audit 2021-03-10T17:21:14.075570+0000 mon.c (mon.1) 2850 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[32348]: audit 2021-03-10T17:21:14.076654+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[32348]: audit 2021-03-10T17:21:14.316584+0000 mon.c (mon.1) 2851 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:14 gibba003 bash[32348]: audit 2021-03-10T17:21:14.317746+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: cluster 2021-03-10T17:21:14.426448+0000 mgr.gibba043.dnkmem (mgr.34373) 11076 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.654602+0000 mon.c (mon.1) 2852 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:21:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.655470+0000 mon.c (mon.1) 2853 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.655963+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:21:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.656166+0000 mon.c (mon.1) 2854 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.656992+0000 mon.c (mon.1) 2855 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.657900+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.659098+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[31385]: audit 2021-03-10T17:21:14.660012+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: cluster 2021-03-10T17:21:14.426448+0000 mgr.gibba043.dnkmem (mgr.34373) 11076 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.654602+0000 mon.c (mon.1) 2852 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:21:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.655470+0000 mon.c (mon.1) 2853 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.655963+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:21:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.656166+0000 mon.c (mon.1) 2854 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.656992+0000 mon.c (mon.1) 2855 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.657900+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.659098+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:21:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:15 gibba003 bash[32348]: audit 2021-03-10T17:21:14.660012+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:21:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: cluster 2021-03-10T17:21:14.426448+0000 mgr.gibba043.dnkmem (mgr.34373) 11076 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.654602+0000 mon.c (mon.1) 2852 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:21:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.655470+0000 mon.c (mon.1) 2853 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.655963+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:21:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.656166+0000 mon.c (mon.1) 2854 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:21:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.656992+0000 mon.c (mon.1) 2855 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:21:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.657900+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.659098+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:21:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:15 gibba043 bash[24019]: audit 2021-03-10T17:21:14.660012+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:21:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:17 gibba003 bash[31385]: cluster 2021-03-10T17:21:16.428388+0000 mgr.gibba043.dnkmem (mgr.34373) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:17 gibba003 bash[32348]: cluster 2021-03-10T17:21:16.428388+0000 mgr.gibba043.dnkmem (mgr.34373) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:17 gibba043 bash[24019]: cluster 2021-03-10T17:21:16.428388+0000 mgr.gibba043.dnkmem (mgr.34373) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:18 gibba003 bash[31385]: cluster 2021-03-10T17:21:18.430085+0000 mgr.gibba043.dnkmem (mgr.34373) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:19.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:18 gibba003 bash[32348]: cluster 2021-03-10T17:21:18.430085+0000 mgr.gibba043.dnkmem (mgr.34373) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:18 gibba043 bash[24019]: cluster 2021-03-10T17:21:18.430085+0000 mgr.gibba043.dnkmem (mgr.34373) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:21 gibba043 bash[24019]: cluster 2021-03-10T17:21:20.431653+0000 mgr.gibba043.dnkmem (mgr.34373) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:21 gibba003 bash[31385]: cluster 2021-03-10T17:21:20.431653+0000 mgr.gibba043.dnkmem (mgr.34373) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:21 gibba003 bash[32348]: cluster 2021-03-10T17:21:20.431653+0000 mgr.gibba043.dnkmem (mgr.34373) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:23.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:23 gibba043 bash[24019]: cluster 2021-03-10T17:21:22.433128+0000 mgr.gibba043.dnkmem (mgr.34373) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:23 gibba003 bash[31385]: cluster 2021-03-10T17:21:22.433128+0000 mgr.gibba043.dnkmem (mgr.34373) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:23 gibba003 bash[32348]: cluster 2021-03-10T17:21:22.433128+0000 mgr.gibba043.dnkmem (mgr.34373) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:25 gibba043 bash[24019]: cluster 2021-03-10T17:21:24.434833+0000 mgr.gibba043.dnkmem (mgr.34373) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:25 gibba003 bash[31385]: cluster 2021-03-10T17:21:24.434833+0000 mgr.gibba043.dnkmem (mgr.34373) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:25 gibba003 bash[32348]: cluster 2021-03-10T17:21:24.434833+0000 mgr.gibba043.dnkmem (mgr.34373) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:27 gibba003 bash[31385]: cluster 2021-03-10T17:21:26.436672+0000 mgr.gibba043.dnkmem (mgr.34373) 11082 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:27 gibba003 bash[31385]: cephadm 2021-03-10T17:21:26.779914+0000 mgr.gibba043.dnkmem (mgr.34373) 11083 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:27 gibba003 bash[32348]: cluster 2021-03-10T17:21:26.436672+0000 mgr.gibba043.dnkmem (mgr.34373) 11082 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:27 gibba003 bash[32348]: cephadm 2021-03-10T17:21:26.779914+0000 mgr.gibba043.dnkmem (mgr.34373) 11083 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:27 gibba043 bash[24019]: cluster 2021-03-10T17:21:26.436672+0000 mgr.gibba043.dnkmem (mgr.34373) 11082 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:27 gibba043 bash[24019]: cephadm 2021-03-10T17:21:26.779914+0000 mgr.gibba043.dnkmem (mgr.34373) 11083 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:28 gibba003 bash[31385]: cluster 2021-03-10T17:21:28.438328+0000 mgr.gibba043.dnkmem (mgr.34373) 11084 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:28 gibba003 bash[32348]: cluster 2021-03-10T17:21:28.438328+0000 mgr.gibba043.dnkmem (mgr.34373) 11084 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:28 gibba043 bash[24019]: cluster 2021-03-10T17:21:28.438328+0000 mgr.gibba043.dnkmem (mgr.34373) 11084 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:30.626 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:21:30.854 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:21:30.855 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 103s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:21:30.855 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 39s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:21:30.855 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:21:30.856 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:21:30.856 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:21:30.856 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:21:30.856 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:21:30.856 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:21:30.857 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 103s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:21:30.857 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 39s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:21:30.857 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:21:30.857 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:21:30.858 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:21:30.858 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:21:30.860 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:21:30.860 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:21:30.860 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:21:30.860 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 39s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:21:30.861 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 39s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:21:30.861 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 103s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:21:31.103 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:21:31.104 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:21:31.104 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:31.104 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:21:31.105 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:21:31.105 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:31.105 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:21:31.105 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:21:31.105 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:21:31.106 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:21:31.106 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:21:31.106 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:21:31.106 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:21:31.107 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:21:31.107 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:21:31.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:31 gibba043 bash[24019]: cluster 2021-03-10T17:21:30.439949+0000 mgr.gibba043.dnkmem (mgr.34373) 11085 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:31 gibba043 bash[24019]: audit 2021-03-10T17:21:30.616691+0000 mgr.gibba043.dnkmem (mgr.34373) 11086 : audit [DBG] from='client.61474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:31.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:31 gibba043 bash[24019]: audit 2021-03-10T17:21:30.841576+0000 mgr.gibba043.dnkmem (mgr.34373) 11087 : audit [DBG] from='client.51489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:31.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:31 gibba043 bash[24019]: audit 2021-03-10T17:21:31.104409+0000 mon.a (mon.0) 2223 : audit [DBG] from='client.? 172.21.2.103:0/3728761279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[31385]: cluster 2021-03-10T17:21:30.439949+0000 mgr.gibba043.dnkmem (mgr.34373) 11085 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[31385]: audit 2021-03-10T17:21:30.616691+0000 mgr.gibba043.dnkmem (mgr.34373) 11086 : audit [DBG] from='client.61474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:31.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[31385]: audit 2021-03-10T17:21:30.841576+0000 mgr.gibba043.dnkmem (mgr.34373) 11087 : audit [DBG] from='client.51489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:31.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[31385]: audit 2021-03-10T17:21:31.104409+0000 mon.a (mon.0) 2223 : audit [DBG] from='client.? 172.21.2.103:0/3728761279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:31.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[32348]: cluster 2021-03-10T17:21:30.439949+0000 mgr.gibba043.dnkmem (mgr.34373) 11085 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[32348]: audit 2021-03-10T17:21:30.616691+0000 mgr.gibba043.dnkmem (mgr.34373) 11086 : audit [DBG] from='client.61474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:31.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[32348]: audit 2021-03-10T17:21:30.841576+0000 mgr.gibba043.dnkmem (mgr.34373) 11087 : audit [DBG] from='client.51489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:31.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:31 gibba003 bash[32348]: audit 2021-03-10T17:21:31.104409+0000 mon.a (mon.0) 2223 : audit [DBG] from='client.? 172.21.2.103:0/3728761279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:33.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:33 gibba043 bash[24019]: cluster 2021-03-10T17:21:32.441434+0000 mgr.gibba043.dnkmem (mgr.34373) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:33 gibba003 bash[31385]: cluster 2021-03-10T17:21:32.441434+0000 mgr.gibba043.dnkmem (mgr.34373) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:33 gibba003 bash[32348]: cluster 2021-03-10T17:21:32.441434+0000 mgr.gibba043.dnkmem (mgr.34373) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:35 gibba043 bash[24019]: cluster 2021-03-10T17:21:34.443059+0000 mgr.gibba043.dnkmem (mgr.34373) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:35 gibba003 bash[31385]: cluster 2021-03-10T17:21:34.443059+0000 mgr.gibba043.dnkmem (mgr.34373) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:35 gibba003 bash[32348]: cluster 2021-03-10T17:21:34.443059+0000 mgr.gibba043.dnkmem (mgr.34373) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:37 gibba003 bash[31385]: cluster 2021-03-10T17:21:36.445036+0000 mgr.gibba043.dnkmem (mgr.34373) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:37 gibba003 bash[32348]: cluster 2021-03-10T17:21:36.445036+0000 mgr.gibba043.dnkmem (mgr.34373) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:37 gibba043 bash[24019]: cluster 2021-03-10T17:21:36.445036+0000 mgr.gibba043.dnkmem (mgr.34373) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:38 gibba003 bash[31385]: cluster 2021-03-10T17:21:38.446563+0000 mgr.gibba043.dnkmem (mgr.34373) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:38 gibba003 bash[32348]: cluster 2021-03-10T17:21:38.446563+0000 mgr.gibba043.dnkmem (mgr.34373) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:38 gibba043 bash[24019]: cluster 2021-03-10T17:21:38.446563+0000 mgr.gibba043.dnkmem (mgr.34373) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.771 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:41 gibba043 bash[24019]: cluster 2021-03-10T17:21:40.448167+0000 mgr.gibba043.dnkmem (mgr.34373) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:41 gibba003 bash[31385]: cluster 2021-03-10T17:21:40.448167+0000 mgr.gibba043.dnkmem (mgr.34373) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:41 gibba003 bash[32348]: cluster 2021-03-10T17:21:40.448167+0000 mgr.gibba043.dnkmem (mgr.34373) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:42.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:42 gibba003 bash[31385]: cephadm 2021-03-10T17:21:41.784474+0000 mgr.gibba043.dnkmem (mgr.34373) 11093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:42.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:42 gibba003 bash[32348]: cephadm 2021-03-10T17:21:41.784474+0000 mgr.gibba043.dnkmem (mgr.34373) 11093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:43.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:42 gibba043 bash[24019]: cephadm 2021-03-10T17:21:41.784474+0000 mgr.gibba043.dnkmem (mgr.34373) 11093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:43 gibba003 bash[31385]: cluster 2021-03-10T17:21:42.449746+0000 mgr.gibba043.dnkmem (mgr.34373) 11094 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:43 gibba003 bash[32348]: cluster 2021-03-10T17:21:42.449746+0000 mgr.gibba043.dnkmem (mgr.34373) 11094 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:43 gibba043 bash[24019]: cluster 2021-03-10T17:21:42.449746+0000 mgr.gibba043.dnkmem (mgr.34373) 11094 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:45 gibba003 bash[31385]: cluster 2021-03-10T17:21:44.451438+0000 mgr.gibba043.dnkmem (mgr.34373) 11095 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:45 gibba003 bash[32348]: cluster 2021-03-10T17:21:44.451438+0000 mgr.gibba043.dnkmem (mgr.34373) 11095 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:45 gibba043 bash[24019]: cluster 2021-03-10T17:21:44.451438+0000 mgr.gibba043.dnkmem (mgr.34373) 11095 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:47 gibba003 bash[31385]: cluster 2021-03-10T17:21:46.453414+0000 mgr.gibba043.dnkmem (mgr.34373) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:47.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:47 gibba003 bash[32348]: cluster 2021-03-10T17:21:46.453414+0000 mgr.gibba043.dnkmem (mgr.34373) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:47 gibba043 bash[24019]: cluster 2021-03-10T17:21:46.453414+0000 mgr.gibba043.dnkmem (mgr.34373) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:48 gibba003 bash[31385]: cluster 2021-03-10T17:21:48.454980+0000 mgr.gibba043.dnkmem (mgr.34373) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:48 gibba003 bash[32348]: cluster 2021-03-10T17:21:48.454980+0000 mgr.gibba043.dnkmem (mgr.34373) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:48 gibba043 bash[24019]: cluster 2021-03-10T17:21:48.454980+0000 mgr.gibba043.dnkmem (mgr.34373) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:51 gibba003 bash[31385]: cluster 2021-03-10T17:21:50.456396+0000 mgr.gibba043.dnkmem (mgr.34373) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:51 gibba003 bash[32348]: cluster 2021-03-10T17:21:50.456396+0000 mgr.gibba043.dnkmem (mgr.34373) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:51 gibba043 bash[24019]: cluster 2021-03-10T17:21:50.456396+0000 mgr.gibba043.dnkmem (mgr.34373) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:53 gibba003 bash[31385]: cluster 2021-03-10T17:21:52.458055+0000 mgr.gibba043.dnkmem (mgr.34373) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:53 gibba003 bash[32348]: cluster 2021-03-10T17:21:52.458055+0000 mgr.gibba043.dnkmem (mgr.34373) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:53 gibba043 bash[24019]: cluster 2021-03-10T17:21:52.458055+0000 mgr.gibba043.dnkmem (mgr.34373) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:55 gibba003 bash[31385]: cluster 2021-03-10T17:21:54.459660+0000 mgr.gibba043.dnkmem (mgr.34373) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:55 gibba003 bash[32348]: cluster 2021-03-10T17:21:54.459660+0000 mgr.gibba043.dnkmem (mgr.34373) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:55 gibba043 bash[24019]: cluster 2021-03-10T17:21:54.459660+0000 mgr.gibba043.dnkmem (mgr.34373) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: cluster 2021-03-10T17:21:56.461034+0000 mgr.gibba043.dnkmem (mgr.34373) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: cephadm 2021-03-10T17:21:56.801327+0000 mgr.gibba043.dnkmem (mgr.34373) 11102 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:21:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: cephadm 2021-03-10T17:21:56.802924+0000 mgr.gibba043.dnkmem (mgr.34373) 11103 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:21:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.016129+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:21:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.019932+0000 mon.c (mon.1) 2856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.021279+0000 mon.c (mon.1) 2857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.022639+0000 mon.c (mon.1) 2858 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.023774+0000 mon.c (mon.1) 2859 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.026784+0000 mon.c (mon.1) 2860 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[31385]: audit 2021-03-10T17:21:57.028350+0000 mon.c (mon.1) 2861 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: cluster 2021-03-10T17:21:56.461034+0000 mgr.gibba043.dnkmem (mgr.34373) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: cephadm 2021-03-10T17:21:56.801327+0000 mgr.gibba043.dnkmem (mgr.34373) 11102 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:21:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: cephadm 2021-03-10T17:21:56.802924+0000 mgr.gibba043.dnkmem (mgr.34373) 11103 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:21:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.016129+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:21:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.019932+0000 mon.c (mon.1) 2856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.021279+0000 mon.c (mon.1) 2857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.022639+0000 mon.c (mon.1) 2858 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.023774+0000 mon.c (mon.1) 2859 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.026784+0000 mon.c (mon.1) 2860 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:57 gibba003 bash[32348]: audit 2021-03-10T17:21:57.028350+0000 mon.c (mon.1) 2861 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: cluster 2021-03-10T17:21:56.461034+0000 mgr.gibba043.dnkmem (mgr.34373) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: cephadm 2021-03-10T17:21:56.801327+0000 mgr.gibba043.dnkmem (mgr.34373) 11102 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:21:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: cephadm 2021-03-10T17:21:56.802924+0000 mgr.gibba043.dnkmem (mgr.34373) 11103 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:21:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.016129+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:21:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.019932+0000 mon.c (mon.1) 2856 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.021279+0000 mon.c (mon.1) 2857 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.022639+0000 mon.c (mon.1) 2858 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.023774+0000 mon.c (mon.1) 2859 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.026784+0000 mon.c (mon.1) 2860 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:57 gibba043 bash[24019]: audit 2021-03-10T17:21:57.028350+0000 mon.c (mon.1) 2861 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.017347+0000 mgr.gibba043.dnkmem (mgr.34373) 11104 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:58.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.019197+0000 mgr.gibba043.dnkmem (mgr.34373) 11105 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.020450+0000 mgr.gibba043.dnkmem (mgr.34373) 11106 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.020488+0000 mgr.gibba043.dnkmem (mgr.34373) 11107 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.021813+0000 mgr.gibba043.dnkmem (mgr.34373) 11108 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.021851+0000 mgr.gibba043.dnkmem (mgr.34373) 11109 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.022898+0000 mgr.gibba043.dnkmem (mgr.34373) 11110 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.024498+0000 mgr.gibba043.dnkmem (mgr.34373) 11111 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.024538+0000 mgr.gibba043.dnkmem (mgr.34373) 11112 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.025993+0000 mgr.gibba043.dnkmem (mgr.34373) 11113 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.026302+0000 mgr.gibba043.dnkmem (mgr.34373) 11114 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.027569+0000 mgr.gibba043.dnkmem (mgr.34373) 11115 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.027606+0000 mgr.gibba043.dnkmem (mgr.34373) 11116 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[31385]: cephadm 2021-03-10T17:21:57.027802+0000 mgr.gibba043.dnkmem (mgr.34373) 11117 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.017347+0000 mgr.gibba043.dnkmem (mgr.34373) 11104 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.019197+0000 mgr.gibba043.dnkmem (mgr.34373) 11105 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.020450+0000 mgr.gibba043.dnkmem (mgr.34373) 11106 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.020488+0000 mgr.gibba043.dnkmem (mgr.34373) 11107 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:58.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.021813+0000 mgr.gibba043.dnkmem (mgr.34373) 11108 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.021851+0000 mgr.gibba043.dnkmem (mgr.34373) 11109 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.022898+0000 mgr.gibba043.dnkmem (mgr.34373) 11110 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.024498+0000 mgr.gibba043.dnkmem (mgr.34373) 11111 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.024538+0000 mgr.gibba043.dnkmem (mgr.34373) 11112 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.025993+0000 mgr.gibba043.dnkmem (mgr.34373) 11113 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.026302+0000 mgr.gibba043.dnkmem (mgr.34373) 11114 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.027569+0000 mgr.gibba043.dnkmem (mgr.34373) 11115 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.027606+0000 mgr.gibba043.dnkmem (mgr.34373) 11116 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:58 gibba003 bash[32348]: cephadm 2021-03-10T17:21:57.027802+0000 mgr.gibba043.dnkmem (mgr.34373) 11117 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.017347+0000 mgr.gibba043.dnkmem (mgr.34373) 11104 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.019197+0000 mgr.gibba043.dnkmem (mgr.34373) 11105 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.020450+0000 mgr.gibba043.dnkmem (mgr.34373) 11106 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.020488+0000 mgr.gibba043.dnkmem (mgr.34373) 11107 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.021813+0000 mgr.gibba043.dnkmem (mgr.34373) 11108 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.021851+0000 mgr.gibba043.dnkmem (mgr.34373) 11109 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.022898+0000 mgr.gibba043.dnkmem (mgr.34373) 11110 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.024498+0000 mgr.gibba043.dnkmem (mgr.34373) 11111 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.024538+0000 mgr.gibba043.dnkmem (mgr.34373) 11112 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:59.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.025993+0000 mgr.gibba043.dnkmem (mgr.34373) 11113 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:59.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.026302+0000 mgr.gibba043.dnkmem (mgr.34373) 11114 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:59.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.027569+0000 mgr.gibba043.dnkmem (mgr.34373) 11115 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:59.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.027606+0000 mgr.gibba043.dnkmem (mgr.34373) 11116 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:59.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:58 gibba043 bash[24019]: cephadm 2021-03-10T17:21:57.027802+0000 mgr.gibba043.dnkmem (mgr.34373) 11117 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:21:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:21:59 gibba003 bash[31385]: cluster 2021-03-10T17:21:58.462674+0000 mgr.gibba043.dnkmem (mgr.34373) 11118 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:59.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:21:59 gibba003 bash[32348]: cluster 2021-03-10T17:21:58.462674+0000 mgr.gibba043.dnkmem (mgr.34373) 11118 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:21:59 gibba043 bash[24019]: cluster 2021-03-10T17:21:58.462674+0000 mgr.gibba043.dnkmem (mgr.34373) 11118 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.343 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:22:01.576 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:22:01.576 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:22:01.576 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 69s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:22:01.577 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:22:01.577 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:22:01.577 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:22:01.577 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:22:01.577 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:22:01.578 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:22:01.578 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:22:01.578 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 69s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:22:01.578 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:22:01.579 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:22:01.579 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:22:01.579 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:22:01.579 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:22:01.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:22:01.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:22:01.580 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:22:01.580 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 69s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:22:01.581 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:22:01.833 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:22:01.833 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:22:01.833 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:01.834 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:22:01.834 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:22:01.834 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:01.834 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:22:01.835 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:22:01.835 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:22:01.835 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:22:01.835 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:22:01.835 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:22:01.836 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:22:01.836 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:22:01.836 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:22:01.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:01 gibba003 bash[31385]: cluster 2021-03-10T17:22:00.464435+0000 mgr.gibba043.dnkmem (mgr.34373) 11119 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:01 gibba003 bash[32348]: cluster 2021-03-10T17:22:00.464435+0000 mgr.gibba043.dnkmem (mgr.34373) 11119 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:01 gibba043 bash[24019]: cluster 2021-03-10T17:22:00.464435+0000 mgr.gibba043.dnkmem (mgr.34373) 11119 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:02.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:02 gibba003 bash[31385]: audit 2021-03-10T17:22:01.334619+0000 mgr.gibba043.dnkmem (mgr.34373) 11120 : audit [DBG] from='client.61492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:02 gibba003 bash[31385]: audit 2021-03-10T17:22:01.563306+0000 mgr.gibba043.dnkmem (mgr.34373) 11121 : audit [DBG] from='client.51507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:02.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:02 gibba003 bash[31385]: audit 2021-03-10T17:22:01.833865+0000 mon.c (mon.1) 2862 : audit [DBG] from='client.? 172.21.2.103:0/416168323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:02.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:02 gibba003 bash[32348]: audit 2021-03-10T17:22:01.334619+0000 mgr.gibba043.dnkmem (mgr.34373) 11120 : audit [DBG] from='client.61492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:02.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:02 gibba003 bash[32348]: audit 2021-03-10T17:22:01.563306+0000 mgr.gibba043.dnkmem (mgr.34373) 11121 : audit [DBG] from='client.51507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:02.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:02 gibba003 bash[32348]: audit 2021-03-10T17:22:01.833865+0000 mon.c (mon.1) 2862 : audit [DBG] from='client.? 172.21.2.103:0/416168323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:03.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:02 gibba043 bash[24019]: audit 2021-03-10T17:22:01.334619+0000 mgr.gibba043.dnkmem (mgr.34373) 11120 : audit [DBG] from='client.61492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:02 gibba043 bash[24019]: audit 2021-03-10T17:22:01.563306+0000 mgr.gibba043.dnkmem (mgr.34373) 11121 : audit [DBG] from='client.51507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:02 gibba043 bash[24019]: audit 2021-03-10T17:22:01.833865+0000 mon.c (mon.1) 2862 : audit [DBG] from='client.? 172.21.2.103:0/416168323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:03 gibba003 bash[31385]: cluster 2021-03-10T17:22:02.466177+0000 mgr.gibba043.dnkmem (mgr.34373) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:03 gibba003 bash[32348]: cluster 2021-03-10T17:22:02.466177+0000 mgr.gibba043.dnkmem (mgr.34373) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:03 gibba043 bash[24019]: cluster 2021-03-10T17:22:02.466177+0000 mgr.gibba043.dnkmem (mgr.34373) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:05 gibba003 bash[31385]: cluster 2021-03-10T17:22:04.467829+0000 mgr.gibba043.dnkmem (mgr.34373) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:05 gibba003 bash[32348]: cluster 2021-03-10T17:22:04.467829+0000 mgr.gibba043.dnkmem (mgr.34373) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:05 gibba043 bash[24019]: cluster 2021-03-10T17:22:04.467829+0000 mgr.gibba043.dnkmem (mgr.34373) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:07 gibba003 bash[32348]: cluster 2021-03-10T17:22:06.468845+0000 mgr.gibba043.dnkmem (mgr.34373) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:07 gibba003 bash[31385]: cluster 2021-03-10T17:22:06.468845+0000 mgr.gibba043.dnkmem (mgr.34373) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:07 gibba043 bash[24019]: cluster 2021-03-10T17:22:06.468845+0000 mgr.gibba043.dnkmem (mgr.34373) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:08 gibba003 bash[31385]: cluster 2021-03-10T17:22:08.470411+0000 mgr.gibba043.dnkmem (mgr.34373) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:08 gibba003 bash[32348]: cluster 2021-03-10T17:22:08.470411+0000 mgr.gibba043.dnkmem (mgr.34373) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:08 gibba043 bash[24019]: cluster 2021-03-10T17:22:08.470411+0000 mgr.gibba043.dnkmem (mgr.34373) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:11 gibba003 bash[31385]: cluster 2021-03-10T17:22:10.471908+0000 mgr.gibba043.dnkmem (mgr.34373) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:11 gibba003 bash[32348]: cluster 2021-03-10T17:22:10.471908+0000 mgr.gibba043.dnkmem (mgr.34373) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:11 gibba043 bash[24019]: cluster 2021-03-10T17:22:10.471908+0000 mgr.gibba043.dnkmem (mgr.34373) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:13 gibba003 bash[31385]: cephadm 2021-03-10T17:22:12.039526+0000 mgr.gibba043.dnkmem (mgr.34373) 11127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:13 gibba003 bash[31385]: cluster 2021-03-10T17:22:12.473584+0000 mgr.gibba043.dnkmem (mgr.34373) 11128 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:13 gibba003 bash[32348]: cephadm 2021-03-10T17:22:12.039526+0000 mgr.gibba043.dnkmem (mgr.34373) 11127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:13 gibba003 bash[32348]: cluster 2021-03-10T17:22:12.473584+0000 mgr.gibba043.dnkmem (mgr.34373) 11128 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:13 gibba043 bash[24019]: cephadm 2021-03-10T17:22:12.039526+0000 mgr.gibba043.dnkmem (mgr.34373) 11127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:13 gibba043 bash[24019]: cluster 2021-03-10T17:22:12.473584+0000 mgr.gibba043.dnkmem (mgr.34373) 11128 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[31385]: audit 2021-03-10T17:22:14.082214+0000 mon.c (mon.1) 2863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[31385]: audit 2021-03-10T17:22:14.083369+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[31385]: audit 2021-03-10T17:22:14.322974+0000 mon.c (mon.1) 2864 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[31385]: audit 2021-03-10T17:22:14.324154+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[32348]: audit 2021-03-10T17:22:14.082214+0000 mon.c (mon.1) 2863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[32348]: audit 2021-03-10T17:22:14.083369+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[32348]: audit 2021-03-10T17:22:14.322974+0000 mon.c (mon.1) 2864 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:14 gibba003 bash[32348]: audit 2021-03-10T17:22:14.324154+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:14 gibba043 bash[24019]: audit 2021-03-10T17:22:14.082214+0000 mon.c (mon.1) 2863 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:14 gibba043 bash[24019]: audit 2021-03-10T17:22:14.083369+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:14 gibba043 bash[24019]: audit 2021-03-10T17:22:14.322974+0000 mon.c (mon.1) 2864 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:14 gibba043 bash[24019]: audit 2021-03-10T17:22:14.324154+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: cluster 2021-03-10T17:22:14.475130+0000 mgr.gibba043.dnkmem (mgr.34373) 11129 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.665408+0000 mon.c (mon.1) 2865 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:22:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.666175+0000 mon.c (mon.1) 2866 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.666632+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:22:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.666844+0000 mon.c (mon.1) 2867 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:22:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.667726+0000 mon.c (mon.1) 2868 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.667966+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.669355+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:22:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[31385]: audit 2021-03-10T17:22:14.670323+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: cluster 2021-03-10T17:22:14.475130+0000 mgr.gibba043.dnkmem (mgr.34373) 11129 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.665408+0000 mon.c (mon.1) 2865 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:22:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.666175+0000 mon.c (mon.1) 2866 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.666632+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:22:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.666844+0000 mon.c (mon.1) 2867 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:22:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.667726+0000 mon.c (mon.1) 2868 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.667966+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.669355+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:22:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:15 gibba003 bash[32348]: audit 2021-03-10T17:22:14.670323+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:22:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: cluster 2021-03-10T17:22:14.475130+0000 mgr.gibba043.dnkmem (mgr.34373) 11129 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.665408+0000 mon.c (mon.1) 2865 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:22:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.666175+0000 mon.c (mon.1) 2866 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.666632+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:22:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.666844+0000 mon.c (mon.1) 2867 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:22:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.667726+0000 mon.c (mon.1) 2868 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:22:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.667966+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.669355+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:22:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:15 gibba043 bash[24019]: audit 2021-03-10T17:22:14.670323+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:22:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:17 gibba003 bash[31385]: cluster 2021-03-10T17:22:16.476129+0000 mgr.gibba043.dnkmem (mgr.34373) 11130 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:17 gibba003 bash[32348]: cluster 2021-03-10T17:22:16.476129+0000 mgr.gibba043.dnkmem (mgr.34373) 11130 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:18.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:17 gibba043 bash[24019]: cluster 2021-03-10T17:22:16.476129+0000 mgr.gibba043.dnkmem (mgr.34373) 11130 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:18 gibba003 bash[31385]: cluster 2021-03-10T17:22:18.477431+0000 mgr.gibba043.dnkmem (mgr.34373) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:18 gibba003 bash[32348]: cluster 2021-03-10T17:22:18.477431+0000 mgr.gibba043.dnkmem (mgr.34373) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:18 gibba043 bash[24019]: cluster 2021-03-10T17:22:18.477431+0000 mgr.gibba043.dnkmem (mgr.34373) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:21 gibba003 bash[31385]: cluster 2021-03-10T17:22:20.478943+0000 mgr.gibba043.dnkmem (mgr.34373) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:21 gibba003 bash[32348]: cluster 2021-03-10T17:22:20.478943+0000 mgr.gibba043.dnkmem (mgr.34373) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:21 gibba043 bash[24019]: cluster 2021-03-10T17:22:20.478943+0000 mgr.gibba043.dnkmem (mgr.34373) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:23 gibba003 bash[31385]: cluster 2021-03-10T17:22:22.480682+0000 mgr.gibba043.dnkmem (mgr.34373) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:23 gibba003 bash[32348]: cluster 2021-03-10T17:22:22.480682+0000 mgr.gibba043.dnkmem (mgr.34373) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:23 gibba043 bash[24019]: cluster 2021-03-10T17:22:22.480682+0000 mgr.gibba043.dnkmem (mgr.34373) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:25 gibba003 bash[31385]: cluster 2021-03-10T17:22:24.482403+0000 mgr.gibba043.dnkmem (mgr.34373) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:25 gibba003 bash[32348]: cluster 2021-03-10T17:22:24.482403+0000 mgr.gibba043.dnkmem (mgr.34373) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:25 gibba043 bash[24019]: cluster 2021-03-10T17:22:24.482403+0000 mgr.gibba043.dnkmem (mgr.34373) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:27 gibba003 bash[32348]: cluster 2021-03-10T17:22:26.483183+0000 mgr.gibba043.dnkmem (mgr.34373) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:27 gibba003 bash[31385]: cluster 2021-03-10T17:22:26.483183+0000 mgr.gibba043.dnkmem (mgr.34373) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:27 gibba043 bash[24019]: cluster 2021-03-10T17:22:26.483183+0000 mgr.gibba043.dnkmem (mgr.34373) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:28 gibba003 bash[31385]: cephadm 2021-03-10T17:22:27.044728+0000 mgr.gibba043.dnkmem (mgr.34373) 11136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:28.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:28 gibba003 bash[32348]: cephadm 2021-03-10T17:22:27.044728+0000 mgr.gibba043.dnkmem (mgr.34373) 11136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:28 gibba043 bash[24019]: cephadm 2021-03-10T17:22:27.044728+0000 mgr.gibba043.dnkmem (mgr.34373) 11136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:29 gibba003 bash[31385]: cluster 2021-03-10T17:22:28.484496+0000 mgr.gibba043.dnkmem (mgr.34373) 11137 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:29 gibba003 bash[32348]: cluster 2021-03-10T17:22:28.484496+0000 mgr.gibba043.dnkmem (mgr.34373) 11137 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:30.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:29 gibba043 bash[24019]: cluster 2021-03-10T17:22:28.484496+0000 mgr.gibba043.dnkmem (mgr.34373) 11137 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:31 gibba003 bash[31385]: cluster 2021-03-10T17:22:30.486124+0000 mgr.gibba043.dnkmem (mgr.34373) 11138 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:31 gibba003 bash[32348]: cluster 2021-03-10T17:22:30.486124+0000 mgr.gibba043.dnkmem (mgr.34373) 11138 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:31 gibba043 bash[24019]: cluster 2021-03-10T17:22:30.486124+0000 mgr.gibba043.dnkmem (mgr.34373) 11138 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:32.079 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:22:32.308 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:22:32.308 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:22:32.308 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 100s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:22:32.309 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:22:32.309 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:22:32.309 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:22:32.309 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:22:32.310 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:22:32.310 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:22:32.310 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:22:32.310 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 100s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:22:32.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:22:32.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:22:32.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:22:32.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:22:32.311 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:22:32.312 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:22:32.312 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:22:32.312 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:22:32.312 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 100s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:22:32.313 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:22:32.554 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:22:32.555 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:22:32.555 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:32.555 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:22:32.555 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:22:32.556 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:32.556 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:22:32.556 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:22:32.556 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:22:32.557 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:22:32.557 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:22:32.557 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:22:32.557 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:22:32.557 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:22:32.558 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:22:32.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:32 gibba003 bash[31385]: audit 2021-03-10T17:22:32.555363+0000 mon.c (mon.1) 2869 : audit [DBG] from='client.? 172.21.2.103:0/996715439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:32.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:32 gibba003 bash[32348]: audit 2021-03-10T17:22:32.555363+0000 mon.c (mon.1) 2869 : audit [DBG] from='client.? 172.21.2.103:0/996715439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:33.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:32 gibba043 bash[24019]: audit 2021-03-10T17:22:32.555363+0000 mon.c (mon.1) 2869 : audit [DBG] from='client.? 172.21.2.103:0/996715439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:33 gibba003 bash[31385]: audit 2021-03-10T17:22:32.068969+0000 mgr.gibba043.dnkmem (mgr.34373) 11139 : audit [DBG] from='client.51519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:33 gibba003 bash[31385]: audit 2021-03-10T17:22:32.294988+0000 mgr.gibba043.dnkmem (mgr.34373) 11140 : audit [DBG] from='client.61516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:33.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:33 gibba003 bash[31385]: cluster 2021-03-10T17:22:32.487873+0000 mgr.gibba043.dnkmem (mgr.34373) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:33.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:33 gibba003 bash[32348]: audit 2021-03-10T17:22:32.068969+0000 mgr.gibba043.dnkmem (mgr.34373) 11139 : audit [DBG] from='client.51519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:33.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:33 gibba003 bash[32348]: audit 2021-03-10T17:22:32.294988+0000 mgr.gibba043.dnkmem (mgr.34373) 11140 : audit [DBG] from='client.61516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:33.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:33 gibba003 bash[32348]: cluster 2021-03-10T17:22:32.487873+0000 mgr.gibba043.dnkmem (mgr.34373) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:33 gibba043 bash[24019]: audit 2021-03-10T17:22:32.068969+0000 mgr.gibba043.dnkmem (mgr.34373) 11139 : audit [DBG] from='client.51519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:33 gibba043 bash[24019]: audit 2021-03-10T17:22:32.294988+0000 mgr.gibba043.dnkmem (mgr.34373) 11140 : audit [DBG] from='client.61516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:33 gibba043 bash[24019]: cluster 2021-03-10T17:22:32.487873+0000 mgr.gibba043.dnkmem (mgr.34373) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:35 gibba003 bash[31385]: cluster 2021-03-10T17:22:34.489505+0000 mgr.gibba043.dnkmem (mgr.34373) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:35 gibba003 bash[32348]: cluster 2021-03-10T17:22:34.489505+0000 mgr.gibba043.dnkmem (mgr.34373) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:35 gibba043 bash[24019]: cluster 2021-03-10T17:22:34.489505+0000 mgr.gibba043.dnkmem (mgr.34373) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:37 gibba003 bash[31385]: cluster 2021-03-10T17:22:36.490105+0000 mgr.gibba043.dnkmem (mgr.34373) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:37 gibba003 bash[32348]: cluster 2021-03-10T17:22:36.490105+0000 mgr.gibba043.dnkmem (mgr.34373) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:37 gibba043 bash[24019]: cluster 2021-03-10T17:22:36.490105+0000 mgr.gibba043.dnkmem (mgr.34373) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:38 gibba043 bash[24019]: cluster 2021-03-10T17:22:38.491377+0000 mgr.gibba043.dnkmem (mgr.34373) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:38 gibba003 bash[31385]: cluster 2021-03-10T17:22:38.491377+0000 mgr.gibba043.dnkmem (mgr.34373) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:38 gibba003 bash[32348]: cluster 2021-03-10T17:22:38.491377+0000 mgr.gibba043.dnkmem (mgr.34373) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:41 gibba003 bash[31385]: cluster 2021-03-10T17:22:40.492654+0000 mgr.gibba043.dnkmem (mgr.34373) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:41 gibba003 bash[32348]: cluster 2021-03-10T17:22:40.492654+0000 mgr.gibba043.dnkmem (mgr.34373) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:41 gibba043 bash[24019]: cluster 2021-03-10T17:22:40.492654+0000 mgr.gibba043.dnkmem (mgr.34373) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:43 gibba003 bash[31385]: cephadm 2021-03-10T17:22:42.060618+0000 mgr.gibba043.dnkmem (mgr.34373) 11146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:43.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:43 gibba003 bash[31385]: cluster 2021-03-10T17:22:42.494313+0000 mgr.gibba043.dnkmem (mgr.34373) 11147 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:43 gibba003 bash[32348]: cephadm 2021-03-10T17:22:42.060618+0000 mgr.gibba043.dnkmem (mgr.34373) 11146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:43 gibba003 bash[32348]: cluster 2021-03-10T17:22:42.494313+0000 mgr.gibba043.dnkmem (mgr.34373) 11147 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:43 gibba043 bash[24019]: cephadm 2021-03-10T17:22:42.060618+0000 mgr.gibba043.dnkmem (mgr.34373) 11146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:43 gibba043 bash[24019]: cluster 2021-03-10T17:22:42.494313+0000 mgr.gibba043.dnkmem (mgr.34373) 11147 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:45 gibba003 bash[31385]: cluster 2021-03-10T17:22:44.495911+0000 mgr.gibba043.dnkmem (mgr.34373) 11148 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:45 gibba003 bash[32348]: cluster 2021-03-10T17:22:44.495911+0000 mgr.gibba043.dnkmem (mgr.34373) 11148 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:45 gibba043 bash[24019]: cluster 2021-03-10T17:22:44.495911+0000 mgr.gibba043.dnkmem (mgr.34373) 11148 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:47 gibba003 bash[31385]: cluster 2021-03-10T17:22:46.496703+0000 mgr.gibba043.dnkmem (mgr.34373) 11149 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:47 gibba003 bash[32348]: cluster 2021-03-10T17:22:46.496703+0000 mgr.gibba043.dnkmem (mgr.34373) 11149 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:47 gibba043 bash[24019]: cluster 2021-03-10T17:22:46.496703+0000 mgr.gibba043.dnkmem (mgr.34373) 11149 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:48 gibba043 bash[24019]: cluster 2021-03-10T17:22:48.498235+0000 mgr.gibba043.dnkmem (mgr.34373) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:48 gibba003 bash[31385]: cluster 2021-03-10T17:22:48.498235+0000 mgr.gibba043.dnkmem (mgr.34373) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.440 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:48 gibba003 bash[32348]: cluster 2021-03-10T17:22:48.498235+0000 mgr.gibba043.dnkmem (mgr.34373) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:51 gibba003 bash[31385]: cluster 2021-03-10T17:22:50.499891+0000 mgr.gibba043.dnkmem (mgr.34373) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:51 gibba003 bash[32348]: cluster 2021-03-10T17:22:50.499891+0000 mgr.gibba043.dnkmem (mgr.34373) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:51 gibba043 bash[24019]: cluster 2021-03-10T17:22:50.499891+0000 mgr.gibba043.dnkmem (mgr.34373) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:53 gibba003 bash[31385]: cluster 2021-03-10T17:22:52.501425+0000 mgr.gibba043.dnkmem (mgr.34373) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:53 gibba003 bash[32348]: cluster 2021-03-10T17:22:52.501425+0000 mgr.gibba043.dnkmem (mgr.34373) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:53 gibba043 bash[24019]: cluster 2021-03-10T17:22:52.501425+0000 mgr.gibba043.dnkmem (mgr.34373) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:55 gibba003 bash[31385]: cluster 2021-03-10T17:22:54.503104+0000 mgr.gibba043.dnkmem (mgr.34373) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:55 gibba003 bash[32348]: cluster 2021-03-10T17:22:54.503104+0000 mgr.gibba043.dnkmem (mgr.34373) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:55 gibba043 bash[24019]: cluster 2021-03-10T17:22:54.503104+0000 mgr.gibba043.dnkmem (mgr.34373) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: cluster 2021-03-10T17:22:56.503875+0000 mgr.gibba043.dnkmem (mgr.34373) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.292330+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:22:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.296047+0000 mon.c (mon.1) 2870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.297452+0000 mon.c (mon.1) 2871 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.298938+0000 mon.c (mon.1) 2872 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.300354+0000 mon.c (mon.1) 2873 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.303705+0000 mon.c (mon.1) 2874 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[31385]: audit 2021-03-10T17:22:57.305394+0000 mon.c (mon.1) 2875 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: cluster 2021-03-10T17:22:56.503875+0000 mgr.gibba043.dnkmem (mgr.34373) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.292330+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:22:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.296047+0000 mon.c (mon.1) 2870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.297452+0000 mon.c (mon.1) 2871 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.298938+0000 mon.c (mon.1) 2872 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.300354+0000 mon.c (mon.1) 2873 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.303705+0000 mon.c (mon.1) 2874 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:57.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:57 gibba003 bash[32348]: audit 2021-03-10T17:22:57.305394+0000 mon.c (mon.1) 2875 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: cluster 2021-03-10T17:22:56.503875+0000 mgr.gibba043.dnkmem (mgr.34373) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.292330+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:22:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.296047+0000 mon.c (mon.1) 2870 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.297452+0000 mon.c (mon.1) 2871 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.298938+0000 mon.c (mon.1) 2872 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.300354+0000 mon.c (mon.1) 2873 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.303705+0000 mon.c (mon.1) 2874 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:57 gibba043 bash[24019]: audit 2021-03-10T17:22:57.305394+0000 mon.c (mon.1) 2875 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.077496+0000 mgr.gibba043.dnkmem (mgr.34373) 11155 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:22:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.079080+0000 mgr.gibba043.dnkmem (mgr.34373) 11156 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:22:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.293630+0000 mgr.gibba043.dnkmem (mgr.34373) 11157 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.295451+0000 mgr.gibba043.dnkmem (mgr.34373) 11158 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.296908+0000 mgr.gibba043.dnkmem (mgr.34373) 11159 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.296941+0000 mgr.gibba043.dnkmem (mgr.34373) 11160 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.298402+0000 mgr.gibba043.dnkmem (mgr.34373) 11161 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.298439+0000 mgr.gibba043.dnkmem (mgr.34373) 11162 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.299659+0000 mgr.gibba043.dnkmem (mgr.34373) 11163 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.301528+0000 mgr.gibba043.dnkmem (mgr.34373) 11164 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.301565+0000 mgr.gibba043.dnkmem (mgr.34373) 11165 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.303092+0000 mgr.gibba043.dnkmem (mgr.34373) 11166 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.303407+0000 mgr.gibba043.dnkmem (mgr.34373) 11167 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:58.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.304791+0000 mgr.gibba043.dnkmem (mgr.34373) 11168 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:58.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.304827+0000 mgr.gibba043.dnkmem (mgr.34373) 11169 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:58.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[31385]: cephadm 2021-03-10T17:22:57.304939+0000 mgr.gibba043.dnkmem (mgr.34373) 11170 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:58.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.077496+0000 mgr.gibba043.dnkmem (mgr.34373) 11155 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:22:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.079080+0000 mgr.gibba043.dnkmem (mgr.34373) 11156 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:22:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.293630+0000 mgr.gibba043.dnkmem (mgr.34373) 11157 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.295451+0000 mgr.gibba043.dnkmem (mgr.34373) 11158 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.296908+0000 mgr.gibba043.dnkmem (mgr.34373) 11159 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.296941+0000 mgr.gibba043.dnkmem (mgr.34373) 11160 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.298402+0000 mgr.gibba043.dnkmem (mgr.34373) 11161 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.298439+0000 mgr.gibba043.dnkmem (mgr.34373) 11162 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.299659+0000 mgr.gibba043.dnkmem (mgr.34373) 11163 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.301528+0000 mgr.gibba043.dnkmem (mgr.34373) 11164 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.301565+0000 mgr.gibba043.dnkmem (mgr.34373) 11165 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.303092+0000 mgr.gibba043.dnkmem (mgr.34373) 11166 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.303407+0000 mgr.gibba043.dnkmem (mgr.34373) 11167 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:58.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.304791+0000 mgr.gibba043.dnkmem (mgr.34373) 11168 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:58.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.304827+0000 mgr.gibba043.dnkmem (mgr.34373) 11169 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:58.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:58 gibba003 bash[32348]: cephadm 2021-03-10T17:22:57.304939+0000 mgr.gibba043.dnkmem (mgr.34373) 11170 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.077496+0000 mgr.gibba043.dnkmem (mgr.34373) 11155 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:22:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.079080+0000 mgr.gibba043.dnkmem (mgr.34373) 11156 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:22:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.293630+0000 mgr.gibba043.dnkmem (mgr.34373) 11157 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.295451+0000 mgr.gibba043.dnkmem (mgr.34373) 11158 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.296908+0000 mgr.gibba043.dnkmem (mgr.34373) 11159 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.296941+0000 mgr.gibba043.dnkmem (mgr.34373) 11160 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.298402+0000 mgr.gibba043.dnkmem (mgr.34373) 11161 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.298439+0000 mgr.gibba043.dnkmem (mgr.34373) 11162 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.299659+0000 mgr.gibba043.dnkmem (mgr.34373) 11163 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.301528+0000 mgr.gibba043.dnkmem (mgr.34373) 11164 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.301565+0000 mgr.gibba043.dnkmem (mgr.34373) 11165 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.303092+0000 mgr.gibba043.dnkmem (mgr.34373) 11166 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.303407+0000 mgr.gibba043.dnkmem (mgr.34373) 11167 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.304791+0000 mgr.gibba043.dnkmem (mgr.34373) 11168 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.304827+0000 mgr.gibba043.dnkmem (mgr.34373) 11169 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:58 gibba043 bash[24019]: cephadm 2021-03-10T17:22:57.304939+0000 mgr.gibba043.dnkmem (mgr.34373) 11170 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:22:59.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:22:59 gibba003 bash[31385]: cluster 2021-03-10T17:22:58.505430+0000 mgr.gibba043.dnkmem (mgr.34373) 11171 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:22:59 gibba003 bash[32348]: cluster 2021-03-10T17:22:58.505430+0000 mgr.gibba043.dnkmem (mgr.34373) 11171 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:00.020 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:22:59 gibba043 bash[24019]: cluster 2021-03-10T17:22:58.505430+0000 mgr.gibba043.dnkmem (mgr.34373) 11171 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:01 gibba003 bash[31385]: cluster 2021-03-10T17:23:00.506903+0000 mgr.gibba043.dnkmem (mgr.34373) 11172 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:01 gibba003 bash[32348]: cluster 2021-03-10T17:23:00.506903+0000 mgr.gibba043.dnkmem (mgr.34373) 11172 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:01 gibba043 bash[24019]: cluster 2021-03-10T17:23:00.506903+0000 mgr.gibba043.dnkmem (mgr.34373) 11172 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:02.799 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:23:03.025 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:23:03.025 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:23:03.025 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:23:03.025 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:23:03.026 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:23:03.026 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:23:03.026 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:23:03.026 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:23:03.027 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:23:03.027 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:23:03.027 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:23:03.027 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:23:03.028 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:23:03.028 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:23:03.028 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:23:03.028 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:23:03.028 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:23:03.029 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:23:03.029 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:23:03.029 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:23:03.029 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:23:03.275 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:23:03.276 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:23:03.276 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:03.276 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:23:03.277 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:23:03.277 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:03.277 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:23:03.278 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:23:03.278 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:23:03.278 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:23:03.278 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:23:03.279 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:23:03.279 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:23:03.279 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:23:03.280 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:23:03.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:03 gibba003 bash[31385]: cluster 2021-03-10T17:23:02.508354+0000 mgr.gibba043.dnkmem (mgr.34373) 11173 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:03.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:03 gibba003 bash[31385]: audit 2021-03-10T17:23:02.789604+0000 mgr.gibba043.dnkmem (mgr.34373) 11174 : audit [DBG] from='client.61528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:03.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:03 gibba003 bash[31385]: audit 2021-03-10T17:23:03.275894+0000 mon.a (mon.0) 2232 : audit [DBG] from='client.? 172.21.2.103:0/1814603286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:03.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:03 gibba003 bash[32348]: cluster 2021-03-10T17:23:02.508354+0000 mgr.gibba043.dnkmem (mgr.34373) 11173 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:03.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:03 gibba003 bash[32348]: audit 2021-03-10T17:23:02.789604+0000 mgr.gibba043.dnkmem (mgr.34373) 11174 : audit [DBG] from='client.61528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:03.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:03 gibba003 bash[32348]: audit 2021-03-10T17:23:03.275894+0000 mon.a (mon.0) 2232 : audit [DBG] from='client.? 172.21.2.103:0/1814603286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:03 gibba043 bash[24019]: cluster 2021-03-10T17:23:02.508354+0000 mgr.gibba043.dnkmem (mgr.34373) 11173 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:04.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:03 gibba043 bash[24019]: audit 2021-03-10T17:23:02.789604+0000 mgr.gibba043.dnkmem (mgr.34373) 11174 : audit [DBG] from='client.61528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:04.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:03 gibba043 bash[24019]: audit 2021-03-10T17:23:03.275894+0000 mon.a (mon.0) 2232 : audit [DBG] from='client.? 172.21.2.103:0/1814603286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:04.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:04 gibba003 bash[31385]: audit 2021-03-10T17:23:03.013035+0000 mgr.gibba043.dnkmem (mgr.34373) 11175 : audit [DBG] from='client.51543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:04.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:04 gibba003 bash[32348]: audit 2021-03-10T17:23:03.013035+0000 mgr.gibba043.dnkmem (mgr.34373) 11175 : audit [DBG] from='client.51543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:05.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:04 gibba043 bash[24019]: audit 2021-03-10T17:23:03.013035+0000 mgr.gibba043.dnkmem (mgr.34373) 11175 : audit [DBG] from='client.51543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:05 gibba003 bash[31385]: cluster 2021-03-10T17:23:04.509747+0000 mgr.gibba043.dnkmem (mgr.34373) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:05 gibba003 bash[32348]: cluster 2021-03-10T17:23:04.509747+0000 mgr.gibba043.dnkmem (mgr.34373) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:05 gibba043 bash[24019]: cluster 2021-03-10T17:23:04.509747+0000 mgr.gibba043.dnkmem (mgr.34373) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:07 gibba003 bash[31385]: cluster 2021-03-10T17:23:06.510664+0000 mgr.gibba043.dnkmem (mgr.34373) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:07 gibba003 bash[32348]: cluster 2021-03-10T17:23:06.510664+0000 mgr.gibba043.dnkmem (mgr.34373) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:07 gibba043 bash[24019]: cluster 2021-03-10T17:23:06.510664+0000 mgr.gibba043.dnkmem (mgr.34373) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:08 gibba043 bash[24019]: cluster 2021-03-10T17:23:08.512289+0000 mgr.gibba043.dnkmem (mgr.34373) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:08 gibba003 bash[31385]: cluster 2021-03-10T17:23:08.512289+0000 mgr.gibba043.dnkmem (mgr.34373) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:08 gibba003 bash[32348]: cluster 2021-03-10T17:23:08.512289+0000 mgr.gibba043.dnkmem (mgr.34373) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:11 gibba003 bash[31385]: cluster 2021-03-10T17:23:10.513546+0000 mgr.gibba043.dnkmem (mgr.34373) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:11 gibba003 bash[32348]: cluster 2021-03-10T17:23:10.513546+0000 mgr.gibba043.dnkmem (mgr.34373) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:11 gibba043 bash[24019]: cluster 2021-03-10T17:23:10.513546+0000 mgr.gibba043.dnkmem (mgr.34373) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:13 gibba003 bash[31385]: cephadm 2021-03-10T17:23:12.320436+0000 mgr.gibba043.dnkmem (mgr.34373) 11180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:13 gibba003 bash[31385]: cluster 2021-03-10T17:23:12.515211+0000 mgr.gibba043.dnkmem (mgr.34373) 11181 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:13 gibba003 bash[32348]: cephadm 2021-03-10T17:23:12.320436+0000 mgr.gibba043.dnkmem (mgr.34373) 11180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:13 gibba003 bash[32348]: cluster 2021-03-10T17:23:12.515211+0000 mgr.gibba043.dnkmem (mgr.34373) 11181 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:13 gibba043 bash[24019]: cephadm 2021-03-10T17:23:12.320436+0000 mgr.gibba043.dnkmem (mgr.34373) 11180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:13 gibba043 bash[24019]: cluster 2021-03-10T17:23:12.515211+0000 mgr.gibba043.dnkmem (mgr.34373) 11181 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[31385]: audit 2021-03-10T17:23:14.089094+0000 mon.c (mon.1) 2876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[31385]: audit 2021-03-10T17:23:14.090247+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[31385]: audit 2021-03-10T17:23:14.330314+0000 mon.c (mon.1) 2877 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[31385]: audit 2021-03-10T17:23:14.331525+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[32348]: audit 2021-03-10T17:23:14.089094+0000 mon.c (mon.1) 2876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[32348]: audit 2021-03-10T17:23:14.090247+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[32348]: audit 2021-03-10T17:23:14.330314+0000 mon.c (mon.1) 2877 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:14 gibba003 bash[32348]: audit 2021-03-10T17:23:14.331525+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:14 gibba043 bash[24019]: audit 2021-03-10T17:23:14.089094+0000 mon.c (mon.1) 2876 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:14 gibba043 bash[24019]: audit 2021-03-10T17:23:14.090247+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:14 gibba043 bash[24019]: audit 2021-03-10T17:23:14.330314+0000 mon.c (mon.1) 2877 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:14 gibba043 bash[24019]: audit 2021-03-10T17:23:14.331525+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: cluster 2021-03-10T17:23:14.516842+0000 mgr.gibba043.dnkmem (mgr.34373) 11182 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.676749+0000 mon.c (mon.1) 2878 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:23:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.677409+0000 mon.c (mon.1) 2879 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:23:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.677948+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:23:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.678019+0000 mon.c (mon.1) 2880 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.678681+0000 mon.c (mon.1) 2881 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.680127+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:23:15.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.681054+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[31385]: audit 2021-03-10T17:23:14.681987+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: cluster 2021-03-10T17:23:14.516842+0000 mgr.gibba043.dnkmem (mgr.34373) 11182 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.676749+0000 mon.c (mon.1) 2878 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:23:15.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.677409+0000 mon.c (mon.1) 2879 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:23:15.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.677948+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:23:15.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.678019+0000 mon.c (mon.1) 2880 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.678681+0000 mon.c (mon.1) 2881 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.680127+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:23:15.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.681054+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:23:15.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:15 gibba003 bash[32348]: audit 2021-03-10T17:23:14.681987+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:16.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: cluster 2021-03-10T17:23:14.516842+0000 mgr.gibba043.dnkmem (mgr.34373) 11182 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.676749+0000 mon.c (mon.1) 2878 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:23:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.677409+0000 mon.c (mon.1) 2879 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:23:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.677948+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:23:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.678019+0000 mon.c (mon.1) 2880 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:23:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.678681+0000 mon.c (mon.1) 2881 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.680127+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:23:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.681054+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:23:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:15 gibba043 bash[24019]: audit 2021-03-10T17:23:14.681987+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:17 gibba003 bash[31385]: cluster 2021-03-10T17:23:16.517722+0000 mgr.gibba043.dnkmem (mgr.34373) 11183 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:17 gibba003 bash[32348]: cluster 2021-03-10T17:23:16.517722+0000 mgr.gibba043.dnkmem (mgr.34373) 11183 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:17 gibba043 bash[24019]: cluster 2021-03-10T17:23:16.517722+0000 mgr.gibba043.dnkmem (mgr.34373) 11183 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:18 gibba043 bash[24019]: cluster 2021-03-10T17:23:18.519306+0000 mgr.gibba043.dnkmem (mgr.34373) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:18 gibba003 bash[31385]: cluster 2021-03-10T17:23:18.519306+0000 mgr.gibba043.dnkmem (mgr.34373) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:18 gibba003 bash[32348]: cluster 2021-03-10T17:23:18.519306+0000 mgr.gibba043.dnkmem (mgr.34373) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:21 gibba003 bash[31385]: cluster 2021-03-10T17:23:20.520549+0000 mgr.gibba043.dnkmem (mgr.34373) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:21 gibba003 bash[32348]: cluster 2021-03-10T17:23:20.520549+0000 mgr.gibba043.dnkmem (mgr.34373) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:21 gibba043 bash[24019]: cluster 2021-03-10T17:23:20.520549+0000 mgr.gibba043.dnkmem (mgr.34373) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:23 gibba003 bash[31385]: cluster 2021-03-10T17:23:22.522262+0000 mgr.gibba043.dnkmem (mgr.34373) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:23 gibba003 bash[32348]: cluster 2021-03-10T17:23:22.522262+0000 mgr.gibba043.dnkmem (mgr.34373) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:23 gibba043 bash[24019]: cluster 2021-03-10T17:23:22.522262+0000 mgr.gibba043.dnkmem (mgr.34373) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:25 gibba003 bash[31385]: cluster 2021-03-10T17:23:24.524102+0000 mgr.gibba043.dnkmem (mgr.34373) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:25 gibba003 bash[32348]: cluster 2021-03-10T17:23:24.524102+0000 mgr.gibba043.dnkmem (mgr.34373) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:25 gibba043 bash[24019]: cluster 2021-03-10T17:23:24.524102+0000 mgr.gibba043.dnkmem (mgr.34373) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:27.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:27 gibba003 bash[31385]: cluster 2021-03-10T17:23:26.525083+0000 mgr.gibba043.dnkmem (mgr.34373) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:27 gibba003 bash[32348]: cluster 2021-03-10T17:23:26.525083+0000 mgr.gibba043.dnkmem (mgr.34373) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:27 gibba043 bash[24019]: cluster 2021-03-10T17:23:26.525083+0000 mgr.gibba043.dnkmem (mgr.34373) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:28 gibba003 bash[31385]: cephadm 2021-03-10T17:23:27.336452+0000 mgr.gibba043.dnkmem (mgr.34373) 11189 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:28.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:28 gibba003 bash[32348]: cephadm 2021-03-10T17:23:27.336452+0000 mgr.gibba043.dnkmem (mgr.34373) 11189 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:28 gibba043 bash[24019]: cephadm 2021-03-10T17:23:27.336452+0000 mgr.gibba043.dnkmem (mgr.34373) 11189 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:29.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:29 gibba003 bash[31385]: cluster 2021-03-10T17:23:28.526688+0000 mgr.gibba043.dnkmem (mgr.34373) 11190 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:29 gibba003 bash[32348]: cluster 2021-03-10T17:23:28.526688+0000 mgr.gibba043.dnkmem (mgr.34373) 11190 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:29 gibba043 bash[24019]: cluster 2021-03-10T17:23:28.526688+0000 mgr.gibba043.dnkmem (mgr.34373) 11190 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:31 gibba003 bash[31385]: cluster 2021-03-10T17:23:30.528250+0000 mgr.gibba043.dnkmem (mgr.34373) 11191 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:31 gibba003 bash[32348]: cluster 2021-03-10T17:23:30.528250+0000 mgr.gibba043.dnkmem (mgr.34373) 11191 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:31 gibba043 bash[24019]: cluster 2021-03-10T17:23:30.528250+0000 mgr.gibba043.dnkmem (mgr.34373) 11191 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:33.519 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:23:33.748 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:23:33.748 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:23:33.749 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:23:33.749 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:23:33.749 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:23:33.750 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:23:33.750 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:23:33.750 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:23:33.750 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:23:33.751 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:23:33.751 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:23:33.751 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:23:33.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:23:33.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:23:33.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:23:33.752 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:23:33.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:23:33.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:23:33.753 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:23:33.753 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:23:33.754 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:23:33.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:33 gibba003 bash[31385]: cluster 2021-03-10T17:23:32.529923+0000 mgr.gibba043.dnkmem (mgr.34373) 11192 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:33.940 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:33 gibba003 bash[32348]: cluster 2021-03-10T17:23:32.529923+0000 mgr.gibba043.dnkmem (mgr.34373) 11192 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:33.995 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:23:33.995 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:23:33.995 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:33.995 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:23:33.996 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:23:33.996 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:33.996 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:23:33.996 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:23:33.997 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:23:33.997 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:23:33.997 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:23:33.997 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:23:33.997 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:23:33.998 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:23:33.998 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:23:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:33 gibba043 bash[24019]: cluster 2021-03-10T17:23:32.529923+0000 mgr.gibba043.dnkmem (mgr.34373) 11192 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:34 gibba003 bash[31385]: audit 2021-03-10T17:23:33.508826+0000 mgr.gibba043.dnkmem (mgr.34373) 11193 : audit [DBG] from='client.61546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:34 gibba003 bash[31385]: audit 2021-03-10T17:23:33.735127+0000 mgr.gibba043.dnkmem (mgr.34373) 11194 : audit [DBG] from='client.51561 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:34.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:34 gibba003 bash[31385]: audit 2021-03-10T17:23:33.995681+0000 mon.a (mon.0) 2239 : audit [DBG] from='client.? 172.21.2.103:0/3995053479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:34 gibba003 bash[32348]: audit 2021-03-10T17:23:33.508826+0000 mgr.gibba043.dnkmem (mgr.34373) 11193 : audit [DBG] from='client.61546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:34.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:34 gibba003 bash[32348]: audit 2021-03-10T17:23:33.735127+0000 mgr.gibba043.dnkmem (mgr.34373) 11194 : audit [DBG] from='client.51561 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:34 gibba003 bash[32348]: audit 2021-03-10T17:23:33.995681+0000 mon.a (mon.0) 2239 : audit [DBG] from='client.? 172.21.2.103:0/3995053479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:35.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:34 gibba043 bash[24019]: audit 2021-03-10T17:23:33.508826+0000 mgr.gibba043.dnkmem (mgr.34373) 11193 : audit [DBG] from='client.61546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:34 gibba043 bash[24019]: audit 2021-03-10T17:23:33.735127+0000 mgr.gibba043.dnkmem (mgr.34373) 11194 : audit [DBG] from='client.51561 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:34 gibba043 bash[24019]: audit 2021-03-10T17:23:33.995681+0000 mon.a (mon.0) 2239 : audit [DBG] from='client.? 172.21.2.103:0/3995053479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:35.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:35 gibba003 bash[31385]: cluster 2021-03-10T17:23:34.531617+0000 mgr.gibba043.dnkmem (mgr.34373) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:35 gibba003 bash[32348]: cluster 2021-03-10T17:23:34.531617+0000 mgr.gibba043.dnkmem (mgr.34373) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:35 gibba043 bash[24019]: cluster 2021-03-10T17:23:34.531617+0000 mgr.gibba043.dnkmem (mgr.34373) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:37 gibba003 bash[31385]: cluster 2021-03-10T17:23:36.532773+0000 mgr.gibba043.dnkmem (mgr.34373) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:37 gibba003 bash[32348]: cluster 2021-03-10T17:23:36.532773+0000 mgr.gibba043.dnkmem (mgr.34373) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:38.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:37 gibba043 bash[24019]: cluster 2021-03-10T17:23:36.532773+0000 mgr.gibba043.dnkmem (mgr.34373) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:38 gibba043 bash[24019]: cluster 2021-03-10T17:23:38.534290+0000 mgr.gibba043.dnkmem (mgr.34373) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:38 gibba003 bash[31385]: cluster 2021-03-10T17:23:38.534290+0000 mgr.gibba043.dnkmem (mgr.34373) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:38 gibba003 bash[32348]: cluster 2021-03-10T17:23:38.534290+0000 mgr.gibba043.dnkmem (mgr.34373) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:41 gibba003 bash[31385]: cluster 2021-03-10T17:23:40.535835+0000 mgr.gibba043.dnkmem (mgr.34373) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:41 gibba003 bash[32348]: cluster 2021-03-10T17:23:40.535835+0000 mgr.gibba043.dnkmem (mgr.34373) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:41 gibba043 bash[24019]: cluster 2021-03-10T17:23:40.535835+0000 mgr.gibba043.dnkmem (mgr.34373) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:43 gibba003 bash[31385]: cephadm 2021-03-10T17:23:42.352248+0000 mgr.gibba043.dnkmem (mgr.34373) 11199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:43.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:43 gibba003 bash[31385]: cluster 2021-03-10T17:23:42.537247+0000 mgr.gibba043.dnkmem (mgr.34373) 11200 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:43 gibba003 bash[32348]: cephadm 2021-03-10T17:23:42.352248+0000 mgr.gibba043.dnkmem (mgr.34373) 11199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:43.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:43 gibba003 bash[32348]: cluster 2021-03-10T17:23:42.537247+0000 mgr.gibba043.dnkmem (mgr.34373) 11200 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:43 gibba043 bash[24019]: cephadm 2021-03-10T17:23:42.352248+0000 mgr.gibba043.dnkmem (mgr.34373) 11199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:44.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:43 gibba043 bash[24019]: cluster 2021-03-10T17:23:42.537247+0000 mgr.gibba043.dnkmem (mgr.34373) 11200 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:45 gibba003 bash[31385]: cluster 2021-03-10T17:23:44.539059+0000 mgr.gibba043.dnkmem (mgr.34373) 11201 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:45 gibba003 bash[32348]: cluster 2021-03-10T17:23:44.539059+0000 mgr.gibba043.dnkmem (mgr.34373) 11201 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:46.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:45 gibba043 bash[24019]: cluster 2021-03-10T17:23:44.539059+0000 mgr.gibba043.dnkmem (mgr.34373) 11201 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:47 gibba003 bash[31385]: cluster 2021-03-10T17:23:46.540294+0000 mgr.gibba043.dnkmem (mgr.34373) 11202 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:47 gibba003 bash[32348]: cluster 2021-03-10T17:23:46.540294+0000 mgr.gibba043.dnkmem (mgr.34373) 11202 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:47 gibba043 bash[24019]: cluster 2021-03-10T17:23:46.540294+0000 mgr.gibba043.dnkmem (mgr.34373) 11202 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:48 gibba043 bash[24019]: cluster 2021-03-10T17:23:48.541893+0000 mgr.gibba043.dnkmem (mgr.34373) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:48 gibba003 bash[31385]: cluster 2021-03-10T17:23:48.541893+0000 mgr.gibba043.dnkmem (mgr.34373) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:48 gibba003 bash[32348]: cluster 2021-03-10T17:23:48.541893+0000 mgr.gibba043.dnkmem (mgr.34373) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:51 gibba003 bash[31385]: cluster 2021-03-10T17:23:50.543296+0000 mgr.gibba043.dnkmem (mgr.34373) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:51 gibba003 bash[32348]: cluster 2021-03-10T17:23:50.543296+0000 mgr.gibba043.dnkmem (mgr.34373) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:51 gibba043 bash[24019]: cluster 2021-03-10T17:23:50.543296+0000 mgr.gibba043.dnkmem (mgr.34373) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:53 gibba003 bash[31385]: cluster 2021-03-10T17:23:52.544731+0000 mgr.gibba043.dnkmem (mgr.34373) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:53 gibba003 bash[32348]: cluster 2021-03-10T17:23:52.544731+0000 mgr.gibba043.dnkmem (mgr.34373) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:53 gibba043 bash[24019]: cluster 2021-03-10T17:23:52.544731+0000 mgr.gibba043.dnkmem (mgr.34373) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:55 gibba003 bash[31385]: cluster 2021-03-10T17:23:54.546377+0000 mgr.gibba043.dnkmem (mgr.34373) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:55 gibba003 bash[32348]: cluster 2021-03-10T17:23:54.546377+0000 mgr.gibba043.dnkmem (mgr.34373) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:55 gibba043 bash[24019]: cluster 2021-03-10T17:23:54.546377+0000 mgr.gibba043.dnkmem (mgr.34373) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: cluster 2021-03-10T17:23:56.548057+0000 mgr.gibba043.dnkmem (mgr.34373) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.596345+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:23:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.599924+0000 mon.c (mon.1) 2882 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.601393+0000 mon.c (mon.1) 2883 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.602369+0000 mon.c (mon.1) 2884 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.603403+0000 mon.c (mon.1) 2885 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.606042+0000 mon.c (mon.1) 2886 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[31385]: audit 2021-03-10T17:23:57.607311+0000 mon.c (mon.1) 2887 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: cluster 2021-03-10T17:23:56.548057+0000 mgr.gibba043.dnkmem (mgr.34373) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.596345+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:23:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.599924+0000 mon.c (mon.1) 2882 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.601393+0000 mon.c (mon.1) 2883 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.602369+0000 mon.c (mon.1) 2884 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.603403+0000 mon.c (mon.1) 2885 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.606042+0000 mon.c (mon.1) 2886 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:57 gibba003 bash[32348]: audit 2021-03-10T17:23:57.607311+0000 mon.c (mon.1) 2887 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: cluster 2021-03-10T17:23:56.548057+0000 mgr.gibba043.dnkmem (mgr.34373) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.596345+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:23:58.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.599924+0000 mon.c (mon.1) 2882 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.601393+0000 mon.c (mon.1) 2883 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.602369+0000 mon.c (mon.1) 2884 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:58.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.603403+0000 mon.c (mon.1) 2885 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.606042+0000 mon.c (mon.1) 2886 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:58.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:57 gibba043 bash[24019]: audit 2021-03-10T17:23:57.607311+0000 mon.c (mon.1) 2887 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.369180+0000 mgr.gibba043.dnkmem (mgr.34373) 11208 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:23:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.370495+0000 mgr.gibba043.dnkmem (mgr.34373) 11209 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:23:58.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.597554+0000 mgr.gibba043.dnkmem (mgr.34373) 11210 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.599484+0000 mgr.gibba043.dnkmem (mgr.34373) 11211 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.600412+0000 mgr.gibba043.dnkmem (mgr.34373) 11212 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.600448+0000 mgr.gibba043.dnkmem (mgr.34373) 11213 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.601453+0000 mgr.gibba043.dnkmem (mgr.34373) 11214 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.601542+0000 mgr.gibba043.dnkmem (mgr.34373) 11215 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.602382+0000 mgr.gibba043.dnkmem (mgr.34373) 11216 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.603906+0000 mgr.gibba043.dnkmem (mgr.34373) 11217 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.603938+0000 mgr.gibba043.dnkmem (mgr.34373) 11218 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.605147+0000 mgr.gibba043.dnkmem (mgr.34373) 11219 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:58.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.605467+0000 mgr.gibba043.dnkmem (mgr.34373) 11220 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:58.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.606349+0000 mgr.gibba043.dnkmem (mgr.34373) 11221 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:58.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.606384+0000 mgr.gibba043.dnkmem (mgr.34373) 11222 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:58.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[31385]: cephadm 2021-03-10T17:23:57.606484+0000 mgr.gibba043.dnkmem (mgr.34373) 11223 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.369180+0000 mgr.gibba043.dnkmem (mgr.34373) 11208 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:23:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.370495+0000 mgr.gibba043.dnkmem (mgr.34373) 11209 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:23:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.597554+0000 mgr.gibba043.dnkmem (mgr.34373) 11210 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:58.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.599484+0000 mgr.gibba043.dnkmem (mgr.34373) 11211 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.600412+0000 mgr.gibba043.dnkmem (mgr.34373) 11212 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.600448+0000 mgr.gibba043.dnkmem (mgr.34373) 11213 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.601453+0000 mgr.gibba043.dnkmem (mgr.34373) 11214 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.601542+0000 mgr.gibba043.dnkmem (mgr.34373) 11215 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:58.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.602382+0000 mgr.gibba043.dnkmem (mgr.34373) 11216 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.603906+0000 mgr.gibba043.dnkmem (mgr.34373) 11217 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.603938+0000 mgr.gibba043.dnkmem (mgr.34373) 11218 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.605147+0000 mgr.gibba043.dnkmem (mgr.34373) 11219 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:58.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.605467+0000 mgr.gibba043.dnkmem (mgr.34373) 11220 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:58.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.606349+0000 mgr.gibba043.dnkmem (mgr.34373) 11221 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:58.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.606384+0000 mgr.gibba043.dnkmem (mgr.34373) 11222 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:58.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:58 gibba003 bash[32348]: cephadm 2021-03-10T17:23:57.606484+0000 mgr.gibba043.dnkmem (mgr.34373) 11223 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.369180+0000 mgr.gibba043.dnkmem (mgr.34373) 11208 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:23:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.370495+0000 mgr.gibba043.dnkmem (mgr.34373) 11209 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:23:59.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.597554+0000 mgr.gibba043.dnkmem (mgr.34373) 11210 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.599484+0000 mgr.gibba043.dnkmem (mgr.34373) 11211 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.600412+0000 mgr.gibba043.dnkmem (mgr.34373) 11212 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.600448+0000 mgr.gibba043.dnkmem (mgr.34373) 11213 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.601453+0000 mgr.gibba043.dnkmem (mgr.34373) 11214 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.601542+0000 mgr.gibba043.dnkmem (mgr.34373) 11215 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.602382+0000 mgr.gibba043.dnkmem (mgr.34373) 11216 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.603906+0000 mgr.gibba043.dnkmem (mgr.34373) 11217 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.603938+0000 mgr.gibba043.dnkmem (mgr.34373) 11218 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.605147+0000 mgr.gibba043.dnkmem (mgr.34373) 11219 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.605467+0000 mgr.gibba043.dnkmem (mgr.34373) 11220 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.606349+0000 mgr.gibba043.dnkmem (mgr.34373) 11221 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.606384+0000 mgr.gibba043.dnkmem (mgr.34373) 11222 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:58 gibba043 bash[24019]: cephadm 2021-03-10T17:23:57.606484+0000 mgr.gibba043.dnkmem (mgr.34373) 11223 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:23:59.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:23:59 gibba003 bash[31385]: cluster 2021-03-10T17:23:58.549720+0000 mgr.gibba043.dnkmem (mgr.34373) 11224 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:23:59 gibba003 bash[32348]: cluster 2021-03-10T17:23:58.549720+0000 mgr.gibba043.dnkmem (mgr.34373) 11224 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:00.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:23:59 gibba043 bash[24019]: cluster 2021-03-10T17:23:58.549720+0000 mgr.gibba043.dnkmem (mgr.34373) 11224 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:01 gibba003 bash[31385]: cluster 2021-03-10T17:24:00.551316+0000 mgr.gibba043.dnkmem (mgr.34373) 11225 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:01 gibba003 bash[32348]: cluster 2021-03-10T17:24:00.551316+0000 mgr.gibba043.dnkmem (mgr.34373) 11225 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:01 gibba043 bash[24019]: cluster 2021-03-10T17:24:00.551316+0000 mgr.gibba043.dnkmem (mgr.34373) 11225 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:03.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:03 gibba003 bash[31385]: cluster 2021-03-10T17:24:02.552970+0000 mgr.gibba043.dnkmem (mgr.34373) 11226 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:03.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:03 gibba003 bash[32348]: cluster 2021-03-10T17:24:02.552970+0000 mgr.gibba043.dnkmem (mgr.34373) 11226 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:03 gibba043 bash[24019]: cluster 2021-03-10T17:24:02.552970+0000 mgr.gibba043.dnkmem (mgr.34373) 11226 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:04.241 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:24:04.469 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:24:04.469 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:24:04.469 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:24:04.469 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:24:04.470 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:24:04.470 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:24:04.470 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:24:04.470 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:24:04.471 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:24:04.471 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:24:04.471 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:24:04.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:24:04.471 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:24:04.472 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:24:04.472 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:24:04.472 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:24:04.472 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:24:04.472 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:24:04.473 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:24:04.473 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:24:04.473 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:24:04.717 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:24:04.718 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:24:04.718 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:04.718 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:24:04.718 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:24:04.718 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:04.719 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:24:04.719 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:24:04.719 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:24:04.719 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:24:04.720 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:24:04.720 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:24:04.720 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:24:04.720 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:24:04.720 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:24:05.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[31385]: audit 2021-03-10T17:24:04.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 11227 : audit [DBG] from='client.61564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[31385]: audit 2021-03-10T17:24:04.457086+0000 mgr.gibba043.dnkmem (mgr.34373) 11228 : audit [DBG] from='client.51579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[31385]: cluster 2021-03-10T17:24:04.554361+0000 mgr.gibba043.dnkmem (mgr.34373) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[31385]: audit 2021-03-10T17:24:04.718106+0000 mon.c (mon.1) 2888 : audit [DBG] from='client.? 172.21.2.103:0/3258213133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:05.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[32348]: audit 2021-03-10T17:24:04.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 11227 : audit [DBG] from='client.61564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:05.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[32348]: audit 2021-03-10T17:24:04.457086+0000 mgr.gibba043.dnkmem (mgr.34373) 11228 : audit [DBG] from='client.51579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:05.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[32348]: cluster 2021-03-10T17:24:04.554361+0000 mgr.gibba043.dnkmem (mgr.34373) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:05 gibba003 bash[32348]: audit 2021-03-10T17:24:04.718106+0000 mon.c (mon.1) 2888 : audit [DBG] from='client.? 172.21.2.103:0/3258213133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:05 gibba043 bash[24019]: audit 2021-03-10T17:24:04.230818+0000 mgr.gibba043.dnkmem (mgr.34373) 11227 : audit [DBG] from='client.61564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:06.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:05 gibba043 bash[24019]: audit 2021-03-10T17:24:04.457086+0000 mgr.gibba043.dnkmem (mgr.34373) 11228 : audit [DBG] from='client.51579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:06.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:05 gibba043 bash[24019]: cluster 2021-03-10T17:24:04.554361+0000 mgr.gibba043.dnkmem (mgr.34373) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:06.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:05 gibba043 bash[24019]: audit 2021-03-10T17:24:04.718106+0000 mon.c (mon.1) 2888 : audit [DBG] from='client.? 172.21.2.103:0/3258213133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:07.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:07 gibba003 bash[31385]: cluster 2021-03-10T17:24:06.555579+0000 mgr.gibba043.dnkmem (mgr.34373) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:07 gibba003 bash[32348]: cluster 2021-03-10T17:24:06.555579+0000 mgr.gibba043.dnkmem (mgr.34373) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:08.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:07 gibba043 bash[24019]: cluster 2021-03-10T17:24:06.555579+0000 mgr.gibba043.dnkmem (mgr.34373) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:08 gibba043 bash[24019]: cluster 2021-03-10T17:24:08.557138+0000 mgr.gibba043.dnkmem (mgr.34373) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:08 gibba003 bash[31385]: cluster 2021-03-10T17:24:08.557138+0000 mgr.gibba043.dnkmem (mgr.34373) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:08 gibba003 bash[32348]: cluster 2021-03-10T17:24:08.557138+0000 mgr.gibba043.dnkmem (mgr.34373) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:11 gibba003 bash[31385]: cluster 2021-03-10T17:24:10.558554+0000 mgr.gibba043.dnkmem (mgr.34373) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:11 gibba003 bash[32348]: cluster 2021-03-10T17:24:10.558554+0000 mgr.gibba043.dnkmem (mgr.34373) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:12.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:11 gibba043 bash[24019]: cluster 2021-03-10T17:24:10.558554+0000 mgr.gibba043.dnkmem (mgr.34373) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:13 gibba003 bash[31385]: cluster 2021-03-10T17:24:12.560291+0000 mgr.gibba043.dnkmem (mgr.34373) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:13 gibba003 bash[31385]: cephadm 2021-03-10T17:24:12.622605+0000 mgr.gibba043.dnkmem (mgr.34373) 11234 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:13 gibba003 bash[32348]: cluster 2021-03-10T17:24:12.560291+0000 mgr.gibba043.dnkmem (mgr.34373) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:13 gibba003 bash[32348]: cephadm 2021-03-10T17:24:12.622605+0000 mgr.gibba043.dnkmem (mgr.34373) 11234 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:13 gibba043 bash[24019]: cluster 2021-03-10T17:24:12.560291+0000 mgr.gibba043.dnkmem (mgr.34373) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:13 gibba043 bash[24019]: cephadm 2021-03-10T17:24:12.622605+0000 mgr.gibba043.dnkmem (mgr.34373) 11234 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[31385]: audit 2021-03-10T17:24:14.095937+0000 mon.c (mon.1) 2889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[31385]: audit 2021-03-10T17:24:14.097009+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[31385]: audit 2021-03-10T17:24:14.337599+0000 mon.c (mon.1) 2890 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[31385]: audit 2021-03-10T17:24:14.338697+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[32348]: audit 2021-03-10T17:24:14.095937+0000 mon.c (mon.1) 2889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[32348]: audit 2021-03-10T17:24:14.097009+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[32348]: audit 2021-03-10T17:24:14.337599+0000 mon.c (mon.1) 2890 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:14.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:14 gibba003 bash[32348]: audit 2021-03-10T17:24:14.338697+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:14 gibba043 bash[24019]: audit 2021-03-10T17:24:14.095937+0000 mon.c (mon.1) 2889 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:14 gibba043 bash[24019]: audit 2021-03-10T17:24:14.097009+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:14 gibba043 bash[24019]: audit 2021-03-10T17:24:14.337599+0000 mon.c (mon.1) 2890 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:14 gibba043 bash[24019]: audit 2021-03-10T17:24:14.338697+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: cluster 2021-03-10T17:24:14.562265+0000 mgr.gibba043.dnkmem (mgr.34373) 11235 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.687451+0000 mon.c (mon.1) 2891 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:24:15.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.687721+0000 mon.c (mon.1) 2892 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:24:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.687937+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:24:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.687971+0000 mon.c (mon.1) 2893 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.688389+0000 mon.c (mon.1) 2894 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.688450+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:24:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.688713+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[31385]: audit 2021-03-10T17:24:14.689040+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: cluster 2021-03-10T17:24:14.562265+0000 mgr.gibba043.dnkmem (mgr.34373) 11235 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.687451+0000 mon.c (mon.1) 2891 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:24:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.687721+0000 mon.c (mon.1) 2892 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:24:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.687937+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:24:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.687971+0000 mon.c (mon.1) 2893 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.688389+0000 mon.c (mon.1) 2894 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.688450+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:24:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.688713+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:24:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:15 gibba003 bash[32348]: audit 2021-03-10T17:24:14.689040+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: cluster 2021-03-10T17:24:14.562265+0000 mgr.gibba043.dnkmem (mgr.34373) 11235 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.687451+0000 mon.c (mon.1) 2891 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:24:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.687721+0000 mon.c (mon.1) 2892 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:24:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.687937+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:24:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.687971+0000 mon.c (mon.1) 2893 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:24:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.688389+0000 mon.c (mon.1) 2894 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.688450+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:24:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.688713+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:24:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:15 gibba043 bash[24019]: audit 2021-03-10T17:24:14.689040+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:17.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:17 gibba003 bash[31385]: cluster 2021-03-10T17:24:16.564131+0000 mgr.gibba043.dnkmem (mgr.34373) 11236 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:17 gibba003 bash[32348]: cluster 2021-03-10T17:24:16.564131+0000 mgr.gibba043.dnkmem (mgr.34373) 11236 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:17 gibba043 bash[24019]: cluster 2021-03-10T17:24:16.564131+0000 mgr.gibba043.dnkmem (mgr.34373) 11236 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:18 gibba043 bash[24019]: cluster 2021-03-10T17:24:18.565697+0000 mgr.gibba043.dnkmem (mgr.34373) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:18 gibba003 bash[31385]: cluster 2021-03-10T17:24:18.565697+0000 mgr.gibba043.dnkmem (mgr.34373) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:18 gibba003 bash[32348]: cluster 2021-03-10T17:24:18.565697+0000 mgr.gibba043.dnkmem (mgr.34373) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:21 gibba003 bash[31385]: cluster 2021-03-10T17:24:20.567102+0000 mgr.gibba043.dnkmem (mgr.34373) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:21 gibba003 bash[32348]: cluster 2021-03-10T17:24:20.567102+0000 mgr.gibba043.dnkmem (mgr.34373) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:21 gibba043 bash[24019]: cluster 2021-03-10T17:24:20.567102+0000 mgr.gibba043.dnkmem (mgr.34373) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:23 gibba003 bash[31385]: cluster 2021-03-10T17:24:22.568568+0000 mgr.gibba043.dnkmem (mgr.34373) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:23 gibba003 bash[32348]: cluster 2021-03-10T17:24:22.568568+0000 mgr.gibba043.dnkmem (mgr.34373) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:23 gibba043 bash[24019]: cluster 2021-03-10T17:24:22.568568+0000 mgr.gibba043.dnkmem (mgr.34373) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:25 gibba003 bash[31385]: cluster 2021-03-10T17:24:24.570386+0000 mgr.gibba043.dnkmem (mgr.34373) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:25 gibba003 bash[32348]: cluster 2021-03-10T17:24:24.570386+0000 mgr.gibba043.dnkmem (mgr.34373) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:25 gibba043 bash[24019]: cluster 2021-03-10T17:24:24.570386+0000 mgr.gibba043.dnkmem (mgr.34373) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:27 gibba003 bash[31385]: cluster 2021-03-10T17:24:26.572245+0000 mgr.gibba043.dnkmem (mgr.34373) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:27 gibba003 bash[32348]: cluster 2021-03-10T17:24:26.572245+0000 mgr.gibba043.dnkmem (mgr.34373) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:27 gibba043 bash[24019]: cluster 2021-03-10T17:24:26.572245+0000 mgr.gibba043.dnkmem (mgr.34373) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:28.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:28 gibba003 bash[31385]: cephadm 2021-03-10T17:24:27.635910+0000 mgr.gibba043.dnkmem (mgr.34373) 11242 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:28.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:28 gibba003 bash[32348]: cephadm 2021-03-10T17:24:27.635910+0000 mgr.gibba043.dnkmem (mgr.34373) 11242 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:28 gibba043 bash[24019]: cephadm 2021-03-10T17:24:27.635910+0000 mgr.gibba043.dnkmem (mgr.34373) 11242 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:29.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:29 gibba003 bash[31385]: cluster 2021-03-10T17:24:28.573949+0000 mgr.gibba043.dnkmem (mgr.34373) 11243 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:29 gibba003 bash[32348]: cluster 2021-03-10T17:24:28.573949+0000 mgr.gibba043.dnkmem (mgr.34373) 11243 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:29 gibba043 bash[24019]: cluster 2021-03-10T17:24:28.573949+0000 mgr.gibba043.dnkmem (mgr.34373) 11243 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:31 gibba003 bash[31385]: cluster 2021-03-10T17:24:30.575525+0000 mgr.gibba043.dnkmem (mgr.34373) 11244 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:31 gibba003 bash[32348]: cluster 2021-03-10T17:24:30.575525+0000 mgr.gibba043.dnkmem (mgr.34373) 11244 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:31 gibba043 bash[24019]: cluster 2021-03-10T17:24:30.575525+0000 mgr.gibba043.dnkmem (mgr.34373) 11244 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:33.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:33 gibba003 bash[31385]: cluster 2021-03-10T17:24:32.577231+0000 mgr.gibba043.dnkmem (mgr.34373) 11245 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:33 gibba003 bash[32348]: cluster 2021-03-10T17:24:32.577231+0000 mgr.gibba043.dnkmem (mgr.34373) 11245 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:34.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:33 gibba043 bash[24019]: cluster 2021-03-10T17:24:32.577231+0000 mgr.gibba043.dnkmem (mgr.34373) 11245 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:34.959 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:24:35.188 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:24:35.189 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:24:35.189 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:24:35.189 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:24:35.189 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:24:35.190 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:24:35.190 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:24:35.190 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:24:35.190 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:24:35.190 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:24:35.191 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:24:35.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:24:35.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:24:35.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:24:35.192 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:24:35.192 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:24:35.192 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:24:35.193 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:24:35.193 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:24:35.193 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:24:35.193 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:24:35.436 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:24:35.436 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:24:35.437 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:35.437 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:24:35.437 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:24:35.437 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:35.437 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:24:35.438 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:24:35.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:24:35.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:24:35.438 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:24:35.439 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:24:35.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:24:35.439 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:24:35.439 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:24:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:35 gibba043 bash[24019]: cluster 2021-03-10T17:24:34.578754+0000 mgr.gibba043.dnkmem (mgr.34373) 11246 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:35 gibba043 bash[24019]: audit 2021-03-10T17:24:34.949257+0000 mgr.gibba043.dnkmem (mgr.34373) 11247 : audit [DBG] from='client.51591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:36.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:35 gibba043 bash[24019]: audit 2021-03-10T17:24:35.436499+0000 mon.a (mon.0) 2247 : audit [DBG] from='client.? 172.21.2.103:0/4003152281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:35 gibba003 bash[31385]: cluster 2021-03-10T17:24:34.578754+0000 mgr.gibba043.dnkmem (mgr.34373) 11246 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:35 gibba003 bash[31385]: audit 2021-03-10T17:24:34.949257+0000 mgr.gibba043.dnkmem (mgr.34373) 11247 : audit [DBG] from='client.51591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:35 gibba003 bash[31385]: audit 2021-03-10T17:24:35.436499+0000 mon.a (mon.0) 2247 : audit [DBG] from='client.? 172.21.2.103:0/4003152281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:35 gibba003 bash[32348]: cluster 2021-03-10T17:24:34.578754+0000 mgr.gibba043.dnkmem (mgr.34373) 11246 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:36.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:35 gibba003 bash[32348]: audit 2021-03-10T17:24:34.949257+0000 mgr.gibba043.dnkmem (mgr.34373) 11247 : audit [DBG] from='client.51591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:36.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:35 gibba003 bash[32348]: audit 2021-03-10T17:24:35.436499+0000 mon.a (mon.0) 2247 : audit [DBG] from='client.? 172.21.2.103:0/4003152281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:37.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:36 gibba043 bash[24019]: audit 2021-03-10T17:24:35.175034+0000 mgr.gibba043.dnkmem (mgr.34373) 11248 : audit [DBG] from='client.51597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:37.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:36 gibba003 bash[31385]: audit 2021-03-10T17:24:35.175034+0000 mgr.gibba043.dnkmem (mgr.34373) 11248 : audit [DBG] from='client.51597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:37.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:36 gibba003 bash[32348]: audit 2021-03-10T17:24:35.175034+0000 mgr.gibba043.dnkmem (mgr.34373) 11248 : audit [DBG] from='client.51597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:37 gibba043 bash[24019]: cluster 2021-03-10T17:24:36.580268+0000 mgr.gibba043.dnkmem (mgr.34373) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:37 gibba003 bash[31385]: cluster 2021-03-10T17:24:36.580268+0000 mgr.gibba043.dnkmem (mgr.34373) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:37 gibba003 bash[32348]: cluster 2021-03-10T17:24:36.580268+0000 mgr.gibba043.dnkmem (mgr.34373) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:39 gibba043 bash[24019]: cluster 2021-03-10T17:24:38.581804+0000 mgr.gibba043.dnkmem (mgr.34373) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:39 gibba003 bash[31385]: cluster 2021-03-10T17:24:38.581804+0000 mgr.gibba043.dnkmem (mgr.34373) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:39 gibba003 bash[32348]: cluster 2021-03-10T17:24:38.581804+0000 mgr.gibba043.dnkmem (mgr.34373) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:41 gibba003 bash[31385]: cluster 2021-03-10T17:24:40.583383+0000 mgr.gibba043.dnkmem (mgr.34373) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:41 gibba003 bash[32348]: cluster 2021-03-10T17:24:40.583383+0000 mgr.gibba043.dnkmem (mgr.34373) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:42.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:41 gibba043 bash[24019]: cluster 2021-03-10T17:24:40.583383+0000 mgr.gibba043.dnkmem (mgr.34373) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:43 gibba003 bash[31385]: cluster 2021-03-10T17:24:42.585103+0000 mgr.gibba043.dnkmem (mgr.34373) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:43 gibba003 bash[31385]: cephadm 2021-03-10T17:24:42.643968+0000 mgr.gibba043.dnkmem (mgr.34373) 11253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:43 gibba003 bash[32348]: cluster 2021-03-10T17:24:42.585103+0000 mgr.gibba043.dnkmem (mgr.34373) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:43 gibba003 bash[32348]: cephadm 2021-03-10T17:24:42.643968+0000 mgr.gibba043.dnkmem (mgr.34373) 11253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:44.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:43 gibba043 bash[24019]: cluster 2021-03-10T17:24:42.585103+0000 mgr.gibba043.dnkmem (mgr.34373) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:44.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:43 gibba043 bash[24019]: cephadm 2021-03-10T17:24:42.643968+0000 mgr.gibba043.dnkmem (mgr.34373) 11253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:45.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:45 gibba003 bash[31385]: cluster 2021-03-10T17:24:44.585606+0000 mgr.gibba043.dnkmem (mgr.34373) 11254 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:45 gibba003 bash[32348]: cluster 2021-03-10T17:24:44.585606+0000 mgr.gibba043.dnkmem (mgr.34373) 11254 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:46.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:45 gibba043 bash[24019]: cluster 2021-03-10T17:24:44.585606+0000 mgr.gibba043.dnkmem (mgr.34373) 11254 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:47 gibba003 bash[31385]: cluster 2021-03-10T17:24:46.587185+0000 mgr.gibba043.dnkmem (mgr.34373) 11255 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:47 gibba003 bash[32348]: cluster 2021-03-10T17:24:46.587185+0000 mgr.gibba043.dnkmem (mgr.34373) 11255 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:47 gibba043 bash[24019]: cluster 2021-03-10T17:24:46.587185+0000 mgr.gibba043.dnkmem (mgr.34373) 11255 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:49 gibba003 bash[31385]: cluster 2021-03-10T17:24:48.588570+0000 mgr.gibba043.dnkmem (mgr.34373) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:49 gibba003 bash[32348]: cluster 2021-03-10T17:24:48.588570+0000 mgr.gibba043.dnkmem (mgr.34373) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:49 gibba043 bash[24019]: cluster 2021-03-10T17:24:48.588570+0000 mgr.gibba043.dnkmem (mgr.34373) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:51 gibba003 bash[31385]: cluster 2021-03-10T17:24:50.590012+0000 mgr.gibba043.dnkmem (mgr.34373) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:51 gibba003 bash[32348]: cluster 2021-03-10T17:24:50.590012+0000 mgr.gibba043.dnkmem (mgr.34373) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:51 gibba043 bash[24019]: cluster 2021-03-10T17:24:50.590012+0000 mgr.gibba043.dnkmem (mgr.34373) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:53.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:53 gibba003 bash[31385]: cluster 2021-03-10T17:24:52.591707+0000 mgr.gibba043.dnkmem (mgr.34373) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:53.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:53 gibba003 bash[32348]: cluster 2021-03-10T17:24:52.591707+0000 mgr.gibba043.dnkmem (mgr.34373) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:53 gibba043 bash[24019]: cluster 2021-03-10T17:24:52.591707+0000 mgr.gibba043.dnkmem (mgr.34373) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:55.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:55 gibba003 bash[31385]: cluster 2021-03-10T17:24:54.592247+0000 mgr.gibba043.dnkmem (mgr.34373) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:55.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:55 gibba003 bash[32348]: cluster 2021-03-10T17:24:54.592247+0000 mgr.gibba043.dnkmem (mgr.34373) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:55 gibba043 bash[24019]: cluster 2021-03-10T17:24:54.592247+0000 mgr.gibba043.dnkmem (mgr.34373) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:57.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:57 gibba003 bash[31385]: cluster 2021-03-10T17:24:56.593869+0000 mgr.gibba043.dnkmem (mgr.34373) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:57.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:57 gibba003 bash[32348]: cluster 2021-03-10T17:24:56.593869+0000 mgr.gibba043.dnkmem (mgr.34373) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:57 gibba043 bash[24019]: cluster 2021-03-10T17:24:56.593869+0000 mgr.gibba043.dnkmem (mgr.34373) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.659502+0000 mgr.gibba043.dnkmem (mgr.34373) 11261 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:24:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.659914+0000 mgr.gibba043.dnkmem (mgr.34373) 11262 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:24:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.868405+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:24:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.869736+0000 mgr.gibba043.dnkmem (mgr.34373) 11263 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.871492+0000 mgr.gibba043.dnkmem (mgr.34373) 11264 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.872045+0000 mon.c (mon.1) 2895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.873068+0000 mgr.gibba043.dnkmem (mgr.34373) 11265 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.873103+0000 mgr.gibba043.dnkmem (mgr.34373) 11266 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.873575+0000 mon.c (mon.1) 2896 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.874716+0000 mgr.gibba043.dnkmem (mgr.34373) 11267 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.874751+0000 mgr.gibba043.dnkmem (mgr.34373) 11268 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.875175+0000 mon.c (mon.1) 2897 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.876223+0000 mgr.gibba043.dnkmem (mgr.34373) 11269 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.876726+0000 mon.c (mon.1) 2898 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.878029+0000 mgr.gibba043.dnkmem (mgr.34373) 11270 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.878065+0000 mgr.gibba043.dnkmem (mgr.34373) 11271 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.879285+0000 mgr.gibba043.dnkmem (mgr.34373) 11272 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.879617+0000 mgr.gibba043.dnkmem (mgr.34373) 11273 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:59.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.880139+0000 mon.c (mon.1) 2899 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.880463+0000 mgr.gibba043.dnkmem (mgr.34373) 11274 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.880498+0000 mgr.gibba043.dnkmem (mgr.34373) 11275 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: cephadm 2021-03-10T17:24:57.880600+0000 mgr.gibba043.dnkmem (mgr.34373) 11276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:59.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[31385]: audit 2021-03-10T17:24:57.881400+0000 mon.c (mon.1) 2900 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.659502+0000 mgr.gibba043.dnkmem (mgr.34373) 11261 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:24:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.659914+0000 mgr.gibba043.dnkmem (mgr.34373) 11262 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:24:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.868405+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:24:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.869736+0000 mgr.gibba043.dnkmem (mgr.34373) 11263 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.871492+0000 mgr.gibba043.dnkmem (mgr.34373) 11264 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.872045+0000 mon.c (mon.1) 2895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.873068+0000 mgr.gibba043.dnkmem (mgr.34373) 11265 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.873103+0000 mgr.gibba043.dnkmem (mgr.34373) 11266 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:59.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.873575+0000 mon.c (mon.1) 2896 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.874716+0000 mgr.gibba043.dnkmem (mgr.34373) 11267 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.874751+0000 mgr.gibba043.dnkmem (mgr.34373) 11268 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.875175+0000 mon.c (mon.1) 2897 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.876223+0000 mgr.gibba043.dnkmem (mgr.34373) 11269 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.876726+0000 mon.c (mon.1) 2898 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.878029+0000 mgr.gibba043.dnkmem (mgr.34373) 11270 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.878065+0000 mgr.gibba043.dnkmem (mgr.34373) 11271 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:59.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.879285+0000 mgr.gibba043.dnkmem (mgr.34373) 11272 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:59.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.879617+0000 mgr.gibba043.dnkmem (mgr.34373) 11273 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:59.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.880139+0000 mon.c (mon.1) 2899 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.880463+0000 mgr.gibba043.dnkmem (mgr.34373) 11274 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:59.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.880498+0000 mgr.gibba043.dnkmem (mgr.34373) 11275 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:59.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: cephadm 2021-03-10T17:24:57.880600+0000 mgr.gibba043.dnkmem (mgr.34373) 11276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:59.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:58 gibba003 bash[32348]: audit 2021-03-10T17:24:57.881400+0000 mon.c (mon.1) 2900 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.659502+0000 mgr.gibba043.dnkmem (mgr.34373) 11261 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:24:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.659914+0000 mgr.gibba043.dnkmem (mgr.34373) 11262 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:24:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.868405+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:24:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.869736+0000 mgr.gibba043.dnkmem (mgr.34373) 11263 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.871492+0000 mgr.gibba043.dnkmem (mgr.34373) 11264 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.872045+0000 mon.c (mon.1) 2895 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.873068+0000 mgr.gibba043.dnkmem (mgr.34373) 11265 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.873103+0000 mgr.gibba043.dnkmem (mgr.34373) 11266 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:59.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.873575+0000 mon.c (mon.1) 2896 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.874716+0000 mgr.gibba043.dnkmem (mgr.34373) 11267 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.874751+0000 mgr.gibba043.dnkmem (mgr.34373) 11268 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.875175+0000 mon.c (mon.1) 2897 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.876223+0000 mgr.gibba043.dnkmem (mgr.34373) 11269 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:59.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.876726+0000 mon.c (mon.1) 2898 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.878029+0000 mgr.gibba043.dnkmem (mgr.34373) 11270 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.878065+0000 mgr.gibba043.dnkmem (mgr.34373) 11271 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.879285+0000 mgr.gibba043.dnkmem (mgr.34373) 11272 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:59.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.879617+0000 mgr.gibba043.dnkmem (mgr.34373) 11273 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.880139+0000 mon.c (mon.1) 2899 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.880463+0000 mgr.gibba043.dnkmem (mgr.34373) 11274 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.880498+0000 mgr.gibba043.dnkmem (mgr.34373) 11275 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: cephadm 2021-03-10T17:24:57.880600+0000 mgr.gibba043.dnkmem (mgr.34373) 11276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:24:59.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:58 gibba043 bash[24019]: audit 2021-03-10T17:24:57.881400+0000 mon.c (mon.1) 2900 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:00.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:24:59 gibba003 bash[31385]: cluster 2021-03-10T17:24:58.595455+0000 mgr.gibba043.dnkmem (mgr.34373) 11277 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:00.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:24:59 gibba003 bash[32348]: cluster 2021-03-10T17:24:58.595455+0000 mgr.gibba043.dnkmem (mgr.34373) 11277 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:00.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:24:59 gibba043 bash[24019]: cluster 2021-03-10T17:24:58.595455+0000 mgr.gibba043.dnkmem (mgr.34373) 11277 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:01 gibba003 bash[31385]: cluster 2021-03-10T17:25:00.597028+0000 mgr.gibba043.dnkmem (mgr.34373) 11278 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:02.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:01 gibba003 bash[32348]: cluster 2021-03-10T17:25:00.597028+0000 mgr.gibba043.dnkmem (mgr.34373) 11278 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:02.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:01 gibba043 bash[24019]: cluster 2021-03-10T17:25:00.597028+0000 mgr.gibba043.dnkmem (mgr.34373) 11278 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:03 gibba003 bash[31385]: cluster 2021-03-10T17:25:02.598417+0000 mgr.gibba043.dnkmem (mgr.34373) 11279 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:03 gibba003 bash[32348]: cluster 2021-03-10T17:25:02.598417+0000 mgr.gibba043.dnkmem (mgr.34373) 11279 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:04.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:03 gibba043 bash[24019]: cluster 2021-03-10T17:25:02.598417+0000 mgr.gibba043.dnkmem (mgr.34373) 11279 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.680 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:25:05.910 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:25:05.910 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:25:05.910 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:25:05.910 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:25:05.911 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:25:05.911 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:25:05.911 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:25:05.911 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:25:05.912 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:25:05.912 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:25:05.912 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:25:05.912 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:25:05.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:25:05.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:25:05.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:25:05.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:25:05.913 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:25:05.914 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:25:05.914 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:25:05.914 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:25:05.914 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:25:06.158 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:25:06.159 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:25:06.159 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:06.159 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:25:06.160 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:25:06.160 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:06.160 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:25:06.160 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:25:06.160 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:25:06.161 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:25:06.161 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:25:06.161 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:25:06.161 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:25:06.162 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:25:06.162 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:25:06.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:05 gibba003 bash[31385]: cluster 2021-03-10T17:25:04.598977+0000 mgr.gibba043.dnkmem (mgr.34373) 11280 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:05 gibba003 bash[32348]: cluster 2021-03-10T17:25:04.598977+0000 mgr.gibba043.dnkmem (mgr.34373) 11280 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:06.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:05 gibba043 bash[24019]: cluster 2021-03-10T17:25:04.598977+0000 mgr.gibba043.dnkmem (mgr.34373) 11280 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:06 gibba003 bash[31385]: audit 2021-03-10T17:25:05.670035+0000 mgr.gibba043.dnkmem (mgr.34373) 11281 : audit [DBG] from='client.61600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:06 gibba003 bash[31385]: audit 2021-03-10T17:25:05.899161+0000 mgr.gibba043.dnkmem (mgr.34373) 11282 : audit [DBG] from='client.51615 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:07.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:06 gibba003 bash[31385]: audit 2021-03-10T17:25:06.159016+0000 mon.a (mon.0) 2249 : audit [DBG] from='client.? 172.21.2.103:0/3281989281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:06 gibba003 bash[32348]: audit 2021-03-10T17:25:05.670035+0000 mgr.gibba043.dnkmem (mgr.34373) 11281 : audit [DBG] from='client.61600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:06 gibba003 bash[32348]: audit 2021-03-10T17:25:05.899161+0000 mgr.gibba043.dnkmem (mgr.34373) 11282 : audit [DBG] from='client.51615 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:07.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:06 gibba003 bash[32348]: audit 2021-03-10T17:25:06.159016+0000 mon.a (mon.0) 2249 : audit [DBG] from='client.? 172.21.2.103:0/3281989281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:06 gibba043 bash[24019]: audit 2021-03-10T17:25:05.670035+0000 mgr.gibba043.dnkmem (mgr.34373) 11281 : audit [DBG] from='client.61600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:07.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:06 gibba043 bash[24019]: audit 2021-03-10T17:25:05.899161+0000 mgr.gibba043.dnkmem (mgr.34373) 11282 : audit [DBG] from='client.51615 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:06 gibba043 bash[24019]: audit 2021-03-10T17:25:06.159016+0000 mon.a (mon.0) 2249 : audit [DBG] from='client.? 172.21.2.103:0/3281989281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:07 gibba003 bash[31385]: cluster 2021-03-10T17:25:06.600732+0000 mgr.gibba043.dnkmem (mgr.34373) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:07 gibba003 bash[32348]: cluster 2021-03-10T17:25:06.600732+0000 mgr.gibba043.dnkmem (mgr.34373) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:08.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:07 gibba043 bash[24019]: cluster 2021-03-10T17:25:06.600732+0000 mgr.gibba043.dnkmem (mgr.34373) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:09 gibba043 bash[24019]: cluster 2021-03-10T17:25:08.602099+0000 mgr.gibba043.dnkmem (mgr.34373) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:09 gibba003 bash[31385]: cluster 2021-03-10T17:25:08.602099+0000 mgr.gibba043.dnkmem (mgr.34373) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:09 gibba003 bash[32348]: cluster 2021-03-10T17:25:08.602099+0000 mgr.gibba043.dnkmem (mgr.34373) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:11 gibba003 bash[31385]: cluster 2021-03-10T17:25:10.603565+0000 mgr.gibba043.dnkmem (mgr.34373) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:11 gibba003 bash[32348]: cluster 2021-03-10T17:25:10.603565+0000 mgr.gibba043.dnkmem (mgr.34373) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:11 gibba043 bash[24019]: cluster 2021-03-10T17:25:10.603565+0000 mgr.gibba043.dnkmem (mgr.34373) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:13 gibba003 bash[31385]: cluster 2021-03-10T17:25:12.605309+0000 mgr.gibba043.dnkmem (mgr.34373) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:13 gibba003 bash[31385]: cephadm 2021-03-10T17:25:12.896590+0000 mgr.gibba043.dnkmem (mgr.34373) 11287 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:13.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:13 gibba003 bash[32348]: cluster 2021-03-10T17:25:12.605309+0000 mgr.gibba043.dnkmem (mgr.34373) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:13 gibba003 bash[32348]: cephadm 2021-03-10T17:25:12.896590+0000 mgr.gibba043.dnkmem (mgr.34373) 11287 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:14.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:13 gibba043 bash[24019]: cluster 2021-03-10T17:25:12.605309+0000 mgr.gibba043.dnkmem (mgr.34373) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:13 gibba043 bash[24019]: cephadm 2021-03-10T17:25:12.896590+0000 mgr.gibba043.dnkmem (mgr.34373) 11287 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:14.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[31385]: audit 2021-03-10T17:25:14.102240+0000 mon.c (mon.1) 2901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[31385]: audit 2021-03-10T17:25:14.103352+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[31385]: audit 2021-03-10T17:25:14.343884+0000 mon.c (mon.1) 2902 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:14.941 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[31385]: audit 2021-03-10T17:25:14.345007+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[32348]: audit 2021-03-10T17:25:14.102240+0000 mon.c (mon.1) 2901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[32348]: audit 2021-03-10T17:25:14.103352+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[32348]: audit 2021-03-10T17:25:14.343884+0000 mon.c (mon.1) 2902 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:14.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:14 gibba003 bash[32348]: audit 2021-03-10T17:25:14.345007+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:15.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:14 gibba043 bash[24019]: audit 2021-03-10T17:25:14.102240+0000 mon.c (mon.1) 2901 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:14 gibba043 bash[24019]: audit 2021-03-10T17:25:14.103352+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:14 gibba043 bash[24019]: audit 2021-03-10T17:25:14.343884+0000 mon.c (mon.1) 2902 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:15.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:14 gibba043 bash[24019]: audit 2021-03-10T17:25:14.345007+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: cluster 2021-03-10T17:25:14.605881+0000 mgr.gibba043.dnkmem (mgr.34373) 11288 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.695453+0000 mon.c (mon.1) 2903 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:25:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.695606+0000 mon.c (mon.1) 2904 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:25:16.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.695738+0000 mon.c (mon.1) 2905 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.695893+0000 mon.c (mon.1) 2906 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.695925+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:25:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.696157+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:25:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.696305+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:15 gibba043 bash[24019]: audit 2021-03-10T17:25:14.696455+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: cluster 2021-03-10T17:25:14.605881+0000 mgr.gibba043.dnkmem (mgr.34373) 11288 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.695453+0000 mon.c (mon.1) 2903 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:25:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.695606+0000 mon.c (mon.1) 2904 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:25:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.695738+0000 mon.c (mon.1) 2905 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.695893+0000 mon.c (mon.1) 2906 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.695925+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:25:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.696157+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:25:16.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.696305+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[31385]: audit 2021-03-10T17:25:14.696455+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: cluster 2021-03-10T17:25:14.605881+0000 mgr.gibba043.dnkmem (mgr.34373) 11288 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:16.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.695453+0000 mon.c (mon.1) 2903 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:25:16.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.695606+0000 mon.c (mon.1) 2904 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:25:16.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.695738+0000 mon.c (mon.1) 2905 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.695893+0000 mon.c (mon.1) 2906 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.695925+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:25:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.696157+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:25:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.696305+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:25:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:15 gibba003 bash[32348]: audit 2021-03-10T17:25:14.696455+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:25:18.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:17 gibba043 bash[24019]: cluster 2021-03-10T17:25:16.607592+0000 mgr.gibba043.dnkmem (mgr.34373) 11289 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:17 gibba003 bash[31385]: cluster 2021-03-10T17:25:16.607592+0000 mgr.gibba043.dnkmem (mgr.34373) 11289 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:17 gibba003 bash[32348]: cluster 2021-03-10T17:25:16.607592+0000 mgr.gibba043.dnkmem (mgr.34373) 11289 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:19 gibba003 bash[31385]: cluster 2021-03-10T17:25:18.609050+0000 mgr.gibba043.dnkmem (mgr.34373) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:19 gibba003 bash[32348]: cluster 2021-03-10T17:25:18.609050+0000 mgr.gibba043.dnkmem (mgr.34373) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:19 gibba043 bash[24019]: cluster 2021-03-10T17:25:18.609050+0000 mgr.gibba043.dnkmem (mgr.34373) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:21 gibba003 bash[31385]: cluster 2021-03-10T17:25:20.610552+0000 mgr.gibba043.dnkmem (mgr.34373) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:21 gibba003 bash[32348]: cluster 2021-03-10T17:25:20.610552+0000 mgr.gibba043.dnkmem (mgr.34373) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:22.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:21 gibba043 bash[24019]: cluster 2021-03-10T17:25:20.610552+0000 mgr.gibba043.dnkmem (mgr.34373) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:23.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:23 gibba003 bash[31385]: cluster 2021-03-10T17:25:22.612306+0000 mgr.gibba043.dnkmem (mgr.34373) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:23.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:23 gibba003 bash[32348]: cluster 2021-03-10T17:25:22.612306+0000 mgr.gibba043.dnkmem (mgr.34373) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:24.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:23 gibba043 bash[24019]: cluster 2021-03-10T17:25:22.612306+0000 mgr.gibba043.dnkmem (mgr.34373) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:25 gibba043 bash[24019]: cluster 2021-03-10T17:25:24.613949+0000 mgr.gibba043.dnkmem (mgr.34373) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:26.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:25 gibba003 bash[31385]: cluster 2021-03-10T17:25:24.613949+0000 mgr.gibba043.dnkmem (mgr.34373) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:26.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:25 gibba003 bash[32348]: cluster 2021-03-10T17:25:24.613949+0000 mgr.gibba043.dnkmem (mgr.34373) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:28.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:27 gibba043 bash[24019]: cluster 2021-03-10T17:25:26.615985+0000 mgr.gibba043.dnkmem (mgr.34373) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:27 gibba003 bash[31385]: cluster 2021-03-10T17:25:26.615985+0000 mgr.gibba043.dnkmem (mgr.34373) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:27 gibba003 bash[32348]: cluster 2021-03-10T17:25:26.615985+0000 mgr.gibba043.dnkmem (mgr.34373) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:28 gibba043 bash[24019]: cephadm 2021-03-10T17:25:27.912280+0000 mgr.gibba043.dnkmem (mgr.34373) 11295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:29.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:28 gibba003 bash[31385]: cephadm 2021-03-10T17:25:27.912280+0000 mgr.gibba043.dnkmem (mgr.34373) 11295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:29.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:28 gibba003 bash[32348]: cephadm 2021-03-10T17:25:27.912280+0000 mgr.gibba043.dnkmem (mgr.34373) 11295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:30.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:29 gibba043 bash[24019]: cluster 2021-03-10T17:25:28.617648+0000 mgr.gibba043.dnkmem (mgr.34373) 11296 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:30.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:29 gibba003 bash[31385]: cluster 2021-03-10T17:25:28.617648+0000 mgr.gibba043.dnkmem (mgr.34373) 11296 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:30.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:29 gibba003 bash[32348]: cluster 2021-03-10T17:25:28.617648+0000 mgr.gibba043.dnkmem (mgr.34373) 11296 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:32.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:31 gibba043 bash[24019]: cluster 2021-03-10T17:25:30.619070+0000 mgr.gibba043.dnkmem (mgr.34373) 11297 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:32.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:31 gibba003 bash[31385]: cluster 2021-03-10T17:25:30.619070+0000 mgr.gibba043.dnkmem (mgr.34373) 11297 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:31 gibba003 bash[32348]: cluster 2021-03-10T17:25:30.619070+0000 mgr.gibba043.dnkmem (mgr.34373) 11297 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:33 gibba043 bash[24019]: cluster 2021-03-10T17:25:32.620606+0000 mgr.gibba043.dnkmem (mgr.34373) 11298 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:34.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:33 gibba003 bash[31385]: cluster 2021-03-10T17:25:32.620606+0000 mgr.gibba043.dnkmem (mgr.34373) 11298 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:34.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:33 gibba003 bash[32348]: cluster 2021-03-10T17:25:32.620606+0000 mgr.gibba043.dnkmem (mgr.34373) 11298 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:36.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:35 gibba043 bash[24019]: cluster 2021-03-10T17:25:34.622108+0000 mgr.gibba043.dnkmem (mgr.34373) 11299 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:36.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:35 gibba003 bash[31385]: cluster 2021-03-10T17:25:34.622108+0000 mgr.gibba043.dnkmem (mgr.34373) 11299 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:36.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:35 gibba003 bash[32348]: cluster 2021-03-10T17:25:34.622108+0000 mgr.gibba043.dnkmem (mgr.34373) 11299 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:36.402 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:25:36.630 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:25:36.631 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:25:36.631 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:25:36.631 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:25:36.631 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:25:36.632 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:25:36.632 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:25:36.632 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:25:36.632 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:25:36.632 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:25:36.633 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:25:36.633 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:25:36.633 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:25:36.633 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:25:36.634 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:25:36.634 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:25:36.634 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:25:36.634 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:25:36.634 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:25:36.635 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:25:36.635 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:25:36.885 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:25:36.886 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:25:36.886 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:36.886 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:25:36.886 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:25:36.887 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:36.887 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:25:36.887 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:25:36.887 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:25:36.888 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:25:36.888 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:25:36.888 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:25:36.888 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:25:36.888 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:25:36.889 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:25:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:37 gibba043 bash[24019]: audit 2021-03-10T17:25:36.391100+0000 mgr.gibba043.dnkmem (mgr.34373) 11300 : audit [DBG] from='client.61618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:37 gibba043 bash[24019]: audit 2021-03-10T17:25:36.616914+0000 mgr.gibba043.dnkmem (mgr.34373) 11301 : audit [DBG] from='client.51633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:37 gibba043 bash[24019]: cluster 2021-03-10T17:25:36.623108+0000 mgr.gibba043.dnkmem (mgr.34373) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:37 gibba043 bash[24019]: audit 2021-03-10T17:25:36.884336+0000 mon.c (mon.1) 2907 : audit [DBG] from='client.? 172.21.2.103:0/2075738294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[31385]: audit 2021-03-10T17:25:36.391100+0000 mgr.gibba043.dnkmem (mgr.34373) 11300 : audit [DBG] from='client.61618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[31385]: audit 2021-03-10T17:25:36.616914+0000 mgr.gibba043.dnkmem (mgr.34373) 11301 : audit [DBG] from='client.51633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[31385]: cluster 2021-03-10T17:25:36.623108+0000 mgr.gibba043.dnkmem (mgr.34373) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[31385]: audit 2021-03-10T17:25:36.884336+0000 mon.c (mon.1) 2907 : audit [DBG] from='client.? 172.21.2.103:0/2075738294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:38.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[32348]: audit 2021-03-10T17:25:36.391100+0000 mgr.gibba043.dnkmem (mgr.34373) 11300 : audit [DBG] from='client.61618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:38.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[32348]: audit 2021-03-10T17:25:36.616914+0000 mgr.gibba043.dnkmem (mgr.34373) 11301 : audit [DBG] from='client.51633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:38.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[32348]: cluster 2021-03-10T17:25:36.623108+0000 mgr.gibba043.dnkmem (mgr.34373) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:38.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:37 gibba003 bash[32348]: audit 2021-03-10T17:25:36.884336+0000 mon.c (mon.1) 2907 : audit [DBG] from='client.? 172.21.2.103:0/2075738294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:39 gibba003 bash[31385]: cluster 2021-03-10T17:25:38.624717+0000 mgr.gibba043.dnkmem (mgr.34373) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:39 gibba003 bash[32348]: cluster 2021-03-10T17:25:38.624717+0000 mgr.gibba043.dnkmem (mgr.34373) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:39 gibba043 bash[24019]: cluster 2021-03-10T17:25:38.624717+0000 mgr.gibba043.dnkmem (mgr.34373) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.940 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:41 gibba003 bash[31385]: cluster 2021-03-10T17:25:40.626295+0000 mgr.gibba043.dnkmem (mgr.34373) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.941 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:41 gibba003 bash[32348]: cluster 2021-03-10T17:25:40.626295+0000 mgr.gibba043.dnkmem (mgr.34373) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:41 gibba043 bash[24019]: cluster 2021-03-10T17:25:40.626295+0000 mgr.gibba043.dnkmem (mgr.34373) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:44.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:43 gibba043 bash[24019]: cluster 2021-03-10T17:25:42.628094+0000 mgr.gibba043.dnkmem (mgr.34373) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:44.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:43 gibba043 bash[24019]: cephadm 2021-03-10T17:25:42.919610+0000 mgr.gibba043.dnkmem (mgr.34373) 11306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:43 gibba003 bash[31385]: cluster 2021-03-10T17:25:42.628094+0000 mgr.gibba043.dnkmem (mgr.34373) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:43 gibba003 bash[31385]: cephadm 2021-03-10T17:25:42.919610+0000 mgr.gibba043.dnkmem (mgr.34373) 11306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:43 gibba003 bash[32348]: cluster 2021-03-10T17:25:42.628094+0000 mgr.gibba043.dnkmem (mgr.34373) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:44.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:43 gibba003 bash[32348]: cephadm 2021-03-10T17:25:42.919610+0000 mgr.gibba043.dnkmem (mgr.34373) 11306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:25:46.031 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:45 gibba043 bash[24019]: cluster 2021-03-10T17:25:44.629070+0000 mgr.gibba043.dnkmem (mgr.34373) 11307 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:46.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:45 gibba003 bash[31385]: cluster 2021-03-10T17:25:44.629070+0000 mgr.gibba043.dnkmem (mgr.34373) 11307 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:45 gibba003 bash[32348]: cluster 2021-03-10T17:25:44.629070+0000 mgr.gibba043.dnkmem (mgr.34373) 11307 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:48.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:47 gibba043 bash[24019]: cluster 2021-03-10T17:25:46.630654+0000 mgr.gibba043.dnkmem (mgr.34373) 11308 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:48.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:47 gibba003 bash[31385]: cluster 2021-03-10T17:25:46.630654+0000 mgr.gibba043.dnkmem (mgr.34373) 11308 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:47 gibba003 bash[32348]: cluster 2021-03-10T17:25:46.630654+0000 mgr.gibba043.dnkmem (mgr.34373) 11308 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:49 gibba003 bash[31385]: cluster 2021-03-10T17:25:48.632046+0000 mgr.gibba043.dnkmem (mgr.34373) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:49 gibba003 bash[32348]: cluster 2021-03-10T17:25:48.632046+0000 mgr.gibba043.dnkmem (mgr.34373) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:49 gibba043 bash[24019]: cluster 2021-03-10T17:25:48.632046+0000 mgr.gibba043.dnkmem (mgr.34373) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:51 gibba043 bash[24019]: cluster 2021-03-10T17:25:50.633449+0000 mgr.gibba043.dnkmem (mgr.34373) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:52.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:51 gibba003 bash[31385]: cluster 2021-03-10T17:25:50.633449+0000 mgr.gibba043.dnkmem (mgr.34373) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:51 gibba003 bash[32348]: cluster 2021-03-10T17:25:50.633449+0000 mgr.gibba043.dnkmem (mgr.34373) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:54.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:53 gibba043 bash[24019]: cluster 2021-03-10T17:25:52.635181+0000 mgr.gibba043.dnkmem (mgr.34373) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:54.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:53 gibba003 bash[31385]: cluster 2021-03-10T17:25:52.635181+0000 mgr.gibba043.dnkmem (mgr.34373) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:53 gibba003 bash[32348]: cluster 2021-03-10T17:25:52.635181+0000 mgr.gibba043.dnkmem (mgr.34373) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:56.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:55 gibba043 bash[24019]: cluster 2021-03-10T17:25:54.635966+0000 mgr.gibba043.dnkmem (mgr.34373) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:55 gibba003 bash[31385]: cluster 2021-03-10T17:25:54.635966+0000 mgr.gibba043.dnkmem (mgr.34373) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:55 gibba003 bash[32348]: cluster 2021-03-10T17:25:54.635966+0000 mgr.gibba043.dnkmem (mgr.34373) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:57 gibba043 bash[24019]: cluster 2021-03-10T17:25:56.637562+0000 mgr.gibba043.dnkmem (mgr.34373) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:58.190 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:57 gibba003 bash[32348]: cluster 2021-03-10T17:25:56.637562+0000 mgr.gibba043.dnkmem (mgr.34373) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:57 gibba003 bash[31385]: cluster 2021-03-10T17:25:56.637562+0000 mgr.gibba043.dnkmem (mgr.34373) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: cephadm 2021-03-10T17:25:57.933225+0000 mgr.gibba043.dnkmem (mgr.34373) 11314 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:25:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: cephadm 2021-03-10T17:25:57.934751+0000 mgr.gibba043.dnkmem (mgr.34373) 11315 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:25:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.162689+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:25:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.166175+0000 mon.c (mon.1) 2908 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.167701+0000 mon.c (mon.1) 2909 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.169431+0000 mon.c (mon.1) 2910 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.171091+0000 mon.c (mon.1) 2911 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.174880+0000 mon.c (mon.1) 2912 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:58 gibba043 bash[24019]: audit 2021-03-10T17:25:58.176450+0000 mon.c (mon.1) 2913 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: cephadm 2021-03-10T17:25:57.933225+0000 mgr.gibba043.dnkmem (mgr.34373) 11314 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:25:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: cephadm 2021-03-10T17:25:57.934751+0000 mgr.gibba043.dnkmem (mgr.34373) 11315 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:25:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.162689+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:25:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.166175+0000 mon.c (mon.1) 2908 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.167701+0000 mon.c (mon.1) 2909 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.169431+0000 mon.c (mon.1) 2910 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.171091+0000 mon.c (mon.1) 2911 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.174880+0000 mon.c (mon.1) 2912 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[31385]: audit 2021-03-10T17:25:58.176450+0000 mon.c (mon.1) 2913 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: cephadm 2021-03-10T17:25:57.933225+0000 mgr.gibba043.dnkmem (mgr.34373) 11314 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:25:59.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: cephadm 2021-03-10T17:25:57.934751+0000 mgr.gibba043.dnkmem (mgr.34373) 11315 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:25:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.162689+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:25:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.166175+0000 mon.c (mon.1) 2908 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.167701+0000 mon.c (mon.1) 2909 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.169431+0000 mon.c (mon.1) 2910 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.171091+0000 mon.c (mon.1) 2911 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.174880+0000 mon.c (mon.1) 2912 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:59.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:58 gibba003 bash[32348]: audit 2021-03-10T17:25:58.176450+0000 mon.c (mon.1) 2913 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:00.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.163949+0000 mgr.gibba043.dnkmem (mgr.34373) 11316 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:00.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.165612+0000 mgr.gibba043.dnkmem (mgr.34373) 11317 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.167259+0000 mgr.gibba043.dnkmem (mgr.34373) 11318 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.167334+0000 mgr.gibba043.dnkmem (mgr.34373) 11319 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.168934+0000 mgr.gibba043.dnkmem (mgr.34373) 11320 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.169010+0000 mgr.gibba043.dnkmem (mgr.34373) 11321 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:00.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.170678+0000 mgr.gibba043.dnkmem (mgr.34373) 11322 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:00.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.172708+0000 mgr.gibba043.dnkmem (mgr.34373) 11323 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:00.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.172746+0000 mgr.gibba043.dnkmem (mgr.34373) 11324 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:00.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.174175+0000 mgr.gibba043.dnkmem (mgr.34373) 11325 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:00.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.174490+0000 mgr.gibba043.dnkmem (mgr.34373) 11326 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:00.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.175908+0000 mgr.gibba043.dnkmem (mgr.34373) 11327 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:00.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.175944+0000 mgr.gibba043.dnkmem (mgr.34373) 11328 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:00.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cephadm 2021-03-10T17:25:58.176048+0000 mgr.gibba043.dnkmem (mgr.34373) 11329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:00.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:25:59 gibba043 bash[24019]: cluster 2021-03-10T17:25:58.638939+0000 mgr.gibba043.dnkmem (mgr.34373) 11330 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.163949+0000 mgr.gibba043.dnkmem (mgr.34373) 11316 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:00.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.165612+0000 mgr.gibba043.dnkmem (mgr.34373) 11317 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.167259+0000 mgr.gibba043.dnkmem (mgr.34373) 11318 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.167334+0000 mgr.gibba043.dnkmem (mgr.34373) 11319 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.168934+0000 mgr.gibba043.dnkmem (mgr.34373) 11320 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.169010+0000 mgr.gibba043.dnkmem (mgr.34373) 11321 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:00.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.170678+0000 mgr.gibba043.dnkmem (mgr.34373) 11322 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.172708+0000 mgr.gibba043.dnkmem (mgr.34373) 11323 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.172746+0000 mgr.gibba043.dnkmem (mgr.34373) 11324 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.174175+0000 mgr.gibba043.dnkmem (mgr.34373) 11325 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:00.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.174490+0000 mgr.gibba043.dnkmem (mgr.34373) 11326 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.175908+0000 mgr.gibba043.dnkmem (mgr.34373) 11327 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.175944+0000 mgr.gibba043.dnkmem (mgr.34373) 11328 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cephadm 2021-03-10T17:25:58.176048+0000 mgr.gibba043.dnkmem (mgr.34373) 11329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:00.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[31385]: cluster 2021-03-10T17:25:58.638939+0000 mgr.gibba043.dnkmem (mgr.34373) 11330 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:00.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.163949+0000 mgr.gibba043.dnkmem (mgr.34373) 11316 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.165612+0000 mgr.gibba043.dnkmem (mgr.34373) 11317 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:00.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.167259+0000 mgr.gibba043.dnkmem (mgr.34373) 11318 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.167334+0000 mgr.gibba043.dnkmem (mgr.34373) 11319 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.168934+0000 mgr.gibba043.dnkmem (mgr.34373) 11320 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.169010+0000 mgr.gibba043.dnkmem (mgr.34373) 11321 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:00.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.170678+0000 mgr.gibba043.dnkmem (mgr.34373) 11322 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.172708+0000 mgr.gibba043.dnkmem (mgr.34373) 11323 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.172746+0000 mgr.gibba043.dnkmem (mgr.34373) 11324 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:00.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.174175+0000 mgr.gibba043.dnkmem (mgr.34373) 11325 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:00.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.174490+0000 mgr.gibba043.dnkmem (mgr.34373) 11326 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:00.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.175908+0000 mgr.gibba043.dnkmem (mgr.34373) 11327 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:00.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.175944+0000 mgr.gibba043.dnkmem (mgr.34373) 11328 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:00.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cephadm 2021-03-10T17:25:58.176048+0000 mgr.gibba043.dnkmem (mgr.34373) 11329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:00.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:25:59 gibba003 bash[32348]: cluster 2021-03-10T17:25:58.638939+0000 mgr.gibba043.dnkmem (mgr.34373) 11330 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:02.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:01 gibba043 bash[24019]: cluster 2021-03-10T17:26:00.639587+0000 mgr.gibba043.dnkmem (mgr.34373) 11331 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:01 gibba003 bash[31385]: cluster 2021-03-10T17:26:00.639587+0000 mgr.gibba043.dnkmem (mgr.34373) 11331 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:02.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:01 gibba003 bash[32348]: cluster 2021-03-10T17:26:00.639587+0000 mgr.gibba043.dnkmem (mgr.34373) 11331 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:04.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:03 gibba043 bash[24019]: cluster 2021-03-10T17:26:02.641069+0000 mgr.gibba043.dnkmem (mgr.34373) 11332 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:04.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:03 gibba003 bash[31385]: cluster 2021-03-10T17:26:02.641069+0000 mgr.gibba043.dnkmem (mgr.34373) 11332 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:04.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:03 gibba003 bash[32348]: cluster 2021-03-10T17:26:02.641069+0000 mgr.gibba043.dnkmem (mgr.34373) 11332 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:06.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:05 gibba043 bash[24019]: cluster 2021-03-10T17:26:04.642699+0000 mgr.gibba043.dnkmem (mgr.34373) 11333 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:05 gibba003 bash[31385]: cluster 2021-03-10T17:26:04.642699+0000 mgr.gibba043.dnkmem (mgr.34373) 11333 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:06.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:05 gibba003 bash[32348]: cluster 2021-03-10T17:26:04.642699+0000 mgr.gibba043.dnkmem (mgr.34373) 11333 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:07.125 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:26:07.357 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:26:07.357 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:26:07.358 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:26:07.358 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:26:07.358 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:26:07.358 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:26:07.359 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:26:07.359 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:26:07.359 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:26:07.359 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:26:07.360 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:26:07.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:26:07.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:26:07.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:26:07.360 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:26:07.361 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:26:07.361 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:26:07.361 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:26:07.361 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:26:07.362 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:26:07.362 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:26:07.608 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:26:07.608 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:26:07.609 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:07.609 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:26:07.609 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:26:07.609 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:07.610 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:26:07.610 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:26:07.610 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:26:07.610 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:26:07.610 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:26:07.611 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:26:07.611 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:26:07.611 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:26:07.611 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:26:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:07 gibba043 bash[24019]: cluster 2021-03-10T17:26:06.643529+0000 mgr.gibba043.dnkmem (mgr.34373) 11334 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:07 gibba043 bash[24019]: audit 2021-03-10T17:26:07.608523+0000 mon.c (mon.1) 2914 : audit [DBG] from='client.? 172.21.2.103:0/1169364586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:07 gibba003 bash[31385]: cluster 2021-03-10T17:26:06.643529+0000 mgr.gibba043.dnkmem (mgr.34373) 11334 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:07 gibba003 bash[31385]: audit 2021-03-10T17:26:07.608523+0000 mon.c (mon.1) 2914 : audit [DBG] from='client.? 172.21.2.103:0/1169364586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:07 gibba003 bash[32348]: cluster 2021-03-10T17:26:06.643529+0000 mgr.gibba043.dnkmem (mgr.34373) 11334 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:08.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:07 gibba003 bash[32348]: audit 2021-03-10T17:26:07.608523+0000 mon.c (mon.1) 2914 : audit [DBG] from='client.? 172.21.2.103:0/1169364586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:08 gibba003 bash[31385]: audit 2021-03-10T17:26:07.115547+0000 mgr.gibba043.dnkmem (mgr.34373) 11335 : audit [DBG] from='client.51645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:09.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:08 gibba003 bash[31385]: audit 2021-03-10T17:26:07.343942+0000 mgr.gibba043.dnkmem (mgr.34373) 11336 : audit [DBG] from='client.61642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:09.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:08 gibba003 bash[32348]: audit 2021-03-10T17:26:07.115547+0000 mgr.gibba043.dnkmem (mgr.34373) 11335 : audit [DBG] from='client.51645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:09.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:08 gibba003 bash[32348]: audit 2021-03-10T17:26:07.343942+0000 mgr.gibba043.dnkmem (mgr.34373) 11336 : audit [DBG] from='client.61642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:09.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:08 gibba043 bash[24019]: audit 2021-03-10T17:26:07.115547+0000 mgr.gibba043.dnkmem (mgr.34373) 11335 : audit [DBG] from='client.51645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:08 gibba043 bash[24019]: audit 2021-03-10T17:26:07.343942+0000 mgr.gibba043.dnkmem (mgr.34373) 11336 : audit [DBG] from='client.61642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:10.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:09 gibba003 bash[31385]: cluster 2021-03-10T17:26:08.644999+0000 mgr.gibba043.dnkmem (mgr.34373) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:10.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:09 gibba003 bash[32348]: cluster 2021-03-10T17:26:08.644999+0000 mgr.gibba043.dnkmem (mgr.34373) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:10.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:09 gibba043 bash[24019]: cluster 2021-03-10T17:26:08.644999+0000 mgr.gibba043.dnkmem (mgr.34373) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:11 gibba003 bash[31385]: cluster 2021-03-10T17:26:10.646708+0000 mgr.gibba043.dnkmem (mgr.34373) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:12.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:11 gibba003 bash[32348]: cluster 2021-03-10T17:26:10.646708+0000 mgr.gibba043.dnkmem (mgr.34373) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:12.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:11 gibba043 bash[24019]: cluster 2021-03-10T17:26:10.646708+0000 mgr.gibba043.dnkmem (mgr.34373) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:14.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:13 gibba003 bash[31385]: cluster 2021-03-10T17:26:12.647529+0000 mgr.gibba043.dnkmem (mgr.34373) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:13 gibba003 bash[32348]: cluster 2021-03-10T17:26:12.647529+0000 mgr.gibba043.dnkmem (mgr.34373) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:13 gibba043 bash[24019]: cluster 2021-03-10T17:26:12.647529+0000 mgr.gibba043.dnkmem (mgr.34373) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: cephadm 2021-03-10T17:26:13.192171+0000 mgr.gibba043.dnkmem (mgr.34373) 11340 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.108410+0000 mon.c (mon.1) 2915 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.109526+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.351661+0000 mon.c (mon.1) 2916 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.352802+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.703323+0000 mon.c (mon.1) 2917 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:26:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.704097+0000 mon.c (mon.1) 2918 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.704554+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:26:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.705130+0000 mon.c (mon.1) 2919 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:26:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.705769+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.706518+0000 mon.c (mon.1) 2920 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.706699+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:26:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[31385]: audit 2021-03-10T17:26:14.707752+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: cephadm 2021-03-10T17:26:13.192171+0000 mgr.gibba043.dnkmem (mgr.34373) 11340 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.108410+0000 mon.c (mon.1) 2915 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.109526+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.351661+0000 mon.c (mon.1) 2916 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.352802+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.703323+0000 mon.c (mon.1) 2917 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:26:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.704097+0000 mon.c (mon.1) 2918 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.704554+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:26:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.705130+0000 mon.c (mon.1) 2919 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:26:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.705769+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.706518+0000 mon.c (mon.1) 2920 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.706699+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:26:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:14 gibba003 bash[32348]: audit 2021-03-10T17:26:14.707752+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: cephadm 2021-03-10T17:26:13.192171+0000 mgr.gibba043.dnkmem (mgr.34373) 11340 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.108410+0000 mon.c (mon.1) 2915 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.109526+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.351661+0000 mon.c (mon.1) 2916 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.352802+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.703323+0000 mon.c (mon.1) 2917 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:26:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.704097+0000 mon.c (mon.1) 2918 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.704554+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:26:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.705130+0000 mon.c (mon.1) 2919 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:26:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.705769+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.706518+0000 mon.c (mon.1) 2920 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:26:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.706699+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:26:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:14 gibba043 bash[24019]: audit 2021-03-10T17:26:14.707752+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:26:16.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:15 gibba003 bash[31385]: cluster 2021-03-10T17:26:14.648934+0000 mgr.gibba043.dnkmem (mgr.34373) 11341 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:15 gibba003 bash[32348]: cluster 2021-03-10T17:26:14.648934+0000 mgr.gibba043.dnkmem (mgr.34373) 11341 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:15 gibba043 bash[24019]: cluster 2021-03-10T17:26:14.648934+0000 mgr.gibba043.dnkmem (mgr.34373) 11341 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:17 gibba003 bash[31385]: cluster 2021-03-10T17:26:16.650898+0000 mgr.gibba043.dnkmem (mgr.34373) 11342 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:17 gibba003 bash[32348]: cluster 2021-03-10T17:26:16.650898+0000 mgr.gibba043.dnkmem (mgr.34373) 11342 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:17 gibba043 bash[24019]: cluster 2021-03-10T17:26:16.650898+0000 mgr.gibba043.dnkmem (mgr.34373) 11342 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:19 gibba003 bash[31385]: cluster 2021-03-10T17:26:18.651798+0000 mgr.gibba043.dnkmem (mgr.34373) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:19 gibba003 bash[32348]: cluster 2021-03-10T17:26:18.651798+0000 mgr.gibba043.dnkmem (mgr.34373) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:19 gibba043 bash[24019]: cluster 2021-03-10T17:26:18.651798+0000 mgr.gibba043.dnkmem (mgr.34373) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:21 gibba043 bash[24019]: cluster 2021-03-10T17:26:20.653387+0000 mgr.gibba043.dnkmem (mgr.34373) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:21 gibba003 bash[31385]: cluster 2021-03-10T17:26:20.653387+0000 mgr.gibba043.dnkmem (mgr.34373) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:21 gibba003 bash[32348]: cluster 2021-03-10T17:26:20.653387+0000 mgr.gibba043.dnkmem (mgr.34373) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:24.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:23 gibba043 bash[24019]: cluster 2021-03-10T17:26:22.655178+0000 mgr.gibba043.dnkmem (mgr.34373) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:23 gibba003 bash[31385]: cluster 2021-03-10T17:26:22.655178+0000 mgr.gibba043.dnkmem (mgr.34373) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:23 gibba003 bash[32348]: cluster 2021-03-10T17:26:22.655178+0000 mgr.gibba043.dnkmem (mgr.34373) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:26.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:25 gibba043 bash[24019]: cluster 2021-03-10T17:26:24.655817+0000 mgr.gibba043.dnkmem (mgr.34373) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:25 gibba003 bash[31385]: cluster 2021-03-10T17:26:24.655817+0000 mgr.gibba043.dnkmem (mgr.34373) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:25 gibba003 bash[32348]: cluster 2021-03-10T17:26:24.655817+0000 mgr.gibba043.dnkmem (mgr.34373) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:28.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:27 gibba043 bash[24019]: cluster 2021-03-10T17:26:26.657291+0000 mgr.gibba043.dnkmem (mgr.34373) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:28.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:27 gibba003 bash[31385]: cluster 2021-03-10T17:26:26.657291+0000 mgr.gibba043.dnkmem (mgr.34373) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:27 gibba003 bash[32348]: cluster 2021-03-10T17:26:26.657291+0000 mgr.gibba043.dnkmem (mgr.34373) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:29 gibba003 bash[31385]: cephadm 2021-03-10T17:26:28.204450+0000 mgr.gibba043.dnkmem (mgr.34373) 11348 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:29 gibba003 bash[31385]: cluster 2021-03-10T17:26:28.658980+0000 mgr.gibba043.dnkmem (mgr.34373) 11349 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:29 gibba003 bash[32348]: cephadm 2021-03-10T17:26:28.204450+0000 mgr.gibba043.dnkmem (mgr.34373) 11348 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:29 gibba003 bash[32348]: cluster 2021-03-10T17:26:28.658980+0000 mgr.gibba043.dnkmem (mgr.34373) 11349 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:29 gibba043 bash[24019]: cephadm 2021-03-10T17:26:28.204450+0000 mgr.gibba043.dnkmem (mgr.34373) 11348 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:29 gibba043 bash[24019]: cluster 2021-03-10T17:26:28.658980+0000 mgr.gibba043.dnkmem (mgr.34373) 11349 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:31 gibba043 bash[24019]: cluster 2021-03-10T17:26:30.659765+0000 mgr.gibba043.dnkmem (mgr.34373) 11350 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:31 gibba003 bash[31385]: cluster 2021-03-10T17:26:30.659765+0000 mgr.gibba043.dnkmem (mgr.34373) 11350 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:31 gibba003 bash[32348]: cluster 2021-03-10T17:26:30.659765+0000 mgr.gibba043.dnkmem (mgr.34373) 11350 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:34.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:33 gibba043 bash[24019]: cluster 2021-03-10T17:26:32.660991+0000 mgr.gibba043.dnkmem (mgr.34373) 11351 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:33 gibba003 bash[31385]: cluster 2021-03-10T17:26:32.660991+0000 mgr.gibba043.dnkmem (mgr.34373) 11351 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:33 gibba003 bash[32348]: cluster 2021-03-10T17:26:32.660991+0000 mgr.gibba043.dnkmem (mgr.34373) 11351 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:36.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:35 gibba043 bash[24019]: cluster 2021-03-10T17:26:34.662363+0000 mgr.gibba043.dnkmem (mgr.34373) 11352 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:35 gibba003 bash[31385]: cluster 2021-03-10T17:26:34.662363+0000 mgr.gibba043.dnkmem (mgr.34373) 11352 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:35 gibba003 bash[32348]: cluster 2021-03-10T17:26:34.662363+0000 mgr.gibba043.dnkmem (mgr.34373) 11352 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:37.853 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:26:38.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:37 gibba043 bash[24019]: cluster 2021-03-10T17:26:36.663208+0000 mgr.gibba043.dnkmem (mgr.34373) 11353 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:38.076 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:26:38.076 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:26:38.076 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:26:38.077 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:26:38.077 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:26:38.077 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:26:38.077 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:26:38.077 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:26:38.078 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:26:38.078 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:26:38.078 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:26:38.078 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:26:38.079 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:26:38.079 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:26:38.079 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:26:38.079 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:26:38.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:26:38.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:26:38.080 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:26:38.080 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:26:38.080 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:26:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:37 gibba003 bash[31385]: cluster 2021-03-10T17:26:36.663208+0000 mgr.gibba043.dnkmem (mgr.34373) 11353 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:37 gibba003 bash[32348]: cluster 2021-03-10T17:26:36.663208+0000 mgr.gibba043.dnkmem (mgr.34373) 11353 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:38.321 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:26:38.322 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:26:38.322 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:38.322 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:26:38.323 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:26:38.323 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:38.323 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:26:38.323 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:26:38.323 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:26:38.324 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:26:38.324 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:26:38.324 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:26:38.324 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:26:38.325 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:26:38.325 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:26:39.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:38 gibba043 bash[24019]: audit 2021-03-10T17:26:37.843057+0000 mgr.gibba043.dnkmem (mgr.34373) 11354 : audit [DBG] from='client.51663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:38 gibba043 bash[24019]: audit 2021-03-10T17:26:38.322100+0000 mon.a (mon.0) 2263 : audit [DBG] from='client.? 172.21.2.103:0/926483170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:38 gibba003 bash[31385]: audit 2021-03-10T17:26:37.843057+0000 mgr.gibba043.dnkmem (mgr.34373) 11354 : audit [DBG] from='client.51663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:39.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:38 gibba003 bash[31385]: audit 2021-03-10T17:26:38.322100+0000 mon.a (mon.0) 2263 : audit [DBG] from='client.? 172.21.2.103:0/926483170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:39.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:38 gibba003 bash[32348]: audit 2021-03-10T17:26:37.843057+0000 mgr.gibba043.dnkmem (mgr.34373) 11354 : audit [DBG] from='client.51663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:39.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:38 gibba003 bash[32348]: audit 2021-03-10T17:26:38.322100+0000 mon.a (mon.0) 2263 : audit [DBG] from='client.? 172.21.2.103:0/926483170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:40.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:39 gibba043 bash[24019]: audit 2021-03-10T17:26:38.066479+0000 mgr.gibba043.dnkmem (mgr.34373) 11355 : audit [DBG] from='client.51669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:40.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:39 gibba043 bash[24019]: cluster 2021-03-10T17:26:38.664770+0000 mgr.gibba043.dnkmem (mgr.34373) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:39 gibba003 bash[31385]: audit 2021-03-10T17:26:38.066479+0000 mgr.gibba043.dnkmem (mgr.34373) 11355 : audit [DBG] from='client.51669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:40.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:39 gibba003 bash[31385]: cluster 2021-03-10T17:26:38.664770+0000 mgr.gibba043.dnkmem (mgr.34373) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:40.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:39 gibba003 bash[32348]: audit 2021-03-10T17:26:38.066479+0000 mgr.gibba043.dnkmem (mgr.34373) 11355 : audit [DBG] from='client.51669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:40.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:39 gibba003 bash[32348]: cluster 2021-03-10T17:26:38.664770+0000 mgr.gibba043.dnkmem (mgr.34373) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:42.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:41 gibba043 bash[24019]: cluster 2021-03-10T17:26:40.666202+0000 mgr.gibba043.dnkmem (mgr.34373) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:41 gibba003 bash[31385]: cluster 2021-03-10T17:26:40.666202+0000 mgr.gibba043.dnkmem (mgr.34373) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:42.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:41 gibba003 bash[32348]: cluster 2021-03-10T17:26:40.666202+0000 mgr.gibba043.dnkmem (mgr.34373) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:44.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:43 gibba003 bash[31385]: cluster 2021-03-10T17:26:42.667023+0000 mgr.gibba043.dnkmem (mgr.34373) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:43 gibba003 bash[32348]: cluster 2021-03-10T17:26:42.667023+0000 mgr.gibba043.dnkmem (mgr.34373) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:44.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:43 gibba043 bash[24019]: cluster 2021-03-10T17:26:42.667023+0000 mgr.gibba043.dnkmem (mgr.34373) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:44 gibba003 bash[31385]: cephadm 2021-03-10T17:26:43.211754+0000 mgr.gibba043.dnkmem (mgr.34373) 11359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:44 gibba003 bash[32348]: cephadm 2021-03-10T17:26:43.211754+0000 mgr.gibba043.dnkmem (mgr.34373) 11359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:44 gibba043 bash[24019]: cephadm 2021-03-10T17:26:43.211754+0000 mgr.gibba043.dnkmem (mgr.34373) 11359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:45 gibba003 bash[31385]: cluster 2021-03-10T17:26:44.668017+0000 mgr.gibba043.dnkmem (mgr.34373) 11360 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:46.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:45 gibba003 bash[32348]: cluster 2021-03-10T17:26:44.668017+0000 mgr.gibba043.dnkmem (mgr.34373) 11360 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:45 gibba043 bash[24019]: cluster 2021-03-10T17:26:44.668017+0000 mgr.gibba043.dnkmem (mgr.34373) 11360 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:48.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:47 gibba003 bash[31385]: cluster 2021-03-10T17:26:46.669728+0000 mgr.gibba043.dnkmem (mgr.34373) 11361 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:48.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:47 gibba003 bash[32348]: cluster 2021-03-10T17:26:46.669728+0000 mgr.gibba043.dnkmem (mgr.34373) 11361 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:48.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:47 gibba043 bash[24019]: cluster 2021-03-10T17:26:46.669728+0000 mgr.gibba043.dnkmem (mgr.34373) 11361 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:49 gibba003 bash[31385]: cluster 2021-03-10T17:26:48.670519+0000 mgr.gibba043.dnkmem (mgr.34373) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:49 gibba003 bash[32348]: cluster 2021-03-10T17:26:48.670519+0000 mgr.gibba043.dnkmem (mgr.34373) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:49 gibba043 bash[24019]: cluster 2021-03-10T17:26:48.670519+0000 mgr.gibba043.dnkmem (mgr.34373) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:51 gibba043 bash[24019]: cluster 2021-03-10T17:26:50.671971+0000 mgr.gibba043.dnkmem (mgr.34373) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:51 gibba003 bash[31385]: cluster 2021-03-10T17:26:50.671971+0000 mgr.gibba043.dnkmem (mgr.34373) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:51 gibba003 bash[32348]: cluster 2021-03-10T17:26:50.671971+0000 mgr.gibba043.dnkmem (mgr.34373) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:54.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:53 gibba043 bash[24019]: cluster 2021-03-10T17:26:52.673657+0000 mgr.gibba043.dnkmem (mgr.34373) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:54.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:53 gibba003 bash[31385]: cluster 2021-03-10T17:26:52.673657+0000 mgr.gibba043.dnkmem (mgr.34373) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:54.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:53 gibba003 bash[32348]: cluster 2021-03-10T17:26:52.673657+0000 mgr.gibba043.dnkmem (mgr.34373) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:56.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:55 gibba043 bash[24019]: cluster 2021-03-10T17:26:54.674998+0000 mgr.gibba043.dnkmem (mgr.34373) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:55 gibba003 bash[31385]: cluster 2021-03-10T17:26:54.674998+0000 mgr.gibba043.dnkmem (mgr.34373) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:55 gibba003 bash[32348]: cluster 2021-03-10T17:26:54.674998+0000 mgr.gibba043.dnkmem (mgr.34373) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:58.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:57 gibba043 bash[24019]: cluster 2021-03-10T17:26:56.676492+0000 mgr.gibba043.dnkmem (mgr.34373) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:57 gibba003 bash[31385]: cluster 2021-03-10T17:26:56.676492+0000 mgr.gibba043.dnkmem (mgr.34373) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:57 gibba003 bash[32348]: cluster 2021-03-10T17:26:56.676492+0000 mgr.gibba043.dnkmem (mgr.34373) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.690 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.431850+0000 mgr.gibba043.dnkmem (mgr.34373) 11367 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:26:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.432419+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.440566+0000 mgr.gibba043.dnkmem (mgr.34373) 11368 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:26:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.441100+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.641330+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.642743+0000 mgr.gibba043.dnkmem (mgr.34373) 11369 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.644604+0000 mgr.gibba043.dnkmem (mgr.34373) 11370 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.644994+0000 mon.c (mon.1) 2921 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.645689+0000 mgr.gibba043.dnkmem (mgr.34373) 11371 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.645728+0000 mgr.gibba043.dnkmem (mgr.34373) 11372 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.646462+0000 mon.c (mon.1) 2922 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.646789+0000 mgr.gibba043.dnkmem (mgr.34373) 11373 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.646834+0000 mgr.gibba043.dnkmem (mgr.34373) 11374 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:59.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.647588+0000 mon.c (mon.1) 2923 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.647867+0000 mgr.gibba043.dnkmem (mgr.34373) 11375 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:59.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.648620+0000 mon.c (mon.1) 2924 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.649494+0000 mgr.gibba043.dnkmem (mgr.34373) 11376 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:59.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.649537+0000 mgr.gibba043.dnkmem (mgr.34373) 11377 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:59.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.650902+0000 mgr.gibba043.dnkmem (mgr.34373) 11378 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:59.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.651227+0000 mgr.gibba043.dnkmem (mgr.34373) 11379 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:59.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.651683+0000 mon.c (mon.1) 2925 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.431850+0000 mgr.gibba043.dnkmem (mgr.34373) 11367 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:26:59.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.432419+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.440566+0000 mgr.gibba043.dnkmem (mgr.34373) 11368 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:26:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.441100+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.641330+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.642743+0000 mgr.gibba043.dnkmem (mgr.34373) 11369 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.644604+0000 mgr.gibba043.dnkmem (mgr.34373) 11370 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.644994+0000 mon.c (mon.1) 2921 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.645689+0000 mgr.gibba043.dnkmem (mgr.34373) 11371 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:59.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.645728+0000 mgr.gibba043.dnkmem (mgr.34373) 11372 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:59.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.646462+0000 mon.c (mon.1) 2922 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.646789+0000 mgr.gibba043.dnkmem (mgr.34373) 11373 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:59.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.646834+0000 mgr.gibba043.dnkmem (mgr.34373) 11374 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:59.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.647588+0000 mon.c (mon.1) 2923 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.647867+0000 mgr.gibba043.dnkmem (mgr.34373) 11375 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:59.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.648620+0000 mon.c (mon.1) 2924 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.649494+0000 mgr.gibba043.dnkmem (mgr.34373) 11376 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:59.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.649537+0000 mgr.gibba043.dnkmem (mgr.34373) 11377 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.650902+0000 mgr.gibba043.dnkmem (mgr.34373) 11378 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.651227+0000 mgr.gibba043.dnkmem (mgr.34373) 11379 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:59.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.651683+0000 mon.c (mon.1) 2925 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.652486+0000 mgr.gibba043.dnkmem (mgr.34373) 11380 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:59.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.652521+0000 mgr.gibba043.dnkmem (mgr.34373) 11381 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:59.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cephadm 2021-03-10T17:26:58.652624+0000 mgr.gibba043.dnkmem (mgr.34373) 11382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:59.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: audit 2021-03-10T17:26:58.653234+0000 mon.c (mon.1) 2926 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[32348]: cluster 2021-03-10T17:26:58.677107+0000 mgr.gibba043.dnkmem (mgr.34373) 11383 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.652486+0000 mgr.gibba043.dnkmem (mgr.34373) 11380 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:59.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.652521+0000 mgr.gibba043.dnkmem (mgr.34373) 11381 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:59.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cephadm 2021-03-10T17:26:58.652624+0000 mgr.gibba043.dnkmem (mgr.34373) 11382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:59.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: audit 2021-03-10T17:26:58.653234+0000 mon.c (mon.1) 2926 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:26:59 gibba003 bash[31385]: cluster 2021-03-10T17:26:58.677107+0000 mgr.gibba043.dnkmem (mgr.34373) 11383 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.431850+0000 mgr.gibba043.dnkmem (mgr.34373) 11367 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:26:59.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.432419+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.440566+0000 mgr.gibba043.dnkmem (mgr.34373) 11368 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:26:59.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.441100+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.641330+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:26:59.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.642743+0000 mgr.gibba043.dnkmem (mgr.34373) 11369 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:59.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.644604+0000 mgr.gibba043.dnkmem (mgr.34373) 11370 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:59.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.644994+0000 mon.c (mon.1) 2921 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:59.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.645689+0000 mgr.gibba043.dnkmem (mgr.34373) 11371 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:59.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.645728+0000 mgr.gibba043.dnkmem (mgr.34373) 11372 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:59.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.646462+0000 mon.c (mon.1) 2922 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.646789+0000 mgr.gibba043.dnkmem (mgr.34373) 11373 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:59.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.646834+0000 mgr.gibba043.dnkmem (mgr.34373) 11374 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:59.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.647588+0000 mon.c (mon.1) 2923 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.647867+0000 mgr.gibba043.dnkmem (mgr.34373) 11375 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:59.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.648620+0000 mon.c (mon.1) 2924 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.649494+0000 mgr.gibba043.dnkmem (mgr.34373) 11376 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:59.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.649537+0000 mgr.gibba043.dnkmem (mgr.34373) 11377 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:59.782 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.650902+0000 mgr.gibba043.dnkmem (mgr.34373) 11378 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:59.782 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.651227+0000 mgr.gibba043.dnkmem (mgr.34373) 11379 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:59.783 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.651683+0000 mon.c (mon.1) 2925 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.783 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.652486+0000 mgr.gibba043.dnkmem (mgr.34373) 11380 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:59.783 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.652521+0000 mgr.gibba043.dnkmem (mgr.34373) 11381 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:59.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cephadm 2021-03-10T17:26:58.652624+0000 mgr.gibba043.dnkmem (mgr.34373) 11382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:26:59.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: audit 2021-03-10T17:26:58.653234+0000 mon.c (mon.1) 2926 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:59.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:26:59 gibba043 bash[24019]: cluster 2021-03-10T17:26:58.677107+0000 mgr.gibba043.dnkmem (mgr.34373) 11383 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:01 gibba043 bash[24019]: cluster 2021-03-10T17:27:00.677846+0000 mgr.gibba043.dnkmem (mgr.34373) 11384 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:01 gibba003 bash[31385]: cluster 2021-03-10T17:27:00.677846+0000 mgr.gibba043.dnkmem (mgr.34373) 11384 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:01 gibba003 bash[32348]: cluster 2021-03-10T17:27:00.677846+0000 mgr.gibba043.dnkmem (mgr.34373) 11384 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:04.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:03 gibba043 bash[24019]: cluster 2021-03-10T17:27:02.679377+0000 mgr.gibba043.dnkmem (mgr.34373) 11385 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:04.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:03 gibba003 bash[31385]: cluster 2021-03-10T17:27:02.679377+0000 mgr.gibba043.dnkmem (mgr.34373) 11385 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:04.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:03 gibba003 bash[32348]: cluster 2021-03-10T17:27:02.679377+0000 mgr.gibba043.dnkmem (mgr.34373) 11385 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:06.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:05 gibba043 bash[24019]: cluster 2021-03-10T17:27:04.680801+0000 mgr.gibba043.dnkmem (mgr.34373) 11386 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:05 gibba003 bash[31385]: cluster 2021-03-10T17:27:04.680801+0000 mgr.gibba043.dnkmem (mgr.34373) 11386 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:06.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:05 gibba003 bash[32348]: cluster 2021-03-10T17:27:04.680801+0000 mgr.gibba043.dnkmem (mgr.34373) 11386 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:08.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:07 gibba043 bash[24019]: cluster 2021-03-10T17:27:06.681781+0000 mgr.gibba043.dnkmem (mgr.34373) 11387 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:07 gibba003 bash[31385]: cluster 2021-03-10T17:27:06.681781+0000 mgr.gibba043.dnkmem (mgr.34373) 11387 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:07 gibba003 bash[32348]: cluster 2021-03-10T17:27:06.681781+0000 mgr.gibba043.dnkmem (mgr.34373) 11387 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:08.564 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:27:08.788 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:27:08.788 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:27:08.788 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:27:08.789 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:27:08.789 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:27:08.789 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:27:08.789 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:27:08.790 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:27:08.790 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:27:08.790 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:27:08.790 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:27:08.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:27:08.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:27:08.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:27:08.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:27:08.791 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:27:08.792 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:27:08.792 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:27:08.792 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:27:08.792 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:27:08.792 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:27:09.037 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:27:09.037 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:27:09.038 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:09.038 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:27:09.038 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:27:09.038 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:09.039 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:27:09.039 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:27:09.039 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:27:09.039 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:27:09.040 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:27:09.040 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:27:09.040 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:27:09.040 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:27:09.040 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:27:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[31385]: audit 2021-03-10T17:27:08.554341+0000 mgr.gibba043.dnkmem (mgr.34373) 11388 : audit [DBG] from='client.51681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[31385]: cluster 2021-03-10T17:27:08.683351+0000 mgr.gibba043.dnkmem (mgr.34373) 11389 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[31385]: audit 2021-03-10T17:27:08.776532+0000 mgr.gibba043.dnkmem (mgr.34373) 11390 : audit [DBG] from='client.61678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[31385]: audit 2021-03-10T17:27:09.037536+0000 mon.c (mon.1) 2927 : audit [DBG] from='client.? 172.21.2.103:0/1813013002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[32348]: audit 2021-03-10T17:27:08.554341+0000 mgr.gibba043.dnkmem (mgr.34373) 11388 : audit [DBG] from='client.51681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[32348]: cluster 2021-03-10T17:27:08.683351+0000 mgr.gibba043.dnkmem (mgr.34373) 11389 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[32348]: audit 2021-03-10T17:27:08.776532+0000 mgr.gibba043.dnkmem (mgr.34373) 11390 : audit [DBG] from='client.61678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:09 gibba003 bash[32348]: audit 2021-03-10T17:27:09.037536+0000 mon.c (mon.1) 2927 : audit [DBG] from='client.? 172.21.2.103:0/1813013002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:09 gibba043 bash[24019]: audit 2021-03-10T17:27:08.554341+0000 mgr.gibba043.dnkmem (mgr.34373) 11388 : audit [DBG] from='client.51681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:09 gibba043 bash[24019]: cluster 2021-03-10T17:27:08.683351+0000 mgr.gibba043.dnkmem (mgr.34373) 11389 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:09 gibba043 bash[24019]: audit 2021-03-10T17:27:08.776532+0000 mgr.gibba043.dnkmem (mgr.34373) 11390 : audit [DBG] from='client.61678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:09 gibba043 bash[24019]: audit 2021-03-10T17:27:09.037536+0000 mon.c (mon.1) 2927 : audit [DBG] from='client.? 172.21.2.103:0/1813013002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:12.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:11 gibba043 bash[24019]: cluster 2021-03-10T17:27:10.684861+0000 mgr.gibba043.dnkmem (mgr.34373) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:12.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:11 gibba003 bash[31385]: cluster 2021-03-10T17:27:10.684861+0000 mgr.gibba043.dnkmem (mgr.34373) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:12.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:11 gibba003 bash[32348]: cluster 2021-03-10T17:27:10.684861+0000 mgr.gibba043.dnkmem (mgr.34373) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:14.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:13 gibba043 bash[24019]: cluster 2021-03-10T17:27:12.685912+0000 mgr.gibba043.dnkmem (mgr.34373) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:13 gibba003 bash[31385]: cluster 2021-03-10T17:27:12.685912+0000 mgr.gibba043.dnkmem (mgr.34373) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:13 gibba003 bash[32348]: cluster 2021-03-10T17:27:12.685912+0000 mgr.gibba043.dnkmem (mgr.34373) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:15.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: cephadm 2021-03-10T17:27:13.668405+0000 mgr.gibba043.dnkmem (mgr.34373) 11393 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.115041+0000 mon.c (mon.1) 2928 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.116246+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.359400+0000 mon.c (mon.1) 2929 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.360490+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.714905+0000 mon.c (mon.1) 2930 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:27:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.715651+0000 mon.c (mon.1) 2931 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.716146+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:27:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.716361+0000 mon.c (mon.1) 2932 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.717173+0000 mon.c (mon.1) 2933 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.717325+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.718585+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[31385]: audit 2021-03-10T17:27:14.719443+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: cephadm 2021-03-10T17:27:13.668405+0000 mgr.gibba043.dnkmem (mgr.34373) 11393 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.115041+0000 mon.c (mon.1) 2928 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.116246+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.359400+0000 mon.c (mon.1) 2929 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.360490+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.714905+0000 mon.c (mon.1) 2930 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:27:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.715651+0000 mon.c (mon.1) 2931 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.716146+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:27:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.716361+0000 mon.c (mon.1) 2932 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.717173+0000 mon.c (mon.1) 2933 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.717325+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.718585+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:14 gibba003 bash[32348]: audit 2021-03-10T17:27:14.719443+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: cephadm 2021-03-10T17:27:13.668405+0000 mgr.gibba043.dnkmem (mgr.34373) 11393 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.115041+0000 mon.c (mon.1) 2928 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.116246+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.359400+0000 mon.c (mon.1) 2929 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.360490+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.714905+0000 mon.c (mon.1) 2930 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:27:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.715651+0000 mon.c (mon.1) 2931 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.716146+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:27:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.716361+0000 mon.c (mon.1) 2932 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.717173+0000 mon.c (mon.1) 2933 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.717325+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.718585+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:14 gibba043 bash[24019]: audit 2021-03-10T17:27:14.719443+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:27:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:15 gibba003 bash[31385]: cluster 2021-03-10T17:27:14.687212+0000 mgr.gibba043.dnkmem (mgr.34373) 11394 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:15 gibba003 bash[32348]: cluster 2021-03-10T17:27:14.687212+0000 mgr.gibba043.dnkmem (mgr.34373) 11394 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:15 gibba043 bash[24019]: cluster 2021-03-10T17:27:14.687212+0000 mgr.gibba043.dnkmem (mgr.34373) 11394 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:17 gibba003 bash[31385]: cluster 2021-03-10T17:27:16.689004+0000 mgr.gibba043.dnkmem (mgr.34373) 11395 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:17 gibba003 bash[32348]: cluster 2021-03-10T17:27:16.689004+0000 mgr.gibba043.dnkmem (mgr.34373) 11395 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:17 gibba043 bash[24019]: cluster 2021-03-10T17:27:16.689004+0000 mgr.gibba043.dnkmem (mgr.34373) 11395 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:19 gibba003 bash[31385]: cluster 2021-03-10T17:27:18.689967+0000 mgr.gibba043.dnkmem (mgr.34373) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:19 gibba003 bash[32348]: cluster 2021-03-10T17:27:18.689967+0000 mgr.gibba043.dnkmem (mgr.34373) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:19 gibba043 bash[24019]: cluster 2021-03-10T17:27:18.689967+0000 mgr.gibba043.dnkmem (mgr.34373) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:21 gibba043 bash[24019]: cluster 2021-03-10T17:27:20.691370+0000 mgr.gibba043.dnkmem (mgr.34373) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:21 gibba003 bash[31385]: cluster 2021-03-10T17:27:20.691370+0000 mgr.gibba043.dnkmem (mgr.34373) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:21 gibba003 bash[32348]: cluster 2021-03-10T17:27:20.691370+0000 mgr.gibba043.dnkmem (mgr.34373) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:24.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:23 gibba043 bash[24019]: cluster 2021-03-10T17:27:22.692950+0000 mgr.gibba043.dnkmem (mgr.34373) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:23 gibba003 bash[31385]: cluster 2021-03-10T17:27:22.692950+0000 mgr.gibba043.dnkmem (mgr.34373) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:24.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:23 gibba003 bash[32348]: cluster 2021-03-10T17:27:22.692950+0000 mgr.gibba043.dnkmem (mgr.34373) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:25 gibba003 bash[31385]: cluster 2021-03-10T17:27:24.694323+0000 mgr.gibba043.dnkmem (mgr.34373) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:25 gibba003 bash[32348]: cluster 2021-03-10T17:27:24.694323+0000 mgr.gibba043.dnkmem (mgr.34373) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:25 gibba043 bash[24019]: cluster 2021-03-10T17:27:24.694323+0000 mgr.gibba043.dnkmem (mgr.34373) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:27 gibba003 bash[31385]: cluster 2021-03-10T17:27:26.696134+0000 mgr.gibba043.dnkmem (mgr.34373) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:27 gibba003 bash[32348]: cluster 2021-03-10T17:27:26.696134+0000 mgr.gibba043.dnkmem (mgr.34373) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:27 gibba043 bash[24019]: cluster 2021-03-10T17:27:26.696134+0000 mgr.gibba043.dnkmem (mgr.34373) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:29 gibba003 bash[31385]: cephadm 2021-03-10T17:27:28.684397+0000 mgr.gibba043.dnkmem (mgr.34373) 11401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:29 gibba003 bash[31385]: cluster 2021-03-10T17:27:28.697455+0000 mgr.gibba043.dnkmem (mgr.34373) 11402 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:29 gibba003 bash[32348]: cephadm 2021-03-10T17:27:28.684397+0000 mgr.gibba043.dnkmem (mgr.34373) 11401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:29 gibba003 bash[32348]: cluster 2021-03-10T17:27:28.697455+0000 mgr.gibba043.dnkmem (mgr.34373) 11402 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:29 gibba043 bash[24019]: cephadm 2021-03-10T17:27:28.684397+0000 mgr.gibba043.dnkmem (mgr.34373) 11401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:29 gibba043 bash[24019]: cluster 2021-03-10T17:27:28.697455+0000 mgr.gibba043.dnkmem (mgr.34373) 11402 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.021 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:31 gibba043 bash[24019]: cluster 2021-03-10T17:27:30.698324+0000 mgr.gibba043.dnkmem (mgr.34373) 11403 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:31 gibba003 bash[31385]: cluster 2021-03-10T17:27:30.698324+0000 mgr.gibba043.dnkmem (mgr.34373) 11403 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:31 gibba003 bash[32348]: cluster 2021-03-10T17:27:30.698324+0000 mgr.gibba043.dnkmem (mgr.34373) 11403 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:33 gibba003 bash[31385]: cluster 2021-03-10T17:27:32.699808+0000 mgr.gibba043.dnkmem (mgr.34373) 11404 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:34.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:33 gibba003 bash[32348]: cluster 2021-03-10T17:27:32.699808+0000 mgr.gibba043.dnkmem (mgr.34373) 11404 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:33 gibba043 bash[24019]: cluster 2021-03-10T17:27:32.699808+0000 mgr.gibba043.dnkmem (mgr.34373) 11404 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:35 gibba003 bash[31385]: cluster 2021-03-10T17:27:34.701339+0000 mgr.gibba043.dnkmem (mgr.34373) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:35 gibba003 bash[32348]: cluster 2021-03-10T17:27:34.701339+0000 mgr.gibba043.dnkmem (mgr.34373) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:36.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:35 gibba043 bash[24019]: cluster 2021-03-10T17:27:34.701339+0000 mgr.gibba043.dnkmem (mgr.34373) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:37 gibba003 bash[31385]: cluster 2021-03-10T17:27:36.702980+0000 mgr.gibba043.dnkmem (mgr.34373) 11406 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:37 gibba003 bash[32348]: cluster 2021-03-10T17:27:36.702980+0000 mgr.gibba043.dnkmem (mgr.34373) 11406 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:37 gibba043 bash[24019]: cluster 2021-03-10T17:27:36.702980+0000 mgr.gibba043.dnkmem (mgr.34373) 11406 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.284 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:27:39.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:39 gibba003 bash[31385]: cluster 2021-03-10T17:27:38.704641+0000 mgr.gibba043.dnkmem (mgr.34373) 11407 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:39 gibba003 bash[32348]: cluster 2021-03-10T17:27:38.704641+0000 mgr.gibba043.dnkmem (mgr.34373) 11407 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.510 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:27:39.510 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:27:39.510 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:27:39.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:27:39.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:27:39.511 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:27:39.511 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:27:39.511 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:27:39.512 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:27:39.512 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:27:39.512 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:27:39.512 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:27:39.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:27:39.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:27:39.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:27:39.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:27:39.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:27:39.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:27:39.514 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:27:39.514 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:27:39.514 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:27:39.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:39 gibba043 bash[24019]: cluster 2021-03-10T17:27:38.704641+0000 mgr.gibba043.dnkmem (mgr.34373) 11407 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.759 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:27:39.759 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:27:39.760 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:39.760 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:27:39.760 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:27:39.760 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:39.760 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:27:39.761 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:27:39.761 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:27:39.761 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:27:39.761 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:27:39.762 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:27:39.762 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:27:39.762 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:27:39.762 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:27:40.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:40 gibba003 bash[31385]: audit 2021-03-10T17:27:39.274463+0000 mgr.gibba043.dnkmem (mgr.34373) 11408 : audit [DBG] from='client.61690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:40.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:40 gibba003 bash[31385]: audit 2021-03-10T17:27:39.496732+0000 mgr.gibba043.dnkmem (mgr.34373) 11409 : audit [DBG] from='client.61696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:40.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:40 gibba003 bash[31385]: audit 2021-03-10T17:27:39.759075+0000 mon.a (mon.0) 2273 : audit [DBG] from='client.? 172.21.2.103:0/1524599549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:40 gibba003 bash[32348]: audit 2021-03-10T17:27:39.274463+0000 mgr.gibba043.dnkmem (mgr.34373) 11408 : audit [DBG] from='client.61690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:40 gibba003 bash[32348]: audit 2021-03-10T17:27:39.496732+0000 mgr.gibba043.dnkmem (mgr.34373) 11409 : audit [DBG] from='client.61696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:40 gibba003 bash[32348]: audit 2021-03-10T17:27:39.759075+0000 mon.a (mon.0) 2273 : audit [DBG] from='client.? 172.21.2.103:0/1524599549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:40 gibba043 bash[24019]: audit 2021-03-10T17:27:39.274463+0000 mgr.gibba043.dnkmem (mgr.34373) 11408 : audit [DBG] from='client.61690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:40 gibba043 bash[24019]: audit 2021-03-10T17:27:39.496732+0000 mgr.gibba043.dnkmem (mgr.34373) 11409 : audit [DBG] from='client.61696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:40 gibba043 bash[24019]: audit 2021-03-10T17:27:39.759075+0000 mon.a (mon.0) 2273 : audit [DBG] from='client.? 172.21.2.103:0/1524599549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:41.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:41 gibba003 bash[31385]: cluster 2021-03-10T17:27:40.706028+0000 mgr.gibba043.dnkmem (mgr.34373) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:41 gibba003 bash[32348]: cluster 2021-03-10T17:27:40.706028+0000 mgr.gibba043.dnkmem (mgr.34373) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:41.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:41 gibba043 bash[24019]: cluster 2021-03-10T17:27:40.706028+0000 mgr.gibba043.dnkmem (mgr.34373) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:44.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:43 gibba043 bash[24019]: cluster 2021-03-10T17:27:42.706985+0000 mgr.gibba043.dnkmem (mgr.34373) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:43 gibba003 bash[31385]: cluster 2021-03-10T17:27:42.706985+0000 mgr.gibba043.dnkmem (mgr.34373) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:43 gibba003 bash[32348]: cluster 2021-03-10T17:27:42.706985+0000 mgr.gibba043.dnkmem (mgr.34373) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:44 gibba003 bash[31385]: cephadm 2021-03-10T17:27:43.700472+0000 mgr.gibba043.dnkmem (mgr.34373) 11412 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:45.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:44 gibba003 bash[32348]: cephadm 2021-03-10T17:27:43.700472+0000 mgr.gibba043.dnkmem (mgr.34373) 11412 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:44 gibba043 bash[24019]: cephadm 2021-03-10T17:27:43.700472+0000 mgr.gibba043.dnkmem (mgr.34373) 11412 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:27:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:45 gibba003 bash[31385]: cluster 2021-03-10T17:27:44.708455+0000 mgr.gibba043.dnkmem (mgr.34373) 11413 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:45 gibba003 bash[32348]: cluster 2021-03-10T17:27:44.708455+0000 mgr.gibba043.dnkmem (mgr.34373) 11413 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:45 gibba043 bash[24019]: cluster 2021-03-10T17:27:44.708455+0000 mgr.gibba043.dnkmem (mgr.34373) 11413 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:47 gibba003 bash[31385]: cluster 2021-03-10T17:27:46.710278+0000 mgr.gibba043.dnkmem (mgr.34373) 11414 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:47 gibba003 bash[32348]: cluster 2021-03-10T17:27:46.710278+0000 mgr.gibba043.dnkmem (mgr.34373) 11414 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:47 gibba043 bash[24019]: cluster 2021-03-10T17:27:46.710278+0000 mgr.gibba043.dnkmem (mgr.34373) 11414 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:49 gibba003 bash[31385]: cluster 2021-03-10T17:27:48.711818+0000 mgr.gibba043.dnkmem (mgr.34373) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:49.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:49 gibba003 bash[32348]: cluster 2021-03-10T17:27:48.711818+0000 mgr.gibba043.dnkmem (mgr.34373) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:49 gibba043 bash[24019]: cluster 2021-03-10T17:27:48.711818+0000 mgr.gibba043.dnkmem (mgr.34373) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:51 gibba003 bash[31385]: cluster 2021-03-10T17:27:50.713632+0000 mgr.gibba043.dnkmem (mgr.34373) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:51 gibba003 bash[32348]: cluster 2021-03-10T17:27:50.713632+0000 mgr.gibba043.dnkmem (mgr.34373) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:51 gibba043 bash[24019]: cluster 2021-03-10T17:27:50.713632+0000 mgr.gibba043.dnkmem (mgr.34373) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:53 gibba003 bash[31385]: cluster 2021-03-10T17:27:52.715050+0000 mgr.gibba043.dnkmem (mgr.34373) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:53 gibba003 bash[32348]: cluster 2021-03-10T17:27:52.715050+0000 mgr.gibba043.dnkmem (mgr.34373) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:53 gibba043 bash[24019]: cluster 2021-03-10T17:27:52.715050+0000 mgr.gibba043.dnkmem (mgr.34373) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:55 gibba003 bash[31385]: cluster 2021-03-10T17:27:54.717034+0000 mgr.gibba043.dnkmem (mgr.34373) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:55 gibba003 bash[32348]: cluster 2021-03-10T17:27:54.717034+0000 mgr.gibba043.dnkmem (mgr.34373) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:55 gibba043 bash[24019]: cluster 2021-03-10T17:27:54.717034+0000 mgr.gibba043.dnkmem (mgr.34373) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:58.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:57 gibba003 bash[31385]: cluster 2021-03-10T17:27:56.718893+0000 mgr.gibba043.dnkmem (mgr.34373) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:57 gibba003 bash[32348]: cluster 2021-03-10T17:27:56.718893+0000 mgr.gibba043.dnkmem (mgr.34373) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:57 gibba043 bash[24019]: cluster 2021-03-10T17:27:56.718893+0000 mgr.gibba043.dnkmem (mgr.34373) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:00.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.717232+0000 mgr.gibba043.dnkmem (mgr.34373) 11420 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:28:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.718814+0000 mgr.gibba043.dnkmem (mgr.34373) 11421 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:28:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cluster 2021-03-10T17:27:58.720392+0000 mgr.gibba043.dnkmem (mgr.34373) 11422 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:00.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.949840+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:28:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.951468+0000 mgr.gibba043.dnkmem (mgr.34373) 11423 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.953361+0000 mgr.gibba043.dnkmem (mgr.34373) 11424 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.953916+0000 mon.c (mon.1) 2934 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:00.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.954710+0000 mgr.gibba043.dnkmem (mgr.34373) 11425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.954823+0000 mgr.gibba043.dnkmem (mgr.34373) 11426 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.955343+0000 mon.c (mon.1) 2935 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.956022+0000 mgr.gibba043.dnkmem (mgr.34373) 11427 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.956058+0000 mgr.gibba043.dnkmem (mgr.34373) 11428 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:00.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.956873+0000 mon.c (mon.1) 2936 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.957200+0000 mgr.gibba043.dnkmem (mgr.34373) 11429 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:00.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.958032+0000 mon.c (mon.1) 2937 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.958911+0000 mgr.gibba043.dnkmem (mgr.34373) 11430 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:00.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.958948+0000 mgr.gibba043.dnkmem (mgr.34373) 11431 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:00.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.960636+0000 mgr.gibba043.dnkmem (mgr.34373) 11432 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:00.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.960952+0000 mgr.gibba043.dnkmem (mgr.34373) 11433 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:00.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.961055+0000 mon.c (mon.1) 2938 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.962002+0000 mgr.gibba043.dnkmem (mgr.34373) 11434 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:00.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.962041+0000 mgr.gibba043.dnkmem (mgr.34373) 11435 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:00.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: cephadm 2021-03-10T17:27:58.962146+0000 mgr.gibba043.dnkmem (mgr.34373) 11436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:00.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:27:59 gibba043 bash[24019]: audit 2021-03-10T17:27:58.962844+0000 mon.c (mon.1) 2939 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.717232+0000 mgr.gibba043.dnkmem (mgr.34373) 11420 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:28:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.718814+0000 mgr.gibba043.dnkmem (mgr.34373) 11421 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:28:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cluster 2021-03-10T17:27:58.720392+0000 mgr.gibba043.dnkmem (mgr.34373) 11422 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.949840+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:28:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.951468+0000 mgr.gibba043.dnkmem (mgr.34373) 11423 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.953361+0000 mgr.gibba043.dnkmem (mgr.34373) 11424 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.953916+0000 mon.c (mon.1) 2934 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.954710+0000 mgr.gibba043.dnkmem (mgr.34373) 11425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:00.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.954823+0000 mgr.gibba043.dnkmem (mgr.34373) 11426 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:00.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.955343+0000 mon.c (mon.1) 2935 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.956022+0000 mgr.gibba043.dnkmem (mgr.34373) 11427 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:00.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.956058+0000 mgr.gibba043.dnkmem (mgr.34373) 11428 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:00.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.956873+0000 mon.c (mon.1) 2936 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.957200+0000 mgr.gibba043.dnkmem (mgr.34373) 11429 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:00.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.958032+0000 mon.c (mon.1) 2937 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.958911+0000 mgr.gibba043.dnkmem (mgr.34373) 11430 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:00.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.958948+0000 mgr.gibba043.dnkmem (mgr.34373) 11431 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:00.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.960636+0000 mgr.gibba043.dnkmem (mgr.34373) 11432 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:00.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.960952+0000 mgr.gibba043.dnkmem (mgr.34373) 11433 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:00.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.961055+0000 mon.c (mon.1) 2938 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.962002+0000 mgr.gibba043.dnkmem (mgr.34373) 11434 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:00.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.717232+0000 mgr.gibba043.dnkmem (mgr.34373) 11420 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:28:00.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.718814+0000 mgr.gibba043.dnkmem (mgr.34373) 11421 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:28:00.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cluster 2021-03-10T17:27:58.720392+0000 mgr.gibba043.dnkmem (mgr.34373) 11422 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:00.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.949840+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:28:00.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.951468+0000 mgr.gibba043.dnkmem (mgr.34373) 11423 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:00.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.953361+0000 mgr.gibba043.dnkmem (mgr.34373) 11424 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:00.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.953916+0000 mon.c (mon.1) 2934 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:00.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.954710+0000 mgr.gibba043.dnkmem (mgr.34373) 11425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:00.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.954823+0000 mgr.gibba043.dnkmem (mgr.34373) 11426 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:00.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.955343+0000 mon.c (mon.1) 2935 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.956022+0000 mgr.gibba043.dnkmem (mgr.34373) 11427 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:00.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.956058+0000 mgr.gibba043.dnkmem (mgr.34373) 11428 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:00.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.956873+0000 mon.c (mon.1) 2936 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.957200+0000 mgr.gibba043.dnkmem (mgr.34373) 11429 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:00.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.958032+0000 mon.c (mon.1) 2937 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.958911+0000 mgr.gibba043.dnkmem (mgr.34373) 11430 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:00.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.958948+0000 mgr.gibba043.dnkmem (mgr.34373) 11431 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:00.456 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.960636+0000 mgr.gibba043.dnkmem (mgr.34373) 11432 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:00.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.960952+0000 mgr.gibba043.dnkmem (mgr.34373) 11433 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:00.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.961055+0000 mon.c (mon.1) 2938 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.457 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.962002+0000 mgr.gibba043.dnkmem (mgr.34373) 11434 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:00.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.962041+0000 mgr.gibba043.dnkmem (mgr.34373) 11435 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:00.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: cephadm 2021-03-10T17:27:58.962146+0000 mgr.gibba043.dnkmem (mgr.34373) 11436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:00.459 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[32348]: audit 2021-03-10T17:27:58.962844+0000 mon.c (mon.1) 2939 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:00.459 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.962041+0000 mgr.gibba043.dnkmem (mgr.34373) 11435 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:00.460 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: cephadm 2021-03-10T17:27:58.962146+0000 mgr.gibba043.dnkmem (mgr.34373) 11436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:00.460 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:27:59 gibba003 bash[31385]: audit 2021-03-10T17:27:58.962844+0000 mon.c (mon.1) 2939 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:01 gibba043 bash[24019]: cluster 2021-03-10T17:28:00.721887+0000 mgr.gibba043.dnkmem (mgr.34373) 11437 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:01 gibba003 bash[31385]: cluster 2021-03-10T17:28:00.721887+0000 mgr.gibba043.dnkmem (mgr.34373) 11437 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:02.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:01 gibba003 bash[32348]: cluster 2021-03-10T17:28:00.721887+0000 mgr.gibba043.dnkmem (mgr.34373) 11437 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:03 gibba043 bash[24019]: cluster 2021-03-10T17:28:02.723419+0000 mgr.gibba043.dnkmem (mgr.34373) 11438 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:03 gibba003 bash[31385]: cluster 2021-03-10T17:28:02.723419+0000 mgr.gibba043.dnkmem (mgr.34373) 11438 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:04.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:03 gibba003 bash[32348]: cluster 2021-03-10T17:28:02.723419+0000 mgr.gibba043.dnkmem (mgr.34373) 11438 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:05 gibba043 bash[24019]: cluster 2021-03-10T17:28:04.725091+0000 mgr.gibba043.dnkmem (mgr.34373) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:05 gibba003 bash[31385]: cluster 2021-03-10T17:28:04.725091+0000 mgr.gibba043.dnkmem (mgr.34373) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:05 gibba003 bash[32348]: cluster 2021-03-10T17:28:04.725091+0000 mgr.gibba043.dnkmem (mgr.34373) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:07 gibba043 bash[24019]: cluster 2021-03-10T17:28:06.726702+0000 mgr.gibba043.dnkmem (mgr.34373) 11440 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:08.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:07 gibba003 bash[31385]: cluster 2021-03-10T17:28:06.726702+0000 mgr.gibba043.dnkmem (mgr.34373) 11440 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:08.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:07 gibba003 bash[32348]: cluster 2021-03-10T17:28:06.726702+0000 mgr.gibba043.dnkmem (mgr.34373) 11440 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:09 gibba003 bash[31385]: cluster 2021-03-10T17:28:08.728270+0000 mgr.gibba043.dnkmem (mgr.34373) 11441 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:09.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:09 gibba003 bash[32348]: cluster 2021-03-10T17:28:08.728270+0000 mgr.gibba043.dnkmem (mgr.34373) 11441 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:09.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:09 gibba043 bash[24019]: cluster 2021-03-10T17:28:08.728270+0000 mgr.gibba043.dnkmem (mgr.34373) 11441 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:10.003 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:28:10.235 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:28:10.235 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:28:10.235 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:28:10.236 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:28:10.236 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:28:10.236 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:28:10.236 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:28:10.236 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:28:10.237 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:28:10.237 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:28:10.237 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:28:10.237 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:28:10.238 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:28:10.238 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:28:10.238 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:28:10.238 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:28:10.238 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:28:10.239 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:28:10.239 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:28:10.239 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:28:10.239 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:28:10.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:10 gibba003 bash[31385]: audit 2021-03-10T17:28:09.992131+0000 mgr.gibba043.dnkmem (mgr.34373) 11442 : audit [DBG] from='client.61708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:10.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:10 gibba003 bash[32348]: audit 2021-03-10T17:28:09.992131+0000 mgr.gibba043.dnkmem (mgr.34373) 11442 : audit [DBG] from='client.61708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:10.487 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:28:10.488 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:28:10.488 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:10.488 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:28:10.488 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:28:10.489 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:10.489 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:28:10.489 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:28:10.489 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:28:10.489 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:28:10.490 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:28:10.490 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:28:10.490 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:28:10.490 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:28:10.491 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:28:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:10 gibba043 bash[24019]: audit 2021-03-10T17:28:09.992131+0000 mgr.gibba043.dnkmem (mgr.34373) 11442 : audit [DBG] from='client.61708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:11 gibba003 bash[31385]: audit 2021-03-10T17:28:10.221672+0000 mgr.gibba043.dnkmem (mgr.34373) 11443 : audit [DBG] from='client.51723 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:11.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:11 gibba003 bash[31385]: audit 2021-03-10T17:28:10.487511+0000 mon.a (mon.0) 2275 : audit [DBG] from='client.? 172.21.2.103:0/2674999919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:11 gibba003 bash[31385]: cluster 2021-03-10T17:28:10.729851+0000 mgr.gibba043.dnkmem (mgr.34373) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:11 gibba003 bash[32348]: audit 2021-03-10T17:28:10.221672+0000 mgr.gibba043.dnkmem (mgr.34373) 11443 : audit [DBG] from='client.51723 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:11 gibba003 bash[32348]: audit 2021-03-10T17:28:10.487511+0000 mon.a (mon.0) 2275 : audit [DBG] from='client.? 172.21.2.103:0/2674999919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:11 gibba003 bash[32348]: cluster 2021-03-10T17:28:10.729851+0000 mgr.gibba043.dnkmem (mgr.34373) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:11 gibba043 bash[24019]: audit 2021-03-10T17:28:10.221672+0000 mgr.gibba043.dnkmem (mgr.34373) 11443 : audit [DBG] from='client.51723 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:11 gibba043 bash[24019]: audit 2021-03-10T17:28:10.487511+0000 mon.a (mon.0) 2275 : audit [DBG] from='client.? 172.21.2.103:0/2674999919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:11 gibba043 bash[24019]: cluster 2021-03-10T17:28:10.729851+0000 mgr.gibba043.dnkmem (mgr.34373) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:13 gibba003 bash[31385]: cluster 2021-03-10T17:28:12.731222+0000 mgr.gibba043.dnkmem (mgr.34373) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:13 gibba003 bash[32348]: cluster 2021-03-10T17:28:12.731222+0000 mgr.gibba043.dnkmem (mgr.34373) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:14.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:13 gibba043 bash[24019]: cluster 2021-03-10T17:28:12.731222+0000 mgr.gibba043.dnkmem (mgr.34373) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: cephadm 2021-03-10T17:28:13.966232+0000 mgr.gibba043.dnkmem (mgr.34373) 11446 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.122370+0000 mon.c (mon.1) 2940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.123718+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.367191+0000 mon.c (mon.1) 2941 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.368576+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.724699+0000 mon.c (mon.1) 2942 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:28:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.725787+0000 mon.c (mon.1) 2943 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.726230+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:28:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.726835+0000 mon.c (mon.1) 2944 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.728127+0000 mon.c (mon.1) 2945 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.728178+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.730013+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[31385]: audit 2021-03-10T17:28:14.731255+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: cephadm 2021-03-10T17:28:13.966232+0000 mgr.gibba043.dnkmem (mgr.34373) 11446 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.122370+0000 mon.c (mon.1) 2940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.123718+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.367191+0000 mon.c (mon.1) 2941 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.368576+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.724699+0000 mon.c (mon.1) 2942 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:28:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.725787+0000 mon.c (mon.1) 2943 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.726230+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:28:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.726835+0000 mon.c (mon.1) 2944 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.728127+0000 mon.c (mon.1) 2945 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.728178+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.730013+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:14 gibba003 bash[32348]: audit 2021-03-10T17:28:14.731255+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: cephadm 2021-03-10T17:28:13.966232+0000 mgr.gibba043.dnkmem (mgr.34373) 11446 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.122370+0000 mon.c (mon.1) 2940 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.123718+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.367191+0000 mon.c (mon.1) 2941 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.368576+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.724699+0000 mon.c (mon.1) 2942 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:28:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.725787+0000 mon.c (mon.1) 2943 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.726230+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:28:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.726835+0000 mon.c (mon.1) 2944 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.728127+0000 mon.c (mon.1) 2945 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.728178+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:28:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.730013+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:14 gibba043 bash[24019]: audit 2021-03-10T17:28:14.731255+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:15 gibba003 bash[31385]: cluster 2021-03-10T17:28:14.731711+0000 mgr.gibba043.dnkmem (mgr.34373) 11447 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:15 gibba003 bash[32348]: cluster 2021-03-10T17:28:14.731711+0000 mgr.gibba043.dnkmem (mgr.34373) 11447 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:15 gibba043 bash[24019]: cluster 2021-03-10T17:28:14.731711+0000 mgr.gibba043.dnkmem (mgr.34373) 11447 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:17 gibba003 bash[31385]: cluster 2021-03-10T17:28:16.733064+0000 mgr.gibba043.dnkmem (mgr.34373) 11448 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:17 gibba003 bash[32348]: cluster 2021-03-10T17:28:16.733064+0000 mgr.gibba043.dnkmem (mgr.34373) 11448 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:17 gibba043 bash[24019]: cluster 2021-03-10T17:28:16.733064+0000 mgr.gibba043.dnkmem (mgr.34373) 11448 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:19 gibba003 bash[31385]: cluster 2021-03-10T17:28:18.734648+0000 mgr.gibba043.dnkmem (mgr.34373) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:19 gibba003 bash[32348]: cluster 2021-03-10T17:28:18.734648+0000 mgr.gibba043.dnkmem (mgr.34373) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:19 gibba043 bash[24019]: cluster 2021-03-10T17:28:18.734648+0000 mgr.gibba043.dnkmem (mgr.34373) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:21 gibba003 bash[31385]: cluster 2021-03-10T17:28:20.736378+0000 mgr.gibba043.dnkmem (mgr.34373) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:22.271 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:21 gibba003 bash[32348]: cluster 2021-03-10T17:28:20.736378+0000 mgr.gibba043.dnkmem (mgr.34373) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:21 gibba043 bash[24019]: cluster 2021-03-10T17:28:20.736378+0000 mgr.gibba043.dnkmem (mgr.34373) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:23 gibba003 bash[31385]: cluster 2021-03-10T17:28:22.737843+0000 mgr.gibba043.dnkmem (mgr.34373) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:23 gibba003 bash[32348]: cluster 2021-03-10T17:28:22.737843+0000 mgr.gibba043.dnkmem (mgr.34373) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:23 gibba043 bash[24019]: cluster 2021-03-10T17:28:22.737843+0000 mgr.gibba043.dnkmem (mgr.34373) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:25 gibba003 bash[31385]: cluster 2021-03-10T17:28:24.739341+0000 mgr.gibba043.dnkmem (mgr.34373) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:25 gibba003 bash[32348]: cluster 2021-03-10T17:28:24.739341+0000 mgr.gibba043.dnkmem (mgr.34373) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:25 gibba043 bash[24019]: cluster 2021-03-10T17:28:24.739341+0000 mgr.gibba043.dnkmem (mgr.34373) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:27 gibba003 bash[31385]: cluster 2021-03-10T17:28:26.740908+0000 mgr.gibba043.dnkmem (mgr.34373) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:27 gibba003 bash[32348]: cluster 2021-03-10T17:28:26.740908+0000 mgr.gibba043.dnkmem (mgr.34373) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:27 gibba043 bash[24019]: cluster 2021-03-10T17:28:26.740908+0000 mgr.gibba043.dnkmem (mgr.34373) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:29 gibba043 bash[24019]: cluster 2021-03-10T17:28:28.742507+0000 mgr.gibba043.dnkmem (mgr.34373) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:29 gibba043 bash[24019]: cephadm 2021-03-10T17:28:28.982003+0000 mgr.gibba043.dnkmem (mgr.34373) 11455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:29 gibba003 bash[31385]: cluster 2021-03-10T17:28:28.742507+0000 mgr.gibba043.dnkmem (mgr.34373) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:29 gibba003 bash[31385]: cephadm 2021-03-10T17:28:28.982003+0000 mgr.gibba043.dnkmem (mgr.34373) 11455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:29 gibba003 bash[32348]: cluster 2021-03-10T17:28:28.742507+0000 mgr.gibba043.dnkmem (mgr.34373) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:29 gibba003 bash[32348]: cephadm 2021-03-10T17:28:28.982003+0000 mgr.gibba043.dnkmem (mgr.34373) 11455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:32.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:31 gibba003 bash[31385]: cluster 2021-03-10T17:28:30.744196+0000 mgr.gibba043.dnkmem (mgr.34373) 11456 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:32.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:31 gibba003 bash[32348]: cluster 2021-03-10T17:28:30.744196+0000 mgr.gibba043.dnkmem (mgr.34373) 11456 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:31 gibba043 bash[24019]: cluster 2021-03-10T17:28:30.744196+0000 mgr.gibba043.dnkmem (mgr.34373) 11456 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:33 gibba003 bash[31385]: cluster 2021-03-10T17:28:32.745721+0000 mgr.gibba043.dnkmem (mgr.34373) 11457 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:33 gibba003 bash[32348]: cluster 2021-03-10T17:28:32.745721+0000 mgr.gibba043.dnkmem (mgr.34373) 11457 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:33 gibba043 bash[24019]: cluster 2021-03-10T17:28:32.745721+0000 mgr.gibba043.dnkmem (mgr.34373) 11457 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:35 gibba003 bash[31385]: cluster 2021-03-10T17:28:34.747416+0000 mgr.gibba043.dnkmem (mgr.34373) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:35 gibba003 bash[32348]: cluster 2021-03-10T17:28:34.747416+0000 mgr.gibba043.dnkmem (mgr.34373) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:35 gibba043 bash[24019]: cluster 2021-03-10T17:28:34.747416+0000 mgr.gibba043.dnkmem (mgr.34373) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:37 gibba003 bash[31385]: cluster 2021-03-10T17:28:36.749019+0000 mgr.gibba043.dnkmem (mgr.34373) 11459 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:37 gibba003 bash[32348]: cluster 2021-03-10T17:28:36.749019+0000 mgr.gibba043.dnkmem (mgr.34373) 11459 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:37 gibba043 bash[24019]: cluster 2021-03-10T17:28:36.749019+0000 mgr.gibba043.dnkmem (mgr.34373) 11459 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:39 gibba003 bash[31385]: cluster 2021-03-10T17:28:38.750577+0000 mgr.gibba043.dnkmem (mgr.34373) 11460 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:39 gibba003 bash[32348]: cluster 2021-03-10T17:28:38.750577+0000 mgr.gibba043.dnkmem (mgr.34373) 11460 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:39 gibba043 bash[24019]: cluster 2021-03-10T17:28:38.750577+0000 mgr.gibba043.dnkmem (mgr.34373) 11460 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:40.730 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:28:40.960 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:28:40.960 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:28:40.960 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:28:40.960 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:28:40.961 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:28:40.961 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:28:40.961 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:28:40.961 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:28:40.962 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:28:40.962 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:28:40.962 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:28:40.962 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:28:40.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:28:40.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:28:40.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:28:40.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:28:40.963 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:28:40.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:28:40.965 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:28:40.965 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:28:40.965 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:28:41.206 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:28:41.207 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:28:41.207 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:41.207 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:28:41.208 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:28:41.208 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:41.208 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:28:41.208 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:28:41.208 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:28:41.209 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:28:41.209 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:28:41.209 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:28:41.209 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:28:41.209 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:28:41.210 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:28:42.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[31385]: audit 2021-03-10T17:28:40.719647+0000 mgr.gibba043.dnkmem (mgr.34373) 11461 : audit [DBG] from='client.51735 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:42.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[31385]: cluster 2021-03-10T17:28:40.752272+0000 mgr.gibba043.dnkmem (mgr.34373) 11462 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[31385]: audit 2021-03-10T17:28:40.946357+0000 mgr.gibba043.dnkmem (mgr.34373) 11463 : audit [DBG] from='client.61732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:42.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[31385]: audit 2021-03-10T17:28:41.206806+0000 mon.a (mon.0) 2282 : audit [DBG] from='client.? 172.21.2.103:0/3510185241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:42.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[32348]: audit 2021-03-10T17:28:40.719647+0000 mgr.gibba043.dnkmem (mgr.34373) 11461 : audit [DBG] from='client.51735 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[32348]: cluster 2021-03-10T17:28:40.752272+0000 mgr.gibba043.dnkmem (mgr.34373) 11462 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[32348]: audit 2021-03-10T17:28:40.946357+0000 mgr.gibba043.dnkmem (mgr.34373) 11463 : audit [DBG] from='client.61732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:42.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:41 gibba003 bash[32348]: audit 2021-03-10T17:28:41.206806+0000 mon.a (mon.0) 2282 : audit [DBG] from='client.? 172.21.2.103:0/3510185241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:42.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:41 gibba043 bash[24019]: audit 2021-03-10T17:28:40.719647+0000 mgr.gibba043.dnkmem (mgr.34373) 11461 : audit [DBG] from='client.51735 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:42.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:41 gibba043 bash[24019]: cluster 2021-03-10T17:28:40.752272+0000 mgr.gibba043.dnkmem (mgr.34373) 11462 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:41 gibba043 bash[24019]: audit 2021-03-10T17:28:40.946357+0000 mgr.gibba043.dnkmem (mgr.34373) 11463 : audit [DBG] from='client.61732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:41 gibba043 bash[24019]: audit 2021-03-10T17:28:41.206806+0000 mon.a (mon.0) 2282 : audit [DBG] from='client.? 172.21.2.103:0/3510185241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:43 gibba003 bash[31385]: cluster 2021-03-10T17:28:42.753834+0000 mgr.gibba043.dnkmem (mgr.34373) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:43 gibba003 bash[32348]: cluster 2021-03-10T17:28:42.753834+0000 mgr.gibba043.dnkmem (mgr.34373) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:43 gibba043 bash[24019]: cluster 2021-03-10T17:28:42.753834+0000 mgr.gibba043.dnkmem (mgr.34373) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:44 gibba003 bash[31385]: cephadm 2021-03-10T17:28:43.996750+0000 mgr.gibba043.dnkmem (mgr.34373) 11465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:44 gibba003 bash[32348]: cephadm 2021-03-10T17:28:43.996750+0000 mgr.gibba043.dnkmem (mgr.34373) 11465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:44 gibba043 bash[24019]: cephadm 2021-03-10T17:28:43.996750+0000 mgr.gibba043.dnkmem (mgr.34373) 11465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:28:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:45 gibba003 bash[31385]: cluster 2021-03-10T17:28:44.755460+0000 mgr.gibba043.dnkmem (mgr.34373) 11466 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:46.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:45 gibba003 bash[32348]: cluster 2021-03-10T17:28:44.755460+0000 mgr.gibba043.dnkmem (mgr.34373) 11466 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:45 gibba043 bash[24019]: cluster 2021-03-10T17:28:44.755460+0000 mgr.gibba043.dnkmem (mgr.34373) 11466 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:47 gibba003 bash[31385]: cluster 2021-03-10T17:28:46.757102+0000 mgr.gibba043.dnkmem (mgr.34373) 11467 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:47 gibba003 bash[32348]: cluster 2021-03-10T17:28:46.757102+0000 mgr.gibba043.dnkmem (mgr.34373) 11467 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:47 gibba043 bash[24019]: cluster 2021-03-10T17:28:46.757102+0000 mgr.gibba043.dnkmem (mgr.34373) 11467 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:49 gibba003 bash[31385]: cluster 2021-03-10T17:28:48.758759+0000 mgr.gibba043.dnkmem (mgr.34373) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:49 gibba003 bash[32348]: cluster 2021-03-10T17:28:48.758759+0000 mgr.gibba043.dnkmem (mgr.34373) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:49 gibba043 bash[24019]: cluster 2021-03-10T17:28:48.758759+0000 mgr.gibba043.dnkmem (mgr.34373) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:51 gibba003 bash[31385]: cluster 2021-03-10T17:28:50.760350+0000 mgr.gibba043.dnkmem (mgr.34373) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:52.255 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:51 gibba003 bash[32348]: cluster 2021-03-10T17:28:50.760350+0000 mgr.gibba043.dnkmem (mgr.34373) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:51 gibba043 bash[24019]: cluster 2021-03-10T17:28:50.760350+0000 mgr.gibba043.dnkmem (mgr.34373) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:53 gibba003 bash[31385]: cluster 2021-03-10T17:28:52.761537+0000 mgr.gibba043.dnkmem (mgr.34373) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:53 gibba003 bash[32348]: cluster 2021-03-10T17:28:52.761537+0000 mgr.gibba043.dnkmem (mgr.34373) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:53 gibba043 bash[24019]: cluster 2021-03-10T17:28:52.761537+0000 mgr.gibba043.dnkmem (mgr.34373) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:55 gibba003 bash[31385]: cluster 2021-03-10T17:28:54.763195+0000 mgr.gibba043.dnkmem (mgr.34373) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:55 gibba003 bash[32348]: cluster 2021-03-10T17:28:54.763195+0000 mgr.gibba043.dnkmem (mgr.34373) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:55 gibba043 bash[24019]: cluster 2021-03-10T17:28:54.763195+0000 mgr.gibba043.dnkmem (mgr.34373) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.244 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:57 gibba003 bash[31385]: cluster 2021-03-10T17:28:56.764782+0000 mgr.gibba043.dnkmem (mgr.34373) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.245 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:57 gibba003 bash[32348]: cluster 2021-03-10T17:28:56.764782+0000 mgr.gibba043.dnkmem (mgr.34373) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:57 gibba043 bash[24019]: cluster 2021-03-10T17:28:56.764782+0000 mgr.gibba043.dnkmem (mgr.34373) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:59 gibba003 bash[31385]: cluster 2021-03-10T17:28:58.766289+0000 mgr.gibba043.dnkmem (mgr.34373) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:59 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.013357+0000 mgr.gibba043.dnkmem (mgr.34373) 11474 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:28:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:28:59 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.014677+0000 mgr.gibba043.dnkmem (mgr.34373) 11475 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:28:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:59 gibba003 bash[32348]: cluster 2021-03-10T17:28:58.766289+0000 mgr.gibba043.dnkmem (mgr.34373) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:59 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.013357+0000 mgr.gibba043.dnkmem (mgr.34373) 11474 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:28:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:28:59 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.014677+0000 mgr.gibba043.dnkmem (mgr.34373) 11475 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:28:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:59 gibba043 bash[24019]: cluster 2021-03-10T17:28:58.766289+0000 mgr.gibba043.dnkmem (mgr.34373) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:59 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.013357+0000 mgr.gibba043.dnkmem (mgr.34373) 11474 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:28:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:28:59 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.014677+0000 mgr.gibba043.dnkmem (mgr.34373) 11475 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:29:00.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.230352+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:29:00.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.231786+0000 mgr.gibba043.dnkmem (mgr.34373) 11476 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:00.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.233356+0000 mgr.gibba043.dnkmem (mgr.34373) 11477 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:00.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.233996+0000 mon.c (mon.1) 2946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:00.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.234414+0000 mgr.gibba043.dnkmem (mgr.34373) 11478 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:00.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.234448+0000 mgr.gibba043.dnkmem (mgr.34373) 11479 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:00.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.235318+0000 mon.c (mon.1) 2947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.235976+0000 mgr.gibba043.dnkmem (mgr.34373) 11480 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.236032+0000 mgr.gibba043.dnkmem (mgr.34373) 11481 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.236428+0000 mon.c (mon.1) 2948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.237238+0000 mgr.gibba043.dnkmem (mgr.34373) 11482 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:00.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.237968+0000 mon.c (mon.1) 2949 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.238712+0000 mgr.gibba043.dnkmem (mgr.34373) 11483 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:00.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.238750+0000 mgr.gibba043.dnkmem (mgr.34373) 11484 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:00.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.239833+0000 mgr.gibba043.dnkmem (mgr.34373) 11485 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:00.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.240155+0000 mgr.gibba043.dnkmem (mgr.34373) 11486 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:00.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.240662+0000 mon.c (mon.1) 2950 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.241272+0000 mgr.gibba043.dnkmem (mgr.34373) 11487 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:00.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.241310+0000 mgr.gibba043.dnkmem (mgr.34373) 11488 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:00.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: cephadm 2021-03-10T17:28:59.241413+0000 mgr.gibba043.dnkmem (mgr.34373) 11489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:00.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:00 gibba043 bash[24019]: audit 2021-03-10T17:28:59.241981+0000 mon.c (mon.1) 2951 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.230352+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:29:00.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.231786+0000 mgr.gibba043.dnkmem (mgr.34373) 11476 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:00.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.233356+0000 mgr.gibba043.dnkmem (mgr.34373) 11477 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:00.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.233996+0000 mon.c (mon.1) 2946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:00.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.234414+0000 mgr.gibba043.dnkmem (mgr.34373) 11478 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:00.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.234448+0000 mgr.gibba043.dnkmem (mgr.34373) 11479 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:00.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.235318+0000 mon.c (mon.1) 2947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.235976+0000 mgr.gibba043.dnkmem (mgr.34373) 11480 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:00.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.236032+0000 mgr.gibba043.dnkmem (mgr.34373) 11481 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:00.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.236428+0000 mon.c (mon.1) 2948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.237238+0000 mgr.gibba043.dnkmem (mgr.34373) 11482 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:00.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.237968+0000 mon.c (mon.1) 2949 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.238712+0000 mgr.gibba043.dnkmem (mgr.34373) 11483 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:00.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.238750+0000 mgr.gibba043.dnkmem (mgr.34373) 11484 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:00.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.239833+0000 mgr.gibba043.dnkmem (mgr.34373) 11485 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:00.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.240155+0000 mgr.gibba043.dnkmem (mgr.34373) 11486 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:00.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.240662+0000 mon.c (mon.1) 2950 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.241272+0000 mgr.gibba043.dnkmem (mgr.34373) 11487 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:00.699 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.241310+0000 mgr.gibba043.dnkmem (mgr.34373) 11488 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:00.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: cephadm 2021-03-10T17:28:59.241413+0000 mgr.gibba043.dnkmem (mgr.34373) 11489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:00.700 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[31385]: audit 2021-03-10T17:28:59.241981+0000 mon.c (mon.1) 2951 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.230352+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:29:00.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.231786+0000 mgr.gibba043.dnkmem (mgr.34373) 11476 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:00.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.233356+0000 mgr.gibba043.dnkmem (mgr.34373) 11477 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:00.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.233996+0000 mon.c (mon.1) 2946 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:00.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.234414+0000 mgr.gibba043.dnkmem (mgr.34373) 11478 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:00.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.234448+0000 mgr.gibba043.dnkmem (mgr.34373) 11479 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:00.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.235318+0000 mon.c (mon.1) 2947 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.235976+0000 mgr.gibba043.dnkmem (mgr.34373) 11480 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:00.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.236032+0000 mgr.gibba043.dnkmem (mgr.34373) 11481 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:00.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.236428+0000 mon.c (mon.1) 2948 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.237238+0000 mgr.gibba043.dnkmem (mgr.34373) 11482 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:00.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.237968+0000 mon.c (mon.1) 2949 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.238712+0000 mgr.gibba043.dnkmem (mgr.34373) 11483 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:00.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.238750+0000 mgr.gibba043.dnkmem (mgr.34373) 11484 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:00.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.239833+0000 mgr.gibba043.dnkmem (mgr.34373) 11485 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:00.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.240155+0000 mgr.gibba043.dnkmem (mgr.34373) 11486 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:00.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.240662+0000 mon.c (mon.1) 2950 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.241272+0000 mgr.gibba043.dnkmem (mgr.34373) 11487 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:00.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.241310+0000 mgr.gibba043.dnkmem (mgr.34373) 11488 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:00.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: cephadm 2021-03-10T17:28:59.241413+0000 mgr.gibba043.dnkmem (mgr.34373) 11489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:00.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:00 gibba003 bash[32348]: audit 2021-03-10T17:28:59.241981+0000 mon.c (mon.1) 2951 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:01 gibba043 bash[24019]: cluster 2021-03-10T17:29:00.768017+0000 mgr.gibba043.dnkmem (mgr.34373) 11490 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:01.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:01 gibba003 bash[31385]: cluster 2021-03-10T17:29:00.768017+0000 mgr.gibba043.dnkmem (mgr.34373) 11490 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:01.691 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:01 gibba003 bash[32348]: cluster 2021-03-10T17:29:00.768017+0000 mgr.gibba043.dnkmem (mgr.34373) 11490 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:03 gibba003 bash[31385]: cluster 2021-03-10T17:29:02.769467+0000 mgr.gibba043.dnkmem (mgr.34373) 11491 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:03 gibba003 bash[32348]: cluster 2021-03-10T17:29:02.769467+0000 mgr.gibba043.dnkmem (mgr.34373) 11491 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:03 gibba043 bash[24019]: cluster 2021-03-10T17:29:02.769467+0000 mgr.gibba043.dnkmem (mgr.34373) 11491 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:05 gibba003 bash[31385]: cluster 2021-03-10T17:29:04.771021+0000 mgr.gibba043.dnkmem (mgr.34373) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:05 gibba003 bash[32348]: cluster 2021-03-10T17:29:04.771021+0000 mgr.gibba043.dnkmem (mgr.34373) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:05 gibba043 bash[24019]: cluster 2021-03-10T17:29:04.771021+0000 mgr.gibba043.dnkmem (mgr.34373) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:07 gibba003 bash[31385]: cluster 2021-03-10T17:29:06.772684+0000 mgr.gibba043.dnkmem (mgr.34373) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:07 gibba003 bash[32348]: cluster 2021-03-10T17:29:06.772684+0000 mgr.gibba043.dnkmem (mgr.34373) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:07 gibba043 bash[24019]: cluster 2021-03-10T17:29:06.772684+0000 mgr.gibba043.dnkmem (mgr.34373) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:09 gibba003 bash[31385]: cluster 2021-03-10T17:29:08.774145+0000 mgr.gibba043.dnkmem (mgr.34373) 11494 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:09 gibba003 bash[32348]: cluster 2021-03-10T17:29:08.774145+0000 mgr.gibba043.dnkmem (mgr.34373) 11494 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:09 gibba043 bash[24019]: cluster 2021-03-10T17:29:08.774145+0000 mgr.gibba043.dnkmem (mgr.34373) 11494 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:11.448 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:29:11.678 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:29:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:29:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:29:11.679 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:29:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:29:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:29:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:29:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:29:11.680 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:29:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:29:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:29:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:29:11.681 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:29:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:29:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:29:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:29:11.682 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:29:11.683 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:29:11.683 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:29:11.683 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:29:11.683 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:29:11.927 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:29:11.927 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:29:11.927 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:11.928 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:29:11.928 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:29:11.928 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:11.928 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:29:11.929 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:29:11.929 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:29:11.929 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:29:11.929 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:29:11.929 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:29:11.930 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:29:11.930 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:29:11.930 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:29:12.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:11 gibba003 bash[31385]: cluster 2021-03-10T17:29:10.775711+0000 mgr.gibba043.dnkmem (mgr.34373) 11495 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:12.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:11 gibba003 bash[32348]: cluster 2021-03-10T17:29:10.775711+0000 mgr.gibba043.dnkmem (mgr.34373) 11495 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:11 gibba043 bash[24019]: cluster 2021-03-10T17:29:10.775711+0000 mgr.gibba043.dnkmem (mgr.34373) 11495 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:13.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:12 gibba003 bash[31385]: audit 2021-03-10T17:29:11.438480+0000 mgr.gibba043.dnkmem (mgr.34373) 11496 : audit [DBG] from='client.51753 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:12 gibba003 bash[31385]: audit 2021-03-10T17:29:11.664702+0000 mgr.gibba043.dnkmem (mgr.34373) 11497 : audit [DBG] from='client.61750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:13.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:12 gibba003 bash[31385]: audit 2021-03-10T17:29:11.926900+0000 mon.a (mon.0) 2284 : audit [DBG] from='client.? 172.21.2.103:0/396672316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:13.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:12 gibba003 bash[32348]: audit 2021-03-10T17:29:11.438480+0000 mgr.gibba043.dnkmem (mgr.34373) 11496 : audit [DBG] from='client.51753 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:13.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:12 gibba003 bash[32348]: audit 2021-03-10T17:29:11.664702+0000 mgr.gibba043.dnkmem (mgr.34373) 11497 : audit [DBG] from='client.61750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:13.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:12 gibba003 bash[32348]: audit 2021-03-10T17:29:11.926900+0000 mon.a (mon.0) 2284 : audit [DBG] from='client.? 172.21.2.103:0/396672316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:12 gibba043 bash[24019]: audit 2021-03-10T17:29:11.438480+0000 mgr.gibba043.dnkmem (mgr.34373) 11496 : audit [DBG] from='client.51753 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:13.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:12 gibba043 bash[24019]: audit 2021-03-10T17:29:11.664702+0000 mgr.gibba043.dnkmem (mgr.34373) 11497 : audit [DBG] from='client.61750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:12 gibba043 bash[24019]: audit 2021-03-10T17:29:11.926900+0000 mon.a (mon.0) 2284 : audit [DBG] from='client.? 172.21.2.103:0/396672316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:13 gibba003 bash[31385]: cluster 2021-03-10T17:29:12.776987+0000 mgr.gibba043.dnkmem (mgr.34373) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:14.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:13 gibba003 bash[32348]: cluster 2021-03-10T17:29:12.776987+0000 mgr.gibba043.dnkmem (mgr.34373) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:14.258 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:13 gibba043 bash[24019]: cluster 2021-03-10T17:29:12.776987+0000 mgr.gibba043.dnkmem (mgr.34373) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.129584+0000 mon.c (mon.1) 2952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.130706+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.374439+0000 mon.c (mon.1) 2953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.375580+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.736595+0000 mon.c (mon.1) 2954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.737385+0000 mon.c (mon.1) 2955 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.737826+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.738097+0000 mon.c (mon.1) 2956 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:29:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.738926+0000 mon.c (mon.1) 2957 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.739062+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.740218+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:29:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[31385]: audit 2021-03-10T17:29:14.741005+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.129584+0000 mon.c (mon.1) 2952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.130706+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.374439+0000 mon.c (mon.1) 2953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.375580+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.736595+0000 mon.c (mon.1) 2954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.737385+0000 mon.c (mon.1) 2955 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.737826+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.738097+0000 mon.c (mon.1) 2956 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:29:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.738926+0000 mon.c (mon.1) 2957 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.739062+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.740218+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:29:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:14 gibba003 bash[32348]: audit 2021-03-10T17:29:14.741005+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.129584+0000 mon.c (mon.1) 2952 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.130706+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.374439+0000 mon.c (mon.1) 2953 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.375580+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.736595+0000 mon.c (mon.1) 2954 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.737385+0000 mon.c (mon.1) 2955 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.737826+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.738097+0000 mon.c (mon.1) 2956 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:29:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.738926+0000 mon.c (mon.1) 2957 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.739062+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:29:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.740218+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:29:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:14 gibba043 bash[24019]: audit 2021-03-10T17:29:14.741005+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:29:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:15 gibba003 bash[31385]: cephadm 2021-03-10T17:29:14.256586+0000 mgr.gibba043.dnkmem (mgr.34373) 11499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:15 gibba003 bash[31385]: cluster 2021-03-10T17:29:14.778499+0000 mgr.gibba043.dnkmem (mgr.34373) 11500 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:15 gibba003 bash[32348]: cephadm 2021-03-10T17:29:14.256586+0000 mgr.gibba043.dnkmem (mgr.34373) 11499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:16.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:15 gibba003 bash[32348]: cluster 2021-03-10T17:29:14.778499+0000 mgr.gibba043.dnkmem (mgr.34373) 11500 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:15 gibba043 bash[24019]: cephadm 2021-03-10T17:29:14.256586+0000 mgr.gibba043.dnkmem (mgr.34373) 11499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:15 gibba043 bash[24019]: cluster 2021-03-10T17:29:14.778499+0000 mgr.gibba043.dnkmem (mgr.34373) 11500 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:17 gibba003 bash[31385]: cluster 2021-03-10T17:29:16.780372+0000 mgr.gibba043.dnkmem (mgr.34373) 11501 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:17 gibba003 bash[32348]: cluster 2021-03-10T17:29:16.780372+0000 mgr.gibba043.dnkmem (mgr.34373) 11501 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:17 gibba043 bash[24019]: cluster 2021-03-10T17:29:16.780372+0000 mgr.gibba043.dnkmem (mgr.34373) 11501 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:19 gibba003 bash[31385]: cluster 2021-03-10T17:29:18.781934+0000 mgr.gibba043.dnkmem (mgr.34373) 11502 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:19.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:19 gibba003 bash[32348]: cluster 2021-03-10T17:29:18.781934+0000 mgr.gibba043.dnkmem (mgr.34373) 11502 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:19 gibba043 bash[24019]: cluster 2021-03-10T17:29:18.781934+0000 mgr.gibba043.dnkmem (mgr.34373) 11502 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:21 gibba003 bash[31385]: cluster 2021-03-10T17:29:20.783703+0000 mgr.gibba043.dnkmem (mgr.34373) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:21 gibba003 bash[32348]: cluster 2021-03-10T17:29:20.783703+0000 mgr.gibba043.dnkmem (mgr.34373) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:21 gibba043 bash[24019]: cluster 2021-03-10T17:29:20.783703+0000 mgr.gibba043.dnkmem (mgr.34373) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:24.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:23 gibba003 bash[31385]: cluster 2021-03-10T17:29:22.785077+0000 mgr.gibba043.dnkmem (mgr.34373) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:24.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:23 gibba003 bash[32348]: cluster 2021-03-10T17:29:22.785077+0000 mgr.gibba043.dnkmem (mgr.34373) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:23 gibba043 bash[24019]: cluster 2021-03-10T17:29:22.785077+0000 mgr.gibba043.dnkmem (mgr.34373) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:25 gibba003 bash[31385]: cluster 2021-03-10T17:29:24.786693+0000 mgr.gibba043.dnkmem (mgr.34373) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:25 gibba003 bash[32348]: cluster 2021-03-10T17:29:24.786693+0000 mgr.gibba043.dnkmem (mgr.34373) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:25 gibba043 bash[24019]: cluster 2021-03-10T17:29:24.786693+0000 mgr.gibba043.dnkmem (mgr.34373) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:27 gibba003 bash[31385]: cluster 2021-03-10T17:29:26.788431+0000 mgr.gibba043.dnkmem (mgr.34373) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:27 gibba003 bash[32348]: cluster 2021-03-10T17:29:26.788431+0000 mgr.gibba043.dnkmem (mgr.34373) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:27 gibba043 bash[24019]: cluster 2021-03-10T17:29:26.788431+0000 mgr.gibba043.dnkmem (mgr.34373) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:29 gibba003 bash[31385]: cluster 2021-03-10T17:29:28.790260+0000 mgr.gibba043.dnkmem (mgr.34373) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:29 gibba003 bash[32348]: cluster 2021-03-10T17:29:28.790260+0000 mgr.gibba043.dnkmem (mgr.34373) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:29 gibba043 bash[24019]: cluster 2021-03-10T17:29:28.790260+0000 mgr.gibba043.dnkmem (mgr.34373) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:30.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:30 gibba003 bash[31385]: cephadm 2021-03-10T17:29:29.272554+0000 mgr.gibba043.dnkmem (mgr.34373) 11508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:30.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:30 gibba003 bash[32348]: cephadm 2021-03-10T17:29:29.272554+0000 mgr.gibba043.dnkmem (mgr.34373) 11508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:30.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:30 gibba043 bash[24019]: cephadm 2021-03-10T17:29:29.272554+0000 mgr.gibba043.dnkmem (mgr.34373) 11508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:31.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:31 gibba003 bash[31385]: cluster 2021-03-10T17:29:30.791924+0000 mgr.gibba043.dnkmem (mgr.34373) 11509 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:31.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:31 gibba003 bash[32348]: cluster 2021-03-10T17:29:30.791924+0000 mgr.gibba043.dnkmem (mgr.34373) 11509 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:31.521 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:31 gibba043 bash[24019]: cluster 2021-03-10T17:29:30.791924+0000 mgr.gibba043.dnkmem (mgr.34373) 11509 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:33 gibba003 bash[31385]: cluster 2021-03-10T17:29:32.793232+0000 mgr.gibba043.dnkmem (mgr.34373) 11510 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:33 gibba003 bash[32348]: cluster 2021-03-10T17:29:32.793232+0000 mgr.gibba043.dnkmem (mgr.34373) 11510 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:33 gibba043 bash[24019]: cluster 2021-03-10T17:29:32.793232+0000 mgr.gibba043.dnkmem (mgr.34373) 11510 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:35 gibba003 bash[31385]: cluster 2021-03-10T17:29:34.794869+0000 mgr.gibba043.dnkmem (mgr.34373) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:35 gibba003 bash[32348]: cluster 2021-03-10T17:29:34.794869+0000 mgr.gibba043.dnkmem (mgr.34373) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:35 gibba043 bash[24019]: cluster 2021-03-10T17:29:34.794869+0000 mgr.gibba043.dnkmem (mgr.34373) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:37 gibba003 bash[31385]: cluster 2021-03-10T17:29:36.796269+0000 mgr.gibba043.dnkmem (mgr.34373) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:37 gibba003 bash[32348]: cluster 2021-03-10T17:29:36.796269+0000 mgr.gibba043.dnkmem (mgr.34373) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:37 gibba043 bash[24019]: cluster 2021-03-10T17:29:36.796269+0000 mgr.gibba043.dnkmem (mgr.34373) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:39 gibba003 bash[31385]: cluster 2021-03-10T17:29:38.798055+0000 mgr.gibba043.dnkmem (mgr.34373) 11513 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:39 gibba003 bash[32348]: cluster 2021-03-10T17:29:38.798055+0000 mgr.gibba043.dnkmem (mgr.34373) 11513 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:39 gibba043 bash[24019]: cluster 2021-03-10T17:29:38.798055+0000 mgr.gibba043.dnkmem (mgr.34373) 11513 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.174 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:29:42.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:41 gibba003 bash[31385]: cluster 2021-03-10T17:29:40.807332+0000 mgr.gibba043.dnkmem (mgr.34373) 11514 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:41 gibba003 bash[32348]: cluster 2021-03-10T17:29:40.807332+0000 mgr.gibba043.dnkmem (mgr.34373) 11514 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.271 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:41 gibba043 bash[24019]: cluster 2021-03-10T17:29:40.807332+0000 mgr.gibba043.dnkmem (mgr.34373) 11514 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.401 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:29:42.401 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:29:42.402 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:29:42.402 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:29:42.402 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:29:42.402 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:29:42.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:29:42.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:29:42.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:29:42.403 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:29:42.404 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:29:42.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:29:42.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:29:42.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:29:42.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:29:42.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:29:42.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:29:42.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:29:42.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:29:42.405 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:29:42.406 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:29:42.648 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:29:42.649 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:29:42.649 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:42.649 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:29:42.649 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:29:42.649 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:42.650 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:29:42.650 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:29:42.650 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:29:42.650 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:29:42.651 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:29:42.651 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:29:42.651 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:29:42.651 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:29:42.651 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:29:43.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:42 gibba003 bash[31385]: audit 2021-03-10T17:29:42.648348+0000 mon.c (mon.1) 2958 : audit [DBG] from='client.? 172.21.2.103:0/2338518880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:43.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:42 gibba003 bash[32348]: audit 2021-03-10T17:29:42.648348+0000 mon.c (mon.1) 2958 : audit [DBG] from='client.? 172.21.2.103:0/2338518880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:42 gibba043 bash[24019]: audit 2021-03-10T17:29:42.648348+0000 mon.c (mon.1) 2958 : audit [DBG] from='client.? 172.21.2.103:0/2338518880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:43 gibba003 bash[31385]: audit 2021-03-10T17:29:42.163014+0000 mgr.gibba043.dnkmem (mgr.34373) 11515 : audit [DBG] from='client.51771 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:44.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:43 gibba003 bash[31385]: audit 2021-03-10T17:29:42.387501+0000 mgr.gibba043.dnkmem (mgr.34373) 11516 : audit [DBG] from='client.61768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:44.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:43 gibba003 bash[31385]: cluster 2021-03-10T17:29:42.808515+0000 mgr.gibba043.dnkmem (mgr.34373) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:43 gibba003 bash[32348]: audit 2021-03-10T17:29:42.163014+0000 mgr.gibba043.dnkmem (mgr.34373) 11515 : audit [DBG] from='client.51771 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:44.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:43 gibba003 bash[32348]: audit 2021-03-10T17:29:42.387501+0000 mgr.gibba043.dnkmem (mgr.34373) 11516 : audit [DBG] from='client.61768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:44.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:43 gibba003 bash[32348]: cluster 2021-03-10T17:29:42.808515+0000 mgr.gibba043.dnkmem (mgr.34373) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:43 gibba043 bash[24019]: audit 2021-03-10T17:29:42.163014+0000 mgr.gibba043.dnkmem (mgr.34373) 11515 : audit [DBG] from='client.51771 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:43 gibba043 bash[24019]: audit 2021-03-10T17:29:42.387501+0000 mgr.gibba043.dnkmem (mgr.34373) 11516 : audit [DBG] from='client.61768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:43 gibba043 bash[24019]: cluster 2021-03-10T17:29:42.808515+0000 mgr.gibba043.dnkmem (mgr.34373) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:45 gibba003 bash[31385]: cephadm 2021-03-10T17:29:44.288550+0000 mgr.gibba043.dnkmem (mgr.34373) 11518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:46.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:45 gibba003 bash[31385]: cluster 2021-03-10T17:29:44.810137+0000 mgr.gibba043.dnkmem (mgr.34373) 11519 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:45 gibba003 bash[32348]: cephadm 2021-03-10T17:29:44.288550+0000 mgr.gibba043.dnkmem (mgr.34373) 11518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:46.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:45 gibba003 bash[32348]: cluster 2021-03-10T17:29:44.810137+0000 mgr.gibba043.dnkmem (mgr.34373) 11519 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:45 gibba043 bash[24019]: cephadm 2021-03-10T17:29:44.288550+0000 mgr.gibba043.dnkmem (mgr.34373) 11518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:29:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:45 gibba043 bash[24019]: cluster 2021-03-10T17:29:44.810137+0000 mgr.gibba043.dnkmem (mgr.34373) 11519 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:47 gibba003 bash[31385]: cluster 2021-03-10T17:29:46.811797+0000 mgr.gibba043.dnkmem (mgr.34373) 11520 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:47 gibba003 bash[32348]: cluster 2021-03-10T17:29:46.811797+0000 mgr.gibba043.dnkmem (mgr.34373) 11520 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:47 gibba043 bash[24019]: cluster 2021-03-10T17:29:46.811797+0000 mgr.gibba043.dnkmem (mgr.34373) 11520 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:49.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:49 gibba003 bash[31385]: cluster 2021-03-10T17:29:48.812264+0000 mgr.gibba043.dnkmem (mgr.34373) 11521 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:49.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:49 gibba003 bash[32348]: cluster 2021-03-10T17:29:48.812264+0000 mgr.gibba043.dnkmem (mgr.34373) 11521 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:49 gibba043 bash[24019]: cluster 2021-03-10T17:29:48.812264+0000 mgr.gibba043.dnkmem (mgr.34373) 11521 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:51 gibba003 bash[31385]: cluster 2021-03-10T17:29:50.813641+0000 mgr.gibba043.dnkmem (mgr.34373) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:52.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:51 gibba003 bash[32348]: cluster 2021-03-10T17:29:50.813641+0000 mgr.gibba043.dnkmem (mgr.34373) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:51 gibba043 bash[24019]: cluster 2021-03-10T17:29:50.813641+0000 mgr.gibba043.dnkmem (mgr.34373) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:53 gibba003 bash[31385]: cluster 2021-03-10T17:29:52.815054+0000 mgr.gibba043.dnkmem (mgr.34373) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:53 gibba003 bash[32348]: cluster 2021-03-10T17:29:52.815054+0000 mgr.gibba043.dnkmem (mgr.34373) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:53 gibba043 bash[24019]: cluster 2021-03-10T17:29:52.815054+0000 mgr.gibba043.dnkmem (mgr.34373) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:55 gibba003 bash[31385]: cluster 2021-03-10T17:29:54.816742+0000 mgr.gibba043.dnkmem (mgr.34373) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:56.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:55 gibba003 bash[32348]: cluster 2021-03-10T17:29:54.816742+0000 mgr.gibba043.dnkmem (mgr.34373) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:55 gibba043 bash[24019]: cluster 2021-03-10T17:29:54.816742+0000 mgr.gibba043.dnkmem (mgr.34373) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:57 gibba003 bash[31385]: cluster 2021-03-10T17:29:56.818417+0000 mgr.gibba043.dnkmem (mgr.34373) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:57 gibba003 bash[32348]: cluster 2021-03-10T17:29:56.818417+0000 mgr.gibba043.dnkmem (mgr.34373) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:57 gibba043 bash[24019]: cluster 2021-03-10T17:29:56.818417+0000 mgr.gibba043.dnkmem (mgr.34373) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:29:59 gibba003 bash[31385]: cluster 2021-03-10T17:29:58.818935+0000 mgr.gibba043.dnkmem (mgr.34373) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:29:59 gibba003 bash[32348]: cluster 2021-03-10T17:29:58.818935+0000 mgr.gibba043.dnkmem (mgr.34373) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:29:59 gibba043 bash[24019]: cluster 2021-03-10T17:29:58.818935+0000 mgr.gibba043.dnkmem (mgr.34373) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:00.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[31385]: debug 2021-03-10T17:29:59.999+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[31385]: cephadm 2021-03-10T17:29:59.306202+0000 mgr.gibba043.dnkmem (mgr.34373) 11527 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:30:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[31385]: audit 2021-03-10T17:29:59.308350+0000 mon.c (mon.1) 2959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:30:00.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[31385]: cluster 2021-03-10T17:30:00.000380+0000 mon.a (mon.0) 2291 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[32348]: cephadm 2021-03-10T17:29:59.306202+0000 mgr.gibba043.dnkmem (mgr.34373) 11527 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:30:00.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[32348]: audit 2021-03-10T17:29:59.308350+0000 mon.c (mon.1) 2959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:30:00.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:00 gibba003 bash[32348]: cluster 2021-03-10T17:30:00.000380+0000 mon.a (mon.0) 2291 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:00 gibba043 bash[24019]: cephadm 2021-03-10T17:29:59.306202+0000 mgr.gibba043.dnkmem (mgr.34373) 11527 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:30:00.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:00 gibba043 bash[24019]: audit 2021-03-10T17:29:59.308350+0000 mon.c (mon.1) 2959 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:30:00.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:00 gibba043 bash[24019]: cluster 2021-03-10T17:30:00.000380+0000 mon.a (mon.0) 2291 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:01.440 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:01 gibba003 bash[31385]: cluster 2021-03-10T17:30:00.820526+0000 mgr.gibba043.dnkmem (mgr.34373) 11528 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:01 gibba003 bash[32348]: cluster 2021-03-10T17:30:00.820526+0000 mgr.gibba043.dnkmem (mgr.34373) 11528 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:01 gibba043 bash[24019]: cluster 2021-03-10T17:30:00.820526+0000 mgr.gibba043.dnkmem (mgr.34373) 11528 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: cluster 2021-03-10T17:30:02.822073+0000 mgr.gibba043.dnkmem (mgr.34373) 11529 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: cephadm 2021-03-10T17:30:02.889957+0000 mgr.gibba043.dnkmem (mgr.34373) 11530 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:30:04.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:02.890400+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:30:04.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.105805+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:30:04.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.115494+0000 mon.c (mon.1) 2960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.118702+0000 mon.c (mon.1) 2961 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.121850+0000 mon.c (mon.1) 2962 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.124798+0000 mon.c (mon.1) 2963 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.134353+0000 mon.c (mon.1) 2964 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[31385]: audit 2021-03-10T17:30:03.141002+0000 mon.c (mon.1) 2965 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: cluster 2021-03-10T17:30:02.822073+0000 mgr.gibba043.dnkmem (mgr.34373) 11529 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: cephadm 2021-03-10T17:30:02.889957+0000 mgr.gibba043.dnkmem (mgr.34373) 11530 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:30:04.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:02.890400+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:30:04.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.105805+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:30:04.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.115494+0000 mon.c (mon.1) 2960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:04.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.118702+0000 mon.c (mon.1) 2961 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.121850+0000 mon.c (mon.1) 2962 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.124798+0000 mon.c (mon.1) 2963 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.134353+0000 mon.c (mon.1) 2964 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:03 gibba003 bash[32348]: audit 2021-03-10T17:30:03.141002+0000 mon.c (mon.1) 2965 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: cluster 2021-03-10T17:30:02.822073+0000 mgr.gibba043.dnkmem (mgr.34373) 11529 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: cephadm 2021-03-10T17:30:02.889957+0000 mgr.gibba043.dnkmem (mgr.34373) 11530 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:30:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:02.890400+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:30:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.105805+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:30:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.115494+0000 mon.c (mon.1) 2960 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:04.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.118702+0000 mon.c (mon.1) 2961 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.121850+0000 mon.c (mon.1) 2962 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.124798+0000 mon.c (mon.1) 2963 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.134353+0000 mon.c (mon.1) 2964 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:04.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:03 gibba043 bash[24019]: audit 2021-03-10T17:30:03.141002+0000 mon.c (mon.1) 2965 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.112590+0000 mgr.gibba043.dnkmem (mgr.34373) 11531 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.116337+0000 mgr.gibba043.dnkmem (mgr.34373) 11532 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.119370+0000 mgr.gibba043.dnkmem (mgr.34373) 11533 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.119409+0000 mgr.gibba043.dnkmem (mgr.34373) 11534 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.122421+0000 mgr.gibba043.dnkmem (mgr.34373) 11535 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.122464+0000 mgr.gibba043.dnkmem (mgr.34373) 11536 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.125555+0000 mgr.gibba043.dnkmem (mgr.34373) 11537 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:05.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.130813+0000 mgr.gibba043.dnkmem (mgr.34373) 11538 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:05.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.131040+0000 mgr.gibba043.dnkmem (mgr.34373) 11539 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:05.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.136108+0000 mgr.gibba043.dnkmem (mgr.34373) 11540 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:05.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.138356+0000 mgr.gibba043.dnkmem (mgr.34373) 11541 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:05.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.142748+0000 mgr.gibba043.dnkmem (mgr.34373) 11542 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:05.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.143055+0000 mgr.gibba043.dnkmem (mgr.34373) 11543 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:05.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[31385]: cephadm 2021-03-10T17:30:03.143979+0000 mgr.gibba043.dnkmem (mgr.34373) 11544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:05.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.112590+0000 mgr.gibba043.dnkmem (mgr.34373) 11531 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:05.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.116337+0000 mgr.gibba043.dnkmem (mgr.34373) 11532 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:05.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.119370+0000 mgr.gibba043.dnkmem (mgr.34373) 11533 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:05.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.119409+0000 mgr.gibba043.dnkmem (mgr.34373) 11534 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:05.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.122421+0000 mgr.gibba043.dnkmem (mgr.34373) 11535 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:05.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.122464+0000 mgr.gibba043.dnkmem (mgr.34373) 11536 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:05.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.125555+0000 mgr.gibba043.dnkmem (mgr.34373) 11537 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:05.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.130813+0000 mgr.gibba043.dnkmem (mgr.34373) 11538 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:05.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.131040+0000 mgr.gibba043.dnkmem (mgr.34373) 11539 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:05.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.136108+0000 mgr.gibba043.dnkmem (mgr.34373) 11540 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:05.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.138356+0000 mgr.gibba043.dnkmem (mgr.34373) 11541 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:05.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.142748+0000 mgr.gibba043.dnkmem (mgr.34373) 11542 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:05.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.143055+0000 mgr.gibba043.dnkmem (mgr.34373) 11543 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:05.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:04 gibba003 bash[32348]: cephadm 2021-03-10T17:30:03.143979+0000 mgr.gibba043.dnkmem (mgr.34373) 11544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.112590+0000 mgr.gibba043.dnkmem (mgr.34373) 11531 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.116337+0000 mgr.gibba043.dnkmem (mgr.34373) 11532 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.119370+0000 mgr.gibba043.dnkmem (mgr.34373) 11533 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.119409+0000 mgr.gibba043.dnkmem (mgr.34373) 11534 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.122421+0000 mgr.gibba043.dnkmem (mgr.34373) 11535 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.122464+0000 mgr.gibba043.dnkmem (mgr.34373) 11536 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.125555+0000 mgr.gibba043.dnkmem (mgr.34373) 11537 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.130813+0000 mgr.gibba043.dnkmem (mgr.34373) 11538 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.131040+0000 mgr.gibba043.dnkmem (mgr.34373) 11539 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:05.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.136108+0000 mgr.gibba043.dnkmem (mgr.34373) 11540 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:05.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.138356+0000 mgr.gibba043.dnkmem (mgr.34373) 11541 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:05.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.142748+0000 mgr.gibba043.dnkmem (mgr.34373) 11542 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:05.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.143055+0000 mgr.gibba043.dnkmem (mgr.34373) 11543 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:05.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:04 gibba043 bash[24019]: cephadm 2021-03-10T17:30:03.143979+0000 mgr.gibba043.dnkmem (mgr.34373) 11544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:06.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:05 gibba003 bash[31385]: cluster 2021-03-10T17:30:04.823558+0000 mgr.gibba043.dnkmem (mgr.34373) 11545 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:05 gibba003 bash[32348]: cluster 2021-03-10T17:30:04.823558+0000 mgr.gibba043.dnkmem (mgr.34373) 11545 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:05 gibba043 bash[24019]: cluster 2021-03-10T17:30:04.823558+0000 mgr.gibba043.dnkmem (mgr.34373) 11545 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:07 gibba003 bash[31385]: cluster 2021-03-10T17:30:06.825107+0000 mgr.gibba043.dnkmem (mgr.34373) 11546 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:07 gibba003 bash[32348]: cluster 2021-03-10T17:30:06.825107+0000 mgr.gibba043.dnkmem (mgr.34373) 11546 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:07 gibba043 bash[24019]: cluster 2021-03-10T17:30:06.825107+0000 mgr.gibba043.dnkmem (mgr.34373) 11546 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:09.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:09 gibba003 bash[31385]: cluster 2021-03-10T17:30:08.825851+0000 mgr.gibba043.dnkmem (mgr.34373) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:09.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:09 gibba003 bash[32348]: cluster 2021-03-10T17:30:08.825851+0000 mgr.gibba043.dnkmem (mgr.34373) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:09 gibba043 bash[24019]: cluster 2021-03-10T17:30:08.825851+0000 mgr.gibba043.dnkmem (mgr.34373) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:11 gibba003 bash[31385]: cluster 2021-03-10T17:30:10.827240+0000 mgr.gibba043.dnkmem (mgr.34373) 11548 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:11 gibba003 bash[32348]: cluster 2021-03-10T17:30:10.827240+0000 mgr.gibba043.dnkmem (mgr.34373) 11548 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:11 gibba043 bash[24019]: cluster 2021-03-10T17:30:10.827240+0000 mgr.gibba043.dnkmem (mgr.34373) 11548 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.892 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:30:13.128 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:30:13.129 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 10s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:30:13.129 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:30:13.129 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:30:13.129 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:30:13.130 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:30:13.130 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:30:13.130 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:30:13.130 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:30:13.131 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 10s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:30:13.131 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:30:13.131 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:30:13.131 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:30:13.131 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:30:13.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 10s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:30:13.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:30:13.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:30:13.132 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:30:13.133 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:30:13.133 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:30:13.133 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 10s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:30:13.383 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:30:13.383 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:30:13.383 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:13.383 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:30:13.384 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:30:13.384 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:13.384 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:30:13.384 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:30:13.385 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:30:13.385 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:30:13.385 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:30:13.385 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:30:13.385 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:30:13.386 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:30:13.386 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:30:14.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:13 gibba003 bash[31385]: cluster 2021-03-10T17:30:12.828780+0000 mgr.gibba043.dnkmem (mgr.34373) 11549 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:13 gibba003 bash[31385]: audit 2021-03-10T17:30:12.881198+0000 mgr.gibba043.dnkmem (mgr.34373) 11550 : audit [DBG] from='client.61780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:14.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:13 gibba003 bash[31385]: audit 2021-03-10T17:30:13.382636+0000 mon.a (mon.0) 2294 : audit [DBG] from='client.? 172.21.2.103:0/2343787905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:13 gibba003 bash[32348]: cluster 2021-03-10T17:30:12.828780+0000 mgr.gibba043.dnkmem (mgr.34373) 11549 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:13 gibba003 bash[32348]: audit 2021-03-10T17:30:12.881198+0000 mgr.gibba043.dnkmem (mgr.34373) 11550 : audit [DBG] from='client.61780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:14.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:13 gibba003 bash[32348]: audit 2021-03-10T17:30:13.382636+0000 mon.a (mon.0) 2294 : audit [DBG] from='client.? 172.21.2.103:0/2343787905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:13 gibba043 bash[24019]: cluster 2021-03-10T17:30:12.828780+0000 mgr.gibba043.dnkmem (mgr.34373) 11549 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:13 gibba043 bash[24019]: audit 2021-03-10T17:30:12.881198+0000 mgr.gibba043.dnkmem (mgr.34373) 11550 : audit [DBG] from='client.61780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:14.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:13 gibba043 bash[24019]: audit 2021-03-10T17:30:13.382636+0000 mon.a (mon.0) 2294 : audit [DBG] from='client.? 172.21.2.103:0/2343787905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:13.114340+0000 mgr.gibba043.dnkmem (mgr.34373) 11551 : audit [DBG] from='client.61786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.136650+0000 mon.c (mon.1) 2966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:15.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.137777+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.379812+0000 mon.c (mon.1) 2967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.380946+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.746192+0000 mon.c (mon.1) 2968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:30:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.747198+0000 mon.c (mon.1) 2969 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.0", "id": [3, 2]}]: dispatch 2021-03-10T17:30:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.747445+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:30:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.747906+0000 mon.c (mon.1) 2970 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.748686+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.0", "id": [3, 2]}]: dispatch 2021-03-10T17:30:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.748791+0000 mon.c (mon.1) 2971 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.749471+0000 mon.c (mon.1) 2972 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.750028+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.750295+0000 mon.c (mon.1) 2973 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [3, 5]}]: dispatch 2021-03-10T17:30:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.750707+0000 mon.c (mon.1) 2974 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.750754+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.751124+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.751315+0000 mon.a (mon.0) 2302 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [3, 5]}]: dispatch 2021-03-10T17:30:15.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[31385]: audit 2021-03-10T17:30:14.751521+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:13.114340+0000 mgr.gibba043.dnkmem (mgr.34373) 11551 : audit [DBG] from='client.61786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.136650+0000 mon.c (mon.1) 2966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.137777+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.379812+0000 mon.c (mon.1) 2967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.380946+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:15.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.746192+0000 mon.c (mon.1) 2968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:30:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.747198+0000 mon.c (mon.1) 2969 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.0", "id": [3, 2]}]: dispatch 2021-03-10T17:30:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.747445+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:30:15.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.747906+0000 mon.c (mon.1) 2970 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.748686+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.0", "id": [3, 2]}]: dispatch 2021-03-10T17:30:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.748791+0000 mon.c (mon.1) 2971 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.749471+0000 mon.c (mon.1) 2972 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.750028+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.750295+0000 mon.c (mon.1) 2973 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [3, 5]}]: dispatch 2021-03-10T17:30:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.750707+0000 mon.c (mon.1) 2974 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.750754+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.751124+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.751315+0000 mon.a (mon.0) 2302 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [3, 5]}]: dispatch 2021-03-10T17:30:15.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:14 gibba003 bash[32348]: audit 2021-03-10T17:30:14.751521+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:13.114340+0000 mgr.gibba043.dnkmem (mgr.34373) 11551 : audit [DBG] from='client.61786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.136650+0000 mon.c (mon.1) 2966 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.137777+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.379812+0000 mon.c (mon.1) 2967 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.380946+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.746192+0000 mon.c (mon.1) 2968 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:30:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.747198+0000 mon.c (mon.1) 2969 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.0", "id": [3, 2]}]: dispatch 2021-03-10T17:30:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.747445+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:30:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.747906+0000 mon.c (mon.1) 2970 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.748686+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.0", "id": [3, 2]}]: dispatch 2021-03-10T17:30:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.748791+0000 mon.c (mon.1) 2971 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.749471+0000 mon.c (mon.1) 2972 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.750028+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.750295+0000 mon.c (mon.1) 2973 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [3, 5]}]: dispatch 2021-03-10T17:30:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.750707+0000 mon.c (mon.1) 2974 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:30:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.750754+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.751124+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 0]}]: dispatch 2021-03-10T17:30:15.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.751315+0000 mon.a (mon.0) 2302 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [3, 5]}]: dispatch 2021-03-10T17:30:15.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:14 gibba043 bash[24019]: audit 2021-03-10T17:30:14.751521+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:30:16.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:15 gibba003 bash[31385]: cluster 2021-03-10T17:30:14.830363+0000 mgr.gibba043.dnkmem (mgr.34373) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.308 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:15 gibba003 bash[32348]: cluster 2021-03-10T17:30:14.830363+0000 mgr.gibba043.dnkmem (mgr.34373) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.309 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:15 gibba043 bash[24019]: cluster 2021-03-10T17:30:14.830363+0000 mgr.gibba043.dnkmem (mgr.34373) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:17 gibba003 bash[31385]: cluster 2021-03-10T17:30:16.832071+0000 mgr.gibba043.dnkmem (mgr.34373) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:17 gibba003 bash[32348]: cluster 2021-03-10T17:30:16.832071+0000 mgr.gibba043.dnkmem (mgr.34373) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:17 gibba043 bash[24019]: cluster 2021-03-10T17:30:16.832071+0000 mgr.gibba043.dnkmem (mgr.34373) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:19 gibba003 bash[31385]: cephadm 2021-03-10T17:30:18.160247+0000 mgr.gibba043.dnkmem (mgr.34373) 11554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:19 gibba003 bash[31385]: cluster 2021-03-10T17:30:18.832938+0000 mgr.gibba043.dnkmem (mgr.34373) 11555 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:19 gibba003 bash[32348]: cephadm 2021-03-10T17:30:18.160247+0000 mgr.gibba043.dnkmem (mgr.34373) 11554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:19 gibba003 bash[32348]: cluster 2021-03-10T17:30:18.832938+0000 mgr.gibba043.dnkmem (mgr.34373) 11555 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:19 gibba043 bash[24019]: cephadm 2021-03-10T17:30:18.160247+0000 mgr.gibba043.dnkmem (mgr.34373) 11554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:19 gibba043 bash[24019]: cluster 2021-03-10T17:30:18.832938+0000 mgr.gibba043.dnkmem (mgr.34373) 11555 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:21 gibba003 bash[31385]: cluster 2021-03-10T17:30:20.834145+0000 mgr.gibba043.dnkmem (mgr.34373) 11556 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:21 gibba003 bash[32348]: cluster 2021-03-10T17:30:20.834145+0000 mgr.gibba043.dnkmem (mgr.34373) 11556 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:21 gibba043 bash[24019]: cluster 2021-03-10T17:30:20.834145+0000 mgr.gibba043.dnkmem (mgr.34373) 11556 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:23 gibba003 bash[31385]: cluster 2021-03-10T17:30:22.835502+0000 mgr.gibba043.dnkmem (mgr.34373) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:23 gibba003 bash[32348]: cluster 2021-03-10T17:30:22.835502+0000 mgr.gibba043.dnkmem (mgr.34373) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:23 gibba043 bash[24019]: cluster 2021-03-10T17:30:22.835502+0000 mgr.gibba043.dnkmem (mgr.34373) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:25 gibba003 bash[31385]: cluster 2021-03-10T17:30:24.837166+0000 mgr.gibba043.dnkmem (mgr.34373) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:25 gibba003 bash[32348]: cluster 2021-03-10T17:30:24.837166+0000 mgr.gibba043.dnkmem (mgr.34373) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:25 gibba043 bash[24019]: cluster 2021-03-10T17:30:24.837166+0000 mgr.gibba043.dnkmem (mgr.34373) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:27 gibba003 bash[31385]: cluster 2021-03-10T17:30:26.838889+0000 mgr.gibba043.dnkmem (mgr.34373) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:27 gibba003 bash[32348]: cluster 2021-03-10T17:30:26.838889+0000 mgr.gibba043.dnkmem (mgr.34373) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:27 gibba043 bash[24019]: cluster 2021-03-10T17:30:26.838889+0000 mgr.gibba043.dnkmem (mgr.34373) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:29 gibba003 bash[31385]: cluster 2021-03-10T17:30:28.839869+0000 mgr.gibba043.dnkmem (mgr.34373) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:29 gibba003 bash[32348]: cluster 2021-03-10T17:30:28.839869+0000 mgr.gibba043.dnkmem (mgr.34373) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:29 gibba043 bash[24019]: cluster 2021-03-10T17:30:28.839869+0000 mgr.gibba043.dnkmem (mgr.34373) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:31 gibba003 bash[31385]: cluster 2021-03-10T17:30:30.841475+0000 mgr.gibba043.dnkmem (mgr.34373) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:31 gibba003 bash[32348]: cluster 2021-03-10T17:30:30.841475+0000 mgr.gibba043.dnkmem (mgr.34373) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:31 gibba043 bash[24019]: cluster 2021-03-10T17:30:30.841475+0000 mgr.gibba043.dnkmem (mgr.34373) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:33 gibba003 bash[31385]: cluster 2021-03-10T17:30:32.843010+0000 mgr.gibba043.dnkmem (mgr.34373) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:33 gibba003 bash[32348]: cluster 2021-03-10T17:30:32.843010+0000 mgr.gibba043.dnkmem (mgr.34373) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:33 gibba043 bash[24019]: cluster 2021-03-10T17:30:32.843010+0000 mgr.gibba043.dnkmem (mgr.34373) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:35.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:34 gibba003 bash[31385]: cephadm 2021-03-10T17:30:33.176092+0000 mgr.gibba043.dnkmem (mgr.34373) 11563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:35.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:34 gibba003 bash[32348]: cephadm 2021-03-10T17:30:33.176092+0000 mgr.gibba043.dnkmem (mgr.34373) 11563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:35.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:34 gibba043 bash[24019]: cephadm 2021-03-10T17:30:33.176092+0000 mgr.gibba043.dnkmem (mgr.34373) 11563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:36.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:35 gibba003 bash[31385]: cluster 2021-03-10T17:30:34.844792+0000 mgr.gibba043.dnkmem (mgr.34373) 11564 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:35 gibba003 bash[32348]: cluster 2021-03-10T17:30:34.844792+0000 mgr.gibba043.dnkmem (mgr.34373) 11564 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:35 gibba043 bash[24019]: cluster 2021-03-10T17:30:34.844792+0000 mgr.gibba043.dnkmem (mgr.34373) 11564 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.190 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:37 gibba003 bash[31385]: cluster 2021-03-10T17:30:36.846425+0000 mgr.gibba043.dnkmem (mgr.34373) 11565 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:37 gibba003 bash[32348]: cluster 2021-03-10T17:30:36.846425+0000 mgr.gibba043.dnkmem (mgr.34373) 11565 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:37 gibba043 bash[24019]: cluster 2021-03-10T17:30:36.846425+0000 mgr.gibba043.dnkmem (mgr.34373) 11565 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:39 gibba003 bash[31385]: cluster 2021-03-10T17:30:38.847248+0000 mgr.gibba043.dnkmem (mgr.34373) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:39 gibba003 bash[32348]: cluster 2021-03-10T17:30:38.847248+0000 mgr.gibba043.dnkmem (mgr.34373) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:39 gibba043 bash[24019]: cluster 2021-03-10T17:30:38.847248+0000 mgr.gibba043.dnkmem (mgr.34373) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:41 gibba003 bash[31385]: cluster 2021-03-10T17:30:40.848554+0000 mgr.gibba043.dnkmem (mgr.34373) 11567 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:41 gibba003 bash[32348]: cluster 2021-03-10T17:30:40.848554+0000 mgr.gibba043.dnkmem (mgr.34373) 11567 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:41 gibba043 bash[24019]: cluster 2021-03-10T17:30:40.848554+0000 mgr.gibba043.dnkmem (mgr.34373) 11567 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:43.624 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:30:43.847 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:30:43.848 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 40s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:30:43.848 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:30:43.848 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:30:43.848 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:30:43.848 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:30:43.849 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:30:43.849 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:30:43.849 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:30:43.850 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 40s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:30:43.850 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:30:43.850 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:30:43.850 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:30:43.851 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:30:43.851 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 40s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:30:43.851 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:30:43.851 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:30:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:30:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:30:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:30:43.852 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 40s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:30:44.097 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:30:44.098 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:30:44.098 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:44.098 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:30:44.099 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:30:44.099 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:44.099 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:30:44.099 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:30:44.099 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:30:44.100 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:30:44.100 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:30:44.100 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:30:44.100 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:30:44.100 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:30:44.101 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:30:44.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:43 gibba003 bash[31385]: cluster 2021-03-10T17:30:42.850088+0000 mgr.gibba043.dnkmem (mgr.34373) 11568 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:43 gibba003 bash[32348]: cluster 2021-03-10T17:30:42.850088+0000 mgr.gibba043.dnkmem (mgr.34373) 11568 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:43 gibba043 bash[24019]: cluster 2021-03-10T17:30:42.850088+0000 mgr.gibba043.dnkmem (mgr.34373) 11568 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:45.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:44 gibba003 bash[31385]: audit 2021-03-10T17:30:43.613789+0000 mgr.gibba043.dnkmem (mgr.34373) 11569 : audit [DBG] from='client.51807 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:44 gibba003 bash[31385]: audit 2021-03-10T17:30:43.835426+0000 mgr.gibba043.dnkmem (mgr.34373) 11570 : audit [DBG] from='client.61804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:44 gibba003 bash[31385]: audit 2021-03-10T17:30:44.097374+0000 mon.c (mon.1) 2975 : audit [DBG] from='client.? 172.21.2.103:0/51575573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:45.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:44 gibba003 bash[32348]: audit 2021-03-10T17:30:43.613789+0000 mgr.gibba043.dnkmem (mgr.34373) 11569 : audit [DBG] from='client.51807 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:44 gibba003 bash[32348]: audit 2021-03-10T17:30:43.835426+0000 mgr.gibba043.dnkmem (mgr.34373) 11570 : audit [DBG] from='client.61804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:44 gibba003 bash[32348]: audit 2021-03-10T17:30:44.097374+0000 mon.c (mon.1) 2975 : audit [DBG] from='client.? 172.21.2.103:0/51575573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:44 gibba043 bash[24019]: audit 2021-03-10T17:30:43.613789+0000 mgr.gibba043.dnkmem (mgr.34373) 11569 : audit [DBG] from='client.51807 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:45.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:44 gibba043 bash[24019]: audit 2021-03-10T17:30:43.835426+0000 mgr.gibba043.dnkmem (mgr.34373) 11570 : audit [DBG] from='client.61804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:44 gibba043 bash[24019]: audit 2021-03-10T17:30:44.097374+0000 mon.c (mon.1) 2975 : audit [DBG] from='client.? 172.21.2.103:0/51575573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:46.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:45 gibba003 bash[31385]: cluster 2021-03-10T17:30:44.851993+0000 mgr.gibba043.dnkmem (mgr.34373) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:45 gibba003 bash[32348]: cluster 2021-03-10T17:30:44.851993+0000 mgr.gibba043.dnkmem (mgr.34373) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:45 gibba043 bash[24019]: cluster 2021-03-10T17:30:44.851993+0000 mgr.gibba043.dnkmem (mgr.34373) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:47 gibba043 bash[24019]: cluster 2021-03-10T17:30:46.853675+0000 mgr.gibba043.dnkmem (mgr.34373) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:47 gibba003 bash[31385]: cluster 2021-03-10T17:30:46.853675+0000 mgr.gibba043.dnkmem (mgr.34373) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:47 gibba003 bash[32348]: cluster 2021-03-10T17:30:46.853675+0000 mgr.gibba043.dnkmem (mgr.34373) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:49 gibba043 bash[24019]: cephadm 2021-03-10T17:30:48.192221+0000 mgr.gibba043.dnkmem (mgr.34373) 11573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:49 gibba043 bash[24019]: cluster 2021-03-10T17:30:48.854566+0000 mgr.gibba043.dnkmem (mgr.34373) 11574 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:49 gibba003 bash[31385]: cephadm 2021-03-10T17:30:48.192221+0000 mgr.gibba043.dnkmem (mgr.34373) 11573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:49 gibba003 bash[31385]: cluster 2021-03-10T17:30:48.854566+0000 mgr.gibba043.dnkmem (mgr.34373) 11574 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:49 gibba003 bash[32348]: cephadm 2021-03-10T17:30:48.192221+0000 mgr.gibba043.dnkmem (mgr.34373) 11573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:30:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:49 gibba003 bash[32348]: cluster 2021-03-10T17:30:48.854566+0000 mgr.gibba043.dnkmem (mgr.34373) 11574 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:52.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:51 gibba003 bash[31385]: cluster 2021-03-10T17:30:50.856137+0000 mgr.gibba043.dnkmem (mgr.34373) 11575 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:52.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:51 gibba003 bash[32348]: cluster 2021-03-10T17:30:50.856137+0000 mgr.gibba043.dnkmem (mgr.34373) 11575 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:51 gibba043 bash[24019]: cluster 2021-03-10T17:30:50.856137+0000 mgr.gibba043.dnkmem (mgr.34373) 11575 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:53 gibba003 bash[31385]: cluster 2021-03-10T17:30:52.857345+0000 mgr.gibba043.dnkmem (mgr.34373) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:53 gibba003 bash[32348]: cluster 2021-03-10T17:30:52.857345+0000 mgr.gibba043.dnkmem (mgr.34373) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:53 gibba043 bash[24019]: cluster 2021-03-10T17:30:52.857345+0000 mgr.gibba043.dnkmem (mgr.34373) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:55 gibba003 bash[31385]: cluster 2021-03-10T17:30:54.858949+0000 mgr.gibba043.dnkmem (mgr.34373) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:55 gibba003 bash[32348]: cluster 2021-03-10T17:30:54.858949+0000 mgr.gibba043.dnkmem (mgr.34373) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:55 gibba043 bash[24019]: cluster 2021-03-10T17:30:54.858949+0000 mgr.gibba043.dnkmem (mgr.34373) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:57 gibba043 bash[24019]: cluster 2021-03-10T17:30:56.860637+0000 mgr.gibba043.dnkmem (mgr.34373) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:57 gibba003 bash[31385]: cluster 2021-03-10T17:30:56.860637+0000 mgr.gibba043.dnkmem (mgr.34373) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:57 gibba003 bash[32348]: cluster 2021-03-10T17:30:56.860637+0000 mgr.gibba043.dnkmem (mgr.34373) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:30:59 gibba043 bash[24019]: cluster 2021-03-10T17:30:58.861495+0000 mgr.gibba043.dnkmem (mgr.34373) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:30:59 gibba003 bash[31385]: cluster 2021-03-10T17:30:58.861495+0000 mgr.gibba043.dnkmem (mgr.34373) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:59.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:30:59 gibba003 bash[32348]: cluster 2021-03-10T17:30:58.861495+0000 mgr.gibba043.dnkmem (mgr.34373) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:01 gibba003 bash[31385]: cluster 2021-03-10T17:31:00.862970+0000 mgr.gibba043.dnkmem (mgr.34373) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.191 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:01 gibba003 bash[32348]: cluster 2021-03-10T17:31:00.862970+0000 mgr.gibba043.dnkmem (mgr.34373) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:01 gibba043 bash[24019]: cluster 2021-03-10T17:31:00.862970+0000 mgr.gibba043.dnkmem (mgr.34373) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:03 gibba003 bash[31385]: cluster 2021-03-10T17:31:02.864520+0000 mgr.gibba043.dnkmem (mgr.34373) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:03 gibba003 bash[31385]: audit 2021-03-10T17:31:03.206637+0000 mon.c (mon.1) 2976 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:31:04.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:03 gibba003 bash[32348]: cluster 2021-03-10T17:31:02.864520+0000 mgr.gibba043.dnkmem (mgr.34373) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:03 gibba003 bash[32348]: audit 2021-03-10T17:31:03.206637+0000 mon.c (mon.1) 2976 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:31:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:03 gibba043 bash[24019]: cluster 2021-03-10T17:31:02.864520+0000 mgr.gibba043.dnkmem (mgr.34373) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:03 gibba043 bash[24019]: audit 2021-03-10T17:31:03.206637+0000 mon.c (mon.1) 2976 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:31:05.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:04 gibba043 bash[24019]: cephadm 2021-03-10T17:31:03.204377+0000 mgr.gibba043.dnkmem (mgr.34373) 11582 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:31:05.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:04 gibba003 bash[31385]: cephadm 2021-03-10T17:31:03.204377+0000 mgr.gibba043.dnkmem (mgr.34373) 11582 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:31:05.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:04 gibba003 bash[32348]: cephadm 2021-03-10T17:31:03.204377+0000 mgr.gibba043.dnkmem (mgr.34373) 11582 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:31:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:05 gibba043 bash[24019]: cluster 2021-03-10T17:31:04.866267+0000 mgr.gibba043.dnkmem (mgr.34373) 11583 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:06.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:05 gibba003 bash[31385]: cluster 2021-03-10T17:31:04.866267+0000 mgr.gibba043.dnkmem (mgr.34373) 11583 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:05 gibba003 bash[32348]: cluster 2021-03-10T17:31:04.866267+0000 mgr.gibba043.dnkmem (mgr.34373) 11583 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: cluster 2021-03-10T17:31:06.867162+0000 mgr.gibba043.dnkmem (mgr.34373) 11584 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: cephadm 2021-03-10T17:31:06.956604+0000 mgr.gibba043.dnkmem (mgr.34373) 11585 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:31:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:06.956718+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:31:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.157469+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:31:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.161261+0000 mon.c (mon.1) 2977 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:08.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.162871+0000 mon.c (mon.1) 2978 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.164376+0000 mon.c (mon.1) 2979 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.165716+0000 mon.c (mon.1) 2980 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.168500+0000 mon.c (mon.1) 2981 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:07 gibba043 bash[24019]: audit 2021-03-10T17:31:07.170219+0000 mon.c (mon.1) 2982 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: cluster 2021-03-10T17:31:06.867162+0000 mgr.gibba043.dnkmem (mgr.34373) 11584 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: cephadm 2021-03-10T17:31:06.956604+0000 mgr.gibba043.dnkmem (mgr.34373) 11585 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:31:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:06.956718+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:31:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.157469+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:31:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.161261+0000 mon.c (mon.1) 2977 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.162871+0000 mon.c (mon.1) 2978 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.164376+0000 mon.c (mon.1) 2979 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.165716+0000 mon.c (mon.1) 2980 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.168500+0000 mon.c (mon.1) 2981 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[31385]: audit 2021-03-10T17:31:07.170219+0000 mon.c (mon.1) 2982 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: cluster 2021-03-10T17:31:06.867162+0000 mgr.gibba043.dnkmem (mgr.34373) 11584 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: cephadm 2021-03-10T17:31:06.956604+0000 mgr.gibba043.dnkmem (mgr.34373) 11585 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:31:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:06.956718+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:31:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.157469+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:31:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.161261+0000 mon.c (mon.1) 2977 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.162871+0000 mon.c (mon.1) 2978 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.164376+0000 mon.c (mon.1) 2979 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.165716+0000 mon.c (mon.1) 2980 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.168500+0000 mon.c (mon.1) 2981 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:08.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:07 gibba003 bash[32348]: audit 2021-03-10T17:31:07.170219+0000 mon.c (mon.1) 2982 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.158989+0000 mgr.gibba043.dnkmem (mgr.34373) 11586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:31:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.160935+0000 mgr.gibba043.dnkmem (mgr.34373) 11587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:31:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.162418+0000 mgr.gibba043.dnkmem (mgr.34373) 11588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:31:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.162488+0000 mgr.gibba043.dnkmem (mgr.34373) 11589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:31:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.163809+0000 mgr.gibba043.dnkmem (mgr.34373) 11590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:31:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.163848+0000 mgr.gibba043.dnkmem (mgr.34373) 11591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:31:09.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.165018+0000 mgr.gibba043.dnkmem (mgr.34373) 11592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:31:09.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.166524+0000 mgr.gibba043.dnkmem (mgr.34373) 11593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:31:09.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.166561+0000 mgr.gibba043.dnkmem (mgr.34373) 11594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:31:09.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.167874+0000 mgr.gibba043.dnkmem (mgr.34373) 11595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:31:09.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.168185+0000 mgr.gibba043.dnkmem (mgr.34373) 11596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:31:09.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.169748+0000 mgr.gibba043.dnkmem (mgr.34373) 11597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:31:09.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.169785+0000 mgr.gibba043.dnkmem (mgr.34373) 11598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:31:09.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:08 gibba043 bash[24019]: cephadm 2021-03-10T17:31:07.169887+0000 mgr.gibba043.dnkmem (mgr.34373) 11599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.158989+0000 mgr.gibba043.dnkmem (mgr.34373) 11586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:31:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.160935+0000 mgr.gibba043.dnkmem (mgr.34373) 11587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:31:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.162418+0000 mgr.gibba043.dnkmem (mgr.34373) 11588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:31:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.162488+0000 mgr.gibba043.dnkmem (mgr.34373) 11589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:31:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.163809+0000 mgr.gibba043.dnkmem (mgr.34373) 11590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:31:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.163848+0000 mgr.gibba043.dnkmem (mgr.34373) 11591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:31:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.165018+0000 mgr.gibba043.dnkmem (mgr.34373) 11592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:31:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.166524+0000 mgr.gibba043.dnkmem (mgr.34373) 11593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:31:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.166561+0000 mgr.gibba043.dnkmem (mgr.34373) 11594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:31:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.167874+0000 mgr.gibba043.dnkmem (mgr.34373) 11595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:31:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.168185+0000 mgr.gibba043.dnkmem (mgr.34373) 11596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:31:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.169748+0000 mgr.gibba043.dnkmem (mgr.34373) 11597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:31:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.169785+0000 mgr.gibba043.dnkmem (mgr.34373) 11598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:31:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[31385]: cephadm 2021-03-10T17:31:07.169887+0000 mgr.gibba043.dnkmem (mgr.34373) 11599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.158989+0000 mgr.gibba043.dnkmem (mgr.34373) 11586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:31:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.160935+0000 mgr.gibba043.dnkmem (mgr.34373) 11587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:31:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.162418+0000 mgr.gibba043.dnkmem (mgr.34373) 11588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:31:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.162488+0000 mgr.gibba043.dnkmem (mgr.34373) 11589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:31:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.163809+0000 mgr.gibba043.dnkmem (mgr.34373) 11590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:31:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.163848+0000 mgr.gibba043.dnkmem (mgr.34373) 11591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:31:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.165018+0000 mgr.gibba043.dnkmem (mgr.34373) 11592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:31:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.166524+0000 mgr.gibba043.dnkmem (mgr.34373) 11593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:31:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.166561+0000 mgr.gibba043.dnkmem (mgr.34373) 11594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:31:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.167874+0000 mgr.gibba043.dnkmem (mgr.34373) 11595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:31:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.168185+0000 mgr.gibba043.dnkmem (mgr.34373) 11596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:31:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.169748+0000 mgr.gibba043.dnkmem (mgr.34373) 11597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:31:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.169785+0000 mgr.gibba043.dnkmem (mgr.34373) 11598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:31:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:08 gibba003 bash[32348]: cephadm 2021-03-10T17:31:07.169887+0000 mgr.gibba043.dnkmem (mgr.34373) 11599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:09 gibba043 bash[24019]: cluster 2021-03-10T17:31:08.868088+0000 mgr.gibba043.dnkmem (mgr.34373) 11600 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:10.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:09 gibba003 bash[31385]: cluster 2021-03-10T17:31:08.868088+0000 mgr.gibba043.dnkmem (mgr.34373) 11600 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:10.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:09 gibba003 bash[32348]: cluster 2021-03-10T17:31:08.868088+0000 mgr.gibba043.dnkmem (mgr.34373) 11600 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:11 gibba043 bash[24019]: cluster 2021-03-10T17:31:10.869594+0000 mgr.gibba043.dnkmem (mgr.34373) 11601 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:12.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:11 gibba003 bash[31385]: cluster 2021-03-10T17:31:10.869594+0000 mgr.gibba043.dnkmem (mgr.34373) 11601 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:12.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:11 gibba003 bash[32348]: cluster 2021-03-10T17:31:10.869594+0000 mgr.gibba043.dnkmem (mgr.34373) 11601 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:13 gibba043 bash[24019]: cluster 2021-03-10T17:31:12.871069+0000 mgr.gibba043.dnkmem (mgr.34373) 11602 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.338 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:31:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:13 gibba003 bash[31385]: cluster 2021-03-10T17:31:12.871069+0000 mgr.gibba043.dnkmem (mgr.34373) 11602 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:13 gibba003 bash[32348]: cluster 2021-03-10T17:31:12.871069+0000 mgr.gibba043.dnkmem (mgr.34373) 11602 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.567 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:31:14.567 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 71s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:31:14.568 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:31:14.568 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:31:14.568 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:31:14.568 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:31:14.568 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:31:14.569 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:31:14.569 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:31:14.569 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 71s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:31:14.570 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:31:14.570 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:31:14.570 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:31:14.570 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:31:14.570 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 71s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:31:14.571 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:31:14.571 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:31:14.571 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:31:14.571 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:31:14.572 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:31:14.572 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 71s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:31:14.818 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:31:14.818 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:31:14.818 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:14.819 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:31:14.819 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:31:14.819 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:14.819 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:31:14.820 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:31:14.820 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:31:14.820 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:31:14.820 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:31:14.821 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:31:14.821 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:31:14.821 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:31:14.821 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:31:15.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.143043+0000 mon.c (mon.1) 2983 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.143506+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.385502+0000 mon.c (mon.1) 2984 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:15.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.385868+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.756790+0000 mon.c (mon.1) 2985 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:31:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.756993+0000 mon.c (mon.1) 2986 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.757165+0000 mon.c (mon.1) 2987 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:31:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.757256+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:31:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.757409+0000 mon.c (mon.1) 2988 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.757651+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.757918+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:31:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.758127+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:14 gibba043 bash[24019]: audit 2021-03-10T17:31:14.817411+0000 mon.a (mon.0) 2312 : audit [DBG] from='client.? 172.21.2.103:0/1456269357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.143043+0000 mon.c (mon.1) 2983 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.143506+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.385502+0000 mon.c (mon.1) 2984 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.385868+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.756790+0000 mon.c (mon.1) 2985 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:31:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.756993+0000 mon.c (mon.1) 2986 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.757165+0000 mon.c (mon.1) 2987 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:31:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.757256+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:31:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.757409+0000 mon.c (mon.1) 2988 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.757651+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.757918+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:31:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.758127+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[31385]: audit 2021-03-10T17:31:14.817411+0000 mon.a (mon.0) 2312 : audit [DBG] from='client.? 172.21.2.103:0/1456269357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.143043+0000 mon.c (mon.1) 2983 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.143506+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.385502+0000 mon.c (mon.1) 2984 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.385868+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.756790+0000 mon.c (mon.1) 2985 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:31:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.756993+0000 mon.c (mon.1) 2986 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.757165+0000 mon.c (mon.1) 2987 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:31:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.757256+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:31:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.757409+0000 mon.c (mon.1) 2988 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.757651+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.757918+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:31:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.758127+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:31:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:14 gibba003 bash[32348]: audit 2021-03-10T17:31:14.817411+0000 mon.a (mon.0) 2312 : audit [DBG] from='client.? 172.21.2.103:0/1456269357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:16.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:16 gibba043 bash[24019]: audit 2021-03-10T17:31:14.327846+0000 mgr.gibba043.dnkmem (mgr.34373) 11603 : audit [DBG] from='client.61816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:16.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:16 gibba043 bash[24019]: audit 2021-03-10T17:31:14.553288+0000 mgr.gibba043.dnkmem (mgr.34373) 11604 : audit [DBG] from='client.51831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:16.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:16 gibba043 bash[24019]: cluster 2021-03-10T17:31:14.872577+0000 mgr.gibba043.dnkmem (mgr.34373) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:16 gibba003 bash[31385]: audit 2021-03-10T17:31:14.327846+0000 mgr.gibba043.dnkmem (mgr.34373) 11603 : audit [DBG] from='client.61816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:16 gibba003 bash[31385]: audit 2021-03-10T17:31:14.553288+0000 mgr.gibba043.dnkmem (mgr.34373) 11604 : audit [DBG] from='client.51831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:16 gibba003 bash[31385]: cluster 2021-03-10T17:31:14.872577+0000 mgr.gibba043.dnkmem (mgr.34373) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:16 gibba003 bash[32348]: audit 2021-03-10T17:31:14.327846+0000 mgr.gibba043.dnkmem (mgr.34373) 11603 : audit [DBG] from='client.61816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:16 gibba003 bash[32348]: audit 2021-03-10T17:31:14.553288+0000 mgr.gibba043.dnkmem (mgr.34373) 11604 : audit [DBG] from='client.51831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:16.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:16 gibba003 bash[32348]: cluster 2021-03-10T17:31:14.872577+0000 mgr.gibba043.dnkmem (mgr.34373) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:18.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:18 gibba043 bash[24019]: cluster 2021-03-10T17:31:16.874161+0000 mgr.gibba043.dnkmem (mgr.34373) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:18 gibba003 bash[31385]: cluster 2021-03-10T17:31:16.874161+0000 mgr.gibba043.dnkmem (mgr.34373) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:18 gibba003 bash[32348]: cluster 2021-03-10T17:31:16.874161+0000 mgr.gibba043.dnkmem (mgr.34373) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:19 gibba043 bash[24019]: cluster 2021-03-10T17:31:18.875007+0000 mgr.gibba043.dnkmem (mgr.34373) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:19 gibba003 bash[31385]: cluster 2021-03-10T17:31:18.875007+0000 mgr.gibba043.dnkmem (mgr.34373) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:19 gibba003 bash[32348]: cluster 2021-03-10T17:31:18.875007+0000 mgr.gibba043.dnkmem (mgr.34373) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:22.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:21 gibba003 bash[31385]: cluster 2021-03-10T17:31:20.876574+0000 mgr.gibba043.dnkmem (mgr.34373) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:22.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:21 gibba003 bash[32348]: cluster 2021-03-10T17:31:20.876574+0000 mgr.gibba043.dnkmem (mgr.34373) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:21 gibba043 bash[24019]: cluster 2021-03-10T17:31:20.876574+0000 mgr.gibba043.dnkmem (mgr.34373) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:23 gibba043 bash[24019]: cephadm 2021-03-10T17:31:22.171263+0000 mgr.gibba043.dnkmem (mgr.34373) 11609 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:23 gibba043 bash[24019]: cluster 2021-03-10T17:31:22.878042+0000 mgr.gibba043.dnkmem (mgr.34373) 11610 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:23 gibba003 bash[31385]: cephadm 2021-03-10T17:31:22.171263+0000 mgr.gibba043.dnkmem (mgr.34373) 11609 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:23 gibba003 bash[31385]: cluster 2021-03-10T17:31:22.878042+0000 mgr.gibba043.dnkmem (mgr.34373) 11610 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:24.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:23 gibba003 bash[32348]: cephadm 2021-03-10T17:31:22.171263+0000 mgr.gibba043.dnkmem (mgr.34373) 11609 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:24.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:23 gibba003 bash[32348]: cluster 2021-03-10T17:31:22.878042+0000 mgr.gibba043.dnkmem (mgr.34373) 11610 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:25 gibba043 bash[24019]: cluster 2021-03-10T17:31:24.879563+0000 mgr.gibba043.dnkmem (mgr.34373) 11611 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:25 gibba003 bash[31385]: cluster 2021-03-10T17:31:24.879563+0000 mgr.gibba043.dnkmem (mgr.34373) 11611 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:26.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:25 gibba003 bash[32348]: cluster 2021-03-10T17:31:24.879563+0000 mgr.gibba043.dnkmem (mgr.34373) 11611 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:27 gibba043 bash[24019]: cluster 2021-03-10T17:31:26.881147+0000 mgr.gibba043.dnkmem (mgr.34373) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:27 gibba003 bash[31385]: cluster 2021-03-10T17:31:26.881147+0000 mgr.gibba043.dnkmem (mgr.34373) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:27 gibba003 bash[32348]: cluster 2021-03-10T17:31:26.881147+0000 mgr.gibba043.dnkmem (mgr.34373) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:29 gibba043 bash[24019]: cluster 2021-03-10T17:31:28.882108+0000 mgr.gibba043.dnkmem (mgr.34373) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:29 gibba003 bash[31385]: cluster 2021-03-10T17:31:28.882108+0000 mgr.gibba043.dnkmem (mgr.34373) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:29 gibba003 bash[32348]: cluster 2021-03-10T17:31:28.882108+0000 mgr.gibba043.dnkmem (mgr.34373) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:31 gibba043 bash[24019]: cluster 2021-03-10T17:31:30.883614+0000 mgr.gibba043.dnkmem (mgr.34373) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:31 gibba003 bash[31385]: cluster 2021-03-10T17:31:30.883614+0000 mgr.gibba043.dnkmem (mgr.34373) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:31 gibba003 bash[32348]: cluster 2021-03-10T17:31:30.883614+0000 mgr.gibba043.dnkmem (mgr.34373) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:33 gibba043 bash[24019]: cluster 2021-03-10T17:31:32.885070+0000 mgr.gibba043.dnkmem (mgr.34373) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:34.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:33 gibba003 bash[31385]: cluster 2021-03-10T17:31:32.885070+0000 mgr.gibba043.dnkmem (mgr.34373) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:34.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:33 gibba003 bash[32348]: cluster 2021-03-10T17:31:32.885070+0000 mgr.gibba043.dnkmem (mgr.34373) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:36.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:35 gibba043 bash[24019]: cluster 2021-03-10T17:31:34.886785+0000 mgr.gibba043.dnkmem (mgr.34373) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:35 gibba003 bash[31385]: cluster 2021-03-10T17:31:34.886785+0000 mgr.gibba043.dnkmem (mgr.34373) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:36.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:35 gibba003 bash[32348]: cluster 2021-03-10T17:31:34.886785+0000 mgr.gibba043.dnkmem (mgr.34373) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:37 gibba043 bash[24019]: cluster 2021-03-10T17:31:36.888415+0000 mgr.gibba043.dnkmem (mgr.34373) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:37 gibba003 bash[31385]: cluster 2021-03-10T17:31:36.888415+0000 mgr.gibba043.dnkmem (mgr.34373) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:38.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:37 gibba003 bash[32348]: cluster 2021-03-10T17:31:36.888415+0000 mgr.gibba043.dnkmem (mgr.34373) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:38 gibba043 bash[24019]: cephadm 2021-03-10T17:31:37.187308+0000 mgr.gibba043.dnkmem (mgr.34373) 11618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:38 gibba003 bash[31385]: cephadm 2021-03-10T17:31:37.187308+0000 mgr.gibba043.dnkmem (mgr.34373) 11618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:38 gibba003 bash[32348]: cephadm 2021-03-10T17:31:37.187308+0000 mgr.gibba043.dnkmem (mgr.34373) 11618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:40.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:39 gibba043 bash[24019]: cluster 2021-03-10T17:31:38.889417+0000 mgr.gibba043.dnkmem (mgr.34373) 11619 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:40.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:39 gibba003 bash[31385]: cluster 2021-03-10T17:31:38.889417+0000 mgr.gibba043.dnkmem (mgr.34373) 11619 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:39 gibba003 bash[32348]: cluster 2021-03-10T17:31:38.889417+0000 mgr.gibba043.dnkmem (mgr.34373) 11619 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:42.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:41 gibba043 bash[24019]: cluster 2021-03-10T17:31:40.890854+0000 mgr.gibba043.dnkmem (mgr.34373) 11620 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:42.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:41 gibba003 bash[31385]: cluster 2021-03-10T17:31:40.890854+0000 mgr.gibba043.dnkmem (mgr.34373) 11620 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:41 gibba003 bash[32348]: cluster 2021-03-10T17:31:40.890854+0000 mgr.gibba043.dnkmem (mgr.34373) 11620 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:44.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:44 gibba043 bash[24019]: cluster 2021-03-10T17:31:42.892172+0000 mgr.gibba043.dnkmem (mgr.34373) 11621 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:44 gibba003 bash[31385]: cluster 2021-03-10T17:31:42.892172+0000 mgr.gibba043.dnkmem (mgr.34373) 11621 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:44 gibba003 bash[32348]: cluster 2021-03-10T17:31:42.892172+0000 mgr.gibba043.dnkmem (mgr.34373) 11621 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:45.061 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:31:45.290 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:31:45.290 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 102s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:31:45.290 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 38s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:31:45.291 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:31:45.291 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:31:45.291 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:31:45.291 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:31:45.292 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:31:45.292 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:31:45.292 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 102s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:31:45.292 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 38s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:31:45.293 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:31:45.293 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:31:45.293 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:31:45.293 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 102s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:31:45.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:31:45.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:31:45.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:31:45.294 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:31:45.295 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 38s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:31:45.295 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 102s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:31:45.540 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:31:45.541 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:31:45.541 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:45.541 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:31:45.541 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:31:45.542 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:45.542 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:31:45.542 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:31:45.543 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:31:45.543 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:31:45.543 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:31:45.543 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:31:45.544 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:31:45.544 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:31:45.544 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:31:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:46 gibba043 bash[24019]: cluster 2021-03-10T17:31:44.893611+0000 mgr.gibba043.dnkmem (mgr.34373) 11622 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:46.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:46 gibba043 bash[24019]: audit 2021-03-10T17:31:45.050796+0000 mgr.gibba043.dnkmem (mgr.34373) 11623 : audit [DBG] from='client.51843 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:46.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:46 gibba043 bash[24019]: audit 2021-03-10T17:31:45.540228+0000 mon.a (mon.0) 2313 : audit [DBG] from='client.? 172.21.2.103:0/1562798433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:46 gibba003 bash[31385]: cluster 2021-03-10T17:31:44.893611+0000 mgr.gibba043.dnkmem (mgr.34373) 11622 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:46 gibba003 bash[31385]: audit 2021-03-10T17:31:45.050796+0000 mgr.gibba043.dnkmem (mgr.34373) 11623 : audit [DBG] from='client.51843 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:46 gibba003 bash[31385]: audit 2021-03-10T17:31:45.540228+0000 mon.a (mon.0) 2313 : audit [DBG] from='client.? 172.21.2.103:0/1562798433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:46.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:46 gibba003 bash[32348]: cluster 2021-03-10T17:31:44.893611+0000 mgr.gibba043.dnkmem (mgr.34373) 11622 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:46.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:46 gibba003 bash[32348]: audit 2021-03-10T17:31:45.050796+0000 mgr.gibba043.dnkmem (mgr.34373) 11623 : audit [DBG] from='client.51843 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:46.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:46 gibba003 bash[32348]: audit 2021-03-10T17:31:45.540228+0000 mon.a (mon.0) 2313 : audit [DBG] from='client.? 172.21.2.103:0/1562798433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:47.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:47 gibba043 bash[24019]: audit 2021-03-10T17:31:45.275521+0000 mgr.gibba043.dnkmem (mgr.34373) 11624 : audit [DBG] from='client.51849 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:47.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:47 gibba003 bash[31385]: audit 2021-03-10T17:31:45.275521+0000 mgr.gibba043.dnkmem (mgr.34373) 11624 : audit [DBG] from='client.51849 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:47 gibba003 bash[32348]: audit 2021-03-10T17:31:45.275521+0000 mgr.gibba043.dnkmem (mgr.34373) 11624 : audit [DBG] from='client.51849 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:48 gibba003 bash[31385]: cluster 2021-03-10T17:31:46.895115+0000 mgr.gibba043.dnkmem (mgr.34373) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:48 gibba003 bash[32348]: cluster 2021-03-10T17:31:46.895115+0000 mgr.gibba043.dnkmem (mgr.34373) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:48.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:48 gibba043 bash[24019]: cluster 2021-03-10T17:31:46.895115+0000 mgr.gibba043.dnkmem (mgr.34373) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:49 gibba043 bash[24019]: cluster 2021-03-10T17:31:48.896099+0000 mgr.gibba043.dnkmem (mgr.34373) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:49 gibba003 bash[31385]: cluster 2021-03-10T17:31:48.896099+0000 mgr.gibba043.dnkmem (mgr.34373) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:49 gibba003 bash[32348]: cluster 2021-03-10T17:31:48.896099+0000 mgr.gibba043.dnkmem (mgr.34373) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:51 gibba043 bash[24019]: cluster 2021-03-10T17:31:50.897639+0000 mgr.gibba043.dnkmem (mgr.34373) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:52.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:51 gibba003 bash[31385]: cluster 2021-03-10T17:31:50.897639+0000 mgr.gibba043.dnkmem (mgr.34373) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:52.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:51 gibba003 bash[32348]: cluster 2021-03-10T17:31:50.897639+0000 mgr.gibba043.dnkmem (mgr.34373) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:53 gibba043 bash[24019]: cephadm 2021-03-10T17:31:52.203420+0000 mgr.gibba043.dnkmem (mgr.34373) 11628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:53 gibba043 bash[24019]: cluster 2021-03-10T17:31:52.899122+0000 mgr.gibba043.dnkmem (mgr.34373) 11629 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:53 gibba003 bash[31385]: cephadm 2021-03-10T17:31:52.203420+0000 mgr.gibba043.dnkmem (mgr.34373) 11628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:53 gibba003 bash[31385]: cluster 2021-03-10T17:31:52.899122+0000 mgr.gibba043.dnkmem (mgr.34373) 11629 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:53 gibba003 bash[32348]: cephadm 2021-03-10T17:31:52.203420+0000 mgr.gibba043.dnkmem (mgr.34373) 11628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:31:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:53 gibba003 bash[32348]: cluster 2021-03-10T17:31:52.899122+0000 mgr.gibba043.dnkmem (mgr.34373) 11629 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:55 gibba043 bash[24019]: cluster 2021-03-10T17:31:54.900628+0000 mgr.gibba043.dnkmem (mgr.34373) 11630 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:56.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:55 gibba003 bash[31385]: cluster 2021-03-10T17:31:54.900628+0000 mgr.gibba043.dnkmem (mgr.34373) 11630 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:56.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:55 gibba003 bash[32348]: cluster 2021-03-10T17:31:54.900628+0000 mgr.gibba043.dnkmem (mgr.34373) 11630 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:58.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:57 gibba043 bash[24019]: cluster 2021-03-10T17:31:56.902089+0000 mgr.gibba043.dnkmem (mgr.34373) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:57 gibba003 bash[31385]: cluster 2021-03-10T17:31:56.902089+0000 mgr.gibba043.dnkmem (mgr.34373) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:58.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:57 gibba003 bash[32348]: cluster 2021-03-10T17:31:56.902089+0000 mgr.gibba043.dnkmem (mgr.34373) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:31:59 gibba043 bash[24019]: cluster 2021-03-10T17:31:58.902897+0000 mgr.gibba043.dnkmem (mgr.34373) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:31:59 gibba003 bash[31385]: cluster 2021-03-10T17:31:58.902897+0000 mgr.gibba043.dnkmem (mgr.34373) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:31:59 gibba003 bash[32348]: cluster 2021-03-10T17:31:58.902897+0000 mgr.gibba043.dnkmem (mgr.34373) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:01 gibba043 bash[24019]: cluster 2021-03-10T17:32:00.904539+0000 mgr.gibba043.dnkmem (mgr.34373) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:01 gibba003 bash[31385]: cluster 2021-03-10T17:32:00.904539+0000 mgr.gibba043.dnkmem (mgr.34373) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:01 gibba003 bash[32348]: cluster 2021-03-10T17:32:00.904539+0000 mgr.gibba043.dnkmem (mgr.34373) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:03 gibba043 bash[24019]: cluster 2021-03-10T17:32:02.906062+0000 mgr.gibba043.dnkmem (mgr.34373) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:03 gibba003 bash[31385]: cluster 2021-03-10T17:32:02.906062+0000 mgr.gibba043.dnkmem (mgr.34373) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:03 gibba003 bash[32348]: cluster 2021-03-10T17:32:02.906062+0000 mgr.gibba043.dnkmem (mgr.34373) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:05 gibba043 bash[24019]: cluster 2021-03-10T17:32:04.907616+0000 mgr.gibba043.dnkmem (mgr.34373) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:05 gibba003 bash[31385]: cluster 2021-03-10T17:32:04.907616+0000 mgr.gibba043.dnkmem (mgr.34373) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:05 gibba003 bash[32348]: cluster 2021-03-10T17:32:04.907616+0000 mgr.gibba043.dnkmem (mgr.34373) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: cluster 2021-03-10T17:32:06.909203+0000 mgr.gibba043.dnkmem (mgr.34373) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.419257+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:32:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.422819+0000 mon.c (mon.1) 2989 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.424286+0000 mon.c (mon.1) 2990 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.426175+0000 mon.c (mon.1) 2991 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.427692+0000 mon.c (mon.1) 2992 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.431228+0000 mon.c (mon.1) 2993 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:07 gibba043 bash[24019]: audit 2021-03-10T17:32:07.432993+0000 mon.c (mon.1) 2994 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: cluster 2021-03-10T17:32:06.909203+0000 mgr.gibba043.dnkmem (mgr.34373) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.419257+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:32:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.422819+0000 mon.c (mon.1) 2989 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.424286+0000 mon.c (mon.1) 2990 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.426175+0000 mon.c (mon.1) 2991 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.427692+0000 mon.c (mon.1) 2992 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.431228+0000 mon.c (mon.1) 2993 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[31385]: audit 2021-03-10T17:32:07.432993+0000 mon.c (mon.1) 2994 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: cluster 2021-03-10T17:32:06.909203+0000 mgr.gibba043.dnkmem (mgr.34373) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.419257+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:32:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.422819+0000 mon.c (mon.1) 2989 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.424286+0000 mon.c (mon.1) 2990 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.426175+0000 mon.c (mon.1) 2991 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.427692+0000 mon.c (mon.1) 2992 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.431228+0000 mon.c (mon.1) 2993 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:07 gibba003 bash[32348]: audit 2021-03-10T17:32:07.432993+0000 mon.c (mon.1) 2994 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.212869+0000 mgr.gibba043.dnkmem (mgr.34373) 11637 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:32:09.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.214429+0000 mgr.gibba043.dnkmem (mgr.34373) 11638 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:32:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.420691+0000 mgr.gibba043.dnkmem (mgr.34373) 11639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.422476+0000 mgr.gibba043.dnkmem (mgr.34373) 11640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.424124+0000 mgr.gibba043.dnkmem (mgr.34373) 11641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.424161+0000 mgr.gibba043.dnkmem (mgr.34373) 11642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.425781+0000 mgr.gibba043.dnkmem (mgr.34373) 11643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.425824+0000 mgr.gibba043.dnkmem (mgr.34373) 11644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.427286+0000 mgr.gibba043.dnkmem (mgr.34373) 11645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:09.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.429169+0000 mgr.gibba043.dnkmem (mgr.34373) 11646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.429205+0000 mgr.gibba043.dnkmem (mgr.34373) 11647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.430822+0000 mgr.gibba043.dnkmem (mgr.34373) 11648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.431145+0000 mgr.gibba043.dnkmem (mgr.34373) 11649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:09.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.432796+0000 mgr.gibba043.dnkmem (mgr.34373) 11650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:09.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.432833+0000 mgr.gibba043.dnkmem (mgr.34373) 11651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:09.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:09 gibba043 bash[24019]: cephadm 2021-03-10T17:32:07.432982+0000 mgr.gibba043.dnkmem (mgr.34373) 11652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.212869+0000 mgr.gibba043.dnkmem (mgr.34373) 11637 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:32:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.214429+0000 mgr.gibba043.dnkmem (mgr.34373) 11638 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:32:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.420691+0000 mgr.gibba043.dnkmem (mgr.34373) 11639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.422476+0000 mgr.gibba043.dnkmem (mgr.34373) 11640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.424124+0000 mgr.gibba043.dnkmem (mgr.34373) 11641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.424161+0000 mgr.gibba043.dnkmem (mgr.34373) 11642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.425781+0000 mgr.gibba043.dnkmem (mgr.34373) 11643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.425824+0000 mgr.gibba043.dnkmem (mgr.34373) 11644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.427286+0000 mgr.gibba043.dnkmem (mgr.34373) 11645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.429169+0000 mgr.gibba043.dnkmem (mgr.34373) 11646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.429205+0000 mgr.gibba043.dnkmem (mgr.34373) 11647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.430822+0000 mgr.gibba043.dnkmem (mgr.34373) 11648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.431145+0000 mgr.gibba043.dnkmem (mgr.34373) 11649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.432796+0000 mgr.gibba043.dnkmem (mgr.34373) 11650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.432833+0000 mgr.gibba043.dnkmem (mgr.34373) 11651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[31385]: cephadm 2021-03-10T17:32:07.432982+0000 mgr.gibba043.dnkmem (mgr.34373) 11652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.212869+0000 mgr.gibba043.dnkmem (mgr.34373) 11637 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:32:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.214429+0000 mgr.gibba043.dnkmem (mgr.34373) 11638 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:32:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.420691+0000 mgr.gibba043.dnkmem (mgr.34373) 11639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.422476+0000 mgr.gibba043.dnkmem (mgr.34373) 11640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.424124+0000 mgr.gibba043.dnkmem (mgr.34373) 11641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.424161+0000 mgr.gibba043.dnkmem (mgr.34373) 11642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.425781+0000 mgr.gibba043.dnkmem (mgr.34373) 11643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.425824+0000 mgr.gibba043.dnkmem (mgr.34373) 11644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.427286+0000 mgr.gibba043.dnkmem (mgr.34373) 11645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.429169+0000 mgr.gibba043.dnkmem (mgr.34373) 11646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.429205+0000 mgr.gibba043.dnkmem (mgr.34373) 11647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.430822+0000 mgr.gibba043.dnkmem (mgr.34373) 11648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.431145+0000 mgr.gibba043.dnkmem (mgr.34373) 11649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.432796+0000 mgr.gibba043.dnkmem (mgr.34373) 11650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.432833+0000 mgr.gibba043.dnkmem (mgr.34373) 11651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:09 gibba003 bash[32348]: cephadm 2021-03-10T17:32:07.432982+0000 mgr.gibba043.dnkmem (mgr.34373) 11652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:10.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:10 gibba043 bash[24019]: cluster 2021-03-10T17:32:08.910488+0000 mgr.gibba043.dnkmem (mgr.34373) 11653 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:10.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:10 gibba003 bash[31385]: cluster 2021-03-10T17:32:08.910488+0000 mgr.gibba043.dnkmem (mgr.34373) 11653 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:10.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:10 gibba003 bash[32348]: cluster 2021-03-10T17:32:08.910488+0000 mgr.gibba043.dnkmem (mgr.34373) 11653 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:12 gibba043 bash[24019]: cluster 2021-03-10T17:32:10.912035+0000 mgr.gibba043.dnkmem (mgr.34373) 11654 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:12 gibba003 bash[31385]: cluster 2021-03-10T17:32:10.912035+0000 mgr.gibba043.dnkmem (mgr.34373) 11654 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:12 gibba003 bash[32348]: cluster 2021-03-10T17:32:10.912035+0000 mgr.gibba043.dnkmem (mgr.34373) 11654 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:14 gibba003 bash[31385]: cluster 2021-03-10T17:32:12.913534+0000 mgr.gibba043.dnkmem (mgr.34373) 11655 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:14 gibba003 bash[32348]: cluster 2021-03-10T17:32:12.913534+0000 mgr.gibba043.dnkmem (mgr.34373) 11655 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:14 gibba043 bash[24019]: cluster 2021-03-10T17:32:12.913534+0000 mgr.gibba043.dnkmem (mgr.34373) 11655 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.148486+0000 mon.c (mon.1) 2995 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.149602+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.393415+0000 mon.c (mon.1) 2996 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.394573+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.764927+0000 mon.c (mon.1) 2997 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:32:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.765652+0000 mon.c (mon.1) 2998 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.766144+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:32:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.766356+0000 mon.c (mon.1) 2999 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.767201+0000 mon.c (mon.1) 3000 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.767410+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.768646+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[31385]: audit 2021-03-10T17:32:14.769451+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.148486+0000 mon.c (mon.1) 2995 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.149602+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.393415+0000 mon.c (mon.1) 2996 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.394573+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.764927+0000 mon.c (mon.1) 2997 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:32:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.765652+0000 mon.c (mon.1) 2998 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.766144+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:32:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.766356+0000 mon.c (mon.1) 2999 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.767201+0000 mon.c (mon.1) 3000 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.767410+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.768646+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:15.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:15 gibba003 bash[32348]: audit 2021-03-10T17:32:14.769451+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.148486+0000 mon.c (mon.1) 2995 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.149602+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.393415+0000 mon.c (mon.1) 2996 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.394573+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.764927+0000 mon.c (mon.1) 2997 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:32:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.765652+0000 mon.c (mon.1) 2998 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.766144+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:32:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.766356+0000 mon.c (mon.1) 2999 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.767201+0000 mon.c (mon.1) 3000 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.767410+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.768646+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:15 gibba043 bash[24019]: audit 2021-03-10T17:32:14.769451+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:32:15.783 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:32:16.012 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:32:16.013 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:32:16.013 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 69s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:32:16.013 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:32:16.014 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:32:16.014 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:32:16.014 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:32:16.014 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:32:16.015 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:32:16.015 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:32:16.015 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 69s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:32:16.015 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:32:16.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:32:16.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:32:16.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:32:16.016 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:32:16.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:32:16.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:32:16.017 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:32:16.017 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 69s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:32:16.017 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:32:16.262 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:32:16.263 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:32:16.263 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:16.263 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:32:16.263 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:32:16.264 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:16.264 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:32:16.264 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:32:16.264 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:32:16.264 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:32:16.265 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:32:16.265 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:32:16.265 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:32:16.265 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:32:16.265 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:32:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:16 gibba003 bash[31385]: cluster 2021-03-10T17:32:14.915274+0000 mgr.gibba043.dnkmem (mgr.34373) 11656 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:16 gibba003 bash[32348]: cluster 2021-03-10T17:32:14.915274+0000 mgr.gibba043.dnkmem (mgr.34373) 11656 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:16 gibba043 bash[24019]: cluster 2021-03-10T17:32:14.915274+0000 mgr.gibba043.dnkmem (mgr.34373) 11656 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:17.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:17 gibba003 bash[31385]: audit 2021-03-10T17:32:15.772334+0000 mgr.gibba043.dnkmem (mgr.34373) 11657 : audit [DBG] from='client.61852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:17 gibba003 bash[31385]: audit 2021-03-10T17:32:15.998213+0000 mgr.gibba043.dnkmem (mgr.34373) 11658 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:17 gibba003 bash[31385]: audit 2021-03-10T17:32:16.261834+0000 mon.a (mon.0) 2321 : audit [DBG] from='client.? 172.21.2.103:0/1936890457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:17 gibba003 bash[32348]: audit 2021-03-10T17:32:15.772334+0000 mgr.gibba043.dnkmem (mgr.34373) 11657 : audit [DBG] from='client.61852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:17 gibba003 bash[32348]: audit 2021-03-10T17:32:15.998213+0000 mgr.gibba043.dnkmem (mgr.34373) 11658 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:17 gibba003 bash[32348]: audit 2021-03-10T17:32:16.261834+0000 mon.a (mon.0) 2321 : audit [DBG] from='client.? 172.21.2.103:0/1936890457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:17 gibba043 bash[24019]: audit 2021-03-10T17:32:15.772334+0000 mgr.gibba043.dnkmem (mgr.34373) 11657 : audit [DBG] from='client.61852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:17 gibba043 bash[24019]: audit 2021-03-10T17:32:15.998213+0000 mgr.gibba043.dnkmem (mgr.34373) 11658 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:17 gibba043 bash[24019]: audit 2021-03-10T17:32:16.261834+0000 mon.a (mon.0) 2321 : audit [DBG] from='client.? 172.21.2.103:0/1936890457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:18.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:18 gibba003 bash[31385]: cluster 2021-03-10T17:32:16.916929+0000 mgr.gibba043.dnkmem (mgr.34373) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:18 gibba003 bash[32348]: cluster 2021-03-10T17:32:16.916929+0000 mgr.gibba043.dnkmem (mgr.34373) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:18 gibba043 bash[24019]: cluster 2021-03-10T17:32:16.916929+0000 mgr.gibba043.dnkmem (mgr.34373) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:19 gibba043 bash[24019]: cluster 2021-03-10T17:32:18.918526+0000 mgr.gibba043.dnkmem (mgr.34373) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:19.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:19 gibba003 bash[31385]: cluster 2021-03-10T17:32:18.918526+0000 mgr.gibba043.dnkmem (mgr.34373) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:19 gibba003 bash[32348]: cluster 2021-03-10T17:32:18.918526+0000 mgr.gibba043.dnkmem (mgr.34373) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:21 gibba043 bash[24019]: cluster 2021-03-10T17:32:20.920210+0000 mgr.gibba043.dnkmem (mgr.34373) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:21 gibba003 bash[31385]: cluster 2021-03-10T17:32:20.920210+0000 mgr.gibba043.dnkmem (mgr.34373) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:21 gibba003 bash[32348]: cluster 2021-03-10T17:32:20.920210+0000 mgr.gibba043.dnkmem (mgr.34373) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:23 gibba043 bash[24019]: cephadm 2021-03-10T17:32:22.448768+0000 mgr.gibba043.dnkmem (mgr.34373) 11662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:24.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:23 gibba043 bash[24019]: cluster 2021-03-10T17:32:22.921541+0000 mgr.gibba043.dnkmem (mgr.34373) 11663 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:23 gibba003 bash[31385]: cephadm 2021-03-10T17:32:22.448768+0000 mgr.gibba043.dnkmem (mgr.34373) 11662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:23 gibba003 bash[31385]: cluster 2021-03-10T17:32:22.921541+0000 mgr.gibba043.dnkmem (mgr.34373) 11663 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:23 gibba003 bash[32348]: cephadm 2021-03-10T17:32:22.448768+0000 mgr.gibba043.dnkmem (mgr.34373) 11662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:24.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:23 gibba003 bash[32348]: cluster 2021-03-10T17:32:22.921541+0000 mgr.gibba043.dnkmem (mgr.34373) 11663 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:26 gibba043 bash[24019]: cluster 2021-03-10T17:32:24.923167+0000 mgr.gibba043.dnkmem (mgr.34373) 11664 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:26 gibba003 bash[31385]: cluster 2021-03-10T17:32:24.923167+0000 mgr.gibba043.dnkmem (mgr.34373) 11664 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:26 gibba003 bash[32348]: cluster 2021-03-10T17:32:24.923167+0000 mgr.gibba043.dnkmem (mgr.34373) 11664 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:28.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:28 gibba043 bash[24019]: cluster 2021-03-10T17:32:26.924571+0000 mgr.gibba043.dnkmem (mgr.34373) 11665 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:28 gibba003 bash[31385]: cluster 2021-03-10T17:32:26.924571+0000 mgr.gibba043.dnkmem (mgr.34373) 11665 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:28 gibba003 bash[32348]: cluster 2021-03-10T17:32:26.924571+0000 mgr.gibba043.dnkmem (mgr.34373) 11665 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:29.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:29 gibba043 bash[24019]: cluster 2021-03-10T17:32:28.926248+0000 mgr.gibba043.dnkmem (mgr.34373) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:29 gibba003 bash[31385]: cluster 2021-03-10T17:32:28.926248+0000 mgr.gibba043.dnkmem (mgr.34373) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:29 gibba003 bash[32348]: cluster 2021-03-10T17:32:28.926248+0000 mgr.gibba043.dnkmem (mgr.34373) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:31 gibba043 bash[24019]: cluster 2021-03-10T17:32:30.927944+0000 mgr.gibba043.dnkmem (mgr.34373) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:31 gibba003 bash[31385]: cluster 2021-03-10T17:32:30.927944+0000 mgr.gibba043.dnkmem (mgr.34373) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:31 gibba003 bash[32348]: cluster 2021-03-10T17:32:30.927944+0000 mgr.gibba043.dnkmem (mgr.34373) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:34 gibba043 bash[24019]: cluster 2021-03-10T17:32:32.929136+0000 mgr.gibba043.dnkmem (mgr.34373) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:34 gibba003 bash[31385]: cluster 2021-03-10T17:32:32.929136+0000 mgr.gibba043.dnkmem (mgr.34373) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:34 gibba003 bash[32348]: cluster 2021-03-10T17:32:32.929136+0000 mgr.gibba043.dnkmem (mgr.34373) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:36.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:36 gibba043 bash[24019]: cluster 2021-03-10T17:32:34.930837+0000 mgr.gibba043.dnkmem (mgr.34373) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:36 gibba003 bash[31385]: cluster 2021-03-10T17:32:34.930837+0000 mgr.gibba043.dnkmem (mgr.34373) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:36.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:36 gibba003 bash[32348]: cluster 2021-03-10T17:32:34.930837+0000 mgr.gibba043.dnkmem (mgr.34373) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:38.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:38 gibba043 bash[24019]: cluster 2021-03-10T17:32:36.932502+0000 mgr.gibba043.dnkmem (mgr.34373) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:38 gibba003 bash[31385]: cluster 2021-03-10T17:32:36.932502+0000 mgr.gibba043.dnkmem (mgr.34373) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:38.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:38 gibba003 bash[32348]: cluster 2021-03-10T17:32:36.932502+0000 mgr.gibba043.dnkmem (mgr.34373) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:39 gibba003 bash[31385]: cephadm 2021-03-10T17:32:37.464807+0000 mgr.gibba043.dnkmem (mgr.34373) 11671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:39 gibba003 bash[32348]: cephadm 2021-03-10T17:32:37.464807+0000 mgr.gibba043.dnkmem (mgr.34373) 11671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:39 gibba043 bash[24019]: cephadm 2021-03-10T17:32:37.464807+0000 mgr.gibba043.dnkmem (mgr.34373) 11671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:40.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:40 gibba003 bash[31385]: cluster 2021-03-10T17:32:38.934191+0000 mgr.gibba043.dnkmem (mgr.34373) 11672 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:40 gibba003 bash[32348]: cluster 2021-03-10T17:32:38.934191+0000 mgr.gibba043.dnkmem (mgr.34373) 11672 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:40 gibba043 bash[24019]: cluster 2021-03-10T17:32:38.934191+0000 mgr.gibba043.dnkmem (mgr.34373) 11672 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:42 gibba003 bash[31385]: cluster 2021-03-10T17:32:40.935895+0000 mgr.gibba043.dnkmem (mgr.34373) 11673 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:42 gibba003 bash[32348]: cluster 2021-03-10T17:32:40.935895+0000 mgr.gibba043.dnkmem (mgr.34373) 11673 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:42 gibba043 bash[24019]: cluster 2021-03-10T17:32:40.935895+0000 mgr.gibba043.dnkmem (mgr.34373) 11673 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:44 gibba003 bash[31385]: cluster 2021-03-10T17:32:42.937440+0000 mgr.gibba043.dnkmem (mgr.34373) 11674 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:44 gibba003 bash[32348]: cluster 2021-03-10T17:32:42.937440+0000 mgr.gibba043.dnkmem (mgr.34373) 11674 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:44 gibba043 bash[24019]: cluster 2021-03-10T17:32:42.937440+0000 mgr.gibba043.dnkmem (mgr.34373) 11674 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:46 gibba003 bash[31385]: cluster 2021-03-10T17:32:44.938961+0000 mgr.gibba043.dnkmem (mgr.34373) 11675 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:46 gibba003 bash[32348]: cluster 2021-03-10T17:32:44.938961+0000 mgr.gibba043.dnkmem (mgr.34373) 11675 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.508 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:32:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:46 gibba043 bash[24019]: cluster 2021-03-10T17:32:44.938961+0000 mgr.gibba043.dnkmem (mgr.34373) 11675 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.737 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:32:46.737 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:32:46.738 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 99s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:32:46.738 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:32:46.738 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:32:46.738 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:32:46.739 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:32:46.739 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:32:46.739 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:32:46.739 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:32:46.740 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 99s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:32:46.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:32:46.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:32:46.740 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:32:46.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:32:46.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:32:46.741 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:32:46.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:32:46.742 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 99s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:32:46.742 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 99s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:32:46.742 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:32:46.987 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:32:46.988 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:32:46.988 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:46.988 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:32:46.989 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:32:46.989 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:46.989 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:32:46.989 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:32:46.989 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:32:46.990 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:32:46.990 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:32:46.990 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:32:46.990 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:32:46.991 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:32:46.991 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:32:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:47 gibba003 bash[31385]: audit 2021-03-10T17:32:46.987248+0000 mon.c (mon.1) 3001 : audit [DBG] from='client.? 172.21.2.103:0/3618851904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:47.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:47 gibba003 bash[32348]: audit 2021-03-10T17:32:46.987248+0000 mon.c (mon.1) 3001 : audit [DBG] from='client.? 172.21.2.103:0/3618851904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:47 gibba043 bash[24019]: audit 2021-03-10T17:32:46.987248+0000 mon.c (mon.1) 3001 : audit [DBG] from='client.? 172.21.2.103:0/3618851904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:48.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:48 gibba003 bash[31385]: audit 2021-03-10T17:32:46.497200+0000 mgr.gibba043.dnkmem (mgr.34373) 11676 : audit [DBG] from='client.61870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:48.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:48 gibba003 bash[31385]: audit 2021-03-10T17:32:46.724627+0000 mgr.gibba043.dnkmem (mgr.34373) 11677 : audit [DBG] from='client.51885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:48.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:48 gibba003 bash[31385]: cluster 2021-03-10T17:32:46.940600+0000 mgr.gibba043.dnkmem (mgr.34373) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:48 gibba003 bash[32348]: audit 2021-03-10T17:32:46.497200+0000 mgr.gibba043.dnkmem (mgr.34373) 11676 : audit [DBG] from='client.61870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:48 gibba003 bash[32348]: audit 2021-03-10T17:32:46.724627+0000 mgr.gibba043.dnkmem (mgr.34373) 11677 : audit [DBG] from='client.51885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:48.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:48 gibba003 bash[32348]: cluster 2021-03-10T17:32:46.940600+0000 mgr.gibba043.dnkmem (mgr.34373) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:48 gibba043 bash[24019]: audit 2021-03-10T17:32:46.497200+0000 mgr.gibba043.dnkmem (mgr.34373) 11676 : audit [DBG] from='client.61870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:48 gibba043 bash[24019]: audit 2021-03-10T17:32:46.724627+0000 mgr.gibba043.dnkmem (mgr.34373) 11677 : audit [DBG] from='client.51885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:48 gibba043 bash[24019]: cluster 2021-03-10T17:32:46.940600+0000 mgr.gibba043.dnkmem (mgr.34373) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:49 gibba043 bash[24019]: cluster 2021-03-10T17:32:48.942172+0000 mgr.gibba043.dnkmem (mgr.34373) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:49 gibba003 bash[31385]: cluster 2021-03-10T17:32:48.942172+0000 mgr.gibba043.dnkmem (mgr.34373) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:49 gibba003 bash[32348]: cluster 2021-03-10T17:32:48.942172+0000 mgr.gibba043.dnkmem (mgr.34373) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:52.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:52 gibba043 bash[24019]: cluster 2021-03-10T17:32:50.943948+0000 mgr.gibba043.dnkmem (mgr.34373) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:52.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:52 gibba003 bash[31385]: cluster 2021-03-10T17:32:50.943948+0000 mgr.gibba043.dnkmem (mgr.34373) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:52.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:52 gibba003 bash[32348]: cluster 2021-03-10T17:32:50.943948+0000 mgr.gibba043.dnkmem (mgr.34373) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:54 gibba043 bash[24019]: cephadm 2021-03-10T17:32:52.473676+0000 mgr.gibba043.dnkmem (mgr.34373) 11681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:54.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:54 gibba043 bash[24019]: cluster 2021-03-10T17:32:52.945396+0000 mgr.gibba043.dnkmem (mgr.34373) 11682 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:54 gibba003 bash[31385]: cephadm 2021-03-10T17:32:52.473676+0000 mgr.gibba043.dnkmem (mgr.34373) 11681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:54 gibba003 bash[31385]: cluster 2021-03-10T17:32:52.945396+0000 mgr.gibba043.dnkmem (mgr.34373) 11682 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:54 gibba003 bash[32348]: cephadm 2021-03-10T17:32:52.473676+0000 mgr.gibba043.dnkmem (mgr.34373) 11681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:32:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:54 gibba003 bash[32348]: cluster 2021-03-10T17:32:52.945396+0000 mgr.gibba043.dnkmem (mgr.34373) 11682 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:56 gibba003 bash[32348]: cluster 2021-03-10T17:32:54.946996+0000 mgr.gibba043.dnkmem (mgr.34373) 11683 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:56 gibba003 bash[31385]: cluster 2021-03-10T17:32:54.946996+0000 mgr.gibba043.dnkmem (mgr.34373) 11683 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:56 gibba043 bash[24019]: cluster 2021-03-10T17:32:54.946996+0000 mgr.gibba043.dnkmem (mgr.34373) 11683 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:58.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:58 gibba003 bash[31385]: cluster 2021-03-10T17:32:56.948656+0000 mgr.gibba043.dnkmem (mgr.34373) 11684 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:58.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:58 gibba003 bash[32348]: cluster 2021-03-10T17:32:56.948656+0000 mgr.gibba043.dnkmem (mgr.34373) 11684 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:58.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:58 gibba043 bash[24019]: cluster 2021-03-10T17:32:56.948656+0000 mgr.gibba043.dnkmem (mgr.34373) 11684 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:59.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:32:59 gibba043 bash[24019]: cluster 2021-03-10T17:32:58.950213+0000 mgr.gibba043.dnkmem (mgr.34373) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:59.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:32:59 gibba003 bash[31385]: cluster 2021-03-10T17:32:58.950213+0000 mgr.gibba043.dnkmem (mgr.34373) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:59.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:32:59 gibba003 bash[32348]: cluster 2021-03-10T17:32:58.950213+0000 mgr.gibba043.dnkmem (mgr.34373) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:02 gibba043 bash[24019]: cluster 2021-03-10T17:33:00.951887+0000 mgr.gibba043.dnkmem (mgr.34373) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:02 gibba003 bash[31385]: cluster 2021-03-10T17:33:00.951887+0000 mgr.gibba043.dnkmem (mgr.34373) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:02 gibba003 bash[32348]: cluster 2021-03-10T17:33:00.951887+0000 mgr.gibba043.dnkmem (mgr.34373) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:04 gibba003 bash[31385]: cluster 2021-03-10T17:33:02.953114+0000 mgr.gibba043.dnkmem (mgr.34373) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:04.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:04 gibba003 bash[32348]: cluster 2021-03-10T17:33:02.953114+0000 mgr.gibba043.dnkmem (mgr.34373) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:04 gibba043 bash[24019]: cluster 2021-03-10T17:33:02.953114+0000 mgr.gibba043.dnkmem (mgr.34373) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:06 gibba003 bash[31385]: cluster 2021-03-10T17:33:04.954770+0000 mgr.gibba043.dnkmem (mgr.34373) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:06 gibba003 bash[32348]: cluster 2021-03-10T17:33:04.954770+0000 mgr.gibba043.dnkmem (mgr.34373) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:06 gibba043 bash[24019]: cluster 2021-03-10T17:33:04.954770+0000 mgr.gibba043.dnkmem (mgr.34373) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: cluster 2021-03-10T17:33:06.956379+0000 mgr.gibba043.dnkmem (mgr.34373) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.709649+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:33:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.713648+0000 mon.c (mon.1) 3002 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.715786+0000 mon.c (mon.1) 3003 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.717691+0000 mon.c (mon.1) 3004 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.718968+0000 mon.c (mon.1) 3005 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.721377+0000 mon.c (mon.1) 3006 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[31385]: audit 2021-03-10T17:33:07.722712+0000 mon.c (mon.1) 3007 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: cluster 2021-03-10T17:33:06.956379+0000 mgr.gibba043.dnkmem (mgr.34373) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.709649+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:33:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.713648+0000 mon.c (mon.1) 3002 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.715786+0000 mon.c (mon.1) 3003 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.717691+0000 mon.c (mon.1) 3004 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.718968+0000 mon.c (mon.1) 3005 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.721377+0000 mon.c (mon.1) 3006 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:08 gibba003 bash[32348]: audit 2021-03-10T17:33:07.722712+0000 mon.c (mon.1) 3007 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: cluster 2021-03-10T17:33:06.956379+0000 mgr.gibba043.dnkmem (mgr.34373) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.709649+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:33:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.713648+0000 mon.c (mon.1) 3002 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.715786+0000 mon.c (mon.1) 3003 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.717691+0000 mon.c (mon.1) 3004 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.718968+0000 mon.c (mon.1) 3005 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.721377+0000 mon.c (mon.1) 3006 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:08.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:08 gibba043 bash[24019]: audit 2021-03-10T17:33:07.722712+0000 mon.c (mon.1) 3007 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.490271+0000 mgr.gibba043.dnkmem (mgr.34373) 11690 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:33:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.491913+0000 mgr.gibba043.dnkmem (mgr.34373) 11691 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:33:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.711197+0000 mgr.gibba043.dnkmem (mgr.34373) 11692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.713782+0000 mgr.gibba043.dnkmem (mgr.34373) 11693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.715698+0000 mgr.gibba043.dnkmem (mgr.34373) 11694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.715800+0000 mgr.gibba043.dnkmem (mgr.34373) 11695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.717204+0000 mgr.gibba043.dnkmem (mgr.34373) 11696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.717280+0000 mgr.gibba043.dnkmem (mgr.34373) 11697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.718307+0000 mgr.gibba043.dnkmem (mgr.34373) 11698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.719445+0000 mgr.gibba043.dnkmem (mgr.34373) 11699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.719533+0000 mgr.gibba043.dnkmem (mgr.34373) 11700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.720680+0000 mgr.gibba043.dnkmem (mgr.34373) 11701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.721081+0000 mgr.gibba043.dnkmem (mgr.34373) 11702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.721947+0000 mgr.gibba043.dnkmem (mgr.34373) 11703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.722090+0000 mgr.gibba043.dnkmem (mgr.34373) 11704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[31385]: cephadm 2021-03-10T17:33:07.722199+0000 mgr.gibba043.dnkmem (mgr.34373) 11705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.490271+0000 mgr.gibba043.dnkmem (mgr.34373) 11690 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:33:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.491913+0000 mgr.gibba043.dnkmem (mgr.34373) 11691 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:33:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.711197+0000 mgr.gibba043.dnkmem (mgr.34373) 11692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.713782+0000 mgr.gibba043.dnkmem (mgr.34373) 11693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.715698+0000 mgr.gibba043.dnkmem (mgr.34373) 11694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.715800+0000 mgr.gibba043.dnkmem (mgr.34373) 11695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.717204+0000 mgr.gibba043.dnkmem (mgr.34373) 11696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.717280+0000 mgr.gibba043.dnkmem (mgr.34373) 11697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.718307+0000 mgr.gibba043.dnkmem (mgr.34373) 11698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.719445+0000 mgr.gibba043.dnkmem (mgr.34373) 11699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.719533+0000 mgr.gibba043.dnkmem (mgr.34373) 11700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.720680+0000 mgr.gibba043.dnkmem (mgr.34373) 11701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.721081+0000 mgr.gibba043.dnkmem (mgr.34373) 11702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.721947+0000 mgr.gibba043.dnkmem (mgr.34373) 11703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.722090+0000 mgr.gibba043.dnkmem (mgr.34373) 11704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:09 gibba003 bash[32348]: cephadm 2021-03-10T17:33:07.722199+0000 mgr.gibba043.dnkmem (mgr.34373) 11705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.490271+0000 mgr.gibba043.dnkmem (mgr.34373) 11690 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:33:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.491913+0000 mgr.gibba043.dnkmem (mgr.34373) 11691 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:33:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.711197+0000 mgr.gibba043.dnkmem (mgr.34373) 11692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.713782+0000 mgr.gibba043.dnkmem (mgr.34373) 11693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.715698+0000 mgr.gibba043.dnkmem (mgr.34373) 11694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.715800+0000 mgr.gibba043.dnkmem (mgr.34373) 11695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.717204+0000 mgr.gibba043.dnkmem (mgr.34373) 11696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.717280+0000 mgr.gibba043.dnkmem (mgr.34373) 11697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.718307+0000 mgr.gibba043.dnkmem (mgr.34373) 11698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.719445+0000 mgr.gibba043.dnkmem (mgr.34373) 11699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.719533+0000 mgr.gibba043.dnkmem (mgr.34373) 11700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.720680+0000 mgr.gibba043.dnkmem (mgr.34373) 11701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.721081+0000 mgr.gibba043.dnkmem (mgr.34373) 11702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.721947+0000 mgr.gibba043.dnkmem (mgr.34373) 11703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.722090+0000 mgr.gibba043.dnkmem (mgr.34373) 11704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:09 gibba043 bash[24019]: cephadm 2021-03-10T17:33:07.722199+0000 mgr.gibba043.dnkmem (mgr.34373) 11705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:10 gibba003 bash[31385]: cluster 2021-03-10T17:33:08.958194+0000 mgr.gibba043.dnkmem (mgr.34373) 11706 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:10.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:10 gibba003 bash[32348]: cluster 2021-03-10T17:33:08.958194+0000 mgr.gibba043.dnkmem (mgr.34373) 11706 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:10 gibba043 bash[24019]: cluster 2021-03-10T17:33:08.958194+0000 mgr.gibba043.dnkmem (mgr.34373) 11706 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:12 gibba003 bash[31385]: cluster 2021-03-10T17:33:10.959831+0000 mgr.gibba043.dnkmem (mgr.34373) 11707 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:12 gibba003 bash[32348]: cluster 2021-03-10T17:33:10.959831+0000 mgr.gibba043.dnkmem (mgr.34373) 11707 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:12 gibba043 bash[24019]: cluster 2021-03-10T17:33:10.959831+0000 mgr.gibba043.dnkmem (mgr.34373) 11707 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:14 gibba003 bash[31385]: cluster 2021-03-10T17:33:12.961077+0000 mgr.gibba043.dnkmem (mgr.34373) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:14 gibba003 bash[32348]: cluster 2021-03-10T17:33:12.961077+0000 mgr.gibba043.dnkmem (mgr.34373) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:14 gibba043 bash[24019]: cluster 2021-03-10T17:33:12.961077+0000 mgr.gibba043.dnkmem (mgr.34373) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.155236+0000 mon.c (mon.1) 3008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.156318+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.400583+0000 mon.c (mon.1) 3009 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.401741+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.774590+0000 mon.c (mon.1) 3010 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:33:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.775387+0000 mon.c (mon.1) 3011 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.775820+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:33:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.776138+0000 mon.c (mon.1) 3012 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:33:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.777033+0000 mon.c (mon.1) 3013 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.777538+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.778559+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:33:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[31385]: audit 2021-03-10T17:33:14.779490+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.155236+0000 mon.c (mon.1) 3008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.156318+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.400583+0000 mon.c (mon.1) 3009 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.401741+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.774590+0000 mon.c (mon.1) 3010 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:33:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.775387+0000 mon.c (mon.1) 3011 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.775820+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:33:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.776138+0000 mon.c (mon.1) 3012 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:33:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.777033+0000 mon.c (mon.1) 3013 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.777538+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.778559+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:33:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:15 gibba003 bash[32348]: audit 2021-03-10T17:33:14.779490+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.155236+0000 mon.c (mon.1) 3008 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.156318+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.400583+0000 mon.c (mon.1) 3009 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.401741+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.774590+0000 mon.c (mon.1) 3010 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:33:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.775387+0000 mon.c (mon.1) 3011 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.775820+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:33:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.776138+0000 mon.c (mon.1) 3012 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:33:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.777033+0000 mon.c (mon.1) 3013 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.777538+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.778559+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:33:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:15 gibba043 bash[24019]: audit 2021-03-10T17:33:14.779490+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:33:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:16 gibba003 bash[31385]: cluster 2021-03-10T17:33:14.962642+0000 mgr.gibba043.dnkmem (mgr.34373) 11709 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:16 gibba003 bash[32348]: cluster 2021-03-10T17:33:14.962642+0000 mgr.gibba043.dnkmem (mgr.34373) 11709 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:16 gibba043 bash[24019]: cluster 2021-03-10T17:33:14.962642+0000 mgr.gibba043.dnkmem (mgr.34373) 11709 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:17.235 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:33:17.462 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:33:17.463 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:33:17.463 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:33:17.463 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:33:17.463 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:33:17.464 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:33:17.464 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:33:17.464 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:33:17.464 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:33:17.464 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:33:17.465 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:33:17.465 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:33:17.465 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:33:17.465 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:33:17.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:33:17.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:33:17.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:33:17.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:33:17.466 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:33:17.467 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:33:17.467 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:33:17.712 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:33:17.713 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:33:17.713 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:17.713 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:33:17.714 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:33:17.714 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:17.715 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:33:17.715 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:33:17.716 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:33:17.716 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:33:17.717 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:33:17.717 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:33:17.718 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:33:17.718 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:33:17.718 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:33:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:18 gibba003 bash[31385]: cluster 2021-03-10T17:33:16.964100+0000 mgr.gibba043.dnkmem (mgr.34373) 11710 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:18 gibba003 bash[31385]: audit 2021-03-10T17:33:17.711216+0000 mon.c (mon.1) 3014 : audit [DBG] from='client.? 172.21.2.103:0/1611381332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:18 gibba003 bash[32348]: cluster 2021-03-10T17:33:16.964100+0000 mgr.gibba043.dnkmem (mgr.34373) 11710 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:18.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:18 gibba003 bash[32348]: audit 2021-03-10T17:33:17.711216+0000 mon.c (mon.1) 3014 : audit [DBG] from='client.? 172.21.2.103:0/1611381332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:18 gibba043 bash[24019]: cluster 2021-03-10T17:33:16.964100+0000 mgr.gibba043.dnkmem (mgr.34373) 11710 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:18.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:18 gibba043 bash[24019]: audit 2021-03-10T17:33:17.711216+0000 mon.c (mon.1) 3014 : audit [DBG] from='client.? 172.21.2.103:0/1611381332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:19.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:19 gibba003 bash[31385]: audit 2021-03-10T17:33:17.224604+0000 mgr.gibba043.dnkmem (mgr.34373) 11711 : audit [DBG] from='client.51897 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:19.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:19 gibba003 bash[31385]: audit 2021-03-10T17:33:17.448560+0000 mgr.gibba043.dnkmem (mgr.34373) 11712 : audit [DBG] from='client.61894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:19.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:19 gibba003 bash[32348]: audit 2021-03-10T17:33:17.224604+0000 mgr.gibba043.dnkmem (mgr.34373) 11711 : audit [DBG] from='client.51897 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:19.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:19 gibba003 bash[32348]: audit 2021-03-10T17:33:17.448560+0000 mgr.gibba043.dnkmem (mgr.34373) 11712 : audit [DBG] from='client.61894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:19.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:19 gibba043 bash[24019]: audit 2021-03-10T17:33:17.224604+0000 mgr.gibba043.dnkmem (mgr.34373) 11711 : audit [DBG] from='client.51897 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:19.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:19 gibba043 bash[24019]: audit 2021-03-10T17:33:17.448560+0000 mgr.gibba043.dnkmem (mgr.34373) 11712 : audit [DBG] from='client.61894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:20.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:20 gibba003 bash[31385]: cluster 2021-03-10T17:33:18.965566+0000 mgr.gibba043.dnkmem (mgr.34373) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:20.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:20 gibba003 bash[32348]: cluster 2021-03-10T17:33:18.965566+0000 mgr.gibba043.dnkmem (mgr.34373) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:20.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:20 gibba043 bash[24019]: cluster 2021-03-10T17:33:18.965566+0000 mgr.gibba043.dnkmem (mgr.34373) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:22 gibba003 bash[31385]: cluster 2021-03-10T17:33:20.967317+0000 mgr.gibba043.dnkmem (mgr.34373) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:22.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:22 gibba003 bash[32348]: cluster 2021-03-10T17:33:20.967317+0000 mgr.gibba043.dnkmem (mgr.34373) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:22 gibba043 bash[24019]: cluster 2021-03-10T17:33:20.967317+0000 mgr.gibba043.dnkmem (mgr.34373) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:24 gibba003 bash[31385]: cephadm 2021-03-10T17:33:22.738306+0000 mgr.gibba043.dnkmem (mgr.34373) 11715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:24 gibba003 bash[31385]: cluster 2021-03-10T17:33:22.968865+0000 mgr.gibba043.dnkmem (mgr.34373) 11716 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:24 gibba003 bash[32348]: cephadm 2021-03-10T17:33:22.738306+0000 mgr.gibba043.dnkmem (mgr.34373) 11715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:24 gibba003 bash[32348]: cluster 2021-03-10T17:33:22.968865+0000 mgr.gibba043.dnkmem (mgr.34373) 11716 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:24 gibba043 bash[24019]: cephadm 2021-03-10T17:33:22.738306+0000 mgr.gibba043.dnkmem (mgr.34373) 11715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:24 gibba043 bash[24019]: cluster 2021-03-10T17:33:22.968865+0000 mgr.gibba043.dnkmem (mgr.34373) 11716 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:26 gibba003 bash[31385]: cluster 2021-03-10T17:33:24.970579+0000 mgr.gibba043.dnkmem (mgr.34373) 11717 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:26.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:26 gibba003 bash[32348]: cluster 2021-03-10T17:33:24.970579+0000 mgr.gibba043.dnkmem (mgr.34373) 11717 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:26 gibba043 bash[24019]: cluster 2021-03-10T17:33:24.970579+0000 mgr.gibba043.dnkmem (mgr.34373) 11717 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:28 gibba003 bash[31385]: cluster 2021-03-10T17:33:26.972177+0000 mgr.gibba043.dnkmem (mgr.34373) 11718 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:28 gibba003 bash[32348]: cluster 2021-03-10T17:33:26.972177+0000 mgr.gibba043.dnkmem (mgr.34373) 11718 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:28 gibba043 bash[24019]: cluster 2021-03-10T17:33:26.972177+0000 mgr.gibba043.dnkmem (mgr.34373) 11718 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:29 gibba003 bash[31385]: cluster 2021-03-10T17:33:28.973574+0000 mgr.gibba043.dnkmem (mgr.34373) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:29 gibba003 bash[32348]: cluster 2021-03-10T17:33:28.973574+0000 mgr.gibba043.dnkmem (mgr.34373) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:29 gibba043 bash[24019]: cluster 2021-03-10T17:33:28.973574+0000 mgr.gibba043.dnkmem (mgr.34373) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:32 gibba003 bash[31385]: cluster 2021-03-10T17:33:30.975138+0000 mgr.gibba043.dnkmem (mgr.34373) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:32.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:32 gibba003 bash[32348]: cluster 2021-03-10T17:33:30.975138+0000 mgr.gibba043.dnkmem (mgr.34373) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:32 gibba043 bash[24019]: cluster 2021-03-10T17:33:30.975138+0000 mgr.gibba043.dnkmem (mgr.34373) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:34.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:34 gibba003 bash[31385]: cluster 2021-03-10T17:33:32.976400+0000 mgr.gibba043.dnkmem (mgr.34373) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:34.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:34 gibba003 bash[32348]: cluster 2021-03-10T17:33:32.976400+0000 mgr.gibba043.dnkmem (mgr.34373) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:34 gibba043 bash[24019]: cluster 2021-03-10T17:33:32.976400+0000 mgr.gibba043.dnkmem (mgr.34373) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:36.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:36 gibba003 bash[32348]: cluster 2021-03-10T17:33:34.978041+0000 mgr.gibba043.dnkmem (mgr.34373) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:36.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:36 gibba003 bash[31385]: cluster 2021-03-10T17:33:34.978041+0000 mgr.gibba043.dnkmem (mgr.34373) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:36 gibba043 bash[24019]: cluster 2021-03-10T17:33:34.978041+0000 mgr.gibba043.dnkmem (mgr.34373) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:38.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:38 gibba003 bash[31385]: cluster 2021-03-10T17:33:36.979584+0000 mgr.gibba043.dnkmem (mgr.34373) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:38.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:38 gibba003 bash[32348]: cluster 2021-03-10T17:33:36.979584+0000 mgr.gibba043.dnkmem (mgr.34373) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:38 gibba043 bash[24019]: cluster 2021-03-10T17:33:36.979584+0000 mgr.gibba043.dnkmem (mgr.34373) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:39 gibba003 bash[31385]: cephadm 2021-03-10T17:33:37.752428+0000 mgr.gibba043.dnkmem (mgr.34373) 11724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:39 gibba003 bash[32348]: cephadm 2021-03-10T17:33:37.752428+0000 mgr.gibba043.dnkmem (mgr.34373) 11724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:39 gibba043 bash[24019]: cephadm 2021-03-10T17:33:37.752428+0000 mgr.gibba043.dnkmem (mgr.34373) 11724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:40.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:40 gibba003 bash[31385]: cluster 2021-03-10T17:33:38.981036+0000 mgr.gibba043.dnkmem (mgr.34373) 11725 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:40 gibba003 bash[32348]: cluster 2021-03-10T17:33:38.981036+0000 mgr.gibba043.dnkmem (mgr.34373) 11725 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:40 gibba043 bash[24019]: cluster 2021-03-10T17:33:38.981036+0000 mgr.gibba043.dnkmem (mgr.34373) 11725 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:42.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:42 gibba003 bash[31385]: cluster 2021-03-10T17:33:40.982462+0000 mgr.gibba043.dnkmem (mgr.34373) 11726 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:42 gibba003 bash[32348]: cluster 2021-03-10T17:33:40.982462+0000 mgr.gibba043.dnkmem (mgr.34373) 11726 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:42 gibba043 bash[24019]: cluster 2021-03-10T17:33:40.982462+0000 mgr.gibba043.dnkmem (mgr.34373) 11726 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:44 gibba003 bash[31385]: cluster 2021-03-10T17:33:42.984049+0000 mgr.gibba043.dnkmem (mgr.34373) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:44 gibba003 bash[32348]: cluster 2021-03-10T17:33:42.984049+0000 mgr.gibba043.dnkmem (mgr.34373) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:44 gibba043 bash[24019]: cluster 2021-03-10T17:33:42.984049+0000 mgr.gibba043.dnkmem (mgr.34373) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:46 gibba003 bash[31385]: cluster 2021-03-10T17:33:44.985715+0000 mgr.gibba043.dnkmem (mgr.34373) 11728 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:46.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:46 gibba003 bash[32348]: cluster 2021-03-10T17:33:44.985715+0000 mgr.gibba043.dnkmem (mgr.34373) 11728 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:46 gibba043 bash[24019]: cluster 2021-03-10T17:33:44.985715+0000 mgr.gibba043.dnkmem (mgr.34373) 11728 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.958 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:33:48.186 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:33:48.187 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:33:48.187 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:33:48.187 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:33:48.188 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:33:48.188 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:33:48.188 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:33:48.188 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:33:48.188 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:33:48.189 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:33:48.189 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:33:48.189 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:33:48.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:33:48.190 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:33:48.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:33:48.191 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:33:48.192 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:33:48.192 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:33:48.193 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:33:48.193 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:33:48.194 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:33:48.437 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:33:48.438 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:33:48.438 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:48.438 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:33:48.439 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:33:48.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:48.439 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:33:48.439 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:33:48.439 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:33:48.440 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:33:48.440 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:33:48.440 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:33:48.440 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:33:48.441 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:33:48.441 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:33:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:48 gibba003 bash[31385]: cluster 2021-03-10T17:33:46.987441+0000 mgr.gibba043.dnkmem (mgr.34373) 11729 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:48 gibba003 bash[32348]: cluster 2021-03-10T17:33:46.987441+0000 mgr.gibba043.dnkmem (mgr.34373) 11729 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:48.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:48 gibba043 bash[24019]: cluster 2021-03-10T17:33:46.987441+0000 mgr.gibba043.dnkmem (mgr.34373) 11729 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:49 gibba003 bash[31385]: audit 2021-03-10T17:33:47.946975+0000 mgr.gibba043.dnkmem (mgr.34373) 11730 : audit [DBG] from='client.51915 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:49 gibba003 bash[31385]: audit 2021-03-10T17:33:48.437289+0000 mon.c (mon.1) 3015 : audit [DBG] from='client.? 172.21.2.103:0/1165534938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:49 gibba003 bash[32348]: audit 2021-03-10T17:33:47.946975+0000 mgr.gibba043.dnkmem (mgr.34373) 11730 : audit [DBG] from='client.51915 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:49 gibba003 bash[32348]: audit 2021-03-10T17:33:48.437289+0000 mon.c (mon.1) 3015 : audit [DBG] from='client.? 172.21.2.103:0/1165534938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:49.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:49 gibba043 bash[24019]: audit 2021-03-10T17:33:47.946975+0000 mgr.gibba043.dnkmem (mgr.34373) 11730 : audit [DBG] from='client.51915 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:49 gibba043 bash[24019]: audit 2021-03-10T17:33:48.437289+0000 mon.c (mon.1) 3015 : audit [DBG] from='client.? 172.21.2.103:0/1165534938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:50.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:50 gibba003 bash[31385]: audit 2021-03-10T17:33:48.173950+0000 mgr.gibba043.dnkmem (mgr.34373) 11731 : audit [DBG] from='client.61912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:50.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:50 gibba003 bash[31385]: cluster 2021-03-10T17:33:48.988970+0000 mgr.gibba043.dnkmem (mgr.34373) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:50.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:50 gibba003 bash[32348]: audit 2021-03-10T17:33:48.173950+0000 mgr.gibba043.dnkmem (mgr.34373) 11731 : audit [DBG] from='client.61912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:50.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:50 gibba003 bash[32348]: cluster 2021-03-10T17:33:48.988970+0000 mgr.gibba043.dnkmem (mgr.34373) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:50.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:50 gibba043 bash[24019]: audit 2021-03-10T17:33:48.173950+0000 mgr.gibba043.dnkmem (mgr.34373) 11731 : audit [DBG] from='client.61912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:50.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:50 gibba043 bash[24019]: cluster 2021-03-10T17:33:48.988970+0000 mgr.gibba043.dnkmem (mgr.34373) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:52.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:52 gibba003 bash[31385]: cluster 2021-03-10T17:33:50.990566+0000 mgr.gibba043.dnkmem (mgr.34373) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:52.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:52 gibba003 bash[32348]: cluster 2021-03-10T17:33:50.990566+0000 mgr.gibba043.dnkmem (mgr.34373) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:52.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:52 gibba043 bash[24019]: cluster 2021-03-10T17:33:50.990566+0000 mgr.gibba043.dnkmem (mgr.34373) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:54 gibba003 bash[31385]: cephadm 2021-03-10T17:33:52.768401+0000 mgr.gibba043.dnkmem (mgr.34373) 11734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:54 gibba003 bash[31385]: cluster 2021-03-10T17:33:52.992019+0000 mgr.gibba043.dnkmem (mgr.34373) 11735 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:54.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:54 gibba003 bash[32348]: cephadm 2021-03-10T17:33:52.768401+0000 mgr.gibba043.dnkmem (mgr.34373) 11734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:54 gibba003 bash[32348]: cluster 2021-03-10T17:33:52.992019+0000 mgr.gibba043.dnkmem (mgr.34373) 11735 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:54 gibba043 bash[24019]: cephadm 2021-03-10T17:33:52.768401+0000 mgr.gibba043.dnkmem (mgr.34373) 11734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:33:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:54 gibba043 bash[24019]: cluster 2021-03-10T17:33:52.992019+0000 mgr.gibba043.dnkmem (mgr.34373) 11735 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:56.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:56 gibba003 bash[32348]: cluster 2021-03-10T17:33:54.993809+0000 mgr.gibba043.dnkmem (mgr.34373) 11736 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:56.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:56 gibba003 bash[31385]: cluster 2021-03-10T17:33:54.993809+0000 mgr.gibba043.dnkmem (mgr.34373) 11736 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:56 gibba043 bash[24019]: cluster 2021-03-10T17:33:54.993809+0000 mgr.gibba043.dnkmem (mgr.34373) 11736 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:57 gibba043 bash[24019]: cluster 2021-03-10T17:33:56.995447+0000 mgr.gibba043.dnkmem (mgr.34373) 11737 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:57 gibba003 bash[31385]: cluster 2021-03-10T17:33:56.995447+0000 mgr.gibba043.dnkmem (mgr.34373) 11737 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:57 gibba003 bash[32348]: cluster 2021-03-10T17:33:56.995447+0000 mgr.gibba043.dnkmem (mgr.34373) 11737 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:33:59 gibba003 bash[31385]: cluster 2021-03-10T17:33:58.997102+0000 mgr.gibba043.dnkmem (mgr.34373) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:33:59 gibba003 bash[32348]: cluster 2021-03-10T17:33:58.997102+0000 mgr.gibba043.dnkmem (mgr.34373) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:33:59 gibba043 bash[24019]: cluster 2021-03-10T17:33:58.997102+0000 mgr.gibba043.dnkmem (mgr.34373) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:02.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:02 gibba003 bash[31385]: cluster 2021-03-10T17:34:00.998828+0000 mgr.gibba043.dnkmem (mgr.34373) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:02 gibba003 bash[32348]: cluster 2021-03-10T17:34:00.998828+0000 mgr.gibba043.dnkmem (mgr.34373) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:02 gibba043 bash[24019]: cluster 2021-03-10T17:34:00.998828+0000 mgr.gibba043.dnkmem (mgr.34373) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:04.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:04 gibba003 bash[31385]: cluster 2021-03-10T17:34:03.000282+0000 mgr.gibba043.dnkmem (mgr.34373) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:04.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:04 gibba003 bash[32348]: cluster 2021-03-10T17:34:03.000282+0000 mgr.gibba043.dnkmem (mgr.34373) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:04 gibba043 bash[24019]: cluster 2021-03-10T17:34:03.000282+0000 mgr.gibba043.dnkmem (mgr.34373) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:06.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:06 gibba003 bash[31385]: cluster 2021-03-10T17:34:05.002268+0000 mgr.gibba043.dnkmem (mgr.34373) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:06.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:06 gibba003 bash[32348]: cluster 2021-03-10T17:34:05.002268+0000 mgr.gibba043.dnkmem (mgr.34373) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:06 gibba043 bash[24019]: cluster 2021-03-10T17:34:05.002268+0000 mgr.gibba043.dnkmem (mgr.34373) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: cluster 2021-03-10T17:34:07.003970+0000 mgr.gibba043.dnkmem (mgr.34373) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:07.989196+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:34:08.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:07.993442+0000 mon.c (mon.1) 3016 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:07.995214+0000 mon.c (mon.1) 3017 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:07.996913+0000 mon.c (mon.1) 3018 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:07.998420+0000 mon.c (mon.1) 3019 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:08.001872+0000 mon.c (mon.1) 3020 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:08 gibba043 bash[24019]: audit 2021-03-10T17:34:08.003712+0000 mon.c (mon.1) 3021 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: cluster 2021-03-10T17:34:07.003970+0000 mgr.gibba043.dnkmem (mgr.34373) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:07.989196+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:34:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:07.993442+0000 mon.c (mon.1) 3016 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:08.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:07.995214+0000 mon.c (mon.1) 3017 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:07.996913+0000 mon.c (mon.1) 3018 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:07.998420+0000 mon.c (mon.1) 3019 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:08.001872+0000 mon.c (mon.1) 3020 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[31385]: audit 2021-03-10T17:34:08.003712+0000 mon.c (mon.1) 3021 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: cluster 2021-03-10T17:34:07.003970+0000 mgr.gibba043.dnkmem (mgr.34373) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:07.989196+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:34:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:07.993442+0000 mon.c (mon.1) 3016 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:08.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:07.995214+0000 mon.c (mon.1) 3017 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:07.996913+0000 mon.c (mon.1) 3018 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:07.998420+0000 mon.c (mon.1) 3019 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:08.001872+0000 mon.c (mon.1) 3020 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:08.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:08 gibba003 bash[32348]: audit 2021-03-10T17:34:08.003712+0000 mon.c (mon.1) 3021 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.773737+0000 mgr.gibba043.dnkmem (mgr.34373) 11743 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:34:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.775039+0000 mgr.gibba043.dnkmem (mgr.34373) 11744 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:34:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.990998+0000 mgr.gibba043.dnkmem (mgr.34373) 11745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.993251+0000 mgr.gibba043.dnkmem (mgr.34373) 11746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.994794+0000 mgr.gibba043.dnkmem (mgr.34373) 11747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.994840+0000 mgr.gibba043.dnkmem (mgr.34373) 11748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.996397+0000 mgr.gibba043.dnkmem (mgr.34373) 11749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.996442+0000 mgr.gibba043.dnkmem (mgr.34373) 11750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.997956+0000 mgr.gibba043.dnkmem (mgr.34373) 11751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.999942+0000 mgr.gibba043.dnkmem (mgr.34373) 11752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:07.999994+0000 mgr.gibba043.dnkmem (mgr.34373) 11753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:08.001328+0000 mgr.gibba043.dnkmem (mgr.34373) 11754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:08.001725+0000 mgr.gibba043.dnkmem (mgr.34373) 11755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:08.003198+0000 mgr.gibba043.dnkmem (mgr.34373) 11756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:09.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:08.003252+0000 mgr.gibba043.dnkmem (mgr.34373) 11757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:09.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[31385]: cephadm 2021-03-10T17:34:08.003387+0000 mgr.gibba043.dnkmem (mgr.34373) 11758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.773737+0000 mgr.gibba043.dnkmem (mgr.34373) 11743 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:34:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.775039+0000 mgr.gibba043.dnkmem (mgr.34373) 11744 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:34:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.990998+0000 mgr.gibba043.dnkmem (mgr.34373) 11745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.993251+0000 mgr.gibba043.dnkmem (mgr.34373) 11746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.994794+0000 mgr.gibba043.dnkmem (mgr.34373) 11747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.994840+0000 mgr.gibba043.dnkmem (mgr.34373) 11748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:09.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.996397+0000 mgr.gibba043.dnkmem (mgr.34373) 11749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.996442+0000 mgr.gibba043.dnkmem (mgr.34373) 11750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.997956+0000 mgr.gibba043.dnkmem (mgr.34373) 11751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.999942+0000 mgr.gibba043.dnkmem (mgr.34373) 11752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:09.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:07.999994+0000 mgr.gibba043.dnkmem (mgr.34373) 11753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:08.001328+0000 mgr.gibba043.dnkmem (mgr.34373) 11754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:08.001725+0000 mgr.gibba043.dnkmem (mgr.34373) 11755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:08.003198+0000 mgr.gibba043.dnkmem (mgr.34373) 11756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:09.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:08.003252+0000 mgr.gibba043.dnkmem (mgr.34373) 11757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:09.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:09 gibba003 bash[32348]: cephadm 2021-03-10T17:34:08.003387+0000 mgr.gibba043.dnkmem (mgr.34373) 11758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.773737+0000 mgr.gibba043.dnkmem (mgr.34373) 11743 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:34:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.775039+0000 mgr.gibba043.dnkmem (mgr.34373) 11744 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:34:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.990998+0000 mgr.gibba043.dnkmem (mgr.34373) 11745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.993251+0000 mgr.gibba043.dnkmem (mgr.34373) 11746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.994794+0000 mgr.gibba043.dnkmem (mgr.34373) 11747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.994840+0000 mgr.gibba043.dnkmem (mgr.34373) 11748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.996397+0000 mgr.gibba043.dnkmem (mgr.34373) 11749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.996442+0000 mgr.gibba043.dnkmem (mgr.34373) 11750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.997956+0000 mgr.gibba043.dnkmem (mgr.34373) 11751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.999942+0000 mgr.gibba043.dnkmem (mgr.34373) 11752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:07.999994+0000 mgr.gibba043.dnkmem (mgr.34373) 11753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:08.001328+0000 mgr.gibba043.dnkmem (mgr.34373) 11754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:08.001725+0000 mgr.gibba043.dnkmem (mgr.34373) 11755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:08.003198+0000 mgr.gibba043.dnkmem (mgr.34373) 11756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:08.003252+0000 mgr.gibba043.dnkmem (mgr.34373) 11757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:09.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:09 gibba043 bash[24019]: cephadm 2021-03-10T17:34:08.003387+0000 mgr.gibba043.dnkmem (mgr.34373) 11758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:10 gibba003 bash[31385]: cluster 2021-03-10T17:34:09.005676+0000 mgr.gibba043.dnkmem (mgr.34373) 11759 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:10 gibba003 bash[32348]: cluster 2021-03-10T17:34:09.005676+0000 mgr.gibba043.dnkmem (mgr.34373) 11759 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:10.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:10 gibba043 bash[24019]: cluster 2021-03-10T17:34:09.005676+0000 mgr.gibba043.dnkmem (mgr.34373) 11759 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:12.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:12 gibba003 bash[31385]: cluster 2021-03-10T17:34:11.007348+0000 mgr.gibba043.dnkmem (mgr.34373) 11760 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:12 gibba003 bash[32348]: cluster 2021-03-10T17:34:11.007348+0000 mgr.gibba043.dnkmem (mgr.34373) 11760 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:12 gibba043 bash[24019]: cluster 2021-03-10T17:34:11.007348+0000 mgr.gibba043.dnkmem (mgr.34373) 11760 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:14 gibba003 bash[31385]: cluster 2021-03-10T17:34:13.008802+0000 mgr.gibba043.dnkmem (mgr.34373) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:14 gibba003 bash[32348]: cluster 2021-03-10T17:34:13.008802+0000 mgr.gibba043.dnkmem (mgr.34373) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:14 gibba043 bash[24019]: cluster 2021-03-10T17:34:13.008802+0000 mgr.gibba043.dnkmem (mgr.34373) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.161296+0000 mon.c (mon.1) 3022 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.161889+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.406627+0000 mon.c (mon.1) 3023 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.407798+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.783273+0000 mon.c (mon.1) 3024 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.784009+0000 mon.c (mon.1) 3025 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.784508+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.784708+0000 mon.c (mon.1) 3026 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:34:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.785399+0000 mon.c (mon.1) 3027 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.785887+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.786831+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:34:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[31385]: audit 2021-03-10T17:34:14.787648+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.161296+0000 mon.c (mon.1) 3022 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.161889+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.406627+0000 mon.c (mon.1) 3023 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.407798+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.783273+0000 mon.c (mon.1) 3024 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.784009+0000 mon.c (mon.1) 3025 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.784508+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.784708+0000 mon.c (mon.1) 3026 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:34:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.785399+0000 mon.c (mon.1) 3027 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.785887+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.786831+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:34:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:15 gibba003 bash[32348]: audit 2021-03-10T17:34:14.787648+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.161296+0000 mon.c (mon.1) 3022 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.161889+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.406627+0000 mon.c (mon.1) 3023 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.407798+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.783273+0000 mon.c (mon.1) 3024 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.784009+0000 mon.c (mon.1) 3025 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.784508+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.784708+0000 mon.c (mon.1) 3026 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:34:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.785399+0000 mon.c (mon.1) 3027 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.785887+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:34:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.786831+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:34:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:15 gibba043 bash[24019]: audit 2021-03-10T17:34:14.787648+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:34:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:16 gibba003 bash[31385]: cluster 2021-03-10T17:34:15.010478+0000 mgr.gibba043.dnkmem (mgr.34373) 11762 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:16.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:16 gibba003 bash[32348]: cluster 2021-03-10T17:34:15.010478+0000 mgr.gibba043.dnkmem (mgr.34373) 11762 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:16 gibba043 bash[24019]: cluster 2021-03-10T17:34:15.010478+0000 mgr.gibba043.dnkmem (mgr.34373) 11762 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:18.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:18 gibba003 bash[31385]: cluster 2021-03-10T17:34:17.012245+0000 mgr.gibba043.dnkmem (mgr.34373) 11763 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:18.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:18 gibba003 bash[32348]: cluster 2021-03-10T17:34:17.012245+0000 mgr.gibba043.dnkmem (mgr.34373) 11763 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:18.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:18 gibba043 bash[24019]: cluster 2021-03-10T17:34:17.012245+0000 mgr.gibba043.dnkmem (mgr.34373) 11763 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:18.679 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:34:18.933 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:34:18.933 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:34:18.934 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:34:18.934 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:34:18.934 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:34:18.935 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:34:18.935 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:34:18.935 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:34:18.935 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:34:18.935 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:34:18.936 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:34:18.936 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:34:18.936 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:34:18.936 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:34:18.937 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:34:18.937 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:34:18.937 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:34:18.937 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:34:18.938 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:34:18.938 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:34:18.938 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:34:19.184 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:34:19.184 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:34:19.185 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:19.185 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:34:19.185 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:34:19.185 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:19.185 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:34:19.186 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:34:19.186 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:34:19.186 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:34:19.186 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:34:19.187 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:34:19.187 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:34:19.187 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:34:19.187 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:34:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[31385]: audit 2021-03-10T17:34:18.669177+0000 mgr.gibba043.dnkmem (mgr.34373) 11764 : audit [DBG] from='client.51933 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[31385]: audit 2021-03-10T17:34:18.893366+0000 mgr.gibba043.dnkmem (mgr.34373) 11765 : audit [DBG] from='client.61930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[31385]: cluster 2021-03-10T17:34:19.013733+0000 mgr.gibba043.dnkmem (mgr.34373) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[31385]: audit 2021-03-10T17:34:19.183482+0000 mon.c (mon.1) 3028 : audit [DBG] from='client.? 172.21.2.103:0/1960131363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[32348]: audit 2021-03-10T17:34:18.669177+0000 mgr.gibba043.dnkmem (mgr.34373) 11764 : audit [DBG] from='client.51933 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:19.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[32348]: audit 2021-03-10T17:34:18.893366+0000 mgr.gibba043.dnkmem (mgr.34373) 11765 : audit [DBG] from='client.61930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:19.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[32348]: cluster 2021-03-10T17:34:19.013733+0000 mgr.gibba043.dnkmem (mgr.34373) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:19 gibba003 bash[32348]: audit 2021-03-10T17:34:19.183482+0000 mon.c (mon.1) 3028 : audit [DBG] from='client.? 172.21.2.103:0/1960131363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:19 gibba043 bash[24019]: audit 2021-03-10T17:34:18.669177+0000 mgr.gibba043.dnkmem (mgr.34373) 11764 : audit [DBG] from='client.51933 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:19 gibba043 bash[24019]: audit 2021-03-10T17:34:18.893366+0000 mgr.gibba043.dnkmem (mgr.34373) 11765 : audit [DBG] from='client.61930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:19 gibba043 bash[24019]: cluster 2021-03-10T17:34:19.013733+0000 mgr.gibba043.dnkmem (mgr.34373) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:19 gibba043 bash[24019]: audit 2021-03-10T17:34:19.183482+0000 mon.c (mon.1) 3028 : audit [DBG] from='client.? 172.21.2.103:0/1960131363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:22 gibba003 bash[31385]: cluster 2021-03-10T17:34:21.015537+0000 mgr.gibba043.dnkmem (mgr.34373) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:22.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:22 gibba003 bash[32348]: cluster 2021-03-10T17:34:21.015537+0000 mgr.gibba043.dnkmem (mgr.34373) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:22 gibba043 bash[24019]: cluster 2021-03-10T17:34:21.015537+0000 mgr.gibba043.dnkmem (mgr.34373) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:24 gibba003 bash[31385]: cephadm 2021-03-10T17:34:23.008688+0000 mgr.gibba043.dnkmem (mgr.34373) 11768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:24 gibba003 bash[31385]: cluster 2021-03-10T17:34:23.016807+0000 mgr.gibba043.dnkmem (mgr.34373) 11769 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:24 gibba003 bash[32348]: cephadm 2021-03-10T17:34:23.008688+0000 mgr.gibba043.dnkmem (mgr.34373) 11768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:24 gibba003 bash[32348]: cluster 2021-03-10T17:34:23.016807+0000 mgr.gibba043.dnkmem (mgr.34373) 11769 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:24 gibba043 bash[24019]: cephadm 2021-03-10T17:34:23.008688+0000 mgr.gibba043.dnkmem (mgr.34373) 11768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:24.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:24 gibba043 bash[24019]: cluster 2021-03-10T17:34:23.016807+0000 mgr.gibba043.dnkmem (mgr.34373) 11769 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:26.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:26 gibba003 bash[31385]: cluster 2021-03-10T17:34:25.018327+0000 mgr.gibba043.dnkmem (mgr.34373) 11770 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:26.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:26 gibba003 bash[32348]: cluster 2021-03-10T17:34:25.018327+0000 mgr.gibba043.dnkmem (mgr.34373) 11770 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:26 gibba043 bash[24019]: cluster 2021-03-10T17:34:25.018327+0000 mgr.gibba043.dnkmem (mgr.34373) 11770 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:28 gibba003 bash[31385]: cluster 2021-03-10T17:34:27.019976+0000 mgr.gibba043.dnkmem (mgr.34373) 11771 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:28 gibba003 bash[32348]: cluster 2021-03-10T17:34:27.019976+0000 mgr.gibba043.dnkmem (mgr.34373) 11771 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:28 gibba043 bash[24019]: cluster 2021-03-10T17:34:27.019976+0000 mgr.gibba043.dnkmem (mgr.34373) 11771 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:29 gibba003 bash[31385]: cluster 2021-03-10T17:34:29.021543+0000 mgr.gibba043.dnkmem (mgr.34373) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:29 gibba003 bash[32348]: cluster 2021-03-10T17:34:29.021543+0000 mgr.gibba043.dnkmem (mgr.34373) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:29 gibba043 bash[24019]: cluster 2021-03-10T17:34:29.021543+0000 mgr.gibba043.dnkmem (mgr.34373) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:32 gibba003 bash[31385]: cluster 2021-03-10T17:34:31.023399+0000 mgr.gibba043.dnkmem (mgr.34373) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:32.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:32 gibba003 bash[32348]: cluster 2021-03-10T17:34:31.023399+0000 mgr.gibba043.dnkmem (mgr.34373) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:32 gibba043 bash[24019]: cluster 2021-03-10T17:34:31.023399+0000 mgr.gibba043.dnkmem (mgr.34373) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:34.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:34 gibba003 bash[31385]: cluster 2021-03-10T17:34:33.024620+0000 mgr.gibba043.dnkmem (mgr.34373) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:34.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:34 gibba003 bash[32348]: cluster 2021-03-10T17:34:33.024620+0000 mgr.gibba043.dnkmem (mgr.34373) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:34 gibba043 bash[24019]: cluster 2021-03-10T17:34:33.024620+0000 mgr.gibba043.dnkmem (mgr.34373) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:36 gibba003 bash[31385]: cluster 2021-03-10T17:34:35.026104+0000 mgr.gibba043.dnkmem (mgr.34373) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:36.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:36 gibba003 bash[32348]: cluster 2021-03-10T17:34:35.026104+0000 mgr.gibba043.dnkmem (mgr.34373) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:36 gibba043 bash[24019]: cluster 2021-03-10T17:34:35.026104+0000 mgr.gibba043.dnkmem (mgr.34373) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:38 gibba003 bash[31385]: cluster 2021-03-10T17:34:37.027906+0000 mgr.gibba043.dnkmem (mgr.34373) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:38.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:38 gibba003 bash[32348]: cluster 2021-03-10T17:34:37.027906+0000 mgr.gibba043.dnkmem (mgr.34373) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:38 gibba043 bash[24019]: cluster 2021-03-10T17:34:37.027906+0000 mgr.gibba043.dnkmem (mgr.34373) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:39 gibba003 bash[31385]: cephadm 2021-03-10T17:34:38.024658+0000 mgr.gibba043.dnkmem (mgr.34373) 11777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:39.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:39 gibba003 bash[32348]: cephadm 2021-03-10T17:34:38.024658+0000 mgr.gibba043.dnkmem (mgr.34373) 11777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:39.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:39 gibba043 bash[24019]: cephadm 2021-03-10T17:34:38.024658+0000 mgr.gibba043.dnkmem (mgr.34373) 11777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:40.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:40 gibba003 bash[31385]: cluster 2021-03-10T17:34:39.029549+0000 mgr.gibba043.dnkmem (mgr.34373) 11778 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:40.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:40 gibba003 bash[32348]: cluster 2021-03-10T17:34:39.029549+0000 mgr.gibba043.dnkmem (mgr.34373) 11778 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:40.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:40 gibba043 bash[24019]: cluster 2021-03-10T17:34:39.029549+0000 mgr.gibba043.dnkmem (mgr.34373) 11778 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:42 gibba003 bash[31385]: cluster 2021-03-10T17:34:41.031226+0000 mgr.gibba043.dnkmem (mgr.34373) 11779 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:42 gibba003 bash[32348]: cluster 2021-03-10T17:34:41.031226+0000 mgr.gibba043.dnkmem (mgr.34373) 11779 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:42 gibba043 bash[24019]: cluster 2021-03-10T17:34:41.031226+0000 mgr.gibba043.dnkmem (mgr.34373) 11779 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:44.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:44 gibba003 bash[31385]: cluster 2021-03-10T17:34:43.032667+0000 mgr.gibba043.dnkmem (mgr.34373) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:44 gibba003 bash[32348]: cluster 2021-03-10T17:34:43.032667+0000 mgr.gibba043.dnkmem (mgr.34373) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:44 gibba043 bash[24019]: cluster 2021-03-10T17:34:43.032667+0000 mgr.gibba043.dnkmem (mgr.34373) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:46.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:46 gibba003 bash[31385]: cluster 2021-03-10T17:34:45.034883+0000 mgr.gibba043.dnkmem (mgr.34373) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:46.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:46 gibba003 bash[32348]: cluster 2021-03-10T17:34:45.034883+0000 mgr.gibba043.dnkmem (mgr.34373) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:46 gibba043 bash[24019]: cluster 2021-03-10T17:34:45.034883+0000 mgr.gibba043.dnkmem (mgr.34373) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:47 gibba043 bash[24019]: cluster 2021-03-10T17:34:47.036602+0000 mgr.gibba043.dnkmem (mgr.34373) 11782 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:47 gibba003 bash[31385]: cluster 2021-03-10T17:34:47.036602+0000 mgr.gibba043.dnkmem (mgr.34373) 11782 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:47 gibba003 bash[32348]: cluster 2021-03-10T17:34:47.036602+0000 mgr.gibba043.dnkmem (mgr.34373) 11782 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.429 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:34:49.655 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:34:49.655 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:34:49.655 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:34:49.655 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:34:49.656 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:34:49.656 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:34:49.656 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:34:49.656 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:34:49.657 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:34:49.657 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:34:49.657 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:34:49.657 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:34:49.657 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:34:49.658 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:34:49.658 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:34:49.658 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:34:49.658 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:34:49.659 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:34:49.659 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:34:49.659 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:34:49.659 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:34:49.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:49 gibba003 bash[31385]: cluster 2021-03-10T17:34:49.038217+0000 mgr.gibba043.dnkmem (mgr.34373) 11783 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:49 gibba003 bash[32348]: cluster 2021-03-10T17:34:49.038217+0000 mgr.gibba043.dnkmem (mgr.34373) 11783 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:49 gibba043 bash[24019]: cluster 2021-03-10T17:34:49.038217+0000 mgr.gibba043.dnkmem (mgr.34373) 11783 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.905 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:34:49.905 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:34:49.906 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:49.906 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:34:49.906 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:34:49.906 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:49.907 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:34:49.907 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:34:49.907 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:34:49.907 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:34:49.908 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:34:49.908 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:34:49.908 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:34:49.909 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:34:49.909 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:34:50.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:50 gibba003 bash[31385]: audit 2021-03-10T17:34:49.418349+0000 mgr.gibba043.dnkmem (mgr.34373) 11784 : audit [DBG] from='client.51951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:50.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:50 gibba003 bash[31385]: audit 2021-03-10T17:34:49.641877+0000 mgr.gibba043.dnkmem (mgr.34373) 11785 : audit [DBG] from='client.61948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:50.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:50 gibba003 bash[31385]: audit 2021-03-10T17:34:49.904071+0000 mon.a (mon.0) 2336 : audit [DBG] from='client.? 172.21.2.103:0/3346782157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:50.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:50 gibba003 bash[32348]: audit 2021-03-10T17:34:49.418349+0000 mgr.gibba043.dnkmem (mgr.34373) 11784 : audit [DBG] from='client.51951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:50.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:50 gibba003 bash[32348]: audit 2021-03-10T17:34:49.641877+0000 mgr.gibba043.dnkmem (mgr.34373) 11785 : audit [DBG] from='client.61948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:50.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:50 gibba003 bash[32348]: audit 2021-03-10T17:34:49.904071+0000 mon.a (mon.0) 2336 : audit [DBG] from='client.? 172.21.2.103:0/3346782157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:50.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:50 gibba043 bash[24019]: audit 2021-03-10T17:34:49.418349+0000 mgr.gibba043.dnkmem (mgr.34373) 11784 : audit [DBG] from='client.51951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:50.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:50 gibba043 bash[24019]: audit 2021-03-10T17:34:49.641877+0000 mgr.gibba043.dnkmem (mgr.34373) 11785 : audit [DBG] from='client.61948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:50.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:50 gibba043 bash[24019]: audit 2021-03-10T17:34:49.904071+0000 mon.a (mon.0) 2336 : audit [DBG] from='client.? 172.21.2.103:0/3346782157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:51.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:51 gibba003 bash[31385]: cluster 2021-03-10T17:34:51.039971+0000 mgr.gibba043.dnkmem (mgr.34373) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:51.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:51 gibba003 bash[32348]: cluster 2021-03-10T17:34:51.039971+0000 mgr.gibba043.dnkmem (mgr.34373) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:51.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:51 gibba043 bash[24019]: cluster 2021-03-10T17:34:51.039971+0000 mgr.gibba043.dnkmem (mgr.34373) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:54 gibba003 bash[31385]: cephadm 2021-03-10T17:34:53.039887+0000 mgr.gibba043.dnkmem (mgr.34373) 11787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:54.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:54 gibba003 bash[31385]: cluster 2021-03-10T17:34:53.040429+0000 mgr.gibba043.dnkmem (mgr.34373) 11788 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:54 gibba003 bash[32348]: cephadm 2021-03-10T17:34:53.039887+0000 mgr.gibba043.dnkmem (mgr.34373) 11787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:54.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:54 gibba003 bash[32348]: cluster 2021-03-10T17:34:53.040429+0000 mgr.gibba043.dnkmem (mgr.34373) 11788 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:54 gibba043 bash[24019]: cephadm 2021-03-10T17:34:53.039887+0000 mgr.gibba043.dnkmem (mgr.34373) 11787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:34:54.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:54 gibba043 bash[24019]: cluster 2021-03-10T17:34:53.040429+0000 mgr.gibba043.dnkmem (mgr.34373) 11788 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:56.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:56 gibba003 bash[31385]: cluster 2021-03-10T17:34:55.041823+0000 mgr.gibba043.dnkmem (mgr.34373) 11789 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:56.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:56 gibba003 bash[32348]: cluster 2021-03-10T17:34:55.041823+0000 mgr.gibba043.dnkmem (mgr.34373) 11789 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:56 gibba043 bash[24019]: cluster 2021-03-10T17:34:55.041823+0000 mgr.gibba043.dnkmem (mgr.34373) 11789 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:58 gibba003 bash[31385]: cluster 2021-03-10T17:34:57.043436+0000 mgr.gibba043.dnkmem (mgr.34373) 11790 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:58.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:58 gibba003 bash[32348]: cluster 2021-03-10T17:34:57.043436+0000 mgr.gibba043.dnkmem (mgr.34373) 11790 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:58.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:58 gibba043 bash[24019]: cluster 2021-03-10T17:34:57.043436+0000 mgr.gibba043.dnkmem (mgr.34373) 11790 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:34:59 gibba003 bash[31385]: cluster 2021-03-10T17:34:59.045064+0000 mgr.gibba043.dnkmem (mgr.34373) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:34:59 gibba003 bash[32348]: cluster 2021-03-10T17:34:59.045064+0000 mgr.gibba043.dnkmem (mgr.34373) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:34:59 gibba043 bash[24019]: cluster 2021-03-10T17:34:59.045064+0000 mgr.gibba043.dnkmem (mgr.34373) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:02 gibba003 bash[31385]: cluster 2021-03-10T17:35:01.045614+0000 mgr.gibba043.dnkmem (mgr.34373) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:02 gibba003 bash[32348]: cluster 2021-03-10T17:35:01.045614+0000 mgr.gibba043.dnkmem (mgr.34373) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:02 gibba043 bash[24019]: cluster 2021-03-10T17:35:01.045614+0000 mgr.gibba043.dnkmem (mgr.34373) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:04 gibba003 bash[31385]: cluster 2021-03-10T17:35:03.046956+0000 mgr.gibba043.dnkmem (mgr.34373) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:04.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:04 gibba003 bash[32348]: cluster 2021-03-10T17:35:03.046956+0000 mgr.gibba043.dnkmem (mgr.34373) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:04 gibba043 bash[24019]: cluster 2021-03-10T17:35:03.046956+0000 mgr.gibba043.dnkmem (mgr.34373) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:06.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:06 gibba003 bash[31385]: cluster 2021-03-10T17:35:05.048573+0000 mgr.gibba043.dnkmem (mgr.34373) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:06.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:06 gibba003 bash[32348]: cluster 2021-03-10T17:35:05.048573+0000 mgr.gibba043.dnkmem (mgr.34373) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:06 gibba043 bash[24019]: cluster 2021-03-10T17:35:05.048573+0000 mgr.gibba043.dnkmem (mgr.34373) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:08 gibba003 bash[31385]: cluster 2021-03-10T17:35:07.050181+0000 mgr.gibba043.dnkmem (mgr.34373) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:08.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:08 gibba003 bash[32348]: cluster 2021-03-10T17:35:07.050181+0000 mgr.gibba043.dnkmem (mgr.34373) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:08 gibba043 bash[24019]: cluster 2021-03-10T17:35:07.050181+0000 mgr.gibba043.dnkmem (mgr.34373) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.056766+0000 mgr.gibba043.dnkmem (mgr.34373) 11796 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:35:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.058482+0000 mgr.gibba043.dnkmem (mgr.34373) 11797 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:35:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.286695+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:35:09.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.290387+0000 mon.c (mon.1) 3029 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.291978+0000 mon.c (mon.1) 3030 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.293391+0000 mon.c (mon.1) 3031 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.294696+0000 mon.c (mon.1) 3032 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.297593+0000 mon.c (mon.1) 3033 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[31385]: audit 2021-03-10T17:35:08.299373+0000 mon.c (mon.1) 3034 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.056766+0000 mgr.gibba043.dnkmem (mgr.34373) 11796 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:35:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.058482+0000 mgr.gibba043.dnkmem (mgr.34373) 11797 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:35:09.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.286695+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:35:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.290387+0000 mon.c (mon.1) 3029 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.291978+0000 mon.c (mon.1) 3030 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.293391+0000 mon.c (mon.1) 3031 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.294696+0000 mon.c (mon.1) 3032 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.297593+0000 mon.c (mon.1) 3033 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:09 gibba003 bash[32348]: audit 2021-03-10T17:35:08.299373+0000 mon.c (mon.1) 3034 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.056766+0000 mgr.gibba043.dnkmem (mgr.34373) 11796 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:35:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.058482+0000 mgr.gibba043.dnkmem (mgr.34373) 11797 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:35:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.286695+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:35:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.290387+0000 mon.c (mon.1) 3029 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.291978+0000 mon.c (mon.1) 3030 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.293391+0000 mon.c (mon.1) 3031 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.294696+0000 mon.c (mon.1) 3032 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.297593+0000 mon.c (mon.1) 3033 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:09.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:09 gibba043 bash[24019]: audit 2021-03-10T17:35:08.299373+0000 mon.c (mon.1) 3034 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.288279+0000 mgr.gibba043.dnkmem (mgr.34373) 11798 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.290162+0000 mgr.gibba043.dnkmem (mgr.34373) 11799 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.291466+0000 mgr.gibba043.dnkmem (mgr.34373) 11800 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.291507+0000 mgr.gibba043.dnkmem (mgr.34373) 11801 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.292922+0000 mgr.gibba043.dnkmem (mgr.34373) 11802 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:10.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.292962+0000 mgr.gibba043.dnkmem (mgr.34373) 11803 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:10.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.294073+0000 mgr.gibba043.dnkmem (mgr.34373) 11804 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:10.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.295761+0000 mgr.gibba043.dnkmem (mgr.34373) 11805 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:10.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.295806+0000 mgr.gibba043.dnkmem (mgr.34373) 11806 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:10.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.297245+0000 mgr.gibba043.dnkmem (mgr.34373) 11807 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:10.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.297621+0000 mgr.gibba043.dnkmem (mgr.34373) 11808 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:10.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.299032+0000 mgr.gibba043.dnkmem (mgr.34373) 11809 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:10.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.299078+0000 mgr.gibba043.dnkmem (mgr.34373) 11810 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:10.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cephadm 2021-03-10T17:35:08.299204+0000 mgr.gibba043.dnkmem (mgr.34373) 11811 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:10.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[31385]: cluster 2021-03-10T17:35:09.050711+0000 mgr.gibba043.dnkmem (mgr.34373) 11812 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:10.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.288279+0000 mgr.gibba043.dnkmem (mgr.34373) 11798 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:10.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.290162+0000 mgr.gibba043.dnkmem (mgr.34373) 11799 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:10.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.291466+0000 mgr.gibba043.dnkmem (mgr.34373) 11800 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:10.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.291507+0000 mgr.gibba043.dnkmem (mgr.34373) 11801 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:10.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.292922+0000 mgr.gibba043.dnkmem (mgr.34373) 11802 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:10.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.292962+0000 mgr.gibba043.dnkmem (mgr.34373) 11803 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:10.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.294073+0000 mgr.gibba043.dnkmem (mgr.34373) 11804 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:10.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.295761+0000 mgr.gibba043.dnkmem (mgr.34373) 11805 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:10.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.295806+0000 mgr.gibba043.dnkmem (mgr.34373) 11806 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:10.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.297245+0000 mgr.gibba043.dnkmem (mgr.34373) 11807 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:10.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.297621+0000 mgr.gibba043.dnkmem (mgr.34373) 11808 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:10.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.299032+0000 mgr.gibba043.dnkmem (mgr.34373) 11809 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:10.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.299078+0000 mgr.gibba043.dnkmem (mgr.34373) 11810 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:10.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cephadm 2021-03-10T17:35:08.299204+0000 mgr.gibba043.dnkmem (mgr.34373) 11811 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:10.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:10 gibba003 bash[32348]: cluster 2021-03-10T17:35:09.050711+0000 mgr.gibba043.dnkmem (mgr.34373) 11812 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.288279+0000 mgr.gibba043.dnkmem (mgr.34373) 11798 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.290162+0000 mgr.gibba043.dnkmem (mgr.34373) 11799 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:10.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.291466+0000 mgr.gibba043.dnkmem (mgr.34373) 11800 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.291507+0000 mgr.gibba043.dnkmem (mgr.34373) 11801 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.292922+0000 mgr.gibba043.dnkmem (mgr.34373) 11802 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.292962+0000 mgr.gibba043.dnkmem (mgr.34373) 11803 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.294073+0000 mgr.gibba043.dnkmem (mgr.34373) 11804 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:10.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.295761+0000 mgr.gibba043.dnkmem (mgr.34373) 11805 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:10.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.295806+0000 mgr.gibba043.dnkmem (mgr.34373) 11806 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:10.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.297245+0000 mgr.gibba043.dnkmem (mgr.34373) 11807 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:10.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.297621+0000 mgr.gibba043.dnkmem (mgr.34373) 11808 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:10.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.299032+0000 mgr.gibba043.dnkmem (mgr.34373) 11809 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:10.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.299078+0000 mgr.gibba043.dnkmem (mgr.34373) 11810 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:10.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cephadm 2021-03-10T17:35:08.299204+0000 mgr.gibba043.dnkmem (mgr.34373) 11811 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:10.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:10 gibba043 bash[24019]: cluster 2021-03-10T17:35:09.050711+0000 mgr.gibba043.dnkmem (mgr.34373) 11812 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:12.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:12 gibba003 bash[31385]: cluster 2021-03-10T17:35:11.052539+0000 mgr.gibba043.dnkmem (mgr.34373) 11813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:12 gibba003 bash[32348]: cluster 2021-03-10T17:35:11.052539+0000 mgr.gibba043.dnkmem (mgr.34373) 11813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:12 gibba043 bash[24019]: cluster 2021-03-10T17:35:11.052539+0000 mgr.gibba043.dnkmem (mgr.34373) 11813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:14.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:14 gibba003 bash[31385]: cluster 2021-03-10T17:35:13.053968+0000 mgr.gibba043.dnkmem (mgr.34373) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:14.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:14 gibba003 bash[32348]: cluster 2021-03-10T17:35:13.053968+0000 mgr.gibba043.dnkmem (mgr.34373) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:14.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:14 gibba043 bash[24019]: cluster 2021-03-10T17:35:13.053968+0000 mgr.gibba043.dnkmem (mgr.34373) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.165048+0000 mon.c (mon.1) 3035 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.165373+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.422899+0000 mon.c (mon.1) 3036 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.424071+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.793236+0000 mon.c (mon.1) 3037 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:35:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.794017+0000 mon.c (mon.1) 3038 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.794423+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:35:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.794705+0000 mon.c (mon.1) 3039 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.795550+0000 mon.c (mon.1) 3040 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.795886+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.796799+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[31385]: audit 2021-03-10T17:35:14.797576+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.165048+0000 mon.c (mon.1) 3035 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.165373+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.422899+0000 mon.c (mon.1) 3036 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:15.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.424071+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.793236+0000 mon.c (mon.1) 3037 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:35:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.794017+0000 mon.c (mon.1) 3038 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.794423+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:35:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.794705+0000 mon.c (mon.1) 3039 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.795550+0000 mon.c (mon.1) 3040 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.795886+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.796799+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:15 gibba003 bash[32348]: audit 2021-03-10T17:35:14.797576+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.165048+0000 mon.c (mon.1) 3035 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.165373+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.422899+0000 mon.c (mon.1) 3036 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.424071+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.793236+0000 mon.c (mon.1) 3037 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:35:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.794017+0000 mon.c (mon.1) 3038 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.794423+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:35:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.794705+0000 mon.c (mon.1) 3039 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.795550+0000 mon.c (mon.1) 3040 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.795886+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.796799+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:35:15.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:15 gibba043 bash[24019]: audit 2021-03-10T17:35:14.797576+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:16 gibba003 bash[32348]: cluster 2021-03-10T17:35:15.055939+0000 mgr.gibba043.dnkmem (mgr.34373) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:16.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:16 gibba003 bash[31385]: cluster 2021-03-10T17:35:15.055939+0000 mgr.gibba043.dnkmem (mgr.34373) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:16 gibba043 bash[24019]: cluster 2021-03-10T17:35:15.055939+0000 mgr.gibba043.dnkmem (mgr.34373) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:17 gibba003 bash[31385]: cluster 2021-03-10T17:35:17.056589+0000 mgr.gibba043.dnkmem (mgr.34373) 11816 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:17.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:17 gibba003 bash[32348]: cluster 2021-03-10T17:35:17.056589+0000 mgr.gibba043.dnkmem (mgr.34373) 11816 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:17 gibba043 bash[24019]: cluster 2021-03-10T17:35:17.056589+0000 mgr.gibba043.dnkmem (mgr.34373) 11816 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:19 gibba003 bash[31385]: cluster 2021-03-10T17:35:19.058001+0000 mgr.gibba043.dnkmem (mgr.34373) 11817 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:19 gibba003 bash[32348]: cluster 2021-03-10T17:35:19.058001+0000 mgr.gibba043.dnkmem (mgr.34373) 11817 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:19 gibba043 bash[24019]: cluster 2021-03-10T17:35:19.058001+0000 mgr.gibba043.dnkmem (mgr.34373) 11817 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:20.148 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:35:20.401 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:35:20.402 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:35:20.402 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:35:20.402 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:35:20.402 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:35:20.403 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:35:20.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:35:20.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:35:20.403 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:35:20.403 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:35:20.404 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:35:20.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:35:20.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:35:20.404 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:35:20.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:35:20.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:35:20.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:35:20.405 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:35:20.406 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:35:20.406 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:35:20.406 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:35:20.654 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:35:20.654 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:35:20.655 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:20.655 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:35:20.655 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:35:20.655 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:20.656 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:35:20.656 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:35:20.656 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:35:20.656 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:35:20.657 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:35:20.657 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:35:20.657 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:35:20.657 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:35:20.658 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:35:20.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:20 gibba003 bash[31385]: audit 2021-03-10T17:35:20.136871+0000 mgr.gibba043.dnkmem (mgr.34373) 11818 : audit [DBG] from='client.51969 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:20.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:20 gibba003 bash[32348]: audit 2021-03-10T17:35:20.136871+0000 mgr.gibba043.dnkmem (mgr.34373) 11818 : audit [DBG] from='client.51969 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:20.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:20 gibba043 bash[24019]: audit 2021-03-10T17:35:20.136871+0000 mgr.gibba043.dnkmem (mgr.34373) 11818 : audit [DBG] from='client.51969 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:21 gibba003 bash[31385]: audit 2021-03-10T17:35:20.362535+0000 mgr.gibba043.dnkmem (mgr.34373) 11819 : audit [DBG] from='client.61966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:21 gibba003 bash[31385]: audit 2021-03-10T17:35:20.653089+0000 mon.c (mon.1) 3041 : audit [DBG] from='client.? 172.21.2.103:0/3272291476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:21 gibba003 bash[31385]: cluster 2021-03-10T17:35:21.059888+0000 mgr.gibba043.dnkmem (mgr.34373) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:21 gibba003 bash[32348]: audit 2021-03-10T17:35:20.362535+0000 mgr.gibba043.dnkmem (mgr.34373) 11819 : audit [DBG] from='client.61966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:21 gibba003 bash[32348]: audit 2021-03-10T17:35:20.653089+0000 mon.c (mon.1) 3041 : audit [DBG] from='client.? 172.21.2.103:0/3272291476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:21 gibba003 bash[32348]: cluster 2021-03-10T17:35:21.059888+0000 mgr.gibba043.dnkmem (mgr.34373) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:21.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:21 gibba043 bash[24019]: audit 2021-03-10T17:35:20.362535+0000 mgr.gibba043.dnkmem (mgr.34373) 11819 : audit [DBG] from='client.61966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:21 gibba043 bash[24019]: audit 2021-03-10T17:35:20.653089+0000 mon.c (mon.1) 3041 : audit [DBG] from='client.? 172.21.2.103:0/3272291476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:21.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:21 gibba043 bash[24019]: cluster 2021-03-10T17:35:21.059888+0000 mgr.gibba043.dnkmem (mgr.34373) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:24 gibba003 bash[31385]: cluster 2021-03-10T17:35:23.061321+0000 mgr.gibba043.dnkmem (mgr.34373) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:24.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:24 gibba003 bash[32348]: cluster 2021-03-10T17:35:23.061321+0000 mgr.gibba043.dnkmem (mgr.34373) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:24 gibba043 bash[24019]: cluster 2021-03-10T17:35:23.061321+0000 mgr.gibba043.dnkmem (mgr.34373) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:25 gibba003 bash[31385]: cephadm 2021-03-10T17:35:23.312465+0000 mgr.gibba043.dnkmem (mgr.34373) 11822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:25 gibba003 bash[32348]: cephadm 2021-03-10T17:35:23.312465+0000 mgr.gibba043.dnkmem (mgr.34373) 11822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:25.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:25 gibba043 bash[24019]: cephadm 2021-03-10T17:35:23.312465+0000 mgr.gibba043.dnkmem (mgr.34373) 11822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:26.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:26 gibba003 bash[32348]: cluster 2021-03-10T17:35:25.062128+0000 mgr.gibba043.dnkmem (mgr.34373) 11823 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:26 gibba003 bash[31385]: cluster 2021-03-10T17:35:25.062128+0000 mgr.gibba043.dnkmem (mgr.34373) 11823 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:26 gibba043 bash[24019]: cluster 2021-03-10T17:35:25.062128+0000 mgr.gibba043.dnkmem (mgr.34373) 11823 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:28.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:28 gibba003 bash[31385]: cluster 2021-03-10T17:35:27.063618+0000 mgr.gibba043.dnkmem (mgr.34373) 11824 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:28 gibba003 bash[32348]: cluster 2021-03-10T17:35:27.063618+0000 mgr.gibba043.dnkmem (mgr.34373) 11824 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:28 gibba043 bash[24019]: cluster 2021-03-10T17:35:27.063618+0000 mgr.gibba043.dnkmem (mgr.34373) 11824 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:29 gibba003 bash[31385]: cluster 2021-03-10T17:35:29.065081+0000 mgr.gibba043.dnkmem (mgr.34373) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:29 gibba003 bash[32348]: cluster 2021-03-10T17:35:29.065081+0000 mgr.gibba043.dnkmem (mgr.34373) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:29 gibba043 bash[24019]: cluster 2021-03-10T17:35:29.065081+0000 mgr.gibba043.dnkmem (mgr.34373) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:32 gibba003 bash[31385]: cluster 2021-03-10T17:35:31.066956+0000 mgr.gibba043.dnkmem (mgr.34373) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:32 gibba003 bash[32348]: cluster 2021-03-10T17:35:31.066956+0000 mgr.gibba043.dnkmem (mgr.34373) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:32 gibba043 bash[24019]: cluster 2021-03-10T17:35:31.066956+0000 mgr.gibba043.dnkmem (mgr.34373) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:34.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:34 gibba003 bash[31385]: cluster 2021-03-10T17:35:33.067779+0000 mgr.gibba043.dnkmem (mgr.34373) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:34.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:34 gibba003 bash[32348]: cluster 2021-03-10T17:35:33.067779+0000 mgr.gibba043.dnkmem (mgr.34373) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:34 gibba043 bash[24019]: cluster 2021-03-10T17:35:33.067779+0000 mgr.gibba043.dnkmem (mgr.34373) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:36.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:36 gibba003 bash[31385]: cluster 2021-03-10T17:35:35.069206+0000 mgr.gibba043.dnkmem (mgr.34373) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:36.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:36 gibba003 bash[32348]: cluster 2021-03-10T17:35:35.069206+0000 mgr.gibba043.dnkmem (mgr.34373) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:36.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:36 gibba043 bash[24019]: cluster 2021-03-10T17:35:35.069206+0000 mgr.gibba043.dnkmem (mgr.34373) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:38 gibba003 bash[31385]: cluster 2021-03-10T17:35:37.070894+0000 mgr.gibba043.dnkmem (mgr.34373) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:38.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:38 gibba003 bash[32348]: cluster 2021-03-10T17:35:37.070894+0000 mgr.gibba043.dnkmem (mgr.34373) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:38.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:38 gibba043 bash[24019]: cluster 2021-03-10T17:35:37.070894+0000 mgr.gibba043.dnkmem (mgr.34373) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:39 gibba003 bash[31385]: cephadm 2021-03-10T17:35:38.325546+0000 mgr.gibba043.dnkmem (mgr.34373) 11830 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:39.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:39 gibba003 bash[31385]: cluster 2021-03-10T17:35:39.072634+0000 mgr.gibba043.dnkmem (mgr.34373) 11831 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:39 gibba003 bash[32348]: cephadm 2021-03-10T17:35:38.325546+0000 mgr.gibba043.dnkmem (mgr.34373) 11830 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:39.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:39 gibba003 bash[32348]: cluster 2021-03-10T17:35:39.072634+0000 mgr.gibba043.dnkmem (mgr.34373) 11831 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:39 gibba043 bash[24019]: cephadm 2021-03-10T17:35:38.325546+0000 mgr.gibba043.dnkmem (mgr.34373) 11830 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:39 gibba043 bash[24019]: cluster 2021-03-10T17:35:39.072634+0000 mgr.gibba043.dnkmem (mgr.34373) 11831 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:42 gibba003 bash[31385]: cluster 2021-03-10T17:35:41.073650+0000 mgr.gibba043.dnkmem (mgr.34373) 11832 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:42 gibba003 bash[32348]: cluster 2021-03-10T17:35:41.073650+0000 mgr.gibba043.dnkmem (mgr.34373) 11832 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:42 gibba043 bash[24019]: cluster 2021-03-10T17:35:41.073650+0000 mgr.gibba043.dnkmem (mgr.34373) 11832 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:44 gibba003 bash[31385]: cluster 2021-03-10T17:35:43.074689+0000 mgr.gibba043.dnkmem (mgr.34373) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:44.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:44 gibba003 bash[32348]: cluster 2021-03-10T17:35:43.074689+0000 mgr.gibba043.dnkmem (mgr.34373) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:44.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:44 gibba043 bash[24019]: cluster 2021-03-10T17:35:43.074689+0000 mgr.gibba043.dnkmem (mgr.34373) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:46.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:46 gibba003 bash[31385]: cluster 2021-03-10T17:35:45.076246+0000 mgr.gibba043.dnkmem (mgr.34373) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:46.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:46 gibba003 bash[32348]: cluster 2021-03-10T17:35:45.076246+0000 mgr.gibba043.dnkmem (mgr.34373) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:46.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:46 gibba043 bash[24019]: cluster 2021-03-10T17:35:45.076246+0000 mgr.gibba043.dnkmem (mgr.34373) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:48.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:48 gibba003 bash[31385]: cluster 2021-03-10T17:35:47.077609+0000 mgr.gibba043.dnkmem (mgr.34373) 11835 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:48 gibba003 bash[32348]: cluster 2021-03-10T17:35:47.077609+0000 mgr.gibba043.dnkmem (mgr.34373) 11835 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:48 gibba043 bash[24019]: cluster 2021-03-10T17:35:47.077609+0000 mgr.gibba043.dnkmem (mgr.34373) 11835 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:49 gibba003 bash[31385]: cluster 2021-03-10T17:35:49.078392+0000 mgr.gibba043.dnkmem (mgr.34373) 11836 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:49 gibba003 bash[32348]: cluster 2021-03-10T17:35:49.078392+0000 mgr.gibba043.dnkmem (mgr.34373) 11836 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:49 gibba043 bash[24019]: cluster 2021-03-10T17:35:49.078392+0000 mgr.gibba043.dnkmem (mgr.34373) 11836 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:50.894 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:35:51.120 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:35:51.120 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:35:51.120 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:35:51.121 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:35:51.121 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:35:51.121 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:35:51.121 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:35:51.122 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:35:51.122 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:35:51.122 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:35:51.122 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:35:51.123 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:35:51.123 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:35:51.123 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:35:51.123 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:35:51.123 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:35:51.124 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:35:51.124 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:35:51.124 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:35:51.124 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:35:51.124 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:35:51.374 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:35:51.375 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:35:51.375 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:51.375 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:35:51.376 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:35:51.376 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:51.376 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:35:51.376 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:35:51.376 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:35:51.377 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:35:51.377 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:35:51.377 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:35:51.377 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:35:51.378 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:35:51.378 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:35:52.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[31385]: audit 2021-03-10T17:35:50.882841+0000 mgr.gibba043.dnkmem (mgr.34373) 11837 : audit [DBG] from='client.61978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:52.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[31385]: cluster 2021-03-10T17:35:51.080236+0000 mgr.gibba043.dnkmem (mgr.34373) 11838 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[31385]: audit 2021-03-10T17:35:51.105563+0000 mgr.gibba043.dnkmem (mgr.34373) 11839 : audit [DBG] from='client.61984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:52.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[31385]: audit 2021-03-10T17:35:51.373945+0000 mon.c (mon.1) 3042 : audit [DBG] from='client.? 172.21.2.103:0/1140626980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[32348]: audit 2021-03-10T17:35:50.882841+0000 mgr.gibba043.dnkmem (mgr.34373) 11837 : audit [DBG] from='client.61978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:52.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[32348]: cluster 2021-03-10T17:35:51.080236+0000 mgr.gibba043.dnkmem (mgr.34373) 11838 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[32348]: audit 2021-03-10T17:35:51.105563+0000 mgr.gibba043.dnkmem (mgr.34373) 11839 : audit [DBG] from='client.61984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:52.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:52 gibba003 bash[32348]: audit 2021-03-10T17:35:51.373945+0000 mon.c (mon.1) 3042 : audit [DBG] from='client.? 172.21.2.103:0/1140626980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:52 gibba043 bash[24019]: audit 2021-03-10T17:35:50.882841+0000 mgr.gibba043.dnkmem (mgr.34373) 11837 : audit [DBG] from='client.61978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:52.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:52 gibba043 bash[24019]: cluster 2021-03-10T17:35:51.080236+0000 mgr.gibba043.dnkmem (mgr.34373) 11838 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:52 gibba043 bash[24019]: audit 2021-03-10T17:35:51.105563+0000 mgr.gibba043.dnkmem (mgr.34373) 11839 : audit [DBG] from='client.61984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:52.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:52 gibba043 bash[24019]: audit 2021-03-10T17:35:51.373945+0000 mon.c (mon.1) 3042 : audit [DBG] from='client.? 172.21.2.103:0/1140626980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:54.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:54 gibba003 bash[31385]: cluster 2021-03-10T17:35:53.081711+0000 mgr.gibba043.dnkmem (mgr.34373) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:54.483 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:54 gibba003 bash[32348]: cluster 2021-03-10T17:35:53.081711+0000 mgr.gibba043.dnkmem (mgr.34373) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:54 gibba043 bash[24019]: cluster 2021-03-10T17:35:53.081711+0000 mgr.gibba043.dnkmem (mgr.34373) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:55 gibba003 bash[31385]: cephadm 2021-03-10T17:35:53.328695+0000 mgr.gibba043.dnkmem (mgr.34373) 11841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:55.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:55 gibba003 bash[32348]: cephadm 2021-03-10T17:35:53.328695+0000 mgr.gibba043.dnkmem (mgr.34373) 11841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:55.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:55 gibba043 bash[24019]: cephadm 2021-03-10T17:35:53.328695+0000 mgr.gibba043.dnkmem (mgr.34373) 11841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:35:56.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:56 gibba003 bash[31385]: cluster 2021-03-10T17:35:55.083493+0000 mgr.gibba043.dnkmem (mgr.34373) 11842 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:56.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:56 gibba003 bash[32348]: cluster 2021-03-10T17:35:55.083493+0000 mgr.gibba043.dnkmem (mgr.34373) 11842 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:56.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:56 gibba043 bash[24019]: cluster 2021-03-10T17:35:55.083493+0000 mgr.gibba043.dnkmem (mgr.34373) 11842 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:58.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:58 gibba003 bash[31385]: cluster 2021-03-10T17:35:57.084175+0000 mgr.gibba043.dnkmem (mgr.34373) 11843 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:58.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:58 gibba003 bash[32348]: cluster 2021-03-10T17:35:57.084175+0000 mgr.gibba043.dnkmem (mgr.34373) 11843 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:58.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:58 gibba043 bash[24019]: cluster 2021-03-10T17:35:57.084175+0000 mgr.gibba043.dnkmem (mgr.34373) 11843 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:35:59 gibba003 bash[31385]: cluster 2021-03-10T17:35:59.085724+0000 mgr.gibba043.dnkmem (mgr.34373) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:59.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:35:59 gibba003 bash[32348]: cluster 2021-03-10T17:35:59.085724+0000 mgr.gibba043.dnkmem (mgr.34373) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:35:59 gibba043 bash[24019]: cluster 2021-03-10T17:35:59.085724+0000 mgr.gibba043.dnkmem (mgr.34373) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:02 gibba003 bash[31385]: cluster 2021-03-10T17:36:01.087408+0000 mgr.gibba043.dnkmem (mgr.34373) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:02 gibba003 bash[32348]: cluster 2021-03-10T17:36:01.087408+0000 mgr.gibba043.dnkmem (mgr.34373) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:02 gibba043 bash[24019]: cluster 2021-03-10T17:36:01.087408+0000 mgr.gibba043.dnkmem (mgr.34373) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:04.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:04 gibba003 bash[31385]: cluster 2021-03-10T17:36:03.088787+0000 mgr.gibba043.dnkmem (mgr.34373) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:04.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:04 gibba003 bash[32348]: cluster 2021-03-10T17:36:03.088787+0000 mgr.gibba043.dnkmem (mgr.34373) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:04.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:04 gibba043 bash[24019]: cluster 2021-03-10T17:36:03.088787+0000 mgr.gibba043.dnkmem (mgr.34373) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:06 gibba003 bash[31385]: cluster 2021-03-10T17:36:05.089601+0000 mgr.gibba043.dnkmem (mgr.34373) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:06 gibba003 bash[32348]: cluster 2021-03-10T17:36:05.089601+0000 mgr.gibba043.dnkmem (mgr.34373) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:06 gibba043 bash[24019]: cluster 2021-03-10T17:36:05.089601+0000 mgr.gibba043.dnkmem (mgr.34373) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:08.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:08 gibba003 bash[32348]: cluster 2021-03-10T17:36:07.091017+0000 mgr.gibba043.dnkmem (mgr.34373) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:08.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:08 gibba003 bash[31385]: cluster 2021-03-10T17:36:07.091017+0000 mgr.gibba043.dnkmem (mgr.34373) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:08.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:08 gibba043 bash[24019]: cluster 2021-03-10T17:36:07.091017+0000 mgr.gibba043.dnkmem (mgr.34373) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:09.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.345192+0000 mgr.gibba043.dnkmem (mgr.34373) 11849 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:36:09.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.346726+0000 mgr.gibba043.dnkmem (mgr.34373) 11850 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:36:09.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.570265+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:36:09.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.571750+0000 mgr.gibba043.dnkmem (mgr.34373) 11851 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:09.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.573913+0000 mon.c (mon.1) 3043 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:09.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.574102+0000 mgr.gibba043.dnkmem (mgr.34373) 11852 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:09.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.576122+0000 mon.c (mon.1) 3044 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.576245+0000 mgr.gibba043.dnkmem (mgr.34373) 11853 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:09.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.576284+0000 mgr.gibba043.dnkmem (mgr.34373) 11854 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:09.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.577791+0000 mgr.gibba043.dnkmem (mgr.34373) 11855 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:09.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.577823+0000 mgr.gibba043.dnkmem (mgr.34373) 11856 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:09.948 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.578316+0000 mon.c (mon.1) 3045 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.579403+0000 mgr.gibba043.dnkmem (mgr.34373) 11857 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:09.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.579627+0000 mon.c (mon.1) 3046 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.581533+0000 mgr.gibba043.dnkmem (mgr.34373) 11858 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:09.949 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.581569+0000 mgr.gibba043.dnkmem (mgr.34373) 11859 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:09.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.583177+0000 mgr.gibba043.dnkmem (mgr.34373) 11860 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:09.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.583374+0000 mon.c (mon.1) 3047 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.583582+0000 mgr.gibba043.dnkmem (mgr.34373) 11861 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:09.950 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.585375+0000 mgr.gibba043.dnkmem (mgr.34373) 11862 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:09.952 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.585412+0000 mgr.gibba043.dnkmem (mgr.34373) 11863 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:09.954 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.345192+0000 mgr.gibba043.dnkmem (mgr.34373) 11849 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:36:09.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.346726+0000 mgr.gibba043.dnkmem (mgr.34373) 11850 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:36:09.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.570265+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:36:09.955 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.571750+0000 mgr.gibba043.dnkmem (mgr.34373) 11851 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:09.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.573913+0000 mon.c (mon.1) 3043 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:09.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.574102+0000 mgr.gibba043.dnkmem (mgr.34373) 11852 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:09.956 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.576122+0000 mon.c (mon.1) 3044 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.576245+0000 mgr.gibba043.dnkmem (mgr.34373) 11853 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:09.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.576284+0000 mgr.gibba043.dnkmem (mgr.34373) 11854 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:09.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.577791+0000 mgr.gibba043.dnkmem (mgr.34373) 11855 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:09.957 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.577823+0000 mgr.gibba043.dnkmem (mgr.34373) 11856 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:09.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.578316+0000 mon.c (mon.1) 3045 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.579403+0000 mgr.gibba043.dnkmem (mgr.34373) 11857 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:09.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.579627+0000 mon.c (mon.1) 3046 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.581533+0000 mgr.gibba043.dnkmem (mgr.34373) 11858 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:09.958 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.581569+0000 mgr.gibba043.dnkmem (mgr.34373) 11859 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:09.959 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.583177+0000 mgr.gibba043.dnkmem (mgr.34373) 11860 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:09.959 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.583374+0000 mon.c (mon.1) 3047 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.959 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.583582+0000 mgr.gibba043.dnkmem (mgr.34373) 11861 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:09.959 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.585375+0000 mgr.gibba043.dnkmem (mgr.34373) 11862 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:09.960 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.585412+0000 mgr.gibba043.dnkmem (mgr.34373) 11863 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:09.960 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: audit 2021-03-10T17:36:08.585440+0000 mon.c (mon.1) 3048 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.961 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cephadm 2021-03-10T17:36:08.585522+0000 mgr.gibba043.dnkmem (mgr.34373) 11864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:09.962 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[31385]: cluster 2021-03-10T17:36:09.092569+0000 mgr.gibba043.dnkmem (mgr.34373) 11865 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:09.962 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: audit 2021-03-10T17:36:08.585440+0000 mon.c (mon.1) 3048 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.963 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cephadm 2021-03-10T17:36:08.585522+0000 mgr.gibba043.dnkmem (mgr.34373) 11864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:09.964 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:09 gibba003 bash[32348]: cluster 2021-03-10T17:36:09.092569+0000 mgr.gibba043.dnkmem (mgr.34373) 11865 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:10.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.345192+0000 mgr.gibba043.dnkmem (mgr.34373) 11849 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:36:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.346726+0000 mgr.gibba043.dnkmem (mgr.34373) 11850 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:36:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.570265+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:36:10.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.571750+0000 mgr.gibba043.dnkmem (mgr.34373) 11851 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:10.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.573913+0000 mon.c (mon.1) 3043 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:10.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.574102+0000 mgr.gibba043.dnkmem (mgr.34373) 11852 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:10.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.576122+0000 mon.c (mon.1) 3044 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:10.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.576245+0000 mgr.gibba043.dnkmem (mgr.34373) 11853 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:10.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.576284+0000 mgr.gibba043.dnkmem (mgr.34373) 11854 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:10.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.577791+0000 mgr.gibba043.dnkmem (mgr.34373) 11855 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:10.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.577823+0000 mgr.gibba043.dnkmem (mgr.34373) 11856 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:10.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.578316+0000 mon.c (mon.1) 3045 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:10.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.579403+0000 mgr.gibba043.dnkmem (mgr.34373) 11857 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:10.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.579627+0000 mon.c (mon.1) 3046 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:10.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.581533+0000 mgr.gibba043.dnkmem (mgr.34373) 11858 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:10.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.581569+0000 mgr.gibba043.dnkmem (mgr.34373) 11859 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:10.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.583177+0000 mgr.gibba043.dnkmem (mgr.34373) 11860 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:10.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.583374+0000 mon.c (mon.1) 3047 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:10.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.583582+0000 mgr.gibba043.dnkmem (mgr.34373) 11861 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:10.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.585375+0000 mgr.gibba043.dnkmem (mgr.34373) 11862 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:10.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.585412+0000 mgr.gibba043.dnkmem (mgr.34373) 11863 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:10.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: audit 2021-03-10T17:36:08.585440+0000 mon.c (mon.1) 3048 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:10.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cephadm 2021-03-10T17:36:08.585522+0000 mgr.gibba043.dnkmem (mgr.34373) 11864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:10.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:09 gibba043 bash[24019]: cluster 2021-03-10T17:36:09.092569+0000 mgr.gibba043.dnkmem (mgr.34373) 11865 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:12.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:12 gibba003 bash[31385]: cluster 2021-03-10T17:36:11.094399+0000 mgr.gibba043.dnkmem (mgr.34373) 11866 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:12.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:12 gibba003 bash[32348]: cluster 2021-03-10T17:36:11.094399+0000 mgr.gibba043.dnkmem (mgr.34373) 11866 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:12.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:12 gibba043 bash[24019]: cluster 2021-03-10T17:36:11.094399+0000 mgr.gibba043.dnkmem (mgr.34373) 11866 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:14.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:14 gibba003 bash[31385]: cluster 2021-03-10T17:36:13.095437+0000 mgr.gibba043.dnkmem (mgr.34373) 11867 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:14.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:14 gibba003 bash[32348]: cluster 2021-03-10T17:36:13.095437+0000 mgr.gibba043.dnkmem (mgr.34373) 11867 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:14.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:14 gibba043 bash[24019]: cluster 2021-03-10T17:36:13.095437+0000 mgr.gibba043.dnkmem (mgr.34373) 11867 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.173175+0000 mon.c (mon.1) 3049 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:15.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.173476+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.430664+0000 mon.c (mon.1) 3050 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.431801+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.803303+0000 mon.c (mon.1) 3051 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:36:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.804069+0000 mon.c (mon.1) 3052 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.804521+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:36:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.804762+0000 mon.c (mon.1) 3053 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.805639+0000 mon.c (mon.1) 3054 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:36:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.805704+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.806915+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[31385]: audit 2021-03-10T17:36:14.807741+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:36:15.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.173175+0000 mon.c (mon.1) 3049 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.173476+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.430664+0000 mon.c (mon.1) 3050 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.431801+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.803303+0000 mon.c (mon.1) 3051 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:36:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.804069+0000 mon.c (mon.1) 3052 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.804521+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:36:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.804762+0000 mon.c (mon.1) 3053 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.805639+0000 mon.c (mon.1) 3054 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:36:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.805704+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.806915+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:15 gibba003 bash[32348]: audit 2021-03-10T17:36:14.807741+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:36:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.173175+0000 mon.c (mon.1) 3049 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.173476+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.430664+0000 mon.c (mon.1) 3050 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.431801+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.803303+0000 mon.c (mon.1) 3051 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:36:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.804069+0000 mon.c (mon.1) 3052 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.804521+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:36:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.804762+0000 mon.c (mon.1) 3053 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.805639+0000 mon.c (mon.1) 3054 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:36:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.805704+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.806915+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:36:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:15 gibba043 bash[24019]: audit 2021-03-10T17:36:14.807741+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:36:16.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:16 gibba003 bash[31385]: cluster 2021-03-10T17:36:15.096930+0000 mgr.gibba043.dnkmem (mgr.34373) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:16.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:16 gibba003 bash[32348]: cluster 2021-03-10T17:36:15.096930+0000 mgr.gibba043.dnkmem (mgr.34373) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:16.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:16 gibba043 bash[24019]: cluster 2021-03-10T17:36:15.096930+0000 mgr.gibba043.dnkmem (mgr.34373) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:17 gibba043 bash[24019]: cluster 2021-03-10T17:36:17.098604+0000 mgr.gibba043.dnkmem (mgr.34373) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:17 gibba003 bash[31385]: cluster 2021-03-10T17:36:17.098604+0000 mgr.gibba043.dnkmem (mgr.34373) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:17 gibba003 bash[32348]: cluster 2021-03-10T17:36:17.098604+0000 mgr.gibba043.dnkmem (mgr.34373) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:19 gibba003 bash[31385]: cluster 2021-03-10T17:36:19.100117+0000 mgr.gibba043.dnkmem (mgr.34373) 11870 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:19 gibba003 bash[32348]: cluster 2021-03-10T17:36:19.100117+0000 mgr.gibba043.dnkmem (mgr.34373) 11870 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:19 gibba043 bash[24019]: cluster 2021-03-10T17:36:19.100117+0000 mgr.gibba043.dnkmem (mgr.34373) 11870 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:21.665 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:36:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:36:21.891 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:36:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:36:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:36:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:36:21.892 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:36:21.893 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:36:21.893 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:36:21.893 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:36:21.893 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:36:21.893 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:36:21.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:36:21.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:36:21.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:36:21.894 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:36:21.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:36:21.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:36:21.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:36:21.895 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:36:21.895 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:36:21.896 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:36:22.142 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:36:22.143 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:36:22.143 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:22.143 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:36:22.143 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:36:22.144 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:22.144 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:36:22.144 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:36:22.144 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:36:22.145 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:36:22.145 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:36:22.145 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:36:22.145 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:36:22.145 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:36:22.146 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:36:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:22 gibba003 bash[31385]: cluster 2021-03-10T17:36:21.101297+0000 mgr.gibba043.dnkmem (mgr.34373) 11871 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:22 gibba003 bash[31385]: audit 2021-03-10T17:36:22.141385+0000 mon.a (mon.0) 2351 : audit [DBG] from='client.? 172.21.2.103:0/1834669969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:22.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:22 gibba003 bash[32348]: cluster 2021-03-10T17:36:21.101297+0000 mgr.gibba043.dnkmem (mgr.34373) 11871 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:22 gibba003 bash[32348]: audit 2021-03-10T17:36:22.141385+0000 mon.a (mon.0) 2351 : audit [DBG] from='client.? 172.21.2.103:0/1834669969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:22.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:22 gibba043 bash[24019]: cluster 2021-03-10T17:36:21.101297+0000 mgr.gibba043.dnkmem (mgr.34373) 11871 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:22 gibba043 bash[24019]: audit 2021-03-10T17:36:22.141385+0000 mon.a (mon.0) 2351 : audit [DBG] from='client.? 172.21.2.103:0/1834669969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:23 gibba003 bash[31385]: audit 2021-03-10T17:36:21.653649+0000 mgr.gibba043.dnkmem (mgr.34373) 11872 : audit [DBG] from='client.61996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:23 gibba003 bash[31385]: audit 2021-03-10T17:36:21.876795+0000 mgr.gibba043.dnkmem (mgr.34373) 11873 : audit [DBG] from='client.52011 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:23 gibba003 bash[32348]: audit 2021-03-10T17:36:21.653649+0000 mgr.gibba043.dnkmem (mgr.34373) 11872 : audit [DBG] from='client.61996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:23 gibba003 bash[32348]: audit 2021-03-10T17:36:21.876795+0000 mgr.gibba043.dnkmem (mgr.34373) 11873 : audit [DBG] from='client.52011 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:23 gibba043 bash[24019]: audit 2021-03-10T17:36:21.653649+0000 mgr.gibba043.dnkmem (mgr.34373) 11872 : audit [DBG] from='client.61996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:23 gibba043 bash[24019]: audit 2021-03-10T17:36:21.876795+0000 mgr.gibba043.dnkmem (mgr.34373) 11873 : audit [DBG] from='client.52011 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:24.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:24 gibba003 bash[31385]: cluster 2021-03-10T17:36:23.102677+0000 mgr.gibba043.dnkmem (mgr.34373) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:24.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:24 gibba003 bash[32348]: cluster 2021-03-10T17:36:23.102677+0000 mgr.gibba043.dnkmem (mgr.34373) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:24.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:24 gibba043 bash[24019]: cluster 2021-03-10T17:36:23.102677+0000 mgr.gibba043.dnkmem (mgr.34373) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:25 gibba003 bash[31385]: cephadm 2021-03-10T17:36:23.596336+0000 mgr.gibba043.dnkmem (mgr.34373) 11875 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:25 gibba003 bash[31385]: cluster 2021-03-10T17:36:25.104246+0000 mgr.gibba043.dnkmem (mgr.34373) 11876 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:25 gibba003 bash[32348]: cephadm 2021-03-10T17:36:23.596336+0000 mgr.gibba043.dnkmem (mgr.34373) 11875 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:25 gibba003 bash[32348]: cluster 2021-03-10T17:36:25.104246+0000 mgr.gibba043.dnkmem (mgr.34373) 11876 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:25 gibba043 bash[24019]: cephadm 2021-03-10T17:36:23.596336+0000 mgr.gibba043.dnkmem (mgr.34373) 11875 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:25 gibba043 bash[24019]: cluster 2021-03-10T17:36:25.104246+0000 mgr.gibba043.dnkmem (mgr.34373) 11876 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:28 gibba003 bash[31385]: cluster 2021-03-10T17:36:27.105806+0000 mgr.gibba043.dnkmem (mgr.34373) 11877 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:28 gibba003 bash[32348]: cluster 2021-03-10T17:36:27.105806+0000 mgr.gibba043.dnkmem (mgr.34373) 11877 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:28 gibba043 bash[24019]: cluster 2021-03-10T17:36:27.105806+0000 mgr.gibba043.dnkmem (mgr.34373) 11877 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:29 gibba003 bash[31385]: cluster 2021-03-10T17:36:29.107043+0000 mgr.gibba043.dnkmem (mgr.34373) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:29 gibba003 bash[32348]: cluster 2021-03-10T17:36:29.107043+0000 mgr.gibba043.dnkmem (mgr.34373) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:29 gibba043 bash[24019]: cluster 2021-03-10T17:36:29.107043+0000 mgr.gibba043.dnkmem (mgr.34373) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:32 gibba003 bash[31385]: cluster 2021-03-10T17:36:31.108811+0000 mgr.gibba043.dnkmem (mgr.34373) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:32 gibba003 bash[32348]: cluster 2021-03-10T17:36:31.108811+0000 mgr.gibba043.dnkmem (mgr.34373) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:32 gibba043 bash[24019]: cluster 2021-03-10T17:36:31.108811+0000 mgr.gibba043.dnkmem (mgr.34373) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:34 gibba003 bash[31385]: cluster 2021-03-10T17:36:33.110092+0000 mgr.gibba043.dnkmem (mgr.34373) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:34 gibba003 bash[32348]: cluster 2021-03-10T17:36:33.110092+0000 mgr.gibba043.dnkmem (mgr.34373) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:34 gibba043 bash[24019]: cluster 2021-03-10T17:36:33.110092+0000 mgr.gibba043.dnkmem (mgr.34373) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:35 gibba043 bash[24019]: cluster 2021-03-10T17:36:35.111646+0000 mgr.gibba043.dnkmem (mgr.34373) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:35 gibba003 bash[31385]: cluster 2021-03-10T17:36:35.111646+0000 mgr.gibba043.dnkmem (mgr.34373) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:35 gibba003 bash[32348]: cluster 2021-03-10T17:36:35.111646+0000 mgr.gibba043.dnkmem (mgr.34373) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:38 gibba003 bash[31385]: cluster 2021-03-10T17:36:37.112849+0000 mgr.gibba043.dnkmem (mgr.34373) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:38 gibba003 bash[32348]: cluster 2021-03-10T17:36:37.112849+0000 mgr.gibba043.dnkmem (mgr.34373) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:38 gibba043 bash[24019]: cluster 2021-03-10T17:36:37.112849+0000 mgr.gibba043.dnkmem (mgr.34373) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:39 gibba003 bash[31385]: cephadm 2021-03-10T17:36:38.612388+0000 mgr.gibba043.dnkmem (mgr.34373) 11883 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:39 gibba003 bash[31385]: cluster 2021-03-10T17:36:39.114461+0000 mgr.gibba043.dnkmem (mgr.34373) 11884 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:39 gibba003 bash[32348]: cephadm 2021-03-10T17:36:38.612388+0000 mgr.gibba043.dnkmem (mgr.34373) 11883 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:39 gibba003 bash[32348]: cluster 2021-03-10T17:36:39.114461+0000 mgr.gibba043.dnkmem (mgr.34373) 11884 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:39 gibba043 bash[24019]: cephadm 2021-03-10T17:36:38.612388+0000 mgr.gibba043.dnkmem (mgr.34373) 11883 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:39 gibba043 bash[24019]: cluster 2021-03-10T17:36:39.114461+0000 mgr.gibba043.dnkmem (mgr.34373) 11884 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:42 gibba003 bash[31385]: cluster 2021-03-10T17:36:41.116331+0000 mgr.gibba043.dnkmem (mgr.34373) 11885 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:42 gibba003 bash[32348]: cluster 2021-03-10T17:36:41.116331+0000 mgr.gibba043.dnkmem (mgr.34373) 11885 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:42 gibba043 bash[24019]: cluster 2021-03-10T17:36:41.116331+0000 mgr.gibba043.dnkmem (mgr.34373) 11885 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:44 gibba003 bash[31385]: cluster 2021-03-10T17:36:43.117576+0000 mgr.gibba043.dnkmem (mgr.34373) 11886 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:44 gibba003 bash[32348]: cluster 2021-03-10T17:36:43.117576+0000 mgr.gibba043.dnkmem (mgr.34373) 11886 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:44 gibba043 bash[24019]: cluster 2021-03-10T17:36:43.117576+0000 mgr.gibba043.dnkmem (mgr.34373) 11886 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:45 gibba043 bash[24019]: cluster 2021-03-10T17:36:45.119028+0000 mgr.gibba043.dnkmem (mgr.34373) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:45 gibba003 bash[31385]: cluster 2021-03-10T17:36:45.119028+0000 mgr.gibba043.dnkmem (mgr.34373) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:45 gibba003 bash[32348]: cluster 2021-03-10T17:36:45.119028+0000 mgr.gibba043.dnkmem (mgr.34373) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:48 gibba003 bash[31385]: cluster 2021-03-10T17:36:47.120700+0000 mgr.gibba043.dnkmem (mgr.34373) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:48 gibba003 bash[32348]: cluster 2021-03-10T17:36:47.120700+0000 mgr.gibba043.dnkmem (mgr.34373) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:48 gibba043 bash[24019]: cluster 2021-03-10T17:36:47.120700+0000 mgr.gibba043.dnkmem (mgr.34373) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:49 gibba003 bash[31385]: cluster 2021-03-10T17:36:49.122203+0000 mgr.gibba043.dnkmem (mgr.34373) 11889 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:49.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:49 gibba003 bash[32348]: cluster 2021-03-10T17:36:49.122203+0000 mgr.gibba043.dnkmem (mgr.34373) 11889 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:49 gibba043 bash[24019]: cluster 2021-03-10T17:36:49.122203+0000 mgr.gibba043.dnkmem (mgr.34373) 11889 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.392 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:36:52.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:52 gibba003 bash[31385]: cluster 2021-03-10T17:36:51.123985+0000 mgr.gibba043.dnkmem (mgr.34373) 11890 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:52 gibba003 bash[32348]: cluster 2021-03-10T17:36:51.123985+0000 mgr.gibba043.dnkmem (mgr.34373) 11890 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:52 gibba043 bash[24019]: cluster 2021-03-10T17:36:51.123985+0000 mgr.gibba043.dnkmem (mgr.34373) 11890 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.620 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:36:52.621 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:36:52.621 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:36:52.621 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:36:52.621 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:36:52.621 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:36:52.622 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:36:52.622 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:36:52.622 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:36:52.622 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:36:52.623 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:36:52.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:36:52.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:36:52.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:36:52.623 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:36:52.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:36:52.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:36:52.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:36:52.624 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:36:52.625 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:36:52.625 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:36:52.872 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:36:52.872 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:36:52.873 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:52.873 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:36:52.873 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:36:52.873 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:52.874 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:36:52.874 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:36:52.874 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:36:52.874 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:36:52.874 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:36:52.875 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:36:52.875 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:36:52.875 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:36:52.875 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:36:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:53 gibba003 bash[31385]: audit 2021-03-10T17:36:52.871393+0000 mon.a (mon.0) 2352 : audit [DBG] from='client.? 172.21.2.103:0/1775559016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:53.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:53 gibba003 bash[32348]: audit 2021-03-10T17:36:52.871393+0000 mon.a (mon.0) 2352 : audit [DBG] from='client.? 172.21.2.103:0/1775559016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:53.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:53 gibba043 bash[24019]: audit 2021-03-10T17:36:52.871393+0000 mon.a (mon.0) 2352 : audit [DBG] from='client.? 172.21.2.103:0/1775559016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:54 gibba043 bash[24019]: audit 2021-03-10T17:36:52.381646+0000 mgr.gibba043.dnkmem (mgr.34373) 11891 : audit [DBG] from='client.52023 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:54 gibba043 bash[24019]: audit 2021-03-10T17:36:52.606088+0000 mgr.gibba043.dnkmem (mgr.34373) 11892 : audit [DBG] from='client.52029 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:54.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:54 gibba043 bash[24019]: cluster 2021-03-10T17:36:53.125140+0000 mgr.gibba043.dnkmem (mgr.34373) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:54 gibba043 bash[24019]: cephadm 2021-03-10T17:36:53.617805+0000 mgr.gibba043.dnkmem (mgr.34373) 11894 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:54.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[31385]: audit 2021-03-10T17:36:52.381646+0000 mgr.gibba043.dnkmem (mgr.34373) 11891 : audit [DBG] from='client.52023 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:54.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[31385]: audit 2021-03-10T17:36:52.606088+0000 mgr.gibba043.dnkmem (mgr.34373) 11892 : audit [DBG] from='client.52029 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:54.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[31385]: cluster 2021-03-10T17:36:53.125140+0000 mgr.gibba043.dnkmem (mgr.34373) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[31385]: cephadm 2021-03-10T17:36:53.617805+0000 mgr.gibba043.dnkmem (mgr.34373) 11894 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:54.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[32348]: audit 2021-03-10T17:36:52.381646+0000 mgr.gibba043.dnkmem (mgr.34373) 11891 : audit [DBG] from='client.52023 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:54.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[32348]: audit 2021-03-10T17:36:52.606088+0000 mgr.gibba043.dnkmem (mgr.34373) 11892 : audit [DBG] from='client.52029 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:54.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[32348]: cluster 2021-03-10T17:36:53.125140+0000 mgr.gibba043.dnkmem (mgr.34373) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:54 gibba003 bash[32348]: cephadm 2021-03-10T17:36:53.617805+0000 mgr.gibba043.dnkmem (mgr.34373) 11894 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:36:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:55 gibba043 bash[24019]: cluster 2021-03-10T17:36:55.126861+0000 mgr.gibba043.dnkmem (mgr.34373) 11895 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:55 gibba003 bash[31385]: cluster 2021-03-10T17:36:55.126861+0000 mgr.gibba043.dnkmem (mgr.34373) 11895 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:55.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:55 gibba003 bash[32348]: cluster 2021-03-10T17:36:55.126861+0000 mgr.gibba043.dnkmem (mgr.34373) 11895 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:58 gibba043 bash[24019]: cluster 2021-03-10T17:36:57.128432+0000 mgr.gibba043.dnkmem (mgr.34373) 11896 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:58 gibba003 bash[31385]: cluster 2021-03-10T17:36:57.128432+0000 mgr.gibba043.dnkmem (mgr.34373) 11896 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:58 gibba003 bash[32348]: cluster 2021-03-10T17:36:57.128432+0000 mgr.gibba043.dnkmem (mgr.34373) 11896 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:59.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:36:59 gibba003 bash[31385]: cluster 2021-03-10T17:36:59.129714+0000 mgr.gibba043.dnkmem (mgr.34373) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:59.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:36:59 gibba003 bash[32348]: cluster 2021-03-10T17:36:59.129714+0000 mgr.gibba043.dnkmem (mgr.34373) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:36:59 gibba043 bash[24019]: cluster 2021-03-10T17:36:59.129714+0000 mgr.gibba043.dnkmem (mgr.34373) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:01 gibba043 bash[24019]: cluster 2021-03-10T17:37:01.131415+0000 mgr.gibba043.dnkmem (mgr.34373) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:01 gibba003 bash[31385]: cluster 2021-03-10T17:37:01.131415+0000 mgr.gibba043.dnkmem (mgr.34373) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:01 gibba003 bash[32348]: cluster 2021-03-10T17:37:01.131415+0000 mgr.gibba043.dnkmem (mgr.34373) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:03 gibba043 bash[24019]: cluster 2021-03-10T17:37:03.132883+0000 mgr.gibba043.dnkmem (mgr.34373) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:03.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:03 gibba003 bash[31385]: cluster 2021-03-10T17:37:03.132883+0000 mgr.gibba043.dnkmem (mgr.34373) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:03.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:03 gibba003 bash[32348]: cluster 2021-03-10T17:37:03.132883+0000 mgr.gibba043.dnkmem (mgr.34373) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:05.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:05 gibba043 bash[24019]: cluster 2021-03-10T17:37:05.134425+0000 mgr.gibba043.dnkmem (mgr.34373) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:05 gibba003 bash[31385]: cluster 2021-03-10T17:37:05.134425+0000 mgr.gibba043.dnkmem (mgr.34373) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:05.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:05 gibba003 bash[32348]: cluster 2021-03-10T17:37:05.134425+0000 mgr.gibba043.dnkmem (mgr.34373) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:07 gibba043 bash[24019]: cluster 2021-03-10T17:37:07.135961+0000 mgr.gibba043.dnkmem (mgr.34373) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:07 gibba003 bash[31385]: cluster 2021-03-10T17:37:07.135961+0000 mgr.gibba043.dnkmem (mgr.34373) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:07 gibba003 bash[32348]: cluster 2021-03-10T17:37:07.135961+0000 mgr.gibba043.dnkmem (mgr.34373) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:08.838502+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:08.838714+0000 mgr.gibba043.dnkmem (mgr.34373) 11902 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:37:10.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:08.842124+0000 mgr.gibba043.dnkmem (mgr.34373) 11903 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:37:10.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:08.842490+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.049890+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.051294+0000 mgr.gibba043.dnkmem (mgr.34373) 11904 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:10.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.052697+0000 mgr.gibba043.dnkmem (mgr.34373) 11905 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:10.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.053293+0000 mon.c (mon.1) 3055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:10.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.053658+0000 mgr.gibba043.dnkmem (mgr.34373) 11906 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:10.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.053698+0000 mgr.gibba043.dnkmem (mgr.34373) 11907 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:10.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.054367+0000 mon.c (mon.1) 3056 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.054670+0000 mgr.gibba043.dnkmem (mgr.34373) 11908 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:10.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.054710+0000 mgr.gibba043.dnkmem (mgr.34373) 11909 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:10.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.055316+0000 mon.c (mon.1) 3057 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.055367+0000 mgr.gibba043.dnkmem (mgr.34373) 11910 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:10.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.056221+0000 mon.c (mon.1) 3058 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.056541+0000 mgr.gibba043.dnkmem (mgr.34373) 11911 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:10.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.056580+0000 mgr.gibba043.dnkmem (mgr.34373) 11912 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:10.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.057598+0000 mgr.gibba043.dnkmem (mgr.34373) 11913 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:10.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.057932+0000 mgr.gibba043.dnkmem (mgr.34373) 11914 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:10.198 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.058271+0000 mon.c (mon.1) 3059 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:08.838502+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:08.838714+0000 mgr.gibba043.dnkmem (mgr.34373) 11902 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:37:10.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:08.842124+0000 mgr.gibba043.dnkmem (mgr.34373) 11903 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:37:10.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:08.842490+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.049890+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.051294+0000 mgr.gibba043.dnkmem (mgr.34373) 11904 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:10.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.052697+0000 mgr.gibba043.dnkmem (mgr.34373) 11905 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:10.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.053293+0000 mon.c (mon.1) 3055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:10.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.053658+0000 mgr.gibba043.dnkmem (mgr.34373) 11906 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:10.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.053698+0000 mgr.gibba043.dnkmem (mgr.34373) 11907 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:10.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.054367+0000 mon.c (mon.1) 3056 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.054670+0000 mgr.gibba043.dnkmem (mgr.34373) 11908 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:10.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.054710+0000 mgr.gibba043.dnkmem (mgr.34373) 11909 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:10.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.055316+0000 mon.c (mon.1) 3057 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.203 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.055367+0000 mgr.gibba043.dnkmem (mgr.34373) 11910 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:10.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.056221+0000 mon.c (mon.1) 3058 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.056541+0000 mgr.gibba043.dnkmem (mgr.34373) 11911 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:10.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.056580+0000 mgr.gibba043.dnkmem (mgr.34373) 11912 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:10.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.057598+0000 mgr.gibba043.dnkmem (mgr.34373) 11913 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:10.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.057932+0000 mgr.gibba043.dnkmem (mgr.34373) 11914 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:10.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.058271+0000 mon.c (mon.1) 3059 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.058708+0000 mgr.gibba043.dnkmem (mgr.34373) 11915 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:10.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.058749+0000 mgr.gibba043.dnkmem (mgr.34373) 11916 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:10.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cephadm 2021-03-10T17:37:09.058860+0000 mgr.gibba043.dnkmem (mgr.34373) 11917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:10.206 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: audit 2021-03-10T17:37:09.059434+0000 mon.c (mon.1) 3060 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.207 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[31385]: cluster 2021-03-10T17:37:09.137442+0000 mgr.gibba043.dnkmem (mgr.34373) 11918 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:10.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.058708+0000 mgr.gibba043.dnkmem (mgr.34373) 11915 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:10.207 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.058749+0000 mgr.gibba043.dnkmem (mgr.34373) 11916 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:10.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cephadm 2021-03-10T17:37:09.058860+0000 mgr.gibba043.dnkmem (mgr.34373) 11917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:10.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: audit 2021-03-10T17:37:09.059434+0000 mon.c (mon.1) 3060 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.208 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:09 gibba003 bash[32348]: cluster 2021-03-10T17:37:09.137442+0000 mgr.gibba043.dnkmem (mgr.34373) 11918 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:08.838502+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:08.838714+0000 mgr.gibba043.dnkmem (mgr.34373) 11902 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:37:10.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:08.842124+0000 mgr.gibba043.dnkmem (mgr.34373) 11903 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:37:10.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:08.842490+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.049890+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:37:10.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.051294+0000 mgr.gibba043.dnkmem (mgr.34373) 11904 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:10.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.052697+0000 mgr.gibba043.dnkmem (mgr.34373) 11905 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:10.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.053293+0000 mon.c (mon.1) 3055 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:10.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.053658+0000 mgr.gibba043.dnkmem (mgr.34373) 11906 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:10.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.053698+0000 mgr.gibba043.dnkmem (mgr.34373) 11907 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:10.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.054367+0000 mon.c (mon.1) 3056 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.054670+0000 mgr.gibba043.dnkmem (mgr.34373) 11908 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:10.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.054710+0000 mgr.gibba043.dnkmem (mgr.34373) 11909 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:10.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.055316+0000 mon.c (mon.1) 3057 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.055367+0000 mgr.gibba043.dnkmem (mgr.34373) 11910 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:10.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.056221+0000 mon.c (mon.1) 3058 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.056541+0000 mgr.gibba043.dnkmem (mgr.34373) 11911 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:10.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.056580+0000 mgr.gibba043.dnkmem (mgr.34373) 11912 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:10.280 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.057598+0000 mgr.gibba043.dnkmem (mgr.34373) 11913 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:10.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.057932+0000 mgr.gibba043.dnkmem (mgr.34373) 11914 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:10.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.058271+0000 mon.c (mon.1) 3059 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.058708+0000 mgr.gibba043.dnkmem (mgr.34373) 11915 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:10.281 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.058749+0000 mgr.gibba043.dnkmem (mgr.34373) 11916 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:10.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cephadm 2021-03-10T17:37:09.058860+0000 mgr.gibba043.dnkmem (mgr.34373) 11917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:10.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: audit 2021-03-10T17:37:09.059434+0000 mon.c (mon.1) 3060 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.282 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:09 gibba043 bash[24019]: cluster 2021-03-10T17:37:09.137442+0000 mgr.gibba043.dnkmem (mgr.34373) 11918 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:11 gibba043 bash[24019]: cluster 2021-03-10T17:37:11.139285+0000 mgr.gibba043.dnkmem (mgr.34373) 11919 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:11 gibba003 bash[31385]: cluster 2021-03-10T17:37:11.139285+0000 mgr.gibba043.dnkmem (mgr.34373) 11919 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:11.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:11 gibba003 bash[32348]: cluster 2021-03-10T17:37:11.139285+0000 mgr.gibba043.dnkmem (mgr.34373) 11919 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:13 gibba043 bash[24019]: cluster 2021-03-10T17:37:13.140612+0000 mgr.gibba043.dnkmem (mgr.34373) 11920 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:13 gibba003 bash[31385]: cluster 2021-03-10T17:37:13.140612+0000 mgr.gibba043.dnkmem (mgr.34373) 11920 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:13.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:13 gibba003 bash[32348]: cluster 2021-03-10T17:37:13.140612+0000 mgr.gibba043.dnkmem (mgr.34373) 11920 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:14 gibba003 bash[31385]: audit 2021-03-10T17:37:14.176730+0000 mon.c (mon.1) 3061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:14 gibba003 bash[31385]: audit 2021-03-10T17:37:14.177778+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:14 gibba003 bash[32348]: audit 2021-03-10T17:37:14.176730+0000 mon.c (mon.1) 3061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:14.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:14 gibba003 bash[32348]: audit 2021-03-10T17:37:14.177778+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:14.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:14 gibba043 bash[24019]: audit 2021-03-10T17:37:14.176730+0000 mon.c (mon.1) 3061 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:14 gibba043 bash[24019]: audit 2021-03-10T17:37:14.177778+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.437737+0000 mon.c (mon.1) 3062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.438214+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.813818+0000 mon.c (mon.1) 3063 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.814592+0000 mon.c (mon.1) 3064 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.815088+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.815339+0000 mon.c (mon.1) 3065 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:37:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.816293+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.816536+0000 mon.c (mon.1) 3066 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.817304+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:37:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: audit 2021-03-10T17:37:14.818261+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[31385]: cluster 2021-03-10T17:37:15.142295+0000 mgr.gibba043.dnkmem (mgr.34373) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.437737+0000 mon.c (mon.1) 3062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.438214+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.813818+0000 mon.c (mon.1) 3063 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.814592+0000 mon.c (mon.1) 3064 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.815088+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.815339+0000 mon.c (mon.1) 3065 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:37:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.816293+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.816536+0000 mon.c (mon.1) 3066 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.817304+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:37:15.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: audit 2021-03-10T17:37:14.818261+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:15 gibba003 bash[32348]: cluster 2021-03-10T17:37:15.142295+0000 mgr.gibba043.dnkmem (mgr.34373) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.437737+0000 mon.c (mon.1) 3062 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.438214+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.813818+0000 mon.c (mon.1) 3063 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.814592+0000 mon.c (mon.1) 3064 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.815088+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.815339+0000 mon.c (mon.1) 3065 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:37:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.816293+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.816536+0000 mon.c (mon.1) 3066 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.817304+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:37:15.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: audit 2021-03-10T17:37:14.818261+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:37:15.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:15 gibba043 bash[24019]: cluster 2021-03-10T17:37:15.142295+0000 mgr.gibba043.dnkmem (mgr.34373) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:17.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:17 gibba043 bash[24019]: cluster 2021-03-10T17:37:17.143918+0000 mgr.gibba043.dnkmem (mgr.34373) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:17 gibba003 bash[31385]: cluster 2021-03-10T17:37:17.143918+0000 mgr.gibba043.dnkmem (mgr.34373) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:17 gibba003 bash[32348]: cluster 2021-03-10T17:37:17.143918+0000 mgr.gibba043.dnkmem (mgr.34373) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:19 gibba003 bash[31385]: cluster 2021-03-10T17:37:19.145328+0000 mgr.gibba043.dnkmem (mgr.34373) 11923 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:19.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:19 gibba003 bash[32348]: cluster 2021-03-10T17:37:19.145328+0000 mgr.gibba043.dnkmem (mgr.34373) 11923 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:19.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:19 gibba043 bash[24019]: cluster 2021-03-10T17:37:19.145328+0000 mgr.gibba043.dnkmem (mgr.34373) 11923 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:21 gibba043 bash[24019]: cluster 2021-03-10T17:37:21.147106+0000 mgr.gibba043.dnkmem (mgr.34373) 11924 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:21 gibba003 bash[31385]: cluster 2021-03-10T17:37:21.147106+0000 mgr.gibba043.dnkmem (mgr.34373) 11924 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:21.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:21 gibba003 bash[32348]: cluster 2021-03-10T17:37:21.147106+0000 mgr.gibba043.dnkmem (mgr.34373) 11924 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:23.117 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:37:23.350 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:37:23.350 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:37:23.350 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:37:23.351 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:37:23.351 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:37:23.351 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:37:23.351 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:37:23.352 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:37:23.352 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:37:23.353 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:37:23.353 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:37:23.353 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:37:23.353 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:37:23.354 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:37:23.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:37:23.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:37:23.355 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:37:23.356 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:37:23.357 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:37:23.357 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:37:23.358 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:37:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:23 gibba043 bash[24019]: audit 2021-03-10T17:37:23.105592+0000 mgr.gibba043.dnkmem (mgr.34373) 11925 : audit [DBG] from='client.52041 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:23 gibba043 bash[24019]: cluster 2021-03-10T17:37:23.148456+0000 mgr.gibba043.dnkmem (mgr.34373) 11926 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:23.602 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:37:23.603 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:37:23.603 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:23.603 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:37:23.603 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:37:23.603 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:23.604 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:37:23.604 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:37:23.604 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:37:23.604 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:37:23.605 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:37:23.605 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:37:23.605 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:37:23.605 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:37:23.605 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:37:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:23 gibba003 bash[31385]: audit 2021-03-10T17:37:23.105592+0000 mgr.gibba043.dnkmem (mgr.34373) 11925 : audit [DBG] from='client.52041 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:23 gibba003 bash[31385]: cluster 2021-03-10T17:37:23.148456+0000 mgr.gibba043.dnkmem (mgr.34373) 11926 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:23 gibba003 bash[32348]: audit 2021-03-10T17:37:23.105592+0000 mgr.gibba043.dnkmem (mgr.34373) 11925 : audit [DBG] from='client.52041 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:23 gibba003 bash[32348]: cluster 2021-03-10T17:37:23.148456+0000 mgr.gibba043.dnkmem (mgr.34373) 11926 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:24.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:24 gibba003 bash[31385]: audit 2021-03-10T17:37:23.335716+0000 mgr.gibba043.dnkmem (mgr.34373) 11927 : audit [DBG] from='client.52047 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:24.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:24 gibba003 bash[31385]: audit 2021-03-10T17:37:23.601369+0000 mon.c (mon.1) 3067 : audit [DBG] from='client.? 172.21.2.103:0/626249714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:24.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:24 gibba003 bash[31385]: cephadm 2021-03-10T17:37:24.074814+0000 mgr.gibba043.dnkmem (mgr.34373) 11928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:24.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:24 gibba003 bash[32348]: audit 2021-03-10T17:37:23.335716+0000 mgr.gibba043.dnkmem (mgr.34373) 11927 : audit [DBG] from='client.52047 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:24.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:24 gibba003 bash[32348]: audit 2021-03-10T17:37:23.601369+0000 mon.c (mon.1) 3067 : audit [DBG] from='client.? 172.21.2.103:0/626249714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:24.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:24 gibba003 bash[32348]: cephadm 2021-03-10T17:37:24.074814+0000 mgr.gibba043.dnkmem (mgr.34373) 11928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:24 gibba043 bash[24019]: audit 2021-03-10T17:37:23.335716+0000 mgr.gibba043.dnkmem (mgr.34373) 11927 : audit [DBG] from='client.52047 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:24 gibba043 bash[24019]: audit 2021-03-10T17:37:23.601369+0000 mon.c (mon.1) 3067 : audit [DBG] from='client.? 172.21.2.103:0/626249714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:24.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:24 gibba043 bash[24019]: cephadm 2021-03-10T17:37:24.074814+0000 mgr.gibba043.dnkmem (mgr.34373) 11928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:25.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:25 gibba003 bash[31385]: cluster 2021-03-10T17:37:25.150305+0000 mgr.gibba043.dnkmem (mgr.34373) 11929 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:25.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:25 gibba003 bash[32348]: cluster 2021-03-10T17:37:25.150305+0000 mgr.gibba043.dnkmem (mgr.34373) 11929 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:25.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:25 gibba043 bash[24019]: cluster 2021-03-10T17:37:25.150305+0000 mgr.gibba043.dnkmem (mgr.34373) 11929 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:27 gibba043 bash[24019]: cluster 2021-03-10T17:37:27.151882+0000 mgr.gibba043.dnkmem (mgr.34373) 11930 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:27 gibba003 bash[31385]: cluster 2021-03-10T17:37:27.151882+0000 mgr.gibba043.dnkmem (mgr.34373) 11930 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:27.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:27 gibba003 bash[32348]: cluster 2021-03-10T17:37:27.151882+0000 mgr.gibba043.dnkmem (mgr.34373) 11930 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:29 gibba003 bash[31385]: cluster 2021-03-10T17:37:29.153233+0000 mgr.gibba043.dnkmem (mgr.34373) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:29.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:29 gibba003 bash[32348]: cluster 2021-03-10T17:37:29.153233+0000 mgr.gibba043.dnkmem (mgr.34373) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:29.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:29 gibba043 bash[24019]: cluster 2021-03-10T17:37:29.153233+0000 mgr.gibba043.dnkmem (mgr.34373) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:31 gibba043 bash[24019]: cluster 2021-03-10T17:37:31.154922+0000 mgr.gibba043.dnkmem (mgr.34373) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:31 gibba003 bash[31385]: cluster 2021-03-10T17:37:31.154922+0000 mgr.gibba043.dnkmem (mgr.34373) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:31.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:31 gibba003 bash[32348]: cluster 2021-03-10T17:37:31.154922+0000 mgr.gibba043.dnkmem (mgr.34373) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:33.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:33 gibba043 bash[24019]: cluster 2021-03-10T17:37:33.156149+0000 mgr.gibba043.dnkmem (mgr.34373) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:33.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:33 gibba003 bash[31385]: cluster 2021-03-10T17:37:33.156149+0000 mgr.gibba043.dnkmem (mgr.34373) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:33.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:33 gibba003 bash[32348]: cluster 2021-03-10T17:37:33.156149+0000 mgr.gibba043.dnkmem (mgr.34373) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:35 gibba043 bash[24019]: cluster 2021-03-10T17:37:35.156696+0000 mgr.gibba043.dnkmem (mgr.34373) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:35 gibba003 bash[31385]: cluster 2021-03-10T17:37:35.156696+0000 mgr.gibba043.dnkmem (mgr.34373) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:35 gibba003 bash[32348]: cluster 2021-03-10T17:37:35.156696+0000 mgr.gibba043.dnkmem (mgr.34373) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:37 gibba043 bash[24019]: cluster 2021-03-10T17:37:37.158060+0000 mgr.gibba043.dnkmem (mgr.34373) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:37 gibba003 bash[31385]: cluster 2021-03-10T17:37:37.158060+0000 mgr.gibba043.dnkmem (mgr.34373) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:37 gibba003 bash[32348]: cluster 2021-03-10T17:37:37.158060+0000 mgr.gibba043.dnkmem (mgr.34373) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:39 gibba003 bash[31385]: cephadm 2021-03-10T17:37:39.083223+0000 mgr.gibba043.dnkmem (mgr.34373) 11936 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:39 gibba003 bash[31385]: cluster 2021-03-10T17:37:39.159588+0000 mgr.gibba043.dnkmem (mgr.34373) 11937 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:39 gibba003 bash[32348]: cephadm 2021-03-10T17:37:39.083223+0000 mgr.gibba043.dnkmem (mgr.34373) 11936 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:39 gibba003 bash[32348]: cluster 2021-03-10T17:37:39.159588+0000 mgr.gibba043.dnkmem (mgr.34373) 11937 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:39 gibba043 bash[24019]: cephadm 2021-03-10T17:37:39.083223+0000 mgr.gibba043.dnkmem (mgr.34373) 11936 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:39 gibba043 bash[24019]: cluster 2021-03-10T17:37:39.159588+0000 mgr.gibba043.dnkmem (mgr.34373) 11937 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:41 gibba043 bash[24019]: cluster 2021-03-10T17:37:41.161406+0000 mgr.gibba043.dnkmem (mgr.34373) 11938 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:41 gibba003 bash[31385]: cluster 2021-03-10T17:37:41.161406+0000 mgr.gibba043.dnkmem (mgr.34373) 11938 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:41.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:41 gibba003 bash[32348]: cluster 2021-03-10T17:37:41.161406+0000 mgr.gibba043.dnkmem (mgr.34373) 11938 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:43.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:43 gibba043 bash[24019]: cluster 2021-03-10T17:37:43.162863+0000 mgr.gibba043.dnkmem (mgr.34373) 11939 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:43.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:43 gibba003 bash[31385]: cluster 2021-03-10T17:37:43.162863+0000 mgr.gibba043.dnkmem (mgr.34373) 11939 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:43.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:43 gibba003 bash[32348]: cluster 2021-03-10T17:37:43.162863+0000 mgr.gibba043.dnkmem (mgr.34373) 11939 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:45 gibba043 bash[24019]: cluster 2021-03-10T17:37:45.164457+0000 mgr.gibba043.dnkmem (mgr.34373) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:45 gibba003 bash[31385]: cluster 2021-03-10T17:37:45.164457+0000 mgr.gibba043.dnkmem (mgr.34373) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:45 gibba003 bash[32348]: cluster 2021-03-10T17:37:45.164457+0000 mgr.gibba043.dnkmem (mgr.34373) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:47 gibba043 bash[24019]: cluster 2021-03-10T17:37:47.166028+0000 mgr.gibba043.dnkmem (mgr.34373) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:47 gibba003 bash[31385]: cluster 2021-03-10T17:37:47.166028+0000 mgr.gibba043.dnkmem (mgr.34373) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:47 gibba003 bash[32348]: cluster 2021-03-10T17:37:47.166028+0000 mgr.gibba043.dnkmem (mgr.34373) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:49 gibba003 bash[31385]: cluster 2021-03-10T17:37:49.167626+0000 mgr.gibba043.dnkmem (mgr.34373) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:49 gibba003 bash[32348]: cluster 2021-03-10T17:37:49.167626+0000 mgr.gibba043.dnkmem (mgr.34373) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:49 gibba043 bash[24019]: cluster 2021-03-10T17:37:49.167626+0000 mgr.gibba043.dnkmem (mgr.34373) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:51 gibba043 bash[24019]: cluster 2021-03-10T17:37:51.169195+0000 mgr.gibba043.dnkmem (mgr.34373) 11943 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:51 gibba003 bash[31385]: cluster 2021-03-10T17:37:51.169195+0000 mgr.gibba043.dnkmem (mgr.34373) 11943 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:51 gibba003 bash[32348]: cluster 2021-03-10T17:37:51.169195+0000 mgr.gibba043.dnkmem (mgr.34373) 11943 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:53 gibba043 bash[24019]: cluster 2021-03-10T17:37:53.170688+0000 mgr.gibba043.dnkmem (mgr.34373) 11944 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:53 gibba003 bash[31385]: cluster 2021-03-10T17:37:53.170688+0000 mgr.gibba043.dnkmem (mgr.34373) 11944 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:53 gibba003 bash[32348]: cluster 2021-03-10T17:37:53.170688+0000 mgr.gibba043.dnkmem (mgr.34373) 11944 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.845 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:37:54.103 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:37:54.104 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:37:54.104 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:37:54.104 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:37:54.105 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:37:54.105 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:37:54.105 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:37:54.105 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:37:54.105 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:37:54.106 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:37:54.106 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:37:54.106 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:37:54.106 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:37:54.107 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:37:54.107 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:37:54.107 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:37:54.107 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:37:54.107 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:37:54.108 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:37:54.108 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:37:54.108 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:37:54.355 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:37:54.356 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:37:54.356 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:54.356 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:37:54.356 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:37:54.357 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:54.357 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:37:54.357 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:37:54.357 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:37:54.358 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:37:54.358 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:37:54.358 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:37:54.358 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:37:54.358 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:37:54.359 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:37:54.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[31385]: audit 2021-03-10T17:37:53.834377+0000 mgr.gibba043.dnkmem (mgr.34373) 11945 : audit [DBG] from='client.62050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:54.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[31385]: audit 2021-03-10T17:37:54.061833+0000 mgr.gibba043.dnkmem (mgr.34373) 11946 : audit [DBG] from='client.52065 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:54.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[31385]: cephadm 2021-03-10T17:37:54.101398+0000 mgr.gibba043.dnkmem (mgr.34373) 11947 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:54.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[31385]: audit 2021-03-10T17:37:54.354559+0000 mon.c (mon.1) 3068 : audit [DBG] from='client.? 172.21.2.103:0/3555059906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:54.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[32348]: audit 2021-03-10T17:37:53.834377+0000 mgr.gibba043.dnkmem (mgr.34373) 11945 : audit [DBG] from='client.62050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:54.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[32348]: audit 2021-03-10T17:37:54.061833+0000 mgr.gibba043.dnkmem (mgr.34373) 11946 : audit [DBG] from='client.52065 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:54.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[32348]: cephadm 2021-03-10T17:37:54.101398+0000 mgr.gibba043.dnkmem (mgr.34373) 11947 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:54.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:54 gibba003 bash[32348]: audit 2021-03-10T17:37:54.354559+0000 mon.c (mon.1) 3068 : audit [DBG] from='client.? 172.21.2.103:0/3555059906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:54.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:54 gibba043 bash[24019]: audit 2021-03-10T17:37:53.834377+0000 mgr.gibba043.dnkmem (mgr.34373) 11945 : audit [DBG] from='client.62050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:54 gibba043 bash[24019]: audit 2021-03-10T17:37:54.061833+0000 mgr.gibba043.dnkmem (mgr.34373) 11946 : audit [DBG] from='client.52065 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:54 gibba043 bash[24019]: cephadm 2021-03-10T17:37:54.101398+0000 mgr.gibba043.dnkmem (mgr.34373) 11947 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:37:54.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:54 gibba043 bash[24019]: audit 2021-03-10T17:37:54.354559+0000 mon.c (mon.1) 3068 : audit [DBG] from='client.? 172.21.2.103:0/3555059906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:55 gibba003 bash[31385]: cluster 2021-03-10T17:37:55.172617+0000 mgr.gibba043.dnkmem (mgr.34373) 11948 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:55.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:55 gibba003 bash[32348]: cluster 2021-03-10T17:37:55.172617+0000 mgr.gibba043.dnkmem (mgr.34373) 11948 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:55.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:55 gibba043 bash[24019]: cluster 2021-03-10T17:37:55.172617+0000 mgr.gibba043.dnkmem (mgr.34373) 11948 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:57.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:57 gibba043 bash[24019]: cluster 2021-03-10T17:37:57.174294+0000 mgr.gibba043.dnkmem (mgr.34373) 11949 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:57.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:57 gibba003 bash[31385]: cluster 2021-03-10T17:37:57.174294+0000 mgr.gibba043.dnkmem (mgr.34373) 11949 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:57.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:57 gibba003 bash[32348]: cluster 2021-03-10T17:37:57.174294+0000 mgr.gibba043.dnkmem (mgr.34373) 11949 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:59.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:37:59 gibba003 bash[31385]: cluster 2021-03-10T17:37:59.175879+0000 mgr.gibba043.dnkmem (mgr.34373) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:59.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:37:59 gibba003 bash[32348]: cluster 2021-03-10T17:37:59.175879+0000 mgr.gibba043.dnkmem (mgr.34373) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:37:59 gibba043 bash[24019]: cluster 2021-03-10T17:37:59.175879+0000 mgr.gibba043.dnkmem (mgr.34373) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:01.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:01 gibba043 bash[24019]: cluster 2021-03-10T17:38:01.177786+0000 mgr.gibba043.dnkmem (mgr.34373) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:01.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:01 gibba003 bash[31385]: cluster 2021-03-10T17:38:01.177786+0000 mgr.gibba043.dnkmem (mgr.34373) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:01.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:01 gibba003 bash[32348]: cluster 2021-03-10T17:38:01.177786+0000 mgr.gibba043.dnkmem (mgr.34373) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:03 gibba043 bash[24019]: cluster 2021-03-10T17:38:03.179127+0000 mgr.gibba043.dnkmem (mgr.34373) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:03 gibba003 bash[31385]: cluster 2021-03-10T17:38:03.179127+0000 mgr.gibba043.dnkmem (mgr.34373) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:03 gibba003 bash[32348]: cluster 2021-03-10T17:38:03.179127+0000 mgr.gibba043.dnkmem (mgr.34373) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:05 gibba043 bash[24019]: cluster 2021-03-10T17:38:05.180730+0000 mgr.gibba043.dnkmem (mgr.34373) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:05 gibba003 bash[31385]: cluster 2021-03-10T17:38:05.180730+0000 mgr.gibba043.dnkmem (mgr.34373) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:05 gibba003 bash[32348]: cluster 2021-03-10T17:38:05.180730+0000 mgr.gibba043.dnkmem (mgr.34373) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:07 gibba043 bash[24019]: cluster 2021-03-10T17:38:07.182090+0000 mgr.gibba043.dnkmem (mgr.34373) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:07.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:07 gibba003 bash[31385]: cluster 2021-03-10T17:38:07.182090+0000 mgr.gibba043.dnkmem (mgr.34373) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:07.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:07 gibba003 bash[32348]: cluster 2021-03-10T17:38:07.182090+0000 mgr.gibba043.dnkmem (mgr.34373) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.118256+0000 mgr.gibba043.dnkmem (mgr.34373) 11955 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:38:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.119876+0000 mgr.gibba043.dnkmem (mgr.34373) 11956 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:38:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: cluster 2021-03-10T17:38:09.182581+0000 mgr.gibba043.dnkmem (mgr.34373) 11957 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.345502+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:38:09.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.349200+0000 mon.c (mon.1) 3069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:09.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.350823+0000 mon.c (mon.1) 3070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.352175+0000 mon.c (mon.1) 3071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.353500+0000 mon.c (mon.1) 3072 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.356812+0000 mon.c (mon.1) 3073 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[31385]: audit 2021-03-10T17:38:09.358716+0000 mon.c (mon.1) 3074 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.118256+0000 mgr.gibba043.dnkmem (mgr.34373) 11955 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:38:09.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.119876+0000 mgr.gibba043.dnkmem (mgr.34373) 11956 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:38:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: cluster 2021-03-10T17:38:09.182581+0000 mgr.gibba043.dnkmem (mgr.34373) 11957 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.345502+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:38:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.349200+0000 mon.c (mon.1) 3069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:09.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.350823+0000 mon.c (mon.1) 3070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.352175+0000 mon.c (mon.1) 3071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.353500+0000 mon.c (mon.1) 3072 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.356812+0000 mon.c (mon.1) 3073 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:09 gibba003 bash[32348]: audit 2021-03-10T17:38:09.358716+0000 mon.c (mon.1) 3074 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.118256+0000 mgr.gibba043.dnkmem (mgr.34373) 11955 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:38:09.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.119876+0000 mgr.gibba043.dnkmem (mgr.34373) 11956 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:38:09.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: cluster 2021-03-10T17:38:09.182581+0000 mgr.gibba043.dnkmem (mgr.34373) 11957 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:09.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.345502+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:38:09.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.349200+0000 mon.c (mon.1) 3069 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:09.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.350823+0000 mon.c (mon.1) 3070 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.352175+0000 mon.c (mon.1) 3071 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.353500+0000 mon.c (mon.1) 3072 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.356812+0000 mon.c (mon.1) 3073 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:09.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:09 gibba043 bash[24019]: audit 2021-03-10T17:38:09.358716+0000 mon.c (mon.1) 3074 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:10.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.347037+0000 mgr.gibba043.dnkmem (mgr.34373) 11958 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:38:10.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.349037+0000 mgr.gibba043.dnkmem (mgr.34373) 11959 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:38:10.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.350351+0000 mgr.gibba043.dnkmem (mgr.34373) 11960 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:38:10.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.350384+0000 mgr.gibba043.dnkmem (mgr.34373) 11961 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:38:10.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.351651+0000 mgr.gibba043.dnkmem (mgr.34373) 11962 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:38:10.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.351781+0000 mgr.gibba043.dnkmem (mgr.34373) 11963 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:38:10.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.353180+0000 mgr.gibba043.dnkmem (mgr.34373) 11964 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:38:10.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.354886+0000 mgr.gibba043.dnkmem (mgr.34373) 11965 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:38:10.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.354919+0000 mgr.gibba043.dnkmem (mgr.34373) 11966 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:38:10.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.356704+0000 mgr.gibba043.dnkmem (mgr.34373) 11967 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:38:10.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.357018+0000 mgr.gibba043.dnkmem (mgr.34373) 11968 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:38:10.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.358732+0000 mgr.gibba043.dnkmem (mgr.34373) 11969 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:38:10.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.358771+0000 mgr.gibba043.dnkmem (mgr.34373) 11970 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:38:10.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[31385]: cephadm 2021-03-10T17:38:09.358877+0000 mgr.gibba043.dnkmem (mgr.34373) 11971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:10.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.347037+0000 mgr.gibba043.dnkmem (mgr.34373) 11958 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:38:10.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.349037+0000 mgr.gibba043.dnkmem (mgr.34373) 11959 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:38:10.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.350351+0000 mgr.gibba043.dnkmem (mgr.34373) 11960 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:38:10.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.350384+0000 mgr.gibba043.dnkmem (mgr.34373) 11961 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:38:10.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.351651+0000 mgr.gibba043.dnkmem (mgr.34373) 11962 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:38:10.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.351781+0000 mgr.gibba043.dnkmem (mgr.34373) 11963 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:38:10.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.353180+0000 mgr.gibba043.dnkmem (mgr.34373) 11964 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:38:10.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.354886+0000 mgr.gibba043.dnkmem (mgr.34373) 11965 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:38:10.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.354919+0000 mgr.gibba043.dnkmem (mgr.34373) 11966 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:38:10.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.356704+0000 mgr.gibba043.dnkmem (mgr.34373) 11967 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:38:10.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.357018+0000 mgr.gibba043.dnkmem (mgr.34373) 11968 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:38:10.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.358732+0000 mgr.gibba043.dnkmem (mgr.34373) 11969 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:38:10.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.358771+0000 mgr.gibba043.dnkmem (mgr.34373) 11970 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:38:10.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:10 gibba003 bash[32348]: cephadm 2021-03-10T17:38:09.358877+0000 mgr.gibba043.dnkmem (mgr.34373) 11971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:10.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.347037+0000 mgr.gibba043.dnkmem (mgr.34373) 11958 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:38:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.349037+0000 mgr.gibba043.dnkmem (mgr.34373) 11959 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:38:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.350351+0000 mgr.gibba043.dnkmem (mgr.34373) 11960 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:38:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.350384+0000 mgr.gibba043.dnkmem (mgr.34373) 11961 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:38:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.351651+0000 mgr.gibba043.dnkmem (mgr.34373) 11962 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:38:10.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.351781+0000 mgr.gibba043.dnkmem (mgr.34373) 11963 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:38:10.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.353180+0000 mgr.gibba043.dnkmem (mgr.34373) 11964 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:38:10.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.354886+0000 mgr.gibba043.dnkmem (mgr.34373) 11965 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:38:10.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.354919+0000 mgr.gibba043.dnkmem (mgr.34373) 11966 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:38:10.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.356704+0000 mgr.gibba043.dnkmem (mgr.34373) 11967 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:38:10.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.357018+0000 mgr.gibba043.dnkmem (mgr.34373) 11968 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:38:10.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.358732+0000 mgr.gibba043.dnkmem (mgr.34373) 11969 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:38:10.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.358771+0000 mgr.gibba043.dnkmem (mgr.34373) 11970 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:38:10.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:10 gibba043 bash[24019]: cephadm 2021-03-10T17:38:09.358877+0000 mgr.gibba043.dnkmem (mgr.34373) 11971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:11 gibba003 bash[31385]: cluster 2021-03-10T17:38:11.183547+0000 mgr.gibba043.dnkmem (mgr.34373) 11972 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:11.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:11 gibba003 bash[32348]: cluster 2021-03-10T17:38:11.183547+0000 mgr.gibba043.dnkmem (mgr.34373) 11972 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:11.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:11 gibba043 bash[24019]: cluster 2021-03-10T17:38:11.183547+0000 mgr.gibba043.dnkmem (mgr.34373) 11972 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:13 gibba043 bash[24019]: cluster 2021-03-10T17:38:13.184813+0000 mgr.gibba043.dnkmem (mgr.34373) 11973 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:13 gibba003 bash[31385]: cluster 2021-03-10T17:38:13.184813+0000 mgr.gibba043.dnkmem (mgr.34373) 11973 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:13 gibba003 bash[32348]: cluster 2021-03-10T17:38:13.184813+0000 mgr.gibba043.dnkmem (mgr.34373) 11973 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:14.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:14 gibba003 bash[31385]: audit 2021-03-10T17:38:14.183923+0000 mon.c (mon.1) 3075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:14 gibba003 bash[31385]: audit 2021-03-10T17:38:14.185065+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:14 gibba003 bash[32348]: audit 2021-03-10T17:38:14.183923+0000 mon.c (mon.1) 3075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:14.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:14 gibba003 bash[32348]: audit 2021-03-10T17:38:14.185065+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:14 gibba043 bash[24019]: audit 2021-03-10T17:38:14.183923+0000 mon.c (mon.1) 3075 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:14 gibba043 bash[24019]: audit 2021-03-10T17:38:14.185065+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.441082+0000 mon.c (mon.1) 3076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.441498+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.825446+0000 mon.c (mon.1) 3077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:38:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.826215+0000 mon.c (mon.1) 3078 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.826638+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:38:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.826904+0000 mon.c (mon.1) 3079 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.827971+0000 mon.c (mon.1) 3080 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:38:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.827998+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.829163+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: audit 2021-03-10T17:38:14.830355+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:38:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[31385]: cluster 2021-03-10T17:38:15.186683+0000 mgr.gibba043.dnkmem (mgr.34373) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.441082+0000 mon.c (mon.1) 3076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.441498+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.825446+0000 mon.c (mon.1) 3077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:38:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.826215+0000 mon.c (mon.1) 3078 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.826638+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:38:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.826904+0000 mon.c (mon.1) 3079 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.827971+0000 mon.c (mon.1) 3080 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:38:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.827998+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.829163+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: audit 2021-03-10T17:38:14.830355+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:38:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:15 gibba003 bash[32348]: cluster 2021-03-10T17:38:15.186683+0000 mgr.gibba043.dnkmem (mgr.34373) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.441082+0000 mon.c (mon.1) 3076 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.441498+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.825446+0000 mon.c (mon.1) 3077 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:38:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.826215+0000 mon.c (mon.1) 3078 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.826638+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:38:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.826904+0000 mon.c (mon.1) 3079 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.827971+0000 mon.c (mon.1) 3080 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:38:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.827998+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.829163+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:38:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: audit 2021-03-10T17:38:14.830355+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:38:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:15 gibba043 bash[24019]: cluster 2021-03-10T17:38:15.186683+0000 mgr.gibba043.dnkmem (mgr.34373) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:17 gibba043 bash[24019]: cluster 2021-03-10T17:38:17.188232+0000 mgr.gibba043.dnkmem (mgr.34373) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:17 gibba003 bash[31385]: cluster 2021-03-10T17:38:17.188232+0000 mgr.gibba043.dnkmem (mgr.34373) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:17.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:17 gibba003 bash[32348]: cluster 2021-03-10T17:38:17.188232+0000 mgr.gibba043.dnkmem (mgr.34373) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:19.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:19 gibba003 bash[31385]: cluster 2021-03-10T17:38:19.189609+0000 mgr.gibba043.dnkmem (mgr.34373) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:19.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:19 gibba003 bash[32348]: cluster 2021-03-10T17:38:19.189609+0000 mgr.gibba043.dnkmem (mgr.34373) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:19.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:19 gibba043 bash[24019]: cluster 2021-03-10T17:38:19.189609+0000 mgr.gibba043.dnkmem (mgr.34373) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:21.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:21 gibba043 bash[24019]: cluster 2021-03-10T17:38:21.191306+0000 mgr.gibba043.dnkmem (mgr.34373) 11977 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:21 gibba003 bash[31385]: cluster 2021-03-10T17:38:21.191306+0000 mgr.gibba043.dnkmem (mgr.34373) 11977 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:21.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:21 gibba003 bash[32348]: cluster 2021-03-10T17:38:21.191306+0000 mgr.gibba043.dnkmem (mgr.34373) 11977 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:23.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:23 gibba043 bash[24019]: cluster 2021-03-10T17:38:23.192889+0000 mgr.gibba043.dnkmem (mgr.34373) 11978 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:23 gibba003 bash[31385]: cluster 2021-03-10T17:38:23.192889+0000 mgr.gibba043.dnkmem (mgr.34373) 11978 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:23.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:23 gibba003 bash[32348]: cluster 2021-03-10T17:38:23.192889+0000 mgr.gibba043.dnkmem (mgr.34373) 11978 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:24.593 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:38:24.820 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:38:24.821 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:38:24.821 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:38:24.821 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:38:24.821 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:38:24.822 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:38:24.822 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:38:24.822 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:38:24.822 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:38:24.822 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:38:24.823 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:38:24.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:38:24.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:38:24.823 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:38:24.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:38:24.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:38:24.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:38:24.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:38:24.824 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:38:24.825 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:38:24.825 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:38:25.068 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:38:25.069 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:38:25.069 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:25.069 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:38:25.069 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:38:25.070 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:25.070 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:38:25.070 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:38:25.070 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:38:25.071 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:38:25.071 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:38:25.071 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:38:25.071 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:38:25.071 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:38:25.072 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:38:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:25 gibba003 bash[31385]: audit 2021-03-10T17:38:25.066766+0000 mon.a (mon.0) 2369 : audit [DBG] from='client.? 172.21.2.103:0/4147825748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:25 gibba003 bash[32348]: audit 2021-03-10T17:38:25.066766+0000 mon.a (mon.0) 2369 : audit [DBG] from='client.? 172.21.2.103:0/4147825748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:25 gibba043 bash[24019]: audit 2021-03-10T17:38:25.066766+0000 mon.a (mon.0) 2369 : audit [DBG] from='client.? 172.21.2.103:0/4147825748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:26.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[31385]: cephadm 2021-03-10T17:38:24.374984+0000 mgr.gibba043.dnkmem (mgr.34373) 11979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[31385]: audit 2021-03-10T17:38:24.582616+0000 mgr.gibba043.dnkmem (mgr.34373) 11980 : audit [DBG] from='client.52077 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[31385]: audit 2021-03-10T17:38:24.806056+0000 mgr.gibba043.dnkmem (mgr.34373) 11981 : audit [DBG] from='client.52083 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:26.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[31385]: cluster 2021-03-10T17:38:25.194080+0000 mgr.gibba043.dnkmem (mgr.34373) 11982 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[32348]: cephadm 2021-03-10T17:38:24.374984+0000 mgr.gibba043.dnkmem (mgr.34373) 11979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[32348]: audit 2021-03-10T17:38:24.582616+0000 mgr.gibba043.dnkmem (mgr.34373) 11980 : audit [DBG] from='client.52077 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:26.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[32348]: audit 2021-03-10T17:38:24.806056+0000 mgr.gibba043.dnkmem (mgr.34373) 11981 : audit [DBG] from='client.52083 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:26.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:26 gibba003 bash[32348]: cluster 2021-03-10T17:38:25.194080+0000 mgr.gibba043.dnkmem (mgr.34373) 11982 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:26 gibba043 bash[24019]: cephadm 2021-03-10T17:38:24.374984+0000 mgr.gibba043.dnkmem (mgr.34373) 11979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:26 gibba043 bash[24019]: audit 2021-03-10T17:38:24.582616+0000 mgr.gibba043.dnkmem (mgr.34373) 11980 : audit [DBG] from='client.52077 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:26 gibba043 bash[24019]: audit 2021-03-10T17:38:24.806056+0000 mgr.gibba043.dnkmem (mgr.34373) 11981 : audit [DBG] from='client.52083 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:26.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:26 gibba043 bash[24019]: cluster 2021-03-10T17:38:25.194080+0000 mgr.gibba043.dnkmem (mgr.34373) 11982 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:27.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:27 gibba043 bash[24019]: cluster 2021-03-10T17:38:27.195721+0000 mgr.gibba043.dnkmem (mgr.34373) 11983 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:27 gibba003 bash[31385]: cluster 2021-03-10T17:38:27.195721+0000 mgr.gibba043.dnkmem (mgr.34373) 11983 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:27.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:27 gibba003 bash[32348]: cluster 2021-03-10T17:38:27.195721+0000 mgr.gibba043.dnkmem (mgr.34373) 11983 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:29 gibba003 bash[31385]: cluster 2021-03-10T17:38:29.197380+0000 mgr.gibba043.dnkmem (mgr.34373) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:29 gibba003 bash[32348]: cluster 2021-03-10T17:38:29.197380+0000 mgr.gibba043.dnkmem (mgr.34373) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:29.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:29 gibba043 bash[24019]: cluster 2021-03-10T17:38:29.197380+0000 mgr.gibba043.dnkmem (mgr.34373) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:31 gibba043 bash[24019]: cluster 2021-03-10T17:38:31.199456+0000 mgr.gibba043.dnkmem (mgr.34373) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:31 gibba003 bash[31385]: cluster 2021-03-10T17:38:31.199456+0000 mgr.gibba043.dnkmem (mgr.34373) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:31.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:31 gibba003 bash[32348]: cluster 2021-03-10T17:38:31.199456+0000 mgr.gibba043.dnkmem (mgr.34373) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:33.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:33 gibba003 bash[31385]: cluster 2021-03-10T17:38:33.200625+0000 mgr.gibba043.dnkmem (mgr.34373) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:33.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:33 gibba003 bash[32348]: cluster 2021-03-10T17:38:33.200625+0000 mgr.gibba043.dnkmem (mgr.34373) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:33.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:33 gibba043 bash[24019]: cluster 2021-03-10T17:38:33.200625+0000 mgr.gibba043.dnkmem (mgr.34373) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:35 gibba003 bash[31385]: cluster 2021-03-10T17:38:35.202494+0000 mgr.gibba043.dnkmem (mgr.34373) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:35.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:35 gibba003 bash[32348]: cluster 2021-03-10T17:38:35.202494+0000 mgr.gibba043.dnkmem (mgr.34373) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:35 gibba043 bash[24019]: cluster 2021-03-10T17:38:35.202494+0000 mgr.gibba043.dnkmem (mgr.34373) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:37 gibba003 bash[31385]: cluster 2021-03-10T17:38:37.204211+0000 mgr.gibba043.dnkmem (mgr.34373) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:37 gibba003 bash[32348]: cluster 2021-03-10T17:38:37.204211+0000 mgr.gibba043.dnkmem (mgr.34373) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:37 gibba043 bash[24019]: cluster 2021-03-10T17:38:37.204211+0000 mgr.gibba043.dnkmem (mgr.34373) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:39 gibba003 bash[31385]: cluster 2021-03-10T17:38:39.205790+0000 mgr.gibba043.dnkmem (mgr.34373) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:39 gibba003 bash[32348]: cluster 2021-03-10T17:38:39.205790+0000 mgr.gibba043.dnkmem (mgr.34373) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:39.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:39 gibba043 bash[24019]: cluster 2021-03-10T17:38:39.205790+0000 mgr.gibba043.dnkmem (mgr.34373) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:40.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:40 gibba003 bash[31385]: cephadm 2021-03-10T17:38:39.391106+0000 mgr.gibba043.dnkmem (mgr.34373) 11990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:40.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:40 gibba003 bash[32348]: cephadm 2021-03-10T17:38:39.391106+0000 mgr.gibba043.dnkmem (mgr.34373) 11990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:40.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:40 gibba043 bash[24019]: cephadm 2021-03-10T17:38:39.391106+0000 mgr.gibba043.dnkmem (mgr.34373) 11990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:41 gibba043 bash[24019]: cluster 2021-03-10T17:38:41.207516+0000 mgr.gibba043.dnkmem (mgr.34373) 11991 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:41.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:41 gibba003 bash[31385]: cluster 2021-03-10T17:38:41.207516+0000 mgr.gibba043.dnkmem (mgr.34373) 11991 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:41.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:41 gibba003 bash[32348]: cluster 2021-03-10T17:38:41.207516+0000 mgr.gibba043.dnkmem (mgr.34373) 11991 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:43 gibba003 bash[31385]: cluster 2021-03-10T17:38:43.208800+0000 mgr.gibba043.dnkmem (mgr.34373) 11992 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:43.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:43 gibba003 bash[32348]: cluster 2021-03-10T17:38:43.208800+0000 mgr.gibba043.dnkmem (mgr.34373) 11992 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:43 gibba043 bash[24019]: cluster 2021-03-10T17:38:43.208800+0000 mgr.gibba043.dnkmem (mgr.34373) 11992 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:45 gibba003 bash[31385]: cluster 2021-03-10T17:38:45.210403+0000 mgr.gibba043.dnkmem (mgr.34373) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:45.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:45 gibba003 bash[32348]: cluster 2021-03-10T17:38:45.210403+0000 mgr.gibba043.dnkmem (mgr.34373) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:45.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:45 gibba043 bash[24019]: cluster 2021-03-10T17:38:45.210403+0000 mgr.gibba043.dnkmem (mgr.34373) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:47 gibba003 bash[31385]: cluster 2021-03-10T17:38:47.212132+0000 mgr.gibba043.dnkmem (mgr.34373) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:47 gibba003 bash[32348]: cluster 2021-03-10T17:38:47.212132+0000 mgr.gibba043.dnkmem (mgr.34373) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:47.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:47 gibba043 bash[24019]: cluster 2021-03-10T17:38:47.212132+0000 mgr.gibba043.dnkmem (mgr.34373) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:49.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:49 gibba003 bash[31385]: cluster 2021-03-10T17:38:49.213758+0000 mgr.gibba043.dnkmem (mgr.34373) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:49 gibba003 bash[32348]: cluster 2021-03-10T17:38:49.213758+0000 mgr.gibba043.dnkmem (mgr.34373) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:49.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:49 gibba043 bash[24019]: cluster 2021-03-10T17:38:49.213758+0000 mgr.gibba043.dnkmem (mgr.34373) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:51.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:51 gibba003 bash[31385]: cluster 2021-03-10T17:38:51.215611+0000 mgr.gibba043.dnkmem (mgr.34373) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:51.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:51 gibba003 bash[32348]: cluster 2021-03-10T17:38:51.215611+0000 mgr.gibba043.dnkmem (mgr.34373) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:51.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:51 gibba043 bash[24019]: cluster 2021-03-10T17:38:51.215611+0000 mgr.gibba043.dnkmem (mgr.34373) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:53.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:53 gibba003 bash[31385]: cluster 2021-03-10T17:38:53.216918+0000 mgr.gibba043.dnkmem (mgr.34373) 11997 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:53.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:53 gibba003 bash[32348]: cluster 2021-03-10T17:38:53.216918+0000 mgr.gibba043.dnkmem (mgr.34373) 11997 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:53.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:53 gibba043 bash[24019]: cluster 2021-03-10T17:38:53.216918+0000 mgr.gibba043.dnkmem (mgr.34373) 11997 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:55.314 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:38:55.542 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:38:55.543 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:38:55.543 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:38:55.543 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:38:55.543 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:38:55.544 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:38:55.544 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:38:55.544 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:38:55.544 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:38:55.545 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:38:55.545 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:38:55.545 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:38:55.545 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:38:55.545 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:38:55.546 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:38:55.546 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:38:55.546 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:38:55.546 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:38:55.547 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:38:55.547 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:38:55.547 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:38:55.691 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:55 gibba003 bash[31385]: cephadm 2021-03-10T17:38:54.407210+0000 mgr.gibba043.dnkmem (mgr.34373) 11998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:55.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:55 gibba003 bash[31385]: cluster 2021-03-10T17:38:55.218709+0000 mgr.gibba043.dnkmem (mgr.34373) 11999 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:55.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:55 gibba003 bash[32348]: cephadm 2021-03-10T17:38:54.407210+0000 mgr.gibba043.dnkmem (mgr.34373) 11998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:55.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:55 gibba003 bash[32348]: cluster 2021-03-10T17:38:55.218709+0000 mgr.gibba043.dnkmem (mgr.34373) 11999 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:55 gibba043 bash[24019]: cephadm 2021-03-10T17:38:54.407210+0000 mgr.gibba043.dnkmem (mgr.34373) 11998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:38:55.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:55 gibba043 bash[24019]: cluster 2021-03-10T17:38:55.218709+0000 mgr.gibba043.dnkmem (mgr.34373) 11999 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:55.789 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:38:55.790 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:38:55.790 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:55.790 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:38:55.791 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:38:55.791 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:55.791 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:38:55.791 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:38:55.791 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:38:55.792 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:38:55.792 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:38:55.792 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:38:55.792 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:38:55.793 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:38:55.793 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:38:56.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:56 gibba003 bash[31385]: audit 2021-03-10T17:38:55.303197+0000 mgr.gibba043.dnkmem (mgr.34373) 12000 : audit [DBG] from='client.62086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:56.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:56 gibba003 bash[31385]: audit 2021-03-10T17:38:55.528448+0000 mgr.gibba043.dnkmem (mgr.34373) 12001 : audit [DBG] from='client.62092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:56.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:56 gibba003 bash[31385]: audit 2021-03-10T17:38:55.788634+0000 mon.c (mon.1) 3081 : audit [DBG] from='client.? 172.21.2.103:0/1875598759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:56.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:56 gibba003 bash[32348]: audit 2021-03-10T17:38:55.303197+0000 mgr.gibba043.dnkmem (mgr.34373) 12000 : audit [DBG] from='client.62086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:56.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:56 gibba003 bash[32348]: audit 2021-03-10T17:38:55.528448+0000 mgr.gibba043.dnkmem (mgr.34373) 12001 : audit [DBG] from='client.62092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:56.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:56 gibba003 bash[32348]: audit 2021-03-10T17:38:55.788634+0000 mon.c (mon.1) 3081 : audit [DBG] from='client.? 172.21.2.103:0/1875598759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:56.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:56 gibba043 bash[24019]: audit 2021-03-10T17:38:55.303197+0000 mgr.gibba043.dnkmem (mgr.34373) 12000 : audit [DBG] from='client.62086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:56 gibba043 bash[24019]: audit 2021-03-10T17:38:55.528448+0000 mgr.gibba043.dnkmem (mgr.34373) 12001 : audit [DBG] from='client.62092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:56.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:56 gibba043 bash[24019]: audit 2021-03-10T17:38:55.788634+0000 mon.c (mon.1) 3081 : audit [DBG] from='client.? 172.21.2.103:0/1875598759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:57.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:57 gibba003 bash[31385]: cluster 2021-03-10T17:38:57.220375+0000 mgr.gibba043.dnkmem (mgr.34373) 12002 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:57.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:57 gibba003 bash[32348]: cluster 2021-03-10T17:38:57.220375+0000 mgr.gibba043.dnkmem (mgr.34373) 12002 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:57.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:57 gibba043 bash[24019]: cluster 2021-03-10T17:38:57.220375+0000 mgr.gibba043.dnkmem (mgr.34373) 12002 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:59.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:38:59 gibba043 bash[24019]: cluster 2021-03-10T17:38:59.221976+0000 mgr.gibba043.dnkmem (mgr.34373) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:59.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:38:59 gibba003 bash[31385]: cluster 2021-03-10T17:38:59.221976+0000 mgr.gibba043.dnkmem (mgr.34373) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:59.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:38:59 gibba003 bash[32348]: cluster 2021-03-10T17:38:59.221976+0000 mgr.gibba043.dnkmem (mgr.34373) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:02 gibba003 bash[31385]: cluster 2021-03-10T17:39:01.223838+0000 mgr.gibba043.dnkmem (mgr.34373) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:02 gibba003 bash[32348]: cluster 2021-03-10T17:39:01.223838+0000 mgr.gibba043.dnkmem (mgr.34373) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:02 gibba043 bash[24019]: cluster 2021-03-10T17:39:01.223838+0000 mgr.gibba043.dnkmem (mgr.34373) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:04 gibba003 bash[31385]: cluster 2021-03-10T17:39:03.224865+0000 mgr.gibba043.dnkmem (mgr.34373) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:04 gibba003 bash[32348]: cluster 2021-03-10T17:39:03.224865+0000 mgr.gibba043.dnkmem (mgr.34373) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:04 gibba043 bash[24019]: cluster 2021-03-10T17:39:03.224865+0000 mgr.gibba043.dnkmem (mgr.34373) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:06 gibba043 bash[24019]: cluster 2021-03-10T17:39:05.226368+0000 mgr.gibba043.dnkmem (mgr.34373) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:06 gibba003 bash[31385]: cluster 2021-03-10T17:39:05.226368+0000 mgr.gibba043.dnkmem (mgr.34373) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:06 gibba003 bash[32348]: cluster 2021-03-10T17:39:05.226368+0000 mgr.gibba043.dnkmem (mgr.34373) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:08.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:08 gibba043 bash[24019]: cluster 2021-03-10T17:39:07.227905+0000 mgr.gibba043.dnkmem (mgr.34373) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:08.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:08 gibba003 bash[31385]: cluster 2021-03-10T17:39:07.227905+0000 mgr.gibba043.dnkmem (mgr.34373) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:08.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:08 gibba003 bash[32348]: cluster 2021-03-10T17:39:07.227905+0000 mgr.gibba043.dnkmem (mgr.34373) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cluster 2021-03-10T17:39:09.229282+0000 mgr.gibba043.dnkmem (mgr.34373) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.423991+0000 mgr.gibba043.dnkmem (mgr.34373) 12009 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:39:10.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.425304+0000 mgr.gibba043.dnkmem (mgr.34373) 12010 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:39:10.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.657245+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:39:10.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.658721+0000 mgr.gibba043.dnkmem (mgr.34373) 12011 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:10.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.660273+0000 mgr.gibba043.dnkmem (mgr.34373) 12012 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:10.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.660687+0000 mon.c (mon.1) 3082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:10.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.661401+0000 mgr.gibba043.dnkmem (mgr.34373) 12013 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:10.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.661435+0000 mgr.gibba043.dnkmem (mgr.34373) 12014 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:10.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.662003+0000 mon.c (mon.1) 3083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.662648+0000 mgr.gibba043.dnkmem (mgr.34373) 12015 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:10.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.662682+0000 mgr.gibba043.dnkmem (mgr.34373) 12016 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:10.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.663210+0000 mon.c (mon.1) 3084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.663776+0000 mgr.gibba043.dnkmem (mgr.34373) 12017 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:10.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.664325+0000 mon.c (mon.1) 3085 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.665199+0000 mgr.gibba043.dnkmem (mgr.34373) 12018 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:10.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.665235+0000 mgr.gibba043.dnkmem (mgr.34373) 12019 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:10.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.666443+0000 mgr.gibba043.dnkmem (mgr.34373) 12020 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:10.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.666770+0000 mgr.gibba043.dnkmem (mgr.34373) 12021 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:10.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.667099+0000 mon.c (mon.1) 3086 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.947 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.667803+0000 mgr.gibba043.dnkmem (mgr.34373) 12022 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:10.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cluster 2021-03-10T17:39:09.229282+0000 mgr.gibba043.dnkmem (mgr.34373) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:10.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.423991+0000 mgr.gibba043.dnkmem (mgr.34373) 12009 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:39:10.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.425304+0000 mgr.gibba043.dnkmem (mgr.34373) 12010 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:39:10.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.657245+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:39:10.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.658721+0000 mgr.gibba043.dnkmem (mgr.34373) 12011 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:10.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.660273+0000 mgr.gibba043.dnkmem (mgr.34373) 12012 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:10.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.660687+0000 mon.c (mon.1) 3082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:10.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.661401+0000 mgr.gibba043.dnkmem (mgr.34373) 12013 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:10.949 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.661435+0000 mgr.gibba043.dnkmem (mgr.34373) 12014 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:10.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.662003+0000 mon.c (mon.1) 3083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.662648+0000 mgr.gibba043.dnkmem (mgr.34373) 12015 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:10.950 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.662682+0000 mgr.gibba043.dnkmem (mgr.34373) 12016 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:10.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.663210+0000 mon.c (mon.1) 3084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.663776+0000 mgr.gibba043.dnkmem (mgr.34373) 12017 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:10.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.664325+0000 mon.c (mon.1) 3085 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.951 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.665199+0000 mgr.gibba043.dnkmem (mgr.34373) 12018 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:10.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.665235+0000 mgr.gibba043.dnkmem (mgr.34373) 12019 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:10.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.666443+0000 mgr.gibba043.dnkmem (mgr.34373) 12020 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:10.952 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.666770+0000 mgr.gibba043.dnkmem (mgr.34373) 12021 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:10.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.667099+0000 mon.c (mon.1) 3086 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.667803+0000 mgr.gibba043.dnkmem (mgr.34373) 12022 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:10.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.667842+0000 mgr.gibba043.dnkmem (mgr.34373) 12023 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:10.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: cephadm 2021-03-10T17:39:09.667947+0000 mgr.gibba043.dnkmem (mgr.34373) 12024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:10.953 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[32348]: audit 2021-03-10T17:39:09.668427+0000 mon.c (mon.1) 3087 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:10.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.667842+0000 mgr.gibba043.dnkmem (mgr.34373) 12023 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:10.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: cephadm 2021-03-10T17:39:09.667947+0000 mgr.gibba043.dnkmem (mgr.34373) 12024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:10.954 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:10 gibba003 bash[31385]: audit 2021-03-10T17:39:09.668427+0000 mon.c (mon.1) 3087 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:11.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cluster 2021-03-10T17:39:09.229282+0000 mgr.gibba043.dnkmem (mgr.34373) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.423991+0000 mgr.gibba043.dnkmem (mgr.34373) 12009 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:39:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.425304+0000 mgr.gibba043.dnkmem (mgr.34373) 12010 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:39:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.657245+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:39:11.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.658721+0000 mgr.gibba043.dnkmem (mgr.34373) 12011 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:11.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.660273+0000 mgr.gibba043.dnkmem (mgr.34373) 12012 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:11.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.660687+0000 mon.c (mon.1) 3082 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:11.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.661401+0000 mgr.gibba043.dnkmem (mgr.34373) 12013 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:11.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.661435+0000 mgr.gibba043.dnkmem (mgr.34373) 12014 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:11.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.662003+0000 mon.c (mon.1) 3083 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:11.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.662648+0000 mgr.gibba043.dnkmem (mgr.34373) 12015 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:11.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.662682+0000 mgr.gibba043.dnkmem (mgr.34373) 12016 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:11.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.663210+0000 mon.c (mon.1) 3084 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:11.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.663776+0000 mgr.gibba043.dnkmem (mgr.34373) 12017 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:11.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.664325+0000 mon.c (mon.1) 3085 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:11.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.665199+0000 mgr.gibba043.dnkmem (mgr.34373) 12018 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:11.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.665235+0000 mgr.gibba043.dnkmem (mgr.34373) 12019 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:11.027 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.666443+0000 mgr.gibba043.dnkmem (mgr.34373) 12020 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:11.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.666770+0000 mgr.gibba043.dnkmem (mgr.34373) 12021 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:11.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.667099+0000 mon.c (mon.1) 3086 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:11.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.667803+0000 mgr.gibba043.dnkmem (mgr.34373) 12022 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:11.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.667842+0000 mgr.gibba043.dnkmem (mgr.34373) 12023 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:11.028 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: cephadm 2021-03-10T17:39:09.667947+0000 mgr.gibba043.dnkmem (mgr.34373) 12024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:11.029 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:10 gibba043 bash[24019]: audit 2021-03-10T17:39:09.668427+0000 mon.c (mon.1) 3087 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:12 gibba003 bash[31385]: cluster 2021-03-10T17:39:11.231034+0000 mgr.gibba043.dnkmem (mgr.34373) 12025 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:12.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:12 gibba003 bash[32348]: cluster 2021-03-10T17:39:11.231034+0000 mgr.gibba043.dnkmem (mgr.34373) 12025 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:13.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:12 gibba043 bash[24019]: cluster 2021-03-10T17:39:11.231034+0000 mgr.gibba043.dnkmem (mgr.34373) 12025 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[31385]: cluster 2021-03-10T17:39:13.232047+0000 mgr.gibba043.dnkmem (mgr.34373) 12026 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[31385]: audit 2021-03-10T17:39:14.190875+0000 mon.c (mon.1) 3088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[31385]: audit 2021-03-10T17:39:14.192076+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[31385]: audit 2021-03-10T17:39:14.445019+0000 mon.c (mon.1) 3089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[31385]: audit 2021-03-10T17:39:14.446259+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[32348]: cluster 2021-03-10T17:39:13.232047+0000 mgr.gibba043.dnkmem (mgr.34373) 12026 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[32348]: audit 2021-03-10T17:39:14.190875+0000 mon.c (mon.1) 3088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[32348]: audit 2021-03-10T17:39:14.192076+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[32348]: audit 2021-03-10T17:39:14.445019+0000 mon.c (mon.1) 3089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:14 gibba003 bash[32348]: audit 2021-03-10T17:39:14.446259+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:14 gibba043 bash[24019]: cluster 2021-03-10T17:39:13.232047+0000 mgr.gibba043.dnkmem (mgr.34373) 12026 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:14 gibba043 bash[24019]: audit 2021-03-10T17:39:14.190875+0000 mon.c (mon.1) 3088 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:14 gibba043 bash[24019]: audit 2021-03-10T17:39:14.192076+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:14 gibba043 bash[24019]: audit 2021-03-10T17:39:14.445019+0000 mon.c (mon.1) 3089 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:14 gibba043 bash[24019]: audit 2021-03-10T17:39:14.446259+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:15.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.837781+0000 mon.c (mon.1) 3090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.838679+0000 mon.c (mon.1) 3091 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.839082+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.839723+0000 mon.c (mon.1) 3092 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.840448+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.840855+0000 mon.c (mon.1) 3093 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.841889+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[31385]: audit 2021-03-10T17:39:14.842366+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.837781+0000 mon.c (mon.1) 3090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.838679+0000 mon.c (mon.1) 3091 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.839082+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.839723+0000 mon.c (mon.1) 3092 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.840448+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.840855+0000 mon.c (mon.1) 3093 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:39:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.841889+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:15 gibba003 bash[32348]: audit 2021-03-10T17:39:14.842366+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:39:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.837781+0000 mon.c (mon.1) 3090 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.838679+0000 mon.c (mon.1) 3091 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:39:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.839082+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.839723+0000 mon.c (mon.1) 3092 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.840448+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:39:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.840855+0000 mon.c (mon.1) 3093 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:39:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.841889+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:15 gibba043 bash[24019]: audit 2021-03-10T17:39:14.842366+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:39:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:16 gibba043 bash[24019]: cluster 2021-03-10T17:39:15.233682+0000 mgr.gibba043.dnkmem (mgr.34373) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:16 gibba003 bash[31385]: cluster 2021-03-10T17:39:15.233682+0000 mgr.gibba043.dnkmem (mgr.34373) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:16 gibba003 bash[32348]: cluster 2021-03-10T17:39:15.233682+0000 mgr.gibba043.dnkmem (mgr.34373) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:19.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:18 gibba043 bash[24019]: cluster 2021-03-10T17:39:17.235038+0000 mgr.gibba043.dnkmem (mgr.34373) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:19.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:18 gibba003 bash[31385]: cluster 2021-03-10T17:39:17.235038+0000 mgr.gibba043.dnkmem (mgr.34373) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:19.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:18 gibba003 bash[32348]: cluster 2021-03-10T17:39:17.235038+0000 mgr.gibba043.dnkmem (mgr.34373) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:20 gibba043 bash[24019]: cluster 2021-03-10T17:39:19.236615+0000 mgr.gibba043.dnkmem (mgr.34373) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:20 gibba003 bash[31385]: cluster 2021-03-10T17:39:19.236615+0000 mgr.gibba043.dnkmem (mgr.34373) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:20 gibba003 bash[32348]: cluster 2021-03-10T17:39:19.236615+0000 mgr.gibba043.dnkmem (mgr.34373) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:22 gibba043 bash[24019]: cluster 2021-03-10T17:39:21.238525+0000 mgr.gibba043.dnkmem (mgr.34373) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:22 gibba003 bash[31385]: cluster 2021-03-10T17:39:21.238525+0000 mgr.gibba043.dnkmem (mgr.34373) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:22 gibba003 bash[32348]: cluster 2021-03-10T17:39:21.238525+0000 mgr.gibba043.dnkmem (mgr.34373) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:24 gibba043 bash[24019]: cluster 2021-03-10T17:39:23.239768+0000 mgr.gibba043.dnkmem (mgr.34373) 12031 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:24 gibba003 bash[31385]: cluster 2021-03-10T17:39:23.239768+0000 mgr.gibba043.dnkmem (mgr.34373) 12031 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:24 gibba003 bash[32348]: cluster 2021-03-10T17:39:23.239768+0000 mgr.gibba043.dnkmem (mgr.34373) 12031 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:26.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:25 gibba043 bash[24019]: cephadm 2021-03-10T17:39:24.683748+0000 mgr.gibba043.dnkmem (mgr.34373) 12032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:26.030 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:39:26.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:25 gibba003 bash[31385]: cephadm 2021-03-10T17:39:24.683748+0000 mgr.gibba043.dnkmem (mgr.34373) 12032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:26.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:25 gibba003 bash[32348]: cephadm 2021-03-10T17:39:24.683748+0000 mgr.gibba043.dnkmem (mgr.34373) 12032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:26.257 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:39:26.258 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:39:26.258 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:39:26.259 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:39:26.259 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:39:26.259 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:39:26.260 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:39:26.260 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:39:26.261 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:39:26.261 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:39:26.261 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:39:26.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:39:26.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:39:26.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:39:26.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:39:26.264 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:39:26.264 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:39:26.264 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:39:26.265 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:39:26.265 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:39:26.266 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:39:26.511 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:39:26.512 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:39:26.512 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:26.512 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:39:26.512 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:39:26.513 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:26.513 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:39:26.513 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:39:26.513 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:39:26.513 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:39:26.514 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:39:26.514 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:39:26.514 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:39:26.514 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:39:26.515 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:39:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:26 gibba043 bash[24019]: cluster 2021-03-10T17:39:25.241301+0000 mgr.gibba043.dnkmem (mgr.34373) 12033 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:26 gibba043 bash[24019]: audit 2021-03-10T17:39:26.019261+0000 mgr.gibba043.dnkmem (mgr.34373) 12034 : audit [DBG] from='client.62104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:26 gibba043 bash[24019]: audit 2021-03-10T17:39:26.510536+0000 mon.c (mon.1) 3094 : audit [DBG] from='client.? 172.21.2.103:0/2549587822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:26 gibba003 bash[31385]: cluster 2021-03-10T17:39:25.241301+0000 mgr.gibba043.dnkmem (mgr.34373) 12033 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:26 gibba003 bash[31385]: audit 2021-03-10T17:39:26.019261+0000 mgr.gibba043.dnkmem (mgr.34373) 12034 : audit [DBG] from='client.62104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:27.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:26 gibba003 bash[31385]: audit 2021-03-10T17:39:26.510536+0000 mon.c (mon.1) 3094 : audit [DBG] from='client.? 172.21.2.103:0/2549587822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:26 gibba003 bash[32348]: cluster 2021-03-10T17:39:25.241301+0000 mgr.gibba043.dnkmem (mgr.34373) 12033 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:27.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:26 gibba003 bash[32348]: audit 2021-03-10T17:39:26.019261+0000 mgr.gibba043.dnkmem (mgr.34373) 12034 : audit [DBG] from='client.62104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:27.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:26 gibba003 bash[32348]: audit 2021-03-10T17:39:26.510536+0000 mon.c (mon.1) 3094 : audit [DBG] from='client.? 172.21.2.103:0/2549587822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:28.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:27 gibba043 bash[24019]: audit 2021-03-10T17:39:26.244394+0000 mgr.gibba043.dnkmem (mgr.34373) 12035 : audit [DBG] from='client.52119 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:28.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:27 gibba003 bash[31385]: audit 2021-03-10T17:39:26.244394+0000 mgr.gibba043.dnkmem (mgr.34373) 12035 : audit [DBG] from='client.52119 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:28.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:27 gibba003 bash[32348]: audit 2021-03-10T17:39:26.244394+0000 mgr.gibba043.dnkmem (mgr.34373) 12035 : audit [DBG] from='client.52119 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:29.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:28 gibba043 bash[24019]: cluster 2021-03-10T17:39:27.242979+0000 mgr.gibba043.dnkmem (mgr.34373) 12036 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:28 gibba003 bash[31385]: cluster 2021-03-10T17:39:27.242979+0000 mgr.gibba043.dnkmem (mgr.34373) 12036 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:29.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:28 gibba003 bash[32348]: cluster 2021-03-10T17:39:27.242979+0000 mgr.gibba043.dnkmem (mgr.34373) 12036 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:30 gibba003 bash[31385]: cluster 2021-03-10T17:39:29.244607+0000 mgr.gibba043.dnkmem (mgr.34373) 12037 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:30 gibba003 bash[32348]: cluster 2021-03-10T17:39:29.244607+0000 mgr.gibba043.dnkmem (mgr.34373) 12037 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:30 gibba043 bash[24019]: cluster 2021-03-10T17:39:29.244607+0000 mgr.gibba043.dnkmem (mgr.34373) 12037 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:32 gibba003 bash[31385]: cluster 2021-03-10T17:39:31.246508+0000 mgr.gibba043.dnkmem (mgr.34373) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:33.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:32 gibba003 bash[32348]: cluster 2021-03-10T17:39:31.246508+0000 mgr.gibba043.dnkmem (mgr.34373) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:32 gibba043 bash[24019]: cluster 2021-03-10T17:39:31.246508+0000 mgr.gibba043.dnkmem (mgr.34373) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:34 gibba003 bash[31385]: cluster 2021-03-10T17:39:33.247721+0000 mgr.gibba043.dnkmem (mgr.34373) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:34 gibba003 bash[32348]: cluster 2021-03-10T17:39:33.247721+0000 mgr.gibba043.dnkmem (mgr.34373) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:34 gibba043 bash[24019]: cluster 2021-03-10T17:39:33.247721+0000 mgr.gibba043.dnkmem (mgr.34373) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:36 gibba003 bash[31385]: cluster 2021-03-10T17:39:35.249577+0000 mgr.gibba043.dnkmem (mgr.34373) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:36 gibba003 bash[32348]: cluster 2021-03-10T17:39:35.249577+0000 mgr.gibba043.dnkmem (mgr.34373) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:36 gibba043 bash[24019]: cluster 2021-03-10T17:39:35.249577+0000 mgr.gibba043.dnkmem (mgr.34373) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:38 gibba003 bash[31385]: cluster 2021-03-10T17:39:37.251172+0000 mgr.gibba043.dnkmem (mgr.34373) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:38 gibba003 bash[32348]: cluster 2021-03-10T17:39:37.251172+0000 mgr.gibba043.dnkmem (mgr.34373) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:38 gibba043 bash[24019]: cluster 2021-03-10T17:39:37.251172+0000 mgr.gibba043.dnkmem (mgr.34373) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:40 gibba003 bash[31385]: cluster 2021-03-10T17:39:39.252809+0000 mgr.gibba043.dnkmem (mgr.34373) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:40 gibba003 bash[31385]: cephadm 2021-03-10T17:39:39.699534+0000 mgr.gibba043.dnkmem (mgr.34373) 12043 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:40 gibba003 bash[32348]: cluster 2021-03-10T17:39:39.252809+0000 mgr.gibba043.dnkmem (mgr.34373) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:40 gibba003 bash[32348]: cephadm 2021-03-10T17:39:39.699534+0000 mgr.gibba043.dnkmem (mgr.34373) 12043 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:40 gibba043 bash[24019]: cluster 2021-03-10T17:39:39.252809+0000 mgr.gibba043.dnkmem (mgr.34373) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:40 gibba043 bash[24019]: cephadm 2021-03-10T17:39:39.699534+0000 mgr.gibba043.dnkmem (mgr.34373) 12043 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:43.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:42 gibba003 bash[31385]: cluster 2021-03-10T17:39:41.254672+0000 mgr.gibba043.dnkmem (mgr.34373) 12044 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:42 gibba003 bash[32348]: cluster 2021-03-10T17:39:41.254672+0000 mgr.gibba043.dnkmem (mgr.34373) 12044 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:43.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:42 gibba043 bash[24019]: cluster 2021-03-10T17:39:41.254672+0000 mgr.gibba043.dnkmem (mgr.34373) 12044 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:44 gibba003 bash[31385]: cluster 2021-03-10T17:39:43.256266+0000 mgr.gibba043.dnkmem (mgr.34373) 12045 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:44 gibba003 bash[32348]: cluster 2021-03-10T17:39:43.256266+0000 mgr.gibba043.dnkmem (mgr.34373) 12045 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:44 gibba043 bash[24019]: cluster 2021-03-10T17:39:43.256266+0000 mgr.gibba043.dnkmem (mgr.34373) 12045 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:47.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:46 gibba003 bash[31385]: cluster 2021-03-10T17:39:45.257641+0000 mgr.gibba043.dnkmem (mgr.34373) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:47.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:46 gibba003 bash[32348]: cluster 2021-03-10T17:39:45.257641+0000 mgr.gibba043.dnkmem (mgr.34373) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:47.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:46 gibba043 bash[24019]: cluster 2021-03-10T17:39:45.257641+0000 mgr.gibba043.dnkmem (mgr.34373) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:48 gibba003 bash[31385]: cluster 2021-03-10T17:39:47.259163+0000 mgr.gibba043.dnkmem (mgr.34373) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:48 gibba003 bash[32348]: cluster 2021-03-10T17:39:47.259163+0000 mgr.gibba043.dnkmem (mgr.34373) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:48 gibba043 bash[24019]: cluster 2021-03-10T17:39:47.259163+0000 mgr.gibba043.dnkmem (mgr.34373) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:50 gibba003 bash[31385]: cluster 2021-03-10T17:39:49.260695+0000 mgr.gibba043.dnkmem (mgr.34373) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:50 gibba003 bash[32348]: cluster 2021-03-10T17:39:49.260695+0000 mgr.gibba043.dnkmem (mgr.34373) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:51.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:50 gibba043 bash[24019]: cluster 2021-03-10T17:39:49.260695+0000 mgr.gibba043.dnkmem (mgr.34373) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:52 gibba003 bash[31385]: cluster 2021-03-10T17:39:51.262688+0000 mgr.gibba043.dnkmem (mgr.34373) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:53.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:52 gibba003 bash[32348]: cluster 2021-03-10T17:39:51.262688+0000 mgr.gibba043.dnkmem (mgr.34373) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:52 gibba043 bash[24019]: cluster 2021-03-10T17:39:51.262688+0000 mgr.gibba043.dnkmem (mgr.34373) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:54 gibba043 bash[24019]: cluster 2021-03-10T17:39:53.264212+0000 mgr.gibba043.dnkmem (mgr.34373) 12050 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:55.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:54 gibba003 bash[31385]: cluster 2021-03-10T17:39:53.264212+0000 mgr.gibba043.dnkmem (mgr.34373) 12050 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:54 gibba003 bash[32348]: cluster 2021-03-10T17:39:53.264212+0000 mgr.gibba043.dnkmem (mgr.34373) 12050 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:56.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:55 gibba003 bash[31385]: cephadm 2021-03-10T17:39:54.715188+0000 mgr.gibba043.dnkmem (mgr.34373) 12051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:56.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:55 gibba003 bash[32348]: cephadm 2021-03-10T17:39:54.715188+0000 mgr.gibba043.dnkmem (mgr.34373) 12051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:56.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:55 gibba043 bash[24019]: cephadm 2021-03-10T17:39:54.715188+0000 mgr.gibba043.dnkmem (mgr.34373) 12051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:39:56.754 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:39:56.980 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:39:56.981 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:39:56.981 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:39:56.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:39:56.981 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:39:56.982 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:39:56.982 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:39:56.982 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:39:56.982 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:39:56.982 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:39:56.983 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:39:56.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:39:56.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:39:56.983 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:39:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:39:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:39:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:39:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:39:56.984 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:39:56.985 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:39:56.985 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:39:57.191 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:56 gibba003 bash[31385]: cluster 2021-03-10T17:39:55.265732+0000 mgr.gibba043.dnkmem (mgr.34373) 12052 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:57.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:56 gibba003 bash[32348]: cluster 2021-03-10T17:39:55.265732+0000 mgr.gibba043.dnkmem (mgr.34373) 12052 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:57.230 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:39:57.230 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:39:57.230 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:57.230 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:39:57.231 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:39:57.231 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:57.231 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:39:57.231 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:39:57.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:39:57.232 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:39:57.232 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:39:57.232 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:39:57.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:39:57.233 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:39:57.233 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:39:57.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:56 gibba043 bash[24019]: cluster 2021-03-10T17:39:55.265732+0000 mgr.gibba043.dnkmem (mgr.34373) 12052 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:57 gibba003 bash[31385]: audit 2021-03-10T17:39:56.743411+0000 mgr.gibba043.dnkmem (mgr.34373) 12053 : audit [DBG] from='client.52131 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:58.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:57 gibba003 bash[31385]: audit 2021-03-10T17:39:56.967129+0000 mgr.gibba043.dnkmem (mgr.34373) 12054 : audit [DBG] from='client.52137 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:58.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:57 gibba003 bash[31385]: audit 2021-03-10T17:39:57.228730+0000 mon.c (mon.1) 3095 : audit [DBG] from='client.? 172.21.2.103:0/3681578454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:57 gibba003 bash[32348]: audit 2021-03-10T17:39:56.743411+0000 mgr.gibba043.dnkmem (mgr.34373) 12053 : audit [DBG] from='client.52131 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:57 gibba003 bash[32348]: audit 2021-03-10T17:39:56.967129+0000 mgr.gibba043.dnkmem (mgr.34373) 12054 : audit [DBG] from='client.52137 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:58.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:57 gibba003 bash[32348]: audit 2021-03-10T17:39:57.228730+0000 mon.c (mon.1) 3095 : audit [DBG] from='client.? 172.21.2.103:0/3681578454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:57 gibba043 bash[24019]: audit 2021-03-10T17:39:56.743411+0000 mgr.gibba043.dnkmem (mgr.34373) 12053 : audit [DBG] from='client.52131 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:57 gibba043 bash[24019]: audit 2021-03-10T17:39:56.967129+0000 mgr.gibba043.dnkmem (mgr.34373) 12054 : audit [DBG] from='client.52137 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:58.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:57 gibba043 bash[24019]: audit 2021-03-10T17:39:57.228730+0000 mon.c (mon.1) 3095 : audit [DBG] from='client.? 172.21.2.103:0/3681578454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:39:58 gibba003 bash[31385]: cluster 2021-03-10T17:39:57.267212+0000 mgr.gibba043.dnkmem (mgr.34373) 12055 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:39:58 gibba003 bash[32348]: cluster 2021-03-10T17:39:57.267212+0000 mgr.gibba043.dnkmem (mgr.34373) 12055 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:39:58 gibba043 bash[24019]: cluster 2021-03-10T17:39:57.267212+0000 mgr.gibba043.dnkmem (mgr.34373) 12055 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:00.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:00 gibba003 bash[31385]: debug 2021-03-10T17:39:59.997+0000 7fe48927a700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:00 gibba003 bash[31385]: cluster 2021-03-10T17:39:59.268840+0000 mgr.gibba043.dnkmem (mgr.34373) 12056 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:00 gibba003 bash[31385]: cluster 2021-03-10T17:40:00.000212+0000 mon.a (mon.0) 2377 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:00 gibba003 bash[32348]: cluster 2021-03-10T17:39:59.268840+0000 mgr.gibba043.dnkmem (mgr.34373) 12056 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:01.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:00 gibba003 bash[32348]: cluster 2021-03-10T17:40:00.000212+0000 mon.a (mon.0) 2377 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:01.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:00 gibba043 bash[24019]: cluster 2021-03-10T17:39:59.268840+0000 mgr.gibba043.dnkmem (mgr.34373) 12056 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:00 gibba043 bash[24019]: cluster 2021-03-10T17:40:00.000212+0000 mon.a (mon.0) 2377 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:03.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:02 gibba003 bash[31385]: cluster 2021-03-10T17:40:01.270417+0000 mgr.gibba043.dnkmem (mgr.34373) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:02 gibba003 bash[32348]: cluster 2021-03-10T17:40:01.270417+0000 mgr.gibba043.dnkmem (mgr.34373) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:03.272 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:02 gibba043 bash[24019]: cluster 2021-03-10T17:40:01.270417+0000 mgr.gibba043.dnkmem (mgr.34373) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:04 gibba003 bash[31385]: cluster 2021-03-10T17:40:03.271637+0000 mgr.gibba043.dnkmem (mgr.34373) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:04 gibba003 bash[32348]: cluster 2021-03-10T17:40:03.271637+0000 mgr.gibba043.dnkmem (mgr.34373) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:04 gibba043 bash[24019]: cluster 2021-03-10T17:40:03.271637+0000 mgr.gibba043.dnkmem (mgr.34373) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:06 gibba043 bash[24019]: cluster 2021-03-10T17:40:05.273017+0000 mgr.gibba043.dnkmem (mgr.34373) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:06 gibba003 bash[31385]: cluster 2021-03-10T17:40:05.273017+0000 mgr.gibba043.dnkmem (mgr.34373) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:06 gibba003 bash[32348]: cluster 2021-03-10T17:40:05.273017+0000 mgr.gibba043.dnkmem (mgr.34373) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:08 gibba043 bash[24019]: cluster 2021-03-10T17:40:07.274379+0000 mgr.gibba043.dnkmem (mgr.34373) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:08 gibba003 bash[31385]: cluster 2021-03-10T17:40:07.274379+0000 mgr.gibba043.dnkmem (mgr.34373) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:09.458 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:08 gibba003 bash[32348]: cluster 2021-03-10T17:40:07.274379+0000 mgr.gibba043.dnkmem (mgr.34373) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:10.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:09 gibba043 bash[24019]: audit 2021-03-10T17:40:09.734876+0000 mon.c (mon.1) 3096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:40:10.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:09 gibba003 bash[31385]: audit 2021-03-10T17:40:09.734876+0000 mon.c (mon.1) 3096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:40:10.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:09 gibba003 bash[32348]: audit 2021-03-10T17:40:09.734876+0000 mon.c (mon.1) 3096 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:40:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:10 gibba043 bash[24019]: cluster 2021-03-10T17:40:09.275900+0000 mgr.gibba043.dnkmem (mgr.34373) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:10 gibba043 bash[24019]: cephadm 2021-03-10T17:40:09.732902+0000 mgr.gibba043.dnkmem (mgr.34373) 12062 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:40:11.441 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:10 gibba003 bash[32348]: cluster 2021-03-10T17:40:09.275900+0000 mgr.gibba043.dnkmem (mgr.34373) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:10 gibba003 bash[32348]: cephadm 2021-03-10T17:40:09.732902+0000 mgr.gibba043.dnkmem (mgr.34373) 12062 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:40:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:10 gibba003 bash[31385]: cluster 2021-03-10T17:40:09.275900+0000 mgr.gibba043.dnkmem (mgr.34373) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:10 gibba003 bash[31385]: cephadm 2021-03-10T17:40:09.732902+0000 mgr.gibba043.dnkmem (mgr.34373) 12062 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:40:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:12 gibba043 bash[24019]: cluster 2021-03-10T17:40:11.277484+0000 mgr.gibba043.dnkmem (mgr.34373) 12063 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:13.441 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:12 gibba003 bash[31385]: cluster 2021-03-10T17:40:11.277484+0000 mgr.gibba043.dnkmem (mgr.34373) 12063 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:13.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:13 gibba003 bash[32348]: cluster 2021-03-10T17:40:11.277484+0000 mgr.gibba043.dnkmem (mgr.34373) 12063 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cluster 2021-03-10T17:40:13.278837+0000 mgr.gibba043.dnkmem (mgr.34373) 12064 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.323780+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:40:14.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.324508+0000 mgr.gibba043.dnkmem (mgr.34373) 12065 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:40:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.566109+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:40:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.573291+0000 mgr.gibba043.dnkmem (mgr.34373) 12066 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.574846+0000 mgr.gibba043.dnkmem (mgr.34373) 12067 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:14.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.575196+0000 mon.c (mon.1) 3097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.576496+0000 mon.c (mon.1) 3098 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.576601+0000 mgr.gibba043.dnkmem (mgr.34373) 12068 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.576643+0000 mgr.gibba043.dnkmem (mgr.34373) 12069 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.578362+0000 mgr.gibba043.dnkmem (mgr.34373) 12070 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:14.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.578403+0000 mgr.gibba043.dnkmem (mgr.34373) 12071 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.578586+0000 mon.c (mon.1) 3099 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.579912+0000 mgr.gibba043.dnkmem (mgr.34373) 12072 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.580233+0000 mon.c (mon.1) 3100 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.581599+0000 mgr.gibba043.dnkmem (mgr.34373) 12073 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:14.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.581639+0000 mgr.gibba043.dnkmem (mgr.34373) 12074 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:14.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.582829+0000 mgr.gibba043.dnkmem (mgr.34373) 12075 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:14.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.583275+0000 mgr.gibba043.dnkmem (mgr.34373) 12076 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:14.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.583314+0000 mon.c (mon.1) 3101 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.584691+0000 mgr.gibba043.dnkmem (mgr.34373) 12077 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cluster 2021-03-10T17:40:13.278837+0000 mgr.gibba043.dnkmem (mgr.34373) 12064 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.323780+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:40:14.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.324508+0000 mgr.gibba043.dnkmem (mgr.34373) 12065 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:40:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.566109+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:40:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.573291+0000 mgr.gibba043.dnkmem (mgr.34373) 12066 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.574846+0000 mgr.gibba043.dnkmem (mgr.34373) 12067 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.575196+0000 mon.c (mon.1) 3097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:14.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.576496+0000 mon.c (mon.1) 3098 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.576601+0000 mgr.gibba043.dnkmem (mgr.34373) 12068 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:14.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.576643+0000 mgr.gibba043.dnkmem (mgr.34373) 12069 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:14.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.578362+0000 mgr.gibba043.dnkmem (mgr.34373) 12070 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:14.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.578403+0000 mgr.gibba043.dnkmem (mgr.34373) 12071 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:14.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.578586+0000 mon.c (mon.1) 3099 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.579912+0000 mgr.gibba043.dnkmem (mgr.34373) 12072 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:14.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.580233+0000 mon.c (mon.1) 3100 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.581599+0000 mgr.gibba043.dnkmem (mgr.34373) 12073 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:14.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.581639+0000 mgr.gibba043.dnkmem (mgr.34373) 12074 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:14.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.582829+0000 mgr.gibba043.dnkmem (mgr.34373) 12075 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:14.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.583275+0000 mgr.gibba043.dnkmem (mgr.34373) 12076 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:14.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.583314+0000 mon.c (mon.1) 3101 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.584691+0000 mgr.gibba043.dnkmem (mgr.34373) 12077 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:14.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.584738+0000 mgr.gibba043.dnkmem (mgr.34373) 12078 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:14.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: cephadm 2021-03-10T17:40:13.584870+0000 mgr.gibba043.dnkmem (mgr.34373) 12079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:14.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:13.584943+0000 mon.c (mon.1) 3102 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.703 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:14.197841+0000 mon.c (mon.1) 3103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:14.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[31385]: audit 2021-03-10T17:40:14.198957+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:14.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.584738+0000 mgr.gibba043.dnkmem (mgr.34373) 12078 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:14.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: cephadm 2021-03-10T17:40:13.584870+0000 mgr.gibba043.dnkmem (mgr.34373) 12079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:14.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:13.584943+0000 mon.c (mon.1) 3102 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:14.197841+0000 mon.c (mon.1) 3103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:14.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:14 gibba003 bash[32348]: audit 2021-03-10T17:40:14.198957+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cluster 2021-03-10T17:40:13.278837+0000 mgr.gibba043.dnkmem (mgr.34373) 12064 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.323780+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:40:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.324508+0000 mgr.gibba043.dnkmem (mgr.34373) 12065 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:40:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.566109+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:40:14.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.573291+0000 mgr.gibba043.dnkmem (mgr.34373) 12066 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.574846+0000 mgr.gibba043.dnkmem (mgr.34373) 12067 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.575196+0000 mon.c (mon.1) 3097 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.576496+0000 mon.c (mon.1) 3098 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.576601+0000 mgr.gibba043.dnkmem (mgr.34373) 12068 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.576643+0000 mgr.gibba043.dnkmem (mgr.34373) 12069 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.578362+0000 mgr.gibba043.dnkmem (mgr.34373) 12070 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.578403+0000 mgr.gibba043.dnkmem (mgr.34373) 12071 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.578586+0000 mon.c (mon.1) 3099 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.579912+0000 mgr.gibba043.dnkmem (mgr.34373) 12072 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:14.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.580233+0000 mon.c (mon.1) 3100 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.581599+0000 mgr.gibba043.dnkmem (mgr.34373) 12073 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:14.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.581639+0000 mgr.gibba043.dnkmem (mgr.34373) 12074 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:14.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.582829+0000 mgr.gibba043.dnkmem (mgr.34373) 12075 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:14.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.583275+0000 mgr.gibba043.dnkmem (mgr.34373) 12076 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:14.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.583314+0000 mon.c (mon.1) 3101 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.584691+0000 mgr.gibba043.dnkmem (mgr.34373) 12077 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:14.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.584738+0000 mgr.gibba043.dnkmem (mgr.34373) 12078 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:14.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: cephadm 2021-03-10T17:40:13.584870+0000 mgr.gibba043.dnkmem (mgr.34373) 12079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:14.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:13.584943+0000 mon.c (mon.1) 3102 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:14.197841+0000 mon.c (mon.1) 3103 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:14.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:14 gibba043 bash[24019]: audit 2021-03-10T17:40:14.198957+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:15.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.452608+0000 mon.c (mon.1) 3104 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.453763+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.849812+0000 mon.c (mon.1) 3105 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:40:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.850537+0000 mon.c (mon.1) 3106 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.851004+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:40:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.851348+0000 mon.c (mon.1) 3107 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.852195+0000 mon.c (mon.1) 3108 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:40:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.852307+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.853627+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[31385]: audit 2021-03-10T17:40:14.854522+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:40:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.452608+0000 mon.c (mon.1) 3104 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:15.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.453763+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.849812+0000 mon.c (mon.1) 3105 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:40:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.850537+0000 mon.c (mon.1) 3106 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.851004+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:40:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.851348+0000 mon.c (mon.1) 3107 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.852195+0000 mon.c (mon.1) 3108 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:40:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.852307+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.853627+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:15 gibba003 bash[32348]: audit 2021-03-10T17:40:14.854522+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:40:15.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.452608+0000 mon.c (mon.1) 3104 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.453763+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.849812+0000 mon.c (mon.1) 3105 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:40:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.850537+0000 mon.c (mon.1) 3106 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.851004+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:40:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.851348+0000 mon.c (mon.1) 3107 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.852195+0000 mon.c (mon.1) 3108 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:40:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.852307+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.853627+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:40:15.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:15 gibba043 bash[24019]: audit 2021-03-10T17:40:14.854522+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:40:16.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:16 gibba003 bash[31385]: cluster 2021-03-10T17:40:15.280442+0000 mgr.gibba043.dnkmem (mgr.34373) 12080 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:16.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:16 gibba003 bash[32348]: cluster 2021-03-10T17:40:15.280442+0000 mgr.gibba043.dnkmem (mgr.34373) 12080 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:16.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:16 gibba043 bash[24019]: cluster 2021-03-10T17:40:15.280442+0000 mgr.gibba043.dnkmem (mgr.34373) 12080 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:18.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:18 gibba003 bash[31385]: cluster 2021-03-10T17:40:17.282020+0000 mgr.gibba043.dnkmem (mgr.34373) 12081 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:18.692 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:18 gibba003 bash[32348]: cluster 2021-03-10T17:40:17.282020+0000 mgr.gibba043.dnkmem (mgr.34373) 12081 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:18 gibba043 bash[24019]: cluster 2021-03-10T17:40:17.282020+0000 mgr.gibba043.dnkmem (mgr.34373) 12081 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:20.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:20 gibba043 bash[24019]: cluster 2021-03-10T17:40:19.283765+0000 mgr.gibba043.dnkmem (mgr.34373) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:20.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:20 gibba003 bash[31385]: cluster 2021-03-10T17:40:19.283765+0000 mgr.gibba043.dnkmem (mgr.34373) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:20.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:20 gibba003 bash[32348]: cluster 2021-03-10T17:40:19.283765+0000 mgr.gibba043.dnkmem (mgr.34373) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:22.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:22 gibba043 bash[24019]: cluster 2021-03-10T17:40:21.285365+0000 mgr.gibba043.dnkmem (mgr.34373) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:22.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:22 gibba003 bash[31385]: cluster 2021-03-10T17:40:21.285365+0000 mgr.gibba043.dnkmem (mgr.34373) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:22.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:22 gibba003 bash[32348]: cluster 2021-03-10T17:40:21.285365+0000 mgr.gibba043.dnkmem (mgr.34373) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:24.772 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:24 gibba043 bash[24019]: cluster 2021-03-10T17:40:23.286566+0000 mgr.gibba043.dnkmem (mgr.34373) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:24 gibba003 bash[31385]: cluster 2021-03-10T17:40:23.286566+0000 mgr.gibba043.dnkmem (mgr.34373) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:24 gibba003 bash[32348]: cluster 2021-03-10T17:40:23.286566+0000 mgr.gibba043.dnkmem (mgr.34373) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:26.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:26 gibba043 bash[24019]: cluster 2021-03-10T17:40:25.287979+0000 mgr.gibba043.dnkmem (mgr.34373) 12085 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:26 gibba003 bash[31385]: cluster 2021-03-10T17:40:25.287979+0000 mgr.gibba043.dnkmem (mgr.34373) 12085 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:26.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:26 gibba003 bash[32348]: cluster 2021-03-10T17:40:25.287979+0000 mgr.gibba043.dnkmem (mgr.34373) 12085 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:27.474 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:40:27.700 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:40:27.700 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 14s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:40:27.700 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:40:27.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:40:27.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:40:27.701 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:40:27.701 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:40:27.701 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:40:27.702 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:40:27.702 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 14s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:40:27.702 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:40:27.702 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:40:27.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:40:27.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:40:27.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 14s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:40:27.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:40:27.703 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:40:27.704 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:40:27.704 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:40:27.704 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:40:27.704 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 14s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:40:27.946 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:40:27.946 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:40:27.947 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:27.947 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:40:27.947 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:40:27.947 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:27.947 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:40:27.948 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:40:27.948 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:40:27.948 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:40:27.948 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:40:27.949 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:40:27.949 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:40:27.949 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:40:27.949 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:40:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:28 gibba043 bash[24019]: cluster 2021-03-10T17:40:27.289332+0000 mgr.gibba043.dnkmem (mgr.34373) 12086 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:28.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:28 gibba043 bash[24019]: audit 2021-03-10T17:40:27.462502+0000 mgr.gibba043.dnkmem (mgr.34373) 12087 : audit [DBG] from='client.62140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:28.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:28 gibba043 bash[24019]: audit 2021-03-10T17:40:27.687485+0000 mgr.gibba043.dnkmem (mgr.34373) 12088 : audit [DBG] from='client.52155 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:28.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:28 gibba043 bash[24019]: audit 2021-03-10T17:40:27.945005+0000 mon.c (mon.1) 3109 : audit [DBG] from='client.? 172.21.2.103:0/240788747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[31385]: cluster 2021-03-10T17:40:27.289332+0000 mgr.gibba043.dnkmem (mgr.34373) 12086 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[31385]: audit 2021-03-10T17:40:27.462502+0000 mgr.gibba043.dnkmem (mgr.34373) 12087 : audit [DBG] from='client.62140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[31385]: audit 2021-03-10T17:40:27.687485+0000 mgr.gibba043.dnkmem (mgr.34373) 12088 : audit [DBG] from='client.52155 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:28.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[31385]: audit 2021-03-10T17:40:27.945005+0000 mon.c (mon.1) 3109 : audit [DBG] from='client.? 172.21.2.103:0/240788747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[32348]: cluster 2021-03-10T17:40:27.289332+0000 mgr.gibba043.dnkmem (mgr.34373) 12086 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[32348]: audit 2021-03-10T17:40:27.462502+0000 mgr.gibba043.dnkmem (mgr.34373) 12087 : audit [DBG] from='client.62140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[32348]: audit 2021-03-10T17:40:27.687485+0000 mgr.gibba043.dnkmem (mgr.34373) 12088 : audit [DBG] from='client.52155 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:28.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:28 gibba003 bash[32348]: audit 2021-03-10T17:40:27.945005+0000 mon.c (mon.1) 3109 : audit [DBG] from='client.? 172.21.2.103:0/240788747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:29 gibba003 bash[31385]: cephadm 2021-03-10T17:40:28.600850+0000 mgr.gibba043.dnkmem (mgr.34373) 12089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:29 gibba003 bash[32348]: cephadm 2021-03-10T17:40:28.600850+0000 mgr.gibba043.dnkmem (mgr.34373) 12089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:29 gibba043 bash[24019]: cephadm 2021-03-10T17:40:28.600850+0000 mgr.gibba043.dnkmem (mgr.34373) 12089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:30 gibba003 bash[31385]: cluster 2021-03-10T17:40:29.290672+0000 mgr.gibba043.dnkmem (mgr.34373) 12090 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:30.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:30 gibba003 bash[32348]: cluster 2021-03-10T17:40:29.290672+0000 mgr.gibba043.dnkmem (mgr.34373) 12090 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:30 gibba043 bash[24019]: cluster 2021-03-10T17:40:29.290672+0000 mgr.gibba043.dnkmem (mgr.34373) 12090 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:32.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:32 gibba003 bash[31385]: cluster 2021-03-10T17:40:31.292478+0000 mgr.gibba043.dnkmem (mgr.34373) 12091 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:32.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:32 gibba003 bash[32348]: cluster 2021-03-10T17:40:31.292478+0000 mgr.gibba043.dnkmem (mgr.34373) 12091 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:33.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:32 gibba043 bash[24019]: cluster 2021-03-10T17:40:31.292478+0000 mgr.gibba043.dnkmem (mgr.34373) 12091 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:34 gibba003 bash[31385]: cluster 2021-03-10T17:40:33.293822+0000 mgr.gibba043.dnkmem (mgr.34373) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:34 gibba003 bash[32348]: cluster 2021-03-10T17:40:33.293822+0000 mgr.gibba043.dnkmem (mgr.34373) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:34 gibba043 bash[24019]: cluster 2021-03-10T17:40:33.293822+0000 mgr.gibba043.dnkmem (mgr.34373) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:36 gibba003 bash[31385]: cluster 2021-03-10T17:40:35.295382+0000 mgr.gibba043.dnkmem (mgr.34373) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:36.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:36 gibba003 bash[32348]: cluster 2021-03-10T17:40:35.295382+0000 mgr.gibba043.dnkmem (mgr.34373) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:36 gibba043 bash[24019]: cluster 2021-03-10T17:40:35.295382+0000 mgr.gibba043.dnkmem (mgr.34373) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:38 gibba003 bash[31385]: cluster 2021-03-10T17:40:37.296773+0000 mgr.gibba043.dnkmem (mgr.34373) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:38 gibba003 bash[32348]: cluster 2021-03-10T17:40:37.296773+0000 mgr.gibba043.dnkmem (mgr.34373) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:39.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:38 gibba043 bash[24019]: cluster 2021-03-10T17:40:37.296773+0000 mgr.gibba043.dnkmem (mgr.34373) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:40.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:40 gibba003 bash[31385]: cluster 2021-03-10T17:40:39.298378+0000 mgr.gibba043.dnkmem (mgr.34373) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:40.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:40 gibba003 bash[32348]: cluster 2021-03-10T17:40:39.298378+0000 mgr.gibba043.dnkmem (mgr.34373) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:40 gibba043 bash[24019]: cluster 2021-03-10T17:40:39.298378+0000 mgr.gibba043.dnkmem (mgr.34373) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:42 gibba003 bash[31385]: cluster 2021-03-10T17:40:41.300062+0000 mgr.gibba043.dnkmem (mgr.34373) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:42.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:42 gibba003 bash[32348]: cluster 2021-03-10T17:40:41.300062+0000 mgr.gibba043.dnkmem (mgr.34373) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:42 gibba043 bash[24019]: cluster 2021-03-10T17:40:41.300062+0000 mgr.gibba043.dnkmem (mgr.34373) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:44 gibba003 bash[31385]: cluster 2021-03-10T17:40:43.301717+0000 mgr.gibba043.dnkmem (mgr.34373) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:44 gibba003 bash[31385]: cephadm 2021-03-10T17:40:43.616103+0000 mgr.gibba043.dnkmem (mgr.34373) 12098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:44 gibba003 bash[32348]: cluster 2021-03-10T17:40:43.301717+0000 mgr.gibba043.dnkmem (mgr.34373) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:44 gibba003 bash[32348]: cephadm 2021-03-10T17:40:43.616103+0000 mgr.gibba043.dnkmem (mgr.34373) 12098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:45.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:44 gibba043 bash[24019]: cluster 2021-03-10T17:40:43.301717+0000 mgr.gibba043.dnkmem (mgr.34373) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:44 gibba043 bash[24019]: cephadm 2021-03-10T17:40:43.616103+0000 mgr.gibba043.dnkmem (mgr.34373) 12098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:46 gibba003 bash[31385]: cluster 2021-03-10T17:40:45.303253+0000 mgr.gibba043.dnkmem (mgr.34373) 12099 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:46.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:46 gibba003 bash[32348]: cluster 2021-03-10T17:40:45.303253+0000 mgr.gibba043.dnkmem (mgr.34373) 12099 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:47.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:46 gibba043 bash[24019]: cluster 2021-03-10T17:40:45.303253+0000 mgr.gibba043.dnkmem (mgr.34373) 12099 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:48 gibba003 bash[31385]: cluster 2021-03-10T17:40:47.304663+0000 mgr.gibba043.dnkmem (mgr.34373) 12100 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:48 gibba003 bash[32348]: cluster 2021-03-10T17:40:47.304663+0000 mgr.gibba043.dnkmem (mgr.34373) 12100 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:48 gibba043 bash[24019]: cluster 2021-03-10T17:40:47.304663+0000 mgr.gibba043.dnkmem (mgr.34373) 12100 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:50.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:50 gibba003 bash[31385]: cluster 2021-03-10T17:40:49.306154+0000 mgr.gibba043.dnkmem (mgr.34373) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:50.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:50 gibba003 bash[32348]: cluster 2021-03-10T17:40:49.306154+0000 mgr.gibba043.dnkmem (mgr.34373) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:50 gibba043 bash[24019]: cluster 2021-03-10T17:40:49.306154+0000 mgr.gibba043.dnkmem (mgr.34373) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:52 gibba003 bash[31385]: cluster 2021-03-10T17:40:51.307995+0000 mgr.gibba043.dnkmem (mgr.34373) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:52 gibba003 bash[32348]: cluster 2021-03-10T17:40:51.307995+0000 mgr.gibba043.dnkmem (mgr.34373) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:52 gibba043 bash[24019]: cluster 2021-03-10T17:40:51.307995+0000 mgr.gibba043.dnkmem (mgr.34373) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:54 gibba003 bash[31385]: cluster 2021-03-10T17:40:53.309377+0000 mgr.gibba043.dnkmem (mgr.34373) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:54 gibba003 bash[32348]: cluster 2021-03-10T17:40:53.309377+0000 mgr.gibba043.dnkmem (mgr.34373) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:54 gibba043 bash[24019]: cluster 2021-03-10T17:40:53.309377+0000 mgr.gibba043.dnkmem (mgr.34373) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:56 gibba003 bash[31385]: cluster 2021-03-10T17:40:55.310770+0000 mgr.gibba043.dnkmem (mgr.34373) 12104 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:56 gibba003 bash[32348]: cluster 2021-03-10T17:40:55.310770+0000 mgr.gibba043.dnkmem (mgr.34373) 12104 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:57.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:56 gibba043 bash[24019]: cluster 2021-03-10T17:40:55.310770+0000 mgr.gibba043.dnkmem (mgr.34373) 12104 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:58.189 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:40:58.416 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:40:58.416 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 45s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:40:58.417 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:40:58.417 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:40:58.417 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:40:58.417 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:40:58.418 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:40:58.418 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:40:58.418 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:40:58.418 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 45s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:40:58.418 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:40:58.419 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:40:58.419 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:40:58.419 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:40:58.419 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 45s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:40:58.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:40:58.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:40:58.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:40:58.420 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:40:58.420 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:40:58.421 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 45s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:40:58.667 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:40:58.667 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:40:58.667 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:58.668 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:40:58.668 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:40:58.668 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:58.668 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:40:58.668 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:40:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:40:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:40:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:40:58.669 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:40:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:40:58.670 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:40:58.670 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:40:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:58 gibba003 bash[31385]: cluster 2021-03-10T17:40:57.312443+0000 mgr.gibba043.dnkmem (mgr.34373) 12105 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:58.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:58 gibba003 bash[31385]: audit 2021-03-10T17:40:58.178032+0000 mgr.gibba043.dnkmem (mgr.34373) 12106 : audit [DBG] from='client.52167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:58 gibba003 bash[32348]: cluster 2021-03-10T17:40:57.312443+0000 mgr.gibba043.dnkmem (mgr.34373) 12105 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:58 gibba003 bash[32348]: audit 2021-03-10T17:40:58.178032+0000 mgr.gibba043.dnkmem (mgr.34373) 12106 : audit [DBG] from='client.52167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:58 gibba043 bash[24019]: cluster 2021-03-10T17:40:57.312443+0000 mgr.gibba043.dnkmem (mgr.34373) 12105 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:58 gibba043 bash[24019]: audit 2021-03-10T17:40:58.178032+0000 mgr.gibba043.dnkmem (mgr.34373) 12106 : audit [DBG] from='client.52167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:59 gibba003 bash[31385]: audit 2021-03-10T17:40:58.401858+0000 mgr.gibba043.dnkmem (mgr.34373) 12107 : audit [DBG] from='client.52173 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:59 gibba003 bash[31385]: cephadm 2021-03-10T17:40:58.632153+0000 mgr.gibba043.dnkmem (mgr.34373) 12108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:59.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:40:59 gibba003 bash[31385]: audit 2021-03-10T17:40:58.665569+0000 mon.a (mon.0) 2386 : audit [DBG] from='client.? 172.21.2.103:0/748621382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:59.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:59 gibba003 bash[32348]: audit 2021-03-10T17:40:58.401858+0000 mgr.gibba043.dnkmem (mgr.34373) 12107 : audit [DBG] from='client.52173 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:59.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:59 gibba003 bash[32348]: cephadm 2021-03-10T17:40:58.632153+0000 mgr.gibba043.dnkmem (mgr.34373) 12108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:40:59.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:40:59 gibba003 bash[32348]: audit 2021-03-10T17:40:58.665569+0000 mon.a (mon.0) 2386 : audit [DBG] from='client.? 172.21.2.103:0/748621382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:00.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:59 gibba043 bash[24019]: audit 2021-03-10T17:40:58.401858+0000 mgr.gibba043.dnkmem (mgr.34373) 12107 : audit [DBG] from='client.52173 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:59 gibba043 bash[24019]: cephadm 2021-03-10T17:40:58.632153+0000 mgr.gibba043.dnkmem (mgr.34373) 12108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:00.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:40:59 gibba043 bash[24019]: audit 2021-03-10T17:40:58.665569+0000 mon.a (mon.0) 2386 : audit [DBG] from='client.? 172.21.2.103:0/748621382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:00.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:00 gibba003 bash[31385]: cluster 2021-03-10T17:40:59.314044+0000 mgr.gibba043.dnkmem (mgr.34373) 12109 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:00.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:00 gibba003 bash[32348]: cluster 2021-03-10T17:40:59.314044+0000 mgr.gibba043.dnkmem (mgr.34373) 12109 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:00 gibba043 bash[24019]: cluster 2021-03-10T17:40:59.314044+0000 mgr.gibba043.dnkmem (mgr.34373) 12109 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:02 gibba003 bash[31385]: cluster 2021-03-10T17:41:01.315852+0000 mgr.gibba043.dnkmem (mgr.34373) 12110 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:02.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:02 gibba003 bash[32348]: cluster 2021-03-10T17:41:01.315852+0000 mgr.gibba043.dnkmem (mgr.34373) 12110 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:03.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:02 gibba043 bash[24019]: cluster 2021-03-10T17:41:01.315852+0000 mgr.gibba043.dnkmem (mgr.34373) 12110 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:04 gibba003 bash[31385]: cluster 2021-03-10T17:41:03.316423+0000 mgr.gibba043.dnkmem (mgr.34373) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:04 gibba003 bash[32348]: cluster 2021-03-10T17:41:03.316423+0000 mgr.gibba043.dnkmem (mgr.34373) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:04 gibba043 bash[24019]: cluster 2021-03-10T17:41:03.316423+0000 mgr.gibba043.dnkmem (mgr.34373) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:06 gibba003 bash[31385]: cluster 2021-03-10T17:41:05.317753+0000 mgr.gibba043.dnkmem (mgr.34373) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:06 gibba003 bash[32348]: cluster 2021-03-10T17:41:05.317753+0000 mgr.gibba043.dnkmem (mgr.34373) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:06 gibba043 bash[24019]: cluster 2021-03-10T17:41:05.317753+0000 mgr.gibba043.dnkmem (mgr.34373) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:08 gibba043 bash[24019]: cluster 2021-03-10T17:41:07.319341+0000 mgr.gibba043.dnkmem (mgr.34373) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:08 gibba003 bash[31385]: cluster 2021-03-10T17:41:07.319341+0000 mgr.gibba043.dnkmem (mgr.34373) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:08 gibba003 bash[32348]: cluster 2021-03-10T17:41:07.319341+0000 mgr.gibba043.dnkmem (mgr.34373) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:11.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:10 gibba043 bash[24019]: cluster 2021-03-10T17:41:09.321028+0000 mgr.gibba043.dnkmem (mgr.34373) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:11.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:10 gibba003 bash[31385]: cluster 2021-03-10T17:41:09.321028+0000 mgr.gibba043.dnkmem (mgr.34373) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:10 gibba003 bash[32348]: cluster 2021-03-10T17:41:09.321028+0000 mgr.gibba043.dnkmem (mgr.34373) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:12 gibba043 bash[24019]: cluster 2021-03-10T17:41:11.322803+0000 mgr.gibba043.dnkmem (mgr.34373) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:12 gibba003 bash[31385]: cluster 2021-03-10T17:41:11.322803+0000 mgr.gibba043.dnkmem (mgr.34373) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:12 gibba003 bash[32348]: cluster 2021-03-10T17:41:11.322803+0000 mgr.gibba043.dnkmem (mgr.34373) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: cluster 2021-03-10T17:41:13.324549+0000 mgr.gibba043.dnkmem (mgr.34373) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: cephadm 2021-03-10T17:41:13.645146+0000 mgr.gibba043.dnkmem (mgr.34373) 12117 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:41:14.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: audit 2021-03-10T17:41:13.648510+0000 mon.c (mon.1) 3110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:41:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: audit 2021-03-10T17:41:14.204604+0000 mon.c (mon.1) 3111 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: audit 2021-03-10T17:41:14.205667+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: audit 2021-03-10T17:41:14.457119+0000 mon.c (mon.1) 3112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:14.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:14 gibba043 bash[24019]: audit 2021-03-10T17:41:14.458260+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: cluster 2021-03-10T17:41:13.324549+0000 mgr.gibba043.dnkmem (mgr.34373) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: cephadm 2021-03-10T17:41:13.645146+0000 mgr.gibba043.dnkmem (mgr.34373) 12117 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:41:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: audit 2021-03-10T17:41:13.648510+0000 mon.c (mon.1) 3110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:41:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: audit 2021-03-10T17:41:14.204604+0000 mon.c (mon.1) 3111 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: audit 2021-03-10T17:41:14.205667+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: audit 2021-03-10T17:41:14.457119+0000 mon.c (mon.1) 3112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:14.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[31385]: audit 2021-03-10T17:41:14.458260+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: cluster 2021-03-10T17:41:13.324549+0000 mgr.gibba043.dnkmem (mgr.34373) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: cephadm 2021-03-10T17:41:13.645146+0000 mgr.gibba043.dnkmem (mgr.34373) 12117 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:41:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: audit 2021-03-10T17:41:13.648510+0000 mon.c (mon.1) 3110 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:41:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: audit 2021-03-10T17:41:14.204604+0000 mon.c (mon.1) 3111 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: audit 2021-03-10T17:41:14.205667+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: audit 2021-03-10T17:41:14.457119+0000 mon.c (mon.1) 3112 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:14.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:14 gibba003 bash[32348]: audit 2021-03-10T17:41:14.458260+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.859683+0000 mon.c (mon.1) 3113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:41:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.860871+0000 mon.c (mon.1) 3114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.861088+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:41:15.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.861893+0000 mon.c (mon.1) 3115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:41:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.862152+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.863177+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:41:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.863187+0000 mon.c (mon.1) 3116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[31385]: audit 2021-03-10T17:41:14.864476+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.859683+0000 mon.c (mon.1) 3113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:41:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.860871+0000 mon.c (mon.1) 3114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.861088+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:41:15.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.861893+0000 mon.c (mon.1) 3115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:41:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.862152+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.863177+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:41:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.863187+0000 mon.c (mon.1) 3116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:41:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:15 gibba003 bash[32348]: audit 2021-03-10T17:41:14.864476+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:41:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.859683+0000 mon.c (mon.1) 3113 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:41:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.860871+0000 mon.c (mon.1) 3114 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:41:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.861088+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:41:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.861893+0000 mon.c (mon.1) 3115 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:41:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.862152+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:41:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.863177+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:41:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.863187+0000 mon.c (mon.1) 3116 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:41:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:15 gibba043 bash[24019]: audit 2021-03-10T17:41:14.864476+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:41:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:16 gibba003 bash[31385]: cluster 2021-03-10T17:41:15.325956+0000 mgr.gibba043.dnkmem (mgr.34373) 12118 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:16.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:16 gibba003 bash[32348]: cluster 2021-03-10T17:41:15.325956+0000 mgr.gibba043.dnkmem (mgr.34373) 12118 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:17.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:16 gibba043 bash[24019]: cluster 2021-03-10T17:41:15.325956+0000 mgr.gibba043.dnkmem (mgr.34373) 12118 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cluster 2021-03-10T17:41:17.326683+0000 mgr.gibba043.dnkmem (mgr.34373) 12119 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.398756+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:41:18.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.399218+0000 mgr.gibba043.dnkmem (mgr.34373) 12120 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:41:18.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.623724+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:41:18.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.625257+0000 mgr.gibba043.dnkmem (mgr.34373) 12121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:18.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.627153+0000 mgr.gibba043.dnkmem (mgr.34373) 12122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:18.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.627185+0000 mon.c (mon.1) 3117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:18.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.628947+0000 mgr.gibba043.dnkmem (mgr.34373) 12123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:18.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.628983+0000 mgr.gibba043.dnkmem (mgr.34373) 12124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:18.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.629043+0000 mon.c (mon.1) 3118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.630499+0000 mgr.gibba043.dnkmem (mgr.34373) 12125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:18.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.630538+0000 mgr.gibba043.dnkmem (mgr.34373) 12126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:18.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.630766+0000 mon.c (mon.1) 3119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.632004+0000 mgr.gibba043.dnkmem (mgr.34373) 12127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:18.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.632224+0000 mon.c (mon.1) 3120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.635092+0000 mgr.gibba043.dnkmem (mgr.34373) 12128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:18.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.635580+0000 mgr.gibba043.dnkmem (mgr.34373) 12129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:18.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.638329+0000 mon.c (mon.1) 3121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.639134+0000 mgr.gibba043.dnkmem (mgr.34373) 12130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:18.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.640991+0000 mgr.gibba043.dnkmem (mgr.34373) 12131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:18.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cluster 2021-03-10T17:41:17.326683+0000 mgr.gibba043.dnkmem (mgr.34373) 12119 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:18.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.398756+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:41:18.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.399218+0000 mgr.gibba043.dnkmem (mgr.34373) 12120 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:41:18.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.623724+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:41:18.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.625257+0000 mgr.gibba043.dnkmem (mgr.34373) 12121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:18.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.627153+0000 mgr.gibba043.dnkmem (mgr.34373) 12122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:18.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.627185+0000 mon.c (mon.1) 3117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:18.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.628947+0000 mgr.gibba043.dnkmem (mgr.34373) 12123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:18.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.628983+0000 mgr.gibba043.dnkmem (mgr.34373) 12124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:18.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.629043+0000 mon.c (mon.1) 3118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.630499+0000 mgr.gibba043.dnkmem (mgr.34373) 12125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:18.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.630538+0000 mgr.gibba043.dnkmem (mgr.34373) 12126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:18.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.630766+0000 mon.c (mon.1) 3119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.632004+0000 mgr.gibba043.dnkmem (mgr.34373) 12127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:18.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.632224+0000 mon.c (mon.1) 3120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.635092+0000 mgr.gibba043.dnkmem (mgr.34373) 12128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:18.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.635580+0000 mgr.gibba043.dnkmem (mgr.34373) 12129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:18.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.638329+0000 mon.c (mon.1) 3121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.639134+0000 mgr.gibba043.dnkmem (mgr.34373) 12130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:18.704 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.640991+0000 mgr.gibba043.dnkmem (mgr.34373) 12131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:18.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: audit 2021-03-10T17:41:17.643064+0000 mon.c (mon.1) 3122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.644102+0000 mgr.gibba043.dnkmem (mgr.34373) 12132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:18.705 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.644366+0000 mgr.gibba043.dnkmem (mgr.34373) 12133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:18.706 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[31385]: cephadm 2021-03-10T17:41:17.644899+0000 mgr.gibba043.dnkmem (mgr.34373) 12134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:18.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: audit 2021-03-10T17:41:17.643064+0000 mon.c (mon.1) 3122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.644102+0000 mgr.gibba043.dnkmem (mgr.34373) 12132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:18.706 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.644366+0000 mgr.gibba043.dnkmem (mgr.34373) 12133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:18.707 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:18 gibba003 bash[32348]: cephadm 2021-03-10T17:41:17.644899+0000 mgr.gibba043.dnkmem (mgr.34373) 12134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cluster 2021-03-10T17:41:17.326683+0000 mgr.gibba043.dnkmem (mgr.34373) 12119 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.398756+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:41:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.399218+0000 mgr.gibba043.dnkmem (mgr.34373) 12120 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:41:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.623724+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:41:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.625257+0000 mgr.gibba043.dnkmem (mgr.34373) 12121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:18.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.627153+0000 mgr.gibba043.dnkmem (mgr.34373) 12122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:18.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.627185+0000 mon.c (mon.1) 3117 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:18.776 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.628947+0000 mgr.gibba043.dnkmem (mgr.34373) 12123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:18.777 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.628983+0000 mgr.gibba043.dnkmem (mgr.34373) 12124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:18.778 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.629043+0000 mon.c (mon.1) 3118 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.630499+0000 mgr.gibba043.dnkmem (mgr.34373) 12125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:18.779 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.630538+0000 mgr.gibba043.dnkmem (mgr.34373) 12126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:18.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.630766+0000 mon.c (mon.1) 3119 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.632004+0000 mgr.gibba043.dnkmem (mgr.34373) 12127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:18.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.632224+0000 mon.c (mon.1) 3120 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.780 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.635092+0000 mgr.gibba043.dnkmem (mgr.34373) 12128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:18.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.635580+0000 mgr.gibba043.dnkmem (mgr.34373) 12129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:18.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.638329+0000 mon.c (mon.1) 3121 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.781 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.639134+0000 mgr.gibba043.dnkmem (mgr.34373) 12130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:18.782 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.640991+0000 mgr.gibba043.dnkmem (mgr.34373) 12131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:18.784 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: audit 2021-03-10T17:41:17.643064+0000 mon.c (mon.1) 3122 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:18.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.644102+0000 mgr.gibba043.dnkmem (mgr.34373) 12132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:18.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.644366+0000 mgr.gibba043.dnkmem (mgr.34373) 12133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:18.785 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:18 gibba043 bash[24019]: cephadm 2021-03-10T17:41:17.644899+0000 mgr.gibba043.dnkmem (mgr.34373) 12134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:20.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:20 gibba003 bash[31385]: cluster 2021-03-10T17:41:19.328241+0000 mgr.gibba043.dnkmem (mgr.34373) 12135 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:20.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:20 gibba003 bash[32348]: cluster 2021-03-10T17:41:19.328241+0000 mgr.gibba043.dnkmem (mgr.34373) 12135 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:20 gibba043 bash[24019]: cluster 2021-03-10T17:41:19.328241+0000 mgr.gibba043.dnkmem (mgr.34373) 12135 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:22.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:22 gibba003 bash[31385]: cluster 2021-03-10T17:41:21.329981+0000 mgr.gibba043.dnkmem (mgr.34373) 12136 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:22.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:22 gibba003 bash[32348]: cluster 2021-03-10T17:41:21.329981+0000 mgr.gibba043.dnkmem (mgr.34373) 12136 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:22 gibba043 bash[24019]: cluster 2021-03-10T17:41:21.329981+0000 mgr.gibba043.dnkmem (mgr.34373) 12136 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:24.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:24 gibba003 bash[31385]: cluster 2021-03-10T17:41:23.331442+0000 mgr.gibba043.dnkmem (mgr.34373) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:24.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:24 gibba003 bash[32348]: cluster 2021-03-10T17:41:23.331442+0000 mgr.gibba043.dnkmem (mgr.34373) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:24 gibba043 bash[24019]: cluster 2021-03-10T17:41:23.331442+0000 mgr.gibba043.dnkmem (mgr.34373) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:26.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:26 gibba003 bash[31385]: cluster 2021-03-10T17:41:25.333014+0000 mgr.gibba043.dnkmem (mgr.34373) 12138 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:26.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:26 gibba003 bash[32348]: cluster 2021-03-10T17:41:25.333014+0000 mgr.gibba043.dnkmem (mgr.34373) 12138 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:26 gibba043 bash[24019]: cluster 2021-03-10T17:41:25.333014+0000 mgr.gibba043.dnkmem (mgr.34373) 12138 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:28.911 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:41:28.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:28 gibba003 bash[31385]: cluster 2021-03-10T17:41:27.334336+0000 mgr.gibba043.dnkmem (mgr.34373) 12139 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:28.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:28 gibba003 bash[32348]: cluster 2021-03-10T17:41:27.334336+0000 mgr.gibba043.dnkmem (mgr.34373) 12139 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:28 gibba043 bash[24019]: cluster 2021-03-10T17:41:27.334336+0000 mgr.gibba043.dnkmem (mgr.34373) 12139 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.168 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:41:29.169 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 75s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:41:29.169 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 11s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:41:29.169 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:41:29.169 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:41:29.170 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 75s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:41:29.170 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 75s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:41:29.170 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:41:29.170 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 75s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:41:29.170 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 75s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:41:29.171 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 11s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:41:29.171 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 75s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:41:29.171 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 75s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:41:29.171 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 75s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:41:29.172 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 75s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:41:29.172 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:41:29.172 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:41:29.172 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:41:29.172 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 11s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:41:29.173 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 11s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:41:29.173 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 75s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:41:29.418 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:41:29.418 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:41:29.418 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:29.419 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:41:29.419 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:41:29.419 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:29.419 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:41:29.419 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:41:29.420 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:41:29.420 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:41:29.420 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:41:29.420 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:41:29.421 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:41:29.421 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:41:29.421 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:41:29.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:29 gibba003 bash[31385]: audit 2021-03-10T17:41:28.899619+0000 mgr.gibba043.dnkmem (mgr.34373) 12140 : audit [DBG] from='client.52185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:29 gibba003 bash[31385]: audit 2021-03-10T17:41:29.126842+0000 mgr.gibba043.dnkmem (mgr.34373) 12141 : audit [DBG] from='client.52191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:29.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:29 gibba003 bash[31385]: audit 2021-03-10T17:41:29.416179+0000 mon.a (mon.0) 2395 : audit [DBG] from='client.? 172.21.2.103:0/3981255745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:29.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:29 gibba003 bash[32348]: audit 2021-03-10T17:41:28.899619+0000 mgr.gibba043.dnkmem (mgr.34373) 12140 : audit [DBG] from='client.52185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:29 gibba003 bash[32348]: audit 2021-03-10T17:41:29.126842+0000 mgr.gibba043.dnkmem (mgr.34373) 12141 : audit [DBG] from='client.52191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:29.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:29 gibba003 bash[32348]: audit 2021-03-10T17:41:29.416179+0000 mon.a (mon.0) 2395 : audit [DBG] from='client.? 172.21.2.103:0/3981255745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:30.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:29 gibba043 bash[24019]: audit 2021-03-10T17:41:28.899619+0000 mgr.gibba043.dnkmem (mgr.34373) 12140 : audit [DBG] from='client.52185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:29 gibba043 bash[24019]: audit 2021-03-10T17:41:29.126842+0000 mgr.gibba043.dnkmem (mgr.34373) 12141 : audit [DBG] from='client.52191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:30.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:29 gibba043 bash[24019]: audit 2021-03-10T17:41:29.416179+0000 mon.a (mon.0) 2395 : audit [DBG] from='client.? 172.21.2.103:0/3981255745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:30.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:30 gibba003 bash[31385]: cluster 2021-03-10T17:41:29.336015+0000 mgr.gibba043.dnkmem (mgr.34373) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:30.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:30 gibba003 bash[32348]: cluster 2021-03-10T17:41:29.336015+0000 mgr.gibba043.dnkmem (mgr.34373) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:30 gibba043 bash[24019]: cluster 2021-03-10T17:41:29.336015+0000 mgr.gibba043.dnkmem (mgr.34373) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:32.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:32 gibba003 bash[31385]: cluster 2021-03-10T17:41:31.337748+0000 mgr.gibba043.dnkmem (mgr.34373) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:32.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:32 gibba003 bash[32348]: cluster 2021-03-10T17:41:31.337748+0000 mgr.gibba043.dnkmem (mgr.34373) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:32 gibba043 bash[24019]: cluster 2021-03-10T17:41:31.337748+0000 mgr.gibba043.dnkmem (mgr.34373) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:33 gibba003 bash[31385]: cephadm 2021-03-10T17:41:32.660749+0000 mgr.gibba043.dnkmem (mgr.34373) 12144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:33.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:33 gibba003 bash[32348]: cephadm 2021-03-10T17:41:32.660749+0000 mgr.gibba043.dnkmem (mgr.34373) 12144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:34.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:33 gibba043 bash[24019]: cephadm 2021-03-10T17:41:32.660749+0000 mgr.gibba043.dnkmem (mgr.34373) 12144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:34.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:34 gibba003 bash[31385]: cluster 2021-03-10T17:41:33.339418+0000 mgr.gibba043.dnkmem (mgr.34373) 12145 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:34.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:34 gibba003 bash[32348]: cluster 2021-03-10T17:41:33.339418+0000 mgr.gibba043.dnkmem (mgr.34373) 12145 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:34 gibba043 bash[24019]: cluster 2021-03-10T17:41:33.339418+0000 mgr.gibba043.dnkmem (mgr.34373) 12145 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:36.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:36 gibba003 bash[31385]: cluster 2021-03-10T17:41:35.340732+0000 mgr.gibba043.dnkmem (mgr.34373) 12146 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:36.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:36 gibba003 bash[32348]: cluster 2021-03-10T17:41:35.340732+0000 mgr.gibba043.dnkmem (mgr.34373) 12146 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:36 gibba043 bash[24019]: cluster 2021-03-10T17:41:35.340732+0000 mgr.gibba043.dnkmem (mgr.34373) 12146 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:38.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:38 gibba003 bash[31385]: cluster 2021-03-10T17:41:37.342222+0000 mgr.gibba043.dnkmem (mgr.34373) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:38.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:38 gibba003 bash[32348]: cluster 2021-03-10T17:41:37.342222+0000 mgr.gibba043.dnkmem (mgr.34373) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:39.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:38 gibba043 bash[24019]: cluster 2021-03-10T17:41:37.342222+0000 mgr.gibba043.dnkmem (mgr.34373) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:40.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:40 gibba003 bash[31385]: cluster 2021-03-10T17:41:39.344060+0000 mgr.gibba043.dnkmem (mgr.34373) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:40.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:40 gibba003 bash[32348]: cluster 2021-03-10T17:41:39.344060+0000 mgr.gibba043.dnkmem (mgr.34373) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:41.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:40 gibba043 bash[24019]: cluster 2021-03-10T17:41:39.344060+0000 mgr.gibba043.dnkmem (mgr.34373) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:42.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:42 gibba003 bash[31385]: cluster 2021-03-10T17:41:41.345567+0000 mgr.gibba043.dnkmem (mgr.34373) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:42.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:42 gibba003 bash[32348]: cluster 2021-03-10T17:41:41.345567+0000 mgr.gibba043.dnkmem (mgr.34373) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:42 gibba043 bash[24019]: cluster 2021-03-10T17:41:41.345567+0000 mgr.gibba043.dnkmem (mgr.34373) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:44.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:44 gibba003 bash[31385]: cluster 2021-03-10T17:41:43.347192+0000 mgr.gibba043.dnkmem (mgr.34373) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:44.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:44 gibba003 bash[32348]: cluster 2021-03-10T17:41:43.347192+0000 mgr.gibba043.dnkmem (mgr.34373) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:44 gibba043 bash[24019]: cluster 2021-03-10T17:41:43.347192+0000 mgr.gibba043.dnkmem (mgr.34373) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:46.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:46 gibba003 bash[31385]: cluster 2021-03-10T17:41:45.348754+0000 mgr.gibba043.dnkmem (mgr.34373) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:46.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:46 gibba003 bash[32348]: cluster 2021-03-10T17:41:45.348754+0000 mgr.gibba043.dnkmem (mgr.34373) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:47.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:46 gibba043 bash[24019]: cluster 2021-03-10T17:41:45.348754+0000 mgr.gibba043.dnkmem (mgr.34373) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:48 gibba003 bash[31385]: cluster 2021-03-10T17:41:47.350259+0000 mgr.gibba043.dnkmem (mgr.34373) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:48 gibba003 bash[31385]: cephadm 2021-03-10T17:41:47.676352+0000 mgr.gibba043.dnkmem (mgr.34373) 12153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:48 gibba003 bash[32348]: cluster 2021-03-10T17:41:47.350259+0000 mgr.gibba043.dnkmem (mgr.34373) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:48 gibba003 bash[32348]: cephadm 2021-03-10T17:41:47.676352+0000 mgr.gibba043.dnkmem (mgr.34373) 12153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:49.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:48 gibba043 bash[24019]: cluster 2021-03-10T17:41:47.350259+0000 mgr.gibba043.dnkmem (mgr.34373) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:49.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:48 gibba043 bash[24019]: cephadm 2021-03-10T17:41:47.676352+0000 mgr.gibba043.dnkmem (mgr.34373) 12153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:41:50.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:50 gibba003 bash[31385]: cluster 2021-03-10T17:41:49.352032+0000 mgr.gibba043.dnkmem (mgr.34373) 12154 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:50.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:50 gibba003 bash[32348]: cluster 2021-03-10T17:41:49.352032+0000 mgr.gibba043.dnkmem (mgr.34373) 12154 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:50 gibba043 bash[24019]: cluster 2021-03-10T17:41:49.352032+0000 mgr.gibba043.dnkmem (mgr.34373) 12154 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:52 gibba003 bash[31385]: cluster 2021-03-10T17:41:51.353805+0000 mgr.gibba043.dnkmem (mgr.34373) 12155 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:52 gibba003 bash[32348]: cluster 2021-03-10T17:41:51.353805+0000 mgr.gibba043.dnkmem (mgr.34373) 12155 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:52 gibba043 bash[24019]: cluster 2021-03-10T17:41:51.353805+0000 mgr.gibba043.dnkmem (mgr.34373) 12155 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:54 gibba003 bash[31385]: cluster 2021-03-10T17:41:53.355376+0000 mgr.gibba043.dnkmem (mgr.34373) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:54 gibba003 bash[32348]: cluster 2021-03-10T17:41:53.355376+0000 mgr.gibba043.dnkmem (mgr.34373) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:55.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:54 gibba043 bash[24019]: cluster 2021-03-10T17:41:53.355376+0000 mgr.gibba043.dnkmem (mgr.34373) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:56 gibba003 bash[31385]: cluster 2021-03-10T17:41:55.356932+0000 mgr.gibba043.dnkmem (mgr.34373) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:56 gibba003 bash[32348]: cluster 2021-03-10T17:41:55.356932+0000 mgr.gibba043.dnkmem (mgr.34373) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:56 gibba043 bash[24019]: cluster 2021-03-10T17:41:55.356932+0000 mgr.gibba043.dnkmem (mgr.34373) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:41:58 gibba043 bash[24019]: cluster 2021-03-10T17:41:57.358609+0000 mgr.gibba043.dnkmem (mgr.34373) 12158 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:41:58 gibba003 bash[31385]: cluster 2021-03-10T17:41:57.358609+0000 mgr.gibba043.dnkmem (mgr.34373) 12158 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:41:58 gibba003 bash[32348]: cluster 2021-03-10T17:41:57.358609+0000 mgr.gibba043.dnkmem (mgr.34373) 12158 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.655 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:41:59.883 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:41:59.884 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 106s ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:41:59.884 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 42s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:41:59.884 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:41:59.885 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:41:59.885 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 106s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:41:59.885 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 106s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:41:59.885 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:41:59.885 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 106s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:41:59.886 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 106s ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:41:59.886 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 42s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:41:59.886 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 106s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:41:59.886 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 106s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:41:59.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 106s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:41:59.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 106s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:41:59.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:41:59.887 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:41:59.888 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:41:59.888 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 42s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:41:59.888 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 42s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:41:59.888 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 106s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:42:00.135 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:42:00.135 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:42:00.136 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:00.136 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:42:00.137 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:42:00.137 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:00.138 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:42:00.138 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:42:00.138 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:42:00.139 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:42:00.139 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:42:00.140 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:42:00.140 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:42:00.141 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:42:00.141 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:42:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:00 gibba043 bash[24019]: cluster 2021-03-10T17:41:59.360449+0000 mgr.gibba043.dnkmem (mgr.34373) 12159 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:00 gibba043 bash[24019]: audit 2021-03-10T17:41:59.644404+0000 mgr.gibba043.dnkmem (mgr.34373) 12160 : audit [DBG] from='client.62194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:01.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:00 gibba043 bash[24019]: audit 2021-03-10T17:41:59.868936+0000 mgr.gibba043.dnkmem (mgr.34373) 12161 : audit [DBG] from='client.62200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:01.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:00 gibba043 bash[24019]: audit 2021-03-10T17:42:00.133762+0000 mon.c (mon.1) 3123 : audit [DBG] from='client.? 172.21.2.103:0/3244072677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:01.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[31385]: cluster 2021-03-10T17:41:59.360449+0000 mgr.gibba043.dnkmem (mgr.34373) 12159 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[31385]: audit 2021-03-10T17:41:59.644404+0000 mgr.gibba043.dnkmem (mgr.34373) 12160 : audit [DBG] from='client.62194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[31385]: audit 2021-03-10T17:41:59.868936+0000 mgr.gibba043.dnkmem (mgr.34373) 12161 : audit [DBG] from='client.62200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:01.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[31385]: audit 2021-03-10T17:42:00.133762+0000 mon.c (mon.1) 3123 : audit [DBG] from='client.? 172.21.2.103:0/3244072677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[32348]: cluster 2021-03-10T17:41:59.360449+0000 mgr.gibba043.dnkmem (mgr.34373) 12159 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[32348]: audit 2021-03-10T17:41:59.644404+0000 mgr.gibba043.dnkmem (mgr.34373) 12160 : audit [DBG] from='client.62194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[32348]: audit 2021-03-10T17:41:59.868936+0000 mgr.gibba043.dnkmem (mgr.34373) 12161 : audit [DBG] from='client.62200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:01.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:00 gibba003 bash[32348]: audit 2021-03-10T17:42:00.133762+0000 mon.c (mon.1) 3123 : audit [DBG] from='client.? 172.21.2.103:0/3244072677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:02 gibba043 bash[24019]: cluster 2021-03-10T17:42:01.362203+0000 mgr.gibba043.dnkmem (mgr.34373) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:03.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:02 gibba003 bash[31385]: cluster 2021-03-10T17:42:01.362203+0000 mgr.gibba043.dnkmem (mgr.34373) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:03.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:02 gibba003 bash[32348]: cluster 2021-03-10T17:42:01.362203+0000 mgr.gibba043.dnkmem (mgr.34373) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:03 gibba043 bash[24019]: cephadm 2021-03-10T17:42:02.692448+0000 mgr.gibba043.dnkmem (mgr.34373) 12163 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:04.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:03 gibba003 bash[31385]: cephadm 2021-03-10T17:42:02.692448+0000 mgr.gibba043.dnkmem (mgr.34373) 12163 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:04.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:03 gibba003 bash[32348]: cephadm 2021-03-10T17:42:02.692448+0000 mgr.gibba043.dnkmem (mgr.34373) 12163 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:04 gibba043 bash[24019]: cluster 2021-03-10T17:42:03.363740+0000 mgr.gibba043.dnkmem (mgr.34373) 12164 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:05.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:04 gibba003 bash[31385]: cluster 2021-03-10T17:42:03.363740+0000 mgr.gibba043.dnkmem (mgr.34373) 12164 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:05.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:04 gibba003 bash[32348]: cluster 2021-03-10T17:42:03.363740+0000 mgr.gibba043.dnkmem (mgr.34373) 12164 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:06 gibba043 bash[24019]: cluster 2021-03-10T17:42:05.365308+0000 mgr.gibba043.dnkmem (mgr.34373) 12165 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:06 gibba003 bash[31385]: cluster 2021-03-10T17:42:05.365308+0000 mgr.gibba043.dnkmem (mgr.34373) 12165 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.519 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:06 gibba003 bash[32348]: cluster 2021-03-10T17:42:05.365308+0000 mgr.gibba043.dnkmem (mgr.34373) 12165 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:09.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:08 gibba043 bash[24019]: cluster 2021-03-10T17:42:07.367012+0000 mgr.gibba043.dnkmem (mgr.34373) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:09.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:08 gibba003 bash[31385]: cluster 2021-03-10T17:42:07.367012+0000 mgr.gibba043.dnkmem (mgr.34373) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:09.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:08 gibba003 bash[32348]: cluster 2021-03-10T17:42:07.367012+0000 mgr.gibba043.dnkmem (mgr.34373) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:11.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:10 gibba043 bash[24019]: cluster 2021-03-10T17:42:09.368813+0000 mgr.gibba043.dnkmem (mgr.34373) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:11.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:10 gibba003 bash[31385]: cluster 2021-03-10T17:42:09.368813+0000 mgr.gibba043.dnkmem (mgr.34373) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:11.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:10 gibba003 bash[32348]: cluster 2021-03-10T17:42:09.368813+0000 mgr.gibba043.dnkmem (mgr.34373) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:12 gibba043 bash[24019]: cluster 2021-03-10T17:42:11.370524+0000 mgr.gibba043.dnkmem (mgr.34373) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:13.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:12 gibba003 bash[31385]: cluster 2021-03-10T17:42:11.370524+0000 mgr.gibba043.dnkmem (mgr.34373) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:13.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:12 gibba003 bash[32348]: cluster 2021-03-10T17:42:11.370524+0000 mgr.gibba043.dnkmem (mgr.34373) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:14 gibba043 bash[24019]: cluster 2021-03-10T17:42:13.372227+0000 mgr.gibba043.dnkmem (mgr.34373) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:14 gibba043 bash[24019]: audit 2021-03-10T17:42:14.211104+0000 mon.c (mon.1) 3124 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:14 gibba043 bash[24019]: audit 2021-03-10T17:42:14.212207+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:14 gibba043 bash[24019]: audit 2021-03-10T17:42:14.464579+0000 mon.c (mon.1) 3125 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:14 gibba043 bash[24019]: audit 2021-03-10T17:42:14.465705+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[31385]: cluster 2021-03-10T17:42:13.372227+0000 mgr.gibba043.dnkmem (mgr.34373) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[31385]: audit 2021-03-10T17:42:14.211104+0000 mon.c (mon.1) 3124 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[31385]: audit 2021-03-10T17:42:14.212207+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[31385]: audit 2021-03-10T17:42:14.464579+0000 mon.c (mon.1) 3125 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:15.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[31385]: audit 2021-03-10T17:42:14.465705+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[32348]: cluster 2021-03-10T17:42:13.372227+0000 mgr.gibba043.dnkmem (mgr.34373) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[32348]: audit 2021-03-10T17:42:14.211104+0000 mon.c (mon.1) 3124 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[32348]: audit 2021-03-10T17:42:14.212207+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[32348]: audit 2021-03-10T17:42:14.464579+0000 mon.c (mon.1) 3125 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:15.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:14 gibba003 bash[32348]: audit 2021-03-10T17:42:14.465705+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.871643+0000 mon.c (mon.1) 3126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:42:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.872404+0000 mon.c (mon.1) 3127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.872897+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:42:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.873162+0000 mon.c (mon.1) 3128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.873986+0000 mon.c (mon.1) 3129 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:42:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.874421+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.875556+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[31385]: audit 2021-03-10T17:42:14.876458+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:42:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.871643+0000 mon.c (mon.1) 3126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:42:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.872404+0000 mon.c (mon.1) 3127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.872897+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:42:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.873162+0000 mon.c (mon.1) 3128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.873986+0000 mon.c (mon.1) 3129 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:42:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.874421+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.875556+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:15 gibba003 bash[32348]: audit 2021-03-10T17:42:14.876458+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:42:16.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.871643+0000 mon.c (mon.1) 3126 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:42:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.872404+0000 mon.c (mon.1) 3127 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.872897+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:42:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.873162+0000 mon.c (mon.1) 3128 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.873986+0000 mon.c (mon.1) 3129 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:42:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.874421+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.875556+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:16.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:15 gibba043 bash[24019]: audit 2021-03-10T17:42:14.876458+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:42:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:16 gibba003 bash[31385]: cluster 2021-03-10T17:42:15.373623+0000 mgr.gibba043.dnkmem (mgr.34373) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:16 gibba003 bash[32348]: cluster 2021-03-10T17:42:15.373623+0000 mgr.gibba043.dnkmem (mgr.34373) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:16 gibba043 bash[24019]: cluster 2021-03-10T17:42:15.373623+0000 mgr.gibba043.dnkmem (mgr.34373) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cluster 2021-03-10T17:42:17.375305+0000 mgr.gibba043.dnkmem (mgr.34373) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.709223+0000 mgr.gibba043.dnkmem (mgr.34373) 12172 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:42:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.710836+0000 mgr.gibba043.dnkmem (mgr.34373) 12173 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:42:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.925715+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:42:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.927489+0000 mgr.gibba043.dnkmem (mgr.34373) 12174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.929600+0000 mon.c (mon.1) 3130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.930025+0000 mgr.gibba043.dnkmem (mgr.34373) 12175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.931576+0000 mgr.gibba043.dnkmem (mgr.34373) 12176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.931630+0000 mgr.gibba043.dnkmem (mgr.34373) 12177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.931787+0000 mon.c (mon.1) 3131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.932832+0000 mgr.gibba043.dnkmem (mgr.34373) 12178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:19.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.932870+0000 mgr.gibba043.dnkmem (mgr.34373) 12179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:19.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.933268+0000 mon.c (mon.1) 3132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.934555+0000 mon.c (mon.1) 3133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.934908+0000 mgr.gibba043.dnkmem (mgr.34373) 12180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:19.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.936729+0000 mgr.gibba043.dnkmem (mgr.34373) 12181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:19.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.936771+0000 mgr.gibba043.dnkmem (mgr.34373) 12182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:19.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.937924+0000 mgr.gibba043.dnkmem (mgr.34373) 12183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:19.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.938368+0000 mgr.gibba043.dnkmem (mgr.34373) 12184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:19.197 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.938403+0000 mon.c (mon.1) 3134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cluster 2021-03-10T17:42:17.375305+0000 mgr.gibba043.dnkmem (mgr.34373) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.709223+0000 mgr.gibba043.dnkmem (mgr.34373) 12172 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:42:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.710836+0000 mgr.gibba043.dnkmem (mgr.34373) 12173 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:42:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.925715+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:42:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.927489+0000 mgr.gibba043.dnkmem (mgr.34373) 12174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:19.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.929600+0000 mon.c (mon.1) 3130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.930025+0000 mgr.gibba043.dnkmem (mgr.34373) 12175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.931576+0000 mgr.gibba043.dnkmem (mgr.34373) 12176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.931630+0000 mgr.gibba043.dnkmem (mgr.34373) 12177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.931787+0000 mon.c (mon.1) 3131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.932832+0000 mgr.gibba043.dnkmem (mgr.34373) 12178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:19.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.932870+0000 mgr.gibba043.dnkmem (mgr.34373) 12179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:19.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.933268+0000 mon.c (mon.1) 3132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.934555+0000 mon.c (mon.1) 3133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.201 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.934908+0000 mgr.gibba043.dnkmem (mgr.34373) 12180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:19.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.936729+0000 mgr.gibba043.dnkmem (mgr.34373) 12181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:19.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.936771+0000 mgr.gibba043.dnkmem (mgr.34373) 12182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:19.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.937924+0000 mgr.gibba043.dnkmem (mgr.34373) 12183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:19.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.938368+0000 mgr.gibba043.dnkmem (mgr.34373) 12184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:19.202 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.938403+0000 mon.c (mon.1) 3134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: audit 2021-03-10T17:42:17.939978+0000 mon.c (mon.1) 3135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.940011+0000 mgr.gibba043.dnkmem (mgr.34373) 12185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:19.203 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.940054+0000 mgr.gibba043.dnkmem (mgr.34373) 12186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:19.204 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[31385]: cephadm 2021-03-10T17:42:17.940176+0000 mgr.gibba043.dnkmem (mgr.34373) 12187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:19.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: audit 2021-03-10T17:42:17.939978+0000 mon.c (mon.1) 3135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.940011+0000 mgr.gibba043.dnkmem (mgr.34373) 12185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:19.204 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.940054+0000 mgr.gibba043.dnkmem (mgr.34373) 12186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:19.205 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:18 gibba003 bash[32348]: cephadm 2021-03-10T17:42:17.940176+0000 mgr.gibba043.dnkmem (mgr.34373) 12187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cluster 2021-03-10T17:42:17.375305+0000 mgr.gibba043.dnkmem (mgr.34373) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.709223+0000 mgr.gibba043.dnkmem (mgr.34373) 12172 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:42:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.710836+0000 mgr.gibba043.dnkmem (mgr.34373) 12173 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:42:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.925715+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:42:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.927489+0000 mgr.gibba043.dnkmem (mgr.34373) 12174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.929600+0000 mon.c (mon.1) 3130 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.930025+0000 mgr.gibba043.dnkmem (mgr.34373) 12175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.931576+0000 mgr.gibba043.dnkmem (mgr.34373) 12176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:19.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.931630+0000 mgr.gibba043.dnkmem (mgr.34373) 12177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:19.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.931787+0000 mon.c (mon.1) 3131 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.932832+0000 mgr.gibba043.dnkmem (mgr.34373) 12178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:19.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.932870+0000 mgr.gibba043.dnkmem (mgr.34373) 12179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:19.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.933268+0000 mon.c (mon.1) 3132 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.934555+0000 mon.c (mon.1) 3133 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.934908+0000 mgr.gibba043.dnkmem (mgr.34373) 12180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:19.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.936729+0000 mgr.gibba043.dnkmem (mgr.34373) 12181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:19.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.936771+0000 mgr.gibba043.dnkmem (mgr.34373) 12182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:19.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.937924+0000 mgr.gibba043.dnkmem (mgr.34373) 12183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:19.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.938368+0000 mgr.gibba043.dnkmem (mgr.34373) 12184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:19.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.938403+0000 mon.c (mon.1) 3134 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: audit 2021-03-10T17:42:17.939978+0000 mon.c (mon.1) 3135 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.940011+0000 mgr.gibba043.dnkmem (mgr.34373) 12185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:19.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.940054+0000 mgr.gibba043.dnkmem (mgr.34373) 12186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:19.279 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:18 gibba043 bash[24019]: cephadm 2021-03-10T17:42:17.940176+0000 mgr.gibba043.dnkmem (mgr.34373) 12187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:20 gibba003 bash[31385]: cluster 2021-03-10T17:42:19.376958+0000 mgr.gibba043.dnkmem (mgr.34373) 12188 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:20 gibba003 bash[32348]: cluster 2021-03-10T17:42:19.376958+0000 mgr.gibba043.dnkmem (mgr.34373) 12188 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:20 gibba043 bash[24019]: cluster 2021-03-10T17:42:19.376958+0000 mgr.gibba043.dnkmem (mgr.34373) 12188 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:23.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:22 gibba043 bash[24019]: cluster 2021-03-10T17:42:21.378670+0000 mgr.gibba043.dnkmem (mgr.34373) 12189 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:22 gibba003 bash[31385]: cluster 2021-03-10T17:42:21.378670+0000 mgr.gibba043.dnkmem (mgr.34373) 12189 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:22 gibba003 bash[32348]: cluster 2021-03-10T17:42:21.378670+0000 mgr.gibba043.dnkmem (mgr.34373) 12189 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:25.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:24 gibba043 bash[24019]: cluster 2021-03-10T17:42:23.380363+0000 mgr.gibba043.dnkmem (mgr.34373) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:24 gibba003 bash[31385]: cluster 2021-03-10T17:42:23.380363+0000 mgr.gibba043.dnkmem (mgr.34373) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:24 gibba003 bash[32348]: cluster 2021-03-10T17:42:23.380363+0000 mgr.gibba043.dnkmem (mgr.34373) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:27.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:26 gibba043 bash[24019]: cluster 2021-03-10T17:42:25.381743+0000 mgr.gibba043.dnkmem (mgr.34373) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:26 gibba003 bash[31385]: cluster 2021-03-10T17:42:25.381743+0000 mgr.gibba043.dnkmem (mgr.34373) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:26 gibba003 bash[32348]: cluster 2021-03-10T17:42:25.381743+0000 mgr.gibba043.dnkmem (mgr.34373) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:28 gibba043 bash[24019]: cluster 2021-03-10T17:42:27.383435+0000 mgr.gibba043.dnkmem (mgr.34373) 12192 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:28 gibba003 bash[31385]: cluster 2021-03-10T17:42:27.383435+0000 mgr.gibba043.dnkmem (mgr.34373) 12192 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:28 gibba003 bash[32348]: cluster 2021-03-10T17:42:27.383435+0000 mgr.gibba043.dnkmem (mgr.34373) 12192 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:30.379 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:42:30.605 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:42:30.606 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:42:30.606 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 73s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:42:30.606 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:42:30.606 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:42:30.606 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:42:30.607 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:42:30.607 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:42:30.607 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:42:30.607 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:42:30.608 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 73s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:42:30.608 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:42:30.608 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:42:30.608 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:42:30.608 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:42:30.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:42:30.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:42:30.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:42:30.609 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 73s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:42:30.610 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 73s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:42:30.610 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:42:30.855 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:42:30.855 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:42:30.855 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:30.855 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:42:30.856 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:42:30.856 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:30.856 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:42:30.856 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:42:30.857 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:42:30.857 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:42:30.857 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:42:30.857 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:42:30.857 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:42:30.858 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:42:30.858 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:42:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:30 gibba043 bash[24019]: cluster 2021-03-10T17:42:29.385086+0000 mgr.gibba043.dnkmem (mgr.34373) 12193 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:30 gibba043 bash[24019]: audit 2021-03-10T17:42:30.853403+0000 mon.c (mon.1) 3136 : audit [DBG] from='client.? 172.21.2.103:0/2329463414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:30 gibba003 bash[31385]: cluster 2021-03-10T17:42:29.385086+0000 mgr.gibba043.dnkmem (mgr.34373) 12193 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:30 gibba003 bash[31385]: audit 2021-03-10T17:42:30.853403+0000 mon.c (mon.1) 3136 : audit [DBG] from='client.? 172.21.2.103:0/2329463414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:30 gibba003 bash[32348]: cluster 2021-03-10T17:42:29.385086+0000 mgr.gibba043.dnkmem (mgr.34373) 12193 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:30 gibba003 bash[32348]: audit 2021-03-10T17:42:30.853403+0000 mon.c (mon.1) 3136 : audit [DBG] from='client.? 172.21.2.103:0/2329463414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:31 gibba043 bash[24019]: audit 2021-03-10T17:42:30.367786+0000 mgr.gibba043.dnkmem (mgr.34373) 12194 : audit [DBG] from='client.52221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:32.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:31 gibba043 bash[24019]: audit 2021-03-10T17:42:30.590537+0000 mgr.gibba043.dnkmem (mgr.34373) 12195 : audit [DBG] from='client.62218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:32.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:31 gibba003 bash[31385]: audit 2021-03-10T17:42:30.367786+0000 mgr.gibba043.dnkmem (mgr.34373) 12194 : audit [DBG] from='client.52221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:32.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:31 gibba003 bash[31385]: audit 2021-03-10T17:42:30.590537+0000 mgr.gibba043.dnkmem (mgr.34373) 12195 : audit [DBG] from='client.62218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:31 gibba003 bash[32348]: audit 2021-03-10T17:42:30.367786+0000 mgr.gibba043.dnkmem (mgr.34373) 12194 : audit [DBG] from='client.52221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:32.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:31 gibba003 bash[32348]: audit 2021-03-10T17:42:30.590537+0000 mgr.gibba043.dnkmem (mgr.34373) 12195 : audit [DBG] from='client.62218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:33 gibba043 bash[24019]: cluster 2021-03-10T17:42:31.386821+0000 mgr.gibba043.dnkmem (mgr.34373) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:33 gibba003 bash[31385]: cluster 2021-03-10T17:42:31.386821+0000 mgr.gibba043.dnkmem (mgr.34373) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:33 gibba003 bash[32348]: cluster 2021-03-10T17:42:31.386821+0000 mgr.gibba043.dnkmem (mgr.34373) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:34 gibba043 bash[24019]: cephadm 2021-03-10T17:42:32.956280+0000 mgr.gibba043.dnkmem (mgr.34373) 12197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:34.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:34 gibba003 bash[31385]: cephadm 2021-03-10T17:42:32.956280+0000 mgr.gibba043.dnkmem (mgr.34373) 12197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:34.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:34 gibba003 bash[32348]: cephadm 2021-03-10T17:42:32.956280+0000 mgr.gibba043.dnkmem (mgr.34373) 12197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:35 gibba043 bash[24019]: cluster 2021-03-10T17:42:33.388526+0000 mgr.gibba043.dnkmem (mgr.34373) 12198 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:35 gibba003 bash[31385]: cluster 2021-03-10T17:42:33.388526+0000 mgr.gibba043.dnkmem (mgr.34373) 12198 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:35 gibba003 bash[32348]: cluster 2021-03-10T17:42:33.388526+0000 mgr.gibba043.dnkmem (mgr.34373) 12198 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:37.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:37 gibba003 bash[31385]: cluster 2021-03-10T17:42:35.390039+0000 mgr.gibba043.dnkmem (mgr.34373) 12199 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:37.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:37 gibba003 bash[32348]: cluster 2021-03-10T17:42:35.390039+0000 mgr.gibba043.dnkmem (mgr.34373) 12199 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:37 gibba043 bash[24019]: cluster 2021-03-10T17:42:35.390039+0000 mgr.gibba043.dnkmem (mgr.34373) 12199 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:39 gibba003 bash[31385]: cluster 2021-03-10T17:42:37.391809+0000 mgr.gibba043.dnkmem (mgr.34373) 12200 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:39 gibba003 bash[32348]: cluster 2021-03-10T17:42:37.391809+0000 mgr.gibba043.dnkmem (mgr.34373) 12200 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:39 gibba043 bash[24019]: cluster 2021-03-10T17:42:37.391809+0000 mgr.gibba043.dnkmem (mgr.34373) 12200 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:41 gibba003 bash[31385]: cluster 2021-03-10T17:42:39.393565+0000 mgr.gibba043.dnkmem (mgr.34373) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:41 gibba003 bash[32348]: cluster 2021-03-10T17:42:39.393565+0000 mgr.gibba043.dnkmem (mgr.34373) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:41 gibba043 bash[24019]: cluster 2021-03-10T17:42:39.393565+0000 mgr.gibba043.dnkmem (mgr.34373) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:43 gibba003 bash[31385]: cluster 2021-03-10T17:42:41.395315+0000 mgr.gibba043.dnkmem (mgr.34373) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:43 gibba003 bash[32348]: cluster 2021-03-10T17:42:41.395315+0000 mgr.gibba043.dnkmem (mgr.34373) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:43 gibba043 bash[24019]: cluster 2021-03-10T17:42:41.395315+0000 mgr.gibba043.dnkmem (mgr.34373) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:45 gibba003 bash[31385]: cluster 2021-03-10T17:42:43.396959+0000 mgr.gibba043.dnkmem (mgr.34373) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:45 gibba003 bash[32348]: cluster 2021-03-10T17:42:43.396959+0000 mgr.gibba043.dnkmem (mgr.34373) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:45 gibba043 bash[24019]: cluster 2021-03-10T17:42:43.396959+0000 mgr.gibba043.dnkmem (mgr.34373) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:47 gibba003 bash[31385]: cluster 2021-03-10T17:42:45.398455+0000 mgr.gibba043.dnkmem (mgr.34373) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:47 gibba003 bash[32348]: cluster 2021-03-10T17:42:45.398455+0000 mgr.gibba043.dnkmem (mgr.34373) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:47 gibba043 bash[24019]: cluster 2021-03-10T17:42:45.398455+0000 mgr.gibba043.dnkmem (mgr.34373) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:49 gibba003 bash[31385]: cluster 2021-03-10T17:42:47.400084+0000 mgr.gibba043.dnkmem (mgr.34373) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:49 gibba003 bash[31385]: cephadm 2021-03-10T17:42:47.972356+0000 mgr.gibba043.dnkmem (mgr.34373) 12206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:49 gibba003 bash[32348]: cluster 2021-03-10T17:42:47.400084+0000 mgr.gibba043.dnkmem (mgr.34373) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:49 gibba003 bash[32348]: cephadm 2021-03-10T17:42:47.972356+0000 mgr.gibba043.dnkmem (mgr.34373) 12206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:49 gibba043 bash[24019]: cluster 2021-03-10T17:42:47.400084+0000 mgr.gibba043.dnkmem (mgr.34373) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:49 gibba043 bash[24019]: cephadm 2021-03-10T17:42:47.972356+0000 mgr.gibba043.dnkmem (mgr.34373) 12206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:42:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:51 gibba003 bash[31385]: cluster 2021-03-10T17:42:49.401886+0000 mgr.gibba043.dnkmem (mgr.34373) 12207 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:51.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:51 gibba003 bash[32348]: cluster 2021-03-10T17:42:49.401886+0000 mgr.gibba043.dnkmem (mgr.34373) 12207 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:51 gibba043 bash[24019]: cluster 2021-03-10T17:42:49.401886+0000 mgr.gibba043.dnkmem (mgr.34373) 12207 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:53 gibba003 bash[31385]: cluster 2021-03-10T17:42:51.403384+0000 mgr.gibba043.dnkmem (mgr.34373) 12208 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:53 gibba003 bash[32348]: cluster 2021-03-10T17:42:51.403384+0000 mgr.gibba043.dnkmem (mgr.34373) 12208 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:53 gibba043 bash[24019]: cluster 2021-03-10T17:42:51.403384+0000 mgr.gibba043.dnkmem (mgr.34373) 12208 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:55 gibba003 bash[31385]: cluster 2021-03-10T17:42:53.405022+0000 mgr.gibba043.dnkmem (mgr.34373) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:55 gibba003 bash[32348]: cluster 2021-03-10T17:42:53.405022+0000 mgr.gibba043.dnkmem (mgr.34373) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:55 gibba043 bash[24019]: cluster 2021-03-10T17:42:53.405022+0000 mgr.gibba043.dnkmem (mgr.34373) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:57 gibba003 bash[31385]: cluster 2021-03-10T17:42:55.406258+0000 mgr.gibba043.dnkmem (mgr.34373) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:57 gibba003 bash[32348]: cluster 2021-03-10T17:42:55.406258+0000 mgr.gibba043.dnkmem (mgr.34373) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:57 gibba043 bash[24019]: cluster 2021-03-10T17:42:55.406258+0000 mgr.gibba043.dnkmem (mgr.34373) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:42:59 gibba003 bash[31385]: cluster 2021-03-10T17:42:57.407797+0000 mgr.gibba043.dnkmem (mgr.34373) 12211 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:42:59 gibba003 bash[32348]: cluster 2021-03-10T17:42:57.407797+0000 mgr.gibba043.dnkmem (mgr.34373) 12211 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:42:59 gibba043 bash[24019]: cluster 2021-03-10T17:42:57.407797+0000 mgr.gibba043.dnkmem (mgr.34373) 12211 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.097 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:43:01.328 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:43:01.328 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:43:01.328 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 103s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:43:01.328 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 103s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:43:01.329 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 103s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:43:01.329 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:43:01.329 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:43:01.329 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 103s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:43:01.330 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:43:01.330 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:43:01.330 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 103s ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:43:01.330 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:43:01.330 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:43:01.331 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:43:01.331 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:43:01.331 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:43:01.331 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:43:01.332 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:43:01.332 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 103s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:43:01.332 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 103s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:43:01.333 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:43:01.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:01 gibba003 bash[31385]: cluster 2021-03-10T17:42:59.409559+0000 mgr.gibba043.dnkmem (mgr.34373) 12212 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:01 gibba003 bash[32348]: cluster 2021-03-10T17:42:59.409559+0000 mgr.gibba043.dnkmem (mgr.34373) 12212 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:01 gibba043 bash[24019]: cluster 2021-03-10T17:42:59.409559+0000 mgr.gibba043.dnkmem (mgr.34373) 12212 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.583 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:43:01.584 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:43:01.584 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:01.584 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:43:01.584 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:43:01.585 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:01.585 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:43:01.585 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:43:01.585 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:43:01.585 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:43:01.586 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:43:01.586 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:43:01.586 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:43:01.586 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:43:01.587 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:43:02.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:02 gibba003 bash[31385]: audit 2021-03-10T17:43:01.086715+0000 mgr.gibba043.dnkmem (mgr.34373) 12213 : audit [DBG] from='client.62230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:02.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:02 gibba003 bash[31385]: audit 2021-03-10T17:43:01.582146+0000 mon.c (mon.1) 3137 : audit [DBG] from='client.? 172.21.2.103:0/26442835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:02 gibba003 bash[32348]: audit 2021-03-10T17:43:01.086715+0000 mgr.gibba043.dnkmem (mgr.34373) 12213 : audit [DBG] from='client.62230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:02.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:02 gibba003 bash[32348]: audit 2021-03-10T17:43:01.582146+0000 mon.c (mon.1) 3137 : audit [DBG] from='client.? 172.21.2.103:0/26442835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:02 gibba043 bash[24019]: audit 2021-03-10T17:43:01.086715+0000 mgr.gibba043.dnkmem (mgr.34373) 12213 : audit [DBG] from='client.62230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:02.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:02 gibba043 bash[24019]: audit 2021-03-10T17:43:01.582146+0000 mon.c (mon.1) 3137 : audit [DBG] from='client.? 172.21.2.103:0/26442835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:03.146 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:03 gibba003 bash[31385]: audit 2021-03-10T17:43:01.313109+0000 mgr.gibba043.dnkmem (mgr.34373) 12214 : audit [DBG] from='client.62236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:03.146 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:03 gibba003 bash[31385]: cluster 2021-03-10T17:43:01.410769+0000 mgr.gibba043.dnkmem (mgr.34373) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:03 gibba043 bash[24019]: audit 2021-03-10T17:43:01.313109+0000 mgr.gibba043.dnkmem (mgr.34373) 12214 : audit [DBG] from='client.62236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:03 gibba043 bash[24019]: cluster 2021-03-10T17:43:01.410769+0000 mgr.gibba043.dnkmem (mgr.34373) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:03 gibba003 bash[32348]: audit 2021-03-10T17:43:01.313109+0000 mgr.gibba043.dnkmem (mgr.34373) 12214 : audit [DBG] from='client.62236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:03.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:03 gibba003 bash[32348]: cluster 2021-03-10T17:43:01.410769+0000 mgr.gibba043.dnkmem (mgr.34373) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:04.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:04 gibba003 bash[31385]: cephadm 2021-03-10T17:43:02.974937+0000 mgr.gibba043.dnkmem (mgr.34373) 12216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:04.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:04 gibba003 bash[32348]: cephadm 2021-03-10T17:43:02.974937+0000 mgr.gibba043.dnkmem (mgr.34373) 12216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:04.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:04 gibba043 bash[24019]: cephadm 2021-03-10T17:43:02.974937+0000 mgr.gibba043.dnkmem (mgr.34373) 12216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:05 gibba003 bash[31385]: cluster 2021-03-10T17:43:03.412414+0000 mgr.gibba043.dnkmem (mgr.34373) 12217 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:05.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:05 gibba003 bash[32348]: cluster 2021-03-10T17:43:03.412414+0000 mgr.gibba043.dnkmem (mgr.34373) 12217 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:05 gibba043 bash[24019]: cluster 2021-03-10T17:43:03.412414+0000 mgr.gibba043.dnkmem (mgr.34373) 12217 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:07 gibba003 bash[31385]: cluster 2021-03-10T17:43:05.413957+0000 mgr.gibba043.dnkmem (mgr.34373) 12218 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:07 gibba003 bash[32348]: cluster 2021-03-10T17:43:05.413957+0000 mgr.gibba043.dnkmem (mgr.34373) 12218 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:07 gibba043 bash[24019]: cluster 2021-03-10T17:43:05.413957+0000 mgr.gibba043.dnkmem (mgr.34373) 12218 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:09 gibba003 bash[31385]: cluster 2021-03-10T17:43:07.415563+0000 mgr.gibba043.dnkmem (mgr.34373) 12219 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:09 gibba003 bash[32348]: cluster 2021-03-10T17:43:07.415563+0000 mgr.gibba043.dnkmem (mgr.34373) 12219 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:09 gibba043 bash[24019]: cluster 2021-03-10T17:43:07.415563+0000 mgr.gibba043.dnkmem (mgr.34373) 12219 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:11 gibba003 bash[31385]: cluster 2021-03-10T17:43:09.417322+0000 mgr.gibba043.dnkmem (mgr.34373) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:11 gibba003 bash[32348]: cluster 2021-03-10T17:43:09.417322+0000 mgr.gibba043.dnkmem (mgr.34373) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:11 gibba043 bash[24019]: cluster 2021-03-10T17:43:09.417322+0000 mgr.gibba043.dnkmem (mgr.34373) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:13 gibba043 bash[24019]: cluster 2021-03-10T17:43:11.419135+0000 mgr.gibba043.dnkmem (mgr.34373) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:13 gibba003 bash[31385]: cluster 2021-03-10T17:43:11.419135+0000 mgr.gibba043.dnkmem (mgr.34373) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:13 gibba003 bash[32348]: cluster 2021-03-10T17:43:11.419135+0000 mgr.gibba043.dnkmem (mgr.34373) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: cluster 2021-03-10T17:43:13.420772+0000 mgr.gibba043.dnkmem (mgr.34373) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.217488+0000 mon.c (mon.1) 3138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.217891+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.470699+0000 mon.c (mon.1) 3139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:15.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.471882+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.881350+0000 mon.c (mon.1) 3140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:43:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.882118+0000 mon.c (mon.1) 3141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.882522+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:43:15.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.882864+0000 mon.c (mon.1) 3142 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:43:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.883747+0000 mon.c (mon.1) 3143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.883850+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.885203+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:43:15.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:15 gibba043 bash[24019]: audit 2021-03-10T17:43:14.886160+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: cluster 2021-03-10T17:43:13.420772+0000 mgr.gibba043.dnkmem (mgr.34373) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.217488+0000 mon.c (mon.1) 3138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:15.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.217891+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.470699+0000 mon.c (mon.1) 3139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.471882+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.881350+0000 mon.c (mon.1) 3140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:43:15.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.882118+0000 mon.c (mon.1) 3141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.882522+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:43:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.882864+0000 mon.c (mon.1) 3142 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:43:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.883747+0000 mon.c (mon.1) 3143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.883850+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.885203+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:43:15.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[31385]: audit 2021-03-10T17:43:14.886160+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.696 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: cluster 2021-03-10T17:43:13.420772+0000 mgr.gibba043.dnkmem (mgr.34373) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.217488+0000 mon.c (mon.1) 3138 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.217891+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.470699+0000 mon.c (mon.1) 3139 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:15.697 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.471882+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.881350+0000 mon.c (mon.1) 3140 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:43:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.882118+0000 mon.c (mon.1) 3141 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.882522+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:43:15.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.882864+0000 mon.c (mon.1) 3142 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:43:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.883747+0000 mon.c (mon.1) 3143 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.883850+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:43:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.885203+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:43:15.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:15 gibba003 bash[32348]: audit 2021-03-10T17:43:14.886160+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:43:17.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:17 gibba043 bash[24019]: cluster 2021-03-10T17:43:15.422237+0000 mgr.gibba043.dnkmem (mgr.34373) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:17.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:17 gibba003 bash[31385]: cluster 2021-03-10T17:43:15.422237+0000 mgr.gibba043.dnkmem (mgr.34373) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:17.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:17 gibba003 bash[32348]: cluster 2021-03-10T17:43:15.422237+0000 mgr.gibba043.dnkmem (mgr.34373) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cluster 2021-03-10T17:43:17.423922+0000 mgr.gibba043.dnkmem (mgr.34373) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:17.991715+0000 mgr.gibba043.dnkmem (mgr.34373) 12225 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:43:19.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:17.993361+0000 mgr.gibba043.dnkmem (mgr.34373) 12226 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:43:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.205926+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:43:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.207898+0000 mgr.gibba043.dnkmem (mgr.34373) 12227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.209929+0000 mon.c (mon.1) 3144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:19.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.210185+0000 mgr.gibba043.dnkmem (mgr.34373) 12228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.211654+0000 mgr.gibba043.dnkmem (mgr.34373) 12229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.211764+0000 mgr.gibba043.dnkmem (mgr.34373) 12230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.212027+0000 mon.c (mon.1) 3145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.213445+0000 mon.c (mon.1) 3146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.215488+0000 mgr.gibba043.dnkmem (mgr.34373) 12231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.215525+0000 mgr.gibba043.dnkmem (mgr.34373) 12232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.217180+0000 mon.c (mon.1) 3147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.220801+0000 mgr.gibba043.dnkmem (mgr.34373) 12233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:19.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.222237+0000 mgr.gibba043.dnkmem (mgr.34373) 12234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.222278+0000 mgr.gibba043.dnkmem (mgr.34373) 12235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.223500+0000 mgr.gibba043.dnkmem (mgr.34373) 12236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.223884+0000 mon.c (mon.1) 3148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.223948+0000 mgr.gibba043.dnkmem (mgr.34373) 12237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:19.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.225114+0000 mgr.gibba043.dnkmem (mgr.34373) 12238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:19.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.225159+0000 mgr.gibba043.dnkmem (mgr.34373) 12239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:19.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: cephadm 2021-03-10T17:43:18.225290+0000 mgr.gibba043.dnkmem (mgr.34373) 12240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:19.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:19 gibba043 bash[24019]: audit 2021-03-10T17:43:18.225391+0000 mon.c (mon.1) 3149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cluster 2021-03-10T17:43:17.423922+0000 mgr.gibba043.dnkmem (mgr.34373) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:19.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:17.991715+0000 mgr.gibba043.dnkmem (mgr.34373) 12225 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:43:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:17.993361+0000 mgr.gibba043.dnkmem (mgr.34373) 12226 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:43:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.205926+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:43:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.207898+0000 mgr.gibba043.dnkmem (mgr.34373) 12227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.209929+0000 mon.c (mon.1) 3144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:19.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.210185+0000 mgr.gibba043.dnkmem (mgr.34373) 12228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:19.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.211654+0000 mgr.gibba043.dnkmem (mgr.34373) 12229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:19.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.211764+0000 mgr.gibba043.dnkmem (mgr.34373) 12230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:19.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.212027+0000 mon.c (mon.1) 3145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.695 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.213445+0000 mon.c (mon.1) 3146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.215488+0000 mgr.gibba043.dnkmem (mgr.34373) 12231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:19.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.215525+0000 mgr.gibba043.dnkmem (mgr.34373) 12232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:19.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.217180+0000 mon.c (mon.1) 3147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.220801+0000 mgr.gibba043.dnkmem (mgr.34373) 12233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:19.696 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.222237+0000 mgr.gibba043.dnkmem (mgr.34373) 12234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:19.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.222278+0000 mgr.gibba043.dnkmem (mgr.34373) 12235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:19.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.223500+0000 mgr.gibba043.dnkmem (mgr.34373) 12236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:19.697 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.223884+0000 mon.c (mon.1) 3148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.223948+0000 mgr.gibba043.dnkmem (mgr.34373) 12237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:19.698 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.225114+0000 mgr.gibba043.dnkmem (mgr.34373) 12238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:19.698 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cluster 2021-03-10T17:43:17.423922+0000 mgr.gibba043.dnkmem (mgr.34373) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:17.991715+0000 mgr.gibba043.dnkmem (mgr.34373) 12225 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:43:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:17.993361+0000 mgr.gibba043.dnkmem (mgr.34373) 12226 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:43:19.699 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.205926+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.207898+0000 mgr.gibba043.dnkmem (mgr.34373) 12227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.209929+0000 mon.c (mon.1) 3144 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.210185+0000 mgr.gibba043.dnkmem (mgr.34373) 12228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.211654+0000 mgr.gibba043.dnkmem (mgr.34373) 12229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.211764+0000 mgr.gibba043.dnkmem (mgr.34373) 12230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:19.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.212027+0000 mon.c (mon.1) 3145 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.213445+0000 mon.c (mon.1) 3146 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.215488+0000 mgr.gibba043.dnkmem (mgr.34373) 12231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:19.701 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.215525+0000 mgr.gibba043.dnkmem (mgr.34373) 12232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:19.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.217180+0000 mon.c (mon.1) 3147 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.220801+0000 mgr.gibba043.dnkmem (mgr.34373) 12233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:19.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.222237+0000 mgr.gibba043.dnkmem (mgr.34373) 12234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:19.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.222278+0000 mgr.gibba043.dnkmem (mgr.34373) 12235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:19.702 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.223500+0000 mgr.gibba043.dnkmem (mgr.34373) 12236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:19.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.223884+0000 mon.c (mon.1) 3148 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.223948+0000 mgr.gibba043.dnkmem (mgr.34373) 12237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:19.703 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.225114+0000 mgr.gibba043.dnkmem (mgr.34373) 12238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:19.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.225159+0000 mgr.gibba043.dnkmem (mgr.34373) 12239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:19.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: cephadm 2021-03-10T17:43:18.225290+0000 mgr.gibba043.dnkmem (mgr.34373) 12240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:19.704 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[31385]: audit 2021-03-10T17:43:18.225391+0000 mon.c (mon.1) 3149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.225159+0000 mgr.gibba043.dnkmem (mgr.34373) 12239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:19.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: cephadm 2021-03-10T17:43:18.225290+0000 mgr.gibba043.dnkmem (mgr.34373) 12240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:19.705 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:19 gibba003 bash[32348]: audit 2021-03-10T17:43:18.225391+0000 mon.c (mon.1) 3149 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:21 gibba043 bash[24019]: cluster 2021-03-10T17:43:19.425423+0000 mgr.gibba043.dnkmem (mgr.34373) 12241 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:21.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:21 gibba003 bash[31385]: cluster 2021-03-10T17:43:19.425423+0000 mgr.gibba043.dnkmem (mgr.34373) 12241 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:21.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:21 gibba003 bash[32348]: cluster 2021-03-10T17:43:19.425423+0000 mgr.gibba043.dnkmem (mgr.34373) 12241 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:23 gibba043 bash[24019]: cluster 2021-03-10T17:43:21.427222+0000 mgr.gibba043.dnkmem (mgr.34373) 12242 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:23.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:23 gibba003 bash[31385]: cluster 2021-03-10T17:43:21.427222+0000 mgr.gibba043.dnkmem (mgr.34373) 12242 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:23.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:23 gibba003 bash[32348]: cluster 2021-03-10T17:43:21.427222+0000 mgr.gibba043.dnkmem (mgr.34373) 12242 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:25 gibba043 bash[24019]: cluster 2021-03-10T17:43:23.428835+0000 mgr.gibba043.dnkmem (mgr.34373) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:25.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:25 gibba003 bash[31385]: cluster 2021-03-10T17:43:23.428835+0000 mgr.gibba043.dnkmem (mgr.34373) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:25.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:25 gibba003 bash[32348]: cluster 2021-03-10T17:43:23.428835+0000 mgr.gibba043.dnkmem (mgr.34373) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:27 gibba043 bash[24019]: cluster 2021-03-10T17:43:25.430330+0000 mgr.gibba043.dnkmem (mgr.34373) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:27 gibba003 bash[31385]: cluster 2021-03-10T17:43:25.430330+0000 mgr.gibba043.dnkmem (mgr.34373) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:27 gibba003 bash[32348]: cluster 2021-03-10T17:43:25.430330+0000 mgr.gibba043.dnkmem (mgr.34373) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:29 gibba043 bash[24019]: cluster 2021-03-10T17:43:27.431852+0000 mgr.gibba043.dnkmem (mgr.34373) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:29 gibba003 bash[31385]: cluster 2021-03-10T17:43:27.431852+0000 mgr.gibba043.dnkmem (mgr.34373) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:29 gibba003 bash[32348]: cluster 2021-03-10T17:43:27.431852+0000 mgr.gibba043.dnkmem (mgr.34373) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:31 gibba043 bash[24019]: cluster 2021-03-10T17:43:29.433440+0000 mgr.gibba043.dnkmem (mgr.34373) 12246 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:31 gibba003 bash[31385]: cluster 2021-03-10T17:43:29.433440+0000 mgr.gibba043.dnkmem (mgr.34373) 12246 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:31 gibba003 bash[32348]: cluster 2021-03-10T17:43:29.433440+0000 mgr.gibba043.dnkmem (mgr.34373) 12246 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.830 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:43:32.060 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:43:32.060 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:43:32.060 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:43:32.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:43:32.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:43:32.061 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:43:32.061 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:43:32.062 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:43:32.062 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:43:32.062 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:43:32.062 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:43:32.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:43:32.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:43:32.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:43:32.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:43:32.063 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:43:32.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:43:32.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:43:32.064 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:43:32.064 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:43:32.065 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:43:32.313 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:43:32.313 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:43:32.313 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:32.314 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:43:32.314 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:43:32.314 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:32.314 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:43:32.315 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:43:32.315 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:43:32.315 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:43:32.315 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:43:32.316 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:43:32.316 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:43:32.316 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:43:32.316 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:43:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:33 gibba043 bash[24019]: cluster 2021-03-10T17:43:31.435087+0000 mgr.gibba043.dnkmem (mgr.34373) 12247 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:33 gibba043 bash[24019]: audit 2021-03-10T17:43:31.818584+0000 mgr.gibba043.dnkmem (mgr.34373) 12248 : audit [DBG] from='client.62248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:33 gibba043 bash[24019]: audit 2021-03-10T17:43:32.045863+0000 mgr.gibba043.dnkmem (mgr.34373) 12249 : audit [DBG] from='client.62254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:33.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:33 gibba043 bash[24019]: audit 2021-03-10T17:43:32.311702+0000 mon.a (mon.0) 2410 : audit [DBG] from='client.? 172.21.2.103:0/1915090073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:33.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[31385]: cluster 2021-03-10T17:43:31.435087+0000 mgr.gibba043.dnkmem (mgr.34373) 12247 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[31385]: audit 2021-03-10T17:43:31.818584+0000 mgr.gibba043.dnkmem (mgr.34373) 12248 : audit [DBG] from='client.62248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[31385]: audit 2021-03-10T17:43:32.045863+0000 mgr.gibba043.dnkmem (mgr.34373) 12249 : audit [DBG] from='client.62254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:33.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[31385]: audit 2021-03-10T17:43:32.311702+0000 mon.a (mon.0) 2410 : audit [DBG] from='client.? 172.21.2.103:0/1915090073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[32348]: cluster 2021-03-10T17:43:31.435087+0000 mgr.gibba043.dnkmem (mgr.34373) 12247 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[32348]: audit 2021-03-10T17:43:31.818584+0000 mgr.gibba043.dnkmem (mgr.34373) 12248 : audit [DBG] from='client.62248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[32348]: audit 2021-03-10T17:43:32.045863+0000 mgr.gibba043.dnkmem (mgr.34373) 12249 : audit [DBG] from='client.62254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:33.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:33 gibba003 bash[32348]: audit 2021-03-10T17:43:32.311702+0000 mon.a (mon.0) 2410 : audit [DBG] from='client.? 172.21.2.103:0/1915090073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:34.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:34 gibba003 bash[31385]: cephadm 2021-03-10T17:43:33.241155+0000 mgr.gibba043.dnkmem (mgr.34373) 12250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:34.865 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:34 gibba003 bash[32348]: cephadm 2021-03-10T17:43:33.241155+0000 mgr.gibba043.dnkmem (mgr.34373) 12250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:34.866 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:34 gibba043 bash[24019]: cephadm 2021-03-10T17:43:33.241155+0000 mgr.gibba043.dnkmem (mgr.34373) 12250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:35.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:35 gibba003 bash[31385]: cluster 2021-03-10T17:43:33.436608+0000 mgr.gibba043.dnkmem (mgr.34373) 12251 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:35 gibba003 bash[32348]: cluster 2021-03-10T17:43:33.436608+0000 mgr.gibba043.dnkmem (mgr.34373) 12251 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:35.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:35 gibba043 bash[24019]: cluster 2021-03-10T17:43:33.436608+0000 mgr.gibba043.dnkmem (mgr.34373) 12251 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:37 gibba003 bash[31385]: cluster 2021-03-10T17:43:35.437870+0000 mgr.gibba043.dnkmem (mgr.34373) 12252 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:37 gibba003 bash[32348]: cluster 2021-03-10T17:43:35.437870+0000 mgr.gibba043.dnkmem (mgr.34373) 12252 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:37 gibba043 bash[24019]: cluster 2021-03-10T17:43:35.437870+0000 mgr.gibba043.dnkmem (mgr.34373) 12252 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:39 gibba003 bash[31385]: cluster 2021-03-10T17:43:37.439381+0000 mgr.gibba043.dnkmem (mgr.34373) 12253 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:39 gibba003 bash[32348]: cluster 2021-03-10T17:43:37.439381+0000 mgr.gibba043.dnkmem (mgr.34373) 12253 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:39 gibba043 bash[24019]: cluster 2021-03-10T17:43:37.439381+0000 mgr.gibba043.dnkmem (mgr.34373) 12253 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:41 gibba003 bash[31385]: cluster 2021-03-10T17:43:39.441068+0000 mgr.gibba043.dnkmem (mgr.34373) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:41 gibba003 bash[32348]: cluster 2021-03-10T17:43:39.441068+0000 mgr.gibba043.dnkmem (mgr.34373) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:41 gibba043 bash[24019]: cluster 2021-03-10T17:43:39.441068+0000 mgr.gibba043.dnkmem (mgr.34373) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:43 gibba003 bash[31385]: cluster 2021-03-10T17:43:41.442577+0000 mgr.gibba043.dnkmem (mgr.34373) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:43 gibba003 bash[32348]: cluster 2021-03-10T17:43:41.442577+0000 mgr.gibba043.dnkmem (mgr.34373) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:43 gibba043 bash[24019]: cluster 2021-03-10T17:43:41.442577+0000 mgr.gibba043.dnkmem (mgr.34373) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:45 gibba003 bash[31385]: cluster 2021-03-10T17:43:43.444288+0000 mgr.gibba043.dnkmem (mgr.34373) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:45 gibba003 bash[32348]: cluster 2021-03-10T17:43:43.444288+0000 mgr.gibba043.dnkmem (mgr.34373) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:45.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:45 gibba043 bash[24019]: cluster 2021-03-10T17:43:43.444288+0000 mgr.gibba043.dnkmem (mgr.34373) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:46.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:46 gibba003 bash[31385]: cluster 2021-03-10T17:43:45.445537+0000 mgr.gibba043.dnkmem (mgr.34373) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:46.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:46 gibba003 bash[32348]: cluster 2021-03-10T17:43:45.445537+0000 mgr.gibba043.dnkmem (mgr.34373) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:46.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:46 gibba043 bash[24019]: cluster 2021-03-10T17:43:45.445537+0000 mgr.gibba043.dnkmem (mgr.34373) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:48 gibba043 bash[24019]: cluster 2021-03-10T17:43:47.447046+0000 mgr.gibba043.dnkmem (mgr.34373) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:48 gibba043 bash[24019]: cephadm 2021-03-10T17:43:48.256604+0000 mgr.gibba043.dnkmem (mgr.34373) 12259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:48.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:48 gibba003 bash[31385]: cluster 2021-03-10T17:43:47.447046+0000 mgr.gibba043.dnkmem (mgr.34373) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:48 gibba003 bash[31385]: cephadm 2021-03-10T17:43:48.256604+0000 mgr.gibba043.dnkmem (mgr.34373) 12259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:48.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:48 gibba003 bash[32348]: cluster 2021-03-10T17:43:47.447046+0000 mgr.gibba043.dnkmem (mgr.34373) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:48 gibba003 bash[32348]: cephadm 2021-03-10T17:43:48.256604+0000 mgr.gibba043.dnkmem (mgr.34373) 12259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:43:50.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:50 gibba003 bash[31385]: cluster 2021-03-10T17:43:49.448737+0000 mgr.gibba043.dnkmem (mgr.34373) 12260 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:50.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:50 gibba003 bash[32348]: cluster 2021-03-10T17:43:49.448737+0000 mgr.gibba043.dnkmem (mgr.34373) 12260 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:51.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:50 gibba043 bash[24019]: cluster 2021-03-10T17:43:49.448737+0000 mgr.gibba043.dnkmem (mgr.34373) 12260 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:52.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:52 gibba003 bash[31385]: cluster 2021-03-10T17:43:51.450160+0000 mgr.gibba043.dnkmem (mgr.34373) 12261 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:52.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:52 gibba003 bash[32348]: cluster 2021-03-10T17:43:51.450160+0000 mgr.gibba043.dnkmem (mgr.34373) 12261 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:53.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:52 gibba043 bash[24019]: cluster 2021-03-10T17:43:51.450160+0000 mgr.gibba043.dnkmem (mgr.34373) 12261 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:54.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:54 gibba003 bash[31385]: cluster 2021-03-10T17:43:53.451567+0000 mgr.gibba043.dnkmem (mgr.34373) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:54.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:54 gibba003 bash[32348]: cluster 2021-03-10T17:43:53.451567+0000 mgr.gibba043.dnkmem (mgr.34373) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:55.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:54 gibba043 bash[24019]: cluster 2021-03-10T17:43:53.451567+0000 mgr.gibba043.dnkmem (mgr.34373) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:56.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:56 gibba003 bash[31385]: cluster 2021-03-10T17:43:55.452893+0000 mgr.gibba043.dnkmem (mgr.34373) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:56.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:56 gibba003 bash[32348]: cluster 2021-03-10T17:43:55.452893+0000 mgr.gibba043.dnkmem (mgr.34373) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:57.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:56 gibba043 bash[24019]: cluster 2021-03-10T17:43:55.452893+0000 mgr.gibba043.dnkmem (mgr.34373) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:58.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:43:58 gibba003 bash[31385]: cluster 2021-03-10T17:43:57.454391+0000 mgr.gibba043.dnkmem (mgr.34373) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:58.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:43:58 gibba003 bash[32348]: cluster 2021-03-10T17:43:57.454391+0000 mgr.gibba043.dnkmem (mgr.34373) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:59.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:43:58 gibba043 bash[24019]: cluster 2021-03-10T17:43:57.454391+0000 mgr.gibba043.dnkmem (mgr.34373) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:00.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:00 gibba003 bash[31385]: cluster 2021-03-10T17:43:59.456078+0000 mgr.gibba043.dnkmem (mgr.34373) 12265 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:00.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:00 gibba003 bash[32348]: cluster 2021-03-10T17:43:59.456078+0000 mgr.gibba043.dnkmem (mgr.34373) 12265 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:01.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:00 gibba043 bash[24019]: cluster 2021-03-10T17:43:59.456078+0000 mgr.gibba043.dnkmem (mgr.34373) 12265 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:02.553 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:44:02.785 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:44:02.785 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:44:02.785 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:44:02.786 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:44:02.786 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:44:02.786 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:44:02.786 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:44:02.786 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:44:02.787 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:44:02.787 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:44:02.787 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:44:02.787 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:44:02.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:44:02.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:44:02.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:44:02.788 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:44:02.789 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:44:02.789 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:44:02.789 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:44:02.789 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:44:02.789 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:44:02.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:02 gibba003 bash[31385]: cluster 2021-03-10T17:44:01.456698+0000 mgr.gibba043.dnkmem (mgr.34373) 12266 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:02.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:02 gibba003 bash[32348]: cluster 2021-03-10T17:44:01.456698+0000 mgr.gibba043.dnkmem (mgr.34373) 12266 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:03.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:02 gibba043 bash[24019]: cluster 2021-03-10T17:44:01.456698+0000 mgr.gibba043.dnkmem (mgr.34373) 12266 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:03.036 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:44:03.036 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:44:03.037 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:03.037 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:44:03.038 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:44:03.038 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:03.039 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:44:03.039 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:44:03.039 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:44:03.040 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:44:03.040 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:44:03.041 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:44:03.041 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:44:03.042 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:44:03.042 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:44:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[31385]: audit 2021-03-10T17:44:02.541667+0000 mgr.gibba043.dnkmem (mgr.34373) 12267 : audit [DBG] from='client.62266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[31385]: audit 2021-03-10T17:44:02.770167+0000 mgr.gibba043.dnkmem (mgr.34373) 12268 : audit [DBG] from='client.52281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:03.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[31385]: audit 2021-03-10T17:44:03.034541+0000 mon.c (mon.1) 3150 : audit [DBG] from='client.? 172.21.2.103:0/2985537145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:03.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[31385]: cephadm 2021-03-10T17:44:03.272569+0000 mgr.gibba043.dnkmem (mgr.34373) 12269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:03.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[32348]: audit 2021-03-10T17:44:02.541667+0000 mgr.gibba043.dnkmem (mgr.34373) 12267 : audit [DBG] from='client.62266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:03.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[32348]: audit 2021-03-10T17:44:02.770167+0000 mgr.gibba043.dnkmem (mgr.34373) 12268 : audit [DBG] from='client.52281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:03.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[32348]: audit 2021-03-10T17:44:03.034541+0000 mon.c (mon.1) 3150 : audit [DBG] from='client.? 172.21.2.103:0/2985537145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:03.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:03 gibba003 bash[32348]: cephadm 2021-03-10T17:44:03.272569+0000 mgr.gibba043.dnkmem (mgr.34373) 12269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:03 gibba043 bash[24019]: audit 2021-03-10T17:44:02.541667+0000 mgr.gibba043.dnkmem (mgr.34373) 12267 : audit [DBG] from='client.62266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:03 gibba043 bash[24019]: audit 2021-03-10T17:44:02.770167+0000 mgr.gibba043.dnkmem (mgr.34373) 12268 : audit [DBG] from='client.52281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:04.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:03 gibba043 bash[24019]: audit 2021-03-10T17:44:03.034541+0000 mon.c (mon.1) 3150 : audit [DBG] from='client.? 172.21.2.103:0/2985537145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:04.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:03 gibba043 bash[24019]: cephadm 2021-03-10T17:44:03.272569+0000 mgr.gibba043.dnkmem (mgr.34373) 12269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:04.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:04 gibba003 bash[31385]: cluster 2021-03-10T17:44:03.457945+0000 mgr.gibba043.dnkmem (mgr.34373) 12270 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:04.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:04 gibba003 bash[32348]: cluster 2021-03-10T17:44:03.457945+0000 mgr.gibba043.dnkmem (mgr.34373) 12270 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:05.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:04 gibba043 bash[24019]: cluster 2021-03-10T17:44:03.457945+0000 mgr.gibba043.dnkmem (mgr.34373) 12270 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:06.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:06 gibba003 bash[31385]: cluster 2021-03-10T17:44:05.459126+0000 mgr.gibba043.dnkmem (mgr.34373) 12271 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:06.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:06 gibba003 bash[32348]: cluster 2021-03-10T17:44:05.459126+0000 mgr.gibba043.dnkmem (mgr.34373) 12271 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:06 gibba043 bash[24019]: cluster 2021-03-10T17:44:05.459126+0000 mgr.gibba043.dnkmem (mgr.34373) 12271 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:08.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:08 gibba003 bash[31385]: cluster 2021-03-10T17:44:07.460810+0000 mgr.gibba043.dnkmem (mgr.34373) 12272 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:08.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:08 gibba003 bash[32348]: cluster 2021-03-10T17:44:07.460810+0000 mgr.gibba043.dnkmem (mgr.34373) 12272 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:09.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:08 gibba043 bash[24019]: cluster 2021-03-10T17:44:07.460810+0000 mgr.gibba043.dnkmem (mgr.34373) 12272 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:10.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:10 gibba003 bash[31385]: cluster 2021-03-10T17:44:09.462455+0000 mgr.gibba043.dnkmem (mgr.34373) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:10.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:10 gibba003 bash[32348]: cluster 2021-03-10T17:44:09.462455+0000 mgr.gibba043.dnkmem (mgr.34373) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:11.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:10 gibba043 bash[24019]: cluster 2021-03-10T17:44:09.462455+0000 mgr.gibba043.dnkmem (mgr.34373) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:12.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:12 gibba003 bash[31385]: cluster 2021-03-10T17:44:11.463348+0000 mgr.gibba043.dnkmem (mgr.34373) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:12.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:12 gibba003 bash[32348]: cluster 2021-03-10T17:44:11.463348+0000 mgr.gibba043.dnkmem (mgr.34373) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:13.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:12 gibba043 bash[24019]: cluster 2021-03-10T17:44:11.463348+0000 mgr.gibba043.dnkmem (mgr.34373) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:14 gibba043 bash[24019]: cluster 2021-03-10T17:44:13.464771+0000 mgr.gibba043.dnkmem (mgr.34373) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:14 gibba043 bash[24019]: audit 2021-03-10T17:44:14.223162+0000 mon.c (mon.1) 3151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:14 gibba043 bash[24019]: audit 2021-03-10T17:44:14.224499+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:14 gibba043 bash[24019]: audit 2021-03-10T17:44:14.476439+0000 mon.c (mon.1) 3152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:14 gibba043 bash[24019]: audit 2021-03-10T17:44:14.477698+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[31385]: cluster 2021-03-10T17:44:13.464771+0000 mgr.gibba043.dnkmem (mgr.34373) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[31385]: audit 2021-03-10T17:44:14.223162+0000 mon.c (mon.1) 3151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[31385]: audit 2021-03-10T17:44:14.224499+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:15.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[31385]: audit 2021-03-10T17:44:14.476439+0000 mon.c (mon.1) 3152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:15.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[31385]: audit 2021-03-10T17:44:14.477698+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[32348]: cluster 2021-03-10T17:44:13.464771+0000 mgr.gibba043.dnkmem (mgr.34373) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[32348]: audit 2021-03-10T17:44:14.223162+0000 mon.c (mon.1) 3151 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[32348]: audit 2021-03-10T17:44:14.224499+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[32348]: audit 2021-03-10T17:44:14.476439+0000 mon.c (mon.1) 3152 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:15.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:14 gibba003 bash[32348]: audit 2021-03-10T17:44:14.477698+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.891891+0000 mon.c (mon.1) 3153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:44:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.892674+0000 mon.c (mon.1) 3154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.893130+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:44:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.893359+0000 mon.c (mon.1) 3155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:44:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.894035+0000 mon.c (mon.1) 3156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.894753+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.895821+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:44:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:15 gibba043 bash[24019]: audit 2021-03-10T17:44:14.896618+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.891891+0000 mon.c (mon.1) 3153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:44:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.892674+0000 mon.c (mon.1) 3154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.893130+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:44:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.893359+0000 mon.c (mon.1) 3155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:44:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.894035+0000 mon.c (mon.1) 3156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.894753+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.895821+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:44:16.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[31385]: audit 2021-03-10T17:44:14.896618+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.891891+0000 mon.c (mon.1) 3153 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:44:16.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.892674+0000 mon.c (mon.1) 3154 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.893130+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:44:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.893359+0000 mon.c (mon.1) 3155 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:44:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.894035+0000 mon.c (mon.1) 3156 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.894753+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:44:16.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.895821+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:44:16.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:15 gibba003 bash[32348]: audit 2021-03-10T17:44:14.896618+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:44:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:16 gibba043 bash[24019]: cluster 2021-03-10T17:44:15.466182+0000 mgr.gibba043.dnkmem (mgr.34373) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:17.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:16 gibba003 bash[31385]: cluster 2021-03-10T17:44:15.466182+0000 mgr.gibba043.dnkmem (mgr.34373) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:17.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:16 gibba003 bash[32348]: cluster 2021-03-10T17:44:15.466182+0000 mgr.gibba043.dnkmem (mgr.34373) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:18.773 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: cluster 2021-03-10T17:44:17.467590+0000 mgr.gibba043.dnkmem (mgr.34373) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.286124+0000 mgr.gibba043.dnkmem (mgr.34373) 12278 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:44:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.287435+0000 mgr.gibba043.dnkmem (mgr.34373) 12279 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:44:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.502191+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:44:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.505950+0000 mon.c (mon.1) 3157 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:18.774 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.507386+0000 mon.c (mon.1) 3158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.508973+0000 mon.c (mon.1) 3159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.510636+0000 mon.c (mon.1) 3160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.513999+0000 mon.c (mon.1) 3161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:18.775 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:18 gibba043 bash[24019]: audit 2021-03-10T17:44:18.516043+0000 mon.c (mon.1) 3162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: cluster 2021-03-10T17:44:17.467590+0000 mgr.gibba043.dnkmem (mgr.34373) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.286124+0000 mgr.gibba043.dnkmem (mgr.34373) 12278 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:44:19.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.287435+0000 mgr.gibba043.dnkmem (mgr.34373) 12279 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:44:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.502191+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:44:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.505950+0000 mon.c (mon.1) 3157 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.507386+0000 mon.c (mon.1) 3158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.508973+0000 mon.c (mon.1) 3159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.510636+0000 mon.c (mon.1) 3160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.513999+0000 mon.c (mon.1) 3161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[31385]: audit 2021-03-10T17:44:18.516043+0000 mon.c (mon.1) 3162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.195 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: cluster 2021-03-10T17:44:17.467590+0000 mgr.gibba043.dnkmem (mgr.34373) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.286124+0000 mgr.gibba043.dnkmem (mgr.34373) 12278 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:44:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.287435+0000 mgr.gibba043.dnkmem (mgr.34373) 12279 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:44:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.502191+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:44:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.505950+0000 mon.c (mon.1) 3157 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:19.196 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.507386+0000 mon.c (mon.1) 3158 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.508973+0000 mon.c (mon.1) 3159 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.510636+0000 mon.c (mon.1) 3160 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.513999+0000 mon.c (mon.1) 3161 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:19.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:18 gibba003 bash[32348]: audit 2021-03-10T17:44:18.516043+0000 mon.c (mon.1) 3162 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:20.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.504043+0000 mgr.gibba043.dnkmem (mgr.34373) 12280 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.505874+0000 mgr.gibba043.dnkmem (mgr.34373) 12281 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.507268+0000 mgr.gibba043.dnkmem (mgr.34373) 12282 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.507306+0000 mgr.gibba043.dnkmem (mgr.34373) 12283 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:20.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.508992+0000 mgr.gibba043.dnkmem (mgr.34373) 12284 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.509029+0000 mgr.gibba043.dnkmem (mgr.34373) 12285 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.510464+0000 mgr.gibba043.dnkmem (mgr.34373) 12286 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.512338+0000 mgr.gibba043.dnkmem (mgr.34373) 12287 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.512379+0000 mgr.gibba043.dnkmem (mgr.34373) 12288 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:20.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.513870+0000 mgr.gibba043.dnkmem (mgr.34373) 12289 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:20.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.514311+0000 mgr.gibba043.dnkmem (mgr.34373) 12290 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:20.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.516043+0000 mgr.gibba043.dnkmem (mgr.34373) 12291 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:20.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.516089+0000 mgr.gibba043.dnkmem (mgr.34373) 12292 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:20.026 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:19 gibba043 bash[24019]: cephadm 2021-03-10T17:44:18.516219+0000 mgr.gibba043.dnkmem (mgr.34373) 12293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.504043+0000 mgr.gibba043.dnkmem (mgr.34373) 12280 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:20.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.505874+0000 mgr.gibba043.dnkmem (mgr.34373) 12281 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.507268+0000 mgr.gibba043.dnkmem (mgr.34373) 12282 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.507306+0000 mgr.gibba043.dnkmem (mgr.34373) 12283 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.508992+0000 mgr.gibba043.dnkmem (mgr.34373) 12284 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:20.194 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.509029+0000 mgr.gibba043.dnkmem (mgr.34373) 12285 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:20.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.510464+0000 mgr.gibba043.dnkmem (mgr.34373) 12286 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:20.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.512338+0000 mgr.gibba043.dnkmem (mgr.34373) 12287 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:20.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.512379+0000 mgr.gibba043.dnkmem (mgr.34373) 12288 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:20.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.513870+0000 mgr.gibba043.dnkmem (mgr.34373) 12289 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:20.195 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.514311+0000 mgr.gibba043.dnkmem (mgr.34373) 12290 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:20.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.516043+0000 mgr.gibba043.dnkmem (mgr.34373) 12291 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:20.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.516089+0000 mgr.gibba043.dnkmem (mgr.34373) 12292 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:20.196 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[31385]: cephadm 2021-03-10T17:44:18.516219+0000 mgr.gibba043.dnkmem (mgr.34373) 12293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.504043+0000 mgr.gibba043.dnkmem (mgr.34373) 12280 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.505874+0000 mgr.gibba043.dnkmem (mgr.34373) 12281 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.507268+0000 mgr.gibba043.dnkmem (mgr.34373) 12282 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.507306+0000 mgr.gibba043.dnkmem (mgr.34373) 12283 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:20.197 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.508992+0000 mgr.gibba043.dnkmem (mgr.34373) 12284 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.509029+0000 mgr.gibba043.dnkmem (mgr.34373) 12285 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.510464+0000 mgr.gibba043.dnkmem (mgr.34373) 12286 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.512338+0000 mgr.gibba043.dnkmem (mgr.34373) 12287 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:20.198 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.512379+0000 mgr.gibba043.dnkmem (mgr.34373) 12288 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.513870+0000 mgr.gibba043.dnkmem (mgr.34373) 12289 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.514311+0000 mgr.gibba043.dnkmem (mgr.34373) 12290 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.516043+0000 mgr.gibba043.dnkmem (mgr.34373) 12291 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:20.199 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.516089+0000 mgr.gibba043.dnkmem (mgr.34373) 12292 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:20.200 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:19 gibba003 bash[32348]: cephadm 2021-03-10T17:44:18.516219+0000 mgr.gibba043.dnkmem (mgr.34373) 12293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:21.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:20 gibba043 bash[24019]: cluster 2021-03-10T17:44:19.469416+0000 mgr.gibba043.dnkmem (mgr.34373) 12294 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:21.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:20 gibba003 bash[31385]: cluster 2021-03-10T17:44:19.469416+0000 mgr.gibba043.dnkmem (mgr.34373) 12294 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:21.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:20 gibba003 bash[32348]: cluster 2021-03-10T17:44:19.469416+0000 mgr.gibba043.dnkmem (mgr.34373) 12294 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:23.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:22 gibba043 bash[24019]: cluster 2021-03-10T17:44:21.471135+0000 mgr.gibba043.dnkmem (mgr.34373) 12295 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:23.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:22 gibba003 bash[31385]: cluster 2021-03-10T17:44:21.471135+0000 mgr.gibba043.dnkmem (mgr.34373) 12295 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:23.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:22 gibba003 bash[32348]: cluster 2021-03-10T17:44:21.471135+0000 mgr.gibba043.dnkmem (mgr.34373) 12295 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:25.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:24 gibba043 bash[24019]: cluster 2021-03-10T17:44:23.472771+0000 mgr.gibba043.dnkmem (mgr.34373) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:25.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:24 gibba003 bash[31385]: cluster 2021-03-10T17:44:23.472771+0000 mgr.gibba043.dnkmem (mgr.34373) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:25.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:24 gibba003 bash[32348]: cluster 2021-03-10T17:44:23.472771+0000 mgr.gibba043.dnkmem (mgr.34373) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:26 gibba043 bash[24019]: cluster 2021-03-10T17:44:25.474247+0000 mgr.gibba043.dnkmem (mgr.34373) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:26 gibba003 bash[31385]: cluster 2021-03-10T17:44:25.474247+0000 mgr.gibba043.dnkmem (mgr.34373) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:26 gibba003 bash[32348]: cluster 2021-03-10T17:44:25.474247+0000 mgr.gibba043.dnkmem (mgr.34373) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:28 gibba003 bash[31385]: cluster 2021-03-10T17:44:27.475816+0000 mgr.gibba043.dnkmem (mgr.34373) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:28 gibba003 bash[32348]: cluster 2021-03-10T17:44:27.475816+0000 mgr.gibba043.dnkmem (mgr.34373) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:28 gibba043 bash[24019]: cluster 2021-03-10T17:44:27.475816+0000 mgr.gibba043.dnkmem (mgr.34373) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:30 gibba003 bash[31385]: cluster 2021-03-10T17:44:29.477277+0000 mgr.gibba043.dnkmem (mgr.34373) 12299 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:30 gibba003 bash[32348]: cluster 2021-03-10T17:44:29.477277+0000 mgr.gibba043.dnkmem (mgr.34373) 12299 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:30 gibba043 bash[24019]: cluster 2021-03-10T17:44:29.477277+0000 mgr.gibba043.dnkmem (mgr.34373) 12299 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:33.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:32 gibba003 bash[31385]: cluster 2021-03-10T17:44:31.478165+0000 mgr.gibba043.dnkmem (mgr.34373) 12300 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:33.192 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:32 gibba003 bash[32348]: cluster 2021-03-10T17:44:31.478165+0000 mgr.gibba043.dnkmem (mgr.34373) 12300 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:33.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:32 gibba043 bash[24019]: cluster 2021-03-10T17:44:31.478165+0000 mgr.gibba043.dnkmem (mgr.34373) 12300 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:33.281 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:44:33.508 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:44:33.509 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:44:33.509 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:44:33.509 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:44:33.510 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:44:33.510 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:44:33.510 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:44:33.510 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:44:33.511 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:44:33.511 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:44:33.511 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:44:33.511 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:44:33.511 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:44:33.512 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:44:33.512 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:44:33.512 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:44:33.512 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:44:33.512 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:44:33.513 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:44:33.513 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:44:33.513 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:44:33.760 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:44:33.761 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:44:33.761 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:33.761 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:44:33.761 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:44:33.762 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:33.762 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:44:33.762 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:44:33.762 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:44:33.762 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:44:33.763 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:44:33.763 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:44:33.763 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:44:33.763 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:44:33.764 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:44:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:33 gibba003 bash[31385]: audit 2021-03-10T17:44:33.269816+0000 mgr.gibba043.dnkmem (mgr.34373) 12301 : audit [DBG] from='client.52293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:34.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:33 gibba003 bash[31385]: audit 2021-03-10T17:44:33.758909+0000 mon.a (mon.0) 2418 : audit [DBG] from='client.? 172.21.2.103:0/684413525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:34.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:33 gibba003 bash[32348]: audit 2021-03-10T17:44:33.269816+0000 mgr.gibba043.dnkmem (mgr.34373) 12301 : audit [DBG] from='client.52293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:34.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:33 gibba003 bash[32348]: audit 2021-03-10T17:44:33.758909+0000 mon.a (mon.0) 2418 : audit [DBG] from='client.? 172.21.2.103:0/684413525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:33 gibba043 bash[24019]: audit 2021-03-10T17:44:33.269816+0000 mgr.gibba043.dnkmem (mgr.34373) 12301 : audit [DBG] from='client.52293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:34.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:33 gibba043 bash[24019]: audit 2021-03-10T17:44:33.758909+0000 mon.a (mon.0) 2418 : audit [DBG] from='client.? 172.21.2.103:0/684413525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:35.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:34 gibba003 bash[31385]: cluster 2021-03-10T17:44:33.479705+0000 mgr.gibba043.dnkmem (mgr.34373) 12302 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:34 gibba003 bash[31385]: audit 2021-03-10T17:44:33.493971+0000 mgr.gibba043.dnkmem (mgr.34373) 12303 : audit [DBG] from='client.62290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:35.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:34 gibba003 bash[31385]: cephadm 2021-03-10T17:44:33.531699+0000 mgr.gibba043.dnkmem (mgr.34373) 12304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:35.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:34 gibba003 bash[32348]: cluster 2021-03-10T17:44:33.479705+0000 mgr.gibba043.dnkmem (mgr.34373) 12302 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:34 gibba003 bash[32348]: audit 2021-03-10T17:44:33.493971+0000 mgr.gibba043.dnkmem (mgr.34373) 12303 : audit [DBG] from='client.62290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:35.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:34 gibba003 bash[32348]: cephadm 2021-03-10T17:44:33.531699+0000 mgr.gibba043.dnkmem (mgr.34373) 12304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:34 gibba043 bash[24019]: cluster 2021-03-10T17:44:33.479705+0000 mgr.gibba043.dnkmem (mgr.34373) 12302 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:34 gibba043 bash[24019]: audit 2021-03-10T17:44:33.493971+0000 mgr.gibba043.dnkmem (mgr.34373) 12303 : audit [DBG] from='client.62290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:35.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:34 gibba043 bash[24019]: cephadm 2021-03-10T17:44:33.531699+0000 mgr.gibba043.dnkmem (mgr.34373) 12304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:37.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:36 gibba003 bash[31385]: cluster 2021-03-10T17:44:35.480977+0000 mgr.gibba043.dnkmem (mgr.34373) 12305 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:36 gibba003 bash[32348]: cluster 2021-03-10T17:44:35.480977+0000 mgr.gibba043.dnkmem (mgr.34373) 12305 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:36 gibba043 bash[24019]: cluster 2021-03-10T17:44:35.480977+0000 mgr.gibba043.dnkmem (mgr.34373) 12305 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:38 gibba003 bash[31385]: cluster 2021-03-10T17:44:37.482468+0000 mgr.gibba043.dnkmem (mgr.34373) 12306 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:38 gibba003 bash[32348]: cluster 2021-03-10T17:44:37.482468+0000 mgr.gibba043.dnkmem (mgr.34373) 12306 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:38 gibba043 bash[24019]: cluster 2021-03-10T17:44:37.482468+0000 mgr.gibba043.dnkmem (mgr.34373) 12306 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:40 gibba003 bash[31385]: cluster 2021-03-10T17:44:39.484145+0000 mgr.gibba043.dnkmem (mgr.34373) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:40 gibba003 bash[32348]: cluster 2021-03-10T17:44:39.484145+0000 mgr.gibba043.dnkmem (mgr.34373) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:40 gibba043 bash[24019]: cluster 2021-03-10T17:44:39.484145+0000 mgr.gibba043.dnkmem (mgr.34373) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:42 gibba003 bash[31385]: cluster 2021-03-10T17:44:41.484834+0000 mgr.gibba043.dnkmem (mgr.34373) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:42 gibba003 bash[32348]: cluster 2021-03-10T17:44:41.484834+0000 mgr.gibba043.dnkmem (mgr.34373) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:42 gibba043 bash[24019]: cluster 2021-03-10T17:44:41.484834+0000 mgr.gibba043.dnkmem (mgr.34373) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:45.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:44 gibba003 bash[31385]: cluster 2021-03-10T17:44:43.486337+0000 mgr.gibba043.dnkmem (mgr.34373) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:45.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:44 gibba003 bash[32348]: cluster 2021-03-10T17:44:43.486337+0000 mgr.gibba043.dnkmem (mgr.34373) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:45.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:44 gibba043 bash[24019]: cluster 2021-03-10T17:44:43.486337+0000 mgr.gibba043.dnkmem (mgr.34373) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:46 gibba003 bash[31385]: cluster 2021-03-10T17:44:45.487527+0000 mgr.gibba043.dnkmem (mgr.34373) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:46 gibba003 bash[32348]: cluster 2021-03-10T17:44:45.487527+0000 mgr.gibba043.dnkmem (mgr.34373) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:46 gibba043 bash[24019]: cluster 2021-03-10T17:44:45.487527+0000 mgr.gibba043.dnkmem (mgr.34373) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:49.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:48 gibba003 bash[31385]: cluster 2021-03-10T17:44:47.488968+0000 mgr.gibba043.dnkmem (mgr.34373) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:49.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:48 gibba003 bash[32348]: cluster 2021-03-10T17:44:47.488968+0000 mgr.gibba043.dnkmem (mgr.34373) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:49.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:48 gibba043 bash[24019]: cluster 2021-03-10T17:44:47.488968+0000 mgr.gibba043.dnkmem (mgr.34373) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:49 gibba003 bash[31385]: cephadm 2021-03-10T17:44:48.547633+0000 mgr.gibba043.dnkmem (mgr.34373) 12312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:50.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:49 gibba003 bash[32348]: cephadm 2021-03-10T17:44:48.547633+0000 mgr.gibba043.dnkmem (mgr.34373) 12312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:50.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:49 gibba043 bash[24019]: cephadm 2021-03-10T17:44:48.547633+0000 mgr.gibba043.dnkmem (mgr.34373) 12312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:44:51.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:50 gibba003 bash[31385]: cluster 2021-03-10T17:44:49.490477+0000 mgr.gibba043.dnkmem (mgr.34373) 12313 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:51.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:50 gibba003 bash[32348]: cluster 2021-03-10T17:44:49.490477+0000 mgr.gibba043.dnkmem (mgr.34373) 12313 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:51.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:50 gibba043 bash[24019]: cluster 2021-03-10T17:44:49.490477+0000 mgr.gibba043.dnkmem (mgr.34373) 12313 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:53.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:52 gibba003 bash[31385]: cluster 2021-03-10T17:44:51.492445+0000 mgr.gibba043.dnkmem (mgr.34373) 12314 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:53.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:52 gibba003 bash[32348]: cluster 2021-03-10T17:44:51.492445+0000 mgr.gibba043.dnkmem (mgr.34373) 12314 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:53.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:52 gibba043 bash[24019]: cluster 2021-03-10T17:44:51.492445+0000 mgr.gibba043.dnkmem (mgr.34373) 12314 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:55.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:54 gibba003 bash[31385]: cluster 2021-03-10T17:44:53.493806+0000 mgr.gibba043.dnkmem (mgr.34373) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:55.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:54 gibba003 bash[32348]: cluster 2021-03-10T17:44:53.493806+0000 mgr.gibba043.dnkmem (mgr.34373) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:55.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:54 gibba043 bash[24019]: cluster 2021-03-10T17:44:53.493806+0000 mgr.gibba043.dnkmem (mgr.34373) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:57.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:56 gibba003 bash[31385]: cluster 2021-03-10T17:44:55.495305+0000 mgr.gibba043.dnkmem (mgr.34373) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:57.194 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:56 gibba003 bash[32348]: cluster 2021-03-10T17:44:55.495305+0000 mgr.gibba043.dnkmem (mgr.34373) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:57.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:56 gibba043 bash[24019]: cluster 2021-03-10T17:44:55.495305+0000 mgr.gibba043.dnkmem (mgr.34373) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:59.192 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:44:58 gibba003 bash[31385]: cluster 2021-03-10T17:44:57.496880+0000 mgr.gibba043.dnkmem (mgr.34373) 12317 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:59.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:44:58 gibba003 bash[32348]: cluster 2021-03-10T17:44:57.496880+0000 mgr.gibba043.dnkmem (mgr.34373) 12317 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:59.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:44:58 gibba043 bash[24019]: cluster 2021-03-10T17:44:57.496880+0000 mgr.gibba043.dnkmem (mgr.34373) 12317 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.187 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:00 gibba003 bash[31385]: cluster 2021-03-10T17:44:59.498805+0000 mgr.gibba043.dnkmem (mgr.34373) 12318 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.188 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:00 gibba003 bash[32348]: cluster 2021-03-10T17:44:59.498805+0000 mgr.gibba043.dnkmem (mgr.34373) 12318 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:00 gibba043 bash[24019]: cluster 2021-03-10T17:44:59.498805+0000 mgr.gibba043.dnkmem (mgr.34373) 12318 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:03.193 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:02 gibba003 bash[31385]: cluster 2021-03-10T17:45:01.499590+0000 mgr.gibba043.dnkmem (mgr.34373) 12319 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:03.193 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:02 gibba003 bash[32348]: cluster 2021-03-10T17:45:01.499590+0000 mgr.gibba043.dnkmem (mgr.34373) 12319 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:03.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:02 gibba043 bash[24019]: cluster 2021-03-10T17:45:01.499590+0000 mgr.gibba043.dnkmem (mgr.34373) 12319 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:04.002 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:45:04.258 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:45:04.259 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:45:04.259 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:45:04.259 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:45:04.260 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:45:04.260 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:45:04.260 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:45:04.260 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:45:04.260 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:45:04.261 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:45:04.261 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:45:04.261 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:45:04.261 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:45:04.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:45:04.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:45:04.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:45:04.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:45:04.262 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:45:04.263 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:45:04.263 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:45:04.263 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:45:04.508 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:45:04.508 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:45:04.509 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:04.509 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:45:04.509 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:45:04.509 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:04.510 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:45:04.510 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:45:04.510 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:45:04.510 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:45:04.510 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:45:04.511 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:45:04.511 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:45:04.511 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:45:04.511 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:45:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:04 gibba043 bash[24019]: cluster 2021-03-10T17:45:03.500832+0000 mgr.gibba043.dnkmem (mgr.34373) 12320 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:05.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:04 gibba043 bash[24019]: cephadm 2021-03-10T17:45:03.563767+0000 mgr.gibba043.dnkmem (mgr.34373) 12321 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:04 gibba043 bash[24019]: audit 2021-03-10T17:45:03.991770+0000 mgr.gibba043.dnkmem (mgr.34373) 12322 : audit [DBG] from='client.52311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:04 gibba043 bash[24019]: audit 2021-03-10T17:45:04.214887+0000 mgr.gibba043.dnkmem (mgr.34373) 12323 : audit [DBG] from='client.52317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:05.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:04 gibba043 bash[24019]: audit 2021-03-10T17:45:04.506827+0000 mon.c (mon.1) 3163 : audit [DBG] from='client.? 172.21.2.103:0/4137632922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:05.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[31385]: cluster 2021-03-10T17:45:03.500832+0000 mgr.gibba043.dnkmem (mgr.34373) 12320 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[31385]: cephadm 2021-03-10T17:45:03.563767+0000 mgr.gibba043.dnkmem (mgr.34373) 12321 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[31385]: audit 2021-03-10T17:45:03.991770+0000 mgr.gibba043.dnkmem (mgr.34373) 12322 : audit [DBG] from='client.52311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:05.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[31385]: audit 2021-03-10T17:45:04.214887+0000 mgr.gibba043.dnkmem (mgr.34373) 12323 : audit [DBG] from='client.52317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:05.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[31385]: audit 2021-03-10T17:45:04.506827+0000 mon.c (mon.1) 3163 : audit [DBG] from='client.? 172.21.2.103:0/4137632922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[32348]: cluster 2021-03-10T17:45:03.500832+0000 mgr.gibba043.dnkmem (mgr.34373) 12320 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[32348]: cephadm 2021-03-10T17:45:03.563767+0000 mgr.gibba043.dnkmem (mgr.34373) 12321 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:05.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[32348]: audit 2021-03-10T17:45:03.991770+0000 mgr.gibba043.dnkmem (mgr.34373) 12322 : audit [DBG] from='client.52311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[32348]: audit 2021-03-10T17:45:04.214887+0000 mgr.gibba043.dnkmem (mgr.34373) 12323 : audit [DBG] from='client.52317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:05.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:04 gibba003 bash[32348]: audit 2021-03-10T17:45:04.506827+0000 mon.c (mon.1) 3163 : audit [DBG] from='client.? 172.21.2.103:0/4137632922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:07.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:06 gibba043 bash[24019]: cluster 2021-03-10T17:45:05.502230+0000 mgr.gibba043.dnkmem (mgr.34373) 12324 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:06 gibba003 bash[31385]: cluster 2021-03-10T17:45:05.502230+0000 mgr.gibba043.dnkmem (mgr.34373) 12324 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:06 gibba003 bash[32348]: cluster 2021-03-10T17:45:05.502230+0000 mgr.gibba043.dnkmem (mgr.34373) 12324 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:09.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:08 gibba043 bash[24019]: cluster 2021-03-10T17:45:07.503869+0000 mgr.gibba043.dnkmem (mgr.34373) 12325 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:09.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:08 gibba003 bash[31385]: cluster 2021-03-10T17:45:07.503869+0000 mgr.gibba043.dnkmem (mgr.34373) 12325 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:09.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:08 gibba003 bash[32348]: cluster 2021-03-10T17:45:07.503869+0000 mgr.gibba043.dnkmem (mgr.34373) 12325 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:11.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:10 gibba043 bash[24019]: cluster 2021-03-10T17:45:09.505447+0000 mgr.gibba043.dnkmem (mgr.34373) 12326 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:11.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:10 gibba003 bash[31385]: cluster 2021-03-10T17:45:09.505447+0000 mgr.gibba043.dnkmem (mgr.34373) 12326 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:11.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:10 gibba003 bash[32348]: cluster 2021-03-10T17:45:09.505447+0000 mgr.gibba043.dnkmem (mgr.34373) 12326 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:13.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:12 gibba043 bash[24019]: cluster 2021-03-10T17:45:11.506365+0000 mgr.gibba043.dnkmem (mgr.34373) 12327 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:13.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:12 gibba003 bash[31385]: cluster 2021-03-10T17:45:11.506365+0000 mgr.gibba043.dnkmem (mgr.34373) 12327 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:13.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:12 gibba003 bash[32348]: cluster 2021-03-10T17:45:11.506365+0000 mgr.gibba043.dnkmem (mgr.34373) 12327 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: cluster 2021-03-10T17:45:13.507916+0000 mgr.gibba043.dnkmem (mgr.34373) 12328 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.230326+0000 mon.c (mon.1) 3164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:15.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.231408+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.484944+0000 mon.c (mon.1) 3165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.486045+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.902300+0000 mon.c (mon.1) 3166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:45:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.903234+0000 mon.c (mon.1) 3167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.903476+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:45:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.904129+0000 mon.c (mon.1) 3168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:45:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.904650+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.905284+0000 mon.c (mon.1) 3169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.905452+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:45:15.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:14 gibba043 bash[24019]: audit 2021-03-10T17:45:14.906412+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: cluster 2021-03-10T17:45:13.507916+0000 mgr.gibba043.dnkmem (mgr.34373) 12328 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.230326+0000 mon.c (mon.1) 3164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:15.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.231408+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.484944+0000 mon.c (mon.1) 3165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.486045+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.902300+0000 mon.c (mon.1) 3166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:45:15.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.903234+0000 mon.c (mon.1) 3167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.903476+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:45:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.904129+0000 mon.c (mon.1) 3168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:45:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.904650+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.905284+0000 mon.c (mon.1) 3169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.905452+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:45:15.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[31385]: audit 2021-03-10T17:45:14.906412+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: cluster 2021-03-10T17:45:13.507916+0000 mgr.gibba043.dnkmem (mgr.34373) 12328 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:15.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.230326+0000 mon.c (mon.1) 3164 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.231408+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.484944+0000 mon.c (mon.1) 3165 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.486045+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.902300+0000 mon.c (mon.1) 3166 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:45:15.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.903234+0000 mon.c (mon.1) 3167 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.903476+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:45:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.904129+0000 mon.c (mon.1) 3168 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:45:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.904650+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.905284+0000 mon.c (mon.1) 3169 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.905452+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:45:15.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:14 gibba003 bash[32348]: audit 2021-03-10T17:45:14.906412+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:17.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:16 gibba043 bash[24019]: cluster 2021-03-10T17:45:15.509258+0000 mgr.gibba043.dnkmem (mgr.34373) 12329 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:17.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:16 gibba003 bash[31385]: cluster 2021-03-10T17:45:15.509258+0000 mgr.gibba043.dnkmem (mgr.34373) 12329 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:17.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:16 gibba003 bash[32348]: cluster 2021-03-10T17:45:15.509258+0000 mgr.gibba043.dnkmem (mgr.34373) 12329 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:19.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: cluster 2021-03-10T17:45:17.510925+0000 mgr.gibba043.dnkmem (mgr.34373) 12330 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.814051+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:45:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.817740+0000 mon.c (mon.1) 3170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.819746+0000 mon.c (mon.1) 3171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.821088+0000 mon.c (mon.1) 3172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.822840+0000 mon.c (mon.1) 3173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.825969+0000 mon.c (mon.1) 3174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:19 gibba043 bash[24019]: audit 2021-03-10T17:45:18.827813+0000 mon.c (mon.1) 3175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: cluster 2021-03-10T17:45:17.510925+0000 mgr.gibba043.dnkmem (mgr.34373) 12330 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.814051+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:45:19.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.817740+0000 mon.c (mon.1) 3170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.819746+0000 mon.c (mon.1) 3171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.821088+0000 mon.c (mon.1) 3172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.822840+0000 mon.c (mon.1) 3173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.825969+0000 mon.c (mon.1) 3174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[31385]: audit 2021-03-10T17:45:18.827813+0000 mon.c (mon.1) 3175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: cluster 2021-03-10T17:45:17.510925+0000 mgr.gibba043.dnkmem (mgr.34373) 12330 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.814051+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:45:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.817740+0000 mon.c (mon.1) 3170 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:19.445 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.819746+0000 mon.c (mon.1) 3171 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.821088+0000 mon.c (mon.1) 3172 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.822840+0000 mon.c (mon.1) 3173 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.825969+0000 mon.c (mon.1) 3174 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:19.446 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:19 gibba003 bash[32348]: audit 2021-03-10T17:45:18.827813+0000 mon.c (mon.1) 3175 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:20.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.580550+0000 mgr.gibba043.dnkmem (mgr.34373) 12331 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:45:20.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.582126+0000 mgr.gibba043.dnkmem (mgr.34373) 12332 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:45:20.274 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.815869+0000 mgr.gibba043.dnkmem (mgr.34373) 12333 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:20.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.818041+0000 mgr.gibba043.dnkmem (mgr.34373) 12334 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:20.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.819409+0000 mgr.gibba043.dnkmem (mgr.34373) 12335 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:20.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.819449+0000 mgr.gibba043.dnkmem (mgr.34373) 12336 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:20.275 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.821196+0000 mgr.gibba043.dnkmem (mgr.34373) 12337 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:20.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.821241+0000 mgr.gibba043.dnkmem (mgr.34373) 12338 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:20.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.822530+0000 mgr.gibba043.dnkmem (mgr.34373) 12339 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:20.276 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.824136+0000 mgr.gibba043.dnkmem (mgr.34373) 12340 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:20.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.824177+0000 mgr.gibba043.dnkmem (mgr.34373) 12341 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:20.277 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.825799+0000 mgr.gibba043.dnkmem (mgr.34373) 12342 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:20.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.826272+0000 mgr.gibba043.dnkmem (mgr.34373) 12343 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:20.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.827427+0000 mgr.gibba043.dnkmem (mgr.34373) 12344 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:20.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.827472+0000 mgr.gibba043.dnkmem (mgr.34373) 12345 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:20.278 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:20 gibba043 bash[24019]: cephadm 2021-03-10T17:45:18.827601+0000 mgr.gibba043.dnkmem (mgr.34373) 12346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.580550+0000 mgr.gibba043.dnkmem (mgr.34373) 12331 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:45:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.582126+0000 mgr.gibba043.dnkmem (mgr.34373) 12332 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:45:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.815869+0000 mgr.gibba043.dnkmem (mgr.34373) 12333 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.818041+0000 mgr.gibba043.dnkmem (mgr.34373) 12334 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.819409+0000 mgr.gibba043.dnkmem (mgr.34373) 12335 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.819449+0000 mgr.gibba043.dnkmem (mgr.34373) 12336 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.821196+0000 mgr.gibba043.dnkmem (mgr.34373) 12337 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.821241+0000 mgr.gibba043.dnkmem (mgr.34373) 12338 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.822530+0000 mgr.gibba043.dnkmem (mgr.34373) 12339 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.824136+0000 mgr.gibba043.dnkmem (mgr.34373) 12340 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.824177+0000 mgr.gibba043.dnkmem (mgr.34373) 12341 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.825799+0000 mgr.gibba043.dnkmem (mgr.34373) 12342 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.826272+0000 mgr.gibba043.dnkmem (mgr.34373) 12343 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.827427+0000 mgr.gibba043.dnkmem (mgr.34373) 12344 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.827472+0000 mgr.gibba043.dnkmem (mgr.34373) 12345 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:20.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[31385]: cephadm 2021-03-10T17:45:18.827601+0000 mgr.gibba043.dnkmem (mgr.34373) 12346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:20.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.580550+0000 mgr.gibba043.dnkmem (mgr.34373) 12331 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:45:20.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.582126+0000 mgr.gibba043.dnkmem (mgr.34373) 12332 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:45:20.447 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.815869+0000 mgr.gibba043.dnkmem (mgr.34373) 12333 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:20.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.818041+0000 mgr.gibba043.dnkmem (mgr.34373) 12334 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:20.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.819409+0000 mgr.gibba043.dnkmem (mgr.34373) 12335 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:20.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.819449+0000 mgr.gibba043.dnkmem (mgr.34373) 12336 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:20.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.821196+0000 mgr.gibba043.dnkmem (mgr.34373) 12337 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:20.448 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.821241+0000 mgr.gibba043.dnkmem (mgr.34373) 12338 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.822530+0000 mgr.gibba043.dnkmem (mgr.34373) 12339 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.824136+0000 mgr.gibba043.dnkmem (mgr.34373) 12340 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.824177+0000 mgr.gibba043.dnkmem (mgr.34373) 12341 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.825799+0000 mgr.gibba043.dnkmem (mgr.34373) 12342 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.826272+0000 mgr.gibba043.dnkmem (mgr.34373) 12343 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.827427+0000 mgr.gibba043.dnkmem (mgr.34373) 12344 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.827472+0000 mgr.gibba043.dnkmem (mgr.34373) 12345 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:20 gibba003 bash[32348]: cephadm 2021-03-10T17:45:18.827601+0000 mgr.gibba043.dnkmem (mgr.34373) 12346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:21.273 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:21 gibba043 bash[24019]: cluster 2021-03-10T17:45:19.512459+0000 mgr.gibba043.dnkmem (mgr.34373) 12347 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:21.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:21 gibba003 bash[32348]: cluster 2021-03-10T17:45:19.512459+0000 mgr.gibba043.dnkmem (mgr.34373) 12347 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:21 gibba003 bash[31385]: cluster 2021-03-10T17:45:19.512459+0000 mgr.gibba043.dnkmem (mgr.34373) 12347 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:23.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:23 gibba003 bash[31385]: cluster 2021-03-10T17:45:21.513264+0000 mgr.gibba043.dnkmem (mgr.34373) 12348 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:23.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:23 gibba003 bash[32348]: cluster 2021-03-10T17:45:21.513264+0000 mgr.gibba043.dnkmem (mgr.34373) 12348 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:23 gibba043 bash[24019]: cluster 2021-03-10T17:45:21.513264+0000 mgr.gibba043.dnkmem (mgr.34373) 12348 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:25 gibba003 bash[31385]: cluster 2021-03-10T17:45:23.514805+0000 mgr.gibba043.dnkmem (mgr.34373) 12349 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:25 gibba003 bash[32348]: cluster 2021-03-10T17:45:23.514805+0000 mgr.gibba043.dnkmem (mgr.34373) 12349 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:25 gibba043 bash[24019]: cluster 2021-03-10T17:45:23.514805+0000 mgr.gibba043.dnkmem (mgr.34373) 12349 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:27 gibba003 bash[31385]: cluster 2021-03-10T17:45:25.516385+0000 mgr.gibba043.dnkmem (mgr.34373) 12350 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:27 gibba003 bash[32348]: cluster 2021-03-10T17:45:25.516385+0000 mgr.gibba043.dnkmem (mgr.34373) 12350 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:27 gibba043 bash[24019]: cluster 2021-03-10T17:45:25.516385+0000 mgr.gibba043.dnkmem (mgr.34373) 12350 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:29.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:29 gibba003 bash[31385]: cluster 2021-03-10T17:45:27.517759+0000 mgr.gibba043.dnkmem (mgr.34373) 12351 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:29 gibba003 bash[32348]: cluster 2021-03-10T17:45:27.517759+0000 mgr.gibba043.dnkmem (mgr.34373) 12351 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:29 gibba043 bash[24019]: cluster 2021-03-10T17:45:27.517759+0000 mgr.gibba043.dnkmem (mgr.34373) 12351 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:31 gibba003 bash[32348]: cluster 2021-03-10T17:45:29.519558+0000 mgr.gibba043.dnkmem (mgr.34373) 12352 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:31.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:31 gibba003 bash[31385]: cluster 2021-03-10T17:45:29.519558+0000 mgr.gibba043.dnkmem (mgr.34373) 12352 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:31.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:31 gibba043 bash[24019]: cluster 2021-03-10T17:45:29.519558+0000 mgr.gibba043.dnkmem (mgr.34373) 12352 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:33.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:33 gibba003 bash[31385]: cluster 2021-03-10T17:45:31.520654+0000 mgr.gibba043.dnkmem (mgr.34373) 12353 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:33 gibba003 bash[32348]: cluster 2021-03-10T17:45:31.520654+0000 mgr.gibba043.dnkmem (mgr.34373) 12353 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:33 gibba043 bash[24019]: cluster 2021-03-10T17:45:31.520654+0000 mgr.gibba043.dnkmem (mgr.34373) 12353 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:34.750 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:45:34.976 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:45:34.977 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:45:34.977 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:45:34.977 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:45:34.978 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:45:34.978 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:45:34.978 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:45:34.978 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:45:34.979 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:45:34.979 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:45:34.979 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:45:34.979 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:45:34.979 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:45:34.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:45:34.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:45:34.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:45:34.980 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:45:34.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:45:34.981 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:45:34.981 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:45:34.981 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:45:35.229 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:45:35.229 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:45:35.230 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:35.230 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:45:35.230 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:45:35.230 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:35.231 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:45:35.231 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:45:35.231 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:45:35.231 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:45:35.231 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:45:35.232 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:45:35.232 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:45:35.232 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:45:35.232 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:45:35.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:35 gibba003 bash[31385]: cluster 2021-03-10T17:45:33.521917+0000 mgr.gibba043.dnkmem (mgr.34373) 12354 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:35.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:35 gibba003 bash[31385]: cephadm 2021-03-10T17:45:33.843537+0000 mgr.gibba043.dnkmem (mgr.34373) 12355 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:35 gibba003 bash[32348]: cluster 2021-03-10T17:45:33.521917+0000 mgr.gibba043.dnkmem (mgr.34373) 12354 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:35.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:35 gibba003 bash[32348]: cephadm 2021-03-10T17:45:33.843537+0000 mgr.gibba043.dnkmem (mgr.34373) 12355 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:35 gibba043 bash[24019]: cluster 2021-03-10T17:45:33.521917+0000 mgr.gibba043.dnkmem (mgr.34373) 12354 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:35 gibba043 bash[24019]: cephadm 2021-03-10T17:45:33.843537+0000 mgr.gibba043.dnkmem (mgr.34373) 12355 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:36.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:36 gibba003 bash[32348]: audit 2021-03-10T17:45:34.738422+0000 mgr.gibba043.dnkmem (mgr.34373) 12356 : audit [DBG] from='client.52329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:36.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:36 gibba003 bash[32348]: audit 2021-03-10T17:45:34.961810+0000 mgr.gibba043.dnkmem (mgr.34373) 12357 : audit [DBG] from='client.62326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:36.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:36 gibba003 bash[32348]: audit 2021-03-10T17:45:35.227821+0000 mon.a (mon.0) 2426 : audit [DBG] from='client.? 172.21.2.103:0/2916683155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:36.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:36 gibba003 bash[31385]: audit 2021-03-10T17:45:34.738422+0000 mgr.gibba043.dnkmem (mgr.34373) 12356 : audit [DBG] from='client.52329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:36 gibba003 bash[31385]: audit 2021-03-10T17:45:34.961810+0000 mgr.gibba043.dnkmem (mgr.34373) 12357 : audit [DBG] from='client.62326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:36.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:36 gibba003 bash[31385]: audit 2021-03-10T17:45:35.227821+0000 mon.a (mon.0) 2426 : audit [DBG] from='client.? 172.21.2.103:0/2916683155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:36.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:36 gibba043 bash[24019]: audit 2021-03-10T17:45:34.738422+0000 mgr.gibba043.dnkmem (mgr.34373) 12356 : audit [DBG] from='client.52329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:36.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:36 gibba043 bash[24019]: audit 2021-03-10T17:45:34.961810+0000 mgr.gibba043.dnkmem (mgr.34373) 12357 : audit [DBG] from='client.62326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:36.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:36 gibba043 bash[24019]: audit 2021-03-10T17:45:35.227821+0000 mon.a (mon.0) 2426 : audit [DBG] from='client.? 172.21.2.103:0/2916683155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:37.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:37 gibba003 bash[31385]: cluster 2021-03-10T17:45:35.523159+0000 mgr.gibba043.dnkmem (mgr.34373) 12358 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:37.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:37 gibba003 bash[32348]: cluster 2021-03-10T17:45:35.523159+0000 mgr.gibba043.dnkmem (mgr.34373) 12358 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:37.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:37 gibba043 bash[24019]: cluster 2021-03-10T17:45:35.523159+0000 mgr.gibba043.dnkmem (mgr.34373) 12358 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:39.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:39 gibba003 bash[31385]: cluster 2021-03-10T17:45:37.524588+0000 mgr.gibba043.dnkmem (mgr.34373) 12359 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:39.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:39 gibba003 bash[32348]: cluster 2021-03-10T17:45:37.524588+0000 mgr.gibba043.dnkmem (mgr.34373) 12359 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:39 gibba043 bash[24019]: cluster 2021-03-10T17:45:37.524588+0000 mgr.gibba043.dnkmem (mgr.34373) 12359 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:41.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:41 gibba003 bash[31385]: cluster 2021-03-10T17:45:39.526255+0000 mgr.gibba043.dnkmem (mgr.34373) 12360 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:41.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:41 gibba003 bash[32348]: cluster 2021-03-10T17:45:39.526255+0000 mgr.gibba043.dnkmem (mgr.34373) 12360 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:41.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:41 gibba043 bash[24019]: cluster 2021-03-10T17:45:39.526255+0000 mgr.gibba043.dnkmem (mgr.34373) 12360 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:43.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:43 gibba003 bash[31385]: cluster 2021-03-10T17:45:41.527164+0000 mgr.gibba043.dnkmem (mgr.34373) 12361 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:43.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:43 gibba003 bash[32348]: cluster 2021-03-10T17:45:41.527164+0000 mgr.gibba043.dnkmem (mgr.34373) 12361 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:43 gibba043 bash[24019]: cluster 2021-03-10T17:45:41.527164+0000 mgr.gibba043.dnkmem (mgr.34373) 12361 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:45.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:45 gibba003 bash[31385]: cluster 2021-03-10T17:45:43.528623+0000 mgr.gibba043.dnkmem (mgr.34373) 12362 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:45.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:45 gibba003 bash[32348]: cluster 2021-03-10T17:45:43.528623+0000 mgr.gibba043.dnkmem (mgr.34373) 12362 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:45 gibba043 bash[24019]: cluster 2021-03-10T17:45:43.528623+0000 mgr.gibba043.dnkmem (mgr.34373) 12362 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:47.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:47 gibba003 bash[31385]: cluster 2021-03-10T17:45:45.529993+0000 mgr.gibba043.dnkmem (mgr.34373) 12363 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:47.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:47 gibba003 bash[32348]: cluster 2021-03-10T17:45:45.529993+0000 mgr.gibba043.dnkmem (mgr.34373) 12363 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:47 gibba043 bash[24019]: cluster 2021-03-10T17:45:45.529993+0000 mgr.gibba043.dnkmem (mgr.34373) 12363 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:49.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:49 gibba003 bash[31385]: cluster 2021-03-10T17:45:47.531520+0000 mgr.gibba043.dnkmem (mgr.34373) 12364 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:49.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:49 gibba003 bash[32348]: cluster 2021-03-10T17:45:47.531520+0000 mgr.gibba043.dnkmem (mgr.34373) 12364 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:49 gibba043 bash[24019]: cluster 2021-03-10T17:45:47.531520+0000 mgr.gibba043.dnkmem (mgr.34373) 12364 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:50.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:50 gibba003 bash[31385]: cephadm 2021-03-10T17:45:48.859775+0000 mgr.gibba043.dnkmem (mgr.34373) 12365 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:50.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:50 gibba003 bash[32348]: cephadm 2021-03-10T17:45:48.859775+0000 mgr.gibba043.dnkmem (mgr.34373) 12365 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:50.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:50 gibba043 bash[24019]: cephadm 2021-03-10T17:45:48.859775+0000 mgr.gibba043.dnkmem (mgr.34373) 12365 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:45:51.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:51 gibba003 bash[32348]: cluster 2021-03-10T17:45:49.533178+0000 mgr.gibba043.dnkmem (mgr.34373) 12366 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:51.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:51 gibba003 bash[31385]: cluster 2021-03-10T17:45:49.533178+0000 mgr.gibba043.dnkmem (mgr.34373) 12366 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:51.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:51 gibba043 bash[24019]: cluster 2021-03-10T17:45:49.533178+0000 mgr.gibba043.dnkmem (mgr.34373) 12366 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:53.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:53 gibba003 bash[31385]: cluster 2021-03-10T17:45:51.534812+0000 mgr.gibba043.dnkmem (mgr.34373) 12367 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:53.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:53 gibba003 bash[32348]: cluster 2021-03-10T17:45:51.534812+0000 mgr.gibba043.dnkmem (mgr.34373) 12367 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:53.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:53 gibba043 bash[24019]: cluster 2021-03-10T17:45:51.534812+0000 mgr.gibba043.dnkmem (mgr.34373) 12367 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:55.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:55 gibba003 bash[31385]: cluster 2021-03-10T17:45:53.536377+0000 mgr.gibba043.dnkmem (mgr.34373) 12368 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:55.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:55 gibba003 bash[32348]: cluster 2021-03-10T17:45:53.536377+0000 mgr.gibba043.dnkmem (mgr.34373) 12368 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:55.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:55 gibba043 bash[24019]: cluster 2021-03-10T17:45:53.536377+0000 mgr.gibba043.dnkmem (mgr.34373) 12368 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:57 gibba003 bash[31385]: cluster 2021-03-10T17:45:55.537737+0000 mgr.gibba043.dnkmem (mgr.34373) 12369 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:57 gibba003 bash[32348]: cluster 2021-03-10T17:45:55.537737+0000 mgr.gibba043.dnkmem (mgr.34373) 12369 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:57 gibba043 bash[24019]: cluster 2021-03-10T17:45:55.537737+0000 mgr.gibba043.dnkmem (mgr.34373) 12369 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:59.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:45:59 gibba003 bash[31385]: cluster 2021-03-10T17:45:57.539252+0000 mgr.gibba043.dnkmem (mgr.34373) 12370 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:59.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:45:59 gibba003 bash[32348]: cluster 2021-03-10T17:45:57.539252+0000 mgr.gibba043.dnkmem (mgr.34373) 12370 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:59.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:45:59 gibba043 bash[24019]: cluster 2021-03-10T17:45:57.539252+0000 mgr.gibba043.dnkmem (mgr.34373) 12370 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:01.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:01 gibba003 bash[32348]: cluster 2021-03-10T17:45:59.540978+0000 mgr.gibba043.dnkmem (mgr.34373) 12371 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:01.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:01 gibba003 bash[31385]: cluster 2021-03-10T17:45:59.540978+0000 mgr.gibba043.dnkmem (mgr.34373) 12371 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:01.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:01 gibba043 bash[24019]: cluster 2021-03-10T17:45:59.540978+0000 mgr.gibba043.dnkmem (mgr.34373) 12371 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:03.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:03 gibba043 bash[24019]: cluster 2021-03-10T17:46:01.542366+0000 mgr.gibba043.dnkmem (mgr.34373) 12372 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:03.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:03 gibba003 bash[31385]: cluster 2021-03-10T17:46:01.542366+0000 mgr.gibba043.dnkmem (mgr.34373) 12372 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:03.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:03 gibba003 bash[32348]: cluster 2021-03-10T17:46:01.542366+0000 mgr.gibba043.dnkmem (mgr.34373) 12372 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:05.484 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:46:05.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:05 gibba043 bash[24019]: cluster 2021-03-10T17:46:03.543898+0000 mgr.gibba043.dnkmem (mgr.34373) 12373 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:05.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:05 gibba043 bash[24019]: cephadm 2021-03-10T17:46:03.864712+0000 mgr.gibba043.dnkmem (mgr.34373) 12374 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:05 gibba003 bash[31385]: cluster 2021-03-10T17:46:03.543898+0000 mgr.gibba043.dnkmem (mgr.34373) 12373 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:05.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:05 gibba003 bash[31385]: cephadm 2021-03-10T17:46:03.864712+0000 mgr.gibba043.dnkmem (mgr.34373) 12374 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:05 gibba003 bash[32348]: cluster 2021-03-10T17:46:03.543898+0000 mgr.gibba043.dnkmem (mgr.34373) 12373 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:05.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:05 gibba003 bash[32348]: cephadm 2021-03-10T17:46:03.864712+0000 mgr.gibba043.dnkmem (mgr.34373) 12374 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:05.715 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:46:05.719 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:46:05.719 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:46:05.720 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:46:05.720 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:46:05.720 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:46:05.721 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:46:05.721 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:46:05.725 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:46:05.725 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:46:05.725 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:46:05.726 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:46:05.726 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:46:05.727 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:46:05.727 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:46:05.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:46:05.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:46:05.728 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:46:05.730 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:46:05.730 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:46:05.731 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:46:05.964 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:46:05.965 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:46:05.965 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:05.965 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:46:05.966 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:46:05.966 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:05.966 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:46:05.966 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:46:05.967 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:46:05.967 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:46:05.967 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:46:05.967 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:46:05.968 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:46:05.968 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:46:05.968 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:46:06.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:06 gibba043 bash[24019]: audit 2021-03-10T17:46:05.963110+0000 mon.a (mon.0) 2427 : audit [DBG] from='client.? 172.21.2.103:0/629115286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:06.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:06 gibba003 bash[31385]: audit 2021-03-10T17:46:05.963110+0000 mon.a (mon.0) 2427 : audit [DBG] from='client.? 172.21.2.103:0/629115286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:06.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:06 gibba003 bash[32348]: audit 2021-03-10T17:46:05.963110+0000 mon.a (mon.0) 2427 : audit [DBG] from='client.? 172.21.2.103:0/629115286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:07 gibba043 bash[24019]: audit 2021-03-10T17:46:05.472786+0000 mgr.gibba043.dnkmem (mgr.34373) 12375 : audit [DBG] from='client.62338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:07 gibba043 bash[24019]: cluster 2021-03-10T17:46:05.545069+0000 mgr.gibba043.dnkmem (mgr.34373) 12376 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:07 gibba043 bash[24019]: audit 2021-03-10T17:46:05.700470+0000 mgr.gibba043.dnkmem (mgr.34373) 12377 : audit [DBG] from='client.62344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:07.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:07 gibba003 bash[31385]: audit 2021-03-10T17:46:05.472786+0000 mgr.gibba043.dnkmem (mgr.34373) 12375 : audit [DBG] from='client.62338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:07.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:07 gibba003 bash[31385]: cluster 2021-03-10T17:46:05.545069+0000 mgr.gibba043.dnkmem (mgr.34373) 12376 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.694 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:07 gibba003 bash[31385]: audit 2021-03-10T17:46:05.700470+0000 mgr.gibba043.dnkmem (mgr.34373) 12377 : audit [DBG] from='client.62344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:07.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:07 gibba003 bash[32348]: audit 2021-03-10T17:46:05.472786+0000 mgr.gibba043.dnkmem (mgr.34373) 12375 : audit [DBG] from='client.62338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:07.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:07 gibba003 bash[32348]: cluster 2021-03-10T17:46:05.545069+0000 mgr.gibba043.dnkmem (mgr.34373) 12376 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.695 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:07 gibba003 bash[32348]: audit 2021-03-10T17:46:05.700470+0000 mgr.gibba043.dnkmem (mgr.34373) 12377 : audit [DBG] from='client.62344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:09.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:09 gibba043 bash[24019]: cluster 2021-03-10T17:46:07.546558+0000 mgr.gibba043.dnkmem (mgr.34373) 12378 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:09 gibba003 bash[31385]: cluster 2021-03-10T17:46:07.546558+0000 mgr.gibba043.dnkmem (mgr.34373) 12378 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:09 gibba003 bash[32348]: cluster 2021-03-10T17:46:07.546558+0000 mgr.gibba043.dnkmem (mgr.34373) 12378 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:11.522 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:11 gibba043 bash[24019]: cluster 2021-03-10T17:46:09.548241+0000 mgr.gibba043.dnkmem (mgr.34373) 12379 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:11.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:11 gibba003 bash[31385]: cluster 2021-03-10T17:46:09.548241+0000 mgr.gibba043.dnkmem (mgr.34373) 12379 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:11.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:11 gibba003 bash[32348]: cluster 2021-03-10T17:46:09.548241+0000 mgr.gibba043.dnkmem (mgr.34373) 12379 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:13.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:13 gibba043 bash[24019]: cluster 2021-03-10T17:46:11.549209+0000 mgr.gibba043.dnkmem (mgr.34373) 12380 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:13.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:13 gibba003 bash[31385]: cluster 2021-03-10T17:46:11.549209+0000 mgr.gibba043.dnkmem (mgr.34373) 12380 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:13.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:13 gibba003 bash[32348]: cluster 2021-03-10T17:46:11.549209+0000 mgr.gibba043.dnkmem (mgr.34373) 12380 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[31385]: cluster 2021-03-10T17:46:13.550625+0000 mgr.gibba043.dnkmem (mgr.34373) 12381 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[31385]: audit 2021-03-10T17:46:14.237344+0000 mon.c (mon.1) 3176 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[31385]: audit 2021-03-10T17:46:14.238453+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[31385]: audit 2021-03-10T17:46:14.499190+0000 mon.c (mon.1) 3177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:14.943 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[31385]: audit 2021-03-10T17:46:14.500339+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[32348]: cluster 2021-03-10T17:46:13.550625+0000 mgr.gibba043.dnkmem (mgr.34373) 12381 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[32348]: audit 2021-03-10T17:46:14.237344+0000 mon.c (mon.1) 3176 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:14.944 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[32348]: audit 2021-03-10T17:46:14.238453+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[32348]: audit 2021-03-10T17:46:14.499190+0000 mon.c (mon.1) 3177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:14.945 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:14 gibba003 bash[32348]: audit 2021-03-10T17:46:14.500339+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:14 gibba043 bash[24019]: cluster 2021-03-10T17:46:13.550625+0000 mgr.gibba043.dnkmem (mgr.34373) 12381 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:14 gibba043 bash[24019]: audit 2021-03-10T17:46:14.237344+0000 mon.c (mon.1) 3176 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:15.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:14 gibba043 bash[24019]: audit 2021-03-10T17:46:14.238453+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:14 gibba043 bash[24019]: audit 2021-03-10T17:46:14.499190+0000 mon.c (mon.1) 3177 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:15.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:14 gibba043 bash[24019]: audit 2021-03-10T17:46:14.500339+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba043.dnkmem/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.912498+0000 mon.c (mon.1) 3178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:46:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.913196+0000 mon.c (mon.1) 3179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.944 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.913682+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:46:15.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.913895+0000 mon.c (mon.1) 3180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.914569+0000 mon.c (mon.1) 3181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:46:15.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.915277+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.945 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.916549+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.946 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[31385]: audit 2021-03-10T17:46:14.917368+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:46:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.912498+0000 mon.c (mon.1) 3178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:46:15.946 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.913196+0000 mon.c (mon.1) 3179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.913682+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:46:15.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.913895+0000 mon.c (mon.1) 3180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.914569+0000 mon.c (mon.1) 3181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:46:15.947 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.915277+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.916549+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:46:15.948 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:15 gibba003 bash[32348]: audit 2021-03-10T17:46:14.917368+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:46:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.912498+0000 mon.c (mon.1) 3178 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:46:16.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.913196+0000 mon.c (mon.1) 3179 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.913682+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:46:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.913895+0000 mon.c (mon.1) 3180 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:46:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.914569+0000 mon.c (mon.1) 3181 : audit [INF] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:46:16.024 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.915277+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.916549+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:46:16.025 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:15 gibba043 bash[24019]: audit 2021-03-10T17:46:14.917368+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:46:16.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:16 gibba003 bash[31385]: cluster 2021-03-10T17:46:15.552194+0000 mgr.gibba043.dnkmem (mgr.34373) 12382 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:16.943 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:16 gibba003 bash[32348]: cluster 2021-03-10T17:46:15.552194+0000 mgr.gibba043.dnkmem (mgr.34373) 12382 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:17.023 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:16 gibba043 bash[24019]: cluster 2021-03-10T17:46:15.552194+0000 mgr.gibba043.dnkmem (mgr.34373) 12382 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:18.942 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:18 gibba003 bash[31385]: cluster 2021-03-10T17:46:17.553658+0000 mgr.gibba043.dnkmem (mgr.34373) 12383 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:18.942 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:18 gibba003 bash[32348]: cluster 2021-03-10T17:46:17.553658+0000 mgr.gibba043.dnkmem (mgr.34373) 12383 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:19.022 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:18 gibba043 bash[24019]: cluster 2021-03-10T17:46:17.553658+0000 mgr.gibba043.dnkmem (mgr.34373) 12383 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:18.881487+0000 mgr.gibba043.dnkmem (mgr.34373) 12384 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:46:20.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:18.883047+0000 mgr.gibba043.dnkmem (mgr.34373) 12385 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:46:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.105205+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:46:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.106725+0000 mgr.gibba043.dnkmem (mgr.34373) 12386 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.108294+0000 mgr.gibba043.dnkmem (mgr.34373) 12387 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:20.444 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.108502+0000 mon.c (mon.1) 3182 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.109406+0000 mgr.gibba043.dnkmem (mgr.34373) 12388 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.109443+0000 mgr.gibba043.dnkmem (mgr.34373) 12389 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.109752+0000 mon.c (mon.1) 3183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.110690+0000 mgr.gibba043.dnkmem (mgr.34373) 12390 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:20.445 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.110726+0000 mgr.gibba043.dnkmem (mgr.34373) 12391 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.111024+0000 mon.c (mon.1) 3184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.112039+0000 mgr.gibba043.dnkmem (mgr.34373) 12392 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.112333+0000 mon.c (mon.1) 3185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.446 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.113317+0000 mgr.gibba043.dnkmem (mgr.34373) 12393 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:20.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.113353+0000 mgr.gibba043.dnkmem (mgr.34373) 12394 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:20.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.114611+0000 mgr.gibba043.dnkmem (mgr.34373) 12395 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:20.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.114921+0000 mgr.gibba043.dnkmem (mgr.34373) 12396 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:20.447 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.114985+0000 mon.c (mon.1) 3186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.116011+0000 mgr.gibba043.dnkmem (mgr.34373) 12397 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:20.448 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.116048+0000 mgr.gibba043.dnkmem (mgr.34373) 12398 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:18.881487+0000 mgr.gibba043.dnkmem (mgr.34373) 12384 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:46:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:18.883047+0000 mgr.gibba043.dnkmem (mgr.34373) 12385 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:46:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.105205+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:46:20.449 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.106725+0000 mgr.gibba043.dnkmem (mgr.34373) 12386 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.108294+0000 mgr.gibba043.dnkmem (mgr.34373) 12387 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.108502+0000 mon.c (mon.1) 3182 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.109406+0000 mgr.gibba043.dnkmem (mgr.34373) 12388 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.109443+0000 mgr.gibba043.dnkmem (mgr.34373) 12389 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:20.450 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.109752+0000 mon.c (mon.1) 3183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.110690+0000 mgr.gibba043.dnkmem (mgr.34373) 12390 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:20.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.110726+0000 mgr.gibba043.dnkmem (mgr.34373) 12391 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:20.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.111024+0000 mon.c (mon.1) 3184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.451 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.112039+0000 mgr.gibba043.dnkmem (mgr.34373) 12392 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:20.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.112333+0000 mon.c (mon.1) 3185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.113317+0000 mgr.gibba043.dnkmem (mgr.34373) 12393 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:20.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.113353+0000 mgr.gibba043.dnkmem (mgr.34373) 12394 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:20.452 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.114611+0000 mgr.gibba043.dnkmem (mgr.34373) 12395 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:20.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.114921+0000 mgr.gibba043.dnkmem (mgr.34373) 12396 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:20.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.114985+0000 mon.c (mon.1) 3186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.116011+0000 mgr.gibba043.dnkmem (mgr.34373) 12397 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:20.453 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.116048+0000 mgr.gibba043.dnkmem (mgr.34373) 12398 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:20.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: cephadm 2021-03-10T17:46:19.116159+0000 mgr.gibba043.dnkmem (mgr.34373) 12399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:20.454 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[31385]: audit 2021-03-10T17:46:19.116410+0000 mon.c (mon.1) 3187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.454 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: cephadm 2021-03-10T17:46:19.116159+0000 mgr.gibba043.dnkmem (mgr.34373) 12399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:20.455 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:20 gibba003 bash[32348]: audit 2021-03-10T17:46:19.116410+0000 mon.c (mon.1) 3187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:18.881487+0000 mgr.gibba043.dnkmem (mgr.34373) 12384 : cephadm [INF] Refreshing gibba003 facts 2021-03-10T17:46:20.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:18.883047+0000 mgr.gibba043.dnkmem (mgr.34373) 12385 : cephadm [INF] Refreshing gibba043 facts 2021-03-10T17:46:20.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.105205+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.34373 ' entity='mgr.gibba043.dnkmem' 2021-03-10T17:46:20.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.106725+0000 mgr.gibba043.dnkmem (mgr.34373) 12386 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:20.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.108294+0000 mgr.gibba043.dnkmem (mgr.34373) 12387 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:20.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.108502+0000 mon.c (mon.1) 3182 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:20.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.109406+0000 mgr.gibba043.dnkmem (mgr.34373) 12388 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:20.525 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.109443+0000 mgr.gibba043.dnkmem (mgr.34373) 12389 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:20.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.109752+0000 mon.c (mon.1) 3183 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.110690+0000 mgr.gibba043.dnkmem (mgr.34373) 12390 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:20.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.110726+0000 mgr.gibba043.dnkmem (mgr.34373) 12391 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:20.526 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.111024+0000 mon.c (mon.1) 3184 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.112039+0000 mgr.gibba043.dnkmem (mgr.34373) 12392 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:20.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.112333+0000 mon.c (mon.1) 3185 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.113317+0000 mgr.gibba043.dnkmem (mgr.34373) 12393 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:20.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.113353+0000 mgr.gibba043.dnkmem (mgr.34373) 12394 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:20.527 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.114611+0000 mgr.gibba043.dnkmem (mgr.34373) 12395 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:20.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.114921+0000 mgr.gibba043.dnkmem (mgr.34373) 12396 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:20.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.114985+0000 mon.c (mon.1) 3186 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:20.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.116011+0000 mgr.gibba043.dnkmem (mgr.34373) 12397 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:20.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.116048+0000 mgr.gibba043.dnkmem (mgr.34373) 12398 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:20.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: cephadm 2021-03-10T17:46:19.116159+0000 mgr.gibba043.dnkmem (mgr.34373) 12399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:20.529 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:20 gibba043 bash[24019]: audit 2021-03-10T17:46:19.116410+0000 mon.c (mon.1) 3187 : audit [DBG] from='mgr.34373 172.21.2.143:0/3962985401' entity='mgr.gibba043.dnkmem' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:21.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:21 gibba003 bash[31385]: cluster 2021-03-10T17:46:19.555307+0000 mgr.gibba043.dnkmem (mgr.34373) 12400 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:21.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:21 gibba003 bash[32348]: cluster 2021-03-10T17:46:19.555307+0000 mgr.gibba043.dnkmem (mgr.34373) 12400 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:21.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:21 gibba043 bash[24019]: cluster 2021-03-10T17:46:19.555307+0000 mgr.gibba043.dnkmem (mgr.34373) 12400 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:23.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:23 gibba003 bash[31385]: cluster 2021-03-10T17:46:21.557075+0000 mgr.gibba043.dnkmem (mgr.34373) 12401 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:23.444 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:23 gibba003 bash[32348]: cluster 2021-03-10T17:46:21.557075+0000 mgr.gibba043.dnkmem (mgr.34373) 12401 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:23.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:23 gibba043 bash[24019]: cluster 2021-03-10T17:46:21.557075+0000 mgr.gibba043.dnkmem (mgr.34373) 12401 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:25.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:25 gibba003 bash[31385]: cluster 2021-03-10T17:46:23.558757+0000 mgr.gibba043.dnkmem (mgr.34373) 12402 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:25.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:25 gibba003 bash[32348]: cluster 2021-03-10T17:46:23.558757+0000 mgr.gibba043.dnkmem (mgr.34373) 12402 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:25.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:25 gibba043 bash[24019]: cluster 2021-03-10T17:46:23.558757+0000 mgr.gibba043.dnkmem (mgr.34373) 12402 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:27 gibba003 bash[31385]: cluster 2021-03-10T17:46:25.560335+0000 mgr.gibba043.dnkmem (mgr.34373) 12403 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:27 gibba003 bash[32348]: cluster 2021-03-10T17:46:25.560335+0000 mgr.gibba043.dnkmem (mgr.34373) 12403 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:27 gibba043 bash[24019]: cluster 2021-03-10T17:46:25.560335+0000 mgr.gibba043.dnkmem (mgr.34373) 12403 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:29.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:29 gibba003 bash[31385]: cluster 2021-03-10T17:46:27.561964+0000 mgr.gibba043.dnkmem (mgr.34373) 12404 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:29.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:29 gibba003 bash[32348]: cluster 2021-03-10T17:46:27.561964+0000 mgr.gibba043.dnkmem (mgr.34373) 12404 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:29.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:29 gibba043 bash[24019]: cluster 2021-03-10T17:46:27.561964+0000 mgr.gibba043.dnkmem (mgr.34373) 12404 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:31.442 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:31 gibba003 bash[31385]: cluster 2021-03-10T17:46:29.563798+0000 mgr.gibba043.dnkmem (mgr.34373) 12405 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:31.442 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:31 gibba003 bash[32348]: cluster 2021-03-10T17:46:29.563798+0000 mgr.gibba043.dnkmem (mgr.34373) 12405 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:31.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:31 gibba043 bash[24019]: cluster 2021-03-10T17:46:29.563798+0000 mgr.gibba043.dnkmem (mgr.34373) 12405 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.443 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:33 gibba003 bash[31385]: cluster 2021-03-10T17:46:31.565299+0000 mgr.gibba043.dnkmem (mgr.34373) 12406 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.443 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:33 gibba003 bash[32348]: cluster 2021-03-10T17:46:31.565299+0000 mgr.gibba043.dnkmem (mgr.34373) 12406 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:33 gibba043 bash[24019]: cluster 2021-03-10T17:46:31.565299+0000 mgr.gibba043.dnkmem (mgr.34373) 12406 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:35.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:35 gibba043 bash[24019]: cluster 2021-03-10T17:46:33.566796+0000 mgr.gibba043.dnkmem (mgr.34373) 12407 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:35.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:35 gibba043 bash[24019]: cephadm 2021-03-10T17:46:34.132238+0000 mgr.gibba043.dnkmem (mgr.34373) 12408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:35 gibba003 bash[31385]: cluster 2021-03-10T17:46:33.566796+0000 mgr.gibba043.dnkmem (mgr.34373) 12407 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:35.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:35 gibba003 bash[31385]: cephadm 2021-03-10T17:46:34.132238+0000 mgr.gibba043.dnkmem (mgr.34373) 12408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:35.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:35 gibba003 bash[32348]: cluster 2021-03-10T17:46:33.566796+0000 mgr.gibba043.dnkmem (mgr.34373) 12407 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:35.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:35 gibba003 bash[32348]: cephadm 2021-03-10T17:46:34.132238+0000 mgr.gibba043.dnkmem (mgr.34373) 12408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba003.uvtpth'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba003.uvtpth']. 2021-03-10T17:46:36.207 INFO:teuthology.orchestra.run.gibba003.stdout:true 2021-03-10T17:46:36.435 INFO:teuthology.orchestra.run.gibba003.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:46:36.436 INFO:teuthology.orchestra.run.gibba003.stdout:alertmanager.a gibba003 running (3h) 6m ago 4h 0.21.0 prom/alertmanager c876f5897d7b 3766a55d6174 2021-03-10T17:46:36.436 INFO:teuthology.orchestra.run.gibba003.stdout:grafana.a gibba043 running (4h) 5m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c bc4083225ccd 2021-03-10T17:46:36.436 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.gibba043.dnkmem gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 154bd117b0e2 2021-03-10T17:46:36.436 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.x gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9cc1d7c3b4bd 2021-03-10T17:46:36.437 INFO:teuthology.orchestra.run.gibba003.stdout:mgr.y gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 53ffea2dbd22 2021-03-10T17:46:36.437 INFO:teuthology.orchestra.run.gibba003.stdout:mon.a gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01c3ec489599 2021-03-10T17:46:36.437 INFO:teuthology.orchestra.run.gibba003.stdout:mon.b gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d36cdf94328f 2021-03-10T17:46:36.437 INFO:teuthology.orchestra.run.gibba003.stdout:mon.c gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bc2a1df68b29 2021-03-10T17:46:36.438 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.a gibba003 running (4h) 6m ago 4h 1.1.2 prom/node-exporter c19ae228f069 09ef7847eaa6 2021-03-10T17:46:36.438 INFO:teuthology.orchestra.run.gibba003.stdout:node-exporter.b gibba043 running (4h) 5m ago 4h 1.1.2 prom/node-exporter c19ae228f069 e41dc542ba77 2021-03-10T17:46:36.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.0 gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 3b077f9f9b31 2021-03-10T17:46:36.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.1 gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 9907b8f6d972 2021-03-10T17:46:36.438 INFO:teuthology.orchestra.run.gibba003.stdout:osd.2 gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8afda6462315 2021-03-10T17:46:36.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.3 gibba003 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 27583868878e 2021-03-10T17:46:36.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.4 gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 18b8808cc7d0 2021-03-10T17:46:36.439 INFO:teuthology.orchestra.run.gibba003.stdout:osd.5 gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 81b5f6bb173b 2021-03-10T17:46:36.440 INFO:teuthology.orchestra.run.gibba003.stdout:osd.6 gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da bdb0e229ecb3 2021-03-10T17:46:36.440 INFO:teuthology.orchestra.run.gibba003.stdout:osd.7 gibba043 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 803cd1e4bf4d 2021-03-10T17:46:36.440 INFO:teuthology.orchestra.run.gibba003.stdout:prometheus.a gibba043 running (3h) 5m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 3030f53c03bc 2021-03-10T17:46:36.440 INFO:teuthology.orchestra.run.gibba003.stdout:rgw.r.z.gibba003.uvtpth gibba003 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:46:36.686 INFO:teuthology.orchestra.run.gibba003.stdout:{ 2021-03-10T17:46:36.687 INFO:teuthology.orchestra.run.gibba003.stdout: "mon": { 2021-03-10T17:46:36.687 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:36.687 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:46:36.687 INFO:teuthology.orchestra.run.gibba003.stdout: "mgr": { 2021-03-10T17:46:36.688 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:36.688 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:46:36.688 INFO:teuthology.orchestra.run.gibba003.stdout: "osd": { 2021-03-10T17:46:36.688 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:46:36.689 INFO:teuthology.orchestra.run.gibba003.stdout: }, 2021-03-10T17:46:36.689 INFO:teuthology.orchestra.run.gibba003.stdout: "mds": {}, 2021-03-10T17:46:36.689 INFO:teuthology.orchestra.run.gibba003.stdout: "overall": { 2021-03-10T17:46:36.689 INFO:teuthology.orchestra.run.gibba003.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:46:36.689 INFO:teuthology.orchestra.run.gibba003.stdout: } 2021-03-10T17:46:36.690 INFO:teuthology.orchestra.run.gibba003.stdout:} 2021-03-10T17:46:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:37 gibba043 bash[24019]: cluster 2021-03-10T17:46:35.568247+0000 mgr.gibba043.dnkmem (mgr.34373) 12409 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:37 gibba043 bash[24019]: audit 2021-03-10T17:46:36.195139+0000 mgr.gibba043.dnkmem (mgr.34373) 12410 : audit [DBG] from='client.52365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:37.524 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:37 gibba043 bash[24019]: audit 2021-03-10T17:46:36.685196+0000 mon.c (mon.1) 3188 : audit [DBG] from='client.? 172.21.2.103:0/4248513031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:37 gibba003 bash[31385]: cluster 2021-03-10T17:46:35.568247+0000 mgr.gibba043.dnkmem (mgr.34373) 12409 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:37 gibba003 bash[31385]: audit 2021-03-10T17:46:36.195139+0000 mgr.gibba043.dnkmem (mgr.34373) 12410 : audit [DBG] from='client.52365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:37.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:37 gibba003 bash[31385]: audit 2021-03-10T17:46:36.685196+0000 mon.c (mon.1) 3188 : audit [DBG] from='client.? 172.21.2.103:0/4248513031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:37 gibba003 bash[32348]: cluster 2021-03-10T17:46:35.568247+0000 mgr.gibba043.dnkmem (mgr.34373) 12409 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:37 gibba003 bash[32348]: audit 2021-03-10T17:46:36.195139+0000 mgr.gibba043.dnkmem (mgr.34373) 12410 : audit [DBG] from='client.52365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:37.694 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:37 gibba003 bash[32348]: audit 2021-03-10T17:46:36.685196+0000 mon.c (mon.1) 3188 : audit [DBG] from='client.? 172.21.2.103:0/4248513031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:38.528 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:38 gibba043 bash[24019]: audit 2021-03-10T17:46:36.420935+0000 mgr.gibba043.dnkmem (mgr.34373) 12411 : audit [DBG] from='client.52371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:38.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:38 gibba003 bash[31385]: audit 2021-03-10T17:46:36.420935+0000 mgr.gibba043.dnkmem (mgr.34373) 12411 : audit [DBG] from='client.52371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:38.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:38 gibba003 bash[32348]: audit 2021-03-10T17:46:36.420935+0000 mgr.gibba043.dnkmem (mgr.34373) 12411 : audit [DBG] from='client.52371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:39.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:39 gibba043 bash[24019]: cluster 2021-03-10T17:46:37.569718+0000 mgr.gibba043.dnkmem (mgr.34373) 12412 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:39.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:39 gibba003 bash[31385]: cluster 2021-03-10T17:46:37.569718+0000 mgr.gibba043.dnkmem (mgr.34373) 12412 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:39.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:39 gibba003 bash[32348]: cluster 2021-03-10T17:46:37.569718+0000 mgr.gibba043.dnkmem (mgr.34373) 12412 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:41.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:41 gibba043 bash[24019]: cluster 2021-03-10T17:46:39.571381+0000 mgr.gibba043.dnkmem (mgr.34373) 12413 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:41.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:41 gibba003 bash[31385]: cluster 2021-03-10T17:46:39.571381+0000 mgr.gibba043.dnkmem (mgr.34373) 12413 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:41.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:41 gibba003 bash[32348]: cluster 2021-03-10T17:46:39.571381+0000 mgr.gibba043.dnkmem (mgr.34373) 12413 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:43.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:43 gibba043 bash[24019]: cluster 2021-03-10T17:46:41.572909+0000 mgr.gibba043.dnkmem (mgr.34373) 12414 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:43.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:43 gibba003 bash[32348]: cluster 2021-03-10T17:46:41.572909+0000 mgr.gibba043.dnkmem (mgr.34373) 12414 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:43.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:43 gibba003 bash[31385]: cluster 2021-03-10T17:46:41.572909+0000 mgr.gibba043.dnkmem (mgr.34373) 12414 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:45 gibba043 bash[24019]: cluster 2021-03-10T17:46:43.574498+0000 mgr.gibba043.dnkmem (mgr.34373) 12415 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:45 gibba003 bash[31385]: cluster 2021-03-10T17:46:43.574498+0000 mgr.gibba043.dnkmem (mgr.34373) 12415 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:45 gibba003 bash[32348]: cluster 2021-03-10T17:46:43.574498+0000 mgr.gibba043.dnkmem (mgr.34373) 12415 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:47.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:47 gibba043 bash[24019]: cluster 2021-03-10T17:46:45.575851+0000 mgr.gibba043.dnkmem (mgr.34373) 12416 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:47.692 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:47 gibba003 bash[31385]: cluster 2021-03-10T17:46:45.575851+0000 mgr.gibba043.dnkmem (mgr.34373) 12416 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:47.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:47 gibba003 bash[32348]: cluster 2021-03-10T17:46:45.575851+0000 mgr.gibba043.dnkmem (mgr.34373) 12416 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:49.523 INFO:journalctl@ceph.mon.b.gibba043.stdout:Mar 10 17:46:49 gibba043 bash[24019]: cluster 2021-03-10T17:46:47.577441+0000 mgr.gibba043.dnkmem (mgr.34373) 12417 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:49.693 INFO:journalctl@ceph.mon.a.gibba003.stdout:Mar 10 17:46:49 gibba003 bash[31385]: cluster 2021-03-10T17:46:47.577441+0000 mgr.gibba043.dnkmem (mgr.34373) 12417 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:49.693 INFO:journalctl@ceph.mon.c.gibba003.stdout:Mar 10 17:46:49 gibba003 bash[32348]: cluster 2021-03-10T17:46:47.577441+0000 mgr.gibba043.dnkmem (mgr.34373) 12417 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 7.0 KiB data, 62 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:50.171 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-10T17:46:50.172 DEBUG:teuthology.task.console_log:Killing console logger for gibba003 2021-03-10T17:46:50.173 DEBUG:teuthology.task.console_log:Killing console logger for gibba043 2021-03-10T17:46:50.174 DEBUG:teuthology.exit:Finished running handlers